2024-04-26T20:59:22.200 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T20:59:22.201 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi --verbose --owner scheduled_rishabh@teuthology --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --archive /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675200 -- /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675200/orig.config.yaml 2024-04-26T20:59:22.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T20:59:22.334 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675200 branch: wip-rishabh-testing-20240426.111959 description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: null first_in_suite: false job_id: '7675200' kernel: flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240426.111959 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240426.111959 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 816 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 sleep_before_teardown: 0 subset: 166/512 suite: fs suite_branch: wip-rishabh-testing-20240426.111959 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 targets: smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGGL+E7xXSEaYHi58fTGLEpkfO4RSu+4kLRTLO7ZRcQOr6V87NiReo0Efnsg2jhubCvqjxoBxOqTqwGA9vr+2UA= smithi120.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJc8BBGWb5+55Y2vBOOlS6fUlzp+fTu/4cXIDxZgFLhXbTxWDnXf77eVBcDahl+kygf8wpE4/2qUL0kPfs3kamk= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/rishabh/src/git.ceph.com_ceph-c_wip-rishabh-testing-20240426.111959/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_19:30:57 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-04-26T20:59:22.334 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa; will attempt to use it 2024-04-26T20:59:22.335 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks 2024-04-26T20:59:22.335 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T20:59:22.337 INFO:teuthology.task.internal:Checking packages... 2024-04-26T20:59:22.360 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bc612ffb9c1d5bc27536bc917a705262a36d4387' 2024-04-26T20:59:22.360 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T20:59:22.360 INFO:teuthology.packaging:ref: None 2024-04-26T20:59:22.360 INFO:teuthology.packaging:tag: None 2024-04-26T20:59:22.360 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240426.111959 2024-04-26T20:59:22.360 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:59:22.360 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240426.111959 2024-04-26T20:59:22.609 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3306.gbc612ffb 2024-04-26T20:59:22.610 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T20:59:22.618 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T20:59:22.618 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T20:59:22.625 INFO:teuthology.task.internal:Saving configuration 2024-04-26T20:59:22.643 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T20:59:22.649 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T20:59:22.670 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675200', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 20:54:17.469975', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGGL+E7xXSEaYHi58fTGLEpkfO4RSu+4kLRTLO7ZRcQOr6V87NiReo0Efnsg2jhubCvqjxoBxOqTqwGA9vr+2UA='} 2024-04-26T20:59:22.690 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675200', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 20:54:17.468669', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJc8BBGWb5+55Y2vBOOlS6fUlzp+fTu/4cXIDxZgFLhXbTxWDnXf77eVBcDahl+kygf8wpE4/2qUL0kPfs3kamk='} 2024-04-26T20:59:22.690 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T20:59:22.696 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-04-26T20:59:22.697 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-04-26T20:59:22.697 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T20:59:22.766 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdbeebf9160>, signals=[15]) 2024-04-26T20:59:22.767 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T20:59:22.773 INFO:teuthology.task.internal:Opening connections... 2024-04-26T20:59:22.773 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2024-04-26T20:59:22.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:59:22.851 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi120.front.sepia.ceph.com 2024-04-26T20:59:22.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:59:22.930 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T20:59:22.937 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-04-26T20:59:22.955 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-04-26T20:59:22.955 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-04-26T20:59:23.011 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-04-26T20:59:23.011 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-04-26T20:59:23.012 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-04-26T20:59:23.012 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-04-26T20:59:23.012 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-04-26T20:59:23.012 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-04-26T20:59:23.012 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T20:59:23.012 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-04-26T20:59:23.012 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-04-26T20:59:23.012 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T20:59:23.012 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-04-26T20:59:23.012 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T20:59:23.012 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T20:59:23.012 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T20:59:23.013 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-04-26T20:59:23.029 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-04-26T20:59:23.047 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-04-26T20:59:23.047 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-04-26T20:59:23.103 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2024-04-26T20:59:23.103 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2024-04-26T20:59:23.103 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2024-04-26T20:59:23.103 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2024-04-26T20:59:23.103 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2024-04-26T20:59:23.103 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2024-04-26T20:59:23.103 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T20:59:23.104 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2024-04-26T20:59:23.104 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2024-04-26T20:59:23.104 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T20:59:23.104 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2024-04-26T20:59:23.104 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T20:59:23.104 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T20:59:23.104 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T20:59:23.104 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-04-26T20:59:23.130 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T20:59:23.139 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T20:59:23.145 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T20:59:23.145 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2024-04-26T20:59:23.147 DEBUG:teuthology.orchestra.run.smithi120:> test '!' -e /home/ubuntu/cephtest 2024-04-26T20:59:23.163 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T20:59:23.169 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T20:59:23.169 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2024-04-26T20:59:23.204 DEBUG:teuthology.orchestra.run.smithi120:> test -z $(ls -A /var/lib/ceph) 2024-04-26T20:59:23.306 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T20:59:23.359 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T20:59:23.373 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-26T20:59:23.374 INFO:teuthology.task.kernel:config {'host.a': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'host.b': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, timeout 300 2024-04-26T20:59:23.374 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T20:59:23.375 DEBUG:teuthology.orchestra.run.smithi120:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T20:59:23.390 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:59:23.391 DEBUG:teuthology.task.kernel:sha1 for host.a is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:59:23.391 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T20:59:23.391 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-04-26T20:59:23.392 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:59:23.392 DEBUG:teuthology.task.kernel:sha1 for host.b is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:59:23.392 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T20:59:23.392 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-04-26T20:59:23.447 INFO:teuthology.orchestra.run.smithi084.stdout:5.14.0-437.el9.x86_64 2024-04-26T20:59:23.447 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:59:23.448 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T20:59:23.448 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:59:23.452 INFO:teuthology.orchestra.run.smithi120.stdout:5.14.0-437.el9.x86_64 2024-04-26T20:59:23.452 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:59:23.452 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T20:59:23.452 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:59:23.667 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum upgrade -y linux-firmware 2024-04-26T20:59:23.673 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum upgrade -y linux-firmware 2024-04-26T20:59:26.196 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 8.6 MB/s | 8.0 MB 00:00 2024-04-26T20:59:26.363 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 8.2 MB/s | 8.0 MB 00:00 2024-04-26T20:59:28.055 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-04-26T20:59:29.239 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 10 MB/s | 19 MB 00:01 2024-04-26T20:59:32.106 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-04-26T20:59:33.272 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-04-26T20:59:33.465 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 16 kB 00:00 2024-04-26T20:59:34.881 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 16 kB 00:00 2024-04-26T20:59:35.408 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-26T20:59:36.102 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-04-26T20:59:40.416 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-26T20:59:41.148 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-26T20:59:42.390 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T20:59:42.391 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-04-26T20:59:42.391 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T20:59:42.503 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on host.b... 2024-04-26T20:59:42.504 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:59:42.850 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-26T20:59:42.851 DEBUG:teuthology.orchestra.run.smithi120:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-26T20:59:42.853 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi120.front.sepia.ceph.com to complete... 2024-04-26T20:59:43.202 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T20:59:43.203 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-04-26T20:59:43.203 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T20:59:43.314 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on host.a... 2024-04-26T20:59:43.314 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:59:43.566 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-26T20:59:43.566 DEBUG:teuthology.orchestra.run.smithi084:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-26T20:59:43.568 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi084.front.sepia.ceph.com to complete... 2024-04-26T21:00:13.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26 21:00:13 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-26T21:00:13.805 INFO:teuthology.orchestra.run.smithi120.stderr:FINISHED --2024-04-26 21:00:13-- 2024-04-26T21:00:13.805 INFO:teuthology.orchestra.run.smithi120.stderr:Total wall clock time: 31s 2024-04-26T21:00:13.805 INFO:teuthology.orchestra.run.smithi120.stderr:Downloaded: 1 files, 341M in 31s (11.2 MB/s) 2024-04-26T21:00:13.808 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on host.b... 2024-04-26T21:00:13.809 DEBUG:teuthology.orchestra.run.smithi120:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-26T21:00:15.915 INFO:teuthology.orchestra.run.smithi120.stdout:Verifying... ######################################## 2024-04-26T21:00:16.053 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing... ######################################## 2024-04-26T21:00:16.177 INFO:teuthology.orchestra.run.smithi120.stdout:Updating / installing... 2024-04-26T21:00:23.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26 21:00:23 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-26T21:00:23.497 INFO:teuthology.orchestra.run.smithi084.stderr:FINISHED --2024-04-26 21:00:23-- 2024-04-26T21:00:23.497 INFO:teuthology.orchestra.run.smithi084.stderr:Total wall clock time: 40s 2024-04-26T21:00:23.497 INFO:teuthology.orchestra.run.smithi084.stderr:Downloaded: 1 files, 341M in 39s (8.64 MB/s) 2024-04-26T21:00:23.500 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on host.a... 2024-04-26T21:00:23.501 DEBUG:teuthology.orchestra.run.smithi084:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-26T21:00:24.160 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-26T21:00:25.626 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying... ######################################## 2024-04-26T21:00:25.835 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing... ######################################## 2024-04-26T21:00:25.957 INFO:teuthology.orchestra.run.smithi084.stdout:Updating / installing... 2024-04-26T21:00:33.915 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-26T21:01:02.049 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi120.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-26T21:01:02.050 DEBUG:teuthology.orchestra.run.smithi120:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-26T21:01:02.142 INFO:teuthology.orchestra.run.smithi120.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:02.142 INFO:teuthology.orchestra.run.smithi120.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:02.142 INFO:teuthology.orchestra.run.smithi120.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:02.142 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-26T21:01:02.142 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-26T21:01:02.143 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-26T21:01:02.143 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-26T21:01:02.143 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-26T21:01:02.143 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-26T21:01:02.143 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T21:01:02.143 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T21:01:02.143 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T21:01:02.143 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T21:01:02.143 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T21:01:02.143 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T21:01:02.143 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T21:01:02.143 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-26T21:01:02.143 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T21:01:02.144 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T21:01:02.144 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T21:01:02.144 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T21:01:02.144 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T21:01:02.144 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T21:01:02.144 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T21:01:02.144 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T21:01:02.144 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T21:01:02.144 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T21:01:02.144 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T21:01:02.144 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T21:01:02.144 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-26T21:01:02.144 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-26T21:01:02.145 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-26T21:01:02.145 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T21:01:02.145 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-26T21:01:02.145 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T21:01:02.145 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T21:01:02.145 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T21:01:02.145 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-26T21:01:02.145 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T21:01:02.145 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T21:01:02.145 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T21:01:02.145 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-26T21:01:02.145 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T21:01:02.145 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T21:01:02.145 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T21:01:02.146 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T21:01:02.146 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T21:01:02.146 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T21:01:02.146 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T21:01:02.146 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T21:01:02.146 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T21:01:02.146 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T21:01:02.146 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T21:01:02.146 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T21:01:02.146 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T21:01:02.146 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T21:01:02.146 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T21:01:02.146 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T21:01:02.147 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T21:01:02.147 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T21:01:02.147 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T21:01:02.147 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T21:01:02.147 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T21:01:02.147 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T21:01:02.147 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T21:01:02.147 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T21:01:02.147 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T21:01:02.147 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T21:01:02.147 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T21:01:02.147 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T21:01:02.147 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T21:01:02.147 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T21:01:02.148 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T21:01:02.148 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T21:01:02.148 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T21:01:02.148 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T21:01:02.148 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T21:01:02.148 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T21:01:02.148 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T21:01:02.148 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T21:01:02.148 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T21:01:02.148 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T21:01:02.148 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T21:01:02.148 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T21:01:02.148 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T21:01:02.148 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T21:01:02.149 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T21:01:02.149 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-26T21:01:02.149 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-26T21:01:02.149 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T21:01:02.149 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T21:01:02.149 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T21:01:02.149 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T21:01:02.149 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T21:01:02.149 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T21:01:02.149 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T21:01:02.149 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-26T21:01:02.149 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T21:01:02.149 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T21:01:02.149 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-26T21:01:02.150 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T21:01:02.150 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T21:01:02.150 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T21:01:02.150 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T21:01:02.150 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T21:01:02.150 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T21:01:02.150 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T21:01:02.150 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T21:01:02.150 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T21:01:02.150 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T21:01:02.150 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T21:01:02.150 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T21:01:02.150 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T21:01:02.151 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T21:01:02.151 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T21:01:02.151 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T21:01:02.151 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T21:01:02.151 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T21:01:02.151 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T21:01:02.151 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T21:01:02.151 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T21:01:02.151 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T21:01:02.151 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T21:01:02.151 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T21:01:02.151 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T21:01:02.151 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T21:01:02.151 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T21:01:02.152 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T21:01:02.152 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T21:01:02.152 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T21:01:02.152 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T21:01:02.152 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T21:01:02.152 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T21:01:02.152 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T21:01:02.152 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T21:01:02.152 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-26T21:01:02.152 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T21:01:02.152 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T21:01:02.152 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T21:01:02.152 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T21:01:02.152 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T21:01:02.152 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T21:01:02.153 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T21:01:02.153 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T21:01:02.153 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T21:01:02.153 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T21:01:02.153 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T21:01:02.153 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T21:01:02.153 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T21:01:02.153 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T21:01:02.153 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T21:01:02.153 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T21:01:02.153 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T21:01:02.153 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-26T21:01:02.153 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T21:01:02.153 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-26T21:01:02.153 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-26T21:01:02.154 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-26T21:01:02.154 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-26T21:01:02.154 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-26T21:01:02.154 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T21:01:02.154 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-26T21:01:02.154 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-26T21:01:02.154 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T21:01:02.154 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-26T21:01:02.154 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-26T21:01:02.154 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T21:01:02.154 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T21:01:02.154 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-26T21:01:02.154 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-26T21:01:02.155 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T21:01:02.155 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T21:01:02.155 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-26T21:01:02.155 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T21:01:02.155 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T21:01:02.155 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T21:01:02.155 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-26T21:01:02.155 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-26T21:01:02.155 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T21:01:02.155 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-26T21:01:02.155 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-26T21:01:02.155 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T21:01:02.155 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-26T21:01:02.155 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T21:01:02.156 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-26T21:01:02.156 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T21:01:02.156 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T21:01:02.156 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T21:01:02.156 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T21:01:02.156 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T21:01:02.156 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-26T21:01:02.156 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T21:01:02.156 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T21:01:02.156 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T21:01:02.156 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T21:01:02.156 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T21:01:02.156 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T21:01:02.156 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T21:01:02.156 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-26T21:01:02.157 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T21:01:02.157 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T21:01:02.157 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T21:01:02.157 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-26T21:01:02.157 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-26T21:01:02.157 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T21:01:02.157 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T21:01:02.157 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T21:01:02.157 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-26T21:01:02.157 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-26T21:01:02.157 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-26T21:01:02.157 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-26T21:01:02.157 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-26T21:01:02.157 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-26T21:01:02.157 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T21:01:02.158 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T21:01:02.158 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-26T21:01:02.158 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-26T21:01:02.158 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T21:01:02.158 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-26T21:01:02.158 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-26T21:01:02.158 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T21:01:02.158 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T21:01:02.158 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-26T21:01:02.158 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-26T21:01:02.158 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-26T21:01:02.158 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T21:01:02.158 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-26T21:01:02.158 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T21:01:02.158 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T21:01:02.159 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T21:01:02.159 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-26T21:01:02.159 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T21:01:02.159 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-26T21:01:02.159 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T21:01:02.159 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-26T21:01:02.159 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-26T21:01:02.159 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-26T21:01:02.159 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-26T21:01:02.159 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T21:01:02.159 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-26T21:01:02.159 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T21:01:02.159 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-26T21:01:02.159 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T21:01:02.160 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T21:01:02.160 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T21:01:02.160 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T21:01:02.160 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T21:01:02.160 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T21:01:02.160 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T21:01:02.160 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T21:01:02.160 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T21:01:02.160 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T21:01:02.160 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T21:01:02.160 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T21:01:02.160 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T21:01:02.160 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-26T21:01:02.160 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-26T21:01:02.161 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T21:01:02.161 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-26T21:01:02.161 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T21:01:02.161 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T21:01:02.161 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-26T21:01:02.161 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T21:01:02.161 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T21:01:02.161 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T21:01:02.161 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T21:01:02.161 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T21:01:02.161 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T21:01:02.161 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T21:01:02.161 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T21:01:02.161 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T21:01:02.162 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T21:01:02.162 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T21:01:02.162 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T21:01:02.162 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T21:01:02.162 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T21:01:02.162 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T21:01:02.162 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T21:01:02.162 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T21:01:02.162 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T21:01:02.162 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T21:01:02.162 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T21:01:02.162 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T21:01:02.162 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T21:01:02.162 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T21:01:02.163 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T21:01:02.163 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T21:01:02.163 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T21:01:02.163 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T21:01:02.163 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T21:01:02.163 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T21:01:02.163 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T21:01:02.163 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T21:01:02.163 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T21:01:02.163 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T21:01:02.163 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T21:01:02.163 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T21:01:02.163 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T21:01:02.163 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T21:01:02.163 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T21:01:02.164 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T21:01:02.164 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T21:01:02.164 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T21:01:02.164 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T21:01:02.164 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T21:01:02.164 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T21:01:02.164 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T21:01:02.164 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T21:01:02.164 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T21:01:02.164 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T21:01:02.164 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T21:01:02.164 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T21:01:02.164 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T21:01:02.164 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T21:01:02.164 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T21:01:02.165 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T21:01:02.165 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T21:01:02.165 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T21:01:02.165 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T21:01:02.165 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T21:01:02.165 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T21:01:02.165 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T21:01:02.165 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T21:01:02.165 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T21:01:02.165 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T21:01:02.165 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T21:01:02.165 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-26T21:01:02.165 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T21:01:02.165 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T21:01:02.165 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T21:01:02.166 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-26T21:01:02.166 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T21:01:02.166 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T21:01:02.166 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T21:01:02.166 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T21:01:02.166 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T21:01:02.166 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T21:01:02.166 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T21:01:02.166 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T21:01:02.166 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T21:01:02.166 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T21:01:02.166 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T21:01:02.166 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T21:01:02.166 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T21:01:02.166 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T21:01:02.167 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T21:01:02.167 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T21:01:02.167 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T21:01:02.167 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T21:01:02.167 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T21:01:02.167 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T21:01:02.167 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T21:01:02.167 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T21:01:02.167 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T21:01:02.167 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T21:01:02.167 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T21:01:02.167 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T21:01:02.167 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T21:01:02.167 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T21:01:02.168 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T21:01:02.168 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T21:01:02.168 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T21:01:02.168 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T21:01:02.168 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T21:01:02.168 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T21:01:02.168 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T21:01:02.168 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T21:01:02.168 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T21:01:02.168 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T21:01:02.168 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T21:01:02.168 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T21:01:02.168 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T21:01:02.168 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T21:01:02.168 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T21:01:02.169 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T21:01:02.169 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T21:01:02.169 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T21:01:02.169 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T21:01:02.169 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T21:01:02.169 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T21:01:02.169 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T21:01:02.169 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T21:01:02.169 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T21:01:02.169 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T21:01:02.169 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T21:01:02.169 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T21:01:02.169 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T21:01:02.169 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T21:01:02.169 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T21:01:02.170 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T21:01:02.170 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T21:01:02.170 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T21:01:02.170 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T21:01:02.170 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T21:01:02.170 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T21:01:02.170 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T21:01:02.170 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T21:01:02.170 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T21:01:02.170 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T21:01:02.170 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T21:01:02.170 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T21:01:02.170 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T21:01:02.170 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T21:01:02.171 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T21:01:02.171 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T21:01:02.171 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T21:01:02.171 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T21:01:02.171 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T21:01:02.171 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T21:01:02.171 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T21:01:02.171 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T21:01:02.171 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T21:01:02.171 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T21:01:02.171 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T21:01:02.171 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T21:01:02.171 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T21:01:02.171 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T21:01:02.172 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T21:01:02.172 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T21:01:02.172 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-26T21:01:02.172 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T21:01:02.172 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T21:01:02.172 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T21:01:02.172 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T21:01:02.172 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T21:01:02.172 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T21:01:02.172 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T21:01:02.172 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T21:01:02.172 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T21:01:02.172 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T21:01:02.172 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T21:01:02.172 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T21:01:02.173 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T21:01:02.173 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T21:01:02.173 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T21:01:02.173 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T21:01:02.173 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T21:01:02.173 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T21:01:02.173 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T21:01:02.173 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T21:01:02.173 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T21:01:02.173 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T21:01:02.173 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T21:01:02.173 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T21:01:02.173 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T21:01:02.173 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T21:01:02.173 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T21:01:02.174 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T21:01:02.174 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T21:01:02.174 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T21:01:02.174 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T21:01:02.174 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T21:01:02.174 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T21:01:02.174 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T21:01:02.174 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T21:01:02.174 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T21:01:02.174 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T21:01:02.174 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T21:01:02.174 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T21:01:02.174 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T21:01:02.174 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T21:01:02.175 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-26T21:01:02.175 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-26T21:01:02.175 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T21:01:02.175 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T21:01:02.175 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-26T21:01:02.175 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T21:01:02.175 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T21:01:02.175 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T21:01:02.175 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T21:01:02.175 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T21:01:02.175 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T21:01:02.175 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T21:01:02.175 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T21:01:02.175 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T21:01:02.176 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T21:01:02.176 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T21:01:02.176 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T21:01:02.176 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T21:01:02.176 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T21:01:02.176 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T21:01:02.176 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T21:01:02.176 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T21:01:02.176 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T21:01:02.176 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T21:01:02.176 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T21:01:02.176 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T21:01:02.176 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T21:01:02.176 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T21:01:02.177 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-26T21:01:02.177 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T21:01:02.177 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-26T21:01:02.177 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T21:01:02.177 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T21:01:02.177 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-26T21:01:02.177 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-26T21:01:02.177 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T21:01:02.177 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T21:01:02.177 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T21:01:02.177 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T21:01:02.177 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T21:01:02.177 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T21:01:02.177 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T21:01:02.177 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-26T21:01:02.178 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-26T21:01:02.178 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T21:01:02.178 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-26T21:01:02.178 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T21:01:02.178 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-26T21:01:02.178 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T21:01:02.178 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-26T21:01:02.178 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T21:01:02.178 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-26T21:01:02.178 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-26T21:01:02.178 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T21:01:02.178 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-26T21:01:02.178 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T21:01:02.178 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-26T21:01:02.179 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T21:01:02.179 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-26T21:01:02.179 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T21:01:02.179 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-26T21:01:02.179 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T21:01:02.179 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-26T21:01:02.179 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-26T21:01:02.179 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T21:01:02.179 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T21:01:02.179 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T21:01:02.179 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T21:01:02.179 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-26T21:01:02.179 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T21:01:02.179 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-26T21:01:02.180 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T21:01:02.180 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T21:01:02.180 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T21:01:02.180 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T21:01:02.180 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T21:01:02.180 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T21:01:02.180 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T21:01:02.180 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T21:01:02.180 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-26T21:01:02.180 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T21:01:02.180 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-26T21:01:02.180 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T21:01:02.180 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T21:01:02.180 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T21:01:02.180 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T21:01:02.180 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T21:01:02.181 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-26T21:01:02.181 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T21:01:02.181 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T21:01:02.181 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T21:01:02.181 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T21:01:02.181 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-26T21:01:02.181 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T21:01:02.181 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T21:01:02.181 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T21:01:02.181 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T21:01:02.181 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T21:01:02.181 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T21:01:02.181 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T21:01:02.181 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T21:01:02.181 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T21:01:02.181 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-26T21:01:02.182 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-26T21:01:02.182 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T21:01:02.182 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T21:01:02.182 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T21:01:02.182 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T21:01:02.182 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T21:01:02.182 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T21:01:02.182 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T21:01:02.182 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T21:01:02.182 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T21:01:02.182 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T21:01:02.182 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T21:01:02.182 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T21:01:02.182 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T21:01:02.182 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T21:01:02.183 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T21:01:02.183 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T21:01:02.183 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-26T21:01:02.183 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T21:01:02.183 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T21:01:02.183 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T21:01:02.183 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T21:01:02.183 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T21:01:02.183 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-26T21:01:02.183 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-26T21:01:02.183 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T21:01:02.183 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T21:01:02.183 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T21:01:02.183 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T21:01:02.184 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T21:01:02.184 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T21:01:02.184 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T21:01:02.184 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-26T21:01:02.184 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T21:01:02.184 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T21:01:02.184 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-26T21:01:02.184 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T21:01:02.184 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T21:01:02.184 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T21:01:02.184 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T21:01:02.184 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-26T21:01:02.184 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-26T21:01:02.184 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T21:01:02.184 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T21:01:02.185 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T21:01:02.185 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T21:01:02.185 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-26T21:01:02.185 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T21:01:02.185 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-26T21:01:02.185 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T21:01:02.185 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T21:01:02.185 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T21:01:02.185 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T21:01:02.185 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T21:01:02.185 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T21:01:02.185 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T21:01:02.185 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-26T21:01:02.185 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T21:01:02.186 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T21:01:02.186 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-26T21:01:02.186 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T21:01:02.186 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T21:01:02.186 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T21:01:02.186 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-26T21:01:02.186 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-26T21:01:02.186 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-26T21:01:02.186 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-26T21:01:02.186 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-26T21:01:02.186 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-26T21:01:02.186 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T21:01:02.186 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T21:01:02.186 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T21:01:02.187 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T21:01:02.187 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-26T21:01:02.187 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T21:01:02.187 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-26T21:01:02.187 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-26T21:01:02.187 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T21:01:02.187 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-26T21:01:02.187 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-26T21:01:02.187 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T21:01:02.187 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T21:01:02.187 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T21:01:02.187 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-26T21:01:02.187 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T21:01:02.187 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T21:01:02.188 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T21:01:02.188 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-26T21:01:02.188 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-26T21:01:02.188 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T21:01:02.188 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T21:01:02.188 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T21:01:02.188 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T21:01:02.188 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-26T21:01:02.188 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T21:01:02.188 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T21:01:02.188 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T21:01:02.188 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T21:01:02.188 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-26T21:01:02.188 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T21:01:02.189 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-26T21:01:02.189 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T21:01:02.189 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-26T21:01:02.189 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T21:01:02.189 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-26T21:01:02.189 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T21:01:02.189 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-26T21:01:02.189 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T21:01:02.189 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T21:01:02.189 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T21:01:02.189 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-26T21:01:02.189 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-26T21:01:02.189 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T21:01:02.189 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-26T21:01:02.189 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T21:01:02.190 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-26T21:01:02.190 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T21:01:02.190 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-26T21:01:02.190 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T21:01:02.190 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T21:01:02.190 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-26T21:01:02.190 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T21:01:02.190 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T21:01:02.190 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-26T21:01:02.190 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T21:01:02.190 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T21:01:02.190 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-26T21:01:02.190 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T21:01:02.190 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T21:01:02.191 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-26T21:01:02.191 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-26T21:01:02.191 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T21:01:02.191 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-26T21:01:02.191 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-26T21:01:02.191 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T21:01:02.191 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-26T21:01:02.191 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T21:01:02.191 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-26T21:01:02.191 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T21:01:02.191 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-26T21:01:02.191 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T21:01:02.191 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-26T21:01:02.191 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T21:01:02.192 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-26T21:01:02.192 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-26T21:01:02.192 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T21:01:02.192 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-26T21:01:02.192 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-26T21:01:02.192 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T21:01:02.192 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T21:01:02.192 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T21:01:02.192 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T21:01:02.192 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T21:01:02.192 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T21:01:02.192 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-26T21:01:02.192 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T21:01:02.192 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T21:01:02.192 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T21:01:02.193 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-26T21:01:02.193 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-26T21:01:02.193 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T21:01:02.193 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T21:01:02.193 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T21:01:02.193 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-26T21:01:02.193 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T21:01:02.193 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-26T21:01:02.193 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T21:01:02.193 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-26T21:01:02.193 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T21:01:02.193 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-26T21:01:02.193 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T21:01:02.193 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-26T21:01:02.194 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T21:01:02.194 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-26T21:01:02.194 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T21:01:02.194 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-26T21:01:02.194 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T21:01:02.194 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-26T21:01:02.194 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T21:01:02.194 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-26T21:01:02.194 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T21:01:02.194 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-26T21:01:02.194 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T21:01:02.194 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T21:01:02.194 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-26T21:01:02.194 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T21:01:02.195 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T21:01:02.195 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T21:01:02.195 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-26T21:01:02.195 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-26T21:01:02.195 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T21:01:02.195 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T21:01:02.195 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-26T21:01:02.195 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-26T21:01:02.195 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T21:01:02.195 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-26T21:01:02.195 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T21:01:02.195 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-26T21:01:02.195 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-26T21:01:02.195 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T21:01:02.195 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-26T21:01:02.196 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T21:01:02.196 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T21:01:02.196 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-26T21:01:02.196 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T21:01:02.196 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-26T21:01:02.196 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T21:01:02.196 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-26T21:01:02.196 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T21:01:02.196 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T21:01:02.196 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-26T21:01:02.196 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-26T21:01:02.196 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T21:01:02.196 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T21:01:02.196 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-26T21:01:02.197 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T21:01:02.197 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-26T21:01:02.197 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T21:01:02.197 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-26T21:01:02.197 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T21:01:02.197 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T21:01:02.197 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T21:01:02.197 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T21:01:02.197 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-26T21:01:02.197 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-26T21:01:02.197 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-26T21:01:02.197 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T21:01:02.197 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-26T21:01:02.197 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T21:01:02.197 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-26T21:01:02.198 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T21:01:02.198 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T21:01:02.198 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-26T21:01:02.198 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T21:01:02.198 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T21:01:02.198 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T21:01:02.198 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T21:01:02.198 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-26T21:01:02.198 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-26T21:01:02.198 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T21:01:02.198 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T21:01:02.198 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-26T21:01:02.198 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T21:01:02.198 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T21:01:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T21:01:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T21:01:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-26T21:01:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T21:01:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-26T21:01:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T21:01:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-26T21:01:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T21:01:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T21:01:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-26T21:01:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T21:01:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T21:01:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-26T21:01:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T21:01:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T21:01:02.200 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-26T21:01:02.200 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T21:01:02.200 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-26T21:01:02.200 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T21:01:02.200 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T21:01:02.200 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-26T21:01:02.200 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T21:01:02.200 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T21:01:02.200 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T21:01:02.200 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-26T21:01:02.200 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T21:01:02.200 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T21:01:02.200 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T21:01:02.200 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T21:01:02.201 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T21:01:02.201 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-26T21:01:02.201 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T21:01:02.201 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T21:01:02.201 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-26T21:01:02.201 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T21:01:02.201 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T21:01:02.201 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-26T21:01:02.201 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T21:01:02.201 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T21:01:02.201 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-26T21:01:02.201 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T21:01:02.201 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T21:01:02.201 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T21:01:02.201 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T21:01:02.202 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T21:01:02.202 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-26T21:01:02.202 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T21:01:02.202 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T21:01:02.202 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T21:01:02.202 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T21:01:02.202 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T21:01:02.202 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T21:01:02.202 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T21:01:02.202 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T21:01:02.202 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T21:01:02.202 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T21:01:02.202 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T21:01:02.203 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T21:01:02.203 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-26T21:01:02.203 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T21:01:02.203 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T21:01:02.203 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T21:01:02.203 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-26T21:01:02.203 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T21:01:02.203 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T21:01:02.203 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T21:01:02.203 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T21:01:02.203 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T21:01:02.203 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-26T21:01:02.203 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-26T21:01:02.203 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T21:01:02.203 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T21:01:02.204 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T21:01:02.204 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-26T21:01:02.204 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T21:01:02.204 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T21:01:02.204 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T21:01:02.204 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T21:01:02.204 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T21:01:02.204 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T21:01:02.204 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-26T21:01:02.204 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T21:01:02.204 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-26T21:01:02.204 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-26T21:01:02.204 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T21:01:02.204 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-26T21:01:02.204 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T21:01:02.205 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-26T21:01:02.205 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T21:01:02.205 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-26T21:01:02.205 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-26T21:01:02.205 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T21:01:02.205 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-26T21:01:02.205 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-26T21:01:02.205 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T21:01:02.205 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T21:01:02.205 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-26T21:01:02.205 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T21:01:02.205 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T21:01:02.205 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T21:01:02.205 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T21:01:02.205 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-26T21:01:02.206 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-26T21:01:02.206 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T21:01:02.206 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-26T21:01:02.206 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-26T21:01:02.206 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T21:01:02.206 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-26T21:01:02.206 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T21:01:02.206 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T21:01:02.206 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T21:01:02.206 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-26T21:01:02.206 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-26T21:01:02.207 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T21:01:02.207 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-26T21:01:02.207 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-26T21:01:02.207 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T21:01:02.207 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T21:01:02.207 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T21:01:02.207 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T21:01:02.207 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T21:01:02.207 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T21:01:02.207 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T21:01:02.207 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T21:01:02.207 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T21:01:02.207 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T21:01:02.207 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T21:01:02.208 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T21:01:02.208 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-26T21:01:02.208 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T21:01:02.208 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T21:01:02.208 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T21:01:02.208 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T21:01:02.208 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T21:01:02.208 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T21:01:02.208 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T21:01:02.208 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T21:01:02.208 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T21:01:02.208 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T21:01:02.208 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T21:01:02.208 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T21:01:02.209 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-26T21:01:02.209 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T21:01:02.209 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T21:01:02.209 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-26T21:01:02.209 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-26T21:01:02.209 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T21:01:02.209 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T21:01:02.209 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T21:01:02.209 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T21:01:02.209 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-26T21:01:02.209 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T21:01:02.209 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T21:01:02.209 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-26T21:01:02.210 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-26T21:01:02.210 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-26T21:01:02.210 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T21:01:02.210 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T21:01:02.210 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-26T21:01:02.210 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T21:01:02.210 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T21:01:02.210 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T21:01:02.210 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T21:01:02.210 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T21:01:02.210 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T21:01:02.210 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T21:01:02.210 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T21:01:02.210 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T21:01:02.211 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T21:01:02.211 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T21:01:02.211 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T21:01:02.211 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T21:01:02.211 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T21:01:02.211 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T21:01:02.211 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T21:01:02.211 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T21:01:02.211 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T21:01:02.211 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T21:01:02.211 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T21:01:02.211 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T21:01:02.211 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T21:01:02.212 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T21:01:02.212 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T21:01:02.212 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T21:01:02.212 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T21:01:02.212 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T21:01:02.212 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T21:01:02.212 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T21:01:02.212 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T21:01:02.212 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T21:01:02.212 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-26T21:01:02.212 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T21:01:02.212 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T21:01:02.212 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T21:01:02.213 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T21:01:02.213 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T21:01:02.213 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-26T21:01:02.213 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T21:01:02.213 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T21:01:02.213 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-26T21:01:02.213 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T21:01:02.213 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T21:01:02.213 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T21:01:02.213 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-26T21:01:02.213 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T21:01:02.214 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T21:01:02.214 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-26T21:01:02.214 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T21:01:02.214 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-26T21:01:02.214 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T21:01:02.214 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-26T21:01:02.215 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T21:01:02.215 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-26T21:01:02.215 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T21:01:02.215 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T21:01:02.215 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-26T21:01:02.215 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T21:01:02.215 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-26T21:01:02.215 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-26T21:01:02.215 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T21:01:02.215 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-26T21:01:02.215 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T21:01:02.216 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T21:01:02.216 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T21:01:02.216 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-26T21:01:02.216 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-26T21:01:02.216 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-26T21:01:02.216 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-26T21:01:02.216 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-26T21:01:02.216 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T21:01:02.216 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-26T21:01:02.216 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T21:01:02.216 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T21:01:02.217 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-26T21:01:02.217 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T21:01:02.217 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T21:01:02.217 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-26T21:01:02.217 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T21:01:02.217 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T21:01:02.217 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T21:01:02.217 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T21:01:02.217 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T21:01:02.217 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T21:01:02.217 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T21:01:02.217 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-26T21:01:02.217 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T21:01:02.218 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T21:01:02.218 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T21:01:02.218 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-26T21:01:02.218 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T21:01:02.218 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T21:01:02.218 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T21:01:02.218 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-26T21:01:02.218 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T21:01:02.218 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-26T21:01:02.218 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T21:01:02.218 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-26T21:01:02.218 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T21:01:02.219 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T21:01:02.219 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T21:01:02.219 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T21:01:02.219 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-26T21:01:02.219 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T21:01:02.219 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-26T21:01:02.219 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T21:01:02.219 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T21:01:02.219 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-26T21:01:02.219 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T21:01:02.219 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T21:01:02.219 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T21:01:02.220 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-26T21:01:02.220 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T21:01:02.220 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T21:01:02.220 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-26T21:01:02.220 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T21:01:02.220 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T21:01:02.220 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T21:01:02.220 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T21:01:02.220 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T21:01:02.220 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T21:01:02.220 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T21:01:02.220 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T21:01:02.220 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T21:01:02.221 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T21:01:02.221 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T21:01:02.221 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-26T21:01:02.221 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T21:01:02.221 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T21:01:02.221 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T21:01:02.221 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T21:01:02.221 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-26T21:01:02.221 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T21:01:02.221 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-26T21:01:02.221 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-26T21:01:02.221 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T21:01:02.221 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-26T21:01:02.222 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T21:01:02.222 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T21:01:02.222 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T21:01:02.222 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T21:01:02.222 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T21:01:02.222 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T21:01:02.222 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-26T21:01:02.222 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T21:01:02.222 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-26T21:01:02.222 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-26T21:01:02.222 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-26T21:01:02.223 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T21:01:02.223 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T21:01:02.223 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T21:01:02.223 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T21:01:02.223 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T21:01:02.223 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T21:01:02.223 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T21:01:02.223 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T21:01:02.223 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T21:01:02.223 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T21:01:02.223 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T21:01:02.223 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T21:01:02.223 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T21:01:02.224 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T21:01:02.224 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T21:01:02.224 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T21:01:02.224 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T21:01:02.224 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T21:01:02.224 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-26T21:01:02.224 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-26T21:01:02.224 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T21:01:02.224 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T21:01:02.224 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T21:01:02.224 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T21:01:02.225 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-26T21:01:02.225 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-26T21:01:02.225 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T21:01:02.225 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T21:01:02.225 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-26T21:01:02.225 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T21:01:02.225 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-26T21:01:02.225 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-26T21:01:02.225 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T21:01:02.225 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-26T21:01:02.225 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T21:01:02.225 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-26T21:01:02.225 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T21:01:02.226 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T21:01:02.226 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T21:01:02.226 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T21:01:02.226 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T21:01:02.226 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-26T21:01:02.226 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-26T21:01:02.226 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T21:01:02.226 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T21:01:02.226 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T21:01:02.226 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T21:01:02.226 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-26T21:01:02.226 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T21:01:02.226 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-26T21:01:02.227 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T21:01:02.227 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T21:01:02.227 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-26T21:01:02.227 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T21:01:02.227 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T21:01:02.227 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T21:01:02.227 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T21:01:02.227 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T21:01:02.227 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T21:01:02.227 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T21:01:02.227 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T21:01:02.228 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T21:01:02.228 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T21:01:02.228 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-26T21:01:02.228 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T21:01:02.228 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T21:01:02.228 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T21:01:02.228 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T21:01:02.228 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T21:01:02.228 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T21:01:02.228 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T21:01:02.228 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-26T21:01:02.228 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T21:01:02.228 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-26T21:01:02.229 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T21:01:02.229 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T21:01:02.229 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T21:01:02.229 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T21:01:02.229 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T21:01:02.229 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T21:01:02.229 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T21:01:02.229 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T21:01:02.229 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T21:01:02.229 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T21:01:02.229 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T21:01:02.229 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T21:01:02.229 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T21:01:02.229 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T21:01:02.229 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T21:01:02.229 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T21:01:02.230 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T21:01:02.230 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T21:01:02.230 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T21:01:02.230 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T21:01:02.230 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T21:01:02.230 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T21:01:02.230 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T21:01:02.230 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T21:01:02.230 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T21:01:02.230 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T21:01:02.230 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T21:01:02.230 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T21:01:02.230 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T21:01:02.230 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T21:01:02.231 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T21:01:02.231 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T21:01:02.231 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T21:01:02.231 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T21:01:02.231 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T21:01:02.231 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T21:01:02.231 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T21:01:02.231 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T21:01:02.231 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T21:01:02.231 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T21:01:02.231 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T21:01:02.231 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T21:01:02.231 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T21:01:02.231 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T21:01:02.231 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T21:01:02.231 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-26T21:01:02.232 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T21:01:02.232 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T21:01:02.232 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T21:01:02.232 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T21:01:02.232 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T21:01:02.232 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T21:01:02.232 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T21:01:02.232 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T21:01:02.232 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T21:01:02.232 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T21:01:02.232 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T21:01:02.232 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T21:01:02.232 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T21:01:02.232 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T21:01:02.232 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T21:01:02.232 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-26T21:01:02.233 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T21:01:02.233 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T21:01:02.233 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T21:01:02.233 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-26T21:01:02.233 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-26T21:01:02.233 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T21:01:02.233 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T21:01:02.233 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T21:01:02.233 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T21:01:02.233 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-26T21:01:02.233 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T21:01:02.233 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T21:01:02.233 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T21:01:02.233 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T21:01:02.234 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-26T21:01:02.234 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-26T21:01:02.234 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T21:01:02.234 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T21:01:02.234 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T21:01:02.234 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-26T21:01:02.234 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-26T21:01:02.234 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-26T21:01:02.234 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-26T21:01:02.235 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-26T21:01:02.235 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-26T21:01:02.235 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-26T21:01:02.235 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-26T21:01:02.235 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-26T21:01:02.235 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-26T21:01:02.235 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T21:01:02.235 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T21:01:02.235 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-26T21:01:02.235 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T21:01:02.235 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T21:01:02.235 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T21:01:02.236 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T21:01:02.236 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T21:01:02.236 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T21:01:02.236 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T21:01:02.236 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T21:01:02.236 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T21:01:02.236 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T21:01:02.236 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T21:01:02.236 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T21:01:02.236 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-26T21:01:02.236 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T21:01:02.236 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T21:01:02.236 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T21:01:02.237 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T21:01:02.237 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T21:01:02.237 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T21:01:02.237 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T21:01:02.237 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T21:01:02.237 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T21:01:02.237 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T21:01:02.237 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T21:01:02.237 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T21:01:02.237 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T21:01:02.237 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T21:01:02.237 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T21:01:02.237 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T21:01:02.238 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T21:01:02.238 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T21:01:02.238 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T21:01:02.238 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T21:01:02.238 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T21:01:02.238 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T21:01:02.238 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T21:01:02.238 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T21:01:02.238 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T21:01:02.238 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T21:01:02.238 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-26T21:01:02.238 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-26T21:01:02.238 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T21:01:02.238 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T21:01:02.239 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T21:01:02.239 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-26T21:01:02.239 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T21:01:02.239 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T21:01:02.239 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-26T21:01:02.239 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T21:01:02.239 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-26T21:01:02.239 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-26T21:01:02.239 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T21:01:02.239 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-26T21:01:02.239 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T21:01:02.239 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-26T21:01:02.239 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T21:01:02.240 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T21:01:02.240 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-26T21:01:02.240 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T21:01:02.240 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-26T21:01:02.240 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T21:01:02.240 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-26T21:01:02.240 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T21:01:02.240 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-26T21:01:02.240 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T21:01:02.240 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-26T21:01:02.240 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T21:01:02.240 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-26T21:01:02.240 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T21:01:02.241 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-26T21:01:02.241 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-26T21:01:02.241 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-26T21:01:02.241 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T21:01:02.241 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-26T21:01:02.241 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-26T21:01:02.241 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T21:01:02.241 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-26T21:01:02.241 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-26T21:01:02.241 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T21:01:02.241 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-26T21:01:02.241 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-26T21:01:02.241 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T21:01:02.241 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-26T21:01:02.242 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T21:01:02.242 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-26T21:01:02.242 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T21:01:02.242 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-26T21:01:02.242 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T21:01:02.242 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-26T21:01:02.242 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T21:01:02.242 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-26T21:01:02.242 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T21:01:02.242 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-26T21:01:02.242 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T21:01:02.243 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-26T21:01:02.243 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T21:01:02.243 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-26T21:01:02.243 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-26T21:01:02.243 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T21:01:02.243 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-26T21:01:02.243 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T21:01:02.243 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-26T21:01:02.243 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T21:01:02.243 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T21:01:02.243 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T21:01:02.243 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T21:01:02.243 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-26T21:01:02.244 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T21:01:02.244 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T21:01:02.244 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-26T21:01:02.244 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T21:01:02.244 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-26T21:01:02.244 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T21:01:02.244 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-26T21:01:02.244 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T21:01:02.244 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T21:01:02.244 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T21:01:02.244 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T21:01:02.244 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T21:01:02.245 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T21:01:02.245 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T21:01:02.245 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T21:01:02.245 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T21:01:02.245 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T21:01:02.245 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T21:01:02.245 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T21:01:02.245 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T21:01:02.245 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T21:01:02.245 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T21:01:02.245 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T21:01:02.245 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T21:01:02.245 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T21:01:02.245 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T21:01:02.245 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T21:01:02.246 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T21:01:02.246 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T21:01:02.246 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T21:01:02.246 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T21:01:02.246 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T21:01:02.246 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T21:01:02.246 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T21:01:02.246 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T21:01:02.246 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T21:01:02.246 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T21:01:02.246 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T21:01:02.246 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T21:01:02.247 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T21:01:02.247 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T21:01:02.247 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T21:01:02.247 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T21:01:02.247 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T21:01:02.247 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T21:01:02.247 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T21:01:02.247 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T21:01:02.247 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T21:01:02.247 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T21:01:02.247 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T21:01:02.247 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T21:01:02.247 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T21:01:02.247 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T21:01:02.248 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T21:01:02.248 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T21:01:02.248 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T21:01:02.248 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T21:01:02.248 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-26T21:01:02.248 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-26T21:01:02.248 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T21:01:02.248 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-26T21:01:02.248 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T21:01:02.248 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-26T21:01:02.248 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T21:01:02.248 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T21:01:02.248 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T21:01:02.248 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T21:01:02.248 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T21:01:02.248 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-26T21:01:02.249 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T21:01:02.249 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-26T21:01:02.249 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T21:01:02.249 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-26T21:01:02.249 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T21:01:02.249 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-26T21:01:02.249 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T21:01:02.249 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-26T21:01:02.249 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-26T21:01:02.249 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T21:01:02.249 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-26T21:01:02.249 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T21:01:02.249 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T21:01:02.249 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-26T21:01:02.249 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T21:01:02.250 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-26T21:01:02.250 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T21:01:02.250 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-26T21:01:02.250 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T21:01:02.250 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-26T21:01:02.250 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T21:01:02.250 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-26T21:01:02.250 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T21:01:02.250 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-26T21:01:02.250 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-26T21:01:02.250 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-26T21:01:02.250 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T21:01:02.250 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-26T21:01:02.250 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-26T21:01:02.250 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-26T21:01:02.251 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-26T21:01:02.251 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T21:01:02.251 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T21:01:02.251 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-26T21:01:02.251 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T21:01:02.251 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T21:01:02.251 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T21:01:02.251 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T21:01:02.251 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-26T21:01:02.251 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T21:01:02.251 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T21:01:02.251 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-26T21:01:02.251 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T21:01:02.251 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-26T21:01:02.252 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T21:01:02.252 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-26T21:01:02.252 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T21:01:02.252 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T21:01:02.252 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T21:01:02.252 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T21:01:02.252 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-26T21:01:02.252 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-26T21:01:02.252 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-26T21:01:02.252 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T21:01:02.252 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-26T21:01:02.252 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-26T21:01:02.253 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T21:01:02.253 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T21:01:02.253 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T21:01:02.253 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T21:01:02.253 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T21:01:02.253 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T21:01:02.253 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T21:01:02.253 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T21:01:02.253 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-26T21:01:02.253 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T21:01:02.253 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T21:01:02.254 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T21:01:02.254 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T21:01:02.254 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T21:01:02.254 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-26T21:01:02.254 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T21:01:02.254 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-26T21:01:02.254 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T21:01:02.254 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T21:01:02.254 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T21:01:02.254 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T21:01:02.258 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-26T21:01:02.258 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T21:01:02.258 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-26T21:01:02.258 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T21:01:02.258 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T21:01:02.258 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-26T21:01:02.258 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T21:01:02.258 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T21:01:02.258 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T21:01:02.258 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T21:01:02.258 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T21:01:02.259 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T21:01:02.259 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T21:01:02.259 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T21:01:02.259 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T21:01:02.259 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T21:01:02.259 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T21:01:02.259 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T21:01:02.259 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T21:01:02.259 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T21:01:02.259 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T21:01:02.260 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T21:01:02.260 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T21:01:02.260 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T21:01:02.260 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T21:01:02.260 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T21:01:02.260 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T21:01:02.260 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-26T21:01:02.260 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T21:01:02.260 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T21:01:02.260 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-26T21:01:02.260 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T21:01:02.260 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-26T21:01:02.260 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-26T21:01:02.261 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T21:01:02.261 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-26T21:01:02.261 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T21:01:02.261 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T21:01:02.261 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T21:01:02.261 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T21:01:02.261 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-26T21:01:02.261 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-26T21:01:02.261 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-26T21:01:02.261 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T21:01:02.261 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T21:01:02.261 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T21:01:02.261 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T21:01:02.261 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T21:01:02.262 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-26T21:01:02.262 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-26T21:01:02.262 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T21:01:02.262 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T21:01:02.262 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T21:01:02.262 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-26T21:01:02.262 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T21:01:02.262 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T21:01:02.262 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T21:01:02.262 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T21:01:02.262 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T21:01:02.262 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T21:01:02.262 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T21:01:02.262 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T21:01:02.263 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T21:01:02.263 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T21:01:02.263 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-26T21:01:02.263 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T21:01:02.263 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T21:01:02.263 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T21:01:02.263 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T21:01:02.263 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T21:01:02.263 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T21:01:02.263 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T21:01:02.263 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T21:01:02.263 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T21:01:02.264 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T21:01:02.264 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T21:01:02.264 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T21:01:02.264 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T21:01:02.264 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T21:01:02.264 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T21:01:02.264 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T21:01:02.264 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T21:01:02.264 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T21:01:02.264 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T21:01:02.264 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T21:01:02.264 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T21:01:02.264 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T21:01:02.264 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T21:01:02.265 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T21:01:02.265 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T21:01:02.265 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T21:01:02.265 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T21:01:02.265 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T21:01:02.265 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T21:01:02.265 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T21:01:02.265 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T21:01:02.265 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T21:01:02.265 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T21:01:02.265 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T21:01:02.265 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T21:01:02.266 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T21:01:02.266 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T21:01:02.266 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T21:01:02.266 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-26T21:01:02.266 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T21:01:02.266 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T21:01:02.266 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T21:01:02.266 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T21:01:02.266 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T21:01:02.266 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T21:01:02.266 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T21:01:02.266 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-26T21:01:02.266 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T21:01:02.267 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T21:01:02.267 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T21:01:02.267 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T21:01:02.267 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T21:01:02.267 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T21:01:02.267 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T21:01:02.267 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T21:01:02.267 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T21:01:02.267 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T21:01:02.267 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T21:01:02.267 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T21:01:02.267 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T21:01:02.267 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T21:01:02.267 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T21:01:02.267 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T21:01:02.268 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T21:01:02.268 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T21:01:02.268 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T21:01:02.268 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T21:01:02.268 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T21:01:02.268 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T21:01:02.268 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T21:01:02.268 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T21:01:02.268 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T21:01:02.268 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T21:01:02.268 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T21:01:02.268 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-26T21:01:02.268 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T21:01:02.268 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-26T21:01:02.268 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T21:01:02.269 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T21:01:02.269 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T21:01:02.269 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T21:01:02.269 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T21:01:02.269 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T21:01:02.269 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T21:01:02.269 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-26T21:01:02.269 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T21:01:02.269 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-26T21:01:02.269 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T21:01:02.269 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-26T21:01:02.269 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T21:01:02.269 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-26T21:01:02.269 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-26T21:01:02.270 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T21:01:02.270 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T21:01:02.270 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T21:01:02.270 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T21:01:02.270 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T21:01:02.270 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T21:01:02.270 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T21:01:02.270 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T21:01:02.270 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T21:01:02.270 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T21:01:02.270 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T21:01:02.270 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T21:01:02.271 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T21:01:02.271 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T21:01:02.271 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T21:01:02.271 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T21:01:02.271 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-26T21:01:02.271 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T21:01:02.271 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T21:01:02.271 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T21:01:02.271 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T21:01:02.271 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T21:01:02.271 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T21:01:02.271 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T21:01:02.271 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T21:01:02.271 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T21:01:02.272 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T21:01:02.272 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T21:01:02.272 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T21:01:02.272 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T21:01:02.272 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T21:01:02.272 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T21:01:02.272 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T21:01:02.272 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T21:01:02.272 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T21:01:02.272 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T21:01:02.272 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T21:01:02.272 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T21:01:02.273 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T21:01:02.273 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T21:01:02.273 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T21:01:02.273 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T21:01:02.273 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T21:01:02.273 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T21:01:02.273 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T21:01:02.273 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T21:01:02.273 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T21:01:02.273 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T21:01:02.273 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T21:01:02.273 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T21:01:02.273 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T21:01:02.273 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T21:01:02.274 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T21:01:02.274 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T21:01:02.274 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T21:01:02.274 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T21:01:02.274 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T21:01:02.274 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T21:01:02.274 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T21:01:02.274 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T21:01:02.274 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T21:01:02.274 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T21:01:02.274 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T21:01:02.275 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T21:01:02.275 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T21:01:02.275 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T21:01:02.275 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T21:01:02.275 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T21:01:02.275 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T21:01:02.275 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T21:01:02.275 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T21:01:02.275 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T21:01:02.275 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T21:01:02.275 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T21:01:02.275 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T21:01:02.275 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-26T21:01:02.275 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T21:01:02.276 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T21:01:02.276 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T21:01:02.276 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T21:01:02.276 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-26T21:01:02.276 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T21:01:02.276 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T21:01:02.276 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T21:01:02.276 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T21:01:02.276 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T21:01:02.276 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T21:01:02.276 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T21:01:02.276 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T21:01:02.277 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T21:01:02.277 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T21:01:02.277 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T21:01:02.277 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T21:01:02.277 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T21:01:02.277 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T21:01:02.277 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T21:01:02.277 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T21:01:02.277 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T21:01:02.277 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T21:01:02.277 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T21:01:02.277 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T21:01:02.277 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T21:01:02.277 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T21:01:02.278 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T21:01:02.278 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T21:01:02.278 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T21:01:02.278 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T21:01:02.278 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T21:01:02.278 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T21:01:02.278 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T21:01:02.278 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T21:01:02.278 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T21:01:02.278 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T21:01:02.278 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T21:01:02.278 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T21:01:02.278 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T21:01:02.278 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T21:01:02.279 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T21:01:02.279 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T21:01:02.279 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T21:01:02.279 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T21:01:02.279 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T21:01:02.279 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T21:01:02.279 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T21:01:02.279 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T21:01:02.279 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T21:01:02.279 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T21:01:02.279 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T21:01:02.279 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T21:01:02.279 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T21:01:02.280 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T21:01:02.280 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T21:01:02.280 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T21:01:02.280 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T21:01:02.280 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T21:01:02.280 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T21:01:02.280 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T21:01:02.280 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T21:01:02.280 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T21:01:02.280 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T21:01:02.280 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T21:01:02.280 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T21:01:02.280 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T21:01:02.280 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T21:01:02.281 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T21:01:02.281 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T21:01:02.281 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T21:01:02.281 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T21:01:02.281 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T21:01:02.281 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T21:01:02.281 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T21:01:02.281 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T21:01:02.281 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-26T21:01:02.281 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T21:01:02.281 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-26T21:01:02.281 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T21:01:02.281 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-26T21:01:02.282 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T21:01:02.282 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T21:01:02.282 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T21:01:02.282 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T21:01:02.282 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-26T21:01:02.282 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T21:01:02.282 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-26T21:01:02.282 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T21:01:02.282 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T21:01:02.282 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T21:01:02.282 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-26T21:01:02.282 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T21:01:02.282 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T21:01:02.282 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T21:01:02.283 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T21:01:02.283 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T21:01:02.283 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T21:01:02.283 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T21:01:02.283 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T21:01:02.283 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T21:01:02.283 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T21:01:02.283 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T21:01:02.283 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T21:01:02.283 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T21:01:02.283 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T21:01:02.283 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T21:01:02.283 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T21:01:02.284 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T21:01:02.284 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T21:01:02.284 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T21:01:02.284 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T21:01:02.284 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T21:01:02.284 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T21:01:02.284 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T21:01:02.284 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T21:01:02.284 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T21:01:02.284 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T21:01:02.284 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T21:01:02.284 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T21:01:02.284 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T21:01:02.284 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T21:01:02.285 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T21:01:02.285 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T21:01:02.285 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T21:01:02.285 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T21:01:02.285 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T21:01:02.285 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T21:01:02.285 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T21:01:02.285 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T21:01:02.285 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T21:01:02.285 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T21:01:02.285 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T21:01:02.285 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T21:01:02.285 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T21:01:02.285 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-26T21:01:02.286 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T21:01:02.286 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T21:01:02.286 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-26T21:01:02.286 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-26T21:01:02.286 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T21:01:02.286 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T21:01:02.286 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T21:01:02.286 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-26T21:01:02.286 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T21:01:02.286 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-26T21:01:02.286 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T21:01:02.286 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T21:01:02.286 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-26T21:01:02.287 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T21:01:02.287 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-26T21:01:02.287 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T21:01:02.287 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T21:01:02.287 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T21:01:02.287 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T21:01:02.287 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T21:01:02.287 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-26T21:01:02.287 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T21:01:02.287 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-26T21:01:02.287 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-26T21:01:02.287 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-26T21:01:02.287 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-26T21:01:02.287 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-26T21:01:02.288 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-26T21:01:02.288 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T21:01:02.288 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T21:01:02.288 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T21:01:02.288 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T21:01:02.288 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T21:01:02.288 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T21:01:02.288 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T21:01:02.288 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T21:01:02.288 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T21:01:02.288 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T21:01:02.288 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T21:01:02.288 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T21:01:02.288 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T21:01:02.289 INFO:teuthology.orchestra.run.smithi120.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-26T21:01:02.293 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:02.293 DEBUG:teuthology.orchestra.run.smithi120:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-26T21:01:02.318 INFO:teuthology.orchestra.run.smithi120.stdout:postinstall scriptlet (using /bin/sh): 2024-04-26T21:01:02.319 INFO:teuthology.orchestra.run.smithi120.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-26T21:01:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-26T21:01:02.319 INFO:teuthology.orchestra.run.smithi120.stdout:fi 2024-04-26T21:01:02.319 INFO:teuthology.orchestra.run.smithi120.stdout:for file in vmlinuz System.map config; do 2024-04-26T21:01:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-26T21:01:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-26T21:01:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: fi 2024-04-26T21:01:02.319 INFO:teuthology.orchestra.run.smithi120.stdout:done 2024-04-26T21:01:02.319 INFO:teuthology.orchestra.run.smithi120.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-26T21:01:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-26T21:01:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-26T21:01:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-26T21:01:02.319 INFO:teuthology.orchestra.run.smithi120.stdout:fi 2024-04-26T21:01:02.319 INFO:teuthology.orchestra.run.smithi120.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-26T21:01:02.320 INFO:teuthology.orchestra.run.smithi120.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:02.320 INFO:teuthology.orchestra.run.smithi120.stdout:fi 2024-04-26T21:01:02.320 INFO:teuthology.orchestra.run.smithi120.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-26T21:01:02.320 INFO:teuthology.orchestra.run.smithi120.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-26T21:01:02.320 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:02.320 INFO:teuthology.orchestra.run.smithi120.stdout:fi 2024-04-26T21:01:02.321 DEBUG:teuthology.orchestra.run.smithi120:> sudo rpm -qi grub2-tools 2024-04-26T21:01:02.396 INFO:teuthology.orchestra.run.smithi120.stdout:Name : grub2-tools 2024-04-26T21:01:02.396 INFO:teuthology.orchestra.run.smithi120.stdout:Epoch : 1 2024-04-26T21:01:02.396 INFO:teuthology.orchestra.run.smithi120.stdout:Version : 2.06 2024-04-26T21:01:02.396 INFO:teuthology.orchestra.run.smithi120.stdout:Release : 68.el9 2024-04-26T21:01:02.396 INFO:teuthology.orchestra.run.smithi120.stdout:Architecture: x86_64 2024-04-26T21:01:02.396 INFO:teuthology.orchestra.run.smithi120.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-26T21:01:02.397 INFO:teuthology.orchestra.run.smithi120.stdout:Group : Unspecified 2024-04-26T21:01:02.397 INFO:teuthology.orchestra.run.smithi120.stdout:Size : 8264254 2024-04-26T21:01:02.397 INFO:teuthology.orchestra.run.smithi120.stdout:License : GPLv3+ 2024-04-26T21:01:02.397 INFO:teuthology.orchestra.run.smithi120.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-26T21:01:02.397 INFO:teuthology.orchestra.run.smithi120.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-26T21:01:02.397 INFO:teuthology.orchestra.run.smithi120.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-26T21:01:02.397 INFO:teuthology.orchestra.run.smithi120.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-26T21:01:02.397 INFO:teuthology.orchestra.run.smithi120.stdout:Packager : builder@centos.org 2024-04-26T21:01:02.397 INFO:teuthology.orchestra.run.smithi120.stdout:Vendor : CentOS 2024-04-26T21:01:02.397 INFO:teuthology.orchestra.run.smithi120.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T21:01:02.397 INFO:teuthology.orchestra.run.smithi120.stdout:Summary : Support tools for GRUB. 2024-04-26T21:01:02.397 INFO:teuthology.orchestra.run.smithi120.stdout:Description : 2024-04-26T21:01:02.397 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:01:02.397 INFO:teuthology.orchestra.run.smithi120.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T21:01:02.398 INFO:teuthology.orchestra.run.smithi120.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T21:01:02.398 INFO:teuthology.orchestra.run.smithi120.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T21:01:02.398 INFO:teuthology.orchestra.run.smithi120.stdout:hardware devices. 2024-04-26T21:01:02.398 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:01:02.398 INFO:teuthology.orchestra.run.smithi120.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T21:01:02.399 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T21:01:02.399 INFO:teuthology.task.kernel:Updating grub on smithi120 to boot 6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:02.399 DEBUG:teuthology.orchestra.run.smithi120:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T21:01:02.958 INFO:teuthology.orchestra.run.smithi120.stderr:Generating grub configuration file ... 2024-04-26T21:01:04.299 INFO:teuthology.orchestra.run.smithi120.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-26T21:01:04.356 INFO:teuthology.orchestra.run.smithi120.stderr:done 2024-04-26T21:01:04.358 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-04-26T21:01:04.373 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.DEEB67Ljov 2024-04-26T21:01:04.373 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.DEEB67Ljov 2024-04-26T21:01:04.439 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.DEEB67Ljov 2024-04-26T21:01:04.575 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.DEEB67Ljov is 6KB 2024-04-26T21:01:04.624 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.DEEB67Ljov 2024-04-26T21:01:04.639 DEBUG:teuthology.orchestra.run.smithi120:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T21:01:04.700 INFO:teuthology.orchestra.run.smithi120.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-26T21:01:04.700 INFO:teuthology.orchestra.run.smithi120.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-26T21:01:04.700 INFO:teuthology.orchestra.run.smithi120.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-26T21:01:04.700 INFO:teuthology.orchestra.run.smithi120.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-26T21:01:04.702 DEBUG:teuthology.orchestra.run.smithi120:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:04.841 DEBUG:teuthology.orchestra.run.smithi120:> sudo shutdown -r now 2024-04-26T21:01:11.163 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi084.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-26T21:01:11.163 DEBUG:teuthology.orchestra.run.smithi084:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-26T21:01:11.248 INFO:teuthology.orchestra.run.smithi084.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:11.248 INFO:teuthology.orchestra.run.smithi084.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:11.248 INFO:teuthology.orchestra.run.smithi084.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:11.248 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-26T21:01:11.248 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-26T21:01:11.249 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-26T21:01:11.249 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-26T21:01:11.249 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-26T21:01:11.249 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-26T21:01:11.249 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T21:01:11.249 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T21:01:11.249 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T21:01:11.249 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T21:01:11.249 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T21:01:11.249 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T21:01:11.249 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T21:01:11.249 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-26T21:01:11.250 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T21:01:11.250 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T21:01:11.250 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T21:01:11.250 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T21:01:11.250 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T21:01:11.250 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T21:01:11.250 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T21:01:11.250 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T21:01:11.250 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T21:01:11.250 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T21:01:11.250 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T21:01:11.251 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T21:01:11.251 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-26T21:01:11.251 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-26T21:01:11.251 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-26T21:01:11.251 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T21:01:11.251 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-26T21:01:11.251 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T21:01:11.251 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T21:01:11.251 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T21:01:11.251 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-26T21:01:11.251 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T21:01:11.251 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T21:01:11.252 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T21:01:11.252 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-26T21:01:11.252 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T21:01:11.252 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T21:01:11.252 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T21:01:11.252 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T21:01:11.252 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T21:01:11.252 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T21:01:11.252 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T21:01:11.252 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T21:01:11.252 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T21:01:11.252 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T21:01:11.253 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T21:01:11.253 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T21:01:11.253 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T21:01:11.253 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T21:01:11.253 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T21:01:11.253 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T21:01:11.253 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T21:01:11.253 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T21:01:11.253 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T21:01:11.253 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T21:01:11.253 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T21:01:11.253 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T21:01:11.254 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T21:01:11.254 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T21:01:11.254 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T21:01:11.254 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T21:01:11.254 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T21:01:11.254 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T21:01:11.254 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T21:01:11.254 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T21:01:11.254 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T21:01:11.254 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T21:01:11.255 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T21:01:11.255 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T21:01:11.255 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T21:01:11.255 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T21:01:11.255 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T21:01:11.255 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T21:01:11.255 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T21:01:11.255 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T21:01:11.255 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T21:01:11.255 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T21:01:11.255 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T21:01:11.255 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T21:01:11.256 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T21:01:11.256 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-26T21:01:11.256 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-26T21:01:11.256 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T21:01:11.256 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T21:01:11.256 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T21:01:11.256 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T21:01:11.256 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T21:01:11.256 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T21:01:11.256 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T21:01:11.256 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-26T21:01:11.256 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T21:01:11.257 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T21:01:11.257 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-26T21:01:11.257 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T21:01:11.257 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T21:01:11.257 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T21:01:11.257 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T21:01:11.257 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T21:01:11.257 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T21:01:11.257 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T21:01:11.257 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T21:01:11.257 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T21:01:11.257 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T21:01:11.258 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T21:01:11.258 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T21:01:11.258 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T21:01:11.258 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T21:01:11.258 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T21:01:11.258 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T21:01:11.258 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T21:01:11.258 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T21:01:11.258 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T21:01:11.258 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T21:01:11.258 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T21:01:11.258 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T21:01:11.259 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T21:01:11.259 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T21:01:11.259 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T21:01:11.259 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T21:01:11.259 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T21:01:11.259 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T21:01:11.259 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T21:01:11.259 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T21:01:11.259 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T21:01:11.259 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T21:01:11.259 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T21:01:11.260 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T21:01:11.260 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T21:01:11.260 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-26T21:01:11.260 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T21:01:11.260 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T21:01:11.260 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T21:01:11.260 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T21:01:11.260 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T21:01:11.260 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T21:01:11.260 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T21:01:11.260 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T21:01:11.260 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T21:01:11.260 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T21:01:11.261 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T21:01:11.261 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T21:01:11.261 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T21:01:11.261 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T21:01:11.261 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T21:01:11.261 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T21:01:11.261 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T21:01:11.261 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-26T21:01:11.261 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T21:01:11.261 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-26T21:01:11.261 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-26T21:01:11.262 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-26T21:01:11.262 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-26T21:01:11.262 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-26T21:01:11.262 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T21:01:11.262 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-26T21:01:11.262 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-26T21:01:11.262 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T21:01:11.262 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-26T21:01:11.262 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-26T21:01:11.262 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T21:01:11.262 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T21:01:11.262 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-26T21:01:11.263 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-26T21:01:11.263 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T21:01:11.263 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T21:01:11.263 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-26T21:01:11.263 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T21:01:11.263 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T21:01:11.263 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T21:01:11.263 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-26T21:01:11.263 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-26T21:01:11.263 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T21:01:11.263 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-26T21:01:11.263 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-26T21:01:11.264 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T21:01:11.264 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-26T21:01:11.264 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T21:01:11.264 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-26T21:01:11.264 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T21:01:11.264 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T21:01:11.264 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T21:01:11.264 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T21:01:11.264 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T21:01:11.264 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-26T21:01:11.264 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T21:01:11.264 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T21:01:11.265 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T21:01:11.265 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T21:01:11.265 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T21:01:11.265 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T21:01:11.265 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T21:01:11.265 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-26T21:01:11.265 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T21:01:11.265 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T21:01:11.265 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T21:01:11.265 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-26T21:01:11.265 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-26T21:01:11.266 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T21:01:11.266 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T21:01:11.266 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T21:01:11.266 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-26T21:01:11.266 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-26T21:01:11.266 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-26T21:01:11.266 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-26T21:01:11.266 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-26T21:01:11.266 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-26T21:01:11.266 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T21:01:11.266 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T21:01:11.267 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-26T21:01:11.267 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-26T21:01:11.267 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T21:01:11.267 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-26T21:01:11.267 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-26T21:01:11.267 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T21:01:11.267 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T21:01:11.267 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-26T21:01:11.267 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-26T21:01:11.267 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-26T21:01:11.267 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T21:01:11.267 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-26T21:01:11.268 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T21:01:11.268 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T21:01:11.268 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T21:01:11.268 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-26T21:01:11.268 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T21:01:11.268 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-26T21:01:11.268 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T21:01:11.268 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-26T21:01:11.268 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-26T21:01:11.268 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-26T21:01:11.268 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-26T21:01:11.269 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T21:01:11.269 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-26T21:01:11.269 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T21:01:11.269 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-26T21:01:11.269 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T21:01:11.269 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T21:01:11.269 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T21:01:11.269 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T21:01:11.269 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T21:01:11.269 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T21:01:11.269 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T21:01:11.270 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T21:01:11.270 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T21:01:11.270 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T21:01:11.270 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T21:01:11.270 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T21:01:11.270 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T21:01:11.270 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-26T21:01:11.270 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-26T21:01:11.270 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T21:01:11.270 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-26T21:01:11.270 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T21:01:11.270 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T21:01:11.271 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-26T21:01:11.271 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T21:01:11.271 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T21:01:11.271 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T21:01:11.271 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T21:01:11.271 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T21:01:11.271 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T21:01:11.271 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T21:01:11.271 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T21:01:11.271 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T21:01:11.271 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T21:01:11.272 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T21:01:11.272 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T21:01:11.272 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T21:01:11.272 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T21:01:11.272 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T21:01:11.272 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T21:01:11.272 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T21:01:11.272 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T21:01:11.272 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T21:01:11.272 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T21:01:11.272 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T21:01:11.272 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T21:01:11.273 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T21:01:11.273 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T21:01:11.273 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T21:01:11.273 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T21:01:11.273 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T21:01:11.273 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T21:01:11.273 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T21:01:11.273 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T21:01:11.273 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T21:01:11.273 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T21:01:11.273 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T21:01:11.273 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T21:01:11.274 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T21:01:11.274 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T21:01:11.274 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T21:01:11.274 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T21:01:11.274 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T21:01:11.274 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T21:01:11.274 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T21:01:11.274 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T21:01:11.274 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T21:01:11.274 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T21:01:11.274 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T21:01:11.275 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T21:01:11.275 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T21:01:11.275 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T21:01:11.275 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T21:01:11.275 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T21:01:11.275 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T21:01:11.275 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T21:01:11.275 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T21:01:11.275 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T21:01:11.275 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T21:01:11.275 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T21:01:11.275 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T21:01:11.276 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T21:01:11.276 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T21:01:11.276 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T21:01:11.276 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T21:01:11.276 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T21:01:11.276 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T21:01:11.276 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T21:01:11.276 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-26T21:01:11.276 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T21:01:11.276 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T21:01:11.276 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T21:01:11.276 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-26T21:01:11.277 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T21:01:11.277 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T21:01:11.277 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T21:01:11.277 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T21:01:11.277 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T21:01:11.277 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T21:01:11.277 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T21:01:11.277 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T21:01:11.277 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T21:01:11.277 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T21:01:11.277 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T21:01:11.277 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T21:01:11.278 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T21:01:11.278 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T21:01:11.278 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T21:01:11.278 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T21:01:11.278 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T21:01:11.278 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T21:01:11.278 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T21:01:11.278 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T21:01:11.278 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T21:01:11.278 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T21:01:11.278 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T21:01:11.278 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T21:01:11.279 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T21:01:11.279 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T21:01:11.279 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T21:01:11.279 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T21:01:11.279 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T21:01:11.279 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T21:01:11.279 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T21:01:11.279 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T21:01:11.279 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T21:01:11.279 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T21:01:11.279 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T21:01:11.279 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T21:01:11.279 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T21:01:11.280 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T21:01:11.280 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T21:01:11.280 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T21:01:11.280 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T21:01:11.280 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T21:01:11.280 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T21:01:11.280 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T21:01:11.280 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T21:01:11.280 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T21:01:11.280 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T21:01:11.280 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T21:01:11.281 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T21:01:11.281 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T21:01:11.281 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T21:01:11.281 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T21:01:11.281 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T21:01:11.281 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T21:01:11.281 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T21:01:11.281 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T21:01:11.281 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T21:01:11.281 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T21:01:11.281 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T21:01:11.281 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T21:01:11.281 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T21:01:11.282 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T21:01:11.282 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T21:01:11.282 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T21:01:11.282 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T21:01:11.282 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T21:01:11.282 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T21:01:11.282 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T21:01:11.282 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T21:01:11.282 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T21:01:11.282 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T21:01:11.282 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T21:01:11.283 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T21:01:11.283 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T21:01:11.283 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T21:01:11.283 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T21:01:11.283 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T21:01:11.283 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T21:01:11.283 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T21:01:11.283 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T21:01:11.283 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T21:01:11.283 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T21:01:11.283 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T21:01:11.284 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T21:01:11.284 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T21:01:11.284 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T21:01:11.284 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T21:01:11.284 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T21:01:11.284 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-26T21:01:11.284 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T21:01:11.284 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T21:01:11.284 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T21:01:11.284 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T21:01:11.284 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T21:01:11.285 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T21:01:11.285 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T21:01:11.285 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T21:01:11.285 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T21:01:11.285 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T21:01:11.285 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T21:01:11.285 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T21:01:11.285 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T21:01:11.285 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T21:01:11.285 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T21:01:11.285 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T21:01:11.285 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T21:01:11.286 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T21:01:11.286 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T21:01:11.286 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T21:01:11.286 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T21:01:11.286 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T21:01:11.286 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T21:01:11.286 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T21:01:11.286 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T21:01:11.286 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T21:01:11.286 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T21:01:11.286 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T21:01:11.286 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T21:01:11.287 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T21:01:11.287 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T21:01:11.287 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T21:01:11.287 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T21:01:11.287 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T21:01:11.287 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T21:01:11.287 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T21:01:11.287 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T21:01:11.287 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T21:01:11.287 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T21:01:11.287 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T21:01:11.288 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T21:01:11.288 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-26T21:01:11.288 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-26T21:01:11.288 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T21:01:11.288 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T21:01:11.288 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-26T21:01:11.288 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T21:01:11.288 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T21:01:11.288 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T21:01:11.288 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T21:01:11.288 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T21:01:11.288 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T21:01:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T21:01:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T21:01:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T21:01:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T21:01:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T21:01:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T21:01:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T21:01:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T21:01:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T21:01:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T21:01:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T21:01:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T21:01:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T21:01:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T21:01:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T21:01:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T21:01:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T21:01:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-26T21:01:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T21:01:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-26T21:01:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T21:01:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T21:01:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-26T21:01:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-26T21:01:11.291 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T21:01:11.291 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T21:01:11.291 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T21:01:11.291 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T21:01:11.291 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T21:01:11.291 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T21:01:11.291 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T21:01:11.291 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-26T21:01:11.291 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-26T21:01:11.291 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T21:01:11.291 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-26T21:01:11.291 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T21:01:11.291 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-26T21:01:11.292 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T21:01:11.292 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-26T21:01:11.292 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T21:01:11.292 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-26T21:01:11.292 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-26T21:01:11.292 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T21:01:11.292 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-26T21:01:11.292 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T21:01:11.292 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-26T21:01:11.292 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T21:01:11.292 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-26T21:01:11.292 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T21:01:11.293 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-26T21:01:11.293 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T21:01:11.293 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-26T21:01:11.293 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-26T21:01:11.293 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T21:01:11.293 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T21:01:11.293 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T21:01:11.293 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T21:01:11.293 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-26T21:01:11.293 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T21:01:11.293 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-26T21:01:11.293 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T21:01:11.293 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T21:01:11.294 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T21:01:11.294 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T21:01:11.294 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T21:01:11.294 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T21:01:11.294 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T21:01:11.294 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T21:01:11.294 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-26T21:01:11.294 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T21:01:11.294 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-26T21:01:11.294 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T21:01:11.294 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T21:01:11.295 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T21:01:11.295 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T21:01:11.295 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T21:01:11.295 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-26T21:01:11.295 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T21:01:11.295 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T21:01:11.295 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T21:01:11.295 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T21:01:11.295 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-26T21:01:11.295 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T21:01:11.295 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T21:01:11.295 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T21:01:11.295 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T21:01:11.296 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T21:01:11.296 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T21:01:11.296 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T21:01:11.296 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T21:01:11.296 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T21:01:11.296 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-26T21:01:11.296 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-26T21:01:11.296 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T21:01:11.296 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T21:01:11.296 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T21:01:11.296 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T21:01:11.296 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T21:01:11.297 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T21:01:11.297 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T21:01:11.297 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T21:01:11.297 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T21:01:11.297 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T21:01:11.297 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T21:01:11.297 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T21:01:11.297 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T21:01:11.297 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T21:01:11.297 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T21:01:11.297 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T21:01:11.297 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-26T21:01:11.298 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T21:01:11.298 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T21:01:11.298 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T21:01:11.298 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T21:01:11.298 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T21:01:11.298 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-26T21:01:11.298 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-26T21:01:11.298 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T21:01:11.298 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T21:01:11.298 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T21:01:11.298 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T21:01:11.298 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T21:01:11.299 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T21:01:11.299 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T21:01:11.299 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-26T21:01:11.299 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T21:01:11.299 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T21:01:11.299 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-26T21:01:11.299 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T21:01:11.299 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T21:01:11.299 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T21:01:11.299 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T21:01:11.299 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-26T21:01:11.299 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-26T21:01:11.299 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T21:01:11.300 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T21:01:11.300 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T21:01:11.300 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T21:01:11.300 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-26T21:01:11.300 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T21:01:11.300 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-26T21:01:11.300 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T21:01:11.300 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T21:01:11.300 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T21:01:11.300 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T21:01:11.300 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T21:01:11.300 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T21:01:11.301 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T21:01:11.301 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-26T21:01:11.301 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T21:01:11.301 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T21:01:11.301 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-26T21:01:11.301 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T21:01:11.301 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T21:01:11.301 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T21:01:11.301 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-26T21:01:11.301 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-26T21:01:11.301 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-26T21:01:11.301 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-26T21:01:11.301 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-26T21:01:11.302 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-26T21:01:11.302 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T21:01:11.302 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T21:01:11.302 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T21:01:11.302 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T21:01:11.302 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-26T21:01:11.302 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T21:01:11.302 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-26T21:01:11.302 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-26T21:01:11.302 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T21:01:11.302 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-26T21:01:11.302 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-26T21:01:11.303 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T21:01:11.303 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T21:01:11.303 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T21:01:11.303 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-26T21:01:11.303 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T21:01:11.303 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T21:01:11.303 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T21:01:11.303 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-26T21:01:11.303 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-26T21:01:11.303 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T21:01:11.303 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T21:01:11.303 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T21:01:11.304 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T21:01:11.304 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-26T21:01:11.304 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T21:01:11.304 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T21:01:11.304 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T21:01:11.304 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T21:01:11.304 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-26T21:01:11.304 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T21:01:11.304 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-26T21:01:11.304 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T21:01:11.304 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-26T21:01:11.304 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T21:01:11.304 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-26T21:01:11.305 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T21:01:11.305 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-26T21:01:11.305 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T21:01:11.305 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T21:01:11.305 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T21:01:11.305 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-26T21:01:11.305 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-26T21:01:11.305 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T21:01:11.305 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-26T21:01:11.305 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T21:01:11.305 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-26T21:01:11.305 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T21:01:11.305 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-26T21:01:11.306 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T21:01:11.306 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T21:01:11.306 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-26T21:01:11.306 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T21:01:11.306 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T21:01:11.306 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-26T21:01:11.306 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T21:01:11.306 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T21:01:11.306 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-26T21:01:11.306 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T21:01:11.306 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T21:01:11.306 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-26T21:01:11.307 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-26T21:01:11.307 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T21:01:11.307 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-26T21:01:11.307 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-26T21:01:11.307 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T21:01:11.307 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-26T21:01:11.307 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T21:01:11.307 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-26T21:01:11.307 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T21:01:11.307 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-26T21:01:11.307 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T21:01:11.307 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-26T21:01:11.308 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T21:01:11.308 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-26T21:01:11.308 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-26T21:01:11.308 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T21:01:11.308 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-26T21:01:11.308 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-26T21:01:11.308 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T21:01:11.308 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T21:01:11.308 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T21:01:11.308 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T21:01:11.308 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T21:01:11.309 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T21:01:11.309 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-26T21:01:11.309 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T21:01:11.309 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T21:01:11.309 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T21:01:11.309 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-26T21:01:11.309 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-26T21:01:11.309 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T21:01:11.309 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T21:01:11.309 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T21:01:11.309 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-26T21:01:11.309 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T21:01:11.309 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-26T21:01:11.309 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T21:01:11.310 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-26T21:01:11.310 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T21:01:11.310 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-26T21:01:11.310 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T21:01:11.310 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-26T21:01:11.310 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T21:01:11.310 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-26T21:01:11.310 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T21:01:11.310 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-26T21:01:11.310 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T21:01:11.310 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-26T21:01:11.310 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T21:01:11.311 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-26T21:01:11.311 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T21:01:11.311 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-26T21:01:11.311 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T21:01:11.311 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T21:01:11.311 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-26T21:01:11.311 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T21:01:11.311 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T21:01:11.311 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T21:01:11.311 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-26T21:01:11.311 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-26T21:01:11.311 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T21:01:11.311 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T21:01:11.312 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-26T21:01:11.312 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-26T21:01:11.312 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T21:01:11.312 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-26T21:01:11.312 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T21:01:11.312 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-26T21:01:11.312 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-26T21:01:11.312 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T21:01:11.312 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-26T21:01:11.312 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T21:01:11.312 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T21:01:11.312 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-26T21:01:11.312 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T21:01:11.313 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-26T21:01:11.313 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T21:01:11.313 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-26T21:01:11.313 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T21:01:11.313 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T21:01:11.313 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-26T21:01:11.313 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-26T21:01:11.313 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T21:01:11.313 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T21:01:11.313 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-26T21:01:11.313 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T21:01:11.313 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-26T21:01:11.313 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T21:01:11.313 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-26T21:01:11.314 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T21:01:11.314 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T21:01:11.314 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T21:01:11.314 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T21:01:11.314 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-26T21:01:11.314 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-26T21:01:11.314 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-26T21:01:11.314 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T21:01:11.314 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-26T21:01:11.314 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T21:01:11.314 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-26T21:01:11.315 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T21:01:11.315 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T21:01:11.315 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-26T21:01:11.315 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T21:01:11.315 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T21:01:11.315 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T21:01:11.315 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T21:01:11.315 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-26T21:01:11.315 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-26T21:01:11.315 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T21:01:11.315 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T21:01:11.315 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-26T21:01:11.316 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T21:01:11.316 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T21:01:11.316 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T21:01:11.316 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T21:01:11.316 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-26T21:01:11.316 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T21:01:11.316 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-26T21:01:11.316 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T21:01:11.316 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-26T21:01:11.316 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T21:01:11.316 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T21:01:11.316 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-26T21:01:11.316 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T21:01:11.317 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T21:01:11.317 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-26T21:01:11.317 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T21:01:11.317 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T21:01:11.317 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-26T21:01:11.317 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T21:01:11.317 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-26T21:01:11.317 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T21:01:11.317 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T21:01:11.317 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-26T21:01:11.317 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T21:01:11.318 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T21:01:11.318 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T21:01:11.318 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-26T21:01:11.318 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T21:01:11.318 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T21:01:11.318 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T21:01:11.318 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T21:01:11.318 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T21:01:11.318 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-26T21:01:11.318 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T21:01:11.318 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T21:01:11.318 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-26T21:01:11.319 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T21:01:11.319 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T21:01:11.319 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-26T21:01:11.319 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T21:01:11.319 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T21:01:11.319 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-26T21:01:11.319 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T21:01:11.319 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T21:01:11.319 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T21:01:11.319 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T21:01:11.319 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T21:01:11.319 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-26T21:01:11.320 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T21:01:11.320 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T21:01:11.320 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T21:01:11.320 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T21:01:11.320 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T21:01:11.320 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T21:01:11.320 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T21:01:11.320 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T21:01:11.320 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T21:01:11.320 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T21:01:11.320 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T21:01:11.320 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T21:01:11.321 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-26T21:01:11.321 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T21:01:11.321 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T21:01:11.321 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T21:01:11.321 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-26T21:01:11.321 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T21:01:11.321 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T21:01:11.321 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T21:01:11.321 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T21:01:11.321 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T21:01:11.321 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-26T21:01:11.321 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-26T21:01:11.322 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T21:01:11.322 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T21:01:11.322 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T21:01:11.322 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-26T21:01:11.322 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T21:01:11.322 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T21:01:11.322 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T21:01:11.322 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T21:01:11.322 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T21:01:11.322 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T21:01:11.322 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-26T21:01:11.322 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T21:01:11.323 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-26T21:01:11.323 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-26T21:01:11.323 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T21:01:11.323 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-26T21:01:11.323 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T21:01:11.323 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-26T21:01:11.323 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T21:01:11.323 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-26T21:01:11.323 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-26T21:01:11.323 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T21:01:11.323 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-26T21:01:11.323 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-26T21:01:11.324 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T21:01:11.324 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T21:01:11.324 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-26T21:01:11.324 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T21:01:11.324 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T21:01:11.324 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T21:01:11.324 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T21:01:11.324 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-26T21:01:11.324 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-26T21:01:11.324 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T21:01:11.324 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-26T21:01:11.324 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-26T21:01:11.324 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T21:01:11.325 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-26T21:01:11.325 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T21:01:11.325 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T21:01:11.325 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T21:01:11.325 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-26T21:01:11.325 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-26T21:01:11.325 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T21:01:11.325 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-26T21:01:11.325 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-26T21:01:11.325 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T21:01:11.325 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T21:01:11.325 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T21:01:11.326 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T21:01:11.326 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T21:01:11.326 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T21:01:11.326 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T21:01:11.326 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T21:01:11.326 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T21:01:11.326 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T21:01:11.326 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T21:01:11.326 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T21:01:11.326 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-26T21:01:11.326 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T21:01:11.326 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T21:01:11.327 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T21:01:11.327 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T21:01:11.327 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T21:01:11.327 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T21:01:11.327 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T21:01:11.327 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T21:01:11.327 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T21:01:11.327 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T21:01:11.327 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T21:01:11.327 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T21:01:11.327 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-26T21:01:11.327 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T21:01:11.328 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T21:01:11.328 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-26T21:01:11.328 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-26T21:01:11.328 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T21:01:11.328 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T21:01:11.328 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T21:01:11.328 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T21:01:11.328 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-26T21:01:11.328 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T21:01:11.328 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T21:01:11.328 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-26T21:01:11.328 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-26T21:01:11.329 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-26T21:01:11.329 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T21:01:11.329 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T21:01:11.329 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-26T21:01:11.329 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T21:01:11.329 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T21:01:11.329 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T21:01:11.329 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T21:01:11.329 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T21:01:11.329 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T21:01:11.329 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T21:01:11.329 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T21:01:11.329 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T21:01:11.330 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T21:01:11.330 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T21:01:11.330 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T21:01:11.330 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T21:01:11.330 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T21:01:11.330 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T21:01:11.330 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T21:01:11.330 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T21:01:11.330 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T21:01:11.330 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T21:01:11.330 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T21:01:11.331 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T21:01:11.331 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T21:01:11.331 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T21:01:11.331 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T21:01:11.331 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T21:01:11.331 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T21:01:11.331 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T21:01:11.331 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T21:01:11.331 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T21:01:11.331 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T21:01:11.331 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T21:01:11.331 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-26T21:01:11.332 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T21:01:11.332 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T21:01:11.332 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T21:01:11.332 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T21:01:11.332 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T21:01:11.332 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-26T21:01:11.332 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T21:01:11.332 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T21:01:11.332 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-26T21:01:11.332 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T21:01:11.332 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T21:01:11.332 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T21:01:11.332 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-26T21:01:11.332 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T21:01:11.333 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T21:01:11.333 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-26T21:01:11.333 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T21:01:11.333 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-26T21:01:11.333 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T21:01:11.333 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-26T21:01:11.333 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T21:01:11.333 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-26T21:01:11.333 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T21:01:11.333 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T21:01:11.333 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-26T21:01:11.333 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T21:01:11.334 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-26T21:01:11.334 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-26T21:01:11.334 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T21:01:11.334 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-26T21:01:11.334 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T21:01:11.334 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T21:01:11.334 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T21:01:11.334 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-26T21:01:11.334 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-26T21:01:11.334 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-26T21:01:11.334 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-26T21:01:11.334 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-26T21:01:11.335 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T21:01:11.335 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-26T21:01:11.335 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T21:01:11.335 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T21:01:11.335 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-26T21:01:11.335 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T21:01:11.335 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T21:01:11.335 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-26T21:01:11.335 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T21:01:11.335 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T21:01:11.335 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T21:01:11.336 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T21:01:11.336 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T21:01:11.336 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T21:01:11.336 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T21:01:11.336 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-26T21:01:11.336 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T21:01:11.336 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T21:01:11.336 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T21:01:11.336 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-26T21:01:11.336 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T21:01:11.336 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T21:01:11.336 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T21:01:11.337 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-26T21:01:11.337 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T21:01:11.337 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-26T21:01:11.337 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T21:01:11.337 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-26T21:01:11.337 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T21:01:11.337 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T21:01:11.337 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T21:01:11.337 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T21:01:11.337 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-26T21:01:11.337 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T21:01:11.337 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-26T21:01:11.338 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T21:01:11.338 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T21:01:11.338 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-26T21:01:11.338 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T21:01:11.338 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T21:01:11.338 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T21:01:11.338 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-26T21:01:11.338 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T21:01:11.338 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T21:01:11.338 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-26T21:01:11.338 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T21:01:11.339 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T21:01:11.339 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T21:01:11.339 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T21:01:11.339 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T21:01:11.339 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T21:01:11.339 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T21:01:11.339 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T21:01:11.339 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T21:01:11.339 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T21:01:11.339 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T21:01:11.339 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-26T21:01:11.339 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T21:01:11.339 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T21:01:11.339 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T21:01:11.340 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T21:01:11.340 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-26T21:01:11.340 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T21:01:11.340 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-26T21:01:11.340 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-26T21:01:11.340 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T21:01:11.340 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-26T21:01:11.340 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T21:01:11.340 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T21:01:11.340 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T21:01:11.340 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T21:01:11.340 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T21:01:11.340 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T21:01:11.340 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-26T21:01:11.341 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T21:01:11.341 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-26T21:01:11.341 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-26T21:01:11.341 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-26T21:01:11.341 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T21:01:11.341 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T21:01:11.341 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T21:01:11.341 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T21:01:11.341 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T21:01:11.341 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T21:01:11.341 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T21:01:11.341 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T21:01:11.341 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T21:01:11.341 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T21:01:11.342 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T21:01:11.342 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T21:01:11.342 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T21:01:11.342 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T21:01:11.342 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T21:01:11.342 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T21:01:11.342 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T21:01:11.342 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T21:01:11.342 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-26T21:01:11.342 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-26T21:01:11.342 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T21:01:11.343 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T21:01:11.343 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T21:01:11.343 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T21:01:11.343 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-26T21:01:11.343 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-26T21:01:11.343 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T21:01:11.343 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T21:01:11.343 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-26T21:01:11.343 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T21:01:11.343 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-26T21:01:11.343 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-26T21:01:11.343 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T21:01:11.344 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-26T21:01:11.344 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T21:01:11.344 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-26T21:01:11.344 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T21:01:11.344 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T21:01:11.344 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T21:01:11.344 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T21:01:11.344 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T21:01:11.344 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-26T21:01:11.344 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-26T21:01:11.344 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T21:01:11.344 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T21:01:11.344 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T21:01:11.345 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T21:01:11.345 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-26T21:01:11.345 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T21:01:11.345 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-26T21:01:11.345 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T21:01:11.345 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T21:01:11.345 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-26T21:01:11.345 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T21:01:11.345 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T21:01:11.345 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T21:01:11.345 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T21:01:11.345 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T21:01:11.345 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T21:01:11.345 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T21:01:11.346 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T21:01:11.346 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T21:01:11.346 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T21:01:11.346 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-26T21:01:11.346 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T21:01:11.346 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T21:01:11.346 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T21:01:11.346 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T21:01:11.346 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T21:01:11.346 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T21:01:11.346 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T21:01:11.347 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-26T21:01:11.347 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T21:01:11.347 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-26T21:01:11.347 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T21:01:11.347 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T21:01:11.347 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T21:01:11.347 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T21:01:11.347 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T21:01:11.347 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T21:01:11.347 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T21:01:11.347 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T21:01:11.347 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T21:01:11.348 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T21:01:11.348 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T21:01:11.348 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T21:01:11.348 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T21:01:11.348 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T21:01:11.348 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T21:01:11.348 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T21:01:11.348 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T21:01:11.348 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T21:01:11.348 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T21:01:11.348 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T21:01:11.348 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T21:01:11.348 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T21:01:11.349 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T21:01:11.349 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T21:01:11.349 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T21:01:11.349 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T21:01:11.349 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T21:01:11.349 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T21:01:11.349 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T21:01:11.349 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T21:01:11.349 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T21:01:11.349 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T21:01:11.349 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T21:01:11.349 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T21:01:11.350 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T21:01:11.350 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T21:01:11.350 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T21:01:11.350 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T21:01:11.350 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T21:01:11.350 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T21:01:11.350 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T21:01:11.350 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T21:01:11.350 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T21:01:11.350 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T21:01:11.350 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T21:01:11.350 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-26T21:01:11.351 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T21:01:11.351 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T21:01:11.351 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T21:01:11.351 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T21:01:11.351 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T21:01:11.351 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T21:01:11.351 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T21:01:11.351 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T21:01:11.351 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T21:01:11.351 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T21:01:11.351 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T21:01:11.351 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T21:01:11.352 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T21:01:11.352 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T21:01:11.352 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T21:01:11.352 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-26T21:01:11.352 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T21:01:11.352 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T21:01:11.352 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T21:01:11.352 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-26T21:01:11.352 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-26T21:01:11.352 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T21:01:11.352 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T21:01:11.353 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T21:01:11.353 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T21:01:11.353 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-26T21:01:11.353 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T21:01:11.353 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T21:01:11.353 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T21:01:11.353 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T21:01:11.353 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-26T21:01:11.353 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-26T21:01:11.353 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T21:01:11.353 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T21:01:11.353 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T21:01:11.354 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-26T21:01:11.354 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-26T21:01:11.354 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-26T21:01:11.354 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-26T21:01:11.354 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-26T21:01:11.354 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-26T21:01:11.354 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-26T21:01:11.354 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-26T21:01:11.354 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-26T21:01:11.354 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-26T21:01:11.354 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T21:01:11.354 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T21:01:11.355 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-26T21:01:11.355 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T21:01:11.355 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T21:01:11.355 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T21:01:11.355 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T21:01:11.355 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T21:01:11.355 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T21:01:11.355 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T21:01:11.355 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T21:01:11.355 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T21:01:11.355 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T21:01:11.355 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T21:01:11.355 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T21:01:11.356 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-26T21:01:11.356 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T21:01:11.356 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T21:01:11.356 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T21:01:11.356 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T21:01:11.356 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T21:01:11.356 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T21:01:11.356 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T21:01:11.356 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T21:01:11.356 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T21:01:11.356 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T21:01:11.356 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T21:01:11.356 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T21:01:11.357 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T21:01:11.357 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T21:01:11.357 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T21:01:11.357 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T21:01:11.357 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T21:01:11.357 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T21:01:11.357 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T21:01:11.357 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T21:01:11.357 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T21:01:11.357 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T21:01:11.357 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T21:01:11.357 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T21:01:11.358 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T21:01:11.358 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T21:01:11.358 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-26T21:01:11.358 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-26T21:01:11.358 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T21:01:11.358 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T21:01:11.358 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T21:01:11.358 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-26T21:01:11.358 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T21:01:11.358 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T21:01:11.358 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-26T21:01:11.358 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T21:01:11.359 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-26T21:01:11.359 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-26T21:01:11.359 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T21:01:11.359 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-26T21:01:11.359 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T21:01:11.359 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-26T21:01:11.359 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T21:01:11.359 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T21:01:11.359 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-26T21:01:11.359 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T21:01:11.359 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-26T21:01:11.359 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T21:01:11.360 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-26T21:01:11.360 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T21:01:11.360 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-26T21:01:11.360 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T21:01:11.360 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-26T21:01:11.360 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T21:01:11.360 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-26T21:01:11.360 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T21:01:11.360 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-26T21:01:11.360 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-26T21:01:11.360 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-26T21:01:11.360 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T21:01:11.360 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-26T21:01:11.360 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-26T21:01:11.361 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T21:01:11.361 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-26T21:01:11.361 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-26T21:01:11.361 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T21:01:11.361 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-26T21:01:11.361 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-26T21:01:11.361 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T21:01:11.361 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-26T21:01:11.361 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T21:01:11.361 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-26T21:01:11.361 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T21:01:11.361 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-26T21:01:11.362 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T21:01:11.362 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-26T21:01:11.362 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T21:01:11.362 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-26T21:01:11.362 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T21:01:11.362 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-26T21:01:11.362 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T21:01:11.362 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-26T21:01:11.362 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T21:01:11.362 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-26T21:01:11.362 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-26T21:01:11.362 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T21:01:11.363 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-26T21:01:11.363 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T21:01:11.363 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-26T21:01:11.363 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T21:01:11.363 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T21:01:11.363 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T21:01:11.363 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T21:01:11.363 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-26T21:01:11.363 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T21:01:11.363 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T21:01:11.363 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-26T21:01:11.363 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T21:01:11.364 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-26T21:01:11.364 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T21:01:11.364 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-26T21:01:11.364 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T21:01:11.364 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T21:01:11.364 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T21:01:11.364 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T21:01:11.364 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T21:01:11.364 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T21:01:11.364 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T21:01:11.364 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T21:01:11.364 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T21:01:11.365 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T21:01:11.365 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T21:01:11.365 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T21:01:11.365 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T21:01:11.365 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T21:01:11.365 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T21:01:11.365 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T21:01:11.365 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T21:01:11.365 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T21:01:11.365 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T21:01:11.365 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T21:01:11.365 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T21:01:11.366 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T21:01:11.366 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T21:01:11.366 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T21:01:11.366 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T21:01:11.366 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T21:01:11.366 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T21:01:11.366 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T21:01:11.366 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T21:01:11.366 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T21:01:11.366 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T21:01:11.366 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T21:01:11.366 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T21:01:11.367 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T21:01:11.367 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T21:01:11.367 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T21:01:11.367 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T21:01:11.367 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T21:01:11.367 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T21:01:11.367 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T21:01:11.367 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T21:01:11.367 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T21:01:11.367 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T21:01:11.367 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T21:01:11.368 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T21:01:11.368 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T21:01:11.368 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T21:01:11.368 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T21:01:11.368 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T21:01:11.368 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T21:01:11.368 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-26T21:01:11.368 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-26T21:01:11.368 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T21:01:11.368 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-26T21:01:11.368 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T21:01:11.368 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-26T21:01:11.368 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T21:01:11.369 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T21:01:11.369 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T21:01:11.369 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T21:01:11.369 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T21:01:11.369 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-26T21:01:11.369 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T21:01:11.369 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-26T21:01:11.369 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T21:01:11.369 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-26T21:01:11.369 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T21:01:11.369 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-26T21:01:11.369 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T21:01:11.370 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-26T21:01:11.370 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-26T21:01:11.370 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T21:01:11.370 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-26T21:01:11.370 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T21:01:11.370 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T21:01:11.370 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-26T21:01:11.370 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T21:01:11.370 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-26T21:01:11.370 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T21:01:11.370 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-26T21:01:11.370 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T21:01:11.371 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-26T21:01:11.371 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T21:01:11.371 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-26T21:01:11.371 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T21:01:11.371 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-26T21:01:11.371 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-26T21:01:11.371 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-26T21:01:11.371 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T21:01:11.371 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-26T21:01:11.371 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-26T21:01:11.371 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-26T21:01:11.372 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-26T21:01:11.372 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T21:01:11.372 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T21:01:11.372 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-26T21:01:11.372 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T21:01:11.372 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T21:01:11.372 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T21:01:11.372 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T21:01:11.372 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-26T21:01:11.372 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T21:01:11.372 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T21:01:11.372 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-26T21:01:11.373 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T21:01:11.373 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-26T21:01:11.373 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T21:01:11.373 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-26T21:01:11.373 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T21:01:11.373 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T21:01:11.373 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T21:01:11.373 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T21:01:11.373 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-26T21:01:11.373 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-26T21:01:11.373 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-26T21:01:11.373 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T21:01:11.374 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-26T21:01:11.374 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-26T21:01:11.374 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T21:01:11.374 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T21:01:11.374 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T21:01:11.374 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T21:01:11.374 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T21:01:11.374 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T21:01:11.374 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T21:01:11.374 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T21:01:11.374 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-26T21:01:11.374 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T21:01:11.375 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T21:01:11.375 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T21:01:11.375 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T21:01:11.375 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T21:01:11.375 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-26T21:01:11.375 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T21:01:11.375 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-26T21:01:11.375 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T21:01:11.375 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T21:01:11.375 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T21:01:11.375 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T21:01:11.375 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-26T21:01:11.375 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T21:01:11.376 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-26T21:01:11.376 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T21:01:11.376 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T21:01:11.376 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-26T21:01:11.376 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T21:01:11.376 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T21:01:11.376 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T21:01:11.376 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T21:01:11.376 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T21:01:11.376 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T21:01:11.376 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T21:01:11.376 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T21:01:11.377 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T21:01:11.377 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T21:01:11.377 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T21:01:11.377 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T21:01:11.377 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T21:01:11.377 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T21:01:11.377 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T21:01:11.377 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T21:01:11.377 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T21:01:11.377 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T21:01:11.377 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T21:01:11.377 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T21:01:11.378 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T21:01:11.378 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-26T21:01:11.378 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T21:01:11.378 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T21:01:11.378 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-26T21:01:11.378 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T21:01:11.378 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-26T21:01:11.378 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-26T21:01:11.378 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T21:01:11.378 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-26T21:01:11.378 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T21:01:11.379 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T21:01:11.379 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T21:01:11.379 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T21:01:11.379 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-26T21:01:11.379 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-26T21:01:11.379 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-26T21:01:11.379 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T21:01:11.379 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T21:01:11.379 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T21:01:11.379 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T21:01:11.379 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T21:01:11.379 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-26T21:01:11.380 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-26T21:01:11.380 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T21:01:11.380 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T21:01:11.380 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T21:01:11.380 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-26T21:01:11.380 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T21:01:11.380 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T21:01:11.380 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T21:01:11.380 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T21:01:11.380 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T21:01:11.380 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T21:01:11.380 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T21:01:11.381 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T21:01:11.381 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T21:01:11.381 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T21:01:11.381 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-26T21:01:11.381 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T21:01:11.381 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T21:01:11.381 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T21:01:11.381 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T21:01:11.381 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T21:01:11.381 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T21:01:11.381 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T21:01:11.381 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T21:01:11.382 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T21:01:11.382 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T21:01:11.382 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T21:01:11.382 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T21:01:11.382 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T21:01:11.382 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T21:01:11.382 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T21:01:11.382 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T21:01:11.382 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T21:01:11.382 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T21:01:11.382 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T21:01:11.383 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T21:01:11.383 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T21:01:11.383 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T21:01:11.383 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T21:01:11.383 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T21:01:11.383 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T21:01:11.383 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T21:01:11.383 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T21:01:11.383 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T21:01:11.383 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T21:01:11.383 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T21:01:11.383 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T21:01:11.384 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T21:01:11.384 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T21:01:11.384 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T21:01:11.384 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T21:01:11.384 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T21:01:11.384 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T21:01:11.384 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T21:01:11.384 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-26T21:01:11.384 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T21:01:11.384 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T21:01:11.384 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T21:01:11.384 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T21:01:11.385 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T21:01:11.385 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T21:01:11.385 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T21:01:11.385 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-26T21:01:11.385 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T21:01:11.385 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T21:01:11.385 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T21:01:11.385 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T21:01:11.385 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T21:01:11.385 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T21:01:11.385 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T21:01:11.385 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T21:01:11.385 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T21:01:11.386 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T21:01:11.386 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T21:01:11.386 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T21:01:11.386 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T21:01:11.386 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T21:01:11.386 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T21:01:11.386 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T21:01:11.386 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T21:01:11.386 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T21:01:11.386 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T21:01:11.386 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T21:01:11.387 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T21:01:11.387 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T21:01:11.387 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T21:01:11.387 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T21:01:11.387 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T21:01:11.387 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T21:01:11.387 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T21:01:11.387 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-26T21:01:11.387 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T21:01:11.387 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-26T21:01:11.387 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T21:01:11.387 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T21:01:11.388 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T21:01:11.388 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T21:01:11.388 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T21:01:11.388 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T21:01:11.388 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T21:01:11.388 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-26T21:01:11.388 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T21:01:11.388 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-26T21:01:11.388 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T21:01:11.388 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-26T21:01:11.388 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T21:01:11.388 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-26T21:01:11.389 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-26T21:01:11.389 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T21:01:11.389 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T21:01:11.389 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T21:01:11.389 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T21:01:11.389 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T21:01:11.389 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T21:01:11.389 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T21:01:11.389 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T21:01:11.389 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T21:01:11.389 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T21:01:11.389 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T21:01:11.389 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T21:01:11.390 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T21:01:11.390 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T21:01:11.390 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T21:01:11.390 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T21:01:11.390 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-26T21:01:11.390 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T21:01:11.390 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T21:01:11.390 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T21:01:11.390 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T21:01:11.390 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T21:01:11.390 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T21:01:11.391 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T21:01:11.391 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T21:01:11.391 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T21:01:11.391 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T21:01:11.391 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T21:01:11.391 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T21:01:11.391 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T21:01:11.391 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T21:01:11.391 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T21:01:11.391 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T21:01:11.391 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T21:01:11.391 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T21:01:11.392 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T21:01:11.392 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T21:01:11.392 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T21:01:11.392 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T21:01:11.392 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T21:01:11.392 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T21:01:11.392 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T21:01:11.392 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T21:01:11.392 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T21:01:11.392 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T21:01:11.392 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T21:01:11.392 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T21:01:11.393 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T21:01:11.393 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T21:01:11.393 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T21:01:11.393 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T21:01:11.393 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T21:01:11.393 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T21:01:11.393 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T21:01:11.393 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T21:01:11.393 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T21:01:11.393 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T21:01:11.393 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T21:01:11.393 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T21:01:11.394 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T21:01:11.394 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T21:01:11.394 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T21:01:11.394 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T21:01:11.394 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T21:01:11.394 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T21:01:11.394 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T21:01:11.394 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T21:01:11.394 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T21:01:11.394 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T21:01:11.394 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T21:01:11.395 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T21:01:11.395 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T21:01:11.395 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T21:01:11.395 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T21:01:11.395 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T21:01:11.395 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-26T21:01:11.395 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T21:01:11.395 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T21:01:11.395 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T21:01:11.395 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T21:01:11.395 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-26T21:01:11.395 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T21:01:11.396 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T21:01:11.396 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T21:01:11.396 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T21:01:11.396 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T21:01:11.396 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T21:01:11.396 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T21:01:11.396 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T21:01:11.396 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T21:01:11.396 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T21:01:11.396 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T21:01:11.396 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T21:01:11.396 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T21:01:11.397 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T21:01:11.397 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T21:01:11.397 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T21:01:11.397 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T21:01:11.397 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T21:01:11.397 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T21:01:11.397 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T21:01:11.397 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T21:01:11.397 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T21:01:11.397 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T21:01:11.397 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T21:01:11.398 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T21:01:11.398 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T21:01:11.398 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T21:01:11.398 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T21:01:11.398 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T21:01:11.398 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T21:01:11.398 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T21:01:11.398 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T21:01:11.398 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T21:01:11.398 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T21:01:11.398 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T21:01:11.398 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T21:01:11.399 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T21:01:11.399 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T21:01:11.399 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T21:01:11.399 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T21:01:11.399 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T21:01:11.399 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T21:01:11.399 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T21:01:11.399 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T21:01:11.399 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T21:01:11.399 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T21:01:11.399 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T21:01:11.399 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T21:01:11.399 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T21:01:11.400 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T21:01:11.400 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T21:01:11.400 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T21:01:11.400 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T21:01:11.400 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T21:01:11.400 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T21:01:11.400 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T21:01:11.400 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T21:01:11.400 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T21:01:11.400 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T21:01:11.400 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T21:01:11.400 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T21:01:11.400 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T21:01:11.401 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T21:01:11.401 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T21:01:11.401 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T21:01:11.401 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T21:01:11.401 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T21:01:11.401 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T21:01:11.401 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T21:01:11.401 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T21:01:11.401 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T21:01:11.401 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-26T21:01:11.401 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T21:01:11.401 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-26T21:01:11.402 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T21:01:11.402 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-26T21:01:11.402 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T21:01:11.402 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T21:01:11.402 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T21:01:11.402 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T21:01:11.402 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-26T21:01:11.402 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T21:01:11.402 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-26T21:01:11.402 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T21:01:11.402 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T21:01:11.403 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T21:01:11.403 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-26T21:01:11.403 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T21:01:11.403 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T21:01:11.403 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T21:01:11.403 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T21:01:11.403 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T21:01:11.403 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T21:01:11.403 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T21:01:11.403 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T21:01:11.403 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T21:01:11.403 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T21:01:11.403 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T21:01:11.404 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T21:01:11.404 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T21:01:11.404 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T21:01:11.404 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T21:01:11.404 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T21:01:11.404 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T21:01:11.404 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T21:01:11.404 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T21:01:11.404 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T21:01:11.404 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T21:01:11.404 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T21:01:11.404 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T21:01:11.405 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T21:01:11.405 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T21:01:11.405 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T21:01:11.405 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T21:01:11.405 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T21:01:11.405 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T21:01:11.405 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T21:01:11.405 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T21:01:11.405 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T21:01:11.405 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T21:01:11.405 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T21:01:11.405 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T21:01:11.405 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T21:01:11.406 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T21:01:11.406 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T21:01:11.406 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T21:01:11.406 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T21:01:11.406 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T21:01:11.406 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T21:01:11.406 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T21:01:11.406 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-26T21:01:11.406 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T21:01:11.406 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T21:01:11.406 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-26T21:01:11.406 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-26T21:01:11.407 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T21:01:11.407 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T21:01:11.407 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T21:01:11.407 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-26T21:01:11.407 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T21:01:11.407 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-26T21:01:11.407 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T21:01:11.407 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T21:01:11.407 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-26T21:01:11.407 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T21:01:11.407 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-26T21:01:11.408 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T21:01:11.408 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T21:01:11.408 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T21:01:11.408 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T21:01:11.408 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T21:01:11.408 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-26T21:01:11.408 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T21:01:11.408 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-26T21:01:11.408 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-26T21:01:11.408 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-26T21:01:11.408 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-26T21:01:11.408 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-26T21:01:11.409 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-26T21:01:11.409 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T21:01:11.409 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T21:01:11.409 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T21:01:11.409 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T21:01:11.409 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T21:01:11.409 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T21:01:11.409 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T21:01:11.409 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T21:01:11.409 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T21:01:11.409 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T21:01:11.409 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T21:01:11.410 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T21:01:11.410 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T21:01:11.410 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-26T21:01:11.413 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:11.413 DEBUG:teuthology.orchestra.run.smithi084:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-26T21:01:11.435 INFO:teuthology.orchestra.run.smithi084.stdout:postinstall scriptlet (using /bin/sh): 2024-04-26T21:01:11.435 INFO:teuthology.orchestra.run.smithi084.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-26T21:01:11.436 INFO:teuthology.orchestra.run.smithi084.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-26T21:01:11.436 INFO:teuthology.orchestra.run.smithi084.stdout:fi 2024-04-26T21:01:11.436 INFO:teuthology.orchestra.run.smithi084.stdout:for file in vmlinuz System.map config; do 2024-04-26T21:01:11.436 INFO:teuthology.orchestra.run.smithi084.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-26T21:01:11.436 INFO:teuthology.orchestra.run.smithi084.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-26T21:01:11.436 INFO:teuthology.orchestra.run.smithi084.stdout: fi 2024-04-26T21:01:11.436 INFO:teuthology.orchestra.run.smithi084.stdout:done 2024-04-26T21:01:11.436 INFO:teuthology.orchestra.run.smithi084.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-26T21:01:11.436 INFO:teuthology.orchestra.run.smithi084.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-26T21:01:11.436 INFO:teuthology.orchestra.run.smithi084.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-26T21:01:11.436 INFO:teuthology.orchestra.run.smithi084.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-26T21:01:11.436 INFO:teuthology.orchestra.run.smithi084.stdout:fi 2024-04-26T21:01:11.437 INFO:teuthology.orchestra.run.smithi084.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-26T21:01:11.437 INFO:teuthology.orchestra.run.smithi084.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:11.437 INFO:teuthology.orchestra.run.smithi084.stdout:fi 2024-04-26T21:01:11.437 INFO:teuthology.orchestra.run.smithi084.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-26T21:01:11.437 INFO:teuthology.orchestra.run.smithi084.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-26T21:01:11.437 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:11.437 INFO:teuthology.orchestra.run.smithi084.stdout:fi 2024-04-26T21:01:11.438 DEBUG:teuthology.orchestra.run.smithi084:> sudo rpm -qi grub2-tools 2024-04-26T21:01:11.511 INFO:teuthology.orchestra.run.smithi084.stdout:Name : grub2-tools 2024-04-26T21:01:11.511 INFO:teuthology.orchestra.run.smithi084.stdout:Epoch : 1 2024-04-26T21:01:11.512 INFO:teuthology.orchestra.run.smithi084.stdout:Version : 2.06 2024-04-26T21:01:11.512 INFO:teuthology.orchestra.run.smithi084.stdout:Release : 68.el9 2024-04-26T21:01:11.512 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: x86_64 2024-04-26T21:01:11.512 INFO:teuthology.orchestra.run.smithi084.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-26T21:01:11.512 INFO:teuthology.orchestra.run.smithi084.stdout:Group : Unspecified 2024-04-26T21:01:11.512 INFO:teuthology.orchestra.run.smithi084.stdout:Size : 8264254 2024-04-26T21:01:11.512 INFO:teuthology.orchestra.run.smithi084.stdout:License : GPLv3+ 2024-04-26T21:01:11.512 INFO:teuthology.orchestra.run.smithi084.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-26T21:01:11.512 INFO:teuthology.orchestra.run.smithi084.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-26T21:01:11.512 INFO:teuthology.orchestra.run.smithi084.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-26T21:01:11.512 INFO:teuthology.orchestra.run.smithi084.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-26T21:01:11.512 INFO:teuthology.orchestra.run.smithi084.stdout:Packager : builder@centos.org 2024-04-26T21:01:11.512 INFO:teuthology.orchestra.run.smithi084.stdout:Vendor : CentOS 2024-04-26T21:01:11.512 INFO:teuthology.orchestra.run.smithi084.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T21:01:11.512 INFO:teuthology.orchestra.run.smithi084.stdout:Summary : Support tools for GRUB. 2024-04-26T21:01:11.513 INFO:teuthology.orchestra.run.smithi084.stdout:Description : 2024-04-26T21:01:11.513 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:01:11.513 INFO:teuthology.orchestra.run.smithi084.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T21:01:11.513 INFO:teuthology.orchestra.run.smithi084.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T21:01:11.513 INFO:teuthology.orchestra.run.smithi084.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T21:01:11.513 INFO:teuthology.orchestra.run.smithi084.stdout:hardware devices. 2024-04-26T21:01:11.513 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:01:11.513 INFO:teuthology.orchestra.run.smithi084.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T21:01:11.514 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T21:01:11.514 INFO:teuthology.task.kernel:Updating grub on smithi084 to boot 6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:11.514 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T21:01:12.059 INFO:teuthology.orchestra.run.smithi084.stderr:Generating grub configuration file ... 2024-04-26T21:01:13.499 INFO:teuthology.orchestra.run.smithi084.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-26T21:01:13.527 INFO:teuthology.orchestra.run.smithi084.stderr:done 2024-04-26T21:01:13.529 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2024-04-26T21:01:13.544 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.xLIeTIAyhx 2024-04-26T21:01:13.545 DEBUG:teuthology.orchestra.run.smithi084:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xLIeTIAyhx 2024-04-26T21:01:13.617 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.xLIeTIAyhx 2024-04-26T21:01:13.752 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.xLIeTIAyhx is 6KB 2024-04-26T21:01:13.799 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.xLIeTIAyhx 2024-04-26T21:01:13.814 DEBUG:teuthology.orchestra.run.smithi084:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T21:01:13.876 INFO:teuthology.orchestra.run.smithi084.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-26T21:01:13.876 INFO:teuthology.orchestra.run.smithi084.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-26T21:01:13.876 INFO:teuthology.orchestra.run.smithi084.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-26T21:01:13.876 INFO:teuthology.orchestra.run.smithi084.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-26T21:01:13.877 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:14.030 DEBUG:teuthology.orchestra.run.smithi084:> sudo shutdown -r now 2024-04-26T21:01:34.865 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-04-26T21:01:34.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-26T21:01:34.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:01:44.042 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-04-26T21:01:44.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-04-26T21:01:44.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:02:18.659 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-04-26T21:02:27.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-04-26T21:02:27.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:02:34.874 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T21:02:43.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-26T21:02:43.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:02:46.046 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-04-26T21:02:58.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-04-26T21:02:58.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:02:59.453 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-04-26T21:02:59.826 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-04-26T21:03:00.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-04-26T21:03:00.034 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T21:03:00.034 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-04-26T21:03:00.075 INFO:teuthology.orchestra.run.smithi084.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T21:03:00.076 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T21:03:00.076 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T21:03:00.076 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T21:03:00.419 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-26T21:03:00.420 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T21:03:00.420 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-04-26T21:03:00.458 INFO:teuthology.orchestra.run.smithi120.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T21:03:00.458 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T21:03:00.458 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T21:03:00.458 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T21:03:01.077 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-04-26T21:03:01.077 DEBUG:teuthology.orchestra.run.smithi084:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T21:03:01.226 INFO:teuthology.orchestra.run.smithi084.stdout:ttyS1 2024-04-26T21:03:01.307 DEBUG:teuthology.parallel:result is None 2024-04-26T21:03:01.460 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-04-26T21:03:01.460 DEBUG:teuthology.orchestra.run.smithi120:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T21:03:01.572 INFO:teuthology.orchestra.run.smithi120.stdout:ttyS1 2024-04-26T21:03:01.617 DEBUG:teuthology.parallel:result is None 2024-04-26T21:03:01.618 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T21:03:01.625 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T21:03:01.625 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T21:03:01.630 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T21:03:01.669 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T21:03:01.676 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T21:03:01.682 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T21:03:01.682 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T21:03:01.714 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T21:03:01.760 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T21:03:01.766 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T21:03:01.767 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T21:03:01.800 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T21:03:01.868 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T21:03:01.894 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T21:03:01.895 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T21:03:01.924 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T21:03:01.928 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T21:03:01.936 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T21:03:01.936 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T21:03:01.941 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T21:03:02.012 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T21:03:02.021 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T21:03:02.022 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T21:03:02.026 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T21:03:02.067 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T21:03:02.178 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T21:03:02.254 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T21:03:02.326 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T21:03:02.391 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-26T21:03:02.391 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T21:03:02.451 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T21:03:02.532 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T21:03:02.614 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T21:03:02.685 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T21:03:02.758 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T21:03:02.758 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T21:03:02.823 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2024-04-26T21:03:02.828 DEBUG:teuthology.orchestra.run.smithi120:> sudo service rsyslog restart 2024-04-26T21:03:02.936 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T21:03:02.958 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T21:03:03.363 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T21:03:03.372 INFO:teuthology.task.internal:Starting timer... 2024-04-26T21:03:03.372 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T21:03:03.381 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T21:03:03.391 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-26T21:03:03.391 DEBUG:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2024-04-26T21:03:03.500 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: 2024-04-26T21:03:03.505 DEBUG:teuthology.orchestra.run.smithi120:> sudo service auditd rotate 2024-04-26T21:03:03.597 INFO:teuthology.orchestra.run.smithi120.stdout:Rotating logs: 2024-04-26T21:03:03.601 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T21:03:03.601 DEBUG:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2024-04-26T21:03:03.653 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2024-04-26T21:03:03.653 DEBUG:teuthology.orchestra.run.smithi120:> /usr/sbin/getenforce 2024-04-26T21:03:03.698 INFO:teuthology.orchestra.run.smithi120.stdout:Permissive 2024-04-26T21:03:03.698 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi084.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi120.front.sepia.ceph.com': 'permissive'} 2024-04-26T21:03:03.698 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T21:03:03.764 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:03:03.764 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T21:03:03.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:03:03.825 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T21:03:03.825 DEBUG:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2024-04-26T21:03:03.908 DEBUG:teuthology.orchestra.run.smithi120:> sudo /usr/sbin/setenforce permissive 2024-04-26T21:03:03.973 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T21:03:03.983 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T21:03:03.999 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T21:03:04.000 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi084.front.sepia.ceph.com,smithi120.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T21:08:12.351 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi120.front.sepia.ceph.com')] 2024-04-26T21:08:12.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-04-26T21:08:12.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:08:12.466 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-04-26T21:08:12.626 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-04-26T21:08:12.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-26T21:08:12.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:08:12.728 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-04-26T21:08:12.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-26T21:08:12.883 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T21:08:12.897 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T21:08:12.897 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T21:08:12.897 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T21:08:12.905 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T21:08:12.905 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T21:08:12.994 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T21:08:12.996 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T21:08:13.034 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T21:08:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T21:08:13.104 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2024-04-26T21:08:13.105 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: ntpd: command not found 2024-04-26T21:08:13.137 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2024-04-26T21:08:13.138 INFO:teuthology.orchestra.run.smithi120.stdout:506 Cannot talk to daemon 2024-04-26T21:08:13.178 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T21:08:13.180 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T21:08:13.221 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T21:08:13.222 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T21:08:13.354 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2024-04-26T21:08:13.363 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T21:08:13.363 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2024-04-26T21:08:13.363 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:08:13.363 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:08:13.363 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:08:13.363 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:08:13.363 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-04-26T21:08:13.372 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T21:08:13.372 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-04-26T21:08:13.372 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:08:13.372 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:08:13.372 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:08:13.372 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:08:13.373 INFO:teuthology.run_tasks:Running task install... 2024-04-26T21:08:13.382 DEBUG:teuthology.task.install:project ceph 2024-04-26T21:08:13.382 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}} 2024-04-26T21:08:13.382 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'} 2024-04-26T21:08:13.383 INFO:teuthology.task.install:Using flavor: default 2024-04-26T21:08:13.388 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T21:08:13.388 INFO:teuthology.task.install:extra packages: [] 2024-04-26T21:08:13.389 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'tag': None, 'wait_for_package': False} 2024-04-26T21:08:13.389 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T21:08:13.389 INFO:teuthology.packaging:ref: None 2024-04-26T21:08:13.389 INFO:teuthology.packaging:tag: None 2024-04-26T21:08:13.389 INFO:teuthology.packaging:branch: quincy 2024-04-26T21:08:13.389 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:08:13.389 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-26T21:08:13.391 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'tag': None, 'wait_for_package': False} 2024-04-26T21:08:13.392 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T21:08:13.392 INFO:teuthology.packaging:ref: None 2024-04-26T21:08:13.392 INFO:teuthology.packaging:tag: None 2024-04-26T21:08:13.392 INFO:teuthology.packaging:branch: quincy 2024-04-26T21:08:13.392 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:08:13.392 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-26T21:08:13.610 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/2be3efa97a7972f8e925bd899b474329979b74d6/centos/9/flavors/default/ 2024-04-26T21:08:13.610 INFO:teuthology.task.install.rpm:Package version is 17.2.7-907.g2be3efa9 2024-04-26T21:08:13.645 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/2be3efa97a7972f8e925bd899b474329979b74d6/centos/9/flavors/default/ 2024-04-26T21:08:13.645 INFO:teuthology.task.install.rpm:Package version is 17.2.7-907.g2be3efa9 2024-04-26T21:08:13.719 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/2be3efa97a7972f8e925bd899b474329979b74d6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/2be3efa97a7972f8e925bd899b474329979b74d6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/2be3efa97a7972f8e925bd899b474329979b74d6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T21:08:13.719 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-26T21:08:13.719 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T21:08:13.752 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/2be3efa97a7972f8e925bd899b474329979b74d6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/2be3efa97a7972f8e925bd899b474329979b74d6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/2be3efa97a7972f8e925bd899b474329979b74d6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T21:08:13.752 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T21:08:13.752 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T21:08:13.811 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-26T21:08:13.811 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T21:08:13.811 INFO:teuthology.packaging:ref: None 2024-04-26T21:08:13.811 INFO:teuthology.packaging:tag: None 2024-04-26T21:08:13.811 INFO:teuthology.packaging:branch: quincy 2024-04-26T21:08:13.811 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:08:13.811 DEBUG:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T21:08:13.841 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-26T21:08:13.842 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T21:08:13.842 INFO:teuthology.packaging:ref: None 2024-04-26T21:08:13.842 INFO:teuthology.packaging:tag: None 2024-04-26T21:08:13.842 INFO:teuthology.packaging:branch: quincy 2024-04-26T21:08:13.842 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:08:13.842 DEBUG:teuthology.orchestra.run.smithi120:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T21:08:13.937 DEBUG:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T21:08:13.970 DEBUG:teuthology.orchestra.run.smithi120:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T21:08:14.050 DEBUG:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T21:08:14.083 DEBUG:teuthology.orchestra.run.smithi120:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T21:08:14.126 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2024-04-26T21:08:14.130 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum clean all 2024-04-26T21:08:14.160 INFO:teuthology.orchestra.run.smithi120.stdout:check_obsoletes = 1 2024-04-26T21:08:14.165 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum clean all 2024-04-26T21:08:14.443 INFO:teuthology.orchestra.run.smithi084.stdout:48 files removed 2024-04-26T21:08:14.482 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw 2024-04-26T21:08:14.490 INFO:teuthology.orchestra.run.smithi120.stdout:48 files removed 2024-04-26T21:08:14.528 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-radosgw 2024-04-26T21:08:15.414 INFO:teuthology.orchestra.run.smithi120.stdout:ceph packages for x86_64 170 kB/s | 77 kB 00:00 2024-04-26T21:08:15.462 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 141 kB/s | 77 kB 00:00 2024-04-26T21:08:15.907 INFO:teuthology.orchestra.run.smithi120.stdout:ceph noarch packages 27 kB/s | 11 kB 00:00 2024-04-26T21:08:15.947 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 28 kB/s | 11 kB 00:00 2024-04-26T21:08:16.480 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 4.0 kB/s | 1.8 kB 00:00 2024-04-26T21:08:16.533 INFO:teuthology.orchestra.run.smithi120.stdout:ceph source packages 3.3 kB/s | 1.8 kB 00:00 2024-04-26T21:08:17.262 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-26T21:08:17.668 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 7.7 MB/s | 8.0 MB 00:01 2024-04-26T21:08:19.371 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-26T21:08:20.219 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 14 MB/s | 19 MB 00:01 2024-04-26T21:08:23.896 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 9.7 MB/s | 6.2 MB 00:00 2024-04-26T21:08:25.753 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.2 MB 00:01 2024-04-26T21:08:25.796 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-04-26T21:08:27.592 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 16 kB 00:00 2024-04-26T21:08:27.771 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-26T21:08:33.623 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-04-26T21:08:36.078 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:08:36.084 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:08:36.084 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-04-26T21:08:36.085 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:08:36.085 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-26T21:08:36.085 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 14 M 2024-04-26T21:08:36.085 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2024-04-26T21:08:36.085 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 3.1 M 2024-04-26T21:08:36.085 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 2.9 M 2024-04-26T21:08:36.085 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-04-26T21:08:36.085 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 5.0 M 2024-04-26T21:08:36.085 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 22 M 2024-04-26T21:08:36.085 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 25 k 2024-04-26T21:08:36.085 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T21:08:36.085 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 637 k 2024-04-26T21:08:36.085 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T21:08:36.085 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T21:08:36.086 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T21:08:36.086 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 457 k 2024-04-26T21:08:36.086 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T21:08:36.086 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 4.9 M 2024-04-26T21:08:36.086 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T21:08:36.086 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T21:08:36.086 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 45 k 2024-04-26T21:08:36.086 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 118 k 2024-04-26T21:08:36.086 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 156 k 2024-04-26T21:08:36.086 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T21:08:36.086 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 320 k 2024-04-26T21:08:36.086 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 293 k 2024-04-26T21:08:36.087 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 99 k 2024-04-26T21:08:36.087 INFO:teuthology.orchestra.run.smithi084.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T21:08:36.087 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:08:36.087 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-26T21:08:36.087 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:08:36.087 INFO:teuthology.orchestra.run.smithi084.stdout:Install 22 Packages 2024-04-26T21:08:36.087 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 2 Packages 2024-04-26T21:08:36.087 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:08:36.087 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 58 M 2024-04-26T21:08:36.088 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-26T21:08:38.199 INFO:teuthology.orchestra.run.smithi084.stdout:(1/24): ceph-radosgw-17.2.7-907.g2be3efa9.el9.x 8.8 MB/s | 14 MB 00:01 2024-04-26T21:08:38.250 INFO:teuthology.orchestra.run.smithi084.stdout:(2/24): ceph-selinux-17.2.7-907.g2be3efa9.el9.x 516 kB/s | 25 kB 00:00 2024-04-26T21:08:38.324 INFO:teuthology.orchestra.run.smithi084.stdout:(3/24): libcephfs2-17.2.7-907.g2be3efa9.el9.x86 8.4 MB/s | 637 kB 00:00 2024-04-26T21:08:38.408 INFO:teuthology.orchestra.run.smithi084.stdout:(4/24): libradosstriper1-17.2.7-907.g2be3efa9.e 5.4 MB/s | 457 kB 00:00 2024-04-26T21:08:38.666 INFO:teuthology.orchestra.run.smithi084.stdout:(5/24): ceph-common-17.2.7-907.g2be3efa9.el9.x8 11 MB/s | 22 MB 00:02 2024-04-26T21:08:38.725 INFO:teuthology.orchestra.run.smithi084.stdout:(6/24): python3-ceph-argparse-17.2.7-907.g2be3e 792 kB/s | 45 kB 00:00 2024-04-26T21:08:38.783 INFO:teuthology.orchestra.run.smithi084.stdout:(7/24): python3-ceph-common-17.2.7-907.g2be3efa 2.0 MB/s | 118 kB 00:00 2024-04-26T21:08:38.875 INFO:teuthology.orchestra.run.smithi084.stdout:(8/24): ceph-base-17.2.7-907.g2be3efa9.el9.x86_ 2.2 MB/s | 5.0 MB 00:02 2024-04-26T21:08:38.909 INFO:teuthology.orchestra.run.smithi084.stdout:(9/24): python3-cephfs-17.2.7-907.g2be3efa9.el9 1.2 MB/s | 156 kB 00:00 2024-04-26T21:08:38.951 INFO:teuthology.orchestra.run.smithi084.stdout:(10/24): python3-rados-17.2.7-907.g2be3efa9.el9 4.2 MB/s | 320 kB 00:00 2024-04-26T21:08:38.984 INFO:teuthology.orchestra.run.smithi084.stdout:(11/24): python3-rbd-17.2.7-907.g2be3efa9.el9.x 3.8 MB/s | 293 kB 00:00 2024-04-26T21:08:39.018 INFO:teuthology.orchestra.run.smithi084.stdout:(12/24): python3-rgw-17.2.7-907.g2be3efa9.el9.x 1.5 MB/s | 99 kB 00:00 2024-04-26T21:08:39.135 INFO:teuthology.orchestra.run.smithi084.stdout:(13/24): librgw2-17.2.7-907.g2be3efa9.el9.x86_6 6.8 MB/s | 4.9 MB 00:00 2024-04-26T21:08:39.760 INFO:teuthology.orchestra.run.smithi084.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 61 kB/s | 45 kB 00:00 2024-04-26T21:08:39.860 INFO:teuthology.orchestra.run.smithi084.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 183 kB/s | 160 kB 00:00 2024-04-26T21:08:40.502 INFO:teuthology.orchestra.run.smithi084.stdout:(16/24): librdkafka-1.6.1-102.el9.x86_64.rpm 485 kB/s | 662 kB 00:01 2024-04-26T21:08:40.527 INFO:teuthology.orchestra.run.smithi084.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 63 kB/s | 42 kB 00:00 2024-04-26T21:08:40.752 INFO:teuthology.orchestra.run.smithi084.stdout:(18/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 295 kB/s | 292 kB 00:00 2024-04-26T21:08:41.161 INFO:teuthology.orchestra.run.smithi084.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 77 kB/s | 49 kB 00:00 2024-04-26T21:08:41.336 INFO:teuthology.orchestra.run.smithi084.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 116 kB/s | 67 kB 00:00 2024-04-26T21:08:41.486 INFO:teuthology.orchestra.run.smithi084.stdout:(21/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 315 kB/s | 309 kB 00:00 2024-04-26T21:08:41.795 INFO:teuthology.orchestra.run.smithi084.stdout:(22/24): librbd1-17.2.7-907.g2be3efa9.el9.x86_6 9.5 MB/s | 2.9 MB 00:00 2024-04-26T21:08:41.995 INFO:teuthology.orchestra.run.smithi084.stdout:(23/24): librados2-17.2.7-907.g2be3efa9.el9.x86 4.7 MB/s | 3.1 MB 00:00 2024-04-26T21:08:43.245 INFO:teuthology.orchestra.run.smithi084.stdout:(24/24): thrift-0.15.0-2.el9.x86_64.rpm 778 kB/s | 1.6 MB 00:02 2024-04-26T21:08:43.257 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:08:43.257 INFO:teuthology.orchestra.run.smithi084.stdout:Total 8.1 MB/s | 58 MB 00:07 2024-04-26T21:08:43.454 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-26T21:08:43.547 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-26T21:08:43.547 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-26T21:08:44.483 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-26T21:08:44.484 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-26T21:08:45.970 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-26T21:08:46.436 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-04-26T21:08:46.531 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:17.2.7-907.g2be3efa9.el9.x86_64 2/26 2024-04-26T21:08:46.669 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:17.2.7-907.g2be3efa9.el9.x86_64 2/26 2024-04-26T21:08:46.773 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:17.2.7-907.g2be3efa9.el9.x86_64 3/26 2024-04-26T21:08:46.807 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:17.2.7-907.g2be3efa9.el9.x86_64 4/26 2024-04-26T21:08:46.960 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:17.2.7-907.g2be3efa9.el9.x86_64 4/26 2024-04-26T21:08:47.028 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-04-26T21:08:47.074 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-04-26T21:08:47.128 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 21 MB 00:19 2024-04-26T21:08:47.628 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-04-26T21:08:47.662 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:17.2.7-907.g2be3efa9.el9.x86_64 8/26 2024-04-26T21:08:47.726 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:17.2.7-907.g2be3efa9.el9.x86_64 8/26 2024-04-26T21:08:47.761 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-04-26T21:08:47.822 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:17.2.7-907.g2be3efa9.el9.x 10/26 2024-04-26T21:08:47.880 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:17.2.7-907.g2be3efa9.el9.x86_64 11/26 2024-04-26T21:08:47.986 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:17.2.7-907.g2be3efa9.el9.x86_64 12/26 2024-04-26T21:08:48.029 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:17.2.7-907.g2be3efa9.el9.x86_64 13/26 2024-04-26T21:08:48.124 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:17.2.7-907.g2be3efa9.el9.x86_64 13/26 2024-04-26T21:08:48.201 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-04-26T21:08:48.249 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-04-26T21:08:48.299 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-04-26T21:08:48.686 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-04-26T21:08:48.725 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:17.2.7-907.g2be3efa9.el9.x86_64 18/26 2024-04-26T21:08:48.839 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:17.2.7-907.g2be3efa9.el9.x86_64 18/26 2024-04-26T21:08:48.934 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:17.2.7-907.g2be3efa9.el9.x86_64 19/26 2024-04-26T21:08:48.994 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:17.2.7-907.g2be3efa9.el9.x86 20/26 2024-04-26T21:08:51.788 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 21/26 2024-04-26T21:08:51.919 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 21/26 2024-04-26T21:08:52.562 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 21/26 2024-04-26T21:08:52.622 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:17.2.7-907.g2be3efa9.el9.x86_64 22/26 2024-04-26T21:08:52.791 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:17.2.7-907.g2be3efa9.el9.x86_64 22/26 2024-04-26T21:08:52.791 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T21:08:52.792 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T21:08:52.792 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:08:52.847 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:17.2.7-907.g2be3efa9.el9.x86_64 23/26 2024-04-26T21:08:53.091 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-04-26T21:08:55.567 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:08:55.585 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:08:55.585 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-04-26T21:08:55.585 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:08:55.585 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-04-26T21:08:55.585 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 14 M 2024-04-26T21:08:55.585 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrading: 2024-04-26T21:08:55.585 INFO:teuthology.orchestra.run.smithi120.stdout: librados2 x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 3.1 M 2024-04-26T21:08:55.585 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1 x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 2.9 M 2024-04-26T21:08:55.585 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-04-26T21:08:55.585 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 5.0 M 2024-04-26T21:08:55.585 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 22 M 2024-04-26T21:08:55.586 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 25 k 2024-04-26T21:08:55.586 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T21:08:55.586 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2 x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 637 k 2024-04-26T21:08:55.586 INFO:teuthology.orchestra.run.smithi120.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T21:08:55.586 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T21:08:55.586 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T21:08:55.586 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1 x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 457 k 2024-04-26T21:08:55.586 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T21:08:55.586 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2 x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 4.9 M 2024-04-26T21:08:55.586 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T21:08:55.586 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T21:08:55.586 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 45 k 2024-04-26T21:08:55.587 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 118 k 2024-04-26T21:08:55.587 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 156 k 2024-04-26T21:08:55.587 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T21:08:55.587 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 320 k 2024-04-26T21:08:55.587 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 293 k 2024-04-26T21:08:55.587 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 99 k 2024-04-26T21:08:55.587 INFO:teuthology.orchestra.run.smithi120.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T21:08:55.587 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:08:55.587 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-04-26T21:08:55.587 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:08:55.588 INFO:teuthology.orchestra.run.smithi120.stdout:Install 22 Packages 2024-04-26T21:08:55.588 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrade 2 Packages 2024-04-26T21:08:55.588 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:08:55.588 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 58 M 2024-04-26T21:08:55.588 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-04-26T21:08:56.627 INFO:teuthology.orchestra.run.smithi120.stdout:(1/24): ceph-base-17.2.7-907.g2be3efa9.el9.x86_ 7.1 MB/s | 5.0 MB 00:00 2024-04-26T21:08:56.685 INFO:teuthology.orchestra.run.smithi120.stdout:(2/24): ceph-selinux-17.2.7-907.g2be3efa9.el9.x 438 kB/s | 25 kB 00:00 2024-04-26T21:08:56.793 INFO:teuthology.orchestra.run.smithi120.stdout:(3/24): libcephfs2-17.2.7-907.g2be3efa9.el9.x86 5.8 MB/s | 637 kB 00:00 2024-04-26T21:08:56.885 INFO:teuthology.orchestra.run.smithi120.stdout:(4/24): libradosstriper1-17.2.7-907.g2be3efa9.e 4.9 MB/s | 457 kB 00:00 2024-04-26T21:08:57.411 INFO:teuthology.orchestra.run.smithi120.stdout:(5/24): ceph-radosgw-17.2.7-907.g2be3efa9.el9.x 9.5 MB/s | 14 MB 00:01 2024-04-26T21:08:57.453 INFO:teuthology.orchestra.run.smithi120.stdout:(6/24): python3-ceph-argparse-17.2.7-907.g2be3e 1.1 MB/s | 45 kB 00:00 2024-04-26T21:08:57.578 INFO:teuthology.orchestra.run.smithi120.stdout:(7/24): librgw2-17.2.7-907.g2be3efa9.el9.x86_64 7.1 MB/s | 4.9 MB 00:00 2024-04-26T21:08:57.611 INFO:teuthology.orchestra.run.smithi120.stdout:(8/24): python3-ceph-common-17.2.7-907.g2be3efa 744 kB/s | 118 kB 00:00 2024-04-26T21:08:57.645 INFO:teuthology.orchestra.run.smithi120.stdout:(9/24): python3-cephfs-17.2.7-907.g2be3efa9.el9 2.3 MB/s | 156 kB 00:00 2024-04-26T21:08:57.687 INFO:teuthology.orchestra.run.smithi120.stdout:(10/24): python3-rados-17.2.7-907.g2be3efa9.el9 4.2 MB/s | 320 kB 00:00 2024-04-26T21:08:57.721 INFO:teuthology.orchestra.run.smithi120.stdout:(11/24): python3-rbd-17.2.7-907.g2be3efa9.el9.x 3.8 MB/s | 293 kB 00:00 2024-04-26T21:08:57.754 INFO:teuthology.orchestra.run.smithi120.stdout:(12/24): python3-rgw-17.2.7-907.g2be3efa9.el9.x 1.5 MB/s | 99 kB 00:00 2024-04-26T21:08:57.813 INFO:teuthology.orchestra.run.smithi120.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 790 kB/s | 45 kB 00:00 2024-04-26T21:08:57.847 INFO:teuthology.orchestra.run.smithi120.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-04-26T21:08:57.955 INFO:teuthology.orchestra.run.smithi120.stdout:(15/24): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-04-26T21:08:57.989 INFO:teuthology.orchestra.run.smithi120.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-04-26T21:08:58.039 INFO:teuthology.orchestra.run.smithi120.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 511 kB/s | 42 kB 00:00 2024-04-26T21:08:58.190 INFO:teuthology.orchestra.run.smithi120.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 326 kB/s | 49 kB 00:00 2024-04-26T21:08:58.257 INFO:teuthology.orchestra.run.smithi120.stdout:(19/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.1 MB/s | 309 kB 00:00 2024-04-26T21:08:58.324 INFO:teuthology.orchestra.run.smithi120.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 507 kB/s | 67 kB 00:00 2024-04-26T21:08:58.457 INFO:teuthology.orchestra.run.smithi120.stdout:(21/24): thrift-0.15.0-2.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-04-26T21:08:58.583 INFO:teuthology.orchestra.run.smithi120.stdout:(22/24): librados2-17.2.7-907.g2be3efa9.el9.x86 12 MB/s | 3.1 MB 00:00 2024-04-26T21:08:58.741 INFO:teuthology.orchestra.run.smithi120.stdout:(23/24): librbd1-17.2.7-907.g2be3efa9.el9.x86_6 10 MB/s | 2.9 MB 00:00 2024-04-26T21:09:01.325 INFO:teuthology.orchestra.run.smithi120.stdout:(24/24): ceph-common-17.2.7-907.g2be3efa9.el9.x 4.2 MB/s | 22 MB 00:05 2024-04-26T21:09:01.331 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:09:01.332 INFO:teuthology.orchestra.run.smithi120.stdout:Total 10 MB/s | 58 MB 00:05 2024-04-26T21:09:01.516 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-04-26T21:09:01.613 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-04-26T21:09:01.613 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-04-26T21:09:02.512 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-04-26T21:09:02.513 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-04-26T21:09:03.623 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:17.2.7-907.g2be3efa9.el9.x86_64 23/26 2024-04-26T21:09:03.623 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2024-04-26T21:09:03.623 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2024-04-26T21:09:03.623 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2024-04-26T21:09:03.623 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2024-04-26T21:09:03.623 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2024-04-26T21:09:03.623 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /root 2024-04-26T21:09:03.623 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2024-04-26T21:09:03.623 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:04.004 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-04-26T21:09:04.452 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-04-26T21:09:04.583 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librados2-2:17.2.7-907.g2be3efa9.el9.x86_64 2/26 2024-04-26T21:09:04.718 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:17.2.7-907.g2be3efa9.el9.x86_64 2/26 2024-04-26T21:09:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rados-2:17.2.7-907.g2be3efa9.el9.x86_64 3/26 2024-04-26T21:09:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs2-2:17.2.7-907.g2be3efa9.el9.x86_64 4/26 2024-04-26T21:09:05.062 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:17.2.7-907.g2be3efa9.el9.x86_64 24/26 2024-04-26T21:09:05.080 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephfs2-2:17.2.7-907.g2be3efa9.el9.x86_64 4/26 2024-04-26T21:09:05.148 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-04-26T21:09:05.187 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-04-26T21:09:05.215 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-907.g2be3efa9.el9.x86_64 24/26 2024-04-26T21:09:05.215 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:09:05.215 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T21:09:05.215 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T21:09:05.215 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T21:09:05.215 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:05.220 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-26T21:09:05.341 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-26T21:09:05.341 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-26T21:09:05.747 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-04-26T21:09:05.782 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librgw2-2:17.2.7-907.g2be3efa9.el9.x86_64 8/26 2024-04-26T21:09:05.873 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librgw2-2:17.2.7-907.g2be3efa9.el9.x86_64 8/26 2024-04-26T21:09:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-04-26T21:09:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-argparse-2:17.2.7-907.g2be3efa9.el9.x 10/26 2024-04-26T21:09:06.028 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cephfs-2:17.2.7-907.g2be3efa9.el9.x86_64 11/26 2024-04-26T21:09:06.133 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rgw-2:17.2.7-907.g2be3efa9.el9.x86_64 12/26 2024-04-26T21:09:06.177 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libradosstriper1-2:17.2.7-907.g2be3efa9.el9.x86_64 13/26 2024-04-26T21:09:06.271 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libradosstriper1-2:17.2.7-907.g2be3efa9.el9.x86_64 13/26 2024-04-26T21:09:06.367 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-04-26T21:09:06.424 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-04-26T21:09:06.474 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-04-26T21:09:06.871 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-04-26T21:09:06.939 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librbd1-2:17.2.7-907.g2be3efa9.el9.x86_64 18/26 2024-04-26T21:09:06.972 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-26T21:09:06.972 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:17.2.7-907.g2be3efa9.el9.x86_64 1/26 2024-04-26T21:09:06.972 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 2/26 2024-04-26T21:09:06.972 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:17.2.7-907.g2be3efa9.el9.x86_64 3/26 2024-04-26T21:09:06.973 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:17.2.7-907.g2be3efa9.el9.x86_64 4/26 2024-04-26T21:09:06.973 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:17.2.7-907.g2be3efa9.el9.x86_64 5/26 2024-04-26T21:09:06.973 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:17.2.7-907.g2be3efa9.el9.x86_64 6/26 2024-04-26T21:09:06.973 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:17.2.7-907.g2be3efa9.el9.x86_64 7/26 2024-04-26T21:09:06.973 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:17.2.7-907.g2be3efa9.el9.x 8/26 2024-04-26T21:09:06.973 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:17.2.7-907.g2be3efa9.el9.x86 9/26 2024-04-26T21:09:06.973 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:17.2.7-907.g2be3efa9.el9.x86_64 10/26 2024-04-26T21:09:06.973 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:17.2.7-907.g2be3efa9.el9.x86_64 11/26 2024-04-26T21:09:06.973 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:17.2.7-907.g2be3efa9.el9.x86_64 12/26 2024-04-26T21:09:06.973 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:17.2.7-907.g2be3efa9.el9.x86_64 13/26 2024-04-26T21:09:06.973 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-04-26T21:09:06.973 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-04-26T21:09:06.973 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-04-26T21:09:06.974 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-04-26T21:09:06.974 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-04-26T21:09:06.974 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-04-26T21:09:06.974 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-04-26T21:09:06.974 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-04-26T21:09:06.974 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-04-26T21:09:06.974 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:17.2.7-907.g2be3efa9.el9.x86_64 23/26 2024-04-26T21:09:06.974 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-04-26T21:09:06.974 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:17.2.7-907.g2be3efa9.el9.x86_64 25/26 2024-04-26T21:09:07.048 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:17.2.7-907.g2be3efa9.el9.x86_64 18/26 2024-04-26T21:09:07.144 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rbd-2:17.2.7-907.g2be3efa9.el9.x86_64 19/26 2024-04-26T21:09:07.178 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-common-2:17.2.7-907.g2be3efa9.el9.x86 20/26 2024-04-26T21:09:07.736 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-04-26T21:09:07.736 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:07.736 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2024-04-26T21:09:07.737 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:07.737 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:07.737 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-26T21:09:07.737 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:07.737 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:07.737 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:07.737 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:07.737 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T21:09:07.737 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:07.737 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T21:09:07.737 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T21:09:07.737 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T21:09:07.737 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:07.738 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T21:09:07.738 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:07.738 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T21:09:07.738 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T21:09:07.738 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:07.738 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:07.738 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:07.738 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T21:09:07.738 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:07.738 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:07.738 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:07.738 INFO:teuthology.orchestra.run.smithi084.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T21:09:07.738 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:07.738 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:09:08.167 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-test 2024-04-26T21:09:08.921 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:35 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:09:09.053 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:09:09.054 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:09:09.054 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-04-26T21:09:09.054 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:09:09.054 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-26T21:09:09.054 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 48 M 2024-04-26T21:09:09.054 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-04-26T21:09:09.054 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 162 k 2024-04-26T21:09:09.054 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T21:09:09.054 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T21:09:09.054 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:09.054 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-26T21:09:09.055 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:09:09.055 INFO:teuthology.orchestra.run.smithi084.stdout:Install 4 Packages 2024-04-26T21:09:09.055 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:09.055 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 48 M 2024-04-26T21:09:09.055 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 192 M 2024-04-26T21:09:09.055 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-26T21:09:10.044 INFO:teuthology.orchestra.run.smithi084.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.2 MB/s | 305 kB 00:00 2024-04-26T21:09:10.101 INFO:teuthology.orchestra.run.smithi084.stdout:(2/4): libcephsqlite-17.2.7-907.g2be3efa9.el9.x 528 kB/s | 162 kB 00:00 2024-04-26T21:09:10.153 INFO:teuthology.orchestra.run.smithi084.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 593 kB/s | 64 kB 00:00 2024-04-26T21:09:10.163 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 21/26 2024-04-26T21:09:10.209 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 21/26 2024-04-26T21:09:10.842 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 21/26 2024-04-26T21:09:10.905 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-base-2:17.2.7-907.g2be3efa9.el9.x86_64 22/26 2024-04-26T21:09:11.094 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-base-2:17.2.7-907.g2be3efa9.el9.x86_64 22/26 2024-04-26T21:09:11.095 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T21:09:11.095 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T21:09:11.095 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:09:11.139 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-selinux-2:17.2.7-907.g2be3efa9.el9.x86_64 23/26 2024-04-26T21:09:12.498 INFO:teuthology.orchestra.run.smithi084.stdout:(4/4): ceph-test-17.2.7-907.g2be3efa9.el9.x86_6 18 MB/s | 48 MB 00:02 2024-04-26T21:09:12.502 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:09:12.503 INFO:teuthology.orchestra.run.smithi084.stdout:Total 14 MB/s | 48 MB 00:03 2024-04-26T21:09:12.582 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-26T21:09:12.634 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-26T21:09:12.634 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-26T21:09:13.089 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-26T21:09:13.090 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-26T21:09:13.718 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-26T21:09:13.856 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-26T21:09:13.914 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-26T21:09:13.943 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephsqlite-2:17.2.7-907.g2be3efa9.el9.x86_64 3/4 2024-04-26T21:09:18.781 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephsqlite-2:17.2.7-907.g2be3efa9.el9.x86_64 3/4 2024-04-26T21:09:18.862 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:17.2.7-907.g2be3efa9.el9.x86_64 4/4 2024-04-26T21:09:21.162 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-test-2:17.2.7-907.g2be3efa9.el9.x86_64 4/4 2024-04-26T21:09:21.162 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:17.2.7-907.g2be3efa9.el9.x86_64 1/4 2024-04-26T21:09:21.162 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephsqlite-2:17.2.7-907.g2be3efa9.el9.x86_64 2/4 2024-04-26T21:09:21.162 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-26T21:09:21.427 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-26T21:09:21.427 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:21.427 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-26T21:09:21.427 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:21.427 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:21.427 INFO:teuthology.orchestra.run.smithi084.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T21:09:21.427 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T21:09:21.427 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:21.427 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:09:21.794 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph 2024-04-26T21:09:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-selinux-2:17.2.7-907.g2be3efa9.el9.x86_64 23/26 2024-04-26T21:09:21.899 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /sys 2024-04-26T21:09:21.899 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /proc 2024-04-26T21:09:21.899 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /mnt 2024-04-26T21:09:21.899 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /var/tmp 2024-04-26T21:09:21.899 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /home 2024-04-26T21:09:21.900 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /root 2024-04-26T21:09:21.900 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /tmp 2024-04-26T21:09:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:09:22.555 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:49 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:09:22.682 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:09:22.685 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:09:22.685 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-04-26T21:09:22.685 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:09:22.685 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-26T21:09:22.685 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 6.5 k 2024-04-26T21:09:22.685 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-04-26T21:09:22.685 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 2.1 M 2024-04-26T21:09:22.685 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 1.4 M 2024-04-26T21:09:22.686 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 240 k 2024-04-26T21:09:22.686 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 3.9 M 2024-04-26T21:09:22.686 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 15 M 2024-04-26T21:09:22.686 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T21:09:22.686 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T21:09:22.686 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T21:09:22.686 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T21:09:22.686 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T21:09:22.686 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T21:09:22.686 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T21:09:22.687 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T21:09:22.687 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T21:09:22.687 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T21:09:22.687 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T21:09:22.687 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T21:09:22.687 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T21:09:22.687 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T21:09:22.687 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T21:09:22.687 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T21:09:22.688 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T21:09:22.688 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T21:09:22.688 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T21:09:22.688 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T21:09:22.688 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T21:09:22.688 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T21:09:22.688 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T21:09:22.688 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T21:09:22.688 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T21:09:22.689 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T21:09:22.689 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T21:09:22.689 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:22.689 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-26T21:09:22.689 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:09:22.689 INFO:teuthology.orchestra.run.smithi084.stdout:Install 33 Packages 2024-04-26T21:09:22.690 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:22.690 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 27 M 2024-04-26T21:09:22.691 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 96 M 2024-04-26T21:09:22.691 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-26T21:09:23.302 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-radosgw-2:17.2.7-907.g2be3efa9.el9.x86_64 24/26 2024-04-26T21:09:23.378 INFO:teuthology.orchestra.run.smithi084.stdout:(1/33): ceph-17.2.7-907.g2be3efa9.el9.x86_64.rp 26 kB/s | 6.5 kB 00:00 2024-04-26T21:09:23.483 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-907.g2be3efa9.el9.x86_64 24/26 2024-04-26T21:09:23.483 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:09:23.483 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T21:09:23.483 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T21:09:23.483 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T21:09:23.483 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:09:23.488 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-26T21:09:23.606 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-26T21:09:23.607 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-26T21:09:23.636 INFO:teuthology.orchestra.run.smithi084.stdout:(2/33): ceph-mds-17.2.7-907.g2be3efa9.el9.x86_6 4.1 MB/s | 2.1 MB 00:00 2024-04-26T21:09:23.945 INFO:teuthology.orchestra.run.smithi084.stdout:(3/33): ceph-mon-17.2.7-907.g2be3efa9.el9.x86_6 6.9 MB/s | 3.9 MB 00:00 2024-04-26T21:09:24.020 INFO:teuthology.orchestra.run.smithi084.stdout:(4/33): ceph-mgr-modules-core-17.2.7-907.g2be3e 3.2 MB/s | 240 kB 00:00 2024-04-26T21:09:24.087 INFO:teuthology.orchestra.run.smithi084.stdout:(5/33): ceph-mgr-17.2.7-907.g2be3efa9.el9.x86_6 1.5 MB/s | 1.4 MB 00:00 2024-04-26T21:09:24.454 INFO:teuthology.orchestra.run.smithi084.stdout:(6/33): ceph-osd-17.2.7-907.g2be3efa9.el9.x86_6 19 MB/s | 15 MB 00:00 2024-04-26T21:09:24.487 INFO:teuthology.orchestra.run.smithi084.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 543 kB/s | 253 kB 00:00 2024-04-26T21:09:24.571 INFO:teuthology.orchestra.run.smithi084.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.6 MB/s | 135 kB 00:00 2024-04-26T21:09:24.613 INFO:teuthology.orchestra.run.smithi084.stdout:(9/33): python3-cryptography-36.0.1-4.el9.x86_6 2.3 MB/s | 1.2 MB 00:00 2024-04-26T21:09:24.646 INFO:teuthology.orchestra.run.smithi084.stdout:(10/33): python3-ply-3.11-14.el9.noarch.rpm 557 kB/s | 106 kB 00:00 2024-04-26T21:09:24.671 INFO:teuthology.orchestra.run.smithi084.stdout:(11/33): python3-requests-2.25.1-8.el9.noarch.r 1.2 MB/s | 125 kB 00:00 2024-04-26T21:09:24.705 INFO:teuthology.orchestra.run.smithi084.stdout:(12/33): python3-urllib3-1.26.5-5.el9.noarch.rp 2.3 MB/s | 215 kB 00:00 2024-04-26T21:09:24.764 INFO:teuthology.orchestra.run.smithi084.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 381 kB/s | 35 kB 00:00 2024-04-26T21:09:24.789 INFO:teuthology.orchestra.run.smithi084.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 618 kB/s | 51 kB 00:00 2024-04-26T21:09:24.823 INFO:teuthology.orchestra.run.smithi084.stdout:(15/33): python3-mako-1.1.4-6.el9.noarch.rpm 985 kB/s | 172 kB 00:00 2024-04-26T21:09:24.848 INFO:teuthology.orchestra.run.smithi084.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 502 kB/s | 42 kB 00:00 2024-04-26T21:09:24.940 INFO:teuthology.orchestra.run.smithi084.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 290 kB/s | 43 kB 00:00 2024-04-26T21:09:24.998 INFO:teuthology.orchestra.run.smithi084.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 185 kB/s | 11 kB 00:00 2024-04-26T21:09:25.057 INFO:teuthology.orchestra.run.smithi084.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 307 kB/s | 18 kB 00:00 2024-04-26T21:09:25.082 INFO:teuthology.orchestra.run.smithi084.stdout:(20/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 664 kB/s | 172 kB 00:00 2024-04-26T21:09:25.116 INFO:teuthology.orchestra.run.smithi084.stdout:(21/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-04-26T21:09:25.141 INFO:teuthology.orchestra.run.smithi084.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 278 kB/s | 23 kB 00:00 2024-04-26T21:09:25.166 INFO:teuthology.orchestra.run.smithi084.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 233 kB/s | 19 kB 00:00 2024-04-26T21:09:25.192 INFO:teuthology.orchestra.run.smithi084.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 263 kB/s | 20 kB 00:00 2024-04-26T21:09:25.234 INFO:teuthology.orchestra.run.smithi084.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2024-04-26T21:09:25.259 INFO:teuthology.orchestra.run.smithi084.stdout:(26/33): python3-logutils-0.3.5-21.el9.noarch.r 508 kB/s | 46 kB 00:00 2024-04-26T21:09:25.293 INFO:teuthology.orchestra.run.smithi084.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-04-26T21:09:25.318 INFO:teuthology.orchestra.run.smithi084.stdout:(28/33): python3-portend-3.1.0-2.el9.noarch.rpm 198 kB/s | 16 kB 00:00 2024-04-26T21:09:25.335 INFO:teuthology.orchestra.run.smithi084.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-04-26T21:09:25.360 INFO:teuthology.orchestra.run.smithi084.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 539 kB/s | 36 kB 00:00 2024-04-26T21:09:25.410 INFO:teuthology.orchestra.run.smithi084.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 405 kB/s | 20 kB 00:00 2024-04-26T21:09:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-26T21:09:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-base-2:17.2.7-907.g2be3efa9.el9.x86_64 1/26 2024-04-26T21:09:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 2/26 2024-04-26T21:09:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-radosgw-2:17.2.7-907.g2be3efa9.el9.x86_64 3/26 2024-04-26T21:09:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-selinux-2:17.2.7-907.g2be3efa9.el9.x86_64 4/26 2024-04-26T21:09:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs2-2:17.2.7-907.g2be3efa9.el9.x86_64 5/26 2024-04-26T21:09:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libradosstriper1-2:17.2.7-907.g2be3efa9.el9.x86_64 6/26 2024-04-26T21:09:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librgw2-2:17.2.7-907.g2be3efa9.el9.x86_64 7/26 2024-04-26T21:09:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-argparse-2:17.2.7-907.g2be3efa9.el9.x 8/26 2024-04-26T21:09:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-common-2:17.2.7-907.g2be3efa9.el9.x86 9/26 2024-04-26T21:09:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cephfs-2:17.2.7-907.g2be3efa9.el9.x86_64 10/26 2024-04-26T21:09:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rados-2:17.2.7-907.g2be3efa9.el9.x86_64 11/26 2024-04-26T21:09:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rbd-2:17.2.7-907.g2be3efa9.el9.x86_64 12/26 2024-04-26T21:09:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rgw-2:17.2.7-907.g2be3efa9.el9.x86_64 13/26 2024-04-26T21:09:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-04-26T21:09:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-04-26T21:09:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-04-26T21:09:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-04-26T21:09:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-04-26T21:09:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-04-26T21:09:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-04-26T21:09:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-04-26T21:09:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-04-26T21:09:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:17.2.7-907.g2be3efa9.el9.x86_64 23/26 2024-04-26T21:09:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-04-26T21:09:25.439 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:17.2.7-907.g2be3efa9.el9.x86_64 25/26 2024-04-26T21:09:25.444 INFO:teuthology.orchestra.run.smithi084.stdout:(32/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-04-26T21:09:25.477 INFO:teuthology.orchestra.run.smithi084.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.9 MB/s | 427 kB 00:00 2024-04-26T21:09:25.481 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:09:25.482 INFO:teuthology.orchestra.run.smithi084.stdout:Total 9.7 MB/s | 27 MB 00:02 2024-04-26T21:09:25.821 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-26T21:09:25.905 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-26T21:09:25.905 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-26T21:09:26.205 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-04-26T21:09:26.205 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:09:26.205 INFO:teuthology.orchestra.run.smithi120.stdout:Upgraded: 2024-04-26T21:09:26.205 INFO:teuthology.orchestra.run.smithi120.stdout: librados2-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:26.205 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:26.205 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-04-26T21:09:26.205 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T21:09:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T21:09:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T21:09:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T21:09:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T21:09:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T21:09:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T21:09:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T21:09:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T21:09:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:09:26.207 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:09:26.390 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-26T21:09:26.391 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-26T21:09:26.652 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-test 2024-04-26T21:09:27.401 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:00:34 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:09:27.535 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:09:27.535 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:09:27.535 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-04-26T21:09:27.536 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:09:27.536 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-04-26T21:09:27.536 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 48 M 2024-04-26T21:09:27.536 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-04-26T21:09:27.536 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 162 k 2024-04-26T21:09:27.536 INFO:teuthology.orchestra.run.smithi120.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T21:09:27.536 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T21:09:27.536 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:09:27.536 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-04-26T21:09:27.536 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:09:27.536 INFO:teuthology.orchestra.run.smithi120.stdout:Install 4 Packages 2024-04-26T21:09:27.536 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:09:27.537 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 48 M 2024-04-26T21:09:27.537 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 192 M 2024-04-26T21:09:27.537 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-04-26T21:09:27.695 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-26T21:09:27.773 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-26T21:09:27.829 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-26T21:09:27.880 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-26T21:09:27.883 INFO:teuthology.orchestra.run.smithi120.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.5 MB/s | 305 kB 00:00 2024-04-26T21:09:27.925 INFO:teuthology.orchestra.run.smithi120.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-04-26T21:09:28.030 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-26T21:09:28.109 INFO:teuthology.orchestra.run.smithi120.stdout:(3/4): libcephsqlite-17.2.7-907.g2be3efa9.el9.x 378 kB/s | 162 kB 00:00 2024-04-26T21:09:28.127 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-26T21:09:28.178 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-26T21:09:28.220 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-26T21:09:28.257 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-04-26T21:09:28.294 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-04-26T21:09:28.338 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-04-26T21:09:28.397 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-04-26T21:09:28.468 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-04-26T21:09:28.514 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-04-26T21:09:28.572 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-04-26T21:09:28.703 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-04-26T21:09:28.899 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-04-26T21:09:29.005 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-04-26T21:09:29.073 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-04-26T21:09:29.116 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-04-26T21:09:29.179 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-04-26T21:09:29.253 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-04-26T21:09:29.498 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-04-26T21:09:29.561 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-04-26T21:09:29.652 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-04-26T21:09:29.763 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-04-26T21:09:29.809 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-04-26T21:09:29.961 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-04-26T21:09:30.139 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-907.g2be3efa9.el9.n 28/33 2024-04-26T21:09:30.166 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:17.2.7-907.g2be3efa9.el9.x86_64 29/33 2024-04-26T21:09:30.247 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:17.2.7-907.g2be3efa9.el9.x86_64 29/33 2024-04-26T21:09:30.247 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:09:30.247 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T21:09:30.247 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T21:09:30.247 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T21:09:30.247 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:30.362 INFO:teuthology.orchestra.run.smithi120.stdout:(4/4): ceph-test-17.2.7-907.g2be3efa9.el9.x86_6 18 MB/s | 48 MB 00:02 2024-04-26T21:09:30.365 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:09:30.365 INFO:teuthology.orchestra.run.smithi120.stdout:Total 17 MB/s | 48 MB 00:02 2024-04-26T21:09:30.431 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-04-26T21:09:30.478 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-04-26T21:09:30.478 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-04-26T21:09:30.970 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-04-26T21:09:30.970 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-04-26T21:09:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-04-26T21:09:31.701 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:17.2.7-907.g2be3efa9.el9.x86_64 30/33 2024-04-26T21:09:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-26T21:09:31.806 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:17.2.7-907.g2be3efa9.el9.x86_64 30/33 2024-04-26T21:09:31.806 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:09:31.806 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T21:09:31.806 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T21:09:31.806 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T21:09:31.806 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-26T21:09:31.900 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephsqlite-2:17.2.7-907.g2be3efa9.el9.x86_64 3/4 2024-04-26T21:09:32.236 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:17.2.7-907.g2be3efa9.el9.x86_64 31/33 2024-04-26T21:09:32.333 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:17.2.7-907.g2be3efa9.el9.x86_64 31/33 2024-04-26T21:09:32.333 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:09:32.334 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T21:09:32.334 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T21:09:32.334 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T21:09:32.334 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:32.568 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:17.2.7-907.g2be3efa9.el9.x86_64 32/33 2024-04-26T21:09:32.653 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:17.2.7-907.g2be3efa9.el9.x86_64 32/33 2024-04-26T21:09:32.653 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:09:32.653 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T21:09:32.653 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T21:09:32.653 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T21:09:32.653 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:32.749 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:17.2.7-907.g2be3efa9.el9.x86_64 33/33 2024-04-26T21:09:32.910 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-2:17.2.7-907.g2be3efa9.el9.x86_64 33/33 2024-04-26T21:09:32.910 INFO:teuthology.orchestra.run.smithi084.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-26T21:09:32.910 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:34.758 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:17.2.7-907.g2be3efa9.el9.x86_64 1/33 2024-04-26T21:09:34.758 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:17.2.7-907.g2be3efa9.el9.x86_64 2/33 2024-04-26T21:09:34.758 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:17.2.7-907.g2be3efa9.el9.x86_64 3/33 2024-04-26T21:09:34.759 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:17.2.7-907.g2be3efa9.el9.x86_64 4/33 2024-04-26T21:09:34.759 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:17.2.7-907.g2be3efa9.el9.x86_64 5/33 2024-04-26T21:09:34.759 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-907.g2be3efa9.el9.n 6/33 2024-04-26T21:09:34.759 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-04-26T21:09:34.759 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-04-26T21:09:34.759 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-04-26T21:09:34.759 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-04-26T21:09:34.759 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-04-26T21:09:34.759 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-04-26T21:09:34.759 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-04-26T21:09:34.759 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-04-26T21:09:34.759 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-04-26T21:09:34.759 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-26T21:09:34.759 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-26T21:09:34.760 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-26T21:09:34.760 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-26T21:09:34.760 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-26T21:09:34.760 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-26T21:09:34.760 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-26T21:09:34.760 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-26T21:09:34.760 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-26T21:09:34.760 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-26T21:09:34.760 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-26T21:09:34.760 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-26T21:09:34.760 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-26T21:09:34.760 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-26T21:09:34.760 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-26T21:09:34.761 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-26T21:09:34.761 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-26T21:09:35.807 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-26T21:09:35.807 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:35.807 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-26T21:09:35.807 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:35.807 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:35.807 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:35.807 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-26T21:09:35.807 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:35.808 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:35.808 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T21:09:35.808 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T21:09:35.808 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T21:09:35.808 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T21:09:35.808 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T21:09:35.808 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T21:09:35.808 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T21:09:35.808 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T21:09:35.808 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T21:09:35.808 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T21:09:35.808 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T21:09:35.808 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T21:09:35.808 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T21:09:35.809 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T21:09:35.809 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T21:09:35.809 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T21:09:35.809 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T21:09:35.809 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T21:09:35.809 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T21:09:35.809 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T21:09:35.809 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T21:09:35.809 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T21:09:35.809 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T21:09:35.809 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T21:09:35.809 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T21:09:35.809 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T21:09:35.809 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T21:09:35.810 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:35.810 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:09:36.196 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-base 2024-04-26T21:09:36.738 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephsqlite-2:17.2.7-907.g2be3efa9.el9.x86_64 3/4 2024-04-26T21:09:36.839 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-test-2:17.2.7-907.g2be3efa9.el9.x86_64 4/4 2024-04-26T21:09:36.936 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:03 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:09:37.021 INFO:teuthology.orchestra.run.smithi084.stdout:Package ceph-base-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-26T21:09:37.062 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:09:37.063 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-04-26T21:09:37.063 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:09:37.147 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install cephadm 2024-04-26T21:09:37.868 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:04 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:09:37.995 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:09:37.996 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:09:37.996 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-04-26T21:09:37.996 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:09:37.996 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-26T21:09:37.997 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 82 k 2024-04-26T21:09:37.997 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:37.997 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-26T21:09:37.997 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:09:37.997 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-04-26T21:09:37.997 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:37.997 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 82 k 2024-04-26T21:09:37.997 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 372 k 2024-04-26T21:09:37.997 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-26T21:09:38.242 INFO:teuthology.orchestra.run.smithi084.stdout:cephadm-17.2.7-907.g2be3efa9.el9.noarch.rpm 336 kB/s | 82 kB 00:00 2024-04-26T21:09:38.244 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:09:38.244 INFO:teuthology.orchestra.run.smithi084.stdout:Total 331 kB/s | 82 kB 00:00 2024-04-26T21:09:38.245 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-26T21:09:38.263 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-26T21:09:38.263 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-26T21:09:38.271 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-26T21:09:38.272 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-26T21:09:38.391 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-26T21:09:39.291 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-test-2:17.2.7-907.g2be3efa9.el9.x86_64 4/4 2024-04-26T21:09:39.292 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-test-2:17.2.7-907.g2be3efa9.el9.x86_64 1/4 2024-04-26T21:09:39.292 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephsqlite-2:17.2.7-907.g2be3efa9.el9.x86_64 2/4 2024-04-26T21:09:39.292 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-26T21:09:39.343 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 1/1 2024-04-26T21:09:39.511 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 1/1 2024-04-26T21:09:39.566 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-26T21:09:39.566 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:09:39.566 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-04-26T21:09:39.566 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:39.566 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:39.566 INFO:teuthology.orchestra.run.smithi120.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T21:09:39.566 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T21:09:39.566 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:09:39.566 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:09:39.930 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph 2024-04-26T21:09:40.003 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 1/1 2024-04-26T21:09:40.306 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 1/1 2024-04-26T21:09:40.306 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:40.306 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-26T21:09:40.306 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-26T21:09:40.307 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:40.307 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:09:40.596 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-immutable-object-cache 2024-04-26T21:09:40.705 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:00:47 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:09:40.831 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:09:40.833 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:09:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-04-26T21:09:40.834 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:09:40.834 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-04-26T21:09:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: ceph x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 6.5 k 2024-04-26T21:09:40.834 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-04-26T21:09:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 2.1 M 2024-04-26T21:09:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 1.4 M 2024-04-26T21:09:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 240 k 2024-04-26T21:09:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 3.9 M 2024-04-26T21:09:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 15 M 2024-04-26T21:09:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T21:09:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T21:09:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T21:09:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T21:09:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T21:09:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T21:09:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T21:09:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T21:09:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T21:09:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T21:09:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T21:09:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T21:09:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T21:09:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T21:09:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T21:09:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T21:09:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T21:09:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T21:09:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T21:09:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T21:09:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T21:09:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T21:09:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T21:09:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T21:09:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T21:09:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T21:09:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T21:09:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:09:40.837 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-04-26T21:09:40.837 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:09:40.837 INFO:teuthology.orchestra.run.smithi120.stdout:Install 33 Packages 2024-04-26T21:09:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:09:40.837 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 27 M 2024-04-26T21:09:40.837 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 96 M 2024-04-26T21:09:40.837 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-04-26T21:09:41.358 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:08 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:09:41.407 INFO:teuthology.orchestra.run.smithi120.stdout:(1/33): ceph-17.2.7-907.g2be3efa9.el9.x86_64.rp 22 kB/s | 6.5 kB 00:00 2024-04-26T21:09:41.506 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:09:41.507 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:09:41.507 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repo Size 2024-04-26T21:09:41.507 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:09:41.507 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-26T21:09:41.507 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 137 k 2024-04-26T21:09:41.507 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:41.507 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-26T21:09:41.507 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:09:41.507 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-04-26T21:09:41.507 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:41.507 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 137 k 2024-04-26T21:09:41.507 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 379 k 2024-04-26T21:09:41.507 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-26T21:09:41.568 INFO:teuthology.orchestra.run.smithi120.stdout:(2/33): ceph-mgr-17.2.7-907.g2be3efa9.el9.x86_6 3.1 MB/s | 1.4 MB 00:00 2024-04-26T21:09:41.649 INFO:teuthology.orchestra.run.smithi120.stdout:(3/33): ceph-mds-17.2.7-907.g2be3efa9.el9.x86_6 3.8 MB/s | 2.1 MB 00:00 2024-04-26T21:09:41.724 INFO:teuthology.orchestra.run.smithi120.stdout:(4/33): ceph-mgr-modules-core-17.2.7-907.g2be3e 3.2 MB/s | 240 kB 00:00 2024-04-26T21:09:41.881 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-immutable-object-cache-17.2.7-907.g2be3efa 368 kB/s | 137 kB 00:00 2024-04-26T21:09:41.883 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:09:41.884 INFO:teuthology.orchestra.run.smithi084.stdout:Total 365 kB/s | 137 kB 00:00 2024-04-26T21:09:41.884 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-26T21:09:41.911 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-26T21:09:41.911 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-26T21:09:41.991 INFO:teuthology.orchestra.run.smithi120.stdout:(5/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 953 kB/s | 253 kB 00:00 2024-04-26T21:09:42.027 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-26T21:09:42.028 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-26T21:09:42.124 INFO:teuthology.orchestra.run.smithi120.stdout:(6/33): python3-cryptography-36.0.1-4.el9.x86_6 9.2 MB/s | 1.2 MB 00:00 2024-04-26T21:09:42.249 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-26T21:09:42.315 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-907.g2be3efa9.e 1/1 2024-04-26T21:09:42.365 INFO:teuthology.orchestra.run.smithi120.stdout:(7/33): ceph-osd-17.2.7-907.g2be3efa9.el9.x86_6 19 MB/s | 15 MB 00:00 2024-04-26T21:09:42.389 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-907.g2be3efa9.e 1/1 2024-04-26T21:09:42.389 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:09:42.389 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T21:09:42.390 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:42.400 INFO:teuthology.orchestra.run.smithi120.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 388 kB/s | 106 kB 00:00 2024-04-26T21:09:42.450 INFO:teuthology.orchestra.run.smithi120.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.6 MB/s | 135 kB 00:00 2024-04-26T21:09:42.592 INFO:teuthology.orchestra.run.smithi120.stdout:(10/33): python3-urllib3-1.26.5-5.el9.noarch.rp 2.9 MB/s | 215 kB 00:00 2024-04-26T21:09:42.643 INFO:teuthology.orchestra.run.smithi120.stdout:(11/33): python3-requests-2.25.1-8.el9.noarch.r 517 kB/s | 125 kB 00:00 2024-04-26T21:09:42.801 INFO:teuthology.orchestra.run.smithi120.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 220 kB/s | 35 kB 00:00 2024-04-26T21:09:42.835 INFO:teuthology.orchestra.run.smithi120.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 714 kB/s | 172 kB 00:00 2024-04-26T21:09:42.911 INFO:teuthology.orchestra.run.smithi120.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 472 kB/s | 51 kB 00:00 2024-04-26T21:09:42.935 INFO:teuthology.orchestra.run.smithi120.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 418 kB/s | 42 kB 00:00 2024-04-26T21:09:43.044 INFO:teuthology.orchestra.run.smithi120.stdout:(16/33): ceph-mon-17.2.7-907.g2be3efa9.el9.x86_ 2.4 MB/s | 3.9 MB 00:01 2024-04-26T21:09:43.311 INFO:teuthology.orchestra.run.smithi120.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 109 kB/s | 43 kB 00:00 2024-04-26T21:09:43.395 INFO:teuthology.orchestra.run.smithi120.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 375 kB/s | 172 kB 00:00 2024-04-26T21:09:43.495 INFO:teuthology.orchestra.run.smithi120.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 58 kB/s | 11 kB 00:00 2024-04-26T21:09:43.554 INFO:teuthology.orchestra.run.smithi120.stdout:(20/33): python3-cherrypy-18.6.1-2.el9.noarch.r 705 kB/s | 358 kB 00:00 2024-04-26T21:09:43.601 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-907.g2be3efa9.e 1/1 2024-04-26T21:09:43.601 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:43.601 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-26T21:09:43.601 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:43.602 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:43.602 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:09:43.679 INFO:teuthology.orchestra.run.smithi120.stdout:(21/33): python3-jaraco-classes-3.2.1-5.el9.noa 62 kB/s | 18 kB 00:00 2024-04-26T21:09:43.763 INFO:teuthology.orchestra.run.smithi120.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 87 kB/s | 23 kB 00:00 2024-04-26T21:09:43.813 INFO:teuthology.orchestra.run.smithi120.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 75 kB/s | 19 kB 00:00 2024-04-26T21:09:43.902 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr 2024-04-26T21:09:43.972 INFO:teuthology.orchestra.run.smithi120.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 67 kB/s | 20 kB 00:00 2024-04-26T21:09:44.130 INFO:teuthology.orchestra.run.smithi120.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 126 kB/s | 46 kB 00:00 2024-04-26T21:09:44.247 INFO:teuthology.orchestra.run.smithi120.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 182 kB/s | 79 kB 00:00 2024-04-26T21:09:44.414 INFO:teuthology.orchestra.run.smithi120.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 58 kB/s | 16 kB 00:00 2024-04-26T21:09:44.481 INFO:teuthology.orchestra.run.smithi120.stdout:(28/33): python3-pecan-1.4.2-3.el9.noarch.rpm 536 kB/s | 272 kB 00:00 2024-04-26T21:09:44.590 INFO:teuthology.orchestra.run.smithi120.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 263 kB/s | 90 kB 00:00 2024-04-26T21:09:44.662 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:11 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:09:44.724 INFO:teuthology.orchestra.run.smithi120.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 116 kB/s | 36 kB 00:00 2024-04-26T21:09:44.745 INFO:teuthology.orchestra.run.smithi084.stdout:Package ceph-mgr-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-26T21:09:44.787 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:09:44.788 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-04-26T21:09:44.788 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:09:44.864 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr-dashboard 2024-04-26T21:09:45.007 INFO:teuthology.orchestra.run.smithi120.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 71 kB/s | 20 kB 00:00 2024-04-26T21:09:45.032 INFO:teuthology.orchestra.run.smithi120.stdout:(32/33): python3-webob-1.8.7-6.el9.noarch.rpm 417 kB/s | 230 kB 00:00 2024-04-26T21:09:45.233 INFO:teuthology.orchestra.run.smithi120.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 666 kB/s | 427 kB 00:00 2024-04-26T21:09:45.244 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:09:45.244 INFO:teuthology.orchestra.run.smithi120.stdout:Total 6.2 MB/s | 27 MB 00:04 2024-04-26T21:09:45.603 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-04-26T21:09:45.616 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:12 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:09:45.691 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-04-26T21:09:45.691 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-04-26T21:09:45.745 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:09:45.746 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:09:45.746 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-04-26T21:09:45.746 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:09:45.746 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-26T21:09:45.746 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 3.4 M 2024-04-26T21:09:45.746 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-04-26T21:09:45.746 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 24 k 2024-04-26T21:09:45.746 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 15 k 2024-04-26T21:09:45.746 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-04-26T21:09:45.747 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T21:09:45.747 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T21:09:45.747 INFO:teuthology.orchestra.run.smithi084.stdout:Installing weak dependencies: 2024-04-26T21:09:45.747 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-04-26T21:09:45.747 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:45.747 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-26T21:09:45.747 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:09:45.747 INFO:teuthology.orchestra.run.smithi084.stdout:Install 7 Packages 2024-04-26T21:09:45.747 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:45.748 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 3.7 M 2024-04-26T21:09:45.748 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 80 M 2024-04-26T21:09:45.748 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-26T21:09:46.196 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-04-26T21:09:46.197 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-04-26T21:09:46.526 INFO:teuthology.orchestra.run.smithi084.stdout:(1/7): ceph-prometheus-alerts-17.2.7-907.g2be3e 41 kB/s | 15 kB 00:00 2024-04-26T21:09:46.551 INFO:teuthology.orchestra.run.smithi084.stdout:(2/7): ceph-grafana-dashboards-17.2.7-907.g2be3 64 kB/s | 24 kB 00:00 2024-04-26T21:09:46.693 INFO:teuthology.orchestra.run.smithi084.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 55 kB/s | 9.0 kB 00:00 2024-04-26T21:09:46.743 INFO:teuthology.orchestra.run.smithi084.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 214 kB/s | 41 kB 00:00 2024-04-26T21:09:46.927 INFO:teuthology.orchestra.run.smithi084.stdout:(5/7): ceph-mgr-dashboard-17.2.7-907.g2be3efa9. 4.4 MB/s | 3.4 MB 00:00 2024-04-26T21:09:46.952 INFO:teuthology.orchestra.run.smithi084.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 119 kB/s | 31 kB 00:00 2024-04-26T21:09:47.002 INFO:teuthology.orchestra.run.smithi084.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 731 kB/s | 188 kB 00:00 2024-04-26T21:09:47.007 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:09:47.008 INFO:teuthology.orchestra.run.smithi084.stdout:Total 2.9 MB/s | 3.7 MB 00:01 2024-04-26T21:09:47.008 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-26T21:09:47.038 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-26T21:09:47.038 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-26T21:09:47.194 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-26T21:09:47.194 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-26T21:09:47.570 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-04-26T21:09:47.601 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-26T21:09:47.628 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-26T21:09:47.666 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-26T21:09:47.678 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-04-26T21:09:47.709 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-26T21:09:47.723 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-04-26T21:09:47.806 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-04-26T21:09:47.845 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-26T21:09:47.868 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-04-26T21:09:47.915 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-907.g2be3efa9.el9.no 5/7 2024-04-26T21:09:47.949 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-26T21:09:48.001 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-26T21:09:48.043 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-26T21:09:48.080 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-04-26T21:09:48.117 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-04-26T21:09:48.160 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-04-26T21:09:48.221 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-04-26T21:09:48.298 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-04-26T21:09:48.338 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-04-26T21:09:48.394 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-04-26T21:09:48.524 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-04-26T21:09:48.715 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-04-26T21:09:48.819 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-04-26T21:09:48.888 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-04-26T21:09:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-04-26T21:09:48.995 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-04-26T21:09:49.085 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-04-26T21:09:49.153 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-907.g2be3efa9.el9.n 6/7 2024-04-26T21:09:49.190 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-907.g2be3efa9.el9.noarch 7/7 2024-04-26T21:09:49.340 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-04-26T21:09:49.427 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-04-26T21:09:49.525 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-04-26T21:09:49.638 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-04-26T21:09:49.692 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-04-26T21:09:49.854 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-04-26T21:09:50.045 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-907.g2be3efa9.el9.n 28/33 2024-04-26T21:09:50.074 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-2:17.2.7-907.g2be3efa9.el9.x86_64 29/33 2024-04-26T21:09:50.145 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-2:17.2.7-907.g2be3efa9.el9.x86_64 29/33 2024-04-26T21:09:50.145 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:09:50.146 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T21:09:50.146 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T21:09:50.146 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T21:09:50.146 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:09:50.253 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-907.g2be3efa9.el9.noarch 7/7 2024-04-26T21:09:50.253 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-907.g2be3efa9.el9.n 1/7 2024-04-26T21:09:50.253 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-907.g2be3efa9.el9.noarch 2/7 2024-04-26T21:09:50.253 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-907.g2be3efa9.el9.no 3/7 2024-04-26T21:09:50.253 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-04-26T21:09:50.253 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-04-26T21:09:50.253 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-04-26T21:09:50.601 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-04-26T21:09:50.601 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:50.601 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-26T21:09:50.601 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-26T21:09:50.601 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-26T21:09:50.602 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-26T21:09:50.602 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-04-26T21:09:50.602 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-04-26T21:09:50.602 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T21:09:50.602 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T21:09:50.602 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:50.602 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:09:50.891 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-26T21:09:51.600 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-osd-2:17.2.7-907.g2be3efa9.el9.x86_64 30/33 2024-04-26T21:09:51.610 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:18 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:09:51.682 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-osd-2:17.2.7-907.g2be3efa9.el9.x86_64 30/33 2024-04-26T21:09:51.682 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:09:51.682 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T21:09:51.682 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T21:09:51.682 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T21:09:51.682 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:09:51.736 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:09:51.737 INFO:teuthology.orchestra.run.smithi084.stdout:====================================================================================== 2024-04-26T21:09:51.737 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-04-26T21:09:51.737 INFO:teuthology.orchestra.run.smithi084.stdout:====================================================================================== 2024-04-26T21:09:51.737 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-26T21:09:51.737 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 7.4 M 2024-04-26T21:09:51.737 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-04-26T21:09:51.737 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T21:09:51.737 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T21:09:51.737 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T21:09:51.738 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T21:09:51.738 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T21:09:51.738 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T21:09:51.738 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T21:09:51.738 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T21:09:51.738 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T21:09:51.738 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T21:09:51.738 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T21:09:51.738 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:51.738 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-26T21:09:51.738 INFO:teuthology.orchestra.run.smithi084.stdout:====================================================================================== 2024-04-26T21:09:51.738 INFO:teuthology.orchestra.run.smithi084.stdout:Install 12 Packages 2024-04-26T21:09:51.738 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:09:51.739 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 38 M 2024-04-26T21:09:51.739 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 209 M 2024-04-26T21:09:51.739 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-26T21:09:52.093 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mon-2:17.2.7-907.g2be3efa9.el9.x86_64 31/33 2024-04-26T21:09:52.161 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mon-2:17.2.7-907.g2be3efa9.el9.x86_64 31/33 2024-04-26T21:09:52.161 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:09:52.161 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T21:09:52.162 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T21:09:52.162 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T21:09:52.162 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:09:52.211 INFO:teuthology.orchestra.run.smithi084.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 748 kB/s | 195 kB 00:00 2024-04-26T21:09:52.252 INFO:teuthology.orchestra.run.smithi084.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 803 kB 00:00 2024-04-26T21:09:52.385 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mds-2:17.2.7-907.g2be3efa9.el9.x86_64 32/33 2024-04-26T21:09:52.428 INFO:teuthology.orchestra.run.smithi084.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 151 kB/s | 33 kB 00:00 2024-04-26T21:09:52.453 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mds-2:17.2.7-907.g2be3efa9.el9.x86_64 32/33 2024-04-26T21:09:52.453 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:09:52.454 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T21:09:52.454 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T21:09:52.454 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T21:09:52.454 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:09:52.478 INFO:teuthology.orchestra.run.smithi084.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 372 kB/s | 18 kB 00:00 2024-04-26T21:09:52.517 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-2:17.2.7-907.g2be3efa9.el9.x86_64 33/33 2024-04-26T21:09:52.537 INFO:teuthology.orchestra.run.smithi084.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 615 kB/s | 35 kB 00:00 2024-04-26T21:09:52.620 INFO:teuthology.orchestra.run.smithi084.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.2 MB/s | 3.0 MB 00:00 2024-04-26T21:09:52.641 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-2:17.2.7-907.g2be3efa9.el9.x86_64 33/33 2024-04-26T21:09:52.641 INFO:teuthology.orchestra.run.smithi120.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-26T21:09:52.641 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:09:52.704 INFO:teuthology.orchestra.run.smithi084.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-04-26T21:09:52.871 INFO:teuthology.orchestra.run.smithi084.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 14 MB/s | 4.7 MB 00:00 2024-04-26T21:09:52.963 INFO:teuthology.orchestra.run.smithi084.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.7 MB/s | 250 kB 00:00 2024-04-26T21:09:53.080 INFO:teuthology.orchestra.run.smithi084.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-04-26T21:09:53.364 INFO:teuthology.orchestra.run.smithi084.stdout:(11/12): ceph-mgr-diskprediction-local-17.2.7-9 5.2 MB/s | 7.4 MB 00:01 2024-04-26T21:09:53.581 INFO:teuthology.orchestra.run.smithi084.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-04-26T21:09:53.583 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:09:53.584 INFO:teuthology.orchestra.run.smithi084.stdout:Total 21 MB/s | 38 MB 00:01 2024-04-26T21:09:54.214 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-26T21:09:54.291 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-26T21:09:54.292 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-26T21:09:54.501 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-2:17.2.7-907.g2be3efa9.el9.x86_64 1/33 2024-04-26T21:09:54.501 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mds-2:17.2.7-907.g2be3efa9.el9.x86_64 2/33 2024-04-26T21:09:54.501 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-2:17.2.7-907.g2be3efa9.el9.x86_64 3/33 2024-04-26T21:09:54.502 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mon-2:17.2.7-907.g2be3efa9.el9.x86_64 4/33 2024-04-26T21:09:54.502 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-osd-2:17.2.7-907.g2be3efa9.el9.x86_64 5/33 2024-04-26T21:09:54.502 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-907.g2be3efa9.el9.n 6/33 2024-04-26T21:09:54.502 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-04-26T21:09:54.503 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-04-26T21:09:54.503 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-04-26T21:09:54.503 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-04-26T21:09:54.503 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-04-26T21:09:54.503 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-04-26T21:09:54.504 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-04-26T21:09:54.504 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-04-26T21:09:54.504 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-04-26T21:09:54.504 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-26T21:09:54.504 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-26T21:09:54.505 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-26T21:09:54.505 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-26T21:09:54.505 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-26T21:09:54.505 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-26T21:09:54.506 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-26T21:09:54.506 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-26T21:09:54.506 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-26T21:09:54.506 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-26T21:09:54.506 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-26T21:09:54.507 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-26T21:09:54.507 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-26T21:09:54.507 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-26T21:09:54.507 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-26T21:09:54.507 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-26T21:09:54.508 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-26T21:09:54.917 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-26T21:09:54.917 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-26T21:09:55.624 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-26T21:09:55.624 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:09:55.624 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-04-26T21:09:55.624 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:55.624 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:55.624 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:55.625 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-26T21:09:55.625 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:55.625 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:09:55.625 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T21:09:55.625 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T21:09:55.625 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T21:09:55.625 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T21:09:55.625 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T21:09:55.625 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T21:09:55.625 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T21:09:55.625 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T21:09:55.625 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T21:09:55.625 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T21:09:55.625 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T21:09:55.626 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T21:09:55.626 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T21:09:55.626 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T21:09:55.626 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T21:09:55.626 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T21:09:55.626 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T21:09:55.626 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T21:09:55.626 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T21:09:55.626 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T21:09:55.626 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T21:09:55.626 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T21:09:55.626 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T21:09:55.626 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T21:09:55.626 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T21:09:55.627 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T21:09:55.627 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T21:09:55.627 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:09:55.627 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:09:55.808 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-26T21:09:55.901 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-26T21:09:55.965 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-26T21:09:56.041 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-base 2024-04-26T21:09:56.120 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-26T21:09:56.165 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-26T21:09:56.422 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-26T21:09:56.454 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-26T21:09:56.582 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-26T21:09:56.817 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:03 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:09:56.908 INFO:teuthology.orchestra.run.smithi120.stdout:Package ceph-base-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-26T21:09:56.953 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:09:56.954 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-04-26T21:09:56.954 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:09:57.063 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install cephadm 2024-04-26T21:09:57.456 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-26T21:09:57.598 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-26T21:09:57.801 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:04 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:09:57.927 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:09:57.927 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:09:57.927 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-04-26T21:09:57.927 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:09:57.927 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-04-26T21:09:57.927 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 82 k 2024-04-26T21:09:57.928 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:09:57.928 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-04-26T21:09:57.928 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:09:57.928 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-04-26T21:09:57.928 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:09:57.928 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 82 k 2024-04-26T21:09:57.928 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 372 k 2024-04-26T21:09:57.929 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-04-26T21:09:58.162 INFO:teuthology.orchestra.run.smithi120.stdout:cephadm-17.2.7-907.g2be3efa9.el9.noarch.rpm 353 kB/s | 82 kB 00:00 2024-04-26T21:09:58.163 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:09:58.164 INFO:teuthology.orchestra.run.smithi120.stdout:Total 347 kB/s | 82 kB 00:00 2024-04-26T21:09:58.165 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-04-26T21:09:58.182 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-04-26T21:09:58.183 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-04-26T21:09:58.190 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-04-26T21:09:58.192 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-04-26T21:09:58.314 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-04-26T21:09:59.129 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 1/1 2024-04-26T21:09:59.165 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-26T21:09:59.288 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 1/1 2024-04-26T21:09:59.689 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 1/1 2024-04-26T21:10:00.027 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 1/1 2024-04-26T21:10:00.027 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:00.028 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-04-26T21:10:00.028 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-26T21:10:00.028 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:00.028 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:10:00.307 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-immutable-object-cache 2024-04-26T21:10:00.338 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-26T21:10:00.369 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-907.g2be3ef 12/12 2024-04-26T21:10:01.080 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:08 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:10:01.227 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:10:01.228 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:10:01.228 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repo Size 2024-04-26T21:10:01.228 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:10:01.228 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-04-26T21:10:01.228 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 137 k 2024-04-26T21:10:01.228 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:01.228 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-04-26T21:10:01.228 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:10:01.228 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-04-26T21:10:01.228 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:01.228 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 137 k 2024-04-26T21:10:01.229 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 379 k 2024-04-26T21:10:01.229 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-04-26T21:10:01.561 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-immutable-object-cache-17.2.7-907.g2be3efa 414 kB/s | 137 kB 00:00 2024-04-26T21:10:01.562 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:10:01.563 INFO:teuthology.orchestra.run.smithi120.stdout:Total 410 kB/s | 137 kB 00:00 2024-04-26T21:10:01.563 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-04-26T21:10:01.591 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-04-26T21:10:01.591 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-04-26T21:10:01.708 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-04-26T21:10:01.709 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-04-26T21:10:01.931 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-04-26T21:10:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-907.g2be3efa9.e 1/1 2024-04-26T21:10:02.086 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-907.g2be3efa9.e 1/1 2024-04-26T21:10:02.086 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:10:02.086 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T21:10:02.086 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-907.g2be3ef 12/12 2024-04-26T21:10:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-907.g2be3ef 1/12 2024-04-26T21:10:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-26T21:10:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-26T21:10:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-26T21:10:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-26T21:10:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-26T21:10:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-26T21:10:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-26T21:10:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-26T21:10:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-26T21:10:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-26T21:10:03.419 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-907.g2be3efa9.e 1/1 2024-04-26T21:10:03.419 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:03.419 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-04-26T21:10:03.419 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:10:03.419 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:03.419 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:10:03.452 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-26T21:10:03.452 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:03.452 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-26T21:10:03.452 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-26T21:10:03.452 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T21:10:03.452 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T21:10:03.453 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T21:10:03.453 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T21:10:03.453 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T21:10:03.453 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T21:10:03.453 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T21:10:03.453 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T21:10:03.453 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T21:10:03.453 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T21:10:03.453 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T21:10:03.453 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:03.453 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:10:03.748 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-mgr 2024-04-26T21:10:03.937 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr-rook 2024-04-26T21:10:04.523 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:11 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:10:04.603 INFO:teuthology.orchestra.run.smithi120.stdout:Package ceph-mgr-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-26T21:10:04.645 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:10:04.646 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-04-26T21:10:04.646 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:10:04.711 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:31 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:10:04.724 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-mgr-dashboard 2024-04-26T21:10:04.838 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:10:04.840 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:04.840 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-04-26T21:10:04.840 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:04.840 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-26T21:10:04.840 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 47 k 2024-04-26T21:10:04.840 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-04-26T21:10:04.840 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T21:10:04.840 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T21:10:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T21:10:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T21:10:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T21:10:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T21:10:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T21:10:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T21:10:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T21:10:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T21:10:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T21:10:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T21:10:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:04.841 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-26T21:10:04.841 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:04.841 INFO:teuthology.orchestra.run.smithi084.stdout:Install 13 Packages 2024-04-26T21:10:04.842 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:04.842 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 2.2 M 2024-04-26T21:10:04.842 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 26 M 2024-04-26T21:10:04.842 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-26T21:10:05.438 INFO:teuthology.orchestra.run.smithi084.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 398 kB/s | 19 kB 00:00 2024-04-26T21:10:05.450 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:12 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:10:05.538 INFO:teuthology.orchestra.run.smithi084.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 172 kB/s | 26 kB 00:00 2024-04-26T21:10:05.580 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:10:05.581 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:10:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-04-26T21:10:05.581 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:10:05.581 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-04-26T21:10:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 3.4 M 2024-04-26T21:10:05.581 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-04-26T21:10:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 24 k 2024-04-26T21:10:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 15 k 2024-04-26T21:10:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-04-26T21:10:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T21:10:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T21:10:05.582 INFO:teuthology.orchestra.run.smithi120.stdout:Installing weak dependencies: 2024-04-26T21:10:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-04-26T21:10:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:05.582 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-04-26T21:10:05.582 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:10:05.582 INFO:teuthology.orchestra.run.smithi120.stdout:Install 7 Packages 2024-04-26T21:10:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:05.583 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 3.7 M 2024-04-26T21:10:05.583 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 80 M 2024-04-26T21:10:05.583 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-04-26T21:10:05.621 INFO:teuthology.orchestra.run.smithi084.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.9 MB/s | 222 kB 00:00 2024-04-26T21:10:05.646 INFO:teuthology.orchestra.run.smithi084.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-04-26T21:10:05.705 INFO:teuthology.orchestra.run.smithi084.stdout:(5/13): python3-requests-oauthlib-1.3.0-12.el9. 930 kB/s | 54 kB 00:00 2024-04-26T21:10:05.747 INFO:teuthology.orchestra.run.smithi084.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.2 MB/s | 279 kB 00:00 2024-04-26T21:10:05.772 INFO:teuthology.orchestra.run.smithi084.stdout:(7/13): ceph-mgr-rook-17.2.7-907.g2be3efa9.el9. 124 kB/s | 47 kB 00:00 2024-04-26T21:10:06.100 INFO:teuthology.orchestra.run.smithi120.stdout:(1/7): ceph-grafana-dashboards-17.2.7-907.g2be3 71 kB/s | 24 kB 00:00 2024-04-26T21:10:06.125 INFO:teuthology.orchestra.run.smithi120.stdout:(2/7): ceph-prometheus-alerts-17.2.7-907.g2be3e 40 kB/s | 15 kB 00:00 2024-04-26T21:10:06.164 INFO:teuthology.orchestra.run.smithi084.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 70 kB/s | 32 kB 00:00 2024-04-26T21:10:06.189 INFO:teuthology.orchestra.run.smithi084.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 34 kB/s | 15 kB 00:00 2024-04-26T21:10:06.350 INFO:teuthology.orchestra.run.smithi120.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 36 kB/s | 9.0 kB 00:00 2024-04-26T21:10:06.440 INFO:teuthology.orchestra.run.smithi084.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 237 kB/s | 59 kB 00:00 2024-04-26T21:10:06.442 INFO:teuthology.orchestra.run.smithi120.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 129 kB/s | 41 kB 00:00 2024-04-26T21:10:06.467 INFO:teuthology.orchestra.run.smithi120.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 265 kB/s | 31 kB 00:00 2024-04-26T21:10:06.481 INFO:teuthology.orchestra.run.smithi084.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 290 kB/s | 206 kB 00:00 2024-04-26T21:10:06.589 INFO:teuthology.orchestra.run.smithi120.stdout:(6/7): ceph-mgr-dashboard-17.2.7-907.g2be3efa9. 4.0 MB/s | 3.4 MB 00:00 2024-04-26T21:10:06.635 INFO:teuthology.orchestra.run.smithi120.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 986 kB/s | 188 kB 00:00 2024-04-26T21:10:06.640 INFO:teuthology.orchestra.run.smithi084.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 450 kB/s | 90 kB 00:00 2024-04-26T21:10:06.643 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:10:06.644 INFO:teuthology.orchestra.run.smithi120.stdout:Total 3.4 MB/s | 3.7 MB 00:01 2024-04-26T21:10:06.645 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-04-26T21:10:06.673 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-04-26T21:10:06.674 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-04-26T21:10:06.723 INFO:teuthology.orchestra.run.smithi084.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.8 MB/s | 1.0 MB 00:00 2024-04-26T21:10:06.731 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:10:06.733 INFO:teuthology.orchestra.run.smithi084.stdout:Total 1.2 MB/s | 2.2 MB 00:01 2024-04-26T21:10:06.833 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-04-26T21:10:06.833 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-04-26T21:10:06.945 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-26T21:10:06.993 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-26T21:10:06.993 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-26T21:10:07.137 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-26T21:10:07.138 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-26T21:10:07.266 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-04-26T21:10:07.345 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-04-26T21:10:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-04-26T21:10:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-04-26T21:10:07.552 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-04-26T21:10:07.594 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-907.g2be3efa9.el9.no 5/7 2024-04-26T21:10:07.866 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-26T21:10:08.119 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-26T21:10:08.184 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-26T21:10:08.258 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-26T21:10:08.296 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-26T21:10:08.342 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-26T21:10:08.477 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-26T21:10:08.615 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-26T21:10:08.686 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-26T21:10:08.854 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-907.g2be3efa9.el9.n 6/7 2024-04-26T21:10:08.899 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-907.g2be3efa9.el9.noarch 7/7 2024-04-26T21:10:09.592 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-26T21:10:09.652 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-26T21:10:09.685 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-26T21:10:09.737 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-26T21:10:09.770 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:17.2.7-907.g2be3efa9.el9.noarch 13/13 2024-04-26T21:10:09.946 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-907.g2be3efa9.el9.noarch 7/7 2024-04-26T21:10:09.947 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-907.g2be3efa9.el9.n 1/7 2024-04-26T21:10:09.947 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-907.g2be3efa9.el9.noarch 2/7 2024-04-26T21:10:09.947 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-907.g2be3efa9.el9.no 3/7 2024-04-26T21:10:09.947 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-04-26T21:10:09.947 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-04-26T21:10:09.947 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-04-26T21:10:10.276 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-04-26T21:10:10.277 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:10.277 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-04-26T21:10:10.277 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-26T21:10:10.277 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-26T21:10:10.277 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-26T21:10:10.277 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-04-26T21:10:10.277 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-04-26T21:10:10.277 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T21:10:10.277 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T21:10:10.277 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:10.277 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:10:10.575 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-26T21:10:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-907.g2be3efa9.el9.noarch 13/13 2024-04-26T21:10:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:17.2.7-907.g2be3efa9.el9.noarch 1/13 2024-04-26T21:10:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-26T21:10:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-26T21:10:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-26T21:10:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-26T21:10:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-26T21:10:10.642 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-26T21:10:10.642 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-26T21:10:10.642 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-26T21:10:10.642 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-26T21:10:10.642 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-26T21:10:10.642 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-26T21:10:11.110 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-26T21:10:11.110 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:11.110 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-26T21:10:11.110 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-26T21:10:11.110 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T21:10:11.110 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T21:10:11.110 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T21:10:11.111 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T21:10:11.111 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T21:10:11.111 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T21:10:11.111 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T21:10:11.111 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T21:10:11.111 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T21:10:11.111 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T21:10:11.111 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T21:10:11.111 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T21:10:11.111 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:11.111 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:10:11.323 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:18 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:10:11.418 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr-cephadm 2024-04-26T21:10:11.446 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:10:11.447 INFO:teuthology.orchestra.run.smithi120.stdout:====================================================================================== 2024-04-26T21:10:11.447 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-04-26T21:10:11.448 INFO:teuthology.orchestra.run.smithi120.stdout:====================================================================================== 2024-04-26T21:10:11.448 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-04-26T21:10:11.448 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 7.4 M 2024-04-26T21:10:11.448 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-04-26T21:10:11.448 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T21:10:11.448 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T21:10:11.448 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T21:10:11.448 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T21:10:11.448 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T21:10:11.448 INFO:teuthology.orchestra.run.smithi120.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T21:10:11.448 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T21:10:11.448 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T21:10:11.448 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T21:10:11.449 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T21:10:11.449 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T21:10:11.449 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:11.449 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-04-26T21:10:11.449 INFO:teuthology.orchestra.run.smithi120.stdout:====================================================================================== 2024-04-26T21:10:11.449 INFO:teuthology.orchestra.run.smithi120.stdout:Install 12 Packages 2024-04-26T21:10:11.449 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:11.449 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 38 M 2024-04-26T21:10:11.450 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 209 M 2024-04-26T21:10:11.450 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-04-26T21:10:12.111 INFO:teuthology.orchestra.run.smithi120.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 530 kB/s | 195 kB 00:00 2024-04-26T21:10:12.169 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:39 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:10:12.211 INFO:teuthology.orchestra.run.smithi120.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.7 MB/s | 803 kB 00:00 2024-04-26T21:10:12.291 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:10:12.292 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:12.292 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-04-26T21:10:12.292 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:12.292 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-26T21:10:12.292 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 123 k 2024-04-26T21:10:12.292 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-04-26T21:10:12.292 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T21:10:12.292 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T21:10:12.293 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T21:10:12.293 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T21:10:12.293 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T21:10:12.293 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:12.293 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-26T21:10:12.293 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:12.293 INFO:teuthology.orchestra.run.smithi084.stdout:Install 6 Packages 2024-04-26T21:10:12.293 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:12.293 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 7.0 M 2024-04-26T21:10:12.294 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 33 M 2024-04-26T21:10:12.294 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-26T21:10:12.570 INFO:teuthology.orchestra.run.smithi120.stdout:(3/12): ceph-mgr-diskprediction-local-17.2.7-90 9.0 MB/s | 7.4 MB 00:00 2024-04-26T21:10:12.870 INFO:teuthology.orchestra.run.smithi120.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 43 kB/s | 33 kB 00:00 2024-04-26T21:10:12.900 INFO:teuthology.orchestra.run.smithi084.stdout:(1/6): ceph-mgr-cephadm-17.2.7-907.g2be3efa9.el 397 kB/s | 123 kB 00:00 2024-04-26T21:10:12.942 INFO:teuthology.orchestra.run.smithi084.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 705 kB/s | 248 kB 00:00 2024-04-26T21:10:13.126 INFO:teuthology.orchestra.run.smithi084.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 316 kB/s | 58 kB 00:00 2024-04-26T21:10:13.179 INFO:teuthology.orchestra.run.smithi120.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 30 kB/s | 18 kB 00:00 2024-04-26T21:10:13.218 INFO:teuthology.orchestra.run.smithi084.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 562 kB/s | 51 kB 00:00 2024-04-26T21:10:13.251 INFO:teuthology.orchestra.run.smithi084.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.5 MB/s | 548 kB 00:00 2024-04-26T21:10:13.487 INFO:teuthology.orchestra.run.smithi120.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 57 kB/s | 35 kB 00:00 2024-04-26T21:10:13.919 INFO:teuthology.orchestra.run.smithi084.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.5 MB/s | 6.0 MB 00:01 2024-04-26T21:10:13.919 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:10:13.919 INFO:teuthology.orchestra.run.smithi084.stdout:Total 4.3 MB/s | 7.0 MB 00:01 2024-04-26T21:10:14.045 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-26T21:10:14.083 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-26T21:10:14.084 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-26T21:10:14.232 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-26T21:10:14.233 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-26T21:10:14.337 INFO:teuthology.orchestra.run.smithi120.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 287 kB/s | 244 kB 00:00 2024-04-26T21:10:14.632 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-26T21:10:14.840 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-26T21:10:14.901 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-26T21:10:15.577 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-26T21:10:15.682 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-26T21:10:15.750 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-26T21:10:15.782 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 6/6 2024-04-26T21:10:16.304 INFO:teuthology.orchestra.run.smithi120.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 748 kB/s | 3.0 MB 00:04 2024-04-26T21:10:16.545 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 6/6 2024-04-26T21:10:16.546 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 1/6 2024-04-26T21:10:16.546 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-26T21:10:16.546 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-26T21:10:16.546 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-26T21:10:16.546 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-26T21:10:16.890 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-26T21:10:16.890 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:16.890 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-26T21:10:16.890 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-26T21:10:16.890 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T21:10:16.891 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T21:10:16.891 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T21:10:16.891 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T21:10:16.891 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T21:10:16.891 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:16.891 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:10:17.171 INFO:teuthology.orchestra.run.smithi120.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 290 kB/s | 250 kB 00:00 2024-04-26T21:10:17.197 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-fuse 2024-04-26T21:10:17.954 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:44 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:10:18.081 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:10:18.082 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:18.082 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-04-26T21:10:18.082 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:18.082 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-26T21:10:18.082 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 812 k 2024-04-26T21:10:18.082 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-04-26T21:10:18.082 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T21:10:18.082 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:18.083 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-26T21:10:18.083 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:18.083 INFO:teuthology.orchestra.run.smithi084.stdout:Install 2 Packages 2024-04-26T21:10:18.083 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:18.083 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 893 k 2024-04-26T21:10:18.083 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 2.6 M 2024-04-26T21:10:18.083 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-26T21:10:18.954 INFO:teuthology.orchestra.run.smithi084.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 108 kB/s | 80 kB 00:00 2024-04-26T21:10:19.036 INFO:teuthology.orchestra.run.smithi084.stdout:(2/2): ceph-fuse-17.2.7-907.g2be3efa9.el9.x86_6 986 kB/s | 812 kB 00:00 2024-04-26T21:10:19.038 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:10:19.039 INFO:teuthology.orchestra.run.smithi084.stdout:Total 934 kB/s | 893 kB 00:00 2024-04-26T21:10:19.079 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-26T21:10:19.152 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-26T21:10:19.152 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-26T21:10:19.196 INFO:teuthology.orchestra.run.smithi120.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 806 kB/s | 4.7 MB 00:06 2024-04-26T21:10:19.259 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-26T21:10:19.259 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-26T21:10:19.555 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-26T21:10:19.755 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-26T21:10:19.833 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 2/2 2024-04-26T21:10:20.621 INFO:teuthology.orchestra.run.smithi120.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 831 kB/s | 5.1 MB 00:06 2024-04-26T21:10:20.779 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 2/2 2024-04-26T21:10:20.779 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 1/2 2024-04-26T21:10:21.052 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-26T21:10:21.053 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:21.053 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-26T21:10:21.053 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-26T21:10:21.053 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:21.053 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:10:21.346 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install librados-devel 2024-04-26T21:10:22.115 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:49 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:10:22.244 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:10:22.244 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:22.244 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repo Size 2024-04-26T21:10:22.244 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:22.244 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-26T21:10:22.245 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 126 k 2024-04-26T21:10:22.245 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:22.245 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-26T21:10:22.245 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:22.245 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-04-26T21:10:22.245 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:22.245 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 126 k 2024-04-26T21:10:22.245 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 448 k 2024-04-26T21:10:22.246 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-26T21:10:22.594 INFO:teuthology.orchestra.run.smithi084.stdout:librados-devel-17.2.7-907.g2be3efa9.el9.x86_64. 363 kB/s | 126 kB 00:00 2024-04-26T21:10:22.597 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:10:22.597 INFO:teuthology.orchestra.run.smithi084.stdout:Total 359 kB/s | 126 kB 00:00 2024-04-26T21:10:22.598 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-26T21:10:22.618 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-26T21:10:22.618 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-26T21:10:22.731 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-26T21:10:22.731 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-26T21:10:22.922 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-26T21:10:23.096 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:10:23.685 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:10:23.935 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:10:23.935 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:23.935 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-26T21:10:23.935 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:10:23.935 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:23.935 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:10:24.283 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install libcephfs2 2024-04-26T21:10:25.041 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:52 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:10:25.129 INFO:teuthology.orchestra.run.smithi084.stdout:Package libcephfs2-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-26T21:10:25.172 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:10:25.173 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-04-26T21:10:25.174 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:10:25.249 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install libcephfs-devel 2024-04-26T21:10:25.979 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:52 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:10:26.102 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:10:26.103 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:26.103 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repo Size 2024-04-26T21:10:26.103 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:26.103 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-26T21:10:26.103 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 25 k 2024-04-26T21:10:26.103 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:26.103 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-26T21:10:26.104 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:26.104 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-04-26T21:10:26.104 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:26.104 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 25 k 2024-04-26T21:10:26.104 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 110 k 2024-04-26T21:10:26.104 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-26T21:10:26.373 INFO:teuthology.orchestra.run.smithi084.stdout:libcephfs-devel-17.2.7-907.g2be3efa9.el9.x86_64 93 kB/s | 25 kB 00:00 2024-04-26T21:10:26.375 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:10:26.376 INFO:teuthology.orchestra.run.smithi084.stdout:Total 92 kB/s | 25 kB 00:00 2024-04-26T21:10:26.376 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-26T21:10:26.389 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-26T21:10:26.389 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-26T21:10:26.395 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-26T21:10:26.396 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-26T21:10:26.527 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-26T21:10:26.735 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:10:27.269 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:10:27.518 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:10:27.519 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:27.519 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-26T21:10:27.519 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:10:27.519 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:27.519 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:10:27.728 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install librados2 2024-04-26T21:10:28.489 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:55 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:10:28.573 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-26T21:10:28.614 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:10:28.615 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-04-26T21:10:28.616 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:10:28.690 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install librbd1 2024-04-26T21:10:29.429 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:56 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:10:29.508 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-26T21:10:29.549 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:10:29.550 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-04-26T21:10:29.550 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:10:29.619 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install python3-rados 2024-04-26T21:10:30.335 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:57 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:10:30.415 INFO:teuthology.orchestra.run.smithi084.stdout:Package python3-rados-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-26T21:10:30.456 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:10:30.457 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-04-26T21:10:30.457 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:10:30.531 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install python3-rgw 2024-04-26T21:10:31.280 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:58 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:10:31.360 INFO:teuthology.orchestra.run.smithi084.stdout:Package python3-rgw-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-26T21:10:31.401 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:10:31.402 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-04-26T21:10:31.402 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:10:31.481 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install python3-cephfs 2024-04-26T21:10:32.193 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:59 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:10:32.275 INFO:teuthology.orchestra.run.smithi084.stdout:Package python3-cephfs-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-26T21:10:32.317 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:10:32.318 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-04-26T21:10:32.318 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:10:32.398 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install python3-rbd 2024-04-26T21:10:33.150 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:00 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:10:33.235 INFO:teuthology.orchestra.run.smithi084.stdout:Package python3-rbd-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-26T21:10:33.279 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:10:33.280 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-04-26T21:10:33.280 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:10:33.358 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install rbd-fuse 2024-04-26T21:10:34.121 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:01 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:10:34.247 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:10:34.248 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:34.248 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-04-26T21:10:34.248 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:34.248 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-26T21:10:34.248 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 82 k 2024-04-26T21:10:34.248 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:34.249 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-26T21:10:34.249 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:34.249 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-04-26T21:10:34.249 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:34.249 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 82 k 2024-04-26T21:10:34.249 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 222 k 2024-04-26T21:10:34.249 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-26T21:10:34.493 INFO:teuthology.orchestra.run.smithi084.stdout:rbd-fuse-17.2.7-907.g2be3efa9.el9.x86_64.rpm 336 kB/s | 82 kB 00:00 2024-04-26T21:10:34.494 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:10:34.495 INFO:teuthology.orchestra.run.smithi084.stdout:Total 332 kB/s | 82 kB 00:00 2024-04-26T21:10:34.495 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-26T21:10:34.519 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-26T21:10:34.519 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-26T21:10:34.630 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-26T21:10:34.631 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-26T21:10:34.829 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-26T21:10:34.986 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:10:35.554 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:10:35.678 INFO:teuthology.orchestra.run.smithi120.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 899 kB/s | 16 MB 00:18 2024-04-26T21:10:35.684 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:10:35.684 INFO:teuthology.orchestra.run.smithi120.stdout:Total 1.6 MB/s | 38 MB 00:24 2024-04-26T21:10:35.876 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:10:35.876 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:35.876 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-26T21:10:35.876 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:10:35.876 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:35.876 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:10:36.191 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install rbd-mirror 2024-04-26T21:10:36.316 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-04-26T21:10:36.395 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-04-26T21:10:36.395 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-04-26T21:10:36.972 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:03 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:10:37.041 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-04-26T21:10:37.042 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-04-26T21:10:37.100 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:10:37.101 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:37.101 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repo Size 2024-04-26T21:10:37.101 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:37.101 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-26T21:10:37.101 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 2.9 M 2024-04-26T21:10:37.101 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:37.101 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-26T21:10:37.101 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:37.101 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-04-26T21:10:37.101 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:37.102 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 2.9 M 2024-04-26T21:10:37.102 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 12 M 2024-04-26T21:10:37.102 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-26T21:10:37.729 INFO:teuthology.orchestra.run.smithi084.stdout:rbd-mirror-17.2.7-907.g2be3efa9.el9.x86_64.rpm 4.7 MB/s | 2.9 MB 00:00 2024-04-26T21:10:37.731 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:10:37.732 INFO:teuthology.orchestra.run.smithi084.stdout:Total 4.7 MB/s | 2.9 MB 00:00 2024-04-26T21:10:37.733 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-26T21:10:37.765 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-26T21:10:37.765 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-26T21:10:37.887 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-26T21:10:37.887 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-26T21:10:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-04-26T21:10:38.071 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-26T21:10:38.127 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-26T21:10:38.301 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-26T21:10:38.356 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-26T21:10:38.412 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-26T21:10:38.505 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:10:38.609 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:10:38.609 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:10:38.609 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T21:10:38.609 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T21:10:38.609 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T21:10:38.609 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:38.618 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-26T21:10:38.653 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-26T21:10:38.782 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-26T21:10:39.630 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-26T21:10:39.792 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-26T21:10:40.082 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:10:40.083 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:40.083 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-26T21:10:40.083 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:10:40.083 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:40.083 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:10:40.394 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install rbd-nbd 2024-04-26T21:10:41.174 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:08 ago on Fri 26 Apr 2024 09:08:33 PM UTC. 2024-04-26T21:10:41.295 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-26T21:10:41.296 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:41.296 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-04-26T21:10:41.296 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:41.296 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-26T21:10:41.296 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 165 k 2024-04-26T21:10:41.296 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:41.296 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-26T21:10:41.296 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-26T21:10:41.296 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-04-26T21:10:41.296 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:41.297 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 165 k 2024-04-26T21:10:41.297 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 477 k 2024-04-26T21:10:41.297 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-26T21:10:41.369 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-26T21:10:41.665 INFO:teuthology.orchestra.run.smithi084.stdout:rbd-nbd-17.2.7-907.g2be3efa9.el9.x86_64.rpm 449 kB/s | 165 kB 00:00 2024-04-26T21:10:41.667 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:10:41.668 INFO:teuthology.orchestra.run.smithi084.stdout:Total 445 kB/s | 165 kB 00:00 2024-04-26T21:10:41.668 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-26T21:10:41.695 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-26T21:10:41.695 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-26T21:10:41.810 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-26T21:10:41.810 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-26T21:10:42.021 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-26T21:10:42.171 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:10:42.540 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-26T21:10:42.570 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-907.g2be3ef 12/12 2024-04-26T21:10:42.763 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-nbd-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:10:43.044 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:10:43.045 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:43.045 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-26T21:10:43.045 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:10:43.045 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:10:43.045 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-26T21:10:43.357 DEBUG:teuthology.parallel:result is None 2024-04-26T21:10:45.187 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-907.g2be3ef 12/12 2024-04-26T21:10:45.187 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-907.g2be3ef 1/12 2024-04-26T21:10:45.187 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-26T21:10:45.187 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-26T21:10:45.188 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-26T21:10:45.188 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-26T21:10:45.188 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-26T21:10:45.188 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-26T21:10:45.188 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-26T21:10:45.188 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-26T21:10:45.188 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-26T21:10:45.188 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-26T21:10:45.711 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-26T21:10:45.711 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:45.711 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-04-26T21:10:45.711 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-26T21:10:45.711 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T21:10:45.711 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T21:10:45.712 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T21:10:45.712 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T21:10:45.712 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T21:10:45.712 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T21:10:45.712 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T21:10:45.712 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T21:10:45.712 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T21:10:45.712 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T21:10:45.712 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T21:10:45.712 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:45.712 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:10:46.116 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-mgr-rook 2024-04-26T21:10:46.889 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:53 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:10:47.021 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:10:47.022 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:10:47.022 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-04-26T21:10:47.022 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:10:47.023 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-04-26T21:10:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 47 k 2024-04-26T21:10:47.023 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-04-26T21:10:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T21:10:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T21:10:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T21:10:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T21:10:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T21:10:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T21:10:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T21:10:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T21:10:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T21:10:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T21:10:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T21:10:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T21:10:47.024 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:47.024 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-04-26T21:10:47.024 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:10:47.024 INFO:teuthology.orchestra.run.smithi120.stdout:Install 13 Packages 2024-04-26T21:10:47.024 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:47.024 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 2.2 M 2024-04-26T21:10:47.024 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 26 M 2024-04-26T21:10:47.025 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-04-26T21:10:47.985 INFO:teuthology.orchestra.run.smithi120.stdout:(1/13): ceph-mgr-rook-17.2.7-907.g2be3efa9.el9. 117 kB/s | 47 kB 00:00 2024-04-26T21:10:48.194 INFO:teuthology.orchestra.run.smithi120.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 31 kB/s | 19 kB 00:00 2024-04-26T21:10:48.294 INFO:teuthology.orchestra.run.smithi120.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 36 kB/s | 26 kB 00:00 2024-04-26T21:10:48.897 INFO:teuthology.orchestra.run.smithi120.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 244 kB/s | 222 kB 00:00 2024-04-26T21:10:49.036 INFO:teuthology.orchestra.run.smithi120.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 206 kB/s | 159 kB 00:00 2024-04-26T21:10:49.161 INFO:teuthology.orchestra.run.smithi120.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 260 kB/s | 32 kB 00:00 2024-04-26T21:10:49.287 INFO:teuthology.orchestra.run.smithi120.stdout:(7/13): python3-certifi-2021.10.8-2.el9.noarch. 280 kB/s | 15 kB 00:00 2024-04-26T21:10:49.321 INFO:teuthology.orchestra.run.smithi120.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 272 kB/s | 279 kB 00:01 2024-04-26T21:10:49.412 INFO:teuthology.orchestra.run.smithi120.stdout:(9/13): python3-google-auth-2.29.0-1.el9.noarch 1.6 MB/s | 206 kB 00:00 2024-04-26T21:10:49.463 INFO:teuthology.orchestra.run.smithi120.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-04-26T21:10:49.505 INFO:teuthology.orchestra.run.smithi120.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.1 MB/s | 90 kB 00:00 2024-04-26T21:10:49.639 INFO:teuthology.orchestra.run.smithi120.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 3.2 MB/s | 1.0 MB 00:00 2024-04-26T21:10:49.672 INFO:teuthology.orchestra.run.smithi120.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 69 kB/s | 54 kB 00:00 2024-04-26T21:10:49.675 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:10:49.675 INFO:teuthology.orchestra.run.smithi120.stdout:Total 849 kB/s | 2.2 MB 00:02 2024-04-26T21:10:49.893 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-04-26T21:10:49.941 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-04-26T21:10:49.941 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-04-26T21:10:50.085 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-04-26T21:10:50.086 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-04-26T21:10:50.819 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-04-26T21:10:51.040 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-26T21:10:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-26T21:10:51.215 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-26T21:10:51.253 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-26T21:10:51.310 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-26T21:10:51.447 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-26T21:10:51.586 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-26T21:10:51.652 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-26T21:10:52.558 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-26T21:10:52.610 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-26T21:10:52.644 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-26T21:10:52.694 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-26T21:10:52.745 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-rook-2:17.2.7-907.g2be3efa9.el9.noarch 13/13 2024-04-26T21:10:53.621 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-907.g2be3efa9.el9.noarch 13/13 2024-04-26T21:10:53.621 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-rook-2:17.2.7-907.g2be3efa9.el9.noarch 1/13 2024-04-26T21:10:53.621 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-26T21:10:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-26T21:10:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-26T21:10:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-26T21:10:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-26T21:10:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-26T21:10:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-26T21:10:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-26T21:10:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-26T21:10:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-26T21:10:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-26T21:10:54.046 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-26T21:10:54.046 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:54.046 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-04-26T21:10:54.046 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-26T21:10:54.046 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T21:10:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T21:10:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T21:10:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T21:10:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T21:10:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T21:10:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T21:10:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T21:10:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T21:10:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T21:10:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T21:10:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T21:10:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:54.047 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:10:54.376 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-mgr-cephadm 2024-04-26T21:10:55.143 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:02 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:10:55.262 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:10:55.263 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:10:55.263 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-04-26T21:10:55.263 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:10:55.264 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-04-26T21:10:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 123 k 2024-04-26T21:10:55.264 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-04-26T21:10:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T21:10:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T21:10:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T21:10:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T21:10:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T21:10:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:55.264 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-04-26T21:10:55.264 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:10:55.264 INFO:teuthology.orchestra.run.smithi120.stdout:Install 6 Packages 2024-04-26T21:10:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:55.265 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 7.0 M 2024-04-26T21:10:55.265 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 33 M 2024-04-26T21:10:55.265 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-04-26T21:10:55.911 INFO:teuthology.orchestra.run.smithi120.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 682 kB/s | 248 kB 00:00 2024-04-26T21:10:56.011 INFO:teuthology.orchestra.run.smithi120.stdout:(2/6): ceph-mgr-cephadm-17.2.7-907.g2be3efa9.el 266 kB/s | 123 kB 00:00 2024-04-26T21:10:56.211 INFO:teuthology.orchestra.run.smithi120.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 9.0 MB/s | 6.0 MB 00:00 2024-04-26T21:10:56.703 INFO:teuthology.orchestra.run.smithi120.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 90 kB/s | 58 kB 00:00 2024-04-26T21:10:56.778 INFO:teuthology.orchestra.run.smithi120.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 100 kB/s | 51 kB 00:00 2024-04-26T21:10:56.812 INFO:teuthology.orchestra.run.smithi120.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 609 kB/s | 548 kB 00:00 2024-04-26T21:10:56.818 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:10:56.818 INFO:teuthology.orchestra.run.smithi120.stdout:Total 4.5 MB/s | 7.0 MB 00:01 2024-04-26T21:10:56.934 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-04-26T21:10:56.974 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-04-26T21:10:56.974 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-04-26T21:10:57.122 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-04-26T21:10:57.123 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-04-26T21:10:57.510 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-04-26T21:10:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-26T21:10:57.780 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-26T21:10:58.442 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-26T21:10:58.570 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-26T21:10:58.648 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-26T21:10:58.677 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 6/6 2024-04-26T21:10:59.545 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 6/6 2024-04-26T21:10:59.545 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 1/6 2024-04-26T21:10:59.545 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-26T21:10:59.545 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-26T21:10:59.545 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-26T21:10:59.545 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-26T21:10:59.920 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-26T21:10:59.920 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:59.920 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-04-26T21:10:59.920 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-26T21:10:59.920 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T21:10:59.920 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T21:10:59.920 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T21:10:59.920 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T21:10:59.920 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T21:10:59.920 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:10:59.921 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:11:00.300 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-fuse 2024-04-26T21:11:01.063 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:08 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:11:01.184 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:11:01.184 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:11:01.185 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-04-26T21:11:01.185 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:11:01.185 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-04-26T21:11:01.185 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 812 k 2024-04-26T21:11:01.185 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-04-26T21:11:01.185 INFO:teuthology.orchestra.run.smithi120.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T21:11:01.185 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:01.185 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-04-26T21:11:01.185 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:11:01.185 INFO:teuthology.orchestra.run.smithi120.stdout:Install 2 Packages 2024-04-26T21:11:01.185 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:01.186 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 893 k 2024-04-26T21:11:01.186 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 2.6 M 2024-04-26T21:11:01.186 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-04-26T21:11:01.676 INFO:teuthology.orchestra.run.smithi120.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 387 kB/s | 80 kB 00:00 2024-04-26T21:11:01.818 INFO:teuthology.orchestra.run.smithi120.stdout:(2/2): ceph-fuse-17.2.7-907.g2be3efa9.el9.x86_6 2.3 MB/s | 812 kB 00:00 2024-04-26T21:11:01.820 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:11:01.821 INFO:teuthology.orchestra.run.smithi120.stdout:Total 1.4 MB/s | 893 kB 00:00 2024-04-26T21:11:01.861 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-04-26T21:11:01.935 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-04-26T21:11:01.935 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-04-26T21:11:02.041 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-04-26T21:11:02.041 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-04-26T21:11:02.303 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-04-26T21:11:02.464 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-26T21:11:02.544 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 2/2 2024-04-26T21:11:03.385 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 2/2 2024-04-26T21:11:03.385 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 1/2 2024-04-26T21:11:03.678 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-26T21:11:03.678 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:03.678 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-04-26T21:11:03.678 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-26T21:11:03.678 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:03.679 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:11:04.035 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install librados-devel 2024-04-26T21:11:04.799 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:11 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:11:04.925 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:11:04.926 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:11:04.926 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repo Size 2024-04-26T21:11:04.926 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:11:04.926 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-04-26T21:11:04.927 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 126 k 2024-04-26T21:11:04.927 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:04.927 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-04-26T21:11:04.927 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:11:04.927 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-04-26T21:11:04.927 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:04.927 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 126 k 2024-04-26T21:11:04.927 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 448 k 2024-04-26T21:11:04.927 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-04-26T21:11:05.164 INFO:teuthology.orchestra.run.smithi120.stdout:librados-devel-17.2.7-907.g2be3efa9.el9.x86_64. 536 kB/s | 126 kB 00:00 2024-04-26T21:11:05.165 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:11:05.166 INFO:teuthology.orchestra.run.smithi120.stdout:Total 528 kB/s | 126 kB 00:00 2024-04-26T21:11:05.166 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-04-26T21:11:05.186 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-04-26T21:11:05.186 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-04-26T21:11:05.300 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-04-26T21:11:05.300 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-04-26T21:11:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-04-26T21:11:05.678 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librados-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:11:06.218 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:11:06.465 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:11:06.466 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:06.466 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-04-26T21:11:06.466 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:11:06.466 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:06.466 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:11:06.778 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install libcephfs2 2024-04-26T21:11:07.553 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:14 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:11:07.640 INFO:teuthology.orchestra.run.smithi120.stdout:Package libcephfs2-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-26T21:11:07.683 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:11:07.685 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-04-26T21:11:07.685 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:11:07.762 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install libcephfs-devel 2024-04-26T21:11:08.459 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:15 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:11:08.583 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:11:08.583 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:11:08.584 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repo Size 2024-04-26T21:11:08.584 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:11:08.584 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-04-26T21:11:08.584 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 25 k 2024-04-26T21:11:08.584 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:08.584 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-04-26T21:11:08.584 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:11:08.584 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-04-26T21:11:08.584 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:08.584 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 25 k 2024-04-26T21:11:08.584 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 110 k 2024-04-26T21:11:08.584 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-04-26T21:11:08.825 INFO:teuthology.orchestra.run.smithi120.stdout:libcephfs-devel-17.2.7-907.g2be3efa9.el9.x86_64 104 kB/s | 25 kB 00:00 2024-04-26T21:11:08.827 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:11:08.828 INFO:teuthology.orchestra.run.smithi120.stdout:Total 102 kB/s | 25 kB 00:00 2024-04-26T21:11:08.828 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-04-26T21:11:08.841 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-04-26T21:11:08.841 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-04-26T21:11:08.847 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-04-26T21:11:08.848 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-04-26T21:11:08.989 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-04-26T21:11:09.132 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:11:09.578 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:11:09.839 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:11:09.839 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:09.839 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-04-26T21:11:09.839 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:11:09.839 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:09.839 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:11:10.084 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install librados2 2024-04-26T21:11:10.842 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:17 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:11:10.923 INFO:teuthology.orchestra.run.smithi120.stdout:Package librados2-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-26T21:11:10.966 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:11:10.966 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-04-26T21:11:10.966 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:11:11.074 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install librbd1 2024-04-26T21:11:11.818 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:18 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:11:11.912 INFO:teuthology.orchestra.run.smithi120.stdout:Package librbd1-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-26T21:11:11.954 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:11:11.956 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-04-26T21:11:11.956 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:11:12.039 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install python3-rados 2024-04-26T21:11:12.766 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:19 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:11:12.851 INFO:teuthology.orchestra.run.smithi120.stdout:Package python3-rados-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-26T21:11:12.893 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:11:12.894 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-04-26T21:11:12.894 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:11:12.980 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install python3-rgw 2024-04-26T21:11:13.718 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:20 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:11:13.806 INFO:teuthology.orchestra.run.smithi120.stdout:Package python3-rgw-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-26T21:11:13.849 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:11:13.850 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-04-26T21:11:13.850 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:11:13.930 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install python3-cephfs 2024-04-26T21:11:14.645 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:21 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:11:14.729 INFO:teuthology.orchestra.run.smithi120.stdout:Package python3-cephfs-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-26T21:11:14.771 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:11:14.772 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-04-26T21:11:14.772 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:11:14.853 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install python3-rbd 2024-04-26T21:11:15.605 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:22 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:11:15.689 INFO:teuthology.orchestra.run.smithi120.stdout:Package python3-rbd-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-26T21:11:15.730 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:11:15.731 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-04-26T21:11:15.731 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:11:15.817 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install rbd-fuse 2024-04-26T21:11:16.558 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:23 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:11:16.679 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:11:16.679 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:11:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: Package Architecture Version Repository Size 2024-04-26T21:11:16.679 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:11:16.679 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-04-26T21:11:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 82 k 2024-04-26T21:11:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:16.679 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-04-26T21:11:16.680 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:11:16.680 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-04-26T21:11:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:16.680 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 82 k 2024-04-26T21:11:16.680 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 222 k 2024-04-26T21:11:16.680 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-04-26T21:11:17.004 INFO:teuthology.orchestra.run.smithi120.stdout:rbd-fuse-17.2.7-907.g2be3efa9.el9.x86_64.rpm 253 kB/s | 82 kB 00:00 2024-04-26T21:11:17.005 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:11:17.006 INFO:teuthology.orchestra.run.smithi120.stdout:Total 251 kB/s | 82 kB 00:00 2024-04-26T21:11:17.007 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-04-26T21:11:17.030 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-04-26T21:11:17.030 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-04-26T21:11:17.145 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-04-26T21:11:17.145 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-04-26T21:11:17.358 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-04-26T21:11:17.482 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:11:18.016 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rbd-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:11:18.386 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:11:18.386 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:18.386 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-04-26T21:11:18.386 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:11:18.386 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:18.386 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:11:18.683 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install rbd-mirror 2024-04-26T21:11:19.457 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:26 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:11:19.598 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:11:19.599 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:11:19.599 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repo Size 2024-04-26T21:11:19.599 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:11:19.600 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-04-26T21:11:19.600 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 2.9 M 2024-04-26T21:11:19.600 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:19.600 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-04-26T21:11:19.600 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:11:19.600 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-04-26T21:11:19.601 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:19.602 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 2.9 M 2024-04-26T21:11:19.602 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 12 M 2024-04-26T21:11:19.602 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-04-26T21:11:19.998 INFO:teuthology.orchestra.run.smithi120.stdout:rbd-mirror-17.2.7-907.g2be3efa9.el9.x86_64.rpm 7.4 MB/s | 2.9 MB 00:00 2024-04-26T21:11:20.000 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:11:20.001 INFO:teuthology.orchestra.run.smithi120.stdout:Total 7.3 MB/s | 2.9 MB 00:00 2024-04-26T21:11:20.001 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-04-26T21:11:20.034 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-04-26T21:11:20.035 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-04-26T21:11:20.153 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-04-26T21:11:20.154 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-04-26T21:11:20.711 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-04-26T21:11:20.782 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-mirror-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:11:20.857 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rbd-mirror-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:11:20.857 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:11:20.857 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T21:11:20.857 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T21:11:20.858 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T21:11:20.858 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:22.271 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-mirror-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:11:22.271 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:22.271 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-04-26T21:11:22.271 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:11:22.271 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:22.272 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:11:22.583 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install rbd-nbd 2024-04-26T21:11:23.385 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:02:30 ago on Fri 26 Apr 2024 09:08:53 PM UTC. 2024-04-26T21:11:23.505 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-04-26T21:11:23.505 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:11:23.505 INFO:teuthology.orchestra.run.smithi120.stdout: Package Architecture Version Repository Size 2024-04-26T21:11:23.505 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:11:23.505 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-04-26T21:11:23.505 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 165 k 2024-04-26T21:11:23.505 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:23.505 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-04-26T21:11:23.506 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-04-26T21:11:23.506 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-04-26T21:11:23.506 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:23.506 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 165 k 2024-04-26T21:11:23.506 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 477 k 2024-04-26T21:11:23.506 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-04-26T21:11:23.746 INFO:teuthology.orchestra.run.smithi120.stdout:rbd-nbd-17.2.7-907.g2be3efa9.el9.x86_64.rpm 699 kB/s | 165 kB 00:00 2024-04-26T21:11:23.746 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:11:23.746 INFO:teuthology.orchestra.run.smithi120.stdout:Total 690 kB/s | 165 kB 00:00 2024-04-26T21:11:23.746 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-04-26T21:11:23.772 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-04-26T21:11:23.773 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-04-26T21:11:23.852 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-04-26T21:11:23.852 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-04-26T21:11:24.060 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-04-26T21:11:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-nbd-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:11:24.810 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rbd-nbd-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:11:25.171 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-nbd-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-26T21:11:25.172 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:25.172 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-04-26T21:11:25.172 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-26T21:11:25.172 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:11:25.172 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-04-26T21:11:25.546 DEBUG:teuthology.parallel:result is None 2024-04-26T21:11:25.546 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T21:11:25.546 INFO:teuthology.packaging:ref: None 2024-04-26T21:11:25.546 INFO:teuthology.packaging:tag: None 2024-04-26T21:11:25.546 INFO:teuthology.packaging:branch: quincy 2024-04-26T21:11:25.546 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:11:25.547 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-26T21:11:25.784 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T21:11:25.856 INFO:teuthology.orchestra.run.smithi084.stdout:17.2.7-907.g2be3efa9.el9 2024-04-26T21:11:25.857 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-907.g2be3efa9.el9 2024-04-26T21:11:25.857 INFO:teuthology.task.install:The correct ceph version 17.2.7-907.g2be3efa9 is installed. 2024-04-26T21:11:25.859 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T21:11:25.859 INFO:teuthology.packaging:ref: None 2024-04-26T21:11:25.859 INFO:teuthology.packaging:tag: None 2024-04-26T21:11:25.859 INFO:teuthology.packaging:branch: quincy 2024-04-26T21:11:25.859 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:11:25.859 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-26T21:11:26.096 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T21:11:26.165 INFO:teuthology.orchestra.run.smithi120.stdout:17.2.7-907.g2be3efa9.el9 2024-04-26T21:11:26.165 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-907.g2be3efa9.el9 2024-04-26T21:11:26.165 INFO:teuthology.task.install:The correct ceph version 17.2.7-907.g2be3efa9 is installed. 2024-04-26T21:11:26.167 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T21:11:26.167 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-26T21:11:26.167 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T21:11:26.257 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T21:11:26.258 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T21:11:26.347 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T21:11:26.347 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-26T21:11:26.347 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T21:11:26.434 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T21:11:26.554 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T21:11:26.554 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T21:11:26.641 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T21:11:26.769 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T21:11:26.769 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-26T21:11:26.770 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T21:11:26.848 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T21:11:26.969 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T21:11:26.969 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T21:11:27.057 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T21:11:27.188 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T21:11:27.189 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-26T21:11:27.189 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T21:11:27.261 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T21:11:27.368 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T21:11:27.368 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T21:11:27.452 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T21:11:27.538 INFO:teuthology.run_tasks:Running task print... 2024-04-26T21:11:27.548 INFO:teuthology.task.print:**** done install task... 2024-04-26T21:11:27.548 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-26T21:11:27.657 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'} 2024-04-26T21:11:27.657 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-04-26T21:11:27.658 INFO:tasks.cephadm:Cluster fsid is 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:11:27.658 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-26T21:11:27.658 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-04-26T21:11:27.658 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi084': '172.21.15.84', 'mon.smithi120': '172.21.15.120'} 2024-04-26T21:11:27.658 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-26T21:11:27.658 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname $(hostname -s) 2024-04-26T21:11:27.735 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname $(hostname -s) 2024-04-26T21:11:27.826 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-04-26T21:11:27.826 DEBUG:teuthology.orchestra.run.smithi084:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-26T21:11:28.233 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 Apr 26 21:11 /home/ubuntu/cephtest/cephadm 2024-04-26T21:11:28.233 DEBUG:teuthology.orchestra.run.smithi120:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-26T21:11:28.529 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 Apr 26 21:11 /home/ubuntu/cephtest/cephadm 2024-04-26T21:11:28.529 DEBUG:teuthology.orchestra.run.smithi084:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-26T21:11:28.591 DEBUG:teuthology.orchestra.run.smithi120:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-26T21:11:28.664 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-04-26T21:11:28.664 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-04-26T21:11:28.672 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-04-26T21:11:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-26T21:11:30.782 INFO:teuthology.orchestra.run.smithi120.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-26T21:12:07.715 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:12:07.715 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)", 2024-04-26T21:12:07.715 INFO:teuthology.orchestra.run.smithi084.stdout: "image_id": "1c583463371507dd553af71bf60c9ae8747aff79bb666e4e29ef4e17d0bc3a13", 2024-04-26T21:12:07.715 INFO:teuthology.orchestra.run.smithi084.stdout: "repo_digests": [ 2024-04-26T21:12:07.715 INFO:teuthology.orchestra.run.smithi084.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9" 2024-04-26T21:12:07.716 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-04-26T21:12:07.716 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:12:08.863 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T21:12:08.863 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_version": "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)", 2024-04-26T21:12:08.863 INFO:teuthology.orchestra.run.smithi120.stdout: "image_id": "1c583463371507dd553af71bf60c9ae8747aff79bb666e4e29ef4e17d0bc3a13", 2024-04-26T21:12:08.863 INFO:teuthology.orchestra.run.smithi120.stdout: "repo_digests": [ 2024-04-26T21:12:08.863 INFO:teuthology.orchestra.run.smithi120.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9" 2024-04-26T21:12:08.863 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T21:12:08.863 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T21:12:08.914 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph 2024-04-26T21:12:09.007 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /etc/ceph 2024-04-26T21:12:09.090 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /etc/ceph 2024-04-26T21:12:09.177 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 777 /etc/ceph 2024-04-26T21:12:09.251 INFO:tasks.cephadm:Writing seed config... 2024-04-26T21:12:09.252 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-04-26T21:12:09.252 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-04-26T21:12:09.252 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-04-26T21:12:09.252 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-04-26T21:12:09.253 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-04-26T21:12:09.253 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-26T21:12:09.253 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-26T21:12:09.253 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-04-26T21:12:09.253 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-04-26T21:12:09.253 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-26T21:12:09.253 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-26T21:12:09.253 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-04-26T21:12:09.253 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-26T21:12:09.253 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-26T21:12:09.253 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-26T21:12:09.253 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-26T21:12:09.253 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-26T21:12:09.253 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-26T21:12:09.253 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-26T21:12:09.254 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-26T21:12:09.254 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-26T21:12:09.254 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-26T21:12:09.254 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-26T21:12:09.254 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-04-26T21:12:09.254 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-26T21:12:09.254 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-26T21:12:09.254 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-26T21:12:09.254 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-26T21:12:09.254 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-26T21:12:09.254 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-26T21:12:09.254 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-26T21:12:09.254 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-26T21:12:09.254 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-26T21:12:09.254 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-26T21:12:09.255 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-26T21:12:09.255 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-26T21:12:09.255 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-26T21:12:09.255 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-26T21:12:09.255 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-26T21:12:09.255 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-26T21:12:09.255 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-26T21:12:09.255 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-26T21:12:09.256 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-26T21:12:09.256 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-26T21:12:09.312 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 8bb44d26-0411-11ef-bc93-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-26T21:12:09.312 DEBUG:teuthology.orchestra.run.smithi084:mon.smithi084> sudo journalctl -f -n 0 -u ceph-8bb44d26-0411-11ef-bc93-c7b262605968@mon.smithi084.service 2024-04-26T21:12:09.360 INFO:tasks.cephadm:Bootstrapping... 2024-04-26T21:12:09.360 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.84 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-26T21:12:09.670 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:12:09.671 INFO:teuthology.orchestra.run.smithi084.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '8bb44d26-0411-11ef-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.84', '--skip-admin-label'] 2024-04-26T21:12:09.731 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-26T21:12:09.731 INFO:teuthology.orchestra.run.smithi084.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-26T21:12:09.731 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying podman|docker is present... 2024-04-26T21:12:09.779 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-26T21:12:09.780 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying lvm2 is present... 2024-04-26T21:12:09.780 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying time synchronization is in place... 2024-04-26T21:12:09.796 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-26T21:12:09.796 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-26T21:12:09.816 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-26T21:12:09.816 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-04-26T21:12:09.840 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout enabled 2024-04-26T21:12:09.858 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout active 2024-04-26T21:12:09.858 INFO:teuthology.orchestra.run.smithi084.stdout:Unit chronyd.service is enabled and running 2024-04-26T21:12:09.859 INFO:teuthology.orchestra.run.smithi084.stdout:Repeating the final host check... 2024-04-26T21:12:09.912 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-26T21:12:09.912 INFO:teuthology.orchestra.run.smithi084.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-26T21:12:09.912 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl is present 2024-04-26T21:12:09.912 INFO:teuthology.orchestra.run.smithi084.stdout:lvcreate is present 2024-04-26T21:12:09.929 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-26T21:12:09.929 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-26T21:12:09.946 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-26T21:12:09.946 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-04-26T21:12:09.972 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout enabled 2024-04-26T21:12:09.996 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout active 2024-04-26T21:12:09.997 INFO:teuthology.orchestra.run.smithi084.stdout:Unit chronyd.service is enabled and running 2024-04-26T21:12:09.997 INFO:teuthology.orchestra.run.smithi084.stdout:Host looks OK 2024-04-26T21:12:09.998 INFO:teuthology.orchestra.run.smithi084.stdout:Cluster fsid: 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:12:09.999 INFO:teuthology.orchestra.run.smithi084.stdout:Acquiring lock 139987690792272 on /run/cephadm/8bb44d26-0411-11ef-bc93-c7b262605968.lock 2024-04-26T21:12:09.999 INFO:teuthology.orchestra.run.smithi084.stdout:Lock 139987690792272 acquired on /run/cephadm/8bb44d26-0411-11ef-bc93-c7b262605968.lock 2024-04-26T21:12:10.001 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying IP 172.21.15.84 port 3300 ... 2024-04-26T21:12:10.003 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying IP 172.21.15.84 port 6789 ... 2024-04-26T21:12:10.003 INFO:teuthology.orchestra.run.smithi084.stdout:Base mon IP(s) is [172.21.15.84:3300, 172.21.15.84:6789], mon addrv is [v2:172.21.15.84:3300,v1:172.21.15.84:6789] 2024-04-26T21:12:10.018 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.84 metric 100 2024-04-26T21:12:10.019 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.84 metric 100 2024-04-26T21:12:10.034 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-26T21:12:10.034 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-04-26T21:12:10.034 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1771sec hoplimit 64 pref medium 2024-04-26T21:12:10.049 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-26T21:12:10.049 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-26T21:12:10.049 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-26T21:12:10.049 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-26T21:12:10.049 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2024-04-26T21:12:10.049 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-26T21:12:10.052 INFO:teuthology.orchestra.run.smithi084.stdout:Mon IP `172.21.15.84` is in CIDR network `172.21.0.0/20` 2024-04-26T21:12:10.052 INFO:teuthology.orchestra.run.smithi084.stdout:Mon IP `172.21.15.84` is in CIDR network `172.21.0.0/20` 2024-04-26T21:12:10.053 INFO:teuthology.orchestra.run.smithi084.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-26T21:12:10.056 INFO:teuthology.orchestra.run.smithi084.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-26T21:12:10.058 INFO:teuthology.orchestra.run.smithi084.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-26T21:12:18.890 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout 1c583463371507dd553af71bf60c9ae8747aff79bb666e4e29ef4e17d0bc3a13 2024-04-26T21:12:18.891 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-26T21:12:18.891 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Getting image source signatures 2024-04-26T21:12:18.891 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Copying blob sha256:4bba5d13506b552b86ba49891516dd450cd5841e76166fa879451331012cf28e 2024-04-26T21:12:18.891 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Copying blob sha256:3d665f4c032644be9cae748af04bee69f2bfe96cdc3616dabe0ab17899633ab5 2024-04-26T21:12:18.891 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Copying config sha256:1c583463371507dd553af71bf60c9ae8747aff79bb666e4e29ef4e17d0bc3a13 2024-04-26T21:12:18.891 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-26T21:12:20.172 INFO:teuthology.orchestra.run.smithi084.stdout:ceph: stdout ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable) 2024-04-26T21:12:20.172 INFO:teuthology.orchestra.run.smithi084.stdout:Ceph version: ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable) 2024-04-26T21:12:20.172 INFO:teuthology.orchestra.run.smithi084.stdout:Extracting ceph user uid/gid from container image... 2024-04-26T21:12:21.361 INFO:teuthology.orchestra.run.smithi084.stdout:stat: stdout 167 167 2024-04-26T21:12:21.361 INFO:teuthology.orchestra.run.smithi084.stdout:Creating initial keys... 2024-04-26T21:12:22.412 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph-authtool: stdout AQC1GCxmyWFCLhAA4FGb5UdfbDggtnfGxYWGpw== 2024-04-26T21:12:23.598 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph-authtool: stdout AQC2GCxm2LenNRAAQ4sZbCJB8TVZDx5MrjKLZQ== 2024-04-26T21:12:24.814 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph-authtool: stdout AQC4GCxmAaWzCRAAOu7hyf0voDy4Mc7vVH1siA== 2024-04-26T21:12:24.818 INFO:teuthology.orchestra.run.smithi084.stdout:Creating initial monmap... 2024-04-26T21:12:25.936 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-26T21:12:25.936 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-04-26T21:12:25.936 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:12:25.936 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-26T21:12:25.936 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool for smithi084 [v2:172.21.15.84:3300,v1:172.21.15.84:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-26T21:12:25.936 INFO:teuthology.orchestra.run.smithi084.stdout:setting min_mon_release = octopus 2024-04-26T21:12:25.936 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: set fsid to 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:12:25.937 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-26T21:12:25.937 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:12:25.937 INFO:teuthology.orchestra.run.smithi084.stdout:Creating mon... 2024-04-26T21:12:27.062 INFO:teuthology.orchestra.run.smithi084.stdout:create mon.smithi084 on 2024-04-26T21:12:27.500 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-26T21:12:27.743 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-26T21:12:27.996 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-8bb44d26-0411-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-8bb44d26-0411-11ef-bc93-c7b262605968.target. 2024-04-26T21:12:27.996 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-8bb44d26-0411-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-8bb44d26-0411-11ef-bc93-c7b262605968.target. 2024-04-26T21:12:28.288 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-8bb44d26-0411-11ef-bc93-c7b262605968@mon.smithi084 2024-04-26T21:12:28.288 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to reset failed state of unit ceph-8bb44d26-0411-11ef-bc93-c7b262605968@mon.smithi084.service: Unit ceph-8bb44d26-0411-11ef-bc93-c7b262605968@mon.smithi084.service not loaded. 2024-04-26T21:12:28.547 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-8bb44d26-0411-11ef-bc93-c7b262605968.target.wants/ceph-8bb44d26-0411-11ef-bc93-c7b262605968@mon.smithi084.service → /etc/systemd/system/ceph-8bb44d26-0411-11ef-bc93-c7b262605968@.service. 2024-04-26T21:12:29.221 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:28 smithi084 podman[25146]: 2024-04-26 21:12:28.941601377 +0000 UTC m=+0.133369268 container create cdd60c9c894624903e3eca4c43e30b00de2bc86b22d05d2de045483a7f892c1c (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, RELEASE=quincy-2be3efa, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-26T21:12:29.221 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:29 smithi084 podman[25146]: 2024-04-26 21:12:29.220001637 +0000 UTC m=+0.411769572 container init cdd60c9c894624903e3eca4c43e30b00de2bc86b22d05d2de045483a7f892c1c (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=quincy-2be3efa, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424) 2024-04-26T21:12:29.344 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T21:12:29.344 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-04-26T21:12:29.361 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T21:12:29.361 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-04-26T21:12:29.361 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-04-26T21:12:29.361 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to enable service . firewalld.service is not available 2024-04-26T21:12:29.362 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mon to start... 2024-04-26T21:12:29.362 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mon... 2024-04-26T21:12:29.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:29 smithi084 podman[25146]: 2024-04-26 21:12:29.230664547 +0000 UTC m=+0.422432481 container start cdd60c9c894624903e3eca4c43e30b00de2bc86b22d05d2de045483a7f892c1c (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=quincy-2be3efa, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424) 2024-04-26T21:12:29.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:29 smithi084 ceph-mon[25164]: mkfs 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:12:29.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:29 smithi084 bash[25146]: cdd60c9c894624903e3eca4c43e30b00de2bc86b22d05d2de045483a7f892c1c 2024-04-26T21:12:29.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:29 smithi084 ceph-mon[25164]: mon.smithi084 is new leader, mons smithi084 in quorum (ranks 0) 2024-04-26T21:12:29.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:29 smithi084 systemd[1]: Started Ceph mon.smithi084 for 8bb44d26-0411-11ef-bc93-c7b262605968. 2024-04-26T21:12:30.524 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:30 smithi084 ceph-mon[25164]: mon.smithi084 is new leader, mons smithi084 in quorum (ranks 0) 2024-04-26T21:12:30.525 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:30 smithi084 ceph-mon[25164]: monmap e1: 1 mons at {smithi084=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-26T21:12:30.525 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:30 smithi084 ceph-mon[25164]: fsmap 2024-04-26T21:12:30.525 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:30 smithi084 ceph-mon[25164]: osdmap e1: 0 total, 0 up, 0 in 2024-04-26T21:12:30.525 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:30 smithi084 ceph-mon[25164]: mgrmap e1: no daemons active 2024-04-26T21:12:31.379 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:31 smithi084 ceph-mon[25164]: from='client.? 172.21.15.84:0/814006641' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-26T21:12:31.394 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout cluster: 2024-04-26T21:12:31.394 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout id: 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:12:31.394 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-26T21:12:31.394 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-04-26T21:12:31.394 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout services: 2024-04-26T21:12:31.394 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi084 (age 1.46719s) 2024-04-26T21:12:31.395 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-26T21:12:31.395 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-26T21:12:31.395 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-04-26T21:12:31.395 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout data: 2024-04-26T21:12:31.395 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-26T21:12:31.395 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-26T21:12:31.395 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-26T21:12:31.395 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout pgs: 2024-04-26T21:12:31.395 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-04-26T21:12:31.395 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.679+0000 7f20da400700 1 Processor -- start 2024-04-26T21:12:31.395 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.679+0000 7f20da400700 1 -- start start 2024-04-26T21:12:31.395 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.679+0000 7f20da400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4078cb0 0x7f20d4077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:31.396 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.679+0000 7f20da400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d40790c0 con 0x7f20d4078cb0 2024-04-26T21:12:31.396 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.681+0000 7f20d3400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4078cb0 0x7f20d4077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:31.396 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.681+0000 7f20d3400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4078cb0 0x7f20d4077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37454/0 (socket says 172.21.15.84:37454) 2024-04-26T21:12:31.396 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.681+0000 7f20d3400700 1 -- 172.21.15.84:0/1300936219 learned_addr learned my addr 172.21.15.84:0/1300936219 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:31.396 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.682+0000 7f20d3400700 1 -- 172.21.15.84:0/1300936219 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d4077750 con 0x7f20d4078cb0 2024-04-26T21:12:31.396 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.682+0000 7f20d3400700 1 --2- 172.21.15.84:0/1300936219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4078cb0 0x7f20d4077210 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f20c40098e0 tx=0x7f20c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be047f9dba9d8dc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:31.396 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.682+0000 7f20d2000700 1 -- 172.21.15.84:0/1300936219 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20c400b860 con 0x7f20d4078cb0 2024-04-26T21:12:31.396 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.682+0000 7f20d2000700 1 -- 172.21.15.84:0/1300936219 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c400b9c0 con 0x7f20d4078cb0 2024-04-26T21:12:31.396 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.682+0000 7f20d2000700 1 -- 172.21.15.84:0/1300936219 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20c400bc90 con 0x7f20d4078cb0 2024-04-26T21:12:31.396 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.683+0000 7f20da400700 1 -- 172.21.15.84:0/1300936219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4078cb0 msgr2=0x7f20d4077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:31.396 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.683+0000 7f20da400700 1 --2- 172.21.15.84:0/1300936219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4078cb0 0x7f20d4077210 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f20c40098e0 tx=0x7f20c4009250 comp rx=0 tx=0).stop 2024-04-26T21:12:31.397 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.683+0000 7f20da400700 1 -- 172.21.15.84:0/1300936219 shutdown_connections 2024-04-26T21:12:31.397 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.683+0000 7f20da400700 1 --2- 172.21.15.84:0/1300936219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4078cb0 0x7f20d4077210 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:31.397 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.683+0000 7f20da400700 1 -- 172.21.15.84:0/1300936219 >> 172.21.15.84:0/1300936219 conn(0x7f20d40fe010 msgr2=0x7f20d4100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:31.397 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.683+0000 7f20da400700 1 -- 172.21.15.84:0/1300936219 shutdown_connections 2024-04-26T21:12:31.397 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.683+0000 7f20da400700 1 -- 172.21.15.84:0/1300936219 wait complete. 2024-04-26T21:12:31.397 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.684+0000 7f20da400700 1 Processor -- start 2024-04-26T21:12:31.397 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.684+0000 7f20da400700 1 -- start start 2024-04-26T21:12:31.397 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.684+0000 7f20da400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4078cb0 0x7f20d4113000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:31.397 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.684+0000 7f20da400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d4113540 con 0x7f20d4078cb0 2024-04-26T21:12:31.397 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.685+0000 7f20d3400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4078cb0 0x7f20d4113000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:31.397 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.685+0000 7f20d3400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4078cb0 0x7f20d4113000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37464/0 (socket says 172.21.15.84:37464) 2024-04-26T21:12:31.397 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.685+0000 7f20d3400700 1 -- 172.21.15.84:0/814006641 learned_addr learned my addr 172.21.15.84:0/814006641 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:31.397 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.685+0000 7f20d3400700 1 -- 172.21.15.84:0/814006641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c40094f0 con 0x7f20d4078cb0 2024-04-26T21:12:31.397 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.685+0000 7f20d3400700 1 --2- 172.21.15.84:0/814006641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4078cb0 0x7f20d4113000 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009290 tx=0x7f20c4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:31.398 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.686+0000 7f20cb400700 1 -- 172.21.15.84:0/814006641 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20c401c5c0 con 0x7f20d4078cb0 2024-04-26T21:12:31.398 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.686+0000 7f20cb400700 1 -- 172.21.15.84:0/814006641 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c401c740 con 0x7f20d4078cb0 2024-04-26T21:12:31.398 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.686+0000 7f20da400700 1 -- 172.21.15.84:0/814006641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d4113740 con 0x7f20d4078cb0 2024-04-26T21:12:31.398 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.686+0000 7f20cb400700 1 -- 172.21.15.84:0/814006641 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20c401ca50 con 0x7f20d4078cb0 2024-04-26T21:12:31.398 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.686+0000 7f20da400700 1 -- 172.21.15.84:0/814006641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d41142b0 con 0x7f20d4078cb0 2024-04-26T21:12:31.398 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.686+0000 7f20cb400700 1 -- 172.21.15.84:0/814006641 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f20c401cbb0 con 0x7f20d4078cb0 2024-04-26T21:12:31.398 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.686+0000 7f20cb400700 1 -- 172.21.15.84:0/814006641 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f20c401ac30 con 0x7f20d4078cb0 2024-04-26T21:12:31.398 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.687+0000 7f20da400700 1 -- 172.21.15.84:0/814006641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d405f5c0 con 0x7f20d4078cb0 2024-04-26T21:12:31.398 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.690+0000 7f20cb400700 1 -- 172.21.15.84:0/814006641 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f20c401adf0 con 0x7f20d4078cb0 2024-04-26T21:12:31.398 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.768+0000 7f20da400700 1 -- 172.21.15.84:0/814006641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f20d4114d80 con 0x7f20d4078cb0 2024-04-26T21:12:31.398 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.769+0000 7f20cb400700 1 -- 172.21.15.84:0/814006641 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+324 (secure 0 0 0) 0x7f20c4025440 con 0x7f20d4078cb0 2024-04-26T21:12:31.399 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.770+0000 7f20da400700 1 -- 172.21.15.84:0/814006641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4078cb0 msgr2=0x7f20d4113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:31.399 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.770+0000 7f20da400700 1 --2- 172.21.15.84:0/814006641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4078cb0 0x7f20d4113000 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009290 tx=0x7f20c4016000 comp rx=0 tx=0).stop 2024-04-26T21:12:31.399 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.770+0000 7f20da400700 1 -- 172.21.15.84:0/814006641 shutdown_connections 2024-04-26T21:12:31.399 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.770+0000 7f20da400700 1 --2- 172.21.15.84:0/814006641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4078cb0 0x7f20d4113000 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:31.399 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.770+0000 7f20da400700 1 -- 172.21.15.84:0/814006641 >> 172.21.15.84:0/814006641 conn(0x7f20d40fe010 msgr2=0x7f20d4109e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:31.399 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.770+0000 7f20da400700 1 -- 172.21.15.84:0/814006641 shutdown_connections 2024-04-26T21:12:31.399 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:30.770+0000 7f20da400700 1 -- 172.21.15.84:0/814006641 wait complete. 2024-04-26T21:12:31.399 INFO:teuthology.orchestra.run.smithi084.stdout:mon is available 2024-04-26T21:12:31.399 INFO:teuthology.orchestra.run.smithi084.stdout:Assimilating anything we can from ceph.conf... 2024-04-26T21:12:32.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:32 smithi084 ceph-mon[25164]: from='client.? 172.21.15.84:0/3238773485' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-26T21:12:32.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:32 smithi084 ceph-mon[25164]: from='client.? 172.21.15.84:0/3238773485' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-26T21:12:32.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-04-26T21:12:32.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [global] 2024-04-26T21:12:32.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout fsid = 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:12:32.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.84:3300,v1:172.21.15.84:6789] 2024-04-26T21:12:32.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-26T21:12:32.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-26T21:12:32.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-26T21:12:32.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-26T21:12:32.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-04-26T21:12:32.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-26T21:12:32.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-26T21:12:32.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-04-26T21:12:32.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [osd] 2024-04-26T21:12:32.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-26T21:12:32.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-26T21:12:32.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-26T21:12:32.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-26T21:12:32.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-26T21:12:32.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.986+0000 7f9395800700 1 Processor -- start 2024-04-26T21:12:32.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.986+0000 7f9395800700 1 -- start start 2024-04-26T21:12:32.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.987+0000 7f9395800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9390076c30 0x7f9390105420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:32.772 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.987+0000 7f9395800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9390105960 con 0x7f9390076c30 2024-04-26T21:12:32.772 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.987+0000 7f938ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9390076c30 0x7f9390105420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:32.772 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.987+0000 7f938ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9390076c30 0x7f9390105420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47370/0 (socket says 172.21.15.84:47370) 2024-04-26T21:12:32.772 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.987+0000 7f938ea00700 1 -- 172.21.15.84:0/3282097534 learned_addr learned my addr 172.21.15.84:0/3282097534 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:32.772 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.988+0000 7f938ea00700 1 -- 172.21.15.84:0/3282097534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9390105aa0 con 0x7f9390076c30 2024-04-26T21:12:32.772 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.988+0000 7f938ea00700 1 --2- 172.21.15.84:0/3282097534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9390076c30 0x7f9390105420 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f93800098e0 tx=0x7f9380009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8372489afa32a02e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:32.772 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.989+0000 7f938d600700 1 -- 172.21.15.84:0/3282097534 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f938000b860 con 0x7f9390076c30 2024-04-26T21:12:32.772 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.989+0000 7f938d600700 1 -- 172.21.15.84:0/3282097534 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938000b9c0 con 0x7f9390076c30 2024-04-26T21:12:32.772 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.989+0000 7f938d600700 1 -- 172.21.15.84:0/3282097534 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f938000bc90 con 0x7f9390076c30 2024-04-26T21:12:32.772 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.989+0000 7f9395800700 1 -- 172.21.15.84:0/3282097534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9390076c30 msgr2=0x7f9390105420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:32.772 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.989+0000 7f9395800700 1 --2- 172.21.15.84:0/3282097534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9390076c30 0x7f9390105420 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f93800098e0 tx=0x7f9380009250 comp rx=0 tx=0).stop 2024-04-26T21:12:32.772 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.990+0000 7f9395800700 1 -- 172.21.15.84:0/3282097534 shutdown_connections 2024-04-26T21:12:32.772 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.990+0000 7f9395800700 1 --2- 172.21.15.84:0/3282097534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9390076c30 0x7f9390105420 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:32.772 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.990+0000 7f9395800700 1 -- 172.21.15.84:0/3282097534 >> 172.21.15.84:0/3282097534 conn(0x7f93900fcef0 msgr2=0x7f93900ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:32.773 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.990+0000 7f9395800700 1 -- 172.21.15.84:0/3282097534 shutdown_connections 2024-04-26T21:12:32.773 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.990+0000 7f9395800700 1 -- 172.21.15.84:0/3282097534 wait complete. 2024-04-26T21:12:32.773 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.991+0000 7f9395800700 1 Processor -- start 2024-04-26T21:12:32.773 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.991+0000 7f9395800700 1 -- start start 2024-04-26T21:12:32.773 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.991+0000 7f9395800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9390076c30 0x7f9390112ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:32.773 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.991+0000 7f9395800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9390113530 con 0x7f9390076c30 2024-04-26T21:12:32.773 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.991+0000 7f938ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9390076c30 0x7f9390112ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:32.773 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.991+0000 7f938ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9390076c30 0x7f9390112ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47378/0 (socket says 172.21.15.84:47378) 2024-04-26T21:12:32.773 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.991+0000 7f938ea00700 1 -- 172.21.15.84:0/3238773485 learned_addr learned my addr 172.21.15.84:0/3238773485 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:32.773 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.992+0000 7f938ea00700 1 -- 172.21.15.84:0/3238773485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93800094f0 con 0x7f9390076c30 2024-04-26T21:12:32.773 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.992+0000 7f938ea00700 1 --2- 172.21.15.84:0/3238773485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9390076c30 0x7f9390112ff0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9380009290 tx=0x7f9380016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:32.773 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.992+0000 7f9386a00700 1 -- 172.21.15.84:0/3238773485 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f938001c5c0 con 0x7f9390076c30 2024-04-26T21:12:32.773 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.992+0000 7f9386a00700 1 -- 172.21.15.84:0/3238773485 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938001c740 con 0x7f9390076c30 2024-04-26T21:12:32.773 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.992+0000 7f9386a00700 1 -- 172.21.15.84:0/3238773485 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f938001ca50 con 0x7f9390076c30 2024-04-26T21:12:32.773 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.992+0000 7f9395800700 1 -- 172.21.15.84:0/3238773485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9390113730 con 0x7f9390076c30 2024-04-26T21:12:32.774 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.992+0000 7f9395800700 1 -- 172.21.15.84:0/3238773485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93901142a0 con 0x7f9390076c30 2024-04-26T21:12:32.774 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.993+0000 7f9386a00700 1 -- 172.21.15.84:0/3238773485 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f938001cbb0 con 0x7f9390076c30 2024-04-26T21:12:32.774 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.993+0000 7f9386a00700 1 -- 172.21.15.84:0/3238773485 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f938001ac30 con 0x7f9390076c30 2024-04-26T21:12:32.774 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.994+0000 7f9395800700 1 -- 172.21.15.84:0/3238773485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f939005f5c0 con 0x7f9390076c30 2024-04-26T21:12:32.774 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:31.996+0000 7f9386a00700 1 -- 172.21.15.84:0/3238773485 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f938001adf0 con 0x7f9390076c30 2024-04-26T21:12:32.774 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:32.071+0000 7f9395800700 1 -- 172.21.15.84:0/3238773485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f9390105f40 con 0x7f9390076c30 2024-04-26T21:12:32.774 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:32.077+0000 7f9386a00700 1 -- 172.21.15.84:0/3238773485 <== mon.0 v2:172.21.15.84:3300/0 7 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f938001a450 con 0x7f9390076c30 2024-04-26T21:12:32.774 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:32.078+0000 7f9386a00700 1 -- 172.21.15.84:0/3238773485 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f9390105f40 con 0x7f9390076c30 2024-04-26T21:12:32.774 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:32.079+0000 7f9395800700 1 -- 172.21.15.84:0/3238773485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9390076c30 msgr2=0x7f9390112ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:32.774 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:32.079+0000 7f9395800700 1 --2- 172.21.15.84:0/3238773485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9390076c30 0x7f9390112ff0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9380009290 tx=0x7f9380016000 comp rx=0 tx=0).stop 2024-04-26T21:12:32.774 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:32.079+0000 7f9395800700 1 -- 172.21.15.84:0/3238773485 shutdown_connections 2024-04-26T21:12:32.774 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:32.079+0000 7f9395800700 1 --2- 172.21.15.84:0/3238773485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9390076c30 0x7f9390112ff0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:32.774 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:32.079+0000 7f9395800700 1 -- 172.21.15.84:0/3238773485 >> 172.21.15.84:0/3238773485 conn(0x7f93900fcef0 msgr2=0x7f93900ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:32.774 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:32.079+0000 7f9395800700 1 -- 172.21.15.84:0/3238773485 shutdown_connections 2024-04-26T21:12:32.775 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:32.079+0000 7f9395800700 1 -- 172.21.15.84:0/3238773485 wait complete. 2024-04-26T21:12:32.775 INFO:teuthology.orchestra.run.smithi084.stdout:Generating new minimal ceph.conf... 2024-04-26T21:12:33.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:33 smithi084 ceph-mon[25164]: from='client.? 172.21.15.84:0/3226900231' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:12:34.076 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.326+0000 7f0bc8400700 1 Processor -- start 2024-04-26T21:12:34.076 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.326+0000 7f0bc8400700 1 -- start start 2024-04-26T21:12:34.076 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.326+0000 7f0bc8400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc007cf60 0x7f0bc010bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:34.076 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.326+0000 7f0bc8400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc007d400 con 0x7f0bc007cf60 2024-04-26T21:12:34.076 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.327+0000 7f0bc5a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc007cf60 0x7f0bc010bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:34.076 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.327+0000 7f0bc5a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc007cf60 0x7f0bc010bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47392/0 (socket says 172.21.15.84:47392) 2024-04-26T21:12:34.077 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.327+0000 7f0bc5a00700 1 -- 172.21.15.84:0/2228210318 learned_addr learned my addr 172.21.15.84:0/2228210318 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:34.080 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.327+0000 7f0bc5a00700 1 -- 172.21.15.84:0/2228210318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc007d540 con 0x7f0bc007cf60 2024-04-26T21:12:34.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.328+0000 7f0bc5a00700 1 --2- 172.21.15.84:0/2228210318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc007cf60 0x7f0bc010bcb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40098e0 tx=0x7f0bb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53cb4be940a0197 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:34.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.328+0000 7f0bbfe00700 1 -- 172.21.15.84:0/2228210318 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bb400b860 con 0x7f0bc007cf60 2024-04-26T21:12:34.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.328+0000 7f0bbfe00700 1 -- 172.21.15.84:0/2228210318 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f0bb400be50 con 0x7f0bc007cf60 2024-04-26T21:12:34.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.328+0000 7f0bbfe00700 1 -- 172.21.15.84:0/2228210318 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bb4010380 con 0x7f0bc007cf60 2024-04-26T21:12:34.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.328+0000 7f0bc8400700 1 -- 172.21.15.84:0/2228210318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc007cf60 msgr2=0x7f0bc010bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:34.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.328+0000 7f0bc8400700 1 --2- 172.21.15.84:0/2228210318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc007cf60 0x7f0bc010bcb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40098e0 tx=0x7f0bb4009250 comp rx=0 tx=0).stop 2024-04-26T21:12:34.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.329+0000 7f0bc8400700 1 -- 172.21.15.84:0/2228210318 shutdown_connections 2024-04-26T21:12:34.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.329+0000 7f0bc8400700 1 --2- 172.21.15.84:0/2228210318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc007cf60 0x7f0bc010bcb0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:34.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.329+0000 7f0bc8400700 1 -- 172.21.15.84:0/2228210318 >> 172.21.15.84:0/2228210318 conn(0x7f0bc0078300 msgr2=0x7f0bc007a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:34.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.329+0000 7f0bc8400700 1 -- 172.21.15.84:0/2228210318 shutdown_connections 2024-04-26T21:12:34.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.329+0000 7f0bc8400700 1 -- 172.21.15.84:0/2228210318 wait complete. 2024-04-26T21:12:34.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.330+0000 7f0bc8400700 1 Processor -- start 2024-04-26T21:12:34.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.330+0000 7f0bc8400700 1 -- start start 2024-04-26T21:12:34.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.330+0000 7f0bc8400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc007cf60 0x7f0bc0117be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:34.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.330+0000 7f0bc8400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc0118120 con 0x7f0bc007cf60 2024-04-26T21:12:34.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.330+0000 7f0bc5a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc007cf60 0x7f0bc0117be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:34.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.330+0000 7f0bc5a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc007cf60 0x7f0bc0117be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47398/0 (socket says 172.21.15.84:47398) 2024-04-26T21:12:34.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.330+0000 7f0bc5a00700 1 -- 172.21.15.84:0/3226900231 learned_addr learned my addr 172.21.15.84:0/3226900231 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:34.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.331+0000 7f0bc5a00700 1 -- 172.21.15.84:0/3226900231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb40094f0 con 0x7f0bc007cf60 2024-04-26T21:12:34.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.331+0000 7f0bc5a00700 1 --2- 172.21.15.84:0/3226900231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc007cf60 0x7f0bc0117be0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4006b00 tx=0x7f0bb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:34.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.331+0000 7f0bbd600700 1 -- 172.21.15.84:0/3226900231 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bb40107c0 con 0x7f0bc007cf60 2024-04-26T21:12:34.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.331+0000 7f0bbd600700 1 -- 172.21.15.84:0/3226900231 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f0bb4010db0 con 0x7f0bc007cf60 2024-04-26T21:12:34.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.331+0000 7f0bc8400700 1 -- 172.21.15.84:0/3226900231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc0118320 con 0x7f0bc007cf60 2024-04-26T21:12:34.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.331+0000 7f0bbd600700 1 -- 172.21.15.84:0/3226900231 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bb401acf0 con 0x7f0bc007cf60 2024-04-26T21:12:34.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.331+0000 7f0bc8400700 1 -- 172.21.15.84:0/3226900231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc0118e90 con 0x7f0bc007cf60 2024-04-26T21:12:34.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.332+0000 7f0bbd600700 1 -- 172.21.15.84:0/3226900231 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f0bb4024440 con 0x7f0bc007cf60 2024-04-26T21:12:34.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.332+0000 7f0bbd600700 1 -- 172.21.15.84:0/3226900231 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f0bb4019710 con 0x7f0bc007cf60 2024-04-26T21:12:34.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.333+0000 7f0bc8400700 1 -- 172.21.15.84:0/3226900231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc005f5c0 con 0x7f0bc007cf60 2024-04-26T21:12:34.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.335+0000 7f0bbd600700 1 -- 172.21.15.84:0/3226900231 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f0bb401a530 con 0x7f0bc007cf60 2024-04-26T21:12:34.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.410+0000 7f0bc8400700 1 -- 172.21.15.84:0/3226900231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f0bc010ce50 con 0x7f0bc007cf60 2024-04-26T21:12:34.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.410+0000 7f0bbd600700 1 -- 172.21.15.84:0/3226900231 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f0bb4010920 con 0x7f0bc007cf60 2024-04-26T21:12:34.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.412+0000 7f0bc8400700 1 -- 172.21.15.84:0/3226900231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc007cf60 msgr2=0x7f0bc0117be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:34.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.412+0000 7f0bc8400700 1 --2- 172.21.15.84:0/3226900231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc007cf60 0x7f0bc0117be0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4006b00 tx=0x7f0bb4009250 comp rx=0 tx=0).stop 2024-04-26T21:12:34.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.412+0000 7f0bc8400700 1 -- 172.21.15.84:0/3226900231 shutdown_connections 2024-04-26T21:12:34.084 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.412+0000 7f0bc8400700 1 --2- 172.21.15.84:0/3226900231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc007cf60 0x7f0bc0117be0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:34.084 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.412+0000 7f0bc8400700 1 -- 172.21.15.84:0/3226900231 >> 172.21.15.84:0/3226900231 conn(0x7f0bc0078300 msgr2=0x7f0bc0079e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:34.084 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.412+0000 7f0bc8400700 1 -- 172.21.15.84:0/3226900231 shutdown_connections 2024-04-26T21:12:34.084 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:33.412+0000 7f0bc8400700 1 -- 172.21.15.84:0/3226900231 wait complete. 2024-04-26T21:12:34.084 INFO:teuthology.orchestra.run.smithi084.stdout:Restarting the monitor... 2024-04-26T21:12:34.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:34 smithi084 systemd[1]: Stopping Ceph mon.smithi084 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:12:34.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:34 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084[25160]: 2024-04-26T21:12:34.615+0000 7f8ec0600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi084 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:12:34.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:34 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084[25160]: 2024-04-26T21:12:34.615+0000 7f8ec0600700 -1 mon.smithi084@0(leader) e1 *** Got Signal Terminated *** 2024-04-26T21:12:34.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:34 smithi084 podman[25407]: 2024-04-26 21:12:34.689489258 +0000 UTC m=+0.259692523 container died cdd60c9c894624903e3eca4c43e30b00de2bc86b22d05d2de045483a7f892c1c (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=quincy-2be3efa, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-26T21:12:35.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:35 smithi084 podman[25407]: 2024-04-26 21:12:35.433780105 +0000 UTC m=+1.003983364 container cleanup cdd60c9c894624903e3eca4c43e30b00de2bc86b22d05d2de045483a7f892c1c (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_CLEAN=True, RELEASE=quincy-2be3efa, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-26T21:12:35.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:35 smithi084 bash[25407]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084 2024-04-26T21:12:36.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:36 smithi084 podman[25421]: 2024-04-26 21:12:36.367987248 +0000 UTC m=+1.665873468 container remove cdd60c9c894624903e3eca4c43e30b00de2bc86b22d05d2de045483a7f892c1c (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, RELEASE=quincy-2be3efa, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True) 2024-04-26T21:12:37.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:36 smithi084 systemd[1]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968@mon.smithi084.service: Deactivated successfully. 2024-04-26T21:12:37.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:36 smithi084 systemd[1]: Stopped Ceph mon.smithi084 for 8bb44d26-0411-11ef-bc93-c7b262605968. 2024-04-26T21:12:37.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:36 smithi084 systemd[1]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968@mon.smithi084.service: Consumed 1.873s CPU time. 2024-04-26T21:12:37.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:36 smithi084 systemd[1]: Starting Ceph mon.smithi084 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:12:37.538 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 podman[25514]: 2024-04-26 21:12:37.276909437 +0000 UTC m=+0.126270772 container create 24cc2d798ea7af7a727e0a8a1d591c789b9faafcdda0c1ce4354b4e8474cd330 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=quincy-2be3efa, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:12:37.538 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 podman[25514]: 2024-04-26 21:12:37.187915883 +0000 UTC m=+0.037277190 image pull 1c583463371507dd553af71bf60c9ae8747aff79bb666e4e29ef4e17d0bc3a13 quay.ceph.io/ceph-ci/ceph:quincy 2024-04-26T21:12:37.538 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 podman[25514]: 2024-04-26 21:12:37.463796658 +0000 UTC m=+0.313158009 container init 24cc2d798ea7af7a727e0a8a1d591c789b9faafcdda0c1ce4354b4e8474cd330 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=quincy-2be3efa) 2024-04-26T21:12:37.538 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 podman[25514]: 2024-04-26 21:12:37.471912024 +0000 UTC m=+0.321273375 container start 24cc2d798ea7af7a727e0a8a1d591c789b9faafcdda0c1ce4354b4e8474cd330 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=quincy-2be3efa, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-26T21:12:37.538 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: set uid:gid to 167:167 (ceph:ceph) 2024-04-26T21:12:37.538 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable), process ceph-mon, pid 2 2024-04-26T21:12:37.538 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: pidfile_write: ignore empty --pid-file 2024-04-26T21:12:37.538 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: load: jerasure load: lrc 2024-04-26T21:12:37.538 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: RocksDB version: 6.15.5 2024-04-26T21:12:37.539 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-04-26T21:12:37.539 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Compile date Apr 26 2024 2024-04-26T21:12:37.539 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: DB SUMMARY 2024-04-26T21:12:37.539 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: DB Session ID: LF3R5EMO11Q7SE2MMBFL 2024-04-26T21:12:37.539 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: CURRENT file: CURRENT 2024-04-26T21:12:37.539 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: IDENTITY file: IDENTITY 2024-04-26T21:12:37.539 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-04-26T21:12:37.539 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi084/store.db dir, Total Num: 1, files: 000008.sst 2024-04-26T21:12:37.539 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi084/store.db: 000010.log size: 98468 ; 2024-04-26T21:12:37.539 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.error_if_exists: 0 2024-04-26T21:12:37.539 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.create_if_missing: 0 2024-04-26T21:12:37.539 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.paranoid_checks: 1 2024-04-26T21:12:37.541 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-26T21:12:37.541 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.env: 0x55bee3284b00 2024-04-26T21:12:37.541 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.fs: Posix File System 2024-04-26T21:12:37.541 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.info_log: 0x55bef0ae7620 2024-04-26T21:12:37.541 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_file_opening_threads: 16 2024-04-26T21:12:37.541 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.statistics: (nil) 2024-04-26T21:12:37.541 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.use_fsync: 0 2024-04-26T21:12:37.541 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_log_file_size: 0 2024-04-26T21:12:37.541 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-26T21:12:37.541 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-26T21:12:37.542 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.keep_log_file_num: 1000 2024-04-26T21:12:37.542 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.recycle_log_file_num: 0 2024-04-26T21:12:37.542 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.allow_fallocate: 1 2024-04-26T21:12:37.542 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.allow_mmap_reads: 0 2024-04-26T21:12:37.542 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.allow_mmap_writes: 0 2024-04-26T21:12:37.542 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.use_direct_reads: 0 2024-04-26T21:12:37.542 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-26T21:12:37.542 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.create_missing_column_families: 0 2024-04-26T21:12:37.542 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.db_log_dir: 2024-04-26T21:12:37.542 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi084/store.db 2024-04-26T21:12:37.542 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-26T21:12:37.542 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-26T21:12:37.542 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-26T21:12:37.542 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-26T21:12:37.543 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-26T21:12:37.543 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-26T21:12:37.543 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.advise_random_on_open: 1 2024-04-26T21:12:37.543 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.db_write_buffer_size: 0 2024-04-26T21:12:37.543 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.write_buffer_manager: 0x55bef17daa20 2024-04-26T21:12:37.543 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-26T21:12:37.543 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-04-26T21:12:37.543 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-26T21:12:37.543 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-26T21:12:37.543 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.rate_limiter: (nil) 2024-04-26T21:12:37.543 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-26T21:12:37.543 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.wal_recovery_mode: 2 2024-04-26T21:12:37.543 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.enable_thread_tracking: 0 2024-04-26T21:12:37.543 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.enable_pipelined_write: 0 2024-04-26T21:12:37.543 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.unordered_write: 0 2024-04-26T21:12:37.543 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-26T21:12:37.544 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-26T21:12:37.544 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-26T21:12:37.544 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-26T21:12:37.544 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.row_cache: None 2024-04-26T21:12:37.544 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.wal_filter: None 2024-04-26T21:12:37.544 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-26T21:12:37.544 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.allow_ingest_behind: 0 2024-04-26T21:12:37.544 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.preserve_deletes: 0 2024-04-26T21:12:37.544 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.two_write_queues: 0 2024-04-26T21:12:37.544 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.manual_wal_flush: 0 2024-04-26T21:12:37.544 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.atomic_flush: 0 2024-04-26T21:12:37.544 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-26T21:12:37.544 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-26T21:12:37.544 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-26T21:12:37.544 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.log_readahead_size: 0 2024-04-26T21:12:37.544 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-26T21:12:37.544 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.best_efforts_recovery: 0 2024-04-26T21:12:37.545 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-26T21:12:37.545 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-26T21:12:37.545 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.allow_data_in_errors: 0 2024-04-26T21:12:37.545 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.db_host_id: __hostname__ 2024-04-26T21:12:37.545 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_background_jobs: 2 2024-04-26T21:12:37.545 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_background_compactions: -1 2024-04-26T21:12:37.545 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_subcompactions: 1 2024-04-26T21:12:37.545 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-26T21:12:37.545 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-26T21:12:37.545 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-26T21:12:37.545 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_total_wal_size: 0 2024-04-26T21:12:37.545 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-26T21:12:37.545 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-26T21:12:37.545 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-26T21:12:37.545 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-26T21:12:37.546 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_open_files: -1 2024-04-26T21:12:37.546 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.bytes_per_sync: 0 2024-04-26T21:12:37.546 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-26T21:12:37.546 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-26T21:12:37.546 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compaction_readahead_size: 0 2024-04-26T21:12:37.546 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_background_flushes: -1 2024-04-26T21:12:37.546 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Compression algorithms supported: 2024-04-26T21:12:37.546 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-26T21:12:37.546 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: kZSTD supported: 0 2024-04-26T21:12:37.546 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: kXpressCompression supported: 0 2024-04-26T21:12:37.546 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: kLZ4HCCompression supported: 1 2024-04-26T21:12:37.546 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: kZlibCompression supported: 1 2024-04-26T21:12:37.546 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: kSnappyCompression supported: 1 2024-04-26T21:12:37.546 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: kLZ4Compression supported: 1 2024-04-26T21:12:37.547 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: kBZip2Compression supported: 0 2024-04-26T21:12:37.547 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-26T21:12:37.547 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi084/store.db/MANIFEST-000009 2024-04-26T21:12:37.547 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-04-26T21:12:37.547 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-26T21:12:37.547 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.merge_operator: 2024-04-26T21:12:37.547 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compaction_filter: None 2024-04-26T21:12:37.547 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compaction_filter_factory: None 2024-04-26T21:12:37.547 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.sst_partitioner_factory: None 2024-04-26T21:12:37.547 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-26T21:12:37.547 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-26T21:12:37.547 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55bef0abaf58) 2024-04-26T21:12:37.547 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: cache_index_and_filter_blocks: 1 2024-04-26T21:12:37.547 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-26T21:12:37.547 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-26T21:12:37.547 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: pin_top_level_index_and_filter: 1 2024-04-26T21:12:37.548 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: index_type: 0 2024-04-26T21:12:37.548 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: data_block_index_type: 0 2024-04-26T21:12:37.548 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: index_shortening: 1 2024-04-26T21:12:37.548 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-26T21:12:37.548 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: hash_index_allow_collision: 1 2024-04-26T21:12:37.548 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: checksum: 1 2024-04-26T21:12:37.548 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: no_block_cache: 0 2024-04-26T21:12:37.548 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: block_cache: 0x55bef0aed090 2024-04-26T21:12:37.548 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: block_cache_name: BinnedLRUCache 2024-04-26T21:12:37.548 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: block_cache_options: 2024-04-26T21:12:37.548 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: capacity : 536870912 2024-04-26T21:12:37.548 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: num_shard_bits : 4 2024-04-26T21:12:37.548 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: strict_capacity_limit : 0 2024-04-26T21:12:37.548 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: high_pri_pool_ratio: 0.000 2024-04-26T21:12:37.548 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: block_cache_compressed: (nil) 2024-04-26T21:12:37.549 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: persistent_cache: (nil) 2024-04-26T21:12:37.549 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: block_size: 4096 2024-04-26T21:12:37.549 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: block_size_deviation: 10 2024-04-26T21:12:37.549 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: block_restart_interval: 16 2024-04-26T21:12:37.549 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: index_block_restart_interval: 1 2024-04-26T21:12:37.549 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: metadata_block_size: 4096 2024-04-26T21:12:37.549 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: partition_filters: 0 2024-04-26T21:12:37.549 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: use_delta_encoding: 1 2024-04-26T21:12:37.549 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-04-26T21:12:37.549 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: whole_key_filtering: 1 2024-04-26T21:12:37.549 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: verify_compression: 0 2024-04-26T21:12:37.549 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: read_amp_bytes_per_bit: 0 2024-04-26T21:12:37.549 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: format_version: 4 2024-04-26T21:12:37.549 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: enable_index_compression: 1 2024-04-26T21:12:37.550 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: block_align: 0 2024-04-26T21:12:37.550 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.write_buffer_size: 33554432 2024-04-26T21:12:37.550 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_write_buffer_number: 2 2024-04-26T21:12:37.550 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compression: NoCompression 2024-04-26T21:12:37.550 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.bottommost_compression: Disabled 2024-04-26T21:12:37.550 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.prefix_extractor: nullptr 2024-04-26T21:12:37.550 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-26T21:12:37.550 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.num_levels: 7 2024-04-26T21:12:37.550 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-26T21:12:37.550 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-26T21:12:37.550 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-26T21:12:37.550 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-26T21:12:37.550 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-26T21:12:37.550 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-26T21:12:37.551 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-26T21:12:37.551 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-26T21:12:37.551 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-26T21:12:37.551 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-26T21:12:37.551 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-26T21:12:37.551 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compression_opts.level: 32767 2024-04-26T21:12:37.551 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compression_opts.strategy: 0 2024-04-26T21:12:37.551 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-26T21:12:37.551 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-26T21:12:37.551 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-26T21:12:37.551 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compression_opts.enabled: false 2024-04-26T21:12:37.551 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-26T21:12:37.551 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-26T21:12:37.551 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-26T21:12:37.551 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.target_file_size_base: 67108864 2024-04-26T21:12:37.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-26T21:12:37.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-26T21:12:37.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-26T21:12:37.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-26T21:12:37.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-26T21:12:37.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-26T21:12:37.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-26T21:12:37.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-26T21:12:37.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-26T21:12:37.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-26T21:12:37.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-26T21:12:37.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-26T21:12:37.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-26T21:12:37.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.arena_block_size: 4194304 2024-04-26T21:12:37.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-26T21:12:37.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-26T21:12:37.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-04-26T21:12:37.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.disable_auto_compactions: 0 2024-04-26T21:12:37.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-26T21:12:37.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-26T21:12:37.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-26T21:12:37.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-26T21:12:37.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-26T21:12:37.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-26T21:12:37.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-26T21:12:37.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-26T21:12:37.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-26T21:12:37.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-26T21:12:37.554 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.table_properties_collectors: 2024-04-26T21:12:37.554 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.inplace_update_support: 0 2024-04-26T21:12:37.554 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-26T21:12:37.554 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-26T21:12:37.554 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-26T21:12:37.554 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-26T21:12:37.554 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.bloom_locality: 0 2024-04-26T21:12:37.554 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.max_successive_merges: 0 2024-04-26T21:12:37.554 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-26T21:12:37.554 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.paranoid_file_checks: 0 2024-04-26T21:12:37.554 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.force_consistency_checks: 1 2024-04-26T21:12:37.554 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.report_bg_io_stats: 0 2024-04-26T21:12:37.554 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.ttl: 2592000 2024-04-26T21:12:37.554 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-26T21:12:37.554 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.enable_blob_files: false 2024-04-26T21:12:37.555 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.min_blob_size: 0 2024-04-26T21:12:37.555 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.blob_file_size: 268435456 2024-04-26T21:12:37.555 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-26T21:12:37.555 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-26T21:12:37.555 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-26T21:12:37.555 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi084/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-26T21:12:37.555 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-04-26T21:12:37.555 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-04-26T21:12:37.555 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714165957519978, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-04-26T21:12:37.555 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-04-26T21:12:37.555 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-04-26T21:12:37.555 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714165957521825, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93519, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91631, "index_size": 248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13606, "raw_average_key_size": 49, "raw_value_size": 84169, "raw_average_value_size": 306, "num_data_blocks": 11, "num_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1714165957, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "fbcffdcd-4b9a-4b9c-bf3c-7cf554df3419", "db_session_id": "LF3R5EMO11Q7SE2MMBFL"}} 2024-04-26T21:12:37.555 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-04-26T21:12:37.555 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714165957522500, "job": 1, "event": "recovery_finished"} 2024-04-26T21:12:37.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi084/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-26T21:12:37.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55bef0a81180 2024-04-26T21:12:37.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: DB pointer 0x55bef0b56000 2024-04-26T21:12:37.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-04-26T21:12:37.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-04-26T21:12:37.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: ** DB Stats ** 2024-04-26T21:12:37.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T21:12:37.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-26T21:12:37.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T21:12:37.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T21:12:37.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-26T21:12:37.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-04-26T21:12:37.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T21:12:37.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: 2024-04-26T21:12:37.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: ** Compaction Stats [default] ** 2024-04-26T21:12:37.557 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-26T21:12:37.557 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T21:12:37.557 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: L0 2/0 93.12 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 68.2 0.00 0.00 1 0.001 0 0 2024-04-26T21:12:37.557 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Sum 2/0 93.12 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 68.2 0.00 0.00 1 0.001 0 0 2024-04-26T21:12:37.557 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 68.2 0.00 0.00 1 0.001 0 0 2024-04-26T21:12:37.557 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: 2024-04-26T21:12:37.557 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: ** Compaction Stats [default] ** 2024-04-26T21:12:37.557 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-26T21:12:37.557 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T21:12:37.557 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 68.2 0.00 0.00 1 0.001 0 0 2024-04-26T21:12:37.557 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T21:12:37.557 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-26T21:12:37.557 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-26T21:12:37.557 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-26T21:12:37.557 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-26T21:12:37.558 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-26T21:12:37.558 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Cumulative compaction: 0.00 GB write, 13.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T21:12:37.558 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Interval compaction: 0.00 GB write, 13.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T21:12:37.558 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-26T21:12:37.558 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: 2024-04-26T21:12:37.558 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-26T21:12:37.558 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: 2024-04-26T21:12:37.558 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: ** Compaction Stats [default] ** 2024-04-26T21:12:37.558 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-26T21:12:37.558 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T21:12:37.558 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: L0 2/0 93.12 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 68.2 0.00 0.00 1 0.001 0 0 2024-04-26T21:12:37.558 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Sum 2/0 93.12 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 68.2 0.00 0.00 1 0.001 0 0 2024-04-26T21:12:37.558 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-26T21:12:37.558 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: 2024-04-26T21:12:37.559 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: ** Compaction Stats [default] ** 2024-04-26T21:12:37.559 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-26T21:12:37.559 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T21:12:37.559 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 68.2 0.00 0.00 1 0.001 0 0 2024-04-26T21:12:37.559 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T21:12:37.559 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-26T21:12:37.559 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-26T21:12:37.559 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-26T21:12:37.559 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-26T21:12:37.559 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-26T21:12:37.559 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Cumulative compaction: 0.00 GB write, 13.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T21:12:37.559 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T21:12:37.559 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-26T21:12:37.559 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: 2024-04-26T21:12:37.559 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-26T21:12:37.560 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: starting mon.smithi084 rank 0 at public addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] at bind addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi084 fsid 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:12:37.560 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: mon.smithi084@-1(???) e1 preinit fsid 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:12:37.560 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: mon.smithi084@-1(???).mds e1 new map 2024-04-26T21:12:37.560 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: mon.smithi084@-1(???).mds e1 print_map 2024-04-26T21:12:37.560 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: e1 2024-04-26T21:12:37.560 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:12:37.560 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:12:37.560 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: legacy client fscid: -1 2024-04-26T21:12:37.560 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: 2024-04-26T21:12:37.560 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: No filesystems configured 2024-04-26T21:12:37.560 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: mon.smithi084@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-26T21:12:37.560 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: mon.smithi084@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T21:12:37.560 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: mon.smithi084@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T21:12:37.560 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: mon.smithi084@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T21:12:37.560 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: mon.smithi084@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-26T21:12:37.561 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 bash[25514]: 24cc2d798ea7af7a727e0a8a1d591c789b9faafcdda0c1ce4354b4e8474cd330 2024-04-26T21:12:37.561 INFO:teuthology.orchestra.run.smithi084.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-26T21:12:37.893 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 systemd[1]: Started Ceph mon.smithi084 for 8bb44d26-0411-11ef-bc93-c7b262605968. 2024-04-26T21:12:37.893 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: mon.smithi084 is new leader, mons smithi084 in quorum (ranks 0) 2024-04-26T21:12:37.893 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: monmap e1: 1 mons at {smithi084=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-26T21:12:37.893 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: fsmap 2024-04-26T21:12:37.893 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: osdmap e1: 0 total, 0 up, 0 in 2024-04-26T21:12:37.894 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:37 smithi084 ceph-mon[25539]: mgrmap e1: no daemons active 2024-04-26T21:12:38.906 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.168+0000 7fe09cc00700 1 Processor -- start 2024-04-26T21:12:38.906 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.168+0000 7fe09cc00700 1 -- start start 2024-04-26T21:12:38.906 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.168+0000 7fe09cc00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe098071310 0x7fe098105410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:38.906 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.168+0000 7fe09cc00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe098105950 con 0x7fe098071310 2024-04-26T21:12:38.906 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.169+0000 7fe095e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe098071310 0x7fe098105410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:38.906 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.169+0000 7fe095e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe098071310 0x7fe098105410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47400/0 (socket says 172.21.15.84:47400) 2024-04-26T21:12:38.906 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.169+0000 7fe095e00700 1 -- 172.21.15.84:0/3655456001 learned_addr learned my addr 172.21.15.84:0/3655456001 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:38.906 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.170+0000 7fe095e00700 1 -- 172.21.15.84:0/3655456001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe098105a90 con 0x7fe098071310 2024-04-26T21:12:38.906 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.170+0000 7fe095e00700 1 --2- 172.21.15.84:0/3655456001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe098071310 0x7fe098105410 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe0880098e0 tx=0x7fe088009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366b23278df61b09 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:38.907 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.170+0000 7fe094a00700 1 -- 172.21.15.84:0/3655456001 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe08800b860 con 0x7fe098071310 2024-04-26T21:12:38.907 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.170+0000 7fe094a00700 1 -- 172.21.15.84:0/3655456001 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe08800be50 con 0x7fe098071310 2024-04-26T21:12:38.907 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.170+0000 7fe094a00700 1 -- 172.21.15.84:0/3655456001 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe088010380 con 0x7fe098071310 2024-04-26T21:12:38.907 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.171+0000 7fe09cc00700 1 -- 172.21.15.84:0/3655456001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe098071310 msgr2=0x7fe098105410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:38.907 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.171+0000 7fe09cc00700 1 --2- 172.21.15.84:0/3655456001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe098071310 0x7fe098105410 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe0880098e0 tx=0x7fe088009250 comp rx=0 tx=0).stop 2024-04-26T21:12:38.907 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.171+0000 7fe09cc00700 1 -- 172.21.15.84:0/3655456001 shutdown_connections 2024-04-26T21:12:38.907 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.171+0000 7fe09cc00700 1 --2- 172.21.15.84:0/3655456001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe098071310 0x7fe098105410 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:38.907 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.171+0000 7fe09cc00700 1 -- 172.21.15.84:0/3655456001 >> 172.21.15.84:0/3655456001 conn(0x7fe0980fcec0 msgr2=0x7fe0980ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:38.907 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.171+0000 7fe09cc00700 1 -- 172.21.15.84:0/3655456001 shutdown_connections 2024-04-26T21:12:38.907 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.171+0000 7fe09cc00700 1 -- 172.21.15.84:0/3655456001 wait complete. 2024-04-26T21:12:38.907 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.172+0000 7fe09cc00700 1 Processor -- start 2024-04-26T21:12:38.907 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.172+0000 7fe09cc00700 1 -- start start 2024-04-26T21:12:38.907 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.173+0000 7fe09cc00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe098071310 0x7fe098102d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:38.908 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.173+0000 7fe09cc00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0981032a0 con 0x7fe098071310 2024-04-26T21:12:38.908 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.173+0000 7fe095e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe098071310 0x7fe098102d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:38.908 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.173+0000 7fe095e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe098071310 0x7fe098102d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47414/0 (socket says 172.21.15.84:47414) 2024-04-26T21:12:38.908 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.173+0000 7fe095e00700 1 -- 172.21.15.84:0/2454567653 learned_addr learned my addr 172.21.15.84:0/2454567653 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:38.908 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.174+0000 7fe095e00700 1 -- 172.21.15.84:0/2454567653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0880094f0 con 0x7fe098071310 2024-04-26T21:12:38.908 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.174+0000 7fe095e00700 1 --2- 172.21.15.84:0/2454567653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe098071310 0x7fe098102d60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe088006b00 tx=0x7fe088009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:38.908 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.174+0000 7fe08e000700 1 -- 172.21.15.84:0/2454567653 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0880107c0 con 0x7fe098071310 2024-04-26T21:12:38.908 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.174+0000 7fe08e000700 1 -- 172.21.15.84:0/2454567653 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe088010db0 con 0x7fe098071310 2024-04-26T21:12:38.908 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.174+0000 7fe08e000700 1 -- 172.21.15.84:0/2454567653 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe08801acf0 con 0x7fe098071310 2024-04-26T21:12:38.908 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.174+0000 7fe09cc00700 1 -- 172.21.15.84:0/2454567653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe098101310 con 0x7fe098071310 2024-04-26T21:12:38.908 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.174+0000 7fe09cc00700 1 -- 172.21.15.84:0/2454567653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe098101800 con 0x7fe098071310 2024-04-26T21:12:38.908 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.175+0000 7fe08e000700 1 -- 172.21.15.84:0/2454567653 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fe088024440 con 0x7fe098071310 2024-04-26T21:12:38.908 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.175+0000 7fe08e000700 1 -- 172.21.15.84:0/2454567653 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe088019710 con 0x7fe098071310 2024-04-26T21:12:38.908 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.176+0000 7fe09cc00700 1 -- 172.21.15.84:0/2454567653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09804bed0 con 0x7fe098071310 2024-04-26T21:12:38.909 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.179+0000 7fe08e000700 1 -- 172.21.15.84:0/2454567653 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fe08801a530 con 0x7fe098071310 2024-04-26T21:12:38.909 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.277+0000 7fe09cc00700 1 -- 172.21.15.84:0/2454567653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fe098101a40 con 0x7fe098071310 2024-04-26T21:12:38.909 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.280+0000 7fe08e000700 1 -- 172.21.15.84:0/2454567653 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe088010920 con 0x7fe098071310 2024-04-26T21:12:38.909 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.281+0000 7fe09cc00700 1 -- 172.21.15.84:0/2454567653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe098071310 msgr2=0x7fe098102d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:38.909 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.281+0000 7fe09cc00700 1 --2- 172.21.15.84:0/2454567653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe098071310 0x7fe098102d60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe088006b00 tx=0x7fe088009250 comp rx=0 tx=0).stop 2024-04-26T21:12:38.909 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.282+0000 7fe09cc00700 1 -- 172.21.15.84:0/2454567653 shutdown_connections 2024-04-26T21:12:38.909 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.282+0000 7fe09cc00700 1 --2- 172.21.15.84:0/2454567653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe098071310 0x7fe098102d60 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:38.909 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.282+0000 7fe09cc00700 1 -- 172.21.15.84:0/2454567653 >> 172.21.15.84:0/2454567653 conn(0x7fe0980fcec0 msgr2=0x7fe0980fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:38.909 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.282+0000 7fe09cc00700 1 -- 172.21.15.84:0/2454567653 shutdown_connections 2024-04-26T21:12:38.909 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:38.282+0000 7fe09cc00700 1 -- 172.21.15.84:0/2454567653 wait complete. 2024-04-26T21:12:38.909 INFO:teuthology.orchestra.run.smithi084.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-26T21:12:38.909 INFO:teuthology.orchestra.run.smithi084.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-26T21:12:38.909 INFO:teuthology.orchestra.run.smithi084.stdout:Creating mgr... 2024-04-26T21:12:38.910 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying port 9283 ... 2024-04-26T21:12:39.265 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-8bb44d26-0411-11ef-bc93-c7b262605968@mgr.smithi084.gyasul 2024-04-26T21:12:39.265 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to reset failed state of unit ceph-8bb44d26-0411-11ef-bc93-c7b262605968@mgr.smithi084.gyasul.service: Unit ceph-8bb44d26-0411-11ef-bc93-c7b262605968@mgr.smithi084.gyasul.service not loaded. 2024-04-26T21:12:39.529 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-8bb44d26-0411-11ef-bc93-c7b262605968.target.wants/ceph-8bb44d26-0411-11ef-bc93-c7b262605968@mgr.smithi084.gyasul.service → /etc/systemd/system/ceph-8bb44d26-0411-11ef-bc93-c7b262605968@.service. 2024-04-26T21:12:39.568 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:39 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2454567653' entity='client.admin' 2024-04-26T21:12:40.311 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T21:12:40.311 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-04-26T21:12:40.330 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T21:12:40.330 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-04-26T21:12:40.330 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-04-26T21:12:40.331 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to enable service . firewalld.service is not available 2024-04-26T21:12:40.352 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T21:12:40.352 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-04-26T21:12:40.370 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T21:12:40.370 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-04-26T21:12:40.370 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-04-26T21:12:40.370 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2024-04-26T21:12:40.370 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr to start... 2024-04-26T21:12:40.371 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr... 2024-04-26T21:12:41.315 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:41 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3017311986' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T21:12:42.070 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-04-26T21:12:42.070 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-04-26T21:12:42.070 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "8bb44d26-0411-11ef-bc93-c7b262605968", 2024-04-26T21:12:42.070 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T21:12:42.070 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T21:12:42.070 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T21:12:42.070 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T21:12:42.070 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:42.070 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T21:12:42.070 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T21:12:42.070 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-04-26T21:12:42.071 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-04-26T21:12:42.071 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T21:12:42.071 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "smithi084" 2024-04-26T21:12:42.071 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-04-26T21:12:42.071 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-04-26T21:12:42.071 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T21:12:42.071 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T21:12:42.071 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-26T21:12:42.071 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T21:12:42.071 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:42.071 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T21:12:42.072 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T21:12:42.072 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T21:12:42.072 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T21:12:42.072 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T21:12:42.080 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T21:12:42.080 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T21:12:42.080 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T21:12:42.080 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:42.080 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T21:12:42.080 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T21:12:42.080 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T21:12:42.080 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T21:12:42.080 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T21:12:42.080 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T21:12:42.080 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T21:12:42.080 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T21:12:42.080 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T21:12:42.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:42.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T21:12:42.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T21:12:42.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T21:12:42.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T21:12:42.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:42.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T21:12:42.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-26T21:12:42.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T21:12:42.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T21:12:42.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T21:12:42.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T21:12:42.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T21:12:42.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-04-26T21:12:42.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T21:12:42.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:42.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T21:12:42.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T21:12:42.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T21:12:29.304688+0000", 2024-04-26T21:12:42.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T21:12:42.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:42.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T21:12:42.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-04-26T21:12:42.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.975+0000 7f390f200700 1 Processor -- start 2024-04-26T21:12:42.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.975+0000 7f390f200700 1 -- start start 2024-04-26T21:12:42.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.975+0000 7f390f200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3910077b70 0x7f3910076120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:42.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.975+0000 7f390f200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3910077f80 con 0x7f3910077b70 2024-04-26T21:12:42.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.976+0000 7f390de00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3910077b70 0x7f3910076120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:42.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.976+0000 7f390de00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3910077b70 0x7f3910076120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47450/0 (socket says 172.21.15.84:47450) 2024-04-26T21:12:42.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.976+0000 7f390de00700 1 -- 172.21.15.84:0/1893552381 learned_addr learned my addr 172.21.15.84:0/1893552381 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:42.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.976+0000 7f390de00700 1 -- 172.21.15.84:0/1893552381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3910076660 con 0x7f3910077b70 2024-04-26T21:12:42.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.977+0000 7f390de00700 1 --2- 172.21.15.84:0/1893552381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3910077b70 0x7f3910076120 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f39000098e0 tx=0x7f3900009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a2d86d0dd2647eb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:42.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.977+0000 7f390d400700 1 -- 172.21.15.84:0/1893552381 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f390000b860 con 0x7f3910077b70 2024-04-26T21:12:42.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.977+0000 7f390d400700 1 -- 172.21.15.84:0/1893552381 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f390000be50 con 0x7f3910077b70 2024-04-26T21:12:42.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.977+0000 7f390d400700 1 -- 172.21.15.84:0/1893552381 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3900010380 con 0x7f3910077b70 2024-04-26T21:12:42.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.978+0000 7f390f200700 1 -- 172.21.15.84:0/1893552381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3910077b70 msgr2=0x7f3910076120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:42.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.978+0000 7f390f200700 1 --2- 172.21.15.84:0/1893552381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3910077b70 0x7f3910076120 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f39000098e0 tx=0x7f3900009250 comp rx=0 tx=0).stop 2024-04-26T21:12:42.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.978+0000 7f390f200700 1 -- 172.21.15.84:0/1893552381 shutdown_connections 2024-04-26T21:12:42.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.978+0000 7f390f200700 1 --2- 172.21.15.84:0/1893552381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3910077b70 0x7f3910076120 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:42.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.978+0000 7f390f200700 1 -- 172.21.15.84:0/1893552381 >> 172.21.15.84:0/1893552381 conn(0x7f39100fde90 msgr2=0x7f39101002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:42.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.978+0000 7f390f200700 1 -- 172.21.15.84:0/1893552381 shutdown_connections 2024-04-26T21:12:42.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.978+0000 7f390f200700 1 -- 172.21.15.84:0/1893552381 wait complete. 2024-04-26T21:12:42.084 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.979+0000 7f390f200700 1 Processor -- start 2024-04-26T21:12:42.084 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.980+0000 7f390f200700 1 -- start start 2024-04-26T21:12:42.084 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.980+0000 7f390f200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3910077b70 0x7f3910113650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:42.084 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.980+0000 7f390f200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3910113b90 con 0x7f3910077b70 2024-04-26T21:12:42.084 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.980+0000 7f390de00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3910077b70 0x7f3910113650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:42.084 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.980+0000 7f390de00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3910077b70 0x7f3910113650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47464/0 (socket says 172.21.15.84:47464) 2024-04-26T21:12:42.084 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.980+0000 7f390de00700 1 -- 172.21.15.84:0/3017311986 learned_addr learned my addr 172.21.15.84:0/3017311986 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:42.084 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.981+0000 7f390de00700 1 -- 172.21.15.84:0/3017311986 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39000094f0 con 0x7f3910077b70 2024-04-26T21:12:42.084 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.981+0000 7f390de00700 1 --2- 172.21.15.84:0/3017311986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3910077b70 0x7f3910113650 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3900006b00 tx=0x7f3900009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:42.084 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.981+0000 7f3906a00700 1 -- 172.21.15.84:0/3017311986 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f39000107c0 con 0x7f3910077b70 2024-04-26T21:12:42.084 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.981+0000 7f3906a00700 1 -- 172.21.15.84:0/3017311986 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f3900010db0 con 0x7f3910077b70 2024-04-26T21:12:42.084 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.981+0000 7f3906a00700 1 -- 172.21.15.84:0/3017311986 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f390001acf0 con 0x7f3910077b70 2024-04-26T21:12:42.084 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.981+0000 7f390f200700 1 -- 172.21.15.84:0/3017311986 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3910113d90 con 0x7f3910077b70 2024-04-26T21:12:42.084 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.981+0000 7f390f200700 1 -- 172.21.15.84:0/3017311986 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3910114900 con 0x7f3910077b70 2024-04-26T21:12:42.085 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.982+0000 7f3906a00700 1 -- 172.21.15.84:0/3017311986 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f3900024440 con 0x7f3910077b70 2024-04-26T21:12:42.085 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.982+0000 7f3906a00700 1 -- 172.21.15.84:0/3017311986 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3900019710 con 0x7f3910077b70 2024-04-26T21:12:42.085 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.982+0000 7f390f200700 1 -- 172.21.15.84:0/3017311986 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391005f5c0 con 0x7f3910077b70 2024-04-26T21:12:42.085 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:40.985+0000 7f3906a00700 1 -- 172.21.15.84:0/3017311986 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f390001a530 con 0x7f3910077b70 2024-04-26T21:12:42.085 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:41.064+0000 7f390f200700 1 -- 172.21.15.84:0/3017311986 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f3910108910 con 0x7f3910077b70 2024-04-26T21:12:42.085 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:41.064+0000 7f3906a00700 1 -- 172.21.15.84:0/3017311986 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f3900010920 con 0x7f3910077b70 2024-04-26T21:12:42.085 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:41.066+0000 7f390f200700 1 -- 172.21.15.84:0/3017311986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3910077b70 msgr2=0x7f3910113650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:42.085 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:41.066+0000 7f390f200700 1 --2- 172.21.15.84:0/3017311986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3910077b70 0x7f3910113650 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3900006b00 tx=0x7f3900009250 comp rx=0 tx=0).stop 2024-04-26T21:12:42.085 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:41.066+0000 7f390f200700 1 -- 172.21.15.84:0/3017311986 shutdown_connections 2024-04-26T21:12:42.085 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:41.066+0000 7f390f200700 1 --2- 172.21.15.84:0/3017311986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3910077b70 0x7f3910113650 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:42.085 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:41.066+0000 7f390f200700 1 -- 172.21.15.84:0/3017311986 >> 172.21.15.84:0/3017311986 conn(0x7f39100fde90 msgr2=0x7f39100fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:42.085 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:41.066+0000 7f390f200700 1 -- 172.21.15.84:0/3017311986 shutdown_connections 2024-04-26T21:12:42.085 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:41.067+0000 7f390f200700 1 -- 172.21.15.84:0/3017311986 wait complete. 2024-04-26T21:12:42.085 INFO:teuthology.orchestra.run.smithi084.stdout:mgr not available, waiting (1/15)... 2024-04-26T21:12:45.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:44 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1140836253' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T21:12:45.545 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-04-26T21:12:45.546 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-04-26T21:12:45.546 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "8bb44d26-0411-11ef-bc93-c7b262605968", 2024-04-26T21:12:45.546 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T21:12:45.546 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T21:12:45.546 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T21:12:45.548 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T21:12:45.548 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:45.548 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T21:12:45.548 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T21:12:45.548 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-04-26T21:12:45.549 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-04-26T21:12:45.549 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T21:12:45.549 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "smithi084" 2024-04-26T21:12:45.549 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-04-26T21:12:45.549 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-04-26T21:12:45.549 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T21:12:45.549 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T21:12:45.549 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-26T21:12:45.549 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T21:12:45.549 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:45.549 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T21:12:45.549 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T21:12:45.549 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T21:12:45.549 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T21:12:45.549 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T21:12:45.557 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T21:12:45.557 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T21:12:45.557 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T21:12:45.557 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:45.558 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T21:12:45.558 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T21:12:45.558 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T21:12:45.558 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T21:12:45.558 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T21:12:45.558 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T21:12:45.558 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T21:12:45.558 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T21:12:45.558 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T21:12:45.558 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:45.558 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T21:12:45.558 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T21:12:45.558 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T21:12:45.559 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T21:12:45.559 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:45.559 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T21:12:45.559 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-26T21:12:45.559 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T21:12:45.559 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T21:12:45.559 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T21:12:45.559 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T21:12:45.559 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T21:12:45.559 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-04-26T21:12:45.559 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T21:12:45.559 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:45.559 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T21:12:45.559 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T21:12:45.560 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T21:12:29.304688+0000", 2024-04-26T21:12:45.560 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T21:12:45.560 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:45.560 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T21:12:45.560 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-04-26T21:12:45.560 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.719+0000 7fb23ac00700 1 Processor -- start 2024-04-26T21:12:45.560 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.719+0000 7fb23ac00700 1 -- start start 2024-04-26T21:12:45.560 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.719+0000 7fb23ac00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb234077b30 0x7fb2340760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:45.560 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.720+0000 7fb23ac00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb234077f40 con 0x7fb234077b30 2024-04-26T21:12:45.560 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.720+0000 7fb233e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb234077b30 0x7fb2340760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:45.560 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.720+0000 7fb233e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb234077b30 0x7fb2340760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39528/0 (socket says 172.21.15.84:39528) 2024-04-26T21:12:45.560 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.720+0000 7fb233e00700 1 -- 172.21.15.84:0/1373637687 learned_addr learned my addr 172.21.15.84:0/1373637687 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:45.560 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.721+0000 7fb233e00700 1 -- 172.21.15.84:0/1373637687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb234076620 con 0x7fb234077b30 2024-04-26T21:12:45.560 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.721+0000 7fb233e00700 1 --2- 172.21.15.84:0/1373637687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb234077b30 0x7fb2340760e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb2240098e0 tx=0x7fb224009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db7043c1e144a40 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:45.561 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.721+0000 7fb232a00700 1 -- 172.21.15.84:0/1373637687 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb22400b860 con 0x7fb234077b30 2024-04-26T21:12:45.561 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.721+0000 7fb232a00700 1 -- 172.21.15.84:0/1373637687 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb22400be50 con 0x7fb234077b30 2024-04-26T21:12:45.561 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.721+0000 7fb232a00700 1 -- 172.21.15.84:0/1373637687 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb224010380 con 0x7fb234077b30 2024-04-26T21:12:45.561 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.722+0000 7fb23ac00700 1 -- 172.21.15.84:0/1373637687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb234077b30 msgr2=0x7fb2340760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:45.561 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.722+0000 7fb23ac00700 1 --2- 172.21.15.84:0/1373637687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb234077b30 0x7fb2340760e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb2240098e0 tx=0x7fb224009250 comp rx=0 tx=0).stop 2024-04-26T21:12:45.561 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.722+0000 7fb23ac00700 1 -- 172.21.15.84:0/1373637687 shutdown_connections 2024-04-26T21:12:45.561 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.722+0000 7fb23ac00700 1 --2- 172.21.15.84:0/1373637687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb234077b30 0x7fb2340760e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:45.561 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.722+0000 7fb23ac00700 1 -- 172.21.15.84:0/1373637687 >> 172.21.15.84:0/1373637687 conn(0x7fb2340fdf90 msgr2=0x7fb234100400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:45.561 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.722+0000 7fb23ac00700 1 -- 172.21.15.84:0/1373637687 shutdown_connections 2024-04-26T21:12:45.561 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.723+0000 7fb23ac00700 1 -- 172.21.15.84:0/1373637687 wait complete. 2024-04-26T21:12:45.561 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.723+0000 7fb23ac00700 1 Processor -- start 2024-04-26T21:12:45.561 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.723+0000 7fb23ac00700 1 -- start start 2024-04-26T21:12:45.561 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.724+0000 7fb23ac00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb234077b30 0x7fb234113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:45.561 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.724+0000 7fb23ac00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb234113d90 con 0x7fb234077b30 2024-04-26T21:12:45.562 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.724+0000 7fb233e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb234077b30 0x7fb234113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:45.562 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.724+0000 7fb233e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb234077b30 0x7fb234113850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39534/0 (socket says 172.21.15.84:39534) 2024-04-26T21:12:45.562 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.724+0000 7fb233e00700 1 -- 172.21.15.84:0/1140836253 learned_addr learned my addr 172.21.15.84:0/1140836253 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:45.562 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.724+0000 7fb233e00700 1 -- 172.21.15.84:0/1140836253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2240094f0 con 0x7fb234077b30 2024-04-26T21:12:45.562 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.725+0000 7fb233e00700 1 --2- 172.21.15.84:0/1140836253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb234077b30 0x7fb234113850 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb224006fd0 tx=0x7fb224009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:45.562 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.725+0000 7fb22be00700 1 -- 172.21.15.84:0/1140836253 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2240107c0 con 0x7fb234077b30 2024-04-26T21:12:45.562 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.725+0000 7fb22be00700 1 -- 172.21.15.84:0/1140836253 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb224010db0 con 0x7fb234077b30 2024-04-26T21:12:45.562 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.725+0000 7fb23ac00700 1 -- 172.21.15.84:0/1140836253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb234113f90 con 0x7fb234077b30 2024-04-26T21:12:45.562 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.725+0000 7fb22be00700 1 -- 172.21.15.84:0/1140836253 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb22401adc0 con 0x7fb234077b30 2024-04-26T21:12:45.562 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.725+0000 7fb23ac00700 1 -- 172.21.15.84:0/1140836253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb234114b00 con 0x7fb234077b30 2024-04-26T21:12:45.562 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.726+0000 7fb22be00700 1 -- 172.21.15.84:0/1140836253 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fb224019410 con 0x7fb234077b30 2024-04-26T21:12:45.562 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.726+0000 7fb22be00700 1 -- 172.21.15.84:0/1140836253 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb224024750 con 0x7fb234077b30 2024-04-26T21:12:45.562 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.726+0000 7fb23ac00700 1 -- 172.21.15.84:0/1140836253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23405f5c0 con 0x7fb234077b30 2024-04-26T21:12:45.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.731+0000 7fb22be00700 1 -- 172.21.15.84:0/1140836253 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fb224029060 con 0x7fb234077b30 2024-04-26T21:12:45.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.808+0000 7fb23ac00700 1 -- 172.21.15.84:0/1140836253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb234108ab0 con 0x7fb234077b30 2024-04-26T21:12:45.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.809+0000 7fb22be00700 1 -- 172.21.15.84:0/1140836253 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fb224020070 con 0x7fb234077b30 2024-04-26T21:12:45.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.810+0000 7fb23ac00700 1 -- 172.21.15.84:0/1140836253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb234077b30 msgr2=0x7fb234113850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:45.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.810+0000 7fb23ac00700 1 --2- 172.21.15.84:0/1140836253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb234077b30 0x7fb234113850 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb224006fd0 tx=0x7fb224009250 comp rx=0 tx=0).stop 2024-04-26T21:12:45.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.810+0000 7fb23ac00700 1 -- 172.21.15.84:0/1140836253 shutdown_connections 2024-04-26T21:12:45.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.810+0000 7fb23ac00700 1 --2- 172.21.15.84:0/1140836253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb234077b30 0x7fb234113850 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:45.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.810+0000 7fb23ac00700 1 -- 172.21.15.84:0/1140836253 >> 172.21.15.84:0/1140836253 conn(0x7fb2340fdf90 msgr2=0x7fb2340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:45.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.810+0000 7fb23ac00700 1 -- 172.21.15.84:0/1140836253 shutdown_connections 2024-04-26T21:12:45.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:44.810+0000 7fb23ac00700 1 -- 172.21.15.84:0/1140836253 wait complete. 2024-04-26T21:12:45.564 INFO:teuthology.orchestra.run.smithi084.stdout:mgr not available, waiting (2/15)... 2024-04-26T21:12:48.628 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:48 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1652179441' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T21:12:48.950 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-04-26T21:12:48.950 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-04-26T21:12:48.950 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "8bb44d26-0411-11ef-bc93-c7b262605968", 2024-04-26T21:12:48.950 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T21:12:48.950 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T21:12:48.950 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T21:12:48.950 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T21:12:48.950 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:48.950 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T21:12:48.950 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T21:12:48.950 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-04-26T21:12:48.951 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-04-26T21:12:48.951 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T21:12:48.951 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "smithi084" 2024-04-26T21:12:48.951 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-04-26T21:12:48.951 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-04-26T21:12:48.951 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T21:12:48.951 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T21:12:48.951 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-26T21:12:48.951 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T21:12:48.951 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:48.951 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T21:12:48.951 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T21:12:48.951 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T21:12:48.951 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T21:12:48.951 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T21:12:48.959 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T21:12:48.959 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T21:12:48.959 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T21:12:48.959 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:48.960 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T21:12:48.960 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T21:12:48.960 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T21:12:48.960 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T21:12:48.960 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T21:12:48.960 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T21:12:48.960 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T21:12:48.960 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T21:12:48.960 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T21:12:48.960 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:48.960 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T21:12:48.960 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T21:12:48.960 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T21:12:48.960 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T21:12:48.960 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:48.960 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T21:12:48.961 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-26T21:12:48.961 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T21:12:48.961 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T21:12:48.961 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T21:12:48.961 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T21:12:48.961 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T21:12:48.961 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-04-26T21:12:48.961 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T21:12:48.961 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:48.961 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T21:12:48.961 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T21:12:48.961 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T21:12:29.304688+0000", 2024-04-26T21:12:48.961 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T21:12:48.961 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:48.961 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T21:12:48.962 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-04-26T21:12:48.962 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.119+0000 7f4e04e00700 1 Processor -- start 2024-04-26T21:12:48.962 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.119+0000 7f4e04e00700 1 -- start start 2024-04-26T21:12:48.962 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.119+0000 7f4e04e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e001026b0 0x7f4e00102ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:48.962 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.119+0000 7f4e04e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e00103000 con 0x7f4e001026b0 2024-04-26T21:12:48.962 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.120+0000 7f4dff400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e001026b0 0x7f4e00102ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:48.962 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.120+0000 7f4dff400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e001026b0 0x7f4e00102ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39544/0 (socket says 172.21.15.84:39544) 2024-04-26T21:12:48.962 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.120+0000 7f4dff400700 1 -- 172.21.15.84:0/1972806719 learned_addr learned my addr 172.21.15.84:0/1972806719 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:48.962 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.120+0000 7f4dff400700 1 -- 172.21.15.84:0/1972806719 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e00103140 con 0x7f4e001026b0 2024-04-26T21:12:48.962 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.121+0000 7f4dff400700 1 --2- 172.21.15.84:0/1972806719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e001026b0 0x7f4e00102ac0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4df00098e0 tx=0x7f4df0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc75a7d54f1d3bb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:48.962 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.121+0000 7f4dfe000700 1 -- 172.21.15.84:0/1972806719 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4df000b860 con 0x7f4e001026b0 2024-04-26T21:12:48.962 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.121+0000 7f4dfe000700 1 -- 172.21.15.84:0/1972806719 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4df000be50 con 0x7f4e001026b0 2024-04-26T21:12:48.962 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.121+0000 7f4dfe000700 1 -- 172.21.15.84:0/1972806719 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4df0010380 con 0x7f4e001026b0 2024-04-26T21:12:48.962 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.122+0000 7f4e04e00700 1 -- 172.21.15.84:0/1972806719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e001026b0 msgr2=0x7f4e00102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:48.963 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.122+0000 7f4e04e00700 1 --2- 172.21.15.84:0/1972806719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e001026b0 0x7f4e00102ac0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4df00098e0 tx=0x7f4df0009250 comp rx=0 tx=0).stop 2024-04-26T21:12:48.963 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.122+0000 7f4e04e00700 1 -- 172.21.15.84:0/1972806719 shutdown_connections 2024-04-26T21:12:48.963 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.122+0000 7f4e04e00700 1 --2- 172.21.15.84:0/1972806719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e001026b0 0x7f4e00102ac0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:48.963 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.122+0000 7f4e04e00700 1 -- 172.21.15.84:0/1972806719 >> 172.21.15.84:0/1972806719 conn(0x7f4e000fde90 msgr2=0x7f4e001002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:48.963 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.122+0000 7f4e04e00700 1 -- 172.21.15.84:0/1972806719 shutdown_connections 2024-04-26T21:12:48.963 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.122+0000 7f4e04e00700 1 -- 172.21.15.84:0/1972806719 wait complete. 2024-04-26T21:12:48.963 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.123+0000 7f4e04e00700 1 Processor -- start 2024-04-26T21:12:48.963 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.123+0000 7f4e04e00700 1 -- start start 2024-04-26T21:12:48.963 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.124+0000 7f4e04e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e001026b0 0x7f4e00111400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:48.963 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.124+0000 7f4e04e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e00111940 con 0x7f4e001026b0 2024-04-26T21:12:48.963 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.124+0000 7f4dff400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e001026b0 0x7f4e00111400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:48.963 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.124+0000 7f4dff400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e001026b0 0x7f4e00111400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39554/0 (socket says 172.21.15.84:39554) 2024-04-26T21:12:48.963 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.124+0000 7f4dff400700 1 -- 172.21.15.84:0/1652179441 learned_addr learned my addr 172.21.15.84:0/1652179441 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:48.963 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.124+0000 7f4dff400700 1 -- 172.21.15.84:0/1652179441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df00094f0 con 0x7f4e001026b0 2024-04-26T21:12:48.963 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.125+0000 7f4dff400700 1 --2- 172.21.15.84:0/1652179441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e001026b0 0x7f4e00111400 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4df0000c00 tx=0x7f4df0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:48.963 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.125+0000 7f4df7400700 1 -- 172.21.15.84:0/1652179441 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4df00107c0 con 0x7f4e001026b0 2024-04-26T21:12:48.964 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.125+0000 7f4df7400700 1 -- 172.21.15.84:0/1652179441 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4df0010db0 con 0x7f4e001026b0 2024-04-26T21:12:48.964 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.125+0000 7f4e04e00700 1 -- 172.21.15.84:0/1652179441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e00111b40 con 0x7f4e001026b0 2024-04-26T21:12:48.964 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.125+0000 7f4df7400700 1 -- 172.21.15.84:0/1652179441 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4df001ad00 con 0x7f4e001026b0 2024-04-26T21:12:48.964 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.125+0000 7f4e04e00700 1 -- 172.21.15.84:0/1652179441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e001126b0 con 0x7f4e001026b0 2024-04-26T21:12:48.964 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.126+0000 7f4df7400700 1 -- 172.21.15.84:0/1652179441 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f4df0024440 con 0x7f4e001026b0 2024-04-26T21:12:48.964 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.126+0000 7f4df7400700 1 -- 172.21.15.84:0/1652179441 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4df0019710 con 0x7f4e001026b0 2024-04-26T21:12:48.964 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.126+0000 7f4e04e00700 1 -- 172.21.15.84:0/1652179441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e0005f5c0 con 0x7f4e001026b0 2024-04-26T21:12:48.964 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.131+0000 7f4df7400700 1 -- 172.21.15.84:0/1652179441 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f4df001a530 con 0x7f4e001026b0 2024-04-26T21:12:48.964 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.208+0000 7f4e04e00700 1 -- 172.21.15.84:0/1652179441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f4e00104480 con 0x7f4e001026b0 2024-04-26T21:12:48.964 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.209+0000 7f4df7400700 1 -- 172.21.15.84:0/1652179441 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1249 (secure 0 0 0) 0x7f4df0010920 con 0x7f4e001026b0 2024-04-26T21:12:48.964 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.210+0000 7f4e04e00700 1 -- 172.21.15.84:0/1652179441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e001026b0 msgr2=0x7f4e00111400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:48.964 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.210+0000 7f4e04e00700 1 --2- 172.21.15.84:0/1652179441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e001026b0 0x7f4e00111400 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4df0000c00 tx=0x7f4df0009250 comp rx=0 tx=0).stop 2024-04-26T21:12:48.964 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.210+0000 7f4e04e00700 1 -- 172.21.15.84:0/1652179441 shutdown_connections 2024-04-26T21:12:48.964 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.210+0000 7f4e04e00700 1 --2- 172.21.15.84:0/1652179441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e001026b0 0x7f4e00111400 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:48.964 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.210+0000 7f4e04e00700 1 -- 172.21.15.84:0/1652179441 >> 172.21.15.84:0/1652179441 conn(0x7f4e000fde90 msgr2=0x7f4e000fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:48.965 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.210+0000 7f4e04e00700 1 -- 172.21.15.84:0/1652179441 shutdown_connections 2024-04-26T21:12:48.965 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:48.211+0000 7f4e04e00700 1 -- 172.21.15.84:0/1652179441 wait complete. 2024-04-26T21:12:48.965 INFO:teuthology.orchestra.run.smithi084.stdout:mgr not available, waiting (3/15)... 2024-04-26T21:12:49.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:49 smithi084 ceph-mon[25539]: Activating manager daemon smithi084.gyasul 2024-04-26T21:12:49.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:49 smithi084 ceph-mon[25539]: mgrmap e2: smithi084.gyasul(active, starting, since 0.00971206s) 2024-04-26T21:12:49.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:49 smithi084 ceph-mon[25539]: from='mgr.14100 172.21.15.84:0/3261157282' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T21:12:49.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:49 smithi084 ceph-mon[25539]: from='mgr.14100 172.21.15.84:0/3261157282' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T21:12:49.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:49 smithi084 ceph-mon[25539]: from='mgr.14100 172.21.15.84:0/3261157282' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T21:12:49.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:49 smithi084 ceph-mon[25539]: from='mgr.14100 172.21.15.84:0/3261157282' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T21:12:49.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:49 smithi084 ceph-mon[25539]: from='mgr.14100 172.21.15.84:0/3261157282' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T21:12:49.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:49 smithi084 ceph-mon[25539]: from='mgr.14100 172.21.15.84:0/3261157282' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T21:12:49.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:49 smithi084 ceph-mon[25539]: from='mgr.14100 172.21.15.84:0/3261157282' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-04-26T21:12:49.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:49 smithi084 ceph-mon[25539]: from='mgr.14100 172.21.15.84:0/3261157282' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr metadata", "who": "smithi084.gyasul", "id": "smithi084.gyasul"}]: dispatch 2024-04-26T21:12:49.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:49 smithi084 ceph-mon[25539]: Manager daemon smithi084.gyasul is now available 2024-04-26T21:12:49.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:49 smithi084 ceph-mon[25539]: from='mgr.14100 172.21.15.84:0/3261157282' entity='mgr.smithi084.gyasul' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.gyasul/mirror_snapshot_schedule"}]: dispatch 2024-04-26T21:12:49.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:49 smithi084 ceph-mon[25539]: from='mgr.14100 172.21.15.84:0/3261157282' entity='mgr.smithi084.gyasul' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.gyasul/trash_purge_schedule"}]: dispatch 2024-04-26T21:12:49.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:49 smithi084 ceph-mon[25539]: from='mgr.14100 172.21.15.84:0/3261157282' entity='mgr.smithi084.gyasul' 2024-04-26T21:12:49.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:49 smithi084 ceph-mon[25539]: from='mgr.14100 172.21.15.84:0/3261157282' entity='mgr.smithi084.gyasul' 2024-04-26T21:12:49.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:49 smithi084 ceph-mon[25539]: from='mgr.14100 172.21.15.84:0/3261157282' entity='mgr.smithi084.gyasul' 2024-04-26T21:12:51.115 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:50 smithi084 ceph-mon[25539]: mgrmap e3: smithi084.gyasul(active, since 1.01974s) 2024-04-26T21:12:52.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:51 smithi084 ceph-mon[25539]: mgrmap e4: smithi084.gyasul(active, since 2s) 2024-04-26T21:12:52.853 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:52 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3226357691' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T21:12:52.862 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-04-26T21:12:52.863 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-04-26T21:12:52.863 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "8bb44d26-0411-11ef-bc93-c7b262605968", 2024-04-26T21:12:52.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T21:12:52.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T21:12:52.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T21:12:52.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T21:12:52.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:52.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T21:12:52.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T21:12:52.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-04-26T21:12:52.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-04-26T21:12:52.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T21:12:52.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "smithi084" 2024-04-26T21:12:52.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-04-26T21:12:52.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-04-26T21:12:52.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T21:12:52.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T21:12:52.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-26T21:12:52.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T21:12:52.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:52.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T21:12:52.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T21:12:52.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T21:12:52.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T21:12:52.875 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T21:12:52.876 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T21:12:52.876 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T21:12:52.876 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T21:12:52.876 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:52.876 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T21:12:52.876 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T21:12:52.876 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T21:12:52.876 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T21:12:52.876 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T21:12:52.876 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T21:12:52.876 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T21:12:52.876 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T21:12:52.876 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T21:12:52.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:52.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T21:12:52.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T21:12:52.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T21:12:52.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T21:12:52.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:52.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T21:12:52.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T21:12:52.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T21:12:52.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T21:12:52.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T21:12:52.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T21:12:52.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T21:12:52.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-04-26T21:12:52.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T21:12:52.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:52.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T21:12:52.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T21:12:52.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T21:12:29.304688+0000", 2024-04-26T21:12:52.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T21:12:52.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-04-26T21:12:52.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T21:12:52.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-04-26T21:12:52.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.562+0000 7f2ec1600700 1 Processor -- start 2024-04-26T21:12:52.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.562+0000 7f2ec1600700 1 -- start start 2024-04-26T21:12:52.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.563+0000 7f2ec1600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ebc102910 0x7f2ebc102d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:52.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.563+0000 7f2ec1600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc103260 con 0x7f2ebc102910 2024-04-26T21:12:52.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.563+0000 7f2ebaa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ebc102910 0x7f2ebc102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:52.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.563+0000 7f2ebaa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ebc102910 0x7f2ebc102d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39620/0 (socket says 172.21.15.84:39620) 2024-04-26T21:12:52.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.563+0000 7f2ebaa00700 1 -- 172.21.15.84:0/3181661771 learned_addr learned my addr 172.21.15.84:0/3181661771 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:52.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.563+0000 7f2ebaa00700 1 -- 172.21.15.84:0/3181661771 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc1033a0 con 0x7f2ebc102910 2024-04-26T21:12:52.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.564+0000 7f2ebaa00700 1 --2- 172.21.15.84:0/3181661771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ebc102910 0x7f2ebc102d20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0098e0 tx=0x7f2eac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba1a359f35313ab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:52.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.564+0000 7f2eb9600700 1 -- 172.21.15.84:0/3181661771 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2eac00b860 con 0x7f2ebc102910 2024-04-26T21:12:52.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.564+0000 7f2eb9600700 1 -- 172.21.15.84:0/3181661771 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f2eac00be50 con 0x7f2ebc102910 2024-04-26T21:12:52.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.564+0000 7f2eb9600700 1 -- 172.21.15.84:0/3181661771 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2eac010380 con 0x7f2ebc102910 2024-04-26T21:12:52.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.565+0000 7f2ec1600700 1 -- 172.21.15.84:0/3181661771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ebc102910 msgr2=0x7f2ebc102d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:52.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.565+0000 7f2ec1600700 1 --2- 172.21.15.84:0/3181661771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ebc102910 0x7f2ebc102d20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0098e0 tx=0x7f2eac009250 comp rx=0 tx=0).stop 2024-04-26T21:12:52.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.565+0000 7f2ec1600700 1 -- 172.21.15.84:0/3181661771 shutdown_connections 2024-04-26T21:12:52.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.565+0000 7f2ec1600700 1 --2- 172.21.15.84:0/3181661771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ebc102910 0x7f2ebc102d20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:52.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.565+0000 7f2ec1600700 1 -- 172.21.15.84:0/3181661771 >> 172.21.15.84:0/3181661771 conn(0x7f2ebc0fe090 msgr2=0x7f2ebc1004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:52.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.565+0000 7f2ec1600700 1 -- 172.21.15.84:0/3181661771 shutdown_connections 2024-04-26T21:12:52.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.565+0000 7f2ec1600700 1 -- 172.21.15.84:0/3181661771 wait complete. 2024-04-26T21:12:52.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.566+0000 7f2ec1600700 1 Processor -- start 2024-04-26T21:12:52.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.566+0000 7f2ec1600700 1 -- start start 2024-04-26T21:12:52.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.566+0000 7f2ec1600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ebc102910 0x7f2ebc111590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:52.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.566+0000 7f2ec1600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc111ad0 con 0x7f2ebc102910 2024-04-26T21:12:52.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.566+0000 7f2ebaa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ebc102910 0x7f2ebc111590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:52.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.566+0000 7f2ebaa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ebc102910 0x7f2ebc111590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39636/0 (socket says 172.21.15.84:39636) 2024-04-26T21:12:52.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.566+0000 7f2ebaa00700 1 -- 172.21.15.84:0/3226357691 learned_addr learned my addr 172.21.15.84:0/3226357691 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:52.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.567+0000 7f2ebaa00700 1 -- 172.21.15.84:0/3226357691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac0094f0 con 0x7f2ebc102910 2024-04-26T21:12:52.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.567+0000 7f2ebaa00700 1 --2- 172.21.15.84:0/3226357691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ebc102910 0x7f2ebc111590 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2eac000c00 tx=0x7f2eac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:52.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.567+0000 7f2eb2a00700 1 -- 172.21.15.84:0/3226357691 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2eac0107c0 con 0x7f2ebc102910 2024-04-26T21:12:52.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.567+0000 7f2eb2a00700 1 -- 172.21.15.84:0/3226357691 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f2eac010db0 con 0x7f2ebc102910 2024-04-26T21:12:52.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.567+0000 7f2eb2a00700 1 -- 172.21.15.84:0/3226357691 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2eac01ad00 con 0x7f2ebc102910 2024-04-26T21:12:52.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.567+0000 7f2ec1600700 1 -- 172.21.15.84:0/3226357691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ebc111cd0 con 0x7f2ebc102910 2024-04-26T21:12:52.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.567+0000 7f2ec1600700 1 -- 172.21.15.84:0/3226357691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ebc112840 con 0x7f2ebc102910 2024-04-26T21:12:52.881 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.568+0000 7f2eb2a00700 1 -- 172.21.15.84:0/3226357691 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7f2eac010920 con 0x7f2ebc102910 2024-04-26T21:12:52.881 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.569+0000 7f2ec1600700 1 -- 172.21.15.84:0/3226357691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ebc05f5c0 con 0x7f2ebc102910 2024-04-26T21:12:52.881 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.569+0000 7f2eb2a00700 1 --2- 172.21.15.84:0/3226357691 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7f2ea0036850 0x7f2ea0038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:52.881 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.569+0000 7f2eb2a00700 1 -- 172.21.15.84:0/3226357691 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2eac04a5c0 con 0x7f2ebc102910 2024-04-26T21:12:52.881 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.569+0000 7f2eba000700 1 --2- 172.21.15.84:0/3226357691 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7f2ea0036850 0x7f2ea0038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:52.881 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.570+0000 7f2eba000700 1 --2- 172.21.15.84:0/3226357691 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7f2ea0036850 0x7f2ea0038d00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009990 tx=0x7f2ea8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:52.881 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.575+0000 7f2eb2a00700 1 -- 172.21.15.84:0/3226357691 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2eac010bd0 con 0x7f2ebc102910 2024-04-26T21:12:52.881 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.866+0000 7f2ec1600700 1 -- 172.21.15.84:0/3226357691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f2ebc04bed0 con 0x7f2ebc102910 2024-04-26T21:12:52.881 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.866+0000 7f2eb2a00700 1 -- 172.21.15.84:0/3226357691 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f2eac023810 con 0x7f2ebc102910 2024-04-26T21:12:52.881 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.869+0000 7f2ec1600700 1 -- 172.21.15.84:0/3226357691 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7f2ea0036850 msgr2=0x7f2ea0038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:52.881 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.869+0000 7f2ec1600700 1 --2- 172.21.15.84:0/3226357691 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7f2ea0036850 0x7f2ea0038d00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009990 tx=0x7f2ea8006e40 comp rx=0 tx=0).stop 2024-04-26T21:12:52.881 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.869+0000 7f2ec1600700 1 -- 172.21.15.84:0/3226357691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ebc102910 msgr2=0x7f2ebc111590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:52.881 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.869+0000 7f2ec1600700 1 --2- 172.21.15.84:0/3226357691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ebc102910 0x7f2ebc111590 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2eac000c00 tx=0x7f2eac009250 comp rx=0 tx=0).stop 2024-04-26T21:12:52.881 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.870+0000 7f2ec1600700 1 -- 172.21.15.84:0/3226357691 shutdown_connections 2024-04-26T21:12:52.882 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.870+0000 7f2ec1600700 1 --2- 172.21.15.84:0/3226357691 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7f2ea0036850 0x7f2ea0038d00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:52.882 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.870+0000 7f2ec1600700 1 --2- 172.21.15.84:0/3226357691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ebc102910 0x7f2ebc111590 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:52.882 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.870+0000 7f2ec1600700 1 -- 172.21.15.84:0/3226357691 >> 172.21.15.84:0/3226357691 conn(0x7f2ebc0fe090 msgr2=0x7f2ebc0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:52.882 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.870+0000 7f2ec1600700 1 -- 172.21.15.84:0/3226357691 shutdown_connections 2024-04-26T21:12:52.882 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:51.870+0000 7f2ec1600700 1 -- 172.21.15.84:0/3226357691 wait complete. 2024-04-26T21:12:52.882 INFO:teuthology.orchestra.run.smithi084.stdout:mgr is available 2024-04-26T21:12:53.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:53 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1472199867' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-26T21:12:54.344 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-04-26T21:12:54.345 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [global] 2024-04-26T21:12:54.345 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout fsid = 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:12:54.345 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-26T21:12:54.345 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-26T21:12:54.345 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-26T21:12:54.345 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-26T21:12:54.345 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-04-26T21:12:54.345 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-26T21:12:54.345 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-26T21:12:54.349 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-04-26T21:12:54.349 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [osd] 2024-04-26T21:12:54.349 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-26T21:12:54.349 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-26T21:12:54.349 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-26T21:12:54.349 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-26T21:12:54.349 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-26T21:12:54.349 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.474+0000 7fd261400700 1 Processor -- start 2024-04-26T21:12:54.349 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.474+0000 7fd261400700 1 -- start start 2024-04-26T21:12:54.349 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.475+0000 7fd261400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd25c071270 0x7fd25c1054b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:54.349 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.475+0000 7fd261400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c071680 con 0x7fd25c071270 2024-04-26T21:12:54.350 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.475+0000 7fd25a800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd25c071270 0x7fd25c1054b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:54.350 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.476+0000 7fd25a800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd25c071270 0x7fd25c1054b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60996/0 (socket says 172.21.15.84:60996) 2024-04-26T21:12:54.350 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.476+0000 7fd25a800700 1 -- 172.21.15.84:0/606754018 learned_addr learned my addr 172.21.15.84:0/606754018 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:54.350 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.476+0000 7fd25a800700 1 -- 172.21.15.84:0/606754018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25c1059f0 con 0x7fd25c071270 2024-04-26T21:12:54.350 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.476+0000 7fd25a800700 1 --2- 172.21.15.84:0/606754018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd25c071270 0x7fd25c1054b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0098e0 tx=0x7fd24c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17512ea4c8564444 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:54.350 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.477+0000 7fd259400700 1 -- 172.21.15.84:0/606754018 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd24c00b860 con 0x7fd25c071270 2024-04-26T21:12:54.350 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.477+0000 7fd259400700 1 -- 172.21.15.84:0/606754018 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd24c00be50 con 0x7fd25c071270 2024-04-26T21:12:54.350 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.477+0000 7fd259400700 1 -- 172.21.15.84:0/606754018 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd24c010380 con 0x7fd25c071270 2024-04-26T21:12:54.350 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.477+0000 7fd261400700 1 -- 172.21.15.84:0/606754018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd25c071270 msgr2=0x7fd25c1054b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:54.350 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.477+0000 7fd261400700 1 --2- 172.21.15.84:0/606754018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd25c071270 0x7fd25c1054b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0098e0 tx=0x7fd24c009250 comp rx=0 tx=0).stop 2024-04-26T21:12:54.350 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.477+0000 7fd261400700 1 -- 172.21.15.84:0/606754018 shutdown_connections 2024-04-26T21:12:54.350 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.477+0000 7fd261400700 1 --2- 172.21.15.84:0/606754018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd25c071270 0x7fd25c1054b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:54.350 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.477+0000 7fd261400700 1 -- 172.21.15.84:0/606754018 >> 172.21.15.84:0/606754018 conn(0x7fd25c0fcec0 msgr2=0x7fd25c0ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:54.351 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.477+0000 7fd261400700 1 -- 172.21.15.84:0/606754018 shutdown_connections 2024-04-26T21:12:54.351 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.478+0000 7fd261400700 1 -- 172.21.15.84:0/606754018 wait complete. 2024-04-26T21:12:54.351 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.478+0000 7fd261400700 1 Processor -- start 2024-04-26T21:12:54.351 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.479+0000 7fd261400700 1 -- start start 2024-04-26T21:12:54.351 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.479+0000 7fd261400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd25c071270 0x7fd25c102e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:54.351 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.479+0000 7fd261400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c103340 con 0x7fd25c071270 2024-04-26T21:12:54.351 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.479+0000 7fd25a800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd25c071270 0x7fd25c102e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:54.351 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.479+0000 7fd25a800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd25c071270 0x7fd25c102e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32770/0 (socket says 172.21.15.84:32770) 2024-04-26T21:12:54.354 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.479+0000 7fd25a800700 1 -- 172.21.15.84:0/1472199867 learned_addr learned my addr 172.21.15.84:0/1472199867 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:54.354 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.479+0000 7fd25a800700 1 -- 172.21.15.84:0/1472199867 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c0094f0 con 0x7fd25c071270 2024-04-26T21:12:54.354 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.480+0000 7fd25a800700 1 --2- 172.21.15.84:0/1472199867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd25c071270 0x7fd25c102e00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd24c006b00 tx=0x7fd24c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:54.354 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.480+0000 7fd252a00700 1 -- 172.21.15.84:0/1472199867 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd24c0107c0 con 0x7fd25c071270 2024-04-26T21:12:54.354 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.480+0000 7fd252a00700 1 -- 172.21.15.84:0/1472199867 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd24c010db0 con 0x7fd25c071270 2024-04-26T21:12:54.354 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.480+0000 7fd261400700 1 -- 172.21.15.84:0/1472199867 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25c1013b0 con 0x7fd25c071270 2024-04-26T21:12:54.354 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.480+0000 7fd252a00700 1 -- 172.21.15.84:0/1472199867 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd24c024cd0 con 0x7fd25c071270 2024-04-26T21:12:54.354 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.480+0000 7fd261400700 1 -- 172.21.15.84:0/1472199867 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25c1018a0 con 0x7fd25c071270 2024-04-26T21:12:54.355 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.481+0000 7fd252a00700 1 -- 172.21.15.84:0/1472199867 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7fd24c01a430 con 0x7fd25c071270 2024-04-26T21:12:54.355 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.481+0000 7fd261400700 1 -- 172.21.15.84:0/1472199867 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd25c04bed0 con 0x7fd25c071270 2024-04-26T21:12:54.355 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.481+0000 7fd252a00700 1 --2- 172.21.15.84:0/1472199867 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7fd240036850 0x7fd240038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:54.355 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.482+0000 7fd252a00700 1 -- 172.21.15.84:0/1472199867 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd24c04a4b0 con 0x7fd25c071270 2024-04-26T21:12:54.355 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.482+0000 7fd259e00700 1 --2- 172.21.15.84:0/1472199867 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7fd240036850 0x7fd240038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:54.355 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.482+0000 7fd259e00700 1 --2- 172.21.15.84:0/1472199867 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7fd240036850 0x7fd240038d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd248009990 tx=0x7fd248006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:54.355 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.487+0000 7fd252a00700 1 -- 172.21.15.84:0/1472199867 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd24c024540 con 0x7fd25c071270 2024-04-26T21:12:54.355 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.680+0000 7fd261400700 1 -- 172.21.15.84:0/1472199867 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fd25c101d20 con 0x7fd25c071270 2024-04-26T21:12:54.355 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.682+0000 7fd252a00700 1 -- 172.21.15.84:0/1472199867 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fd24c0233a0 con 0x7fd25c071270 2024-04-26T21:12:54.355 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.685+0000 7fd261400700 1 -- 172.21.15.84:0/1472199867 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7fd240036850 msgr2=0x7fd240038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:54.355 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.685+0000 7fd261400700 1 --2- 172.21.15.84:0/1472199867 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7fd240036850 0x7fd240038d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd248009990 tx=0x7fd248006e40 comp rx=0 tx=0).stop 2024-04-26T21:12:54.355 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.685+0000 7fd261400700 1 -- 172.21.15.84:0/1472199867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd25c071270 msgr2=0x7fd25c102e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:54.355 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.685+0000 7fd261400700 1 --2- 172.21.15.84:0/1472199867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd25c071270 0x7fd25c102e00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd24c006b00 tx=0x7fd24c009250 comp rx=0 tx=0).stop 2024-04-26T21:12:54.355 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.685+0000 7fd261400700 1 -- 172.21.15.84:0/1472199867 shutdown_connections 2024-04-26T21:12:54.356 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.685+0000 7fd261400700 1 --2- 172.21.15.84:0/1472199867 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7fd240036850 0x7fd240038d00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:54.356 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.685+0000 7fd261400700 1 --2- 172.21.15.84:0/1472199867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd25c071270 0x7fd25c102e00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:54.356 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.685+0000 7fd261400700 1 -- 172.21.15.84:0/1472199867 >> 172.21.15.84:0/1472199867 conn(0x7fd25c0fcec0 msgr2=0x7fd25c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:54.356 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.685+0000 7fd261400700 1 -- 172.21.15.84:0/1472199867 shutdown_connections 2024-04-26T21:12:54.356 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:53.685+0000 7fd261400700 1 -- 172.21.15.84:0/1472199867 wait complete. 2024-04-26T21:12:54.356 INFO:teuthology.orchestra.run.smithi084.stdout:Enabling cephadm module... 2024-04-26T21:12:55.565 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:55 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3709245217' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-26T21:12:56.034 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.952+0000 7f6251200700 1 Processor -- start 2024-04-26T21:12:56.034 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.952+0000 7f6251200700 1 -- start start 2024-04-26T21:12:56.034 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.953+0000 7f6251200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f624c07cf60 0x7f624c10bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:56.034 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.953+0000 7f6251200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c07d400 con 0x7f624c07cf60 2024-04-26T21:12:56.034 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.953+0000 7f6249e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f624c07cf60 0x7f624c10bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:56.034 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.953+0000 7f6249e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f624c07cf60 0x7f624c10bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32778/0 (socket says 172.21.15.84:32778) 2024-04-26T21:12:56.034 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.953+0000 7f6249e00700 1 -- 172.21.15.84:0/4198569712 learned_addr learned my addr 172.21.15.84:0/4198569712 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:56.034 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.954+0000 7f6249e00700 1 -- 172.21.15.84:0/4198569712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c07d540 con 0x7f624c07cf60 2024-04-26T21:12:56.034 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.954+0000 7f6249e00700 1 --2- 172.21.15.84:0/4198569712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f624c07cf60 0x7f624c10bcb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f623c0098e0 tx=0x7f623c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0c7c452b51ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:56.035 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.954+0000 7f6248a00700 1 -- 172.21.15.84:0/4198569712 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f623c00b860 con 0x7f624c07cf60 2024-04-26T21:12:56.035 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.954+0000 7f6248a00700 1 -- 172.21.15.84:0/4198569712 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f623c00be50 con 0x7f624c07cf60 2024-04-26T21:12:56.035 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.954+0000 7f6248a00700 1 -- 172.21.15.84:0/4198569712 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f623c010380 con 0x7f624c07cf60 2024-04-26T21:12:56.035 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.955+0000 7f6251200700 1 -- 172.21.15.84:0/4198569712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f624c07cf60 msgr2=0x7f624c10bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:56.035 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.955+0000 7f6251200700 1 --2- 172.21.15.84:0/4198569712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f624c07cf60 0x7f624c10bcb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f623c0098e0 tx=0x7f623c009250 comp rx=0 tx=0).stop 2024-04-26T21:12:56.035 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.955+0000 7f6251200700 1 -- 172.21.15.84:0/4198569712 shutdown_connections 2024-04-26T21:12:56.035 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.955+0000 7f6251200700 1 --2- 172.21.15.84:0/4198569712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f624c07cf60 0x7f624c10bcb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:56.035 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.955+0000 7f6251200700 1 -- 172.21.15.84:0/4198569712 >> 172.21.15.84:0/4198569712 conn(0x7f624c078300 msgr2=0x7f624c07a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:56.035 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.955+0000 7f6251200700 1 -- 172.21.15.84:0/4198569712 shutdown_connections 2024-04-26T21:12:56.035 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.955+0000 7f6251200700 1 -- 172.21.15.84:0/4198569712 wait complete. 2024-04-26T21:12:56.035 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.956+0000 7f6251200700 1 Processor -- start 2024-04-26T21:12:56.035 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.956+0000 7f6251200700 1 -- start start 2024-04-26T21:12:56.035 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.957+0000 7f6251200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f624c07cf60 0x7f624c117be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:56.035 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.957+0000 7f6251200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c118120 con 0x7f624c07cf60 2024-04-26T21:12:56.036 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.957+0000 7f6249e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f624c07cf60 0x7f624c117be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:56.036 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.957+0000 7f6249e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f624c07cf60 0x7f624c117be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32788/0 (socket says 172.21.15.84:32788) 2024-04-26T21:12:56.036 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.957+0000 7f6249e00700 1 -- 172.21.15.84:0/3709245217 learned_addr learned my addr 172.21.15.84:0/3709245217 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:56.036 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.957+0000 7f6249e00700 1 -- 172.21.15.84:0/3709245217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623c0094f0 con 0x7f624c07cf60 2024-04-26T21:12:56.036 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.958+0000 7f6249e00700 1 --2- 172.21.15.84:0/3709245217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f624c07cf60 0x7f624c117be0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f623c006b00 tx=0x7f623c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:56.036 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.958+0000 7f6242000700 1 -- 172.21.15.84:0/3709245217 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f623c0107c0 con 0x7f624c07cf60 2024-04-26T21:12:56.036 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.958+0000 7f6242000700 1 -- 172.21.15.84:0/3709245217 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f623c010db0 con 0x7f624c07cf60 2024-04-26T21:12:56.036 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.958+0000 7f6251200700 1 -- 172.21.15.84:0/3709245217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624c118320 con 0x7f624c07cf60 2024-04-26T21:12:56.036 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.958+0000 7f6242000700 1 -- 172.21.15.84:0/3709245217 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f623c024cd0 con 0x7f624c07cf60 2024-04-26T21:12:56.036 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.958+0000 7f6251200700 1 -- 172.21.15.84:0/3709245217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624c118e90 con 0x7f624c07cf60 2024-04-26T21:12:56.036 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.959+0000 7f6242000700 1 -- 172.21.15.84:0/3709245217 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7f623c01a430 con 0x7f624c07cf60 2024-04-26T21:12:56.036 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.959+0000 7f6251200700 1 -- 172.21.15.84:0/3709245217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624c05f5c0 con 0x7f624c07cf60 2024-04-26T21:12:56.036 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.960+0000 7f6242000700 1 --2- 172.21.15.84:0/3709245217 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7f6230036850 0x7f6230038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:56.036 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.960+0000 7f6242000700 1 -- 172.21.15.84:0/3709245217 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f623c04a500 con 0x7f624c07cf60 2024-04-26T21:12:56.037 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.960+0000 7f6249400700 1 --2- 172.21.15.84:0/3709245217 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7f6230036850 0x7f6230038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:56.037 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.961+0000 7f6249400700 1 --2- 172.21.15.84:0/3709245217 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7f6230036850 0x7f6230038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6238009990 tx=0x7f6238006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:56.037 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:54.965+0000 7f6242000700 1 -- 172.21.15.84:0/3709245217 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f623c024540 con 0x7f624c07cf60 2024-04-26T21:12:56.037 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:55.233+0000 7f6251200700 1 -- 172.21.15.84:0/3709245217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f624c04bed0 con 0x7f624c07cf60 2024-04-26T21:12:56.037 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:55.289+0000 7f6242000700 1 -- 172.21.15.84:0/3709245217 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f623c017db0 con 0x7f624c07cf60 2024-04-26T21:12:56.037 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:55.292+0000 7f6242000700 1 -- 172.21.15.84:0/3709245217 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f623c04cca0 con 0x7f624c07cf60 2024-04-26T21:12:56.037 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:55.295+0000 7f6251200700 1 -- 172.21.15.84:0/3709245217 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7f6230036850 msgr2=0x7f6230038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:56.037 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:55.295+0000 7f6251200700 1 --2- 172.21.15.84:0/3709245217 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7f6230036850 0x7f6230038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6238009990 tx=0x7f6238006e40 comp rx=0 tx=0).stop 2024-04-26T21:12:56.037 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:55.295+0000 7f6251200700 1 -- 172.21.15.84:0/3709245217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f624c07cf60 msgr2=0x7f624c117be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:56.037 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:55.295+0000 7f6251200700 1 --2- 172.21.15.84:0/3709245217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f624c07cf60 0x7f624c117be0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f623c006b00 tx=0x7f623c009250 comp rx=0 tx=0).stop 2024-04-26T21:12:56.037 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:55.295+0000 7f6251200700 1 -- 172.21.15.84:0/3709245217 shutdown_connections 2024-04-26T21:12:56.037 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:55.295+0000 7f6251200700 1 --2- 172.21.15.84:0/3709245217 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7f6230036850 0x7f6230038d00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:56.037 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:55.295+0000 7f6251200700 1 --2- 172.21.15.84:0/3709245217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f624c07cf60 0x7f624c117be0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:56.038 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:55.295+0000 7f6251200700 1 -- 172.21.15.84:0/3709245217 >> 172.21.15.84:0/3709245217 conn(0x7f624c078300 msgr2=0x7f624c079e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:56.038 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:55.296+0000 7f6251200700 1 -- 172.21.15.84:0/3709245217 shutdown_connections 2024-04-26T21:12:56.038 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:55.296+0000 7f6251200700 1 -- 172.21.15.84:0/3709245217 wait complete. 2024-04-26T21:12:56.468 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:56 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3709245217' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-26T21:12:56.468 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:56 smithi084 ceph-mon[25539]: mgrmap e5: smithi084.gyasul(active, since 6s) 2024-04-26T21:12:57.636 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:12:57 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1657645488' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-26T21:12:57.654 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-04-26T21:12:57.654 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-26T21:12:57.654 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T21:12:57.654 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "active_name": "smithi084.gyasul", 2024-04-26T21:12:57.654 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-26T21:12:57.654 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-04-26T21:12:57.654 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.612+0000 7f13be400700 1 Processor -- start 2024-04-26T21:12:57.654 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.612+0000 7f13be400700 1 -- start start 2024-04-26T21:12:57.654 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.612+0000 7f13be400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b81026b0 0x7f13b8102ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:57.654 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.612+0000 7f13be400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b8103000 con 0x7f13b81026b0 2024-04-26T21:12:57.655 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.612+0000 7f13bd000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b81026b0 0x7f13b8102ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:57.655 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.612+0000 7f13bd000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b81026b0 0x7f13b8102ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32816/0 (socket says 172.21.15.84:32816) 2024-04-26T21:12:57.655 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.613+0000 7f13bd000700 1 -- 172.21.15.84:0/653424666 learned_addr learned my addr 172.21.15.84:0/653424666 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:57.655 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.613+0000 7f13bd000700 1 -- 172.21.15.84:0/653424666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b8103140 con 0x7f13b81026b0 2024-04-26T21:12:57.655 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.613+0000 7f13bd000700 1 --2- 172.21.15.84:0/653424666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b81026b0 0x7f13b8102ac0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009e50 tx=0x7f13ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=259f4dac64cc219b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:57.655 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.613+0000 7f13b7400700 1 -- 172.21.15.84:0/653424666 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13ac0092e0 con 0x7f13b81026b0 2024-04-26T21:12:57.655 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.614+0000 7f13b7400700 1 -- 172.21.15.84:0/653424666 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f13ac012430 con 0x7f13b81026b0 2024-04-26T21:12:57.655 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.614+0000 7f13b7400700 1 -- 172.21.15.84:0/653424666 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13ac0075c0 con 0x7f13b81026b0 2024-04-26T21:12:57.655 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.614+0000 7f13be400700 1 -- 172.21.15.84:0/653424666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b81026b0 msgr2=0x7f13b8102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:57.655 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.614+0000 7f13be400700 1 --2- 172.21.15.84:0/653424666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b81026b0 0x7f13b8102ac0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009e50 tx=0x7f13ac009840 comp rx=0 tx=0).stop 2024-04-26T21:12:57.655 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.615+0000 7f13be400700 1 -- 172.21.15.84:0/653424666 shutdown_connections 2024-04-26T21:12:57.655 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.615+0000 7f13be400700 1 --2- 172.21.15.84:0/653424666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b81026b0 0x7f13b8102ac0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:57.655 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.615+0000 7f13be400700 1 -- 172.21.15.84:0/653424666 >> 172.21.15.84:0/653424666 conn(0x7f13b80fde90 msgr2=0x7f13b81002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:57.655 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.615+0000 7f13be400700 1 -- 172.21.15.84:0/653424666 shutdown_connections 2024-04-26T21:12:57.655 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.615+0000 7f13be400700 1 -- 172.21.15.84:0/653424666 wait complete. 2024-04-26T21:12:57.656 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.615+0000 7f13be400700 1 Processor -- start 2024-04-26T21:12:57.656 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.616+0000 7f13be400700 1 -- start start 2024-04-26T21:12:57.656 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.616+0000 7f13be400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b81026b0 0x7f13b8113620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:57.656 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.616+0000 7f13be400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b8113b60 con 0x7f13b81026b0 2024-04-26T21:12:57.656 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.616+0000 7f13bd000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b81026b0 0x7f13b8113620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:57.656 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.616+0000 7f13bd000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b81026b0 0x7f13b8113620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32828/0 (socket says 172.21.15.84:32828) 2024-04-26T21:12:57.656 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.616+0000 7f13bd000700 1 -- 172.21.15.84:0/1657645488 learned_addr learned my addr 172.21.15.84:0/1657645488 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:12:57.656 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.617+0000 7f13bd000700 1 -- 172.21.15.84:0/1657645488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac009ae0 con 0x7f13b81026b0 2024-04-26T21:12:57.656 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.617+0000 7f13bd000700 1 --2- 172.21.15.84:0/1657645488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b81026b0 0x7f13b8113620 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009fd0 tx=0x7f13ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:57.656 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.617+0000 7f13b4c00700 1 -- 172.21.15.84:0/1657645488 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13ac0092e0 con 0x7f13b81026b0 2024-04-26T21:12:57.656 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.617+0000 7f13b4c00700 1 -- 172.21.15.84:0/1657645488 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f13ac007cc0 con 0x7f13b81026b0 2024-04-26T21:12:57.656 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.617+0000 7f13b4c00700 1 -- 172.21.15.84:0/1657645488 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13ac01c9a0 con 0x7f13b81026b0 2024-04-26T21:12:57.656 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.617+0000 7f13be400700 1 -- 172.21.15.84:0/1657645488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b8113d60 con 0x7f13b81026b0 2024-04-26T21:12:57.656 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.617+0000 7f13be400700 1 -- 172.21.15.84:0/1657645488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b81148d0 con 0x7f13b81026b0 2024-04-26T21:12:57.656 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.618+0000 7f13be400700 1 -- 172.21.15.84:0/1657645488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b805f5c0 con 0x7f13b81026b0 2024-04-26T21:12:57.657 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.619+0000 7f13b4c00700 1 -- 172.21.15.84:0/1657645488 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f13ac019070 con 0x7f13b81026b0 2024-04-26T21:12:57.657 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.619+0000 7f13b4c00700 1 --2- 172.21.15.84:0/1657645488 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7f13a00368a0 0x7f13a0038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:57.657 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.619+0000 7f13b4c00700 1 -- 172.21.15.84:0/1657645488 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f13ac049d40 con 0x7f13b81026b0 2024-04-26T21:12:57.657 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.619+0000 7f13b7e00700 1 -- 172.21.15.84:0/1657645488 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7f13a00368a0 msgr2=0x7f13a0038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/3231603698 2024-04-26T21:12:57.657 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.619+0000 7f13b7e00700 1 --2- 172.21.15.84:0/1657645488 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7f13a00368a0 0x7f13a0038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T21:12:57.657 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.624+0000 7f13b4c00700 1 -- 172.21.15.84:0/1657645488 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f13ac050080 con 0x7f13b81026b0 2024-04-26T21:12:57.657 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.820+0000 7f13b7e00700 1 -- 172.21.15.84:0/1657645488 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7f13a00368a0 msgr2=0x7f13a0038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/3231603698 2024-04-26T21:12:57.657 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.820+0000 7f13b7e00700 1 --2- 172.21.15.84:0/1657645488 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7f13a00368a0 0x7f13a0038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T21:12:57.657 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.889+0000 7f13be400700 1 -- 172.21.15.84:0/1657645488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f13b8114c70 con 0x7f13b81026b0 2024-04-26T21:12:57.657 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.889+0000 7f13b4c00700 1 -- 172.21.15.84:0/1657645488 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f13ac017080 con 0x7f13b81026b0 2024-04-26T21:12:57.657 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.893+0000 7f13be400700 1 -- 172.21.15.84:0/1657645488 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7f13a00368a0 msgr2=0x7f13a0038d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T21:12:57.657 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.893+0000 7f13be400700 1 --2- 172.21.15.84:0/1657645488 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7f13a00368a0 0x7f13a0038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:57.658 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.893+0000 7f13be400700 1 -- 172.21.15.84:0/1657645488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b81026b0 msgr2=0x7f13b8113620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:57.658 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.893+0000 7f13be400700 1 --2- 172.21.15.84:0/1657645488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b81026b0 0x7f13b8113620 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009fd0 tx=0x7f13ac009840 comp rx=0 tx=0).stop 2024-04-26T21:12:57.658 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.893+0000 7f13be400700 1 -- 172.21.15.84:0/1657645488 shutdown_connections 2024-04-26T21:12:57.658 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.893+0000 7f13be400700 1 --2- 172.21.15.84:0/1657645488 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7f13a00368a0 0x7f13a0038d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:57.658 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.893+0000 7f13be400700 1 --2- 172.21.15.84:0/1657645488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13b81026b0 0x7f13b8113620 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:57.658 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.893+0000 7f13be400700 1 -- 172.21.15.84:0/1657645488 >> 172.21.15.84:0/1657645488 conn(0x7f13b80fde90 msgr2=0x7f13b80fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:57.658 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.893+0000 7f13be400700 1 -- 172.21.15.84:0/1657645488 shutdown_connections 2024-04-26T21:12:57.658 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:56.893+0000 7f13be400700 1 -- 172.21.15.84:0/1657645488 wait complete. 2024-04-26T21:12:57.658 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for the mgr to restart... 2024-04-26T21:12:57.658 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr epoch 5... 2024-04-26T21:13:03.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:03 smithi084 ceph-mon[25539]: Active manager daemon smithi084.gyasul restarted 2024-04-26T21:13:03.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:03 smithi084 ceph-mon[25539]: Activating manager daemon smithi084.gyasul 2024-04-26T21:13:03.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:03 smithi084 ceph-mon[25539]: osdmap e2: 0 total, 0 up, 0 in 2024-04-26T21:13:03.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:03 smithi084 ceph-mon[25539]: mgrmap e6: smithi084.gyasul(active, starting, since 0.0048467s) 2024-04-26T21:13:03.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:03 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-04-26T21:13:03.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:03 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr metadata", "who": "smithi084.gyasul", "id": "smithi084.gyasul"}]: dispatch 2024-04-26T21:13:03.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:03 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T21:13:03.914 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:03 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T21:13:03.914 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:03 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T21:13:03.914 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:03 smithi084 ceph-mon[25539]: Manager daemon smithi084.gyasul is now available 2024-04-26T21:13:03.914 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:03 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:03.914 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:03 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:04.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:04 smithi084 ceph-mon[25539]: Found migration_current of "None". Setting to last migration. 2024-04-26T21:13:04.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:04 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:13:04.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:04 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:13:04.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:04 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:13:04.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:04 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.gyasul/mirror_snapshot_schedule"}]: dispatch 2024-04-26T21:13:04.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:04 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.gyasul/trash_purge_schedule"}]: dispatch 2024-04-26T21:13:04.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:04 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:04.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:04 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:13:04.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:04 smithi084 ceph-mon[25539]: mgrmap e7: smithi084.gyasul(active, since 1.01657s) 2024-04-26T21:13:05.376 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-04-26T21:13:05.376 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-26T21:13:05.376 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-26T21:13:05.376 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-04-26T21:13:05.376 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.300+0000 7f000be00700 1 Processor -- start 2024-04-26T21:13:05.376 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.301+0000 7f000be00700 1 -- start start 2024-04-26T21:13:05.376 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.301+0000 7f000be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0004077b90 0x7f0004076140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:05.377 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.301+0000 7f000be00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0004077fa0 con 0x7f0004077b90 2024-04-26T21:13:05.377 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.301+0000 7f0009400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0004077b90 0x7f0004076140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:05.377 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.302+0000 7f0009400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0004077b90 0x7f0004076140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32836/0 (socket says 172.21.15.84:32836) 2024-04-26T21:13:05.377 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.302+0000 7f0009400700 1 -- 172.21.15.84:0/56250312 learned_addr learned my addr 172.21.15.84:0/56250312 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:05.377 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.302+0000 7f0009400700 1 -- 172.21.15.84:0/56250312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0004076680 con 0x7f0004077b90 2024-04-26T21:13:05.377 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.302+0000 7f0009400700 1 --2- 172.21.15.84:0/56250312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0004077b90 0x7f0004076140 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efff80098e0 tx=0x7efff8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9892edf14a3dc45b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:05.377 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.302+0000 7f0003e00700 1 -- 172.21.15.84:0/56250312 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efff800b860 con 0x7f0004077b90 2024-04-26T21:13:05.377 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.302+0000 7f0003e00700 1 -- 172.21.15.84:0/56250312 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7efff800be50 con 0x7f0004077b90 2024-04-26T21:13:05.377 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.302+0000 7f0003e00700 1 -- 172.21.15.84:0/56250312 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efff8010380 con 0x7f0004077b90 2024-04-26T21:13:05.377 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.303+0000 7f000be00700 1 -- 172.21.15.84:0/56250312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0004077b90 msgr2=0x7f0004076140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:05.377 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.303+0000 7f000be00700 1 --2- 172.21.15.84:0/56250312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0004077b90 0x7f0004076140 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efff80098e0 tx=0x7efff8009250 comp rx=0 tx=0).stop 2024-04-26T21:13:05.377 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.303+0000 7f000be00700 1 -- 172.21.15.84:0/56250312 shutdown_connections 2024-04-26T21:13:05.377 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.303+0000 7f000be00700 1 --2- 172.21.15.84:0/56250312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0004077b90 0x7f0004076140 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:05.378 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.303+0000 7f000be00700 1 -- 172.21.15.84:0/56250312 >> 172.21.15.84:0/56250312 conn(0x7f00040fdf90 msgr2=0x7f0004100400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:05.378 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.303+0000 7f000be00700 1 -- 172.21.15.84:0/56250312 shutdown_connections 2024-04-26T21:13:05.378 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.304+0000 7f000be00700 1 -- 172.21.15.84:0/56250312 wait complete. 2024-04-26T21:13:05.378 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.305+0000 7f000be00700 1 Processor -- start 2024-04-26T21:13:05.378 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.305+0000 7f000be00700 1 -- start start 2024-04-26T21:13:05.378 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.305+0000 7f000be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0004077b90 0x7f0004113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:05.378 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.305+0000 7f000be00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0004113d80 con 0x7f0004077b90 2024-04-26T21:13:05.378 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.306+0000 7f0009400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0004077b90 0x7f0004113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:05.378 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.306+0000 7f0009400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0004077b90 0x7f0004113840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32850/0 (socket says 172.21.15.84:32850) 2024-04-26T21:13:05.378 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.306+0000 7f0009400700 1 -- 172.21.15.84:0/2372458383 learned_addr learned my addr 172.21.15.84:0/2372458383 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:05.378 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.306+0000 7f0009400700 1 -- 172.21.15.84:0/2372458383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff80094f0 con 0x7f0004077b90 2024-04-26T21:13:05.378 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.306+0000 7f0009400700 1 --2- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0004077b90 0x7f0004113840 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efff8006fd0 tx=0x7efff8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:05.378 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.306+0000 7f0001600700 1 -- 172.21.15.84:0/2372458383 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efff80107c0 con 0x7f0004077b90 2024-04-26T21:13:05.378 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.306+0000 7f0001600700 1 -- 172.21.15.84:0/2372458383 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7efff8010db0 con 0x7f0004077b90 2024-04-26T21:13:05.379 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.306+0000 7f000be00700 1 -- 172.21.15.84:0/2372458383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0004113f80 con 0x7f0004077b90 2024-04-26T21:13:05.379 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.307+0000 7f0001600700 1 -- 172.21.15.84:0/2372458383 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efff801ada0 con 0x7f0004077b90 2024-04-26T21:13:05.379 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.308+0000 7f000be00700 1 -- 172.21.15.84:0/2372458383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0004114af0 con 0x7f0004077b90 2024-04-26T21:13:05.379 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.308+0000 7f0001600700 1 -- 172.21.15.84:0/2372458383 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7efff8010920 con 0x7f0004077b90 2024-04-26T21:13:05.379 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.309+0000 7f0001600700 1 --2- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7effec0368a0 0x7effec038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:05.379 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.309+0000 7f0001600700 1 -- 172.21.15.84:0/2372458383 --> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7effec039460 con 0x7effec0368a0 2024-04-26T21:13:05.379 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.309+0000 7f0001600700 1 -- 172.21.15.84:0/2372458383 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7efff8049610 con 0x7f0004077b90 2024-04-26T21:13:05.379 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.309+0000 7f0008a00700 1 -- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7effec0368a0 msgr2=0x7effec038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/3231603698 2024-04-26T21:13:05.379 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.309+0000 7f0008a00700 1 --2- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7effec0368a0 0x7effec038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T21:13:05.379 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.510+0000 7f0008a00700 1 -- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7effec0368a0 msgr2=0x7effec038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/3231603698 2024-04-26T21:13:05.379 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.510+0000 7f0008a00700 1 --2- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7effec0368a0 0x7effec038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T21:13:05.379 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.911+0000 7f0008a00700 1 -- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7effec0368a0 msgr2=0x7effec038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/3231603698 2024-04-26T21:13:05.379 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:58.911+0000 7f0008a00700 1 --2- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7effec0368a0 0x7effec038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T21:13:05.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:59.712+0000 7f0008a00700 1 -- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7effec0368a0 msgr2=0x7effec038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/3231603698 2024-04-26T21:13:05.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:12:59.712+0000 7f0008a00700 1 --2- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7effec0368a0 0x7effec038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T21:13:05.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:01.314+0000 7f0008a00700 1 -- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7effec0368a0 msgr2=0x7effec038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/3231603698 2024-04-26T21:13:05.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:01.314+0000 7f0008a00700 1 --2- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7effec0368a0 0x7effec038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-26T21:13:05.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:03.645+0000 7f0001600700 1 -- 172.21.15.84:0/2372458383 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mgrmap(e 6) v1 ==== 43143+0+0 (secure 0 0 0) 0x7efff8024780 con 0x7f0004077b90 2024-04-26T21:13:05.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:03.645+0000 7f0001600700 1 -- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7effec0368a0 msgr2=0x7effec038d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T21:13:05.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:03.645+0000 7f0001600700 1 --2- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7effec0368a0 0x7effec038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:05.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:04.651+0000 7f0001600700 1 -- 172.21.15.84:0/2372458383 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 7) v1 ==== 43270+0+0 (secure 0 0 0) 0x7efff8022310 con 0x7f0004077b90 2024-04-26T21:13:05.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:04.652+0000 7f0001600700 1 --2- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7effec039ff0 0x7effec03c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:05.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:04.652+0000 7f0001600700 1 -- 172.21.15.84:0/2372458383 --> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7effec039460 con 0x7effec039ff0 2024-04-26T21:13:05.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:04.653+0000 7f0008a00700 1 --2- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7effec039ff0 0x7effec03c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:05.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:04.658+0000 7f0008a00700 1 --2- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7effec039ff0 0x7effec03c3d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7efff00039d0 tx=0x7efff0009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:05.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:04.660+0000 7f0001600700 1 -- 172.21.15.84:0/2372458383 <== mgr.14120 v2:172.21.15.84:6800/2151160823 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7effec039460 con 0x7effec039ff0 2024-04-26T21:13:05.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:04.667+0000 7f000be00700 1 -- 172.21.15.84:0/2372458383 --> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f0004114410 con 0x7effec039ff0 2024-04-26T21:13:05.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:04.668+0000 7f0001600700 1 -- 172.21.15.84:0/2372458383 <== mgr.14120 v2:172.21.15.84:6800/2151160823 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f0004114410 con 0x7effec039ff0 2024-04-26T21:13:05.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:04.668+0000 7f000be00700 1 -- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7effec039ff0 msgr2=0x7effec03c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:05.381 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:04.668+0000 7f000be00700 1 --2- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7effec039ff0 0x7effec03c3d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7efff00039d0 tx=0x7efff0009350 comp rx=0 tx=0).stop 2024-04-26T21:13:05.381 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:04.668+0000 7f000be00700 1 -- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0004077b90 msgr2=0x7f0004113840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:05.381 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:04.668+0000 7f000be00700 1 --2- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0004077b90 0x7f0004113840 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efff8006fd0 tx=0x7efff8009250 comp rx=0 tx=0).stop 2024-04-26T21:13:05.381 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:04.669+0000 7f000be00700 1 -- 172.21.15.84:0/2372458383 shutdown_connections 2024-04-26T21:13:05.381 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:04.669+0000 7f000be00700 1 --2- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7effec039ff0 0x7effec03c3d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:05.381 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:04.669+0000 7f000be00700 1 --2- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0004077b90 0x7f0004113840 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:05.381 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:04.669+0000 7f000be00700 1 --2- 172.21.15.84:0/2372458383 >> [v2:172.21.15.84:6800/3231603698,v1:172.21.15.84:6801/3231603698] conn(0x7effec0368a0 0x7effec038d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:05.381 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:04.669+0000 7f000be00700 1 -- 172.21.15.84:0/2372458383 >> 172.21.15.84:0/2372458383 conn(0x7f00040fdf90 msgr2=0x7f00040feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:05.381 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:04.669+0000 7f000be00700 1 -- 172.21.15.84:0/2372458383 shutdown_connections 2024-04-26T21:13:05.381 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:04.669+0000 7f000be00700 1 -- 172.21.15.84:0/2372458383 wait complete. 2024-04-26T21:13:05.381 INFO:teuthology.orchestra.run.smithi084.stdout:mgr epoch 5 is available 2024-04-26T21:13:05.381 INFO:teuthology.orchestra.run.smithi084.stdout:Setting orchestrator backend to cephadm... 2024-04-26T21:13:05.987 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:05 smithi084 ceph-mon[25539]: [26/Apr/2024:21:13:04] ENGINE Bus STARTING 2024-04-26T21:13:05.987 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:05 smithi084 ceph-mon[25539]: [26/Apr/2024:21:13:04] ENGINE Serving on https://172.21.15.84:7150 2024-04-26T21:13:05.987 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:05 smithi084 ceph-mon[25539]: [26/Apr/2024:21:13:04] ENGINE Bus STARTED 2024-04-26T21:13:05.987 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:05 smithi084 ceph-mon[25539]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-26T21:13:05.987 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:05 smithi084 ceph-mon[25539]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-26T21:13:06.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:06 smithi084 ceph-mon[25539]: mgrmap e8: smithi084.gyasul(active, since 2s) 2024-04-26T21:13:06.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:06 smithi084 ceph-mon[25539]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:06.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:06 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:06.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:06 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:13:06.977 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.986+0000 7fd6ed600700 1 Processor -- start 2024-04-26T21:13:06.977 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.986+0000 7fd6ed600700 1 -- start start 2024-04-26T21:13:06.977 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.986+0000 7fd6ed600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e807cf60 0x7fd6e810bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:06.977 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.986+0000 7fd6ed600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e807d400 con 0x7fd6e807cf60 2024-04-26T21:13:06.977 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.987+0000 7fd6e6a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e807cf60 0x7fd6e810bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:06.977 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.987+0000 7fd6e6a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e807cf60 0x7fd6e810bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46686/0 (socket says 172.21.15.84:46686) 2024-04-26T21:13:06.977 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.987+0000 7fd6e6a00700 1 -- 172.21.15.84:0/3294288063 learned_addr learned my addr 172.21.15.84:0/3294288063 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:06.977 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.987+0000 7fd6e6a00700 1 -- 172.21.15.84:0/3294288063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e807d540 con 0x7fd6e807cf60 2024-04-26T21:13:06.977 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.988+0000 7fd6e6a00700 1 --2- 172.21.15.84:0/3294288063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e807cf60 0x7fd6e810bcb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80098e0 tx=0x7fd6d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09ea05199e6be01 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:06.978 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.988+0000 7fd6e6000700 1 -- 172.21.15.84:0/3294288063 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6d800b860 con 0x7fd6e807cf60 2024-04-26T21:13:06.978 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.988+0000 7fd6e6000700 1 -- 172.21.15.84:0/3294288063 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd6d800be50 con 0x7fd6e807cf60 2024-04-26T21:13:06.978 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.988+0000 7fd6e6000700 1 -- 172.21.15.84:0/3294288063 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6d8010380 con 0x7fd6e807cf60 2024-04-26T21:13:06.978 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.989+0000 7fd6ed600700 1 -- 172.21.15.84:0/3294288063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e807cf60 msgr2=0x7fd6e810bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:06.978 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.989+0000 7fd6ed600700 1 --2- 172.21.15.84:0/3294288063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e807cf60 0x7fd6e810bcb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80098e0 tx=0x7fd6d8009250 comp rx=0 tx=0).stop 2024-04-26T21:13:06.978 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.989+0000 7fd6ed600700 1 -- 172.21.15.84:0/3294288063 shutdown_connections 2024-04-26T21:13:06.978 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.989+0000 7fd6ed600700 1 --2- 172.21.15.84:0/3294288063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e807cf60 0x7fd6e810bcb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:06.978 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.989+0000 7fd6ed600700 1 -- 172.21.15.84:0/3294288063 >> 172.21.15.84:0/3294288063 conn(0x7fd6e8078300 msgr2=0x7fd6e807a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:06.978 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.989+0000 7fd6ed600700 1 -- 172.21.15.84:0/3294288063 shutdown_connections 2024-04-26T21:13:06.978 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.989+0000 7fd6ed600700 1 -- 172.21.15.84:0/3294288063 wait complete. 2024-04-26T21:13:06.978 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.990+0000 7fd6ed600700 1 Processor -- start 2024-04-26T21:13:06.978 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.990+0000 7fd6ed600700 1 -- start start 2024-04-26T21:13:06.978 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.991+0000 7fd6ed600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e807cf60 0x7fd6e8117be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:06.979 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.991+0000 7fd6ed600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e8118120 con 0x7fd6e807cf60 2024-04-26T21:13:06.979 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.991+0000 7fd6e6a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e807cf60 0x7fd6e8117be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:06.979 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.991+0000 7fd6e6a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e807cf60 0x7fd6e8117be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46698/0 (socket says 172.21.15.84:46698) 2024-04-26T21:13:06.979 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.991+0000 7fd6e6a00700 1 -- 172.21.15.84:0/480919590 learned_addr learned my addr 172.21.15.84:0/480919590 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:06.979 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.991+0000 7fd6e6a00700 1 -- 172.21.15.84:0/480919590 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d80094f0 con 0x7fd6e807cf60 2024-04-26T21:13:06.979 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.992+0000 7fd6e6a00700 1 --2- 172.21.15.84:0/480919590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e807cf60 0x7fd6e8117be0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8006b00 tx=0x7fd6d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:06.979 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.992+0000 7fd6df400700 1 -- 172.21.15.84:0/480919590 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6d80107c0 con 0x7fd6e807cf60 2024-04-26T21:13:06.979 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.992+0000 7fd6df400700 1 -- 172.21.15.84:0/480919590 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd6d8010db0 con 0x7fd6e807cf60 2024-04-26T21:13:06.979 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.992+0000 7fd6df400700 1 -- 172.21.15.84:0/480919590 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6d801acf0 con 0x7fd6e807cf60 2024-04-26T21:13:06.979 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.992+0000 7fd6ed600700 1 -- 172.21.15.84:0/480919590 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e8118320 con 0x7fd6e807cf60 2024-04-26T21:13:06.979 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.992+0000 7fd6ed600700 1 -- 172.21.15.84:0/480919590 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e8118e90 con 0x7fd6e807cf60 2024-04-26T21:13:06.979 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.993+0000 7fd6df400700 1 -- 172.21.15.84:0/480919590 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fd6d8010920 con 0x7fd6e807cf60 2024-04-26T21:13:06.979 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.993+0000 7fd6ed600700 1 -- 172.21.15.84:0/480919590 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e805f5c0 con 0x7fd6e807cf60 2024-04-26T21:13:06.979 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.994+0000 7fd6df400700 1 --2- 172.21.15.84:0/480919590 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fd6cc0368a0 0x7fd6cc038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:06.980 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.994+0000 7fd6df400700 1 -- 172.21.15.84:0/480919590 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd6d804a650 con 0x7fd6e807cf60 2024-04-26T21:13:06.980 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.994+0000 7fd6de000700 1 --2- 172.21.15.84:0/480919590 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fd6cc0368a0 0x7fd6cc038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:06.980 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.995+0000 7fd6de000700 1 --2- 172.21.15.84:0/480919590 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fd6cc0368a0 0x7fd6cc038d50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000ad90 tx=0x7fd6d0009410 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:06.980 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:05.999+0000 7fd6df400700 1 -- 172.21.15.84:0/480919590 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd6d801a530 con 0x7fd6e807cf60 2024-04-26T21:13:06.980 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:06.224+0000 7fd6ed600700 1 -- 172.21.15.84:0/480919590 --> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6e807a5a0 con 0x7fd6cc0368a0 2024-04-26T21:13:06.980 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:06.243+0000 7fd6df400700 1 -- 172.21.15.84:0/480919590 <== mgr.14120 v2:172.21.15.84:6800/2151160823 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd6e807a5a0 con 0x7fd6cc0368a0 2024-04-26T21:13:06.980 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:06.247+0000 7fd6ed600700 1 -- 172.21.15.84:0/480919590 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fd6cc0368a0 msgr2=0x7fd6cc038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:06.980 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:06.247+0000 7fd6ed600700 1 --2- 172.21.15.84:0/480919590 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fd6cc0368a0 0x7fd6cc038d50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000ad90 tx=0x7fd6d0009410 comp rx=0 tx=0).stop 2024-04-26T21:13:06.980 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:06.247+0000 7fd6ed600700 1 -- 172.21.15.84:0/480919590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e807cf60 msgr2=0x7fd6e8117be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:06.980 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:06.247+0000 7fd6ed600700 1 --2- 172.21.15.84:0/480919590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e807cf60 0x7fd6e8117be0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8006b00 tx=0x7fd6d8009250 comp rx=0 tx=0).stop 2024-04-26T21:13:06.980 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:06.248+0000 7fd6ed600700 1 -- 172.21.15.84:0/480919590 shutdown_connections 2024-04-26T21:13:06.980 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:06.248+0000 7fd6ed600700 1 --2- 172.21.15.84:0/480919590 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fd6cc0368a0 0x7fd6cc038d50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:06.980 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:06.248+0000 7fd6ed600700 1 --2- 172.21.15.84:0/480919590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e807cf60 0x7fd6e8117be0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:06.980 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:06.248+0000 7fd6ed600700 1 -- 172.21.15.84:0/480919590 >> 172.21.15.84:0/480919590 conn(0x7fd6e8078300 msgr2=0x7fd6e8079e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:06.980 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:06.248+0000 7fd6ed600700 1 -- 172.21.15.84:0/480919590 shutdown_connections 2024-04-26T21:13:06.981 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:06.249+0000 7fd6ed600700 1 -- 172.21.15.84:0/480919590 wait complete. 2024-04-26T21:13:08.462 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-26T21:13:08.463 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.519+0000 7fe756600700 1 Processor -- start 2024-04-26T21:13:08.463 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.519+0000 7fe756600700 1 -- start start 2024-04-26T21:13:08.463 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.520+0000 7fe756600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe750077b90 0x7fe750076140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:08.463 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.520+0000 7fe756600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe750077fa0 con 0x7fe750077b90 2024-04-26T21:13:08.463 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.520+0000 7fe74f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe750077b90 0x7fe750076140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:08.463 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.520+0000 7fe74f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe750077b90 0x7fe750076140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46708/0 (socket says 172.21.15.84:46708) 2024-04-26T21:13:08.463 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.521+0000 7fe74f400700 1 -- 172.21.15.84:0/2138209680 learned_addr learned my addr 172.21.15.84:0/2138209680 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:08.463 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.521+0000 7fe74f400700 1 -- 172.21.15.84:0/2138209680 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe750076680 con 0x7fe750077b90 2024-04-26T21:13:08.463 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.521+0000 7fe74f400700 1 --2- 172.21.15.84:0/2138209680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe750077b90 0x7fe750076140 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe7400098e0 tx=0x7fe740009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a499b90c3e494b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:08.463 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.521+0000 7fe74e000700 1 -- 172.21.15.84:0/2138209680 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe74000b860 con 0x7fe750077b90 2024-04-26T21:13:08.463 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.522+0000 7fe74e000700 1 -- 172.21.15.84:0/2138209680 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe74000be50 con 0x7fe750077b90 2024-04-26T21:13:08.463 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.522+0000 7fe74e000700 1 -- 172.21.15.84:0/2138209680 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe740010380 con 0x7fe750077b90 2024-04-26T21:13:08.463 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.522+0000 7fe756600700 1 -- 172.21.15.84:0/2138209680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe750077b90 msgr2=0x7fe750076140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:08.464 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.522+0000 7fe756600700 1 --2- 172.21.15.84:0/2138209680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe750077b90 0x7fe750076140 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe7400098e0 tx=0x7fe740009250 comp rx=0 tx=0).stop 2024-04-26T21:13:08.464 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.523+0000 7fe756600700 1 -- 172.21.15.84:0/2138209680 shutdown_connections 2024-04-26T21:13:08.464 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.523+0000 7fe756600700 1 --2- 172.21.15.84:0/2138209680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe750077b90 0x7fe750076140 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:08.464 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.523+0000 7fe756600700 1 -- 172.21.15.84:0/2138209680 >> 172.21.15.84:0/2138209680 conn(0x7fe7500fdf90 msgr2=0x7fe750100400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:08.464 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.523+0000 7fe756600700 1 -- 172.21.15.84:0/2138209680 shutdown_connections 2024-04-26T21:13:08.464 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.523+0000 7fe756600700 1 -- 172.21.15.84:0/2138209680 wait complete. 2024-04-26T21:13:08.464 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.524+0000 7fe756600700 1 Processor -- start 2024-04-26T21:13:08.464 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.524+0000 7fe756600700 1 -- start start 2024-04-26T21:13:08.464 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.524+0000 7fe756600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe750077b90 0x7fe750113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:08.464 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.524+0000 7fe756600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe750113d80 con 0x7fe750077b90 2024-04-26T21:13:08.464 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.525+0000 7fe74f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe750077b90 0x7fe750113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:08.464 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.525+0000 7fe74f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe750077b90 0x7fe750113840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46716/0 (socket says 172.21.15.84:46716) 2024-04-26T21:13:08.464 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.525+0000 7fe74f400700 1 -- 172.21.15.84:0/3957509705 learned_addr learned my addr 172.21.15.84:0/3957509705 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:08.464 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.525+0000 7fe74f400700 1 -- 172.21.15.84:0/3957509705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7400094f0 con 0x7fe750077b90 2024-04-26T21:13:08.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.525+0000 7fe74f400700 1 --2- 172.21.15.84:0/3957509705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe750077b90 0x7fe750113840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe74000b440 tx=0x7fe740009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:08.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.526+0000 7fe747400700 1 -- 172.21.15.84:0/3957509705 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe740010760 con 0x7fe750077b90 2024-04-26T21:13:08.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.526+0000 7fe747400700 1 -- 172.21.15.84:0/3957509705 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe740010d50 con 0x7fe750077b90 2024-04-26T21:13:08.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.526+0000 7fe747400700 1 -- 172.21.15.84:0/3957509705 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe74001adc0 con 0x7fe750077b90 2024-04-26T21:13:08.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.526+0000 7fe756600700 1 -- 172.21.15.84:0/3957509705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe750113f80 con 0x7fe750077b90 2024-04-26T21:13:08.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.526+0000 7fe756600700 1 -- 172.21.15.84:0/3957509705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe750114af0 con 0x7fe750077b90 2024-04-26T21:13:08.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.527+0000 7fe747400700 1 -- 172.21.15.84:0/3957509705 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fe7400108c0 con 0x7fe750077b90 2024-04-26T21:13:08.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.527+0000 7fe756600700 1 -- 172.21.15.84:0/3957509705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75005f5c0 con 0x7fe750077b90 2024-04-26T21:13:08.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.528+0000 7fe747400700 1 --2- 172.21.15.84:0/3957509705 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fe734036830 0x7fe734038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:08.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.528+0000 7fe747400700 1 -- 172.21.15.84:0/3957509705 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe74004a0c0 con 0x7fe750077b90 2024-04-26T21:13:08.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.528+0000 7fe74ea00700 1 --2- 172.21.15.84:0/3957509705 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fe734036830 0x7fe734038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:08.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.529+0000 7fe74ea00700 1 --2- 172.21.15.84:0/3957509705 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fe734036830 0x7fe734038ce0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009990 tx=0x7fe73c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:08.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.533+0000 7fe747400700 1 -- 172.21.15.84:0/3957509705 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe74007c250 con 0x7fe750077b90 2024-04-26T21:13:08.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.743+0000 7fe756600700 1 -- 172.21.15.84:0/3957509705 --> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7500ff250 con 0x7fe734036830 2024-04-26T21:13:08.466 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.744+0000 7fe747400700 1 -- 172.21.15.84:0/3957509705 <== mgr.14120 v2:172.21.15.84:6800/2151160823 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fe7500ff250 con 0x7fe734036830 2024-04-26T21:13:08.466 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.747+0000 7fe756600700 1 -- 172.21.15.84:0/3957509705 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fe734036830 msgr2=0x7fe734038ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:08.466 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.747+0000 7fe756600700 1 --2- 172.21.15.84:0/3957509705 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fe734036830 0x7fe734038ce0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009990 tx=0x7fe73c006e40 comp rx=0 tx=0).stop 2024-04-26T21:13:08.466 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.747+0000 7fe756600700 1 -- 172.21.15.84:0/3957509705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe750077b90 msgr2=0x7fe750113840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:08.466 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.747+0000 7fe756600700 1 --2- 172.21.15.84:0/3957509705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe750077b90 0x7fe750113840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe74000b440 tx=0x7fe740009250 comp rx=0 tx=0).stop 2024-04-26T21:13:08.466 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.747+0000 7fe756600700 1 -- 172.21.15.84:0/3957509705 shutdown_connections 2024-04-26T21:13:08.466 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.747+0000 7fe756600700 1 --2- 172.21.15.84:0/3957509705 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fe734036830 0x7fe734038ce0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:08.466 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.747+0000 7fe756600700 1 --2- 172.21.15.84:0/3957509705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe750077b90 0x7fe750113840 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:08.466 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.747+0000 7fe756600700 1 -- 172.21.15.84:0/3957509705 >> 172.21.15.84:0/3957509705 conn(0x7fe7500fdf90 msgr2=0x7fe7500feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:08.466 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.747+0000 7fe756600700 1 -- 172.21.15.84:0/3957509705 shutdown_connections 2024-04-26T21:13:08.466 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:07.747+0000 7fe756600700 1 -- 172.21.15.84:0/3957509705 wait complete. 2024-04-26T21:13:08.466 INFO:teuthology.orchestra.run.smithi084.stdout:Generating ssh key... 2024-04-26T21:13:08.785 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:08 smithi084 ceph-mon[25539]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:09.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:09 smithi084 ceph-mon[25539]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:09.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:09 smithi084 ceph-mon[25539]: Generating ssh key... 2024-04-26T21:13:09.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:09 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:09.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:09 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:10.070 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.080+0000 7f0476000700 1 Processor -- start 2024-04-26T21:13:10.076 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.080+0000 7f0476000700 1 -- start start 2024-04-26T21:13:10.076 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.081+0000 7f0476000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0470071310 0x7f0470105410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:10.076 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.081+0000 7f0476000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0470105950 con 0x7f0470071310 2024-04-26T21:13:10.076 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.081+0000 7f046f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0470071310 0x7f0470105410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:10.076 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.081+0000 7f046f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0470071310 0x7f0470105410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46726/0 (socket says 172.21.15.84:46726) 2024-04-26T21:13:10.076 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.081+0000 7f046f400700 1 -- 172.21.15.84:0/3614944808 learned_addr learned my addr 172.21.15.84:0/3614944808 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:10.076 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.082+0000 7f046f400700 1 -- 172.21.15.84:0/3614944808 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0470105a90 con 0x7f0470071310 2024-04-26T21:13:10.076 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.082+0000 7f046f400700 1 --2- 172.21.15.84:0/3614944808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0470071310 0x7f0470105410 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0460009e50 tx=0x7f0460009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca126e5e57d1a295 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:10.076 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.082+0000 7f046e000700 1 -- 172.21.15.84:0/3614944808 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04600092e0 con 0x7f0470071310 2024-04-26T21:13:10.076 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.082+0000 7f046e000700 1 -- 172.21.15.84:0/3614944808 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f0460012430 con 0x7f0470071310 2024-04-26T21:13:10.076 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.082+0000 7f046e000700 1 -- 172.21.15.84:0/3614944808 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04600075c0 con 0x7f0470071310 2024-04-26T21:13:10.076 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.083+0000 7f0476000700 1 -- 172.21.15.84:0/3614944808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0470071310 msgr2=0x7f0470105410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:10.076 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.083+0000 7f0476000700 1 --2- 172.21.15.84:0/3614944808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0470071310 0x7f0470105410 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0460009e50 tx=0x7f0460009840 comp rx=0 tx=0).stop 2024-04-26T21:13:10.077 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.083+0000 7f0476000700 1 -- 172.21.15.84:0/3614944808 shutdown_connections 2024-04-26T21:13:10.077 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.083+0000 7f0476000700 1 --2- 172.21.15.84:0/3614944808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0470071310 0x7f0470105410 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:10.077 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.083+0000 7f0476000700 1 -- 172.21.15.84:0/3614944808 >> 172.21.15.84:0/3614944808 conn(0x7f04700fcec0 msgr2=0x7f04700ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:10.077 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.083+0000 7f0476000700 1 -- 172.21.15.84:0/3614944808 shutdown_connections 2024-04-26T21:13:10.077 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.083+0000 7f0476000700 1 -- 172.21.15.84:0/3614944808 wait complete. 2024-04-26T21:13:10.077 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.084+0000 7f0476000700 1 Processor -- start 2024-04-26T21:13:10.077 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.085+0000 7f0476000700 1 -- start start 2024-04-26T21:13:10.077 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.085+0000 7f0476000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0470071310 0x7f0470102d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:10.077 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.085+0000 7f0476000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04701032a0 con 0x7f0470071310 2024-04-26T21:13:10.077 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.085+0000 7f046f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0470071310 0x7f0470102d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:10.077 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.085+0000 7f046f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0470071310 0x7f0470102d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46740/0 (socket says 172.21.15.84:46740) 2024-04-26T21:13:10.077 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.085+0000 7f046f400700 1 -- 172.21.15.84:0/2885533490 learned_addr learned my addr 172.21.15.84:0/2885533490 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:10.077 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.086+0000 7f046f400700 1 -- 172.21.15.84:0/2885533490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0460009ae0 con 0x7f0470071310 2024-04-26T21:13:10.077 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.086+0000 7f046f400700 1 --2- 172.21.15.84:0/2885533490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0470071310 0x7f0470102d60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0460009fd0 tx=0x7f0460009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:10.078 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.086+0000 7f0467400700 1 -- 172.21.15.84:0/2885533490 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04600092e0 con 0x7f0470071310 2024-04-26T21:13:10.078 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.086+0000 7f0467400700 1 -- 172.21.15.84:0/2885533490 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f0460007cc0 con 0x7f0470071310 2024-04-26T21:13:10.078 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.086+0000 7f0476000700 1 -- 172.21.15.84:0/2885533490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0470101370 con 0x7f0470071310 2024-04-26T21:13:10.078 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.086+0000 7f0467400700 1 -- 172.21.15.84:0/2885533490 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f046001c880 con 0x7f0470071310 2024-04-26T21:13:10.078 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.087+0000 7f0476000700 1 -- 172.21.15.84:0/2885533490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0470101860 con 0x7f0470071310 2024-04-26T21:13:10.078 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.088+0000 7f0467400700 1 -- 172.21.15.84:0/2885533490 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f0460019070 con 0x7f0470071310 2024-04-26T21:13:10.078 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.088+0000 7f0476000700 1 -- 172.21.15.84:0/2885533490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f047004bed0 con 0x7f0470071310 2024-04-26T21:13:10.078 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.088+0000 7f0467400700 1 --2- 172.21.15.84:0/2885533490 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f04540368a0 0x7f0454038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:10.078 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.088+0000 7f0467400700 1 -- 172.21.15.84:0/2885533490 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0460049dd0 con 0x7f0470071310 2024-04-26T21:13:10.078 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.088+0000 7f046ea00700 1 --2- 172.21.15.84:0/2885533490 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f04540368a0 0x7f0454038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:10.078 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.089+0000 7f046ea00700 1 --2- 172.21.15.84:0/2885533490 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f04540368a0 0x7f0454038d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f045c009990 tx=0x7f045c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:10.078 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.094+0000 7f0467400700 1 -- 172.21.15.84:0/2885533490 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f046004d030 con 0x7f0470071310 2024-04-26T21:13:10.078 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.309+0000 7f0476000700 1 -- 172.21.15.84:0/2885533490 --> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f0470101f70 con 0x7f04540368a0 2024-04-26T21:13:10.078 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.411+0000 7f0467400700 1 -- 172.21.15.84:0/2885533490 <== mgr.14120 v2:172.21.15.84:6800/2151160823 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0470101f70 con 0x7f04540368a0 2024-04-26T21:13:10.079 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.413+0000 7f0476000700 1 -- 172.21.15.84:0/2885533490 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f04540368a0 msgr2=0x7f0454038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:10.079 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.413+0000 7f0476000700 1 --2- 172.21.15.84:0/2885533490 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f04540368a0 0x7f0454038d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f045c009990 tx=0x7f045c006e40 comp rx=0 tx=0).stop 2024-04-26T21:13:10.079 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.414+0000 7f0476000700 1 -- 172.21.15.84:0/2885533490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0470071310 msgr2=0x7f0470102d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:10.079 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.414+0000 7f0476000700 1 --2- 172.21.15.84:0/2885533490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0470071310 0x7f0470102d60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0460009fd0 tx=0x7f0460009840 comp rx=0 tx=0).stop 2024-04-26T21:13:10.079 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.414+0000 7f0476000700 1 -- 172.21.15.84:0/2885533490 shutdown_connections 2024-04-26T21:13:10.079 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.414+0000 7f0476000700 1 --2- 172.21.15.84:0/2885533490 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f04540368a0 0x7f0454038d50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:10.079 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.414+0000 7f0476000700 1 --2- 172.21.15.84:0/2885533490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0470071310 0x7f0470102d60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:10.079 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.414+0000 7f0476000700 1 -- 172.21.15.84:0/2885533490 >> 172.21.15.84:0/2885533490 conn(0x7f04700fcec0 msgr2=0x7f04700fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:10.079 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.414+0000 7f0476000700 1 -- 172.21.15.84:0/2885533490 shutdown_connections 2024-04-26T21:13:10.079 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:09.414+0000 7f0476000700 1 -- 172.21.15.84:0/2885533490 wait complete. 2024-04-26T21:13:11.597 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:11 smithi084 ceph-mon[25539]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:11.613 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqMNqp11k+iyvnErzBFiArwVdr/mAz932UDFPygKexwHwyYQ0lp02QhCuMyXX85ximGq0bQ4StqcVJ7ZBtyQwWCfuoanCP36bfbvvrN4+zCkqjTJYrLxWcjBCRB8cGvkjtweV4QI86E+4idmLIKhGusAJGZp/hL3jUClZ7VsG17RcdMq95/OrWEAQg5EyoljAoQ8Hbu8QpOKpqYKouKUYPToYYsj7XR2g7HQTAJcXUNuF1588xWShVLI49gGpMPIwji1JUh6OsZuO/h6SsdJl9VuSGON4U9bv+ZjICDRnp657bEG25ES9iLD2oVmGutr79ht4uSaPJT+aedLZxahdgJms8gj8ZbNd1DVxza5fUKZLOnEGepeykpEMomgsxPUfN0XSsan409E/hbljEa5xaLgQ3caumpbJBDBE1RuHQ2C8yl0lN7U0iuI+oIm+ohTtFX7TWzoVLpmBGJMrdj/asWLF1Kwd313AzRuCAZWVlxuhpPCilf7gyaNh3MuH3450= ceph-8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:13:11.614 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.672+0000 7f915c400700 1 Processor -- start 2024-04-26T21:13:11.614 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.672+0000 7f915c400700 1 -- start start 2024-04-26T21:13:11.614 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.673+0000 7f915c400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9154102850 0x7f9154102c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:11.614 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.673+0000 7f915c400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91541031a0 con 0x7f9154102850 2024-04-26T21:13:11.614 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.673+0000 7f9159a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9154102850 0x7f9154102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:11.614 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.673+0000 7f9159a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9154102850 0x7f9154102c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46744/0 (socket says 172.21.15.84:46744) 2024-04-26T21:13:11.614 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.673+0000 7f9159a00700 1 -- 172.21.15.84:0/509114694 learned_addr learned my addr 172.21.15.84:0/509114694 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:11.614 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.674+0000 7f9159a00700 1 -- 172.21.15.84:0/509114694 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91541032e0 con 0x7f9154102850 2024-04-26T21:13:11.614 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.674+0000 7f9159a00700 1 --2- 172.21.15.84:0/509114694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9154102850 0x7f9154102c60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f91480098e0 tx=0x7f9148009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742a137d9c249a2d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:11.614 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.674+0000 7f9153e00700 1 -- 172.21.15.84:0/509114694 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f914800b860 con 0x7f9154102850 2024-04-26T21:13:11.614 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.674+0000 7f9153e00700 1 -- 172.21.15.84:0/509114694 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f914800be50 con 0x7f9154102850 2024-04-26T21:13:11.615 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.674+0000 7f9153e00700 1 -- 172.21.15.84:0/509114694 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9148010380 con 0x7f9154102850 2024-04-26T21:13:11.615 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.675+0000 7f915c400700 1 -- 172.21.15.84:0/509114694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9154102850 msgr2=0x7f9154102c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:11.615 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.675+0000 7f915c400700 1 --2- 172.21.15.84:0/509114694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9154102850 0x7f9154102c60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f91480098e0 tx=0x7f9148009250 comp rx=0 tx=0).stop 2024-04-26T21:13:11.615 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.675+0000 7f915c400700 1 -- 172.21.15.84:0/509114694 shutdown_connections 2024-04-26T21:13:11.615 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.675+0000 7f915c400700 1 --2- 172.21.15.84:0/509114694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9154102850 0x7f9154102c60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:11.615 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.675+0000 7f915c400700 1 -- 172.21.15.84:0/509114694 >> 172.21.15.84:0/509114694 conn(0x7f91540fdff0 msgr2=0x7f9154100400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:11.615 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.676+0000 7f915c400700 1 -- 172.21.15.84:0/509114694 shutdown_connections 2024-04-26T21:13:11.615 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.676+0000 7f915c400700 1 -- 172.21.15.84:0/509114694 wait complete. 2024-04-26T21:13:11.615 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.676+0000 7f915c400700 1 Processor -- start 2024-04-26T21:13:11.615 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.677+0000 7f915c400700 1 -- start start 2024-04-26T21:13:11.615 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.677+0000 7f915c400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9154102850 0x7f9154113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:11.615 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.677+0000 7f915c400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9154113ca0 con 0x7f9154102850 2024-04-26T21:13:11.615 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.677+0000 7f9159a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9154102850 0x7f9154113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:11.615 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.677+0000 7f9159a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9154102850 0x7f9154113760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46756/0 (socket says 172.21.15.84:46756) 2024-04-26T21:13:11.615 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.677+0000 7f9159a00700 1 -- 172.21.15.84:0/1226699705 learned_addr learned my addr 172.21.15.84:0/1226699705 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:11.615 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.677+0000 7f9159a00700 1 -- 172.21.15.84:0/1226699705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91480094f0 con 0x7f9154102850 2024-04-26T21:13:11.616 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.678+0000 7f9159a00700 1 --2- 172.21.15.84:0/1226699705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9154102850 0x7f9154113760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9148000c00 tx=0x7f9148009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:11.616 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.678+0000 7f9151600700 1 -- 172.21.15.84:0/1226699705 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f91480107c0 con 0x7f9154102850 2024-04-26T21:13:11.616 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.678+0000 7f9151600700 1 -- 172.21.15.84:0/1226699705 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9148010db0 con 0x7f9154102850 2024-04-26T21:13:11.616 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.678+0000 7f915c400700 1 -- 172.21.15.84:0/1226699705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9154113ea0 con 0x7f9154102850 2024-04-26T21:13:11.616 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.678+0000 7f9151600700 1 -- 172.21.15.84:0/1226699705 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f914801ad00 con 0x7f9154102850 2024-04-26T21:13:11.616 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.679+0000 7f915c400700 1 -- 172.21.15.84:0/1226699705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9154114a10 con 0x7f9154102850 2024-04-26T21:13:11.616 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.680+0000 7f9151600700 1 -- 172.21.15.84:0/1226699705 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f914801a530 con 0x7f9154102850 2024-04-26T21:13:11.616 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.680+0000 7f915c400700 1 -- 172.21.15.84:0/1226699705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f915405f5c0 con 0x7f9154102850 2024-04-26T21:13:11.616 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.680+0000 7f9151600700 1 --2- 172.21.15.84:0/1226699705 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f913c0368a0 0x7f913c038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:11.616 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.680+0000 7f9151600700 1 -- 172.21.15.84:0/1226699705 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9148049fa0 con 0x7f9154102850 2024-04-26T21:13:11.616 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.681+0000 7f9159000700 1 --2- 172.21.15.84:0/1226699705 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f913c0368a0 0x7f913c038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:11.617 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.681+0000 7f9159000700 1 --2- 172.21.15.84:0/1226699705 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f913c0368a0 0x7f913c038d50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9140009990 tx=0x7f9140006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:11.617 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.686+0000 7f9151600700 1 -- 172.21.15.84:0/1226699705 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9148022990 con 0x7f9154102850 2024-04-26T21:13:11.617 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.897+0000 7f915c400700 1 -- 172.21.15.84:0/1226699705 --> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f91540ff100 con 0x7f913c0368a0 2024-04-26T21:13:11.617 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.899+0000 7f9151600700 1 -- 172.21.15.84:0/1226699705 <== mgr.14120 v2:172.21.15.84:6800/2151160823 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f91540ff100 con 0x7f913c0368a0 2024-04-26T21:13:11.617 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.902+0000 7f915c400700 1 -- 172.21.15.84:0/1226699705 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f913c0368a0 msgr2=0x7f913c038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:11.617 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.902+0000 7f915c400700 1 --2- 172.21.15.84:0/1226699705 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f913c0368a0 0x7f913c038d50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9140009990 tx=0x7f9140006e40 comp rx=0 tx=0).stop 2024-04-26T21:13:11.617 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.902+0000 7f915c400700 1 -- 172.21.15.84:0/1226699705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9154102850 msgr2=0x7f9154113760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:11.617 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.902+0000 7f915c400700 1 --2- 172.21.15.84:0/1226699705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9154102850 0x7f9154113760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9148000c00 tx=0x7f9148009250 comp rx=0 tx=0).stop 2024-04-26T21:13:11.617 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.902+0000 7f915c400700 1 -- 172.21.15.84:0/1226699705 shutdown_connections 2024-04-26T21:13:11.617 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.902+0000 7f915c400700 1 --2- 172.21.15.84:0/1226699705 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f913c0368a0 0x7f913c038d50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:11.617 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.902+0000 7f915c400700 1 --2- 172.21.15.84:0/1226699705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9154102850 0x7f9154113760 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:11.617 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.902+0000 7f915c400700 1 -- 172.21.15.84:0/1226699705 >> 172.21.15.84:0/1226699705 conn(0x7f91540fdff0 msgr2=0x7f91540fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:11.618 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.902+0000 7f915c400700 1 -- 172.21.15.84:0/1226699705 shutdown_connections 2024-04-26T21:13:11.618 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:10.902+0000 7f915c400700 1 -- 172.21.15.84:0/1226699705 wait complete. 2024-04-26T21:13:11.618 INFO:teuthology.orchestra.run.smithi084.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-26T21:13:11.618 INFO:teuthology.orchestra.run.smithi084.stdout:Adding key to root@localhost authorized_keys... 2024-04-26T21:13:11.618 INFO:teuthology.orchestra.run.smithi084.stdout:Adding host smithi084... 2024-04-26T21:13:13.739 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:13 smithi084 ceph-mon[25539]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi084", "addr": "172.21.15.84", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:14.558 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:14 smithi084 ceph-mon[25539]: Deploying cephadm binary to smithi084 2024-04-26T21:13:16.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Added host 'smithi084' with addr '172.21.15.84' 2024-04-26T21:13:16.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.244+0000 7fdbb3200700 1 Processor -- start 2024-04-26T21:13:16.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.244+0000 7fdbb3200700 1 -- start start 2024-04-26T21:13:16.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.245+0000 7fdbb3200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac07c7f0 0x7fdbac07cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:16.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.245+0000 7fdbb3200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac07d1d0 con 0x7fdbac07c7f0 2024-04-26T21:13:16.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.245+0000 7fdbb1e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac07c7f0 0x7fdbac07cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:16.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.245+0000 7fdbb1e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac07c7f0 0x7fdbac07cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34042/0 (socket says 172.21.15.84:34042) 2024-04-26T21:13:16.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.245+0000 7fdbb1e00700 1 -- 172.21.15.84:0/3422651984 learned_addr learned my addr 172.21.15.84:0/3422651984 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:16.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.246+0000 7fdbb1e00700 1 -- 172.21.15.84:0/3422651984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac07d310 con 0x7fdbac07c7f0 2024-04-26T21:13:16.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.246+0000 7fdbb1e00700 1 --2- 172.21.15.84:0/3422651984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac07c7f0 0x7fdbac07cc00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdba00098e0 tx=0x7fdba0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5782cd6f3bb812 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:16.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.246+0000 7fdbb0a00700 1 -- 172.21.15.84:0/3422651984 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdba000b860 con 0x7fdbac07c7f0 2024-04-26T21:13:16.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.246+0000 7fdbb0a00700 1 -- 172.21.15.84:0/3422651984 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fdba000be50 con 0x7fdbac07c7f0 2024-04-26T21:13:16.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.246+0000 7fdbb0a00700 1 -- 172.21.15.84:0/3422651984 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdba0010380 con 0x7fdbac07c7f0 2024-04-26T21:13:16.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.247+0000 7fdbb3200700 1 -- 172.21.15.84:0/3422651984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac07c7f0 msgr2=0x7fdbac07cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:16.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.247+0000 7fdbb3200700 1 --2- 172.21.15.84:0/3422651984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac07c7f0 0x7fdbac07cc00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdba00098e0 tx=0x7fdba0009250 comp rx=0 tx=0).stop 2024-04-26T21:13:16.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.247+0000 7fdbb3200700 1 -- 172.21.15.84:0/3422651984 shutdown_connections 2024-04-26T21:13:16.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.247+0000 7fdbb3200700 1 --2- 172.21.15.84:0/3422651984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac07c7f0 0x7fdbac07cc00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:16.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.247+0000 7fdbb3200700 1 -- 172.21.15.84:0/3422651984 >> 172.21.15.84:0/3422651984 conn(0x7fdbac078110 msgr2=0x7fdbac07a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:16.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.247+0000 7fdbb3200700 1 -- 172.21.15.84:0/3422651984 shutdown_connections 2024-04-26T21:13:16.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.247+0000 7fdbb3200700 1 -- 172.21.15.84:0/3422651984 wait complete. 2024-04-26T21:13:16.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.248+0000 7fdbb3200700 1 Processor -- start 2024-04-26T21:13:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.248+0000 7fdbb3200700 1 -- start start 2024-04-26T21:13:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.248+0000 7fdbb3200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac07c7f0 0x7fdbac1179c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.248+0000 7fdbb3200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac117f00 con 0x7fdbac07c7f0 2024-04-26T21:13:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.248+0000 7fdbb1e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac07c7f0 0x7fdbac1179c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.248+0000 7fdbb1e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac07c7f0 0x7fdbac1179c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34054/0 (socket says 172.21.15.84:34054) 2024-04-26T21:13:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.248+0000 7fdbb1e00700 1 -- 172.21.15.84:0/1284534055 learned_addr learned my addr 172.21.15.84:0/1284534055 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.249+0000 7fdbb1e00700 1 -- 172.21.15.84:0/1284534055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba00094f0 con 0x7fdbac07c7f0 2024-04-26T21:13:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.249+0000 7fdbb1e00700 1 --2- 172.21.15.84:0/1284534055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac07c7f0 0x7fdbac1179c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdba0006b00 tx=0x7fdba0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.249+0000 7fdba6000700 1 -- 172.21.15.84:0/1284534055 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdba00107c0 con 0x7fdbac07c7f0 2024-04-26T21:13:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.249+0000 7fdba6000700 1 -- 172.21.15.84:0/1284534055 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fdba0010db0 con 0x7fdbac07c7f0 2024-04-26T21:13:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.249+0000 7fdba6000700 1 -- 172.21.15.84:0/1284534055 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdba001acf0 con 0x7fdbac07c7f0 2024-04-26T21:13:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.249+0000 7fdbb3200700 1 -- 172.21.15.84:0/1284534055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbac118100 con 0x7fdbac07c7f0 2024-04-26T21:13:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.250+0000 7fdbb3200700 1 -- 172.21.15.84:0/1284534055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac118c70 con 0x7fdbac07c7f0 2024-04-26T21:13:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.251+0000 7fdba6000700 1 -- 172.21.15.84:0/1284534055 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fdba0010920 con 0x7fdbac07c7f0 2024-04-26T21:13:16.763 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.251+0000 7fdbb3200700 1 -- 172.21.15.84:0/1284534055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbac05f5c0 con 0x7fdbac07c7f0 2024-04-26T21:13:16.763 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.251+0000 7fdba6000700 1 --2- 172.21.15.84:0/1284534055 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fdb940368a0 0x7fdb94038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:16.763 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.251+0000 7fdba6000700 1 -- 172.21.15.84:0/1284534055 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fdba004a610 con 0x7fdbac07c7f0 2024-04-26T21:13:16.763 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.251+0000 7fdbb1400700 1 --2- 172.21.15.84:0/1284534055 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fdb940368a0 0x7fdb94038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:16.763 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.252+0000 7fdbb1400700 1 --2- 172.21.15.84:0/1284534055 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fdb940368a0 0x7fdb94038d50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009990 tx=0x7fdb9c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:16.763 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.256+0000 7fdba6000700 1 -- 172.21.15.84:0/1284534055 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fdba001a530 con 0x7fdbac07c7f0 2024-04-26T21:13:16.763 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:12.471+0000 7fdbb3200700 1 -- 172.21.15.84:0/1284534055 --> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi084", "addr": "172.21.15.84", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbac07a300 con 0x7fdb940368a0 2024-04-26T21:13:16.763 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:16.031+0000 7fdba6000700 1 -- 172.21.15.84:0/1284534055 <== mgr.14120 v2:172.21.15.84:6800/2151160823 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fdbac07a300 con 0x7fdb940368a0 2024-04-26T21:13:16.763 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:16.036+0000 7fdbb3200700 1 -- 172.21.15.84:0/1284534055 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fdb940368a0 msgr2=0x7fdb94038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:16.763 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:16.036+0000 7fdbb3200700 1 --2- 172.21.15.84:0/1284534055 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fdb940368a0 0x7fdb94038d50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009990 tx=0x7fdb9c006e40 comp rx=0 tx=0).stop 2024-04-26T21:13:16.763 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:16.036+0000 7fdbb3200700 1 -- 172.21.15.84:0/1284534055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac07c7f0 msgr2=0x7fdbac1179c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:16.763 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:16.036+0000 7fdbb3200700 1 --2- 172.21.15.84:0/1284534055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac07c7f0 0x7fdbac1179c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdba0006b00 tx=0x7fdba0009250 comp rx=0 tx=0).stop 2024-04-26T21:13:16.763 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:16.036+0000 7fdbb3200700 1 -- 172.21.15.84:0/1284534055 shutdown_connections 2024-04-26T21:13:16.764 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:16.036+0000 7fdbb3200700 1 --2- 172.21.15.84:0/1284534055 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fdb940368a0 0x7fdb94038d50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:16.764 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:16.036+0000 7fdbb3200700 1 --2- 172.21.15.84:0/1284534055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac07c7f0 0x7fdbac1179c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:16.764 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:16.036+0000 7fdbb3200700 1 -- 172.21.15.84:0/1284534055 >> 172.21.15.84:0/1284534055 conn(0x7fdbac078110 msgr2=0x7fdbac079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:16.764 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:16.036+0000 7fdbb3200700 1 -- 172.21.15.84:0/1284534055 shutdown_connections 2024-04-26T21:13:16.764 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:16.037+0000 7fdbb3200700 1 -- 172.21.15.84:0/1284534055 wait complete. 2024-04-26T21:13:16.764 INFO:teuthology.orchestra.run.smithi084.stdout:Deploying mon service with default placement... 2024-04-26T21:13:17.280 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:17 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:17.280 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:17 smithi084 ceph-mon[25539]: Added host smithi084 2024-04-26T21:13:17.280 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:17 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:13:18.537 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-26T21:13:18.538 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.439+0000 7f8d82200700 1 Processor -- start 2024-04-26T21:13:18.538 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.439+0000 7f8d82200700 1 -- start start 2024-04-26T21:13:18.538 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.439+0000 7f8d82200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c078c10 0x7f8d7c077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:18.538 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.439+0000 7f8d82200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c079020 con 0x7f8d7c078c10 2024-04-26T21:13:18.538 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.440+0000 7f8d80e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c078c10 0x7f8d7c077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:18.538 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.440+0000 7f8d80e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c078c10 0x7f8d7c077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34066/0 (socket says 172.21.15.84:34066) 2024-04-26T21:13:18.538 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.440+0000 7f8d80e00700 1 -- 172.21.15.84:0/1578540957 learned_addr learned my addr 172.21.15.84:0/1578540957 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:18.538 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.440+0000 7f8d80e00700 1 -- 172.21.15.84:0/1578540957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c077750 con 0x7f8d7c078c10 2024-04-26T21:13:18.538 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.441+0000 7f8d80e00700 1 --2- 172.21.15.84:0/1578540957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c078c10 0x7f8d7c077210 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8d700098e0 tx=0x7f8d70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200a53a20bc8b6fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:18.538 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.441+0000 7f8d7b400700 1 -- 172.21.15.84:0/1578540957 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d7000b860 con 0x7f8d7c078c10 2024-04-26T21:13:18.538 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.441+0000 7f8d7b400700 1 -- 172.21.15.84:0/1578540957 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f8d7000be50 con 0x7f8d7c078c10 2024-04-26T21:13:18.538 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.441+0000 7f8d7b400700 1 -- 172.21.15.84:0/1578540957 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d70010380 con 0x7f8d7c078c10 2024-04-26T21:13:18.538 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.442+0000 7f8d82200700 1 -- 172.21.15.84:0/1578540957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c078c10 msgr2=0x7f8d7c077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:18.539 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.442+0000 7f8d82200700 1 --2- 172.21.15.84:0/1578540957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c078c10 0x7f8d7c077210 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8d700098e0 tx=0x7f8d70009250 comp rx=0 tx=0).stop 2024-04-26T21:13:18.539 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.442+0000 7f8d82200700 1 -- 172.21.15.84:0/1578540957 shutdown_connections 2024-04-26T21:13:18.539 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.442+0000 7f8d82200700 1 --2- 172.21.15.84:0/1578540957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c078c10 0x7f8d7c077210 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:18.539 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.442+0000 7f8d82200700 1 -- 172.21.15.84:0/1578540957 >> 172.21.15.84:0/1578540957 conn(0x7f8d7c0fdee0 msgr2=0x7f8d7c1002f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:18.539 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.442+0000 7f8d82200700 1 -- 172.21.15.84:0/1578540957 shutdown_connections 2024-04-26T21:13:18.539 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.442+0000 7f8d82200700 1 -- 172.21.15.84:0/1578540957 wait complete. 2024-04-26T21:13:18.539 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.443+0000 7f8d82200700 1 Processor -- start 2024-04-26T21:13:18.539 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.443+0000 7f8d82200700 1 -- start start 2024-04-26T21:13:18.539 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.443+0000 7f8d82200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c078c10 0x7f8d7c1136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:18.539 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.443+0000 7f8d82200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c113c00 con 0x7f8d7c078c10 2024-04-26T21:13:18.539 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.444+0000 7f8d80e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c078c10 0x7f8d7c1136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:18.539 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.444+0000 7f8d80e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c078c10 0x7f8d7c1136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34082/0 (socket says 172.21.15.84:34082) 2024-04-26T21:13:18.539 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.444+0000 7f8d80e00700 1 -- 172.21.15.84:0/4082002307 learned_addr learned my addr 172.21.15.84:0/4082002307 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:18.539 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.444+0000 7f8d80e00700 1 -- 172.21.15.84:0/4082002307 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d700094f0 con 0x7f8d7c078c10 2024-04-26T21:13:18.540 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.444+0000 7f8d80e00700 1 --2- 172.21.15.84:0/4082002307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c078c10 0x7f8d7c1136c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8d70006d40 tx=0x7f8d70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:18.540 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.445+0000 7f8d78c00700 1 -- 172.21.15.84:0/4082002307 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d700107c0 con 0x7f8d7c078c10 2024-04-26T21:13:18.540 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.445+0000 7f8d78c00700 1 -- 172.21.15.84:0/4082002307 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f8d70010db0 con 0x7f8d7c078c10 2024-04-26T21:13:18.540 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.445+0000 7f8d82200700 1 -- 172.21.15.84:0/4082002307 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7c113e00 con 0x7f8d7c078c10 2024-04-26T21:13:18.540 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.445+0000 7f8d78c00700 1 -- 172.21.15.84:0/4082002307 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d7001ad90 con 0x7f8d7c078c10 2024-04-26T21:13:18.540 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.445+0000 7f8d82200700 1 -- 172.21.15.84:0/4082002307 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7c114970 con 0x7f8d7c078c10 2024-04-26T21:13:18.540 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.446+0000 7f8d82200700 1 -- 172.21.15.84:0/4082002307 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7c05f5c0 con 0x7f8d7c078c10 2024-04-26T21:13:18.540 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.446+0000 7f8d78c00700 1 -- 172.21.15.84:0/4082002307 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f8d70010920 con 0x7f8d7c078c10 2024-04-26T21:13:18.540 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.446+0000 7f8d78c00700 1 --2- 172.21.15.84:0/4082002307 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f8d640368a0 0x7f8d64038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:18.540 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.446+0000 7f8d78c00700 1 -- 172.21.15.84:0/4082002307 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f8d7001e070 con 0x7f8d7c078c10 2024-04-26T21:13:18.540 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.447+0000 7f8d7be00700 1 --2- 172.21.15.84:0/4082002307 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f8d640368a0 0x7f8d64038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:18.540 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.448+0000 7f8d7be00700 1 --2- 172.21.15.84:0/4082002307 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f8d640368a0 0x7f8d64038d50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009990 tx=0x7f8d68006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:18.540 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.452+0000 7f8d78c00700 1 -- 172.21.15.84:0/4082002307 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8d70029340 con 0x7f8d7c078c10 2024-04-26T21:13:18.540 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.681+0000 7f8d82200700 1 -- 172.21.15.84:0/4082002307 --> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d7c0ff140 con 0x7f8d640368a0 2024-04-26T21:13:18.541 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.690+0000 7f8d78c00700 1 -- 172.21.15.84:0/4082002307 <== mgr.14120 v2:172.21.15.84:6800/2151160823 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f8d7c0ff140 con 0x7f8d640368a0 2024-04-26T21:13:18.541 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.693+0000 7f8d82200700 1 -- 172.21.15.84:0/4082002307 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f8d640368a0 msgr2=0x7f8d64038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:18.541 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.693+0000 7f8d82200700 1 --2- 172.21.15.84:0/4082002307 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f8d640368a0 0x7f8d64038d50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009990 tx=0x7f8d68006e40 comp rx=0 tx=0).stop 2024-04-26T21:13:18.541 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.693+0000 7f8d82200700 1 -- 172.21.15.84:0/4082002307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c078c10 msgr2=0x7f8d7c1136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:18.541 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.693+0000 7f8d82200700 1 --2- 172.21.15.84:0/4082002307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c078c10 0x7f8d7c1136c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8d70006d40 tx=0x7f8d70009250 comp rx=0 tx=0).stop 2024-04-26T21:13:18.541 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.693+0000 7f8d82200700 1 -- 172.21.15.84:0/4082002307 shutdown_connections 2024-04-26T21:13:18.541 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.693+0000 7f8d82200700 1 --2- 172.21.15.84:0/4082002307 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f8d640368a0 0x7f8d64038d50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:18.541 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.693+0000 7f8d82200700 1 --2- 172.21.15.84:0/4082002307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c078c10 0x7f8d7c1136c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:18.541 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.693+0000 7f8d82200700 1 -- 172.21.15.84:0/4082002307 >> 172.21.15.84:0/4082002307 conn(0x7f8d7c0fdee0 msgr2=0x7f8d7c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:18.541 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.693+0000 7f8d82200700 1 -- 172.21.15.84:0/4082002307 shutdown_connections 2024-04-26T21:13:18.541 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:17.693+0000 7f8d82200700 1 -- 172.21.15.84:0/4082002307 wait complete. 2024-04-26T21:13:18.541 INFO:teuthology.orchestra.run.smithi084.stdout:Deploying mgr service with default placement... 2024-04-26T21:13:18.821 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:18 smithi084 ceph-mon[25539]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:18.821 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:18 smithi084 ceph-mon[25539]: Saving service mon spec with placement count:5 2024-04-26T21:13:18.821 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:18 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:20.860 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:20 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:20.860 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:20 smithi084 ceph-mon[25539]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:20.860 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:20 smithi084 ceph-mon[25539]: Saving service mgr spec with placement count:2 2024-04-26T21:13:20.860 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:20 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:20.860 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:20 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:20.871 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-26T21:13:20.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.955+0000 7f5f1f400700 1 Processor -- start 2024-04-26T21:13:20.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.955+0000 7f5f1f400700 1 -- start start 2024-04-26T21:13:20.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.956+0000 7f5f1f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18104bd0 0x7f5f18104fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:20.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.956+0000 7f5f1f400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f181055b0 con 0x7f5f18104bd0 2024-04-26T21:13:20.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.956+0000 7f5f1ca00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18104bd0 0x7f5f18104fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:20.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.956+0000 7f5f1ca00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18104bd0 0x7f5f18104fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34094/0 (socket says 172.21.15.84:34094) 2024-04-26T21:13:20.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.956+0000 7f5f1ca00700 1 -- 172.21.15.84:0/1739114388 learned_addr learned my addr 172.21.15.84:0/1739114388 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:20.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.957+0000 7f5f1ca00700 1 -- 172.21.15.84:0/1739114388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f181056f0 con 0x7f5f18104bd0 2024-04-26T21:13:20.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.957+0000 7f5f1ca00700 1 --2- 172.21.15.84:0/1739114388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18104bd0 0x7f5f18104fe0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c0098e0 tx=0x7f5f0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a79b0734c809e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:20.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.957+0000 7f5f17400700 1 -- 172.21.15.84:0/1739114388 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f0c00b860 con 0x7f5f18104bd0 2024-04-26T21:13:20.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.957+0000 7f5f17400700 1 -- 172.21.15.84:0/1739114388 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5f0c00be90 con 0x7f5f18104bd0 2024-04-26T21:13:20.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.957+0000 7f5f17400700 1 -- 172.21.15.84:0/1739114388 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f0c0103c0 con 0x7f5f18104bd0 2024-04-26T21:13:20.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.958+0000 7f5f1f400700 1 -- 172.21.15.84:0/1739114388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18104bd0 msgr2=0x7f5f18104fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:20.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.958+0000 7f5f1f400700 1 --2- 172.21.15.84:0/1739114388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18104bd0 0x7f5f18104fe0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c0098e0 tx=0x7f5f0c009250 comp rx=0 tx=0).stop 2024-04-26T21:13:20.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.958+0000 7f5f1f400700 1 -- 172.21.15.84:0/1739114388 shutdown_connections 2024-04-26T21:13:20.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.958+0000 7f5f1f400700 1 --2- 172.21.15.84:0/1739114388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18104bd0 0x7f5f18104fe0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:20.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.958+0000 7f5f1f400700 1 -- 172.21.15.84:0/1739114388 >> 172.21.15.84:0/1739114388 conn(0x7f5f18078300 msgr2=0x7f5f18078700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:20.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.958+0000 7f5f1f400700 1 -- 172.21.15.84:0/1739114388 shutdown_connections 2024-04-26T21:13:20.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.958+0000 7f5f1f400700 1 -- 172.21.15.84:0/1739114388 wait complete. 2024-04-26T21:13:20.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.959+0000 7f5f1f400700 1 Processor -- start 2024-04-26T21:13:20.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.959+0000 7f5f1f400700 1 -- start start 2024-04-26T21:13:20.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.959+0000 7f5f1f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18104bd0 0x7f5f18113800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:20.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.959+0000 7f5f1f400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18113d40 con 0x7f5f18104bd0 2024-04-26T21:13:20.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.960+0000 7f5f1ca00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18104bd0 0x7f5f18113800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:20.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.960+0000 7f5f1ca00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18104bd0 0x7f5f18113800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34102/0 (socket says 172.21.15.84:34102) 2024-04-26T21:13:20.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.960+0000 7f5f1ca00700 1 -- 172.21.15.84:0/2077792186 learned_addr learned my addr 172.21.15.84:0/2077792186 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:20.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.960+0000 7f5f1ca00700 1 -- 172.21.15.84:0/2077792186 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c0094f0 con 0x7f5f18104bd0 2024-04-26T21:13:20.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.960+0000 7f5f1ca00700 1 --2- 172.21.15.84:0/2077792186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18104bd0 0x7f5f18113800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c011680 tx=0x7f5f0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:20.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.961+0000 7f5f14c00700 1 -- 172.21.15.84:0/2077792186 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f0c010890 con 0x7f5f18104bd0 2024-04-26T21:13:20.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.961+0000 7f5f14c00700 1 -- 172.21.15.84:0/2077792186 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5f0c010ec0 con 0x7f5f18104bd0 2024-04-26T21:13:20.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.961+0000 7f5f14c00700 1 -- 172.21.15.84:0/2077792186 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f0c0243f0 con 0x7f5f18104bd0 2024-04-26T21:13:20.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.961+0000 7f5f1f400700 1 -- 172.21.15.84:0/2077792186 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f18113f40 con 0x7f5f18104bd0 2024-04-26T21:13:20.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.961+0000 7f5f1f400700 1 -- 172.21.15.84:0/2077792186 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f18114ab0 con 0x7f5f18104bd0 2024-04-26T21:13:20.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.962+0000 7f5f14c00700 1 -- 172.21.15.84:0/2077792186 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f5f0c01a8c0 con 0x7f5f18104bd0 2024-04-26T21:13:20.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.962+0000 7f5f1f400700 1 -- 172.21.15.84:0/2077792186 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1805f5c0 con 0x7f5f18104bd0 2024-04-26T21:13:20.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.962+0000 7f5f14c00700 1 --2- 172.21.15.84:0/2077792186 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f5f00036850 0x7f5f00038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:20.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.962+0000 7f5f14c00700 1 -- 172.21.15.84:0/2077792186 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f5f0c04a2f0 con 0x7f5f18104bd0 2024-04-26T21:13:20.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.963+0000 7f5f17e00700 1 --2- 172.21.15.84:0/2077792186 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f5f00036850 0x7f5f00038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:20.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.963+0000 7f5f17e00700 1 --2- 172.21.15.84:0/2077792186 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f5f00036850 0x7f5f00038d00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009990 tx=0x7f5f04006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:20.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:19.968+0000 7f5f14c00700 1 -- 172.21.15.84:0/2077792186 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5f0c02b8e0 con 0x7f5f18104bd0 2024-04-26T21:13:20.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:20.195+0000 7f5f1f400700 1 -- 172.21.15.84:0/2077792186 --> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f18102b00 con 0x7f5f00036850 2024-04-26T21:13:20.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:20.203+0000 7f5f14c00700 1 -- 172.21.15.84:0/2077792186 <== mgr.14120 v2:172.21.15.84:6800/2151160823 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f5f18102b00 con 0x7f5f00036850 2024-04-26T21:13:20.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:20.206+0000 7f5f1f400700 1 -- 172.21.15.84:0/2077792186 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f5f00036850 msgr2=0x7f5f00038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:20.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:20.206+0000 7f5f1f400700 1 --2- 172.21.15.84:0/2077792186 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f5f00036850 0x7f5f00038d00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009990 tx=0x7f5f04006e40 comp rx=0 tx=0).stop 2024-04-26T21:13:20.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:20.206+0000 7f5f1f400700 1 -- 172.21.15.84:0/2077792186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18104bd0 msgr2=0x7f5f18113800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:20.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:20.206+0000 7f5f1f400700 1 --2- 172.21.15.84:0/2077792186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18104bd0 0x7f5f18113800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c011680 tx=0x7f5f0c009250 comp rx=0 tx=0).stop 2024-04-26T21:13:20.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:20.206+0000 7f5f1f400700 1 -- 172.21.15.84:0/2077792186 shutdown_connections 2024-04-26T21:13:20.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:20.206+0000 7f5f1f400700 1 --2- 172.21.15.84:0/2077792186 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f5f00036850 0x7f5f00038d00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:20.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:20.206+0000 7f5f1f400700 1 --2- 172.21.15.84:0/2077792186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f18104bd0 0x7f5f18113800 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:20.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:20.206+0000 7f5f1f400700 1 -- 172.21.15.84:0/2077792186 >> 172.21.15.84:0/2077792186 conn(0x7f5f18078300 msgr2=0x7f5f181023f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:20.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:20.206+0000 7f5f1f400700 1 -- 172.21.15.84:0/2077792186 shutdown_connections 2024-04-26T21:13:20.881 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:20.207+0000 7f5f1f400700 1 -- 172.21.15.84:0/2077792186 wait complete. 2024-04-26T21:13:20.881 INFO:teuthology.orchestra.run.smithi084.stdout:Deploying crash service with default placement... 2024-04-26T21:13:22.562 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-04-26T21:13:22.562 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.490+0000 7fd55d800700 1 Processor -- start 2024-04-26T21:13:22.562 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.490+0000 7fd55d800700 1 -- start start 2024-04-26T21:13:22.562 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.490+0000 7fd55d800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd558101760 0x7fd558101b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:22.562 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.490+0000 7fd55d800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5581020b0 con 0x7fd558101760 2024-04-26T21:13:22.562 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.491+0000 7fd556a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd558101760 0x7fd558101b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:22.562 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.491+0000 7fd556a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd558101760 0x7fd558101b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34104/0 (socket says 172.21.15.84:34104) 2024-04-26T21:13:22.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.491+0000 7fd556a00700 1 -- 172.21.15.84:0/151253133 learned_addr learned my addr 172.21.15.84:0/151253133 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:22.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.491+0000 7fd556a00700 1 -- 172.21.15.84:0/151253133 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5581021f0 con 0x7fd558101760 2024-04-26T21:13:22.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.492+0000 7fd556a00700 1 --2- 172.21.15.84:0/151253133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd558101760 0x7fd558101b70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd5480098e0 tx=0x7fd548009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4638e9256ebf56 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:22.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.492+0000 7fd555600700 1 -- 172.21.15.84:0/151253133 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd54800b860 con 0x7fd558101760 2024-04-26T21:13:22.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.492+0000 7fd555600700 1 -- 172.21.15.84:0/151253133 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd54800be90 con 0x7fd558101760 2024-04-26T21:13:22.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.492+0000 7fd555600700 1 -- 172.21.15.84:0/151253133 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5480103c0 con 0x7fd558101760 2024-04-26T21:13:22.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.493+0000 7fd55d800700 1 -- 172.21.15.84:0/151253133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd558101760 msgr2=0x7fd558101b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:22.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.493+0000 7fd55d800700 1 --2- 172.21.15.84:0/151253133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd558101760 0x7fd558101b70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd5480098e0 tx=0x7fd548009250 comp rx=0 tx=0).stop 2024-04-26T21:13:22.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.493+0000 7fd55d800700 1 -- 172.21.15.84:0/151253133 shutdown_connections 2024-04-26T21:13:22.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.493+0000 7fd55d800700 1 --2- 172.21.15.84:0/151253133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd558101760 0x7fd558101b70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:22.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.493+0000 7fd55d800700 1 -- 172.21.15.84:0/151253133 >> 172.21.15.84:0/151253133 conn(0x7fd5580fcea0 msgr2=0x7fd5580ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:22.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.493+0000 7fd55d800700 1 -- 172.21.15.84:0/151253133 shutdown_connections 2024-04-26T21:13:22.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.493+0000 7fd55d800700 1 -- 172.21.15.84:0/151253133 wait complete. 2024-04-26T21:13:22.563 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.495+0000 7fd55d800700 1 Processor -- start 2024-04-26T21:13:22.564 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.495+0000 7fd55d800700 1 -- start start 2024-04-26T21:13:22.564 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.495+0000 7fd55d800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd558101760 0x7fd558071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:22.564 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.495+0000 7fd55d800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd558114330 con 0x7fd558101760 2024-04-26T21:13:22.564 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.496+0000 7fd556a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd558101760 0x7fd558071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:22.564 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.496+0000 7fd556a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd558101760 0x7fd558071210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34116/0 (socket says 172.21.15.84:34116) 2024-04-26T21:13:22.564 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.496+0000 7fd556a00700 1 -- 172.21.15.84:0/1583597386 learned_addr learned my addr 172.21.15.84:0/1583597386 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:22.564 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.496+0000 7fd556a00700 1 -- 172.21.15.84:0/1583597386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5480094f0 con 0x7fd558101760 2024-04-26T21:13:22.564 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.497+0000 7fd556a00700 1 --2- 172.21.15.84:0/1583597386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd558101760 0x7fd558071210 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd5480090b0 tx=0x7fd548009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:22.564 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.497+0000 7fd54ea00700 1 -- 172.21.15.84:0/1583597386 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd548010840 con 0x7fd558101760 2024-04-26T21:13:22.564 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.497+0000 7fd54ea00700 1 -- 172.21.15.84:0/1583597386 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd548010e70 con 0x7fd558101760 2024-04-26T21:13:22.564 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.497+0000 7fd55d800700 1 -- 172.21.15.84:0/1583597386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd558114470 con 0x7fd558101760 2024-04-26T21:13:22.564 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.497+0000 7fd55d800700 1 -- 172.21.15.84:0/1583597386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd558114900 con 0x7fd558101760 2024-04-26T21:13:22.564 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.497+0000 7fd54ea00700 1 -- 172.21.15.84:0/1583597386 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd548024e40 con 0x7fd558101760 2024-04-26T21:13:22.564 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.498+0000 7fd54ea00700 1 -- 172.21.15.84:0/1583597386 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fd5480109a0 con 0x7fd558101760 2024-04-26T21:13:22.565 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.498+0000 7fd55d800700 1 -- 172.21.15.84:0/1583597386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd55804bed0 con 0x7fd558101760 2024-04-26T21:13:22.565 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.499+0000 7fd54ea00700 1 --2- 172.21.15.84:0/1583597386 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fd53c036850 0x7fd53c038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:22.565 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.499+0000 7fd54ea00700 1 -- 172.21.15.84:0/1583597386 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd54804a7c0 con 0x7fd558101760 2024-04-26T21:13:22.565 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.499+0000 7fd556000700 1 --2- 172.21.15.84:0/1583597386 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fd53c036850 0x7fd53c038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:22.565 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.500+0000 7fd556000700 1 --2- 172.21.15.84:0/1583597386 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fd53c036850 0x7fd53c038d00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd544009990 tx=0x7fd544006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:22.565 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.504+0000 7fd54ea00700 1 -- 172.21.15.84:0/1583597386 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd54802c930 con 0x7fd558101760 2024-04-26T21:13:22.565 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.743+0000 7fd55d800700 1 -- 172.21.15.84:0/1583597386 --> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5580fe0d0 con 0x7fd53c036850 2024-04-26T21:13:22.565 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.752+0000 7fd54ea00700 1 -- 172.21.15.84:0/1583597386 <== mgr.14120 v2:172.21.15.84:6800/2151160823 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fd5580fe0d0 con 0x7fd53c036850 2024-04-26T21:13:22.565 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.755+0000 7fd55d800700 1 -- 172.21.15.84:0/1583597386 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fd53c036850 msgr2=0x7fd53c038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:22.565 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.755+0000 7fd55d800700 1 --2- 172.21.15.84:0/1583597386 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fd53c036850 0x7fd53c038d00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd544009990 tx=0x7fd544006e40 comp rx=0 tx=0).stop 2024-04-26T21:13:22.565 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.755+0000 7fd55d800700 1 -- 172.21.15.84:0/1583597386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd558101760 msgr2=0x7fd558071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:22.565 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.755+0000 7fd55d800700 1 --2- 172.21.15.84:0/1583597386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd558101760 0x7fd558071210 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd5480090b0 tx=0x7fd548009250 comp rx=0 tx=0).stop 2024-04-26T21:13:22.565 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.755+0000 7fd55d800700 1 -- 172.21.15.84:0/1583597386 shutdown_connections 2024-04-26T21:13:22.565 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.755+0000 7fd55d800700 1 --2- 172.21.15.84:0/1583597386 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fd53c036850 0x7fd53c038d00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:22.565 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.755+0000 7fd55d800700 1 --2- 172.21.15.84:0/1583597386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd558101760 0x7fd558071210 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:22.566 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.755+0000 7fd55d800700 1 -- 172.21.15.84:0/1583597386 >> 172.21.15.84:0/1583597386 conn(0x7fd5580fcea0 msgr2=0x7fd5580fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:22.566 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.756+0000 7fd55d800700 1 -- 172.21.15.84:0/1583597386 shutdown_connections 2024-04-26T21:13:22.566 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:21.756+0000 7fd55d800700 1 -- 172.21.15.84:0/1583597386 wait complete. 2024-04-26T21:13:22.566 INFO:teuthology.orchestra.run.smithi084.stdout:Deploying prometheus service with default placement... 2024-04-26T21:13:22.826 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:22 smithi084 ceph-mon[25539]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:22.826 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:22 smithi084 ceph-mon[25539]: Saving service crash spec with placement * 2024-04-26T21:13:22.826 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:22 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:24.300 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-04-26T21:13:24.300 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.420+0000 7fcbff200700 1 Processor -- start 2024-04-26T21:13:24.300 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.420+0000 7fcbff200700 1 -- start start 2024-04-26T21:13:24.301 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.420+0000 7fcbff200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0007c7f0 0x7fcc0007cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:24.301 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.420+0000 7fcbff200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0007d1d0 con 0x7fcc0007c7f0 2024-04-26T21:13:24.301 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.421+0000 7fcbfde00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0007c7f0 0x7fcc0007cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:24.301 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.421+0000 7fcbfde00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0007c7f0 0x7fcc0007cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57186/0 (socket says 172.21.15.84:57186) 2024-04-26T21:13:24.301 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.421+0000 7fcbfde00700 1 -- 172.21.15.84:0/2735022078 learned_addr learned my addr 172.21.15.84:0/2735022078 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:24.301 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.421+0000 7fcbfde00700 1 -- 172.21.15.84:0/2735022078 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0007d310 con 0x7fcc0007c7f0 2024-04-26T21:13:24.301 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.422+0000 7fcbfde00700 1 --2- 172.21.15.84:0/2735022078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0007c7f0 0x7fcc0007cc00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00098e0 tx=0x7fcbf0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4381703cbfdab2d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:24.301 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.422+0000 7fcbfca00700 1 -- 172.21.15.84:0/2735022078 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbf000b860 con 0x7fcc0007c7f0 2024-04-26T21:13:24.301 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.422+0000 7fcbfca00700 1 -- 172.21.15.84:0/2735022078 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcbf000be90 con 0x7fcc0007c7f0 2024-04-26T21:13:24.301 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.422+0000 7fcbfca00700 1 -- 172.21.15.84:0/2735022078 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbf00103c0 con 0x7fcc0007c7f0 2024-04-26T21:13:24.301 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.423+0000 7fcbff200700 1 -- 172.21.15.84:0/2735022078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0007c7f0 msgr2=0x7fcc0007cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:24.302 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.423+0000 7fcbff200700 1 --2- 172.21.15.84:0/2735022078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0007c7f0 0x7fcc0007cc00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00098e0 tx=0x7fcbf0009250 comp rx=0 tx=0).stop 2024-04-26T21:13:24.302 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.423+0000 7fcbff200700 1 -- 172.21.15.84:0/2735022078 shutdown_connections 2024-04-26T21:13:24.302 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.423+0000 7fcbff200700 1 --2- 172.21.15.84:0/2735022078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0007c7f0 0x7fcc0007cc00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:24.302 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.423+0000 7fcbff200700 1 -- 172.21.15.84:0/2735022078 >> 172.21.15.84:0/2735022078 conn(0x7fcc00078110 msgr2=0x7fcc0007a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:24.302 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.423+0000 7fcbff200700 1 -- 172.21.15.84:0/2735022078 shutdown_connections 2024-04-26T21:13:24.302 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.423+0000 7fcbff200700 1 -- 172.21.15.84:0/2735022078 wait complete. 2024-04-26T21:13:24.302 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.424+0000 7fcbff200700 1 Processor -- start 2024-04-26T21:13:24.302 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.424+0000 7fcbff200700 1 -- start start 2024-04-26T21:13:24.302 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.424+0000 7fcbff200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0007c7f0 0x7fcc001179f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:24.302 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.424+0000 7fcbff200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00117f30 con 0x7fcc0007c7f0 2024-04-26T21:13:24.302 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.424+0000 7fcbfde00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0007c7f0 0x7fcc001179f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:24.302 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.424+0000 7fcbfde00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0007c7f0 0x7fcc001179f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57188/0 (socket says 172.21.15.84:57188) 2024-04-26T21:13:24.302 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.424+0000 7fcbfde00700 1 -- 172.21.15.84:0/1984462511 learned_addr learned my addr 172.21.15.84:0/1984462511 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:24.303 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.425+0000 7fcbfde00700 1 -- 172.21.15.84:0/1984462511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf00094f0 con 0x7fcc0007c7f0 2024-04-26T21:13:24.303 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.425+0000 7fcbfde00700 1 --2- 172.21.15.84:0/1984462511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0007c7f0 0x7fcc001179f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0006d40 tx=0x7fcbf0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:24.303 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.425+0000 7fcbf6000700 1 -- 172.21.15.84:0/1984462511 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbf0010840 con 0x7fcc0007c7f0 2024-04-26T21:13:24.303 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.425+0000 7fcbf6000700 1 -- 172.21.15.84:0/1984462511 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcbf0010e70 con 0x7fcc0007c7f0 2024-04-26T21:13:24.303 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.425+0000 7fcbf6000700 1 -- 172.21.15.84:0/1984462511 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbf0024ea0 con 0x7fcc0007c7f0 2024-04-26T21:13:24.303 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.425+0000 7fcbff200700 1 -- 172.21.15.84:0/1984462511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc00118130 con 0x7fcc0007c7f0 2024-04-26T21:13:24.303 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.425+0000 7fcbff200700 1 -- 172.21.15.84:0/1984462511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc00118ca0 con 0x7fcc0007c7f0 2024-04-26T21:13:24.303 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.426+0000 7fcbf6000700 1 -- 172.21.15.84:0/1984462511 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fcbf0024780 con 0x7fcc0007c7f0 2024-04-26T21:13:24.303 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.427+0000 7fcbff200700 1 -- 172.21.15.84:0/1984462511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc0005f5c0 con 0x7fcc0007c7f0 2024-04-26T21:13:24.303 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.427+0000 7fcbf6000700 1 --2- 172.21.15.84:0/1984462511 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fcbe4036800 0x7fcbe4038cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:24.303 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.427+0000 7fcbf6000700 1 -- 172.21.15.84:0/1984462511 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fcbf004a770 con 0x7fcc0007c7f0 2024-04-26T21:13:24.303 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.427+0000 7fcbfd400700 1 --2- 172.21.15.84:0/1984462511 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fcbe4036800 0x7fcbe4038cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:24.303 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.428+0000 7fcbfd400700 1 --2- 172.21.15.84:0/1984462511 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fcbe4036800 0x7fcbe4038cb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009990 tx=0x7fcbec006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:24.303 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.432+0000 7fcbf6000700 1 -- 172.21.15.84:0/1984462511 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fcbf002c930 con 0x7fcc0007c7f0 2024-04-26T21:13:24.304 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.659+0000 7fcbff200700 1 -- 172.21.15.84:0/1984462511 --> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc0007a300 con 0x7fcbe4036800 2024-04-26T21:13:24.304 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.665+0000 7fcbf6000700 1 -- 172.21.15.84:0/1984462511 <== mgr.14120 v2:172.21.15.84:6800/2151160823 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fcc0007a300 con 0x7fcbe4036800 2024-04-26T21:13:24.304 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.668+0000 7fcbff200700 1 -- 172.21.15.84:0/1984462511 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fcbe4036800 msgr2=0x7fcbe4038cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:24.304 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.668+0000 7fcbff200700 1 --2- 172.21.15.84:0/1984462511 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fcbe4036800 0x7fcbe4038cb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009990 tx=0x7fcbec006e40 comp rx=0 tx=0).stop 2024-04-26T21:13:24.304 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.668+0000 7fcbff200700 1 -- 172.21.15.84:0/1984462511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0007c7f0 msgr2=0x7fcc001179f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:24.304 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.668+0000 7fcbff200700 1 --2- 172.21.15.84:0/1984462511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0007c7f0 0x7fcc001179f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0006d40 tx=0x7fcbf0009250 comp rx=0 tx=0).stop 2024-04-26T21:13:24.304 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.668+0000 7fcbff200700 1 -- 172.21.15.84:0/1984462511 shutdown_connections 2024-04-26T21:13:24.304 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.668+0000 7fcbff200700 1 --2- 172.21.15.84:0/1984462511 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fcbe4036800 0x7fcbe4038cb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:24.304 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.668+0000 7fcbff200700 1 --2- 172.21.15.84:0/1984462511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0007c7f0 0x7fcc001179f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:24.304 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.668+0000 7fcbff200700 1 -- 172.21.15.84:0/1984462511 >> 172.21.15.84:0/1984462511 conn(0x7fcc00078110 msgr2=0x7fcc00079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:24.304 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.668+0000 7fcbff200700 1 -- 172.21.15.84:0/1984462511 shutdown_connections 2024-04-26T21:13:24.304 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:23.668+0000 7fcbff200700 1 -- 172.21.15.84:0/1984462511 wait complete. 2024-04-26T21:13:24.304 INFO:teuthology.orchestra.run.smithi084.stdout:Deploying grafana service with default placement... 2024-04-26T21:13:24.786 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:24 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:24.786 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:24 smithi084 ceph-mon[25539]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:13:24.786 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:24 smithi084 ceph-mon[25539]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:24.786 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:24 smithi084 ceph-mon[25539]: Saving service prometheus spec with placement count:1 2024-04-26T21:13:24.786 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:24 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:25.789 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-04-26T21:13:25.789 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.844+0000 7f3211a00700 1 Processor -- start 2024-04-26T21:13:25.789 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.844+0000 7f3211a00700 1 -- start start 2024-04-26T21:13:25.789 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.845+0000 7f3211a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f320c078cc0 0x7f320c077270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:25.789 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.845+0000 7f3211a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320c0790d0 con 0x7f320c078cc0 2024-04-26T21:13:25.789 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.845+0000 7f320aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f320c078cc0 0x7f320c077270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:25.790 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.845+0000 7f320aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f320c078cc0 0x7f320c077270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57204/0 (socket says 172.21.15.84:57204) 2024-04-26T21:13:25.790 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.845+0000 7f320aa00700 1 -- 172.21.15.84:0/1164328930 learned_addr learned my addr 172.21.15.84:0/1164328930 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:25.790 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.846+0000 7f320aa00700 1 -- 172.21.15.84:0/1164328930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320c0777b0 con 0x7f320c078cc0 2024-04-26T21:13:25.790 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.846+0000 7f320aa00700 1 --2- 172.21.15.84:0/1164328930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f320c078cc0 0x7f320c077270 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0098e0 tx=0x7f31fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6c42bb8772f52f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:25.790 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.846+0000 7f3209600700 1 -- 172.21.15.84:0/1164328930 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31fc00b860 con 0x7f320c078cc0 2024-04-26T21:13:25.790 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.846+0000 7f3209600700 1 -- 172.21.15.84:0/1164328930 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f31fc00be90 con 0x7f320c078cc0 2024-04-26T21:13:25.790 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.846+0000 7f3209600700 1 -- 172.21.15.84:0/1164328930 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31fc0103c0 con 0x7f320c078cc0 2024-04-26T21:13:25.790 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.847+0000 7f3211a00700 1 -- 172.21.15.84:0/1164328930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f320c078cc0 msgr2=0x7f320c077270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:25.790 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.847+0000 7f3211a00700 1 --2- 172.21.15.84:0/1164328930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f320c078cc0 0x7f320c077270 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0098e0 tx=0x7f31fc009250 comp rx=0 tx=0).stop 2024-04-26T21:13:25.790 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.847+0000 7f3211a00700 1 -- 172.21.15.84:0/1164328930 shutdown_connections 2024-04-26T21:13:25.790 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.847+0000 7f3211a00700 1 --2- 172.21.15.84:0/1164328930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f320c078cc0 0x7f320c077270 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:25.790 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.847+0000 7f3211a00700 1 -- 172.21.15.84:0/1164328930 >> 172.21.15.84:0/1164328930 conn(0x7f320c0fe070 msgr2=0x7f320c100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:25.791 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.847+0000 7f3211a00700 1 -- 172.21.15.84:0/1164328930 shutdown_connections 2024-04-26T21:13:25.791 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.847+0000 7f3211a00700 1 -- 172.21.15.84:0/1164328930 wait complete. 2024-04-26T21:13:25.791 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.849+0000 7f3211a00700 1 Processor -- start 2024-04-26T21:13:25.791 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.849+0000 7f3211a00700 1 -- start start 2024-04-26T21:13:25.791 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.849+0000 7f3211a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f320c078cc0 0x7f320c113810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:25.791 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.849+0000 7f3211a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320c113d50 con 0x7f320c078cc0 2024-04-26T21:13:25.791 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.849+0000 7f320aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f320c078cc0 0x7f320c113810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:25.791 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.850+0000 7f320aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f320c078cc0 0x7f320c113810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57212/0 (socket says 172.21.15.84:57212) 2024-04-26T21:13:25.791 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.850+0000 7f320aa00700 1 -- 172.21.15.84:0/3158474072 learned_addr learned my addr 172.21.15.84:0/3158474072 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:25.791 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.850+0000 7f320aa00700 1 -- 172.21.15.84:0/3158474072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc0094f0 con 0x7f320c078cc0 2024-04-26T21:13:25.791 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.850+0000 7f320aa00700 1 --2- 172.21.15.84:0/3158474072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f320c078cc0 0x7f320c113810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f31fc006d40 tx=0x7f31fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:25.791 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.850+0000 7f3202a00700 1 -- 172.21.15.84:0/3158474072 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31fc010840 con 0x7f320c078cc0 2024-04-26T21:13:25.791 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.851+0000 7f3202a00700 1 -- 172.21.15.84:0/3158474072 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f31fc010e70 con 0x7f320c078cc0 2024-04-26T21:13:25.791 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.851+0000 7f3211a00700 1 -- 172.21.15.84:0/3158474072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320c113f50 con 0x7f320c078cc0 2024-04-26T21:13:25.792 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.851+0000 7f3202a00700 1 -- 172.21.15.84:0/3158474072 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31fc024ea0 con 0x7f320c078cc0 2024-04-26T21:13:25.792 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.851+0000 7f3211a00700 1 -- 172.21.15.84:0/3158474072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320c114ac0 con 0x7f320c078cc0 2024-04-26T21:13:25.792 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.852+0000 7f3211a00700 1 -- 172.21.15.84:0/3158474072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320c05f5c0 con 0x7f320c078cc0 2024-04-26T21:13:25.792 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.852+0000 7f3202a00700 1 -- 172.21.15.84:0/3158474072 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f31fc024780 con 0x7f320c078cc0 2024-04-26T21:13:25.792 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.852+0000 7f3202a00700 1 --2- 172.21.15.84:0/3158474072 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f31f0036850 0x7f31f0038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:25.792 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.852+0000 7f3202a00700 1 -- 172.21.15.84:0/3158474072 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f31fc04a680 con 0x7f320c078cc0 2024-04-26T21:13:25.792 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.853+0000 7f320a000700 1 --2- 172.21.15.84:0/3158474072 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f31f0036850 0x7f31f0038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:25.792 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.853+0000 7f320a000700 1 --2- 172.21.15.84:0/3158474072 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f31f0036850 0x7f31f0038d00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009990 tx=0x7f31f8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:25.792 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:24.857+0000 7f3202a00700 1 -- 172.21.15.84:0/3158474072 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f31fc02c910 con 0x7f320c078cc0 2024-04-26T21:13:25.792 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:25.084+0000 7f3211a00700 1 -- 172.21.15.84:0/3158474072 --> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f320c0ff2b0 con 0x7f31f0036850 2024-04-26T21:13:25.792 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:25.089+0000 7f3202a00700 1 -- 172.21.15.84:0/3158474072 <== mgr.14120 v2:172.21.15.84:6800/2151160823 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f320c0ff2b0 con 0x7f31f0036850 2024-04-26T21:13:25.792 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:25.092+0000 7f3211a00700 1 -- 172.21.15.84:0/3158474072 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f31f0036850 msgr2=0x7f31f0038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:25.792 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:25.092+0000 7f3211a00700 1 --2- 172.21.15.84:0/3158474072 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f31f0036850 0x7f31f0038d00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009990 tx=0x7f31f8006e40 comp rx=0 tx=0).stop 2024-04-26T21:13:25.792 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:25.092+0000 7f3211a00700 1 -- 172.21.15.84:0/3158474072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f320c078cc0 msgr2=0x7f320c113810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:25.792 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:25.092+0000 7f3211a00700 1 --2- 172.21.15.84:0/3158474072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f320c078cc0 0x7f320c113810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f31fc006d40 tx=0x7f31fc009250 comp rx=0 tx=0).stop 2024-04-26T21:13:25.793 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:25.092+0000 7f3211a00700 1 -- 172.21.15.84:0/3158474072 shutdown_connections 2024-04-26T21:13:25.793 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:25.092+0000 7f3211a00700 1 --2- 172.21.15.84:0/3158474072 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f31f0036850 0x7f31f0038d00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:25.793 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:25.092+0000 7f3211a00700 1 --2- 172.21.15.84:0/3158474072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f320c078cc0 0x7f320c113810 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:25.793 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:25.092+0000 7f3211a00700 1 -- 172.21.15.84:0/3158474072 >> 172.21.15.84:0/3158474072 conn(0x7f320c0fe070 msgr2=0x7f320c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:25.793 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:25.092+0000 7f3211a00700 1 -- 172.21.15.84:0/3158474072 shutdown_connections 2024-04-26T21:13:25.793 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:25.092+0000 7f3211a00700 1 -- 172.21.15.84:0/3158474072 wait complete. 2024-04-26T21:13:25.793 INFO:teuthology.orchestra.run.smithi084.stdout:Deploying node-exporter service with default placement... 2024-04-26T21:13:26.367 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:26 smithi084 ceph-mon[25539]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:26.367 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:26 smithi084 ceph-mon[25539]: Saving service grafana spec with placement count:1 2024-04-26T21:13:26.367 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:26 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:26.367 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:26 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:27.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:27 smithi084 ceph-mon[25539]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:13:27.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:27 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:27.793 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-04-26T21:13:27.794 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.365+0000 7f6a93c00700 1 Processor -- start 2024-04-26T21:13:27.794 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.365+0000 7f6a93c00700 1 -- start start 2024-04-26T21:13:27.794 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.366+0000 7f6a93c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a8c101760 0x7f6a8c101b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:27.794 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.366+0000 7f6a93c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c1020b0 con 0x7f6a8c101760 2024-04-26T21:13:27.796 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.366+0000 7f6a91200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a8c101760 0x7f6a8c101b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:27.797 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.366+0000 7f6a91200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a8c101760 0x7f6a8c101b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57218/0 (socket says 172.21.15.84:57218) 2024-04-26T21:13:27.797 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.366+0000 7f6a91200700 1 -- 172.21.15.84:0/4230633667 learned_addr learned my addr 172.21.15.84:0/4230633667 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:27.797 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.367+0000 7f6a91200700 1 -- 172.21.15.84:0/4230633667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c1021f0 con 0x7f6a8c101760 2024-04-26T21:13:27.797 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.367+0000 7f6a91200700 1 --2- 172.21.15.84:0/4230633667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a8c101760 0x7f6a8c101b70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000bb80 tx=0x7f6a8000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9411a8c5d6a5d54 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:27.797 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.367+0000 7f6a8b400700 1 -- 172.21.15.84:0/4230633667 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a8000dd00 con 0x7f6a8c101760 2024-04-26T21:13:27.797 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.368+0000 7f6a8b400700 1 -- 172.21.15.84:0/4230633667 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a8000de60 con 0x7f6a8c101760 2024-04-26T21:13:27.797 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.368+0000 7f6a8b400700 1 -- 172.21.15.84:0/4230633667 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a80018920 con 0x7f6a8c101760 2024-04-26T21:13:27.797 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.369+0000 7f6a93c00700 1 -- 172.21.15.84:0/4230633667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a8c101760 msgr2=0x7f6a8c101b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:27.797 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.369+0000 7f6a93c00700 1 --2- 172.21.15.84:0/4230633667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a8c101760 0x7f6a8c101b70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000bb80 tx=0x7f6a8000b4f0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.797 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.369+0000 7f6a93c00700 1 -- 172.21.15.84:0/4230633667 shutdown_connections 2024-04-26T21:13:27.797 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.369+0000 7f6a93c00700 1 --2- 172.21.15.84:0/4230633667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a8c101760 0x7f6a8c101b70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.797 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.369+0000 7f6a93c00700 1 -- 172.21.15.84:0/4230633667 >> 172.21.15.84:0/4230633667 conn(0x7f6a8c0fcea0 msgr2=0x7f6a8c0ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:27.797 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.369+0000 7f6a93c00700 1 -- 172.21.15.84:0/4230633667 shutdown_connections 2024-04-26T21:13:27.798 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.369+0000 7f6a93c00700 1 -- 172.21.15.84:0/4230633667 wait complete. 2024-04-26T21:13:27.798 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.370+0000 7f6a93c00700 1 Processor -- start 2024-04-26T21:13:27.798 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.370+0000 7f6a93c00700 1 -- start start 2024-04-26T21:13:27.798 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.370+0000 7f6a93c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a8c101760 0x7f6a8c113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:27.798 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.370+0000 7f6a93c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c113cc0 con 0x7f6a8c101760 2024-04-26T21:13:27.798 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.371+0000 7f6a91200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a8c101760 0x7f6a8c113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:27.798 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.371+0000 7f6a91200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a8c101760 0x7f6a8c113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57226/0 (socket says 172.21.15.84:57226) 2024-04-26T21:13:27.798 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.371+0000 7f6a91200700 1 -- 172.21.15.84:0/4031467217 learned_addr learned my addr 172.21.15.84:0/4031467217 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:27.798 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.371+0000 7f6a91200700 1 -- 172.21.15.84:0/4031467217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8000b790 con 0x7f6a8c101760 2024-04-26T21:13:27.801 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.371+0000 7f6a91200700 1 --2- 172.21.15.84:0/4031467217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a8c101760 0x7f6a8c113780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6a800106a0 tx=0x7f6a8000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:27.801 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.372+0000 7f6a88c00700 1 -- 172.21.15.84:0/4031467217 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a80018e90 con 0x7f6a8c101760 2024-04-26T21:13:27.801 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.372+0000 7f6a88c00700 1 -- 172.21.15.84:0/4031467217 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a80010c30 con 0x7f6a8c101760 2024-04-26T21:13:27.801 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.372+0000 7f6a93c00700 1 -- 172.21.15.84:0/4031467217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8c113ec0 con 0x7f6a8c101760 2024-04-26T21:13:27.801 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.372+0000 7f6a88c00700 1 -- 172.21.15.84:0/4031467217 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a80021530 con 0x7f6a8c101760 2024-04-26T21:13:27.801 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.372+0000 7f6a93c00700 1 -- 172.21.15.84:0/4031467217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8c114a30 con 0x7f6a8c101760 2024-04-26T21:13:27.801 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.373+0000 7f6a88c00700 1 -- 172.21.15.84:0/4031467217 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f6a800223f0 con 0x7f6a8c101760 2024-04-26T21:13:27.801 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.374+0000 7f6a88c00700 1 --2- 172.21.15.84:0/4031467217 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f6a740368a0 0x7f6a74038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:27.802 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.374+0000 7f6a93c00700 1 -- 172.21.15.84:0/4031467217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8c05f5c0 con 0x7f6a8c101760 2024-04-26T21:13:27.802 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.374+0000 7f6a88c00700 1 -- 172.21.15.84:0/4031467217 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6a80014070 con 0x7f6a8c101760 2024-04-26T21:13:27.802 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.374+0000 7f6a8be00700 1 --2- 172.21.15.84:0/4031467217 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f6a740368a0 0x7f6a74038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:27.802 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.375+0000 7f6a8be00700 1 --2- 172.21.15.84:0/4031467217 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f6a740368a0 0x7f6a74038d50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009990 tx=0x7f6a78006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:27.802 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.379+0000 7f6a88c00700 1 -- 172.21.15.84:0/4031467217 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6a80022a50 con 0x7f6a8c101760 2024-04-26T21:13:27.802 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.604+0000 7f6a93c00700 1 -- 172.21.15.84:0/4031467217 --> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a8c114de0 con 0x7f6a740368a0 2024-04-26T21:13:27.802 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.610+0000 7f6a88c00700 1 -- 172.21.15.84:0/4031467217 <== mgr.14120 v2:172.21.15.84:6800/2151160823 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f6a8c114de0 con 0x7f6a740368a0 2024-04-26T21:13:27.802 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.613+0000 7f6a93c00700 1 -- 172.21.15.84:0/4031467217 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f6a740368a0 msgr2=0x7f6a74038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:27.802 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.613+0000 7f6a93c00700 1 --2- 172.21.15.84:0/4031467217 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f6a740368a0 0x7f6a74038d50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009990 tx=0x7f6a78006e40 comp rx=0 tx=0).stop 2024-04-26T21:13:27.802 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.613+0000 7f6a93c00700 1 -- 172.21.15.84:0/4031467217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a8c101760 msgr2=0x7f6a8c113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:27.802 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.613+0000 7f6a93c00700 1 --2- 172.21.15.84:0/4031467217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a8c101760 0x7f6a8c113780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6a800106a0 tx=0x7f6a8000b4f0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.802 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.613+0000 7f6a93c00700 1 -- 172.21.15.84:0/4031467217 shutdown_connections 2024-04-26T21:13:27.802 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.613+0000 7f6a93c00700 1 --2- 172.21.15.84:0/4031467217 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f6a740368a0 0x7f6a74038d50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.803 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.613+0000 7f6a93c00700 1 --2- 172.21.15.84:0/4031467217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a8c101760 0x7f6a8c113780 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.803 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.613+0000 7f6a93c00700 1 -- 172.21.15.84:0/4031467217 >> 172.21.15.84:0/4031467217 conn(0x7f6a8c0fcea0 msgr2=0x7f6a8c109fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:27.803 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.614+0000 7f6a93c00700 1 -- 172.21.15.84:0/4031467217 shutdown_connections 2024-04-26T21:13:27.803 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:26.614+0000 7f6a93c00700 1 -- 172.21.15.84:0/4031467217 wait complete. 2024-04-26T21:13:27.803 INFO:teuthology.orchestra.run.smithi084.stdout:Deploying alertmanager service with default placement... 2024-04-26T21:13:28.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:28 smithi084 ceph-mon[25539]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:28.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:28 smithi084 ceph-mon[25539]: Saving service node-exporter spec with placement * 2024-04-26T21:13:29.411 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:29 smithi084 ceph-mon[25539]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:13:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:29 smithi084 ceph-mon[25539]: from='mgr.14120 172.21.15.84:0/1754305192' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:29.767 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-04-26T21:13:29.767 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.749+0000 7fa436a00700 1 Processor -- start 2024-04-26T21:13:29.767 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.749+0000 7fa436a00700 1 -- start start 2024-04-26T21:13:29.767 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.750+0000 7fa436a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa430078d40 0x7fa430077250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:29.768 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.750+0000 7fa436a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa430079150 con 0x7fa430078d40 2024-04-26T21:13:29.768 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.750+0000 7fa42fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa430078d40 0x7fa430077250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:29.768 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.750+0000 7fa42fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa430078d40 0x7fa430077250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57232/0 (socket says 172.21.15.84:57232) 2024-04-26T21:13:29.768 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.750+0000 7fa42fe00700 1 -- 172.21.15.84:0/2669169000 learned_addr learned my addr 172.21.15.84:0/2669169000 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:29.768 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.751+0000 7fa42fe00700 1 -- 172.21.15.84:0/2669169000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa430077790 con 0x7fa430078d40 2024-04-26T21:13:29.768 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.751+0000 7fa42fe00700 1 --2- 172.21.15.84:0/2669169000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa430078d40 0x7fa430077250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa4200098e0 tx=0x7fa420009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4789971f961c1d95 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:29.768 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.751+0000 7fa42ea00700 1 -- 172.21.15.84:0/2669169000 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa42000b860 con 0x7fa430078d40 2024-04-26T21:13:29.768 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.751+0000 7fa42ea00700 1 -- 172.21.15.84:0/2669169000 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa42000be90 con 0x7fa430078d40 2024-04-26T21:13:29.768 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.751+0000 7fa42ea00700 1 -- 172.21.15.84:0/2669169000 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4200103c0 con 0x7fa430078d40 2024-04-26T21:13:29.768 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.752+0000 7fa436a00700 1 -- 172.21.15.84:0/2669169000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa430078d40 msgr2=0x7fa430077250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:29.768 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.752+0000 7fa436a00700 1 --2- 172.21.15.84:0/2669169000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa430078d40 0x7fa430077250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa4200098e0 tx=0x7fa420009250 comp rx=0 tx=0).stop 2024-04-26T21:13:29.768 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.752+0000 7fa436a00700 1 -- 172.21.15.84:0/2669169000 shutdown_connections 2024-04-26T21:13:29.768 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.752+0000 7fa436a00700 1 --2- 172.21.15.84:0/2669169000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa430078d40 0x7fa430077250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:29.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.752+0000 7fa436a00700 1 -- 172.21.15.84:0/2669169000 >> 172.21.15.84:0/2669169000 conn(0x7fa4300fdfd0 msgr2=0x7fa4301003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:29.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.752+0000 7fa436a00700 1 -- 172.21.15.84:0/2669169000 shutdown_connections 2024-04-26T21:13:29.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.753+0000 7fa436a00700 1 -- 172.21.15.84:0/2669169000 wait complete. 2024-04-26T21:13:29.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.753+0000 7fa436a00700 1 Processor -- start 2024-04-26T21:13:29.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.753+0000 7fa436a00700 1 -- start start 2024-04-26T21:13:29.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.754+0000 7fa436a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa430078d40 0x7fa4301138b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:29.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.754+0000 7fa436a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa430113df0 con 0x7fa430078d40 2024-04-26T21:13:29.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.754+0000 7fa42fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa430078d40 0x7fa4301138b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:29.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.754+0000 7fa42fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa430078d40 0x7fa4301138b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57234/0 (socket says 172.21.15.84:57234) 2024-04-26T21:13:29.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.754+0000 7fa42fe00700 1 -- 172.21.15.84:0/4136775288 learned_addr learned my addr 172.21.15.84:0/4136775288 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:29.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.754+0000 7fa42fe00700 1 -- 172.21.15.84:0/4136775288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4200094f0 con 0x7fa430078d40 2024-04-26T21:13:29.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.755+0000 7fa42fe00700 1 --2- 172.21.15.84:0/4136775288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa430078d40 0x7fa4301138b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa4200105b0 tx=0x7fa420009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:29.769 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.755+0000 7fa427e00700 1 -- 172.21.15.84:0/4136775288 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa420010840 con 0x7fa430078d40 2024-04-26T21:13:29.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.755+0000 7fa427e00700 1 -- 172.21.15.84:0/4136775288 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa420010e70 con 0x7fa430078d40 2024-04-26T21:13:29.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.755+0000 7fa427e00700 1 -- 172.21.15.84:0/4136775288 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa42001ae30 con 0x7fa430078d40 2024-04-26T21:13:29.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.755+0000 7fa436a00700 1 -- 172.21.15.84:0/4136775288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa430113ff0 con 0x7fa430078d40 2024-04-26T21:13:29.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.755+0000 7fa436a00700 1 -- 172.21.15.84:0/4136775288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa430114b60 con 0x7fa430078d40 2024-04-26T21:13:29.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.756+0000 7fa427e00700 1 -- 172.21.15.84:0/4136775288 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fa42001a430 con 0x7fa430078d40 2024-04-26T21:13:29.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.756+0000 7fa436a00700 1 -- 172.21.15.84:0/4136775288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43005f5c0 con 0x7fa430078d40 2024-04-26T21:13:29.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.757+0000 7fa427e00700 1 --2- 172.21.15.84:0/4136775288 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fa4140368a0 0x7fa414038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:29.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.757+0000 7fa427e00700 1 -- 172.21.15.84:0/4136775288 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa42004a210 con 0x7fa430078d40 2024-04-26T21:13:29.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.757+0000 7fa42f400700 1 --2- 172.21.15.84:0/4136775288 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fa4140368a0 0x7fa414038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:29.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.758+0000 7fa42f400700 1 --2- 172.21.15.84:0/4136775288 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fa4140368a0 0x7fa414038d50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009990 tx=0x7fa41c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:29.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.762+0000 7fa427e00700 1 -- 172.21.15.84:0/4136775288 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa42002b4d0 con 0x7fa430078d40 2024-04-26T21:13:29.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.983+0000 7fa436a00700 1 -- 172.21.15.84:0/4136775288 --> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4300ff230 con 0x7fa4140368a0 2024-04-26T21:13:29.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.990+0000 7fa427e00700 1 -- 172.21.15.84:0/4136775288 <== mgr.14120 v2:172.21.15.84:6800/2151160823 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fa4300ff230 con 0x7fa4140368a0 2024-04-26T21:13:29.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.993+0000 7fa436a00700 1 -- 172.21.15.84:0/4136775288 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fa4140368a0 msgr2=0x7fa414038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:29.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.993+0000 7fa436a00700 1 --2- 172.21.15.84:0/4136775288 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fa4140368a0 0x7fa414038d50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009990 tx=0x7fa41c006e40 comp rx=0 tx=0).stop 2024-04-26T21:13:29.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.993+0000 7fa436a00700 1 -- 172.21.15.84:0/4136775288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa430078d40 msgr2=0x7fa4301138b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:29.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.993+0000 7fa436a00700 1 --2- 172.21.15.84:0/4136775288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa430078d40 0x7fa4301138b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa4200105b0 tx=0x7fa420009250 comp rx=0 tx=0).stop 2024-04-26T21:13:29.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.993+0000 7fa436a00700 1 -- 172.21.15.84:0/4136775288 shutdown_connections 2024-04-26T21:13:29.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.993+0000 7fa436a00700 1 --2- 172.21.15.84:0/4136775288 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7fa4140368a0 0x7fa414038d50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:29.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.993+0000 7fa436a00700 1 --2- 172.21.15.84:0/4136775288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa430078d40 0x7fa4301138b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:29.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.993+0000 7fa436a00700 1 -- 172.21.15.84:0/4136775288 >> 172.21.15.84:0/4136775288 conn(0x7fa4300fdfd0 msgr2=0x7fa4300feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:29.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.994+0000 7fa436a00700 1 -- 172.21.15.84:0/4136775288 shutdown_connections 2024-04-26T21:13:29.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:28.994+0000 7fa436a00700 1 -- 172.21.15.84:0/4136775288 wait complete. 2024-04-26T21:13:30.302 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:30 smithi084 ceph-mon[25539]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:30.302 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:30 smithi084 ceph-mon[25539]: Saving service alertmanager spec with placement count:1 2024-04-26T21:13:31.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:31 smithi084 ceph-mon[25539]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:13:31.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:31 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2884024427' entity='client.admin' 2024-04-26T21:13:31.241 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.300+0000 7f281b600700 1 Processor -- start 2024-04-26T21:13:31.241 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.300+0000 7f281b600700 1 -- start start 2024-04-26T21:13:31.241 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.301+0000 7f281b600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2814077b70 0x7f2814076120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:31.241 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.301+0000 7f281b600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2814077f80 con 0x7f2814077b70 2024-04-26T21:13:31.241 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.301+0000 7f2818c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2814077b70 0x7f2814076120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:31.241 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.301+0000 7f2818c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2814077b70 0x7f2814076120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57242/0 (socket says 172.21.15.84:57242) 2024-04-26T21:13:31.241 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.301+0000 7f2818c00700 1 -- 172.21.15.84:0/49406936 learned_addr learned my addr 172.21.15.84:0/49406936 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:31.241 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.302+0000 7f2818c00700 1 -- 172.21.15.84:0/49406936 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2814076660 con 0x7f2814077b70 2024-04-26T21:13:31.241 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.302+0000 7f2818c00700 1 --2- 172.21.15.84:0/49406936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2814077b70 0x7f2814076120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2808009e50 tx=0x7f2808009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0daa4138148601 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:31.241 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.302+0000 7f2813400700 1 -- 172.21.15.84:0/49406936 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28080092e0 con 0x7f2814077b70 2024-04-26T21:13:31.241 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.303+0000 7f2813400700 1 -- 172.21.15.84:0/49406936 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2808012430 con 0x7f2814077b70 2024-04-26T21:13:31.241 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.303+0000 7f2813400700 1 -- 172.21.15.84:0/49406936 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28080075a0 con 0x7f2814077b70 2024-04-26T21:13:31.242 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.303+0000 7f281b600700 1 -- 172.21.15.84:0/49406936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2814077b70 msgr2=0x7f2814076120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:31.242 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.303+0000 7f281b600700 1 --2- 172.21.15.84:0/49406936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2814077b70 0x7f2814076120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2808009e50 tx=0x7f2808009840 comp rx=0 tx=0).stop 2024-04-26T21:13:31.245 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.303+0000 7f281b600700 1 -- 172.21.15.84:0/49406936 shutdown_connections 2024-04-26T21:13:31.245 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.303+0000 7f281b600700 1 --2- 172.21.15.84:0/49406936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2814077b70 0x7f2814076120 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:31.245 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.303+0000 7f281b600700 1 -- 172.21.15.84:0/49406936 >> 172.21.15.84:0/49406936 conn(0x7f28140fdf90 msgr2=0x7f2814100400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:31.246 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.304+0000 7f281b600700 1 -- 172.21.15.84:0/49406936 shutdown_connections 2024-04-26T21:13:31.246 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.304+0000 7f281b600700 1 -- 172.21.15.84:0/49406936 wait complete. 2024-04-26T21:13:31.246 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.304+0000 7f281b600700 1 Processor -- start 2024-04-26T21:13:31.246 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.304+0000 7f281b600700 1 -- start start 2024-04-26T21:13:31.246 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.305+0000 7f281b600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2814077b70 0x7f2814113860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:31.246 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.305+0000 7f281b600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2814113da0 con 0x7f2814077b70 2024-04-26T21:13:31.246 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.305+0000 7f2818c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2814077b70 0x7f2814113860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:31.246 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.305+0000 7f2818c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2814077b70 0x7f2814113860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57256/0 (socket says 172.21.15.84:57256) 2024-04-26T21:13:31.246 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.305+0000 7f2818c00700 1 -- 172.21.15.84:0/2884024427 learned_addr learned my addr 172.21.15.84:0/2884024427 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:31.246 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.305+0000 7f2818c00700 1 -- 172.21.15.84:0/2884024427 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2808009ae0 con 0x7f2814077b70 2024-04-26T21:13:31.246 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.306+0000 7f2818c00700 1 --2- 172.21.15.84:0/2884024427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2814077b70 0x7f2814113860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2808009fd0 tx=0x7f2808009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:31.246 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.306+0000 7f2810c00700 1 -- 172.21.15.84:0/2884024427 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28080092e0 con 0x7f2814077b70 2024-04-26T21:13:31.246 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.306+0000 7f2810c00700 1 -- 172.21.15.84:0/2884024427 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2808007ce0 con 0x7f2814077b70 2024-04-26T21:13:31.247 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.306+0000 7f281b600700 1 -- 172.21.15.84:0/2884024427 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2814113fa0 con 0x7f2814077b70 2024-04-26T21:13:31.247 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.306+0000 7f2810c00700 1 -- 172.21.15.84:0/2884024427 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28080259c0 con 0x7f2814077b70 2024-04-26T21:13:31.247 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.306+0000 7f281b600700 1 -- 172.21.15.84:0/2884024427 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2814114b10 con 0x7f2814077b70 2024-04-26T21:13:31.247 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.307+0000 7f281b600700 1 -- 172.21.15.84:0/2884024427 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281405f5c0 con 0x7f2814077b70 2024-04-26T21:13:31.247 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.307+0000 7f2810c00700 1 -- 172.21.15.84:0/2884024427 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f2808019050 con 0x7f2814077b70 2024-04-26T21:13:31.247 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.308+0000 7f2810c00700 1 --2- 172.21.15.84:0/2884024427 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f27fc036850 0x7f27fc038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:31.247 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.308+0000 7f2810c00700 1 -- 172.21.15.84:0/2884024427 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f280804a0b0 con 0x7f2814077b70 2024-04-26T21:13:31.247 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.308+0000 7f2813e00700 1 --2- 172.21.15.84:0/2884024427 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f27fc036850 0x7f27fc038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:31.247 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.309+0000 7f2813e00700 1 --2- 172.21.15.84:0/2884024427 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f27fc036850 0x7f27fc038d00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2800009990 tx=0x7f2800006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:31.247 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.313+0000 7f2810c00700 1 -- 172.21.15.84:0/2884024427 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f280800be50 con 0x7f2814077b70 2024-04-26T21:13:31.247 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.522+0000 7f281b600700 1 -- 172.21.15.84:0/2884024427 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f281404bed0 con 0x7f2814077b70 2024-04-26T21:13:31.247 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.530+0000 7f2810c00700 1 -- 172.21.15.84:0/2884024427 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f2808020030 con 0x7f2814077b70 2024-04-26T21:13:31.247 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.533+0000 7f281b600700 1 -- 172.21.15.84:0/2884024427 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f27fc036850 msgr2=0x7f27fc038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:31.247 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.533+0000 7f281b600700 1 --2- 172.21.15.84:0/2884024427 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f27fc036850 0x7f27fc038d00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2800009990 tx=0x7f2800006e40 comp rx=0 tx=0).stop 2024-04-26T21:13:31.248 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.533+0000 7f281b600700 1 -- 172.21.15.84:0/2884024427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2814077b70 msgr2=0x7f2814113860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:31.248 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.533+0000 7f281b600700 1 --2- 172.21.15.84:0/2884024427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2814077b70 0x7f2814113860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2808009fd0 tx=0x7f2808009840 comp rx=0 tx=0).stop 2024-04-26T21:13:31.248 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.533+0000 7f281b600700 1 -- 172.21.15.84:0/2884024427 shutdown_connections 2024-04-26T21:13:31.248 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.533+0000 7f281b600700 1 --2- 172.21.15.84:0/2884024427 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f27fc036850 0x7f27fc038d00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:31.248 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.533+0000 7f281b600700 1 --2- 172.21.15.84:0/2884024427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2814077b70 0x7f2814113860 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:31.248 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.533+0000 7f281b600700 1 -- 172.21.15.84:0/2884024427 >> 172.21.15.84:0/2884024427 conn(0x7f28140fdf90 msgr2=0x7f28140feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:31.248 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.533+0000 7f281b600700 1 -- 172.21.15.84:0/2884024427 shutdown_connections 2024-04-26T21:13:31.248 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:30.533+0000 7f281b600700 1 -- 172.21.15.84:0/2884024427 wait complete. 2024-04-26T21:13:32.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.868+0000 7f4a4c600700 1 Processor -- start 2024-04-26T21:13:32.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.868+0000 7f4a4c600700 1 -- start start 2024-04-26T21:13:32.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.869+0000 7f4a4c600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a44102830 0x7f4a44102c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:32.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.869+0000 7f4a4c600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a44103180 con 0x7f4a44102830 2024-04-26T21:13:32.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.869+0000 7f4a49c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a44102830 0x7f4a44102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:32.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.869+0000 7f4a49c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a44102830 0x7f4a44102c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57170/0 (socket says 172.21.15.84:57170) 2024-04-26T21:13:32.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.869+0000 7f4a49c00700 1 -- 172.21.15.84:0/267242394 learned_addr learned my addr 172.21.15.84:0/267242394 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:32.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.870+0000 7f4a49c00700 1 -- 172.21.15.84:0/267242394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a441032c0 con 0x7f4a44102830 2024-04-26T21:13:32.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.870+0000 7f4a49c00700 1 --2- 172.21.15.84:0/267242394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a44102830 0x7f4a44102c40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4a380098e0 tx=0x7f4a38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7280e3340d8706ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:32.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.870+0000 7f4a43e00700 1 -- 172.21.15.84:0/267242394 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a3800b860 con 0x7f4a44102830 2024-04-26T21:13:32.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.870+0000 7f4a43e00700 1 -- 172.21.15.84:0/267242394 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a3800be90 con 0x7f4a44102830 2024-04-26T21:13:32.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.870+0000 7f4a43e00700 1 -- 172.21.15.84:0/267242394 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a380103c0 con 0x7f4a44102830 2024-04-26T21:13:32.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.871+0000 7f4a4c600700 1 -- 172.21.15.84:0/267242394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a44102830 msgr2=0x7f4a44102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:32.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.871+0000 7f4a4c600700 1 --2- 172.21.15.84:0/267242394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a44102830 0x7f4a44102c40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4a380098e0 tx=0x7f4a38009250 comp rx=0 tx=0).stop 2024-04-26T21:13:32.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.871+0000 7f4a4c600700 1 -- 172.21.15.84:0/267242394 shutdown_connections 2024-04-26T21:13:32.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.871+0000 7f4a4c600700 1 --2- 172.21.15.84:0/267242394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a44102830 0x7f4a44102c40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:32.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.871+0000 7f4a4c600700 1 -- 172.21.15.84:0/267242394 >> 172.21.15.84:0/267242394 conn(0x7f4a440fe010 msgr2=0x7f4a44100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:32.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.871+0000 7f4a4c600700 1 -- 172.21.15.84:0/267242394 shutdown_connections 2024-04-26T21:13:32.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.871+0000 7f4a4c600700 1 -- 172.21.15.84:0/267242394 wait complete. 2024-04-26T21:13:32.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.872+0000 7f4a4c600700 1 Processor -- start 2024-04-26T21:13:32.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.872+0000 7f4a4c600700 1 -- start start 2024-04-26T21:13:32.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.873+0000 7f4a4c600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a44102830 0x7f4a441138e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:32.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.873+0000 7f4a4c600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a44113e20 con 0x7f4a44102830 2024-04-26T21:13:32.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.873+0000 7f4a49c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a44102830 0x7f4a441138e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:32.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.873+0000 7f4a49c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a44102830 0x7f4a441138e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57176/0 (socket says 172.21.15.84:57176) 2024-04-26T21:13:32.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.873+0000 7f4a49c00700 1 -- 172.21.15.84:0/3626906788 learned_addr learned my addr 172.21.15.84:0/3626906788 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:32.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.873+0000 7f4a49c00700 1 -- 172.21.15.84:0/3626906788 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a380094f0 con 0x7f4a44102830 2024-04-26T21:13:32.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.874+0000 7f4a49c00700 1 --2- 172.21.15.84:0/3626906788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a44102830 0x7f4a441138e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a38006b00 tx=0x7f4a38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:32.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.874+0000 7f4a41600700 1 -- 172.21.15.84:0/3626906788 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a38010840 con 0x7f4a44102830 2024-04-26T21:13:32.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.874+0000 7f4a41600700 1 -- 172.21.15.84:0/3626906788 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a38010e70 con 0x7f4a44102830 2024-04-26T21:13:32.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.874+0000 7f4a41600700 1 -- 172.21.15.84:0/3626906788 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a3801ae70 con 0x7f4a44102830 2024-04-26T21:13:32.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.874+0000 7f4a4c600700 1 -- 172.21.15.84:0/3626906788 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a44114020 con 0x7f4a44102830 2024-04-26T21:13:32.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.874+0000 7f4a4c600700 1 -- 172.21.15.84:0/3626906788 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a44114b40 con 0x7f4a44102830 2024-04-26T21:13:32.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.875+0000 7f4a41600700 1 -- 172.21.15.84:0/3626906788 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f4a3801a780 con 0x7f4a44102830 2024-04-26T21:13:32.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.876+0000 7f4a4c600700 1 -- 172.21.15.84:0/3626906788 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4405f5c0 con 0x7f4a44102830 2024-04-26T21:13:32.866 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.876+0000 7f4a41600700 1 --2- 172.21.15.84:0/3626906788 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f4a2c0368a0 0x7f4a2c038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:32.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.876+0000 7f4a41600700 1 -- 172.21.15.84:0/3626906788 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f4a3804aba0 con 0x7f4a44102830 2024-04-26T21:13:32.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.876+0000 7f4a49200700 1 --2- 172.21.15.84:0/3626906788 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f4a2c0368a0 0x7f4a2c038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:32.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.877+0000 7f4a49200700 1 --2- 172.21.15.84:0/3626906788 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f4a2c0368a0 0x7f4a2c038d50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009990 tx=0x7f4a30006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:32.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:31.881+0000 7f4a41600700 1 -- 172.21.15.84:0/3626906788 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4a3801a430 con 0x7f4a44102830 2024-04-26T21:13:32.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:32.091+0000 7f4a4c600700 1 -- 172.21.15.84:0/3626906788 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f4a4404bed0 con 0x7f4a44102830 2024-04-26T21:13:32.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:32.097+0000 7f4a41600700 1 -- 172.21.15.84:0/3626906788 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f4a3802cb80 con 0x7f4a44102830 2024-04-26T21:13:32.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:32.100+0000 7f4a4c600700 1 -- 172.21.15.84:0/3626906788 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f4a2c0368a0 msgr2=0x7f4a2c038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:32.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:32.100+0000 7f4a4c600700 1 --2- 172.21.15.84:0/3626906788 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f4a2c0368a0 0x7f4a2c038d50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009990 tx=0x7f4a30006e40 comp rx=0 tx=0).stop 2024-04-26T21:13:32.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:32.100+0000 7f4a4c600700 1 -- 172.21.15.84:0/3626906788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a44102830 msgr2=0x7f4a441138e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:32.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:32.100+0000 7f4a4c600700 1 --2- 172.21.15.84:0/3626906788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a44102830 0x7f4a441138e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a38006b00 tx=0x7f4a38009250 comp rx=0 tx=0).stop 2024-04-26T21:13:32.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:32.101+0000 7f4a4c600700 1 -- 172.21.15.84:0/3626906788 shutdown_connections 2024-04-26T21:13:32.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:32.101+0000 7f4a4c600700 1 --2- 172.21.15.84:0/3626906788 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f4a2c0368a0 0x7f4a2c038d50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:32.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:32.101+0000 7f4a4c600700 1 --2- 172.21.15.84:0/3626906788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a44102830 0x7f4a441138e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:32.868 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:32.101+0000 7f4a4c600700 1 -- 172.21.15.84:0/3626906788 >> 172.21.15.84:0/3626906788 conn(0x7f4a440fe010 msgr2=0x7f4a440fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:32.868 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:32.101+0000 7f4a4c600700 1 -- 172.21.15.84:0/3626906788 shutdown_connections 2024-04-26T21:13:32.868 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:32.101+0000 7f4a4c600700 1 -- 172.21.15.84:0/3626906788 wait complete. 2024-04-26T21:13:32.868 INFO:teuthology.orchestra.run.smithi084.stdout:Enabling the dashboard module... 2024-04-26T21:13:33.363 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:33 smithi084 ceph-mon[25539]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:13:33.364 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:33 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3626906788' entity='client.admin' 2024-04-26T21:13:34.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:34 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2359970640' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-26T21:13:34.757 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.440+0000 7f3635600700 1 Processor -- start 2024-04-26T21:13:34.757 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.440+0000 7f3635600700 1 -- start start 2024-04-26T21:13:34.757 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.441+0000 7f3635600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630071310 0x7f3630107810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:34.758 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.441+0000 7f3635600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3630103200 con 0x7f3630071310 2024-04-26T21:13:34.758 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.441+0000 7f362ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630071310 0x7f3630107810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:34.758 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.441+0000 7f362ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630071310 0x7f3630107810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57182/0 (socket says 172.21.15.84:57182) 2024-04-26T21:13:34.758 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.441+0000 7f362ea00700 1 -- 172.21.15.84:0/2818048514 learned_addr learned my addr 172.21.15.84:0/2818048514 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:34.758 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.441+0000 7f362ea00700 1 -- 172.21.15.84:0/2818048514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3630107d50 con 0x7f3630071310 2024-04-26T21:13:34.758 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.442+0000 7f362ea00700 1 --2- 172.21.15.84:0/2818048514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630071310 0x7f3630107810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f36200098e0 tx=0x7f3620009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8cdc1afd59a29b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:34.758 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.442+0000 7f362d600700 1 -- 172.21.15.84:0/2818048514 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f362000b860 con 0x7f3630071310 2024-04-26T21:13:34.758 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.442+0000 7f362d600700 1 -- 172.21.15.84:0/2818048514 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f362000be90 con 0x7f3630071310 2024-04-26T21:13:34.758 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.442+0000 7f362d600700 1 -- 172.21.15.84:0/2818048514 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f36200103c0 con 0x7f3630071310 2024-04-26T21:13:34.758 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.443+0000 7f3635600700 1 -- 172.21.15.84:0/2818048514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630071310 msgr2=0x7f3630107810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:34.758 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.443+0000 7f3635600700 1 --2- 172.21.15.84:0/2818048514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630071310 0x7f3630107810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f36200098e0 tx=0x7f3620009250 comp rx=0 tx=0).stop 2024-04-26T21:13:34.758 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.443+0000 7f3635600700 1 -- 172.21.15.84:0/2818048514 shutdown_connections 2024-04-26T21:13:34.759 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.443+0000 7f3635600700 1 --2- 172.21.15.84:0/2818048514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630071310 0x7f3630107810 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:34.759 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.443+0000 7f3635600700 1 -- 172.21.15.84:0/2818048514 >> 172.21.15.84:0/2818048514 conn(0x7f36300fcec0 msgr2=0x7f36300ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:34.759 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.443+0000 7f3635600700 1 -- 172.21.15.84:0/2818048514 shutdown_connections 2024-04-26T21:13:34.759 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.443+0000 7f3635600700 1 -- 172.21.15.84:0/2818048514 wait complete. 2024-04-26T21:13:34.759 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.444+0000 7f3635600700 1 Processor -- start 2024-04-26T21:13:34.759 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.444+0000 7f3635600700 1 -- start start 2024-04-26T21:13:34.759 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.444+0000 7f3635600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630071310 0x7f36301137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:34.759 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.444+0000 7f3635600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3630113d00 con 0x7f3630071310 2024-04-26T21:13:34.759 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.445+0000 7f362ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630071310 0x7f36301137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:34.759 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.445+0000 7f362ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630071310 0x7f36301137c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57198/0 (socket says 172.21.15.84:57198) 2024-04-26T21:13:34.759 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.445+0000 7f362ea00700 1 -- 172.21.15.84:0/2359970640 learned_addr learned my addr 172.21.15.84:0/2359970640 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:34.759 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.445+0000 7f362ea00700 1 -- 172.21.15.84:0/2359970640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36200094f0 con 0x7f3630071310 2024-04-26T21:13:34.759 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.445+0000 7f362ea00700 1 --2- 172.21.15.84:0/2359970640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630071310 0x7f36301137c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f36200094c0 tx=0x7f3620009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:34.759 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.445+0000 7f3626a00700 1 -- 172.21.15.84:0/2359970640 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3620010890 con 0x7f3630071310 2024-04-26T21:13:34.759 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.446+0000 7f3626a00700 1 -- 172.21.15.84:0/2359970640 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3620010ec0 con 0x7f3630071310 2024-04-26T21:13:34.759 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.446+0000 7f3635600700 1 -- 172.21.15.84:0/2359970640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3630113f00 con 0x7f3630071310 2024-04-26T21:13:34.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.446+0000 7f3626a00700 1 -- 172.21.15.84:0/2359970640 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f36200243f0 con 0x7f3630071310 2024-04-26T21:13:34.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.446+0000 7f3635600700 1 -- 172.21.15.84:0/2359970640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3630114a70 con 0x7f3630071310 2024-04-26T21:13:34.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.447+0000 7f3626a00700 1 -- 172.21.15.84:0/2359970640 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f36200109f0 con 0x7f3630071310 2024-04-26T21:13:34.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.447+0000 7f3635600700 1 -- 172.21.15.84:0/2359970640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363005f5c0 con 0x7f3630071310 2024-04-26T21:13:34.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.447+0000 7f3626a00700 1 --2- 172.21.15.84:0/2359970640 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f3614036850 0x7f3614038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:34.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.447+0000 7f3626a00700 1 -- 172.21.15.84:0/2359970640 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f362004a320 con 0x7f3630071310 2024-04-26T21:13:34.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.448+0000 7f362e000700 1 --2- 172.21.15.84:0/2359970640 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f3614036850 0x7f3614038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:34.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.448+0000 7f362e000700 1 --2- 172.21.15.84:0/2359970640 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f3614036850 0x7f3614038d00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f361c009990 tx=0x7f361c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:34.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.453+0000 7f3626a00700 1 -- 172.21.15.84:0/2359970640 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f362002b8e0 con 0x7f3630071310 2024-04-26T21:13:34.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:33.726+0000 7f3635600700 1 -- 172.21.15.84:0/2359970640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f363004bed0 con 0x7f3630071310 2024-04-26T21:13:34.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:34.109+0000 7f3626a00700 1 -- 172.21.15.84:0/2359970640 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f362001a7e0 con 0x7f3630071310 2024-04-26T21:13:34.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:34.112+0000 7f3626a00700 1 -- 172.21.15.84:0/2359970640 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f362000fb50 con 0x7f3630071310 2024-04-26T21:13:34.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:34.115+0000 7f3635600700 1 -- 172.21.15.84:0/2359970640 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f3614036850 msgr2=0x7f3614038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:34.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:34.115+0000 7f3635600700 1 --2- 172.21.15.84:0/2359970640 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f3614036850 0x7f3614038d00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f361c009990 tx=0x7f361c006e40 comp rx=0 tx=0).stop 2024-04-26T21:13:34.760 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:34.115+0000 7f3635600700 1 -- 172.21.15.84:0/2359970640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630071310 msgr2=0x7f36301137c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:34.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:34.115+0000 7f3635600700 1 --2- 172.21.15.84:0/2359970640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630071310 0x7f36301137c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f36200094c0 tx=0x7f3620009250 comp rx=0 tx=0).stop 2024-04-26T21:13:34.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:34.115+0000 7f3635600700 1 -- 172.21.15.84:0/2359970640 shutdown_connections 2024-04-26T21:13:34.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:34.115+0000 7f3635600700 1 --2- 172.21.15.84:0/2359970640 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f3614036850 0x7f3614038d00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:34.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:34.115+0000 7f3635600700 1 --2- 172.21.15.84:0/2359970640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630071310 0x7f36301137c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:34.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:34.115+0000 7f3635600700 1 -- 172.21.15.84:0/2359970640 >> 172.21.15.84:0/2359970640 conn(0x7f36300fcec0 msgr2=0x7f36300fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:34.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:34.115+0000 7f3635600700 1 -- 172.21.15.84:0/2359970640 shutdown_connections 2024-04-26T21:13:34.761 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:34.115+0000 7f3635600700 1 -- 172.21.15.84:0/2359970640 wait complete. 2024-04-26T21:13:35.387 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:35 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2359970640' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-26T21:13:35.387 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:35 smithi084 ceph-mon[25539]: mgrmap e9: smithi084.gyasul(active, since 30s) 2024-04-26T21:13:36.248 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:36 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/4237884757' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-26T21:13:36.256 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-04-26T21:13:36.257 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-26T21:13:36.257 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T21:13:36.258 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "active_name": "smithi084.gyasul", 2024-04-26T21:13:36.258 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-26T21:13:36.258 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-04-26T21:13:36.258 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.384+0000 7f0d0e400700 1 Processor -- start 2024-04-26T21:13:36.258 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.384+0000 7f0d0e400700 1 -- start start 2024-04-26T21:13:36.258 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.385+0000 7f0d0e400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d08071310 0x7f0d08105410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:36.261 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.385+0000 7f0d0e400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d08105950 con 0x7f0d08071310 2024-04-26T21:13:36.261 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.385+0000 7f0d07400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d08071310 0x7f0d08105410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:36.261 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.385+0000 7f0d07400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d08071310 0x7f0d08105410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57222/0 (socket says 172.21.15.84:57222) 2024-04-26T21:13:36.261 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.385+0000 7f0d07400700 1 -- 172.21.15.84:0/4257168574 learned_addr learned my addr 172.21.15.84:0/4257168574 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:36.261 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.386+0000 7f0d07400700 1 -- 172.21.15.84:0/4257168574 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d08105a90 con 0x7f0d08071310 2024-04-26T21:13:36.261 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.386+0000 7f0d07400700 1 --2- 172.21.15.84:0/4257168574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d08071310 0x7f0d08105410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80098e0 tx=0x7f0cf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2baaccc907574a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:36.261 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.386+0000 7f0d06000700 1 -- 172.21.15.84:0/4257168574 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cf800b860 con 0x7f0d08071310 2024-04-26T21:13:36.261 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.387+0000 7f0d06000700 1 -- 172.21.15.84:0/4257168574 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0cf800be90 con 0x7f0d08071310 2024-04-26T21:13:36.262 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.387+0000 7f0d06000700 1 -- 172.21.15.84:0/4257168574 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cf80103c0 con 0x7f0d08071310 2024-04-26T21:13:36.262 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.387+0000 7f0d0e400700 1 -- 172.21.15.84:0/4257168574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d08071310 msgr2=0x7f0d08105410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:36.262 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.387+0000 7f0d0e400700 1 --2- 172.21.15.84:0/4257168574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d08071310 0x7f0d08105410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80098e0 tx=0x7f0cf8009250 comp rx=0 tx=0).stop 2024-04-26T21:13:36.262 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.388+0000 7f0d0e400700 1 -- 172.21.15.84:0/4257168574 shutdown_connections 2024-04-26T21:13:36.262 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.388+0000 7f0d0e400700 1 --2- 172.21.15.84:0/4257168574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d08071310 0x7f0d08105410 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:36.262 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.388+0000 7f0d0e400700 1 -- 172.21.15.84:0/4257168574 >> 172.21.15.84:0/4257168574 conn(0x7f0d080fcec0 msgr2=0x7f0d080ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:36.262 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.388+0000 7f0d0e400700 1 -- 172.21.15.84:0/4257168574 shutdown_connections 2024-04-26T21:13:36.262 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.388+0000 7f0d0e400700 1 -- 172.21.15.84:0/4257168574 wait complete. 2024-04-26T21:13:36.262 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.389+0000 7f0d0e400700 1 Processor -- start 2024-04-26T21:13:36.262 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.389+0000 7f0d0e400700 1 -- start start 2024-04-26T21:13:36.262 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.389+0000 7f0d0e400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d08071310 0x7f0d08111620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:36.262 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.390+0000 7f0d0e400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d08111b60 con 0x7f0d08071310 2024-04-26T21:13:36.262 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.390+0000 7f0d07400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d08071310 0x7f0d08111620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:36.263 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.390+0000 7f0d07400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d08071310 0x7f0d08111620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57238/0 (socket says 172.21.15.84:57238) 2024-04-26T21:13:36.263 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.390+0000 7f0d07400700 1 -- 172.21.15.84:0/4237884757 learned_addr learned my addr 172.21.15.84:0/4237884757 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:36.265 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.390+0000 7f0d07400700 1 -- 172.21.15.84:0/4237884757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf80094f0 con 0x7f0d08071310 2024-04-26T21:13:36.266 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.390+0000 7f0d07400700 1 --2- 172.21.15.84:0/4237884757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d08071310 0x7f0d08111620 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8006d40 tx=0x7f0cf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:36.266 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.391+0000 7f0cff400700 1 -- 172.21.15.84:0/4237884757 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cf8010840 con 0x7f0d08071310 2024-04-26T21:13:36.266 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.391+0000 7f0cff400700 1 -- 172.21.15.84:0/4237884757 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0cf8010e70 con 0x7f0d08071310 2024-04-26T21:13:36.266 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.391+0000 7f0d0e400700 1 -- 172.21.15.84:0/4237884757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d08111d60 con 0x7f0d08071310 2024-04-26T21:13:36.266 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.391+0000 7f0cff400700 1 -- 172.21.15.84:0/4237884757 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cf8024ea0 con 0x7f0d08071310 2024-04-26T21:13:36.266 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.391+0000 7f0d0e400700 1 -- 172.21.15.84:0/4237884757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d081128d0 con 0x7f0d08071310 2024-04-26T21:13:36.266 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.392+0000 7f0d0e400700 1 -- 172.21.15.84:0/4237884757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0805f5c0 con 0x7f0d08071310 2024-04-26T21:13:36.266 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.392+0000 7f0cff400700 1 -- 172.21.15.84:0/4237884757 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f0cf8024780 con 0x7f0d08071310 2024-04-26T21:13:36.266 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.393+0000 7f0cff400700 1 --2- 172.21.15.84:0/4237884757 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f0cec0368a0 0x7f0cec038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:36.266 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.393+0000 7f0cff400700 1 -- 172.21.15.84:0/4237884757 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0cf804a790 con 0x7f0d08071310 2024-04-26T21:13:36.266 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.393+0000 7f0d06a00700 1 -- 172.21.15.84:0/4237884757 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f0cec0368a0 msgr2=0x7f0cec038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/2151160823 2024-04-26T21:13:36.266 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.393+0000 7f0d06a00700 1 --2- 172.21.15.84:0/4237884757 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f0cec0368a0 0x7f0cec038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T21:13:36.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.402+0000 7f0cff400700 1 -- 172.21.15.84:0/4237884757 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0cf802c930 con 0x7f0d08071310 2024-04-26T21:13:36.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.594+0000 7f0d06a00700 1 -- 172.21.15.84:0/4237884757 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f0cec0368a0 msgr2=0x7f0cec038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/2151160823 2024-04-26T21:13:36.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.594+0000 7f0d06a00700 1 --2- 172.21.15.84:0/4237884757 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f0cec0368a0 0x7f0cec038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T21:13:36.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.655+0000 7f0d0e400700 1 -- 172.21.15.84:0/4237884757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f0d08112c70 con 0x7f0d08071310 2024-04-26T21:13:36.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.656+0000 7f0cff400700 1 -- 172.21.15.84:0/4237884757 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f0cf802c340 con 0x7f0d08071310 2024-04-26T21:13:36.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.659+0000 7f0d0e400700 1 -- 172.21.15.84:0/4237884757 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f0cec0368a0 msgr2=0x7f0cec038d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T21:13:36.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.659+0000 7f0d0e400700 1 --2- 172.21.15.84:0/4237884757 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f0cec0368a0 0x7f0cec038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:36.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.659+0000 7f0d0e400700 1 -- 172.21.15.84:0/4237884757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d08071310 msgr2=0x7f0d08111620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:36.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.659+0000 7f0d0e400700 1 --2- 172.21.15.84:0/4237884757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d08071310 0x7f0d08111620 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8006d40 tx=0x7f0cf8009250 comp rx=0 tx=0).stop 2024-04-26T21:13:36.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.660+0000 7f0d0e400700 1 -- 172.21.15.84:0/4237884757 shutdown_connections 2024-04-26T21:13:36.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.660+0000 7f0d0e400700 1 --2- 172.21.15.84:0/4237884757 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f0cec0368a0 0x7f0cec038d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:36.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.660+0000 7f0d0e400700 1 --2- 172.21.15.84:0/4237884757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d08071310 0x7f0d08111620 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:36.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.660+0000 7f0d0e400700 1 -- 172.21.15.84:0/4237884757 >> 172.21.15.84:0/4237884757 conn(0x7f0d080fcec0 msgr2=0x7f0d080fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:36.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.660+0000 7f0d0e400700 1 -- 172.21.15.84:0/4237884757 shutdown_connections 2024-04-26T21:13:36.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:35.660+0000 7f0d0e400700 1 -- 172.21.15.84:0/4237884757 wait complete. 2024-04-26T21:13:36.268 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for the mgr to restart... 2024-04-26T21:13:36.268 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr epoch 9... 2024-04-26T21:13:43.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:42 smithi084 ceph-mon[25539]: Active manager daemon smithi084.gyasul restarted 2024-04-26T21:13:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:42 smithi084 ceph-mon[25539]: Activating manager daemon smithi084.gyasul 2024-04-26T21:13:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:42 smithi084 ceph-mon[25539]: osdmap e3: 0 total, 0 up, 0 in 2024-04-26T21:13:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:42 smithi084 ceph-mon[25539]: mgrmap e10: smithi084.gyasul(active, starting, since 0.00539859s) 2024-04-26T21:13:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:42 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-04-26T21:13:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:42 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr metadata", "who": "smithi084.gyasul", "id": "smithi084.gyasul"}]: dispatch 2024-04-26T21:13:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:42 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T21:13:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:42 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T21:13:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:42 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T21:13:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:42 smithi084 ceph-mon[25539]: Manager daemon smithi084.gyasul is now available 2024-04-26T21:13:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:42 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:13:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:42 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:13:44.149 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:43 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.gyasul/mirror_snapshot_schedule"}]: dispatch 2024-04-26T21:13:44.149 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:43 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.gyasul/trash_purge_schedule"}]: dispatch 2024-04-26T21:13:44.149 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:43 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:44.149 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:43 smithi084 ceph-mon[25539]: mgrmap e11: smithi084.gyasul(active, since 1.01657s) 2024-04-26T21:13:44.816 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:44 smithi084 ceph-mon[25539]: [26/Apr/2024:21:13:43] ENGINE Bus STARTING 2024-04-26T21:13:44.816 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:44 smithi084 ceph-mon[25539]: [26/Apr/2024:21:13:43] ENGINE Serving on https://172.21.15.84:7150 2024-04-26T21:13:44.816 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:44 smithi084 ceph-mon[25539]: [26/Apr/2024:21:13:43] ENGINE Bus STARTED 2024-04-26T21:13:44.816 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:44 smithi084 ceph-mon[25539]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-26T21:13:44.816 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:44 smithi084 ceph-mon[25539]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-26T21:13:44.816 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:44 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:44.831 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-04-26T21:13:44.831 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-26T21:13:44.831 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-26T21:13:44.832 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-04-26T21:13:44.832 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.860+0000 7f6489200700 1 Processor -- start 2024-04-26T21:13:44.832 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.860+0000 7f6489200700 1 -- start start 2024-04-26T21:13:44.832 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.860+0000 7f6489200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64841015f0 0x7f6484101a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:44.832 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.860+0000 7f6489200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6484101f40 con 0x7f64841015f0 2024-04-26T21:13:44.832 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.861+0000 7f6483400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64841015f0 0x7f6484101a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:44.832 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.861+0000 7f6483400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64841015f0 0x7f6484101a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57246/0 (socket says 172.21.15.84:57246) 2024-04-26T21:13:44.832 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.861+0000 7f6483400700 1 -- 172.21.15.84:0/3048274041 learned_addr learned my addr 172.21.15.84:0/3048274041 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:44.832 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.861+0000 7f6483400700 1 -- 172.21.15.84:0/3048274041 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6484102080 con 0x7f64841015f0 2024-04-26T21:13:44.832 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.862+0000 7f6483400700 1 --2- 172.21.15.84:0/3048274041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64841015f0 0x7f6484101a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f64740098e0 tx=0x7f6474009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb10c16285d1113a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:44.832 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.862+0000 7f6482000700 1 -- 172.21.15.84:0/3048274041 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f647400b860 con 0x7f64841015f0 2024-04-26T21:13:44.832 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.862+0000 7f6482000700 1 -- 172.21.15.84:0/3048274041 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f647400be90 con 0x7f64841015f0 2024-04-26T21:13:44.833 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.862+0000 7f6482000700 1 -- 172.21.15.84:0/3048274041 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f64740103c0 con 0x7f64841015f0 2024-04-26T21:13:44.833 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.863+0000 7f6489200700 1 -- 172.21.15.84:0/3048274041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64841015f0 msgr2=0x7f6484101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:44.833 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.863+0000 7f6489200700 1 --2- 172.21.15.84:0/3048274041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64841015f0 0x7f6484101a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f64740098e0 tx=0x7f6474009250 comp rx=0 tx=0).stop 2024-04-26T21:13:44.833 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.863+0000 7f6489200700 1 -- 172.21.15.84:0/3048274041 shutdown_connections 2024-04-26T21:13:44.833 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.863+0000 7f6489200700 1 --2- 172.21.15.84:0/3048274041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64841015f0 0x7f6484101a00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:44.833 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.863+0000 7f6489200700 1 -- 172.21.15.84:0/3048274041 >> 172.21.15.84:0/3048274041 conn(0x7f64840fcd70 msgr2=0x7f64840ff180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:44.833 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.863+0000 7f6489200700 1 -- 172.21.15.84:0/3048274041 shutdown_connections 2024-04-26T21:13:44.833 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.863+0000 7f6489200700 1 -- 172.21.15.84:0/3048274041 wait complete. 2024-04-26T21:13:44.833 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.864+0000 7f6489200700 1 Processor -- start 2024-04-26T21:13:44.833 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.864+0000 7f6489200700 1 -- start start 2024-04-26T21:13:44.833 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.864+0000 7f6489200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64841015f0 0x7f6484113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:44.833 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.864+0000 7f6489200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6484113c40 con 0x7f64841015f0 2024-04-26T21:13:44.833 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.864+0000 7f6483400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64841015f0 0x7f6484113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:44.833 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.865+0000 7f6483400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64841015f0 0x7f6484113700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57250/0 (socket says 172.21.15.84:57250) 2024-04-26T21:13:44.834 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.865+0000 7f6483400700 1 -- 172.21.15.84:0/1287037783 learned_addr learned my addr 172.21.15.84:0/1287037783 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:44.834 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.865+0000 7f6483400700 1 -- 172.21.15.84:0/1287037783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64740094f0 con 0x7f64841015f0 2024-04-26T21:13:44.834 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.865+0000 7f6483400700 1 --2- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64841015f0 0x7f6484113700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6474006b00 tx=0x7f6474009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:44.834 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.865+0000 7f647b400700 1 -- 172.21.15.84:0/1287037783 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6474010840 con 0x7f64841015f0 2024-04-26T21:13:44.834 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.865+0000 7f647b400700 1 -- 172.21.15.84:0/1287037783 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6474010e70 con 0x7f64841015f0 2024-04-26T21:13:44.834 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.865+0000 7f6489200700 1 -- 172.21.15.84:0/1287037783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6484113e40 con 0x7f64841015f0 2024-04-26T21:13:44.834 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.865+0000 7f647b400700 1 -- 172.21.15.84:0/1287037783 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f647401ae70 con 0x7f64841015f0 2024-04-26T21:13:44.834 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.866+0000 7f6489200700 1 -- 172.21.15.84:0/1287037783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64841149b0 con 0x7f64841015f0 2024-04-26T21:13:44.834 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.867+0000 7f647b400700 1 -- 172.21.15.84:0/1287037783 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f647401a780 con 0x7f64841015f0 2024-04-26T21:13:44.834 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.867+0000 7f647b400700 1 --2- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f64680368f0 0x7f6468038da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:44.834 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.867+0000 7f647b400700 1 -- 172.21.15.84:0/1287037783 --> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f64680394b0 con 0x7f64680368f0 2024-04-26T21:13:44.834 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.867+0000 7f647b400700 1 -- 172.21.15.84:0/1287037783 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f647404ab80 con 0x7f64841015f0 2024-04-26T21:13:44.834 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.867+0000 7f6482a00700 1 -- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f64680368f0 msgr2=0x7f6468038da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/2151160823 2024-04-26T21:13:44.834 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:36.867+0000 7f6482a00700 1 --2- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f64680368f0 0x7f6468038da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T21:13:44.835 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:37.068+0000 7f6482a00700 1 -- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f64680368f0 msgr2=0x7f6468038da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/2151160823 2024-04-26T21:13:44.835 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:37.068+0000 7f6482a00700 1 --2- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f64680368f0 0x7f6468038da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T21:13:44.835 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:37.469+0000 7f6482a00700 1 -- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f64680368f0 msgr2=0x7f6468038da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/2151160823 2024-04-26T21:13:44.835 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:37.469+0000 7f6482a00700 1 --2- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f64680368f0 0x7f6468038da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T21:13:44.835 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:38.270+0000 7f6482a00700 1 -- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f64680368f0 msgr2=0x7f6468038da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/2151160823 2024-04-26T21:13:44.835 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:38.270+0000 7f6482a00700 1 --2- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f64680368f0 0x7f6468038da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T21:13:44.835 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:39.872+0000 7f6482a00700 1 -- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f64680368f0 msgr2=0x7f6468038da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/2151160823 2024-04-26T21:13:44.835 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:39.872+0000 7f6482a00700 1 --2- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f64680368f0 0x7f6468038da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-26T21:13:44.835 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:42.671+0000 7f647b400700 1 -- 172.21.15.84:0/1287037783 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mgrmap(e 10) v1 ==== 43156+0+0 (secure 0 0 0) 0x7f64740109a0 con 0x7f64841015f0 2024-04-26T21:13:44.835 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:42.671+0000 7f647b400700 1 -- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f64680368f0 msgr2=0x7f6468038da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T21:13:44.835 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:42.671+0000 7f647b400700 1 --2- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f64680368f0 0x7f6468038da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:44.835 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:43.677+0000 7f647b400700 1 -- 172.21.15.84:0/1287037783 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 11) v1 ==== 43283+0+0 (secure 0 0 0) 0x7f647402c390 con 0x7f64841015f0 2024-04-26T21:13:44.835 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:43.677+0000 7f647b400700 1 --2- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f646803a3a0 0x7f646803c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:44.835 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:43.677+0000 7f647b400700 1 -- 172.21.15.84:0/1287037783 --> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f64680394b0 con 0x7f646803a3a0 2024-04-26T21:13:44.836 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:43.680+0000 7f6482a00700 1 --2- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f646803a3a0 0x7f646803c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:44.836 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:43.683+0000 7f6482a00700 1 --2- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f646803a3a0 0x7f646803c780 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f64700039d0 tx=0x7f6470009350 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:44.836 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:43.685+0000 7f647b400700 1 -- 172.21.15.84:0/1287037783 <== mgr.14162 v2:172.21.15.84:6800/3446199945 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f64680394b0 con 0x7f646803a3a0 2024-04-26T21:13:44.836 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:43.692+0000 7f6489200700 1 -- 172.21.15.84:0/1287037783 --> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f64841142d0 con 0x7f646803a3a0 2024-04-26T21:13:44.836 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:43.693+0000 7f647b400700 1 -- 172.21.15.84:0/1287037783 <== mgr.14162 v2:172.21.15.84:6800/3446199945 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f64841142d0 con 0x7f646803a3a0 2024-04-26T21:13:44.836 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:43.694+0000 7f6489200700 1 -- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f646803a3a0 msgr2=0x7f646803c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:44.836 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:43.694+0000 7f6489200700 1 --2- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f646803a3a0 0x7f646803c780 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f64700039d0 tx=0x7f6470009350 comp rx=0 tx=0).stop 2024-04-26T21:13:44.836 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:43.694+0000 7f6489200700 1 -- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64841015f0 msgr2=0x7f6484113700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:44.836 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:43.694+0000 7f6489200700 1 --2- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64841015f0 0x7f6484113700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6474006b00 tx=0x7f6474009250 comp rx=0 tx=0).stop 2024-04-26T21:13:44.836 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:43.694+0000 7f6489200700 1 -- 172.21.15.84:0/1287037783 shutdown_connections 2024-04-26T21:13:44.836 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:43.694+0000 7f6489200700 1 --2- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f646803a3a0 0x7f646803c780 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:44.836 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:43.694+0000 7f6489200700 1 --2- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64841015f0 0x7f6484113700 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:44.836 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:43.694+0000 7f6489200700 1 --2- 172.21.15.84:0/1287037783 >> [v2:172.21.15.84:6800/2151160823,v1:172.21.15.84:6801/2151160823] conn(0x7f64680368f0 0x7f6468038da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:44.837 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:43.694+0000 7f6489200700 1 -- 172.21.15.84:0/1287037783 >> 172.21.15.84:0/1287037783 conn(0x7f64840fcd70 msgr2=0x7f64840fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:44.837 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:43.694+0000 7f6489200700 1 -- 172.21.15.84:0/1287037783 shutdown_connections 2024-04-26T21:13:44.837 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:43.694+0000 7f6489200700 1 -- 172.21.15.84:0/1287037783 wait complete. 2024-04-26T21:13:44.837 INFO:teuthology.orchestra.run.smithi084.stdout:mgr epoch 9 is available 2024-04-26T21:13:44.837 INFO:teuthology.orchestra.run.smithi084.stdout:Generating a dashboard self-signed certificate... 2024-04-26T21:13:46.447 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-26T21:13:46.448 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.440+0000 7fc5ff000700 1 Processor -- start 2024-04-26T21:13:46.448 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.440+0000 7fc5ff000700 1 -- start start 2024-04-26T21:13:46.448 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.441+0000 7fc5ff000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f8104bb0 0x7fc5f8104fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:46.448 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.441+0000 7fc5ff000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f8105590 con 0x7fc5f8104bb0 2024-04-26T21:13:46.449 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.441+0000 7fc5f7e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f8104bb0 0x7fc5f8104fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:46.449 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.441+0000 7fc5f7e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f8104bb0 0x7fc5f8104fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50616/0 (socket says 172.21.15.84:50616) 2024-04-26T21:13:46.449 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.441+0000 7fc5f7e00700 1 -- 172.21.15.84:0/3298386323 learned_addr learned my addr 172.21.15.84:0/3298386323 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:46.449 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.442+0000 7fc5f7e00700 1 -- 172.21.15.84:0/3298386323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f81056d0 con 0x7fc5f8104bb0 2024-04-26T21:13:46.449 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.442+0000 7fc5f7e00700 1 --2- 172.21.15.84:0/3298386323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f8104bb0 0x7fc5f8104fc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc5e80098e0 tx=0x7fc5e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db13a8ce631c5ed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:46.449 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.442+0000 7fc5f6a00700 1 -- 172.21.15.84:0/3298386323 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5e800b860 con 0x7fc5f8104bb0 2024-04-26T21:13:46.450 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.442+0000 7fc5f6a00700 1 -- 172.21.15.84:0/3298386323 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5e800be90 con 0x7fc5f8104bb0 2024-04-26T21:13:46.450 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.442+0000 7fc5f6a00700 1 -- 172.21.15.84:0/3298386323 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5e80103c0 con 0x7fc5f8104bb0 2024-04-26T21:13:46.450 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.443+0000 7fc5ff000700 1 -- 172.21.15.84:0/3298386323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f8104bb0 msgr2=0x7fc5f8104fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:46.450 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.443+0000 7fc5ff000700 1 --2- 172.21.15.84:0/3298386323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f8104bb0 0x7fc5f8104fc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc5e80098e0 tx=0x7fc5e8009250 comp rx=0 tx=0).stop 2024-04-26T21:13:46.451 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.443+0000 7fc5ff000700 1 -- 172.21.15.84:0/3298386323 shutdown_connections 2024-04-26T21:13:46.451 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.443+0000 7fc5ff000700 1 --2- 172.21.15.84:0/3298386323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f8104bb0 0x7fc5f8104fc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:46.451 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.443+0000 7fc5ff000700 1 -- 172.21.15.84:0/3298386323 >> 172.21.15.84:0/3298386323 conn(0x7fc5f8078300 msgr2=0x7fc5f8078700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:46.451 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.444+0000 7fc5ff000700 1 -- 172.21.15.84:0/3298386323 shutdown_connections 2024-04-26T21:13:46.452 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.444+0000 7fc5ff000700 1 -- 172.21.15.84:0/3298386323 wait complete. 2024-04-26T21:13:46.452 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.444+0000 7fc5ff000700 1 Processor -- start 2024-04-26T21:13:46.452 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.444+0000 7fc5ff000700 1 -- start start 2024-04-26T21:13:46.452 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.445+0000 7fc5ff000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f8104bb0 0x7fc5f81137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:46.452 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.445+0000 7fc5ff000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f8113d10 con 0x7fc5f8104bb0 2024-04-26T21:13:46.452 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.445+0000 7fc5f7e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f8104bb0 0x7fc5f81137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:46.453 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.445+0000 7fc5f7e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f8104bb0 0x7fc5f81137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50620/0 (socket says 172.21.15.84:50620) 2024-04-26T21:13:46.453 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.445+0000 7fc5f7e00700 1 -- 172.21.15.84:0/679223624 learned_addr learned my addr 172.21.15.84:0/679223624 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:46.453 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.445+0000 7fc5f7e00700 1 -- 172.21.15.84:0/679223624 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e80094f0 con 0x7fc5f8104bb0 2024-04-26T21:13:46.453 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.446+0000 7fc5f7e00700 1 --2- 172.21.15.84:0/679223624 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f8104bb0 0x7fc5f81137d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8006d40 tx=0x7fc5e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:46.454 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.446+0000 7fc5efe00700 1 -- 172.21.15.84:0/679223624 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5e8010840 con 0x7fc5f8104bb0 2024-04-26T21:13:46.454 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.446+0000 7fc5efe00700 1 -- 172.21.15.84:0/679223624 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5e8010e70 con 0x7fc5f8104bb0 2024-04-26T21:13:46.454 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.446+0000 7fc5efe00700 1 -- 172.21.15.84:0/679223624 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5e8024ea0 con 0x7fc5f8104bb0 2024-04-26T21:13:46.454 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.446+0000 7fc5ff000700 1 -- 172.21.15.84:0/679223624 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f8113f10 con 0x7fc5f8104bb0 2024-04-26T21:13:46.455 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.446+0000 7fc5ff000700 1 -- 172.21.15.84:0/679223624 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f8114a80 con 0x7fc5f8104bb0 2024-04-26T21:13:46.455 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.448+0000 7fc5ed600700 1 -- 172.21.15.84:0/679223624 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d00052b0 con 0x7fc5f8104bb0 2024-04-26T21:13:46.455 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.448+0000 7fc5efe00700 1 -- 172.21.15.84:0/679223624 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 43283+0+0 (secure 0 0 0) 0x7fc5e8024780 con 0x7fc5f8104bb0 2024-04-26T21:13:46.455 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.449+0000 7fc5efe00700 1 --2- 172.21.15.84:0/679223624 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fc5dc036770 0x7fc5dc038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:46.455 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.449+0000 7fc5efe00700 1 -- 172.21.15.84:0/679223624 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc5e804a5e0 con 0x7fc5f8104bb0 2024-04-26T21:13:46.455 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.449+0000 7fc5f7400700 1 --2- 172.21.15.84:0/679223624 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fc5dc036770 0x7fc5dc038c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:46.455 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.450+0000 7fc5f7400700 1 --2- 172.21.15.84:0/679223624 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fc5dc036770 0x7fc5dc038c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4009990 tx=0x7fc5e4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:46.456 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.454+0000 7fc5efe00700 1 -- 172.21.15.84:0/679223624 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc5e802c930 con 0x7fc5f8104bb0 2024-04-26T21:13:46.457 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.600+0000 7fc5efe00700 1 -- 172.21.15.84:0/679223624 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7fc5e802e440 con 0x7fc5f8104bb0 2024-04-26T21:13:46.457 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.688+0000 7fc5ed600700 1 -- 172.21.15.84:0/679223624 --> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5d0000bc0 con 0x7fc5dc036770 2024-04-26T21:13:46.457 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.786+0000 7fc5efe00700 1 -- 172.21.15.84:0/679223624 <== mgr.14162 v2:172.21.15.84:6800/3446199945 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fc5d0000bc0 con 0x7fc5dc036770 2024-04-26T21:13:46.457 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.790+0000 7fc5ed600700 1 -- 172.21.15.84:0/679223624 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fc5dc036770 msgr2=0x7fc5dc038c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:46.457 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.790+0000 7fc5ed600700 1 --2- 172.21.15.84:0/679223624 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fc5dc036770 0x7fc5dc038c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4009990 tx=0x7fc5e4006e40 comp rx=0 tx=0).stop 2024-04-26T21:13:46.457 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.790+0000 7fc5ed600700 1 -- 172.21.15.84:0/679223624 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f8104bb0 msgr2=0x7fc5f81137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:46.457 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.790+0000 7fc5ed600700 1 --2- 172.21.15.84:0/679223624 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f8104bb0 0x7fc5f81137d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8006d40 tx=0x7fc5e8009250 comp rx=0 tx=0).stop 2024-04-26T21:13:46.457 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.791+0000 7fc5ed600700 1 -- 172.21.15.84:0/679223624 shutdown_connections 2024-04-26T21:13:46.457 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.791+0000 7fc5ed600700 1 --2- 172.21.15.84:0/679223624 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fc5dc036770 0x7fc5dc038c20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:46.457 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.791+0000 7fc5ed600700 1 --2- 172.21.15.84:0/679223624 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f8104bb0 0x7fc5f81137d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:46.457 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.791+0000 7fc5ed600700 1 -- 172.21.15.84:0/679223624 >> 172.21.15.84:0/679223624 conn(0x7fc5f8078300 msgr2=0x7fc5f8102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:46.458 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.791+0000 7fc5ed600700 1 -- 172.21.15.84:0/679223624 shutdown_connections 2024-04-26T21:13:46.458 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:45.791+0000 7fc5ed600700 1 -- 172.21.15.84:0/679223624 wait complete. 2024-04-26T21:13:46.458 INFO:teuthology.orchestra.run.smithi084.stdout:Creating initial admin user... 2024-04-26T21:13:46.769 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:46 smithi084 ceph-mon[25539]: mgrmap e12: smithi084.gyasul(active, since 2s) 2024-04-26T21:13:46.769 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:46 smithi084 ceph-mon[25539]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:46.769 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:46 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:46.769 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:46 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:46.769 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:46 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:48.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:48 smithi084 ceph-mon[25539]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:48.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:48 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:48.862 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$r1p52igEQ0KqVlINo7IMMOGRCRW8L45X.DrszJCunPAySyoT6KMQy", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1714166027, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-26T21:13:48.862 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.102+0000 7fee96800700 1 Processor -- start 2024-04-26T21:13:48.862 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.103+0000 7fee96800700 1 -- start start 2024-04-26T21:13:48.863 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.103+0000 7fee96800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee90101740 0x7fee90101b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:48.863 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.103+0000 7fee96800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee90102090 con 0x7fee90101740 2024-04-26T21:13:48.863 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.103+0000 7fee8f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee90101740 0x7fee90101b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:48.863 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.103+0000 7fee8f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee90101740 0x7fee90101b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50624/0 (socket says 172.21.15.84:50624) 2024-04-26T21:13:48.863 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.103+0000 7fee8f400700 1 -- 172.21.15.84:0/4092869011 learned_addr learned my addr 172.21.15.84:0/4092869011 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:48.863 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.104+0000 7fee8f400700 1 -- 172.21.15.84:0/4092869011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee901021d0 con 0x7fee90101740 2024-04-26T21:13:48.863 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.104+0000 7fee8f400700 1 --2- 172.21.15.84:0/4092869011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee90101740 0x7fee90101b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee800098e0 tx=0x7fee80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8486426702cc3a41 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:48.863 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.104+0000 7fee8e000700 1 -- 172.21.15.84:0/4092869011 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee8000b860 con 0x7fee90101740 2024-04-26T21:13:48.863 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.105+0000 7fee8e000700 1 -- 172.21.15.84:0/4092869011 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee8000be90 con 0x7fee90101740 2024-04-26T21:13:48.863 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.105+0000 7fee8e000700 1 -- 172.21.15.84:0/4092869011 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee800103c0 con 0x7fee90101740 2024-04-26T21:13:48.863 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.105+0000 7fee96800700 1 -- 172.21.15.84:0/4092869011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee90101740 msgr2=0x7fee90101b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:48.863 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.105+0000 7fee96800700 1 --2- 172.21.15.84:0/4092869011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee90101740 0x7fee90101b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee800098e0 tx=0x7fee80009250 comp rx=0 tx=0).stop 2024-04-26T21:13:48.863 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.105+0000 7fee96800700 1 -- 172.21.15.84:0/4092869011 shutdown_connections 2024-04-26T21:13:48.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.105+0000 7fee96800700 1 --2- 172.21.15.84:0/4092869011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee90101740 0x7fee90101b50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:48.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.105+0000 7fee96800700 1 -- 172.21.15.84:0/4092869011 >> 172.21.15.84:0/4092869011 conn(0x7fee900fcec0 msgr2=0x7fee900ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:48.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.106+0000 7fee96800700 1 -- 172.21.15.84:0/4092869011 shutdown_connections 2024-04-26T21:13:48.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.106+0000 7fee96800700 1 -- 172.21.15.84:0/4092869011 wait complete. 2024-04-26T21:13:48.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.106+0000 7fee96800700 1 Processor -- start 2024-04-26T21:13:48.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.107+0000 7fee96800700 1 -- start start 2024-04-26T21:13:48.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.107+0000 7fee96800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee90101740 0x7fee901079b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:48.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.107+0000 7fee96800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee90107ef0 con 0x7fee90101740 2024-04-26T21:13:48.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.107+0000 7fee8f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee90101740 0x7fee901079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:48.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.107+0000 7fee8f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee90101740 0x7fee901079b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50638/0 (socket says 172.21.15.84:50638) 2024-04-26T21:13:48.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.107+0000 7fee8f400700 1 -- 172.21.15.84:0/1581193730 learned_addr learned my addr 172.21.15.84:0/1581193730 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:48.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.108+0000 7fee8f400700 1 -- 172.21.15.84:0/1581193730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee800094f0 con 0x7fee90101740 2024-04-26T21:13:48.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.108+0000 7fee8f400700 1 --2- 172.21.15.84:0/1581193730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee90101740 0x7fee901079b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fee80011680 tx=0x7fee80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:48.864 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.108+0000 7fee87400700 1 -- 172.21.15.84:0/1581193730 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee80010890 con 0x7fee90101740 2024-04-26T21:13:48.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.108+0000 7fee87400700 1 -- 172.21.15.84:0/1581193730 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee80010ec0 con 0x7fee90101740 2024-04-26T21:13:48.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.108+0000 7fee96800700 1 -- 172.21.15.84:0/1581193730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee90105f60 con 0x7fee90101740 2024-04-26T21:13:48.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.108+0000 7fee87400700 1 -- 172.21.15.84:0/1581193730 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee800243f0 con 0x7fee90101740 2024-04-26T21:13:48.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.109+0000 7fee96800700 1 -- 172.21.15.84:0/1581193730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee90106450 con 0x7fee90101740 2024-04-26T21:13:48.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.109+0000 7fee87400700 1 -- 172.21.15.84:0/1581193730 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7fee8002d3f0 con 0x7fee90101740 2024-04-26T21:13:48.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.110+0000 7fee87400700 1 --2- 172.21.15.84:0/1581193730 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fee740368a0 0x7fee74038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:48.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.110+0000 7fee87400700 1 -- 172.21.15.84:0/1581193730 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fee8004a670 con 0x7fee90101740 2024-04-26T21:13:48.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.110+0000 7fee96800700 1 -- 172.21.15.84:0/1581193730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9004bed0 con 0x7fee90101740 2024-04-26T21:13:48.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.110+0000 7fee8ea00700 1 --2- 172.21.15.84:0/1581193730 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fee740368a0 0x7fee74038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:48.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.111+0000 7fee8ea00700 1 --2- 172.21.15.84:0/1581193730 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fee740368a0 0x7fee74038d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009990 tx=0x7fee7c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:48.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.116+0000 7fee87400700 1 -- 172.21.15.84:0/1581193730 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fee8002b8e0 con 0x7fee90101740 2024-04-26T21:13:48.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.356+0000 7fee96800700 1 -- 172.21.15.84:0/1581193730 --> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fee901034e0 con 0x7fee740368a0 2024-04-26T21:13:48.865 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.613+0000 7fee87400700 1 -- 172.21.15.84:0/1581193730 <== mgr.14162 v2:172.21.15.84:6800/3446199945 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fee901034e0 con 0x7fee740368a0 2024-04-26T21:13:48.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.617+0000 7fee96800700 1 -- 172.21.15.84:0/1581193730 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fee740368a0 msgr2=0x7fee74038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:48.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.617+0000 7fee96800700 1 --2- 172.21.15.84:0/1581193730 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fee740368a0 0x7fee74038d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009990 tx=0x7fee7c006e40 comp rx=0 tx=0).stop 2024-04-26T21:13:48.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.617+0000 7fee96800700 1 -- 172.21.15.84:0/1581193730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee90101740 msgr2=0x7fee901079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:48.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.617+0000 7fee96800700 1 --2- 172.21.15.84:0/1581193730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee90101740 0x7fee901079b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fee80011680 tx=0x7fee80009250 comp rx=0 tx=0).stop 2024-04-26T21:13:48.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.617+0000 7fee96800700 1 -- 172.21.15.84:0/1581193730 shutdown_connections 2024-04-26T21:13:48.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.617+0000 7fee96800700 1 --2- 172.21.15.84:0/1581193730 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fee740368a0 0x7fee74038d50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:48.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.617+0000 7fee96800700 1 --2- 172.21.15.84:0/1581193730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee90101740 0x7fee901079b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:48.867 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.617+0000 7fee96800700 1 -- 172.21.15.84:0/1581193730 >> 172.21.15.84:0/1581193730 conn(0x7fee900fcec0 msgr2=0x7fee900fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:48.868 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.617+0000 7fee96800700 1 -- 172.21.15.84:0/1581193730 shutdown_connections 2024-04-26T21:13:48.868 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:47.618+0000 7fee96800700 1 -- 172.21.15.84:0/1581193730 wait complete. 2024-04-26T21:13:48.868 INFO:teuthology.orchestra.run.smithi084.stdout:Fetching dashboard port number... 2024-04-26T21:13:50.340 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 8443 2024-04-26T21:13:50.340 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.454+0000 7f236da00700 1 Processor -- start 2024-04-26T21:13:50.341 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.454+0000 7f236da00700 1 -- start start 2024-04-26T21:13:50.341 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.454+0000 7f236da00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2368104bb0 0x7f2368104fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:50.341 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.454+0000 7f236da00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2368105590 con 0x7f2368104bb0 2024-04-26T21:13:50.341 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.455+0000 7f2366a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2368104bb0 0x7f2368104fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:50.341 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.455+0000 7f2366a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2368104bb0 0x7f2368104fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50644/0 (socket says 172.21.15.84:50644) 2024-04-26T21:13:50.341 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.455+0000 7f2366a00700 1 -- 172.21.15.84:0/3062306349 learned_addr learned my addr 172.21.15.84:0/3062306349 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:50.341 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.455+0000 7f2366a00700 1 -- 172.21.15.84:0/3062306349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23681056d0 con 0x7f2368104bb0 2024-04-26T21:13:50.341 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.456+0000 7f2366a00700 1 --2- 172.21.15.84:0/3062306349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2368104bb0 0x7f2368104fc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f23580098e0 tx=0x7f2358009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1cb0a86cb41b6e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:50.341 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.456+0000 7f2365600700 1 -- 172.21.15.84:0/3062306349 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f235800b860 con 0x7f2368104bb0 2024-04-26T21:13:50.341 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.456+0000 7f2365600700 1 -- 172.21.15.84:0/3062306349 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f235800be90 con 0x7f2368104bb0 2024-04-26T21:13:50.342 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.456+0000 7f2365600700 1 -- 172.21.15.84:0/3062306349 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23580103c0 con 0x7f2368104bb0 2024-04-26T21:13:50.342 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.457+0000 7f236da00700 1 -- 172.21.15.84:0/3062306349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2368104bb0 msgr2=0x7f2368104fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:50.342 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.457+0000 7f236da00700 1 --2- 172.21.15.84:0/3062306349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2368104bb0 0x7f2368104fc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f23580098e0 tx=0x7f2358009250 comp rx=0 tx=0).stop 2024-04-26T21:13:50.342 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.457+0000 7f236da00700 1 -- 172.21.15.84:0/3062306349 shutdown_connections 2024-04-26T21:13:50.342 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.457+0000 7f236da00700 1 --2- 172.21.15.84:0/3062306349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2368104bb0 0x7f2368104fc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:50.342 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.457+0000 7f236da00700 1 -- 172.21.15.84:0/3062306349 >> 172.21.15.84:0/3062306349 conn(0x7f2368078300 msgr2=0x7f2368078700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:50.342 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.457+0000 7f236da00700 1 -- 172.21.15.84:0/3062306349 shutdown_connections 2024-04-26T21:13:50.342 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.457+0000 7f236da00700 1 -- 172.21.15.84:0/3062306349 wait complete. 2024-04-26T21:13:50.342 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.458+0000 7f236da00700 1 Processor -- start 2024-04-26T21:13:50.342 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.458+0000 7f236da00700 1 -- start start 2024-04-26T21:13:50.342 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.459+0000 7f236da00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2368104bb0 0x7f2368113820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:50.342 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.459+0000 7f236da00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2368113d60 con 0x7f2368104bb0 2024-04-26T21:13:50.343 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.459+0000 7f2366a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2368104bb0 0x7f2368113820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:50.343 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.459+0000 7f2366a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2368104bb0 0x7f2368113820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50658/0 (socket says 172.21.15.84:50658) 2024-04-26T21:13:50.343 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.459+0000 7f2366a00700 1 -- 172.21.15.84:0/1017090303 learned_addr learned my addr 172.21.15.84:0/1017090303 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:50.343 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.459+0000 7f2366a00700 1 -- 172.21.15.84:0/1017090303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23580094f0 con 0x7f2368104bb0 2024-04-26T21:13:50.343 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.459+0000 7f2366a00700 1 --2- 172.21.15.84:0/1017090303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2368104bb0 0x7f2368113820 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2358006d40 tx=0x7f2358009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:50.343 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.460+0000 7f235ea00700 1 -- 172.21.15.84:0/1017090303 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2358010840 con 0x7f2368104bb0 2024-04-26T21:13:50.343 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.460+0000 7f235ea00700 1 -- 172.21.15.84:0/1017090303 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2358010e70 con 0x7f2368104bb0 2024-04-26T21:13:50.343 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.460+0000 7f235ea00700 1 -- 172.21.15.84:0/1017090303 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2358024ea0 con 0x7f2368104bb0 2024-04-26T21:13:50.343 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.460+0000 7f236da00700 1 -- 172.21.15.84:0/1017090303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2368113f60 con 0x7f2368104bb0 2024-04-26T21:13:50.343 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.460+0000 7f236da00700 1 -- 172.21.15.84:0/1017090303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2368114ad0 con 0x7f2368104bb0 2024-04-26T21:13:50.343 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.461+0000 7f235ea00700 1 -- 172.21.15.84:0/1017090303 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f2358024780 con 0x7f2368104bb0 2024-04-26T21:13:50.343 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.461+0000 7f236da00700 1 -- 172.21.15.84:0/1017090303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f236805f5c0 con 0x7f2368104bb0 2024-04-26T21:13:50.343 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.461+0000 7f235ea00700 1 --2- 172.21.15.84:0/1017090303 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f234c0368a0 0x7f234c038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:50.343 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.461+0000 7f235ea00700 1 -- 172.21.15.84:0/1017090303 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f235804a7a0 con 0x7f2368104bb0 2024-04-26T21:13:50.343 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.462+0000 7f2366000700 1 --2- 172.21.15.84:0/1017090303 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f234c0368a0 0x7f234c038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:50.344 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.462+0000 7f2366000700 1 --2- 172.21.15.84:0/1017090303 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f234c0368a0 0x7f234c038d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2354009990 tx=0x7f2354006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:50.344 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.467+0000 7f235ea00700 1 -- 172.21.15.84:0/1017090303 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f235802c930 con 0x7f2368104bb0 2024-04-26T21:13:50.344 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.617+0000 7f235ea00700 1 -- 172.21.15.84:0/1017090303 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f235802e440 con 0x7f2368104bb0 2024-04-26T21:13:50.344 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.679+0000 7f236da00700 1 -- 172.21.15.84:0/1017090303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f236804bed0 con 0x7f2368104bb0 2024-04-26T21:13:50.344 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.680+0000 7f235ea00700 1 -- 172.21.15.84:0/1017090303 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f23580244f0 con 0x7f2368104bb0 2024-04-26T21:13:50.344 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.682+0000 7f236da00700 1 -- 172.21.15.84:0/1017090303 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f234c0368a0 msgr2=0x7f234c038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:50.344 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.682+0000 7f236da00700 1 --2- 172.21.15.84:0/1017090303 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f234c0368a0 0x7f234c038d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2354009990 tx=0x7f2354006e40 comp rx=0 tx=0).stop 2024-04-26T21:13:50.344 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.682+0000 7f236da00700 1 -- 172.21.15.84:0/1017090303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2368104bb0 msgr2=0x7f2368113820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:50.344 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.682+0000 7f236da00700 1 --2- 172.21.15.84:0/1017090303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2368104bb0 0x7f2368113820 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2358006d40 tx=0x7f2358009250 comp rx=0 tx=0).stop 2024-04-26T21:13:50.344 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.682+0000 7f236da00700 1 -- 172.21.15.84:0/1017090303 shutdown_connections 2024-04-26T21:13:50.344 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.682+0000 7f236da00700 1 --2- 172.21.15.84:0/1017090303 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f234c0368a0 0x7f234c038d50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:50.344 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.682+0000 7f236da00700 1 --2- 172.21.15.84:0/1017090303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2368104bb0 0x7f2368113820 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:50.345 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.682+0000 7f236da00700 1 -- 172.21.15.84:0/1017090303 >> 172.21.15.84:0/1017090303 conn(0x7f2368078300 msgr2=0x7f23681024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:50.345 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.683+0000 7f236da00700 1 -- 172.21.15.84:0/1017090303 shutdown_connections 2024-04-26T21:13:50.345 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:49.683+0000 7f236da00700 1 -- 172.21.15.84:0/1017090303 wait complete. 2024-04-26T21:13:50.373 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T21:13:50.374 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-04-26T21:13:50.400 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T21:13:50.400 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-04-26T21:13:50.400 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-04-26T21:13:50.400 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-26T21:13:50.408 INFO:teuthology.orchestra.run.smithi084.stdout:Ceph Dashboard is now available at: 2024-04-26T21:13:50.408 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:13:50.408 INFO:teuthology.orchestra.run.smithi084.stdout: URL: https://smithi084.front.sepia.ceph.com:8443/ 2024-04-26T21:13:50.409 INFO:teuthology.orchestra.run.smithi084.stdout: User: admin 2024-04-26T21:13:50.409 INFO:teuthology.orchestra.run.smithi084.stdout: Password: vcdyn8dqxj 2024-04-26T21:13:50.409 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:13:50.409 INFO:teuthology.orchestra.run.smithi084.stdout:Saving cluster configuration to /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config directory 2024-04-26T21:13:50.412 INFO:teuthology.orchestra.run.smithi084.stdout:Enabling autotune for osd_memory_target 2024-04-26T21:13:50.852 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:50 smithi084 ceph-mon[25539]: mgrmap e13: smithi084.gyasul(active, since 6s) 2024-04-26T21:13:50.852 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:50 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1017090303' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-26T21:13:51.876 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.012+0000 7f1f1b800700 1 Processor -- start 2024-04-26T21:13:51.876 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.012+0000 7f1f1b800700 1 -- start start 2024-04-26T21:13:51.876 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.013+0000 7f1f1b800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f14104bb0 0x7f1f14104fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:51.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.013+0000 7f1f1b800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f14105590 con 0x7f1f14104bb0 2024-04-26T21:13:51.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.013+0000 7f1f18e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f14104bb0 0x7f1f14104fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:51.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.013+0000 7f1f18e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f14104bb0 0x7f1f14104fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50668/0 (socket says 172.21.15.84:50668) 2024-04-26T21:13:51.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.013+0000 7f1f18e00700 1 -- 172.21.15.84:0/2950141701 learned_addr learned my addr 172.21.15.84:0/2950141701 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:51.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.014+0000 7f1f18e00700 1 -- 172.21.15.84:0/2950141701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f141056d0 con 0x7f1f14104bb0 2024-04-26T21:13:51.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.014+0000 7f1f18e00700 1 --2- 172.21.15.84:0/2950141701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f14104bb0 0x7f1f14104fc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1f080098e0 tx=0x7f1f08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25692a7da162747 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:51.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.014+0000 7f1f13400700 1 -- 172.21.15.84:0/2950141701 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1f0800b860 con 0x7f1f14104bb0 2024-04-26T21:13:51.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.014+0000 7f1f13400700 1 -- 172.21.15.84:0/2950141701 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f0800be90 con 0x7f1f14104bb0 2024-04-26T21:13:51.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.014+0000 7f1f13400700 1 -- 172.21.15.84:0/2950141701 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1f080103c0 con 0x7f1f14104bb0 2024-04-26T21:13:51.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.015+0000 7f1f1b800700 1 -- 172.21.15.84:0/2950141701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f14104bb0 msgr2=0x7f1f14104fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:51.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.015+0000 7f1f1b800700 1 --2- 172.21.15.84:0/2950141701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f14104bb0 0x7f1f14104fc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1f080098e0 tx=0x7f1f08009250 comp rx=0 tx=0).stop 2024-04-26T21:13:51.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.015+0000 7f1f1b800700 1 -- 172.21.15.84:0/2950141701 shutdown_connections 2024-04-26T21:13:51.877 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.015+0000 7f1f1b800700 1 --2- 172.21.15.84:0/2950141701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f14104bb0 0x7f1f14104fc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:51.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.015+0000 7f1f1b800700 1 -- 172.21.15.84:0/2950141701 >> 172.21.15.84:0/2950141701 conn(0x7f1f14078300 msgr2=0x7f1f14078700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:51.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.015+0000 7f1f1b800700 1 -- 172.21.15.84:0/2950141701 shutdown_connections 2024-04-26T21:13:51.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.015+0000 7f1f1b800700 1 -- 172.21.15.84:0/2950141701 wait complete. 2024-04-26T21:13:51.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.016+0000 7f1f1b800700 1 Processor -- start 2024-04-26T21:13:51.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.016+0000 7f1f1b800700 1 -- start start 2024-04-26T21:13:51.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.017+0000 7f1f1b800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f14104bb0 0x7f1f14113820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:51.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.017+0000 7f1f1b800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f14113d60 con 0x7f1f14104bb0 2024-04-26T21:13:51.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.017+0000 7f1f18e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f14104bb0 0x7f1f14113820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:51.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.017+0000 7f1f18e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f14104bb0 0x7f1f14113820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50674/0 (socket says 172.21.15.84:50674) 2024-04-26T21:13:51.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.017+0000 7f1f18e00700 1 -- 172.21.15.84:0/2611063364 learned_addr learned my addr 172.21.15.84:0/2611063364 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:51.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.017+0000 7f1f18e00700 1 -- 172.21.15.84:0/2611063364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f080094f0 con 0x7f1f14104bb0 2024-04-26T21:13:51.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.017+0000 7f1f18e00700 1 --2- 172.21.15.84:0/2611063364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f14104bb0 0x7f1f14113820 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1f08006d40 tx=0x7f1f08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:51.878 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.018+0000 7f1f10c00700 1 -- 172.21.15.84:0/2611063364 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1f08010840 con 0x7f1f14104bb0 2024-04-26T21:13:51.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.018+0000 7f1f10c00700 1 -- 172.21.15.84:0/2611063364 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f08010e70 con 0x7f1f14104bb0 2024-04-26T21:13:51.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.018+0000 7f1f10c00700 1 -- 172.21.15.84:0/2611063364 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1f08024ea0 con 0x7f1f14104bb0 2024-04-26T21:13:51.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.018+0000 7f1f1b800700 1 -- 172.21.15.84:0/2611063364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f14113f60 con 0x7f1f14104bb0 2024-04-26T21:13:51.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.018+0000 7f1f1b800700 1 -- 172.21.15.84:0/2611063364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f14114ad0 con 0x7f1f14104bb0 2024-04-26T21:13:51.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.019+0000 7f1f10c00700 1 -- 172.21.15.84:0/2611063364 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f1f08024780 con 0x7f1f14104bb0 2024-04-26T21:13:51.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.019+0000 7f1f1b800700 1 -- 172.21.15.84:0/2611063364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f1405f5c0 con 0x7f1f14104bb0 2024-04-26T21:13:51.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.020+0000 7f1f10c00700 1 --2- 172.21.15.84:0/2611063364 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f1efc036940 0x7f1efc038df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:51.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.020+0000 7f1f10c00700 1 -- 172.21.15.84:0/2611063364 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1f0804a820 con 0x7f1f14104bb0 2024-04-26T21:13:51.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.020+0000 7f1f13e00700 1 --2- 172.21.15.84:0/2611063364 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f1efc036940 0x7f1efc038df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:51.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.020+0000 7f1f13e00700 1 --2- 172.21.15.84:0/2611063364 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f1efc036940 0x7f1efc038df0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009990 tx=0x7f1f00006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:51.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.025+0000 7f1f10c00700 1 -- 172.21.15.84:0/2611063364 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1f0802c930 con 0x7f1f14104bb0 2024-04-26T21:13:51.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.234+0000 7f1f1b800700 1 -- 172.21.15.84:0/2611063364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f1f1404bed0 con 0x7f1f14104bb0 2024-04-26T21:13:51.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.235+0000 7f1f10c00700 1 -- 172.21.15.84:0/2611063364 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f1f0802c340 con 0x7f1f14104bb0 2024-04-26T21:13:51.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.238+0000 7f1f1b800700 1 -- 172.21.15.84:0/2611063364 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f1efc036940 msgr2=0x7f1efc038df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:51.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.238+0000 7f1f1b800700 1 --2- 172.21.15.84:0/2611063364 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f1efc036940 0x7f1efc038df0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009990 tx=0x7f1f00006e40 comp rx=0 tx=0).stop 2024-04-26T21:13:51.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.238+0000 7f1f1b800700 1 -- 172.21.15.84:0/2611063364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f14104bb0 msgr2=0x7f1f14113820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:51.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.238+0000 7f1f1b800700 1 --2- 172.21.15.84:0/2611063364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f14104bb0 0x7f1f14113820 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1f08006d40 tx=0x7f1f08009250 comp rx=0 tx=0).stop 2024-04-26T21:13:51.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.238+0000 7f1f1b800700 1 -- 172.21.15.84:0/2611063364 shutdown_connections 2024-04-26T21:13:51.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.238+0000 7f1f1b800700 1 --2- 172.21.15.84:0/2611063364 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f1efc036940 0x7f1efc038df0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:51.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.238+0000 7f1f1b800700 1 --2- 172.21.15.84:0/2611063364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f14104bb0 0x7f1f14113820 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:51.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.238+0000 7f1f1b800700 1 -- 172.21.15.84:0/2611063364 >> 172.21.15.84:0/2611063364 conn(0x7f1f14078300 msgr2=0x7f1f141024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:51.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.238+0000 7f1f1b800700 1 -- 172.21.15.84:0/2611063364 shutdown_connections 2024-04-26T21:13:51.880 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:51.239+0000 7f1f1b800700 1 -- 172.21.15.84:0/2611063364 wait complete. 2024-04-26T21:13:53.463 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.457+0000 7ff2a8600700 1 Processor -- start 2024-04-26T21:13:53.463 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.457+0000 7ff2a8600700 1 -- start start 2024-04-26T21:13:53.463 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.458+0000 7ff2a8600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a0102870 0x7ff2a0102c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:53.463 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.458+0000 7ff2a8600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a01031c0 con 0x7ff2a0102870 2024-04-26T21:13:53.463 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.458+0000 7ff2a5c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a0102870 0x7ff2a0102c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:53.463 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.458+0000 7ff2a5c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a0102870 0x7ff2a0102c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60384/0 (socket says 172.21.15.84:60384) 2024-04-26T21:13:53.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.458+0000 7ff2a5c00700 1 -- 172.21.15.84:0/2891735129 learned_addr learned my addr 172.21.15.84:0/2891735129 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:53.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.459+0000 7ff2a5c00700 1 -- 172.21.15.84:0/2891735129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a0103300 con 0x7ff2a0102870 2024-04-26T21:13:53.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.459+0000 7ff2a5c00700 1 --2- 172.21.15.84:0/2891735129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a0102870 0x7ff2a0102c80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff294009e50 tx=0x7ff294009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3db1e059de1dc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:53.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.459+0000 7ff29fe00700 1 -- 172.21.15.84:0/2891735129 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2940092e0 con 0x7ff2a0102870 2024-04-26T21:13:53.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.459+0000 7ff29fe00700 1 -- 172.21.15.84:0/2891735129 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff294012430 con 0x7ff2a0102870 2024-04-26T21:13:53.465 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.459+0000 7ff29fe00700 1 -- 172.21.15.84:0/2891735129 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2940075a0 con 0x7ff2a0102870 2024-04-26T21:13:53.466 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.460+0000 7ff2a8600700 1 -- 172.21.15.84:0/2891735129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a0102870 msgr2=0x7ff2a0102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:53.466 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.460+0000 7ff2a8600700 1 --2- 172.21.15.84:0/2891735129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a0102870 0x7ff2a0102c80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff294009e50 tx=0x7ff294009840 comp rx=0 tx=0).stop 2024-04-26T21:13:53.466 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.460+0000 7ff2a8600700 1 -- 172.21.15.84:0/2891735129 shutdown_connections 2024-04-26T21:13:53.466 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.460+0000 7ff2a8600700 1 --2- 172.21.15.84:0/2891735129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a0102870 0x7ff2a0102c80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:53.466 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.460+0000 7ff2a8600700 1 -- 172.21.15.84:0/2891735129 >> 172.21.15.84:0/2891735129 conn(0x7ff2a00fdf90 msgr2=0x7ff2a0100400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:53.466 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.460+0000 7ff2a8600700 1 -- 172.21.15.84:0/2891735129 shutdown_connections 2024-04-26T21:13:53.466 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.460+0000 7ff2a8600700 1 -- 172.21.15.84:0/2891735129 wait complete. 2024-04-26T21:13:53.466 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.461+0000 7ff2a8600700 1 Processor -- start 2024-04-26T21:13:53.466 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.461+0000 7ff2a8600700 1 -- start start 2024-04-26T21:13:53.469 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.461+0000 7ff2a8600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a0102870 0x7ff2a0113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:53.469 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.461+0000 7ff2a8600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a0113d80 con 0x7ff2a0102870 2024-04-26T21:13:53.469 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.462+0000 7ff2a5c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a0102870 0x7ff2a0113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:53.470 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.462+0000 7ff2a5c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a0102870 0x7ff2a0113840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60398/0 (socket says 172.21.15.84:60398) 2024-04-26T21:13:53.470 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.462+0000 7ff2a5c00700 1 -- 172.21.15.84:0/3878137278 learned_addr learned my addr 172.21.15.84:0/3878137278 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:53.470 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.462+0000 7ff2a5c00700 1 -- 172.21.15.84:0/3878137278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff294009ae0 con 0x7ff2a0102870 2024-04-26T21:13:53.470 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.462+0000 7ff2a5c00700 1 --2- 172.21.15.84:0/3878137278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a0102870 0x7ff2a0113840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff294009fd0 tx=0x7ff294009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:53.470 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.462+0000 7ff29d600700 1 -- 172.21.15.84:0/3878137278 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2940092e0 con 0x7ff2a0102870 2024-04-26T21:13:53.470 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.463+0000 7ff2a8600700 1 -- 172.21.15.84:0/3878137278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a0113f80 con 0x7ff2a0102870 2024-04-26T21:13:53.470 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.463+0000 7ff29d600700 1 -- 172.21.15.84:0/3878137278 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff294007ce0 con 0x7ff2a0102870 2024-04-26T21:13:53.470 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.463+0000 7ff29d600700 1 -- 172.21.15.84:0/3878137278 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff294025990 con 0x7ff2a0102870 2024-04-26T21:13:53.470 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.463+0000 7ff2a8600700 1 -- 172.21.15.84:0/3878137278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a0114af0 con 0x7ff2a0102870 2024-04-26T21:13:53.470 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.464+0000 7ff2a8600700 1 -- 172.21.15.84:0/3878137278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a005f5c0 con 0x7ff2a0102870 2024-04-26T21:13:53.470 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.464+0000 7ff29d600700 1 -- 172.21.15.84:0/3878137278 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7ff294019050 con 0x7ff2a0102870 2024-04-26T21:13:53.470 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.464+0000 7ff29d600700 1 --2- 172.21.15.84:0/3878137278 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7ff288036940 0x7ff288038df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:53.470 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.464+0000 7ff29d600700 1 -- 172.21.15.84:0/3878137278 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff29404a360 con 0x7ff2a0102870 2024-04-26T21:13:53.471 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.465+0000 7ff2a5200700 1 --2- 172.21.15.84:0/3878137278 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7ff288036940 0x7ff288038df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:53.471 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.466+0000 7ff2a5200700 1 --2- 172.21.15.84:0/3878137278 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7ff288036940 0x7ff288038df0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff28c009990 tx=0x7ff28c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:53.471 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.470+0000 7ff29d600700 1 -- 172.21.15.84:0/3878137278 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff29402db40 con 0x7ff2a0102870 2024-04-26T21:13:53.471 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.800+0000 7ff2a8600700 1 -- 172.21.15.84:0/3878137278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7ff2a004bed0 con 0x7ff2a0102870 2024-04-26T21:13:53.471 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.805+0000 7ff29d600700 1 -- 172.21.15.84:0/3878137278 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7ff294020070 con 0x7ff2a0102870 2024-04-26T21:13:53.471 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.808+0000 7ff2a8600700 1 -- 172.21.15.84:0/3878137278 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7ff288036940 msgr2=0x7ff288038df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:53.471 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.808+0000 7ff2a8600700 1 --2- 172.21.15.84:0/3878137278 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7ff288036940 0x7ff288038df0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff28c009990 tx=0x7ff28c006e40 comp rx=0 tx=0).stop 2024-04-26T21:13:53.471 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.808+0000 7ff2a8600700 1 -- 172.21.15.84:0/3878137278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a0102870 msgr2=0x7ff2a0113840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:53.471 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.808+0000 7ff2a8600700 1 --2- 172.21.15.84:0/3878137278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a0102870 0x7ff2a0113840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff294009fd0 tx=0x7ff294009840 comp rx=0 tx=0).stop 2024-04-26T21:13:53.471 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.809+0000 7ff2a8600700 1 -- 172.21.15.84:0/3878137278 shutdown_connections 2024-04-26T21:13:53.471 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.809+0000 7ff2a8600700 1 --2- 172.21.15.84:0/3878137278 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7ff288036940 0x7ff288038df0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:53.472 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.809+0000 7ff2a8600700 1 --2- 172.21.15.84:0/3878137278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a0102870 0x7ff2a0113840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:53.472 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.809+0000 7ff2a8600700 1 -- 172.21.15.84:0/3878137278 >> 172.21.15.84:0/3878137278 conn(0x7ff2a00fdf90 msgr2=0x7ff2a00fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:53.473 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.809+0000 7ff2a8600700 1 -- 172.21.15.84:0/3878137278 shutdown_connections 2024-04-26T21:13:53.473 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr 2024-04-26T21:13:52.809+0000 7ff2a8600700 1 -- 172.21.15.84:0/3878137278 wait complete. 2024-04-26T21:13:53.473 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-26T21:13:53.473 INFO:teuthology.orchestra.run.smithi084.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-26T21:13:53.473 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:13:53.473 INFO:teuthology.orchestra.run.smithi084.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-26T21:13:53.473 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:13:53.473 INFO:teuthology.orchestra.run.smithi084.stdout:Or, if you are only running a single cluster on this host: 2024-04-26T21:13:53.473 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:13:53.473 INFO:teuthology.orchestra.run.smithi084.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-26T21:13:53.473 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:13:53.473 INFO:teuthology.orchestra.run.smithi084.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-26T21:13:53.473 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:13:53.473 INFO:teuthology.orchestra.run.smithi084.stdout: ceph telemetry on 2024-04-26T21:13:53.474 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:13:53.474 INFO:teuthology.orchestra.run.smithi084.stdout:For more information see: 2024-04-26T21:13:53.474 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:13:53.474 INFO:teuthology.orchestra.run.smithi084.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-04-26T21:13:53.474 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:13:53.474 INFO:teuthology.orchestra.run.smithi084.stdout:Bootstrap complete. 2024-04-26T21:13:53.578 INFO:tasks.cephadm:Fetching config... 2024-04-26T21:13:53.578 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-26T21:13:53.578 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-26T21:13:53.668 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-26T21:13:53.668 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-26T21:13:53.668 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-26T21:13:53.749 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-26T21:13:53.750 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-26T21:13:53.750 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/keyring of=/dev/stdout 2024-04-26T21:13:53.868 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-26T21:13:53.868 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-26T21:13:53.868 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-26T21:13:53.915 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-26T21:13:53.915 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqMNqp11k+iyvnErzBFiArwVdr/mAz932UDFPygKexwHwyYQ0lp02QhCuMyXX85ximGq0bQ4StqcVJ7ZBtyQwWCfuoanCP36bfbvvrN4+zCkqjTJYrLxWcjBCRB8cGvkjtweV4QI86E+4idmLIKhGusAJGZp/hL3jUClZ7VsG17RcdMq95/OrWEAQg5EyoljAoQ8Hbu8QpOKpqYKouKUYPToYYsj7XR2g7HQTAJcXUNuF1588xWShVLI49gGpMPIwji1JUh6OsZuO/h6SsdJl9VuSGON4U9bv+ZjICDRnp657bEG25ES9iLD2oVmGutr79ht4uSaPJT+aedLZxahdgJms8gj8ZbNd1DVxza5fUKZLOnEGepeykpEMomgsxPUfN0XSsan409E/hbljEa5xaLgQ3caumpbJBDBE1RuHQ2C8yl0lN7U0iuI+oIm+ohTtFX7TWzoVLpmBGJMrdj/asWLF1Kwd313AzRuCAZWVlxuhpPCilf7gyaNh3MuH3450= ceph-8bb44d26-0411-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-26T21:13:54.046 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:53 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3878137278' entity='client.admin' 2024-04-26T21:13:54.054 INFO:teuthology.orchestra.run.smithi084.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqMNqp11k+iyvnErzBFiArwVdr/mAz932UDFPygKexwHwyYQ0lp02QhCuMyXX85ximGq0bQ4StqcVJ7ZBtyQwWCfuoanCP36bfbvvrN4+zCkqjTJYrLxWcjBCRB8cGvkjtweV4QI86E+4idmLIKhGusAJGZp/hL3jUClZ7VsG17RcdMq95/OrWEAQg5EyoljAoQ8Hbu8QpOKpqYKouKUYPToYYsj7XR2g7HQTAJcXUNuF1588xWShVLI49gGpMPIwji1JUh6OsZuO/h6SsdJl9VuSGON4U9bv+ZjICDRnp657bEG25ES9iLD2oVmGutr79ht4uSaPJT+aedLZxahdgJms8gj8ZbNd1DVxza5fUKZLOnEGepeykpEMomgsxPUfN0XSsan409E/hbljEa5xaLgQ3caumpbJBDBE1RuHQ2C8yl0lN7U0iuI+oIm+ohTtFX7TWzoVLpmBGJMrdj/asWLF1Kwd313AzRuCAZWVlxuhpPCilf7gyaNh3MuH3450= ceph-8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:13:54.097 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqMNqp11k+iyvnErzBFiArwVdr/mAz932UDFPygKexwHwyYQ0lp02QhCuMyXX85ximGq0bQ4StqcVJ7ZBtyQwWCfuoanCP36bfbvvrN4+zCkqjTJYrLxWcjBCRB8cGvkjtweV4QI86E+4idmLIKhGusAJGZp/hL3jUClZ7VsG17RcdMq95/OrWEAQg5EyoljAoQ8Hbu8QpOKpqYKouKUYPToYYsj7XR2g7HQTAJcXUNuF1588xWShVLI49gGpMPIwji1JUh6OsZuO/h6SsdJl9VuSGON4U9bv+ZjICDRnp657bEG25ES9iLD2oVmGutr79ht4uSaPJT+aedLZxahdgJms8gj8ZbNd1DVxza5fUKZLOnEGepeykpEMomgsxPUfN0XSsan409E/hbljEa5xaLgQ3caumpbJBDBE1RuHQ2C8yl0lN7U0iuI+oIm+ohTtFX7TWzoVLpmBGJMrdj/asWLF1Kwd313AzRuCAZWVlxuhpPCilf7gyaNh3MuH3450= ceph-8bb44d26-0411-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-26T21:13:54.228 INFO:teuthology.orchestra.run.smithi120.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqMNqp11k+iyvnErzBFiArwVdr/mAz932UDFPygKexwHwyYQ0lp02QhCuMyXX85ximGq0bQ4StqcVJ7ZBtyQwWCfuoanCP36bfbvvrN4+zCkqjTJYrLxWcjBCRB8cGvkjtweV4QI86E+4idmLIKhGusAJGZp/hL3jUClZ7VsG17RcdMq95/OrWEAQg5EyoljAoQ8Hbu8QpOKpqYKouKUYPToYYsj7XR2g7HQTAJcXUNuF1588xWShVLI49gGpMPIwji1JUh6OsZuO/h6SsdJl9VuSGON4U9bv+ZjICDRnp657bEG25ES9iLD2oVmGutr79ht4uSaPJT+aedLZxahdgJms8gj8ZbNd1DVxza5fUKZLOnEGepeykpEMomgsxPUfN0XSsan409E/hbljEa5xaLgQ3caumpbJBDBE1RuHQ2C8yl0lN7U0iuI+oIm+ohTtFX7TWzoVLpmBGJMrdj/asWLF1Kwd313AzRuCAZWVlxuhpPCilf7gyaNh3MuH3450= ceph-8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:13:54.285 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-26T21:13:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:13:57.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.459+0000 7fa9b8600700 1 -- 172.21.15.84:0/3760289634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9b01030b0 msgr2=0x7fa9b01034c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:57.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.459+0000 7fa9b8600700 1 --2- 172.21.15.84:0/3760289634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9b01030b0 0x7fa9b01034c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa9a40048c0 tx=0x7fa9a4009e30 comp rx=0 tx=0).stop 2024-04-26T21:13:57.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.459+0000 7fa9b8600700 1 -- 172.21.15.84:0/3760289634 shutdown_connections 2024-04-26T21:13:57.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.459+0000 7fa9b8600700 1 --2- 172.21.15.84:0/3760289634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9b01030b0 0x7fa9b01034c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:57.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.461+0000 7fa9b8600700 1 -- 172.21.15.84:0/3760289634 >> 172.21.15.84:0/3760289634 conn(0x7fa9b00722a0 msgr2=0x7fa9b00746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:57.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.461+0000 7fa9b8600700 1 -- 172.21.15.84:0/3760289634 shutdown_connections 2024-04-26T21:13:57.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.461+0000 7fa9b8600700 1 -- 172.21.15.84:0/3760289634 wait complete. 2024-04-26T21:13:57.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.461+0000 7fa9b8600700 1 Processor -- start 2024-04-26T21:13:57.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.461+0000 7fa9b8600700 1 -- start start 2024-04-26T21:13:57.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.461+0000 7fa9b8600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9b01030b0 0x7fa9b01136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:57.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.461+0000 7fa9b8600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b0113be0 con 0x7fa9b01030b0 2024-04-26T21:13:57.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.462+0000 7fa9b5c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9b01030b0 0x7fa9b01136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:57.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.462+0000 7fa9b5c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9b01030b0 0x7fa9b01136a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60408/0 (socket says 172.21.15.84:60408) 2024-04-26T21:13:57.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.462+0000 7fa9b5c00700 1 -- 172.21.15.84:0/2910975108 learned_addr learned my addr 172.21.15.84:0/2910975108 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:13:57.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.462+0000 7fa9b5c00700 1 -- 172.21.15.84:0/2910975108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a4005040 con 0x7fa9b01030b0 2024-04-26T21:13:57.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.462+0000 7fa9b5c00700 1 --2- 172.21.15.84:0/2910975108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9b01030b0 0x7fa9b01136a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4009680 tx=0x7fa9a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:57.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.463+0000 7fa9ad600700 1 -- 172.21.15.84:0/2910975108 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa9a400b5c0 con 0x7fa9b01030b0 2024-04-26T21:13:57.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.463+0000 7fa9ad600700 1 -- 172.21.15.84:0/2910975108 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa9a400be70 con 0x7fa9b01030b0 2024-04-26T21:13:57.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.463+0000 7fa9b8600700 1 -- 172.21.15.84:0/2910975108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b0113de0 con 0x7fa9b01030b0 2024-04-26T21:13:57.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.463+0000 7fa9ad600700 1 -- 172.21.15.84:0/2910975108 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa9a40135a0 con 0x7fa9b01030b0 2024-04-26T21:13:57.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.463+0000 7fa9b8600700 1 -- 172.21.15.84:0/2910975108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b0114950 con 0x7fa9b01030b0 2024-04-26T21:13:57.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.464+0000 7fa9ad600700 1 -- 172.21.15.84:0/2910975108 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fa9a4004d30 con 0x7fa9b01030b0 2024-04-26T21:13:57.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.464+0000 7fa9b8600700 1 -- 172.21.15.84:0/2910975108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b0109560 con 0x7fa9b01030b0 2024-04-26T21:13:57.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.465+0000 7fa9ad600700 1 --2- 172.21.15.84:0/2910975108 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fa998036880 0x7fa998038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:57.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.465+0000 7fa9ad600700 1 -- 172.21.15.84:0/2910975108 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa9a4049460 con 0x7fa9b01030b0 2024-04-26T21:13:57.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.465+0000 7fa9b5200700 1 --2- 172.21.15.84:0/2910975108 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fa998036880 0x7fa998038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:57.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.465+0000 7fa9b5200700 1 --2- 172.21.15.84:0/2910975108 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fa998036880 0x7fa998038d30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009990 tx=0x7fa99c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:57.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.471+0000 7fa9ad600700 1 -- 172.21.15.84:0/2910975108 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa9a4011960 con 0x7fa9b01030b0 2024-04-26T21:13:57.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.683+0000 7fa9b8600700 1 -- 172.21.15.84:0/2910975108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fa9b005f5c0 con 0x7fa9b01030b0 2024-04-26T21:13:57.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.687+0000 7fa9ad600700 1 -- 172.21.15.84:0/2910975108 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fa9a4021070 con 0x7fa9b01030b0 2024-04-26T21:13:57.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.689+0000 7fa9b8600700 1 -- 172.21.15.84:0/2910975108 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fa998036880 msgr2=0x7fa998038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:57.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.689+0000 7fa9b8600700 1 --2- 172.21.15.84:0/2910975108 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fa998036880 0x7fa998038d30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009990 tx=0x7fa99c006e40 comp rx=0 tx=0).stop 2024-04-26T21:13:57.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.689+0000 7fa9b8600700 1 -- 172.21.15.84:0/2910975108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9b01030b0 msgr2=0x7fa9b01136a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:57.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.689+0000 7fa9b8600700 1 --2- 172.21.15.84:0/2910975108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9b01030b0 0x7fa9b01136a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4009680 tx=0x7fa9a4009e30 comp rx=0 tx=0).stop 2024-04-26T21:13:57.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.690+0000 7fa9b8600700 1 -- 172.21.15.84:0/2910975108 shutdown_connections 2024-04-26T21:13:57.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.690+0000 7fa9b8600700 1 --2- 172.21.15.84:0/2910975108 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fa998036880 0x7fa998038d30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:57.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.690+0000 7fa9b8600700 1 --2- 172.21.15.84:0/2910975108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9b01030b0 0x7fa9b01136a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:57.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.690+0000 7fa9b8600700 1 -- 172.21.15.84:0/2910975108 >> 172.21.15.84:0/2910975108 conn(0x7fa9b00722a0 msgr2=0x7fa9b010a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:57.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.690+0000 7fa9b8600700 1 -- 172.21.15.84:0/2910975108 shutdown_connections 2024-04-26T21:13:57.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:13:57.690+0000 7fa9b8600700 1 -- 172.21.15.84:0/2910975108 wait complete. 2024-04-26T21:13:58.056 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:57 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:58.056 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:57 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:58.056 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:57 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd/host:smithi084", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:58.056 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:57 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:13:58.056 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:57 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi084", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:13:58.056 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:57 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi084", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-26T21:13:58.056 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:57 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:13:58.056 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:57 smithi084 ceph-mon[25539]: Deploying daemon crash.smithi084 on smithi084 2024-04-26T21:13:58.056 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:13:57 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2910975108' entity='client.admin' 2024-04-26T21:13:58.465 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-26T21:13:58.465 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-26T21:13:58.902 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:14:01.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.725+0000 7fe3f1800700 1 -- 172.21.15.84:0/571038699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3ec071de0 msgr2=0x7fe3ec0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:01.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.725+0000 7fe3f1800700 1 --2- 172.21.15.84:0/571038699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3ec071de0 0x7fe3ec0702f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc0048c0 tx=0x7fe3dc009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:01.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.725+0000 7fe3f1800700 1 -- 172.21.15.84:0/571038699 shutdown_connections 2024-04-26T21:14:01.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.725+0000 7fe3f1800700 1 --2- 172.21.15.84:0/571038699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3ec071de0 0x7fe3ec0702f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:01.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.725+0000 7fe3f1800700 1 -- 172.21.15.84:0/571038699 >> 172.21.15.84:0/571038699 conn(0x7fe3ec0f8170 msgr2=0x7fe3ec0fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:01.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.725+0000 7fe3f1800700 1 -- 172.21.15.84:0/571038699 shutdown_connections 2024-04-26T21:14:01.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.725+0000 7fe3f1800700 1 -- 172.21.15.84:0/571038699 wait complete. 2024-04-26T21:14:01.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.726+0000 7fe3f1800700 1 Processor -- start 2024-04-26T21:14:01.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.726+0000 7fe3f1800700 1 -- start start 2024-04-26T21:14:01.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.727+0000 7fe3f1800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3ec071de0 0x7fe3ec10f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:01.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.727+0000 7fe3f1800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec10f840 con 0x7fe3ec071de0 2024-04-26T21:14:01.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.727+0000 7fe3eaa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3ec071de0 0x7fe3ec10f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:01.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.727+0000 7fe3eaa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3ec071de0 0x7fe3ec10f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60428/0 (socket says 172.21.15.84:60428) 2024-04-26T21:14:01.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.727+0000 7fe3eaa00700 1 -- 172.21.15.84:0/2932820551 learned_addr learned my addr 172.21.15.84:0/2932820551 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:14:01.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.727+0000 7fe3eaa00700 1 -- 172.21.15.84:0/2932820551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc005040 con 0x7fe3ec071de0 2024-04-26T21:14:01.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.728+0000 7fe3eaa00700 1 --2- 172.21.15.84:0/2932820551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3ec071de0 0x7fe3ec10f300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00b900 tx=0x7fe3dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:01.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.728+0000 7fe3e2a00700 1 -- 172.21.15.84:0/2932820551 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe3dc00b5c0 con 0x7fe3ec071de0 2024-04-26T21:14:01.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.728+0000 7fe3e2a00700 1 -- 172.21.15.84:0/2932820551 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe3dc00be70 con 0x7fe3ec071de0 2024-04-26T21:14:01.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.728+0000 7fe3f1800700 1 -- 172.21.15.84:0/2932820551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3ec10fa40 con 0x7fe3ec071de0 2024-04-26T21:14:01.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.728+0000 7fe3e2a00700 1 -- 172.21.15.84:0/2932820551 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe3dc01c590 con 0x7fe3ec071de0 2024-04-26T21:14:01.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.728+0000 7fe3f1800700 1 -- 172.21.15.84:0/2932820551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3ec1105b0 con 0x7fe3ec071de0 2024-04-26T21:14:01.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.729+0000 7fe3e2a00700 1 -- 172.21.15.84:0/2932820551 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fe3dc01c850 con 0x7fe3ec071de0 2024-04-26T21:14:01.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.729+0000 7fe3f1800700 1 -- 172.21.15.84:0/2932820551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3ec105150 con 0x7fe3ec071de0 2024-04-26T21:14:01.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.730+0000 7fe3e2a00700 1 --2- 172.21.15.84:0/2932820551 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fe3d0036880 0x7fe3d0038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:01.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.730+0000 7fe3e2a00700 1 -- 172.21.15.84:0/2932820551 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe3dc049410 con 0x7fe3ec071de0 2024-04-26T21:14:01.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.730+0000 7fe3ea000700 1 --2- 172.21.15.84:0/2932820551 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fe3d0036880 0x7fe3d0038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:01.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.731+0000 7fe3ea000700 1 --2- 172.21.15.84:0/2932820551 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fe3d0036880 0x7fe3d0038d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8009990 tx=0x7fe3d8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:01.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.735+0000 7fe3e2a00700 1 -- 172.21.15.84:0/2932820551 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe3dc011960 con 0x7fe3ec071de0 2024-04-26T21:14:01.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.951+0000 7fe3f1800700 1 -- 172.21.15.84:0/2932820551 --> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3ec1107f0 con 0x7fe3d0036880 2024-04-26T21:14:01.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.956+0000 7fe3e2a00700 1 -- 172.21.15.84:0/2932820551 <== mgr.14162 v2:172.21.15.84:6800/3446199945 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe3ec1107f0 con 0x7fe3d0036880 2024-04-26T21:14:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.959+0000 7fe3f1800700 1 -- 172.21.15.84:0/2932820551 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fe3d0036880 msgr2=0x7fe3d0038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.959+0000 7fe3f1800700 1 --2- 172.21.15.84:0/2932820551 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fe3d0036880 0x7fe3d0038d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8009990 tx=0x7fe3d8006e40 comp rx=0 tx=0).stop 2024-04-26T21:14:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.959+0000 7fe3f1800700 1 -- 172.21.15.84:0/2932820551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3ec071de0 msgr2=0x7fe3ec10f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.959+0000 7fe3f1800700 1 --2- 172.21.15.84:0/2932820551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3ec071de0 0x7fe3ec10f300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00b900 tx=0x7fe3dc009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.959+0000 7fe3f1800700 1 -- 172.21.15.84:0/2932820551 shutdown_connections 2024-04-26T21:14:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.959+0000 7fe3f1800700 1 --2- 172.21.15.84:0/2932820551 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fe3d0036880 0x7fe3d0038d30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.959+0000 7fe3f1800700 1 --2- 172.21.15.84:0/2932820551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3ec071de0 0x7fe3ec10f300 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.959+0000 7fe3f1800700 1 -- 172.21.15.84:0/2932820551 >> 172.21.15.84:0/2932820551 conn(0x7fe3ec0f8170 msgr2=0x7fe3ec105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.959+0000 7fe3f1800700 1 -- 172.21.15.84:0/2932820551 shutdown_connections 2024-04-26T21:14:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:01.959+0000 7fe3f1800700 1 -- 172.21.15.84:0/2932820551 wait complete. 2024-04-26T21:14:03.088 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:02 smithi084 ceph-mon[25539]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:14:03.088 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:02 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:03.091 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi120 2024-04-26T21:14:03.092 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T21:14:03.092 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/etc/ceph/ceph.conf 2024-04-26T21:14:03.149 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T21:14:03.149 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:14:03.243 INFO:tasks.cephadm:Adding host smithi120 to orchestrator... 2024-04-26T21:14:03.243 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph orch host add smithi120 2024-04-26T21:14:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:14:04.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:03 smithi084 ceph-mon[25539]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:05.251 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:05 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:05.251 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:05 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:05.251 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:05 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:05.251 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:05 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:05.251 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:05 smithi084 ceph-mon[25539]: Deploying daemon node-exporter.smithi084 on smithi084 2024-04-26T21:14:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.976+0000 7f65e3800700 1 -- 172.21.15.84:0/3957764758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65dc071dc0 msgr2=0x7f65dc0702d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.976+0000 7f65e3800700 1 --2- 172.21.15.84:0/3957764758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65dc071dc0 0x7f65dc0702d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f65d00048c0 tx=0x7f65d0009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.976+0000 7f65e3800700 1 -- 172.21.15.84:0/3957764758 shutdown_connections 2024-04-26T21:14:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.976+0000 7f65e3800700 1 --2- 172.21.15.84:0/3957764758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65dc071dc0 0x7f65dc0702d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.976+0000 7f65e3800700 1 -- 172.21.15.84:0/3957764758 >> 172.21.15.84:0/3957764758 conn(0x7f65dc0f81a0 msgr2=0x7f65dc0fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.976+0000 7f65e3800700 1 -- 172.21.15.84:0/3957764758 shutdown_connections 2024-04-26T21:14:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.976+0000 7f65e3800700 1 -- 172.21.15.84:0/3957764758 wait complete. 2024-04-26T21:14:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.977+0000 7f65e3800700 1 Processor -- start 2024-04-26T21:14:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.977+0000 7f65e3800700 1 -- start start 2024-04-26T21:14:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.977+0000 7f65e3800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65dc071dc0 0x7f65dc10f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.978+0000 7f65e3800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc10f7d0 con 0x7f65dc071dc0 2024-04-26T21:14:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.978+0000 7f65e0e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65dc071dc0 0x7f65dc10f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.978+0000 7f65e0e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65dc071dc0 0x7f65dc10f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39956/0 (socket says 172.21.15.84:39956) 2024-04-26T21:14:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.978+0000 7f65e0e00700 1 -- 172.21.15.84:0/3969839882 learned_addr learned my addr 172.21.15.84:0/3969839882 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:14:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.978+0000 7f65e0e00700 1 -- 172.21.15.84:0/3969839882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d0005040 con 0x7f65dc071dc0 2024-04-26T21:14:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.979+0000 7f65e0e00700 1 --2- 172.21.15.84:0/3969839882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65dc071dc0 0x7f65dc10f290 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f65d000b900 tx=0x7f65d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.979+0000 7f65d8c00700 1 -- 172.21.15.84:0/3969839882 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65d000b5c0 con 0x7f65dc071dc0 2024-04-26T21:14:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.979+0000 7f65d8c00700 1 -- 172.21.15.84:0/3969839882 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f65d000be70 con 0x7f65dc071dc0 2024-04-26T21:14:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.979+0000 7f65d8c00700 1 -- 172.21.15.84:0/3969839882 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65d001c590 con 0x7f65dc071dc0 2024-04-26T21:14:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.979+0000 7f65e3800700 1 -- 172.21.15.84:0/3969839882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65dc10f9d0 con 0x7f65dc071dc0 2024-04-26T21:14:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.979+0000 7f65e3800700 1 -- 172.21.15.84:0/3969839882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65dc110540 con 0x7f65dc071dc0 2024-04-26T21:14:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.980+0000 7f65d8c00700 1 -- 172.21.15.84:0/3969839882 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f65d0013420 con 0x7f65dc071dc0 2024-04-26T21:14:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.981+0000 7f65e3800700 1 -- 172.21.15.84:0/3969839882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65dc105140 con 0x7f65dc071dc0 2024-04-26T21:14:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.981+0000 7f65d8c00700 1 --2- 172.21.15.84:0/3969839882 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f65c40368d0 0x7f65c4038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.981+0000 7f65d8c00700 1 -- 172.21.15.84:0/3969839882 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f65d00493c0 con 0x7f65dc071dc0 2024-04-26T21:14:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.981+0000 7f65dbe00700 1 --2- 172.21.15.84:0/3969839882 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f65c40368d0 0x7f65c4038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.982+0000 7f65dbe00700 1 --2- 172.21.15.84:0/3969839882 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f65c40368d0 0x7f65c4038d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f65c8009990 tx=0x7f65c8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:05.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:05.990+0000 7f65d8c00700 1 -- 172.21.15.84:0/3969839882 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f65d0011550 con 0x7f65dc071dc0 2024-04-26T21:14:06.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:06 smithi084 ceph-mon[25539]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:06.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:06.222+0000 7f65e3800700 1 -- 172.21.15.84:0/3969839882 --> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi120", "target": ["mon-mgr", ""]}) v1 -- 0x7f65dc110780 con 0x7f65c40368d0 2024-04-26T21:14:07.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:07 smithi084 ceph-mon[25539]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi120", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:14:08.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:08 smithi084 ceph-mon[25539]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:08.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:08 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:09.154 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:09 smithi084 ceph-mon[25539]: Deploying cephadm binary to smithi120 2024-04-26T21:14:09.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:09.896+0000 7f65d8c00700 1 -- 172.21.15.84:0/3969839882 <== mgr.14162 v2:172.21.15.84:6800/3446199945 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f65dc110780 con 0x7f65c40368d0 2024-04-26T21:14:09.900 INFO:teuthology.orchestra.run.smithi084.stdout:Added host 'smithi120' with addr '172.21.15.120' 2024-04-26T21:14:09.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:09.900+0000 7f65e3800700 1 -- 172.21.15.84:0/3969839882 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f65c40368d0 msgr2=0x7f65c4038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:09.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:09.900+0000 7f65e3800700 1 --2- 172.21.15.84:0/3969839882 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f65c40368d0 0x7f65c4038d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f65c8009990 tx=0x7f65c8006e40 comp rx=0 tx=0).stop 2024-04-26T21:14:09.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:09.900+0000 7f65e3800700 1 -- 172.21.15.84:0/3969839882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65dc071dc0 msgr2=0x7f65dc10f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:09.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:09.900+0000 7f65e3800700 1 --2- 172.21.15.84:0/3969839882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65dc071dc0 0x7f65dc10f290 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f65d000b900 tx=0x7f65d0009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:09.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:09.900+0000 7f65e3800700 1 -- 172.21.15.84:0/3969839882 shutdown_connections 2024-04-26T21:14:09.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:09.900+0000 7f65e3800700 1 --2- 172.21.15.84:0/3969839882 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f65c40368d0 0x7f65c4038d80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:09.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:09.900+0000 7f65e3800700 1 --2- 172.21.15.84:0/3969839882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65dc071dc0 0x7f65dc10f290 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:09.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:09.900+0000 7f65e3800700 1 -- 172.21.15.84:0/3969839882 >> 172.21.15.84:0/3969839882 conn(0x7f65dc0f81a0 msgr2=0x7f65dc105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:09.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:09.900+0000 7f65e3800700 1 -- 172.21.15.84:0/3969839882 shutdown_connections 2024-04-26T21:14:09.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:09.900+0000 7f65e3800700 1 -- 172.21.15.84:0/3969839882 wait complete. 2024-04-26T21:14:10.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:10 smithi084 ceph-mon[25539]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:10.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:10 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:10.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:10 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:10.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:10 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:10.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:10 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:10.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:10 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:10.604 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-26T21:14:11.046 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:14:11.349 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:11 smithi084 ceph-mon[25539]: Deploying daemon alertmanager.smithi084 on smithi084 2024-04-26T21:14:11.349 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:11 smithi084 ceph-mon[25539]: Added host smithi120 2024-04-26T21:14:12.384 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:12 smithi084 ceph-mon[25539]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:13.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:13 smithi084 ceph-mon[25539]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:13.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:13 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:13.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.959+0000 7f4e02200700 1 -- 172.21.15.84:0/973567729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dfc071e40 msgr2=0x7f4dfc070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:13.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.959+0000 7f4e02200700 1 --2- 172.21.15.84:0/973567729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dfc071e40 0x7f4dfc070350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0048c0 tx=0x7f4dec009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:13.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.959+0000 7f4e02200700 1 -- 172.21.15.84:0/973567729 shutdown_connections 2024-04-26T21:14:13.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.959+0000 7f4e02200700 1 --2- 172.21.15.84:0/973567729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dfc071e40 0x7f4dfc070350 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.959+0000 7f4e02200700 1 -- 172.21.15.84:0/973567729 >> 172.21.15.84:0/973567729 conn(0x7f4dfc0f81a0 msgr2=0x7f4dfc0fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.959+0000 7f4e02200700 1 -- 172.21.15.84:0/973567729 shutdown_connections 2024-04-26T21:14:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.959+0000 7f4e02200700 1 -- 172.21.15.84:0/973567729 wait complete. 2024-04-26T21:14:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.960+0000 7f4e02200700 1 Processor -- start 2024-04-26T21:14:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.960+0000 7f4e02200700 1 -- start start 2024-04-26T21:14:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.960+0000 7f4e02200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dfc071e40 0x7f4dfc10f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.960+0000 7f4e02200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc10f7f0 con 0x7f4dfc071e40 2024-04-26T21:14:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.961+0000 7f4dfb400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dfc071e40 0x7f4dfc10f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.961+0000 7f4dfb400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dfc071e40 0x7f4dfc10f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59212/0 (socket says 172.21.15.84:59212) 2024-04-26T21:14:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.961+0000 7f4dfb400700 1 -- 172.21.15.84:0/2133908494 learned_addr learned my addr 172.21.15.84:0/2133908494 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:14:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.961+0000 7f4dfb400700 1 -- 172.21.15.84:0/2133908494 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec005040 con 0x7f4dfc071e40 2024-04-26T21:14:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.961+0000 7f4dfb400700 1 --2- 172.21.15.84:0/2133908494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dfc071e40 0x7f4dfc10f2b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00b900 tx=0x7f4dec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.962+0000 7f4df3400700 1 -- 172.21.15.84:0/2133908494 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4dec00b5c0 con 0x7f4dfc071e40 2024-04-26T21:14:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.962+0000 7f4df3400700 1 -- 172.21.15.84:0/2133908494 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4dec00be70 con 0x7f4dfc071e40 2024-04-26T21:14:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.962+0000 7f4df3400700 1 -- 172.21.15.84:0/2133908494 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4dec01c590 con 0x7f4dfc071e40 2024-04-26T21:14:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.962+0000 7f4e02200700 1 -- 172.21.15.84:0/2133908494 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dfc10f9f0 con 0x7f4dfc071e40 2024-04-26T21:14:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.962+0000 7f4e02200700 1 -- 172.21.15.84:0/2133908494 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc110560 con 0x7f4dfc071e40 2024-04-26T21:14:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.963+0000 7f4df3400700 1 -- 172.21.15.84:0/2133908494 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f4dec004d30 con 0x7f4dfc071e40 2024-04-26T21:14:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.963+0000 7f4e02200700 1 -- 172.21.15.84:0/2133908494 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dfc105160 con 0x7f4dfc071e40 2024-04-26T21:14:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.963+0000 7f4df3400700 1 --2- 172.21.15.84:0/2133908494 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f4de0036880 0x7f4de0038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.963+0000 7f4df3400700 1 -- 172.21.15.84:0/2133908494 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4dec049460 con 0x7f4dfc071e40 2024-04-26T21:14:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.963+0000 7f4dfaa00700 1 --2- 172.21.15.84:0/2133908494 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f4de0036880 0x7f4de0038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.964+0000 7f4dfaa00700 1 --2- 172.21.15.84:0/2133908494 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f4de0036880 0x7f4de0038d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4de8009990 tx=0x7f4de8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:13.968+0000 7f4df3400700 1 -- 172.21.15.84:0/2133908494 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4dec01b350 con 0x7f4dfc071e40 2024-04-26T21:14:14.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:14.243+0000 7f4e02200700 1 -- 172.21.15.84:0/2133908494 --> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4dfc110860 con 0x7f4de0036880 2024-04-26T21:14:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:14.245+0000 7f4df3400700 1 -- 172.21.15.84:0/2133908494 <== mgr.14162 v2:172.21.15.84:6800/3446199945 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f4dfc110860 con 0x7f4de0036880 2024-04-26T21:14:14.246 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:14:14.246 INFO:teuthology.orchestra.run.smithi084.stdout:[{"addr": "172.21.15.84", "hostname": "smithi084", "labels": [], "status": ""}, {"addr": "172.21.15.120", "hostname": "smithi120", "labels": [], "status": ""}] 2024-04-26T21:14:14.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:14.248+0000 7f4e02200700 1 -- 172.21.15.84:0/2133908494 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f4de0036880 msgr2=0x7f4de0038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:14.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:14.248+0000 7f4e02200700 1 --2- 172.21.15.84:0/2133908494 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f4de0036880 0x7f4de0038d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4de8009990 tx=0x7f4de8006e40 comp rx=0 tx=0).stop 2024-04-26T21:14:14.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:14.249+0000 7f4e02200700 1 -- 172.21.15.84:0/2133908494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dfc071e40 msgr2=0x7f4dfc10f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:14.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:14.249+0000 7f4e02200700 1 --2- 172.21.15.84:0/2133908494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dfc071e40 0x7f4dfc10f2b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00b900 tx=0x7f4dec009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:14.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:14.249+0000 7f4e02200700 1 -- 172.21.15.84:0/2133908494 shutdown_connections 2024-04-26T21:14:14.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:14.249+0000 7f4e02200700 1 --2- 172.21.15.84:0/2133908494 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f4de0036880 0x7f4de0038d30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:14.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:14.249+0000 7f4e02200700 1 --2- 172.21.15.84:0/2133908494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dfc071e40 0x7f4dfc10f2b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:14.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:14.249+0000 7f4e02200700 1 -- 172.21.15.84:0/2133908494 >> 172.21.15.84:0/2133908494 conn(0x7f4dfc0f81a0 msgr2=0x7f4dfc105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:14.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:14.249+0000 7f4e02200700 1 -- 172.21.15.84:0/2133908494 shutdown_connections 2024-04-26T21:14:14.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:14.249+0000 7f4e02200700 1 -- 172.21.15.84:0/2133908494 wait complete. 2024-04-26T21:14:14.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:14 smithi084 ceph-mon[25539]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T21:14:15.933 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:15 smithi084 ceph-mon[25539]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:15.975 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-26T21:14:15.975 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-26T21:14:16.416 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:14:18.078 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:17 smithi084 ceph-mon[25539]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:19.855 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:19 smithi084 ceph-mon[25539]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:20.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.919+0000 7fa4d7800700 1 -- 172.21.15.84:0/609845435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d01030b0 msgr2=0x7fa4d01034c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:20.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.919+0000 7fa4d7800700 1 --2- 172.21.15.84:0/609845435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d01030b0 0x7fa4d01034c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40048c0 tx=0x7fa4c4009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:20.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.920+0000 7fa4d7800700 1 -- 172.21.15.84:0/609845435 shutdown_connections 2024-04-26T21:14:20.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.920+0000 7fa4d7800700 1 --2- 172.21.15.84:0/609845435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d01030b0 0x7fa4d01034c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:20.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.920+0000 7fa4d7800700 1 -- 172.21.15.84:0/609845435 >> 172.21.15.84:0/609845435 conn(0x7fa4d00722a0 msgr2=0x7fa4d00746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.920+0000 7fa4d7800700 1 -- 172.21.15.84:0/609845435 shutdown_connections 2024-04-26T21:14:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.920+0000 7fa4d7800700 1 -- 172.21.15.84:0/609845435 wait complete. 2024-04-26T21:14:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.920+0000 7fa4d7800700 1 Processor -- start 2024-04-26T21:14:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.921+0000 7fa4d7800700 1 -- start start 2024-04-26T21:14:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.921+0000 7fa4d7800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d01030b0 0x7fa4d01136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.921+0000 7fa4d7800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d0113be0 con 0x7fa4d01030b0 2024-04-26T21:14:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.921+0000 7fa4d4e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d01030b0 0x7fa4d01136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.921+0000 7fa4d4e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d01030b0 0x7fa4d01136a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59238/0 (socket says 172.21.15.84:59238) 2024-04-26T21:14:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.921+0000 7fa4d4e00700 1 -- 172.21.15.84:0/3536346960 learned_addr learned my addr 172.21.15.84:0/3536346960 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:14:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.922+0000 7fa4d4e00700 1 -- 172.21.15.84:0/3536346960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c4005040 con 0x7fa4d01030b0 2024-04-26T21:14:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.922+0000 7fa4d4e00700 1 --2- 172.21.15.84:0/3536346960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d01030b0 0x7fa4d01136a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009680 tx=0x7fa4c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.922+0000 7fa4ccc00700 1 -- 172.21.15.84:0/3536346960 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4c400b5c0 con 0x7fa4d01030b0 2024-04-26T21:14:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.922+0000 7fa4ccc00700 1 -- 172.21.15.84:0/3536346960 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa4c400be70 con 0x7fa4d01030b0 2024-04-26T21:14:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.922+0000 7fa4d7800700 1 -- 172.21.15.84:0/3536346960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d0113de0 con 0x7fa4d01030b0 2024-04-26T21:14:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.922+0000 7fa4ccc00700 1 -- 172.21.15.84:0/3536346960 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4c40135a0 con 0x7fa4d01030b0 2024-04-26T21:14:20.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.922+0000 7fa4d7800700 1 -- 172.21.15.84:0/3536346960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d0114950 con 0x7fa4d01030b0 2024-04-26T21:14:20.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.923+0000 7fa4ccc00700 1 -- 172.21.15.84:0/3536346960 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fa4c401ca90 con 0x7fa4d01030b0 2024-04-26T21:14:20.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.923+0000 7fa4d7800700 1 -- 172.21.15.84:0/3536346960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d0109560 con 0x7fa4d01030b0 2024-04-26T21:14:20.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.924+0000 7fa4ccc00700 1 --2- 172.21.15.84:0/3536346960 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fa4b80368d0 0x7fa4b8038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:20.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.924+0000 7fa4ccc00700 1 -- 172.21.15.84:0/3536346960 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa4c4049410 con 0x7fa4d01030b0 2024-04-26T21:14:20.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.924+0000 7fa4cfe00700 1 --2- 172.21.15.84:0/3536346960 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fa4b80368d0 0x7fa4b8038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:20.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.925+0000 7fa4cfe00700 1 --2- 172.21.15.84:0/3536346960 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fa4b80368d0 0x7fa4b8038d80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009990 tx=0x7fa4bc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:20.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:19.929+0000 7fa4ccc00700 1 -- 172.21.15.84:0/3536346960 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa4c4011960 con 0x7fa4d01030b0 2024-04-26T21:14:20.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:20.147+0000 7fa4d7800700 1 -- 172.21.15.84:0/3536346960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa4d0115360 con 0x7fa4d01030b0 2024-04-26T21:14:20.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:20 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3536346960' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-26T21:14:20.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:20.764+0000 7fa4ccc00700 1 -- 172.21.15.84:0/3536346960 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa4c4021020 con 0x7fa4d01030b0 2024-04-26T21:14:20.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:20.768+0000 7fa4d7800700 1 -- 172.21.15.84:0/3536346960 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fa4b80368d0 msgr2=0x7fa4b8038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:20.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:20.768+0000 7fa4d7800700 1 --2- 172.21.15.84:0/3536346960 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fa4b80368d0 0x7fa4b8038d80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009990 tx=0x7fa4bc006e40 comp rx=0 tx=0).stop 2024-04-26T21:14:20.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:20.768+0000 7fa4d7800700 1 -- 172.21.15.84:0/3536346960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d01030b0 msgr2=0x7fa4d01136a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:20.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:20.768+0000 7fa4d7800700 1 --2- 172.21.15.84:0/3536346960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d01030b0 0x7fa4d01136a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009680 tx=0x7fa4c4009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:20.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:20.769+0000 7fa4d7800700 1 -- 172.21.15.84:0/3536346960 shutdown_connections 2024-04-26T21:14:20.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:20.769+0000 7fa4d7800700 1 --2- 172.21.15.84:0/3536346960 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fa4b80368d0 0x7fa4b8038d80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:20.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:20.769+0000 7fa4d7800700 1 --2- 172.21.15.84:0/3536346960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d01030b0 0x7fa4d01136a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:20.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:20.769+0000 7fa4d7800700 1 -- 172.21.15.84:0/3536346960 >> 172.21.15.84:0/3536346960 conn(0x7fa4d00722a0 msgr2=0x7fa4d010a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:20.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:20.769+0000 7fa4d7800700 1 -- 172.21.15.84:0/3536346960 shutdown_connections 2024-04-26T21:14:20.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:14:20.769+0000 7fa4d7800700 1 -- 172.21.15.84:0/3536346960 wait complete. 2024-04-26T21:14:20.772 INFO:teuthology.orchestra.run.smithi084.stderr:adjusted tunables profile to default 2024-04-26T21:14:21.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:21 smithi084 ceph-mon[25539]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:21.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:21 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3536346960' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-26T21:14:21.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:21 smithi084 ceph-mon[25539]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T21:14:22.028 INFO:tasks.cephadm:Adding mon.smithi084 on smithi084 2024-04-26T21:14:22.028 INFO:tasks.cephadm:Adding mon.smithi120 on smithi120 2024-04-26T21:14:22.029 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph orch apply mon '2;smithi084:172.21.15.84=smithi084;smithi120:172.21.15.120=smithi120' 2024-04-26T21:14:22.476 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:14:22.582 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:14:24.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:23 smithi084 ceph-mon[25539]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:25.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.261+0000 7fef30600700 1 -- 172.21.15.120:0/3682029346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef281030b0 msgr2=0x7fef281034c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:25.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.261+0000 7fef30600700 1 --2- 172.21.15.120:0/3682029346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef281030b0 0x7fef281034c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fef1c0048c0 tx=0x7fef1c009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:25.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.261+0000 7fef30600700 1 -- 172.21.15.120:0/3682029346 shutdown_connections 2024-04-26T21:14:25.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.261+0000 7fef30600700 1 --2- 172.21.15.120:0/3682029346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef281030b0 0x7fef281034c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:25.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.261+0000 7fef30600700 1 -- 172.21.15.120:0/3682029346 >> 172.21.15.120:0/3682029346 conn(0x7fef280722a0 msgr2=0x7fef280746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:25.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.261+0000 7fef30600700 1 -- 172.21.15.120:0/3682029346 shutdown_connections 2024-04-26T21:14:25.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.262+0000 7fef30600700 1 -- 172.21.15.120:0/3682029346 wait complete. 2024-04-26T21:14:25.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.262+0000 7fef30600700 1 Processor -- start 2024-04-26T21:14:25.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.263+0000 7fef30600700 1 -- start start 2024-04-26T21:14:25.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.263+0000 7fef30600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef281030b0 0x7fef281136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:25.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.263+0000 7fef30600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef28113be0 con 0x7fef281030b0 2024-04-26T21:14:25.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.264+0000 7fef2dc00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef281030b0 0x7fef281136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:25.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.264+0000 7fef2dc00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef281030b0 0x7fef281136a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.120:44580/0 (socket says 172.21.15.120:44580) 2024-04-26T21:14:25.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.264+0000 7fef2dc00700 1 -- 172.21.15.120:0/533936617 learned_addr learned my addr 172.21.15.120:0/533936617 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:14:25.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.264+0000 7fef2dc00700 1 -- 172.21.15.120:0/533936617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c005040 con 0x7fef281030b0 2024-04-26T21:14:25.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.265+0000 7fef2dc00700 1 --2- 172.21.15.120:0/533936617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef281030b0 0x7fef281136a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009680 tx=0x7fef1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:25.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.265+0000 7fef25600700 1 -- 172.21.15.120:0/533936617 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fef1c00b5c0 con 0x7fef281030b0 2024-04-26T21:14:25.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.265+0000 7fef30600700 1 -- 172.21.15.120:0/533936617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef28113de0 con 0x7fef281030b0 2024-04-26T21:14:25.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.265+0000 7fef25600700 1 -- 172.21.15.120:0/533936617 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef1c00be70 con 0x7fef281030b0 2024-04-26T21:14:25.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.265+0000 7fef30600700 1 -- 172.21.15.120:0/533936617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef28114950 con 0x7fef281030b0 2024-04-26T21:14:25.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.265+0000 7fef25600700 1 -- 172.21.15.120:0/533936617 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fef1c0135c0 con 0x7fef281030b0 2024-04-26T21:14:25.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.267+0000 7fef30600700 1 -- 172.21.15.120:0/533936617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef28109560 con 0x7fef281030b0 2024-04-26T21:14:25.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.267+0000 7fef25600700 1 -- 172.21.15.120:0/533936617 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fef1c01c430 con 0x7fef281030b0 2024-04-26T21:14:25.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.268+0000 7fef25600700 1 --2- 172.21.15.120:0/533936617 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fef10036880 0x7fef10038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:25.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.268+0000 7fef25600700 1 -- 172.21.15.120:0/533936617 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fef1c0494a0 con 0x7fef281030b0 2024-04-26T21:14:25.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.268+0000 7fef2d200700 1 --2- 172.21.15.120:0/533936617 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fef10036880 0x7fef10038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:25.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.269+0000 7fef2d200700 1 --2- 172.21.15.120:0/533936617 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fef10036880 0x7fef10038d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fef14009990 tx=0x7fef14006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:25.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.282+0000 7fef25600700 1 -- 172.21.15.120:0/533936617 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fef1c0249b0 con 0x7fef281030b0 2024-04-26T21:14:25.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:25 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:25 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:25 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:25 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:25 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:25 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:25 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-26T21:14:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:25 smithi084 ceph-mon[25539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-26T21:14:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:25 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:25.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.506+0000 7fef30600700 1 -- 172.21.15.120:0/533936617 --> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi084:172.21.15.84=smithi084;smithi120:172.21.15.120=smithi120", "target": ["mon-mgr", ""]}) v1 -- 0x7fef28114c40 con 0x7fef10036880 2024-04-26T21:14:25.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.521+0000 7fef25600700 1 -- 172.21.15.120:0/533936617 <== mgr.14162 v2:172.21.15.84:6800/3446199945 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fef28114c40 con 0x7fef10036880 2024-04-26T21:14:25.521 INFO:teuthology.orchestra.run.smithi120.stdout:Scheduled mon update... 2024-04-26T21:14:25.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.523+0000 7fef30600700 1 -- 172.21.15.120:0/533936617 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fef10036880 msgr2=0x7fef10038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:25.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.523+0000 7fef30600700 1 --2- 172.21.15.120:0/533936617 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fef10036880 0x7fef10038d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fef14009990 tx=0x7fef14006e40 comp rx=0 tx=0).stop 2024-04-26T21:14:25.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.523+0000 7fef30600700 1 -- 172.21.15.120:0/533936617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef281030b0 msgr2=0x7fef281136a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:25.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.523+0000 7fef30600700 1 --2- 172.21.15.120:0/533936617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef281030b0 0x7fef281136a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009680 tx=0x7fef1c009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:25.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.523+0000 7fef30600700 1 -- 172.21.15.120:0/533936617 shutdown_connections 2024-04-26T21:14:25.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.523+0000 7fef30600700 1 --2- 172.21.15.120:0/533936617 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fef10036880 0x7fef10038d30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:25.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.524+0000 7fef30600700 1 --2- 172.21.15.120:0/533936617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef281030b0 0x7fef281136a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:25.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.524+0000 7fef30600700 1 -- 172.21.15.120:0/533936617 >> 172.21.15.120:0/533936617 conn(0x7fef280722a0 msgr2=0x7fef2810a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:25.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.524+0000 7fef30600700 1 -- 172.21.15.120:0/533936617 shutdown_connections 2024-04-26T21:14:25.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:25.524+0000 7fef30600700 1 -- 172.21.15.120:0/533936617 wait complete. 2024-04-26T21:14:26.410 DEBUG:teuthology.orchestra.run.smithi120:mon.smithi120> sudo journalctl -f -n 0 -u ceph-8bb44d26-0411-11ef-bc93-c7b262605968@mon.smithi120.service 2024-04-26T21:14:26.417 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T21:14:26.418 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T21:14:26.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:26 smithi084 ceph-mon[25539]: Deploying daemon grafana.smithi084 on smithi084 2024-04-26T21:14:26.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:26 smithi084 ceph-mon[25539]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:26.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:26 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:27.509 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:14:27.631 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:14:27.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:27 smithi084 ceph-mon[25539]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi084:172.21.15.84=smithi084;smithi120:172.21.15.120=smithi120", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:14:27.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:27 smithi084 ceph-mon[25539]: Saving service mon spec with placement smithi084:172.21.15.84=smithi084;smithi120:172.21.15.120=smithi120;count:2 2024-04-26T21:14:28.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:28 smithi084 ceph-mon[25539]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:28.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:28 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.638+0000 7f413d600700 1 -- 172.21.15.120:0/2169715462 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f413000bb80 con 0x7f41400fca40 2024-04-26T21:14:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.639+0000 7f4145a00700 1 -- 172.21.15.120:0/2169715462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41400fca40 msgr2=0x7f41400fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.639+0000 7f4145a00700 1 --2- 172.21.15.120:0/2169715462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41400fca40 0x7f41400fce50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f41300048c0 tx=0x7f4130009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.639+0000 7f4145a00700 1 -- 172.21.15.120:0/2169715462 shutdown_connections 2024-04-26T21:14:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.639+0000 7f4145a00700 1 --2- 172.21.15.120:0/2169715462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41400fca40 0x7f41400fce50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.639+0000 7f4145a00700 1 -- 172.21.15.120:0/2169715462 >> 172.21.15.120:0/2169715462 conn(0x7f41400f81a0 msgr2=0x7f41400fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.639+0000 7f4145a00700 1 -- 172.21.15.120:0/2169715462 shutdown_connections 2024-04-26T21:14:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.639+0000 7f4145a00700 1 -- 172.21.15.120:0/2169715462 wait complete. 2024-04-26T21:14:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.640+0000 7f4145a00700 1 Processor -- start 2024-04-26T21:14:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.640+0000 7f4145a00700 1 -- start start 2024-04-26T21:14:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.640+0000 7f4145a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41400fca40 0x7f414010f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.640+0000 7f4145a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414010f7c0 con 0x7f41400fca40 2024-04-26T21:14:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.641+0000 7f413ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41400fca40 0x7f414010f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.641+0000 7f413ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41400fca40 0x7f414010f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.120:44594/0 (socket says 172.21.15.120:44594) 2024-04-26T21:14:29.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.641+0000 7f413ea00700 1 -- 172.21.15.120:0/4127804504 learned_addr learned my addr 172.21.15.120:0/4127804504 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:14:29.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.641+0000 7f413ea00700 1 -- 172.21.15.120:0/4127804504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4130005040 con 0x7f41400fca40 2024-04-26T21:14:29.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.642+0000 7f413ea00700 1 --2- 172.21.15.120:0/4127804504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41400fca40 0x7f414010f280 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f41300096b0 tx=0x7f4130009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:29.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.642+0000 7f4136a00700 1 -- 172.21.15.120:0/4127804504 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f413000bed0 con 0x7f41400fca40 2024-04-26T21:14:29.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.642+0000 7f4145a00700 1 -- 172.21.15.120:0/4127804504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414010f9c0 con 0x7f41400fca40 2024-04-26T21:14:29.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.642+0000 7f4136a00700 1 -- 172.21.15.120:0/4127804504 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f413000b5c0 con 0x7f41400fca40 2024-04-26T21:14:29.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.642+0000 7f4136a00700 1 -- 172.21.15.120:0/4127804504 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f413001c5b0 con 0x7f41400fca40 2024-04-26T21:14:29.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.642+0000 7f4145a00700 1 -- 172.21.15.120:0/4127804504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4140110530 con 0x7f41400fca40 2024-04-26T21:14:29.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.643+0000 7f4145a00700 1 -- 172.21.15.120:0/4127804504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4140102f50 con 0x7f41400fca40 2024-04-26T21:14:29.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.644+0000 7f4136a00700 1 -- 172.21.15.120:0/4127804504 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f4130004d30 con 0x7f41400fca40 2024-04-26T21:14:29.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.645+0000 7f4136a00700 1 --2- 172.21.15.120:0/4127804504 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f4124036880 0x7f4124038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:29.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.645+0000 7f4136a00700 1 -- 172.21.15.120:0/4127804504 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f413004a520 con 0x7f41400fca40 2024-04-26T21:14:29.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.645+0000 7f413e000700 1 --2- 172.21.15.120:0/4127804504 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f4124036880 0x7f4124038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:29.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.647+0000 7f413e000700 1 --2- 172.21.15.120:0/4127804504 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f4124036880 0x7f4124038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f412c009990 tx=0x7f412c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:29.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:29 smithi084 ceph-mon[25539]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:29.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.663+0000 7f4136a00700 1 -- 172.21.15.120:0/4127804504 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f413001b980 con 0x7f41400fca40 2024-04-26T21:14:29.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.955+0000 7f4145a00700 1 -- 172.21.15.120:0/4127804504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f414004bed0 con 0x7f41400fca40 2024-04-26T21:14:29.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.956+0000 7f4136a00700 1 -- 172.21.15.120:0/4127804504 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f413001b390 con 0x7f41400fca40 2024-04-26T21:14:29.957 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:14:29.957 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","modified":"2024-04-26T21:12:25.273724Z","created":"2024-04-26T21:12:25.273724Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T21:14:29.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.959+0000 7f4145a00700 1 -- 172.21.15.120:0/4127804504 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f4124036880 msgr2=0x7f4124038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:29.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.959+0000 7f4145a00700 1 --2- 172.21.15.120:0/4127804504 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f4124036880 0x7f4124038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f412c009990 tx=0x7f412c006e40 comp rx=0 tx=0).stop 2024-04-26T21:14:29.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.959+0000 7f4145a00700 1 -- 172.21.15.120:0/4127804504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41400fca40 msgr2=0x7f414010f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:29.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.959+0000 7f4145a00700 1 --2- 172.21.15.120:0/4127804504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41400fca40 0x7f414010f280 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f41300096b0 tx=0x7f4130009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:29.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.959+0000 7f4145a00700 1 -- 172.21.15.120:0/4127804504 shutdown_connections 2024-04-26T21:14:29.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.959+0000 7f4145a00700 1 --2- 172.21.15.120:0/4127804504 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f4124036880 0x7f4124038d30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:29.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.959+0000 7f4145a00700 1 --2- 172.21.15.120:0/4127804504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41400fca40 0x7f414010f280 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:29.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.959+0000 7f4145a00700 1 -- 172.21.15.120:0/4127804504 >> 172.21.15.120:0/4127804504 conn(0x7f41400f81a0 msgr2=0x7f41400fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:29.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.959+0000 7f4145a00700 1 -- 172.21.15.120:0/4127804504 shutdown_connections 2024-04-26T21:14:29.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:29.959+0000 7f4145a00700 1 -- 172.21.15.120:0/4127804504 wait complete. 2024-04-26T21:14:29.961 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-04-26T21:14:30.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:30 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/4127804504' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:14:31.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:31 smithi084 ceph-mon[25539]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:31.997 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T21:14:31.998 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T21:14:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:14:32.541 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:14:34.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:33 smithi084 ceph-mon[25539]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:34.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.533+0000 7f4c28e00700 1 -- 172.21.15.120:0/519062475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c24065d30 msgr2=0x7f4c240ff630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:34.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.533+0000 7f4c28e00700 1 --2- 172.21.15.120:0/519062475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c24065d30 0x7f4c240ff630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4c140048c0 tx=0x7f4c14009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:34.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.533+0000 7f4c28e00700 1 -- 172.21.15.120:0/519062475 shutdown_connections 2024-04-26T21:14:34.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.533+0000 7f4c28e00700 1 --2- 172.21.15.120:0/519062475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c24065d30 0x7f4c240ff630 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:34.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.533+0000 7f4c28e00700 1 -- 172.21.15.120:0/519062475 >> 172.21.15.120:0/519062475 conn(0x7f4c240f70a0 msgr2=0x7f4c240f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:34.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.533+0000 7f4c28e00700 1 -- 172.21.15.120:0/519062475 shutdown_connections 2024-04-26T21:14:34.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.533+0000 7f4c28e00700 1 -- 172.21.15.120:0/519062475 wait complete. 2024-04-26T21:14:34.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.534+0000 7f4c28e00700 1 Processor -- start 2024-04-26T21:14:34.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.534+0000 7f4c28e00700 1 -- start start 2024-04-26T21:14:34.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.535+0000 7f4c28e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c24065d30 0x7f4c240fcf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:34.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.535+0000 7f4c28e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c240fd4c0 con 0x7f4c24065d30 2024-04-26T21:14:34.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.536+0000 7f4c21e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c24065d30 0x7f4c240fcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:34.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.536+0000 7f4c21e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c24065d30 0x7f4c240fcf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.120:53192/0 (socket says 172.21.15.120:53192) 2024-04-26T21:14:34.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.536+0000 7f4c21e00700 1 -- 172.21.15.120:0/1945880156 learned_addr learned my addr 172.21.15.120:0/1945880156 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:14:34.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.537+0000 7f4c21e00700 1 -- 172.21.15.120:0/1945880156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c14005040 con 0x7f4c24065d30 2024-04-26T21:14:34.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.537+0000 7f4c21e00700 1 --2- 172.21.15.120:0/1945880156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c24065d30 0x7f4c240fcf80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400b900 tx=0x7f4c14009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:34.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.537+0000 7f4c1a000700 1 -- 172.21.15.120:0/1945880156 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4c1400b5c0 con 0x7f4c24065d30 2024-04-26T21:14:34.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.537+0000 7f4c1a000700 1 -- 172.21.15.120:0/1945880156 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4c1400be70 con 0x7f4c24065d30 2024-04-26T21:14:34.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.537+0000 7f4c28e00700 1 -- 172.21.15.120:0/1945880156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c240fb590 con 0x7f4c24065d30 2024-04-26T21:14:34.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.537+0000 7f4c1a000700 1 -- 172.21.15.120:0/1945880156 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4c1401c590 con 0x7f4c24065d30 2024-04-26T21:14:34.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.538+0000 7f4c28e00700 1 -- 172.21.15.120:0/1945880156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c240fba80 con 0x7f4c24065d30 2024-04-26T21:14:34.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.539+0000 7f4c28e00700 1 -- 172.21.15.120:0/1945880156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2405f5c0 con 0x7f4c24065d30 2024-04-26T21:14:34.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.539+0000 7f4c1a000700 1 -- 172.21.15.120:0/1945880156 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f4c14004d30 con 0x7f4c24065d30 2024-04-26T21:14:34.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.539+0000 7f4c1a000700 1 --2- 172.21.15.120:0/1945880156 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f4c08036880 0x7f4c08038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:34.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.539+0000 7f4c1a000700 1 -- 172.21.15.120:0/1945880156 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4c14049480 con 0x7f4c24065d30 2024-04-26T21:14:34.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.540+0000 7f4c21400700 1 --2- 172.21.15.120:0/1945880156 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f4c08036880 0x7f4c08038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:34.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.541+0000 7f4c21400700 1 --2- 172.21.15.120:0/1945880156 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f4c08036880 0x7f4c08038d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009990 tx=0x7f4c10006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:34.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.549+0000 7f4c1a000700 1 -- 172.21.15.120:0/1945880156 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4c1401b350 con 0x7f4c24065d30 2024-04-26T21:14:34.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.847+0000 7f4c28e00700 1 -- 172.21.15.120:0/1945880156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4c24106410 con 0x7f4c24065d30 2024-04-26T21:14:34.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.848+0000 7f4c1a000700 1 -- 172.21.15.120:0/1945880156 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f4c14021020 con 0x7f4c24065d30 2024-04-26T21:14:34.850 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:14:34.850 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","modified":"2024-04-26T21:12:25.273724Z","created":"2024-04-26T21:12:25.273724Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T21:14:34.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.850+0000 7f4c28e00700 1 -- 172.21.15.120:0/1945880156 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f4c08036880 msgr2=0x7f4c08038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:34.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.850+0000 7f4c28e00700 1 --2- 172.21.15.120:0/1945880156 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f4c08036880 0x7f4c08038d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009990 tx=0x7f4c10006e40 comp rx=0 tx=0).stop 2024-04-26T21:14:34.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.850+0000 7f4c28e00700 1 -- 172.21.15.120:0/1945880156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c24065d30 msgr2=0x7f4c240fcf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:34.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.850+0000 7f4c28e00700 1 --2- 172.21.15.120:0/1945880156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c24065d30 0x7f4c240fcf80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400b900 tx=0x7f4c14009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:34.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.850+0000 7f4c28e00700 1 -- 172.21.15.120:0/1945880156 shutdown_connections 2024-04-26T21:14:34.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.850+0000 7f4c28e00700 1 --2- 172.21.15.120:0/1945880156 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f4c08036880 0x7f4c08038d30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:34.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.850+0000 7f4c28e00700 1 --2- 172.21.15.120:0/1945880156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c24065d30 0x7f4c240fcf80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:34.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.850+0000 7f4c28e00700 1 -- 172.21.15.120:0/1945880156 >> 172.21.15.120:0/1945880156 conn(0x7f4c240f70a0 msgr2=0x7f4c24103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:34.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.851+0000 7f4c28e00700 1 -- 172.21.15.120:0/1945880156 shutdown_connections 2024-04-26T21:14:34.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:34.851+0000 7f4c28e00700 1 -- 172.21.15.120:0/1945880156 wait complete. 2024-04-26T21:14:34.854 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-04-26T21:14:36.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:35 smithi084 ceph-mon[25539]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:36.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:35 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/1945880156' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:14:36.630 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T21:14:36.630 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T21:14:37.059 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:14:37.168 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:14:38.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:37 smithi084 ceph-mon[25539]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:39.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.093+0000 7fb0a9200700 1 -- 172.21.15.120:0/1079140457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0a4065cd0 msgr2=0x7fb0a4101a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:39.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.093+0000 7fb0a9200700 1 --2- 172.21.15.120:0/1079140457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0a4065cd0 0x7fb0a4101a90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb0940048c0 tx=0x7fb094009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:39.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.093+0000 7fb0a9200700 1 -- 172.21.15.120:0/1079140457 shutdown_connections 2024-04-26T21:14:39.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.093+0000 7fb0a9200700 1 --2- 172.21.15.120:0/1079140457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0a4065cd0 0x7fb0a4101a90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:39.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.093+0000 7fb0a9200700 1 -- 172.21.15.120:0/1079140457 >> 172.21.15.120:0/1079140457 conn(0x7fb0a40f70a0 msgr2=0x7fb0a40f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:39.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.093+0000 7fb0a9200700 1 -- 172.21.15.120:0/1079140457 shutdown_connections 2024-04-26T21:14:39.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.094+0000 7fb0a9200700 1 -- 172.21.15.120:0/1079140457 wait complete. 2024-04-26T21:14:39.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.094+0000 7fb0a9200700 1 Processor -- start 2024-04-26T21:14:39.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.094+0000 7fb0a9200700 1 -- start start 2024-04-26T21:14:39.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.095+0000 7fb0a9200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0a4065cd0 0x7fb0a410f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:39.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.095+0000 7fb0a9200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a410f800 con 0x7fb0a4065cd0 2024-04-26T21:14:39.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.095+0000 7fb0a1e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0a4065cd0 0x7fb0a410f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:39.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.096+0000 7fb0a1e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0a4065cd0 0x7fb0a410f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.120:53212/0 (socket says 172.21.15.120:53212) 2024-04-26T21:14:39.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.096+0000 7fb0a1e00700 1 -- 172.21.15.120:0/4138531262 learned_addr learned my addr 172.21.15.120:0/4138531262 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:14:39.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.096+0000 7fb0a1e00700 1 -- 172.21.15.120:0/4138531262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb094005040 con 0x7fb0a4065cd0 2024-04-26T21:14:39.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.096+0000 7fb0a1e00700 1 --2- 172.21.15.120:0/4138531262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0a4065cd0 0x7fb0a410f2c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb094009680 tx=0x7fb094009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:39.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.097+0000 7fb09aa00700 1 -- 172.21.15.120:0/4138531262 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb09400bed0 con 0x7fb0a4065cd0 2024-04-26T21:14:39.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.097+0000 7fb0a9200700 1 -- 172.21.15.120:0/4138531262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a410fa00 con 0x7fb0a4065cd0 2024-04-26T21:14:39.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.097+0000 7fb09aa00700 1 -- 172.21.15.120:0/4138531262 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb09400b5c0 con 0x7fb0a4065cd0 2024-04-26T21:14:39.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.097+0000 7fb09aa00700 1 -- 172.21.15.120:0/4138531262 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb09401c5b0 con 0x7fb0a4065cd0 2024-04-26T21:14:39.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.097+0000 7fb0a9200700 1 -- 172.21.15.120:0/4138531262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a4110570 con 0x7fb0a4065cd0 2024-04-26T21:14:39.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.098+0000 7fb0a9200700 1 -- 172.21.15.120:0/4138531262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a4105150 con 0x7fb0a4065cd0 2024-04-26T21:14:39.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.098+0000 7fb09aa00700 1 -- 172.21.15.120:0/4138531262 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fb094004d30 con 0x7fb0a4065cd0 2024-04-26T21:14:39.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.099+0000 7fb09aa00700 1 --2- 172.21.15.120:0/4138531262 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fb088036880 0x7fb088038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:39.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.099+0000 7fb09aa00700 1 -- 172.21.15.120:0/4138531262 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb094049980 con 0x7fb0a4065cd0 2024-04-26T21:14:39.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.100+0000 7fb099400700 1 --2- 172.21.15.120:0/4138531262 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fb088036880 0x7fb088038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:39.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.101+0000 7fb099400700 1 --2- 172.21.15.120:0/4138531262 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fb088036880 0x7fb088038d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009990 tx=0x7fb08c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:39.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.114+0000 7fb09aa00700 1 -- 172.21.15.120:0/4138531262 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb094011960 con 0x7fb0a4065cd0 2024-04-26T21:14:39.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.409+0000 7fb0a9200700 1 -- 172.21.15.120:0/4138531262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb0a4111040 con 0x7fb0a4065cd0 2024-04-26T21:14:39.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.411+0000 7fb09aa00700 1 -- 172.21.15.120:0/4138531262 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fb094011370 con 0x7fb0a4065cd0 2024-04-26T21:14:39.413 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:14:39.413 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","modified":"2024-04-26T21:12:25.273724Z","created":"2024-04-26T21:12:25.273724Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T21:14:39.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.413+0000 7fb0a9200700 1 -- 172.21.15.120:0/4138531262 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fb088036880 msgr2=0x7fb088038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:39.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.413+0000 7fb0a9200700 1 --2- 172.21.15.120:0/4138531262 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fb088036880 0x7fb088038d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009990 tx=0x7fb08c006e40 comp rx=0 tx=0).stop 2024-04-26T21:14:39.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.413+0000 7fb0a9200700 1 -- 172.21.15.120:0/4138531262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0a4065cd0 msgr2=0x7fb0a410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:39.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.413+0000 7fb0a9200700 1 --2- 172.21.15.120:0/4138531262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0a4065cd0 0x7fb0a410f2c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb094009680 tx=0x7fb094009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:39.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.413+0000 7fb0a9200700 1 -- 172.21.15.120:0/4138531262 shutdown_connections 2024-04-26T21:14:39.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.413+0000 7fb0a9200700 1 --2- 172.21.15.120:0/4138531262 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fb088036880 0x7fb088038d30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:39.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.413+0000 7fb0a9200700 1 --2- 172.21.15.120:0/4138531262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0a4065cd0 0x7fb0a410f2c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:39.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.413+0000 7fb0a9200700 1 -- 172.21.15.120:0/4138531262 >> 172.21.15.120:0/4138531262 conn(0x7fb0a40f70a0 msgr2=0x7fb0a4105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:39.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.414+0000 7fb0a9200700 1 -- 172.21.15.120:0/4138531262 shutdown_connections 2024-04-26T21:14:39.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:39.414+0000 7fb0a9200700 1 -- 172.21.15.120:0/4138531262 wait complete. 2024-04-26T21:14:39.416 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-04-26T21:14:39.896 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:39 smithi084 ceph-mon[25539]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:39.896 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:39 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/4138531262' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:14:41.175 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T21:14:41.175 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T21:14:41.638 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:14:41.736 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:14:42.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:41 smithi084 ceph-mon[25539]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:43.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.743+0000 7f831b400700 1 -- 172.21.15.120:0/1478565144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83140fca40 msgr2=0x7f83140fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:43.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.743+0000 7f831b400700 1 --2- 172.21.15.120:0/1478565144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83140fca40 0x7f83140fce50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8308009c60 tx=0x7f8308004d10 comp rx=0 tx=0).stop 2024-04-26T21:14:43.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.743+0000 7f831b400700 1 -- 172.21.15.120:0/1478565144 shutdown_connections 2024-04-26T21:14:43.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.743+0000 7f831b400700 1 --2- 172.21.15.120:0/1478565144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83140fca40 0x7f83140fce50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:43.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.743+0000 7f831b400700 1 -- 172.21.15.120:0/1478565144 >> 172.21.15.120:0/1478565144 conn(0x7f83140f81a0 msgr2=0x7f83140fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:43.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.743+0000 7f831b400700 1 -- 172.21.15.120:0/1478565144 shutdown_connections 2024-04-26T21:14:43.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.743+0000 7f831b400700 1 -- 172.21.15.120:0/1478565144 wait complete. 2024-04-26T21:14:43.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.744+0000 7f831b400700 1 Processor -- start 2024-04-26T21:14:43.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.744+0000 7f831b400700 1 -- start start 2024-04-26T21:14:43.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.745+0000 7f831b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83140fca40 0x7f831410f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:43.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.745+0000 7f831b400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831410f7c0 con 0x7f83140fca40 2024-04-26T21:14:43.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.745+0000 7f8318a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83140fca40 0x7f831410f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:43.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.746+0000 7f8318a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83140fca40 0x7f831410f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.120:38230/0 (socket says 172.21.15.120:38230) 2024-04-26T21:14:43.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.746+0000 7f8318a00700 1 -- 172.21.15.120:0/564488376 learned_addr learned my addr 172.21.15.120:0/564488376 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:14:43.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.746+0000 7f8318a00700 1 -- 172.21.15.120:0/564488376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8308009940 con 0x7f83140fca40 2024-04-26T21:14:43.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.747+0000 7f8318a00700 1 --2- 172.21.15.120:0/564488376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83140fca40 0x7f831410f280 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8308009500 tx=0x7f8308004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:43.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.747+0000 7f8310c00700 1 -- 172.21.15.120:0/564488376 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8308007c80 con 0x7f83140fca40 2024-04-26T21:14:43.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.747+0000 7f831b400700 1 -- 172.21.15.120:0/564488376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831410f9c0 con 0x7f83140fca40 2024-04-26T21:14:43.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.747+0000 7f8310c00700 1 -- 172.21.15.120:0/564488376 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f830801d910 con 0x7f83140fca40 2024-04-26T21:14:43.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.747+0000 7f8310c00700 1 -- 172.21.15.120:0/564488376 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83080129d0 con 0x7f83140fca40 2024-04-26T21:14:43.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.747+0000 7f831b400700 1 -- 172.21.15.120:0/564488376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8314110530 con 0x7f83140fca40 2024-04-26T21:14:43.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.748+0000 7f831b400700 1 -- 172.21.15.120:0/564488376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8314102f50 con 0x7f83140fca40 2024-04-26T21:14:43.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.749+0000 7f8310c00700 1 -- 172.21.15.120:0/564488376 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f8308019040 con 0x7f83140fca40 2024-04-26T21:14:43.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.749+0000 7f8310c00700 1 --2- 172.21.15.120:0/564488376 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f82fc036880 0x7f82fc038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:43.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.750+0000 7f8310c00700 1 -- 172.21.15.120:0/564488376 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f830804a450 con 0x7f83140fca40 2024-04-26T21:14:43.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.750+0000 7f8313e00700 1 --2- 172.21.15.120:0/564488376 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f82fc036880 0x7f82fc038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:43.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.751+0000 7f8313e00700 1 --2- 172.21.15.120:0/564488376 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f82fc036880 0x7f82fc038d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8300009990 tx=0x7f8300006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:43.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:43.760+0000 7f8310c00700 1 -- 172.21.15.120:0/564488376 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f830802eb40 con 0x7f83140fca40 2024-04-26T21:14:43.894 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:43 smithi084 ceph-mon[25539]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:43.894 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:43 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:43.895 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:43 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:43.895 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:43 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:43.895 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:43 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:43.895 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:43 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:43.895 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:43 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:44.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:44.055+0000 7f831b400700 1 -- 172.21.15.120:0/564488376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f83141106c0 con 0x7f83140fca40 2024-04-26T21:14:44.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:44.056+0000 7f8310c00700 1 -- 172.21.15.120:0/564488376 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8308017020 con 0x7f83140fca40 2024-04-26T21:14:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:14:44.058 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","modified":"2024-04-26T21:12:25.273724Z","created":"2024-04-26T21:12:25.273724Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T21:14:44.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:44.059+0000 7f831b400700 1 -- 172.21.15.120:0/564488376 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f82fc036880 msgr2=0x7f82fc038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:44.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:44.059+0000 7f831b400700 1 --2- 172.21.15.120:0/564488376 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f82fc036880 0x7f82fc038d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8300009990 tx=0x7f8300006e40 comp rx=0 tx=0).stop 2024-04-26T21:14:44.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:44.059+0000 7f831b400700 1 -- 172.21.15.120:0/564488376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83140fca40 msgr2=0x7f831410f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:44.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:44.059+0000 7f831b400700 1 --2- 172.21.15.120:0/564488376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83140fca40 0x7f831410f280 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8308009500 tx=0x7f8308004d10 comp rx=0 tx=0).stop 2024-04-26T21:14:44.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:44.059+0000 7f831b400700 1 -- 172.21.15.120:0/564488376 shutdown_connections 2024-04-26T21:14:44.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:44.059+0000 7f831b400700 1 --2- 172.21.15.120:0/564488376 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f82fc036880 0x7f82fc038d30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:44.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:44.059+0000 7f831b400700 1 --2- 172.21.15.120:0/564488376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83140fca40 0x7f831410f280 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:44.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:44.059+0000 7f831b400700 1 -- 172.21.15.120:0/564488376 >> 172.21.15.120:0/564488376 conn(0x7f83140f81a0 msgr2=0x7f83140fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:44.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:44.059+0000 7f831b400700 1 -- 172.21.15.120:0/564488376 shutdown_connections 2024-04-26T21:14:44.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:44.059+0000 7f831b400700 1 -- 172.21.15.120:0/564488376 wait complete. 2024-04-26T21:14:44.062 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-04-26T21:14:45.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:44 smithi084 ceph-mon[25539]: Deploying daemon prometheus.smithi084 on smithi084 2024-04-26T21:14:45.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:44 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/564488376' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:14:45.721 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T21:14:45.722 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T21:14:45.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:45 smithi084 ceph-mon[25539]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:46.161 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:14:46.263 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:14:48.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.149+0000 7fab1b400700 1 -- 172.21.15.120:0/3926899915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab140fec40 msgr2=0x7fab140ff050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:48.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.149+0000 7fab1b400700 1 --2- 172.21.15.120:0/3926899915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab140fec40 0x7fab140ff050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fab080048c0 tx=0x7fab08009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.149+0000 7fab1b400700 1 -- 172.21.15.120:0/3926899915 shutdown_connections 2024-04-26T21:14:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.149+0000 7fab1b400700 1 --2- 172.21.15.120:0/3926899915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab140fec40 0x7fab140ff050 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.149+0000 7fab1b400700 1 -- 172.21.15.120:0/3926899915 >> 172.21.15.120:0/3926899915 conn(0x7fab140fa570 msgr2=0x7fab140fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.149+0000 7fab1b400700 1 -- 172.21.15.120:0/3926899915 shutdown_connections 2024-04-26T21:14:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.149+0000 7fab1b400700 1 -- 172.21.15.120:0/3926899915 wait complete. 2024-04-26T21:14:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.150+0000 7fab1b400700 1 Processor -- start 2024-04-26T21:14:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.150+0000 7fab1b400700 1 -- start start 2024-04-26T21:14:48.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.150+0000 7fab1b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab140fec40 0x7fab141136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:48.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.150+0000 7fab1b400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab14113bf0 con 0x7fab140fec40 2024-04-26T21:14:48.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.151+0000 7fab18a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab140fec40 0x7fab141136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:48.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.151+0000 7fab18a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab140fec40 0x7fab141136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.120:38240/0 (socket says 172.21.15.120:38240) 2024-04-26T21:14:48.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.151+0000 7fab18a00700 1 -- 172.21.15.120:0/455237200 learned_addr learned my addr 172.21.15.120:0/455237200 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:14:48.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.151+0000 7fab18a00700 1 -- 172.21.15.120:0/455237200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab08005040 con 0x7fab140fec40 2024-04-26T21:14:48.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.151+0000 7fab18a00700 1 --2- 172.21.15.120:0/455237200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab140fec40 0x7fab141136b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fab08009680 tx=0x7fab08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:48.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.152+0000 7fab10c00700 1 -- 172.21.15.120:0/455237200 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab0800b5c0 con 0x7fab140fec40 2024-04-26T21:14:48.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.152+0000 7fab10c00700 1 -- 172.21.15.120:0/455237200 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab0800be70 con 0x7fab140fec40 2024-04-26T21:14:48.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.152+0000 7fab10c00700 1 -- 172.21.15.120:0/455237200 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab080135a0 con 0x7fab140fec40 2024-04-26T21:14:48.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.152+0000 7fab1b400700 1 -- 172.21.15.120:0/455237200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab14113df0 con 0x7fab140fec40 2024-04-26T21:14:48.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.152+0000 7fab1b400700 1 -- 172.21.15.120:0/455237200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab14114960 con 0x7fab140fec40 2024-04-26T21:14:48.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.153+0000 7fab1b400700 1 -- 172.21.15.120:0/455237200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab14105150 con 0x7fab140fec40 2024-04-26T21:14:48.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.154+0000 7fab10c00700 1 -- 172.21.15.120:0/455237200 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fab0801ca90 con 0x7fab140fec40 2024-04-26T21:14:48.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.154+0000 7fab10c00700 1 --2- 172.21.15.120:0/455237200 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7faafc0368d0 0x7faafc038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:48.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.154+0000 7fab10c00700 1 -- 172.21.15.120:0/455237200 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fab08049410 con 0x7fab140fec40 2024-04-26T21:14:48.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.155+0000 7fab13e00700 1 --2- 172.21.15.120:0/455237200 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7faafc0368d0 0x7faafc038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:48.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.156+0000 7fab13e00700 1 --2- 172.21.15.120:0/455237200 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7faafc0368d0 0x7faafc038d80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fab00009990 tx=0x7fab00006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:48.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:47 smithi084 ceph-mon[25539]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:48.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:47 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:14:48.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.160+0000 7fab10c00700 1 -- 172.21.15.120:0/455237200 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fab08011940 con 0x7fab140fec40 2024-04-26T21:14:48.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.453+0000 7fab1b400700 1 -- 172.21.15.120:0/455237200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fab14115370 con 0x7fab140fec40 2024-04-26T21:14:48.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.454+0000 7fab10c00700 1 -- 172.21.15.120:0/455237200 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fab08021070 con 0x7fab140fec40 2024-04-26T21:14:48.456 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:14:48.456 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","modified":"2024-04-26T21:12:25.273724Z","created":"2024-04-26T21:12:25.273724Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T21:14:48.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.457+0000 7fab1b400700 1 -- 172.21.15.120:0/455237200 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7faafc0368d0 msgr2=0x7faafc038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:48.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.457+0000 7fab1b400700 1 --2- 172.21.15.120:0/455237200 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7faafc0368d0 0x7faafc038d80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fab00009990 tx=0x7fab00006e40 comp rx=0 tx=0).stop 2024-04-26T21:14:48.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.457+0000 7fab1b400700 1 -- 172.21.15.120:0/455237200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab140fec40 msgr2=0x7fab141136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:48.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.457+0000 7fab1b400700 1 --2- 172.21.15.120:0/455237200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab140fec40 0x7fab141136b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fab08009680 tx=0x7fab08009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:48.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.457+0000 7fab1b400700 1 -- 172.21.15.120:0/455237200 shutdown_connections 2024-04-26T21:14:48.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.457+0000 7fab1b400700 1 --2- 172.21.15.120:0/455237200 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7faafc0368d0 0x7faafc038d80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:48.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.457+0000 7fab1b400700 1 --2- 172.21.15.120:0/455237200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab140fec40 0x7fab141136b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:48.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.457+0000 7fab1b400700 1 -- 172.21.15.120:0/455237200 >> 172.21.15.120:0/455237200 conn(0x7fab140fa570 msgr2=0x7fab140fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:48.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.457+0000 7fab1b400700 1 -- 172.21.15.120:0/455237200 shutdown_connections 2024-04-26T21:14:48.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:48.457+0000 7fab1b400700 1 -- 172.21.15.120:0/455237200 wait complete. 2024-04-26T21:14:48.460 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-04-26T21:14:49.048 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:48 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/455237200' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:14:50.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:49 smithi084 ceph-mon[25539]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:50.197 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T21:14:50.197 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T21:14:50.637 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:14:50.735 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:14:52.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:51 smithi084 ceph-mon[25539]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:52.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.687+0000 7f6277e00700 1 -- 172.21.15.120:0/2604940578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62780feab0 msgr2=0x7f62780feec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:52.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.687+0000 7f6277e00700 1 --2- 172.21.15.120:0/2604940578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62780feab0 0x7f62780feec0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f62680048c0 tx=0x7f6268009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:52.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.687+0000 7f6277e00700 1 -- 172.21.15.120:0/2604940578 shutdown_connections 2024-04-26T21:14:52.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.687+0000 7f6277e00700 1 --2- 172.21.15.120:0/2604940578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62780feab0 0x7f62780feec0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:52.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.687+0000 7f6277e00700 1 -- 172.21.15.120:0/2604940578 >> 172.21.15.120:0/2604940578 conn(0x7f62780fa570 msgr2=0x7f62780fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:52.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.687+0000 7f6277e00700 1 -- 172.21.15.120:0/2604940578 shutdown_connections 2024-04-26T21:14:52.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.687+0000 7f6277e00700 1 -- 172.21.15.120:0/2604940578 wait complete. 2024-04-26T21:14:52.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.688+0000 7f6277e00700 1 Processor -- start 2024-04-26T21:14:52.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.688+0000 7f6277e00700 1 -- start start 2024-04-26T21:14:52.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.689+0000 7f6277e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62780feab0 0x7f627810f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:52.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.689+0000 7f6277e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627810f600 con 0x7f62780feab0 2024-04-26T21:14:52.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.689+0000 7f6276a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62780feab0 0x7f627810f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:52.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.689+0000 7f6276a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62780feab0 0x7f627810f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.120:48598/0 (socket says 172.21.15.120:48598) 2024-04-26T21:14:52.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.689+0000 7f6276a00700 1 -- 172.21.15.120:0/1013161563 learned_addr learned my addr 172.21.15.120:0/1013161563 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:14:52.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.690+0000 7f6276a00700 1 -- 172.21.15.120:0/1013161563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6268005040 con 0x7f62780feab0 2024-04-26T21:14:52.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.690+0000 7f6276a00700 1 --2- 172.21.15.120:0/1013161563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62780feab0 0x7f627810f0c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6268009680 tx=0x7f6268009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:52.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.691+0000 7f626ea00700 1 -- 172.21.15.120:0/1013161563 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f626800b5c0 con 0x7f62780feab0 2024-04-26T21:14:52.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.691+0000 7f6277e00700 1 -- 172.21.15.120:0/1013161563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627810f800 con 0x7f62780feab0 2024-04-26T21:14:52.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.691+0000 7f626ea00700 1 -- 172.21.15.120:0/1013161563 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f626800be70 con 0x7f62780feab0 2024-04-26T21:14:52.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.691+0000 7f626ea00700 1 -- 172.21.15.120:0/1013161563 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62680135a0 con 0x7f62780feab0 2024-04-26T21:14:52.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.691+0000 7f6277e00700 1 -- 172.21.15.120:0/1013161563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6278110370 con 0x7f62780feab0 2024-04-26T21:14:52.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.692+0000 7f6277e00700 1 -- 172.21.15.120:0/1013161563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6278104fc0 con 0x7f62780feab0 2024-04-26T21:14:52.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.693+0000 7f626ea00700 1 -- 172.21.15.120:0/1013161563 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f626801ca90 con 0x7f62780feab0 2024-04-26T21:14:52.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.693+0000 7f626ea00700 1 --2- 172.21.15.120:0/1013161563 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f625c0368d0 0x7f625c038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:52.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.693+0000 7f626ea00700 1 -- 172.21.15.120:0/1013161563 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f62680493d0 con 0x7f62780feab0 2024-04-26T21:14:52.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.694+0000 7f6276000700 1 --2- 172.21.15.120:0/1013161563 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f625c0368d0 0x7f625c038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:52.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.695+0000 7f6276000700 1 --2- 172.21.15.120:0/1013161563 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f625c0368d0 0x7f625c038d80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6264009990 tx=0x7f6264006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:52.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.708+0000 7f626ea00700 1 -- 172.21.15.120:0/1013161563 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6268011940 con 0x7f62780feab0 2024-04-26T21:14:52.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.997+0000 7f6277e00700 1 -- 172.21.15.120:0/1013161563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6278110d80 con 0x7f62780feab0 2024-04-26T21:14:53.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:52.998+0000 7f626ea00700 1 -- 172.21.15.120:0/1013161563 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6268021070 con 0x7f62780feab0 2024-04-26T21:14:53.000 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:14:53.000 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","modified":"2024-04-26T21:12:25.273724Z","created":"2024-04-26T21:12:25.273724Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T21:14:53.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:53.001+0000 7f6277e00700 1 -- 172.21.15.120:0/1013161563 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f625c0368d0 msgr2=0x7f625c038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:53.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:53.001+0000 7f6277e00700 1 --2- 172.21.15.120:0/1013161563 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f625c0368d0 0x7f625c038d80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6264009990 tx=0x7f6264006e40 comp rx=0 tx=0).stop 2024-04-26T21:14:53.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:53.001+0000 7f6277e00700 1 -- 172.21.15.120:0/1013161563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62780feab0 msgr2=0x7f627810f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:53.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:53.001+0000 7f6277e00700 1 --2- 172.21.15.120:0/1013161563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62780feab0 0x7f627810f0c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6268009680 tx=0x7f6268009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:53.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:53.001+0000 7f6277e00700 1 -- 172.21.15.120:0/1013161563 shutdown_connections 2024-04-26T21:14:53.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:53.001+0000 7f6277e00700 1 --2- 172.21.15.120:0/1013161563 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f625c0368d0 0x7f625c038d80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:53.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:53.001+0000 7f6277e00700 1 --2- 172.21.15.120:0/1013161563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62780feab0 0x7f627810f0c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:53.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:53.001+0000 7f6277e00700 1 -- 172.21.15.120:0/1013161563 >> 172.21.15.120:0/1013161563 conn(0x7f62780fa570 msgr2=0x7f62780fb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:53.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:53.002+0000 7f6277e00700 1 -- 172.21.15.120:0/1013161563 shutdown_connections 2024-04-26T21:14:53.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:53.002+0000 7f6277e00700 1 -- 172.21.15.120:0/1013161563 wait complete. 2024-04-26T21:14:53.005 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-04-26T21:14:53.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:53 smithi084 ceph-mon[25539]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:53.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:53 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/1013161563' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:14:54.661 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T21:14:54.662 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T21:14:55.096 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:14:55.202 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:14:56.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:55 smithi084 ceph-mon[25539]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:57.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.474+0000 7fe73c200700 1 -- 172.21.15.120:0/1439653371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7341030b0 msgr2=0x7fe7341034c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:57.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.474+0000 7fe73c200700 1 --2- 172.21.15.120:0/1439653371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7341030b0 0x7fe7341034c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe7280048c0 tx=0x7fe728009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:57.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.475+0000 7fe73c200700 1 -- 172.21.15.120:0/1439653371 shutdown_connections 2024-04-26T21:14:57.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.475+0000 7fe73c200700 1 --2- 172.21.15.120:0/1439653371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7341030b0 0x7fe7341034c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:57.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.475+0000 7fe73c200700 1 -- 172.21.15.120:0/1439653371 >> 172.21.15.120:0/1439653371 conn(0x7fe7340722a0 msgr2=0x7fe7340746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:57.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.475+0000 7fe73c200700 1 -- 172.21.15.120:0/1439653371 shutdown_connections 2024-04-26T21:14:57.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.475+0000 7fe73c200700 1 -- 172.21.15.120:0/1439653371 wait complete. 2024-04-26T21:14:57.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.476+0000 7fe73c200700 1 Processor -- start 2024-04-26T21:14:57.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.476+0000 7fe73c200700 1 -- start start 2024-04-26T21:14:57.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.477+0000 7fe73c200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7341030b0 0x7fe7341136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:57.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.477+0000 7fe73c200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe734113be0 con 0x7fe7341030b0 2024-04-26T21:14:57.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.477+0000 7fe739800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7341030b0 0x7fe7341136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:57.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.477+0000 7fe739800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7341030b0 0x7fe7341136a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.120:48626/0 (socket says 172.21.15.120:48626) 2024-04-26T21:14:57.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.477+0000 7fe739800700 1 -- 172.21.15.120:0/1524689292 learned_addr learned my addr 172.21.15.120:0/1524689292 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:14:57.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.478+0000 7fe739800700 1 -- 172.21.15.120:0/1524689292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe728005040 con 0x7fe7341030b0 2024-04-26T21:14:57.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.478+0000 7fe739800700 1 --2- 172.21.15.120:0/1524689292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7341030b0 0x7fe7341136a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe7280096b0 tx=0x7fe728009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:57.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.479+0000 7fe731600700 1 -- 172.21.15.120:0/1524689292 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe72800bed0 con 0x7fe7341030b0 2024-04-26T21:14:57.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.479+0000 7fe73c200700 1 -- 172.21.15.120:0/1524689292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe734113de0 con 0x7fe7341030b0 2024-04-26T21:14:57.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.479+0000 7fe73c200700 1 -- 172.21.15.120:0/1524689292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe734114950 con 0x7fe7341030b0 2024-04-26T21:14:57.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.479+0000 7fe731600700 1 -- 172.21.15.120:0/1524689292 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe72800b5c0 con 0x7fe7341030b0 2024-04-26T21:14:57.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.479+0000 7fe731600700 1 -- 172.21.15.120:0/1524689292 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7280255c0 con 0x7fe7341030b0 2024-04-26T21:14:57.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.480+0000 7fe73c200700 1 -- 172.21.15.120:0/1524689292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe734109560 con 0x7fe7341030b0 2024-04-26T21:14:57.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.481+0000 7fe731600700 1 -- 172.21.15.120:0/1524689292 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fe7280139f0 con 0x7fe7341030b0 2024-04-26T21:14:57.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.481+0000 7fe731600700 1 --2- 172.21.15.120:0/1524689292 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fe71c0368d0 0x7fe71c038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:57.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.481+0000 7fe731600700 1 -- 172.21.15.120:0/1524689292 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe728049a20 con 0x7fe7341030b0 2024-04-26T21:14:57.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.482+0000 7fe738e00700 1 --2- 172.21.15.120:0/1524689292 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fe71c0368d0 0x7fe71c038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:57.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.483+0000 7fe738e00700 1 --2- 172.21.15.120:0/1524689292 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fe71c0368d0 0x7fe71c038d80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe720009990 tx=0x7fe720006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:57.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.495+0000 7fe731600700 1 -- 172.21.15.120:0/1524689292 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe7280238f0 con 0x7fe7341030b0 2024-04-26T21:14:57.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.788+0000 7fe73c200700 1 -- 172.21.15.120:0/1524689292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe73405f5c0 con 0x7fe7341030b0 2024-04-26T21:14:57.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.789+0000 7fe731600700 1 -- 172.21.15.120:0/1524689292 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fe728023300 con 0x7fe7341030b0 2024-04-26T21:14:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:14:57.791 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","modified":"2024-04-26T21:12:25.273724Z","created":"2024-04-26T21:12:25.273724Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T21:14:57.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.792+0000 7fe73c200700 1 -- 172.21.15.120:0/1524689292 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fe71c0368d0 msgr2=0x7fe71c038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:57.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.792+0000 7fe73c200700 1 --2- 172.21.15.120:0/1524689292 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fe71c0368d0 0x7fe71c038d80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe720009990 tx=0x7fe720006e40 comp rx=0 tx=0).stop 2024-04-26T21:14:57.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.792+0000 7fe73c200700 1 -- 172.21.15.120:0/1524689292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7341030b0 msgr2=0x7fe7341136a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:57.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.792+0000 7fe73c200700 1 --2- 172.21.15.120:0/1524689292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7341030b0 0x7fe7341136a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe7280096b0 tx=0x7fe728009e30 comp rx=0 tx=0).stop 2024-04-26T21:14:57.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.792+0000 7fe73c200700 1 -- 172.21.15.120:0/1524689292 shutdown_connections 2024-04-26T21:14:57.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.792+0000 7fe73c200700 1 --2- 172.21.15.120:0/1524689292 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7fe71c0368d0 0x7fe71c038d80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:57.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.792+0000 7fe73c200700 1 --2- 172.21.15.120:0/1524689292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7341030b0 0x7fe7341136a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:57.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.792+0000 7fe73c200700 1 -- 172.21.15.120:0/1524689292 >> 172.21.15.120:0/1524689292 conn(0x7fe7340722a0 msgr2=0x7fe73410a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:57.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.793+0000 7fe73c200700 1 -- 172.21.15.120:0/1524689292 shutdown_connections 2024-04-26T21:14:57.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:14:57.793+0000 7fe73c200700 1 -- 172.21.15.120:0/1524689292 wait complete. 2024-04-26T21:14:57.794 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-04-26T21:14:58.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:57 smithi084 ceph-mon[25539]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:14:58.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:57 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/1524689292' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:14:59.510 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T21:14:59.511 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T21:14:59.954 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:15:00.050 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:14:59 smithi084 ceph-mon[25539]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:00.057 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:15:02.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:01 smithi084 ceph-mon[25539]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:02.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.170+0000 7f1426e00700 1 -- 172.21.15.120:0/53115740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14200fec40 msgr2=0x7f14200ff050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:02.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.170+0000 7f1426e00700 1 --2- 172.21.15.120:0/53115740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14200fec40 0x7f14200ff050 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f14100048c0 tx=0x7f1410009e30 comp rx=0 tx=0).stop 2024-04-26T21:15:02.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.170+0000 7f1426e00700 1 -- 172.21.15.120:0/53115740 shutdown_connections 2024-04-26T21:15:02.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.170+0000 7f1426e00700 1 --2- 172.21.15.120:0/53115740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14200fec40 0x7f14200ff050 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:02.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.170+0000 7f1426e00700 1 -- 172.21.15.120:0/53115740 >> 172.21.15.120:0/53115740 conn(0x7f14200fa570 msgr2=0x7f14200fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:02.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.171+0000 7f1426e00700 1 -- 172.21.15.120:0/53115740 shutdown_connections 2024-04-26T21:15:02.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.171+0000 7f1426e00700 1 -- 172.21.15.120:0/53115740 wait complete. 2024-04-26T21:15:02.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.172+0000 7f1426e00700 1 Processor -- start 2024-04-26T21:15:02.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.172+0000 7f1426e00700 1 -- start start 2024-04-26T21:15:02.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.172+0000 7f1426e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14200fec40 0x7f142010f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:02.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.172+0000 7f1426e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142010f7e0 con 0x7f14200fec40 2024-04-26T21:15:02.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.173+0000 7f141fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14200fec40 0x7f142010f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:02.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.173+0000 7f141fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14200fec40 0x7f142010f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.120:59772/0 (socket says 172.21.15.120:59772) 2024-04-26T21:15:02.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.173+0000 7f141fe00700 1 -- 172.21.15.120:0/4289316367 learned_addr learned my addr 172.21.15.120:0/4289316367 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:15:02.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.174+0000 7f141fe00700 1 -- 172.21.15.120:0/4289316367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1410005040 con 0x7f14200fec40 2024-04-26T21:15:02.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.174+0000 7f141fe00700 1 --2- 172.21.15.120:0/4289316367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14200fec40 0x7f142010f2a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1410009680 tx=0x7f1410009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:02.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.175+0000 7f1417e00700 1 -- 172.21.15.120:0/4289316367 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f141000b5c0 con 0x7f14200fec40 2024-04-26T21:15:02.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.175+0000 7f1417e00700 1 -- 172.21.15.120:0/4289316367 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f141000be70 con 0x7f14200fec40 2024-04-26T21:15:02.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.175+0000 7f1417e00700 1 -- 172.21.15.120:0/4289316367 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f14100135a0 con 0x7f14200fec40 2024-04-26T21:15:02.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.175+0000 7f1426e00700 1 -- 172.21.15.120:0/4289316367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142010f9e0 con 0x7f14200fec40 2024-04-26T21:15:02.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.175+0000 7f1426e00700 1 -- 172.21.15.120:0/4289316367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1420110550 con 0x7f14200fec40 2024-04-26T21:15:02.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.176+0000 7f1426e00700 1 -- 172.21.15.120:0/4289316367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1420105150 con 0x7f14200fec40 2024-04-26T21:15:02.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.177+0000 7f1417e00700 1 -- 172.21.15.120:0/4289316367 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f141001ca90 con 0x7f14200fec40 2024-04-26T21:15:02.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.177+0000 7f1417e00700 1 --2- 172.21.15.120:0/4289316367 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f14040368d0 0x7f1404038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:02.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.177+0000 7f1417e00700 1 -- 172.21.15.120:0/4289316367 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1410049340 con 0x7f14200fec40 2024-04-26T21:15:02.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.178+0000 7f141f400700 1 --2- 172.21.15.120:0/4289316367 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f14040368d0 0x7f1404038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:02.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.179+0000 7f141f400700 1 --2- 172.21.15.120:0/4289316367 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f14040368d0 0x7f1404038d80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f140c009990 tx=0x7f140c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:02.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.189+0000 7f1417e00700 1 -- 172.21.15.120:0/4289316367 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1410011960 con 0x7f14200fec40 2024-04-26T21:15:02.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.477+0000 7f1426e00700 1 -- 172.21.15.120:0/4289316367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1420110f60 con 0x7f14200fec40 2024-04-26T21:15:02.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.478+0000 7f1417e00700 1 -- 172.21.15.120:0/4289316367 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1410021070 con 0x7f14200fec40 2024-04-26T21:15:02.479 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:15:02.479 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","modified":"2024-04-26T21:12:25.273724Z","created":"2024-04-26T21:12:25.273724Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T21:15:02.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.481+0000 7f1426e00700 1 -- 172.21.15.120:0/4289316367 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f14040368d0 msgr2=0x7f1404038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:02.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.481+0000 7f1426e00700 1 --2- 172.21.15.120:0/4289316367 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f14040368d0 0x7f1404038d80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f140c009990 tx=0x7f140c006e40 comp rx=0 tx=0).stop 2024-04-26T21:15:02.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.481+0000 7f1426e00700 1 -- 172.21.15.120:0/4289316367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14200fec40 msgr2=0x7f142010f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:02.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.481+0000 7f1426e00700 1 --2- 172.21.15.120:0/4289316367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14200fec40 0x7f142010f2a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1410009680 tx=0x7f1410009e30 comp rx=0 tx=0).stop 2024-04-26T21:15:02.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.481+0000 7f1426e00700 1 -- 172.21.15.120:0/4289316367 shutdown_connections 2024-04-26T21:15:02.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.481+0000 7f1426e00700 1 --2- 172.21.15.120:0/4289316367 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f14040368d0 0x7f1404038d80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:02.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.481+0000 7f1426e00700 1 --2- 172.21.15.120:0/4289316367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14200fec40 0x7f142010f2a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:02.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.481+0000 7f1426e00700 1 -- 172.21.15.120:0/4289316367 >> 172.21.15.120:0/4289316367 conn(0x7f14200fa570 msgr2=0x7f14200fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:02.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.481+0000 7f1426e00700 1 -- 172.21.15.120:0/4289316367 shutdown_connections 2024-04-26T21:15:02.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:02.481+0000 7f1426e00700 1 -- 172.21.15.120:0/4289316367 wait complete. 2024-04-26T21:15:02.483 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-04-26T21:15:03.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:02 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:03.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:02 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:03.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:02 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:03.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:02 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-26T21:15:03.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:02 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/4289316367' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:15:03.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:02 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:04.176 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T21:15:04.177 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T21:15:04.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:03 smithi084 ceph-mon[25539]: from='mgr.14162 172.21.15.84:0/3797916019' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-26T21:15:04.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:03 smithi084 ceph-mon[25539]: mgrmap e14: smithi084.gyasul(active, since 80s) 2024-04-26T21:15:04.607 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:15:04.706 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:15:06.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.706+0000 7f6893800700 1 -- 172.21.15.120:0/2102405592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f688c1030b0 msgr2=0x7f688c1034c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:06.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.706+0000 7f6893800700 1 --2- 172.21.15.120:0/2102405592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f688c1030b0 0x7f688c1034c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f68800048c0 tx=0x7f6880009e30 comp rx=0 tx=0).stop 2024-04-26T21:15:06.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.706+0000 7f6893800700 1 -- 172.21.15.120:0/2102405592 shutdown_connections 2024-04-26T21:15:06.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.706+0000 7f6893800700 1 --2- 172.21.15.120:0/2102405592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f688c1030b0 0x7f688c1034c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:06.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.706+0000 7f6893800700 1 -- 172.21.15.120:0/2102405592 >> 172.21.15.120:0/2102405592 conn(0x7f688c0722a0 msgr2=0x7f688c0746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:06.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.706+0000 7f6893800700 1 -- 172.21.15.120:0/2102405592 shutdown_connections 2024-04-26T21:15:06.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.706+0000 7f6893800700 1 -- 172.21.15.120:0/2102405592 wait complete. 2024-04-26T21:15:06.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.707+0000 7f6893800700 1 Processor -- start 2024-04-26T21:15:06.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.707+0000 7f6893800700 1 -- start start 2024-04-26T21:15:06.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.708+0000 7f6893800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f688c1030b0 0x7f688c1136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:06.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.708+0000 7f6893800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c113be0 con 0x7f688c1030b0 2024-04-26T21:15:06.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.708+0000 7f6890e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f688c1030b0 0x7f688c1136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:06.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.708+0000 7f6890e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f688c1030b0 0x7f688c1136a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.120:59782/0 (socket says 172.21.15.120:59782) 2024-04-26T21:15:06.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.708+0000 7f6890e00700 1 -- 172.21.15.120:0/320673139 learned_addr learned my addr 172.21.15.120:0/320673139 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:15:06.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.709+0000 7f6890e00700 1 -- 172.21.15.120:0/320673139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6880005040 con 0x7f688c1030b0 2024-04-26T21:15:06.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.709+0000 7f6890e00700 1 --2- 172.21.15.120:0/320673139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f688c1030b0 0x7f688c1136a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6880009680 tx=0x7f6880009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:06.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.710+0000 7f6888c00700 1 -- 172.21.15.120:0/320673139 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f688000b5c0 con 0x7f688c1030b0 2024-04-26T21:15:06.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.710+0000 7f6888c00700 1 -- 172.21.15.120:0/320673139 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f688000be70 con 0x7f688c1030b0 2024-04-26T21:15:06.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.710+0000 7f6888c00700 1 -- 172.21.15.120:0/320673139 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68800135a0 con 0x7f688c1030b0 2024-04-26T21:15:06.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.710+0000 7f6893800700 1 -- 172.21.15.120:0/320673139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688c113de0 con 0x7f688c1030b0 2024-04-26T21:15:06.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.710+0000 7f6893800700 1 -- 172.21.15.120:0/320673139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688c114950 con 0x7f688c1030b0 2024-04-26T21:15:06.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.711+0000 7f6893800700 1 -- 172.21.15.120:0/320673139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f688c109560 con 0x7f688c1030b0 2024-04-26T21:15:06.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.711+0000 7f6888c00700 1 -- 172.21.15.120:0/320673139 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 14) v1 ==== 43446+0+0 (secure 0 0 0) 0x7f6880004d30 con 0x7f688c1030b0 2024-04-26T21:15:06.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.712+0000 7f6888c00700 1 --2- 172.21.15.120:0/320673139 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f68740368d0 0x7f6874038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:06.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.712+0000 7f6888c00700 1 -- 172.21.15.120:0/320673139 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f68800494a0 con 0x7f688c1030b0 2024-04-26T21:15:06.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.712+0000 7f688be00700 1 -- 172.21.15.120:0/320673139 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f68740368d0 msgr2=0x7f6874038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/3446199945 2024-04-26T21:15:06.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.712+0000 7f688be00700 1 --2- 172.21.15.120:0/320673139 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f68740368d0 0x7f6874038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T21:15:06.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.722+0000 7f6888c00700 1 -- 172.21.15.120:0/320673139 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6880011960 con 0x7f688c1030b0 2024-04-26T21:15:06.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.913+0000 7f688be00700 1 -- 172.21.15.120:0/320673139 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f68740368d0 msgr2=0x7f6874038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/3446199945 2024-04-26T21:15:06.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:06.913+0000 7f688be00700 1 --2- 172.21.15.120:0/320673139 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f68740368d0 0x7f6874038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T21:15:07.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:07.019+0000 7f6893800700 1 -- 172.21.15.120:0/320673139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f688c115360 con 0x7f688c1030b0 2024-04-26T21:15:07.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:07.020+0000 7f6888c00700 1 -- 172.21.15.120:0/320673139 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6880021070 con 0x7f688c1030b0 2024-04-26T21:15:07.020 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:15:07.021 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","modified":"2024-04-26T21:12:25.273724Z","created":"2024-04-26T21:12:25.273724Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T21:15:07.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:07.022+0000 7f6893800700 1 -- 172.21.15.120:0/320673139 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f68740368d0 msgr2=0x7f6874038d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T21:15:07.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:07.022+0000 7f6893800700 1 --2- 172.21.15.120:0/320673139 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f68740368d0 0x7f6874038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:07.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:07.022+0000 7f6893800700 1 -- 172.21.15.120:0/320673139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f688c1030b0 msgr2=0x7f688c1136a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:07.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:07.022+0000 7f6893800700 1 --2- 172.21.15.120:0/320673139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f688c1030b0 0x7f688c1136a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6880009680 tx=0x7f6880009e30 comp rx=0 tx=0).stop 2024-04-26T21:15:07.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:07.022+0000 7f6893800700 1 -- 172.21.15.120:0/320673139 shutdown_connections 2024-04-26T21:15:07.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:07.022+0000 7f6893800700 1 --2- 172.21.15.120:0/320673139 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f68740368d0 0x7f6874038d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:07.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:07.022+0000 7f6893800700 1 --2- 172.21.15.120:0/320673139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f688c1030b0 0x7f688c1136a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:07.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:07.022+0000 7f6893800700 1 -- 172.21.15.120:0/320673139 >> 172.21.15.120:0/320673139 conn(0x7f688c0722a0 msgr2=0x7f688c10a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:07.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:07.022+0000 7f6893800700 1 -- 172.21.15.120:0/320673139 shutdown_connections 2024-04-26T21:15:07.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:07.023+0000 7f6893800700 1 -- 172.21.15.120:0/320673139 wait complete. 2024-04-26T21:15:07.024 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-04-26T21:15:07.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:07 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/320673139' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:15:08.891 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T21:15:08.892 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T21:15:09.336 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:15:09.443 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:15:11.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.379+0000 7f2bf2a00700 1 -- 172.21.15.120:0/2112582615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bec1030b0 msgr2=0x7f2bec1034c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:11.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.379+0000 7f2bf2a00700 1 --2- 172.21.15.120:0/2112582615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bec1030b0 0x7f2bec1034c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0048c0 tx=0x7f2bdc009e30 comp rx=0 tx=0).stop 2024-04-26T21:15:11.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.380+0000 7f2bf2a00700 1 -- 172.21.15.120:0/2112582615 shutdown_connections 2024-04-26T21:15:11.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.380+0000 7f2bf2a00700 1 --2- 172.21.15.120:0/2112582615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bec1030b0 0x7f2bec1034c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:11.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.380+0000 7f2bf2a00700 1 -- 172.21.15.120:0/2112582615 >> 172.21.15.120:0/2112582615 conn(0x7f2bec0722a0 msgr2=0x7f2bec0746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:11.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.380+0000 7f2bf2a00700 1 -- 172.21.15.120:0/2112582615 shutdown_connections 2024-04-26T21:15:11.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.380+0000 7f2bf2a00700 1 -- 172.21.15.120:0/2112582615 wait complete. 2024-04-26T21:15:11.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.381+0000 7f2bf2a00700 1 Processor -- start 2024-04-26T21:15:11.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.381+0000 7f2bf2a00700 1 -- start start 2024-04-26T21:15:11.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.381+0000 7f2bf2a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bec1030b0 0x7f2bec1136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:11.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.381+0000 7f2bf2a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec113be0 con 0x7f2bec1030b0 2024-04-26T21:15:11.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.381+0000 7f2bebe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bec1030b0 0x7f2bec1136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:11.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.382+0000 7f2bebe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bec1030b0 0x7f2bec1136a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.120:43880/0 (socket says 172.21.15.120:43880) 2024-04-26T21:15:11.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.382+0000 7f2bebe00700 1 -- 172.21.15.120:0/389690077 learned_addr learned my addr 172.21.15.120:0/389690077 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:15:11.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.382+0000 7f2bebe00700 1 -- 172.21.15.120:0/389690077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc005040 con 0x7f2bec1030b0 2024-04-26T21:15:11.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.382+0000 7f2bebe00700 1 --2- 172.21.15.120:0/389690077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bec1030b0 0x7f2bec1136a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc009680 tx=0x7f2bdc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:11.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.383+0000 7f2be3e00700 1 -- 172.21.15.120:0/389690077 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2bdc00b5c0 con 0x7f2bec1030b0 2024-04-26T21:15:11.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.383+0000 7f2be3e00700 1 -- 172.21.15.120:0/389690077 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2bdc00be70 con 0x7f2bec1030b0 2024-04-26T21:15:11.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.383+0000 7f2bf2a00700 1 -- 172.21.15.120:0/389690077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bec113de0 con 0x7f2bec1030b0 2024-04-26T21:15:11.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.383+0000 7f2be3e00700 1 -- 172.21.15.120:0/389690077 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2bdc0135a0 con 0x7f2bec1030b0 2024-04-26T21:15:11.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.383+0000 7f2bf2a00700 1 -- 172.21.15.120:0/389690077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bec114950 con 0x7f2bec1030b0 2024-04-26T21:15:11.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.384+0000 7f2bf2a00700 1 -- 172.21.15.120:0/389690077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bec109560 con 0x7f2bec1030b0 2024-04-26T21:15:11.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.384+0000 7f2be3e00700 1 -- 172.21.15.120:0/389690077 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 14) v1 ==== 43446+0+0 (secure 0 0 0) 0x7f2bdc004d30 con 0x7f2bec1030b0 2024-04-26T21:15:11.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.385+0000 7f2be3e00700 1 --2- 172.21.15.120:0/389690077 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f2bd00368d0 0x7f2bd0038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:11.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.385+0000 7f2be3e00700 1 -- 172.21.15.120:0/389690077 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2bdc049460 con 0x7f2bec1030b0 2024-04-26T21:15:11.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.385+0000 7f2beb400700 1 -- 172.21.15.120:0/389690077 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f2bd00368d0 msgr2=0x7f2bd0038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/3446199945 2024-04-26T21:15:11.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.385+0000 7f2beb400700 1 --2- 172.21.15.120:0/389690077 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f2bd00368d0 0x7f2bd0038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T21:15:11.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.401+0000 7f2be3e00700 1 -- 172.21.15.120:0/389690077 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2bdc011960 con 0x7f2bec1030b0 2024-04-26T21:15:11.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.406+0000 7f2be3e00700 1 -- 172.21.15.120:0/389690077 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 15) v1 ==== 43170+0+0 (secure 0 0 0) 0x7f2bdc01c520 con 0x7f2bec1030b0 2024-04-26T21:15:11.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.406+0000 7f2be3e00700 1 -- 172.21.15.120:0/389690077 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f2bd00368d0 msgr2=0x7f2bd0038d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T21:15:11.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.406+0000 7f2be3e00700 1 --2- 172.21.15.120:0/389690077 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f2bd00368d0 0x7f2bd0038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:11.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:11 smithi084 ceph-mon[25539]: Active manager daemon smithi084.gyasul restarted 2024-04-26T21:15:11.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:11 smithi084 ceph-mon[25539]: Activating manager daemon smithi084.gyasul 2024-04-26T21:15:11.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:11 smithi084 ceph-mon[25539]: osdmap e5: 0 total, 0 up, 0 in 2024-04-26T21:15:11.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:11 smithi084 ceph-mon[25539]: mgrmap e15: smithi084.gyasul(active, starting, since 0.00905839s) 2024-04-26T21:15:11.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:11 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-04-26T21:15:11.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:11 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr metadata", "who": "smithi084.gyasul", "id": "smithi084.gyasul"}]: dispatch 2024-04-26T21:15:11.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:11 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T21:15:11.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:11 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T21:15:11.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:11 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T21:15:11.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:11 smithi084 ceph-mon[25539]: Manager daemon smithi084.gyasul is now available 2024-04-26T21:15:11.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:11 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:15:11.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:11 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:15:11.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.699+0000 7f2bf2a00700 1 -- 172.21.15.120:0/389690077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2bec115360 con 0x7f2bec1030b0 2024-04-26T21:15:11.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.700+0000 7f2be3e00700 1 -- 172.21.15.120:0/389690077 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2bdc021020 con 0x7f2bec1030b0 2024-04-26T21:15:11.701 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:15:11.701 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","modified":"2024-04-26T21:12:25.273724Z","created":"2024-04-26T21:12:25.273724Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T21:15:11.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.703+0000 7f2bf2a00700 1 -- 172.21.15.120:0/389690077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bec1030b0 msgr2=0x7f2bec1136a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:11.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.703+0000 7f2bf2a00700 1 --2- 172.21.15.120:0/389690077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bec1030b0 0x7f2bec1136a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc009680 tx=0x7f2bdc009e30 comp rx=0 tx=0).stop 2024-04-26T21:15:11.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.703+0000 7f2bf2a00700 1 -- 172.21.15.120:0/389690077 shutdown_connections 2024-04-26T21:15:11.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.703+0000 7f2bf2a00700 1 --2- 172.21.15.120:0/389690077 >> [v2:172.21.15.84:6800/3446199945,v1:172.21.15.84:6801/3446199945] conn(0x7f2bd00368d0 0x7f2bd0038d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:11.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.703+0000 7f2bf2a00700 1 --2- 172.21.15.120:0/389690077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bec1030b0 0x7f2bec1136a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:11.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.703+0000 7f2bf2a00700 1 -- 172.21.15.120:0/389690077 >> 172.21.15.120:0/389690077 conn(0x7f2bec0722a0 msgr2=0x7f2bec10a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:11.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.703+0000 7f2bf2a00700 1 -- 172.21.15.120:0/389690077 shutdown_connections 2024-04-26T21:15:11.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:11.704+0000 7f2bf2a00700 1 -- 172.21.15.120:0/389690077 wait complete. 2024-04-26T21:15:11.705 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-04-26T21:15:12.820 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:12 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:12.820 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:12 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:15:12.820 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:12 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.gyasul/mirror_snapshot_schedule"}]: dispatch 2024-04-26T21:15:12.821 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:12 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.gyasul/trash_purge_schedule"}]: dispatch 2024-04-26T21:15:12.821 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:12 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/389690077' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:15:12.821 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:12 smithi084 ceph-mon[25539]: [26/Apr/2024:21:15:11] ENGINE Bus STARTING 2024-04-26T21:15:12.821 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:12 smithi084 ceph-mon[25539]: [26/Apr/2024:21:15:11] ENGINE Serving on https://172.21.15.84:7150 2024-04-26T21:15:12.821 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:12 smithi084 ceph-mon[25539]: [26/Apr/2024:21:15:11] ENGINE Bus STARTED 2024-04-26T21:15:12.821 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:12 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:12.821 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:12 smithi084 ceph-mon[25539]: mgrmap e16: smithi084.gyasul(active, since 1.00923s) 2024-04-26T21:15:12.821 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:12 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:13.511 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T21:15:13.512 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T21:15:13.953 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:15:14.073 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:15:14.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:14 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:15.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:15 smithi084 ceph-mon[25539]: mgrmap e17: smithi084.gyasul(active, since 2s) 2024-04-26T21:15:15.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:15 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:17.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.915+0000 7f6280e00700 1 -- 172.21.15.120:0/2773134206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f627c066520 msgr2=0x7f627c0ff4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:17.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.915+0000 7f6280e00700 1 --2- 172.21.15.120:0/2773134206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f627c066520 0x7f627c0ff4f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f626c0048c0 tx=0x7f626c009e30 comp rx=0 tx=0).stop 2024-04-26T21:15:17.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.916+0000 7f6280e00700 1 -- 172.21.15.120:0/2773134206 shutdown_connections 2024-04-26T21:15:17.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.916+0000 7f6280e00700 1 --2- 172.21.15.120:0/2773134206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f627c066520 0x7f627c0ff4f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:17.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.916+0000 7f6280e00700 1 -- 172.21.15.120:0/2773134206 >> 172.21.15.120:0/2773134206 conn(0x7f627c0f6ec0 msgr2=0x7f627c0f92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:17.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.916+0000 7f6280e00700 1 -- 172.21.15.120:0/2773134206 shutdown_connections 2024-04-26T21:15:17.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.916+0000 7f6280e00700 1 -- 172.21.15.120:0/2773134206 wait complete. 2024-04-26T21:15:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.917+0000 7f6280e00700 1 Processor -- start 2024-04-26T21:15:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.917+0000 7f6280e00700 1 -- start start 2024-04-26T21:15:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.917+0000 7f6280e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f627c066520 0x7f627c10f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.917+0000 7f6280e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c10f630 con 0x7f627c066520 2024-04-26T21:15:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.918+0000 7f627b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f627c066520 0x7f627c10f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.918+0000 7f627b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f627c066520 0x7f627c10f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.120:43908/0 (socket says 172.21.15.120:43908) 2024-04-26T21:15:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.918+0000 7f627b400700 1 -- 172.21.15.120:0/3525462674 learned_addr learned my addr 172.21.15.120:0/3525462674 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:15:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.918+0000 7f627b400700 1 -- 172.21.15.120:0/3525462674 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c005040 con 0x7f627c066520 2024-04-26T21:15:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.919+0000 7f627b400700 1 --2- 172.21.15.120:0/3525462674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f627c066520 0x7f627c10f0f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f626c009480 tx=0x7f626c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.920+0000 7f6273400700 1 -- 172.21.15.120:0/3525462674 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f626c00bba0 con 0x7f627c066520 2024-04-26T21:15:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.920+0000 7f6273400700 1 -- 172.21.15.120:0/3525462674 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f626c00bd00 con 0x7f627c066520 2024-04-26T21:15:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.920+0000 7f6280e00700 1 -- 172.21.15.120:0/3525462674 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627c10f830 con 0x7f627c066520 2024-04-26T21:15:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.920+0000 7f6273400700 1 -- 172.21.15.120:0/3525462674 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f626c01c570 con 0x7f627c066520 2024-04-26T21:15:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.920+0000 7f6280e00700 1 -- 172.21.15.120:0/3525462674 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627c1103a0 con 0x7f627c066520 2024-04-26T21:15:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.921+0000 7f6280e00700 1 -- 172.21.15.120:0/3525462674 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627c102d70 con 0x7f627c066520 2024-04-26T21:15:17.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.922+0000 7f6273400700 1 -- 172.21.15.120:0/3525462674 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f626c013a80 con 0x7f627c066520 2024-04-26T21:15:17.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.922+0000 7f6273400700 1 --2- 172.21.15.120:0/3525462674 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f62600369c0 0x7f6260038e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:17.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.922+0000 7f6273400700 1 -- 172.21.15.120:0/3525462674 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f626c049780 con 0x7f627c066520 2024-04-26T21:15:17.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.923+0000 7f627aa00700 1 --2- 172.21.15.120:0/3525462674 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f62600369c0 0x7f6260038e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:17.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.924+0000 7f627aa00700 1 --2- 172.21.15.120:0/3525462674 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f62600369c0 0x7f6260038e70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6268009990 tx=0x7f6268006e40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:17.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:16.931+0000 7f6273400700 1 -- 172.21.15.120:0/3525462674 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f626c013420 con 0x7f627c066520 2024-04-26T21:15:17.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:17.241+0000 7f6280e00700 1 -- 172.21.15.120:0/3525462674 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f627c1106a0 con 0x7f627c066520 2024-04-26T21:15:17.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:17.242+0000 7f6273400700 1 -- 172.21.15.120:0/3525462674 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f626c021020 con 0x7f627c066520 2024-04-26T21:15:17.244 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:15:17.244 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","modified":"2024-04-26T21:12:25.273724Z","created":"2024-04-26T21:12:25.273724Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T21:15:17.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:17.245+0000 7f6280e00700 1 -- 172.21.15.120:0/3525462674 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f62600369c0 msgr2=0x7f6260038e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:17.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:17.245+0000 7f6280e00700 1 --2- 172.21.15.120:0/3525462674 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f62600369c0 0x7f6260038e70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6268009990 tx=0x7f6268006e40 comp rx=0 tx=0).stop 2024-04-26T21:15:17.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:17.246+0000 7f6280e00700 1 -- 172.21.15.120:0/3525462674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f627c066520 msgr2=0x7f627c10f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:17.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:17.246+0000 7f6280e00700 1 --2- 172.21.15.120:0/3525462674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f627c066520 0x7f627c10f0f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f626c009480 tx=0x7f626c009e30 comp rx=0 tx=0).stop 2024-04-26T21:15:17.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:17.246+0000 7f6280e00700 1 -- 172.21.15.120:0/3525462674 shutdown_connections 2024-04-26T21:15:17.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:17.246+0000 7f6280e00700 1 --2- 172.21.15.120:0/3525462674 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f62600369c0 0x7f6260038e70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:17.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:17.246+0000 7f6280e00700 1 --2- 172.21.15.120:0/3525462674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f627c066520 0x7f627c10f0f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:17.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:17.246+0000 7f6280e00700 1 -- 172.21.15.120:0/3525462674 >> 172.21.15.120:0/3525462674 conn(0x7f627c0f6ec0 msgr2=0x7f627c0f92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:17.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:17.246+0000 7f6280e00700 1 -- 172.21.15.120:0/3525462674 shutdown_connections 2024-04-26T21:15:17.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:17.246+0000 7f6280e00700 1 -- 172.21.15.120:0/3525462674 wait complete. 2024-04-26T21:15:17.248 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-04-26T21:15:18.400 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:17 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:18.400 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:17 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:18.401 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:17 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/3525462674' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:15:19.120 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T21:15:19.120 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T21:15:19.546 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:15:19.664 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T21:15:19.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:19 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:19.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:19 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:19.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:19 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd/host:smithi084", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:15:22.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.450+0000 7f4918400700 1 -- 172.21.15.120:0/2002419664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4910065d30 msgr2=0x7f49100ff630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:22.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.450+0000 7f4918400700 1 --2- 172.21.15.120:0/2002419664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4910065d30 0x7f49100ff630 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f49040048c0 tx=0x7f4904009e30 comp rx=0 tx=0).stop 2024-04-26T21:15:22.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.450+0000 7f4918400700 1 -- 172.21.15.120:0/2002419664 shutdown_connections 2024-04-26T21:15:22.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.450+0000 7f4918400700 1 --2- 172.21.15.120:0/2002419664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4910065d30 0x7f49100ff630 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:22.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.450+0000 7f4918400700 1 -- 172.21.15.120:0/2002419664 >> 172.21.15.120:0/2002419664 conn(0x7f49100f70a0 msgr2=0x7f49100f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:22.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.450+0000 7f4918400700 1 -- 172.21.15.120:0/2002419664 shutdown_connections 2024-04-26T21:15:22.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.450+0000 7f4918400700 1 -- 172.21.15.120:0/2002419664 wait complete. 2024-04-26T21:15:22.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.451+0000 7f4918400700 1 Processor -- start 2024-04-26T21:15:22.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.451+0000 7f4918400700 1 -- start start 2024-04-26T21:15:22.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.451+0000 7f4918400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4910065d30 0x7f491010f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:22.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.452+0000 7f4918400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491010f7e0 con 0x7f4910065d30 2024-04-26T21:15:22.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.452+0000 7f4915a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4910065d30 0x7f491010f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:22.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.452+0000 7f4915a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4910065d30 0x7f491010f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.120:45248/0 (socket says 172.21.15.120:45248) 2024-04-26T21:15:22.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.452+0000 7f4915a00700 1 -- 172.21.15.120:0/3882469331 learned_addr learned my addr 172.21.15.120:0/3882469331 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:15:22.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.452+0000 7f4915a00700 1 -- 172.21.15.120:0/3882469331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4904005040 con 0x7f4910065d30 2024-04-26T21:15:22.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.453+0000 7f4915a00700 1 --2- 172.21.15.120:0/3882469331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4910065d30 0x7f491010f2a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f490400b900 tx=0x7f4904009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:22.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.453+0000 7f490d600700 1 -- 172.21.15.120:0/3882469331 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f490400b5c0 con 0x7f4910065d30 2024-04-26T21:15:22.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.453+0000 7f490d600700 1 -- 172.21.15.120:0/3882469331 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f490400be70 con 0x7f4910065d30 2024-04-26T21:15:22.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.453+0000 7f490d600700 1 -- 172.21.15.120:0/3882469331 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f490401c590 con 0x7f4910065d30 2024-04-26T21:15:22.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.453+0000 7f4918400700 1 -- 172.21.15.120:0/3882469331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491010f9e0 con 0x7f4910065d30 2024-04-26T21:15:22.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.453+0000 7f4918400700 1 -- 172.21.15.120:0/3882469331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4910110550 con 0x7f4910065d30 2024-04-26T21:15:22.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.454+0000 7f490d600700 1 -- 172.21.15.120:0/3882469331 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f4904004d30 con 0x7f4910065d30 2024-04-26T21:15:22.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.454+0000 7f4918400700 1 -- 172.21.15.120:0/3882469331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4910102f40 con 0x7f4910065d30 2024-04-26T21:15:22.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.455+0000 7f490d600700 1 --2- 172.21.15.120:0/3882469331 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f48f80369c0 0x7f48f8038e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:22.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.455+0000 7f490d600700 1 -- 172.21.15.120:0/3882469331 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f49040495e0 con 0x7f4910065d30 2024-04-26T21:15:22.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.455+0000 7f4915000700 1 --2- 172.21.15.120:0/3882469331 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f48f80369c0 0x7f48f8038e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:22.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.456+0000 7f4915000700 1 --2- 172.21.15.120:0/3882469331 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f48f80369c0 0x7f48f8038e70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f48fc009990 tx=0x7f48fc006e40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:22.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.460+0000 7f490d600700 1 -- 172.21.15.120:0/3882469331 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4904011d90 con 0x7f4910065d30 2024-04-26T21:15:22.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.761+0000 7f4918400700 1 -- 172.21.15.120:0/3882469331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4910110790 con 0x7f4910065d30 2024-04-26T21:15:22.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.762+0000 7f490d600700 1 -- 172.21.15.120:0/3882469331 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f4904021030 con 0x7f4910065d30 2024-04-26T21:15:22.764 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:15:22.764 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","modified":"2024-04-26T21:12:25.273724Z","created":"2024-04-26T21:12:25.273724Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T21:15:22.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.764+0000 7f4918400700 1 -- 172.21.15.120:0/3882469331 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f48f80369c0 msgr2=0x7f48f8038e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:22.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.764+0000 7f4918400700 1 --2- 172.21.15.120:0/3882469331 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f48f80369c0 0x7f48f8038e70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f48fc009990 tx=0x7f48fc006e40 comp rx=0 tx=0).stop 2024-04-26T21:15:22.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.764+0000 7f4918400700 1 -- 172.21.15.120:0/3882469331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4910065d30 msgr2=0x7f491010f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:22.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.764+0000 7f4918400700 1 --2- 172.21.15.120:0/3882469331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4910065d30 0x7f491010f2a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f490400b900 tx=0x7f4904009e30 comp rx=0 tx=0).stop 2024-04-26T21:15:22.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.765+0000 7f4918400700 1 -- 172.21.15.120:0/3882469331 shutdown_connections 2024-04-26T21:15:22.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.765+0000 7f4918400700 1 --2- 172.21.15.120:0/3882469331 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f48f80369c0 0x7f48f8038e70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:22.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.765+0000 7f4918400700 1 --2- 172.21.15.120:0/3882469331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4910065d30 0x7f491010f2a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:22.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.765+0000 7f4918400700 1 -- 172.21.15.120:0/3882469331 >> 172.21.15.120:0/3882469331 conn(0x7f49100f70a0 msgr2=0x7f49100f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:22.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.765+0000 7f4918400700 1 -- 172.21.15.120:0/3882469331 shutdown_connections 2024-04-26T21:15:22.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:22.765+0000 7f4918400700 1 -- 172.21.15.120:0/3882469331 wait complete. 2024-04-26T21:15:22.768 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-04-26T21:15:22.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:22 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:22.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:22 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:22.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:22 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:22.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:22 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:22.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:22 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd/host:smithi120", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:15:22.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:22 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:22.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:22 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:15:22.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:22 smithi084 ceph-mon[25539]: Updating smithi084:/etc/ceph/ceph.conf 2024-04-26T21:15:22.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:22 smithi084 ceph-mon[25539]: Updating smithi120:/etc/ceph/ceph.conf 2024-04-26T21:15:23.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:23 smithi084 ceph-mon[25539]: Updating smithi120:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:15:23.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:23 smithi084 ceph-mon[25539]: Updating smithi084:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:15:23.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:23 smithi084 ceph-mon[25539]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:15:23.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:23 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/3882469331' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:15:23.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:23 smithi084 ceph-mon[25539]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:15:24.547 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T21:15:24.547 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T21:15:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:25 smithi084 ceph-mon[25539]: Updating smithi120:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:15:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:25 smithi084 ceph-mon[25539]: Updating smithi084:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:15:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:25 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:25 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:25 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:25 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:25 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:25 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi120", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:15:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:25 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi120", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-26T21:15:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:25 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:25.641 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:15:26.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:26 smithi084 ceph-mon[25539]: Deploying daemon crash.smithi120 on smithi120 2024-04-26T21:15:27.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:27 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:15:28.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.564+0000 7f6923e00700 1 -- 172.21.15.120:0/2053014015 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f691800bb80 con 0x7f69241017e0 2024-04-26T21:15:28.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.565+0000 7f692b000700 1 -- 172.21.15.120:0/2053014015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69241017e0 msgr2=0x7f6924101bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:28.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.565+0000 7f692b000700 1 --2- 172.21.15.120:0/2053014015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69241017e0 0x7f6924101bb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f69180048c0 tx=0x7f6918009e30 comp rx=0 tx=0).stop 2024-04-26T21:15:28.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.565+0000 7f692b000700 1 -- 172.21.15.120:0/2053014015 shutdown_connections 2024-04-26T21:15:28.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.565+0000 7f692b000700 1 --2- 172.21.15.120:0/2053014015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69241017e0 0x7f6924101bb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:28.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.565+0000 7f692b000700 1 -- 172.21.15.120:0/2053014015 >> 172.21.15.120:0/2053014015 conn(0x7f69240726f0 msgr2=0x7f6924072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:28.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.565+0000 7f692b000700 1 -- 172.21.15.120:0/2053014015 shutdown_connections 2024-04-26T21:15:28.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.565+0000 7f692b000700 1 -- 172.21.15.120:0/2053014015 wait complete. 2024-04-26T21:15:28.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.566+0000 7f692b000700 1 Processor -- start 2024-04-26T21:15:28.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.567+0000 7f692b000700 1 -- start start 2024-04-26T21:15:28.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.567+0000 7f692b000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69241017e0 0x7f6924112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:28.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.567+0000 7f692b000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6924113490 con 0x7f69241017e0 2024-04-26T21:15:28.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.568+0000 7f6929c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69241017e0 0x7f6924112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.568+0000 7f6929c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69241017e0 0x7f6924112f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.120:45272/0 (socket says 172.21.15.120:45272) 2024-04-26T21:15:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.568+0000 7f6929c00700 1 -- 172.21.15.120:0/2307430951 learned_addr learned my addr 172.21.15.120:0/2307430951 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:15:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.568+0000 7f6929c00700 1 -- 172.21.15.120:0/2307430951 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6918005040 con 0x7f69241017e0 2024-04-26T21:15:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.569+0000 7f6929c00700 1 --2- 172.21.15.120:0/2307430951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69241017e0 0x7f6924112f50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f691800b820 tx=0x7f6918009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.569+0000 7f6921600700 1 -- 172.21.15.120:0/2307430951 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69180093c0 con 0x7f69241017e0 2024-04-26T21:15:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.569+0000 7f692b000700 1 -- 172.21.15.120:0/2307430951 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6924113690 con 0x7f69241017e0 2024-04-26T21:15:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.569+0000 7f6921600700 1 -- 172.21.15.120:0/2307430951 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6918013420 con 0x7f69241017e0 2024-04-26T21:15:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.569+0000 7f692b000700 1 -- 172.21.15.120:0/2307430951 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6924113b80 con 0x7f69241017e0 2024-04-26T21:15:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.569+0000 7f6921600700 1 -- 172.21.15.120:0/2307430951 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6918025560 con 0x7f69241017e0 2024-04-26T21:15:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.570+0000 7f692b000700 1 -- 172.21.15.120:0/2307430951 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69240fcee0 con 0x7f69241017e0 2024-04-26T21:15:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.571+0000 7f6921600700 1 -- 172.21.15.120:0/2307430951 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f6918013a90 con 0x7f69241017e0 2024-04-26T21:15:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.571+0000 7f6921600700 1 --2- 172.21.15.120:0/2307430951 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f690c036970 0x7f690c038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.572+0000 7f6921600700 1 -- 172.21.15.120:0/2307430951 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6918049a30 con 0x7f69241017e0 2024-04-26T21:15:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.572+0000 7f6929200700 1 --2- 172.21.15.120:0/2307430951 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f690c036970 0x7f690c038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:28.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.573+0000 7f6929200700 1 --2- 172.21.15.120:0/2307430951 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f690c036970 0x7f690c038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6910009990 tx=0x7f6910006e40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:28.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.588+0000 7f6921600700 1 -- 172.21.15.120:0/2307430951 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6918023300 con 0x7f69241017e0 2024-04-26T21:15:28.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.888+0000 7f692b000700 1 -- 172.21.15.120:0/2307430951 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f692405f5c0 con 0x7f69241017e0 2024-04-26T21:15:28.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.889+0000 7f6921600700 1 -- 172.21.15.120:0/2307430951 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6918011b60 con 0x7f69241017e0 2024-04-26T21:15:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:15:28.891 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","modified":"2024-04-26T21:12:25.273724Z","created":"2024-04-26T21:12:25.273724Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T21:15:28.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.894+0000 7f692b000700 1 -- 172.21.15.120:0/2307430951 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f690c036970 msgr2=0x7f690c038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:28.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.894+0000 7f692b000700 1 --2- 172.21.15.120:0/2307430951 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f690c036970 0x7f690c038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6910009990 tx=0x7f6910006e40 comp rx=0 tx=0).stop 2024-04-26T21:15:28.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.894+0000 7f692b000700 1 -- 172.21.15.120:0/2307430951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69241017e0 msgr2=0x7f6924112f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:28.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.894+0000 7f692b000700 1 --2- 172.21.15.120:0/2307430951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69241017e0 0x7f6924112f50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f691800b820 tx=0x7f6918009e30 comp rx=0 tx=0).stop 2024-04-26T21:15:28.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.894+0000 7f692b000700 1 -- 172.21.15.120:0/2307430951 shutdown_connections 2024-04-26T21:15:28.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.894+0000 7f692b000700 1 --2- 172.21.15.120:0/2307430951 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f690c036970 0x7f690c038e20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:28.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.894+0000 7f692b000700 1 --2- 172.21.15.120:0/2307430951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69241017e0 0x7f6924112f50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:28.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.894+0000 7f692b000700 1 -- 172.21.15.120:0/2307430951 >> 172.21.15.120:0/2307430951 conn(0x7f69240726f0 msgr2=0x7f6924065050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:28.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.894+0000 7f692b000700 1 -- 172.21.15.120:0/2307430951 shutdown_connections 2024-04-26T21:15:28.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:28.894+0000 7f692b000700 1 -- 172.21.15.120:0/2307430951 wait complete. 2024-04-26T21:15:28.897 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-04-26T21:15:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:28 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/2307430951' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:15:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:28 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:28 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:30.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:29 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:30.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:29 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:30.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:29 smithi084 ceph-mon[25539]: Deploying daemon node-exporter.smithi120 on smithi120 2024-04-26T21:15:30.719 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T21:15:30.719 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T21:15:31.149 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:15:32.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:32 smithi084 ceph-mon[25539]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:32.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:32 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:34.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.696+0000 7efdc5600700 1 -- 172.21.15.120:0/1351689976 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdb800bb80 con 0x7efdc8102aa0 2024-04-26T21:15:34.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.696+0000 7efdcdc00700 1 -- 172.21.15.120:0/1351689976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc8102aa0 msgr2=0x7efdc8102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:34.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.696+0000 7efdcdc00700 1 --2- 172.21.15.120:0/1351689976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc8102aa0 0x7efdc8102e70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efdb80048c0 tx=0x7efdb8009e30 comp rx=0 tx=0).stop 2024-04-26T21:15:34.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.696+0000 7efdcdc00700 1 -- 172.21.15.120:0/1351689976 shutdown_connections 2024-04-26T21:15:34.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.697+0000 7efdcdc00700 1 --2- 172.21.15.120:0/1351689976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc8102aa0 0x7efdc8102e70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:34.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.697+0000 7efdcdc00700 1 -- 172.21.15.120:0/1351689976 >> 172.21.15.120:0/1351689976 conn(0x7efdc80f85c0 msgr2=0x7efdc80fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:34.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.697+0000 7efdcdc00700 1 -- 172.21.15.120:0/1351689976 shutdown_connections 2024-04-26T21:15:34.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.697+0000 7efdcdc00700 1 -- 172.21.15.120:0/1351689976 wait complete. 2024-04-26T21:15:34.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.698+0000 7efdcdc00700 1 Processor -- start 2024-04-26T21:15:34.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.698+0000 7efdcdc00700 1 -- start start 2024-04-26T21:15:34.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.698+0000 7efdcdc00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc8102aa0 0x7efdc81152f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:34.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.698+0000 7efdcdc00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc8115830 con 0x7efdc8102aa0 2024-04-26T21:15:34.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.699+0000 7efdc6a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc8102aa0 0x7efdc81152f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:34.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.699+0000 7efdc6a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc8102aa0 0x7efdc81152f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.120:37660/0 (socket says 172.21.15.120:37660) 2024-04-26T21:15:34.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.699+0000 7efdc6a00700 1 -- 172.21.15.120:0/50613918 learned_addr learned my addr 172.21.15.120:0/50613918 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:15:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.700+0000 7efdc6a00700 1 -- 172.21.15.120:0/50613918 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb8005040 con 0x7efdc8102aa0 2024-04-26T21:15:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.700+0000 7efdc6a00700 1 --2- 172.21.15.120:0/50613918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc8102aa0 0x7efdc81152f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efdb800b820 tx=0x7efdb8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.701+0000 7efdbea00700 1 -- 172.21.15.120:0/50613918 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdb80093c0 con 0x7efdc8102aa0 2024-04-26T21:15:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.701+0000 7efdcdc00700 1 -- 172.21.15.120:0/50613918 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc8115a30 con 0x7efdc8102aa0 2024-04-26T21:15:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.701+0000 7efdbea00700 1 -- 172.21.15.120:0/50613918 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efdb8013420 con 0x7efdc8102aa0 2024-04-26T21:15:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.701+0000 7efdbea00700 1 -- 172.21.15.120:0/50613918 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdb80255c0 con 0x7efdc8102aa0 2024-04-26T21:15:34.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.701+0000 7efdcdc00700 1 -- 172.21.15.120:0/50613918 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc8115f20 con 0x7efdc8102aa0 2024-04-26T21:15:34.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.702+0000 7efdcdc00700 1 -- 172.21.15.120:0/50613918 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc80fe1a0 con 0x7efdc8102aa0 2024-04-26T21:15:34.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.702+0000 7efdbea00700 1 -- 172.21.15.120:0/50613918 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7efdb8013590 con 0x7efdc8102aa0 2024-04-26T21:15:34.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.703+0000 7efdbea00700 1 --2- 172.21.15.120:0/50613918 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efdac0369c0 0x7efdac038e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:34.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.703+0000 7efdbea00700 1 -- 172.21.15.120:0/50613918 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7efdb8049ab0 con 0x7efdc8102aa0 2024-04-26T21:15:34.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.703+0000 7efdc6000700 1 --2- 172.21.15.120:0/50613918 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efdac0369c0 0x7efdac038e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:34.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.704+0000 7efdc6000700 1 --2- 172.21.15.120:0/50613918 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efdac0369c0 0x7efdac038e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009990 tx=0x7efdb4006e40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:34.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:34.717+0000 7efdbea00700 1 -- 172.21.15.120:0/50613918 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7efdb80238f0 con 0x7efdc8102aa0 2024-04-26T21:15:34.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:34 smithi084 ceph-mon[25539]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:35.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:35.018+0000 7efdcdc00700 1 -- 172.21.15.120:0/50613918 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7efdc805f5c0 con 0x7efdc8102aa0 2024-04-26T21:15:35.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:35.019+0000 7efdbea00700 1 -- 172.21.15.120:0/50613918 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7efdb8011370 con 0x7efdc8102aa0 2024-04-26T21:15:35.021 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:15:35.021 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","modified":"2024-04-26T21:12:25.273724Z","created":"2024-04-26T21:12:25.273724Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T21:15:35.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:35.023+0000 7efdcdc00700 1 -- 172.21.15.120:0/50613918 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efdac0369c0 msgr2=0x7efdac038e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:35.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:35.023+0000 7efdcdc00700 1 --2- 172.21.15.120:0/50613918 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efdac0369c0 0x7efdac038e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009990 tx=0x7efdb4006e40 comp rx=0 tx=0).stop 2024-04-26T21:15:35.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:35.023+0000 7efdcdc00700 1 -- 172.21.15.120:0/50613918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc8102aa0 msgr2=0x7efdc81152f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:35.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:35.023+0000 7efdcdc00700 1 --2- 172.21.15.120:0/50613918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc8102aa0 0x7efdc81152f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efdb800b820 tx=0x7efdb8009e30 comp rx=0 tx=0).stop 2024-04-26T21:15:35.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:35.023+0000 7efdcdc00700 1 -- 172.21.15.120:0/50613918 shutdown_connections 2024-04-26T21:15:35.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:35.023+0000 7efdcdc00700 1 --2- 172.21.15.120:0/50613918 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efdac0369c0 0x7efdac038e70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:35.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:35.023+0000 7efdcdc00700 1 --2- 172.21.15.120:0/50613918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc8102aa0 0x7efdc81152f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:35.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:35.023+0000 7efdcdc00700 1 -- 172.21.15.120:0/50613918 >> 172.21.15.120:0/50613918 conn(0x7efdc80f85c0 msgr2=0x7efdc80fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:35.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:35.023+0000 7efdcdc00700 1 -- 172.21.15.120:0/50613918 shutdown_connections 2024-04-26T21:15:35.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:35.023+0000 7efdcdc00700 1 -- 172.21.15.120:0/50613918 wait complete. 2024-04-26T21:15:35.026 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-04-26T21:15:35.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:35 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/50613918' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:15:35.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:35 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:35.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:35 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:35.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:35 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:35.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:35 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:35.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:35 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.zjaduj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:15:35.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:35 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.zjaduj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T21:15:35.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:35 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:15:35.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:35 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:36.846 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T21:15:36.846 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T21:15:36.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:36 smithi084 ceph-mon[25539]: Deploying daemon mgr.smithi120.zjaduj on smithi120 2024-04-26T21:15:36.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:36 smithi084 ceph-mon[25539]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:37.557 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:15:37.814 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:37 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:38.847 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:38 smithi084 ceph-mon[25539]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:40.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.081+0000 7f33e3200700 1 -- 172.21.15.120:0/1293065051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33e41028c0 msgr2=0x7f33e4102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:40.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.081+0000 7f33e3200700 1 --2- 172.21.15.120:0/1293065051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33e41028c0 0x7f33e4102c90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f33d40048c0 tx=0x7f33d4009e30 comp rx=0 tx=0).stop 2024-04-26T21:15:40.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.081+0000 7f33e3200700 1 -- 172.21.15.120:0/1293065051 shutdown_connections 2024-04-26T21:15:40.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.081+0000 7f33e3200700 1 --2- 172.21.15.120:0/1293065051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33e41028c0 0x7f33e4102c90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:40.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.081+0000 7f33e3200700 1 -- 172.21.15.120:0/1293065051 >> 172.21.15.120:0/1293065051 conn(0x7f33e40f83e0 msgr2=0x7f33e40fa7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:40.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.081+0000 7f33e3200700 1 -- 172.21.15.120:0/1293065051 shutdown_connections 2024-04-26T21:15:40.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.081+0000 7f33e3200700 1 -- 172.21.15.120:0/1293065051 wait complete. 2024-04-26T21:15:40.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.082+0000 7f33e3200700 1 Processor -- start 2024-04-26T21:15:40.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.082+0000 7f33e3200700 1 -- start start 2024-04-26T21:15:40.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.083+0000 7f33e3200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33e41028c0 0x7f33e4070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:40.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.083+0000 7f33e3200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e4072210 con 0x7f33e41028c0 2024-04-26T21:15:40.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.083+0000 7f33e1e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33e41028c0 0x7f33e4070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:40.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.083+0000 7f33e1e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33e41028c0 0x7f33e4070280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.120:57266/0 (socket says 172.21.15.120:57266) 2024-04-26T21:15:40.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.083+0000 7f33e1e00700 1 -- 172.21.15.120:0/4227925936 learned_addr learned my addr 172.21.15.120:0/4227925936 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:15:40.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.084+0000 7f33e1e00700 1 -- 172.21.15.120:0/4227925936 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d4005040 con 0x7f33e41028c0 2024-04-26T21:15:40.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.084+0000 7f33e1e00700 1 --2- 172.21.15.120:0/4227925936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33e41028c0 0x7f33e4070280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f33d400b7f0 tx=0x7f33d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:40.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.084+0000 7f33da000700 1 -- 172.21.15.120:0/4227925936 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f33d4009370 con 0x7f33e41028c0 2024-04-26T21:15:40.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.084+0000 7f33e3200700 1 -- 172.21.15.120:0/4227925936 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e4070820 con 0x7f33e41028c0 2024-04-26T21:15:40.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.085+0000 7f33e3200700 1 -- 172.21.15.120:0/4227925936 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e4070d10 con 0x7f33e41028c0 2024-04-26T21:15:40.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.085+0000 7f33da000700 1 -- 172.21.15.120:0/4227925936 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f33d4013420 con 0x7f33e41028c0 2024-04-26T21:15:40.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.085+0000 7f33da000700 1 -- 172.21.15.120:0/4227925936 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f33d401c570 con 0x7f33e41028c0 2024-04-26T21:15:40.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.086+0000 7f33e3200700 1 -- 172.21.15.120:0/4227925936 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e4101b30 con 0x7f33e41028c0 2024-04-26T21:15:40.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.086+0000 7f33da000700 1 -- 172.21.15.120:0/4227925936 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f33d4013a50 con 0x7f33e41028c0 2024-04-26T21:15:40.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.088+0000 7f33da000700 1 --2- 172.21.15.120:0/4227925936 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f33c8036970 0x7f33c8038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:40.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.088+0000 7f33da000700 1 -- 172.21.15.120:0/4227925936 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f33d4049490 con 0x7f33e41028c0 2024-04-26T21:15:40.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.088+0000 7f33e1400700 1 --2- 172.21.15.120:0/4227925936 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f33c8036970 0x7f33c8038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:40.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.089+0000 7f33e1400700 1 --2- 172.21.15.120:0/4227925936 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f33c8036970 0x7f33c8038e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f33d0009990 tx=0x7f33d0006e40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:40.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.103+0000 7f33da000700 1 -- 172.21.15.120:0/4227925936 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f33d4024950 con 0x7f33e41028c0 2024-04-26T21:15:40.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.401+0000 7f33e3200700 1 -- 172.21.15.120:0/4227925936 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f33e404bed0 con 0x7f33e41028c0 2024-04-26T21:15:40.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.402+0000 7f33da000700 1 -- 172.21.15.120:0/4227925936 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f33d4021030 con 0x7f33e41028c0 2024-04-26T21:15:40.404 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:15:40.404 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","modified":"2024-04-26T21:12:25.273724Z","created":"2024-04-26T21:12:25.273724Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T21:15:40.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.406+0000 7f33e3200700 1 -- 172.21.15.120:0/4227925936 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f33c8036970 msgr2=0x7f33c8038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:40.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.406+0000 7f33e3200700 1 --2- 172.21.15.120:0/4227925936 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f33c8036970 0x7f33c8038e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f33d0009990 tx=0x7f33d0006e40 comp rx=0 tx=0).stop 2024-04-26T21:15:40.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.406+0000 7f33e3200700 1 -- 172.21.15.120:0/4227925936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33e41028c0 msgr2=0x7f33e4070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:40.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.406+0000 7f33e3200700 1 --2- 172.21.15.120:0/4227925936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33e41028c0 0x7f33e4070280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f33d400b7f0 tx=0x7f33d4009e30 comp rx=0 tx=0).stop 2024-04-26T21:15:40.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.406+0000 7f33e3200700 1 -- 172.21.15.120:0/4227925936 shutdown_connections 2024-04-26T21:15:40.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.406+0000 7f33e3200700 1 --2- 172.21.15.120:0/4227925936 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f33c8036970 0x7f33c8038e20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:40.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.406+0000 7f33e3200700 1 --2- 172.21.15.120:0/4227925936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33e41028c0 0x7f33e4070280 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:40.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.406+0000 7f33e3200700 1 -- 172.21.15.120:0/4227925936 >> 172.21.15.120:0/4227925936 conn(0x7f33e40f83e0 msgr2=0x7f33e40f9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:40.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.406+0000 7f33e3200700 1 -- 172.21.15.120:0/4227925936 shutdown_connections 2024-04-26T21:15:40.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:40.406+0000 7f33e3200700 1 -- 172.21.15.120:0/4227925936 wait complete. 2024-04-26T21:15:40.409 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-04-26T21:15:40.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:40 smithi084 ceph-mon[25539]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:40.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:40.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:40.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:40.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:40.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:15:40.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:40.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:40 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/4227925936' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:15:41.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:41 smithi084 ceph-mon[25539]: Deploying daemon mon.smithi120 on smithi120 2024-04-26T21:15:41.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:15:42.267 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T21:15:42.268 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T21:15:42.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:42 smithi084 ceph-mon[25539]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:42.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:42 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:43.393 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:15:44.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:44 smithi084 ceph-mon[25539]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:44.921 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:44 smithi120 systemd[1]: Starting Ceph mon.smithi120 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:15:45.553 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:45 smithi120 podman[32692]: 2024-04-26 21:15:45.398091334 +0000 UTC m=+0.036115808 image pull 1c583463371507dd553af71bf60c9ae8747aff79bb666e4e29ef4e17d0bc3a13 quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9 2024-04-26T21:15:45.553 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:45 smithi120 podman[32692]: 2024-04-26 21:15:45.551958286 +0000 UTC m=+0.189982797 container create 72c786fd622b7197634631df96ef1f979ee9930ea832c908f88d2bd9c93d06ba (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi120, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=quincy-2be3efa, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-26T21:15:46.275 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 podman[32692]: 2024-04-26 21:15:46.022963229 +0000 UTC m=+0.660987709 container init 72c786fd622b7197634631df96ef1f979ee9930ea832c908f88d2bd9c93d06ba (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi120, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=quincy-2be3efa, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-26T21:15:46.275 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 podman[32692]: 2024-04-26 21:15:46.030295481 +0000 UTC m=+0.668319956 container start 72c786fd622b7197634631df96ef1f979ee9930ea832c908f88d2bd9c93d06ba (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi120, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-2be3efa, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, ceph=True) 2024-04-26T21:15:46.275 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: set uid:gid to 167:167 (ceph:ceph) 2024-04-26T21:15:46.275 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable), process ceph-mon, pid 2 2024-04-26T21:15:46.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: pidfile_write: ignore empty --pid-file 2024-04-26T21:15:46.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: load: jerasure load: lrc 2024-04-26T21:15:46.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: RocksDB version: 6.15.5 2024-04-26T21:15:46.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-04-26T21:15:46.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Compile date Apr 26 2024 2024-04-26T21:15:46.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: DB SUMMARY 2024-04-26T21:15:46.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: DB Session ID: RENU7S4U7GSR6HYXMQ2Z 2024-04-26T21:15:46.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: CURRENT file: CURRENT 2024-04-26T21:15:46.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: IDENTITY file: IDENTITY 2024-04-26T21:15:46.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-04-26T21:15:46.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi120/store.db dir, Total Num: 0, files: 2024-04-26T21:15:46.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi120/store.db: 000004.log size: 511 ; 2024-04-26T21:15:46.276 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.error_if_exists: 0 2024-04-26T21:15:46.277 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.create_if_missing: 0 2024-04-26T21:15:46.277 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.paranoid_checks: 1 2024-04-26T21:15:46.277 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-26T21:15:46.277 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.env: 0x55f9c5b4cb00 2024-04-26T21:15:46.277 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.fs: Posix File System 2024-04-26T21:15:46.277 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.info_log: 0x55f9e8515620 2024-04-26T21:15:46.277 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_file_opening_threads: 16 2024-04-26T21:15:46.277 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.statistics: (nil) 2024-04-26T21:15:46.277 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.use_fsync: 0 2024-04-26T21:15:46.278 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_log_file_size: 0 2024-04-26T21:15:46.278 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-26T21:15:46.278 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-26T21:15:46.278 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.keep_log_file_num: 1000 2024-04-26T21:15:46.278 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.recycle_log_file_num: 0 2024-04-26T21:15:46.278 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.allow_fallocate: 1 2024-04-26T21:15:46.278 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.allow_mmap_reads: 0 2024-04-26T21:15:46.279 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.allow_mmap_writes: 0 2024-04-26T21:15:46.279 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.use_direct_reads: 0 2024-04-26T21:15:46.279 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-26T21:15:46.279 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.create_missing_column_families: 0 2024-04-26T21:15:46.279 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.db_log_dir: 2024-04-26T21:15:46.279 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi120/store.db 2024-04-26T21:15:46.279 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-26T21:15:46.279 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-26T21:15:46.279 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-26T21:15:46.279 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-26T21:15:46.279 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-26T21:15:46.279 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-26T21:15:46.280 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.advise_random_on_open: 1 2024-04-26T21:15:46.280 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.db_write_buffer_size: 0 2024-04-26T21:15:46.280 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.write_buffer_manager: 0x55f9e9208a20 2024-04-26T21:15:46.280 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-26T21:15:46.280 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-04-26T21:15:46.280 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-26T21:15:46.280 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-26T21:15:46.280 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.rate_limiter: (nil) 2024-04-26T21:15:46.280 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-26T21:15:46.280 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.wal_recovery_mode: 2 2024-04-26T21:15:46.280 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.enable_thread_tracking: 0 2024-04-26T21:15:46.280 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.enable_pipelined_write: 0 2024-04-26T21:15:46.280 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.unordered_write: 0 2024-04-26T21:15:46.281 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-26T21:15:46.281 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-26T21:15:46.281 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-26T21:15:46.281 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-26T21:15:46.281 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.row_cache: None 2024-04-26T21:15:46.281 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.wal_filter: None 2024-04-26T21:15:46.281 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-26T21:15:46.281 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.allow_ingest_behind: 0 2024-04-26T21:15:46.281 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.preserve_deletes: 0 2024-04-26T21:15:46.281 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.two_write_queues: 0 2024-04-26T21:15:46.281 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.manual_wal_flush: 0 2024-04-26T21:15:46.281 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.atomic_flush: 0 2024-04-26T21:15:46.281 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-26T21:15:46.282 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-26T21:15:46.282 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-26T21:15:46.282 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.log_readahead_size: 0 2024-04-26T21:15:46.282 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-26T21:15:46.282 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.best_efforts_recovery: 0 2024-04-26T21:15:46.282 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-26T21:15:46.282 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-26T21:15:46.282 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.allow_data_in_errors: 0 2024-04-26T21:15:46.282 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.db_host_id: __hostname__ 2024-04-26T21:15:46.282 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_background_jobs: 2 2024-04-26T21:15:46.282 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_background_compactions: -1 2024-04-26T21:15:46.282 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_subcompactions: 1 2024-04-26T21:15:46.282 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-26T21:15:46.283 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-26T21:15:46.283 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-26T21:15:46.283 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_total_wal_size: 0 2024-04-26T21:15:46.283 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-26T21:15:46.283 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-26T21:15:46.283 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-26T21:15:46.283 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-26T21:15:46.283 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_open_files: -1 2024-04-26T21:15:46.283 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.bytes_per_sync: 0 2024-04-26T21:15:46.283 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-26T21:15:46.283 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-26T21:15:46.283 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compaction_readahead_size: 0 2024-04-26T21:15:46.283 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_background_flushes: -1 2024-04-26T21:15:46.283 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Compression algorithms supported: 2024-04-26T21:15:46.284 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-26T21:15:46.284 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: kZSTD supported: 0 2024-04-26T21:15:46.284 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: kXpressCompression supported: 0 2024-04-26T21:15:46.284 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: kLZ4HCCompression supported: 1 2024-04-26T21:15:46.284 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: kZlibCompression supported: 1 2024-04-26T21:15:46.284 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: kSnappyCompression supported: 1 2024-04-26T21:15:46.284 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: kLZ4Compression supported: 1 2024-04-26T21:15:46.284 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: kBZip2Compression supported: 0 2024-04-26T21:15:46.284 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-26T21:15:46.284 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi120/store.db/MANIFEST-000003 2024-04-26T21:15:46.284 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-04-26T21:15:46.284 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-26T21:15:46.284 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.merge_operator: 2024-04-26T21:15:46.284 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compaction_filter: None 2024-04-26T21:15:46.284 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compaction_filter_factory: None 2024-04-26T21:15:46.285 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.sst_partitioner_factory: None 2024-04-26T21:15:46.285 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-26T21:15:46.285 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-26T21:15:46.285 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f9e84e8f58) 2024-04-26T21:15:46.285 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: cache_index_and_filter_blocks: 1 2024-04-26T21:15:46.285 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-26T21:15:46.285 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-26T21:15:46.285 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: pin_top_level_index_and_filter: 1 2024-04-26T21:15:46.285 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: index_type: 0 2024-04-26T21:15:46.285 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: data_block_index_type: 0 2024-04-26T21:15:46.285 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: index_shortening: 1 2024-04-26T21:15:46.285 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-26T21:15:46.285 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: hash_index_allow_collision: 1 2024-04-26T21:15:46.285 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: checksum: 1 2024-04-26T21:15:46.285 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: no_block_cache: 0 2024-04-26T21:15:46.286 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_cache: 0x55f9e851b090 2024-04-26T21:15:46.286 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_cache_name: BinnedLRUCache 2024-04-26T21:15:46.286 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_cache_options: 2024-04-26T21:15:46.286 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: capacity : 536870912 2024-04-26T21:15:46.286 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: num_shard_bits : 4 2024-04-26T21:15:46.286 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: strict_capacity_limit : 0 2024-04-26T21:15:46.286 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: high_pri_pool_ratio: 0.000 2024-04-26T21:15:46.286 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_cache_compressed: (nil) 2024-04-26T21:15:46.286 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: persistent_cache: (nil) 2024-04-26T21:15:46.286 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_size: 4096 2024-04-26T21:15:46.286 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_size_deviation: 10 2024-04-26T21:15:46.286 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_restart_interval: 16 2024-04-26T21:15:46.286 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: index_block_restart_interval: 1 2024-04-26T21:15:46.286 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: metadata_block_size: 4096 2024-04-26T21:15:46.287 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: partition_filters: 0 2024-04-26T21:15:46.287 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: use_delta_encoding: 1 2024-04-26T21:15:46.287 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-04-26T21:15:46.287 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: whole_key_filtering: 1 2024-04-26T21:15:46.287 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: verify_compression: 0 2024-04-26T21:15:46.287 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: read_amp_bytes_per_bit: 0 2024-04-26T21:15:46.287 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: format_version: 4 2024-04-26T21:15:46.287 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: enable_index_compression: 1 2024-04-26T21:15:46.287 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_align: 0 2024-04-26T21:15:46.287 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.write_buffer_size: 33554432 2024-04-26T21:15:46.287 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_write_buffer_number: 2 2024-04-26T21:15:46.287 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compression: NoCompression 2024-04-26T21:15:46.287 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.bottommost_compression: Disabled 2024-04-26T21:15:46.287 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.prefix_extractor: nullptr 2024-04-26T21:15:46.289 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-26T21:15:46.289 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.num_levels: 7 2024-04-26T21:15:46.289 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-26T21:15:46.289 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-26T21:15:46.289 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-26T21:15:46.289 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-26T21:15:46.289 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-26T21:15:46.290 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-26T21:15:46.290 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-26T21:15:46.290 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-26T21:15:46.290 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-26T21:15:46.290 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-26T21:15:46.290 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-26T21:15:46.290 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compression_opts.level: 32767 2024-04-26T21:15:46.290 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compression_opts.strategy: 0 2024-04-26T21:15:46.290 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-26T21:15:46.290 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-26T21:15:46.290 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-26T21:15:46.290 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compression_opts.enabled: false 2024-04-26T21:15:46.290 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-26T21:15:46.290 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-26T21:15:46.291 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-26T21:15:46.291 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.target_file_size_base: 67108864 2024-04-26T21:15:46.291 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-26T21:15:46.291 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-26T21:15:46.291 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-26T21:15:46.291 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-26T21:15:46.291 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-26T21:15:46.291 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-26T21:15:46.291 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-26T21:15:46.291 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-26T21:15:46.291 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-26T21:15:46.291 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-26T21:15:46.291 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-26T21:15:46.291 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-26T21:15:46.291 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-26T21:15:46.292 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.arena_block_size: 4194304 2024-04-26T21:15:46.292 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-26T21:15:46.292 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-26T21:15:46.292 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-04-26T21:15:46.292 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.disable_auto_compactions: 0 2024-04-26T21:15:46.292 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-26T21:15:46.292 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-26T21:15:46.292 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-26T21:15:46.292 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-26T21:15:46.292 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-26T21:15:46.292 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-26T21:15:46.292 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-26T21:15:46.292 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-26T21:15:46.292 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-26T21:15:46.293 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-26T21:15:46.293 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.table_properties_collectors: 2024-04-26T21:15:46.293 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.inplace_update_support: 0 2024-04-26T21:15:46.293 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-26T21:15:46.293 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-26T21:15:46.293 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-26T21:15:46.293 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-26T21:15:46.293 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.bloom_locality: 0 2024-04-26T21:15:46.293 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.max_successive_merges: 0 2024-04-26T21:15:46.293 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-26T21:15:46.293 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.paranoid_file_checks: 0 2024-04-26T21:15:46.293 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.force_consistency_checks: 1 2024-04-26T21:15:46.293 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.report_bg_io_stats: 0 2024-04-26T21:15:46.293 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.ttl: 2592000 2024-04-26T21:15:46.293 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-26T21:15:46.294 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.enable_blob_files: false 2024-04-26T21:15:46.294 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.min_blob_size: 0 2024-04-26T21:15:46.294 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.blob_file_size: 268435456 2024-04-26T21:15:46.294 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-26T21:15:46.294 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-26T21:15:46.294 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-26T21:15:46.294 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi120/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-26T21:15:46.294 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2024-04-26T21:15:46.294 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2024-04-26T21:15:46.294 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714166146074328, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-26T21:15:46.294 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2024-04-26T21:15:46.294 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-04-26T21:15:46.294 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714166146075134, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1714166146, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "0db40225-7687-4c60-8e91-8c774fd84657", "db_session_id": "RENU7S4U7GSR6HYXMQ2Z"}} 2024-04-26T21:15:46.295 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2024-04-26T21:15:46.295 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714166146075925, "job": 1, "event": "recovery_finished"} 2024-04-26T21:15:46.295 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi120/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-26T21:15:46.295 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55f9e84af180 2024-04-26T21:15:46.295 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: DB pointer 0x55f9e8584000 2024-04-26T21:15:46.295 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-04-26T21:15:46.295 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-04-26T21:15:46.295 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** DB Stats ** 2024-04-26T21:15:46.295 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T21:15:46.295 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-26T21:15:46.295 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T21:15:46.295 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T21:15:46.295 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-26T21:15:46.295 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-04-26T21:15:46.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T21:15:46.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-04-26T21:15:46.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** Compaction Stats [default] ** 2024-04-26T21:15:46.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-26T21:15:46.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T21:15:46.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2024-04-26T21:15:46.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2024-04-26T21:15:46.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2024-04-26T21:15:46.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-04-26T21:15:46.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** Compaction Stats [default] ** 2024-04-26T21:15:46.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-26T21:15:46.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T21:15:46.296 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2024-04-26T21:15:46.297 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T21:15:46.297 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-26T21:15:46.297 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-26T21:15:46.297 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-26T21:15:46.297 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-26T21:15:46.297 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-26T21:15:46.297 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Cumulative compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T21:15:46.297 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Interval compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T21:15:46.297 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-26T21:15:46.297 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-04-26T21:15:46.297 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-26T21:15:46.297 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-04-26T21:15:46.297 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** Compaction Stats [default] ** 2024-04-26T21:15:46.297 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-26T21:15:46.298 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T21:15:46.298 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2024-04-26T21:15:46.298 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2024-04-26T21:15:46.298 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-26T21:15:46.298 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-04-26T21:15:46.298 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** Compaction Stats [default] ** 2024-04-26T21:15:46.298 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-26T21:15:46.298 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T21:15:46.298 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2024-04-26T21:15:46.298 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T21:15:46.298 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-26T21:15:46.298 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-26T21:15:46.298 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-26T21:15:46.299 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-26T21:15:46.299 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-26T21:15:46.299 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Cumulative compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T21:15:46.299 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T21:15:46.299 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-26T21:15:46.299 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-04-26T21:15:46.299 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-26T21:15:46.299 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: mon.smithi120 does not exist in monmap, will attempt to join an existing cluster 2024-04-26T21:15:46.299 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: using public_addr v2:172.21.15.120:0/0 -> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-04-26T21:15:46.299 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: starting mon.smithi120 rank -1 at public addrs [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] at bind addrs [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi120 fsid 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:15:46.299 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: mon.smithi120@-1(???) e0 preinit fsid 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:15:46.299 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: mon.smithi120@-1(synchronizing).mds e1 new map 2024-04-26T21:15:46.299 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: mon.smithi120@-1(synchronizing).mds e1 print_map 2024-04-26T21:15:46.299 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: e1 2024-04-26T21:15:46.299 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:15:46.300 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:15:46.300 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: legacy client fscid: -1 2024-04-26T21:15:46.300 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-04-26T21:15:46.300 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: No filesystems configured 2024-04-26T21:15:46.300 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: mon.smithi120@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-26T21:15:46.300 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: mon.smithi120@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-26T21:15:46.300 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: mon.smithi120@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-26T21:15:46.300 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: mon.smithi120@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-26T21:15:46.300 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: mon.smithi120@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-26T21:15:46.300 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: mon.smithi120@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-26T21:15:46.300 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: mon.smithi120@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-04-26T21:15:46.301 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: mon.smithi120@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-26T21:15:46.301 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: mon.smithi120@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T21:15:46.301 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: mon.smithi120@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T21:15:46.301 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: mon.smithi120@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T21:15:46.301 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.301 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.301 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.301 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.301 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd/host:smithi120", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:15:46.301 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:46.301 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:15:46.301 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: Updating smithi084:/etc/ceph/ceph.conf 2024-04-26T21:15:46.301 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: Updating smithi120:/etc/ceph/ceph.conf 2024-04-26T21:15:46.301 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: Updating smithi120:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:15:46.301 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: Updating smithi084:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:15:46.302 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:15:46.302 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='client.? 172.21.15.120:0/3882469331' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:15:46.302 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:15:46.302 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: Updating smithi120:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:15:46.302 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: Updating smithi084:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:15:46.302 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.302 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.302 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.302 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.302 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.302 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi120", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:15:46.302 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi120", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-26T21:15:46.302 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:46.303 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: Deploying daemon crash.smithi120 on smithi120 2024-04-26T21:15:46.303 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:15:46.303 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='client.? 172.21.15.120:0/2307430951' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:15:46.303 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.303 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.303 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.303 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.303 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: Deploying daemon node-exporter.smithi120 on smithi120 2024-04-26T21:15:46.303 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:46.303 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.303 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:46.303 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='client.? 172.21.15.120:0/50613918' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:15:46.303 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.303 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.303 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.303 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.304 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.zjaduj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:15:46.304 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.zjaduj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T21:15:46.304 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:15:46.304 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:46.304 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: Deploying daemon mgr.smithi120.zjaduj on smithi120 2024-04-26T21:15:46.304 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:46.304 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.304 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:46.304 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:46.304 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.304 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.304 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.304 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.304 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:15:46.304 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:46.304 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='client.? 172.21.15.120:0/4227925936' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:15:46.305 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: Deploying daemon mon.smithi120 on smithi120 2024-04-26T21:15:46.305 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:15:46.305 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:46.305 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:46.305 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:46.305 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 ceph-mon[32741]: mon.smithi120@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-04-26T21:15:46.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 bash[32692]: 72c786fd622b7197634631df96ef1f979ee9930ea832c908f88d2bd9c93d06ba 2024-04-26T21:15:46.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:46 smithi120 systemd[1]: Started Ceph mon.smithi120 for 8bb44d26-0411-11ef-bc93-c7b262605968. 2024-04-26T21:15:51.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-04-26T21:15:51.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:15:51.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: mon.smithi084 calling monitor election 2024-04-26T21:15:51.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:15:51.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:51.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:15:51.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: mon.smithi120 calling monitor election 2024-04-26T21:15:51.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.120:0/3720495914' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.zjaduj/crt"}]: dispatch 2024-04-26T21:15:51.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:15:51.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:51.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:15:51.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:15:51.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: mon.smithi084 is new leader, mons smithi084,smithi120 in quorum (ranks 0,1) 2024-04-26T21:15:51.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: monmap e2: 2 mons at {smithi084=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],smithi120=[v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-26T21:15:51.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: fsmap 2024-04-26T21:15:51.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: osdmap e5: 0 total, 0 up, 0 in 2024-04-26T21:15:51.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: mgrmap e17: smithi084.gyasul(active, since 39s) 2024-04-26T21:15:51.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: overall HEALTH_OK 2024-04-26T21:15:51.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: Standby manager daemon smithi120.zjaduj started 2024-04-26T21:15:51.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.120:0/3720495914' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:15:51.666 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:51.666 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.120:0/3720495914' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.zjaduj/key"}]: dispatch 2024-04-26T21:15:51.666 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.120:0/3720495914' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:15:51.666 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:51 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:51.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-04-26T21:15:51.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:15:51.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: mon.smithi084 calling monitor election 2024-04-26T21:15:51.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:15:51.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:51.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:15:51.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: mon.smithi120 calling monitor election 2024-04-26T21:15:51.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.120:0/3720495914' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.zjaduj/crt"}]: dispatch 2024-04-26T21:15:51.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:15:51.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:51.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:15:51.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:15:51.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: mon.smithi084 is new leader, mons smithi084,smithi120 in quorum (ranks 0,1) 2024-04-26T21:15:51.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: monmap e2: 2 mons at {smithi084=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],smithi120=[v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-26T21:15:51.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: fsmap 2024-04-26T21:15:51.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: osdmap e5: 0 total, 0 up, 0 in 2024-04-26T21:15:51.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: mgrmap e17: smithi084.gyasul(active, since 39s) 2024-04-26T21:15:51.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: overall HEALTH_OK 2024-04-26T21:15:51.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: Standby manager daemon smithi120.zjaduj started 2024-04-26T21:15:51.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.120:0/3720495914' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:15:51.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:51.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.120:0/3720495914' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.zjaduj/key"}]: dispatch 2024-04-26T21:15:51.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.120:0/3720495914' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:15:51.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:51 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:52.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.293+0000 7f1356a00700 1 -- 172.21.15.120:0/2345460187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13340061d0 msgr2=0x7f1334008650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:52.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.293+0000 7f1356a00700 1 --2- 172.21.15.120:0/2345460187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13340061d0 0x7f1334008650 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f13500ffd30 tx=0x7f1340002040 comp rx=0 tx=0).stop 2024-04-26T21:15:52.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.293+0000 7f1356a00700 1 -- 172.21.15.120:0/2345460187 shutdown_connections 2024-04-26T21:15:52.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.293+0000 7f1356a00700 1 --2- 172.21.15.120:0/2345460187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13340061d0 0x7f1334008650 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:52.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.293+0000 7f1356a00700 1 -- 172.21.15.120:0/2345460187 >> 172.21.15.120:0/2345460187 conn(0x7f13500faab0 msgr2=0x7f13500fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:52.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.293+0000 7f1356a00700 1 -- 172.21.15.120:0/2345460187 shutdown_connections 2024-04-26T21:15:52.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.293+0000 7f1356a00700 1 -- 172.21.15.120:0/2345460187 wait complete. 2024-04-26T21:15:52.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.294+0000 7f1356a00700 1 Processor -- start 2024-04-26T21:15:52.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.295+0000 7f1356a00700 1 -- start start 2024-04-26T21:15:52.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.295+0000 7f1356a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13340061d0 0x7f13501153c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:52.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.295+0000 7f1356a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350115900 0x7f135010f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:52.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.295+0000 7f1356a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1350115f10 con 0x7f1350115900 2024-04-26T21:15:52.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.295+0000 7f1356a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1350116080 con 0x7f13340061d0 2024-04-26T21:15:52.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.296+0000 7f134f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350115900 0x7f135010f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:52.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.296+0000 7f134f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350115900 0x7f135010f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.120:46884/0 (socket says 172.21.15.120:46884) 2024-04-26T21:15:52.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.296+0000 7f134f400700 1 -- 172.21.15.120:0/1680507405 learned_addr learned my addr 172.21.15.120:0/1680507405 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:15:52.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.296+0000 7f134fe00700 1 --2- 172.21.15.120:0/1680507405 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13340061d0 0x7f13501153c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:52.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.296+0000 7f134fe00700 1 -- 172.21.15.120:0/1680507405 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13340061d0 msgr2=0x7f13501153c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-26T21:15:52.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.296+0000 7f134fe00700 1 -- 172.21.15.120:0/1680507405 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13340061d0 msgr2=0x7f13501153c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T21:15:52.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.296+0000 7f134fe00700 1 --2- 172.21.15.120:0/1680507405 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13340061d0 0x7f13501153c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-26T21:15:52.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.297+0000 7f134fe00700 1 --2- 172.21.15.120:0/1680507405 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13340061d0 0x7f13501153c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T21:15:52.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.297+0000 7f134f400700 1 -- 172.21.15.120:0/1680507405 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13340061d0 msgr2=0x7f13501153c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T21:15:52.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.297+0000 7f134f400700 1 --2- 172.21.15.120:0/1680507405 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13340061d0 0x7f13501153c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:52.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.297+0000 7f134f400700 1 -- 172.21.15.120:0/1680507405 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1340005040 con 0x7f1350115900 2024-04-26T21:15:52.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.297+0000 7f134f400700 1 --2- 172.21.15.120:0/1680507405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350115900 0x7f135010f360 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f133c00b790 tx=0x7f133c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:52.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.298+0000 7f1347e00700 1 -- 172.21.15.120:0/1680507405 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f133c010870 con 0x7f1350115900 2024-04-26T21:15:52.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.298+0000 7f1347e00700 1 -- 172.21.15.120:0/1680507405 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f133c00f3e0 con 0x7f1350115900 2024-04-26T21:15:52.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.298+0000 7f1347e00700 1 -- 172.21.15.120:0/1680507405 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f133c010ea0 con 0x7f1350115900 2024-04-26T21:15:52.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.298+0000 7f1356a00700 1 -- 172.21.15.120:0/1680507405 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135010f9c0 con 0x7f1350115900 2024-04-26T21:15:52.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.298+0000 7f1356a00700 1 -- 172.21.15.120:0/1680507405 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135010ff80 con 0x7f1350115900 2024-04-26T21:15:52.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.299+0000 7f1356a00700 1 -- 172.21.15.120:0/1680507405 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13501003b0 con 0x7f1350115900 2024-04-26T21:15:52.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.301+0000 7f1347e00700 1 -- 172.21.15.120:0/1680507405 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f133c00f550 con 0x7f1350115900 2024-04-26T21:15:52.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.302+0000 7f1347e00700 1 --2- 172.21.15.120:0/1680507405 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f1330069320 0x7f133006b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:52.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.302+0000 7f1347e00700 1 -- 172.21.15.120:0/1680507405 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f133c086b50 con 0x7f1350115900 2024-04-26T21:15:52.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.303+0000 7f134fe00700 1 --2- 172.21.15.120:0/1680507405 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f1330069320 0x7f133006b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:52.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.304+0000 7f134fe00700 1 --2- 172.21.15.120:0/1680507405 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f1330069320 0x7f133006b7d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1340004f50 tx=0x7f1340002040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:52.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.315+0000 7f1347e00700 1 -- 172.21.15.120:0/1680507405 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f133c053f00 con 0x7f1350115900 2024-04-26T21:15:52.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.613+0000 7f1356a00700 1 -- 172.21.15.120:0/1680507405 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f135005f5c0 con 0x7f1350115900 2024-04-26T21:15:52.614 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:52 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:52.614 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:52 smithi120 ceph-mon[32741]: mgrmap e18: smithi084.gyasul(active, since 39s), standbys: smithi120.zjaduj 2024-04-26T21:15:52.614 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:52 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr metadata", "who": "smithi120.zjaduj", "id": "smithi120.zjaduj"}]: dispatch 2024-04-26T21:15:52.614 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:52 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:52.614 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:52 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:52.614 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:52 smithi120 ceph-mon[32741]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:52.615 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:52 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:52.615 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:52 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:15:52.615 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:52 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:15:52.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.614+0000 7f1347e00700 1 -- 172.21.15.120:0/1680507405 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7f133c057520 con 0x7f1350115900 2024-04-26T21:15:52.615 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T21:15:52.615 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":2,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","modified":"2024-04-26T21:15:46.135185Z","created":"2024-04-26T21:12:25.273724Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi120","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:3300","nonce":0},{"type":"v1","addr":"172.21.15.120:6789","nonce":0}]},"addr":"172.21.15.120:6789/0","public_addr":"172.21.15.120:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-26T21:15:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.617+0000 7f1356a00700 1 -- 172.21.15.120:0/1680507405 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f1330069320 msgr2=0x7f133006b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.617+0000 7f1356a00700 1 --2- 172.21.15.120:0/1680507405 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f1330069320 0x7f133006b7d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1340004f50 tx=0x7f1340002040 comp rx=0 tx=0).stop 2024-04-26T21:15:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.617+0000 7f1356a00700 1 -- 172.21.15.120:0/1680507405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350115900 msgr2=0x7f135010f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.617+0000 7f1356a00700 1 --2- 172.21.15.120:0/1680507405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350115900 0x7f135010f360 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f133c00b790 tx=0x7f133c009250 comp rx=0 tx=0).stop 2024-04-26T21:15:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.617+0000 7f1356a00700 1 -- 172.21.15.120:0/1680507405 shutdown_connections 2024-04-26T21:15:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.617+0000 7f1356a00700 1 --2- 172.21.15.120:0/1680507405 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f1330069320 0x7f133006b7d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.617+0000 7f1356a00700 1 --2- 172.21.15.120:0/1680507405 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13340061d0 0x7f13501153c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.617+0000 7f1356a00700 1 --2- 172.21.15.120:0/1680507405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350115900 0x7f135010f360 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.617+0000 7f1356a00700 1 -- 172.21.15.120:0/1680507405 >> 172.21.15.120:0/1680507405 conn(0x7f13500faab0 msgr2=0x7f1350108200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.617+0000 7f1356a00700 1 -- 172.21.15.120:0/1680507405 shutdown_connections 2024-04-26T21:15:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:15:52.617+0000 7f1356a00700 1 -- 172.21.15.120:0/1680507405 wait complete. 2024-04-26T21:15:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 2 2024-04-26T21:15:52.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:52 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:52.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:52 smithi084 ceph-mon[25539]: mgrmap e18: smithi084.gyasul(active, since 39s), standbys: smithi120.zjaduj 2024-04-26T21:15:52.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:52 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr metadata", "who": "smithi120.zjaduj", "id": "smithi120.zjaduj"}]: dispatch 2024-04-26T21:15:52.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:52 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:52.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:52 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:52.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:52 smithi084 ceph-mon[25539]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:52.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:52 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:52.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:52 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:15:52.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:52 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:15:53.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:53 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/1680507405' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:15:53.536 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:53 smithi120 ceph-mon[32741]: from='client.? 172.21.15.120:0/1680507405' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T21:15:53.923 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-26T21:15:53.923 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-26T21:15:54.394 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:15:54.541 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:54 smithi084 ceph-mon[25539]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:54.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:54 smithi120 ceph-mon[32741]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:56.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:55 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:56.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:55 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:56.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:55 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:56.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:55 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:15:56.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:55 smithi084 ceph-mon[25539]: Updating smithi084:/etc/ceph/ceph.conf 2024-04-26T21:15:56.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:55 smithi084 ceph-mon[25539]: Updating smithi120:/etc/ceph/ceph.conf 2024-04-26T21:15:56.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:55 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:56.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:55 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:56.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:55 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:56.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:55 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:15:56.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:55 smithi120 ceph-mon[32741]: Updating smithi084:/etc/ceph/ceph.conf 2024-04-26T21:15:56.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:55 smithi120 ceph-mon[32741]: Updating smithi120:/etc/ceph/ceph.conf 2024-04-26T21:15:56.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.344+0000 7f241d400700 1 -- 172.21.15.84:0/370083464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2418070280 msgr2=0x7f2418070650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.344+0000 7f241d400700 1 --2- 172.21.15.84:0/370083464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2418070280 0x7f2418070650 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f24080048c0 tx=0x7f2408009e30 comp rx=0 tx=0).stop 2024-04-26T21:15:56.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.344+0000 7f241d400700 1 -- 172.21.15.84:0/370083464 shutdown_connections 2024-04-26T21:15:56.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.344+0000 7f241d400700 1 --2- 172.21.15.84:0/370083464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2418070280 0x7f2418070650 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.344+0000 7f241d400700 1 -- 172.21.15.84:0/370083464 >> 172.21.15.84:0/370083464 conn(0x7f24180f85b0 msgr2=0x7f24180fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:56.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.344+0000 7f241d400700 1 -- 172.21.15.84:0/370083464 shutdown_connections 2024-04-26T21:15:56.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.344+0000 7f241d400700 1 -- 172.21.15.84:0/370083464 wait complete. 2024-04-26T21:15:56.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.345+0000 7f241d400700 1 Processor -- start 2024-04-26T21:15:56.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.345+0000 7f241d400700 1 -- start start 2024-04-26T21:15:56.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.346+0000 7f241d400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2418070280 0x7f24181154a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.346+0000 7f241d400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24181159e0 0x7f241810f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.346+0000 7f241d400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2418115fa0 con 0x7f24181159e0 2024-04-26T21:15:56.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.346+0000 7f241d400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241810f960 con 0x7f2418070280 2024-04-26T21:15:56.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.346+0000 7f240fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24181159e0 0x7f241810f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.346+0000 7f240fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24181159e0 0x7f241810f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43072/0 (socket says 172.21.15.84:43072) 2024-04-26T21:15:56.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.346+0000 7f240fe00700 1 -- 172.21.15.84:0/2283569253 learned_addr learned my addr 172.21.15.84:0/2283569253 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:15:56.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.346+0000 7f2416800700 1 --2- 172.21.15.84:0/2283569253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2418070280 0x7f24181154a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.346+0000 7f240fe00700 1 -- 172.21.15.84:0/2283569253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2418070280 msgr2=0x7f24181154a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.346+0000 7f240fe00700 1 --2- 172.21.15.84:0/2283569253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2418070280 0x7f24181154a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.346+0000 7f240fe00700 1 -- 172.21.15.84:0/2283569253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2408005040 con 0x7f24181159e0 2024-04-26T21:15:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.346+0000 7f2416800700 1 --2- 172.21.15.84:0/2283569253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2418070280 0x7f24181154a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:15:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.347+0000 7f240fe00700 1 --2- 172.21.15.84:0/2283569253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24181159e0 0x7f241810f420 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f240000b790 tx=0x7f2400009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.347+0000 7f240ea00700 1 -- 172.21.15.84:0/2283569253 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2400010870 con 0x7f24181159e0 2024-04-26T21:15:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.347+0000 7f240ea00700 1 -- 172.21.15.84:0/2283569253 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f240000f3e0 con 0x7f24181159e0 2024-04-26T21:15:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.347+0000 7f241d400700 1 -- 172.21.15.84:0/2283569253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241810fc40 con 0x7f24181159e0 2024-04-26T21:15:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.347+0000 7f240ea00700 1 -- 172.21.15.84:0/2283569253 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2400010ea0 con 0x7f24181159e0 2024-04-26T21:15:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.347+0000 7f241d400700 1 -- 172.21.15.84:0/2283569253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2418110180 con 0x7f24181159e0 2024-04-26T21:15:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.349+0000 7f241d400700 1 -- 172.21.15.84:0/2283569253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24180719c0 con 0x7f24181159e0 2024-04-26T21:15:56.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.349+0000 7f240ea00700 1 -- 172.21.15.84:0/2283569253 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f240000f550 con 0x7f24181159e0 2024-04-26T21:15:56.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.351+0000 7f240ea00700 1 --2- 172.21.15.84:0/2283569253 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f23fc069360 0x7f23fc06b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.351+0000 7f240ea00700 1 -- 172.21.15.84:0/2283569253 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f2400086780 con 0x7f24181159e0 2024-04-26T21:15:56.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.351+0000 7f2416800700 1 --2- 172.21.15.84:0/2283569253 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f23fc069360 0x7f23fc06b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.352+0000 7f2416800700 1 --2- 172.21.15.84:0/2283569253 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f23fc069360 0x7f23fc06b810 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2408004e30 tx=0x7f2408009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:56.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.356+0000 7f240ea00700 1 -- 172.21.15.84:0/2283569253 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2400057500 con 0x7f24181159e0 2024-04-26T21:15:56.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.604+0000 7f241d400700 1 -- 172.21.15.84:0/2283569253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f241804bed0 con 0x7f24181159e0 2024-04-26T21:15:56.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.605+0000 7f240ea00700 1 -- 172.21.15.84:0/2283569253 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f2400014100 con 0x7f24181159e0 2024-04-26T21:15:56.607 INFO:teuthology.orchestra.run.smithi084.stdout:# minimal ceph.conf for 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:15:56.607 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2024-04-26T21:15:56.607 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:15:56.607 INFO:teuthology.orchestra.run.smithi084.stdout: mon_host = [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-04-26T21:15:56.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.608+0000 7f241d400700 1 -- 172.21.15.84:0/2283569253 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f23fc069360 msgr2=0x7f23fc06b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.608+0000 7f241d400700 1 --2- 172.21.15.84:0/2283569253 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f23fc069360 0x7f23fc06b810 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2408004e30 tx=0x7f2408009e30 comp rx=0 tx=0).stop 2024-04-26T21:15:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.608+0000 7f241d400700 1 -- 172.21.15.84:0/2283569253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24181159e0 msgr2=0x7f241810f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.608+0000 7f241d400700 1 --2- 172.21.15.84:0/2283569253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24181159e0 0x7f241810f420 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f240000b790 tx=0x7f2400009250 comp rx=0 tx=0).stop 2024-04-26T21:15:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.608+0000 7f241d400700 1 -- 172.21.15.84:0/2283569253 shutdown_connections 2024-04-26T21:15:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.608+0000 7f241d400700 1 --2- 172.21.15.84:0/2283569253 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f23fc069360 0x7f23fc06b810 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.608+0000 7f241d400700 1 --2- 172.21.15.84:0/2283569253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2418070280 0x7f24181154a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.608+0000 7f241d400700 1 --2- 172.21.15.84:0/2283569253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24181159e0 0x7f241810f420 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.608+0000 7f241d400700 1 -- 172.21.15.84:0/2283569253 >> 172.21.15.84:0/2283569253 conn(0x7f24180f85b0 msgr2=0x7f2418102d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:56.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.608+0000 7f241d400700 1 -- 172.21.15.84:0/2283569253 shutdown_connections 2024-04-26T21:15:56.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:15:56.609+0000 7f241d400700 1 -- 172.21.15.84:0/2283569253 wait complete. 2024-04-26T21:15:57.283 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:57 smithi084 ceph-mon[25539]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:57.283 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:57 smithi084 ceph-mon[25539]: Updating smithi120:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:15:57.283 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:57 smithi084 ceph-mon[25539]: Updating smithi084:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:15:57.283 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:57 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:57.283 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:57 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:57.283 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:57 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:57.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:57 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:57.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:57 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:57.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:57 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:15:57.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:57 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T21:15:57.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:57 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:57.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:57 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:15:57.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:57 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2283569253' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:57.340 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-26T21:15:57.340 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-26T21:15:57.341 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.conf 2024-04-26T21:15:57.418 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-26T21:15:57.418 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:15:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:57 smithi120 ceph-mon[32741]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:57.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:57 smithi120 ceph-mon[32741]: Updating smithi120:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:15:57.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:57 smithi120 ceph-mon[32741]: Updating smithi084:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:15:57.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:57 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:57.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:57 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:57.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:57 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:57.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:57 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:57.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:57 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:57.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:57 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:15:57.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:57 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T21:15:57.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:57 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:57.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:57 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:15:57.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:57 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2283569253' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:57.531 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T21:15:57.532 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.conf 2024-04-26T21:15:57.625 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T21:15:57.625 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:15:57.755 INFO:tasks.cephadm:Deploying OSDs... 2024-04-26T21:15:57.755 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-26T21:15:57.755 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T21:15:57.807 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T21:15:57.807 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2024-04-26T21:15:57.846 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T21:15:57.847 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:15:57.847 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-04-26T21:15:57.847 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:15:57.847 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:15:57.847 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-04-26 21:15:00.944319953 +0000 2024-04-26T21:15:57.847 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-04-26 21:07:42.239867976 +0000 2024-04-26T21:15:57.847 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-04-26 21:07:42.239867976 +0000 2024-04-26T21:15:57.847 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-04-26 21:07:42.239867976 +0000 2024-04-26T21:15:57.847 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T21:15:57.958 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-04-26T21:15:57.958 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-04-26T21:15:57.958 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000369135 s, 1.4 MB/s 2024-04-26T21:15:57.961 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T21:15:58.013 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2024-04-26T21:15:58.061 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T21:15:58.061 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:15:58.061 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-04-26T21:15:58.061 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:15:58.061 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:15:58.061 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-04-26 21:15:00.945319937 +0000 2024-04-26T21:15:58.061 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-04-26 21:07:42.799858491 +0000 2024-04-26T21:15:58.061 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-04-26 21:07:42.799858491 +0000 2024-04-26T21:15:58.061 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-04-26 21:07:42.799858491 +0000 2024-04-26T21:15:58.062 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T21:15:58.136 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-04-26T21:15:58.136 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-04-26T21:15:58.136 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000366846 s, 1.4 MB/s 2024-04-26T21:15:58.136 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:58 smithi084 ceph-mon[25539]: Reconfiguring mon.smithi084 (unknown last config time)... 2024-04-26T21:15:58.137 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:58 smithi084 ceph-mon[25539]: Reconfiguring daemon mon.smithi084 on smithi084 2024-04-26T21:15:58.140 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T21:15:58.191 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2024-04-26T21:15:58.230 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T21:15:58.230 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:15:58.230 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-04-26T21:15:58.230 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:15:58.230 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:15:58.230 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-04-26 21:15:00.946319920 +0000 2024-04-26T21:15:58.230 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-04-26 21:07:43.415848057 +0000 2024-04-26T21:15:58.230 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-04-26 21:07:43.415848057 +0000 2024-04-26T21:15:58.230 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-04-26 21:07:43.415848057 +0000 2024-04-26T21:15:58.231 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T21:15:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-04-26T21:15:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-04-26T21:15:58.341 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000372534 s, 1.4 MB/s 2024-04-26T21:15:58.344 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T21:15:58.391 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2024-04-26T21:15:58.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:58 smithi120 ceph-mon[32741]: Reconfiguring mon.smithi084 (unknown last config time)... 2024-04-26T21:15:58.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:58 smithi120 ceph-mon[32741]: Reconfiguring daemon mon.smithi084 on smithi084 2024-04-26T21:15:58.481 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T21:15:58.481 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:15:58.481 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-04-26T21:15:58.481 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:15:58.481 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:15:58.481 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-04-26 21:15:00.946319920 +0000 2024-04-26T21:15:58.481 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-04-26 21:07:44.009837996 +0000 2024-04-26T21:15:58.481 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-04-26 21:07:44.009837996 +0000 2024-04-26T21:15:58.481 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-04-26 21:07:44.009837996 +0000 2024-04-26T21:15:58.482 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T21:15:58.558 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-04-26T21:15:58.558 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-04-26T21:15:58.558 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000351513 s, 1.5 MB/s 2024-04-26T21:15:58.562 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T21:15:58.618 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T21:15:58.618 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T21:15:58.677 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T21:15:58.678 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_1 2024-04-26T21:15:58.732 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T21:15:58.732 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:15:58.732 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-04-26T21:15:58.732 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:15:58.732 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:15:58.732 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-04-26 21:15:44.538385511 +0000 2024-04-26T21:15:58.732 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-04-26 21:07:45.083387268 +0000 2024-04-26T21:15:58.732 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-04-26 21:07:45.083387268 +0000 2024-04-26T21:15:58.732 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-04-26 21:07:45.083387268 +0000 2024-04-26T21:15:58.733 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T21:15:58.807 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-04-26T21:15:58.807 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-04-26T21:15:58.807 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000435638 s, 1.2 MB/s 2024-04-26T21:15:58.811 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T21:15:58.864 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_2 2024-04-26T21:15:58.913 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T21:15:58.914 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:15:58.914 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-04-26T21:15:58.914 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:15:58.914 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:15:58.914 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-04-26 21:15:44.540385466 +0000 2024-04-26T21:15:58.914 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-04-26 21:07:45.631374994 +0000 2024-04-26T21:15:58.914 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-04-26 21:07:45.631374994 +0000 2024-04-26T21:15:58.914 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-04-26 21:07:45.631374994 +0000 2024-04-26T21:15:58.914 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T21:15:58.981 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-04-26T21:15:58.981 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-04-26T21:15:58.981 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.00028282 s, 1.8 MB/s 2024-04-26T21:15:58.985 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T21:15:59.033 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_3 2024-04-26T21:15:59.080 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T21:15:59.080 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:15:59.080 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-04-26T21:15:59.080 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:15:59.080 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:15:59.080 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-04-26 21:15:44.540385466 +0000 2024-04-26T21:15:59.080 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-04-26 21:07:46.208362070 +0000 2024-04-26T21:15:59.080 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-04-26 21:07:46.208362070 +0000 2024-04-26T21:15:59.080 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-04-26 21:07:46.208362070 +0000 2024-04-26T21:15:59.081 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T21:15:59.155 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-04-26T21:15:59.156 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-04-26T21:15:59.156 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000368539 s, 1.4 MB/s 2024-04-26T21:15:59.159 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T21:15:59.215 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_4 2024-04-26T21:15:59.261 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T21:15:59.261 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:15:59.261 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-04-26T21:15:59.261 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:15:59.261 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:15:59.261 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-04-26 21:15:44.541385444 +0000 2024-04-26T21:15:59.261 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-04-26 21:07:46.781349236 +0000 2024-04-26T21:15:59.261 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-04-26 21:07:46.781349236 +0000 2024-04-26T21:15:59.261 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-04-26 21:07:46.781349236 +0000 2024-04-26T21:15:59.262 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T21:15:59.328 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-04-26T21:15:59.328 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-04-26T21:15:59.328 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000365843 s, 1.4 MB/s 2024-04-26T21:15:59.331 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T21:15:59.375 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:59 smithi084 ceph-mon[25539]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:59.375 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:59 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:59.375 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:59 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:59.375 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:59 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi084.gyasul", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:15:59.375 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:59 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:15:59.375 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:15:59 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:59.381 INFO:tasks.cephadm:Deploying osd.0 on smithi084 with /dev/vg_nvme/lv_4... 2024-04-26T21:15:59.381 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-26T21:15:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:59 smithi120 ceph-mon[32741]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:15:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:59 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:59 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:15:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:59 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi084.gyasul", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:15:59.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:59 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:15:59.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:15:59 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:00.410 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:00 smithi084 ceph-mon[25539]: Reconfiguring mgr.smithi084.gyasul (unknown last config time)... 2024-04-26T21:16:00.410 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:00 smithi084 ceph-mon[25539]: Reconfiguring daemon mgr.smithi084.gyasul on smithi084 2024-04-26T21:16:00.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:00 smithi120 ceph-mon[32741]: Reconfiguring mgr.smithi084.gyasul (unknown last config time)... 2024-04-26T21:16:00.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:00 smithi120 ceph-mon[32741]: Reconfiguring daemon mgr.smithi084.gyasul on smithi084 2024-04-26T21:16:00.727 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:16:01.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:01 smithi084 ceph-mon[25539]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:01.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:01 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:01.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:01 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:01.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:01 smithi084 ceph-mon[25539]: Reconfiguring crash.smithi084 (monmap changed)... 2024-04-26T21:16:01.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:01 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi084", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:16:01.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:01 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:01.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:01 smithi084 ceph-mon[25539]: Reconfiguring daemon crash.smithi084 on smithi084 2024-04-26T21:16:01.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:01 smithi120 ceph-mon[32741]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:01.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:01 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:01.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:01 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:01.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:01 smithi120 ceph-mon[32741]: Reconfiguring crash.smithi084 (monmap changed)... 2024-04-26T21:16:01.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:01 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi084", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:16:01.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:01 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:01.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:01 smithi120 ceph-mon[32741]: Reconfiguring daemon crash.smithi084 on smithi084 2024-04-26T21:16:02.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:02 smithi120 ceph-mon[32741]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:02.334 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:02 smithi084 ceph-mon[25539]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:04.037 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-26T21:16:04.037 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-26T21:16:04.037 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2024-04-26T21:16:04.038 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2024-04-26T21:16:04.038 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.06137 s, 171 MB/s 2024-04-26T21:16:04.038 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2024-04-26T21:16:04.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:04 smithi084 ceph-mon[25539]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:04.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:04 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:04.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:04 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:04.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:04 smithi084 ceph-mon[25539]: Reconfiguring alertmanager.smithi084 (dependencies changed)... 2024-04-26T21:16:04.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:04 smithi084 ceph-mon[25539]: Reconfiguring daemon alertmanager.smithi084 on smithi084 2024-04-26T21:16:04.779 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi084:vg_nvme/lv_4 2024-04-26T21:16:04.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:04 smithi120 ceph-mon[32741]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:04.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:04 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:04.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:04 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:04.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:04 smithi120 ceph-mon[32741]: Reconfiguring alertmanager.smithi084 (dependencies changed)... 2024-04-26T21:16:04.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:04 smithi120 ceph-mon[32741]: Reconfiguring daemon alertmanager.smithi084 on smithi084 2024-04-26T21:16:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:16:06.646 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:06 smithi084 ceph-mon[25539]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:06.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:06 smithi120 ceph-mon[32741]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:08.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:08 smithi084 ceph-mon[25539]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:08.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:08 smithi120 ceph-mon[32741]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:09.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.192+0000 7f11c6e00700 1 -- 172.21.15.84:0/1372424550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11c0070940 msgr2=0x7f11c0070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:09.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.192+0000 7f11c6e00700 1 --2- 172.21.15.84:0/1372424550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11c0070940 0x7f11c0070db0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f11ac004940 tx=0x7f11ac009e30 comp rx=0 tx=0).stop 2024-04-26T21:16:09.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.192+0000 7f11c6e00700 1 -- 172.21.15.84:0/1372424550 shutdown_connections 2024-04-26T21:16:09.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.192+0000 7f11c6e00700 1 --2- 172.21.15.84:0/1372424550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11c0070940 0x7f11c0070db0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:09.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.192+0000 7f11c6e00700 1 --2- 172.21.15.84:0/1372424550 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11c0071ef0 0x7f11c0070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:09.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.192+0000 7f11c6e00700 1 -- 172.21.15.84:0/1372424550 >> 172.21.15.84:0/1372424550 conn(0x7f11c00f8560 msgr2=0x7f11c00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.192+0000 7f11c6e00700 1 -- 172.21.15.84:0/1372424550 shutdown_connections 2024-04-26T21:16:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.192+0000 7f11c6e00700 1 -- 172.21.15.84:0/1372424550 wait complete. 2024-04-26T21:16:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.193+0000 7f11c6e00700 1 Processor -- start 2024-04-26T21:16:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.193+0000 7f11c6e00700 1 -- start start 2024-04-26T21:16:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.193+0000 7f11c6e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11c0070940 0x7f11c010fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.193+0000 7f11c6e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11c0071ef0 0x7f11c0110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.193+0000 7f11c6e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c0110810 con 0x7f11c0071ef0 2024-04-26T21:16:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.193+0000 7f11c6e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c0111000 con 0x7f11c0070940 2024-04-26T21:16:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.194+0000 7f11bf400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11c0071ef0 0x7f11c0110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.194+0000 7f11bf400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11c0071ef0 0x7f11c0110180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56832/0 (socket says 172.21.15.84:56832) 2024-04-26T21:16:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.194+0000 7f11bf400700 1 -- 172.21.15.84:0/1626700740 learned_addr learned my addr 172.21.15.84:0/1626700740 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:16:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.194+0000 7f11bfe00700 1 --2- 172.21.15.84:0/1626700740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11c0070940 0x7f11c010fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.194+0000 7f11bf400700 1 -- 172.21.15.84:0/1626700740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11c0070940 msgr2=0x7f11c010fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.194+0000 7f11bf400700 1 --2- 172.21.15.84:0/1626700740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11c0070940 0x7f11c010fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.194+0000 7f11bf400700 1 -- 172.21.15.84:0/1626700740 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac005040 con 0x7f11c0071ef0 2024-04-26T21:16:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.195+0000 7f11bf400700 1 --2- 172.21.15.84:0/1626700740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11c0071ef0 0x7f11c0110180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f11ac00b3b0 tx=0x7f11ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.195+0000 7f11b7e00700 1 -- 172.21.15.84:0/1626700740 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11ac00e040 con 0x7f11c0071ef0 2024-04-26T21:16:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.195+0000 7f11b7e00700 1 -- 172.21.15.84:0/1626700740 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f11ac004290 con 0x7f11c0071ef0 2024-04-26T21:16:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.195+0000 7f11c6e00700 1 -- 172.21.15.84:0/1626700740 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c0111280 con 0x7f11c0071ef0 2024-04-26T21:16:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.195+0000 7f11c6e00700 1 -- 172.21.15.84:0/1626700740 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c0111840 con 0x7f11c0071ef0 2024-04-26T21:16:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.196+0000 7f11b7e00700 1 -- 172.21.15.84:0/1626700740 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11ac01c3f0 con 0x7f11c0071ef0 2024-04-26T21:16:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.197+0000 7f11c6e00700 1 -- 172.21.15.84:0/1626700740 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a00052e0 con 0x7f11c0071ef0 2024-04-26T21:16:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.198+0000 7f11b7e00700 1 -- 172.21.15.84:0/1626700740 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f11ac01c550 con 0x7f11c0071ef0 2024-04-26T21:16:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.198+0000 7f11b7e00700 1 --2- 172.21.15.84:0/1626700740 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f11a40692e0 0x7f11a406b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.199+0000 7f11b7e00700 1 -- 172.21.15.84:0/1626700740 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f11ac087230 con 0x7f11c0071ef0 2024-04-26T21:16:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.199+0000 7f11bfe00700 1 --2- 172.21.15.84:0/1626700740 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f11a40692e0 0x7f11a406b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.200+0000 7f11bfe00700 1 --2- 172.21.15.84:0/1626700740 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f11a40692e0 0x7f11a406b790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f11c0071c30 tx=0x7f11b00091a0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.204+0000 7f11b7e00700 1 -- 172.21.15.84:0/1626700740 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f11ac058120 con 0x7f11c0071ef0 2024-04-26T21:16:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:09.425+0000 7f11c6e00700 1 -- 172.21.15.84:0/1626700740 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f11a0000bf0 con 0x7f11a40692e0 2024-04-26T21:16:09.842 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:09 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T21:16:09.843 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:09 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T21:16:09.843 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:09 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:09.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:09 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T21:16:09.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:09 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T21:16:09.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:09 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:10.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:10 smithi084 ceph-mon[25539]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:10.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:10 smithi084 ceph-mon[25539]: from='client.14246 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:16:10.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:10 smithi120 ceph-mon[32741]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:10.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:10 smithi120 ceph-mon[32741]: from='client.14246 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:16:11.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:11 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:16:11.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:11 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:16:12.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:12 smithi084 ceph-mon[25539]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:12.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:12 smithi120 ceph-mon[32741]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:14.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:13 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:14.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:13 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:14.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:13 smithi084 ceph-mon[25539]: Reconfiguring grafana.smithi084 (dependencies changed)... 2024-04-26T21:16:14.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:13 smithi084 ceph-mon[25539]: Reconfiguring daemon grafana.smithi084 on smithi084 2024-04-26T21:16:14.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:13 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:14.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:13 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:14.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:13 smithi120 ceph-mon[32741]: Reconfiguring grafana.smithi084 (dependencies changed)... 2024-04-26T21:16:14.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:13 smithi120 ceph-mon[32741]: Reconfiguring daemon grafana.smithi084 on smithi084 2024-04-26T21:16:15.088 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:14 smithi084 ceph-mon[25539]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:15.089 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:14 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/4169362149' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6c04d45-3ba8-4cc3-92ee-2e99279c6da1"}]: dispatch 2024-04-26T21:16:15.089 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:14 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/4169362149' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6c04d45-3ba8-4cc3-92ee-2e99279c6da1"}]': finished 2024-04-26T21:16:15.089 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:14 smithi084 ceph-mon[25539]: osdmap e6: 1 total, 0 up, 1 in 2024-04-26T21:16:15.089 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:14 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:16:15.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:14 smithi120 ceph-mon[32741]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:15.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:14 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/4169362149' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6c04d45-3ba8-4cc3-92ee-2e99279c6da1"}]: dispatch 2024-04-26T21:16:15.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:14 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/4169362149' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6c04d45-3ba8-4cc3-92ee-2e99279c6da1"}]': finished 2024-04-26T21:16:15.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:14 smithi120 ceph-mon[32741]: osdmap e6: 1 total, 0 up, 1 in 2024-04-26T21:16:15.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:14 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:16:16.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:15 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3147809898' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T21:16:16.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:15 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/3147809898' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T21:16:17.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:16 smithi084 ceph-mon[25539]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:17.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:16 smithi120 ceph-mon[32741]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:19.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:18 smithi084 ceph-mon[25539]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:19.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:18 smithi120 ceph-mon[32741]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:21.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:20 smithi084 ceph-mon[25539]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:21.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:20 smithi120 ceph-mon[32741]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:23.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:22 smithi084 ceph-mon[25539]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:23.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:22 smithi120 ceph-mon[32741]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:25.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:24 smithi120 ceph-mon[32741]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:25.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:24 smithi084 ceph-mon[25539]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:26.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:26 smithi084 ceph-mon[25539]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:26.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:26 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:26.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:26 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:26.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:26 smithi084 ceph-mon[25539]: Reconfiguring prometheus.smithi084 (dependencies changed)... 2024-04-26T21:16:26.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:26 smithi084 ceph-mon[25539]: Reconfiguring daemon prometheus.smithi084 on smithi084 2024-04-26T21:16:26.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:26 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:16:26.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:26 smithi120 ceph-mon[32741]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:26.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:26 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:26.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:26 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:26.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:26 smithi120 ceph-mon[32741]: Reconfiguring prometheus.smithi084 (dependencies changed)... 2024-04-26T21:16:26.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:26 smithi120 ceph-mon[32741]: Reconfiguring daemon prometheus.smithi084 on smithi084 2024-04-26T21:16:26.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:26 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:16:27.683 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:27 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T21:16:27.683 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:27 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:27.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:27 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T21:16:27.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:27 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:28.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:28 smithi084 ceph-mon[25539]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:28.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:28 smithi084 ceph-mon[25539]: Deploying daemon osd.0 on smithi084 2024-04-26T21:16:28.913 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:28 smithi120 ceph-mon[32741]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:28.913 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:28 smithi120 ceph-mon[32741]: Deploying daemon osd.0 on smithi084 2024-04-26T21:16:30.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:30 smithi120 ceph-mon[32741]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:31.035 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:30 smithi084 ceph-mon[25539]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:32.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:32 smithi084 ceph-mon[25539]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:32.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:32 smithi120 ceph-mon[32741]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:34.771 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:34 smithi084 ceph-mon[25539]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:34.771 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:34 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:34.771 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:34 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:34.771 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:34 smithi084 ceph-mon[25539]: Reconfiguring crash.smithi120 (monmap changed)... 2024-04-26T21:16:34.771 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:34 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi120", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:16:34.771 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:34 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:34.771 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:34 smithi084 ceph-mon[25539]: Reconfiguring daemon crash.smithi120 on smithi120 2024-04-26T21:16:34.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:34 smithi120 ceph-mon[32741]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:34.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:34 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:34.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:34 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:34.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:34 smithi120 ceph-mon[32741]: Reconfiguring crash.smithi120 (monmap changed)... 2024-04-26T21:16:34.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:34 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi120", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:16:34.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:34 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:34.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:34 smithi120 ceph-mon[32741]: Reconfiguring daemon crash.smithi120 on smithi120 2024-04-26T21:16:36.636 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:36 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:36.637 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:36 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:36.637 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:36 smithi084 ceph-mon[25539]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:36.637 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:36 smithi084 ceph-mon[25539]: Reconfiguring mgr.smithi120.zjaduj (monmap changed)... 2024-04-26T21:16:36.637 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:36 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.zjaduj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:16:36.637 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:36 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:16:36.637 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:36 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:36.637 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:36 smithi084 ceph-mon[25539]: Reconfiguring daemon mgr.smithi120.zjaduj on smithi120 2024-04-26T21:16:36.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:36 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:36.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:36 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:36.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:36 smithi120 ceph-mon[32741]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:36.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:36 smithi120 ceph-mon[32741]: Reconfiguring mgr.smithi120.zjaduj (monmap changed)... 2024-04-26T21:16:36.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:36 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.zjaduj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:16:36.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:36 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:16:36.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:36 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:36.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:36 smithi120 ceph-mon[32741]: Reconfiguring daemon mgr.smithi120.zjaduj on smithi120 2024-04-26T21:16:38.563 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:38 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:38.563 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:38 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:38.563 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:38 smithi120 ceph-mon[32741]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:38.563 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:38 smithi120 ceph-mon[32741]: Reconfiguring mon.smithi120 (monmap changed)... 2024-04-26T21:16:38.563 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:38 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:16:38.563 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:38 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T21:16:38.563 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:38 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:38.563 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:38 smithi120 ceph-mon[32741]: Reconfiguring daemon mon.smithi120 on smithi120 2024-04-26T21:16:38.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:38 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:38.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:38 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:38.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:38 smithi084 ceph-mon[25539]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:38.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:38 smithi084 ceph-mon[25539]: Reconfiguring mon.smithi120 (monmap changed)... 2024-04-26T21:16:38.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:38 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:16:38.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:38 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T21:16:38.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:38 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:38.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:38 smithi084 ceph-mon[25539]: Reconfiguring daemon mon.smithi120 on smithi120 2024-04-26T21:16:40.599 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:40 smithi084 ceph-mon[25539]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:40.599 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:40.599 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:40.599 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-26T21:16:40.599 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:40 smithi084 ceph-mon[25539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-26T21:16:40.600 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi084.front.sepia.ceph.com:9093"}]: dispatch 2024-04-26T21:16:40.600 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:40 smithi084 ceph-mon[25539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi084.front.sepia.ceph.com:9093"}]: dispatch 2024-04-26T21:16:40.600 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:40.600 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-26T21:16:40.600 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:40 smithi084 ceph-mon[25539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-26T21:16:40.600 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi084.front.sepia.ceph.com:3000"}]: dispatch 2024-04-26T21:16:40.600 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:40 smithi084 ceph-mon[25539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi084.front.sepia.ceph.com:3000"}]: dispatch 2024-04-26T21:16:40.600 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:40.600 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:16:40.600 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:40 smithi084 ceph-mon[25539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:16:40.600 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi084.front.sepia.ceph.com:9095"}]: dispatch 2024-04-26T21:16:40.600 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:40 smithi084 ceph-mon[25539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi084.front.sepia.ceph.com:9095"}]: dispatch 2024-04-26T21:16:40.600 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:40.600 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:16:40.783 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:40 smithi120 ceph-mon[32741]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:40.783 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:40 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:40.783 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:40 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:40.783 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:40 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-26T21:16:40.783 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:40 smithi120 ceph-mon[32741]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-26T21:16:40.783 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:40 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi084.front.sepia.ceph.com:9093"}]: dispatch 2024-04-26T21:16:40.783 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:40 smithi120 ceph-mon[32741]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi084.front.sepia.ceph.com:9093"}]: dispatch 2024-04-26T21:16:40.783 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:40 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:40.783 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:40 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-26T21:16:40.783 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:40 smithi120 ceph-mon[32741]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-26T21:16:40.783 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:40 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi084.front.sepia.ceph.com:3000"}]: dispatch 2024-04-26T21:16:40.784 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:40 smithi120 ceph-mon[32741]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi084.front.sepia.ceph.com:3000"}]: dispatch 2024-04-26T21:16:40.784 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:40 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:40.784 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:40 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:16:40.784 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:40 smithi120 ceph-mon[32741]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:16:40.784 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:40 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi084.front.sepia.ceph.com:9095"}]: dispatch 2024-04-26T21:16:40.784 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:40 smithi120 ceph-mon[32741]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi084.front.sepia.ceph.com:9095"}]: dispatch 2024-04-26T21:16:40.784 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:40 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:40.784 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:40 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:16:42.113 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:42.113 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:42.113 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:16:42.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:42.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:42.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:16:42.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:42 smithi084 ceph-mon[25539]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:42.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:42 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:42.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:42 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:43.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:42 smithi120 ceph-mon[32741]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:43.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:42 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:43.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:42 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:45.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:44 smithi084 ceph-mon[25539]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:45.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:44 smithi120 ceph-mon[32741]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:45.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:45.656+0000 7f11b7e00700 1 -- 172.21.15.84:0/1626700740 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f11a0000bf0 con 0x7f11a40692e0 2024-04-26T21:16:45.658 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 0 on host 'smithi084' 2024-04-26T21:16:45.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:45.659+0000 7f11c6e00700 1 -- 172.21.15.84:0/1626700740 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f11a40692e0 msgr2=0x7f11a406b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:45.659+0000 7f11c6e00700 1 --2- 172.21.15.84:0/1626700740 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f11a40692e0 0x7f11a406b790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f11c0071c30 tx=0x7f11b00091a0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:45.659+0000 7f11c6e00700 1 -- 172.21.15.84:0/1626700740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11c0071ef0 msgr2=0x7f11c0110180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:45.659+0000 7f11c6e00700 1 --2- 172.21.15.84:0/1626700740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11c0071ef0 0x7f11c0110180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f11ac00b3b0 tx=0x7f11ac009e30 comp rx=0 tx=0).stop 2024-04-26T21:16:45.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:45.660+0000 7f11c6e00700 1 -- 172.21.15.84:0/1626700740 shutdown_connections 2024-04-26T21:16:45.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:45.660+0000 7f11c6e00700 1 --2- 172.21.15.84:0/1626700740 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f11a40692e0 0x7f11a406b790 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:45.660+0000 7f11c6e00700 1 --2- 172.21.15.84:0/1626700740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11c0070940 0x7f11c010fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:45.660+0000 7f11c6e00700 1 --2- 172.21.15.84:0/1626700740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11c0071ef0 0x7f11c0110180 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:45.660+0000 7f11c6e00700 1 -- 172.21.15.84:0/1626700740 >> 172.21.15.84:0/1626700740 conn(0x7f11c00f8560 msgr2=0x7f11c0102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:45.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:45.660+0000 7f11c6e00700 1 -- 172.21.15.84:0/1626700740 shutdown_connections 2024-04-26T21:16:45.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:45.660+0000 7f11c6e00700 1 -- 172.21.15.84:0/1626700740 wait complete. 2024-04-26T21:16:46.048 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:45 smithi084 ceph-mon[25539]: from='osd.0 [v2:172.21.15.84:6802/4265849542,v1:172.21.15.84:6803/4265849542]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T21:16:46.048 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:45 smithi084 ceph-mon[25539]: from='osd.0 [v2:172.21.15.84:6802/4265849542,v1:172.21.15.84:6803/4265849542]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T21:16:46.048 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:45 smithi084 ceph-mon[25539]: osdmap e7: 1 total, 0 up, 1 in 2024-04-26T21:16:46.048 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:45 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:16:46.048 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:45 smithi084 ceph-mon[25539]: from='osd.0 [v2:172.21.15.84:6802/4265849542,v1:172.21.15.84:6803/4265849542]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-04-26T21:16:46.048 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:45 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:46.048 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:45 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:46.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:45 smithi120 ceph-mon[32741]: from='osd.0 [v2:172.21.15.84:6802/4265849542,v1:172.21.15.84:6803/4265849542]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T21:16:46.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:45 smithi120 ceph-mon[32741]: from='osd.0 [v2:172.21.15.84:6802/4265849542,v1:172.21.15.84:6803/4265849542]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T21:16:46.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:45 smithi120 ceph-mon[32741]: osdmap e7: 1 total, 0 up, 1 in 2024-04-26T21:16:46.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:45 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:16:46.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:45 smithi120 ceph-mon[32741]: from='osd.0 [v2:172.21.15.84:6802/4265849542,v1:172.21.15.84:6803/4265849542]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-04-26T21:16:46.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:45 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:46.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:45 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:46.595 DEBUG:teuthology.orchestra.run.smithi084:osd.0> sudo journalctl -f -n 0 -u ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.0.service 2024-04-26T21:16:46.600 INFO:tasks.cephadm:Deploying osd.1 on smithi084 with /dev/vg_nvme/lv_3... 2024-04-26T21:16:46.600 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-26T21:16:47.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:46 smithi084 ceph-mon[25539]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:47.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:46 smithi084 ceph-mon[25539]: from='osd.0 [v2:172.21.15.84:6802/4265849542,v1:172.21.15.84:6803/4265849542]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-04-26T21:16:47.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:46 smithi084 ceph-mon[25539]: osdmap e8: 1 total, 0 up, 1 in 2024-04-26T21:16:47.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:46 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:16:47.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:46 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:16:47.168 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:16:47.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:46 smithi120 ceph-mon[32741]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:47.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:46 smithi120 ceph-mon[32741]: from='osd.0 [v2:172.21.15.84:6802/4265849542,v1:172.21.15.84:6803/4265849542]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-04-26T21:16:47.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:46 smithi120 ceph-mon[32741]: osdmap e8: 1 total, 0 up, 1 in 2024-04-26T21:16:47.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:16:47.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:16:47.910 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:47 smithi084 ceph-mon[25539]: purged_snaps scrub starts 2024-04-26T21:16:47.911 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:47 smithi084 ceph-mon[25539]: purged_snaps scrub ok 2024-04-26T21:16:47.911 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:47 smithi084 ceph-mon[25539]: osd.0 [v2:172.21.15.84:6802/4265849542,v1:172.21.15.84:6803/4265849542] boot 2024-04-26T21:16:47.911 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:47 smithi084 ceph-mon[25539]: osdmap e9: 1 total, 1 up, 1 in 2024-04-26T21:16:47.911 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:47 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:16:48.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:47 smithi120 ceph-mon[32741]: purged_snaps scrub starts 2024-04-26T21:16:48.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:47 smithi120 ceph-mon[32741]: purged_snaps scrub ok 2024-04-26T21:16:48.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:47 smithi120 ceph-mon[32741]: osd.0 [v2:172.21.15.84:6802/4265849542,v1:172.21.15.84:6803/4265849542] boot 2024-04-26T21:16:48.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:47 smithi120 ceph-mon[32741]: osdmap e9: 1 total, 1 up, 1 in 2024-04-26T21:16:48.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:47 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:16:49.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:48 smithi084 ceph-mon[25539]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:49.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:48 smithi084 ceph-mon[25539]: osdmap e10: 1 total, 1 up, 1 in 2024-04-26T21:16:49.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:48 smithi120 ceph-mon[32741]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T21:16:49.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:48 smithi120 ceph-mon[32741]: osdmap e10: 1 total, 1 up, 1 in 2024-04-26T21:16:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-26T21:16:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-26T21:16:50.216 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2024-04-26T21:16:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2024-04-26T21:16:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0580085 s, 181 MB/s 2024-04-26T21:16:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2024-04-26T21:16:50.569 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:50 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:50.569 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:50 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:50.569 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:50 smithi084 ceph-mon[25539]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:16:50.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:50 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:50.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:50 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:50.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:50 smithi120 ceph-mon[32741]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:16:50.948 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi084:vg_nvme/lv_3 2024-04-26T21:16:52.244 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:16:52.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:52 smithi084 ceph-mon[25539]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:16:52.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:52 smithi120 ceph-mon[32741]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:16:54.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.709+0000 7f7397a00700 1 -- 172.21.15.84:0/732541887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7390070890 msgr2=0x7f7390070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:54.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.709+0000 7f7397a00700 1 --2- 172.21.15.84:0/732541887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7390070890 0x7f7390070d00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f737c004940 tx=0x7f737c009e30 comp rx=0 tx=0).stop 2024-04-26T21:16:54.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.709+0000 7f7397a00700 1 -- 172.21.15.84:0/732541887 shutdown_connections 2024-04-26T21:16:54.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.709+0000 7f7397a00700 1 --2- 172.21.15.84:0/732541887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7390070890 0x7f7390070d00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:54.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.709+0000 7f7397a00700 1 --2- 172.21.15.84:0/732541887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7390071e40 0x7f7390070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:54.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.709+0000 7f7397a00700 1 -- 172.21.15.84:0/732541887 >> 172.21.15.84:0/732541887 conn(0x7f73900f8560 msgr2=0x7f73900fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:54.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.709+0000 7f7397a00700 1 -- 172.21.15.84:0/732541887 shutdown_connections 2024-04-26T21:16:54.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.709+0000 7f7397a00700 1 -- 172.21.15.84:0/732541887 wait complete. 2024-04-26T21:16:54.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.710+0000 7f7397a00700 1 Processor -- start 2024-04-26T21:16:54.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.710+0000 7f7397a00700 1 -- start start 2024-04-26T21:16:54.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.711+0000 7f7397a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7390070890 0x7f7390114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:54.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.711+0000 7f7397a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7390071e40 0x7f73901145a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:54.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.711+0000 7f7397a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7390114ba0 con 0x7f7390071e40 2024-04-26T21:16:54.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.711+0000 7f7397a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73901153a0 con 0x7f7390070890 2024-04-26T21:16:54.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.711+0000 7f738fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7390071e40 0x7f73901145a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:54.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.711+0000 7f738fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7390071e40 0x7f73901145a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45468/0 (socket says 172.21.15.84:45468) 2024-04-26T21:16:54.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.711+0000 7f738fe00700 1 -- 172.21.15.84:0/2130173648 learned_addr learned my addr 172.21.15.84:0/2130173648 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:16:54.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.711+0000 7f7395000700 1 --2- 172.21.15.84:0/2130173648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7390070890 0x7f7390114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:54.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.712+0000 7f738fe00700 1 -- 172.21.15.84:0/2130173648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7390070890 msgr2=0x7f7390114060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:54.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.712+0000 7f738fe00700 1 --2- 172.21.15.84:0/2130173648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7390070890 0x7f7390114060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:54.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.712+0000 7f738fe00700 1 -- 172.21.15.84:0/2130173648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c005040 con 0x7f7390071e40 2024-04-26T21:16:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.712+0000 7f738fe00700 1 --2- 172.21.15.84:0/2130173648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7390071e40 0x7f73901145a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f737c009150 tx=0x7f737c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.712+0000 7f738cc00700 1 -- 172.21.15.84:0/2130173648 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f737c00e040 con 0x7f7390071e40 2024-04-26T21:16:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.712+0000 7f738cc00700 1 -- 172.21.15.84:0/2130173648 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f737c00bbf0 con 0x7f7390071e40 2024-04-26T21:16:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.712+0000 7f738cc00700 1 -- 172.21.15.84:0/2130173648 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f737c01c630 con 0x7f7390071e40 2024-04-26T21:16:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.712+0000 7f7397a00700 1 -- 172.21.15.84:0/2130173648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7390115620 con 0x7f7390071e40 2024-04-26T21:16:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.712+0000 7f7397a00700 1 -- 172.21.15.84:0/2130173648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7390115b60 con 0x7f7390071e40 2024-04-26T21:16:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.714+0000 7f7397a00700 1 -- 172.21.15.84:0/2130173648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f739005f5c0 con 0x7f7390071e40 2024-04-26T21:16:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.715+0000 7f738cc00700 1 -- 172.21.15.84:0/2130173648 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f737c00bd60 con 0x7f7390071e40 2024-04-26T21:16:54.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.716+0000 7f738cc00700 1 --2- 172.21.15.84:0/2130173648 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7378069210 0x7f737806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:54.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.716+0000 7f738cc00700 1 -- 172.21.15.84:0/2130173648 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f737c088150 con 0x7f7390071e40 2024-04-26T21:16:54.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.716+0000 7f7395000700 1 --2- 172.21.15.84:0/2130173648 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7378069210 0x7f737806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:54.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.717+0000 7f7395000700 1 --2- 172.21.15.84:0/2130173648 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7378069210 0x7f737806b6c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f73840041d0 tx=0x7f73840043c0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:54.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.723+0000 7f738cc00700 1 -- 172.21.15.84:0/2130173648 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f737c058d70 con 0x7f7390071e40 2024-04-26T21:16:54.769 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:54 smithi084 ceph-mon[25539]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:16:54.834 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:54 smithi120 ceph-mon[32741]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:16:54.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:16:54.962+0000 7f7397a00700 1 -- 172.21.15.84:0/2130173648 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7390115f10 con 0x7f7378069210 2024-04-26T21:16:55.829 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:55 smithi084 ceph-mon[25539]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:16:55.830 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:55 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T21:16:55.830 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:55 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T21:16:55.830 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:55 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:55.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:55 smithi120 ceph-mon[32741]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:16:55.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:55 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T21:16:55.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:55 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T21:16:55.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:55 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:56.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:56 smithi120 ceph-mon[32741]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:16:56.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:56 smithi120 ceph-mon[32741]: Detected new or changed devices on smithi084 2024-04-26T21:16:56.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:56 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:56.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:56 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:56.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:56 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:16:56.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:56 smithi120 ceph-mon[32741]: Adjusting osd_memory_target on smithi084 to 12865M 2024-04-26T21:16:56.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:56 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:56.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:56 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:56.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:56 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:16:56.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:56 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:56.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:56 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:16:56.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:56 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:16:56.845 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:56 smithi084 ceph-mon[25539]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:16:56.846 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:56 smithi084 ceph-mon[25539]: Detected new or changed devices on smithi084 2024-04-26T21:16:56.846 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:56 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:56.846 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:56 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:56.846 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:56 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:16:56.846 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:56 smithi084 ceph-mon[25539]: Adjusting osd_memory_target on smithi084 to 12865M 2024-04-26T21:16:56.846 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:56 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:56.846 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:56 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:56.846 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:56 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:16:56.846 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:56 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:56.846 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:56 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:16:56.846 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:56 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:16:58.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:58 smithi084 ceph-mon[25539]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:16:58.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:58 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:58.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:58 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:58.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:58 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3781476943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4417e988-3443-4671-8df5-4d964b8e5954"}]: dispatch 2024-04-26T21:16:58.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:58 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3781476943' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4417e988-3443-4671-8df5-4d964b8e5954"}]': finished 2024-04-26T21:16:58.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:58 smithi084 ceph-mon[25539]: osdmap e11: 2 total, 1 up, 2 in 2024-04-26T21:16:58.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:58 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:16:58.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:58 smithi120 ceph-mon[32741]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:16:58.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:58 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:58.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:58 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:16:58.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:58 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/3781476943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4417e988-3443-4671-8df5-4d964b8e5954"}]: dispatch 2024-04-26T21:16:58.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:58 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/3781476943' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4417e988-3443-4671-8df5-4d964b8e5954"}]': finished 2024-04-26T21:16:58.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:58 smithi120 ceph-mon[32741]: osdmap e11: 2 total, 1 up, 2 in 2024-04-26T21:16:58.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:58 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:17:00.057 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:16:59 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3347393030' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T21:17:00.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:16:59 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/3347393030' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T21:17:01.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:00 smithi084 ceph-mon[25539]: pgmap v53: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:01.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:00 smithi120 ceph-mon[32741]: pgmap v53: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:03.021 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:02 smithi084 ceph-mon[25539]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:03.021 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:02 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:03.021 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:02 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:03.021 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:02 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:03.021 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:02 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:17:03.021 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:02 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:03.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:02 smithi120 ceph-mon[32741]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:03.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:02 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:03.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:02 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:03.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:02 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:03.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:02 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:17:03.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:02 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:04.849 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:04 smithi084 ceph-mon[25539]: pgmap v55: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:05.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:04 smithi120 ceph-mon[32741]: pgmap v55: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:07.144 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:06 smithi084 ceph-mon[25539]: pgmap v56: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:07.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:06 smithi120 ceph-mon[32741]: pgmap v56: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:08.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:07 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T21:17:08.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:07 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:08.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:07 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T21:17:08.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:07 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:09.127 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:08 smithi084 ceph-mon[25539]: pgmap v57: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:09.127 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:08 smithi084 ceph-mon[25539]: Deploying daemon osd.1 on smithi084 2024-04-26T21:17:09.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:08 smithi120 ceph-mon[32741]: pgmap v57: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:09.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:08 smithi120 ceph-mon[32741]: Deploying daemon osd.1 on smithi084 2024-04-26T21:17:10.889 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:10 smithi084 ceph-mon[25539]: pgmap v58: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:11.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:10 smithi120 ceph-mon[32741]: pgmap v58: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:11.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:11 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:17:12.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:11 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:17:12.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:12 smithi084 ceph-mon[25539]: pgmap v59: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:13.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:12 smithi120 ceph-mon[32741]: pgmap v59: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:15.070 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:14 smithi084 ceph-mon[25539]: pgmap v60: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:15.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:14 smithi120 ceph-mon[32741]: pgmap v60: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:15.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:15 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:17:15.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:15 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:15.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:15 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:16.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:15 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:17:16.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:15 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:16.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:15 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:17.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:16 smithi084 ceph-mon[25539]: pgmap v61: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:17.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:16 smithi120 ceph-mon[32741]: pgmap v61: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:19.003 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:18 smithi084 ceph-mon[25539]: pgmap v62: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:19.003 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:18 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:19.003 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:18 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:19.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:18 smithi120 ceph-mon[32741]: pgmap v62: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:19.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:18 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:19.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:18 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:20.153+0000 7f738cc00700 1 -- 172.21.15.84:0/2130173648 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7390115f10 con 0x7f7378069210 2024-04-26T21:17:20.154 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 1 on host 'smithi084' 2024-04-26T21:17:20.155 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:19 smithi084 ceph-mon[25539]: from='osd.1 [v2:172.21.15.84:6810/2545485308,v1:172.21.15.84:6811/2545485308]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T21:17:20.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:20.157+0000 7f7397a00700 1 -- 172.21.15.84:0/2130173648 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7378069210 msgr2=0x7f737806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:20.157+0000 7f7397a00700 1 --2- 172.21.15.84:0/2130173648 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7378069210 0x7f737806b6c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f73840041d0 tx=0x7f73840043c0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:20.157+0000 7f7397a00700 1 -- 172.21.15.84:0/2130173648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7390071e40 msgr2=0x7f73901145a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:20.157+0000 7f7397a00700 1 --2- 172.21.15.84:0/2130173648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7390071e40 0x7f73901145a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f737c009150 tx=0x7f737c009e30 comp rx=0 tx=0).stop 2024-04-26T21:17:20.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:20.157+0000 7f7397a00700 1 -- 172.21.15.84:0/2130173648 shutdown_connections 2024-04-26T21:17:20.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:20.157+0000 7f7397a00700 1 --2- 172.21.15.84:0/2130173648 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7378069210 0x7f737806b6c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:20.157+0000 7f7397a00700 1 --2- 172.21.15.84:0/2130173648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7390070890 0x7f7390114060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:20.157+0000 7f7397a00700 1 --2- 172.21.15.84:0/2130173648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7390071e40 0x7f73901145a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:20.157+0000 7f7397a00700 1 -- 172.21.15.84:0/2130173648 >> 172.21.15.84:0/2130173648 conn(0x7f73900f8560 msgr2=0x7f73900f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:20.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:20.157+0000 7f7397a00700 1 -- 172.21.15.84:0/2130173648 shutdown_connections 2024-04-26T21:17:20.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:20.157+0000 7f7397a00700 1 -- 172.21.15.84:0/2130173648 wait complete. 2024-04-26T21:17:20.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:19 smithi120 ceph-mon[32741]: from='osd.1 [v2:172.21.15.84:6810/2545485308,v1:172.21.15.84:6811/2545485308]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T21:17:21.007 DEBUG:teuthology.orchestra.run.smithi084:osd.1> sudo journalctl -f -n 0 -u ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.1.service 2024-04-26T21:17:21.012 INFO:tasks.cephadm:Deploying osd.2 on smithi084 with /dev/vg_nvme/lv_2... 2024-04-26T21:17:21.012 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-26T21:17:21.113 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:20 smithi084 ceph-mon[25539]: pgmap v63: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:21.113 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:20 smithi084 ceph-mon[25539]: from='osd.1 [v2:172.21.15.84:6810/2545485308,v1:172.21.15.84:6811/2545485308]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T21:17:21.113 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:20 smithi084 ceph-mon[25539]: osdmap e12: 2 total, 1 up, 2 in 2024-04-26T21:17:21.113 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:20 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:17:21.113 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:20 smithi084 ceph-mon[25539]: from='osd.1 [v2:172.21.15.84:6810/2545485308,v1:172.21.15.84:6811/2545485308]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-04-26T21:17:21.113 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:20 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:21.113 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:20 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:21.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:20 smithi120 ceph-mon[32741]: pgmap v63: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:21.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:20 smithi120 ceph-mon[32741]: from='osd.1 [v2:172.21.15.84:6810/2545485308,v1:172.21.15.84:6811/2545485308]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T21:17:21.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:20 smithi120 ceph-mon[32741]: osdmap e12: 2 total, 1 up, 2 in 2024-04-26T21:17:21.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:20 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:17:21.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:20 smithi120 ceph-mon[32741]: from='osd.1 [v2:172.21.15.84:6810/2545485308,v1:172.21.15.84:6811/2545485308]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-04-26T21:17:21.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:20 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:21.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:20 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:21.745 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:17:22.099 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:21 smithi084 ceph-mon[25539]: from='osd.1 [v2:172.21.15.84:6810/2545485308,v1:172.21.15.84:6811/2545485308]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-04-26T21:17:22.099 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:21 smithi084 ceph-mon[25539]: osdmap e13: 2 total, 1 up, 2 in 2024-04-26T21:17:22.099 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:21 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:17:22.099 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:21 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:17:22.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:21 smithi120 ceph-mon[32741]: from='osd.1 [v2:172.21.15.84:6810/2545485308,v1:172.21.15.84:6811/2545485308]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-04-26T21:17:22.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:21 smithi120 ceph-mon[32741]: osdmap e13: 2 total, 1 up, 2 in 2024-04-26T21:17:22.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:21 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:17:22.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:21 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:17:23.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:22 smithi084 ceph-mon[25539]: purged_snaps scrub starts 2024-04-26T21:17:23.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:22 smithi084 ceph-mon[25539]: purged_snaps scrub ok 2024-04-26T21:17:23.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:22 smithi084 ceph-mon[25539]: pgmap v66: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:23.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:22 smithi084 ceph-mon[25539]: osd.1 [v2:172.21.15.84:6810/2545485308,v1:172.21.15.84:6811/2545485308] boot 2024-04-26T21:17:23.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:22 smithi084 ceph-mon[25539]: osdmap e14: 2 total, 2 up, 2 in 2024-04-26T21:17:23.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:22 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:17:23.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:22 smithi120 ceph-mon[32741]: purged_snaps scrub starts 2024-04-26T21:17:23.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:22 smithi120 ceph-mon[32741]: purged_snaps scrub ok 2024-04-26T21:17:23.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:22 smithi120 ceph-mon[32741]: pgmap v66: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-26T21:17:23.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:22 smithi120 ceph-mon[32741]: osd.1 [v2:172.21.15.84:6810/2545485308,v1:172.21.15.84:6811/2545485308] boot 2024-04-26T21:17:23.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:22 smithi120 ceph-mon[32741]: osdmap e14: 2 total, 2 up, 2 in 2024-04-26T21:17:23.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:22 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:17:23.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:23 smithi120 ceph-mon[32741]: osdmap e15: 2 total, 2 up, 2 in 2024-04-26T21:17:24.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:23 smithi084 ceph-mon[25539]: osdmap e15: 2 total, 2 up, 2 in 2024-04-26T21:17:24.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:24 smithi084 ceph-mon[25539]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:25.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:24 smithi120 ceph-mon[32741]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:25.485 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-26T21:17:25.486 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-26T21:17:25.486 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2024-04-26T21:17:25.486 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2024-04-26T21:17:25.486 INFO:teuthology.orchestra.run.smithi084.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0327775 s, 320 MB/s 2024-04-26T21:17:25.486 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2024-04-26T21:17:26.024 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:25 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:26.024 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:25 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:26.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:25 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:26.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:25 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:26.600 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi084:vg_nvme/lv_2 2024-04-26T21:17:27.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:26 smithi084 ceph-mon[25539]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:27.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:26 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:17:27.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:26 smithi120 ceph-mon[32741]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:27.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:26 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:17:27.326 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:17:29.112 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:28 smithi084 ceph-mon[25539]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:29.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:28 smithi120 ceph-mon[32741]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:30.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.031+0000 7fb467000700 1 -- 172.21.15.84:0/1483573234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4601044e0 msgr2=0x7fb460104950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:30.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.031+0000 7fb467000700 1 --2- 172.21.15.84:0/1483573234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4601044e0 0x7fb460104950 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb44c004940 tx=0x7fb44c009e30 comp rx=0 tx=0).stop 2024-04-26T21:17:30.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.032+0000 7fb467000700 1 -- 172.21.15.84:0/1483573234 shutdown_connections 2024-04-26T21:17:30.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.032+0000 7fb467000700 1 --2- 172.21.15.84:0/1483573234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4601044e0 0x7fb460104950 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.032+0000 7fb467000700 1 --2- 172.21.15.84:0/1483573234 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb460103230 0x7fb460103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.032+0000 7fb467000700 1 -- 172.21.15.84:0/1483573234 >> 172.21.15.84:0/1483573234 conn(0x7fb4600724d0 msgr2=0x7fb4600748e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:30.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.032+0000 7fb467000700 1 -- 172.21.15.84:0/1483573234 shutdown_connections 2024-04-26T21:17:30.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.032+0000 7fb467000700 1 -- 172.21.15.84:0/1483573234 wait complete. 2024-04-26T21:17:30.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.032+0000 7fb467000700 1 Processor -- start 2024-04-26T21:17:30.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.033+0000 7fb467000700 1 -- start start 2024-04-26T21:17:30.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.033+0000 7fb467000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb460103230 0x7fb460113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:30.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.033+0000 7fb467000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4601044e0 0x7fb4601143d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:30.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.033+0000 7fb467000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb460115140 con 0x7fb4601044e0 2024-04-26T21:17:30.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.033+0000 7fb467000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4601152b0 con 0x7fb460103230 2024-04-26T21:17:30.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.033+0000 7fb465200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4601044e0 0x7fb4601143d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:30.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.033+0000 7fb465200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4601044e0 0x7fb4601143d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47498/0 (socket says 172.21.15.84:47498) 2024-04-26T21:17:30.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.033+0000 7fb465200700 1 -- 172.21.15.84:0/2501472448 learned_addr learned my addr 172.21.15.84:0/2501472448 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:17:30.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.034+0000 7fb465c00700 1 --2- 172.21.15.84:0/2501472448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb460103230 0x7fb460113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:30.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.034+0000 7fb465200700 1 -- 172.21.15.84:0/2501472448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb460103230 msgr2=0x7fb460113e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:30.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.034+0000 7fb465200700 1 --2- 172.21.15.84:0/2501472448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb460103230 0x7fb460113e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.034+0000 7fb465200700 1 -- 172.21.15.84:0/2501472448 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c005040 con 0x7fb4601044e0 2024-04-26T21:17:30.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.034+0000 7fb465200700 1 --2- 172.21.15.84:0/2501472448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4601044e0 0x7fb4601143d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009150 tx=0x7fb44c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:30.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.034+0000 7fb45d600700 1 -- 172.21.15.84:0/2501472448 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb44c00e040 con 0x7fb4601044e0 2024-04-26T21:17:30.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.034+0000 7fb45d600700 1 -- 172.21.15.84:0/2501472448 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb44c00bbf0 con 0x7fb4601044e0 2024-04-26T21:17:30.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.034+0000 7fb467000700 1 -- 172.21.15.84:0/2501472448 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4601154d0 con 0x7fb4601044e0 2024-04-26T21:17:30.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.034+0000 7fb45d600700 1 -- 172.21.15.84:0/2501472448 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb44c01c630 con 0x7fb4601044e0 2024-04-26T21:17:30.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.035+0000 7fb467000700 1 -- 172.21.15.84:0/2501472448 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb460115a90 con 0x7fb4601044e0 2024-04-26T21:17:30.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.036+0000 7fb467000700 1 -- 172.21.15.84:0/2501472448 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb460076060 con 0x7fb4601044e0 2024-04-26T21:17:30.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.037+0000 7fb45d600700 1 -- 172.21.15.84:0/2501472448 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7fb44c00bd60 con 0x7fb4601044e0 2024-04-26T21:17:30.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.037+0000 7fb45d600700 1 --2- 172.21.15.84:0/2501472448 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fb448069210 0x7fb44806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:30.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.038+0000 7fb45d600700 1 -- 172.21.15.84:0/2501472448 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7fb44c0878b0 con 0x7fb4601044e0 2024-04-26T21:17:30.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.038+0000 7fb465c00700 1 --2- 172.21.15.84:0/2501472448 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fb448069210 0x7fb44806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:30.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.038+0000 7fb465c00700 1 --2- 172.21.15.84:0/2501472448 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fb448069210 0x7fb44806b6c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb4540041d0 tx=0x7fb454009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:30.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.042+0000 7fb45d600700 1 -- 172.21.15.84:0/2501472448 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb44c054940 con 0x7fb4601044e0 2024-04-26T21:17:30.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:30.266+0000 7fb467000700 1 -- 172.21.15.84:0/2501472448 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb460115dc0 con 0x7fb448069210 2024-04-26T21:17:31.169 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:30 smithi084 ceph-mon[25539]: pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:31.169 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:30 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T21:17:31.169 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:30 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T21:17:31.169 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:30 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:31.169 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:30 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:31.169 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:30 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:31.169 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:30 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:17:31.169 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:30 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:17:31.169 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:30 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:31.169 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:30 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:31.170 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:30 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:17:31.170 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:30 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:31.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:30 smithi120 ceph-mon[32741]: pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:31.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:30 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T21:17:31.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:30 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T21:17:31.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:30 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:31.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:30 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:31.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:30 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:31.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:30 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:17:31.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:30 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:17:31.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:30 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:31.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:30 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:31.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:30 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:17:31.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:30 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:31.992 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:31 smithi084 ceph-mon[25539]: from='client.14282 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:17:31.992 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:31 smithi084 ceph-mon[25539]: Detected new or changed devices on smithi084 2024-04-26T21:17:31.992 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:31 smithi084 ceph-mon[25539]: Adjusting osd_memory_target on smithi084 to 6432M 2024-04-26T21:17:31.992 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:31 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:17:32.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:31 smithi120 ceph-mon[32741]: from='client.14282 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:17:32.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:31 smithi120 ceph-mon[32741]: Detected new or changed devices on smithi084 2024-04-26T21:17:32.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:31 smithi120 ceph-mon[32741]: Adjusting osd_memory_target on smithi084 to 6432M 2024-04-26T21:17:32.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:31 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:17:33.124 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:32 smithi084 ceph-mon[25539]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:33.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:32 smithi120 ceph-mon[32741]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:34.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:33 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2538580965' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "240901fd-0810-4752-bfa0-2857359b30a2"}]: dispatch 2024-04-26T21:17:34.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:33 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2538580965' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "240901fd-0810-4752-bfa0-2857359b30a2"}]': finished 2024-04-26T21:17:34.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:33 smithi084 ceph-mon[25539]: osdmap e16: 3 total, 2 up, 3 in 2024-04-26T21:17:34.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:33 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:17:34.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:33 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2538580965' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "240901fd-0810-4752-bfa0-2857359b30a2"}]: dispatch 2024-04-26T21:17:34.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:33 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2538580965' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "240901fd-0810-4752-bfa0-2857359b30a2"}]': finished 2024-04-26T21:17:34.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:33 smithi120 ceph-mon[32741]: osdmap e16: 3 total, 2 up, 3 in 2024-04-26T21:17:34.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:33 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:17:35.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:34 smithi084 ceph-mon[25539]: pgmap v74: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:35.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:34 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1104133401' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T21:17:35.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:34 smithi120 ceph-mon[32741]: pgmap v74: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:35.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:34 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/1104133401' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T21:17:37.120 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:36 smithi084 ceph-mon[25539]: pgmap v76: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:37.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:36 smithi120 ceph-mon[32741]: pgmap v76: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:38.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:38 smithi084 ceph-mon[25539]: pgmap v77: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:38.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:38 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:38.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:38 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:38.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:38 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:38.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:38 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:17:38.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:38 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:38.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:38 smithi120 ceph-mon[32741]: pgmap v77: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:38.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:38 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:38.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:38 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:38.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:38 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:38.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:38 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:17:38.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:38 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:40.877 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:40 smithi084 ceph-mon[25539]: pgmap v78: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:40.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:40 smithi120 ceph-mon[32741]: pgmap v78: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:41.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:17:41.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:17:42.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:42 smithi084 ceph-mon[25539]: pgmap v79: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:42.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:42 smithi120 ceph-mon[32741]: pgmap v79: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:43.805 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:43 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T21:17:43.805 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:43 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:43.805 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:43 smithi084 ceph-mon[25539]: Deploying daemon osd.2 on smithi084 2024-04-26T21:17:43.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:43 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T21:17:43.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:43 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:43.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:43 smithi120 ceph-mon[32741]: Deploying daemon osd.2 on smithi084 2024-04-26T21:17:44.822 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:44 smithi084 ceph-mon[25539]: pgmap v80: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:44.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:44 smithi120 ceph-mon[32741]: pgmap v80: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:46.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:46 smithi084 ceph-mon[25539]: pgmap v81: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:46.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:46 smithi120 ceph-mon[32741]: pgmap v81: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:48.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:48 smithi084 ceph-mon[25539]: pgmap v82: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:48.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:48 smithi120 ceph-mon[32741]: pgmap v82: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:50.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:50 smithi084 ceph-mon[25539]: pgmap v83: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:50.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:50 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:17:50.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:50 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:50.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:50 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:50.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:50 smithi120 ceph-mon[32741]: pgmap v83: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:50.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:50 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:17:50.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:50 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:50.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:50 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:52.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:52 smithi084 ceph-mon[25539]: pgmap v84: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:52.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:52 smithi120 ceph-mon[32741]: pgmap v84: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:54.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:54 smithi084 ceph-mon[25539]: pgmap v85: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:54.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:54 smithi084 ceph-mon[25539]: from='osd.2 [v2:172.21.15.84:6818/1485373275,v1:172.21.15.84:6819/1485373275]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T21:17:54.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:54 smithi120 ceph-mon[32741]: pgmap v85: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:54.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:54 smithi120 ceph-mon[32741]: from='osd.2 [v2:172.21.15.84:6818/1485373275,v1:172.21.15.84:6819/1485373275]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T21:17:55.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:55 smithi120 ceph-mon[32741]: from='osd.2 [v2:172.21.15.84:6818/1485373275,v1:172.21.15.84:6819/1485373275]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T21:17:55.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:55 smithi120 ceph-mon[32741]: osdmap e17: 3 total, 2 up, 3 in 2024-04-26T21:17:55.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:55 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:17:55.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:55 smithi120 ceph-mon[32741]: from='osd.2 [v2:172.21.15.84:6818/1485373275,v1:172.21.15.84:6819/1485373275]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-04-26T21:17:55.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:55 smithi120 ceph-mon[32741]: from='osd.2 [v2:172.21.15.84:6818/1485373275,v1:172.21.15.84:6819/1485373275]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-04-26T21:17:55.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:55 smithi120 ceph-mon[32741]: osdmap e18: 3 total, 2 up, 3 in 2024-04-26T21:17:55.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:55 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:17:55.965 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:55 smithi084 ceph-mon[25539]: from='osd.2 [v2:172.21.15.84:6818/1485373275,v1:172.21.15.84:6819/1485373275]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T21:17:55.965 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:55 smithi084 ceph-mon[25539]: osdmap e17: 3 total, 2 up, 3 in 2024-04-26T21:17:55.965 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:55 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:17:55.965 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:55 smithi084 ceph-mon[25539]: from='osd.2 [v2:172.21.15.84:6818/1485373275,v1:172.21.15.84:6819/1485373275]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-04-26T21:17:55.965 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:55 smithi084 ceph-mon[25539]: from='osd.2 [v2:172.21.15.84:6818/1485373275,v1:172.21.15.84:6819/1485373275]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-04-26T21:17:55.965 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:55 smithi084 ceph-mon[25539]: osdmap e18: 3 total, 2 up, 3 in 2024-04-26T21:17:55.966 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:55 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:17:56.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:56.046+0000 7fb45d600700 1 -- 172.21.15.84:0/2501472448 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb460115dc0 con 0x7fb448069210 2024-04-26T21:17:56.048 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 2 on host 'smithi084' 2024-04-26T21:17:56.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:56.049+0000 7fb467000700 1 -- 172.21.15.84:0/2501472448 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fb448069210 msgr2=0x7fb44806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:56.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:56.049+0000 7fb467000700 1 --2- 172.21.15.84:0/2501472448 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fb448069210 0x7fb44806b6c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb4540041d0 tx=0x7fb454009040 comp rx=0 tx=0).stop 2024-04-26T21:17:56.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:56.049+0000 7fb467000700 1 -- 172.21.15.84:0/2501472448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4601044e0 msgr2=0x7fb4601143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:56.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:56.049+0000 7fb467000700 1 --2- 172.21.15.84:0/2501472448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4601044e0 0x7fb4601143d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009150 tx=0x7fb44c009e30 comp rx=0 tx=0).stop 2024-04-26T21:17:56.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:56.049+0000 7fb467000700 1 -- 172.21.15.84:0/2501472448 shutdown_connections 2024-04-26T21:17:56.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:56.049+0000 7fb467000700 1 --2- 172.21.15.84:0/2501472448 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fb448069210 0x7fb44806b6c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:56.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:56.049+0000 7fb467000700 1 --2- 172.21.15.84:0/2501472448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb460103230 0x7fb460113e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:56.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:56.049+0000 7fb467000700 1 --2- 172.21.15.84:0/2501472448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4601044e0 0x7fb4601143d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:56.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:56.049+0000 7fb467000700 1 -- 172.21.15.84:0/2501472448 >> 172.21.15.84:0/2501472448 conn(0x7fb4600724d0 msgr2=0x7fb460074b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:56.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:56.050+0000 7fb467000700 1 -- 172.21.15.84:0/2501472448 shutdown_connections 2024-04-26T21:17:56.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:17:56.050+0000 7fb467000700 1 -- 172.21.15.84:0/2501472448 wait complete. 2024-04-26T21:17:56.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:56 smithi084 ceph-mon[25539]: pgmap v87: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:56.930 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:56 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:17:56.930 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:56 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:56.930 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:56 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:56.930 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:56 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:17:56.930 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:56 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:17:57.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:56 smithi120 ceph-mon[32741]: pgmap v87: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:57.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:56 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:17:57.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:56 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:57.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:56 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:57.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:56 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:17:57.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:56 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:17:57.210 DEBUG:teuthology.orchestra.run.smithi084:osd.2> sudo journalctl -f -n 0 -u ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.2.service 2024-04-26T21:17:57.216 INFO:tasks.cephadm:Deploying osd.3 on smithi120 with /dev/vg_nvme/lv_4... 2024-04-26T21:17:57.216 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-26T21:17:57.662 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi120/config 2024-04-26T21:17:58.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:58 smithi084 ceph-mon[25539]: osd.2 [v2:172.21.15.84:6818/1485373275,v1:172.21.15.84:6819/1485373275] boot 2024-04-26T21:17:58.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:58 smithi084 ceph-mon[25539]: osdmap e19: 3 total, 3 up, 3 in 2024-04-26T21:17:58.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:58 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:17:58.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:58 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-04-26T21:17:58.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:58 smithi120 ceph-mon[32741]: osd.2 [v2:172.21.15.84:6818/1485373275,v1:172.21.15.84:6819/1485373275] boot 2024-04-26T21:17:58.404 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:58 smithi120 ceph-mon[32741]: osdmap e19: 3 total, 3 up, 3 in 2024-04-26T21:17:58.404 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:58 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:17:58.404 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:58 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-04-26T21:17:59.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:59 smithi084 ceph-mon[25539]: purged_snaps scrub starts 2024-04-26T21:17:59.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:59 smithi084 ceph-mon[25539]: purged_snaps scrub ok 2024-04-26T21:17:59.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:59 smithi084 ceph-mon[25539]: pgmap v90: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:59.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:59 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-04-26T21:17:59.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:59 smithi084 ceph-mon[25539]: osdmap e20: 3 total, 3 up, 3 in 2024-04-26T21:17:59.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:59 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T21:17:59.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:59 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:59.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:17:59 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:59.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:59 smithi120 ceph-mon[32741]: purged_snaps scrub starts 2024-04-26T21:17:59.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:59 smithi120 ceph-mon[32741]: purged_snaps scrub ok 2024-04-26T21:17:59.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:59 smithi120 ceph-mon[32741]: pgmap v90: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-26T21:17:59.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:59 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-04-26T21:17:59.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:59 smithi120 ceph-mon[32741]: osdmap e20: 3 total, 3 up, 3 in 2024-04-26T21:17:59.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:59 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T21:17:59.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:59 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:17:59.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:17:59 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:00.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:00 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-26T21:18:00.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:00 smithi084 ceph-mon[25539]: osdmap e21: 3 total, 3 up, 3 in 2024-04-26T21:18:00.162 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:17:59 smithi084 sudo[60521]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T21:18:00.162 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:17:59 smithi084 sudo[60521]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T21:18:00.162 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:17:59 smithi084 sudo[60521]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T21:18:00.163 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:17:59 smithi084 sudo[60521]: pam_unix(sudo:session): session closed for user root 2024-04-26T21:18:00.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:00 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-26T21:18:00.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:00 smithi120 ceph-mon[32741]: osdmap e21: 3 total, 3 up, 3 in 2024-04-26T21:18:00.645 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:18:00 smithi084 sudo[60579]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T21:18:00.645 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:18:00 smithi084 sudo[60579]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T21:18:00.645 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:18:00 smithi084 sudo[60579]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T21:18:00.645 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:18:00 smithi084 sudo[60579]: pam_unix(sudo:session): session closed for user root 2024-04-26T21:18:00.655 INFO:teuthology.orchestra.run.smithi120.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-26T21:18:00.656 INFO:teuthology.orchestra.run.smithi120.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-26T21:18:00.656 INFO:teuthology.orchestra.run.smithi120.stderr: stderr: 10+0 records in 2024-04-26T21:18:00.656 INFO:teuthology.orchestra.run.smithi120.stderr:10+0 records out 2024-04-26T21:18:00.656 INFO:teuthology.orchestra.run.smithi120.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0357335 s, 293 MB/s 2024-04-26T21:18:00.656 INFO:teuthology.orchestra.run.smithi120.stderr:--> Zapping successful for: 2024-04-26T21:18:01.362 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:18:01 smithi084 sudo[60601]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T21:18:01.363 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:18:01 smithi084 sudo[60601]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T21:18:01.363 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:18:01 smithi084 sudo[60601]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T21:18:01.363 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:18:01 smithi084 sudo[60601]: pam_unix(sudo:session): session closed for user root 2024-04-26T21:18:01.363 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:01 smithi084 ceph-mon[25539]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:01.363 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:01 smithi084 ceph-mon[25539]: mgrmap e19: smithi084.gyasul(active, since 2m), standbys: smithi120.zjaduj 2024-04-26T21:18:01.363 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:01 smithi084 ceph-mon[25539]: osdmap e22: 3 total, 3 up, 3 in 2024-04-26T21:18:01.363 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:01 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:01.404 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:01 smithi120 ceph-mon[32741]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:01.404 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:01 smithi120 ceph-mon[32741]: mgrmap e19: smithi084.gyasul(active, since 2m), standbys: smithi120.zjaduj 2024-04-26T21:18:01.405 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:01 smithi120 ceph-mon[32741]: osdmap e22: 3 total, 3 up, 3 in 2024-04-26T21:18:01.405 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:01 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:01.473 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi120:vg_nvme/lv_4 2024-04-26T21:18:01.912 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:18:01 smithi084 sudo[60625]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T21:18:01.912 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:18:01 smithi084 sudo[60625]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T21:18:01.912 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:18:01 smithi084 sudo[60625]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T21:18:01.912 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:18:01 smithi084 sudo[60625]: pam_unix(sudo:session): session closed for user root 2024-04-26T21:18:01.928 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi120/config 2024-04-26T21:18:02.254 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:02 smithi084 ceph-mon[25539]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:02.374 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:02 smithi120 ceph-mon[32741]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:02.663 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:18:02 smithi084 sudo[60638]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T21:18:02.663 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:18:02 smithi084 sudo[60638]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T21:18:02.663 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:18:02 smithi084 sudo[60638]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T21:18:02.663 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:18:02 smithi084 sudo[60638]: pam_unix(sudo:session): session closed for user root 2024-04-26T21:18:03.162 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:18:02 smithi084 sudo[60665]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T21:18:03.162 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:18:02 smithi084 sudo[60665]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T21:18:03.162 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:18:02 smithi084 sudo[60665]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T21:18:03.162 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:18:02 smithi084 sudo[60665]: pam_unix(sudo:session): session closed for user root 2024-04-26T21:18:03.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:03 smithi084 sudo[63008]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T21:18:03.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:03 smithi084 sudo[63008]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T21:18:03.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:03 smithi084 sudo[63008]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T21:18:03.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:03 smithi084 sudo[63008]: pam_unix(sudo:session): session closed for user root 2024-04-26T21:18:04.111 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:03 smithi084 sudo[63337]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T21:18:04.111 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:04 smithi084 sudo[63337]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T21:18:04.111 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:04 smithi084 sudo[63337]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T21:18:04.111 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:04 smithi084 sudo[63337]: pam_unix(sudo:session): session closed for user root 2024-04-26T21:18:04.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:04 smithi120 sudo[35844]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T21:18:04.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:04 smithi120 sudo[35844]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T21:18:04.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:04 smithi120 sudo[35844]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T21:18:04.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:04 smithi120 sudo[35844]: pam_unix(sudo:session): session closed for user root 2024-04-26T21:18:05.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.159+0000 7f2f7b800700 1 -- 172.21.15.120:0/4086014272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f74071ef0 msgr2=0x7f2f74070400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:05.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.159+0000 7f2f7b800700 1 --2- 172.21.15.120:0/4086014272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f74071ef0 0x7f2f74070400 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2f68004940 tx=0x7f2f68009e30 comp rx=0 tx=0).stop 2024-04-26T21:18:05.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.159+0000 7f2f7b800700 1 -- 172.21.15.120:0/4086014272 shutdown_connections 2024-04-26T21:18:05.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.159+0000 7f2f7b800700 1 --2- 172.21.15.120:0/4086014272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f74070940 0x7f2f74070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:05.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.159+0000 7f2f7b800700 1 --2- 172.21.15.120:0/4086014272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f74071ef0 0x7f2f74070400 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:05.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.159+0000 7f2f7b800700 1 -- 172.21.15.120:0/4086014272 >> 172.21.15.120:0/4086014272 conn(0x7f2f740f8560 msgr2=0x7f2f740fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:05.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.159+0000 7f2f7b800700 1 -- 172.21.15.120:0/4086014272 shutdown_connections 2024-04-26T21:18:05.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.159+0000 7f2f7b800700 1 -- 172.21.15.120:0/4086014272 wait complete. 2024-04-26T21:18:05.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.160+0000 7f2f7b800700 1 Processor -- start 2024-04-26T21:18:05.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.161+0000 7f2f7b800700 1 -- start start 2024-04-26T21:18:05.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.161+0000 7f2f7b800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f74070940 0x7f2f7410fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:05.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.161+0000 7f2f7b800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f74071ef0 0x7f2f74110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:05.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.161+0000 7f2f7b800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f74110700 con 0x7f2f74070940 2024-04-26T21:18:05.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.161+0000 7f2f7b800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f74110f50 con 0x7f2f74071ef0 2024-04-26T21:18:05.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.161+0000 7f2f73e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f74071ef0 0x7f2f74110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:05.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.161+0000 7f2f73e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f74071ef0 0x7f2f74110100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37466/0 (socket says 172.21.15.120:37466) 2024-04-26T21:18:05.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.161+0000 7f2f73e00700 1 -- 172.21.15.120:0/2574461133 learned_addr learned my addr 172.21.15.120:0/2574461133 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:18:05.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.162+0000 7f2f73e00700 1 -- 172.21.15.120:0/2574461133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f74070940 msgr2=0x7f2f7410fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:05.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.162+0000 7f2f73e00700 1 --2- 172.21.15.120:0/2574461133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f74070940 0x7f2f7410fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:05.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.162+0000 7f2f73e00700 1 -- 172.21.15.120:0/2574461133 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f68005040 con 0x7f2f74071ef0 2024-04-26T21:18:05.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.162+0000 7f2f73e00700 1 --2- 172.21.15.120:0/2574461133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f74071ef0 0x7f2f74110100 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000eb70 tx=0x7f2f6000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:05.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.164+0000 7f2f70c00700 1 -- 172.21.15.120:0/2574461133 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f60007cc0 con 0x7f2f74071ef0 2024-04-26T21:18:05.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.164+0000 7f2f70c00700 1 -- 172.21.15.120:0/2574461133 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f6000f040 con 0x7f2f74071ef0 2024-04-26T21:18:05.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.164+0000 7f2f70c00700 1 -- 172.21.15.120:0/2574461133 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f60009640 con 0x7f2f74071ef0 2024-04-26T21:18:05.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.164+0000 7f2f7b800700 1 -- 172.21.15.120:0/2574461133 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f741111d0 con 0x7f2f74071ef0 2024-04-26T21:18:05.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.164+0000 7f2f7b800700 1 -- 172.21.15.120:0/2574461133 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f74111710 con 0x7f2f74071ef0 2024-04-26T21:18:05.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.165+0000 7f2f7b800700 1 -- 172.21.15.120:0/2574461133 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f7405f5c0 con 0x7f2f74071ef0 2024-04-26T21:18:05.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.166+0000 7f2f70c00700 1 -- 172.21.15.120:0/2574461133 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f2f600097a0 con 0x7f2f74071ef0 2024-04-26T21:18:05.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.167+0000 7f2f70c00700 1 --2- 172.21.15.120:0/2574461133 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2f5c0692b0 0x7f2f5c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:05.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.167+0000 7f2f70c00700 1 -- 172.21.15.120:0/2574461133 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3228+0+0 (secure 0 0 0) 0x7f2f600864e0 con 0x7f2f74071ef0 2024-04-26T21:18:05.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.168+0000 7f2f78e00700 1 --2- 172.21.15.120:0/2574461133 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2f5c0692b0 0x7f2f5c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:05.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.169+0000 7f2f78e00700 1 --2- 172.21.15.120:0/2574461133 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2f5c0692b0 0x7f2f5c06b760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009fd0 tx=0x7f2f68009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:05.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.172+0000 7f2f70c00700 1 -- 172.21.15.120:0/2574461133 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2f60056ac0 con 0x7f2f74071ef0 2024-04-26T21:18:05.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:05.385+0000 7f2f7b800700 1 -- 172.21.15.120:0/2574461133 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f74111af0 con 0x7f2f5c0692b0 2024-04-26T21:18:05.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:05 smithi084 ceph-mon[25539]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T21:18:05.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:05 smithi084 ceph-mon[25539]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T21:18:05.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:05 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-04-26T21:18:05.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:05 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:18:05.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:05 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-04-26T21:18:05.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:05 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:18:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:05 smithi120 sudo[35847]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T21:18:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:05 smithi120 sudo[35847]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T21:18:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:05 smithi120 sudo[35847]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T21:18:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:05 smithi120 sudo[35847]: pam_unix(sudo:session): session closed for user root 2024-04-26T21:18:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:05 smithi120 ceph-mon[32741]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T21:18:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:05 smithi120 ceph-mon[32741]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T21:18:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:05 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-04-26T21:18:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:05 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:18:05.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:05 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-04-26T21:18:05.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:05 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:18:06.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:06.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T21:18:06.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: Detected new or changed devices on smithi084 2024-04-26T21:18:06.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T21:18:06.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:06.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:06.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:18:06.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:18:06.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:18:06.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: Adjusting osd_memory_target on smithi084 to 4288M 2024-04-26T21:18:06.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:06.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:06.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:18:06.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:06.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:06.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: from='client.24123 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:18:06.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T21:18:06.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T21:18:06.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:06.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:06.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:06 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:06.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:06.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T21:18:06.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: Detected new or changed devices on smithi084 2024-04-26T21:18:06.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T21:18:06.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:06.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:06.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:18:06.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:18:06.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:18:06.515 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: Adjusting osd_memory_target on smithi084 to 4288M 2024-04-26T21:18:06.515 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:06.515 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:06.515 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:18:06.515 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:06.515 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:06.515 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: from='client.24123 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:18:06.515 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T21:18:06.515 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T21:18:06.515 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:06.515 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:06.515 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:06 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:08.843 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:08 smithi084 ceph-mon[25539]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:08.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:08 smithi120 ceph-mon[32741]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:09.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:09 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/2327498421' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2d8384f-8b7d-4da4-8a67-4bdb83753822"}]: dispatch 2024-04-26T21:18:09.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:09 smithi084 ceph-mon[25539]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2d8384f-8b7d-4da4-8a67-4bdb83753822"}]: dispatch 2024-04-26T21:18:09.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:09 smithi084 ceph-mon[25539]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2d8384f-8b7d-4da4-8a67-4bdb83753822"}]': finished 2024-04-26T21:18:09.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:09 smithi084 ceph-mon[25539]: osdmap e23: 4 total, 3 up, 4 in 2024-04-26T21:18:09.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:09 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:18:09.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:09 smithi120 ceph-mon[32741]: from='client.? 172.21.15.120:0/2327498421' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2d8384f-8b7d-4da4-8a67-4bdb83753822"}]: dispatch 2024-04-26T21:18:09.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:09 smithi120 ceph-mon[32741]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2d8384f-8b7d-4da4-8a67-4bdb83753822"}]: dispatch 2024-04-26T21:18:09.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:09 smithi120 ceph-mon[32741]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2d8384f-8b7d-4da4-8a67-4bdb83753822"}]': finished 2024-04-26T21:18:09.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:09 smithi120 ceph-mon[32741]: osdmap e23: 4 total, 3 up, 4 in 2024-04-26T21:18:09.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:09 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:18:10.618 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:10 smithi084 ceph-mon[25539]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-26T21:18:10.618 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:10 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/672396262' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T21:18:10.775 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:10 smithi120 ceph-mon[32741]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-26T21:18:10.776 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:10 smithi120 ceph-mon[32741]: from='client.? 172.21.15.120:0/672396262' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T21:18:12.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:12 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:12.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:12 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:12.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:12 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:12.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:12 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:18:12.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:12 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:12.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:12 smithi084 ceph-mon[25539]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-04-26T21:18:12.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:12 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:18:12.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:12 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:12.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:12 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:12.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:12 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:12.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:12 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:18:12.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:12 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:12.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:12 smithi120 ceph-mon[32741]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-04-26T21:18:12.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:12 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:18:14.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:14 smithi120 ceph-mon[32741]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-26T21:18:14.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:14 smithi084 ceph-mon[25539]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-26T21:18:16.619 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:16 smithi120 ceph-mon[32741]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-26T21:18:16.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:16 smithi084 ceph-mon[25539]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-26T21:18:18.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:18 smithi084 ceph-mon[25539]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-26T21:18:18.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:18 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T21:18:18.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:18 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:18.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:18 smithi120 ceph-mon[32741]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-26T21:18:18.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:18 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T21:18:18.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:18 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:19.862 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:19 smithi120 ceph-mon[32741]: Deploying daemon osd.3 on smithi120 2024-04-26T21:18:19.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:19 smithi084 ceph-mon[25539]: Deploying daemon osd.3 on smithi120 2024-04-26T21:18:20.791 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:20 smithi120 ceph-mon[32741]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:20.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:20 smithi084 ceph-mon[25539]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:22.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:22 smithi120 ceph-mon[32741]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:22.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:22 smithi084 ceph-mon[25539]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:24.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:24 smithi084 ceph-mon[25539]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:24.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:24 smithi120 ceph-mon[32741]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:27.327 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:27 smithi120 ceph-mon[32741]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:27.327 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:27 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:27.327 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:27 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:27.327 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:27 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:27.327 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:27 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:18:27.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:27 smithi084 ceph-mon[25539]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:27.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:27 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:27.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:27 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:27.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:27 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:27.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:27 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:18:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:29 smithi084 ceph-mon[25539]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:29.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:29 smithi120 ceph-mon[32741]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:30.402 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:30 smithi120 ceph-mon[32741]: from='osd.3 [v2:172.21.15.120:6800/1269727678,v1:172.21.15.120:6801/1269727678]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T21:18:30.402 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:30 smithi120 ceph-mon[32741]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T21:18:30.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:30 smithi084 ceph-mon[25539]: from='osd.3 [v2:172.21.15.120:6800/1269727678,v1:172.21.15.120:6801/1269727678]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T21:18:30.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:30 smithi084 ceph-mon[25539]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T21:18:30.896 INFO:teuthology.orchestra.run.smithi120.stdout:Created osd(s) 3 on host 'smithi120' 2024-04-26T21:18:30.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:30.894+0000 7f2f70c00700 1 -- 172.21.15.120:0/2574461133 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2f74111af0 con 0x7f2f5c0692b0 2024-04-26T21:18:30.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:30.899+0000 7f2f7b800700 1 -- 172.21.15.120:0/2574461133 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2f5c0692b0 msgr2=0x7f2f5c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:30.899+0000 7f2f7b800700 1 --2- 172.21.15.120:0/2574461133 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2f5c0692b0 0x7f2f5c06b760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009fd0 tx=0x7f2f68009e30 comp rx=0 tx=0).stop 2024-04-26T21:18:30.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:30.899+0000 7f2f7b800700 1 -- 172.21.15.120:0/2574461133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f74071ef0 msgr2=0x7f2f74110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:30.899+0000 7f2f7b800700 1 --2- 172.21.15.120:0/2574461133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f74071ef0 0x7f2f74110100 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000eb70 tx=0x7f2f6000b040 comp rx=0 tx=0).stop 2024-04-26T21:18:30.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:30.899+0000 7f2f7b800700 1 -- 172.21.15.120:0/2574461133 shutdown_connections 2024-04-26T21:18:30.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:30.899+0000 7f2f7b800700 1 --2- 172.21.15.120:0/2574461133 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2f5c0692b0 0x7f2f5c06b760 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:30.899+0000 7f2f7b800700 1 --2- 172.21.15.120:0/2574461133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f74070940 0x7f2f7410fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:30.899+0000 7f2f7b800700 1 --2- 172.21.15.120:0/2574461133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f74071ef0 0x7f2f74110100 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:30.899+0000 7f2f7b800700 1 -- 172.21.15.120:0/2574461133 >> 172.21.15.120:0/2574461133 conn(0x7f2f740f8560 msgr2=0x7f2f740f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:30.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:30.900+0000 7f2f7b800700 1 -- 172.21.15.120:0/2574461133 shutdown_connections 2024-04-26T21:18:30.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:30.900+0000 7f2f7b800700 1 -- 172.21.15.120:0/2574461133 wait complete. 2024-04-26T21:18:31.311 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:31 smithi120 ceph-mon[32741]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:31.311 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:31 smithi120 ceph-mon[32741]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T21:18:31.311 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:31 smithi120 ceph-mon[32741]: osdmap e24: 4 total, 3 up, 4 in 2024-04-26T21:18:31.311 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:31 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:18:31.311 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:31 smithi120 ceph-mon[32741]: from='osd.3 [v2:172.21.15.120:6800/1269727678,v1:172.21.15.120:6801/1269727678]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:18:31.312 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:31 smithi120 ceph-mon[32741]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:18:31.312 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:31 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:31.312 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:31 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:31.312 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:31 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:31.312 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:31 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:31.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:31 smithi084 ceph-mon[25539]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:31 smithi084 ceph-mon[25539]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T21:18:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:31 smithi084 ceph-mon[25539]: osdmap e24: 4 total, 3 up, 4 in 2024-04-26T21:18:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:31 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:18:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:31 smithi084 ceph-mon[25539]: from='osd.3 [v2:172.21.15.120:6800/1269727678,v1:172.21.15.120:6801/1269727678]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:18:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:31 smithi084 ceph-mon[25539]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:18:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:31 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:31 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:31 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:31 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:31.697 DEBUG:teuthology.orchestra.run.smithi120:osd.3> sudo journalctl -f -n 0 -u ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.3.service 2024-04-26T21:18:31.702 INFO:tasks.cephadm:Deploying osd.4 on smithi120 with /dev/vg_nvme/lv_3... 2024-04-26T21:18:31.703 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-26T21:18:32.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:32 smithi084 ceph-mon[25539]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-04-26T21:18:32.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:32 smithi084 ceph-mon[25539]: osdmap e25: 4 total, 3 up, 4 in 2024-04-26T21:18:32.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:32 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:18:32.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:32 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:18:32.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:32 smithi084 ceph-mon[25539]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:32.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:32 smithi120 ceph-mon[32741]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-04-26T21:18:32.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:32 smithi120 ceph-mon[32741]: osdmap e25: 4 total, 3 up, 4 in 2024-04-26T21:18:32.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:32 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:18:32.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:32 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:18:32.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:32 smithi120 ceph-mon[32741]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-26T21:18:33.127 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi120/config 2024-04-26T21:18:33.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:33 smithi084 ceph-mon[25539]: purged_snaps scrub starts 2024-04-26T21:18:33.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:33 smithi084 ceph-mon[25539]: purged_snaps scrub ok 2024-04-26T21:18:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:33 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:18:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:33 smithi084 ceph-mon[25539]: osd.3 [v2:172.21.15.120:6800/1269727678,v1:172.21.15.120:6801/1269727678] boot 2024-04-26T21:18:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:33 smithi084 ceph-mon[25539]: osdmap e26: 4 total, 4 up, 4 in 2024-04-26T21:18:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:33 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:18:33.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:33 smithi120 ceph-mon[32741]: purged_snaps scrub starts 2024-04-26T21:18:33.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:33 smithi120 ceph-mon[32741]: purged_snaps scrub ok 2024-04-26T21:18:33.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:33 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:18:33.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:33 smithi120 ceph-mon[32741]: osd.3 [v2:172.21.15.120:6800/1269727678,v1:172.21.15.120:6801/1269727678] boot 2024-04-26T21:18:33.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:33 smithi120 ceph-mon[32741]: osdmap e26: 4 total, 4 up, 4 in 2024-04-26T21:18:33.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:33 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:18:34.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:34 smithi120 ceph-mon[32741]: osdmap e27: 4 total, 4 up, 4 in 2024-04-26T21:18:34.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:34 smithi120 ceph-mon[32741]: pgmap v116: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:18:34.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:34 smithi084 ceph-mon[25539]: osdmap e27: 4 total, 4 up, 4 in 2024-04-26T21:18:34.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:34 smithi084 ceph-mon[25539]: pgmap v116: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:18:35.261 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:35 smithi120 ceph-mon[32741]: osdmap e28: 4 total, 4 up, 4 in 2024-04-26T21:18:35.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:35 smithi084 ceph-mon[25539]: osdmap e28: 4 total, 4 up, 4 in 2024-04-26T21:18:36.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:36 smithi120 ceph-mon[32741]: osdmap e29: 4 total, 4 up, 4 in 2024-04-26T21:18:36.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:36 smithi120 ceph-mon[32741]: pgmap v119: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:18:36.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:36 smithi084 ceph-mon[25539]: osdmap e29: 4 total, 4 up, 4 in 2024-04-26T21:18:36.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:36 smithi084 ceph-mon[25539]: pgmap v119: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:18:36.675 INFO:teuthology.orchestra.run.smithi120.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-26T21:18:36.676 INFO:teuthology.orchestra.run.smithi120.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-26T21:18:36.676 INFO:teuthology.orchestra.run.smithi120.stderr: stderr: 10+0 records in 2024-04-26T21:18:36.676 INFO:teuthology.orchestra.run.smithi120.stderr:10+0 records out 2024-04-26T21:18:36.676 INFO:teuthology.orchestra.run.smithi120.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0369808 s, 284 MB/s 2024-04-26T21:18:36.676 INFO:teuthology.orchestra.run.smithi120.stderr:--> Zapping successful for: 2024-04-26T21:18:37.423 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:37 smithi120 ceph-mon[32741]: osdmap e30: 4 total, 4 up, 4 in 2024-04-26T21:18:37.423 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:37 smithi120 ceph-mon[32741]: Detected new or changed devices on smithi120 2024-04-26T21:18:37.424 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:37 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:37.424 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:37 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:37.424 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:37 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:18:37.424 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:37 smithi120 ceph-mon[32741]: Adjusting osd_memory_target on smithi120 to 15937M 2024-04-26T21:18:37.424 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:37 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:37.424 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:37 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:37.424 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:37 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:18:37.425 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:37 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:37.425 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:37 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:37.425 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:37 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:37.425 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:37 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:18:37.425 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:37 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:37.474 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi120:vg_nvme/lv_3 2024-04-26T21:18:37.565 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:37 smithi084 ceph-mon[25539]: osdmap e30: 4 total, 4 up, 4 in 2024-04-26T21:18:37.566 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:37 smithi084 ceph-mon[25539]: Detected new or changed devices on smithi120 2024-04-26T21:18:37.566 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:37 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:37.566 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:37 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:37.566 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:37 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:18:37.566 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:37 smithi084 ceph-mon[25539]: Adjusting osd_memory_target on smithi120 to 15937M 2024-04-26T21:18:37.566 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:37 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:37.566 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:37 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:37.566 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:37 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:18:37.566 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:37 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:37.566 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:37 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:37.566 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:37 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:37.566 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:37 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:18:37.566 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:37 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:18:37.930 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi120/config 2024-04-26T21:18:38.331 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:38 smithi120 ceph-mon[32741]: pgmap v121: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:18:38.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:38 smithi084 ceph-mon[25539]: pgmap v121: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:18:40.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.332+0000 7fc630200700 1 -- 172.21.15.120:0/1975997986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6281046a0 msgr2=0x7fc628104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:40.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.332+0000 7fc630200700 1 --2- 172.21.15.120:0/1975997986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6281046a0 0x7fc628104b10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc614004940 tx=0x7fc614009e30 comp rx=0 tx=0).stop 2024-04-26T21:18:40.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.332+0000 7fc630200700 1 -- 172.21.15.120:0/1975997986 shutdown_connections 2024-04-26T21:18:40.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.332+0000 7fc630200700 1 --2- 172.21.15.120:0/1975997986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6281046a0 0x7fc628104b10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:40.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.332+0000 7fc630200700 1 --2- 172.21.15.120:0/1975997986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6281033f0 0x7fc628103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:40.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.332+0000 7fc630200700 1 -- 172.21.15.120:0/1975997986 >> 172.21.15.120:0/1975997986 conn(0x7fc6280725e0 msgr2=0x7fc628074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:40.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.332+0000 7fc630200700 1 -- 172.21.15.120:0/1975997986 shutdown_connections 2024-04-26T21:18:40.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.333+0000 7fc630200700 1 -- 172.21.15.120:0/1975997986 wait complete. 2024-04-26T21:18:40.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.333+0000 7fc630200700 1 Processor -- start 2024-04-26T21:18:40.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.333+0000 7fc630200700 1 -- start start 2024-04-26T21:18:40.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.334+0000 7fc630200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6281033f0 0x7fc628113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:40.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.334+0000 7fc630200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6281046a0 0x7fc628114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:40.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.334+0000 7fc630200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc628114a40 con 0x7fc6281046a0 2024-04-26T21:18:40.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.334+0000 7fc630200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc628114bb0 con 0x7fc6281033f0 2024-04-26T21:18:40.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.334+0000 7fc62d800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6281033f0 0x7fc628113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:40.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.334+0000 7fc62d800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6281033f0 0x7fc628113f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37544/0 (socket says 172.21.15.120:37544) 2024-04-26T21:18:40.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.334+0000 7fc62d800700 1 -- 172.21.15.120:0/3390940042 learned_addr learned my addr 172.21.15.120:0/3390940042 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:18:40.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.334+0000 7fc62ce00700 1 --2- 172.21.15.120:0/3390940042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6281046a0 0x7fc628114440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:40.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.335+0000 7fc62d800700 1 -- 172.21.15.120:0/3390940042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6281046a0 msgr2=0x7fc628114440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:40.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.335+0000 7fc62d800700 1 --2- 172.21.15.120:0/3390940042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6281046a0 0x7fc628114440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:40.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.335+0000 7fc62d800700 1 -- 172.21.15.120:0/3390940042 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc614005040 con 0x7fc6281033f0 2024-04-26T21:18:40.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.335+0000 7fc62d800700 1 --2- 172.21.15.120:0/3390940042 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6281033f0 0x7fc628113f00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc61c002a50 tx=0x7fc61c0046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:40.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.335+0000 7fc625600700 1 -- 172.21.15.120:0/3390940042 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc61c007cc0 con 0x7fc6281033f0 2024-04-26T21:18:40.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.335+0000 7fc625600700 1 -- 172.21.15.120:0/3390940042 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc61c00f040 con 0x7fc6281033f0 2024-04-26T21:18:40.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.335+0000 7fc630200700 1 -- 172.21.15.120:0/3390940042 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc628119610 con 0x7fc6281033f0 2024-04-26T21:18:40.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.335+0000 7fc625600700 1 -- 172.21.15.120:0/3390940042 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc61c009640 con 0x7fc6281033f0 2024-04-26T21:18:40.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.335+0000 7fc630200700 1 -- 172.21.15.120:0/3390940042 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc628119bd0 con 0x7fc6281033f0 2024-04-26T21:18:40.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.337+0000 7fc630200700 1 -- 172.21.15.120:0/3390940042 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62804c710 con 0x7fc6281033f0 2024-04-26T21:18:40.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.338+0000 7fc625600700 1 -- 172.21.15.120:0/3390940042 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fc61c0097a0 con 0x7fc6281033f0 2024-04-26T21:18:40.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.338+0000 7fc625600700 1 --2- 172.21.15.120:0/3390940042 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc6100692a0 0x7fc61006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:40.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.339+0000 7fc625600700 1 -- 172.21.15.120:0/3390940042 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3770+0+0 (secure 0 0 0) 0x7fc61c086930 con 0x7fc6281033f0 2024-04-26T21:18:40.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.339+0000 7fc62ce00700 1 --2- 172.21.15.120:0/3390940042 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc6100692a0 0x7fc61006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:40.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.340+0000 7fc62ce00700 1 --2- 172.21.15.120:0/3390940042 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc6100692a0 0x7fc61006b750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc61400b3b0 tx=0x7fc614009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:40.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.343+0000 7fc625600700 1 -- 172.21.15.120:0/3390940042 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc61c056d10 con 0x7fc6281033f0 2024-04-26T21:18:40.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:18:40.563+0000 7fc630200700 1 -- 172.21.15.120:0/3390940042 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6281089b0 con 0x7fc6100692a0 2024-04-26T21:18:40.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:40 smithi084 ceph-mon[25539]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-26T21:18:40.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:40 smithi120 ceph-mon[32741]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-26T21:18:41.727 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:41 smithi120 ceph-mon[32741]: from='client.24141 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:18:41.728 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T21:18:41.728 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T21:18:41.728 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:41.728 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:18:41.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:41 smithi084 ceph-mon[25539]: from='client.24141 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:18:41.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T21:18:41.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T21:18:41.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:41.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:18:42.807 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:42 smithi120 ceph-mon[32741]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-04-26T21:18:42.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:42 smithi084 ceph-mon[25539]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-04-26T21:18:44.876 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:44 smithi120 ceph-mon[32741]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-04-26T21:18:44.876 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:44 smithi120 ceph-mon[32741]: from='client.? 172.21.15.120:0/739757330' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27aa8cbb-e94e-4e63-b2d4-be8a71b292ae"}]: dispatch 2024-04-26T21:18:44.876 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:44 smithi120 ceph-mon[32741]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27aa8cbb-e94e-4e63-b2d4-be8a71b292ae"}]: dispatch 2024-04-26T21:18:44.876 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:44 smithi120 ceph-mon[32741]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "27aa8cbb-e94e-4e63-b2d4-be8a71b292ae"}]': finished 2024-04-26T21:18:44.876 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:44 smithi120 ceph-mon[32741]: osdmap e31: 5 total, 4 up, 5 in 2024-04-26T21:18:44.876 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:44 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:18:44.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:44 smithi084 ceph-mon[25539]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-04-26T21:18:44.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:44 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/739757330' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27aa8cbb-e94e-4e63-b2d4-be8a71b292ae"}]: dispatch 2024-04-26T21:18:44.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:44 smithi084 ceph-mon[25539]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27aa8cbb-e94e-4e63-b2d4-be8a71b292ae"}]: dispatch 2024-04-26T21:18:44.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:44 smithi084 ceph-mon[25539]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "27aa8cbb-e94e-4e63-b2d4-be8a71b292ae"}]': finished 2024-04-26T21:18:44.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:44 smithi084 ceph-mon[25539]: osdmap e31: 5 total, 4 up, 5 in 2024-04-26T21:18:44.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:44 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:18:45.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:45 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/3580022364' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T21:18:45.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:45 smithi120 ceph-mon[32741]: from='client.? 172.21.15.120:0/3580022364' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T21:18:46.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:46 smithi084 ceph-mon[25539]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-04-26T21:18:46.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:46 smithi120 ceph-mon[32741]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-04-26T21:18:48.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:48 smithi084 ceph-mon[25539]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T21:18:48.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:48 smithi120 ceph-mon[32741]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T21:18:50.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:50 smithi120 ceph-mon[32741]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:18:50.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:50 smithi084 ceph-mon[25539]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:18:52.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:52 smithi084 ceph-mon[25539]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:18:52.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:52 smithi120 ceph-mon[32741]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:18:53.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:53 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T21:18:53.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:53 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:53.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:53 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T21:18:53.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:53 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:54.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:54 smithi084 ceph-mon[25539]: Deploying daemon osd.4 on smithi120 2024-04-26T21:18:54.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:54 smithi084 ceph-mon[25539]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:18:54.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:54 smithi120 ceph-mon[32741]: Deploying daemon osd.4 on smithi120 2024-04-26T21:18:54.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:54 smithi120 ceph-mon[32741]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:18:56.878 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:56 smithi120 ceph-mon[32741]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:18:56.879 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:56 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:18:56.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:56 smithi084 ceph-mon[25539]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:18:56.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:56 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:18:58.817 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:18:58 smithi120 ceph-mon[32741]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:18:58.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:18:58 smithi084 ceph-mon[25539]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:19:00.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:00 smithi084 ceph-mon[25539]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:19:00.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:00 smithi120 ceph-mon[32741]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:19:01.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:01 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:19:01.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:01 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:01.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:01 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:01.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:01 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:19:01.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:01 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:01.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:01 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:02.906 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:02 smithi120 ceph-mon[32741]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:19:02.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:02 smithi084 ceph-mon[25539]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:19:04.823 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:04 smithi120 ceph-mon[32741]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:19:04.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:04 smithi084 ceph-mon[25539]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:19:05.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:05.769+0000 7fc625600700 1 -- 172.21.15.120:0/3390940042 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc6281089b0 con 0x7fc6100692a0 2024-04-26T21:19:05.771 INFO:teuthology.orchestra.run.smithi120.stdout:Created osd(s) 4 on host 'smithi120' 2024-04-26T21:19:05.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:05.772+0000 7fc630200700 1 -- 172.21.15.120:0/3390940042 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc6100692a0 msgr2=0x7fc61006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:05.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:05.772+0000 7fc630200700 1 --2- 172.21.15.120:0/3390940042 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc6100692a0 0x7fc61006b750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc61400b3b0 tx=0x7fc614009e30 comp rx=0 tx=0).stop 2024-04-26T21:19:05.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:05.772+0000 7fc630200700 1 -- 172.21.15.120:0/3390940042 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6281033f0 msgr2=0x7fc628113f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:05.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:05.772+0000 7fc630200700 1 --2- 172.21.15.120:0/3390940042 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6281033f0 0x7fc628113f00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc61c002a50 tx=0x7fc61c0046b0 comp rx=0 tx=0).stop 2024-04-26T21:19:05.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:05.772+0000 7fc630200700 1 -- 172.21.15.120:0/3390940042 shutdown_connections 2024-04-26T21:19:05.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:05.772+0000 7fc630200700 1 --2- 172.21.15.120:0/3390940042 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc6100692a0 0x7fc61006b750 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:05.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:05.772+0000 7fc630200700 1 --2- 172.21.15.120:0/3390940042 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6281033f0 0x7fc628113f00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:05.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:05.772+0000 7fc630200700 1 --2- 172.21.15.120:0/3390940042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6281046a0 0x7fc628114440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:05.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:05.772+0000 7fc630200700 1 -- 172.21.15.120:0/3390940042 >> 172.21.15.120:0/3390940042 conn(0x7fc6280725e0 msgr2=0x7fc628073cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:05.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:05.772+0000 7fc630200700 1 -- 172.21.15.120:0/3390940042 shutdown_connections 2024-04-26T21:19:05.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:05.772+0000 7fc630200700 1 -- 172.21.15.120:0/3390940042 wait complete. 2024-04-26T21:19:05.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:05 smithi084 ceph-mon[25539]: from='osd.4 [v2:172.21.15.120:6808/3403602597,v1:172.21.15.120:6809/3403602597]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T21:19:05.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:05 smithi084 ceph-mon[25539]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T21:19:05.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:05 smithi120 ceph-mon[32741]: from='osd.4 [v2:172.21.15.120:6808/3403602597,v1:172.21.15.120:6809/3403602597]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T21:19:05.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:05 smithi120 ceph-mon[32741]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T21:19:06.563 DEBUG:teuthology.orchestra.run.smithi120:osd.4> sudo journalctl -f -n 0 -u ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.4.service 2024-04-26T21:19:06.570 INFO:tasks.cephadm:Deploying osd.5 on smithi120 with /dev/vg_nvme/lv_2... 2024-04-26T21:19:06.570 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-26T21:19:06.759 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:06 smithi120 ceph-mon[32741]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:19:06.759 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:06 smithi120 ceph-mon[32741]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T21:19:06.759 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:06 smithi120 ceph-mon[32741]: osdmap e32: 5 total, 4 up, 5 in 2024-04-26T21:19:06.759 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:06 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:19:06.759 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:06 smithi120 ceph-mon[32741]: from='osd.4 [v2:172.21.15.120:6808/3403602597,v1:172.21.15.120:6809/3403602597]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:19:06.759 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:06 smithi120 ceph-mon[32741]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:19:06.759 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:06 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:06.759 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:06 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:06.759 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:06 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:06.759 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:06 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:06.760 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:19:06 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[44891]: 2024-04-26T21:19:06.684+0000 7eff13600700 -1 osd.4 0 waiting for initial osdmap 2024-04-26T21:19:06.760 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:19:06 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[44891]: 2024-04-26T21:19:06.701+0000 7eff08c00700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:19:07.066 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi120/config 2024-04-26T21:19:07.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:06 smithi084 ceph-mon[25539]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:19:07.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:06 smithi084 ceph-mon[25539]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T21:19:07.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:06 smithi084 ceph-mon[25539]: osdmap e32: 5 total, 4 up, 5 in 2024-04-26T21:19:07.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:06 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:19:07.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:06 smithi084 ceph-mon[25539]: from='osd.4 [v2:172.21.15.120:6808/3403602597,v1:172.21.15.120:6809/3403602597]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:19:07.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:06 smithi084 ceph-mon[25539]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:19:07.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:06 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:07.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:06 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:07.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:06 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:07.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:06 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:07.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:07 smithi120 ceph-mon[32741]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-04-26T21:19:07.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:07 smithi120 ceph-mon[32741]: osdmap e33: 5 total, 4 up, 5 in 2024-04-26T21:19:07.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:07 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:19:07.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:07 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:19:08.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:07 smithi084 ceph-mon[25539]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-04-26T21:19:08.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:07 smithi084 ceph-mon[25539]: osdmap e33: 5 total, 4 up, 5 in 2024-04-26T21:19:08.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:07 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:19:08.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:07 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:19:08.763 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:08 smithi120 ceph-mon[32741]: purged_snaps scrub starts 2024-04-26T21:19:08.763 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:08 smithi120 ceph-mon[32741]: purged_snaps scrub ok 2024-04-26T21:19:08.763 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:08 smithi120 ceph-mon[32741]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:19:08.763 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:08 smithi120 ceph-mon[32741]: osd.4 [v2:172.21.15.120:6808/3403602597,v1:172.21.15.120:6809/3403602597] boot 2024-04-26T21:19:08.763 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:08 smithi120 ceph-mon[32741]: osdmap e34: 5 total, 5 up, 5 in 2024-04-26T21:19:08.763 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:08 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:19:09.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:08 smithi084 ceph-mon[25539]: purged_snaps scrub starts 2024-04-26T21:19:09.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:08 smithi084 ceph-mon[25539]: purged_snaps scrub ok 2024-04-26T21:19:09.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:08 smithi084 ceph-mon[25539]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-26T21:19:09.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:08 smithi084 ceph-mon[25539]: osd.4 [v2:172.21.15.120:6808/3403602597,v1:172.21.15.120:6809/3403602597] boot 2024-04-26T21:19:09.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:08 smithi084 ceph-mon[25539]: osdmap e34: 5 total, 5 up, 5 in 2024-04-26T21:19:09.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:08 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:19:10.153 INFO:teuthology.orchestra.run.smithi120.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-26T21:19:10.153 INFO:teuthology.orchestra.run.smithi120.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-26T21:19:10.153 INFO:teuthology.orchestra.run.smithi120.stderr: stderr: 10+0 records in 2024-04-26T21:19:10.153 INFO:teuthology.orchestra.run.smithi120.stderr:10+0 records out 2024-04-26T21:19:10.153 INFO:teuthology.orchestra.run.smithi120.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0423162 s, 248 MB/s 2024-04-26T21:19:10.153 INFO:teuthology.orchestra.run.smithi120.stderr:--> Zapping successful for: 2024-04-26T21:19:10.153 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:09 smithi120 ceph-mon[32741]: osdmap e35: 5 total, 5 up, 5 in 2024-04-26T21:19:10.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:09 smithi084 ceph-mon[25539]: osdmap e35: 5 total, 5 up, 5 in 2024-04-26T21:19:10.878 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:10 smithi120 ceph-mon[32741]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:11.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:10 smithi084 ceph-mon[25539]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:11.212 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi120:vg_nvme/lv_2 2024-04-26T21:19:11.653 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi120/config 2024-04-26T21:19:11.986 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:11 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:19:12.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:11 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:19:12.911 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:12 smithi120 ceph-mon[32741]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:13.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:12 smithi084 ceph-mon[25539]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:14.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.427+0000 7fc278400700 1 -- 172.21.15.120:0/3519550071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2700727c0 msgr2=0x7fc270072bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:14.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.427+0000 7fc278400700 1 --2- 172.21.15.120:0/3519550071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2700727c0 0x7fc270072bd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc264004940 tx=0x7fc264009e30 comp rx=0 tx=0).stop 2024-04-26T21:19:14.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.428+0000 7fc278400700 1 -- 172.21.15.120:0/3519550071 shutdown_connections 2024-04-26T21:19:14.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.428+0000 7fc278400700 1 --2- 172.21.15.120:0/3519550071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc270073110 0x7fc270073b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:14.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.428+0000 7fc278400700 1 --2- 172.21.15.120:0/3519550071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2700727c0 0x7fc270072bd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:14.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.428+0000 7fc278400700 1 -- 172.21.15.120:0/3519550071 >> 172.21.15.120:0/3519550071 conn(0x7fc2700fa8f0 msgr2=0x7fc2700fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:14.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.428+0000 7fc278400700 1 -- 172.21.15.120:0/3519550071 shutdown_connections 2024-04-26T21:19:14.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.428+0000 7fc278400700 1 -- 172.21.15.120:0/3519550071 wait complete. 2024-04-26T21:19:14.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.429+0000 7fc278400700 1 Processor -- start 2024-04-26T21:19:14.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.429+0000 7fc278400700 1 -- start start 2024-04-26T21:19:14.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.429+0000 7fc278400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2700727c0 0x7fc270114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:14.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.429+0000 7fc278400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2701145a0 0x7fc2701153f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:14.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.429+0000 7fc278400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc270114a60 con 0x7fc2700727c0 2024-04-26T21:19:14.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.429+0000 7fc278400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc270114ba0 con 0x7fc2701145a0 2024-04-26T21:19:14.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.429+0000 7fc275000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2701145a0 0x7fc2701153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:14.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.429+0000 7fc275000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2701145a0 0x7fc2701153f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46890/0 (socket says 172.21.15.120:46890) 2024-04-26T21:19:14.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.430+0000 7fc275000700 1 -- 172.21.15.120:0/622387826 learned_addr learned my addr 172.21.15.120:0/622387826 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:19:14.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.430+0000 7fc275a00700 1 --2- 172.21.15.120:0/622387826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2700727c0 0x7fc270114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:14.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.430+0000 7fc275000700 1 -- 172.21.15.120:0/622387826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2700727c0 msgr2=0x7fc270114060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:14.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.430+0000 7fc275000700 1 --2- 172.21.15.120:0/622387826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2700727c0 0x7fc270114060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:14.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.430+0000 7fc275000700 1 -- 172.21.15.120:0/622387826 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc264005040 con 0x7fc2701145a0 2024-04-26T21:19:14.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.430+0000 7fc275000700 1 --2- 172.21.15.120:0/622387826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2701145a0 0x7fc2701153f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00c830 tx=0x7fc25c004470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:14.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.431+0000 7fc26d600700 1 -- 172.21.15.120:0/622387826 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc25c00a760 con 0x7fc2701145a0 2024-04-26T21:19:14.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.431+0000 7fc26d600700 1 -- 172.21.15.120:0/622387826 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc25c00ad90 con 0x7fc2701145a0 2024-04-26T21:19:14.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.431+0000 7fc278400700 1 -- 172.21.15.120:0/622387826 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc270115a50 con 0x7fc2701145a0 2024-04-26T21:19:14.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.431+0000 7fc26d600700 1 -- 172.21.15.120:0/622387826 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc25c0113a0 con 0x7fc2701145a0 2024-04-26T21:19:14.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.431+0000 7fc278400700 1 -- 172.21.15.120:0/622387826 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc270115fe0 con 0x7fc2701145a0 2024-04-26T21:19:14.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.432+0000 7fc278400700 1 -- 172.21.15.120:0/622387826 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27010c6d0 con 0x7fc2701145a0 2024-04-26T21:19:14.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.433+0000 7fc26d600700 1 -- 172.21.15.120:0/622387826 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fc25c012400 con 0x7fc2701145a0 2024-04-26T21:19:14.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.434+0000 7fc26d600700 1 --2- 172.21.15.120:0/622387826 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc2580692b0 0x7fc25806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:14.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.434+0000 7fc26d600700 1 -- 172.21.15.120:0/622387826 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4202+0+0 (secure 0 0 0) 0x7fc25c086d20 con 0x7fc2701145a0 2024-04-26T21:19:14.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.435+0000 7fc275a00700 1 --2- 172.21.15.120:0/622387826 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc2580692b0 0x7fc25806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:14.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.436+0000 7fc275a00700 1 --2- 172.21.15.120:0/622387826 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc2580692b0 0x7fc25806b760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc26400b3b0 tx=0x7fc264009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:14.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.439+0000 7fc26d600700 1 -- 172.21.15.120:0/622387826 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc25c056fb0 con 0x7fc2701145a0 2024-04-26T21:19:14.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:14.658+0000 7fc278400700 1 -- 172.21.15.120:0/622387826 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc270073110 con 0x7fc2580692b0 2024-04-26T21:19:15.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:14 smithi120 ceph-mon[32741]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:15.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:14 smithi120 ceph-mon[32741]: Detected new or changed devices on smithi120 2024-04-26T21:19:15.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:14 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:15.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:14 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:15.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:14 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:19:15.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:14 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:19:15.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:14 smithi120 ceph-mon[32741]: Adjusting osd_memory_target on smithi120 to 7968M 2024-04-26T21:19:15.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:14 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:15.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:14 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:15.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:14 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:19:15.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:14 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:15.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:14 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:19:15.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:14 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:15.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:14 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:19:15.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:14 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:15.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:14 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T21:19:15.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:14 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T21:19:15.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:14 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:14 smithi084 ceph-mon[25539]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:14 smithi084 ceph-mon[25539]: Detected new or changed devices on smithi120 2024-04-26T21:19:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:14 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:14 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:14 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:19:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:14 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:19:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:14 smithi084 ceph-mon[25539]: Adjusting osd_memory_target on smithi120 to 7968M 2024-04-26T21:19:15.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:14 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:15.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:14 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:15.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:14 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:19:15.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:14 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:15.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:14 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:19:15.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:14 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:15.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:14 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:19:15.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:14 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:15.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:14 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T21:19:15.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:14 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T21:19:15.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:14 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:16.157 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:15 smithi120 ceph-mon[32741]: from='client.24159 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:19:16.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:15 smithi084 ceph-mon[25539]: from='client.24159 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:19:17.169 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:16 smithi120 ceph-mon[32741]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:16 smithi084 ceph-mon[25539]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:19.214 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:18 smithi120 ceph-mon[32741]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:19.214 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:18 smithi120 ceph-mon[32741]: from='client.? 172.21.15.120:0/3155191876' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e13abdd9-155d-40a0-a69a-4448a658ee5b"}]: dispatch 2024-04-26T21:19:19.214 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:18 smithi120 ceph-mon[32741]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e13abdd9-155d-40a0-a69a-4448a658ee5b"}]: dispatch 2024-04-26T21:19:19.214 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:18 smithi120 ceph-mon[32741]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e13abdd9-155d-40a0-a69a-4448a658ee5b"}]': finished 2024-04-26T21:19:19.214 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:18 smithi120 ceph-mon[32741]: osdmap e36: 6 total, 5 up, 6 in 2024-04-26T21:19:19.214 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:18 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:19:19.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:18 smithi084 ceph-mon[25539]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:19.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:18 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/3155191876' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e13abdd9-155d-40a0-a69a-4448a658ee5b"}]: dispatch 2024-04-26T21:19:19.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:18 smithi084 ceph-mon[25539]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e13abdd9-155d-40a0-a69a-4448a658ee5b"}]: dispatch 2024-04-26T21:19:19.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:18 smithi084 ceph-mon[25539]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e13abdd9-155d-40a0-a69a-4448a658ee5b"}]': finished 2024-04-26T21:19:19.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:18 smithi084 ceph-mon[25539]: osdmap e36: 6 total, 5 up, 6 in 2024-04-26T21:19:19.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:18 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:19:20.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:19 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/2041222189' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T21:19:20.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:19 smithi120 ceph-mon[32741]: from='client.? 172.21.15.120:0/2041222189' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T21:19:21.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:20 smithi084 ceph-mon[25539]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:21.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:20 smithi120 ceph-mon[32741]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:23.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:22 smithi084 ceph-mon[25539]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:23.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:22 smithi120 ceph-mon[32741]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:25.051 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:24 smithi120 ceph-mon[32741]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:25.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:24 smithi084 ceph-mon[25539]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:27.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:26 smithi084 ceph-mon[25539]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:27.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:26 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:19:27.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:26 smithi120 ceph-mon[32741]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:27.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:26 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:19:28.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:27 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T21:19:28.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:27 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:28.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:27 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T21:19:28.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:27 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:29.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:28 smithi120 ceph-mon[32741]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:29.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:28 smithi120 ceph-mon[32741]: Deploying daemon osd.5 on smithi120 2024-04-26T21:19:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:28 smithi084 ceph-mon[25539]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:28 smithi084 ceph-mon[25539]: Deploying daemon osd.5 on smithi120 2024-04-26T21:19:31.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:30 smithi120 ceph-mon[32741]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:31.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:30 smithi084 ceph-mon[25539]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:33.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:32 smithi120 ceph-mon[32741]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:33.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:32 smithi084 ceph-mon[25539]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:35.384 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:34 smithi120 ceph-mon[32741]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:35.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:34 smithi084 ceph-mon[25539]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:37.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:36 smithi084 ceph-mon[25539]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:37.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:36 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:37.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:36 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:37.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:36 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:19:37.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:36 smithi120 ceph-mon[32741]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:37.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:36 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:37.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:36 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:37.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:36 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:19:38.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:38 smithi120 ceph-mon[32741]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:39.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:38 smithi084 ceph-mon[25539]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:40.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:39 smithi120 ceph-mon[32741]: from='osd.5 [v2:172.21.15.120:6816/2091850685,v1:172.21.15.120:6817/2091850685]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T21:19:40.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:39 smithi120 ceph-mon[32741]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T21:19:40.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:39 smithi084 ceph-mon[25539]: from='osd.5 [v2:172.21.15.120:6816/2091850685,v1:172.21.15.120:6817/2091850685]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T21:19:40.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:39 smithi084 ceph-mon[25539]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T21:19:40.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:40.922+0000 7fc26d600700 1 -- 172.21.15.120:0/622387826 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc270073110 con 0x7fc2580692b0 2024-04-26T21:19:40.923 INFO:teuthology.orchestra.run.smithi120.stdout:Created osd(s) 5 on host 'smithi120' 2024-04-26T21:19:40.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:40.925+0000 7fc278400700 1 -- 172.21.15.120:0/622387826 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc2580692b0 msgr2=0x7fc25806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:40.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:40.925+0000 7fc278400700 1 --2- 172.21.15.120:0/622387826 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc2580692b0 0x7fc25806b760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc26400b3b0 tx=0x7fc264009e30 comp rx=0 tx=0).stop 2024-04-26T21:19:40.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:40.925+0000 7fc278400700 1 -- 172.21.15.120:0/622387826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2701145a0 msgr2=0x7fc2701153f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:40.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:40.925+0000 7fc278400700 1 --2- 172.21.15.120:0/622387826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2701145a0 0x7fc2701153f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00c830 tx=0x7fc25c004470 comp rx=0 tx=0).stop 2024-04-26T21:19:40.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:40.925+0000 7fc278400700 1 -- 172.21.15.120:0/622387826 shutdown_connections 2024-04-26T21:19:40.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:40.925+0000 7fc278400700 1 --2- 172.21.15.120:0/622387826 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc2580692b0 0x7fc25806b760 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:40.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:40.925+0000 7fc278400700 1 --2- 172.21.15.120:0/622387826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2700727c0 0x7fc270114060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:40.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:40.925+0000 7fc278400700 1 --2- 172.21.15.120:0/622387826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2701145a0 0x7fc2701153f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:40.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:40.925+0000 7fc278400700 1 -- 172.21.15.120:0/622387826 >> 172.21.15.120:0/622387826 conn(0x7fc2700fa8f0 msgr2=0x7fc2700fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:40.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:40.926+0000 7fc278400700 1 -- 172.21.15.120:0/622387826 shutdown_connections 2024-04-26T21:19:40.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:40.926+0000 7fc278400700 1 -- 172.21.15.120:0/622387826 wait complete. 2024-04-26T21:19:41.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:40 smithi120 ceph-mon[32741]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:41.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:40 smithi120 ceph-mon[32741]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T21:19:41.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:40 smithi120 ceph-mon[32741]: osdmap e37: 6 total, 5 up, 6 in 2024-04-26T21:19:41.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:40 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:19:41.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:40 smithi120 ceph-mon[32741]: from='osd.5 [v2:172.21.15.120:6816/2091850685,v1:172.21.15.120:6817/2091850685]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:19:41.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:40 smithi120 ceph-mon[32741]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:19:41.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:40 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:41.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:40 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:41.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:40 smithi084 ceph-mon[25539]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:41.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:40 smithi084 ceph-mon[25539]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T21:19:41.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:40 smithi084 ceph-mon[25539]: osdmap e37: 6 total, 5 up, 6 in 2024-04-26T21:19:41.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:19:41.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:40 smithi084 ceph-mon[25539]: from='osd.5 [v2:172.21.15.120:6816/2091850685,v1:172.21.15.120:6817/2091850685]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:19:41.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:40 smithi084 ceph-mon[25539]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:19:41.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:41.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:40 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:41.745 DEBUG:teuthology.orchestra.run.smithi120:osd.5> sudo journalctl -f -n 0 -u ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.5.service 2024-04-26T21:19:41.750 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-04-26T21:19:41.750 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-26T21:19:42.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:41 smithi084 ceph-mon[25539]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-04-26T21:19:42.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:41 smithi084 ceph-mon[25539]: osdmap e38: 6 total, 5 up, 6 in 2024-04-26T21:19:42.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:19:42.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:19:42.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:19:42.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:42.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:42.236 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:41 smithi120 ceph-mon[32741]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-04-26T21:19:42.237 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:41 smithi120 ceph-mon[32741]: osdmap e38: 6 total, 5 up, 6 in 2024-04-26T21:19:42.237 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:19:42.237 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:19:42.237 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:19:42.237 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:42.237 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:42.237 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:19:43.137 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:42 smithi120 ceph-mon[32741]: purged_snaps scrub starts 2024-04-26T21:19:43.137 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:42 smithi120 ceph-mon[32741]: purged_snaps scrub ok 2024-04-26T21:19:43.137 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:42 smithi120 ceph-mon[32741]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:43.137 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:42 smithi120 ceph-mon[32741]: osd.5 [v2:172.21.15.120:6816/2091850685,v1:172.21.15.120:6817/2091850685] boot 2024-04-26T21:19:43.137 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:42 smithi120 ceph-mon[32741]: osdmap e39: 6 total, 6 up, 6 in 2024-04-26T21:19:43.138 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:42 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:19:43.403 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:42 smithi084 ceph-mon[25539]: purged_snaps scrub starts 2024-04-26T21:19:43.403 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:42 smithi084 ceph-mon[25539]: purged_snaps scrub ok 2024-04-26T21:19:43.403 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:42 smithi084 ceph-mon[25539]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-26T21:19:43.403 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:42 smithi084 ceph-mon[25539]: osd.5 [v2:172.21.15.120:6816/2091850685,v1:172.21.15.120:6817/2091850685] boot 2024-04-26T21:19:43.403 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:42 smithi084 ceph-mon[25539]: osdmap e39: 6 total, 6 up, 6 in 2024-04-26T21:19:43.403 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:42 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:19:44.041 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:43 smithi084 ceph-mon[25539]: osdmap e40: 6 total, 6 up, 6 in 2024-04-26T21:19:44.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:43 smithi120 ceph-mon[32741]: osdmap e40: 6 total, 6 up, 6 in 2024-04-26T21:19:44.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.203+0000 7fbf50c00700 1 -- 172.21.15.84:0/566535241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf4c1033f0 msgr2=0x7fbf4c103800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.203+0000 7fbf50c00700 1 --2- 172.21.15.84:0/566535241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf4c1033f0 0x7fbf4c103800 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c004940 tx=0x7fbf3c009e30 comp rx=0 tx=0).stop 2024-04-26T21:19:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.203+0000 7fbf50c00700 1 -- 172.21.15.84:0/566535241 shutdown_connections 2024-04-26T21:19:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.203+0000 7fbf50c00700 1 --2- 172.21.15.84:0/566535241 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf4c1046a0 0x7fbf4c104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.203+0000 7fbf50c00700 1 --2- 172.21.15.84:0/566535241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf4c1033f0 0x7fbf4c103800 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.203+0000 7fbf50c00700 1 -- 172.21.15.84:0/566535241 >> 172.21.15.84:0/566535241 conn(0x7fbf4c0725e0 msgr2=0x7fbf4c074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.203+0000 7fbf50c00700 1 -- 172.21.15.84:0/566535241 shutdown_connections 2024-04-26T21:19:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.203+0000 7fbf50c00700 1 -- 172.21.15.84:0/566535241 wait complete. 2024-04-26T21:19:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.204+0000 7fbf50c00700 1 Processor -- start 2024-04-26T21:19:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.204+0000 7fbf50c00700 1 -- start start 2024-04-26T21:19:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.204+0000 7fbf50c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf4c1033f0 0x7fbf4c113f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.204+0000 7fbf50c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf4c1046a0 0x7fbf4c114460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.204+0000 7fbf50c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c114af0 con 0x7fbf4c1046a0 2024-04-26T21:19:44.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.204+0000 7fbf50c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c119490 con 0x7fbf4c1033f0 2024-04-26T21:19:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.205+0000 7fbf49400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf4c1046a0 0x7fbf4c114460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.205+0000 7fbf49400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf4c1046a0 0x7fbf4c114460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43200/0 (socket says 172.21.15.84:43200) 2024-04-26T21:19:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.205+0000 7fbf49400700 1 -- 172.21.15.84:0/1095641651 learned_addr learned my addr 172.21.15.84:0/1095641651 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:19:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.205+0000 7fbf49e00700 1 --2- 172.21.15.84:0/1095641651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf4c1033f0 0x7fbf4c113f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.205+0000 7fbf49400700 1 -- 172.21.15.84:0/1095641651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf4c1033f0 msgr2=0x7fbf4c113f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.205+0000 7fbf49400700 1 --2- 172.21.15.84:0/1095641651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf4c1033f0 0x7fbf4c113f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.205+0000 7fbf49400700 1 -- 172.21.15.84:0/1095641651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3c005040 con 0x7fbf4c1046a0 2024-04-26T21:19:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.205+0000 7fbf49400700 1 --2- 172.21.15.84:0/1095641651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf4c1046a0 0x7fbf4c114460 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800b790 tx=0x7fbf38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.206+0000 7fbf42000700 1 -- 172.21.15.84:0/1095641651 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf3800f770 con 0x7fbf4c1046a0 2024-04-26T21:19:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.206+0000 7fbf42000700 1 -- 172.21.15.84:0/1095641651 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf3800fda0 con 0x7fbf4c1046a0 2024-04-26T21:19:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.206+0000 7fbf50c00700 1 -- 172.21.15.84:0/1095641651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4c1196f0 con 0x7fbf4c1046a0 2024-04-26T21:19:44.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.206+0000 7fbf42000700 1 -- 172.21.15.84:0/1095641651 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf3800d310 con 0x7fbf4c1046a0 2024-04-26T21:19:44.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.206+0000 7fbf50c00700 1 -- 172.21.15.84:0/1095641651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4c119c60 con 0x7fbf4c1046a0 2024-04-26T21:19:44.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.207+0000 7fbf50c00700 1 -- 172.21.15.84:0/1095641651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4c04c710 con 0x7fbf4c1046a0 2024-04-26T21:19:44.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.208+0000 7fbf42000700 1 -- 172.21.15.84:0/1095641651 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fbf38010420 con 0x7fbf4c1046a0 2024-04-26T21:19:44.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.209+0000 7fbf42000700 1 --2- 172.21.15.84:0/1095641651 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fbf300692a0 0x7fbf3006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:44.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.209+0000 7fbf42000700 1 -- 172.21.15.84:0/1095641651 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fbf38086f20 con 0x7fbf4c1046a0 2024-04-26T21:19:44.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.209+0000 7fbf49e00700 1 --2- 172.21.15.84:0/1095641651 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fbf300692a0 0x7fbf3006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:44.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.210+0000 7fbf49e00700 1 --2- 172.21.15.84:0/1095641651 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fbf300692a0 0x7fbf3006b750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00b3b0 tx=0x7fbf3c009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:44.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.214+0000 7fbf42000700 1 -- 172.21.15.84:0/1095641651 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbf38056f80 con 0x7fbf4c1046a0 2024-04-26T21:19:44.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.425+0000 7fbf50c00700 1 -- 172.21.15.84:0/1095641651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fbf4c11a130 con 0x7fbf4c1046a0 2024-04-26T21:19:44.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.426+0000 7fbf42000700 1 -- 172.21.15.84:0/1095641651 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7fbf38056b10 con 0x7fbf4c1046a0 2024-04-26T21:19:44.427 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:19:44.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.429+0000 7fbf50c00700 1 -- 172.21.15.84:0/1095641651 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fbf300692a0 msgr2=0x7fbf3006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:44.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.429+0000 7fbf50c00700 1 --2- 172.21.15.84:0/1095641651 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fbf300692a0 0x7fbf3006b750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00b3b0 tx=0x7fbf3c009e30 comp rx=0 tx=0).stop 2024-04-26T21:19:44.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.429+0000 7fbf50c00700 1 -- 172.21.15.84:0/1095641651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf4c1046a0 msgr2=0x7fbf4c114460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:44.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.429+0000 7fbf50c00700 1 --2- 172.21.15.84:0/1095641651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf4c1046a0 0x7fbf4c114460 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800b790 tx=0x7fbf38009250 comp rx=0 tx=0).stop 2024-04-26T21:19:44.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.429+0000 7fbf50c00700 1 -- 172.21.15.84:0/1095641651 shutdown_connections 2024-04-26T21:19:44.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.429+0000 7fbf50c00700 1 --2- 172.21.15.84:0/1095641651 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fbf300692a0 0x7fbf3006b750 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:44.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.429+0000 7fbf50c00700 1 --2- 172.21.15.84:0/1095641651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf4c1033f0 0x7fbf4c113f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:44.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.429+0000 7fbf50c00700 1 --2- 172.21.15.84:0/1095641651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf4c1046a0 0x7fbf4c114460 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:44.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.429+0000 7fbf50c00700 1 -- 172.21.15.84:0/1095641651 >> 172.21.15.84:0/1095641651 conn(0x7fbf4c0725e0 msgr2=0x7fbf4c073c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:44.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.429+0000 7fbf50c00700 1 -- 172.21.15.84:0/1095641651 shutdown_connections 2024-04-26T21:19:44.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:44.429+0000 7fbf50c00700 1 -- 172.21.15.84:0/1095641651 wait complete. 2024-04-26T21:19:45.091 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:44 smithi084 ceph-mon[25539]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:19:45.091 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:44 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1095641651' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T21:19:45.149 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1714166381,"num_in_osds":6,"osd_in_since":1714166358,"num_remapped_pgs":0} 2024-04-26T21:19:45.149 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T21:19:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:44 smithi120 ceph-mon[32741]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:19:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:44 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/1095641651' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T21:19:45.620 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:19:47.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:46 smithi084 ceph-mon[25539]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:19:47.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:46 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:47.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:46 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:47.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:46 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:19:47.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:46 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:19:47.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:46 smithi120 ceph-mon[32741]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:19:47.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:47.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:47.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:19:47.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:46 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:19:47.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.665+0000 7f9e06800700 1 -- 172.21.15.84:0/1228780355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e00104fd0 msgr2=0x7f9e001053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:47.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.665+0000 7f9e06800700 1 --2- 172.21.15.84:0/1228780355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e00104fd0 0x7f9e001053a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9df0004940 tx=0x7f9df0009e30 comp rx=0 tx=0).stop 2024-04-26T21:19:47.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.665+0000 7f9e06800700 1 -- 172.21.15.84:0/1228780355 shutdown_connections 2024-04-26T21:19:47.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.665+0000 7f9e06800700 1 --2- 172.21.15.84:0/1228780355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e00105970 0x7f9e000fefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:47.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.665+0000 7f9e06800700 1 --2- 172.21.15.84:0/1228780355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e00104fd0 0x7f9e001053a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:47.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.665+0000 7f9e06800700 1 -- 172.21.15.84:0/1228780355 >> 172.21.15.84:0/1228780355 conn(0x7f9e000fab80 msgr2=0x7f9e000fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:47.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.665+0000 7f9e06800700 1 -- 172.21.15.84:0/1228780355 shutdown_connections 2024-04-26T21:19:47.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.665+0000 7f9e06800700 1 -- 172.21.15.84:0/1228780355 wait complete. 2024-04-26T21:19:47.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.666+0000 7f9e06800700 1 Processor -- start 2024-04-26T21:19:47.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.666+0000 7f9e06800700 1 -- start start 2024-04-26T21:19:47.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.666+0000 7f9e06800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e00104fd0 0x7f9e00115b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:47.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.666+0000 7f9e06800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e00105970 0x7f9e00116060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:47.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.666+0000 7f9e06800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e001166b0 con 0x7f9e00104fd0 2024-04-26T21:19:47.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.666+0000 7f9e06800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0010fc90 con 0x7f9e00105970 2024-04-26T21:19:47.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.667+0000 7f9dff400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e00104fd0 0x7f9e00115b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:47.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.667+0000 7f9dff400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e00104fd0 0x7f9e00115b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43224/0 (socket says 172.21.15.84:43224) 2024-04-26T21:19:47.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.667+0000 7f9dff400700 1 -- 172.21.15.84:0/2772609666 learned_addr learned my addr 172.21.15.84:0/2772609666 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:19:47.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.667+0000 7f9dfea00700 1 --2- 172.21.15.84:0/2772609666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e00105970 0x7f9e00116060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:47.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.667+0000 7f9dff400700 1 -- 172.21.15.84:0/2772609666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e00105970 msgr2=0x7f9e00116060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:47.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.667+0000 7f9dff400700 1 --2- 172.21.15.84:0/2772609666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e00105970 0x7f9e00116060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:47.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.667+0000 7f9dff400700 1 -- 172.21.15.84:0/2772609666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df0005040 con 0x7f9e00104fd0 2024-04-26T21:19:47.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.667+0000 7f9dfea00700 1 --2- 172.21.15.84:0/2772609666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e00105970 0x7f9e00116060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:19:47.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.667+0000 7f9dff400700 1 --2- 172.21.15.84:0/2772609666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e00104fd0 0x7f9e00115b20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9df000b8b0 tx=0x7f9df0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:47.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.668+0000 7f9df7400700 1 -- 172.21.15.84:0/2772609666 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9df000e040 con 0x7f9e00104fd0 2024-04-26T21:19:47.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.668+0000 7f9df7400700 1 -- 172.21.15.84:0/2772609666 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9df0004290 con 0x7f9e00104fd0 2024-04-26T21:19:47.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.668+0000 7f9e06800700 1 -- 172.21.15.84:0/2772609666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0010ff10 con 0x7f9e00104fd0 2024-04-26T21:19:47.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.668+0000 7f9df7400700 1 -- 172.21.15.84:0/2772609666 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9df001c3f0 con 0x7f9e00104fd0 2024-04-26T21:19:47.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.668+0000 7f9e06800700 1 -- 172.21.15.84:0/2772609666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e00110450 con 0x7f9e00104fd0 2024-04-26T21:19:47.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.669+0000 7f9e06800700 1 -- 172.21.15.84:0/2772609666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e00100720 con 0x7f9e00104fd0 2024-04-26T21:19:47.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.670+0000 7f9df7400700 1 -- 172.21.15.84:0/2772609666 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f9df00137b0 con 0x7f9e00104fd0 2024-04-26T21:19:47.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.671+0000 7f9df7400700 1 --2- 172.21.15.84:0/2772609666 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f9de40692a0 0x7f9de406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:47.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.671+0000 7f9df7400700 1 -- 172.21.15.84:0/2772609666 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9df0088260 con 0x7f9e00104fd0 2024-04-26T21:19:47.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.671+0000 7f9dfea00700 1 --2- 172.21.15.84:0/2772609666 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f9de40692a0 0x7f9de406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:47.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.672+0000 7f9dfea00700 1 --2- 172.21.15.84:0/2772609666 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f9de40692a0 0x7f9de406b750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009b80 tx=0x7f9dec00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:47.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.676+0000 7f9df7400700 1 -- 172.21.15.84:0/2772609666 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9df00582c0 con 0x7f9e00104fd0 2024-04-26T21:19:47.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.893+0000 7f9e06800700 1 -- 172.21.15.84:0/2772609666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e0004c710 con 0x7f9e00104fd0 2024-04-26T21:19:47.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.894+0000 7f9df7400700 1 -- 172.21.15.84:0/2772609666 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11092 (secure 0 0 0) 0x7f9df0057e50 con 0x7f9e00104fd0 2024-04-26T21:19:47.896 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:19:47.896 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":40,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","created":"2024-04-26T21:12:29.304108+0000","modified":"2024-04-26T21:19:42.952340+0000","last_up_change":"2024-04-26T21:19:41.940176+0000","last_in_change":"2024-04-26T21:19:18.310009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:17:58.092436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"d6c04d45-3ba8-4cc3-92ee-2e99279c6da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":4265849542},{"type":"v1","addr":"172.21.15.84:6803","nonce":4265849542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4265849542},{"type":"v1","addr":"172.21.15.84:6805","nonce":4265849542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4265849542},{"type":"v1","addr":"172.21.15.84:6809","nonce":4265849542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":4265849542},{"type":"v1","addr":"172.21.15.84:6807","nonce":4265849542}]},"public_addr":"172.21.15.84:6803/4265849542","cluster_addr":"172.21.15.84:6805/4265849542","heartbeat_back_addr":"172.21.15.84:6809/4265849542","heartbeat_front_addr":"172.21.15.84:6807/4265849542","state":["exists","up"]},{"osd":1,"uuid":"4417e988-3443-4671-8df5-4d964b8e5954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2545485308},{"type":"v1","addr":"172.21.15.84:6811","nonce":2545485308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2545485308},{"type":"v1","addr":"172.21.15.84:6813","nonce":2545485308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2545485308},{"type":"v1","addr":"172.21.15.84:6817","nonce":2545485308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2545485308},{"type":"v1","addr":"172.21.15.84:6815","nonce":2545485308}]},"public_addr":"172.21.15.84:6811/2545485308","cluster_addr":"172.21.15.84:6813/2545485308","heartbeat_back_addr":"172.21.15.84:6817/2545485308","heartbeat_front_addr":"172.21.15.84:6815/2545485308","state":["exists","up"]},{"osd":2,"uuid":"240901fd-0810-4752-bfa0-2857359b30a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1485373275},{"type":"v1","addr":"172.21.15.84:6819","nonce":1485373275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1485373275},{"type":"v1","addr":"172.21.15.84:6821","nonce":1485373275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1485373275},{"type":"v1","addr":"172.21.15.84:6825","nonce":1485373275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1485373275},{"type":"v1","addr":"172.21.15.84:6823","nonce":1485373275}]},"public_addr":"172.21.15.84:6819/1485373275","cluster_addr":"172.21.15.84:6821/1485373275","heartbeat_back_addr":"172.21.15.84:6825/1485373275","heartbeat_front_addr":"172.21.15.84:6823/1485373275","state":["exists","up"]},{"osd":3,"uuid":"f2d8384f-8b7d-4da4-8a67-4bdb83753822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1269727678},{"type":"v1","addr":"172.21.15.120:6801","nonce":1269727678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1269727678},{"type":"v1","addr":"172.21.15.120:6803","nonce":1269727678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1269727678},{"type":"v1","addr":"172.21.15.120:6807","nonce":1269727678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1269727678},{"type":"v1","addr":"172.21.15.120:6805","nonce":1269727678}]},"public_addr":"172.21.15.120:6801/1269727678","cluster_addr":"172.21.15.120:6803/1269727678","heartbeat_back_addr":"172.21.15.120:6807/1269727678","heartbeat_front_addr":"172.21.15.120:6805/1269727678","state":["exists","up"]},{"osd":4,"uuid":"27aa8cbb-e94e-4e63-b2d4-be8a71b292ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3403602597},{"type":"v1","addr":"172.21.15.120:6809","nonce":3403602597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":3403602597},{"type":"v1","addr":"172.21.15.120:6811","nonce":3403602597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":3403602597},{"type":"v1","addr":"172.21.15.120:6815","nonce":3403602597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3403602597},{"type":"v1","addr":"172.21.15.120:6813","nonce":3403602597}]},"public_addr":"172.21.15.120:6809/3403602597","cluster_addr":"172.21.15.120:6811/3403602597","heartbeat_back_addr":"172.21.15.120:6815/3403602597","heartbeat_front_addr":"172.21.15.120:6813/3403602597","state":["exists","up"]},{"osd":5,"uuid":"e13abdd9-155d-40a0-a69a-4448a658ee5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":2091850685},{"type":"v1","addr":"172.21.15.120:6817","nonce":2091850685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":2091850685},{"type":"v1","addr":"172.21.15.120:6819","nonce":2091850685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":2091850685},{"type":"v1","addr":"172.21.15.120:6823","nonce":2091850685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":2091850685},{"type":"v1","addr":"172.21.15.120:6821","nonce":2091850685}]},"public_addr":"172.21.15.120:6817/2091850685","cluster_addr":"172.21.15.120:6819/2091850685","heartbeat_back_addr":"172.21.15.120:6823/2091850685","heartbeat_front_addr":"172.21.15.120:6821/2091850685","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:45.823555+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:17:20.567670+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:17:55.623700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:18:31.061632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:19:06.227030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:19:40.886216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/1001623":"2024-04-27T21:15:11.400421+0000","172.21.15.84:0/3356039008":"2024-04-27T21:15:11.400421+0000","172.21.15.84:6800/3446199945":"2024-04-27T21:15:11.400421+0000","172.21.15.84:6801/2151160823":"2024-04-27T21:13:42.669268+0000","172.21.15.84:6800/2151160823":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/1155142360":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/1430131141":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/801206978":"2024-04-27T21:13:03.641160+0000","172.21.15.84:0/1460734944":"2024-04-27T21:13:03.641160+0000","172.21.15.84:6800/3231603698":"2024-04-27T21:13:03.641160+0000","172.21.15.84:0/3648317863":"2024-04-27T21:13:03.641160+0000","172.21.15.84:6801/3231603698":"2024-04-27T21:13:03.641160+0000","172.21.15.84:0/413656261":"2024-04-27T21:15:11.400421+0000","172.21.15.84:6801/3446199945":"2024-04-27T21:15:11.400421+0000","172.21.15.84:0/3621485381":"2024-04-27T21:13:42.669268+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:19:47.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.897+0000 7f9e06800700 1 -- 172.21.15.84:0/2772609666 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f9de40692a0 msgr2=0x7f9de406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:47.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.897+0000 7f9e06800700 1 --2- 172.21.15.84:0/2772609666 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f9de40692a0 0x7f9de406b750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009b80 tx=0x7f9dec00b040 comp rx=0 tx=0).stop 2024-04-26T21:19:47.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.897+0000 7f9e06800700 1 -- 172.21.15.84:0/2772609666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e00104fd0 msgr2=0x7f9e00115b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:47.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.897+0000 7f9e06800700 1 --2- 172.21.15.84:0/2772609666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e00104fd0 0x7f9e00115b20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9df000b8b0 tx=0x7f9df0009e30 comp rx=0 tx=0).stop 2024-04-26T21:19:47.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.897+0000 7f9e06800700 1 -- 172.21.15.84:0/2772609666 shutdown_connections 2024-04-26T21:19:47.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.897+0000 7f9e06800700 1 --2- 172.21.15.84:0/2772609666 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f9de40692a0 0x7f9de406b750 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:47.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.897+0000 7f9e06800700 1 --2- 172.21.15.84:0/2772609666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e00104fd0 0x7f9e00115b20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:47.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.897+0000 7f9e06800700 1 --2- 172.21.15.84:0/2772609666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e00105970 0x7f9e00116060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:47.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.897+0000 7f9e06800700 1 -- 172.21.15.84:0/2772609666 >> 172.21.15.84:0/2772609666 conn(0x7f9e000fab80 msgr2=0x7f9e00107d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:47.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.898+0000 7f9e06800700 1 -- 172.21.15.84:0/2772609666 shutdown_connections 2024-04-26T21:19:47.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:47.898+0000 7f9e06800700 1 -- 172.21.15.84:0/2772609666 wait complete. 2024-04-26T21:19:48.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:47 smithi084 ceph-mon[25539]: Detected new or changed devices on smithi120 2024-04-26T21:19:48.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:47 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:19:48.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:47 smithi084 ceph-mon[25539]: Adjusting osd_memory_target on smithi120 to 5312M 2024-04-26T21:19:48.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:47 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:48.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:47 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:48.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:47 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:19:48.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:47 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:48.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:47 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:19:48.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:47 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:48.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:47 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:19:48.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:47 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:48.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:47 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2772609666' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:19:48.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:47 smithi120 ceph-mon[32741]: Detected new or changed devices on smithi120 2024-04-26T21:19:48.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:47 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:19:48.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:47 smithi120 ceph-mon[32741]: Adjusting osd_memory_target on smithi120 to 5312M 2024-04-26T21:19:48.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:47 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:48.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:47 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:48.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:47 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:19:48.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:47 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:48.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:47 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:19:48.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:47 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:48.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:47 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:19:48.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:47 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:19:48.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:47 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2772609666' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:19:48.642 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:17:58.092436+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-04-26T21:19:48.643 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-26T21:19:49.115 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:19:49.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:48 smithi084 ceph-mon[25539]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:19:49.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:48 smithi120 ceph-mon[32741]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:19:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.193+0000 7f7633400700 1 -- 172.21.15.84:0/1616788924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f762c102e00 msgr2=0x7f762c1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.193+0000 7f7633400700 1 --2- 172.21.15.84:0/1616788924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f762c102e00 0x7f762c1031d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f761c004940 tx=0x7f761c009e30 comp rx=0 tx=0).stop 2024-04-26T21:19:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.194+0000 7f7633400700 1 -- 172.21.15.84:0/1616788924 shutdown_connections 2024-04-26T21:19:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.194+0000 7f7633400700 1 --2- 172.21.15.84:0/1616788924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f762c1037a0 0x7f762c0fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.194+0000 7f7633400700 1 --2- 172.21.15.84:0/1616788924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f762c102e00 0x7f762c1031d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.194+0000 7f7633400700 1 -- 172.21.15.84:0/1616788924 >> 172.21.15.84:0/1616788924 conn(0x7f762c0f89d0 msgr2=0x7f762c0fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.194+0000 7f7633400700 1 -- 172.21.15.84:0/1616788924 shutdown_connections 2024-04-26T21:19:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.194+0000 7f7633400700 1 -- 172.21.15.84:0/1616788924 wait complete. 2024-04-26T21:19:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.195+0000 7f7633400700 1 Processor -- start 2024-04-26T21:19:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.195+0000 7f7633400700 1 -- start start 2024-04-26T21:19:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.195+0000 7f7633400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f762c102e00 0x7f762c115b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.195+0000 7f7633400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f762c1037a0 0x7f762c1160b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.195+0000 7f7633400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c116700 con 0x7f762c102e00 2024-04-26T21:19:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.195+0000 7f7633400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c10fce0 con 0x7f762c1037a0 2024-04-26T21:19:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.195+0000 7f7630a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f762c102e00 0x7f762c115b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.195+0000 7f7630a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f762c102e00 0x7f762c115b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43234/0 (socket says 172.21.15.84:43234) 2024-04-26T21:19:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.196+0000 7f7630a00700 1 -- 172.21.15.84:0/4206847068 learned_addr learned my addr 172.21.15.84:0/4206847068 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:19:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.196+0000 7f7630a00700 1 -- 172.21.15.84:0/4206847068 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f762c1037a0 msgr2=0x7f762c1160b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.196+0000 7f7630a00700 1 --2- 172.21.15.84:0/4206847068 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f762c1037a0 0x7f762c1160b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.196+0000 7f7630a00700 1 -- 172.21.15.84:0/4206847068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f761c005040 con 0x7f762c102e00 2024-04-26T21:19:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.196+0000 7f7630a00700 1 --2- 172.21.15.84:0/4206847068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f762c102e00 0x7f762c115b70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f761c00b8b0 tx=0x7f761c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.196+0000 7f7629600700 1 -- 172.21.15.84:0/4206847068 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f761c00e040 con 0x7f762c102e00 2024-04-26T21:19:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.197+0000 7f7629600700 1 -- 172.21.15.84:0/4206847068 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f761c004290 con 0x7f762c102e00 2024-04-26T21:19:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.197+0000 7f7633400700 1 -- 172.21.15.84:0/4206847068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762c10ff60 con 0x7f762c102e00 2024-04-26T21:19:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.197+0000 7f7629600700 1 -- 172.21.15.84:0/4206847068 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f761c01c3f0 con 0x7f762c102e00 2024-04-26T21:19:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.197+0000 7f7633400700 1 -- 172.21.15.84:0/4206847068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762c110520 con 0x7f762c102e00 2024-04-26T21:19:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.198+0000 7f7633400700 1 -- 172.21.15.84:0/4206847068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762c107300 con 0x7f762c102e00 2024-04-26T21:19:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.199+0000 7f7629600700 1 -- 172.21.15.84:0/4206847068 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f761c0137b0 con 0x7f762c102e00 2024-04-26T21:19:51.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.200+0000 7f7629600700 1 --2- 172.21.15.84:0/4206847068 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f76100692a0 0x7f761006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:51.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.200+0000 7f7629600700 1 -- 172.21.15.84:0/4206847068 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f761c088160 con 0x7f762c102e00 2024-04-26T21:19:51.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.200+0000 7f7623e00700 1 --2- 172.21.15.84:0/4206847068 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f76100692a0 0x7f761006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:51.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.201+0000 7f7623e00700 1 --2- 172.21.15.84:0/4206847068 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f76100692a0 0x7f761006b750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f762c111410 tx=0x7f7618007d40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:51.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.205+0000 7f7629600700 1 -- 172.21.15.84:0/4206847068 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f761c058240 con 0x7f762c102e00 2024-04-26T21:19:51.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:50 smithi084 ceph-mon[25539]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:19:51.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.417+0000 7f7633400700 1 -- 172.21.15.84:0/4206847068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f762c0fe550 con 0x7f762c102e00 2024-04-26T21:19:51.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.417+0000 7f7629600700 1 -- 172.21.15.84:0/4206847068 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f761c057dd0 con 0x7f762c102e00 2024-04-26T21:19:51.419 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-04-26T21:19:51.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.420+0000 7f7633400700 1 -- 172.21.15.84:0/4206847068 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f76100692a0 msgr2=0x7f761006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:51.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.420+0000 7f7633400700 1 --2- 172.21.15.84:0/4206847068 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f76100692a0 0x7f761006b750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f762c111410 tx=0x7f7618007d40 comp rx=0 tx=0).stop 2024-04-26T21:19:51.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.420+0000 7f7633400700 1 -- 172.21.15.84:0/4206847068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f762c102e00 msgr2=0x7f762c115b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:51.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.420+0000 7f7633400700 1 --2- 172.21.15.84:0/4206847068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f762c102e00 0x7f762c115b70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f761c00b8b0 tx=0x7f761c009e30 comp rx=0 tx=0).stop 2024-04-26T21:19:51.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.420+0000 7f7633400700 1 -- 172.21.15.84:0/4206847068 shutdown_connections 2024-04-26T21:19:51.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.420+0000 7f7633400700 1 --2- 172.21.15.84:0/4206847068 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f76100692a0 0x7f761006b750 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:51.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.420+0000 7f7633400700 1 --2- 172.21.15.84:0/4206847068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f762c102e00 0x7f762c115b70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:51.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.420+0000 7f7633400700 1 --2- 172.21.15.84:0/4206847068 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f762c1037a0 0x7f762c1160b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:51.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.420+0000 7f7633400700 1 -- 172.21.15.84:0/4206847068 >> 172.21.15.84:0/4206847068 conn(0x7f762c0f89d0 msgr2=0x7f762c0fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:51.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.420+0000 7f7633400700 1 -- 172.21.15.84:0/4206847068 shutdown_connections 2024-04-26T21:19:51.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:51.420+0000 7f7633400700 1 -- 172.21.15.84:0/4206847068 wait complete. 2024-04-26T21:19:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:50 smithi120 ceph-mon[32741]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:19:52.082 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:51 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/4206847068' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T21:19:52.145 INFO:tasks.cephadm:Setting up client nodes... 2024-04-26T21:19:52.145 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-26T21:19:52.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:51 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/4206847068' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T21:19:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:19:53.043 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:53 smithi084 ceph-mon[25539]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:19:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:53 smithi120 ceph-mon[32741]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:19:54.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.627+0000 7fb7d0000700 1 -- 172.21.15.84:0/3253479838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7c81046c0 msgr2=0x7fb7c8104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:54.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.627+0000 7fb7d0000700 1 --2- 172.21.15.84:0/3253479838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7c81046c0 0x7fb7c8104b30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4004940 tx=0x7fb7b4009e30 comp rx=0 tx=0).stop 2024-04-26T21:19:54.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.627+0000 7fb7d0000700 1 -- 172.21.15.84:0/3253479838 shutdown_connections 2024-04-26T21:19:54.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.627+0000 7fb7d0000700 1 --2- 172.21.15.84:0/3253479838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7c81046c0 0x7fb7c8104b30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:54.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.627+0000 7fb7d0000700 1 --2- 172.21.15.84:0/3253479838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c8103410 0x7fb7c8103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:54.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.627+0000 7fb7d0000700 1 -- 172.21.15.84:0/3253479838 >> 172.21.15.84:0/3253479838 conn(0x7fb7c80725e0 msgr2=0x7fb7c8074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:54.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.627+0000 7fb7d0000700 1 -- 172.21.15.84:0/3253479838 shutdown_connections 2024-04-26T21:19:54.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.627+0000 7fb7d0000700 1 -- 172.21.15.84:0/3253479838 wait complete. 2024-04-26T21:19:54.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.628+0000 7fb7d0000700 1 Processor -- start 2024-04-26T21:19:54.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.628+0000 7fb7d0000700 1 -- start start 2024-04-26T21:19:54.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.628+0000 7fb7d0000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7c8103410 0x7fb7c8113f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:54.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.628+0000 7fb7d0000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c81046c0 0x7fb7c8114480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:54.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.628+0000 7fb7d0000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c8114a80 con 0x7fb7c8103410 2024-04-26T21:19:54.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.628+0000 7fb7d0000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c8114bf0 con 0x7fb7c81046c0 2024-04-26T21:19:54.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.629+0000 7fb7cd600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7c8103410 0x7fb7c8113f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:54.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.629+0000 7fb7cd600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7c8103410 0x7fb7c8113f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46190/0 (socket says 172.21.15.84:46190) 2024-04-26T21:19:54.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.629+0000 7fb7cd600700 1 -- 172.21.15.84:0/3583205321 learned_addr learned my addr 172.21.15.84:0/3583205321 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:19:54.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.629+0000 7fb7ccc00700 1 --2- 172.21.15.84:0/3583205321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c81046c0 0x7fb7c8114480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:54.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.629+0000 7fb7cd600700 1 -- 172.21.15.84:0/3583205321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c81046c0 msgr2=0x7fb7c8114480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:54.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.629+0000 7fb7cd600700 1 --2- 172.21.15.84:0/3583205321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c81046c0 0x7fb7c8114480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:54.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.629+0000 7fb7cd600700 1 -- 172.21.15.84:0/3583205321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b4005040 con 0x7fb7c8103410 2024-04-26T21:19:54.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.629+0000 7fb7ccc00700 1 --2- 172.21.15.84:0/3583205321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c81046c0 0x7fb7c8114480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:19:54.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.630+0000 7fb7cd600700 1 --2- 172.21.15.84:0/3583205321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7c8103410 0x7fb7c8113f40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00c830 tx=0x7fb7bc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:54.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.630+0000 7fb7c5600700 1 -- 172.21.15.84:0/3583205321 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7bc00a760 con 0x7fb7c8103410 2024-04-26T21:19:54.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.630+0000 7fb7c5600700 1 -- 172.21.15.84:0/3583205321 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb7bc00ad90 con 0x7fb7c8103410 2024-04-26T21:19:54.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.630+0000 7fb7d0000700 1 -- 172.21.15.84:0/3583205321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c8119600 con 0x7fb7c8103410 2024-04-26T21:19:54.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.630+0000 7fb7c5600700 1 -- 172.21.15.84:0/3583205321 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7bc0113a0 con 0x7fb7c8103410 2024-04-26T21:19:54.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.630+0000 7fb7d0000700 1 -- 172.21.15.84:0/3583205321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c8119bc0 con 0x7fb7c8103410 2024-04-26T21:19:54.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.631+0000 7fb7d0000700 1 -- 172.21.15.84:0/3583205321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c804c710 con 0x7fb7c8103410 2024-04-26T21:19:54.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.632+0000 7fb7c5600700 1 -- 172.21.15.84:0/3583205321 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb7bc012400 con 0x7fb7c8103410 2024-04-26T21:19:54.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.633+0000 7fb7c5600700 1 --2- 172.21.15.84:0/3583205321 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fb7b00692b0 0x7fb7b006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:54.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.633+0000 7fb7c5600700 1 -- 172.21.15.84:0/3583205321 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb7bc086ed0 con 0x7fb7c8103410 2024-04-26T21:19:54.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.633+0000 7fb7ccc00700 1 --2- 172.21.15.84:0/3583205321 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fb7b00692b0 0x7fb7b006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:54.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.634+0000 7fb7ccc00700 1 --2- 172.21.15.84:0/3583205321 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fb7b00692b0 0x7fb7b006b760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb7b400b3b0 tx=0x7fb7b4009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:54.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.638+0000 7fb7c5600700 1 -- 172.21.15.84:0/3583205321 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb7bc056fb0 con 0x7fb7c8103410 2024-04-26T21:19:54.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.931+0000 7fb7d0000700 1 -- 172.21.15.84:0/3583205321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fb7c810bf00 con 0x7fb7c8103410 2024-04-26T21:19:54.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.940+0000 7fb7c5600700 1 -- 172.21.15.84:0/3583205321 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7fb7bc05c020 con 0x7fb7c8103410 2024-04-26T21:19:54.942 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2024-04-26T21:19:54.942 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQB6GixmnhWrNxAA8QdCuWq66jRmZCMDw5TClg== 2024-04-26T21:19:54.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.943+0000 7fb7d0000700 1 -- 172.21.15.84:0/3583205321 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fb7b00692b0 msgr2=0x7fb7b006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:54.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.943+0000 7fb7d0000700 1 --2- 172.21.15.84:0/3583205321 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fb7b00692b0 0x7fb7b006b760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb7b400b3b0 tx=0x7fb7b4009e30 comp rx=0 tx=0).stop 2024-04-26T21:19:54.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.943+0000 7fb7d0000700 1 -- 172.21.15.84:0/3583205321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7c8103410 msgr2=0x7fb7c8113f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:54.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.943+0000 7fb7d0000700 1 --2- 172.21.15.84:0/3583205321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7c8103410 0x7fb7c8113f40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00c830 tx=0x7fb7bc004470 comp rx=0 tx=0).stop 2024-04-26T21:19:54.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.943+0000 7fb7d0000700 1 -- 172.21.15.84:0/3583205321 shutdown_connections 2024-04-26T21:19:54.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.943+0000 7fb7d0000700 1 --2- 172.21.15.84:0/3583205321 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fb7b00692b0 0x7fb7b006b760 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:54.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.943+0000 7fb7d0000700 1 --2- 172.21.15.84:0/3583205321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7c8103410 0x7fb7c8113f40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:54.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.943+0000 7fb7d0000700 1 --2- 172.21.15.84:0/3583205321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c81046c0 0x7fb7c8114480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:54.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.943+0000 7fb7d0000700 1 -- 172.21.15.84:0/3583205321 >> 172.21.15.84:0/3583205321 conn(0x7fb7c80725e0 msgr2=0x7fb7c8073c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:54.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.943+0000 7fb7d0000700 1 -- 172.21.15.84:0/3583205321 shutdown_connections 2024-04-26T21:19:54.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:19:54.943+0000 7fb7d0000700 1 -- 172.21.15.84:0/3583205321 wait complete. 2024-04-26T21:19:55.298 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:55 smithi084 ceph-mon[25539]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:19:55.299 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:55 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3583205321' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T21:19:55.299 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:55 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3583205321' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T21:19:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:55 smithi120 ceph-mon[32741]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:19:55.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:55 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/3583205321' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T21:19:55.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:55 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/3583205321' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T21:19:55.721 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-26T21:19:55.721 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-26T21:19:55.721 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T21:19:55.855 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-26T21:19:56.284 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi120/config 2024-04-26T21:19:57.235 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:57 smithi120 ceph-mon[32741]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:19:57.236 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:57 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:19:57.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:57 smithi084 ceph-mon[25539]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:19:57.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:57 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:19:58.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.500+0000 7f1f2ce00700 1 -- 172.21.15.120:0/358872578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f281046c0 msgr2=0x7f1f28104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:58.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.500+0000 7f1f2ce00700 1 --2- 172.21.15.120:0/358872578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f281046c0 0x7f1f28104b30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1f14004940 tx=0x7f1f14009e30 comp rx=0 tx=0).stop 2024-04-26T21:19:58.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.500+0000 7f1f2ce00700 1 -- 172.21.15.120:0/358872578 shutdown_connections 2024-04-26T21:19:58.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.500+0000 7f1f2ce00700 1 --2- 172.21.15.120:0/358872578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f281046c0 0x7f1f28104b30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:58.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.500+0000 7f1f2ce00700 1 --2- 172.21.15.120:0/358872578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f28103410 0x7f1f28103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:58.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.500+0000 7f1f2ce00700 1 -- 172.21.15.120:0/358872578 >> 172.21.15.120:0/358872578 conn(0x7f1f280725e0 msgr2=0x7f1f28074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:58.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.500+0000 7f1f2ce00700 1 -- 172.21.15.120:0/358872578 shutdown_connections 2024-04-26T21:19:58.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.500+0000 7f1f2ce00700 1 -- 172.21.15.120:0/358872578 wait complete. 2024-04-26T21:19:58.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.501+0000 7f1f2ce00700 1 Processor -- start 2024-04-26T21:19:58.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.501+0000 7f1f2ce00700 1 -- start start 2024-04-26T21:19:58.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.501+0000 7f1f2ce00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f28103410 0x7f1f28113ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:58.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.501+0000 7f1f2ce00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f281046c0 0x7f1f28114430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:58.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.501+0000 7f1f2ce00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f28114ac0 con 0x7f1f28103410 2024-04-26T21:19:58.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.501+0000 7f1f2ce00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f28119460 con 0x7f1f281046c0 2024-04-26T21:19:58.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.501+0000 7f1f25400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f281046c0 0x7f1f28114430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:58.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.501+0000 7f1f25400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f281046c0 0x7f1f28114430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55628/0 (socket says 172.21.15.120:55628) 2024-04-26T21:19:58.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.501+0000 7f1f25400700 1 -- 172.21.15.120:0/2418505314 learned_addr learned my addr 172.21.15.120:0/2418505314 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-26T21:19:58.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.502+0000 7f1f25e00700 1 --2- 172.21.15.120:0/2418505314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f28103410 0x7f1f28113ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:58.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.502+0000 7f1f25400700 1 -- 172.21.15.120:0/2418505314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f28103410 msgr2=0x7f1f28113ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:58.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.502+0000 7f1f25400700 1 --2- 172.21.15.120:0/2418505314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f28103410 0x7f1f28113ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:58.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.502+0000 7f1f25400700 1 -- 172.21.15.120:0/2418505314 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f14005040 con 0x7f1f281046c0 2024-04-26T21:19:58.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.502+0000 7f1f25400700 1 --2- 172.21.15.120:0/2418505314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f281046c0 0x7f1f28114430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400b3b0 tx=0x7f1f14009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:58.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.502+0000 7f1f1e000700 1 -- 172.21.15.120:0/2418505314 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f1400e040 con 0x7f1f281046c0 2024-04-26T21:19:58.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.502+0000 7f1f1e000700 1 -- 172.21.15.120:0/2418505314 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f1400bcc0 con 0x7f1f281046c0 2024-04-26T21:19:58.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.502+0000 7f1f2ce00700 1 -- 172.21.15.120:0/2418505314 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f28119660 con 0x7f1f281046c0 2024-04-26T21:19:58.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.503+0000 7f1f1e000700 1 -- 172.21.15.120:0/2418505314 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f1401c630 con 0x7f1f281046c0 2024-04-26T21:19:58.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.503+0000 7f1f2ce00700 1 -- 172.21.15.120:0/2418505314 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f28119bd0 con 0x7f1f281046c0 2024-04-26T21:19:58.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.504+0000 7f1f2ce00700 1 -- 172.21.15.120:0/2418505314 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2804c710 con 0x7f1f281046c0 2024-04-26T21:19:58.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.505+0000 7f1f1e000700 1 -- 172.21.15.120:0/2418505314 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f1f14013980 con 0x7f1f281046c0 2024-04-26T21:19:58.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.506+0000 7f1f1e000700 1 --2- 172.21.15.120:0/2418505314 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f1f0c0692a0 0x7f1f0c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:58.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.506+0000 7f1f1e000700 1 -- 172.21.15.120:0/2418505314 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1f14087d30 con 0x7f1f281046c0 2024-04-26T21:19:58.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.506+0000 7f1f25e00700 1 --2- 172.21.15.120:0/2418505314 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f1f0c0692a0 0x7f1f0c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:58.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.507+0000 7f1f25e00700 1 --2- 172.21.15.120:0/2418505314 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f1f0c0692a0 0x7f1f0c06b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1f18006fd0 tx=0x7f1f18008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:58.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.511+0000 7f1f1e000700 1 -- 172.21.15.120:0/2418505314 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1f14057d10 con 0x7f1f281046c0 2024-04-26T21:19:58.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.802+0000 7f1f2ce00700 1 -- 172.21.15.120:0/2418505314 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f1f28119fb0 con 0x7f1f281046c0 2024-04-26T21:19:58.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.812+0000 7f1f1e000700 1 -- 172.21.15.120:0/2418505314 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f1f140578a0 con 0x7f1f281046c0 2024-04-26T21:19:58.814 INFO:teuthology.orchestra.run.smithi120.stdout:[client.1] 2024-04-26T21:19:58.815 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQB+GixmSvYLMBAAzDVKxwy0YoPC8X0gcBSCZg== 2024-04-26T21:19:58.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.815+0000 7f1f2ce00700 1 -- 172.21.15.120:0/2418505314 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f1f0c0692a0 msgr2=0x7f1f0c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:58.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.815+0000 7f1f2ce00700 1 --2- 172.21.15.120:0/2418505314 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f1f0c0692a0 0x7f1f0c06b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1f18006fd0 tx=0x7f1f18008040 comp rx=0 tx=0).stop 2024-04-26T21:19:58.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.815+0000 7f1f2ce00700 1 -- 172.21.15.120:0/2418505314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f281046c0 msgr2=0x7f1f28114430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:58.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.815+0000 7f1f2ce00700 1 --2- 172.21.15.120:0/2418505314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f281046c0 0x7f1f28114430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400b3b0 tx=0x7f1f14009e30 comp rx=0 tx=0).stop 2024-04-26T21:19:58.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.816+0000 7f1f2ce00700 1 -- 172.21.15.120:0/2418505314 shutdown_connections 2024-04-26T21:19:58.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.816+0000 7f1f2ce00700 1 --2- 172.21.15.120:0/2418505314 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f1f0c0692a0 0x7f1f0c06b750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:58.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.816+0000 7f1f2ce00700 1 --2- 172.21.15.120:0/2418505314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f28103410 0x7f1f28113ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:58.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.816+0000 7f1f2ce00700 1 --2- 172.21.15.120:0/2418505314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f281046c0 0x7f1f28114430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:58.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.816+0000 7f1f2ce00700 1 -- 172.21.15.120:0/2418505314 >> 172.21.15.120:0/2418505314 conn(0x7f1f280725e0 msgr2=0x7f1f28073b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:58.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.816+0000 7f1f2ce00700 1 -- 172.21.15.120:0/2418505314 shutdown_connections 2024-04-26T21:19:58.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:19:58.816+0000 7f1f2ce00700 1 -- 172.21.15.120:0/2418505314 wait complete. 2024-04-26T21:19:59.135 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:59 smithi120 ceph-mon[32741]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:19:59.135 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:59 smithi120 ceph-mon[32741]: from='client.? 172.21.15.120:0/2418505314' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T21:19:59.135 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:59 smithi120 ceph-mon[32741]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T21:19:59.135 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:19:59 smithi120 ceph-mon[32741]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T21:19:59.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:59 smithi084 ceph-mon[25539]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:19:59.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:59 smithi084 ceph-mon[25539]: from='client.? 172.21.15.120:0/2418505314' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T21:19:59.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:59 smithi084 ceph-mon[25539]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T21:19:59.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:19:59 smithi084 ceph-mon[25539]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T21:19:59.556 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T21:19:59.556 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-04-26T21:19:59.556 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-26T21:19:59.675 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T21:19:59.676 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-26T21:19:59.676 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-26T21:20:00.142 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:00.286 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:00 smithi084 ceph-mon[25539]: overall HEALTH_OK 2024-04-26T21:20:00.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:00 smithi120 ceph-mon[32741]: overall HEALTH_OK 2024-04-26T21:20:01.298 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:01 smithi084 ceph-mon[25539]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:01.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:01 smithi120 ceph-mon[32741]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.199+0000 7fba30e00700 1 -- 172.21.15.84:0/1673118634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba2c105000 msgr2=0x7fba2c1053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.199+0000 7fba30e00700 1 --2- 172.21.15.84:0/1673118634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba2c105000 0x7fba2c1053d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fba1c004940 tx=0x7fba1c009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.199+0000 7fba30e00700 1 -- 172.21.15.84:0/1673118634 shutdown_connections 2024-04-26T21:20:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.199+0000 7fba30e00700 1 --2- 172.21.15.84:0/1673118634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba2c1059a0 0x7fba2c0ff010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.199+0000 7fba30e00700 1 --2- 172.21.15.84:0/1673118634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba2c105000 0x7fba2c1053d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.199+0000 7fba30e00700 1 -- 172.21.15.84:0/1673118634 >> 172.21.15.84:0/1673118634 conn(0x7fba2c0fab70 msgr2=0x7fba2c0fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.199+0000 7fba30e00700 1 -- 172.21.15.84:0/1673118634 shutdown_connections 2024-04-26T21:20:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.199+0000 7fba30e00700 1 -- 172.21.15.84:0/1673118634 wait complete. 2024-04-26T21:20:02.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.201+0000 7fba30e00700 1 Processor -- start 2024-04-26T21:20:02.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.201+0000 7fba30e00700 1 -- start start 2024-04-26T21:20:02.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.202+0000 7fba30e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba2c105000 0x7fba2c115b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:02.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.202+0000 7fba30e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba2c1059a0 0x7fba2c1160b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:02.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.202+0000 7fba30e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c116700 con 0x7fba2c1059a0 2024-04-26T21:20:02.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.202+0000 7fba30e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c10fce0 con 0x7fba2c105000 2024-04-26T21:20:02.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.202+0000 7fba29400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba2c1059a0 0x7fba2c1160b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:02.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.202+0000 7fba29400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba2c1059a0 0x7fba2c1160b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58266/0 (socket says 172.21.15.84:58266) 2024-04-26T21:20:02.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.202+0000 7fba29400700 1 -- 172.21.15.84:0/2153653864 learned_addr learned my addr 172.21.15.84:0/2153653864 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:02.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.202+0000 7fba29e00700 1 --2- 172.21.15.84:0/2153653864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba2c105000 0x7fba2c115b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:02.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.203+0000 7fba29400700 1 -- 172.21.15.84:0/2153653864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba2c105000 msgr2=0x7fba2c115b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:02.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.203+0000 7fba29400700 1 --2- 172.21.15.84:0/2153653864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba2c105000 0x7fba2c115b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:02.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.203+0000 7fba29400700 1 -- 172.21.15.84:0/2153653864 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c005040 con 0x7fba2c1059a0 2024-04-26T21:20:02.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.203+0000 7fba29e00700 1 --2- 172.21.15.84:0/2153653864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba2c105000 0x7fba2c115b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:20:02.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.203+0000 7fba29400700 1 --2- 172.21.15.84:0/2153653864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba2c1059a0 0x7fba2c1160b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba1800c800 tx=0x7fba18004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:02.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.203+0000 7fba22000700 1 -- 172.21.15.84:0/2153653864 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba1800a760 con 0x7fba2c1059a0 2024-04-26T21:20:02.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.203+0000 7fba22000700 1 -- 172.21.15.84:0/2153653864 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba1800ad90 con 0x7fba2c1059a0 2024-04-26T21:20:02.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.203+0000 7fba22000700 1 -- 172.21.15.84:0/2153653864 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba180113a0 con 0x7fba2c1059a0 2024-04-26T21:20:02.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.203+0000 7fba30e00700 1 -- 172.21.15.84:0/2153653864 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba2c10ffc0 con 0x7fba2c1059a0 2024-04-26T21:20:02.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.203+0000 7fba30e00700 1 -- 172.21.15.84:0/2153653864 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2c110580 con 0x7fba2c1059a0 2024-04-26T21:20:02.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.204+0000 7fba30e00700 1 -- 172.21.15.84:0/2153653864 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba2c100750 con 0x7fba2c1059a0 2024-04-26T21:20:02.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.206+0000 7fba22000700 1 -- 172.21.15.84:0/2153653864 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fba18012400 con 0x7fba2c1059a0 2024-04-26T21:20:02.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.207+0000 7fba22000700 1 --2- 172.21.15.84:0/2153653864 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fba100692a0 0x7fba1006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:02.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.207+0000 7fba22000700 1 -- 172.21.15.84:0/2153653864 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fba18086e80 con 0x7fba2c1059a0 2024-04-26T21:20:02.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.207+0000 7fba29e00700 1 --2- 172.21.15.84:0/2153653864 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fba100692a0 0x7fba1006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:02.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.208+0000 7fba29e00700 1 --2- 172.21.15.84:0/2153653864 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fba100692a0 0x7fba1006b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00b3b0 tx=0x7fba1c009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:02.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.214+0000 7fba22000700 1 -- 172.21.15.84:0/2153653864 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fba18056f60 con 0x7fba2c1059a0 2024-04-26T21:20:02.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.482+0000 7fba30e00700 1 -- 172.21.15.84:0/2153653864 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fba2c04c710 con 0x7fba2c1059a0 2024-04-26T21:20:02.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.492+0000 7fba22000700 1 -- 172.21.15.84:0/2153653864 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+167179 (secure 0 0 0) 0x7fba18056af0 con 0x7fba2c1059a0 2024-04-26T21:20:02.493 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:20:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.495+0000 7fba30e00700 1 -- 172.21.15.84:0/2153653864 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fba100692a0 msgr2=0x7fba1006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.495+0000 7fba30e00700 1 --2- 172.21.15.84:0/2153653864 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fba100692a0 0x7fba1006b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00b3b0 tx=0x7fba1c009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.495+0000 7fba30e00700 1 -- 172.21.15.84:0/2153653864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba2c1059a0 msgr2=0x7fba2c1160b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.495+0000 7fba30e00700 1 --2- 172.21.15.84:0/2153653864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba2c1059a0 0x7fba2c1160b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba1800c800 tx=0x7fba18004470 comp rx=0 tx=0).stop 2024-04-26T21:20:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.496+0000 7fba30e00700 1 -- 172.21.15.84:0/2153653864 shutdown_connections 2024-04-26T21:20:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.496+0000 7fba30e00700 1 --2- 172.21.15.84:0/2153653864 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fba100692a0 0x7fba1006b750 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.496+0000 7fba30e00700 1 --2- 172.21.15.84:0/2153653864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba2c105000 0x7fba2c115b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.496+0000 7fba30e00700 1 --2- 172.21.15.84:0/2153653864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba2c1059a0 0x7fba2c1160b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.496+0000 7fba30e00700 1 -- 172.21.15.84:0/2153653864 >> 172.21.15.84:0/2153653864 conn(0x7fba2c0fab70 msgr2=0x7fba2c0fbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:02.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.496+0000 7fba30e00700 1 -- 172.21.15.84:0/2153653864 shutdown_connections 2024-04-26T21:20:02.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:02.496+0000 7fba30e00700 1 -- 172.21.15.84:0/2153653864 wait complete. 2024-04-26T21:20:03.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:03 smithi084 ceph-mon[25539]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:03.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:03 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2153653864' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-26T21:20:03.246 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":19,"flags":0,"active_gid":14212,"active_name":"smithi084.gyasul","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3574511298},{"type":"v1","addr":"172.21.15.84:6801","nonce":3574511298}]},"active_addr":"172.21.15.84:6801/3574511298","active_change":"2024-04-26T21:15:11.400833+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14232,"name":"smithi120.zjaduj","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.84:8443/","prometheus":"http://172.21.15.84:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":3365760548}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2390150734}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2708514508}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2815093662}]}]} 2024-04-26T21:20:03.250 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-26T21:20:03.250 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-26T21:20:03.250 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T21:20:03.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:03 smithi120 ceph-mon[32741]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:03.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:03 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2153653864' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-26T21:20:03.720 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:05.367 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:05 smithi084 ceph-mon[25539]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:05 smithi120 ceph-mon[32741]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:05.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.524+0000 7f0dd1400700 1 -- 172.21.15.84:0/3193724370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dcc103780 msgr2=0x7f0dcc0fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:05.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.524+0000 7f0dd1400700 1 --2- 172.21.15.84:0/3193724370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dcc103780 0x7f0dcc0fcdf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0db4004940 tx=0x7f0db4009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:05.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.524+0000 7f0dd1400700 1 -- 172.21.15.84:0/3193724370 shutdown_connections 2024-04-26T21:20:05.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.524+0000 7f0dd1400700 1 --2- 172.21.15.84:0/3193724370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dcc103780 0x7f0dcc0fcdf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:05.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.524+0000 7f0dd1400700 1 --2- 172.21.15.84:0/3193724370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0dcc102de0 0x7f0dcc1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:05.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.524+0000 7f0dd1400700 1 -- 172.21.15.84:0/3193724370 >> 172.21.15.84:0/3193724370 conn(0x7f0dcc0f89b0 msgr2=0x7f0dcc0fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:05.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.524+0000 7f0dd1400700 1 -- 172.21.15.84:0/3193724370 shutdown_connections 2024-04-26T21:20:05.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.524+0000 7f0dd1400700 1 -- 172.21.15.84:0/3193724370 wait complete. 2024-04-26T21:20:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.525+0000 7f0dd1400700 1 Processor -- start 2024-04-26T21:20:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.525+0000 7f0dd1400700 1 -- start start 2024-04-26T21:20:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.526+0000 7f0dd1400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dcc102de0 0x7f0dcc115d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.526+0000 7f0dd1400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0dcc103780 0x7f0dcc1162a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.526+0000 7f0dd1400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc1168f0 con 0x7f0dcc102de0 2024-04-26T21:20:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.526+0000 7f0dd1400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc10fcc0 con 0x7f0dcc103780 2024-04-26T21:20:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.526+0000 7f0dca800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dcc102de0 0x7f0dcc115d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.526+0000 7f0dca800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dcc102de0 0x7f0dcc115d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58276/0 (socket says 172.21.15.84:58276) 2024-04-26T21:20:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.526+0000 7f0dca800700 1 -- 172.21.15.84:0/562425280 learned_addr learned my addr 172.21.15.84:0/562425280 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.526+0000 7f0dc1e00700 1 --2- 172.21.15.84:0/562425280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0dcc103780 0x7f0dcc1162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.526+0000 7f0dca800700 1 -- 172.21.15.84:0/562425280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0dcc103780 msgr2=0x7f0dcc1162a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.526+0000 7f0dca800700 1 --2- 172.21.15.84:0/562425280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0dcc103780 0x7f0dcc1162a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.526+0000 7f0dca800700 1 -- 172.21.15.84:0/562425280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db4005040 con 0x7f0dcc102de0 2024-04-26T21:20:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.527+0000 7f0dca800700 1 --2- 172.21.15.84:0/562425280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dcc102de0 0x7f0dcc115d60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00cb10 tx=0x7f0dbc007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.527+0000 7f0dc3400700 1 -- 172.21.15.84:0/562425280 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dbc004200 con 0x7f0dcc102de0 2024-04-26T21:20:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.527+0000 7f0dc3400700 1 -- 172.21.15.84:0/562425280 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0dbc00acc0 con 0x7f0dcc102de0 2024-04-26T21:20:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.527+0000 7f0dc3400700 1 -- 172.21.15.84:0/562425280 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dbc003d90 con 0x7f0dcc102de0 2024-04-26T21:20:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.527+0000 7f0dd1400700 1 -- 172.21.15.84:0/562425280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dcc10ffa0 con 0x7f0dcc102de0 2024-04-26T21:20:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.527+0000 7f0dd1400700 1 -- 172.21.15.84:0/562425280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dcc110510 con 0x7f0dcc102de0 2024-04-26T21:20:05.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.528+0000 7f0dd1400700 1 -- 172.21.15.84:0/562425280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dcc0fe530 con 0x7f0dcc102de0 2024-04-26T21:20:05.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.529+0000 7f0dc3400700 1 -- 172.21.15.84:0/562425280 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f0dbc003430 con 0x7f0dcc102de0 2024-04-26T21:20:05.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.530+0000 7f0dc3400700 1 --2- 172.21.15.84:0/562425280 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f0db00692b0 0x7f0db006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:05.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.530+0000 7f0dc3400700 1 -- 172.21.15.84:0/562425280 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0dbc087500 con 0x7f0dcc102de0 2024-04-26T21:20:05.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.530+0000 7f0dc1e00700 1 --2- 172.21.15.84:0/562425280 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f0db00692b0 0x7f0db006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:05.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.531+0000 7f0dc1e00700 1 --2- 172.21.15.84:0/562425280 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f0db00692b0 0x7f0db006b760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0db400b020 tx=0x7f0db4009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:05.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.540+0000 7f0dc3400700 1 -- 172.21.15.84:0/562425280 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0dbc0574e0 con 0x7f0dcc102de0 2024-04-26T21:20:05.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.757+0000 7f0dd1400700 1 -- 172.21.15.84:0/562425280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dcc05f5c0 con 0x7f0dcc102de0 2024-04-26T21:20:05.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.758+0000 7f0dc3400700 1 -- 172.21.15.84:0/562425280 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11092 (secure 0 0 0) 0x7f0dbc057070 con 0x7f0dcc102de0 2024-04-26T21:20:05.759 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:20:05.759 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":40,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","created":"2024-04-26T21:12:29.304108+0000","modified":"2024-04-26T21:19:42.952340+0000","last_up_change":"2024-04-26T21:19:41.940176+0000","last_in_change":"2024-04-26T21:19:18.310009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:17:58.092436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"d6c04d45-3ba8-4cc3-92ee-2e99279c6da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":4265849542},{"type":"v1","addr":"172.21.15.84:6803","nonce":4265849542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4265849542},{"type":"v1","addr":"172.21.15.84:6805","nonce":4265849542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4265849542},{"type":"v1","addr":"172.21.15.84:6809","nonce":4265849542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":4265849542},{"type":"v1","addr":"172.21.15.84:6807","nonce":4265849542}]},"public_addr":"172.21.15.84:6803/4265849542","cluster_addr":"172.21.15.84:6805/4265849542","heartbeat_back_addr":"172.21.15.84:6809/4265849542","heartbeat_front_addr":"172.21.15.84:6807/4265849542","state":["exists","up"]},{"osd":1,"uuid":"4417e988-3443-4671-8df5-4d964b8e5954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2545485308},{"type":"v1","addr":"172.21.15.84:6811","nonce":2545485308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2545485308},{"type":"v1","addr":"172.21.15.84:6813","nonce":2545485308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2545485308},{"type":"v1","addr":"172.21.15.84:6817","nonce":2545485308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2545485308},{"type":"v1","addr":"172.21.15.84:6815","nonce":2545485308}]},"public_addr":"172.21.15.84:6811/2545485308","cluster_addr":"172.21.15.84:6813/2545485308","heartbeat_back_addr":"172.21.15.84:6817/2545485308","heartbeat_front_addr":"172.21.15.84:6815/2545485308","state":["exists","up"]},{"osd":2,"uuid":"240901fd-0810-4752-bfa0-2857359b30a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1485373275},{"type":"v1","addr":"172.21.15.84:6819","nonce":1485373275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1485373275},{"type":"v1","addr":"172.21.15.84:6821","nonce":1485373275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1485373275},{"type":"v1","addr":"172.21.15.84:6825","nonce":1485373275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1485373275},{"type":"v1","addr":"172.21.15.84:6823","nonce":1485373275}]},"public_addr":"172.21.15.84:6819/1485373275","cluster_addr":"172.21.15.84:6821/1485373275","heartbeat_back_addr":"172.21.15.84:6825/1485373275","heartbeat_front_addr":"172.21.15.84:6823/1485373275","state":["exists","up"]},{"osd":3,"uuid":"f2d8384f-8b7d-4da4-8a67-4bdb83753822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1269727678},{"type":"v1","addr":"172.21.15.120:6801","nonce":1269727678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1269727678},{"type":"v1","addr":"172.21.15.120:6803","nonce":1269727678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1269727678},{"type":"v1","addr":"172.21.15.120:6807","nonce":1269727678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1269727678},{"type":"v1","addr":"172.21.15.120:6805","nonce":1269727678}]},"public_addr":"172.21.15.120:6801/1269727678","cluster_addr":"172.21.15.120:6803/1269727678","heartbeat_back_addr":"172.21.15.120:6807/1269727678","heartbeat_front_addr":"172.21.15.120:6805/1269727678","state":["exists","up"]},{"osd":4,"uuid":"27aa8cbb-e94e-4e63-b2d4-be8a71b292ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3403602597},{"type":"v1","addr":"172.21.15.120:6809","nonce":3403602597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":3403602597},{"type":"v1","addr":"172.21.15.120:6811","nonce":3403602597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":3403602597},{"type":"v1","addr":"172.21.15.120:6815","nonce":3403602597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3403602597},{"type":"v1","addr":"172.21.15.120:6813","nonce":3403602597}]},"public_addr":"172.21.15.120:6809/3403602597","cluster_addr":"172.21.15.120:6811/3403602597","heartbeat_back_addr":"172.21.15.120:6815/3403602597","heartbeat_front_addr":"172.21.15.120:6813/3403602597","state":["exists","up"]},{"osd":5,"uuid":"e13abdd9-155d-40a0-a69a-4448a658ee5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":2091850685},{"type":"v1","addr":"172.21.15.120:6817","nonce":2091850685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":2091850685},{"type":"v1","addr":"172.21.15.120:6819","nonce":2091850685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":2091850685},{"type":"v1","addr":"172.21.15.120:6823","nonce":2091850685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":2091850685},{"type":"v1","addr":"172.21.15.120:6821","nonce":2091850685}]},"public_addr":"172.21.15.120:6817/2091850685","cluster_addr":"172.21.15.120:6819/2091850685","heartbeat_back_addr":"172.21.15.120:6823/2091850685","heartbeat_front_addr":"172.21.15.120:6821/2091850685","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:45.823555+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:17:20.567670+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:17:55.623700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:18:31.061632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:19:06.227030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:19:40.886216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/1001623":"2024-04-27T21:15:11.400421+0000","172.21.15.84:0/3356039008":"2024-04-27T21:15:11.400421+0000","172.21.15.84:6800/3446199945":"2024-04-27T21:15:11.400421+0000","172.21.15.84:6801/2151160823":"2024-04-27T21:13:42.669268+0000","172.21.15.84:6800/2151160823":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/1155142360":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/1430131141":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/801206978":"2024-04-27T21:13:03.641160+0000","172.21.15.84:0/1460734944":"2024-04-27T21:13:03.641160+0000","172.21.15.84:6800/3231603698":"2024-04-27T21:13:03.641160+0000","172.21.15.84:0/3648317863":"2024-04-27T21:13:03.641160+0000","172.21.15.84:6801/3231603698":"2024-04-27T21:13:03.641160+0000","172.21.15.84:0/413656261":"2024-04-27T21:15:11.400421+0000","172.21.15.84:6801/3446199945":"2024-04-27T21:15:11.400421+0000","172.21.15.84:0/3621485381":"2024-04-27T21:13:42.669268+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:20:05.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.761+0000 7f0dd1400700 1 -- 172.21.15.84:0/562425280 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f0db00692b0 msgr2=0x7f0db006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:05.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.761+0000 7f0dd1400700 1 --2- 172.21.15.84:0/562425280 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f0db00692b0 0x7f0db006b760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0db400b020 tx=0x7f0db4009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:05.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.761+0000 7f0dd1400700 1 -- 172.21.15.84:0/562425280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dcc102de0 msgr2=0x7f0dcc115d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:05.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.761+0000 7f0dd1400700 1 --2- 172.21.15.84:0/562425280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dcc102de0 0x7f0dcc115d60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00cb10 tx=0x7f0dbc007f90 comp rx=0 tx=0).stop 2024-04-26T21:20:05.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.761+0000 7f0dd1400700 1 -- 172.21.15.84:0/562425280 shutdown_connections 2024-04-26T21:20:05.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.761+0000 7f0dd1400700 1 --2- 172.21.15.84:0/562425280 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f0db00692b0 0x7f0db006b760 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:05.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.761+0000 7f0dd1400700 1 --2- 172.21.15.84:0/562425280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dcc102de0 0x7f0dcc115d60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:05.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.761+0000 7f0dd1400700 1 --2- 172.21.15.84:0/562425280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0dcc103780 0x7f0dcc1162a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:05.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.761+0000 7f0dd1400700 1 -- 172.21.15.84:0/562425280 >> 172.21.15.84:0/562425280 conn(0x7f0dcc0f89b0 msgr2=0x7f0dcc071ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:05.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.762+0000 7f0dd1400700 1 -- 172.21.15.84:0/562425280 shutdown_connections 2024-04-26T21:20:05.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:05.762+0000 7f0dd1400700 1 -- 172.21.15.84:0/562425280 wait complete. 2024-04-26T21:20:06.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:06 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/562425280' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:20:06.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:06 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/562425280' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:20:06.505 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-26T21:20:06.506 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T21:20:06.973 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:07.339 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:07 smithi084 ceph-mon[25539]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:07.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:07 smithi120 ceph-mon[32741]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:09.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.015+0000 7f8f3dc00700 1 -- 172.21.15.84:0/4085907121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f38102710 msgr2=0x7f8f380fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:09.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.015+0000 7f8f3dc00700 1 --2- 172.21.15.84:0/4085907121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f38102710 0x7f8f380fbd80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8f24004940 tx=0x7f8f24009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:09.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.015+0000 7f8f3dc00700 1 -- 172.21.15.84:0/4085907121 shutdown_connections 2024-04-26T21:20:09.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.015+0000 7f8f3dc00700 1 --2- 172.21.15.84:0/4085907121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f38102710 0x7f8f380fbd80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:09.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.015+0000 7f8f3dc00700 1 --2- 172.21.15.84:0/4085907121 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f38101d70 0x7f8f38102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:09.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.015+0000 7f8f3dc00700 1 -- 172.21.15.84:0/4085907121 >> 172.21.15.84:0/4085907121 conn(0x7f8f380f78e0 msgr2=0x7f8f380f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:09.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.015+0000 7f8f3dc00700 1 -- 172.21.15.84:0/4085907121 shutdown_connections 2024-04-26T21:20:09.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.015+0000 7f8f3dc00700 1 -- 172.21.15.84:0/4085907121 wait complete. 2024-04-26T21:20:09.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.016+0000 7f8f3dc00700 1 Processor -- start 2024-04-26T21:20:09.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.017+0000 7f8f3dc00700 1 -- start start 2024-04-26T21:20:09.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.017+0000 7f8f3dc00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f38101d70 0x7f8f38115b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:09.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.017+0000 7f8f3dc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f38102710 0x7f8f38116070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:09.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.017+0000 7f8f3dc00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f381166c0 con 0x7f8f38101d70 2024-04-26T21:20:09.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.017+0000 7f8f3dc00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3810fca0 con 0x7f8f38102710 2024-04-26T21:20:09.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.017+0000 7f8f36a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f38101d70 0x7f8f38115b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:09.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.017+0000 7f8f36a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f38101d70 0x7f8f38115b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58294/0 (socket says 172.21.15.84:58294) 2024-04-26T21:20:09.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.017+0000 7f8f36a00700 1 -- 172.21.15.84:0/3339169029 learned_addr learned my addr 172.21.15.84:0/3339169029 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.018+0000 7f8f36000700 1 --2- 172.21.15.84:0/3339169029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f38102710 0x7f8f38116070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.018+0000 7f8f36a00700 1 -- 172.21.15.84:0/3339169029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f38102710 msgr2=0x7f8f38116070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.018+0000 7f8f36a00700 1 --2- 172.21.15.84:0/3339169029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f38102710 0x7f8f38116070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.018+0000 7f8f36a00700 1 -- 172.21.15.84:0/3339169029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f24005040 con 0x7f8f38101d70 2024-04-26T21:20:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.018+0000 7f8f36a00700 1 --2- 172.21.15.84:0/3339169029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f38101d70 0x7f8f38115b30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800c830 tx=0x7f8f28004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.018+0000 7f8f2ea00700 1 -- 172.21.15.84:0/3339169029 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f2800a760 con 0x7f8f38101d70 2024-04-26T21:20:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.018+0000 7f8f2ea00700 1 -- 172.21.15.84:0/3339169029 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f2800ad90 con 0x7f8f38101d70 2024-04-26T21:20:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.018+0000 7f8f2ea00700 1 -- 172.21.15.84:0/3339169029 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f280113a0 con 0x7f8f38101d70 2024-04-26T21:20:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.018+0000 7f8f3dc00700 1 -- 172.21.15.84:0/3339169029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3810ff80 con 0x7f8f38101d70 2024-04-26T21:20:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.019+0000 7f8f3dc00700 1 -- 172.21.15.84:0/3339169029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f38110540 con 0x7f8f38101d70 2024-04-26T21:20:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.020+0000 7f8f3dc00700 1 -- 172.21.15.84:0/3339169029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f380fd4c0 con 0x7f8f38101d70 2024-04-26T21:20:09.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.021+0000 7f8f2ea00700 1 -- 172.21.15.84:0/3339169029 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f8f28012400 con 0x7f8f38101d70 2024-04-26T21:20:09.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.023+0000 7f8f2ea00700 1 --2- 172.21.15.84:0/3339169029 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f8f1c0692a0 0x7f8f1c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:09.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.023+0000 7f8f2ea00700 1 -- 172.21.15.84:0/3339169029 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8f280879b0 con 0x7f8f38101d70 2024-04-26T21:20:09.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.023+0000 7f8f36000700 1 --2- 172.21.15.84:0/3339169029 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f8f1c0692a0 0x7f8f1c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:09.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.024+0000 7f8f36000700 1 --2- 172.21.15.84:0/3339169029 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f8f1c0692a0 0x7f8f1c06b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400b3b0 tx=0x7f8f24009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:09.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.027+0000 7f8f2ea00700 1 -- 172.21.15.84:0/3339169029 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8f28057a90 con 0x7f8f38101d70 2024-04-26T21:20:09.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:09 smithi084 ceph-mon[25539]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:09.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.244+0000 7f8f3dc00700 1 -- 172.21.15.84:0/3339169029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f3804c710 con 0x7f8f38101d70 2024-04-26T21:20:09.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.246+0000 7f8f2ea00700 1 -- 172.21.15.84:0/3339169029 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11092 (secure 0 0 0) 0x7f8f28057620 con 0x7f8f38101d70 2024-04-26T21:20:09.247 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:20:09.247 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":40,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","created":"2024-04-26T21:12:29.304108+0000","modified":"2024-04-26T21:19:42.952340+0000","last_up_change":"2024-04-26T21:19:41.940176+0000","last_in_change":"2024-04-26T21:19:18.310009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:17:58.092436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"d6c04d45-3ba8-4cc3-92ee-2e99279c6da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":4265849542},{"type":"v1","addr":"172.21.15.84:6803","nonce":4265849542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4265849542},{"type":"v1","addr":"172.21.15.84:6805","nonce":4265849542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4265849542},{"type":"v1","addr":"172.21.15.84:6809","nonce":4265849542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":4265849542},{"type":"v1","addr":"172.21.15.84:6807","nonce":4265849542}]},"public_addr":"172.21.15.84:6803/4265849542","cluster_addr":"172.21.15.84:6805/4265849542","heartbeat_back_addr":"172.21.15.84:6809/4265849542","heartbeat_front_addr":"172.21.15.84:6807/4265849542","state":["exists","up"]},{"osd":1,"uuid":"4417e988-3443-4671-8df5-4d964b8e5954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2545485308},{"type":"v1","addr":"172.21.15.84:6811","nonce":2545485308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2545485308},{"type":"v1","addr":"172.21.15.84:6813","nonce":2545485308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2545485308},{"type":"v1","addr":"172.21.15.84:6817","nonce":2545485308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2545485308},{"type":"v1","addr":"172.21.15.84:6815","nonce":2545485308}]},"public_addr":"172.21.15.84:6811/2545485308","cluster_addr":"172.21.15.84:6813/2545485308","heartbeat_back_addr":"172.21.15.84:6817/2545485308","heartbeat_front_addr":"172.21.15.84:6815/2545485308","state":["exists","up"]},{"osd":2,"uuid":"240901fd-0810-4752-bfa0-2857359b30a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1485373275},{"type":"v1","addr":"172.21.15.84:6819","nonce":1485373275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1485373275},{"type":"v1","addr":"172.21.15.84:6821","nonce":1485373275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1485373275},{"type":"v1","addr":"172.21.15.84:6825","nonce":1485373275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1485373275},{"type":"v1","addr":"172.21.15.84:6823","nonce":1485373275}]},"public_addr":"172.21.15.84:6819/1485373275","cluster_addr":"172.21.15.84:6821/1485373275","heartbeat_back_addr":"172.21.15.84:6825/1485373275","heartbeat_front_addr":"172.21.15.84:6823/1485373275","state":["exists","up"]},{"osd":3,"uuid":"f2d8384f-8b7d-4da4-8a67-4bdb83753822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1269727678},{"type":"v1","addr":"172.21.15.120:6801","nonce":1269727678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1269727678},{"type":"v1","addr":"172.21.15.120:6803","nonce":1269727678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1269727678},{"type":"v1","addr":"172.21.15.120:6807","nonce":1269727678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1269727678},{"type":"v1","addr":"172.21.15.120:6805","nonce":1269727678}]},"public_addr":"172.21.15.120:6801/1269727678","cluster_addr":"172.21.15.120:6803/1269727678","heartbeat_back_addr":"172.21.15.120:6807/1269727678","heartbeat_front_addr":"172.21.15.120:6805/1269727678","state":["exists","up"]},{"osd":4,"uuid":"27aa8cbb-e94e-4e63-b2d4-be8a71b292ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3403602597},{"type":"v1","addr":"172.21.15.120:6809","nonce":3403602597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":3403602597},{"type":"v1","addr":"172.21.15.120:6811","nonce":3403602597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":3403602597},{"type":"v1","addr":"172.21.15.120:6815","nonce":3403602597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3403602597},{"type":"v1","addr":"172.21.15.120:6813","nonce":3403602597}]},"public_addr":"172.21.15.120:6809/3403602597","cluster_addr":"172.21.15.120:6811/3403602597","heartbeat_back_addr":"172.21.15.120:6815/3403602597","heartbeat_front_addr":"172.21.15.120:6813/3403602597","state":["exists","up"]},{"osd":5,"uuid":"e13abdd9-155d-40a0-a69a-4448a658ee5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":2091850685},{"type":"v1","addr":"172.21.15.120:6817","nonce":2091850685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":2091850685},{"type":"v1","addr":"172.21.15.120:6819","nonce":2091850685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":2091850685},{"type":"v1","addr":"172.21.15.120:6823","nonce":2091850685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":2091850685},{"type":"v1","addr":"172.21.15.120:6821","nonce":2091850685}]},"public_addr":"172.21.15.120:6817/2091850685","cluster_addr":"172.21.15.120:6819/2091850685","heartbeat_back_addr":"172.21.15.120:6823/2091850685","heartbeat_front_addr":"172.21.15.120:6821/2091850685","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:45.823555+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:17:20.567670+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:17:55.623700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:18:31.061632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:19:06.227030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:19:40.886216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/1001623":"2024-04-27T21:15:11.400421+0000","172.21.15.84:0/3356039008":"2024-04-27T21:15:11.400421+0000","172.21.15.84:6800/3446199945":"2024-04-27T21:15:11.400421+0000","172.21.15.84:6801/2151160823":"2024-04-27T21:13:42.669268+0000","172.21.15.84:6800/2151160823":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/1155142360":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/1430131141":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/801206978":"2024-04-27T21:13:03.641160+0000","172.21.15.84:0/1460734944":"2024-04-27T21:13:03.641160+0000","172.21.15.84:6800/3231603698":"2024-04-27T21:13:03.641160+0000","172.21.15.84:0/3648317863":"2024-04-27T21:13:03.641160+0000","172.21.15.84:6801/3231603698":"2024-04-27T21:13:03.641160+0000","172.21.15.84:0/413656261":"2024-04-27T21:15:11.400421+0000","172.21.15.84:6801/3446199945":"2024-04-27T21:15:11.400421+0000","172.21.15.84:0/3621485381":"2024-04-27T21:13:42.669268+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:20:09.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.248+0000 7f8f3dc00700 1 -- 172.21.15.84:0/3339169029 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f8f1c0692a0 msgr2=0x7f8f1c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:09.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.248+0000 7f8f3dc00700 1 --2- 172.21.15.84:0/3339169029 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f8f1c0692a0 0x7f8f1c06b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400b3b0 tx=0x7f8f24009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:09.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.248+0000 7f8f3dc00700 1 -- 172.21.15.84:0/3339169029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f38101d70 msgr2=0x7f8f38115b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:09.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.248+0000 7f8f3dc00700 1 --2- 172.21.15.84:0/3339169029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f38101d70 0x7f8f38115b30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800c830 tx=0x7f8f28004470 comp rx=0 tx=0).stop 2024-04-26T21:20:09.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.248+0000 7f8f3dc00700 1 -- 172.21.15.84:0/3339169029 shutdown_connections 2024-04-26T21:20:09.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.248+0000 7f8f3dc00700 1 --2- 172.21.15.84:0/3339169029 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f8f1c0692a0 0x7f8f1c06b750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:09.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.248+0000 7f8f3dc00700 1 --2- 172.21.15.84:0/3339169029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f38101d70 0x7f8f38115b30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:09.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.248+0000 7f8f3dc00700 1 --2- 172.21.15.84:0/3339169029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f38102710 0x7f8f38116070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:09.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.248+0000 7f8f3dc00700 1 -- 172.21.15.84:0/3339169029 >> 172.21.15.84:0/3339169029 conn(0x7f8f380f78e0 msgr2=0x7f8f38066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:09.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.249+0000 7f8f3dc00700 1 -- 172.21.15.84:0/3339169029 shutdown_connections 2024-04-26T21:20:09.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:09.249+0000 7f8f3dc00700 1 -- 172.21.15.84:0/3339169029 wait complete. 2024-04-26T21:20:09.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:09 smithi120 ceph-mon[32741]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:09.982 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-26T21:20:09.983 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-26T21:20:09.983 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-26T21:20:09.984 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-26T21:20:09.984 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-26T21:20:09.984 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-26T21:20:10.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:10 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3339169029' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:20:10.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:10 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/3339169029' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:20:10.500 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:10.504 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:11.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:11 smithi084 ceph-mon[25539]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:11.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:11 smithi120 ceph-mon[32741]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:11.682 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:11.682 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:12.038 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:12.041 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:12.295 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:12 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:20:12.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:12 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:20:13.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:13 smithi084 ceph-mon[25539]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:13.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:13 smithi120 ceph-mon[32741]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:15.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:15 smithi084 ceph-mon[25539]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:15.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:15 smithi120 ceph-mon[32741]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:16.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.867+0000 7f86a2e00700 1 -- 172.21.15.84:0/1290812083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f869c0702a0 msgr2=0x7f869c070670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.867+0000 7f86a2e00700 1 --2- 172.21.15.84:0/1290812083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f869c0702a0 0x7f869c070670 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8690004970 tx=0x7f8690009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.867+0000 7f86a2e00700 1 -- 172.21.15.84:0/1290812083 shutdown_connections 2024-04-26T21:20:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.867+0000 7f86a2e00700 1 --2- 172.21.15.84:0/1290812083 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f869c070bb0 0x7f869c108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.867+0000 7f86a2e00700 1 --2- 172.21.15.84:0/1290812083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f869c0702a0 0x7f869c070670 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.867+0000 7f86a2e00700 1 -- 172.21.15.84:0/1290812083 >> 172.21.15.84:0/1290812083 conn(0x7f869c0f8740 msgr2=0x7f869c0fab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.867+0000 7f86a2e00700 1 -- 172.21.15.84:0/1290812083 shutdown_connections 2024-04-26T21:20:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.868+0000 7f86a2e00700 1 -- 172.21.15.84:0/1290812083 wait complete. 2024-04-26T21:20:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.868+0000 7f86a2e00700 1 Processor -- start 2024-04-26T21:20:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.869+0000 7f86a2e00700 1 -- start start 2024-04-26T21:20:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.869+0000 7f86a2e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f869c0702a0 0x7f869c115b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.869+0000 7f86a2e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f869c070bb0 0x7f869c1160c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.869+0000 7f86a2e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c1167a0 con 0x7f869c070bb0 2024-04-26T21:20:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.869+0000 7f86a2e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c10fb20 con 0x7f869c0702a0 2024-04-26T21:20:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.869+0000 7f86a1000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f869c070bb0 0x7f869c1160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.869+0000 7f86a1000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f869c070bb0 0x7f869c1160c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52616/0 (socket says 172.21.15.84:52616) 2024-04-26T21:20:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.869+0000 7f86a1000700 1 -- 172.21.15.84:0/719031301 learned_addr learned my addr 172.21.15.84:0/719031301 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.870+0000 7f86a1a00700 1 --2- 172.21.15.84:0/719031301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f869c0702a0 0x7f869c115b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.870+0000 7f86a1000700 1 -- 172.21.15.84:0/719031301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f869c0702a0 msgr2=0x7f869c115b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.870+0000 7f86a1000700 1 --2- 172.21.15.84:0/719031301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f869c0702a0 0x7f869c115b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.870+0000 7f86a1000700 1 -- 172.21.15.84:0/719031301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8690005040 con 0x7f869c070bb0 2024-04-26T21:20:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.870+0000 7f86a1000700 1 --2- 172.21.15.84:0/719031301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f869c070bb0 0x7f869c1160c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f868800b790 tx=0x7f8688009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.870+0000 7f8699600700 1 -- 172.21.15.84:0/719031301 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f868800f770 con 0x7f869c070bb0 2024-04-26T21:20:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.870+0000 7f8699600700 1 -- 172.21.15.84:0/719031301 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f868800fda0 con 0x7f869c070bb0 2024-04-26T21:20:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.870+0000 7f86a2e00700 1 -- 172.21.15.84:0/719031301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f869c10fe00 con 0x7f869c070bb0 2024-04-26T21:20:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.870+0000 7f8699600700 1 -- 172.21.15.84:0/719031301 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f868800d310 con 0x7f869c070bb0 2024-04-26T21:20:16.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.870+0000 7f86a2e00700 1 -- 172.21.15.84:0/719031301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f869c110340 con 0x7f869c070bb0 2024-04-26T21:20:16.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.871+0000 7f86a2e00700 1 -- 172.21.15.84:0/719031301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f869c1108c0 con 0x7f869c070bb0 2024-04-26T21:20:16.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.872+0000 7f8699600700 1 -- 172.21.15.84:0/719031301 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f8688010420 con 0x7f869c070bb0 2024-04-26T21:20:16.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.873+0000 7f8699600700 1 --2- 172.21.15.84:0/719031301 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f86840692a0 0x7f868406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:16.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.874+0000 7f8699600700 1 -- 172.21.15.84:0/719031301 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8688086f20 con 0x7f869c070bb0 2024-04-26T21:20:16.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.874+0000 7f86a1a00700 1 --2- 172.21.15.84:0/719031301 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f86840692a0 0x7f868406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:16.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.874+0000 7f8699600700 1 --2- 172.21.15.84:0/719031301 >> [v2:172.21.15.84:6810/2545485308,v1:172.21.15.84:6811/2545485308] conn(0x7f868406ef70 0x7f8684071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:16.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.874+0000 7f8699600700 1 -- 172.21.15.84:0/719031301 --> [v2:172.21.15.84:6810/2545485308,v1:172.21.15.84:6811/2545485308] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8684071a30 con 0x7f868406ef70 2024-04-26T21:20:16.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.874+0000 7f8699600700 1 -- 172.21.15.84:0/719031301 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f868808c490 con 0x7f869c070bb0 2024-04-26T21:20:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.874+0000 7f86a2400700 1 --2- 172.21.15.84:0/719031301 >> [v2:172.21.15.84:6810/2545485308,v1:172.21.15.84:6811/2545485308] conn(0x7f868406ef70 0x7f8684071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.874+0000 7f86a1a00700 1 --2- 172.21.15.84:0/719031301 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f86840692a0 0x7f868406b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f869000b370 tx=0x7f8690009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.875+0000 7f86a2400700 1 --2- 172.21.15.84:0/719031301 >> [v2:172.21.15.84:6810/2545485308,v1:172.21.15.84:6811/2545485308] conn(0x7f868406ef70 0x7f8684071380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.876+0000 7f8699600700 1 -- 172.21.15.84:0/719031301 <== osd.1 v2:172.21.15.84:6810/2545485308 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f8684071a30 con 0x7f868406ef70 2024-04-26T21:20:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.892+0000 7f86a2e00700 1 -- 172.21.15.84:0/719031301 --> [v2:172.21.15.84:6810/2545485308,v1:172.21.15.84:6811/2545485308] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f869c0fa5a0 con 0x7f868406ef70 2024-04-26T21:20:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.892+0000 7f8699600700 1 -- 172.21.15.84:0/719031301 <== osd.1 v2:172.21.15.84:6810/2545485308 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f869c0fa5a0 con 0x7f868406ef70 2024-04-26T21:20:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.893+0000 7f86a2e00700 1 -- 172.21.15.84:0/719031301 >> [v2:172.21.15.84:6810/2545485308,v1:172.21.15.84:6811/2545485308] conn(0x7f868406ef70 msgr2=0x7f8684071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.893+0000 7f86a2e00700 1 --2- 172.21.15.84:0/719031301 >> [v2:172.21.15.84:6810/2545485308,v1:172.21.15.84:6811/2545485308] conn(0x7f868406ef70 0x7f8684071380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.893+0000 7f86a2e00700 1 -- 172.21.15.84:0/719031301 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f86840692a0 msgr2=0x7f868406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.893+0000 7f86a2e00700 1 --2- 172.21.15.84:0/719031301 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f86840692a0 0x7f868406b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f869000b370 tx=0x7f8690009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.893+0000 7f86a2e00700 1 -- 172.21.15.84:0/719031301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f869c070bb0 msgr2=0x7f869c1160c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.893+0000 7f86a2e00700 1 --2- 172.21.15.84:0/719031301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f869c070bb0 0x7f869c1160c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f868800b790 tx=0x7f8688009250 comp rx=0 tx=0).stop 2024-04-26T21:20:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.893+0000 7f86a2e00700 1 -- 172.21.15.84:0/719031301 shutdown_connections 2024-04-26T21:20:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.893+0000 7f86a2e00700 1 --2- 172.21.15.84:0/719031301 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f86840692a0 0x7f868406b750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.893+0000 7f86a2e00700 1 --2- 172.21.15.84:0/719031301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f869c0702a0 0x7f869c115b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:16.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.893+0000 7f86a2e00700 1 --2- 172.21.15.84:0/719031301 >> [v2:172.21.15.84:6810/2545485308,v1:172.21.15.84:6811/2545485308] conn(0x7f868406ef70 0x7f8684071380 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:16.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.893+0000 7f86a2e00700 1 --2- 172.21.15.84:0/719031301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f869c070bb0 0x7f869c1160c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:16.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.893+0000 7f86a2e00700 1 -- 172.21.15.84:0/719031301 >> 172.21.15.84:0/719031301 conn(0x7f869c0f8740 msgr2=0x7f869c0f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:16.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.894+0000 7f86a2e00700 1 -- 172.21.15.84:0/719031301 shutdown_connections 2024-04-26T21:20:16.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:15.894+0000 7f86a2e00700 1 -- 172.21.15.84:0/719031301 wait complete. 2024-04-26T21:20:17.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:17 smithi084 ceph-mon[25539]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:17.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:17 smithi120 ceph-mon[32741]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:17.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.803+0000 7f817a600700 1 -- 172.21.15.84:0/1505315374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8174071f30 msgr2=0x7f8174070300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:17.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.803+0000 7f817a600700 1 --2- 172.21.15.84:0/1505315374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8174071f30 0x7f8174070300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8164004970 tx=0x7f8164009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:17.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.803+0000 7f817a600700 1 -- 172.21.15.84:0/1505315374 shutdown_connections 2024-04-26T21:20:17.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.803+0000 7f817a600700 1 --2- 172.21.15.84:0/1505315374 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8174070840 0x7f8174070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:17.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.803+0000 7f817a600700 1 --2- 172.21.15.84:0/1505315374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8174071f30 0x7f8174070300 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:17.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.803+0000 7f817a600700 1 -- 172.21.15.84:0/1505315374 >> 172.21.15.84:0/1505315374 conn(0x7f81740f89b0 msgr2=0x7f81740fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:17.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.803+0000 7f817a600700 1 -- 172.21.15.84:0/1505315374 shutdown_connections 2024-04-26T21:20:17.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.803+0000 7f817a600700 1 -- 172.21.15.84:0/1505315374 wait complete. 2024-04-26T21:20:17.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.804+0000 7f817a600700 1 Processor -- start 2024-04-26T21:20:17.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.804+0000 7f817a600700 1 -- start start 2024-04-26T21:20:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.804+0000 7f817a600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8174070840 0x7f817411a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.804+0000 7f817a600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8174071f30 0x7f817411a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.804+0000 7f817a600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817411adf0 con 0x7f8174071f30 2024-04-26T21:20:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.804+0000 7f817a600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8174114130 con 0x7f8174070840 2024-04-26T21:20:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.805+0000 7f8172a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8174071f30 0x7f817411a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.805+0000 7f8172a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8174071f30 0x7f817411a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52634/0 (socket says 172.21.15.84:52634) 2024-04-26T21:20:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.805+0000 7f8172a00700 1 -- 172.21.15.84:0/1905182408 learned_addr learned my addr 172.21.15.84:0/1905182408 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.805+0000 7f8173400700 1 --2- 172.21.15.84:0/1905182408 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8174070840 0x7f817411a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.805+0000 7f8172a00700 1 -- 172.21.15.84:0/1905182408 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8174070840 msgr2=0x7f817411a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.805+0000 7f8172a00700 1 --2- 172.21.15.84:0/1905182408 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8174070840 0x7f817411a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.805+0000 7f8172a00700 1 -- 172.21.15.84:0/1905182408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8164005040 con 0x7f8174071f30 2024-04-26T21:20:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.806+0000 7f8172a00700 1 --2- 172.21.15.84:0/1905182408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8174071f30 0x7f817411a710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f816000b790 tx=0x7f8160009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.806+0000 7f816b400700 1 -- 172.21.15.84:0/1905182408 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f816000f770 con 0x7f8174071f30 2024-04-26T21:20:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.806+0000 7f816b400700 1 -- 172.21.15.84:0/1905182408 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f816000fda0 con 0x7f8174071f30 2024-04-26T21:20:17.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.806+0000 7f817a600700 1 -- 172.21.15.84:0/1905182408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81741143b0 con 0x7f8174071f30 2024-04-26T21:20:17.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.806+0000 7f816b400700 1 -- 172.21.15.84:0/1905182408 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f816000d310 con 0x7f8174071f30 2024-04-26T21:20:17.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.806+0000 7f817a600700 1 -- 172.21.15.84:0/1905182408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81741148f0 con 0x7f8174071f30 2024-04-26T21:20:17.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.807+0000 7f817a600700 1 -- 172.21.15.84:0/1905182408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8174114e80 con 0x7f8174071f30 2024-04-26T21:20:17.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.808+0000 7f816b400700 1 -- 172.21.15.84:0/1905182408 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f8160010420 con 0x7f8174071f30 2024-04-26T21:20:17.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.809+0000 7f816b400700 1 --2- 172.21.15.84:0/1905182408 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f81580692b0 0x7f815806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:17.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.809+0000 7f816b400700 1 -- 172.21.15.84:0/1905182408 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f81600878b0 con 0x7f8174071f30 2024-04-26T21:20:17.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.809+0000 7f8173400700 1 --2- 172.21.15.84:0/1905182408 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f81580692b0 0x7f815806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:17.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.809+0000 7f816b400700 1 --2- 172.21.15.84:0/1905182408 >> [v2:172.21.15.120:6800/1269727678,v1:172.21.15.120:6801/1269727678] conn(0x7f815806ef80 0x7f8158071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:17.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.809+0000 7f816b400700 1 -- 172.21.15.84:0/1905182408 --> [v2:172.21.15.120:6800/1269727678,v1:172.21.15.120:6801/1269727678] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8158071a40 con 0x7f815806ef80 2024-04-26T21:20:17.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.809+0000 7f816b400700 1 -- 172.21.15.84:0/1905182408 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8160087cb0 con 0x7f8174071f30 2024-04-26T21:20:17.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.810+0000 7f8173400700 1 --2- 172.21.15.84:0/1905182408 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f81580692b0 0x7f815806b760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f816400b370 tx=0x7f8164009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:17.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.810+0000 7f8173e00700 1 --2- 172.21.15.84:0/1905182408 >> [v2:172.21.15.120:6800/1269727678,v1:172.21.15.120:6801/1269727678] conn(0x7f815806ef80 0x7f8158071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:17.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.811+0000 7f8173e00700 1 --2- 172.21.15.84:0/1905182408 >> [v2:172.21.15.120:6800/1269727678,v1:172.21.15.120:6801/1269727678] conn(0x7f815806ef80 0x7f8158071390 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:17.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.813+0000 7f816b400700 1 -- 172.21.15.84:0/1905182408 <== osd.3 v2:172.21.15.120:6800/1269727678 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f8158071a40 con 0x7f815806ef80 2024-04-26T21:20:17.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.831+0000 7f817a600700 1 -- 172.21.15.84:0/1905182408 --> [v2:172.21.15.120:6800/1269727678,v1:172.21.15.120:6801/1269727678] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f81740fa400 con 0x7f815806ef80 2024-04-26T21:20:17.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.832+0000 7f816b400700 1 -- 172.21.15.84:0/1905182408 <== osd.3 v2:172.21.15.120:6800/1269727678 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f81740fa400 con 0x7f815806ef80 2024-04-26T21:20:17.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.833+0000 7f817a600700 1 -- 172.21.15.84:0/1905182408 >> [v2:172.21.15.120:6800/1269727678,v1:172.21.15.120:6801/1269727678] conn(0x7f815806ef80 msgr2=0x7f8158071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:17.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.833+0000 7f817a600700 1 --2- 172.21.15.84:0/1905182408 >> [v2:172.21.15.120:6800/1269727678,v1:172.21.15.120:6801/1269727678] conn(0x7f815806ef80 0x7f8158071390 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:17.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.833+0000 7f817a600700 1 -- 172.21.15.84:0/1905182408 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f81580692b0 msgr2=0x7f815806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:17.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.833+0000 7f817a600700 1 --2- 172.21.15.84:0/1905182408 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f81580692b0 0x7f815806b760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f816400b370 tx=0x7f8164009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:17.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.833+0000 7f817a600700 1 -- 172.21.15.84:0/1905182408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8174071f30 msgr2=0x7f817411a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:17.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.833+0000 7f817a600700 1 --2- 172.21.15.84:0/1905182408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8174071f30 0x7f817411a710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f816000b790 tx=0x7f8160009250 comp rx=0 tx=0).stop 2024-04-26T21:20:17.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.833+0000 7f817a600700 1 -- 172.21.15.84:0/1905182408 shutdown_connections 2024-04-26T21:20:17.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.833+0000 7f817a600700 1 --2- 172.21.15.84:0/1905182408 >> [v2:172.21.15.120:6800/1269727678,v1:172.21.15.120:6801/1269727678] conn(0x7f815806ef80 0x7f8158071390 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:17.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.833+0000 7f817a600700 1 --2- 172.21.15.84:0/1905182408 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f81580692b0 0x7f815806b760 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:17.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.833+0000 7f817a600700 1 --2- 172.21.15.84:0/1905182408 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8174070840 0x7f817411a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:17.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.833+0000 7f817a600700 1 --2- 172.21.15.84:0/1905182408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8174071f30 0x7f817411a710 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:17.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.833+0000 7f817a600700 1 -- 172.21.15.84:0/1905182408 >> 172.21.15.84:0/1905182408 conn(0x7f81740f89b0 msgr2=0x7f81740f9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:17.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.833+0000 7f817a600700 1 -- 172.21.15.84:0/1905182408 shutdown_connections 2024-04-26T21:20:17.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:17.833+0000 7f817a600700 1 -- 172.21.15.84:0/1905182408 wait complete. 2024-04-26T21:20:18.417 INFO:teuthology.orchestra.run.smithi084.stdout:60129542181 2024-04-26T21:20:18.418 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-26T21:20:18.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.597+0000 7f88ef200700 1 -- 172.21.15.84:0/2121300647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88e8070bb0 msgr2=0x7f88e8109150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:18.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.597+0000 7f88ef200700 1 --2- 172.21.15.84:0/2121300647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88e8070bb0 0x7f88e8109150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f88d4004970 tx=0x7f88d4009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:18.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.597+0000 7f88ef200700 1 -- 172.21.15.84:0/2121300647 shutdown_connections 2024-04-26T21:20:18.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.597+0000 7f88ef200700 1 --2- 172.21.15.84:0/2121300647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88e8070bb0 0x7f88e8109150 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:18.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.597+0000 7f88ef200700 1 --2- 172.21.15.84:0/2121300647 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88e80702a0 0x7f88e8070670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:18.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.597+0000 7f88ef200700 1 -- 172.21.15.84:0/2121300647 >> 172.21.15.84:0/2121300647 conn(0x7f88e80f8990 msgr2=0x7f88e80fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:18.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.597+0000 7f88ef200700 1 -- 172.21.15.84:0/2121300647 shutdown_connections 2024-04-26T21:20:18.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.597+0000 7f88ef200700 1 -- 172.21.15.84:0/2121300647 wait complete. 2024-04-26T21:20:18.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.598+0000 7f88ef200700 1 Processor -- start 2024-04-26T21:20:18.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.598+0000 7f88ef200700 1 -- start start 2024-04-26T21:20:18.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.599+0000 7f88ef200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88e80702a0 0x7f88e8115b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:18.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.599+0000 7f88ef200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88e8070bb0 0x7f88e81160d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:18.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.599+0000 7f88ef200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e8116720 con 0x7f88e80702a0 2024-04-26T21:20:18.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.599+0000 7f88ef200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e810fd00 con 0x7f88e8070bb0 2024-04-26T21:20:18.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.599+0000 7f88e7e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88e80702a0 0x7f88e8115b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:18.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.599+0000 7f88e7e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88e80702a0 0x7f88e8115b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52650/0 (socket says 172.21.15.84:52650) 2024-04-26T21:20:18.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.599+0000 7f88e7e00700 1 -- 172.21.15.84:0/3636691648 learned_addr learned my addr 172.21.15.84:0/3636691648 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:18.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.599+0000 7f88e7400700 1 --2- 172.21.15.84:0/3636691648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88e8070bb0 0x7f88e81160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:18.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.600+0000 7f88e7e00700 1 -- 172.21.15.84:0/3636691648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88e8070bb0 msgr2=0x7f88e81160d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:18.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.600+0000 7f88e7e00700 1 --2- 172.21.15.84:0/3636691648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88e8070bb0 0x7f88e81160d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:18.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.600+0000 7f88e7e00700 1 -- 172.21.15.84:0/3636691648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d4005040 con 0x7f88e80702a0 2024-04-26T21:20:18.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.600+0000 7f88e7400700 1 --2- 172.21.15.84:0/3636691648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88e8070bb0 0x7f88e81160d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:20:18.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.600+0000 7f88e7e00700 1 --2- 172.21.15.84:0/3636691648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88e80702a0 0x7f88e8115b90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f88d8002a50 tx=0x7f88d80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:18.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.600+0000 7f88dfe00700 1 -- 172.21.15.84:0/3636691648 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88d8007cc0 con 0x7f88e80702a0 2024-04-26T21:20:18.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.600+0000 7f88dfe00700 1 -- 172.21.15.84:0/3636691648 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f88d800f040 con 0x7f88e80702a0 2024-04-26T21:20:18.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.600+0000 7f88dfe00700 1 -- 172.21.15.84:0/3636691648 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88d800db70 con 0x7f88e80702a0 2024-04-26T21:20:18.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.600+0000 7f88ef200700 1 -- 172.21.15.84:0/3636691648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e810ffe0 con 0x7f88e80702a0 2024-04-26T21:20:18.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.601+0000 7f88ef200700 1 -- 172.21.15.84:0/3636691648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e81104f0 con 0x7f88e80702a0 2024-04-26T21:20:18.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.602+0000 7f88ef200700 1 -- 172.21.15.84:0/3636691648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f88e8110a90 con 0x7f88e80702a0 2024-04-26T21:20:18.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.604+0000 7f88dfe00700 1 -- 172.21.15.84:0/3636691648 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f88d800dcd0 con 0x7f88e80702a0 2024-04-26T21:20:18.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.605+0000 7f88dfe00700 1 --2- 172.21.15.84:0/3636691648 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f88cc0692a0 0x7f88cc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:18.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.605+0000 7f88dfe00700 1 -- 172.21.15.84:0/3636691648 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f88d8086af0 con 0x7f88e80702a0 2024-04-26T21:20:18.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.605+0000 7f88dfe00700 1 --2- 172.21.15.84:0/3636691648 >> [v2:172.21.15.84:6802/4265849542,v1:172.21.15.84:6803/4265849542] conn(0x7f88cc06ef70 0x7f88cc071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:18.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.605+0000 7f88dfe00700 1 -- 172.21.15.84:0/3636691648 --> [v2:172.21.15.84:6802/4265849542,v1:172.21.15.84:6803/4265849542] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88cc071a30 con 0x7f88cc06ef70 2024-04-26T21:20:18.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.605+0000 7f88e7400700 1 --2- 172.21.15.84:0/3636691648 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f88cc0692a0 0x7f88cc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:18.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.605+0000 7f88dfe00700 1 -- 172.21.15.84:0/3636691648 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88d8086e30 con 0x7f88e80702a0 2024-04-26T21:20:18.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.605+0000 7f88ed200700 1 --2- 172.21.15.84:0/3636691648 >> [v2:172.21.15.84:6802/4265849542,v1:172.21.15.84:6803/4265849542] conn(0x7f88cc06ef70 0x7f88cc071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:18.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.606+0000 7f88e7400700 1 --2- 172.21.15.84:0/3636691648 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f88cc0692a0 0x7f88cc06b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f88d4009fd0 tx=0x7f88d4009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:18.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.606+0000 7f88ed200700 1 --2- 172.21.15.84:0/3636691648 >> [v2:172.21.15.84:6802/4265849542,v1:172.21.15.84:6803/4265849542] conn(0x7f88cc06ef70 0x7f88cc071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:18.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.607+0000 7f88dfe00700 1 -- 172.21.15.84:0/3636691648 <== osd.0 v2:172.21.15.84:6802/4265849542 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f88cc071a30 con 0x7f88cc06ef70 2024-04-26T21:20:18.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.641+0000 7f88ef200700 1 -- 172.21.15.84:0/3636691648 --> [v2:172.21.15.84:6802/4265849542,v1:172.21.15.84:6803/4265849542] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f88e8110170 con 0x7f88cc06ef70 2024-04-26T21:20:18.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.642+0000 7f88dfe00700 1 -- 172.21.15.84:0/3636691648 <== osd.0 v2:172.21.15.84:6802/4265849542 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f88e8110170 con 0x7f88cc06ef70 2024-04-26T21:20:18.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.642+0000 7f88ef200700 1 -- 172.21.15.84:0/3636691648 >> [v2:172.21.15.84:6802/4265849542,v1:172.21.15.84:6803/4265849542] conn(0x7f88cc06ef70 msgr2=0x7f88cc071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:18.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.642+0000 7f88ef200700 1 --2- 172.21.15.84:0/3636691648 >> [v2:172.21.15.84:6802/4265849542,v1:172.21.15.84:6803/4265849542] conn(0x7f88cc06ef70 0x7f88cc071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:18.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.642+0000 7f88ef200700 1 -- 172.21.15.84:0/3636691648 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f88cc0692a0 msgr2=0x7f88cc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:18.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.642+0000 7f88ef200700 1 --2- 172.21.15.84:0/3636691648 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f88cc0692a0 0x7f88cc06b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f88d4009fd0 tx=0x7f88d4009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:18.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.642+0000 7f88ef200700 1 -- 172.21.15.84:0/3636691648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88e80702a0 msgr2=0x7f88e8115b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:18.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.642+0000 7f88ef200700 1 --2- 172.21.15.84:0/3636691648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88e80702a0 0x7f88e8115b90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f88d8002a50 tx=0x7f88d80046b0 comp rx=0 tx=0).stop 2024-04-26T21:20:18.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.643+0000 7f88ef200700 1 -- 172.21.15.84:0/3636691648 shutdown_connections 2024-04-26T21:20:18.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.643+0000 7f88ef200700 1 --2- 172.21.15.84:0/3636691648 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f88cc0692a0 0x7f88cc06b750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:18.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.643+0000 7f88ef200700 1 --2- 172.21.15.84:0/3636691648 >> [v2:172.21.15.84:6802/4265849542,v1:172.21.15.84:6803/4265849542] conn(0x7f88cc06ef70 0x7f88cc071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:18.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.643+0000 7f88ef200700 1 --2- 172.21.15.84:0/3636691648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88e80702a0 0x7f88e8115b90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:18.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.643+0000 7f88ef200700 1 --2- 172.21.15.84:0/3636691648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88e8070bb0 0x7f88e81160d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:18.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.643+0000 7f88ef200700 1 -- 172.21.15.84:0/3636691648 >> 172.21.15.84:0/3636691648 conn(0x7f88e80f8990 msgr2=0x7f88e80f9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:18.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.643+0000 7f88ef200700 1 -- 172.21.15.84:0/3636691648 shutdown_connections 2024-04-26T21:20:18.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:18.643+0000 7f88ef200700 1 -- 172.21.15.84:0/3636691648 wait complete. 2024-04-26T21:20:19.393 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:19 smithi084 ceph-mon[25539]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:19.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:19 smithi120 ceph-mon[32741]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:20.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.371+0000 7f9413400700 1 -- 172.21.15.84:0/3875889686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f940c109db0 msgr2=0x7f940c103420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:20.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.371+0000 7f9413400700 1 --2- 172.21.15.84:0/3875889686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f940c109db0 0x7f940c103420 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f93f8004940 tx=0x7f93f8009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:20.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.371+0000 7f9413400700 1 -- 172.21.15.84:0/3875889686 shutdown_connections 2024-04-26T21:20:20.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.371+0000 7f9413400700 1 --2- 172.21.15.84:0/3875889686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f940c109db0 0x7f940c103420 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:20.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.371+0000 7f9413400700 1 --2- 172.21.15.84:0/3875889686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f940c109410 0x7f940c1097e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:20.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.371+0000 7f9413400700 1 -- 172.21.15.84:0/3875889686 >> 172.21.15.84:0/3875889686 conn(0x7f940c072c00 msgr2=0x7f940c075010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:20.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.371+0000 7f9413400700 1 -- 172.21.15.84:0/3875889686 shutdown_connections 2024-04-26T21:20:20.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.371+0000 7f9413400700 1 -- 172.21.15.84:0/3875889686 wait complete. 2024-04-26T21:20:20.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.372+0000 7f9413400700 1 Processor -- start 2024-04-26T21:20:20.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.372+0000 7f9413400700 1 -- start start 2024-04-26T21:20:20.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.372+0000 7f9413400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f940c109410 0x7f940c119f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:20.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.372+0000 7f9413400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f940c109db0 0x7f940c11a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:20.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.372+0000 7f9413400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940c11aae0 con 0x7f940c109410 2024-04-26T21:20:20.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.372+0000 7f9413400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940c1140c0 con 0x7f940c109db0 2024-04-26T21:20:20.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.373+0000 7f9410a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f940c109410 0x7f940c119f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:20.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.373+0000 7f9410a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f940c109410 0x7f940c119f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52660/0 (socket says 172.21.15.84:52660) 2024-04-26T21:20:20.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.373+0000 7f9410a00700 1 -- 172.21.15.84:0/3855096829 learned_addr learned my addr 172.21.15.84:0/3855096829 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:20.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.373+0000 7f940be00700 1 --2- 172.21.15.84:0/3855096829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f940c109db0 0x7f940c11a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:20.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.373+0000 7f9410a00700 1 -- 172.21.15.84:0/3855096829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f940c109db0 msgr2=0x7f940c11a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:20.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.373+0000 7f9410a00700 1 --2- 172.21.15.84:0/3855096829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f940c109db0 0x7f940c11a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:20.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.373+0000 7f9410a00700 1 -- 172.21.15.84:0/3855096829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f8005040 con 0x7f940c109410 2024-04-26T21:20:20.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.373+0000 7f9410a00700 1 --2- 172.21.15.84:0/3855096829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f940c109410 0x7f940c119f50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f940000c830 tx=0x7f9400004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:20.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.374+0000 7f9408c00700 1 -- 172.21.15.84:0/3855096829 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f940000a760 con 0x7f940c109410 2024-04-26T21:20:20.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.374+0000 7f9408c00700 1 -- 172.21.15.84:0/3855096829 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f940000ad90 con 0x7f940c109410 2024-04-26T21:20:20.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.374+0000 7f9408c00700 1 -- 172.21.15.84:0/3855096829 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94000113a0 con 0x7f940c109410 2024-04-26T21:20:20.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.374+0000 7f9413400700 1 -- 172.21.15.84:0/3855096829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f940c1143a0 con 0x7f940c109410 2024-04-26T21:20:20.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.374+0000 7f9413400700 1 -- 172.21.15.84:0/3855096829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f940c114960 con 0x7f940c109410 2024-04-26T21:20:20.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.375+0000 7f9413400700 1 -- 172.21.15.84:0/3855096829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f940c114ef0 con 0x7f940c109410 2024-04-26T21:20:20.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.376+0000 7f9408c00700 1 -- 172.21.15.84:0/3855096829 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f9400012400 con 0x7f940c109410 2024-04-26T21:20:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.377+0000 7f9408c00700 1 --2- 172.21.15.84:0/3855096829 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f93f40692a0 0x7f93f406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.377+0000 7f9408c00700 1 -- 172.21.15.84:0/3855096829 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f94000878b0 con 0x7f940c109410 2024-04-26T21:20:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.377+0000 7f940be00700 1 --2- 172.21.15.84:0/3855096829 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f93f40692a0 0x7f93f406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.377+0000 7f9408c00700 1 --2- 172.21.15.84:0/3855096829 >> [v2:172.21.15.84:6818/1485373275,v1:172.21.15.84:6819/1485373275] conn(0x7f93f406ef70 0x7f93f4071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.377+0000 7f9408c00700 1 -- 172.21.15.84:0/3855096829 --> [v2:172.21.15.84:6818/1485373275,v1:172.21.15.84:6819/1485373275] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f93f4071a30 con 0x7f93f406ef70 2024-04-26T21:20:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.377+0000 7f9408c00700 1 -- 172.21.15.84:0/3855096829 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9400087bf0 con 0x7f940c109410 2024-04-26T21:20:20.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.378+0000 7f9411400700 1 --2- 172.21.15.84:0/3855096829 >> [v2:172.21.15.84:6818/1485373275,v1:172.21.15.84:6819/1485373275] conn(0x7f93f406ef70 0x7f93f4071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:20.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.378+0000 7f940be00700 1 --2- 172.21.15.84:0/3855096829 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f93f40692a0 0x7f93f406b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f93f800b3b0 tx=0x7f93f8009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:20.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.378+0000 7f9411400700 1 --2- 172.21.15.84:0/3855096829 >> [v2:172.21.15.84:6818/1485373275,v1:172.21.15.84:6819/1485373275] conn(0x7f93f406ef70 0x7f93f4071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:20.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.379+0000 7f9408c00700 1 -- 172.21.15.84:0/3855096829 <== osd.2 v2:172.21.15.84:6818/1485373275 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f93f4071a30 con 0x7f93f406ef70 2024-04-26T21:20:20.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.396+0000 7f9413400700 1 -- 172.21.15.84:0/3855096829 --> [v2:172.21.15.84:6818/1485373275,v1:172.21.15.84:6819/1485373275] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f940c104b60 con 0x7f93f406ef70 2024-04-26T21:20:20.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.397+0000 7f9408c00700 1 -- 172.21.15.84:0/3855096829 <== osd.2 v2:172.21.15.84:6818/1485373275 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f940c104b60 con 0x7f93f406ef70 2024-04-26T21:20:20.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.397+0000 7f9413400700 1 -- 172.21.15.84:0/3855096829 >> [v2:172.21.15.84:6818/1485373275,v1:172.21.15.84:6819/1485373275] conn(0x7f93f406ef70 msgr2=0x7f93f4071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:20.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.397+0000 7f9413400700 1 --2- 172.21.15.84:0/3855096829 >> [v2:172.21.15.84:6818/1485373275,v1:172.21.15.84:6819/1485373275] conn(0x7f93f406ef70 0x7f93f4071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:20.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.398+0000 7f9413400700 1 -- 172.21.15.84:0/3855096829 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f93f40692a0 msgr2=0x7f93f406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:20.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.398+0000 7f9413400700 1 --2- 172.21.15.84:0/3855096829 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f93f40692a0 0x7f93f406b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f93f800b3b0 tx=0x7f93f8009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:20.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.398+0000 7f9413400700 1 -- 172.21.15.84:0/3855096829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f940c109410 msgr2=0x7f940c119f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:20.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.398+0000 7f9413400700 1 --2- 172.21.15.84:0/3855096829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f940c109410 0x7f940c119f50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f940000c830 tx=0x7f9400004470 comp rx=0 tx=0).stop 2024-04-26T21:20:20.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.398+0000 7f9413400700 1 -- 172.21.15.84:0/3855096829 shutdown_connections 2024-04-26T21:20:20.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.398+0000 7f9413400700 1 --2- 172.21.15.84:0/3855096829 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f93f40692a0 0x7f93f406b750 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:20.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.398+0000 7f9413400700 1 --2- 172.21.15.84:0/3855096829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f940c109410 0x7f940c119f50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:20.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.398+0000 7f9413400700 1 --2- 172.21.15.84:0/3855096829 >> [v2:172.21.15.84:6818/1485373275,v1:172.21.15.84:6819/1485373275] conn(0x7f93f406ef70 0x7f93f4071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:20.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.398+0000 7f9413400700 1 --2- 172.21.15.84:0/3855096829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f940c109db0 0x7f940c11a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:20.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.398+0000 7f9413400700 1 -- 172.21.15.84:0/3855096829 >> 172.21.15.84:0/3855096829 conn(0x7f940c072c00 msgr2=0x7f940c074c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:20.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.398+0000 7f9413400700 1 -- 172.21.15.84:0/3855096829 shutdown_connections 2024-04-26T21:20:20.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.398+0000 7f9413400700 1 -- 172.21.15.84:0/3855096829 wait complete. 2024-04-26T21:20:20.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.549+0000 7f47d3600700 1 -- 172.21.15.84:0/518437722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47cc109410 msgr2=0x7f47cc1097e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:20.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.549+0000 7f47d3600700 1 --2- 172.21.15.84:0/518437722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47cc109410 0x7f47cc1097e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f47c0004940 tx=0x7f47c0009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:20.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.549+0000 7f47d3600700 1 -- 172.21.15.84:0/518437722 shutdown_connections 2024-04-26T21:20:20.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.549+0000 7f47d3600700 1 --2- 172.21.15.84:0/518437722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47cc109db0 0x7f47cc103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:20.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.549+0000 7f47d3600700 1 --2- 172.21.15.84:0/518437722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47cc109410 0x7f47cc1097e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:20.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.549+0000 7f47d3600700 1 -- 172.21.15.84:0/518437722 >> 172.21.15.84:0/518437722 conn(0x7f47cc072c00 msgr2=0x7f47cc075010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:20.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.549+0000 7f47d3600700 1 -- 172.21.15.84:0/518437722 shutdown_connections 2024-04-26T21:20:20.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.549+0000 7f47d3600700 1 -- 172.21.15.84:0/518437722 wait complete. 2024-04-26T21:20:20.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.550+0000 7f47d3600700 1 Processor -- start 2024-04-26T21:20:20.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.550+0000 7f47d3600700 1 -- start start 2024-04-26T21:20:20.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.550+0000 7f47d3600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47cc109410 0x7f47cc119f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:20.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.550+0000 7f47d3600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47cc109db0 0x7f47cc11a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:20.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.550+0000 7f47d3600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc11aab0 con 0x7f47cc109410 2024-04-26T21:20:20.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.550+0000 7f47d3600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc114090 con 0x7f47cc109db0 2024-04-26T21:20:20.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.551+0000 7f47d0c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47cc109410 0x7f47cc119f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:20.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.551+0000 7f47d0c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47cc109410 0x7f47cc119f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52682/0 (socket says 172.21.15.84:52682) 2024-04-26T21:20:20.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.551+0000 7f47d0c00700 1 -- 172.21.15.84:0/3132445110 learned_addr learned my addr 172.21.15.84:0/3132445110 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:20.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.551+0000 7f47cbe00700 1 --2- 172.21.15.84:0/3132445110 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47cc109db0 0x7f47cc11a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:20.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.551+0000 7f47d0c00700 1 -- 172.21.15.84:0/3132445110 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47cc109db0 msgr2=0x7f47cc11a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:20.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.551+0000 7f47d0c00700 1 --2- 172.21.15.84:0/3132445110 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47cc109db0 0x7f47cc11a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:20.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.551+0000 7f47d0c00700 1 -- 172.21.15.84:0/3132445110 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c0005040 con 0x7f47cc109410 2024-04-26T21:20:20.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.551+0000 7f47d0c00700 1 --2- 172.21.15.84:0/3132445110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47cc109410 0x7f47cc119f20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009150 tx=0x7f47c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:20.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.552+0000 7f47c8c00700 1 -- 172.21.15.84:0/3132445110 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47c000e040 con 0x7f47cc109410 2024-04-26T21:20:20.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.552+0000 7f47c8c00700 1 -- 172.21.15.84:0/3132445110 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f47c0013420 con 0x7f47cc109410 2024-04-26T21:20:20.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.552+0000 7f47d3600700 1 -- 172.21.15.84:0/3132445110 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47cc114310 con 0x7f47cc109410 2024-04-26T21:20:20.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.552+0000 7f47c8c00700 1 -- 172.21.15.84:0/3132445110 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47c001c630 con 0x7f47cc109410 2024-04-26T21:20:20.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.552+0000 7f47d3600700 1 -- 172.21.15.84:0/3132445110 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47cc1148d0 con 0x7f47cc109410 2024-04-26T21:20:20.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.553+0000 7f47d3600700 1 -- 172.21.15.84:0/3132445110 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f47cc114ec0 con 0x7f47cc109410 2024-04-26T21:20:20.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.554+0000 7f47c8c00700 1 -- 172.21.15.84:0/3132445110 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f47c0013590 con 0x7f47cc109410 2024-04-26T21:20:20.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.555+0000 7f47c8c00700 1 --2- 172.21.15.84:0/3132445110 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f47b40692a0 0x7f47b406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:20.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.555+0000 7f47c8c00700 1 -- 172.21.15.84:0/3132445110 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f47c0088b60 con 0x7f47cc109410 2024-04-26T21:20:20.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.555+0000 7f47cbe00700 1 --2- 172.21.15.84:0/3132445110 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f47b40692a0 0x7f47b406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:20.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.555+0000 7f47c8c00700 1 --2- 172.21.15.84:0/3132445110 >> [v2:172.21.15.120:6808/3403602597,v1:172.21.15.120:6809/3403602597] conn(0x7f47b406ef70 0x7f47b4071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:20.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.555+0000 7f47c8c00700 1 -- 172.21.15.84:0/3132445110 --> [v2:172.21.15.120:6808/3403602597,v1:172.21.15.120:6809/3403602597] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f47b4071a30 con 0x7f47b406ef70 2024-04-26T21:20:20.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.555+0000 7f47c8c00700 1 -- 172.21.15.84:0/3132445110 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47c0088ea0 con 0x7f47cc109410 2024-04-26T21:20:20.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.556+0000 7f47cbe00700 1 --2- 172.21.15.84:0/3132445110 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f47b40692a0 0x7f47b406b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f47cc1157c0 tx=0x7f47b800b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:20.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.556+0000 7f47d1600700 1 --2- 172.21.15.84:0/3132445110 >> [v2:172.21.15.120:6808/3403602597,v1:172.21.15.120:6809/3403602597] conn(0x7f47b406ef70 0x7f47b4071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:20.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.557+0000 7f47d1600700 1 --2- 172.21.15.84:0/3132445110 >> [v2:172.21.15.120:6808/3403602597,v1:172.21.15.120:6809/3403602597] conn(0x7f47b406ef70 0x7f47b4071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:20.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.559+0000 7f47c8c00700 1 -- 172.21.15.84:0/3132445110 <== osd.4 v2:172.21.15.120:6808/3403602597 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f47b4071a30 con 0x7f47b406ef70 2024-04-26T21:20:20.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.575+0000 7f47d3600700 1 -- 172.21.15.84:0/3132445110 --> [v2:172.21.15.120:6808/3403602597,v1:172.21.15.120:6809/3403602597] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f47cc1144a0 con 0x7f47b406ef70 2024-04-26T21:20:20.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.576+0000 7f47c8c00700 1 -- 172.21.15.84:0/3132445110 <== osd.4 v2:172.21.15.120:6808/3403602597 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f47cc1144a0 con 0x7f47b406ef70 2024-04-26T21:20:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.576+0000 7f47d3600700 1 -- 172.21.15.84:0/3132445110 >> [v2:172.21.15.120:6808/3403602597,v1:172.21.15.120:6809/3403602597] conn(0x7f47b406ef70 msgr2=0x7f47b4071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.576+0000 7f47d3600700 1 --2- 172.21.15.84:0/3132445110 >> [v2:172.21.15.120:6808/3403602597,v1:172.21.15.120:6809/3403602597] conn(0x7f47b406ef70 0x7f47b4071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.577+0000 7f47d3600700 1 -- 172.21.15.84:0/3132445110 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f47b40692a0 msgr2=0x7f47b406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.577+0000 7f47d3600700 1 --2- 172.21.15.84:0/3132445110 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f47b40692a0 0x7f47b406b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f47cc1157c0 tx=0x7f47b800b040 comp rx=0 tx=0).stop 2024-04-26T21:20:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.577+0000 7f47d3600700 1 -- 172.21.15.84:0/3132445110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47cc109410 msgr2=0x7f47cc119f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.577+0000 7f47d3600700 1 --2- 172.21.15.84:0/3132445110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47cc109410 0x7f47cc119f20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009150 tx=0x7f47c0009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.577+0000 7f47d3600700 1 -- 172.21.15.84:0/3132445110 shutdown_connections 2024-04-26T21:20:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.577+0000 7f47d3600700 1 --2- 172.21.15.84:0/3132445110 >> [v2:172.21.15.120:6808/3403602597,v1:172.21.15.120:6809/3403602597] conn(0x7f47b406ef70 0x7f47b4071380 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.577+0000 7f47d3600700 1 --2- 172.21.15.84:0/3132445110 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f47b40692a0 0x7f47b406b750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.577+0000 7f47d3600700 1 --2- 172.21.15.84:0/3132445110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47cc109410 0x7f47cc119f20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.577+0000 7f47d3600700 1 --2- 172.21.15.84:0/3132445110 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47cc109db0 0x7f47cc11a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.577+0000 7f47d3600700 1 -- 172.21.15.84:0/3132445110 >> 172.21.15.84:0/3132445110 conn(0x7f47cc072c00 msgr2=0x7f47cc074b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.577+0000 7f47d3600700 1 -- 172.21.15.84:0/3132445110 shutdown_connections 2024-04-26T21:20:20.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:20.577+0000 7f47d3600700 1 -- 172.21.15.84:0/3132445110 wait complete. 2024-04-26T21:20:21.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.035+0000 7f3231800700 1 -- 172.21.15.84:0/3815747763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f322c1059a0 msgr2=0x7f322c0ff010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:21.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.035+0000 7f3231800700 1 --2- 172.21.15.84:0/3815747763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f322c1059a0 0x7f322c0ff010 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3218004940 tx=0x7f3218009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:21.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.035+0000 7f3231800700 1 -- 172.21.15.84:0/3815747763 shutdown_connections 2024-04-26T21:20:21.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.035+0000 7f3231800700 1 --2- 172.21.15.84:0/3815747763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f322c1059a0 0x7f322c0ff010 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:21.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.035+0000 7f3231800700 1 --2- 172.21.15.84:0/3815747763 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f322c105000 0x7f322c1053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:21.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.035+0000 7f3231800700 1 -- 172.21.15.84:0/3815747763 >> 172.21.15.84:0/3815747763 conn(0x7f322c0fab70 msgr2=0x7f322c0fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:21.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.035+0000 7f3231800700 1 -- 172.21.15.84:0/3815747763 shutdown_connections 2024-04-26T21:20:21.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.035+0000 7f3231800700 1 -- 172.21.15.84:0/3815747763 wait complete. 2024-04-26T21:20:21.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.036+0000 7f3231800700 1 Processor -- start 2024-04-26T21:20:21.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.036+0000 7f3231800700 1 -- start start 2024-04-26T21:20:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.037+0000 7f3231800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f322c105000 0x7f322c115ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.037+0000 7f3231800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f322c1059a0 0x7f322c1160e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.037+0000 7f3231800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c116730 con 0x7f322c105000 2024-04-26T21:20:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.037+0000 7f3231800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c10fd10 con 0x7f322c1059a0 2024-04-26T21:20:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.037+0000 7f322aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f322c105000 0x7f322c115ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.037+0000 7f322aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f322c105000 0x7f322c115ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52704/0 (socket says 172.21.15.84:52704) 2024-04-26T21:20:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.037+0000 7f322aa00700 1 -- 172.21.15.84:0/1213185987 learned_addr learned my addr 172.21.15.84:0/1213185987 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.037+0000 7f322aa00700 1 -- 172.21.15.84:0/1213185987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f322c1059a0 msgr2=0x7f322c1160e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.037+0000 7f322aa00700 1 --2- 172.21.15.84:0/1213185987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f322c1059a0 0x7f322c1160e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.037+0000 7f322aa00700 1 -- 172.21.15.84:0/1213185987 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3218005040 con 0x7f322c105000 2024-04-26T21:20:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.038+0000 7f322aa00700 1 --2- 172.21.15.84:0/1213185987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f322c105000 0x7f322c115ba0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f321c002a50 tx=0x7f321c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.038+0000 7f3222a00700 1 -- 172.21.15.84:0/1213185987 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f321c007cc0 con 0x7f322c105000 2024-04-26T21:20:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.038+0000 7f3222a00700 1 -- 172.21.15.84:0/1213185987 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f321c00f040 con 0x7f322c105000 2024-04-26T21:20:21.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.038+0000 7f3231800700 1 -- 172.21.15.84:0/1213185987 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322c10fff0 con 0x7f322c105000 2024-04-26T21:20:21.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.038+0000 7f3222a00700 1 -- 172.21.15.84:0/1213185987 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f321c00db70 con 0x7f322c105000 2024-04-26T21:20:21.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.038+0000 7f3231800700 1 -- 172.21.15.84:0/1213185987 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322c1105b0 con 0x7f322c105000 2024-04-26T21:20:21.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.039+0000 7f3231800700 1 -- 172.21.15.84:0/1213185987 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f322c110ae0 con 0x7f322c105000 2024-04-26T21:20:21.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.040+0000 7f3222a00700 1 -- 172.21.15.84:0/1213185987 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f321c00dd10 con 0x7f322c105000 2024-04-26T21:20:21.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.041+0000 7f3222a00700 1 --2- 172.21.15.84:0/1213185987 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f32100692a0 0x7f321006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:21.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.041+0000 7f3222a00700 1 -- 172.21.15.84:0/1213185987 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f321c086560 con 0x7f322c105000 2024-04-26T21:20:21.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.041+0000 7f322a000700 1 --2- 172.21.15.84:0/1213185987 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f32100692a0 0x7f321006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:21.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.041+0000 7f3222a00700 1 --2- 172.21.15.84:0/1213185987 >> [v2:172.21.15.120:6816/2091850685,v1:172.21.15.120:6817/2091850685] conn(0x7f321006ef70 0x7f3210071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:21.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.041+0000 7f3222a00700 1 -- 172.21.15.84:0/1213185987 --> [v2:172.21.15.120:6816/2091850685,v1:172.21.15.120:6817/2091850685] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3210071a30 con 0x7f321006ef70 2024-04-26T21:20:21.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.041+0000 7f3222a00700 1 -- 172.21.15.84:0/1213185987 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f321c088ab0 con 0x7f322c105000 2024-04-26T21:20:21.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.042+0000 7f322a000700 1 --2- 172.21.15.84:0/1213185987 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f32100692a0 0x7f321006b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3218004f90 tx=0x7f3218009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:21.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.042+0000 7f322b400700 1 --2- 172.21.15.84:0/1213185987 >> [v2:172.21.15.120:6816/2091850685,v1:172.21.15.120:6817/2091850685] conn(0x7f321006ef70 0x7f3210071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:21.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.043+0000 7f322b400700 1 --2- 172.21.15.84:0/1213185987 >> [v2:172.21.15.120:6816/2091850685,v1:172.21.15.120:6817/2091850685] conn(0x7f321006ef70 0x7f3210071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:21.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.045+0000 7f3222a00700 1 -- 172.21.15.84:0/1213185987 <== osd.5 v2:172.21.15.120:6816/2091850685 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f3210071a30 con 0x7f321006ef70 2024-04-26T21:20:21.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.062+0000 7f3231800700 1 -- 172.21.15.84:0/1213185987 --> [v2:172.21.15.120:6816/2091850685,v1:172.21.15.120:6817/2091850685] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f322c0fc480 con 0x7f321006ef70 2024-04-26T21:20:21.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.062+0000 7f3222a00700 1 -- 172.21.15.84:0/1213185987 <== osd.5 v2:172.21.15.120:6816/2091850685 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f322c0fc480 con 0x7f321006ef70 2024-04-26T21:20:21.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.063+0000 7f3231800700 1 -- 172.21.15.84:0/1213185987 >> [v2:172.21.15.120:6816/2091850685,v1:172.21.15.120:6817/2091850685] conn(0x7f321006ef70 msgr2=0x7f3210071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:21.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.063+0000 7f3231800700 1 --2- 172.21.15.84:0/1213185987 >> [v2:172.21.15.120:6816/2091850685,v1:172.21.15.120:6817/2091850685] conn(0x7f321006ef70 0x7f3210071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:21.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.063+0000 7f3231800700 1 -- 172.21.15.84:0/1213185987 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f32100692a0 msgr2=0x7f321006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:21.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.063+0000 7f3231800700 1 --2- 172.21.15.84:0/1213185987 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f32100692a0 0x7f321006b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3218004f90 tx=0x7f3218009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:21.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.063+0000 7f3231800700 1 -- 172.21.15.84:0/1213185987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f322c105000 msgr2=0x7f322c115ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:21.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.063+0000 7f3231800700 1 --2- 172.21.15.84:0/1213185987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f322c105000 0x7f322c115ba0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f321c002a50 tx=0x7f321c0046b0 comp rx=0 tx=0).stop 2024-04-26T21:20:21.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.063+0000 7f3231800700 1 -- 172.21.15.84:0/1213185987 shutdown_connections 2024-04-26T21:20:21.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.063+0000 7f3231800700 1 --2- 172.21.15.84:0/1213185987 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f32100692a0 0x7f321006b750 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:21.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.063+0000 7f3231800700 1 --2- 172.21.15.84:0/1213185987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f322c105000 0x7f322c115ba0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:21.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.063+0000 7f3231800700 1 --2- 172.21.15.84:0/1213185987 >> [v2:172.21.15.120:6816/2091850685,v1:172.21.15.120:6817/2091850685] conn(0x7f321006ef70 0x7f3210071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:21.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.063+0000 7f3231800700 1 --2- 172.21.15.84:0/1213185987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f322c1059a0 0x7f322c1160e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:21.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.063+0000 7f3231800700 1 -- 172.21.15.84:0/1213185987 >> 172.21.15.84:0/1213185987 conn(0x7f322c0fab70 msgr2=0x7f322c0fbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:21.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.063+0000 7f3231800700 1 -- 172.21.15.84:0/1213185987 shutdown_connections 2024-04-26T21:20:21.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:21.063+0000 7f3231800700 1 -- 172.21.15.84:0/1213185987 wait complete. 2024-04-26T21:20:21.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:21 smithi084 ceph-mon[25539]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:21.410 INFO:teuthology.orchestra.run.smithi084.stdout:81604378654 2024-04-26T21:20:21.410 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-26T21:20:21.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:21 smithi120 ceph-mon[32741]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:22.356 INFO:teuthology.orchestra.run.smithi084.stdout:38654705710 2024-04-26T21:20:22.356 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-26T21:20:22.846 INFO:teuthology.orchestra.run.smithi084.stdout:167503724555 2024-04-26T21:20:22.847 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-26T21:20:23.161 INFO:teuthology.orchestra.run.smithi084.stdout:146028888080 2024-04-26T21:20:23.161 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-26T21:20:23.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:23 smithi084 ceph-mon[25539]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:23.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:23 smithi120 ceph-mon[32741]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:23.619 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:23.650 INFO:teuthology.orchestra.run.smithi084.stdout:111669149718 2024-04-26T21:20:23.650 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-26T21:20:23.715 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:24.926 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:25.104 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:25.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:25 smithi084 ceph-mon[25539]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:25.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:25 smithi120 ceph-mon[32741]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:27.240 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:27 smithi084 ceph-mon[25539]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:27.240 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:27 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:20:27.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.265+0000 7f57a9c00700 1 -- 172.21.15.84:0/631190209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a40fbc60 msgr2=0x7f57a40fc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:27.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.265+0000 7f57a9c00700 1 --2- 172.21.15.84:0/631190209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a40fbc60 0x7f57a40fc030 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5794004940 tx=0x7f5794009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:27.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.265+0000 7f57a9c00700 1 -- 172.21.15.84:0/631190209 shutdown_connections 2024-04-26T21:20:27.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.265+0000 7f57a9c00700 1 --2- 172.21.15.84:0/631190209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57a40fc600 0x7f57a4100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:27.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.265+0000 7f57a9c00700 1 --2- 172.21.15.84:0/631190209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a40fbc60 0x7f57a40fc030 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:27.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.265+0000 7f57a9c00700 1 -- 172.21.15.84:0/631190209 >> 172.21.15.84:0/631190209 conn(0x7f57a40f78e0 msgr2=0x7f57a40f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:27.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.265+0000 7f57a9c00700 1 -- 172.21.15.84:0/631190209 shutdown_connections 2024-04-26T21:20:27.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.265+0000 7f57a9c00700 1 -- 172.21.15.84:0/631190209 wait complete. 2024-04-26T21:20:27.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.266+0000 7f57a9c00700 1 Processor -- start 2024-04-26T21:20:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.266+0000 7f57a9c00700 1 -- start start 2024-04-26T21:20:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.266+0000 7f57a9c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a40fbc60 0x7f57a4119fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.266+0000 7f57a9c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57a40fc600 0x7f57a411a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.266+0000 7f57a9c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a411ab60 con 0x7f57a40fbc60 2024-04-26T21:20:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.266+0000 7f57a9c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a4114140 con 0x7f57a40fc600 2024-04-26T21:20:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.267+0000 7f57a2a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a40fbc60 0x7f57a4119fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.267+0000 7f57a2a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a40fbc60 0x7f57a4119fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36910/0 (socket says 172.21.15.84:36910) 2024-04-26T21:20:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.267+0000 7f57a2a00700 1 -- 172.21.15.84:0/2085162378 learned_addr learned my addr 172.21.15.84:0/2085162378 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.267+0000 7f57a2000700 1 --2- 172.21.15.84:0/2085162378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57a40fc600 0x7f57a411a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.267+0000 7f57a2a00700 1 -- 172.21.15.84:0/2085162378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57a40fc600 msgr2=0x7f57a411a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.267+0000 7f57a2a00700 1 --2- 172.21.15.84:0/2085162378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57a40fc600 0x7f57a411a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.267+0000 7f57a2a00700 1 -- 172.21.15.84:0/2085162378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5794005040 con 0x7f57a40fbc60 2024-04-26T21:20:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.267+0000 7f57a2000700 1 --2- 172.21.15.84:0/2085162378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57a40fc600 0x7f57a411a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:20:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.267+0000 7f57a2a00700 1 --2- 172.21.15.84:0/2085162378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a40fbc60 0x7f57a4119fd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5794009150 tx=0x7f5794009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.268+0000 7f579aa00700 1 -- 172.21.15.84:0/2085162378 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f579400e040 con 0x7f57a40fbc60 2024-04-26T21:20:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.268+0000 7f579aa00700 1 -- 172.21.15.84:0/2085162378 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5794013420 con 0x7f57a40fbc60 2024-04-26T21:20:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.268+0000 7f579aa00700 1 -- 172.21.15.84:0/2085162378 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f579401c630 con 0x7f57a40fbc60 2024-04-26T21:20:27.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.268+0000 7f57a9c00700 1 -- 172.21.15.84:0/2085162378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a41143c0 con 0x7f57a40fbc60 2024-04-26T21:20:27.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.268+0000 7f57a9c00700 1 -- 172.21.15.84:0/2085162378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a4114900 con 0x7f57a40fbc60 2024-04-26T21:20:27.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.269+0000 7f57a9c00700 1 -- 172.21.15.84:0/2085162378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a4066ad0 con 0x7f57a40fbc60 2024-04-26T21:20:27.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.270+0000 7f579aa00700 1 -- 172.21.15.84:0/2085162378 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f5794013590 con 0x7f57a40fbc60 2024-04-26T21:20:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.271+0000 7f579aa00700 1 --2- 172.21.15.84:0/2085162378 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f57880692a0 0x7f578806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.271+0000 7f579aa00700 1 -- 172.21.15.84:0/2085162378 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5794088170 con 0x7f57a40fbc60 2024-04-26T21:20:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.271+0000 7f57a2000700 1 --2- 172.21.15.84:0/2085162378 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f57880692a0 0x7f578806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.272+0000 7f57a2000700 1 --2- 172.21.15.84:0/2085162378 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f57880692a0 0x7f578806b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5790007fd0 tx=0x7f5790009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:27.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.276+0000 7f579aa00700 1 -- 172.21.15.84:0/2085162378 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f57940581d0 con 0x7f57a40fbc60 2024-04-26T21:20:27.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:27 smithi120 ceph-mon[32741]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:27.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:27 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:20:27.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.499+0000 7f57a9c00700 1 -- 172.21.15.84:0/2085162378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f57a404c710 con 0x7f57a40fbc60 2024-04-26T21:20:27.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.500+0000 7f579aa00700 1 -- 172.21.15.84:0/2085162378 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5794057d60 con 0x7f57a40fbc60 2024-04-26T21:20:27.502 INFO:teuthology.orchestra.run.smithi084.stdout:81604378655 2024-04-26T21:20:27.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.503+0000 7f57a9c00700 1 -- 172.21.15.84:0/2085162378 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f57880692a0 msgr2=0x7f578806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:27.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.503+0000 7f57a9c00700 1 --2- 172.21.15.84:0/2085162378 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f57880692a0 0x7f578806b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5790007fd0 tx=0x7f5790009040 comp rx=0 tx=0).stop 2024-04-26T21:20:27.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.503+0000 7f57a9c00700 1 -- 172.21.15.84:0/2085162378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a40fbc60 msgr2=0x7f57a4119fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:27.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.503+0000 7f57a9c00700 1 --2- 172.21.15.84:0/2085162378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a40fbc60 0x7f57a4119fd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5794009150 tx=0x7f5794009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:27.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.503+0000 7f57a9c00700 1 -- 172.21.15.84:0/2085162378 shutdown_connections 2024-04-26T21:20:27.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.503+0000 7f57a9c00700 1 --2- 172.21.15.84:0/2085162378 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f57880692a0 0x7f578806b750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:27.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.503+0000 7f57a9c00700 1 --2- 172.21.15.84:0/2085162378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a40fbc60 0x7f57a4119fd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:27.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.503+0000 7f57a9c00700 1 --2- 172.21.15.84:0/2085162378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57a40fc600 0x7f57a411a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:27.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.503+0000 7f57a9c00700 1 -- 172.21.15.84:0/2085162378 >> 172.21.15.84:0/2085162378 conn(0x7f57a40f78e0 msgr2=0x7f57a410aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:27.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.503+0000 7f57a9c00700 1 -- 172.21.15.84:0/2085162378 shutdown_connections 2024-04-26T21:20:27.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:27.503+0000 7f57a9c00700 1 -- 172.21.15.84:0/2085162378 wait complete. 2024-04-26T21:20:27.690 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:27.692 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:28.361 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:28 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2085162378' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-26T21:20:28.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:28 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2085162378' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-26T21:20:29.309 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:29 smithi084 ceph-mon[25539]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:29.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:29 smithi120 ceph-mon[32741]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:29.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.934+0000 7fe900600700 1 -- 172.21.15.84:0/3829832965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f80fe7a0 msgr2=0x7fe8f8106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:29.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.934+0000 7fe900600700 1 --2- 172.21.15.84:0/3829832965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f80fe7a0 0x7fe8f8106de0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4004940 tx=0x7fe8e4009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:29.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.934+0000 7fe900600700 1 -- 172.21.15.84:0/3829832965 shutdown_connections 2024-04-26T21:20:29.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.934+0000 7fe900600700 1 --2- 172.21.15.84:0/3829832965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f80fe7a0 0x7fe8f8106de0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.934+0000 7fe900600700 1 --2- 172.21.15.84:0/3829832965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8f80fde00 0x7fe8f80fe1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.934+0000 7fe900600700 1 -- 172.21.15.84:0/3829832965 >> 172.21.15.84:0/3829832965 conn(0x7fe8f80f7810 msgr2=0x7fe8f80f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.934+0000 7fe900600700 1 -- 172.21.15.84:0/3829832965 shutdown_connections 2024-04-26T21:20:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.934+0000 7fe900600700 1 -- 172.21.15.84:0/3829832965 wait complete. 2024-04-26T21:20:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.935+0000 7fe900600700 1 Processor -- start 2024-04-26T21:20:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.935+0000 7fe900600700 1 -- start start 2024-04-26T21:20:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.935+0000 7fe900600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8f80fde00 0x7fe8f8113920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.935+0000 7fe900600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f80fe7a0 0x7fe8f8113e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.935+0000 7fe900600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f81144b0 con 0x7fe8f80fe7a0 2024-04-26T21:20:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.935+0000 7fe900600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f810dab0 con 0x7fe8f80fde00 2024-04-26T21:20:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.935+0000 7fe8fd200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f80fe7a0 0x7fe8f8113e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.935+0000 7fe8fd200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f80fe7a0 0x7fe8f8113e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36934/0 (socket says 172.21.15.84:36934) 2024-04-26T21:20:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.936+0000 7fe8fd200700 1 -- 172.21.15.84:0/1853017748 learned_addr learned my addr 172.21.15.84:0/1853017748 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.936+0000 7fe8fdc00700 1 --2- 172.21.15.84:0/1853017748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8f80fde00 0x7fe8f8113920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.936+0000 7fe8fd200700 1 -- 172.21.15.84:0/1853017748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8f80fde00 msgr2=0x7fe8f8113920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.936+0000 7fe8fd200700 1 --2- 172.21.15.84:0/1853017748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8f80fde00 0x7fe8f8113920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.936+0000 7fe8fd200700 1 -- 172.21.15.84:0/1853017748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e4005040 con 0x7fe8f80fe7a0 2024-04-26T21:20:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.936+0000 7fe8fd200700 1 --2- 172.21.15.84:0/1853017748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f80fe7a0 0x7fe8f8113e60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4004890 tx=0x7fe8e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.936+0000 7fe8f5600700 1 -- 172.21.15.84:0/1853017748 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8e400e040 con 0x7fe8f80fe7a0 2024-04-26T21:20:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.936+0000 7fe8f5600700 1 -- 172.21.15.84:0/1853017748 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8e4009af0 con 0x7fe8f80fe7a0 2024-04-26T21:20:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.936+0000 7fe900600700 1 -- 172.21.15.84:0/1853017748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f810dd30 con 0x7fe8f80fe7a0 2024-04-26T21:20:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.936+0000 7fe8f5600700 1 -- 172.21.15.84:0/1853017748 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8e401c630 con 0x7fe8f80fe7a0 2024-04-26T21:20:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.937+0000 7fe900600700 1 -- 172.21.15.84:0/1853017748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f810e270 con 0x7fe8f80fe7a0 2024-04-26T21:20:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.938+0000 7fe900600700 1 -- 172.21.15.84:0/1853017748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f8066ad0 con 0x7fe8f80fe7a0 2024-04-26T21:20:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.939+0000 7fe8f5600700 1 -- 172.21.15.84:0/1853017748 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe8e400bbc0 con 0x7fe8f80fe7a0 2024-04-26T21:20:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.940+0000 7fe8f5600700 1 --2- 172.21.15.84:0/1853017748 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe8e00692a0 0x7fe8e006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.940+0000 7fe8f5600700 1 -- 172.21.15.84:0/1853017748 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe8e4088120 con 0x7fe8f80fe7a0 2024-04-26T21:20:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.940+0000 7fe8fdc00700 1 --2- 172.21.15.84:0/1853017748 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe8e00692a0 0x7fe8e006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.941+0000 7fe8fdc00700 1 --2- 172.21.15.84:0/1853017748 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe8e00692a0 0x7fe8e006b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec004d60 tx=0x7fe8ec00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:29.945+0000 7fe8f5600700 1 -- 172.21.15.84:0/1853017748 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe8e4058200 con 0x7fe8f80fe7a0 2024-04-26T21:20:30.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:30.170+0000 7fe900600700 1 -- 172.21.15.84:0/1853017748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe8f8109e90 con 0x7fe8f80fe7a0 2024-04-26T21:20:30.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:30.171+0000 7fe8f5600700 1 -- 172.21.15.84:0/1853017748 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe8e4057d90 con 0x7fe8f80fe7a0 2024-04-26T21:20:30.172 INFO:teuthology.orchestra.run.smithi084.stdout:146028888082 2024-04-26T21:20:30.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:30.173+0000 7fe900600700 1 -- 172.21.15.84:0/1853017748 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe8e00692a0 msgr2=0x7fe8e006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:30.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:30.173+0000 7fe900600700 1 --2- 172.21.15.84:0/1853017748 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe8e00692a0 0x7fe8e006b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec004d60 tx=0x7fe8ec00b040 comp rx=0 tx=0).stop 2024-04-26T21:20:30.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:30.173+0000 7fe900600700 1 -- 172.21.15.84:0/1853017748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f80fe7a0 msgr2=0x7fe8f8113e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:30.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:30.173+0000 7fe900600700 1 --2- 172.21.15.84:0/1853017748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f80fe7a0 0x7fe8f8113e60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4004890 tx=0x7fe8e4009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:30.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:30.173+0000 7fe900600700 1 -- 172.21.15.84:0/1853017748 shutdown_connections 2024-04-26T21:20:30.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:30.173+0000 7fe900600700 1 --2- 172.21.15.84:0/1853017748 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe8e00692a0 0x7fe8e006b750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:30.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:30.173+0000 7fe900600700 1 --2- 172.21.15.84:0/1853017748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8f80fde00 0x7fe8f8113920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:30.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:30.173+0000 7fe900600700 1 --2- 172.21.15.84:0/1853017748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f80fe7a0 0x7fe8f8113e60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:30.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:30.173+0000 7fe900600700 1 -- 172.21.15.84:0/1853017748 >> 172.21.15.84:0/1853017748 conn(0x7fe8f80f7810 msgr2=0x7fe8f80f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:30.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:30.174+0000 7fe900600700 1 -- 172.21.15.84:0/1853017748 shutdown_connections 2024-04-26T21:20:30.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:30.174+0000 7fe900600700 1 -- 172.21.15.84:0/1853017748 wait complete. 2024-04-26T21:20:31.376 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:31 smithi084 ceph-mon[25539]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:31.376 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:31 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1853017748' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-26T21:20:31.428 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378654 got 81604378655 for osd.2 2024-04-26T21:20:31.429 DEBUG:teuthology.parallel:result is None 2024-04-26T21:20:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:31 smithi120 ceph-mon[32741]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:31 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/1853017748' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-26T21:20:32.724 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888080 got 146028888082 for osd.4 2024-04-26T21:20:32.725 DEBUG:teuthology.parallel:result is None 2024-04-26T21:20:33.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.355+0000 7f599ee00700 1 -- 172.21.15.84:0/887974121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59980fbc60 msgr2=0x7f59980fc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:33.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.355+0000 7f599ee00700 1 --2- 172.21.15.84:0/887974121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59980fbc60 0x7f59980fc030 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5988004940 tx=0x7f5988009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:33.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.355+0000 7f599ee00700 1 -- 172.21.15.84:0/887974121 shutdown_connections 2024-04-26T21:20:33.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.355+0000 7f599ee00700 1 --2- 172.21.15.84:0/887974121 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59980fc600 0x7f5998100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:33.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.355+0000 7f599ee00700 1 --2- 172.21.15.84:0/887974121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59980fbc60 0x7f59980fc030 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:33.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.355+0000 7f599ee00700 1 -- 172.21.15.84:0/887974121 >> 172.21.15.84:0/887974121 conn(0x7f59980f78e0 msgr2=0x7f59980f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:33.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.355+0000 7f599ee00700 1 -- 172.21.15.84:0/887974121 shutdown_connections 2024-04-26T21:20:33.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.355+0000 7f599ee00700 1 -- 172.21.15.84:0/887974121 wait complete. 2024-04-26T21:20:33.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.356+0000 7f599ee00700 1 Processor -- start 2024-04-26T21:20:33.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.356+0000 7f599ee00700 1 -- start start 2024-04-26T21:20:33.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.357+0000 7f599ee00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59980fbc60 0x7f5998119fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:33.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.357+0000 7f599ee00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59980fc600 0x7f599811a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:33.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.357+0000 7f599ee00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599811ab60 con 0x7f59980fbc60 2024-04-26T21:20:33.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.357+0000 7f599ee00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5998114140 con 0x7f59980fc600 2024-04-26T21:20:33.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.357+0000 7f5997e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59980fbc60 0x7f5998119fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:33.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.357+0000 7f5997e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59980fbc60 0x7f5998119fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53766/0 (socket says 172.21.15.84:53766) 2024-04-26T21:20:33.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.357+0000 7f5997e00700 1 -- 172.21.15.84:0/2717478395 learned_addr learned my addr 172.21.15.84:0/2717478395 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:33.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.357+0000 7f5997400700 1 --2- 172.21.15.84:0/2717478395 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59980fc600 0x7f599811a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:33.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.358+0000 7f5997e00700 1 -- 172.21.15.84:0/2717478395 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59980fc600 msgr2=0x7f599811a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:33.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.358+0000 7f5997e00700 1 --2- 172.21.15.84:0/2717478395 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59980fc600 0x7f599811a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:33.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.358+0000 7f5997e00700 1 -- 172.21.15.84:0/2717478395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5988005040 con 0x7f59980fbc60 2024-04-26T21:20:33.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.358+0000 7f5997e00700 1 --2- 172.21.15.84:0/2717478395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59980fbc60 0x7f5998119fd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f598800b8b0 tx=0x7f5988009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:33.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.358+0000 7f598fe00700 1 -- 172.21.15.84:0/2717478395 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f598800e040 con 0x7f59980fbc60 2024-04-26T21:20:33.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.358+0000 7f598fe00700 1 -- 172.21.15.84:0/2717478395 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5988004290 con 0x7f59980fbc60 2024-04-26T21:20:33.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.358+0000 7f599ee00700 1 -- 172.21.15.84:0/2717478395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59981143c0 con 0x7f59980fbc60 2024-04-26T21:20:33.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.358+0000 7f598fe00700 1 -- 172.21.15.84:0/2717478395 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f598801c3f0 con 0x7f59980fbc60 2024-04-26T21:20:33.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.358+0000 7f599ee00700 1 -- 172.21.15.84:0/2717478395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5998114900 con 0x7f59980fbc60 2024-04-26T21:20:33.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.359+0000 7f599ee00700 1 -- 172.21.15.84:0/2717478395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5998066ad0 con 0x7f59980fbc60 2024-04-26T21:20:33.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.361+0000 7f598fe00700 1 -- 172.21.15.84:0/2717478395 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f59880137b0 con 0x7f59980fbc60 2024-04-26T21:20:33.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.362+0000 7f598fe00700 1 --2- 172.21.15.84:0/2717478395 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f597c0692a0 0x7f597c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:33.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.362+0000 7f598fe00700 1 -- 172.21.15.84:0/2717478395 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5988088260 con 0x7f59980fbc60 2024-04-26T21:20:33.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.362+0000 7f5997400700 1 --2- 172.21.15.84:0/2717478395 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f597c0692a0 0x7f597c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:33.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.363+0000 7f5997400700 1 --2- 172.21.15.84:0/2717478395 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f597c0692a0 0x7f597c06b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5984007fd0 tx=0x7f5984009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:33.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.370+0000 7f598fe00700 1 -- 172.21.15.84:0/2717478395 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f59880582c0 con 0x7f59980fbc60 2024-04-26T21:20:33.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.238+0000 7fec52e00700 1 -- 172.21.15.84:0/2232212321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4c103780 msgr2=0x7fec4c0fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:33.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.238+0000 7fec52e00700 1 --2- 172.21.15.84:0/2232212321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4c103780 0x7fec4c0fcdf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fec38004940 tx=0x7fec38009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:33.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.238+0000 7fec52e00700 1 -- 172.21.15.84:0/2232212321 shutdown_connections 2024-04-26T21:20:33.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.238+0000 7fec52e00700 1 --2- 172.21.15.84:0/2232212321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4c103780 0x7fec4c0fcdf0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:33.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.238+0000 7fec52e00700 1 --2- 172.21.15.84:0/2232212321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec4c102de0 0x7fec4c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:33.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.238+0000 7fec52e00700 1 -- 172.21.15.84:0/2232212321 >> 172.21.15.84:0/2232212321 conn(0x7fec4c0f89b0 msgr2=0x7fec4c0fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:33.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.238+0000 7fec52e00700 1 -- 172.21.15.84:0/2232212321 shutdown_connections 2024-04-26T21:20:33.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.238+0000 7fec52e00700 1 -- 172.21.15.84:0/2232212321 wait complete. 2024-04-26T21:20:33.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.239+0000 7fec52e00700 1 Processor -- start 2024-04-26T21:20:33.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.239+0000 7fec52e00700 1 -- start start 2024-04-26T21:20:33.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.240+0000 7fec52e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec4c102de0 0x7fec4c113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:33.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.240+0000 7fec52e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4c103780 0x7fec4c1140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:33.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.240+0000 7fec52e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c114730 con 0x7fec4c103780 2024-04-26T21:20:33.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.240+0000 7fec52e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c10db20 con 0x7fec4c102de0 2024-04-26T21:20:33.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.240+0000 7fec4b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4c103780 0x7fec4c1140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:33.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.240+0000 7fec4b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4c103780 0x7fec4c1140e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53726/0 (socket says 172.21.15.84:53726) 2024-04-26T21:20:33.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.240+0000 7fec4b400700 1 -- 172.21.15.84:0/2963469165 learned_addr learned my addr 172.21.15.84:0/2963469165 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:33.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.240+0000 7fec4be00700 1 --2- 172.21.15.84:0/2963469165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec4c102de0 0x7fec4c113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:33.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.240+0000 7fec4b400700 1 -- 172.21.15.84:0/2963469165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec4c102de0 msgr2=0x7fec4c113ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:33.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.240+0000 7fec4b400700 1 --2- 172.21.15.84:0/2963469165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec4c102de0 0x7fec4c113ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:33.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.240+0000 7fec4b400700 1 -- 172.21.15.84:0/2963469165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec38005040 con 0x7fec4c103780 2024-04-26T21:20:33.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.241+0000 7fec4b400700 1 --2- 172.21.15.84:0/2963469165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4c103780 0x7fec4c1140e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fec38009180 tx=0x7fec38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:33.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.241+0000 7fec43e00700 1 -- 172.21.15.84:0/2963469165 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec3800e040 con 0x7fec4c103780 2024-04-26T21:20:33.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.241+0000 7fec43e00700 1 -- 172.21.15.84:0/2963469165 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec3800bbc0 con 0x7fec4c103780 2024-04-26T21:20:33.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.241+0000 7fec52e00700 1 -- 172.21.15.84:0/2963469165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4c10dda0 con 0x7fec4c103780 2024-04-26T21:20:33.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.241+0000 7fec43e00700 1 -- 172.21.15.84:0/2963469165 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec3801c3f0 con 0x7fec4c103780 2024-04-26T21:20:33.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.241+0000 7fec52e00700 1 -- 172.21.15.84:0/2963469165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4c10e360 con 0x7fec4c103780 2024-04-26T21:20:33.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.242+0000 7fec52e00700 1 -- 172.21.15.84:0/2963469165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4c0fe530 con 0x7fec4c103780 2024-04-26T21:20:33.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.243+0000 7fec43e00700 1 -- 172.21.15.84:0/2963469165 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fec3800bd30 con 0x7fec4c103780 2024-04-26T21:20:33.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.244+0000 7fec43e00700 1 --2- 172.21.15.84:0/2963469165 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fec300692a0 0x7fec3006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:33.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.244+0000 7fec43e00700 1 -- 172.21.15.84:0/2963469165 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fec380881a0 con 0x7fec4c103780 2024-04-26T21:20:33.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.244+0000 7fec4be00700 1 --2- 172.21.15.84:0/2963469165 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fec300692a0 0x7fec3006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:33.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.245+0000 7fec4be00700 1 --2- 172.21.15.84:0/2963469165 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fec300692a0 0x7fec3006b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fec3c007fd0 tx=0x7fec3c009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:33.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.249+0000 7fec43e00700 1 -- 172.21.15.84:0/2963469165 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fec380582a0 con 0x7fec4c103780 2024-04-26T21:20:33.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.484+0000 7fec52e00700 1 -- 172.21.15.84:0/2963469165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fec4c109ec0 con 0x7fec4c103780 2024-04-26T21:20:33.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.484+0000 7fec43e00700 1 -- 172.21.15.84:0/2963469165 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec38057e30 con 0x7fec4c103780 2024-04-26T21:20:33.401 INFO:teuthology.orchestra.run.smithi084.stdout:38654705712 2024-04-26T21:20:33.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.487+0000 7fec52e00700 1 -- 172.21.15.84:0/2963469165 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fec300692a0 msgr2=0x7fec3006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:33.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.487+0000 7fec52e00700 1 --2- 172.21.15.84:0/2963469165 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fec300692a0 0x7fec3006b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fec3c007fd0 tx=0x7fec3c009040 comp rx=0 tx=0).stop 2024-04-26T21:20:33.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.487+0000 7fec52e00700 1 -- 172.21.15.84:0/2963469165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4c103780 msgr2=0x7fec4c1140e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:33.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.487+0000 7fec52e00700 1 --2- 172.21.15.84:0/2963469165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4c103780 0x7fec4c1140e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fec38009180 tx=0x7fec38009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:33.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.487+0000 7fec52e00700 1 -- 172.21.15.84:0/2963469165 shutdown_connections 2024-04-26T21:20:33.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.487+0000 7fec52e00700 1 --2- 172.21.15.84:0/2963469165 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fec300692a0 0x7fec3006b750 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:33.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.487+0000 7fec52e00700 1 --2- 172.21.15.84:0/2963469165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec4c102de0 0x7fec4c113ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:33.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.487+0000 7fec52e00700 1 --2- 172.21.15.84:0/2963469165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4c103780 0x7fec4c1140e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:33.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.487+0000 7fec52e00700 1 -- 172.21.15.84:0/2963469165 >> 172.21.15.84:0/2963469165 conn(0x7fec4c0f89b0 msgr2=0x7fec4c0f9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:33.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.487+0000 7fec52e00700 1 -- 172.21.15.84:0/2963469165 shutdown_connections 2024-04-26T21:20:33.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:32.487+0000 7fec52e00700 1 -- 172.21.15.84:0/2963469165 wait complete. 2024-04-26T21:20:33.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:33 smithi120 ceph-mon[32741]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:33.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:33 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2963469165' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-26T21:20:33.501 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:33 smithi084 ceph-mon[25539]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:33.502 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:33 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2963469165' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-26T21:20:33.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.592+0000 7f599ee00700 1 -- 172.21.15.84:0/2717478395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f599804c710 con 0x7f59980fbc60 2024-04-26T21:20:33.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.592+0000 7f598fe00700 1 -- 172.21.15.84:0/2717478395 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5988057e50 con 0x7f59980fbc60 2024-04-26T21:20:33.594 INFO:teuthology.orchestra.run.smithi084.stdout:167503724557 2024-04-26T21:20:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.595+0000 7f599ee00700 1 -- 172.21.15.84:0/2717478395 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f597c0692a0 msgr2=0x7f597c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.595+0000 7f599ee00700 1 --2- 172.21.15.84:0/2717478395 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f597c0692a0 0x7f597c06b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5984007fd0 tx=0x7f5984009040 comp rx=0 tx=0).stop 2024-04-26T21:20:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.595+0000 7f599ee00700 1 -- 172.21.15.84:0/2717478395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59980fbc60 msgr2=0x7f5998119fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.595+0000 7f599ee00700 1 --2- 172.21.15.84:0/2717478395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59980fbc60 0x7f5998119fd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f598800b8b0 tx=0x7f5988009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.595+0000 7f599ee00700 1 -- 172.21.15.84:0/2717478395 shutdown_connections 2024-04-26T21:20:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.595+0000 7f599ee00700 1 --2- 172.21.15.84:0/2717478395 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f597c0692a0 0x7f597c06b750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.595+0000 7f599ee00700 1 --2- 172.21.15.84:0/2717478395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59980fbc60 0x7f5998119fd0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.595+0000 7f599ee00700 1 --2- 172.21.15.84:0/2717478395 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59980fc600 0x7f599811a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.595+0000 7f599ee00700 1 -- 172.21.15.84:0/2717478395 >> 172.21.15.84:0/2717478395 conn(0x7f59980f78e0 msgr2=0x7f599810aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.595+0000 7f599ee00700 1 -- 172.21.15.84:0/2717478395 shutdown_connections 2024-04-26T21:20:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.595+0000 7f599ee00700 1 -- 172.21.15.84:0/2717478395 wait complete. 2024-04-26T21:20:34.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.265+0000 7f7b8aa00700 1 -- 172.21.15.84:0/1434098194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b84070840 msgr2=0x7f7b84070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.265+0000 7f7b8aa00700 1 --2- 172.21.15.84:0/1434098194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b84070840 0x7f7b84070cb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7b70004970 tx=0x7f7b70009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.265+0000 7f7b8aa00700 1 -- 172.21.15.84:0/1434098194 shutdown_connections 2024-04-26T21:20:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.265+0000 7f7b8aa00700 1 --2- 172.21.15.84:0/1434098194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b84070840 0x7f7b84070cb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.265+0000 7f7b8aa00700 1 --2- 172.21.15.84:0/1434098194 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b84071f30 0x7f7b84070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.265+0000 7f7b8aa00700 1 -- 172.21.15.84:0/1434098194 >> 172.21.15.84:0/1434098194 conn(0x7f7b840f89b0 msgr2=0x7f7b840fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.265+0000 7f7b8aa00700 1 -- 172.21.15.84:0/1434098194 shutdown_connections 2024-04-26T21:20:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.265+0000 7f7b8aa00700 1 -- 172.21.15.84:0/1434098194 wait complete. 2024-04-26T21:20:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.266+0000 7f7b8aa00700 1 Processor -- start 2024-04-26T21:20:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.266+0000 7f7b8aa00700 1 -- start start 2024-04-26T21:20:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.266+0000 7f7b8aa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b84070840 0x7f7b8411a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.266+0000 7f7b8aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b84071f30 0x7f7b8411a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.266+0000 7f7b8aa00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8411acd0 con 0x7f7b84071f30 2024-04-26T21:20:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.266+0000 7f7b8aa00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b841140a0 con 0x7f7b84070840 2024-04-26T21:20:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.267+0000 7f7b83400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b84071f30 0x7f7b8411a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.267+0000 7f7b83400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b84071f30 0x7f7b8411a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53744/0 (socket says 172.21.15.84:53744) 2024-04-26T21:20:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.267+0000 7f7b83400700 1 -- 172.21.15.84:0/2536349874 learned_addr learned my addr 172.21.15.84:0/2536349874 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.267+0000 7f7b83e00700 1 --2- 172.21.15.84:0/2536349874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b84070840 0x7f7b8411a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.267+0000 7f7b83400700 1 -- 172.21.15.84:0/2536349874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b84070840 msgr2=0x7f7b8411a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.267+0000 7f7b83400700 1 --2- 172.21.15.84:0/2536349874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b84070840 0x7f7b8411a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.267+0000 7f7b83400700 1 -- 172.21.15.84:0/2536349874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b70005040 con 0x7f7b84071f30 2024-04-26T21:20:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.267+0000 7f7b83e00700 1 --2- 172.21.15.84:0/2536349874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b84070840 0x7f7b8411a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:20:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.267+0000 7f7b83400700 1 --2- 172.21.15.84:0/2536349874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b84071f30 0x7f7b8411a680 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7b70004f50 tx=0x7f7b70009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.268+0000 7f7b7be00700 1 -- 172.21.15.84:0/2536349874 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b7000e040 con 0x7f7b84071f30 2024-04-26T21:20:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.268+0000 7f7b7be00700 1 -- 172.21.15.84:0/2536349874 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b7000bc10 con 0x7f7b84071f30 2024-04-26T21:20:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.268+0000 7f7b8aa00700 1 -- 172.21.15.84:0/2536349874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b84114320 con 0x7f7b84071f30 2024-04-26T21:20:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.268+0000 7f7b7be00700 1 -- 172.21.15.84:0/2536349874 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b7001c630 con 0x7f7b84071f30 2024-04-26T21:20:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.268+0000 7f7b8aa00700 1 -- 172.21.15.84:0/2536349874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b84114860 con 0x7f7b84071f30 2024-04-26T21:20:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.269+0000 7f7b8aa00700 1 -- 172.21.15.84:0/2536349874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b84071a40 con 0x7f7b84071f30 2024-04-26T21:20:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.271+0000 7f7b7be00700 1 -- 172.21.15.84:0/2536349874 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7b70013420 con 0x7f7b84071f30 2024-04-26T21:20:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.271+0000 7f7b7be00700 1 --2- 172.21.15.84:0/2536349874 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7b680692b0 0x7f7b6806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.272+0000 7f7b7be00700 1 -- 172.21.15.84:0/2536349874 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7b700881d0 con 0x7f7b84071f30 2024-04-26T21:20:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.272+0000 7f7b83e00700 1 --2- 172.21.15.84:0/2536349874 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7b680692b0 0x7f7b6806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.273+0000 7f7b83e00700 1 --2- 172.21.15.84:0/2536349874 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7b680692b0 0x7f7b6806b760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7b74007fd0 tx=0x7f7b74009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.276+0000 7f7b7be00700 1 -- 172.21.15.84:0/2536349874 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7b700582b0 con 0x7f7b84071f30 2024-04-26T21:20:34.140 INFO:teuthology.orchestra.run.smithi084.stdout:111669149721 2024-04-26T21:20:34.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.501+0000 7f7b8aa00700 1 -- 172.21.15.84:0/2536349874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7b8405f5c0 con 0x7f7b84071f30 2024-04-26T21:20:34.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.502+0000 7f7b7be00700 1 -- 172.21.15.84:0/2536349874 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b70057e40 con 0x7f7b84071f30 2024-04-26T21:20:34.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.505+0000 7f7b8aa00700 1 -- 172.21.15.84:0/2536349874 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7b680692b0 msgr2=0x7f7b6806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:34.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.505+0000 7f7b8aa00700 1 --2- 172.21.15.84:0/2536349874 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7b680692b0 0x7f7b6806b760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7b74007fd0 tx=0x7f7b74009040 comp rx=0 tx=0).stop 2024-04-26T21:20:34.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.505+0000 7f7b8aa00700 1 -- 172.21.15.84:0/2536349874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b84071f30 msgr2=0x7f7b8411a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:34.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.505+0000 7f7b8aa00700 1 --2- 172.21.15.84:0/2536349874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b84071f30 0x7f7b8411a680 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7b70004f50 tx=0x7f7b70009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:34.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.506+0000 7f7b8aa00700 1 -- 172.21.15.84:0/2536349874 shutdown_connections 2024-04-26T21:20:34.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.506+0000 7f7b8aa00700 1 --2- 172.21.15.84:0/2536349874 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7b680692b0 0x7f7b6806b760 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:34.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.506+0000 7f7b8aa00700 1 --2- 172.21.15.84:0/2536349874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b84070840 0x7f7b8411a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:34.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.506+0000 7f7b8aa00700 1 --2- 172.21.15.84:0/2536349874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b84071f30 0x7f7b8411a680 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:34.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.506+0000 7f7b8aa00700 1 -- 172.21.15.84:0/2536349874 >> 172.21.15.84:0/2536349874 conn(0x7f7b840f89b0 msgr2=0x7f7b840f99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:34.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.506+0000 7f7b8aa00700 1 -- 172.21.15.84:0/2536349874 shutdown_connections 2024-04-26T21:20:34.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:33.506+0000 7f7b8aa00700 1 -- 172.21.15.84:0/2536349874 wait complete. 2024-04-26T21:20:34.400 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:34 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2536349874' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-26T21:20:34.400 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:34 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2717478395' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-26T21:20:34.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:34 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2536349874' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-26T21:20:34.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:34 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2717478395' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-26T21:20:34.753 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149718 got 111669149721 for osd.3 2024-04-26T21:20:34.754 DEBUG:teuthology.parallel:result is None 2024-04-26T21:20:34.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.950+0000 7fe3b5400700 1 -- 172.21.15.84:0/3763293947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3b0071f30 msgr2=0x7fe3b0070300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:34.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.950+0000 7fe3b5400700 1 --2- 172.21.15.84:0/3763293947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3b0071f30 0x7fe3b0070300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0004970 tx=0x7fe3a0009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:34.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.951+0000 7fe3b5400700 1 -- 172.21.15.84:0/3763293947 shutdown_connections 2024-04-26T21:20:34.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.951+0000 7fe3b5400700 1 --2- 172.21.15.84:0/3763293947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3b0070840 0x7fe3b0070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:34.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.951+0000 7fe3b5400700 1 --2- 172.21.15.84:0/3763293947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3b0071f30 0x7fe3b0070300 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:34.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.951+0000 7fe3b5400700 1 -- 172.21.15.84:0/3763293947 >> 172.21.15.84:0/3763293947 conn(0x7fe3b00f89b0 msgr2=0x7fe3b00fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:34.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.951+0000 7fe3b5400700 1 -- 172.21.15.84:0/3763293947 shutdown_connections 2024-04-26T21:20:34.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.951+0000 7fe3b5400700 1 -- 172.21.15.84:0/3763293947 wait complete. 2024-04-26T21:20:34.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.952+0000 7fe3b5400700 1 Processor -- start 2024-04-26T21:20:34.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.952+0000 7fe3b5400700 1 -- start start 2024-04-26T21:20:34.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.953+0000 7fe3b5400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3b0070840 0x7fe3b010cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:34.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.953+0000 7fe3b5400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3b0071f30 0x7fe3b010d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.953+0000 7fe3b5400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b0107b90 con 0x7fe3b0071f30 2024-04-26T21:20:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.953+0000 7fe3b5400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b0107cd0 con 0x7fe3b0070840 2024-04-26T21:20:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.953+0000 7fe3ade00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3b0071f30 0x7fe3b010d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.953+0000 7fe3ade00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3b0071f30 0x7fe3b010d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53774/0 (socket says 172.21.15.84:53774) 2024-04-26T21:20:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.953+0000 7fe3ade00700 1 -- 172.21.15.84:0/1774557348 learned_addr learned my addr 172.21.15.84:0/1774557348 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.953+0000 7fe3ae800700 1 --2- 172.21.15.84:0/1774557348 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3b0070840 0x7fe3b010cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.953+0000 7fe3ade00700 1 -- 172.21.15.84:0/1774557348 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3b0070840 msgr2=0x7fe3b010cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.953+0000 7fe3ade00700 1 --2- 172.21.15.84:0/1774557348 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3b0070840 0x7fe3b010cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.953+0000 7fe3ade00700 1 -- 172.21.15.84:0/1774557348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a0005040 con 0x7fe3b0071f30 2024-04-26T21:20:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.953+0000 7fe3ae800700 1 --2- 172.21.15.84:0/1774557348 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3b0070840 0x7fe3b010cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:20:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.954+0000 7fe3ade00700 1 --2- 172.21.15.84:0/1774557348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3b0071f30 0x7fe3b010d160 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe39c002a50 tx=0x7fe39c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.954+0000 7fe3a6a00700 1 -- 172.21.15.84:0/1774557348 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe39c007cc0 con 0x7fe3b0071f30 2024-04-26T21:20:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.954+0000 7fe3a6a00700 1 -- 172.21.15.84:0/1774557348 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe39c00f040 con 0x7fe3b0071f30 2024-04-26T21:20:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.954+0000 7fe3b5400700 1 -- 172.21.15.84:0/1774557348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b0107fb0 con 0x7fe3b0071f30 2024-04-26T21:20:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.954+0000 7fe3a6a00700 1 -- 172.21.15.84:0/1774557348 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe39c009640 con 0x7fe3b0071f30 2024-04-26T21:20:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.954+0000 7fe3b5400700 1 -- 172.21.15.84:0/1774557348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b01084f0 con 0x7fe3b0071f30 2024-04-26T21:20:34.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.955+0000 7fe3b5400700 1 -- 172.21.15.84:0/1774557348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b0071a40 con 0x7fe3b0071f30 2024-04-26T21:20:34.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.956+0000 7fe3a6a00700 1 -- 172.21.15.84:0/1774557348 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe39c0097a0 con 0x7fe3b0071f30 2024-04-26T21:20:34.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.957+0000 7fe3a6a00700 1 --2- 172.21.15.84:0/1774557348 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe3940692a0 0x7fe39406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.957+0000 7fe3a6a00700 1 -- 172.21.15.84:0/1774557348 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe39c086c20 con 0x7fe3b0071f30 2024-04-26T21:20:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.957+0000 7fe3ae800700 1 --2- 172.21.15.84:0/1774557348 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe3940692a0 0x7fe39406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.958+0000 7fe3ae800700 1 --2- 172.21.15.84:0/1774557348 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe3940692a0 0x7fe39406b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0004f50 tx=0x7fe3a0009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:34.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:34.962+0000 7fe3a6a00700 1 -- 172.21.15.84:0/1774557348 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe39c0531f0 con 0x7fe3b0071f30 2024-04-26T21:20:35.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:35.182+0000 7fe3b5400700 1 -- 172.21.15.84:0/1774557348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe3b0110520 con 0x7fe3b0071f30 2024-04-26T21:20:35.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:35.183+0000 7fe3a6a00700 1 -- 172.21.15.84:0/1774557348 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe39c056810 con 0x7fe3b0071f30 2024-04-26T21:20:35.185 INFO:teuthology.orchestra.run.smithi084.stdout:60129542185 2024-04-26T21:20:35.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:35.186+0000 7fe3b5400700 1 -- 172.21.15.84:0/1774557348 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe3940692a0 msgr2=0x7fe39406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:35.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:35.186+0000 7fe3b5400700 1 --2- 172.21.15.84:0/1774557348 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe3940692a0 0x7fe39406b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0004f50 tx=0x7fe3a0009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:35.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:35.186+0000 7fe3b5400700 1 -- 172.21.15.84:0/1774557348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3b0071f30 msgr2=0x7fe3b010d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:35.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:35.186+0000 7fe3b5400700 1 --2- 172.21.15.84:0/1774557348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3b0071f30 0x7fe3b010d160 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe39c002a50 tx=0x7fe39c0046b0 comp rx=0 tx=0).stop 2024-04-26T21:20:35.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:35.186+0000 7fe3b5400700 1 -- 172.21.15.84:0/1774557348 shutdown_connections 2024-04-26T21:20:35.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:35.186+0000 7fe3b5400700 1 --2- 172.21.15.84:0/1774557348 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe3940692a0 0x7fe39406b750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:35.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:35.186+0000 7fe3b5400700 1 --2- 172.21.15.84:0/1774557348 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3b0070840 0x7fe3b010cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:35.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:35.186+0000 7fe3b5400700 1 --2- 172.21.15.84:0/1774557348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3b0071f30 0x7fe3b010d160 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:35.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:35.186+0000 7fe3b5400700 1 -- 172.21.15.84:0/1774557348 >> 172.21.15.84:0/1774557348 conn(0x7fe3b00f89b0 msgr2=0x7fe3b00f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:35.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:35.186+0000 7fe3b5400700 1 -- 172.21.15.84:0/1774557348 shutdown_connections 2024-04-26T21:20:35.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:35.186+0000 7fe3b5400700 1 -- 172.21.15.84:0/1774557348 wait complete. 2024-04-26T21:20:35.205 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:35 smithi084 ceph-mon[25539]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:35.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:35 smithi120 ceph-mon[32741]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:35.779 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705710 got 38654705712 for osd.0 2024-04-26T21:20:35.779 DEBUG:teuthology.parallel:result is None 2024-04-26T21:20:36.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:36 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1774557348' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-26T21:20:36.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:36 smithi084 ceph-mon[25539]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:36.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:36 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/1774557348' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-26T21:20:36.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:36 smithi120 ceph-mon[32741]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:36.481 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724555 got 167503724557 for osd.5 2024-04-26T21:20:36.481 DEBUG:teuthology.parallel:result is None 2024-04-26T21:20:36.666 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542181 got 60129542185 for osd.1 2024-04-26T21:20:36.666 DEBUG:teuthology.parallel:result is None 2024-04-26T21:20:36.667 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-26T21:20:36.667 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T21:20:37.138 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:38.727 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:38 smithi084 ceph-mon[25539]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:38.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:38 smithi120 ceph-mon[32741]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:39.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.222+0000 7fe828c00700 1 -- 172.21.15.84:0/1162663082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8241059a0 msgr2=0x7fe8240ff010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:39.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.222+0000 7fe828c00700 1 --2- 172.21.15.84:0/1162663082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8241059a0 0x7fe8240ff010 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe810004940 tx=0x7fe810009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:39.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.222+0000 7fe828c00700 1 -- 172.21.15.84:0/1162663082 shutdown_connections 2024-04-26T21:20:39.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.222+0000 7fe828c00700 1 --2- 172.21.15.84:0/1162663082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8241059a0 0x7fe8240ff010 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:39.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.222+0000 7fe828c00700 1 --2- 172.21.15.84:0/1162663082 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe824105000 0x7fe8241053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:39.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.222+0000 7fe828c00700 1 -- 172.21.15.84:0/1162663082 >> 172.21.15.84:0/1162663082 conn(0x7fe8240fab70 msgr2=0x7fe8240fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:39.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.222+0000 7fe828c00700 1 -- 172.21.15.84:0/1162663082 shutdown_connections 2024-04-26T21:20:39.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.222+0000 7fe828c00700 1 -- 172.21.15.84:0/1162663082 wait complete. 2024-04-26T21:20:39.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.223+0000 7fe828c00700 1 Processor -- start 2024-04-26T21:20:39.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.223+0000 7fe828c00700 1 -- start start 2024-04-26T21:20:39.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.223+0000 7fe828c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe824105000 0x7fe824115b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:39.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.223+0000 7fe828c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8241059a0 0x7fe824116080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:39.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.223+0000 7fe828c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8241166d0 con 0x7fe824105000 2024-04-26T21:20:39.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.223+0000 7fe828c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82410fcf0 con 0x7fe8241059a0 2024-04-26T21:20:39.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.223+0000 7fe821e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe824105000 0x7fe824115b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:39.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.223+0000 7fe821e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe824105000 0x7fe824115b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53792/0 (socket says 172.21.15.84:53792) 2024-04-26T21:20:39.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.223+0000 7fe821e00700 1 -- 172.21.15.84:0/2459402222 learned_addr learned my addr 172.21.15.84:0/2459402222 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:39.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.224+0000 7fe821400700 1 --2- 172.21.15.84:0/2459402222 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8241059a0 0x7fe824116080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:39.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.224+0000 7fe821e00700 1 -- 172.21.15.84:0/2459402222 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8241059a0 msgr2=0x7fe824116080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:39.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.224+0000 7fe821e00700 1 --2- 172.21.15.84:0/2459402222 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8241059a0 0x7fe824116080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:39.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.224+0000 7fe821e00700 1 -- 172.21.15.84:0/2459402222 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe810005040 con 0x7fe824105000 2024-04-26T21:20:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.224+0000 7fe821e00700 1 --2- 172.21.15.84:0/2459402222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe824105000 0x7fe824115b40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe814002a50 tx=0x7fe8140046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.224+0000 7fe81a000700 1 -- 172.21.15.84:0/2459402222 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe814007cc0 con 0x7fe824105000 2024-04-26T21:20:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.224+0000 7fe81a000700 1 -- 172.21.15.84:0/2459402222 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe81400f040 con 0x7fe824105000 2024-04-26T21:20:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.224+0000 7fe81a000700 1 -- 172.21.15.84:0/2459402222 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe814009640 con 0x7fe824105000 2024-04-26T21:20:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.224+0000 7fe828c00700 1 -- 172.21.15.84:0/2459402222 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82410ffd0 con 0x7fe824105000 2024-04-26T21:20:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.225+0000 7fe828c00700 1 -- 172.21.15.84:0/2459402222 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe824110590 con 0x7fe824105000 2024-04-26T21:20:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.226+0000 7fe828c00700 1 -- 172.21.15.84:0/2459402222 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe824100750 con 0x7fe824105000 2024-04-26T21:20:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.227+0000 7fe81a000700 1 -- 172.21.15.84:0/2459402222 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe8140097a0 con 0x7fe824105000 2024-04-26T21:20:39.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.228+0000 7fe81a000700 1 --2- 172.21.15.84:0/2459402222 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe8080692a0 0x7fe80806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:39.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.228+0000 7fe81a000700 1 -- 172.21.15.84:0/2459402222 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe814086c20 con 0x7fe824105000 2024-04-26T21:20:39.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.228+0000 7fe821400700 1 --2- 172.21.15.84:0/2459402222 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe8080692a0 0x7fe80806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:39.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.229+0000 7fe821400700 1 --2- 172.21.15.84:0/2459402222 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe8080692a0 0x7fe80806b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe81000b3b0 tx=0x7fe810009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:39.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.233+0000 7fe81a000700 1 -- 172.21.15.84:0/2459402222 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe8140531f0 con 0x7fe824105000 2024-04-26T21:20:39.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.437+0000 7fe828c00700 1 -- 172.21.15.84:0/2459402222 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8241111d0 con 0x7fe8080692a0 2024-04-26T21:20:39.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.441+0000 7fe81a000700 1 -- 172.21.15.84:0/2459402222 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27205 (secure 0 0 0) 0x7fe8241111d0 con 0x7fe8080692a0 2024-04-26T21:20:39.444 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:20:39.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.444+0000 7fe828c00700 1 -- 172.21.15.84:0/2459402222 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe8080692a0 msgr2=0x7fe80806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:39.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.444+0000 7fe828c00700 1 --2- 172.21.15.84:0/2459402222 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe8080692a0 0x7fe80806b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe81000b3b0 tx=0x7fe810009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:39.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.444+0000 7fe828c00700 1 -- 172.21.15.84:0/2459402222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe824105000 msgr2=0x7fe824115b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:39.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.444+0000 7fe828c00700 1 --2- 172.21.15.84:0/2459402222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe824105000 0x7fe824115b40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe814002a50 tx=0x7fe8140046b0 comp rx=0 tx=0).stop 2024-04-26T21:20:39.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.444+0000 7fe828c00700 1 -- 172.21.15.84:0/2459402222 shutdown_connections 2024-04-26T21:20:39.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.444+0000 7fe828c00700 1 --2- 172.21.15.84:0/2459402222 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe8080692a0 0x7fe80806b750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:39.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.444+0000 7fe828c00700 1 --2- 172.21.15.84:0/2459402222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe824105000 0x7fe824115b40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:39.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.444+0000 7fe828c00700 1 --2- 172.21.15.84:0/2459402222 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8241059a0 0x7fe824116080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:39.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.444+0000 7fe828c00700 1 -- 172.21.15.84:0/2459402222 >> 172.21.15.84:0/2459402222 conn(0x7fe8240fab70 msgr2=0x7fe8240fbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:39.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.444+0000 7fe828c00700 1 -- 172.21.15.84:0/2459402222 shutdown_connections 2024-04-26T21:20:39.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:39.444+0000 7fe828c00700 1 -- 172.21.15.84:0/2459402222 wait complete. 2024-04-26T21:20:39.447 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-04-26T21:20:40.167 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-04-26T21:20:37.489361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788020,"kb_used_data":3872,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682892,"statfs":{"total":575970213888,"available":574139281408,"internally_reserved":0,"allocated":3964928,"data_stored":2605601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003371"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":189,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:19:41.947777+0000","last_change":"2024-04-26T21:19:07.683738+0000","last_active":"2024-04-26T21:19:41.947777+0000","last_peered":"2024-04-26T21:19:41.947777+0000","last_clean":"2024-04-26T21:19:41.947777+0000","last_became_active":"2024-04-26T21:19:07.682855+0000","last_became_peered":"2024-04-26T21:19:07.682855+0000","last_unstale":"2024-04-26T21:19:41.947777+0000","last_undegraded":"2024-04-26T21:19:41.947777+0000","last_fullsized":"2024-04-26T21:19:41.947777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:58.095547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:58.095547+0000","last_clean_scrub_stamp":"2024-04-26T21:17:58.095547+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:56:59.921227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297716,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447436,"statfs":{"total":95995035648,"available":95690174464,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":3.9729999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":3.891}]},{"osd":1,"last update":"Fri Apr 26 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.105},{"interface":"front","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.0640000000000001}]},{"osd":2,"last update":"Fri Apr 26 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.165},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.2190000000000001}]},{"osd":3,"last update":"Fri Apr 26 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.143},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.98099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149722,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298292,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446860,"statfs":{"total":95995035648,"available":95689584640,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 21:19:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":1.3140000000000001}]},{"osd":1,"last update":"Fri Apr 26 21:19:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.87},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.2889999999999999}]},{"osd":2,"last update":"Fri Apr 26 21:19:36 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.089}]},{"osd":4,"last update":"Fri Apr 26 21:20:09 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.0229999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378657,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":360448,"data_stored":138532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 21:20:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.78900000000000003,"15min":0.76600000000000001},"min":{"1min":0.65700000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.83699999999999997,"15min":0.82099999999999995},"min":{"1min":0.503,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.74099999999999999}]},{"osd":1,"last update":"Fri Apr 26 21:20:02 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.85299999999999998,"15min":0.84499999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.079,"5min":0.94699999999999995,"15min":0.92500000000000004},"min":{"1min":0.86199999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.0469999999999999}]},{"osd":3,"last update":"Fri Apr 26 21:19:32 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.262}]},{"osd":4,"last update":"Fri Apr 26 21:20:11 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.3169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]}]},{"osd":0,"up_from":9,"seq":38654705713,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298292,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446860,"statfs":{"total":95995035648,"available":95689584640,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 21:20:30 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.77000000000000002,"15min":0.73599999999999999},"min":{"1min":0.33200000000000002,"5min":0.318,"15min":0.318},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.84099999999999997,"15min":0.82299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.746,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.99099999999999999}]},{"osd":2,"last update":"Fri Apr 26 21:19:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.91600000000000004,"15min":0.91100000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.879},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.93600000000000005,"15min":0.93000000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.2969999999999999}]},{"osd":3,"last update":"Fri Apr 26 21:19:34 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":1.198}]},{"osd":4,"last update":"Fri Apr 26 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.367},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":1.0529999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542185,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298296,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446856,"statfs":{"total":95995035648,"available":95689580544,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 21:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.72999999999999998,"15min":0.71599999999999997},"min":{"1min":0.60999999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":2.1019999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.79900000000000004,"15min":0.78700000000000003},"min":{"1min":0.68899999999999995,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1859999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.95699999999999996}]},{"osd":2,"last update":"Fri Apr 26 21:20:00 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.90100000000000002,"15min":0.88700000000000001},"min":{"1min":0.628,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":2.2759999999999998},{"interface":"front","average":{"1min":1.006,"5min":0.93600000000000005,"15min":0.92400000000000004},"min":{"1min":0.68300000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.3420000000000001}]},{"osd":3,"last update":"Fri Apr 26 21:19:34 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.8879999999999999}]},{"osd":4,"last update":"Fri Apr 26 21:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":1.6919999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":2.1890000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:20:40.169 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T21:20:40.640 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:40.813 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:40 smithi084 ceph-mon[25539]: from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T21:20:40.813 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:40 smithi084 ceph-mon[25539]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:40.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:40 smithi120 ceph-mon[32741]: from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T21:20:40.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:40 smithi120 ceph-mon[32741]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:41.823 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:20:41.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:20:42.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.783+0000 7f4bf4400700 1 -- 172.21.15.84:0/4005002335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bec105000 msgr2=0x7f4bec1053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:42.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.783+0000 7f4bf4400700 1 --2- 172.21.15.84:0/4005002335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bec105000 0x7f4bec1053d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4be0004940 tx=0x7f4be0009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:42.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.784+0000 7f4bf4400700 1 -- 172.21.15.84:0/4005002335 shutdown_connections 2024-04-26T21:20:42.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.784+0000 7f4bf4400700 1 --2- 172.21.15.84:0/4005002335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bec1059a0 0x7f4bec0ff010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:42.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.784+0000 7f4bf4400700 1 --2- 172.21.15.84:0/4005002335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bec105000 0x7f4bec1053d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:42.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.784+0000 7f4bf4400700 1 -- 172.21.15.84:0/4005002335 >> 172.21.15.84:0/4005002335 conn(0x7f4bec0fab70 msgr2=0x7f4bec0fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:42.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.784+0000 7f4bf4400700 1 -- 172.21.15.84:0/4005002335 shutdown_connections 2024-04-26T21:20:42.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.784+0000 7f4bf4400700 1 -- 172.21.15.84:0/4005002335 wait complete. 2024-04-26T21:20:42.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.784+0000 7f4bf4400700 1 Processor -- start 2024-04-26T21:20:42.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.785+0000 7f4bf4400700 1 -- start start 2024-04-26T21:20:42.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.785+0000 7f4bf4400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bec105000 0x7f4bec115b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:42.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.785+0000 7f4bf4400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bec1059a0 0x7f4bec1160c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:42.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.785+0000 7f4bf4400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec116710 con 0x7f4bec105000 2024-04-26T21:20:42.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.785+0000 7f4bf4400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec10fcf0 con 0x7f4bec1059a0 2024-04-26T21:20:42.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.785+0000 7f4bf1a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bec105000 0x7f4bec115b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:42.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.785+0000 7f4bf1a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bec105000 0x7f4bec115b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37758/0 (socket says 172.21.15.84:37758) 2024-04-26T21:20:42.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.785+0000 7f4bf1a00700 1 -- 172.21.15.84:0/3537038608 learned_addr learned my addr 172.21.15.84:0/3537038608 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:42.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.786+0000 7f4bf1a00700 1 -- 172.21.15.84:0/3537038608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bec1059a0 msgr2=0x7f4bec1160c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:42.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.786+0000 7f4bf1a00700 1 --2- 172.21.15.84:0/3537038608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bec1059a0 0x7f4bec1160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:42.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.786+0000 7f4bf1a00700 1 -- 172.21.15.84:0/3537038608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be0005040 con 0x7f4bec105000 2024-04-26T21:20:42.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.786+0000 7f4bf1a00700 1 --2- 172.21.15.84:0/3537038608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bec105000 0x7f4bec115b80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4be0009b30 tx=0x7f4be0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:42.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.786+0000 7f4be9600700 1 -- 172.21.15.84:0/3537038608 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4be000e070 con 0x7f4bec105000 2024-04-26T21:20:42.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.786+0000 7f4be9600700 1 -- 172.21.15.84:0/3537038608 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4be0013cd0 con 0x7f4bec105000 2024-04-26T21:20:42.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.786+0000 7f4bf4400700 1 -- 172.21.15.84:0/3537038608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bec10ff70 con 0x7f4bec105000 2024-04-26T21:20:42.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.786+0000 7f4be9600700 1 -- 172.21.15.84:0/3537038608 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4be000b720 con 0x7f4bec105000 2024-04-26T21:20:42.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.786+0000 7f4bf4400700 1 -- 172.21.15.84:0/3537038608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bec110450 con 0x7f4bec105000 2024-04-26T21:20:42.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.788+0000 7f4bf4400700 1 -- 172.21.15.84:0/3537038608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bec100750 con 0x7f4bec105000 2024-04-26T21:20:42.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.789+0000 7f4be9600700 1 -- 172.21.15.84:0/3537038608 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4be001cab0 con 0x7f4bec105000 2024-04-26T21:20:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.789+0000 7f4be9600700 1 --2- 172.21.15.84:0/3537038608 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f4bd40692a0 0x7f4bd406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.790+0000 7f4be9600700 1 -- 172.21.15.84:0/3537038608 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4be0088750 con 0x7f4bec105000 2024-04-26T21:20:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.790+0000 7f4bf1000700 1 --2- 172.21.15.84:0/3537038608 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f4bd40692a0 0x7f4bd406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.791+0000 7f4bf1000700 1 --2- 172.21.15.84:0/3537038608 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f4bd40692a0 0x7f4bd406b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4bec111420 tx=0x7f4bd800b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:42.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:42.794+0000 7f4be9600700 1 -- 172.21.15.84:0/3537038608 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4be0058830 con 0x7f4bec105000 2024-04-26T21:20:42.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:42 smithi084 ceph-mon[25539]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:42.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:42 smithi120 ceph-mon[32741]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:43.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:43.002+0000 7f4bf4400700 1 -- 172.21.15.84:0/3537038608 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4bec10c120 con 0x7f4bd40692a0 2024-04-26T21:20:43.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:43.006+0000 7f4be9600700 1 -- 172.21.15.84:0/3537038608 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27122 (secure 0 0 0) 0x7f4bec10c120 con 0x7f4bd40692a0 2024-04-26T21:20:43.008 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:20:43.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:43.009+0000 7f4bf4400700 1 -- 172.21.15.84:0/3537038608 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f4bd40692a0 msgr2=0x7f4bd406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:43.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:43.009+0000 7f4bf4400700 1 --2- 172.21.15.84:0/3537038608 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f4bd40692a0 0x7f4bd406b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4bec111420 tx=0x7f4bd800b040 comp rx=0 tx=0).stop 2024-04-26T21:20:43.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:43.009+0000 7f4bf4400700 1 -- 172.21.15.84:0/3537038608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bec105000 msgr2=0x7f4bec115b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:43.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:43.009+0000 7f4bf4400700 1 --2- 172.21.15.84:0/3537038608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bec105000 0x7f4bec115b80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4be0009b30 tx=0x7f4be0009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:43.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:43.009+0000 7f4bf4400700 1 -- 172.21.15.84:0/3537038608 shutdown_connections 2024-04-26T21:20:43.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:43.009+0000 7f4bf4400700 1 --2- 172.21.15.84:0/3537038608 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f4bd40692a0 0x7f4bd406b750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:43.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:43.009+0000 7f4bf4400700 1 --2- 172.21.15.84:0/3537038608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bec105000 0x7f4bec115b80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:43.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:43.009+0000 7f4bf4400700 1 --2- 172.21.15.84:0/3537038608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bec1059a0 0x7f4bec1160c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:43.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:43.009+0000 7f4bf4400700 1 -- 172.21.15.84:0/3537038608 >> 172.21.15.84:0/3537038608 conn(0x7f4bec0fab70 msgr2=0x7f4bec0fbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:43.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:43.009+0000 7f4bf4400700 1 -- 172.21.15.84:0/3537038608 shutdown_connections 2024-04-26T21:20:43.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:43.010+0000 7f4bf4400700 1 -- 172.21.15.84:0/3537038608 wait complete. 2024-04-26T21:20:43.012 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-04-26T21:20:43.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:43 smithi084 ceph-mon[25539]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T21:20:43.741 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-04-26T21:20:41.494221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788020,"kb_used_data":3872,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682892,"statfs":{"total":575970213888,"available":574139281408,"internally_reserved":0,"allocated":3964928,"data_stored":2605601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007042"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":189,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:19:41.947777+0000","last_change":"2024-04-26T21:19:07.683738+0000","last_active":"2024-04-26T21:19:41.947777+0000","last_peered":"2024-04-26T21:19:41.947777+0000","last_clean":"2024-04-26T21:19:41.947777+0000","last_became_active":"2024-04-26T21:19:07.682855+0000","last_became_peered":"2024-04-26T21:19:07.682855+0000","last_unstale":"2024-04-26T21:19:41.947777+0000","last_undegraded":"2024-04-26T21:19:41.947777+0000","last_fullsized":"2024-04-26T21:19:41.947777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:58.095547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:58.095547+0000","last_clean_scrub_stamp":"2024-04-26T21:17:58.095547+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:56:59.921227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297716,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447436,"statfs":{"total":95995035648,"available":95690174464,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":1.0489999999999999}]},{"osd":1,"last update":"Fri Apr 26 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.097}]},{"osd":2,"last update":"Fri Apr 26 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.153}]},{"osd":3,"last update":"Fri Apr 26 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.5069999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]}]},{"osd":3,"up_from":26,"seq":111669149723,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298292,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446860,"statfs":{"total":95995035648,"available":95689584640,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 21:19:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":1.117},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":1.1819999999999999}]},{"osd":1,"last update":"Fri Apr 26 21:19:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.252}]},{"osd":2,"last update":"Fri Apr 26 21:19:36 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.22}]},{"osd":4,"last update":"Fri Apr 26 21:20:09 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.89600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378658,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":360448,"data_stored":138532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 21:20:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.78900000000000003,"15min":0.76600000000000001},"min":{"1min":0.65700000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.83699999999999997,"15min":0.82099999999999995},"min":{"1min":0.503,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.73999999999999999}]},{"osd":1,"last update":"Fri Apr 26 21:20:02 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.85299999999999998,"15min":0.84499999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.079,"5min":0.94699999999999995,"15min":0.92500000000000004},"min":{"1min":0.86199999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.54200000000000004}]},{"osd":3,"last update":"Fri Apr 26 21:20:35 2024","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.1339999999999999,"15min":1.117},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.0980000000000001,"15min":1.0860000000000001},"min":{"1min":0.94999999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6379999999999999,"5min":1.663,"15min":1.663},"last":0.94999999999999996}]},{"osd":4,"last update":"Fri Apr 26 21:20:11 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.234},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.84499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298292,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446860,"statfs":{"total":95995035648,"available":95689584640,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 21:20:30 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.77000000000000002,"15min":0.73599999999999999},"min":{"1min":0.33200000000000002,"5min":0.318,"15min":0.318},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.84099999999999997,"15min":0.82299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.746,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.72699999999999998}]},{"osd":2,"last update":"Fri Apr 26 21:19:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.91600000000000004,"15min":0.91100000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.93600000000000005,"15min":0.93000000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.125}]},{"osd":3,"last update":"Fri Apr 26 21:20:36 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.0600000000000001,"15min":1.046},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":1.091},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1080000000000001,"15min":1.1060000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.046}]},{"osd":4,"last update":"Fri Apr 26 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.272},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":1.2549999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]}]},{"osd":1,"up_from":14,"seq":60129542186,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298296,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446856,"statfs":{"total":95995035648,"available":95689580544,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 21:20:34 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.77200000000000002,"15min":0.72999999999999998},"min":{"1min":0.40200000000000002,"5min":0.376,"15min":0.376},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.88,"5min":0.81899999999999995,"15min":0.79300000000000004},"min":{"1min":0.54500000000000004,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.214,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.82499999999999996}]},{"osd":2,"last update":"Fri Apr 26 21:20:00 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.90100000000000002,"15min":0.88700000000000001},"min":{"1min":0.628,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.755},{"interface":"front","average":{"1min":1.006,"5min":0.93600000000000005,"15min":0.92400000000000004},"min":{"1min":0.68300000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.70899999999999996}]},{"osd":3,"last update":"Fri Apr 26 21:20:34 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.0409999999999999,"15min":1.0249999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.22},{"interface":"front","average":{"1min":1.345,"5min":1.147,"15min":1.1140000000000001},"min":{"1min":0.99199999999999999,"5min":0.747,"15min":0.747},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":1.077}]},{"osd":4,"last update":"Fri Apr 26 21:20:07 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.266}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:20:43.742 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-26T21:20:43.742 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T21:20:43.742 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-26T21:20:43.742 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph health --format=json 2024-04-26T21:20:43.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:43 smithi120 ceph-mon[32741]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T21:20:44.217 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:44.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:44 smithi084 ceph-mon[25539]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:44.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:44 smithi120 ceph-mon[32741]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:46.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.186+0000 7f1212200700 1 -- 172.21.15.84:0/926454968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f120c102c20 msgr2=0x7f120c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:46.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.186+0000 7f1212200700 1 --2- 172.21.15.84:0/926454968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f120c102c20 0x7f120c102ff0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f11fc004940 tx=0x7f11fc009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:46.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.186+0000 7f1212200700 1 -- 172.21.15.84:0/926454968 shutdown_connections 2024-04-26T21:20:46.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.186+0000 7f1212200700 1 --2- 172.21.15.84:0/926454968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f120c1035c0 0x7f120c0fcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:46.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.186+0000 7f1212200700 1 --2- 172.21.15.84:0/926454968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f120c102c20 0x7f120c102ff0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:46.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.186+0000 7f1212200700 1 -- 172.21.15.84:0/926454968 >> 172.21.15.84:0/926454968 conn(0x7f120c0f8790 msgr2=0x7f120c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:46.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.186+0000 7f1212200700 1 -- 172.21.15.84:0/926454968 shutdown_connections 2024-04-26T21:20:46.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.186+0000 7f1212200700 1 -- 172.21.15.84:0/926454968 wait complete. 2024-04-26T21:20:46.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.187+0000 7f1212200700 1 Processor -- start 2024-04-26T21:20:46.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.187+0000 7f1212200700 1 -- start start 2024-04-26T21:20:46.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.188+0000 7f1212200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f120c102c20 0x7f120c115b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:46.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.188+0000 7f1212200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f120c1035c0 0x7f120c1160d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:46.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.188+0000 7f1212200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120c116720 con 0x7f120c1035c0 2024-04-26T21:20:46.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.188+0000 7f1212200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120c10fb30 con 0x7f120c102c20 2024-04-26T21:20:46.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.188+0000 7f1203e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f120c1035c0 0x7f120c1160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:46.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.188+0000 7f1203e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f120c1035c0 0x7f120c1160d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37774/0 (socket says 172.21.15.84:37774) 2024-04-26T21:20:46.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.188+0000 7f1203e00700 1 -- 172.21.15.84:0/2327053135 learned_addr learned my addr 172.21.15.84:0/2327053135 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:46.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.188+0000 7f1210e00700 1 --2- 172.21.15.84:0/2327053135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f120c102c20 0x7f120c115b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:46.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.189+0000 7f1203e00700 1 -- 172.21.15.84:0/2327053135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f120c102c20 msgr2=0x7f120c115b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:46.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.189+0000 7f1203e00700 1 --2- 172.21.15.84:0/2327053135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f120c102c20 0x7f120c115b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:46.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.189+0000 7f1203e00700 1 -- 172.21.15.84:0/2327053135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc005040 con 0x7f120c1035c0 2024-04-26T21:20:46.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.189+0000 7f1203e00700 1 --2- 172.21.15.84:0/2327053135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f120c1035c0 0x7f120c1160d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f11f800c800 tx=0x7f11f8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:46.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.189+0000 7f1209600700 1 -- 172.21.15.84:0/2327053135 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11f80106f0 con 0x7f120c1035c0 2024-04-26T21:20:46.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.189+0000 7f1209600700 1 -- 172.21.15.84:0/2327053135 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f11f8010d20 con 0x7f120c1035c0 2024-04-26T21:20:46.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.189+0000 7f1212200700 1 -- 172.21.15.84:0/2327053135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f120c10fe10 con 0x7f120c1035c0 2024-04-26T21:20:46.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.189+0000 7f1209600700 1 -- 172.21.15.84:0/2327053135 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11f80113a0 con 0x7f120c1035c0 2024-04-26T21:20:46.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.189+0000 7f1212200700 1 -- 172.21.15.84:0/2327053135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f120c1103d0 con 0x7f120c1035c0 2024-04-26T21:20:46.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.190+0000 7f1212200700 1 -- 172.21.15.84:0/2327053135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120c0fe370 con 0x7f120c1035c0 2024-04-26T21:20:46.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.191+0000 7f1209600700 1 -- 172.21.15.84:0/2327053135 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f11f8012400 con 0x7f120c1035c0 2024-04-26T21:20:46.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.193+0000 7f1209600700 1 --2- 172.21.15.84:0/2327053135 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f11f00692b0 0x7f11f006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:46.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.193+0000 7f1209600700 1 -- 172.21.15.84:0/2327053135 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f11f8086da0 con 0x7f120c1035c0 2024-04-26T21:20:46.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.193+0000 7f1210e00700 1 --2- 172.21.15.84:0/2327053135 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f11f00692b0 0x7f11f006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:46.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.194+0000 7f1210e00700 1 --2- 172.21.15.84:0/2327053135 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f11f00692b0 0x7f11f006b760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009fd0 tx=0x7f11fc009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:46.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.197+0000 7f1209600700 1 -- 172.21.15.84:0/2327053135 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f11f80533f0 con 0x7f120c1035c0 2024-04-26T21:20:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.455+0000 7f1212200700 1 -- 172.21.15.84:0/2327053135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f120c109d10 con 0x7f120c1035c0 2024-04-26T21:20:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.456+0000 7f1209600700 1 -- 172.21.15.84:0/2327053135 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f11f8056a10 con 0x7f120c1035c0 2024-04-26T21:20:46.458 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:20:46.458 INFO:teuthology.orchestra.run.smithi084.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T21:20:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.459+0000 7f1212200700 1 -- 172.21.15.84:0/2327053135 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f11f00692b0 msgr2=0x7f11f006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.459+0000 7f1212200700 1 --2- 172.21.15.84:0/2327053135 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f11f00692b0 0x7f11f006b760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009fd0 tx=0x7f11fc009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.459+0000 7f1212200700 1 -- 172.21.15.84:0/2327053135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f120c1035c0 msgr2=0x7f120c1160d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.459+0000 7f1212200700 1 --2- 172.21.15.84:0/2327053135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f120c1035c0 0x7f120c1160d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f11f800c800 tx=0x7f11f8004470 comp rx=0 tx=0).stop 2024-04-26T21:20:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.459+0000 7f1212200700 1 -- 172.21.15.84:0/2327053135 shutdown_connections 2024-04-26T21:20:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.459+0000 7f1212200700 1 --2- 172.21.15.84:0/2327053135 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f11f00692b0 0x7f11f006b760 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.459+0000 7f1212200700 1 --2- 172.21.15.84:0/2327053135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f120c102c20 0x7f120c115b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.459+0000 7f1212200700 1 --2- 172.21.15.84:0/2327053135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f120c1035c0 0x7f120c1160d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.459+0000 7f1212200700 1 -- 172.21.15.84:0/2327053135 >> 172.21.15.84:0/2327053135 conn(0x7f120c0f8790 msgr2=0x7f120c071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.459+0000 7f1212200700 1 -- 172.21.15.84:0/2327053135 shutdown_connections 2024-04-26T21:20:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:46.459+0000 7f1212200700 1 -- 172.21.15.84:0/2327053135 wait complete. 2024-04-26T21:20:46.843 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:46 smithi084 ceph-mon[25539]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:46.843 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:46 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2327053135' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-26T21:20:46.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:46 smithi120 ceph-mon[32741]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:46.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:46 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2327053135' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-26T21:20:47.272 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-26T21:20:47.273 INFO:tasks.cephadm:Setup complete, yielding 2024-04-26T21:20:47.273 INFO:teuthology.run_tasks:Running task print... 2024-04-26T21:20:47.284 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-04-26T21:20:47.284 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T21:20:47.299 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi084.front.sepia.ceph.com 2024-04-26T21:20:47.299 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-04-26T21:20:47.759 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:48.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:48 smithi084 ceph-mon[25539]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:48.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:48 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:20:48.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:48 smithi120 ceph-mon[32741]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:48.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:48 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:20:49.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.764+0000 7f8e54800700 1 -- 172.21.15.84:0/2739783236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e4c100270 msgr2=0x7f8e4c1006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:49.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.764+0000 7f8e54800700 1 --2- 172.21.15.84:0/2739783236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e4c100270 0x7f8e4c1006e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c004940 tx=0x7f8e3c009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:49.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.765+0000 7f8e54800700 1 -- 172.21.15.84:0/2739783236 shutdown_connections 2024-04-26T21:20:49.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.765+0000 7f8e54800700 1 --2- 172.21.15.84:0/2739783236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e4c100270 0x7f8e4c1006e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:49.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.765+0000 7f8e54800700 1 --2- 172.21.15.84:0/2739783236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e4c0fefc0 0x7f8e4c0ff3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:49.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.765+0000 7f8e54800700 1 -- 172.21.15.84:0/2739783236 >> 172.21.15.84:0/2739783236 conn(0x7f8e4c0fa8f0 msgr2=0x7f8e4c0fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:49.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.765+0000 7f8e54800700 1 -- 172.21.15.84:0/2739783236 shutdown_connections 2024-04-26T21:20:49.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.765+0000 7f8e54800700 1 -- 172.21.15.84:0/2739783236 wait complete. 2024-04-26T21:20:49.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.766+0000 7f8e54800700 1 Processor -- start 2024-04-26T21:20:49.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.766+0000 7f8e54800700 1 -- start start 2024-04-26T21:20:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.766+0000 7f8e54800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e4c0fefc0 0x7f8e4c10fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.766+0000 7f8e54800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e4c100270 0x7f8e4c110120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.766+0000 7f8e54800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c1107b0 con 0x7f8e4c100270 2024-04-26T21:20:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.766+0000 7f8e54800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c110fa0 con 0x7f8e4c0fefc0 2024-04-26T21:20:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.767+0000 7f8e51400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e4c100270 0x7f8e4c110120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.767+0000 7f8e51400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e4c100270 0x7f8e4c110120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37790/0 (socket says 172.21.15.84:37790) 2024-04-26T21:20:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.767+0000 7f8e51400700 1 -- 172.21.15.84:0/962611538 learned_addr learned my addr 172.21.15.84:0/962611538 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.767+0000 7f8e51e00700 1 --2- 172.21.15.84:0/962611538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e4c0fefc0 0x7f8e4c10fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.767+0000 7f8e51400700 1 -- 172.21.15.84:0/962611538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e4c0fefc0 msgr2=0x7f8e4c10fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.767+0000 7f8e51400700 1 --2- 172.21.15.84:0/962611538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e4c0fefc0 0x7f8e4c10fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.767+0000 7f8e51400700 1 -- 172.21.15.84:0/962611538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c005040 con 0x7f8e4c100270 2024-04-26T21:20:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.767+0000 7f8e51e00700 1 --2- 172.21.15.84:0/962611538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e4c0fefc0 0x7f8e4c10fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:20:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.767+0000 7f8e51400700 1 --2- 172.21.15.84:0/962611538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e4c100270 0x7f8e4c110120 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009150 tx=0x7f8e3c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.768+0000 7f8e46000700 1 -- 172.21.15.84:0/962611538 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e3c00e040 con 0x7f8e4c100270 2024-04-26T21:20:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.768+0000 7f8e46000700 1 -- 172.21.15.84:0/962611538 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e3c00bbf0 con 0x7f8e4c100270 2024-04-26T21:20:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.768+0000 7f8e54800700 1 -- 172.21.15.84:0/962611538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c111220 con 0x7f8e4c100270 2024-04-26T21:20:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.768+0000 7f8e46000700 1 -- 172.21.15.84:0/962611538 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e3c01c630 con 0x7f8e4c100270 2024-04-26T21:20:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.768+0000 7f8e54800700 1 -- 172.21.15.84:0/962611538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c1117e0 con 0x7f8e4c100270 2024-04-26T21:20:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.769+0000 7f8e54800700 1 -- 172.21.15.84:0/962611538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4c05f5c0 con 0x7f8e4c100270 2024-04-26T21:20:49.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.770+0000 7f8e46000700 1 -- 172.21.15.84:0/962611538 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f8e3c00bd60 con 0x7f8e4c100270 2024-04-26T21:20:49.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.771+0000 7f8e46000700 1 --2- 172.21.15.84:0/962611538 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f8e340692b0 0x7f8e3406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:49.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.771+0000 7f8e46000700 1 -- 172.21.15.84:0/962611538 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8e3c088250 con 0x7f8e4c100270 2024-04-26T21:20:49.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.771+0000 7f8e51e00700 1 --2- 172.21.15.84:0/962611538 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f8e340692b0 0x7f8e3406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:49.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.772+0000 7f8e51e00700 1 --2- 172.21.15.84:0/962611538 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f8e340692b0 0x7f8e3406b760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8e40006fd0 tx=0x7f8e40008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:49.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.776+0000 7f8e46000700 1 -- 172.21.15.84:0/962611538 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8e3c058330 con 0x7f8e4c100270 2024-04-26T21:20:49.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:49 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:20:49.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:49 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:20:49.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:49 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:20:49.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:49 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:20:49.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:49 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:20:49.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:49 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:20:49.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:49.990+0000 7f8e54800700 1 -- 172.21.15.84:0/962611538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f8e4c04bed0 con 0x7f8e4c100270 2024-04-26T21:20:50.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:50.000+0000 7f8e46000700 1 -- 172.21.15.84:0/962611538 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f8e4c04bed0 con 0x7f8e4c100270 2024-04-26T21:20:50.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:50.003+0000 7f8e54800700 1 -- 172.21.15.84:0/962611538 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f8e340692b0 msgr2=0x7f8e3406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:50.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:50.003+0000 7f8e54800700 1 --2- 172.21.15.84:0/962611538 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f8e340692b0 0x7f8e3406b760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8e40006fd0 tx=0x7f8e40008040 comp rx=0 tx=0).stop 2024-04-26T21:20:50.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:50.004+0000 7f8e54800700 1 -- 172.21.15.84:0/962611538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e4c100270 msgr2=0x7f8e4c110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:50.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:50.004+0000 7f8e54800700 1 --2- 172.21.15.84:0/962611538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e4c100270 0x7f8e4c110120 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009150 tx=0x7f8e3c009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:50.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:50.004+0000 7f8e54800700 1 -- 172.21.15.84:0/962611538 shutdown_connections 2024-04-26T21:20:50.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:50.004+0000 7f8e54800700 1 --2- 172.21.15.84:0/962611538 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f8e340692b0 0x7f8e3406b760 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:50.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:50.004+0000 7f8e54800700 1 --2- 172.21.15.84:0/962611538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e4c0fefc0 0x7f8e4c10fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:50.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:50.004+0000 7f8e54800700 1 --2- 172.21.15.84:0/962611538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e4c100270 0x7f8e4c110120 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:50.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:50.004+0000 7f8e54800700 1 -- 172.21.15.84:0/962611538 >> 172.21.15.84:0/962611538 conn(0x7f8e4c0fa8f0 msgr2=0x7f8e4c0fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:50.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:50.004+0000 7f8e54800700 1 -- 172.21.15.84:0/962611538 shutdown_connections 2024-04-26T21:20:50.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:50.004+0000 7f8e54800700 1 -- 172.21.15.84:0/962611538 wait complete. 2024-04-26T21:20:50.724 INFO:teuthology.run_tasks:Running task print... 2024-04-26T21:20:50.733 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-04-26T21:20:50.733 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T21:20:50.748 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi084.front.sepia.ceph.com 2024-04-26T21:20:50.749 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-26T21:20:51.224 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:51.373 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:50 smithi084 ceph-mon[25539]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:51.373 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:50 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/962611538' entity='client.admin' 2024-04-26T21:20:51.373 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:50 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:20:51.373 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:50 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:20:51.373 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:50 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:20:51.373 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:50 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:20:51.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:50 smithi120 ceph-mon[32741]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:51.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:50 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/962611538' entity='client.admin' 2024-04-26T21:20:51.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:50 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:20:51.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:50 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:20:51.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:50 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:20:51.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:50 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:20:53.255 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:53 smithi084 ceph-mon[25539]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:53.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.417+0000 7fd9d1400700 1 -- 172.21.15.84:0/2634744121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc100280 msgr2=0x7fd9cc1006f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:53.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.417+0000 7fd9d1400700 1 --2- 172.21.15.84:0/2634744121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc100280 0x7fd9cc1006f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8004940 tx=0x7fd9b8009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:53.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.417+0000 7fd9d1400700 1 -- 172.21.15.84:0/2634744121 shutdown_connections 2024-04-26T21:20:53.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.417+0000 7fd9d1400700 1 --2- 172.21.15.84:0/2634744121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc100280 0x7fd9cc1006f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:53.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.417+0000 7fd9d1400700 1 --2- 172.21.15.84:0/2634744121 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9cc0fefd0 0x7fd9cc0ff3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:53.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.417+0000 7fd9d1400700 1 -- 172.21.15.84:0/2634744121 >> 172.21.15.84:0/2634744121 conn(0x7fd9cc0faab0 msgr2=0x7fd9cc0fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:53.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.417+0000 7fd9d1400700 1 -- 172.21.15.84:0/2634744121 shutdown_connections 2024-04-26T21:20:53.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.417+0000 7fd9d1400700 1 -- 172.21.15.84:0/2634744121 wait complete. 2024-04-26T21:20:53.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.418+0000 7fd9d1400700 1 Processor -- start 2024-04-26T21:20:53.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.418+0000 7fd9d1400700 1 -- start start 2024-04-26T21:20:53.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.418+0000 7fd9d1400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc0fefd0 0x7fd9cc10fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:53.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.419+0000 7fd9d1400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9cc100280 0x7fd9cc110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:53.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.419+0000 7fd9d1400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc110740 con 0x7fd9cc0fefd0 2024-04-26T21:20:53.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.419+0000 7fd9d1400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc110f90 con 0x7fd9cc100280 2024-04-26T21:20:53.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.419+0000 7fd9ca800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc0fefd0 0x7fd9cc10fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:53.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.419+0000 7fd9ca800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc0fefd0 0x7fd9cc10fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56678/0 (socket says 172.21.15.84:56678) 2024-04-26T21:20:53.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.419+0000 7fd9ca800700 1 -- 172.21.15.84:0/2395721544 learned_addr learned my addr 172.21.15.84:0/2395721544 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:53.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.419+0000 7fd9c9e00700 1 --2- 172.21.15.84:0/2395721544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9cc100280 0x7fd9cc110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:53.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.419+0000 7fd9ca800700 1 -- 172.21.15.84:0/2395721544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9cc100280 msgr2=0x7fd9cc110140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:53.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.419+0000 7fd9ca800700 1 --2- 172.21.15.84:0/2395721544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9cc100280 0x7fd9cc110140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:53.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.419+0000 7fd9ca800700 1 -- 172.21.15.84:0/2395721544 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8005040 con 0x7fd9cc0fefd0 2024-04-26T21:20:53.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.420+0000 7fd9ca800700 1 --2- 172.21.15.84:0/2395721544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc0fefd0 0x7fd9cc10fc00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc00c830 tx=0x7fd9bc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:53.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.420+0000 7fd9c2a00700 1 -- 172.21.15.84:0/2395721544 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9bc00a760 con 0x7fd9cc0fefd0 2024-04-26T21:20:53.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.420+0000 7fd9c2a00700 1 -- 172.21.15.84:0/2395721544 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd9bc00ad90 con 0x7fd9cc0fefd0 2024-04-26T21:20:53.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.420+0000 7fd9d1400700 1 -- 172.21.15.84:0/2395721544 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9cc111270 con 0x7fd9cc0fefd0 2024-04-26T21:20:53.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.420+0000 7fd9c2a00700 1 -- 172.21.15.84:0/2395721544 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9bc0113a0 con 0x7fd9cc0fefd0 2024-04-26T21:20:53.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.420+0000 7fd9d1400700 1 -- 172.21.15.84:0/2395721544 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9cc1117b0 con 0x7fd9cc0fefd0 2024-04-26T21:20:53.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.421+0000 7fd9d1400700 1 -- 172.21.15.84:0/2395721544 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9cc05f5c0 con 0x7fd9cc0fefd0 2024-04-26T21:20:53.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.422+0000 7fd9c2a00700 1 -- 172.21.15.84:0/2395721544 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fd9bc012400 con 0x7fd9cc0fefd0 2024-04-26T21:20:53.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.423+0000 7fd9c2a00700 1 --2- 172.21.15.84:0/2395721544 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fd9b00692b0 0x7fd9b006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:53.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.423+0000 7fd9c2a00700 1 -- 172.21.15.84:0/2395721544 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd9bc086ed0 con 0x7fd9cc0fefd0 2024-04-26T21:20:53.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.423+0000 7fd9c9e00700 1 --2- 172.21.15.84:0/2395721544 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fd9b00692b0 0x7fd9b006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:53.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.424+0000 7fd9c9e00700 1 --2- 172.21.15.84:0/2395721544 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fd9b00692b0 0x7fd9b006b760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8004f90 tx=0x7fd9b8009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:53.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.428+0000 7fd9c2a00700 1 -- 172.21.15.84:0/2395721544 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd9bc056fb0 con 0x7fd9cc0fefd0 2024-04-26T21:20:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:53 smithi120 ceph-mon[32741]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.655+0000 7fd9d1400700 1 -- 172.21.15.84:0/2395721544 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9cc111be0 con 0x7fd9b00692b0 2024-04-26T21:20:53.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.657+0000 7fd9c2a00700 1 -- 172.21.15.84:0/2395721544 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fd9cc111be0 con 0x7fd9b00692b0 2024-04-26T21:20:53.658 INFO:teuthology.orchestra.run.smithi084.stdout:Backend: cephadm 2024-04-26T21:20:53.658 INFO:teuthology.orchestra.run.smithi084.stdout:Available: Yes 2024-04-26T21:20:53.659 INFO:teuthology.orchestra.run.smithi084.stdout:Paused: No 2024-04-26T21:20:53.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.660+0000 7fd9d1400700 1 -- 172.21.15.84:0/2395721544 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fd9b00692b0 msgr2=0x7fd9b006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:53.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.660+0000 7fd9d1400700 1 --2- 172.21.15.84:0/2395721544 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fd9b00692b0 0x7fd9b006b760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8004f90 tx=0x7fd9b8009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:53.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.660+0000 7fd9d1400700 1 -- 172.21.15.84:0/2395721544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc0fefd0 msgr2=0x7fd9cc10fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:53.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.660+0000 7fd9d1400700 1 --2- 172.21.15.84:0/2395721544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc0fefd0 0x7fd9cc10fc00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc00c830 tx=0x7fd9bc004470 comp rx=0 tx=0).stop 2024-04-26T21:20:53.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.660+0000 7fd9d1400700 1 -- 172.21.15.84:0/2395721544 shutdown_connections 2024-04-26T21:20:53.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.660+0000 7fd9d1400700 1 --2- 172.21.15.84:0/2395721544 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fd9b00692b0 0x7fd9b006b760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:53.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.660+0000 7fd9d1400700 1 --2- 172.21.15.84:0/2395721544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc0fefd0 0x7fd9cc10fc00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:53.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.660+0000 7fd9d1400700 1 --2- 172.21.15.84:0/2395721544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9cc100280 0x7fd9cc110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:53.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.660+0000 7fd9d1400700 1 -- 172.21.15.84:0/2395721544 >> 172.21.15.84:0/2395721544 conn(0x7fd9cc0faab0 msgr2=0x7fd9cc0fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:53.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.661+0000 7fd9d1400700 1 -- 172.21.15.84:0/2395721544 shutdown_connections 2024-04-26T21:20:53.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:53.661+0000 7fd9d1400700 1 -- 172.21.15.84:0/2395721544 wait complete. 2024-04-26T21:20:54.546 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-26T21:20:55.021 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:55.326 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:55 smithi084 ceph-mon[25539]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:55.326 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:55 smithi084 ceph-mon[25539]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:20:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:55 smithi120 ceph-mon[32741]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:55.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:55 smithi120 ceph-mon[32741]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:20:57.132 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:57 smithi120 ceph-mon[32741]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:57.132 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:57 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:20:57.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.248+0000 7f5881a00700 1 -- 172.21.15.84:0/923845824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c1002a0 msgr2=0x7f587c100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:57.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.248+0000 7f5881a00700 1 --2- 172.21.15.84:0/923845824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c1002a0 0x7f587c100710 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5868004940 tx=0x7f5868009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:57.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.248+0000 7f5881a00700 1 -- 172.21.15.84:0/923845824 shutdown_connections 2024-04-26T21:20:57.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.248+0000 7f5881a00700 1 --2- 172.21.15.84:0/923845824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c1002a0 0x7f587c100710 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:57.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.248+0000 7f5881a00700 1 --2- 172.21.15.84:0/923845824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0feff0 0x7f587c0ff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:57.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.248+0000 7f5881a00700 1 -- 172.21.15.84:0/923845824 >> 172.21.15.84:0/923845824 conn(0x7f587c0fa8f0 msgr2=0x7f587c0fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:57.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.248+0000 7f5881a00700 1 -- 172.21.15.84:0/923845824 shutdown_connections 2024-04-26T21:20:57.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.248+0000 7f5881a00700 1 -- 172.21.15.84:0/923845824 wait complete. 2024-04-26T21:20:57.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.249+0000 7f5881a00700 1 Processor -- start 2024-04-26T21:20:57.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.249+0000 7f5881a00700 1 -- start start 2024-04-26T21:20:57.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.250+0000 7f5881a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c0feff0 0x7f587c10fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:57.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.250+0000 7f5881a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c1002a0 0x7f587c110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:57.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.250+0000 7f5881a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c110640 con 0x7f587c0feff0 2024-04-26T21:20:57.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.250+0000 7f5881a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c1107b0 con 0x7f587c1002a0 2024-04-26T21:20:57.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.250+0000 7f587aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c0feff0 0x7f587c10fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:57.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.250+0000 7f587aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c0feff0 0x7f587c10fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56690/0 (socket says 172.21.15.84:56690) 2024-04-26T21:20:57.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.250+0000 7f587aa00700 1 -- 172.21.15.84:0/4227158425 learned_addr learned my addr 172.21.15.84:0/4227158425 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:20:57.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.250+0000 7f587a000700 1 --2- 172.21.15.84:0/4227158425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c1002a0 0x7f587c110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:57.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.251+0000 7f587aa00700 1 -- 172.21.15.84:0/4227158425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c1002a0 msgr2=0x7f587c110040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:57.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.251+0000 7f587aa00700 1 --2- 172.21.15.84:0/4227158425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c1002a0 0x7f587c110040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:57.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.251+0000 7f587aa00700 1 -- 172.21.15.84:0/4227158425 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5868005040 con 0x7f587c0feff0 2024-04-26T21:20:57.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.251+0000 7f587a000700 1 --2- 172.21.15.84:0/4227158425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c1002a0 0x7f587c110040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:20:57.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.251+0000 7f587aa00700 1 --2- 172.21.15.84:0/4227158425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c0feff0 0x7f587c10fb00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f586c002a50 tx=0x7f586c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:57.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.251+0000 7f5872a00700 1 -- 172.21.15.84:0/4227158425 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f586c007cc0 con 0x7f587c0feff0 2024-04-26T21:20:57.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.251+0000 7f5872a00700 1 -- 172.21.15.84:0/4227158425 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f586c00f040 con 0x7f587c0feff0 2024-04-26T21:20:57.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.251+0000 7f5872a00700 1 -- 172.21.15.84:0/4227158425 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f586c009640 con 0x7f587c0feff0 2024-04-26T21:20:57.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.251+0000 7f5881a00700 1 -- 172.21.15.84:0/4227158425 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c115210 con 0x7f587c0feff0 2024-04-26T21:20:57.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.251+0000 7f5881a00700 1 -- 172.21.15.84:0/4227158425 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c1157d0 con 0x7f587c0feff0 2024-04-26T21:20:57.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.252+0000 7f5881a00700 1 -- 172.21.15.84:0/4227158425 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587c04c710 con 0x7f587c0feff0 2024-04-26T21:20:57.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.253+0000 7f5872a00700 1 -- 172.21.15.84:0/4227158425 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f586c0097a0 con 0x7f587c0feff0 2024-04-26T21:20:57.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.254+0000 7f5872a00700 1 --2- 172.21.15.84:0/4227158425 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f58600692a0 0x7f586006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:57.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.254+0000 7f5872a00700 1 -- 172.21.15.84:0/4227158425 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f586c086c20 con 0x7f587c0feff0 2024-04-26T21:20:57.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.255+0000 7f587a000700 1 --2- 172.21.15.84:0/4227158425 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f58600692a0 0x7f586006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:57.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.255+0000 7f587a000700 1 --2- 172.21.15.84:0/4227158425 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f58600692a0 0x7f586006b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f586800b7a0 tx=0x7f5868009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:57.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.259+0000 7f5872a00700 1 -- 172.21.15.84:0/4227158425 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f586c056c80 con 0x7f587c0feff0 2024-04-26T21:20:57.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:57 smithi084 ceph-mon[25539]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:57.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:57 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:20:57.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.479+0000 7f5881a00700 1 -- 172.21.15.84:0/4227158425 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f587c104610 con 0x7f58600692a0 2024-04-26T21:20:57.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.504+0000 7f5872a00700 1 -- 172.21.15.84:0/4227158425 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2718 (secure 0 0 0) 0x7f587c104610 con 0x7f58600692a0 2024-04-26T21:20:57.506 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:20:57.506 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (4m) 2m ago 6m 14.4M - 0.25.0 c8568f914cd2 e17e61753bb1 2024-04-26T21:20:57.506 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (6m) 2m ago 6m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 a111b0ee8187 2024-04-26T21:20:57.506 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (5m) 76s ago 5m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 66f4d21263a1 2024-04-26T21:20:57.506 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (4m) 2m ago 6m 73.5M - 9.4.7 954c08fa6188 67caa0766f89 2024-04-26T21:20:57.506 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:9283 running (8m) 2m ago 8m 473M - 17.2.7-907-g2be3efa9 1c5834633715 98242b12bd6c 2024-04-26T21:20:57.506 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283 running (5m) 76s ago 5m 431M - 17.2.7-907-g2be3efa9 1c5834633715 29dc99fc0efb 2024-04-26T21:20:57.507 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (8m) 2m ago 8m 40.8M 2048M 17.2.7-907-g2be3efa9 1c5834633715 24cc2d798ea7 2024-04-26T21:20:57.507 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (5m) 76s ago 5m 37.5M 2048M 17.2.7-907-g2be3efa9 1c5834633715 72c786fd622b 2024-04-26T21:20:57.507 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (6m) 2m ago 6m 7612k - 1.5.0 0da6a335fe13 8fdbcc05a9dd 2024-04-26T21:20:57.507 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (5m) 76s ago 5m 7436k - 1.5.0 0da6a335fe13 1b07a56a6ace 2024-04-26T21:20:57.507 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (4m) 2m ago 4m 39.4M 4288M 17.2.7-907-g2be3efa9 1c5834633715 3a2e74d7e51a 2024-04-26T21:20:57.507 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (3m) 2m ago 3m 37.4M 4288M 17.2.7-907-g2be3efa9 1c5834633715 d283a0a93213 2024-04-26T21:20:57.508 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (3m) 2m ago 3m 36.7M 4288M 17.2.7-907-g2be3efa9 1c5834633715 5899468fc5c8 2024-04-26T21:20:57.508 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (2m) 76s ago 2m 38.7M 5312M 17.2.7-907-g2be3efa9 1c5834633715 b8a14c87d730 2024-04-26T21:20:57.508 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (116s) 76s ago 116s 36.0M 5312M 17.2.7-907-g2be3efa9 1c5834633715 4d294df735a3 2024-04-26T21:20:57.508 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (82s) 76s ago 81s 10.5M 5312M 17.2.7-907-g2be3efa9 1c5834633715 9b60997971a8 2024-04-26T21:20:57.508 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (4m) 2m ago 5m 36.0M - 2.43.0 a07b618ecd1d 7b6983aea888 2024-04-26T21:20:57.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.507+0000 7f5881a00700 1 -- 172.21.15.84:0/4227158425 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f58600692a0 msgr2=0x7f586006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:57.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.507+0000 7f5881a00700 1 --2- 172.21.15.84:0/4227158425 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f58600692a0 0x7f586006b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f586800b7a0 tx=0x7f5868009e30 comp rx=0 tx=0).stop 2024-04-26T21:20:57.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.507+0000 7f5881a00700 1 -- 172.21.15.84:0/4227158425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c0feff0 msgr2=0x7f587c10fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:57.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.507+0000 7f5881a00700 1 --2- 172.21.15.84:0/4227158425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c0feff0 0x7f587c10fb00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f586c002a50 tx=0x7f586c0046b0 comp rx=0 tx=0).stop 2024-04-26T21:20:57.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.507+0000 7f5881a00700 1 -- 172.21.15.84:0/4227158425 shutdown_connections 2024-04-26T21:20:57.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.507+0000 7f5881a00700 1 --2- 172.21.15.84:0/4227158425 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f58600692a0 0x7f586006b750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:57.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.507+0000 7f5881a00700 1 --2- 172.21.15.84:0/4227158425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c0feff0 0x7f587c10fb00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:57.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.507+0000 7f5881a00700 1 --2- 172.21.15.84:0/4227158425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c1002a0 0x7f587c110040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:57.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.507+0000 7f5881a00700 1 -- 172.21.15.84:0/4227158425 >> 172.21.15.84:0/4227158425 conn(0x7f587c0fa8f0 msgr2=0x7f587c0fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:57.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.507+0000 7f5881a00700 1 -- 172.21.15.84:0/4227158425 shutdown_connections 2024-04-26T21:20:57.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:20:57.507+0000 7f5881a00700 1 -- 172.21.15.84:0/4227158425 wait complete. 2024-04-26T21:20:58.349 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-26T21:20:58.813 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:20:59.220 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:59 smithi084 ceph-mon[25539]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:20:59.220 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:20:59 smithi084 ceph-mon[25539]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:20:59.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:59 smithi120 ceph-mon[32741]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:20:59.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:20:59 smithi120 ceph-mon[32741]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.908+0000 7f47cb000700 1 -- 172.21.15.84:0/2157922727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47c40feff0 msgr2=0x7f47c40ff400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.908+0000 7f47cb000700 1 --2- 172.21.15.84:0/2157922727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47c40feff0 0x7f47c40ff400 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f47b4004940 tx=0x7f47b4009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.908+0000 7f47cb000700 1 -- 172.21.15.84:0/2157922727 shutdown_connections 2024-04-26T21:21:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.908+0000 7f47cb000700 1 --2- 172.21.15.84:0/2157922727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47c41002a0 0x7f47c4100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.908+0000 7f47cb000700 1 --2- 172.21.15.84:0/2157922727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47c40feff0 0x7f47c40ff400 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.908+0000 7f47cb000700 1 -- 172.21.15.84:0/2157922727 >> 172.21.15.84:0/2157922727 conn(0x7f47c40fa8f0 msgr2=0x7f47c40fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.908+0000 7f47cb000700 1 -- 172.21.15.84:0/2157922727 shutdown_connections 2024-04-26T21:21:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.908+0000 7f47cb000700 1 -- 172.21.15.84:0/2157922727 wait complete. 2024-04-26T21:21:00.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.909+0000 7f47cb000700 1 Processor -- start 2024-04-26T21:21:00.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.909+0000 7f47cb000700 1 -- start start 2024-04-26T21:21:00.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.910+0000 7f47cb000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47c40feff0 0x7f47c410fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:00.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.910+0000 7f47cb000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47c41002a0 0x7f47c4110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:00.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.910+0000 7f47cb000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c4110670 con 0x7f47c40feff0 2024-04-26T21:21:00.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.910+0000 7f47cb000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c41107e0 con 0x7f47c41002a0 2024-04-26T21:21:00.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.910+0000 7f47c3e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47c40feff0 0x7f47c410fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:00.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.910+0000 7f47c3e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47c40feff0 0x7f47c410fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56702/0 (socket says 172.21.15.84:56702) 2024-04-26T21:21:00.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.910+0000 7f47c3e00700 1 -- 172.21.15.84:0/2351840739 learned_addr learned my addr 172.21.15.84:0/2351840739 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:21:00.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.910+0000 7f47c3e00700 1 -- 172.21.15.84:0/2351840739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47c41002a0 msgr2=0x7f47c4110070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:00.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.910+0000 7f47c3e00700 1 --2- 172.21.15.84:0/2351840739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47c41002a0 0x7f47c4110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:00.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.911+0000 7f47c3e00700 1 -- 172.21.15.84:0/2351840739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b4005040 con 0x7f47c40feff0 2024-04-26T21:21:00.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.911+0000 7f47c3e00700 1 --2- 172.21.15.84:0/2351840739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47c40feff0 0x7f47c410fb30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f47b400b3b0 tx=0x7f47b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:00.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.911+0000 7f47bbe00700 1 -- 172.21.15.84:0/2351840739 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47b400e040 con 0x7f47c40feff0 2024-04-26T21:21:00.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.911+0000 7f47bbe00700 1 -- 172.21.15.84:0/2351840739 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f47b4004290 con 0x7f47c40feff0 2024-04-26T21:21:00.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.911+0000 7f47bbe00700 1 -- 172.21.15.84:0/2351840739 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47b401c630 con 0x7f47c40feff0 2024-04-26T21:21:00.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.911+0000 7f47cb000700 1 -- 172.21.15.84:0/2351840739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c41151e0 con 0x7f47c40feff0 2024-04-26T21:21:00.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.911+0000 7f47cb000700 1 -- 172.21.15.84:0/2351840739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c41157a0 con 0x7f47c40feff0 2024-04-26T21:21:00.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.912+0000 7f47cb000700 1 -- 172.21.15.84:0/2351840739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c404c710 con 0x7f47c40feff0 2024-04-26T21:21:00.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.913+0000 7f47bbe00700 1 -- 172.21.15.84:0/2351840739 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f47b400bbf0 con 0x7f47c40feff0 2024-04-26T21:21:00.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.914+0000 7f47bbe00700 1 --2- 172.21.15.84:0/2351840739 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f47a80692a0 0x7f47a806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:00.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.915+0000 7f47bbe00700 1 -- 172.21.15.84:0/2351840739 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f47b40882d0 con 0x7f47c40feff0 2024-04-26T21:21:00.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.915+0000 7f47c3400700 1 --2- 172.21.15.84:0/2351840739 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f47a80692a0 0x7f47a806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:00.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.915+0000 7f47c3400700 1 --2- 172.21.15.84:0/2351840739 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f47a80692a0 0x7f47a806b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f47b0004ad0 tx=0x7f47b0007d40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:00.920+0000 7f47bbe00700 1 -- 172.21.15.84:0/2351840739 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f47b40583b0 con 0x7f47c40feff0 2024-04-26T21:21:01.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:01.143+0000 7f47cb000700 1 -- 172.21.15.84:0/2351840739 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f47c41045c0 con 0x7f47a80692a0 2024-04-26T21:21:01.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:01.155+0000 7f47bbe00700 1 -- 172.21.15.84:0/2351840739 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7f47c41045c0 con 0x7f47a80692a0 2024-04-26T21:21:01.156 INFO:teuthology.orchestra.run.smithi084.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-26T21:21:01.156 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager ?:9093,9094 1/1 2m ago 7m count:1 2024-04-26T21:21:01.156 INFO:teuthology.orchestra.run.smithi084.stdout:crash 2/2 2m ago 7m * 2024-04-26T21:21:01.156 INFO:teuthology.orchestra.run.smithi084.stdout:grafana ?:3000 1/1 2m ago 7m count:1 2024-04-26T21:21:01.156 INFO:teuthology.orchestra.run.smithi084.stdout:mgr 2/2 2m ago 7m count:2 2024-04-26T21:21:01.156 INFO:teuthology.orchestra.run.smithi084.stdout:mon 2/2 2m ago 6m smithi084:172.21.15.84=smithi084;smithi120:172.21.15.120=smithi120;count:2 2024-04-26T21:21:01.156 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter ?:9100 2/2 2m ago 7m * 2024-04-26T21:21:01.156 INFO:teuthology.orchestra.run.smithi084.stdout:osd 6 2m ago - 2024-04-26T21:21:01.157 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus ?:9095 1/1 2m ago 7m count:1 2024-04-26T21:21:01.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:01.158+0000 7f47cb000700 1 -- 172.21.15.84:0/2351840739 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f47a80692a0 msgr2=0x7f47a806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:01.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:01.158+0000 7f47cb000700 1 --2- 172.21.15.84:0/2351840739 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f47a80692a0 0x7f47a806b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f47b0004ad0 tx=0x7f47b0007d40 comp rx=0 tx=0).stop 2024-04-26T21:21:01.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:01.158+0000 7f47cb000700 1 -- 172.21.15.84:0/2351840739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47c40feff0 msgr2=0x7f47c410fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:01.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:01.158+0000 7f47cb000700 1 --2- 172.21.15.84:0/2351840739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47c40feff0 0x7f47c410fb30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f47b400b3b0 tx=0x7f47b4009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:01.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:01.158+0000 7f47cb000700 1 -- 172.21.15.84:0/2351840739 shutdown_connections 2024-04-26T21:21:01.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:01.158+0000 7f47cb000700 1 --2- 172.21.15.84:0/2351840739 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f47a80692a0 0x7f47a806b750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:01.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:01.158+0000 7f47cb000700 1 --2- 172.21.15.84:0/2351840739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47c40feff0 0x7f47c410fb30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:01.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:01.158+0000 7f47cb000700 1 --2- 172.21.15.84:0/2351840739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47c41002a0 0x7f47c4110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:01.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:01.158+0000 7f47cb000700 1 -- 172.21.15.84:0/2351840739 >> 172.21.15.84:0/2351840739 conn(0x7f47c40fa8f0 msgr2=0x7f47c40fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:01.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:01.158+0000 7f47cb000700 1 -- 172.21.15.84:0/2351840739 shutdown_connections 2024-04-26T21:21:01.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:01.159+0000 7f47cb000700 1 -- 172.21.15.84:0/2351840739 wait complete. 2024-04-26T21:21:01.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:01 smithi084 ceph-mon[25539]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:01.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:01 smithi120 ceph-mon[32741]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:02.056 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-26T21:21:02.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:02 smithi084 ceph-mon[25539]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:02.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:02 smithi120 ceph-mon[32741]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:02.532 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:21:03.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:03 smithi084 ceph-mon[25539]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:03.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:03 smithi120 ceph-mon[32741]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:04.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.834+0000 7f65a4a00700 1 -- 172.21.15.84:0/3299716579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65a00fdfd0 msgr2=0x7f65a00fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:04.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.834+0000 7f65a4a00700 1 --2- 172.21.15.84:0/3299716579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65a00fdfd0 0x7f65a00fe440 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f658c004940 tx=0x7f658c009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:04.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.834+0000 7f65a4a00700 1 -- 172.21.15.84:0/3299716579 shutdown_connections 2024-04-26T21:21:04.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.834+0000 7f65a4a00700 1 --2- 172.21.15.84:0/3299716579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65a00fdfd0 0x7f65a00fe440 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:04.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.834+0000 7f65a4a00700 1 --2- 172.21.15.84:0/3299716579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65a00fce60 0x7f65a00fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:04.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.834+0000 7f65a4a00700 1 -- 172.21.15.84:0/3299716579 >> 172.21.15.84:0/3299716579 conn(0x7f65a00f8540 msgr2=0x7f65a00fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:04.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.834+0000 7f65a4a00700 1 -- 172.21.15.84:0/3299716579 shutdown_connections 2024-04-26T21:21:04.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.834+0000 7f65a4a00700 1 -- 172.21.15.84:0/3299716579 wait complete. 2024-04-26T21:21:04.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.835+0000 7f65a4a00700 1 Processor -- start 2024-04-26T21:21:04.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.836+0000 7f65a4a00700 1 -- start start 2024-04-26T21:21:04.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.836+0000 7f65a4a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65a00fce60 0x7f65a010d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:04.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.836+0000 7f65a4a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65a00fdfd0 0x7f65a010de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:04.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.836+0000 7f65a4a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a010e450 con 0x7f65a00fdfd0 2024-04-26T21:21:04.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.836+0000 7f65a4a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a010e5c0 con 0x7f65a00fce60 2024-04-26T21:21:04.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.836+0000 7f659d400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65a00fdfd0 0x7f65a010de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:04.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.836+0000 7f659d400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65a00fdfd0 0x7f65a010de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56036/0 (socket says 172.21.15.84:56036) 2024-04-26T21:21:04.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.836+0000 7f659d400700 1 -- 172.21.15.84:0/3351732025 learned_addr learned my addr 172.21.15.84:0/3351732025 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:21:04.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.837+0000 7f659de00700 1 --2- 172.21.15.84:0/3351732025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65a00fce60 0x7f65a010d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:04.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.837+0000 7f659d400700 1 -- 172.21.15.84:0/3351732025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65a00fce60 msgr2=0x7f65a010d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:04.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.837+0000 7f659d400700 1 --2- 172.21.15.84:0/3351732025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65a00fce60 0x7f65a010d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:04.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.837+0000 7f659d400700 1 -- 172.21.15.84:0/3351732025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c005040 con 0x7f65a00fdfd0 2024-04-26T21:21:04.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.837+0000 7f659d400700 1 --2- 172.21.15.84:0/3351732025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65a00fdfd0 0x7f65a010de50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f658c009150 tx=0x7f658c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:04.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.837+0000 7f6596000700 1 -- 172.21.15.84:0/3351732025 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f658c00e040 con 0x7f65a00fdfd0 2024-04-26T21:21:04.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.838+0000 7f6596000700 1 -- 172.21.15.84:0/3351732025 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f658c00bcc0 con 0x7f65a00fdfd0 2024-04-26T21:21:04.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.838+0000 7f65a4a00700 1 -- 172.21.15.84:0/3351732025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a0112fc0 con 0x7f65a00fdfd0 2024-04-26T21:21:04.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.838+0000 7f6596000700 1 -- 172.21.15.84:0/3351732025 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f658c01c630 con 0x7f65a00fdfd0 2024-04-26T21:21:04.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.838+0000 7f65a4a00700 1 -- 172.21.15.84:0/3351732025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a0113550 con 0x7f65a00fdfd0 2024-04-26T21:21:04.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.839+0000 7f65a4a00700 1 -- 172.21.15.84:0/3351732025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a004c710 con 0x7f65a00fdfd0 2024-04-26T21:21:04.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.840+0000 7f6596000700 1 -- 172.21.15.84:0/3351732025 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f658c013420 con 0x7f65a00fdfd0 2024-04-26T21:21:04.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.841+0000 7f6596000700 1 --2- 172.21.15.84:0/3351732025 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f65840692a0 0x7f658406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:04.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.841+0000 7f6596000700 1 -- 172.21.15.84:0/3351732025 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f658c087cc0 con 0x7f65a00fdfd0 2024-04-26T21:21:04.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.841+0000 7f659de00700 1 --2- 172.21.15.84:0/3351732025 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f65840692a0 0x7f658406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:04.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.842+0000 7f659de00700 1 --2- 172.21.15.84:0/3351732025 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f65840692a0 0x7f658406b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6590007fd0 tx=0x7f6590009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:04.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:04.846+0000 7f6596000700 1 -- 172.21.15.84:0/3351732025 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f658c08d020 con 0x7f65a00fdfd0 2024-04-26T21:21:05.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:05.066+0000 7f65a4a00700 1 -- 172.21.15.84:0/3351732025 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f65a0102360 con 0x7f65840692a0 2024-04-26T21:21:05.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:05.068+0000 7f6596000700 1 -- 172.21.15.84:0/3351732025 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f65a0102360 con 0x7f65840692a0 2024-04-26T21:21:05.068 INFO:teuthology.orchestra.run.smithi084.stdout:HOST ADDR LABELS STATUS 2024-04-26T21:21:05.069 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084 172.21.15.84 2024-04-26T21:21:05.069 INFO:teuthology.orchestra.run.smithi084.stdout:smithi120 172.21.15.120 2024-04-26T21:21:05.069 INFO:teuthology.orchestra.run.smithi084.stdout:2 hosts in cluster 2024-04-26T21:21:05.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:05.070+0000 7f65a4a00700 1 -- 172.21.15.84:0/3351732025 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f65840692a0 msgr2=0x7f658406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:05.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:05.070+0000 7f65a4a00700 1 --2- 172.21.15.84:0/3351732025 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f65840692a0 0x7f658406b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6590007fd0 tx=0x7f6590009040 comp rx=0 tx=0).stop 2024-04-26T21:21:05.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:05.070+0000 7f65a4a00700 1 -- 172.21.15.84:0/3351732025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65a00fdfd0 msgr2=0x7f65a010de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:05.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:05.070+0000 7f65a4a00700 1 --2- 172.21.15.84:0/3351732025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65a00fdfd0 0x7f65a010de50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f658c009150 tx=0x7f658c009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:05.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:05.070+0000 7f65a4a00700 1 -- 172.21.15.84:0/3351732025 shutdown_connections 2024-04-26T21:21:05.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:05.070+0000 7f65a4a00700 1 --2- 172.21.15.84:0/3351732025 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f65840692a0 0x7f658406b750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:05.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:05.071+0000 7f65a4a00700 1 --2- 172.21.15.84:0/3351732025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65a00fce60 0x7f65a010d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:05.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:05.071+0000 7f65a4a00700 1 --2- 172.21.15.84:0/3351732025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65a00fdfd0 0x7f65a010de50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:05.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:05.071+0000 7f65a4a00700 1 -- 172.21.15.84:0/3351732025 >> 172.21.15.84:0/3351732025 conn(0x7f65a00f8540 msgr2=0x7f65a00f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:05.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:05.071+0000 7f65a4a00700 1 -- 172.21.15.84:0/3351732025 shutdown_connections 2024-04-26T21:21:05.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:05.071+0000 7f65a4a00700 1 -- 172.21.15.84:0/3351732025 wait complete. 2024-04-26T21:21:05.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:05 smithi084 ceph-mon[25539]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:05 smithi120 ceph-mon[32741]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:05.908 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-26T21:21:06.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:06 smithi084 ceph-mon[25539]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:06.385 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:21:06.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:06 smithi120 ceph-mon[32741]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:07.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:07 smithi084 ceph-mon[25539]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:07.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:07 smithi120 ceph-mon[32741]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:08.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.558+0000 7f41b1200700 1 -- 172.21.15.84:0/2750351875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41ac070940 msgr2=0x7f41ac070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:08.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.558+0000 7f41b1200700 1 --2- 172.21.15.84:0/2750351875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41ac070940 0x7f41ac070db0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4198004940 tx=0x7f4198009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:08.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.558+0000 7f41b1200700 1 -- 172.21.15.84:0/2750351875 shutdown_connections 2024-04-26T21:21:08.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.558+0000 7f41b1200700 1 --2- 172.21.15.84:0/2750351875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41ac070940 0x7f41ac070db0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:08.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.558+0000 7f41b1200700 1 --2- 172.21.15.84:0/2750351875 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41ac071ef0 0x7f41ac070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:08.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.558+0000 7f41b1200700 1 -- 172.21.15.84:0/2750351875 >> 172.21.15.84:0/2750351875 conn(0x7f41ac0f8560 msgr2=0x7f41ac0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:08.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.558+0000 7f41b1200700 1 -- 172.21.15.84:0/2750351875 shutdown_connections 2024-04-26T21:21:08.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.558+0000 7f41b1200700 1 -- 172.21.15.84:0/2750351875 wait complete. 2024-04-26T21:21:08.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.559+0000 7f41b1200700 1 Processor -- start 2024-04-26T21:21:08.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.559+0000 7f41b1200700 1 -- start start 2024-04-26T21:21:08.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.559+0000 7f41b1200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41ac070940 0x7f41ac10fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:08.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.560+0000 7f41b1200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41ac071ef0 0x7f41ac110110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:08.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.560+0000 7f41b1200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac110710 con 0x7f41ac070940 2024-04-26T21:21:08.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.560+0000 7f41b1200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac110f60 con 0x7f41ac071ef0 2024-04-26T21:21:08.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.560+0000 7f41a9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41ac070940 0x7f41ac10fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:08.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.560+0000 7f41a9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41ac070940 0x7f41ac10fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56056/0 (socket says 172.21.15.84:56056) 2024-04-26T21:21:08.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.560+0000 7f41a9e00700 1 -- 172.21.15.84:0/1222784927 learned_addr learned my addr 172.21.15.84:0/1222784927 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:21:08.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.560+0000 7f41a9400700 1 --2- 172.21.15.84:0/1222784927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41ac071ef0 0x7f41ac110110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:08.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.560+0000 7f41a9e00700 1 -- 172.21.15.84:0/1222784927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41ac071ef0 msgr2=0x7f41ac110110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:08.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.560+0000 7f41a9e00700 1 --2- 172.21.15.84:0/1222784927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41ac071ef0 0x7f41ac110110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:08.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.560+0000 7f41a9e00700 1 -- 172.21.15.84:0/1222784927 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4198005040 con 0x7f41ac070940 2024-04-26T21:21:08.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.561+0000 7f41a9e00700 1 --2- 172.21.15.84:0/1222784927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41ac070940 0x7f41ac10fbd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f419c00c8b0 tx=0x7f419c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:08.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.561+0000 7f41a2000700 1 -- 172.21.15.84:0/1222784927 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f419c00a760 con 0x7f41ac070940 2024-04-26T21:21:08.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.561+0000 7f41a2000700 1 -- 172.21.15.84:0/1222784927 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f419c00ad90 con 0x7f41ac070940 2024-04-26T21:21:08.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.561+0000 7f41a2000700 1 -- 172.21.15.84:0/1222784927 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f419c0113a0 con 0x7f41ac070940 2024-04-26T21:21:08.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.561+0000 7f41b1200700 1 -- 172.21.15.84:0/1222784927 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ac111240 con 0x7f41ac070940 2024-04-26T21:21:08.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.561+0000 7f41b1200700 1 -- 172.21.15.84:0/1222784927 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41ac111780 con 0x7f41ac070940 2024-04-26T21:21:08.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.562+0000 7f41b1200700 1 -- 172.21.15.84:0/1222784927 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ac05f5c0 con 0x7f41ac070940 2024-04-26T21:21:08.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.563+0000 7f41a2000700 1 -- 172.21.15.84:0/1222784927 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f419c012400 con 0x7f41ac070940 2024-04-26T21:21:08.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.564+0000 7f41a2000700 1 --2- 172.21.15.84:0/1222784927 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f41900692b0 0x7f419006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:08.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.564+0000 7f41a2000700 1 -- 172.21.15.84:0/1222784927 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f419c086e60 con 0x7f41ac070940 2024-04-26T21:21:08.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.564+0000 7f41a9400700 1 --2- 172.21.15.84:0/1222784927 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f41900692b0 0x7f419006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:08.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.565+0000 7f41a9400700 1 --2- 172.21.15.84:0/1222784927 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f41900692b0 0x7f419006b760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f419800b970 tx=0x7f4198009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:08.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.568+0000 7f41a2000700 1 -- 172.21.15.84:0/1222784927 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f419c056f40 con 0x7f41ac070940 2024-04-26T21:21:08.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.790+0000 7f41b1200700 1 -- 172.21.15.84:0/1222784927 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f41ac111bc0 con 0x7f41900692b0 2024-04-26T21:21:08.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.794+0000 7f41a2000700 1 -- 172.21.15.84:0/1222784927 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f41ac111bc0 con 0x7f41900692b0 2024-04-26T21:21:08.794 INFO:teuthology.orchestra.run.smithi084.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-26T21:21:08.794 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400WF400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-26T21:21:08.794 INFO:teuthology.orchestra.run.smithi084.stdout:smithi120 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400XV400BGN 372G No 81s ago Has a FileSystem, LVM detected 2024-04-26T21:21:08.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.796+0000 7f41b1200700 1 -- 172.21.15.84:0/1222784927 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f41900692b0 msgr2=0x7f419006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:08.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.796+0000 7f41b1200700 1 --2- 172.21.15.84:0/1222784927 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f41900692b0 0x7f419006b760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f419800b970 tx=0x7f4198009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:08.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.796+0000 7f41b1200700 1 -- 172.21.15.84:0/1222784927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41ac070940 msgr2=0x7f41ac10fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:08.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.796+0000 7f41b1200700 1 --2- 172.21.15.84:0/1222784927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41ac070940 0x7f41ac10fbd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f419c00c8b0 tx=0x7f419c004470 comp rx=0 tx=0).stop 2024-04-26T21:21:08.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.797+0000 7f41b1200700 1 -- 172.21.15.84:0/1222784927 shutdown_connections 2024-04-26T21:21:08.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.797+0000 7f41b1200700 1 --2- 172.21.15.84:0/1222784927 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f41900692b0 0x7f419006b760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:08.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.797+0000 7f41b1200700 1 --2- 172.21.15.84:0/1222784927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41ac070940 0x7f41ac10fbd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:08.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.797+0000 7f41b1200700 1 --2- 172.21.15.84:0/1222784927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41ac071ef0 0x7f41ac110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:08.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.797+0000 7f41b1200700 1 -- 172.21.15.84:0/1222784927 >> 172.21.15.84:0/1222784927 conn(0x7f41ac0f8560 msgr2=0x7f41ac0f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:08.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.797+0000 7f41b1200700 1 -- 172.21.15.84:0/1222784927 shutdown_connections 2024-04-26T21:21:08.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:08.797+0000 7f41b1200700 1 -- 172.21.15.84:0/1222784927 wait complete. 2024-04-26T21:21:09.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:09 smithi084 ceph-mon[25539]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:09.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:09 smithi120 ceph-mon[32741]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:09.673 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T21:21:09.685 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi084.front.sepia.ceph.com 2024-04-26T21:21:09.685 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-04-26T21:21:10.129 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:21:10.327 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:10 smithi084 ceph-mon[25539]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:10.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:10 smithi120 ceph-mon[32741]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:11.340 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:11 smithi084 ceph-mon[25539]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:11.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:11 smithi120 ceph-mon[32741]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:12.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:12 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:21:12.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.332+0000 7fab98400700 1 -- 172.21.15.84:0/176690772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab901046a0 msgr2=0x7fab90104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:12.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.332+0000 7fab98400700 1 --2- 172.21.15.84:0/176690772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab901046a0 0x7fab90104b10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fab7c004940 tx=0x7fab7c009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:12.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.332+0000 7fab98400700 1 -- 172.21.15.84:0/176690772 shutdown_connections 2024-04-26T21:21:12.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.332+0000 7fab98400700 1 --2- 172.21.15.84:0/176690772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab901046a0 0x7fab90104b10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:12.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.332+0000 7fab98400700 1 --2- 172.21.15.84:0/176690772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab901033f0 0x7fab90103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:12.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.332+0000 7fab98400700 1 -- 172.21.15.84:0/176690772 >> 172.21.15.84:0/176690772 conn(0x7fab900725e0 msgr2=0x7fab90074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:12.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.332+0000 7fab98400700 1 -- 172.21.15.84:0/176690772 shutdown_connections 2024-04-26T21:21:12.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.333+0000 7fab98400700 1 -- 172.21.15.84:0/176690772 wait complete. 2024-04-26T21:21:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.333+0000 7fab98400700 1 Processor -- start 2024-04-26T21:21:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.334+0000 7fab98400700 1 -- start start 2024-04-26T21:21:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.334+0000 7fab98400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab901033f0 0x7fab90113ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.334+0000 7fab98400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab901046a0 0x7fab90114430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.334+0000 7fab98400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab90114a30 con 0x7fab901046a0 2024-04-26T21:21:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.334+0000 7fab98400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab90114ba0 con 0x7fab901033f0 2024-04-26T21:21:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.334+0000 7fab95000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab901046a0 0x7fab90114430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.334+0000 7fab95000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab901046a0 0x7fab90114430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41806/0 (socket says 172.21.15.84:41806) 2024-04-26T21:21:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.334+0000 7fab95000700 1 -- 172.21.15.84:0/4170190402 learned_addr learned my addr 172.21.15.84:0/4170190402 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:21:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.335+0000 7fab95a00700 1 --2- 172.21.15.84:0/4170190402 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab901033f0 0x7fab90113ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.335+0000 7fab95000700 1 -- 172.21.15.84:0/4170190402 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab901033f0 msgr2=0x7fab90113ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.335+0000 7fab95000700 1 --2- 172.21.15.84:0/4170190402 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab901033f0 0x7fab90113ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.335+0000 7fab95000700 1 -- 172.21.15.84:0/4170190402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7c005040 con 0x7fab901046a0 2024-04-26T21:21:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.335+0000 7fab95000700 1 --2- 172.21.15.84:0/4170190402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab901046a0 0x7fab90114430 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009150 tx=0x7fab7c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:12.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.335+0000 7fab8d600700 1 -- 172.21.15.84:0/4170190402 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab7c00e040 con 0x7fab901046a0 2024-04-26T21:21:12.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.335+0000 7fab8d600700 1 -- 172.21.15.84:0/4170190402 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab7c00bbf0 con 0x7fab901046a0 2024-04-26T21:21:12.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.335+0000 7fab98400700 1 -- 172.21.15.84:0/4170190402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab901195a0 con 0x7fab901046a0 2024-04-26T21:21:12.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.335+0000 7fab8d600700 1 -- 172.21.15.84:0/4170190402 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab7c01c630 con 0x7fab901046a0 2024-04-26T21:21:12.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.336+0000 7fab98400700 1 -- 172.21.15.84:0/4170190402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab90119b60 con 0x7fab901046a0 2024-04-26T21:21:12.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.337+0000 7fab98400700 1 -- 172.21.15.84:0/4170190402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab9004c710 con 0x7fab901046a0 2024-04-26T21:21:12.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.338+0000 7fab8d600700 1 -- 172.21.15.84:0/4170190402 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fab7c00bd60 con 0x7fab901046a0 2024-04-26T21:21:12.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.339+0000 7fab8d600700 1 --2- 172.21.15.84:0/4170190402 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fab780692a0 0x7fab7806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:12.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.339+0000 7fab8d600700 1 -- 172.21.15.84:0/4170190402 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fab7c088250 con 0x7fab901046a0 2024-04-26T21:21:12.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.339+0000 7fab95a00700 1 --2- 172.21.15.84:0/4170190402 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fab780692a0 0x7fab7806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:12.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.340+0000 7fab95a00700 1 --2- 172.21.15.84:0/4170190402 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fab780692a0 0x7fab7806b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fab840041d0 tx=0x7fab84009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:12.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.344+0000 7fab8d600700 1 -- 172.21.15.84:0/4170190402 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fab7c058330 con 0x7fab901046a0 2024-04-26T21:21:12.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:12 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:21:12.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:12.586+0000 7fab98400700 1 -- 172.21.15.84:0/4170190402 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fab901089e0 con 0x7fab780692a0 2024-04-26T21:21:13.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:13 smithi084 ceph-mon[25539]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:13.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:13 smithi120 ceph-mon[32741]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:14.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:14.240+0000 7fab8d600700 1 -- 172.21.15.84:0/4170190402 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fab901089e0 con 0x7fab780692a0 2024-04-26T21:21:14.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:14.245+0000 7fab98400700 1 -- 172.21.15.84:0/4170190402 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fab780692a0 msgr2=0x7fab7806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:14.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:14.245+0000 7fab98400700 1 --2- 172.21.15.84:0/4170190402 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fab780692a0 0x7fab7806b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fab840041d0 tx=0x7fab84009040 comp rx=0 tx=0).stop 2024-04-26T21:21:14.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:14.245+0000 7fab98400700 1 -- 172.21.15.84:0/4170190402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab901046a0 msgr2=0x7fab90114430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:14.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:14.245+0000 7fab98400700 1 --2- 172.21.15.84:0/4170190402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab901046a0 0x7fab90114430 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009150 tx=0x7fab7c009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:14.245+0000 7fab98400700 1 -- 172.21.15.84:0/4170190402 shutdown_connections 2024-04-26T21:21:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:14.245+0000 7fab98400700 1 --2- 172.21.15.84:0/4170190402 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fab780692a0 0x7fab7806b750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:14.245+0000 7fab98400700 1 --2- 172.21.15.84:0/4170190402 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab901033f0 0x7fab90113ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:14.245+0000 7fab98400700 1 --2- 172.21.15.84:0/4170190402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab901046a0 0x7fab90114430 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:14.245+0000 7fab98400700 1 -- 172.21.15.84:0/4170190402 >> 172.21.15.84:0/4170190402 conn(0x7fab900725e0 msgr2=0x7fab90073c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:14.245+0000 7fab98400700 1 -- 172.21.15.84:0/4170190402 shutdown_connections 2024-04-26T21:21:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:14.245+0000 7fab98400700 1 -- 172.21.15.84:0/4170190402 wait complete. 2024-04-26T21:21:14.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:14 smithi084 ceph-mon[25539]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:14.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:14 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-26T21:21:14.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:14 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-26T21:21:14.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:14 smithi084 ceph-mon[25539]: osdmap e41: 6 total, 6 up, 6 in 2024-04-26T21:21:14.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:14 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-26T21:21:14.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:14 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084[25535]: 2024-04-26T21:21:14.208+0000 7f4f20800700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:21:14.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:14 smithi120 ceph-mon[32741]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:14.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:14 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-26T21:21:14.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:14 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-26T21:21:14.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:14 smithi120 ceph-mon[32741]: osdmap e41: 6 total, 6 up, 6 in 2024-04-26T21:21:14.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:14 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-26T21:21:15.005 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-26T21:21:15.298 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:15 smithi084 ceph-mon[25539]: pgmap v210: 33 pgs: 1 active+clean, 32 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:15.298 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:15 smithi084 ceph-mon[25539]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T21:21:15.299 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:15 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-26T21:21:15.299 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:15 smithi084 ceph-mon[25539]: osdmap e42: 6 total, 6 up, 6 in 2024-04-26T21:21:15.299 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:15 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-26T21:21:15.299 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:15 smithi084 ceph-mon[25539]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:21:15.299 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:15 smithi084 ceph-mon[25539]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T21:21:15.299 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:15 smithi084 ceph-mon[25539]: osdmap e43: 6 total, 6 up, 6 in 2024-04-26T21:21:15.299 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:15 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-26T21:21:15.299 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:15 smithi084 ceph-mon[25539]: fsmap cephfs:0 2024-04-26T21:21:15.299 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:15 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:15.299 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:15 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:21:15.299 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:15 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:15.299 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:15 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:21:15.299 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:15 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:15.299 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:15 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.hbjunw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:21:15.300 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:15 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.hbjunw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T21:21:15.300 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:15 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:15.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:15 smithi120 ceph-mon[32741]: pgmap v210: 33 pgs: 1 active+clean, 32 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:15.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:15 smithi120 ceph-mon[32741]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T21:21:15.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:15 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-26T21:21:15.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:15 smithi120 ceph-mon[32741]: osdmap e42: 6 total, 6 up, 6 in 2024-04-26T21:21:15.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:15 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-26T21:21:15.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:15 smithi120 ceph-mon[32741]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:21:15.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:15 smithi120 ceph-mon[32741]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T21:21:15.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:15 smithi120 ceph-mon[32741]: osdmap e43: 6 total, 6 up, 6 in 2024-04-26T21:21:15.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:15 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-26T21:21:15.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:15 smithi120 ceph-mon[32741]: fsmap cephfs:0 2024-04-26T21:21:15.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:15 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:15.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:15 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:21:15.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:15 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:15.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:15 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:21:15.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:15 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:15.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:15 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.hbjunw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:21:15.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:15 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.hbjunw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T21:21:15.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:15 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:16.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:16 smithi084 ceph-mon[25539]: Saving service mds.cephfs spec with placement count:4 2024-04-26T21:21:16.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:16 smithi084 ceph-mon[25539]: Deploying daemon mds.cephfs.smithi084.hbjunw on smithi084 2024-04-26T21:21:16.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:16 smithi084 ceph-mon[25539]: osdmap e44: 6 total, 6 up, 6 in 2024-04-26T21:21:16.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:16 smithi120 ceph-mon[32741]: Saving service mds.cephfs spec with placement count:4 2024-04-26T21:21:16.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:16 smithi120 ceph-mon[32741]: Deploying daemon mds.cephfs.smithi084.hbjunw on smithi084 2024-04-26T21:21:16.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:16 smithi120 ceph-mon[32741]: osdmap e44: 6 total, 6 up, 6 in 2024-04-26T21:21:16.544 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:21:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:17 smithi084 ceph-mon[25539]: pgmap v214: 65 pgs: 1 active+clean, 64 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:17 smithi084 ceph-mon[25539]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-26T21:21:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:17 smithi084 ceph-mon[25539]: osdmap e45: 6 total, 6 up, 6 in 2024-04-26T21:21:17.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:17 smithi120 ceph-mon[32741]: pgmap v214: 65 pgs: 1 active+clean, 64 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:17.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:17 smithi120 ceph-mon[32741]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-26T21:21:17.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:17 smithi120 ceph-mon[32741]: osdmap e45: 6 total, 6 up, 6 in 2024-04-26T21:21:18.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.737+0000 7f397a800700 1 -- 172.21.15.84:0/3526048629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39740727c0 msgr2=0x7f3974072bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:18.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.737+0000 7f397a800700 1 --2- 172.21.15.84:0/3526048629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39740727c0 0x7f3974072bd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3964004940 tx=0x7f3964009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:18.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.737+0000 7f397a800700 1 -- 172.21.15.84:0/3526048629 shutdown_connections 2024-04-26T21:21:18.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.737+0000 7f397a800700 1 --2- 172.21.15.84:0/3526048629 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3974073110 0x7f3974073b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:18.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.737+0000 7f397a800700 1 --2- 172.21.15.84:0/3526048629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39740727c0 0x7f3974072bd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:18.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.737+0000 7f397a800700 1 -- 172.21.15.84:0/3526048629 >> 172.21.15.84:0/3526048629 conn(0x7f39740fa8f0 msgr2=0x7f39740fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:18.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.737+0000 7f397a800700 1 -- 172.21.15.84:0/3526048629 shutdown_connections 2024-04-26T21:21:18.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.737+0000 7f397a800700 1 -- 172.21.15.84:0/3526048629 wait complete. 2024-04-26T21:21:18.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.738+0000 7f397a800700 1 Processor -- start 2024-04-26T21:21:18.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.738+0000 7f397a800700 1 -- start start 2024-04-26T21:21:18.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.739+0000 7f397a800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39740727c0 0x7f3974114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:18.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.739+0000 7f397a800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39741145a0 0x7f39741153f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:18.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.739+0000 7f397a800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3974114a60 con 0x7f39740727c0 2024-04-26T21:21:18.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.739+0000 7f397a800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3974114ba0 con 0x7f39741145a0 2024-04-26T21:21:18.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.739+0000 7f3973400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39740727c0 0x7f3974114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:18.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.739+0000 7f3973400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39740727c0 0x7f3974114060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41846/0 (socket says 172.21.15.84:41846) 2024-04-26T21:21:18.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.739+0000 7f3973400700 1 -- 172.21.15.84:0/266468829 learned_addr learned my addr 172.21.15.84:0/266468829 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:21:18.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.739+0000 7f3972a00700 1 --2- 172.21.15.84:0/266468829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39741145a0 0x7f39741153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:18.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.739+0000 7f3973400700 1 -- 172.21.15.84:0/266468829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39741145a0 msgr2=0x7f39741153f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:18.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.739+0000 7f3973400700 1 --2- 172.21.15.84:0/266468829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39741145a0 0x7f39741153f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:18.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.739+0000 7f3973400700 1 -- 172.21.15.84:0/266468829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3964005040 con 0x7f39740727c0 2024-04-26T21:21:18.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.740+0000 7f3973400700 1 --2- 172.21.15.84:0/266468829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39740727c0 0x7f3974114060 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f396400b970 tx=0x7f3964009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:18.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.740+0000 7f396b400700 1 -- 172.21.15.84:0/266468829 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396400e040 con 0x7f39740727c0 2024-04-26T21:21:18.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.740+0000 7f396b400700 1 -- 172.21.15.84:0/266468829 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3964004290 con 0x7f39740727c0 2024-04-26T21:21:18.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.740+0000 7f397a800700 1 -- 172.21.15.84:0/266468829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39741159f0 con 0x7f39740727c0 2024-04-26T21:21:18.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.740+0000 7f396b400700 1 -- 172.21.15.84:0/266468829 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396401c630 con 0x7f39740727c0 2024-04-26T21:21:18.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.740+0000 7f397a800700 1 -- 172.21.15.84:0/266468829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3974115f80 con 0x7f39740727c0 2024-04-26T21:21:18.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.741+0000 7f397a800700 1 -- 172.21.15.84:0/266468829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f397405f5c0 con 0x7f39740727c0 2024-04-26T21:21:18.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.742+0000 7f396b400700 1 -- 172.21.15.84:0/266468829 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f396400bbf0 con 0x7f39740727c0 2024-04-26T21:21:18.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.743+0000 7f396b400700 1 --2- 172.21.15.84:0/266468829 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f39580692b0 0x7f395806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:18.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.743+0000 7f396b400700 1 -- 172.21.15.84:0/266468829 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3964088520 con 0x7f39740727c0 2024-04-26T21:21:18.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.743+0000 7f3972a00700 1 --2- 172.21.15.84:0/266468829 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f39580692b0 0x7f395806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:18.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.744+0000 7f3972a00700 1 --2- 172.21.15.84:0/266468829 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f39580692b0 0x7f395806b760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3960004d60 tx=0x7f396000b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:18.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:18.749+0000 7f396b400700 1 -- 172.21.15.84:0/266468829 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f39640582c0 con 0x7f39740727c0 2024-04-26T21:21:19.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:19.022+0000 7f397a800700 1 -- 172.21.15.84:0/266468829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3974073110 con 0x7f39740727c0 2024-04-26T21:21:19.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:19.023+0000 7f396b400700 1 -- 172.21.15.84:0/266468829 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f3964013e60 con 0x7f39740727c0 2024-04-26T21:21:19.024 INFO:teuthology.orchestra.run.smithi084.stdout:e2 2024-04-26T21:21:19.024 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:21:19.024 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:21:19.024 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:21:19.025 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:21:19.025 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:21:19.025 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:21:19.025 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 2 2024-04-26T21:21:19.025 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:21:19.025 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:21:19.025 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:21:14.209005+0000 2024-04-26T21:21:19.025 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:21:19.025 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:21:19.025 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:21:19.025 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:21:19.025 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:21:19.025 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:21:19.025 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:21:19.026 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:21:19.026 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:21:19.026 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 1 2024-04-26T21:21:19.026 INFO:teuthology.orchestra.run.smithi084.stdout:in 2024-04-26T21:21:19.026 INFO:teuthology.orchestra.run.smithi084.stdout:up {} 2024-04-26T21:21:19.026 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:21:19.026 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:21:19.026 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:21:19.026 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:21:19.026 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:21:19.026 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-04-26T21:21:19.026 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:21:19.026 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 0 2024-04-26T21:21:19.027 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:21:19.027 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:21:19.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:19.027+0000 7f397a800700 1 -- 172.21.15.84:0/266468829 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f39580692b0 msgr2=0x7f395806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:19.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:19.027+0000 7f397a800700 1 --2- 172.21.15.84:0/266468829 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f39580692b0 0x7f395806b760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3960004d60 tx=0x7f396000b040 comp rx=0 tx=0).stop 2024-04-26T21:21:19.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:19.027+0000 7f397a800700 1 -- 172.21.15.84:0/266468829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39740727c0 msgr2=0x7f3974114060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:19.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:19.027+0000 7f397a800700 1 --2- 172.21.15.84:0/266468829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39740727c0 0x7f3974114060 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f396400b970 tx=0x7f3964009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:19.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:19.027+0000 7f397a800700 1 -- 172.21.15.84:0/266468829 shutdown_connections 2024-04-26T21:21:19.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:19.027+0000 7f397a800700 1 --2- 172.21.15.84:0/266468829 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f39580692b0 0x7f395806b760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:19.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:19.027+0000 7f397a800700 1 --2- 172.21.15.84:0/266468829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39740727c0 0x7f3974114060 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:19.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:19.027+0000 7f397a800700 1 --2- 172.21.15.84:0/266468829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39741145a0 0x7f39741153f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:19.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:19.027+0000 7f397a800700 1 -- 172.21.15.84:0/266468829 >> 172.21.15.84:0/266468829 conn(0x7f39740fa8f0 msgr2=0x7f39740fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:19.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:19.027+0000 7f397a800700 1 -- 172.21.15.84:0/266468829 shutdown_connections 2024-04-26T21:21:19.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:19.028+0000 7f397a800700 1 -- 172.21.15.84:0/266468829 wait complete. 2024-04-26T21:21:19.029 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 2 2024-04-26T21:21:19.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:19 smithi084 ceph-mon[25539]: pgmap v216: 65 pgs: 1 active+clean, 64 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:19.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:19 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:19.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:19 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:19.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:19 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:19.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:19 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.qnkxcn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:21:19.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:19 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.qnkxcn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T21:21:19.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:19 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:19.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:19 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/266468829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:21:19.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:19 smithi084 ceph-mon[25539]: daemon mds.cephfs.smithi084.hbjunw assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-26T21:21:19.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:19 smithi084 ceph-mon[25539]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T21:21:19.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:19 smithi084 ceph-mon[25539]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T21:21:19.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:19 smithi084 ceph-mon[25539]: Cluster is now healthy 2024-04-26T21:21:19.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:19 smithi084 ceph-mon[25539]: mds.? [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] up:boot 2024-04-26T21:21:19.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:19 smithi084 ceph-mon[25539]: fsmap cephfs:1 {0=cephfs.smithi084.hbjunw=up:creating} 2024-04-26T21:21:19.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:19 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.hbjunw"}]: dispatch 2024-04-26T21:21:19.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:19 smithi084 ceph-mon[25539]: daemon mds.cephfs.smithi084.hbjunw is now active in filesystem cephfs as rank 0 2024-04-26T21:21:19.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:19 smithi120 ceph-mon[32741]: pgmap v216: 65 pgs: 1 active+clean, 64 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:19.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:19 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:19.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:19 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:19.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:19 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:19.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:19 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.qnkxcn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:21:19.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:19 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.qnkxcn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T21:21:19.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:19 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:19.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:19 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/266468829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:21:19.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:19 smithi120 ceph-mon[32741]: daemon mds.cephfs.smithi084.hbjunw assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-26T21:21:19.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:19 smithi120 ceph-mon[32741]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T21:21:19.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:19 smithi120 ceph-mon[32741]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T21:21:19.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:19 smithi120 ceph-mon[32741]: Cluster is now healthy 2024-04-26T21:21:19.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:19 smithi120 ceph-mon[32741]: mds.? [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] up:boot 2024-04-26T21:21:19.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:19 smithi120 ceph-mon[32741]: fsmap cephfs:1 {0=cephfs.smithi084.hbjunw=up:creating} 2024-04-26T21:21:19.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:19 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.hbjunw"}]: dispatch 2024-04-26T21:21:19.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:19 smithi120 ceph-mon[32741]: daemon mds.cephfs.smithi084.hbjunw is now active in filesystem cephfs as rank 0 2024-04-26T21:21:20.019 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T21:21:20.028 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi084.front.sepia.ceph.com 2024-04-26T21:21:20.029 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-04-26T21:21:20.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:20 smithi084 ceph-mon[25539]: Deploying daemon mds.cephfs.smithi120.qnkxcn on smithi120 2024-04-26T21:21:20.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:20 smithi084 ceph-mon[25539]: mds.? [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] up:active 2024-04-26T21:21:20.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:20 smithi084 ceph-mon[25539]: fsmap cephfs:1 {0=cephfs.smithi084.hbjunw=up:active} 2024-04-26T21:21:20.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:20 smithi120 ceph-mon[32741]: Deploying daemon mds.cephfs.smithi120.qnkxcn on smithi120 2024-04-26T21:21:20.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:20 smithi120 ceph-mon[32741]: mds.? [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] up:active 2024-04-26T21:21:20.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:20 smithi120 ceph-mon[32741]: fsmap cephfs:1 {0=cephfs.smithi084.hbjunw=up:active} 2024-04-26T21:21:20.512 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:21:21.393 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:21 smithi120 ceph-mon[32741]: pgmap v217: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:21.406 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:21 smithi084 ceph-mon[25539]: pgmap v217: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:22.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.651+0000 7f58c2600700 1 -- 172.21.15.84:0/3208031597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58bc0fce60 msgr2=0x7f58bc0fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:22.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.651+0000 7f58c2600700 1 --2- 172.21.15.84:0/3208031597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58bc0fce60 0x7f58bc0fd270 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f58ac004940 tx=0x7f58ac009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:22.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.651+0000 7f58c2600700 1 -- 172.21.15.84:0/3208031597 shutdown_connections 2024-04-26T21:21:22.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.651+0000 7f58c2600700 1 --2- 172.21.15.84:0/3208031597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58bc0fdfd0 0x7f58bc0fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:22.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.651+0000 7f58c2600700 1 --2- 172.21.15.84:0/3208031597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58bc0fce60 0x7f58bc0fd270 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:22.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.651+0000 7f58c2600700 1 -- 172.21.15.84:0/3208031597 >> 172.21.15.84:0/3208031597 conn(0x7f58bc0f8560 msgr2=0x7f58bc0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:22.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.651+0000 7f58c2600700 1 -- 172.21.15.84:0/3208031597 shutdown_connections 2024-04-26T21:21:22.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.651+0000 7f58c2600700 1 -- 172.21.15.84:0/3208031597 wait complete. 2024-04-26T21:21:22.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.652+0000 7f58c2600700 1 Processor -- start 2024-04-26T21:21:22.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.652+0000 7f58c2600700 1 -- start start 2024-04-26T21:21:22.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.652+0000 7f58c2600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58bc0fce60 0x7f58bc10fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:22.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.652+0000 7f58c2600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58bc0fdfd0 0x7f58bc110120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:22.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.652+0000 7f58c2600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc1107b0 con 0x7f58bc0fce60 2024-04-26T21:21:22.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.652+0000 7f58c2600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc110fa0 con 0x7f58bc0fdfd0 2024-04-26T21:21:22.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.653+0000 7f58bb400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58bc0fce60 0x7f58bc10fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:22.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.653+0000 7f58bb400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58bc0fce60 0x7f58bc10fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41532/0 (socket says 172.21.15.84:41532) 2024-04-26T21:21:22.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.653+0000 7f58bb400700 1 -- 172.21.15.84:0/421370706 learned_addr learned my addr 172.21.15.84:0/421370706 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:21:22.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.653+0000 7f58baa00700 1 --2- 172.21.15.84:0/421370706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58bc0fdfd0 0x7f58bc110120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:22.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.653+0000 7f58bb400700 1 -- 172.21.15.84:0/421370706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58bc0fdfd0 msgr2=0x7f58bc110120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:22.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.653+0000 7f58bb400700 1 --2- 172.21.15.84:0/421370706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58bc0fdfd0 0x7f58bc110120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:22.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.653+0000 7f58bb400700 1 -- 172.21.15.84:0/421370706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac005040 con 0x7f58bc0fce60 2024-04-26T21:21:22.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.653+0000 7f58baa00700 1 --2- 172.21.15.84:0/421370706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58bc0fdfd0 0x7f58bc110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:21:22.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.653+0000 7f58bb400700 1 --2- 172.21.15.84:0/421370706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58bc0fce60 0x7f58bc10fbe0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f58ac009150 tx=0x7f58ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:22.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.654+0000 7f58b3400700 1 -- 172.21.15.84:0/421370706 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58ac00e040 con 0x7f58bc0fce60 2024-04-26T21:21:22.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.654+0000 7f58b3400700 1 -- 172.21.15.84:0/421370706 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f58ac00bbf0 con 0x7f58bc0fce60 2024-04-26T21:21:22.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.654+0000 7f58b3400700 1 -- 172.21.15.84:0/421370706 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58ac01c630 con 0x7f58bc0fce60 2024-04-26T21:21:22.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.654+0000 7f58c2600700 1 -- 172.21.15.84:0/421370706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58bc111220 con 0x7f58bc0fce60 2024-04-26T21:21:22.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.654+0000 7f58c2600700 1 -- 172.21.15.84:0/421370706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58bc1117e0 con 0x7f58bc0fce60 2024-04-26T21:21:22.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.655+0000 7f58b0c00700 1 -- 172.21.15.84:0/421370706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58bc05f5c0 con 0x7f58bc0fce60 2024-04-26T21:21:22.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.657+0000 7f58b3400700 1 -- 172.21.15.84:0/421370706 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f58ac00bd60 con 0x7f58bc0fce60 2024-04-26T21:21:22.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.658+0000 7f58b3400700 1 --2- 172.21.15.84:0/421370706 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f58a00692b0 0x7f58a006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:22.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.658+0000 7f58b3400700 1 -- 172.21.15.84:0/421370706 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f58ac0885c0 con 0x7f58bc0fce60 2024-04-26T21:21:22.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.658+0000 7f58baa00700 1 --2- 172.21.15.84:0/421370706 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f58a00692b0 0x7f58a006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:22.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.659+0000 7f58baa00700 1 --2- 172.21.15.84:0/421370706 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f58a00692b0 0x7f58a006b760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f58a8006fd0 tx=0x7f58a8008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:22.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.663+0000 7f58b3400700 1 -- 172.21.15.84:0/421370706 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f58ac058410 con 0x7f58bc0fce60 2024-04-26T21:21:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:22.926+0000 7f58b0c00700 1 -- 172.21.15.84:0/421370706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f58bc04bed0 con 0x7f58bc0fce60 2024-04-26T21:21:23.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:23.165+0000 7f58b3400700 1 -- 172.21.15.84:0/421370706 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v5) v1 ==== 105+0+0 (secure 0 0 0) 0x7f58ac057fa0 con 0x7f58bc0fce60 2024-04-26T21:21:23.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:23.168+0000 7f58b0c00700 1 -- 172.21.15.84:0/421370706 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f58a00692b0 msgr2=0x7f58a006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:23.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:23.168+0000 7f58b0c00700 1 --2- 172.21.15.84:0/421370706 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f58a00692b0 0x7f58a006b760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f58a8006fd0 tx=0x7f58a8008040 comp rx=0 tx=0).stop 2024-04-26T21:21:23.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:23.168+0000 7f58b0c00700 1 -- 172.21.15.84:0/421370706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58bc0fce60 msgr2=0x7f58bc10fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:23.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:23.168+0000 7f58b0c00700 1 --2- 172.21.15.84:0/421370706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58bc0fce60 0x7f58bc10fbe0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f58ac009150 tx=0x7f58ac009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:23.168+0000 7f58b0c00700 1 -- 172.21.15.84:0/421370706 shutdown_connections 2024-04-26T21:21:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:23.168+0000 7f58b0c00700 1 --2- 172.21.15.84:0/421370706 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f58a00692b0 0x7f58a006b760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:23.168+0000 7f58b0c00700 1 --2- 172.21.15.84:0/421370706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58bc0fce60 0x7f58bc10fbe0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:23.168+0000 7f58b0c00700 1 --2- 172.21.15.84:0/421370706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58bc0fdfd0 0x7f58bc110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:23.168+0000 7f58b0c00700 1 -- 172.21.15.84:0/421370706 >> 172.21.15.84:0/421370706 conn(0x7f58bc0f8560 msgr2=0x7f58bc0f9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:23.169+0000 7f58b0c00700 1 -- 172.21.15.84:0/421370706 shutdown_connections 2024-04-26T21:21:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:23.169+0000 7f58b0c00700 1 -- 172.21.15.84:0/421370706 wait complete. 2024-04-26T21:21:23.189 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:23 smithi084 ceph-mon[25539]: pgmap v218: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:23.189 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:23 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:23.189 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:23 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:23.190 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:23 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:23.190 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:23 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.rtrqtr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:21:23.190 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:23 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.rtrqtr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T21:21:23.190 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:23 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:23.190 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:23 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/421370706' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-04-26T21:21:23.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:23 smithi120 ceph-mon[32741]: pgmap v218: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:23.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:23 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:23.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:23 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:23.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:23 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:23.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:23 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.rtrqtr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:21:23.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:23 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.rtrqtr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T21:21:23.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:23 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:23.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:23 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/421370706' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-04-26T21:21:24.047 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T21:21:24.059 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi084.front.sepia.ceph.com 2024-04-26T21:21:24.059 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-04-26T21:21:24.309 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:24 smithi084 ceph-mon[25539]: Deploying daemon mds.cephfs.smithi084.rtrqtr on smithi084 2024-04-26T21:21:24.309 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:24 smithi084 ceph-mon[25539]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T21:21:24.309 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:24 smithi084 ceph-mon[25539]: mds.? [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] up:boot 2024-04-26T21:21:24.310 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:24 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/421370706' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-04-26T21:21:24.310 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:24 smithi084 ceph-mon[25539]: daemon mds.cephfs.smithi120.qnkxcn assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-26T21:21:24.310 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:24 smithi084 ceph-mon[25539]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-04-26T21:21:24.310 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:24 smithi084 ceph-mon[25539]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T21:21:24.310 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:24 smithi084 ceph-mon[25539]: fsmap cephfs:1 {0=cephfs.smithi084.hbjunw=up:active} 1 up:standby 2024-04-26T21:21:24.310 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:24 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.qnkxcn"}]: dispatch 2024-04-26T21:21:24.310 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:24 smithi084 ceph-mon[25539]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:creating} 2024-04-26T21:21:24.310 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:24 smithi084 ceph-mon[25539]: daemon mds.cephfs.smithi120.qnkxcn is now active in filesystem cephfs as rank 1 2024-04-26T21:21:24.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:24 smithi120 ceph-mon[32741]: Deploying daemon mds.cephfs.smithi084.rtrqtr on smithi084 2024-04-26T21:21:24.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:24 smithi120 ceph-mon[32741]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T21:21:24.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:24 smithi120 ceph-mon[32741]: mds.? [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] up:boot 2024-04-26T21:21:24.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:24 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/421370706' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-04-26T21:21:24.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:24 smithi120 ceph-mon[32741]: daemon mds.cephfs.smithi120.qnkxcn assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-26T21:21:24.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:24 smithi120 ceph-mon[32741]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-04-26T21:21:24.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:24 smithi120 ceph-mon[32741]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T21:21:24.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:24 smithi120 ceph-mon[32741]: fsmap cephfs:1 {0=cephfs.smithi084.hbjunw=up:active} 1 up:standby 2024-04-26T21:21:24.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:24 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.qnkxcn"}]: dispatch 2024-04-26T21:21:24.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:24 smithi120 ceph-mon[32741]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:creating} 2024-04-26T21:21:24.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:24 smithi120 ceph-mon[32741]: daemon mds.cephfs.smithi120.qnkxcn is now active in filesystem cephfs as rank 1 2024-04-26T21:21:25.277 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:21:25.437 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:25 smithi084 ceph-mon[25539]: pgmap v219: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-04-26T21:21:25.437 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:25 smithi084 ceph-mon[25539]: mds.? [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] up:active 2024-04-26T21:21:25.437 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:25 smithi084 ceph-mon[25539]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2024-04-26T21:21:25.587 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:25 smithi120 ceph-mon[32741]: pgmap v219: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-04-26T21:21:25.587 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:25 smithi120 ceph-mon[32741]: mds.? [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] up:active 2024-04-26T21:21:25.587 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:25 smithi120 ceph-mon[32741]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2024-04-26T21:21:26.266 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:26 smithi120 ceph-mon[32741]: pgmap v220: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-04-26T21:21:26.474 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:26 smithi084 ceph-mon[25539]: pgmap v220: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-04-26T21:21:27.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.716+0000 7fe488200700 1 -- 172.21.15.84:0/221412544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4801002a0 msgr2=0x7fe480100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:27.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.716+0000 7fe488200700 1 --2- 172.21.15.84:0/221412544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4801002a0 0x7fe480100710 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe46c004940 tx=0x7fe46c009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:27.719 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:27 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:27.719 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:27 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:21:27.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.716+0000 7fe488200700 1 -- 172.21.15.84:0/221412544 shutdown_connections 2024-04-26T21:21:27.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.716+0000 7fe488200700 1 --2- 172.21.15.84:0/221412544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4801002a0 0x7fe480100710 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:27.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.716+0000 7fe488200700 1 --2- 172.21.15.84:0/221412544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4800feff0 0x7fe4800ff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:27.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.716+0000 7fe488200700 1 -- 172.21.15.84:0/221412544 >> 172.21.15.84:0/221412544 conn(0x7fe4800fa8f0 msgr2=0x7fe4800fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:27.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.717+0000 7fe488200700 1 -- 172.21.15.84:0/221412544 shutdown_connections 2024-04-26T21:21:27.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.717+0000 7fe488200700 1 -- 172.21.15.84:0/221412544 wait complete. 2024-04-26T21:21:27.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.717+0000 7fe488200700 1 Processor -- start 2024-04-26T21:21:27.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.718+0000 7fe488200700 1 -- start start 2024-04-26T21:21:27.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.718+0000 7fe488200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4800feff0 0x7fe48010fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:27.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.718+0000 7fe488200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4801002a0 0x7fe480110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:27.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.718+0000 7fe488200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe480110640 con 0x7fe4800feff0 2024-04-26T21:21:27.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.718+0000 7fe488200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4801107b0 con 0x7fe4801002a0 2024-04-26T21:21:27.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.718+0000 7fe485800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4800feff0 0x7fe48010fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:27.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.718+0000 7fe485800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4800feff0 0x7fe48010fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41578/0 (socket says 172.21.15.84:41578) 2024-04-26T21:21:27.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.718+0000 7fe485800700 1 -- 172.21.15.84:0/145187065 learned_addr learned my addr 172.21.15.84:0/145187065 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:21:27.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.719+0000 7fe484e00700 1 --2- 172.21.15.84:0/145187065 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4801002a0 0x7fe480110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:27.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.719+0000 7fe485800700 1 -- 172.21.15.84:0/145187065 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4801002a0 msgr2=0x7fe480110040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:27.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.719+0000 7fe485800700 1 --2- 172.21.15.84:0/145187065 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4801002a0 0x7fe480110040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:27.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.719+0000 7fe485800700 1 -- 172.21.15.84:0/145187065 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c005040 con 0x7fe4800feff0 2024-04-26T21:21:27.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.719+0000 7fe485800700 1 --2- 172.21.15.84:0/145187065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4800feff0 0x7fe48010fb00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe47400c830 tx=0x7fe474004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:27.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.720+0000 7fe47d600700 1 -- 172.21.15.84:0/145187065 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4740106f0 con 0x7fe4800feff0 2024-04-26T21:21:27.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.720+0000 7fe47d600700 1 -- 172.21.15.84:0/145187065 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe474010d20 con 0x7fe4800feff0 2024-04-26T21:21:27.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.720+0000 7fe488200700 1 -- 172.21.15.84:0/145187065 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe480115210 con 0x7fe4800feff0 2024-04-26T21:21:27.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.720+0000 7fe47d600700 1 -- 172.21.15.84:0/145187065 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4740113a0 con 0x7fe4800feff0 2024-04-26T21:21:27.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.720+0000 7fe488200700 1 -- 172.21.15.84:0/145187065 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4801157d0 con 0x7fe4800feff0 2024-04-26T21:21:27.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.721+0000 7fe488200700 1 -- 172.21.15.84:0/145187065 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48004c710 con 0x7fe4800feff0 2024-04-26T21:21:27.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.722+0000 7fe47d600700 1 -- 172.21.15.84:0/145187065 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe474012400 con 0x7fe4800feff0 2024-04-26T21:21:27.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.723+0000 7fe47d600700 1 --2- 172.21.15.84:0/145187065 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe4680692a0 0x7fe46806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:27.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.723+0000 7fe47d600700 1 -- 172.21.15.84:0/145187065 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe474087070 con 0x7fe4800feff0 2024-04-26T21:21:27.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.723+0000 7fe484e00700 1 --2- 172.21.15.84:0/145187065 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe4680692a0 0x7fe46806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:27.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.724+0000 7fe484e00700 1 --2- 172.21.15.84:0/145187065 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe4680692a0 0x7fe46806b750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009fd0 tx=0x7fe46c009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:27.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.728+0000 7fe47d600700 1 -- 172.21.15.84:0/145187065 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe474056ed0 con 0x7fe4800feff0 2024-04-26T21:21:27.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:27 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:27.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:27 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:21:27.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:27.995+0000 7fe488200700 1 -- 172.21.15.84:0/145187065 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe480115aa0 con 0x7fe4800feff0 2024-04-26T21:21:28.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:28.498+0000 7fe47d600700 1 -- 172.21.15.84:0/145187065 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe474056a60 con 0x7fe4800feff0 2024-04-26T21:21:28.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:28.503+0000 7fe488200700 1 -- 172.21.15.84:0/145187065 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe4680692a0 msgr2=0x7fe46806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:28.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:28.503+0000 7fe488200700 1 --2- 172.21.15.84:0/145187065 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe4680692a0 0x7fe46806b750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009fd0 tx=0x7fe46c009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:28.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:28.503+0000 7fe488200700 1 -- 172.21.15.84:0/145187065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4800feff0 msgr2=0x7fe48010fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:28.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:28.503+0000 7fe488200700 1 --2- 172.21.15.84:0/145187065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4800feff0 0x7fe48010fb00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe47400c830 tx=0x7fe474004470 comp rx=0 tx=0).stop 2024-04-26T21:21:28.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:28.504+0000 7fe488200700 1 -- 172.21.15.84:0/145187065 shutdown_connections 2024-04-26T21:21:28.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:28.504+0000 7fe488200700 1 --2- 172.21.15.84:0/145187065 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe4680692a0 0x7fe46806b750 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:28.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:28.504+0000 7fe488200700 1 --2- 172.21.15.84:0/145187065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4800feff0 0x7fe48010fb00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:28.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:28.504+0000 7fe488200700 1 --2- 172.21.15.84:0/145187065 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4801002a0 0x7fe480110040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:28.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:28.504+0000 7fe488200700 1 -- 172.21.15.84:0/145187065 >> 172.21.15.84:0/145187065 conn(0x7fe4800fa8f0 msgr2=0x7fe4800fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:28.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:28.504+0000 7fe488200700 1 -- 172.21.15.84:0/145187065 shutdown_connections 2024-04-26T21:21:28.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:28.504+0000 7fe488200700 1 -- 172.21.15.84:0/145187065 wait complete. 2024-04-26T21:21:29.045 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:28 smithi120 ceph-mon[32741]: pgmap v221: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-26T21:21:29.045 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:28 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:29.045 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:28 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:29.045 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:28 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:29.045 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:28 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.ufqfoh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:21:29.045 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:28 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.ufqfoh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T21:21:29.045 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:28 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:29.045 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:28 smithi120 ceph-mon[32741]: Deploying daemon mds.cephfs.smithi120.ufqfoh on smithi120 2024-04-26T21:21:29.045 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:28 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/145187065' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-04-26T21:21:29.045 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:28 smithi120 ceph-mon[32741]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-04-26T21:21:29.046 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:28 smithi120 ceph-mon[32741]: Cluster is now healthy 2024-04-26T21:21:29.046 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:28 smithi120 ceph-mon[32741]: mds.? [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] up:boot 2024-04-26T21:21:29.046 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:28 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/145187065' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-04-26T21:21:29.046 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:28 smithi120 ceph-mon[32741]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 1 up:standby 2024-04-26T21:21:29.046 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:28 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.rtrqtr"}]: dispatch 2024-04-26T21:21:29.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:28 smithi084 ceph-mon[25539]: pgmap v221: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-26T21:21:29.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:28 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:29.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:28 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:29.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:28 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:29.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:28 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.ufqfoh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:21:29.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:28 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.ufqfoh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T21:21:29.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:28 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:29.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:28 smithi084 ceph-mon[25539]: Deploying daemon mds.cephfs.smithi120.ufqfoh on smithi120 2024-04-26T21:21:29.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:28 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/145187065' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-04-26T21:21:29.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:28 smithi084 ceph-mon[25539]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-04-26T21:21:29.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:28 smithi084 ceph-mon[25539]: Cluster is now healthy 2024-04-26T21:21:29.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:28 smithi084 ceph-mon[25539]: mds.? [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] up:boot 2024-04-26T21:21:29.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:28 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/145187065' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-04-26T21:21:29.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:28 smithi084 ceph-mon[25539]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 1 up:standby 2024-04-26T21:21:29.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:28 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.rtrqtr"}]: dispatch 2024-04-26T21:21:29.396 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T21:21:29.406 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi084.front.sepia.ceph.com 2024-04-26T21:21:29.407 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-04-26T21:21:29.886 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:21:30.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:30 smithi120 ceph-mon[32741]: pgmap v222: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-04-26T21:21:31.023 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:30 smithi084 ceph-mon[25539]: pgmap v222: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-04-26T21:21:31.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.863+0000 7f1319a00700 1 -- 172.21.15.84:0/2562907374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13141046a0 msgr2=0x7f1314104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:31.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.863+0000 7f1319a00700 1 --2- 172.21.15.84:0/2562907374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13141046a0 0x7f1314104b10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1300004940 tx=0x7f1300009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:31.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.863+0000 7f1319a00700 1 -- 172.21.15.84:0/2562907374 shutdown_connections 2024-04-26T21:21:31.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.863+0000 7f1319a00700 1 --2- 172.21.15.84:0/2562907374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13141046a0 0x7f1314104b10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:31.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.863+0000 7f1319a00700 1 --2- 172.21.15.84:0/2562907374 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13141033f0 0x7f1314103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:31.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.863+0000 7f1319a00700 1 -- 172.21.15.84:0/2562907374 >> 172.21.15.84:0/2562907374 conn(0x7f13140725e0 msgr2=0x7f1314074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:31.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.863+0000 7f1319a00700 1 -- 172.21.15.84:0/2562907374 shutdown_connections 2024-04-26T21:21:31.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.863+0000 7f1319a00700 1 -- 172.21.15.84:0/2562907374 wait complete. 2024-04-26T21:21:31.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.864+0000 7f1319a00700 1 Processor -- start 2024-04-26T21:21:31.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.864+0000 7f1319a00700 1 -- start start 2024-04-26T21:21:31.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.865+0000 7f1319a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13141033f0 0x7f1314113ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:31.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.865+0000 7f1319a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13141046a0 0x7f1314114430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:31.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.865+0000 7f1319a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1314114a30 con 0x7f13141033f0 2024-04-26T21:21:31.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.865+0000 7f1319a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1314114ba0 con 0x7f13141046a0 2024-04-26T21:21:31.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.865+0000 7f1312a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13141033f0 0x7f1314113ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:31.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.865+0000 7f1312a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13141033f0 0x7f1314113ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35406/0 (socket says 172.21.15.84:35406) 2024-04-26T21:21:31.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.865+0000 7f1312a00700 1 -- 172.21.15.84:0/1761968586 learned_addr learned my addr 172.21.15.84:0/1761968586 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:21:31.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.865+0000 7f1312000700 1 --2- 172.21.15.84:0/1761968586 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13141046a0 0x7f1314114430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:31.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.865+0000 7f1312a00700 1 -- 172.21.15.84:0/1761968586 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13141046a0 msgr2=0x7f1314114430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:31.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.865+0000 7f1312a00700 1 --2- 172.21.15.84:0/1761968586 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13141046a0 0x7f1314114430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:31.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.865+0000 7f1312a00700 1 -- 172.21.15.84:0/1761968586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1300005040 con 0x7f13141033f0 2024-04-26T21:21:31.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.865+0000 7f1312000700 1 --2- 172.21.15.84:0/1761968586 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13141046a0 0x7f1314114430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:21:31.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.866+0000 7f1312a00700 1 --2- 172.21.15.84:0/1761968586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13141033f0 0x7f1314113ef0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f130400c830 tx=0x7f1304004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:31.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.866+0000 7f130aa00700 1 -- 172.21.15.84:0/1761968586 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f130400a760 con 0x7f13141033f0 2024-04-26T21:21:31.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.866+0000 7f130aa00700 1 -- 172.21.15.84:0/1761968586 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f130400ad90 con 0x7f13141033f0 2024-04-26T21:21:31.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.866+0000 7f1319a00700 1 -- 172.21.15.84:0/1761968586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1314119600 con 0x7f13141033f0 2024-04-26T21:21:31.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.866+0000 7f130aa00700 1 -- 172.21.15.84:0/1761968586 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13040113a0 con 0x7f13141033f0 2024-04-26T21:21:31.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.866+0000 7f1319a00700 1 -- 172.21.15.84:0/1761968586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1314119bc0 con 0x7f13141033f0 2024-04-26T21:21:31.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.867+0000 7f1319a00700 1 -- 172.21.15.84:0/1761968586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f131404c710 con 0x7f13141033f0 2024-04-26T21:21:31.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.868+0000 7f130aa00700 1 -- 172.21.15.84:0/1761968586 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f1304012400 con 0x7f13141033f0 2024-04-26T21:21:31.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.869+0000 7f130aa00700 1 --2- 172.21.15.84:0/1761968586 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f12f80692a0 0x7f12f806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:31.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.869+0000 7f130aa00700 1 -- 172.21.15.84:0/1761968586 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f13040872c0 con 0x7f13141033f0 2024-04-26T21:21:31.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.869+0000 7f1312000700 1 --2- 172.21.15.84:0/1761968586 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f12f80692a0 0x7f12f806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:31.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.870+0000 7f1312000700 1 --2- 172.21.15.84:0/1761968586 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f12f80692a0 0x7f12f806b750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f130000b3b0 tx=0x7f1300009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:31.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:31.874+0000 7f130aa00700 1 -- 172.21.15.84:0/1761968586 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1304056fe0 con 0x7f13141033f0 2024-04-26T21:21:32.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:32.135+0000 7f1319a00700 1 -- 172.21.15.84:0/1761968586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f131410bee0 con 0x7f13141033f0 2024-04-26T21:21:32.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:32.891+0000 7f130aa00700 1 -- 172.21.15.84:0/1761968586 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v10) v1 ==== 168+0+0 (secure 0 0 0) 0x7f1304056b70 con 0x7f13141033f0 2024-04-26T21:21:32.894 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:32 smithi084 ceph-mon[25539]: pgmap v223: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-04-26T21:21:32.894 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:32 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:32.894 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:32 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:32.895 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:32 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:32.895 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:32 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:32.895 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:32 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:32.895 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:32 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:32.895 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:32 smithi084 ceph-mon[25539]: mds.? [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] up:boot 2024-04-26T21:21:32.895 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:32 smithi084 ceph-mon[25539]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:21:32.895 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:32 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.ufqfoh"}]: dispatch 2024-04-26T21:21:32.895 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:32 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:21:32.895 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:32 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1761968586' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T21:21:32.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:32.895+0000 7f1319a00700 1 -- 172.21.15.84:0/1761968586 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f12f80692a0 msgr2=0x7f12f806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:32.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:32.895+0000 7f1319a00700 1 --2- 172.21.15.84:0/1761968586 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f12f80692a0 0x7f12f806b750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f130000b3b0 tx=0x7f1300009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:32.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:32.895+0000 7f1319a00700 1 -- 172.21.15.84:0/1761968586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13141033f0 msgr2=0x7f1314113ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:32.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:32.895+0000 7f1319a00700 1 --2- 172.21.15.84:0/1761968586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13141033f0 0x7f1314113ef0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f130400c830 tx=0x7f1304004470 comp rx=0 tx=0).stop 2024-04-26T21:21:32.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:32.896+0000 7f1319a00700 1 -- 172.21.15.84:0/1761968586 shutdown_connections 2024-04-26T21:21:32.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:32.896+0000 7f1319a00700 1 --2- 172.21.15.84:0/1761968586 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f12f80692a0 0x7f12f806b750 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:32.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:32.896+0000 7f1319a00700 1 --2- 172.21.15.84:0/1761968586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13141033f0 0x7f1314113ef0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:32.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:32.896+0000 7f1319a00700 1 --2- 172.21.15.84:0/1761968586 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13141046a0 0x7f1314114430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:32.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:32.896+0000 7f1319a00700 1 -- 172.21.15.84:0/1761968586 >> 172.21.15.84:0/1761968586 conn(0x7f13140725e0 msgr2=0x7f1314073c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:32.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:32.896+0000 7f1319a00700 1 -- 172.21.15.84:0/1761968586 shutdown_connections 2024-04-26T21:21:32.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:32.896+0000 7f1319a00700 1 -- 172.21.15.84:0/1761968586 wait complete. 2024-04-26T21:21:32.899 INFO:teuthology.orchestra.run.smithi084.stderr:inline data enabled 2024-04-26T21:21:32.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:32 smithi120 ceph-mon[32741]: pgmap v223: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-04-26T21:21:32.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:32 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:32.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:32 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:32.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:32 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:32.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:32 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:32.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:32 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:32.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:32 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:32.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:32 smithi120 ceph-mon[32741]: mds.? [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] up:boot 2024-04-26T21:21:32.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:32 smithi120 ceph-mon[32741]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:21:32.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:32 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.ufqfoh"}]: dispatch 2024-04-26T21:21:32.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:32 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:21:32.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:32 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/1761968586' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T21:21:33.894 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:33 smithi120 ceph-mon[32741]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-04-26T21:21:33.894 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:33 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/1761968586' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-04-26T21:21:33.894 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:33 smithi120 ceph-mon[32741]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:21:33.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:33 smithi084 ceph-mon[25539]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-04-26T21:21:33.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:33 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1761968586' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-04-26T21:21:33.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:33 smithi084 ceph-mon[25539]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:21:34.069 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T21:21:34.079 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi084.front.sepia.ceph.com 2024-04-26T21:21:34.079 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-26T21:21:35.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:34 smithi084 ceph-mon[25539]: pgmap v224: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-04-26T21:21:35.180 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:21:35.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:34 smithi120 ceph-mon[32741]: pgmap v224: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-04-26T21:21:36.463 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:36 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:36.463 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:36 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:36.464 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:36 smithi084 ceph-mon[25539]: mds.? [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] up:active 2024-04-26T21:21:36.464 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:36 smithi084 ceph-mon[25539]: mds.? [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] up:active 2024-04-26T21:21:36.464 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:36 smithi084 ceph-mon[25539]: mds.? [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] up:standby 2024-04-26T21:21:36.464 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:36 smithi084 ceph-mon[25539]: mds.? [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] up:standby 2024-04-26T21:21:36.464 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:36 smithi084 ceph-mon[25539]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:21:36.607 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:36 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:36.607 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:36 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:36.607 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:36 smithi120 ceph-mon[32741]: mds.? [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] up:active 2024-04-26T21:21:36.607 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:36 smithi120 ceph-mon[32741]: mds.? [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] up:active 2024-04-26T21:21:36.607 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:36 smithi120 ceph-mon[32741]: mds.? [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] up:standby 2024-04-26T21:21:36.607 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:36 smithi120 ceph-mon[32741]: mds.? [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] up:standby 2024-04-26T21:21:36.607 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:36 smithi120 ceph-mon[32741]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:21:37.408 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:37 smithi084 ceph-mon[25539]: pgmap v225: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 3 op/s 2024-04-26T21:21:37.408 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:37 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:37.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:37 smithi120 ceph-mon[32741]: pgmap v225: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 3 op/s 2024-04-26T21:21:37.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:37 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:38.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.243+0000 7f22a3800700 1 -- 172.21.15.84:0/473539658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f229c1077c0 msgr2=0x7f229c107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:38.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.243+0000 7f22a3800700 1 --2- 172.21.15.84:0/473539658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f229c1077c0 0x7f229c107bd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2290004940 tx=0x7f2290009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:38.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.243+0000 7f22a3800700 1 -- 172.21.15.84:0/473539658 shutdown_connections 2024-04-26T21:21:38.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.243+0000 7f22a3800700 1 --2- 172.21.15.84:0/473539658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f229c108a70 0x7f229c108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:38.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.243+0000 7f22a3800700 1 --2- 172.21.15.84:0/473539658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f229c1077c0 0x7f229c107bd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:38.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.243+0000 7f22a3800700 1 -- 172.21.15.84:0/473539658 >> 172.21.15.84:0/473539658 conn(0x7f229c0675d0 msgr2=0x7f229c0679d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:38.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.243+0000 7f22a3800700 1 -- 172.21.15.84:0/473539658 shutdown_connections 2024-04-26T21:21:38.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.243+0000 7f22a3800700 1 -- 172.21.15.84:0/473539658 wait complete. 2024-04-26T21:21:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.245+0000 7f22a3800700 1 Processor -- start 2024-04-26T21:21:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.245+0000 7f22a3800700 1 -- start start 2024-04-26T21:21:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.245+0000 7f22a3800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f229c1077c0 0x7f229c118370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.245+0000 7f22a3800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f229c108a70 0x7f229c1188b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.245+0000 7f22a3800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c118eb0 con 0x7f229c108a70 2024-04-26T21:21:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.245+0000 7f22a3800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c119020 con 0x7f229c1077c0 2024-04-26T21:21:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.245+0000 7f229be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f229c108a70 0x7f229c1188b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.245+0000 7f229be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f229c108a70 0x7f229c1188b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35410/0 (socket says 172.21.15.84:35410) 2024-04-26T21:21:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.245+0000 7f229be00700 1 -- 172.21.15.84:0/1260209723 learned_addr learned my addr 172.21.15.84:0/1260209723 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:21:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.246+0000 7f22a0e00700 1 --2- 172.21.15.84:0/1260209723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f229c1077c0 0x7f229c118370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.246+0000 7f229be00700 1 -- 172.21.15.84:0/1260209723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f229c1077c0 msgr2=0x7f229c118370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.246+0000 7f229be00700 1 --2- 172.21.15.84:0/1260209723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f229c1077c0 0x7f229c118370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.246+0000 7f229be00700 1 -- 172.21.15.84:0/1260209723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2290005040 con 0x7f229c108a70 2024-04-26T21:21:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.246+0000 7f229be00700 1 --2- 172.21.15.84:0/1260209723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f229c108a70 0x7f229c1188b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f228800c830 tx=0x7f2288004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.247+0000 7f2298c00700 1 -- 172.21.15.84:0/1260209723 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f228800a760 con 0x7f229c108a70 2024-04-26T21:21:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.247+0000 7f22a3800700 1 -- 172.21.15.84:0/1260209723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f229c11da30 con 0x7f229c108a70 2024-04-26T21:21:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.247+0000 7f2298c00700 1 -- 172.21.15.84:0/1260209723 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f228800ad90 con 0x7f229c108a70 2024-04-26T21:21:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.247+0000 7f2298c00700 1 -- 172.21.15.84:0/1260209723 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22880113a0 con 0x7f229c108a70 2024-04-26T21:21:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.247+0000 7f22a3800700 1 -- 172.21.15.84:0/1260209723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f229c11dff0 con 0x7f229c108a70 2024-04-26T21:21:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.248+0000 7f22a3800700 1 -- 172.21.15.84:0/1260209723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f229c04c710 con 0x7f229c108a70 2024-04-26T21:21:38.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.249+0000 7f2298c00700 1 -- 172.21.15.84:0/1260209723 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f2288012400 con 0x7f229c108a70 2024-04-26T21:21:38.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.250+0000 7f2298c00700 1 --2- 172.21.15.84:0/1260209723 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f22840692a0 0x7f228406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:38.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.250+0000 7f2298c00700 1 -- 172.21.15.84:0/1260209723 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2288087150 con 0x7f229c108a70 2024-04-26T21:21:38.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.251+0000 7f22a0e00700 1 --2- 172.21.15.84:0/1260209723 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f22840692a0 0x7f228406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:38.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.252+0000 7f22a0e00700 1 --2- 172.21.15.84:0/1260209723 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f22840692a0 0x7f228406b750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2290004f90 tx=0x7f2290009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:38.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.255+0000 7f2298c00700 1 -- 172.21.15.84:0/1260209723 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2288056fb0 con 0x7f229c108a70 2024-04-26T21:21:38.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:38 smithi084 ceph-mon[25539]: pgmap v226: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 3 op/s 2024-04-26T21:21:38.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.546+0000 7f22a3800700 1 -- 172.21.15.84:0/1260209723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f229c11dbc0 con 0x7f229c108a70 2024-04-26T21:21:38.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.547+0000 7f2298c00700 1 -- 172.21.15.84:0/1260209723 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1818 (secure 0 0 0) 0x7f229c11dbc0 con 0x7f229c108a70 2024-04-26T21:21:38.549 INFO:teuthology.orchestra.run.smithi084.stdout:e11 2024-04-26T21:21:38.549 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:21:38.549 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:21:38.549 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:21:38.549 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:21:38.549 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:21:38.549 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:21:38.549 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 11 2024-04-26T21:21:38.549 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:21:38.549 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:21:38.549 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:21:35.894623+0000 2024-04-26T21:21:38.549 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:21:38.550 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:21:38.550 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:21:38.550 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:21:38.550 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:21:38.550 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:21:38.550 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:21:38.550 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:21:38.550 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:21:38.550 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:21:38.550 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:21:38.550 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456,1=24231} 2024-04-26T21:21:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:21:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:21:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:21:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:21:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:21:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:21:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:21:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:21:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:21:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:21:38.551 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:21:38.551 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:21:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:21:38.551 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:21:38.552 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:21:38.552 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:21:38.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.551+0000 7f22a3800700 1 -- 172.21.15.84:0/1260209723 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f22840692a0 msgr2=0x7f228406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:38.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.551+0000 7f22a3800700 1 --2- 172.21.15.84:0/1260209723 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f22840692a0 0x7f228406b750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2290004f90 tx=0x7f2290009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:38.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.551+0000 7f22a3800700 1 -- 172.21.15.84:0/1260209723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f229c108a70 msgr2=0x7f229c1188b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:38.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.551+0000 7f22a3800700 1 --2- 172.21.15.84:0/1260209723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f229c108a70 0x7f229c1188b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f228800c830 tx=0x7f2288004470 comp rx=0 tx=0).stop 2024-04-26T21:21:38.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.551+0000 7f22a3800700 1 -- 172.21.15.84:0/1260209723 shutdown_connections 2024-04-26T21:21:38.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.551+0000 7f22a3800700 1 --2- 172.21.15.84:0/1260209723 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f22840692a0 0x7f228406b750 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:38.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.551+0000 7f22a3800700 1 --2- 172.21.15.84:0/1260209723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f229c1077c0 0x7f229c118370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:38.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.551+0000 7f22a3800700 1 --2- 172.21.15.84:0/1260209723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f229c108a70 0x7f229c1188b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:38.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.551+0000 7f22a3800700 1 -- 172.21.15.84:0/1260209723 >> 172.21.15.84:0/1260209723 conn(0x7f229c0675d0 msgr2=0x7f229c105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:38.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.551+0000 7f22a3800700 1 -- 172.21.15.84:0/1260209723 shutdown_connections 2024-04-26T21:21:38.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:38.552+0000 7f22a3800700 1 -- 172.21.15.84:0/1260209723 wait complete. 2024-04-26T21:21:38.554 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 11 2024-04-26T21:21:38.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:38 smithi120 ceph-mon[32741]: pgmap v226: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 3 op/s 2024-04-26T21:21:39.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:39 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1260209723' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:21:39.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:39 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/1260209723' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:21:39.867 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-04-26T21:21:40.332 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:21:40.476 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:40 smithi084 ceph-mon[25539]: pgmap v227: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 3 op/s 2024-04-26T21:21:40.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:40 smithi120 ceph-mon[32741]: pgmap v227: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 3 op/s 2024-04-26T21:21:41.486 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:41.487 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:41.487 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:41.487 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:21:41.487 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:41.487 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:21:41.644 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:41.644 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:41.644 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:41.644 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:21:41.644 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:41.645 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:21:42.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.253+0000 7fc63a000700 1 -- 172.21.15.84:0/877569863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6340feff0 msgr2=0x7fc6340ff400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:42.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.253+0000 7fc63a000700 1 --2- 172.21.15.84:0/877569863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6340feff0 0x7fc6340ff400 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc624004940 tx=0x7fc624009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:42.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.253+0000 7fc63a000700 1 -- 172.21.15.84:0/877569863 shutdown_connections 2024-04-26T21:21:42.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.253+0000 7fc63a000700 1 --2- 172.21.15.84:0/877569863 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6341002a0 0x7fc634100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:42.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.253+0000 7fc63a000700 1 --2- 172.21.15.84:0/877569863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6340feff0 0x7fc6340ff400 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:42.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.253+0000 7fc63a000700 1 -- 172.21.15.84:0/877569863 >> 172.21.15.84:0/877569863 conn(0x7fc6340fa8f0 msgr2=0x7fc6340fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:42.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.253+0000 7fc63a000700 1 -- 172.21.15.84:0/877569863 shutdown_connections 2024-04-26T21:21:42.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.253+0000 7fc63a000700 1 -- 172.21.15.84:0/877569863 wait complete. 2024-04-26T21:21:42.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.254+0000 7fc63a000700 1 Processor -- start 2024-04-26T21:21:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.254+0000 7fc63a000700 1 -- start start 2024-04-26T21:21:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.254+0000 7fc63a000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6340feff0 0x7fc63410faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.254+0000 7fc63a000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6341002a0 0x7fc63410ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.254+0000 7fc63a000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6341105e0 con 0x7fc6340feff0 2024-04-26T21:21:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.254+0000 7fc63a000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc634110750 con 0x7fc6341002a0 2024-04-26T21:21:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.255+0000 7fc633400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6340feff0 0x7fc63410faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.255+0000 7fc633400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6340feff0 0x7fc63410faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34856/0 (socket says 172.21.15.84:34856) 2024-04-26T21:21:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.255+0000 7fc633400700 1 -- 172.21.15.84:0/3895428410 learned_addr learned my addr 172.21.15.84:0/3895428410 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:21:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.255+0000 7fc632a00700 1 --2- 172.21.15.84:0/3895428410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6341002a0 0x7fc63410ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.255+0000 7fc633400700 1 -- 172.21.15.84:0/3895428410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6341002a0 msgr2=0x7fc63410ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.255+0000 7fc633400700 1 --2- 172.21.15.84:0/3895428410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6341002a0 0x7fc63410ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.255+0000 7fc633400700 1 -- 172.21.15.84:0/3895428410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc624005040 con 0x7fc6340feff0 2024-04-26T21:21:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.255+0000 7fc633400700 1 --2- 172.21.15.84:0/3895428410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6340feff0 0x7fc63410faa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc624013870 tx=0x7fc624009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:42.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.256+0000 7fc62b400700 1 -- 172.21.15.84:0/3895428410 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc624021070 con 0x7fc6340feff0 2024-04-26T21:21:42.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.256+0000 7fc62b400700 1 -- 172.21.15.84:0/3895428410 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc624009430 con 0x7fc6340feff0 2024-04-26T21:21:42.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.256+0000 7fc62b400700 1 -- 172.21.15.84:0/3895428410 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc62400e070 con 0x7fc6340feff0 2024-04-26T21:21:42.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.256+0000 7fc63a000700 1 -- 172.21.15.84:0/3895428410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc634115150 con 0x7fc6340feff0 2024-04-26T21:21:42.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.256+0000 7fc63a000700 1 -- 172.21.15.84:0/3895428410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc634115690 con 0x7fc6340feff0 2024-04-26T21:21:42.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.257+0000 7fc63a000700 1 -- 172.21.15.84:0/3895428410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63404c710 con 0x7fc6340feff0 2024-04-26T21:21:42.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.258+0000 7fc62b400700 1 -- 172.21.15.84:0/3895428410 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fc62401c750 con 0x7fc6340feff0 2024-04-26T21:21:42.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.259+0000 7fc62b400700 1 --2- 172.21.15.84:0/3895428410 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc618069240 0x7fc61806b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:42.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.259+0000 7fc62b400700 1 -- 172.21.15.84:0/3895428410 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fc624088460 con 0x7fc6340feff0 2024-04-26T21:21:42.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.259+0000 7fc632a00700 1 --2- 172.21.15.84:0/3895428410 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc618069240 0x7fc61806b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:42.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.260+0000 7fc632a00700 1 --2- 172.21.15.84:0/3895428410 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc618069240 0x7fc61806b6f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc620009b80 tx=0x7fc62000b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:42.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.264+0000 7fc62b400700 1 -- 172.21.15.84:0/3895428410 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc624058220 con 0x7fc6340feff0 2024-04-26T21:21:42.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.531+0000 7fc63a000700 1 -- 172.21.15.84:0/3895428410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc634107ae0 con 0x7fc6340feff0 2024-04-26T21:21:42.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.531+0000 7fc62b400700 1 -- 172.21.15.84:0/3895428410 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+4707 (secure 0 0 0) 0x7fc624057db0 con 0x7fc6340feff0 2024-04-26T21:21:42.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.534+0000 7fc63a000700 1 -- 172.21.15.84:0/3895428410 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc618069240 msgr2=0x7fc61806b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:42.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.534+0000 7fc63a000700 1 --2- 172.21.15.84:0/3895428410 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc618069240 0x7fc61806b6f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc620009b80 tx=0x7fc62000b040 comp rx=0 tx=0).stop 2024-04-26T21:21:42.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.534+0000 7fc63a000700 1 -- 172.21.15.84:0/3895428410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6340feff0 msgr2=0x7fc63410faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:42.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.534+0000 7fc63a000700 1 --2- 172.21.15.84:0/3895428410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6340feff0 0x7fc63410faa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc624013870 tx=0x7fc624009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:42.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.534+0000 7fc63a000700 1 -- 172.21.15.84:0/3895428410 shutdown_connections 2024-04-26T21:21:42.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.534+0000 7fc63a000700 1 --2- 172.21.15.84:0/3895428410 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc618069240 0x7fc61806b6f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:42.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.534+0000 7fc63a000700 1 --2- 172.21.15.84:0/3895428410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6340feff0 0x7fc63410faa0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:42.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.534+0000 7fc63a000700 1 --2- 172.21.15.84:0/3895428410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6341002a0 0x7fc63410ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:42.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.534+0000 7fc63a000700 1 -- 172.21.15.84:0/3895428410 >> 172.21.15.84:0/3895428410 conn(0x7fc6340fa8f0 msgr2=0x7fc6340fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:42.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.534+0000 7fc63a000700 1 -- 172.21.15.84:0/3895428410 shutdown_connections 2024-04-26T21:21:42.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:42.534+0000 7fc63a000700 1 -- 172.21.15.84:0/3895428410 wait complete. 2024-04-26T21:21:42.537 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 11 2024-04-26T21:21:42.551 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:21:42.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:42 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:42.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:42 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:21:42.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:42 smithi084 ceph-mon[25539]: pgmap v228: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:42.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:42 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:42.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:42 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:21:42.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:42 smithi120 ceph-mon[32741]: pgmap v228: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:43.491 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-04-26T21:21:43.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:43 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3895428410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T21:21:43.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:43 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/3895428410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T21:21:43.953 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:21:45.070 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:44 smithi084 ceph-mon[25539]: pgmap v229: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:45.070 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:44 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:45.070 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:44 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:45.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:44 smithi120 ceph-mon[32741]: pgmap v229: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:45.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:44 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:45.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:44 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:46.884 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:46 smithi084 ceph-mon[25539]: pgmap v230: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:47.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:46 smithi120 ceph-mon[32741]: pgmap v230: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:47.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.373+0000 7fc963600700 1 -- 172.21.15.84:0/2355102606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc95c1002a0 msgr2=0x7fc95c100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:47.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.373+0000 7fc963600700 1 --2- 172.21.15.84:0/2355102606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc95c1002a0 0x7fc95c100710 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc948004940 tx=0x7fc948009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:47.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.374+0000 7fc963600700 1 -- 172.21.15.84:0/2355102606 shutdown_connections 2024-04-26T21:21:47.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.374+0000 7fc963600700 1 --2- 172.21.15.84:0/2355102606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc95c1002a0 0x7fc95c100710 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:47.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.374+0000 7fc963600700 1 --2- 172.21.15.84:0/2355102606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc95c0feff0 0x7fc95c0ff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:47.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.374+0000 7fc963600700 1 -- 172.21.15.84:0/2355102606 >> 172.21.15.84:0/2355102606 conn(0x7fc95c0fa8f0 msgr2=0x7fc95c0fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:47.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.374+0000 7fc963600700 1 -- 172.21.15.84:0/2355102606 shutdown_connections 2024-04-26T21:21:47.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.374+0000 7fc963600700 1 -- 172.21.15.84:0/2355102606 wait complete. 2024-04-26T21:21:47.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.374+0000 7fc963600700 1 Processor -- start 2024-04-26T21:21:47.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.375+0000 7fc963600700 1 -- start start 2024-04-26T21:21:47.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.375+0000 7fc963600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc95c0feff0 0x7fc95c10fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:47.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.375+0000 7fc963600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc95c1002a0 0x7fc95c110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:47.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.375+0000 7fc963600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c110640 con 0x7fc95c1002a0 2024-04-26T21:21:47.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.375+0000 7fc963600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c1107b0 con 0x7fc95c0feff0 2024-04-26T21:21:47.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.375+0000 7fc95be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc95c1002a0 0x7fc95c110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:47.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.375+0000 7fc95be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc95c1002a0 0x7fc95c110040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34870/0 (socket says 172.21.15.84:34870) 2024-04-26T21:21:47.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.375+0000 7fc95be00700 1 -- 172.21.15.84:0/305321558 learned_addr learned my addr 172.21.15.84:0/305321558 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:21:47.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.376+0000 7fc960c00700 1 --2- 172.21.15.84:0/305321558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc95c0feff0 0x7fc95c10fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:47.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.376+0000 7fc95be00700 1 -- 172.21.15.84:0/305321558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc95c0feff0 msgr2=0x7fc95c10fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:47.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.376+0000 7fc95be00700 1 --2- 172.21.15.84:0/305321558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc95c0feff0 0x7fc95c10fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:47.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.376+0000 7fc95be00700 1 -- 172.21.15.84:0/305321558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc948005040 con 0x7fc95c1002a0 2024-04-26T21:21:47.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.376+0000 7fc95be00700 1 --2- 172.21.15.84:0/305321558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc95c1002a0 0x7fc95c110040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc948009150 tx=0x7fc948009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:47.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.376+0000 7fc958c00700 1 -- 172.21.15.84:0/305321558 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc94800e040 con 0x7fc95c1002a0 2024-04-26T21:21:47.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.376+0000 7fc958c00700 1 -- 172.21.15.84:0/305321558 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc94800bcc0 con 0x7fc95c1002a0 2024-04-26T21:21:47.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.376+0000 7fc958c00700 1 -- 172.21.15.84:0/305321558 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc94801c630 con 0x7fc95c1002a0 2024-04-26T21:21:47.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.377+0000 7fc963600700 1 -- 172.21.15.84:0/305321558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc95c1151b0 con 0x7fc95c1002a0 2024-04-26T21:21:47.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.377+0000 7fc963600700 1 -- 172.21.15.84:0/305321558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc95c115720 con 0x7fc95c1002a0 2024-04-26T21:21:47.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.378+0000 7fc963600700 1 -- 172.21.15.84:0/305321558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95c04c710 con 0x7fc95c1002a0 2024-04-26T21:21:47.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.379+0000 7fc958c00700 1 -- 172.21.15.84:0/305321558 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fc948013420 con 0x7fc95c1002a0 2024-04-26T21:21:47.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.380+0000 7fc958c00700 1 --2- 172.21.15.84:0/305321558 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc9440692a0 0x7fc94406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:47.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.380+0000 7fc958c00700 1 -- 172.21.15.84:0/305321558 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fc948087f40 con 0x7fc95c1002a0 2024-04-26T21:21:47.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.380+0000 7fc960c00700 1 --2- 172.21.15.84:0/305321558 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc9440692a0 0x7fc94406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:47.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.381+0000 7fc960c00700 1 --2- 172.21.15.84:0/305321558 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc9440692a0 0x7fc94406b750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc950007fd0 tx=0x7fc950009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:47.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.385+0000 7fc958c00700 1 -- 172.21.15.84:0/305321558 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc948057ce0 con 0x7fc95c1002a0 2024-04-26T21:21:47.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.714+0000 7fc963600700 1 -- 172.21.15.84:0/305321558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fc95c115b90 con 0x7fc95c1002a0 2024-04-26T21:21:47.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.715+0000 7fc958c00700 1 -- 172.21.15.84:0/305321558 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v11) v1 ==== 78+0+99 (secure 0 0 0) 0x7fc948057870 con 0x7fc95c1002a0 2024-04-26T21:21:47.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.718+0000 7fc963600700 1 -- 172.21.15.84:0/305321558 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc9440692a0 msgr2=0x7fc94406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:47.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.718+0000 7fc963600700 1 --2- 172.21.15.84:0/305321558 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc9440692a0 0x7fc94406b750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc950007fd0 tx=0x7fc950009040 comp rx=0 tx=0).stop 2024-04-26T21:21:47.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.718+0000 7fc963600700 1 -- 172.21.15.84:0/305321558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc95c1002a0 msgr2=0x7fc95c110040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:47.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.718+0000 7fc963600700 1 --2- 172.21.15.84:0/305321558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc95c1002a0 0x7fc95c110040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc948009150 tx=0x7fc948009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:47.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.718+0000 7fc963600700 1 -- 172.21.15.84:0/305321558 shutdown_connections 2024-04-26T21:21:47.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.718+0000 7fc963600700 1 --2- 172.21.15.84:0/305321558 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc9440692a0 0x7fc94406b750 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:47.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.718+0000 7fc963600700 1 --2- 172.21.15.84:0/305321558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc95c0feff0 0x7fc95c10fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:47.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.718+0000 7fc963600700 1 --2- 172.21.15.84:0/305321558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc95c1002a0 0x7fc95c110040 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:47.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.718+0000 7fc963600700 1 -- 172.21.15.84:0/305321558 >> 172.21.15.84:0/305321558 conn(0x7fc95c0fa8f0 msgr2=0x7fc95c0fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:47.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.718+0000 7fc963600700 1 -- 172.21.15.84:0/305321558 shutdown_connections 2024-04-26T21:21:47.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:47.719+0000 7fc963600700 1 -- 172.21.15.84:0/305321558 wait complete. 2024-04-26T21:21:47.737 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:21:48.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:47 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/305321558' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-26T21:21:48.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:47 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/305321558' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-26T21:21:49.101 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:48 smithi084 ceph-mon[25539]: pgmap v231: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:49.104 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-04-26T21:21:49.115 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:21:49.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:48 smithi120 ceph-mon[32741]: pgmap v231: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:49.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.327+0000 7f7b1ea00640 1 -- 172.21.15.84:0/1366627415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b180fbfe0 msgr2=0x7f7b180fc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:49.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.327+0000 7f7b1ea00640 1 --2- 172.21.15.84:0/1366627415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b180fbfe0 0x7f7b180fc3f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0048d0 tx=0x7f7b0c009da0 comp rx=0 tx=0).stop 2024-04-26T21:21:49.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.327+0000 7f7b1ea00640 1 -- 172.21.15.84:0/1366627415 shutdown_connections 2024-04-26T21:21:49.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.327+0000 7f7b1ea00640 1 --2- 172.21.15.84:0/1366627415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b180fd2b0 0x7f7b180fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:49.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.327+0000 7f7b1ea00640 1 --2- 172.21.15.84:0/1366627415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b180fbfe0 0x7f7b180fc3f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:49.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.327+0000 7f7b1ea00640 1 -- 172.21.15.84:0/1366627415 >> 172.21.15.84:0/1366627415 conn(0x7f7b180f7780 msgr2=0x7f7b180f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:49.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.327+0000 7f7b1ea00640 1 -- 172.21.15.84:0/1366627415 shutdown_connections 2024-04-26T21:21:49.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.327+0000 7f7b1ea00640 1 -- 172.21.15.84:0/1366627415 wait complete. 2024-04-26T21:21:49.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.328+0000 7f7b1ea00640 1 Processor -- start 2024-04-26T21:21:49.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.328+0000 7f7b1ea00640 1 -- start start 2024-04-26T21:21:49.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.329+0000 7f7b1ea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b180fbfe0 0x7f7b1810ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:49.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.329+0000 7f7b1ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b180fd2b0 0x7f7b1810f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:49.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.329+0000 7f7b1ea00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1810f8d0 con 0x7f7b180fd2b0 2024-04-26T21:21:49.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.329+0000 7f7b1ea00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b18114290 con 0x7f7b180fbfe0 2024-04-26T21:21:49.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.329+0000 7f7b1d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b180fbfe0 0x7f7b1810ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:49.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.329+0000 7f7b1d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b180fbfe0 0x7f7b1810ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:53788/0 (socket says 172.21.15.84:53788) 2024-04-26T21:21:49.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.329+0000 7f7b1d600640 1 -- 172.21.15.84:0/568397461 learned_addr learned my addr 172.21.15.84:0/568397461 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:21:49.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.329+0000 7f7b1cc00640 1 --2- 172.21.15.84:0/568397461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b180fd2b0 0x7f7b1810f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:49.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.330+0000 7f7b1cc00640 1 -- 172.21.15.84:0/568397461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b180fbfe0 msgr2=0x7f7b1810ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:49.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.330+0000 7f7b1cc00640 1 --2- 172.21.15.84:0/568397461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b180fbfe0 0x7f7b1810ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:49.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.330+0000 7f7b1cc00640 1 -- 172.21.15.84:0/568397461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0c005040 con 0x7f7b180fd2b0 2024-04-26T21:21:49.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.330+0000 7f7b1cc00640 1 --2- 172.21.15.84:0/568397461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b180fd2b0 0x7f7b1810f280 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7b040027d0 tx=0x7f7b04009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:49.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.330+0000 7f7b15600640 1 -- 172.21.15.84:0/568397461 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b04002dc0 con 0x7f7b180fd2b0 2024-04-26T21:21:49.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.330+0000 7f7b15600640 1 -- 172.21.15.84:0/568397461 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b0400f040 con 0x7f7b180fd2b0 2024-04-26T21:21:49.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.330+0000 7f7b1ea00640 1 -- 172.21.15.84:0/568397461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b18114430 con 0x7f7b180fd2b0 2024-04-26T21:21:49.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.330+0000 7f7b15600640 1 -- 172.21.15.84:0/568397461 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b0400db50 con 0x7f7b180fd2b0 2024-04-26T21:21:49.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.330+0000 7f7b1ea00640 1 -- 172.21.15.84:0/568397461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b18114900 con 0x7f7b180fd2b0 2024-04-26T21:21:49.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.332+0000 7f7b1ea00640 1 -- 172.21.15.84:0/568397461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b1804bcc0 con 0x7f7b180fd2b0 2024-04-26T21:21:49.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.333+0000 7f7b15600640 1 -- 172.21.15.84:0/568397461 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7b0400dcb0 con 0x7f7b180fd2b0 2024-04-26T21:21:49.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.334+0000 7f7b15600640 1 --2- 172.21.15.84:0/568397461 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7b00069210 0x7f7b0006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:49.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.334+0000 7f7b15600640 1 -- 172.21.15.84:0/568397461 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f7b04086800 con 0x7f7b180fd2b0 2024-04-26T21:21:49.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.334+0000 7f7b1d600640 1 --2- 172.21.15.84:0/568397461 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7b00069210 0x7f7b0006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:49.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.335+0000 7f7b1d600640 1 --2- 172.21.15.84:0/568397461 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7b00069210 0x7f7b0006b6c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7b18110200 tx=0x7f7b0c009da0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:49.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.339+0000 7f7b15600640 1 -- 172.21.15.84:0/568397461 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7b04052be0 con 0x7f7b180fd2b0 2024-04-26T21:21:49.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.529+0000 7f7b1ea00640 1 -- 172.21.15.84:0/568397461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b18100bb0 con 0x7f7b180fd2b0 2024-04-26T21:21:49.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.532+0000 7f7b15600640 1 -- 172.21.15.84:0/568397461 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+14277 (secure 0 0 0) 0x7f7b04056200 con 0x7f7b180fd2b0 2024-04-26T21:21:49.533 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:21:49.533 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":45,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","created":"2024-04-26T21:12:29.304108+0000","modified":"2024-04-26T21:21:16.219797+0000","last_up_change":"2024-04-26T21:19:41.940176+0000","last_in_change":"2024-04-26T21:19:18.310009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:17:58.092436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-26T21:21:13.126623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-26T21:21:13.704785+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d6c04d45-3ba8-4cc3-92ee-2e99279c6da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":4265849542},{"type":"v1","addr":"172.21.15.84:6803","nonce":4265849542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4265849542},{"type":"v1","addr":"172.21.15.84:6805","nonce":4265849542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4265849542},{"type":"v1","addr":"172.21.15.84:6809","nonce":4265849542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":4265849542},{"type":"v1","addr":"172.21.15.84:6807","nonce":4265849542}]},"public_addr":"172.21.15.84:6803/4265849542","cluster_addr":"172.21.15.84:6805/4265849542","heartbeat_back_addr":"172.21.15.84:6809/4265849542","heartbeat_front_addr":"172.21.15.84:6807/4265849542","state":["exists","up"]},{"osd":1,"uuid":"4417e988-3443-4671-8df5-4d964b8e5954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2545485308},{"type":"v1","addr":"172.21.15.84:6811","nonce":2545485308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2545485308},{"type":"v1","addr":"172.21.15.84:6813","nonce":2545485308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2545485308},{"type":"v1","addr":"172.21.15.84:6817","nonce":2545485308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2545485308},{"type":"v1","addr":"172.21.15.84:6815","nonce":2545485308}]},"public_addr":"172.21.15.84:6811/2545485308","cluster_addr":"172.21.15.84:6813/2545485308","heartbeat_back_addr":"172.21.15.84:6817/2545485308","heartbeat_front_addr":"172.21.15.84:6815/2545485308","state":["exists","up"]},{"osd":2,"uuid":"240901fd-0810-4752-bfa0-2857359b30a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1485373275},{"type":"v1","addr":"172.21.15.84:6819","nonce":1485373275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1485373275},{"type":"v1","addr":"172.21.15.84:6821","nonce":1485373275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1485373275},{"type":"v1","addr":"172.21.15.84:6825","nonce":1485373275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1485373275},{"type":"v1","addr":"172.21.15.84:6823","nonce":1485373275}]},"public_addr":"172.21.15.84:6819/1485373275","cluster_addr":"172.21.15.84:6821/1485373275","heartbeat_back_addr":"172.21.15.84:6825/1485373275","heartbeat_front_addr":"172.21.15.84:6823/1485373275","state":["exists","up"]},{"osd":3,"uuid":"f2d8384f-8b7d-4da4-8a67-4bdb83753822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1269727678},{"type":"v1","addr":"172.21.15.120:6801","nonce":1269727678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1269727678},{"type":"v1","addr":"172.21.15.120:6803","nonce":1269727678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1269727678},{"type":"v1","addr":"172.21.15.120:6807","nonce":1269727678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1269727678},{"type":"v1","addr":"172.21.15.120:6805","nonce":1269727678}]},"public_addr":"172.21.15.120:6801/1269727678","cluster_addr":"172.21.15.120:6803/1269727678","heartbeat_back_addr":"172.21.15.120:6807/1269727678","heartbeat_front_addr":"172.21.15.120:6805/1269727678","state":["exists","up"]},{"osd":4,"uuid":"27aa8cbb-e94e-4e63-b2d4-be8a71b292ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3403602597},{"type":"v1","addr":"172.21.15.120:6809","nonce":3403602597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":3403602597},{"type":"v1","addr":"172.21.15.120:6811","nonce":3403602597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":3403602597},{"type":"v1","addr":"172.21.15.120:6815","nonce":3403602597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3403602597},{"type":"v1","addr":"172.21.15.120:6813","nonce":3403602597}]},"public_addr":"172.21.15.120:6809/3403602597","cluster_addr":"172.21.15.120:6811/3403602597","heartbeat_back_addr":"172.21.15.120:6815/3403602597","heartbeat_front_addr":"172.21.15.120:6813/3403602597","state":["exists","up"]},{"osd":5,"uuid":"e13abdd9-155d-40a0-a69a-4448a658ee5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":2091850685},{"type":"v1","addr":"172.21.15.120:6817","nonce":2091850685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":2091850685},{"type":"v1","addr":"172.21.15.120:6819","nonce":2091850685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":2091850685},{"type":"v1","addr":"172.21.15.120:6823","nonce":2091850685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":2091850685},{"type":"v1","addr":"172.21.15.120:6821","nonce":2091850685}]},"public_addr":"172.21.15.120:6817/2091850685","cluster_addr":"172.21.15.120:6819/2091850685","heartbeat_back_addr":"172.21.15.120:6823/2091850685","heartbeat_front_addr":"172.21.15.120:6821/2091850685","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:45.823555+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:17:20.567670+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:17:55.623700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:18:31.061632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:19:06.227030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:19:40.886216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/1001623":"2024-04-27T21:15:11.400421+0000","172.21.15.84:0/3356039008":"2024-04-27T21:15:11.400421+0000","172.21.15.84:6800/3446199945":"2024-04-27T21:15:11.400421+0000","172.21.15.84:6801/2151160823":"2024-04-27T21:13:42.669268+0000","172.21.15.84:6800/2151160823":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/1155142360":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/1430131141":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/801206978":"2024-04-27T21:13:03.641160+0000","172.21.15.84:0/1460734944":"2024-04-27T21:13:03.641160+0000","172.21.15.84:6800/3231603698":"2024-04-27T21:13:03.641160+0000","172.21.15.84:0/3648317863":"2024-04-27T21:13:03.641160+0000","172.21.15.84:6801/3231603698":"2024-04-27T21:13:03.641160+0000","172.21.15.84:0/413656261":"2024-04-27T21:15:11.400421+0000","172.21.15.84:6801/3446199945":"2024-04-27T21:15:11.400421+0000","172.21.15.84:0/3621485381":"2024-04-27T21:13:42.669268+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:21:49.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.534+0000 7f7b1ea00640 1 -- 172.21.15.84:0/568397461 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7b00069210 msgr2=0x7f7b0006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:49.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.534+0000 7f7b1ea00640 1 --2- 172.21.15.84:0/568397461 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7b00069210 0x7f7b0006b6c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7b18110200 tx=0x7f7b0c009da0 comp rx=0 tx=0).stop 2024-04-26T21:21:49.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.534+0000 7f7b1ea00640 1 -- 172.21.15.84:0/568397461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b180fd2b0 msgr2=0x7f7b1810f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:49.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.534+0000 7f7b1ea00640 1 --2- 172.21.15.84:0/568397461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b180fd2b0 0x7f7b1810f280 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7b040027d0 tx=0x7f7b04009f70 comp rx=0 tx=0).stop 2024-04-26T21:21:49.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.534+0000 7f7b1ea00640 1 -- 172.21.15.84:0/568397461 shutdown_connections 2024-04-26T21:21:49.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.534+0000 7f7b1ea00640 1 --2- 172.21.15.84:0/568397461 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7b00069210 0x7f7b0006b6c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:49.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.534+0000 7f7b1ea00640 1 --2- 172.21.15.84:0/568397461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b180fd2b0 0x7f7b1810f280 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:49.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.534+0000 7f7b1ea00640 1 --2- 172.21.15.84:0/568397461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b180fbfe0 0x7f7b1810ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:49.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.534+0000 7f7b1ea00640 1 -- 172.21.15.84:0/568397461 >> 172.21.15.84:0/568397461 conn(0x7f7b180f7780 msgr2=0x7f7b180f8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:49.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.535+0000 7f7b1ea00640 1 -- 172.21.15.84:0/568397461 shutdown_connections 2024-04-26T21:21:49.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.535+0000 7f7b1ea00640 1 -- 172.21.15.84:0/568397461 wait complete. 2024-04-26T21:21:49.555 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:17:58.092436+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-26T21:21:13.126623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-26T21:21:13.704785+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:21:49.555 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:21:49.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.753+0000 7fe8af200640 1 -- 172.21.15.84:0/1811803549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8a80ff430 msgr2=0x7fe8a80ff8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:49.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.753+0000 7fe8af200640 1 --2- 172.21.15.84:0/1811803549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8a80ff430 0x7fe8a80ff8a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe8980048d0 tx=0x7fe898009da0 comp rx=0 tx=0).stop 2024-04-26T21:21:49.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.753+0000 7fe8af200640 1 -- 172.21.15.84:0/1811803549 shutdown_connections 2024-04-26T21:21:49.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.753+0000 7fe8af200640 1 --2- 172.21.15.84:0/1811803549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8a80ff430 0x7fe8a80ff8a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:49.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.753+0000 7fe8af200640 1 --2- 172.21.15.84:0/1811803549 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8a80fe200 0x7fe8a80fe610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:49.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.753+0000 7fe8af200640 1 -- 172.21.15.84:0/1811803549 >> 172.21.15.84:0/1811803549 conn(0x7fe8a80f9a80 msgr2=0x7fe8a80fbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:49.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.753+0000 7fe8af200640 1 -- 172.21.15.84:0/1811803549 shutdown_connections 2024-04-26T21:21:49.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.753+0000 7fe8af200640 1 -- 172.21.15.84:0/1811803549 wait complete. 2024-04-26T21:21:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.754+0000 7fe8af200640 1 Processor -- start 2024-04-26T21:21:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.755+0000 7fe8af200640 1 -- start start 2024-04-26T21:21:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.755+0000 7fe8af200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8a80fe200 0x7fe8a810ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.755+0000 7fe8af200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8a80ff430 0x7fe8a810f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.755+0000 7fe8af200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a810f8d0 con 0x7fe8a80ff430 2024-04-26T21:21:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.755+0000 7fe8af200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a8114290 con 0x7fe8a80fe200 2024-04-26T21:21:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.755+0000 7fe8ad400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8a80ff430 0x7fe8a810f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.755+0000 7fe8ad400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8a80ff430 0x7fe8a810f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34890/0 (socket says 172.21.15.84:34890) 2024-04-26T21:21:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.755+0000 7fe8ad400640 1 -- 172.21.15.84:0/181658072 learned_addr learned my addr 172.21.15.84:0/181658072 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:21:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.756+0000 7fe8ade00640 1 --2- 172.21.15.84:0/181658072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8a80fe200 0x7fe8a810ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.756+0000 7fe8ad400640 1 -- 172.21.15.84:0/181658072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8a80fe200 msgr2=0x7fe8a810ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.756+0000 7fe8ad400640 1 --2- 172.21.15.84:0/181658072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8a80fe200 0x7fe8a810ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.756+0000 7fe8ad400640 1 -- 172.21.15.84:0/181658072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe898005040 con 0x7fe8a80ff430 2024-04-26T21:21:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.756+0000 7fe8ade00640 1 --2- 172.21.15.84:0/181658072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8a80fe200 0x7fe8a810ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:21:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.756+0000 7fe8ad400640 1 --2- 172.21.15.84:0/181658072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8a80ff430 0x7fe8a810f280 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe898000c00 tx=0x7fe898009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:49.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.756+0000 7fe8a2000640 1 -- 172.21.15.84:0/181658072 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8980094c0 con 0x7fe8a80ff430 2024-04-26T21:21:49.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.756+0000 7fe8a2000640 1 -- 172.21.15.84:0/181658072 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe898032e90 con 0x7fe8a80ff430 2024-04-26T21:21:49.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.756+0000 7fe8af200640 1 -- 172.21.15.84:0/181658072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a81143d0 con 0x7fe8a80ff430 2024-04-26T21:21:49.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.756+0000 7fe8a2000640 1 -- 172.21.15.84:0/181658072 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8980435f0 con 0x7fe8a80ff430 2024-04-26T21:21:49.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.757+0000 7fe8af200640 1 -- 172.21.15.84:0/181658072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a8114840 con 0x7fe8a80ff430 2024-04-26T21:21:49.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.758+0000 7fe8af200640 1 -- 172.21.15.84:0/181658072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a804bcc0 con 0x7fe8a80ff430 2024-04-26T21:21:49.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.759+0000 7fe8a2000640 1 -- 172.21.15.84:0/181658072 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe89802f070 con 0x7fe8a80ff430 2024-04-26T21:21:49.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.760+0000 7fe8a2000640 1 --2- 172.21.15.84:0/181658072 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe890069220 0x7fe89006b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:49.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.760+0000 7fe8a2000640 1 -- 172.21.15.84:0/181658072 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe8980a9060 con 0x7fe8a80ff430 2024-04-26T21:21:49.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.761+0000 7fe8ade00640 1 --2- 172.21.15.84:0/181658072 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe890069220 0x7fe89006b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:49.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.761+0000 7fe8ade00640 1 --2- 172.21.15.84:0/181658072 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe890069220 0x7fe89006b6d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8110200 tx=0x7fe89c00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:49.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.765+0000 7fe8a2000640 1 -- 172.21.15.84:0/181658072 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe898075310 con 0x7fe8a80ff430 2024-04-26T21:21:49.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.977+0000 7fe8af200640 1 -- 172.21.15.84:0/181658072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8a8114de0 con 0x7fe8a80ff430 2024-04-26T21:21:49.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.978+0000 7fe8a2000640 1 -- 172.21.15.84:0/181658072 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe898078930 con 0x7fe8a80ff430 2024-04-26T21:21:49.979 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-04-26T21:21:49.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.980+0000 7fe8af200640 1 -- 172.21.15.84:0/181658072 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe890069220 msgr2=0x7fe89006b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:49.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.980+0000 7fe8af200640 1 --2- 172.21.15.84:0/181658072 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe890069220 0x7fe89006b6d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8110200 tx=0x7fe89c00b040 comp rx=0 tx=0).stop 2024-04-26T21:21:49.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.980+0000 7fe8af200640 1 -- 172.21.15.84:0/181658072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8a80ff430 msgr2=0x7fe8a810f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:49.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.980+0000 7fe8af200640 1 --2- 172.21.15.84:0/181658072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8a80ff430 0x7fe8a810f280 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe898000c00 tx=0x7fe898009da0 comp rx=0 tx=0).stop 2024-04-26T21:21:49.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.980+0000 7fe8af200640 1 -- 172.21.15.84:0/181658072 shutdown_connections 2024-04-26T21:21:49.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.980+0000 7fe8af200640 1 --2- 172.21.15.84:0/181658072 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe890069220 0x7fe89006b6d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:49.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.980+0000 7fe8af200640 1 --2- 172.21.15.84:0/181658072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8a80ff430 0x7fe8a810f280 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:49.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.980+0000 7fe8af200640 1 --2- 172.21.15.84:0/181658072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8a80fe200 0x7fe8a810ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:49.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.980+0000 7fe8af200640 1 -- 172.21.15.84:0/181658072 >> 172.21.15.84:0/181658072 conn(0x7fe8a80f9a80 msgr2=0x7fe8a80fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:49.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.981+0000 7fe8af200640 1 -- 172.21.15.84:0/181658072 shutdown_connections 2024-04-26T21:21:49.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:49.981+0000 7fe8af200640 1 -- 172.21.15.84:0/181658072 wait complete. 2024-04-26T21:21:50.000 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-26T21:21:50.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:49 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/568397461' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:21:50.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.170+0000 7f8157e00640 1 -- 172.21.15.84:0/2215224692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8158065010 msgr2=0x7f81580febe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:50.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.170+0000 7f8157e00640 1 --2- 172.21.15.84:0/2215224692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8158065010 0x7f81580febe0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f81480048d0 tx=0x7f8148009da0 comp rx=0 tx=0).stop 2024-04-26T21:21:50.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.171+0000 7f8157e00640 1 -- 172.21.15.84:0/2215224692 shutdown_connections 2024-04-26T21:21:50.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.171+0000 7f8157e00640 1 --2- 172.21.15.84:0/2215224692 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81580ff120 0x7f8158101500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:50.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.171+0000 7f8157e00640 1 --2- 172.21.15.84:0/2215224692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8158065010 0x7f81580febe0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:50.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.171+0000 7f8157e00640 1 -- 172.21.15.84:0/2215224692 >> 172.21.15.84:0/2215224692 conn(0x7f81580f66d0 msgr2=0x7f81580f8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:50.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.171+0000 7f8157e00640 1 -- 172.21.15.84:0/2215224692 shutdown_connections 2024-04-26T21:21:50.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.171+0000 7f8157e00640 1 -- 172.21.15.84:0/2215224692 wait complete. 2024-04-26T21:21:50.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.171+0000 7f8157e00640 1 Processor -- start 2024-04-26T21:21:50.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.172+0000 7f8157e00640 1 -- start start 2024-04-26T21:21:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.172+0000 7f8157e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8158065010 0x7f815810edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.172+0000 7f8157e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81580ff120 0x7f815810f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.172+0000 7f8157e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815810f950 con 0x7f8158065010 2024-04-26T21:21:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.172+0000 7f8157e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8158114310 con 0x7f81580ff120 2024-04-26T21:21:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.172+0000 7f8156a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8158065010 0x7f815810edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.172+0000 7f8156a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8158065010 0x7f815810edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34910/0 (socket says 172.21.15.84:34910) 2024-04-26T21:21:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.172+0000 7f8156a00640 1 -- 172.21.15.84:0/3434731127 learned_addr learned my addr 172.21.15.84:0/3434731127 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:21:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.172+0000 7f8156000640 1 --2- 172.21.15.84:0/3434731127 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81580ff120 0x7f815810f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.173+0000 7f8156a00640 1 -- 172.21.15.84:0/3434731127 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81580ff120 msgr2=0x7f815810f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.173+0000 7f8156a00640 1 --2- 172.21.15.84:0/3434731127 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81580ff120 0x7f815810f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.173+0000 7f8156a00640 1 -- 172.21.15.84:0/3434731127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8148005040 con 0x7f8158065010 2024-04-26T21:21:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.173+0000 7f8156a00640 1 --2- 172.21.15.84:0/3434731127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8158065010 0x7f815810edc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8148000c00 tx=0x7f8148009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.173+0000 7f814ea00640 1 -- 172.21.15.84:0/3434731127 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81480094c0 con 0x7f8158065010 2024-04-26T21:21:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.173+0000 7f8157e00640 1 -- 172.21.15.84:0/3434731127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8158114450 con 0x7f8158065010 2024-04-26T21:21:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.173+0000 7f814ea00640 1 -- 172.21.15.84:0/3434731127 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8148009620 con 0x7f8158065010 2024-04-26T21:21:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.173+0000 7f814ea00640 1 -- 172.21.15.84:0/3434731127 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81480435f0 con 0x7f8158065010 2024-04-26T21:21:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.173+0000 7f8157e00640 1 -- 172.21.15.84:0/3434731127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81581148c0 con 0x7f8158065010 2024-04-26T21:21:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.175+0000 7f8157e00640 1 -- 172.21.15.84:0/3434731127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815804bcc0 con 0x7f8158065010 2024-04-26T21:21:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.176+0000 7f814ea00640 1 -- 172.21.15.84:0/3434731127 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f814802f070 con 0x7f8158065010 2024-04-26T21:21:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.177+0000 7f814ea00640 1 --2- 172.21.15.84:0/3434731127 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f813c069220 0x7f813c06b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.177+0000 7f814ea00640 1 -- 172.21.15.84:0/3434731127 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f81480a92d0 con 0x7f8158065010 2024-04-26T21:21:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.177+0000 7f8156000640 1 --2- 172.21.15.84:0/3434731127 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f813c069220 0x7f813c06b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.178+0000 7f8156000640 1 --2- 172.21.15.84:0/3434731127 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f813c069220 0x7f813c06b6d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f81440041d0 tx=0x7f8144009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:50.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:49 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/568397461' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:21:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.182+0000 7f814ea00640 1 -- 172.21.15.84:0/3434731127 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f81480754e0 con 0x7f8158065010 2024-04-26T21:21:50.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.374+0000 7f8157e00640 1 -- 172.21.15.84:0/3434731127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f8158104b40 con 0x7f8158065010 2024-04-26T21:21:50.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.375+0000 7f814ea00640 1 -- 172.21.15.84:0/3434731127 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v45) v1 ==== 107+0+11 (secure 0 0 0) 0x7f8148078b00 con 0x7f8158065010 2024-04-26T21:21:50.377 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-04-26T21:21:50.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.378+0000 7f8157e00640 1 -- 172.21.15.84:0/3434731127 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f813c069220 msgr2=0x7f813c06b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:50.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.378+0000 7f8157e00640 1 --2- 172.21.15.84:0/3434731127 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f813c069220 0x7f813c06b6d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f81440041d0 tx=0x7f8144009040 comp rx=0 tx=0).stop 2024-04-26T21:21:50.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.378+0000 7f8157e00640 1 -- 172.21.15.84:0/3434731127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8158065010 msgr2=0x7f815810edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:50.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.378+0000 7f8157e00640 1 --2- 172.21.15.84:0/3434731127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8158065010 0x7f815810edc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8148000c00 tx=0x7f8148009da0 comp rx=0 tx=0).stop 2024-04-26T21:21:50.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.378+0000 7f8157e00640 1 -- 172.21.15.84:0/3434731127 shutdown_connections 2024-04-26T21:21:50.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.378+0000 7f8157e00640 1 --2- 172.21.15.84:0/3434731127 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f813c069220 0x7f813c06b6d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:50.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.378+0000 7f8157e00640 1 --2- 172.21.15.84:0/3434731127 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81580ff120 0x7f815810f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:50.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.378+0000 7f8157e00640 1 --2- 172.21.15.84:0/3434731127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8158065010 0x7f815810edc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:50.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.378+0000 7f8157e00640 1 -- 172.21.15.84:0/3434731127 >> 172.21.15.84:0/3434731127 conn(0x7f81580f66d0 msgr2=0x7f81580face0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:50.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.378+0000 7f8157e00640 1 -- 172.21.15.84:0/3434731127 shutdown_connections 2024-04-26T21:21:50.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.378+0000 7f8157e00640 1 -- 172.21.15.84:0/3434731127 wait complete. 2024-04-26T21:21:50.397 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-26T21:21:50.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.586+0000 7f7364000640 1 -- 172.21.15.84:0/1934528793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c0fd430 msgr2=0x7f735c0fd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:50.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.586+0000 7f7364000640 1 --2- 172.21.15.84:0/1934528793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c0fd430 0x7f735c0fd8a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f73480048d0 tx=0x7f7348009da0 comp rx=0 tx=0).stop 2024-04-26T21:21:50.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.586+0000 7f7364000640 1 -- 172.21.15.84:0/1934528793 shutdown_connections 2024-04-26T21:21:50.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.586+0000 7f7364000640 1 --2- 172.21.15.84:0/1934528793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c0fd430 0x7f735c0fd8a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:50.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.586+0000 7f7364000640 1 --2- 172.21.15.84:0/1934528793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f735c0fc160 0x7f735c0fc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:50.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.586+0000 7f7364000640 1 -- 172.21.15.84:0/1934528793 >> 172.21.15.84:0/1934528793 conn(0x7f735c0f7920 msgr2=0x7f735c0f9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:50.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.586+0000 7f7364000640 1 -- 172.21.15.84:0/1934528793 shutdown_connections 2024-04-26T21:21:50.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.586+0000 7f7364000640 1 -- 172.21.15.84:0/1934528793 wait complete. 2024-04-26T21:21:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.587+0000 7f7364000640 1 Processor -- start 2024-04-26T21:21:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.587+0000 7f7364000640 1 -- start start 2024-04-26T21:21:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.587+0000 7f7364000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c0fc160 0x7f735c10eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.587+0000 7f7364000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f735c0fd430 0x7f735c10f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.587+0000 7f7364000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c10fa30 con 0x7f735c0fc160 2024-04-26T21:21:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.587+0000 7f7364000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c114430 con 0x7f735c0fd430 2024-04-26T21:21:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.588+0000 7f7361600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c0fc160 0x7f735c10eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.588+0000 7f7361600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c0fc160 0x7f735c10eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34926/0 (socket says 172.21.15.84:34926) 2024-04-26T21:21:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.588+0000 7f7361600640 1 -- 172.21.15.84:0/3572377225 learned_addr learned my addr 172.21.15.84:0/3572377225 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:21:50.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.588+0000 7f7361600640 1 -- 172.21.15.84:0/3572377225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f735c0fd430 msgr2=0x7f735c10f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:50.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.588+0000 7f7361600640 1 --2- 172.21.15.84:0/3572377225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f735c0fd430 0x7f735c10f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:50.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.588+0000 7f7361600640 1 -- 172.21.15.84:0/3572377225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7348005040 con 0x7f735c0fc160 2024-04-26T21:21:50.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.588+0000 7f7361600640 1 --2- 172.21.15.84:0/3572377225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c0fc160 0x7f735c10eea0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f735000c790 tx=0x7f73500043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:50.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.589+0000 7f7359600640 1 -- 172.21.15.84:0/3572377225 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f735000a820 con 0x7f735c0fc160 2024-04-26T21:21:50.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.589+0000 7f7359600640 1 -- 172.21.15.84:0/3572377225 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f735000ae50 con 0x7f735c0fc160 2024-04-26T21:21:50.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.589+0000 7f7359600640 1 -- 172.21.15.84:0/3572377225 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73500115e0 con 0x7f735c0fc160 2024-04-26T21:21:50.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.589+0000 7f7364000640 1 -- 172.21.15.84:0/3572377225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735c1145d0 con 0x7f735c0fc160 2024-04-26T21:21:50.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.589+0000 7f7364000640 1 -- 172.21.15.84:0/3572377225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735c114ac0 con 0x7f735c0fc160 2024-04-26T21:21:50.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.590+0000 7f7364000640 1 -- 172.21.15.84:0/3572377225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f735c04bcc0 con 0x7f735c0fc160 2024-04-26T21:21:50.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.591+0000 7f7359600640 1 -- 172.21.15.84:0/3572377225 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7350012400 con 0x7f735c0fc160 2024-04-26T21:21:50.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.593+0000 7f7359600640 1 --2- 172.21.15.84:0/3572377225 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7344069210 0x7f734406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:50.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.593+0000 7f7359600640 1 -- 172.21.15.84:0/3572377225 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f7350087290 con 0x7f735c0fc160 2024-04-26T21:21:50.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.593+0000 7f7360c00640 1 --2- 172.21.15.84:0/3572377225 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7344069210 0x7f734406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:50.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.594+0000 7f7360c00640 1 --2- 172.21.15.84:0/3572377225 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7344069210 0x7f734406b6c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f734802be70 tx=0x7f7348009da0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:50.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.596+0000 7f7359600640 1 -- 172.21.15.84:0/3572377225 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7350053720 con 0x7f735c0fc160 2024-04-26T21:21:50.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.785+0000 7f7364000640 1 -- 172.21.15.84:0/3572377225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f735c104e70 con 0x7f735c0fc160 2024-04-26T21:21:50.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.786+0000 7f7359600640 1 -- 172.21.15.84:0/3572377225 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v45) v1 ==== 107+0+11 (secure 0 0 0) 0x7f7350056d40 con 0x7f735c0fc160 2024-04-26T21:21:50.788 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-04-26T21:21:50.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.789+0000 7f7364000640 1 -- 172.21.15.84:0/3572377225 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7344069210 msgr2=0x7f734406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:50.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.789+0000 7f7364000640 1 --2- 172.21.15.84:0/3572377225 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7344069210 0x7f734406b6c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f734802be70 tx=0x7f7348009da0 comp rx=0 tx=0).stop 2024-04-26T21:21:50.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.789+0000 7f7364000640 1 -- 172.21.15.84:0/3572377225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c0fc160 msgr2=0x7f735c10eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:50.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.789+0000 7f7364000640 1 --2- 172.21.15.84:0/3572377225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c0fc160 0x7f735c10eea0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f735000c790 tx=0x7f73500043c0 comp rx=0 tx=0).stop 2024-04-26T21:21:50.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.789+0000 7f7364000640 1 -- 172.21.15.84:0/3572377225 shutdown_connections 2024-04-26T21:21:50.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.789+0000 7f7364000640 1 --2- 172.21.15.84:0/3572377225 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f7344069210 0x7f734406b6c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:50.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.789+0000 7f7364000640 1 --2- 172.21.15.84:0/3572377225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f735c0fd430 0x7f735c10f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:50.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.789+0000 7f7364000640 1 --2- 172.21.15.84:0/3572377225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c0fc160 0x7f735c10eea0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:50.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.789+0000 7f7364000640 1 -- 172.21.15.84:0/3572377225 >> 172.21.15.84:0/3572377225 conn(0x7f735c0f7920 msgr2=0x7f735c0f8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:50.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.789+0000 7f7364000640 1 -- 172.21.15.84:0/3572377225 shutdown_connections 2024-04-26T21:21:50.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.789+0000 7f7364000640 1 -- 172.21.15.84:0/3572377225 wait complete. 2024-04-26T21:21:50.808 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:21:50.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.998+0000 7f2829c00640 1 -- 172.21.15.84:0/3791272591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28240fc060 msgr2=0x7f28240fc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:51.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.998+0000 7f2829c00640 1 --2- 172.21.15.84:0/3791272591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28240fc060 0x7f28240fc470 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f28140048d0 tx=0x7f2814009da0 comp rx=0 tx=0).stop 2024-04-26T21:21:51.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.998+0000 7f2829c00640 1 -- 172.21.15.84:0/3791272591 shutdown_connections 2024-04-26T21:21:51.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.998+0000 7f2829c00640 1 --2- 172.21.15.84:0/3791272591 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f28240fd330 0x7f28240fd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:51.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.998+0000 7f2829c00640 1 --2- 172.21.15.84:0/3791272591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28240fc060 0x7f28240fc470 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:51.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.998+0000 7f2829c00640 1 -- 172.21.15.84:0/3791272591 >> 172.21.15.84:0/3791272591 conn(0x7f28240f7820 msgr2=0x7f28240f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:51.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.998+0000 7f2829c00640 1 -- 172.21.15.84:0/3791272591 shutdown_connections 2024-04-26T21:21:51.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.998+0000 7f2829c00640 1 -- 172.21.15.84:0/3791272591 wait complete. 2024-04-26T21:21:51.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.999+0000 7f2829c00640 1 Processor -- start 2024-04-26T21:21:51.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.999+0000 7f2829c00640 1 -- start start 2024-04-26T21:21:51.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.999+0000 7f2829c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f28240fc060 0x7f282410cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:51.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.999+0000 7f2829c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28240fd330 0x7f282410d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:51.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.999+0000 7f2829c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282410d690 con 0x7f28240fd330 2024-04-26T21:21:51.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:50.999+0000 7f2829c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2824112090 con 0x7f28240fc060 2024-04-26T21:21:51.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.000+0000 7f2823400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28240fd330 0x7f282410d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:51.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.000+0000 7f2823400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28240fd330 0x7f282410d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34950/0 (socket says 172.21.15.84:34950) 2024-04-26T21:21:51.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.000+0000 7f2823400640 1 -- 172.21.15.84:0/3498964136 learned_addr learned my addr 172.21.15.84:0/3498964136 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:21:51.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.000+0000 7f2823e00640 1 --2- 172.21.15.84:0/3498964136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f28240fc060 0x7f282410cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:51.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.000+0000 7f2823400640 1 -- 172.21.15.84:0/3498964136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f28240fc060 msgr2=0x7f282410cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:51.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.000+0000 7f2823400640 1 --2- 172.21.15.84:0/3498964136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f28240fc060 0x7f282410cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:51.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.000+0000 7f2823400640 1 -- 172.21.15.84:0/3498964136 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2814005040 con 0x7f28240fd330 2024-04-26T21:21:51.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.001+0000 7f2823400640 1 --2- 172.21.15.84:0/3498964136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28240fd330 0x7f282410d040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f281000c790 tx=0x7f28100043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:51.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.001+0000 7f281be00640 1 -- 172.21.15.84:0/3498964136 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f281000a820 con 0x7f28240fd330 2024-04-26T21:21:51.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.001+0000 7f281be00640 1 -- 172.21.15.84:0/3498964136 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f281000ae50 con 0x7f28240fd330 2024-04-26T21:21:51.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.001+0000 7f2829c00640 1 -- 172.21.15.84:0/3498964136 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2824112230 con 0x7f28240fd330 2024-04-26T21:21:51.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.001+0000 7f281be00640 1 -- 172.21.15.84:0/3498964136 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28100115e0 con 0x7f28240fd330 2024-04-26T21:21:51.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.001+0000 7f2829c00640 1 -- 172.21.15.84:0/3498964136 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2824112720 con 0x7f28240fd330 2024-04-26T21:21:51.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.002+0000 7f2829c00640 1 -- 172.21.15.84:0/3498964136 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282404bcc0 con 0x7f28240fd330 2024-04-26T21:21:51.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.004+0000 7f281be00640 1 -- 172.21.15.84:0/3498964136 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f2810012400 con 0x7f28240fd330 2024-04-26T21:21:51.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.005+0000 7f281be00640 1 --2- 172.21.15.84:0/3498964136 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2808069210 0x7f280806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:51.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.005+0000 7f281be00640 1 -- 172.21.15.84:0/3498964136 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2810087360 con 0x7f28240fd330 2024-04-26T21:21:51.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.005+0000 7f2823e00640 1 --2- 172.21.15.84:0/3498964136 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2808069210 0x7f280806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:51.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.006+0000 7f2823e00640 1 --2- 172.21.15.84:0/3498964136 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2808069210 0x7f280806b6c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f28140317e0 tx=0x7f2814009da0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:51.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.009+0000 7f281be00640 1 -- 172.21.15.84:0/3498964136 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2810053690 con 0x7f28240fd330 2024-04-26T21:21:51.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:50 smithi084 ceph-mon[25539]: pgmap v232: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:51.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:50 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/181658072' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T21:21:51.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:50 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:51.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:50 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:51.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:50 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3434731127' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-26T21:21:51.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:50 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3572377225' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-26T21:21:51.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:50 smithi120 ceph-mon[32741]: pgmap v232: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:51.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:50 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/181658072' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T21:21:51.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:50 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:51.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:50 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:51.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:50 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/3434731127' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-26T21:21:51.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:50 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/3572377225' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-26T21:21:51.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.230+0000 7f2829c00640 1 -- 172.21.15.84:0/3498964136 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2824104b60 con 0x7f28240fd330 2024-04-26T21:21:51.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.232+0000 7f281be00640 1 -- 172.21.15.84:0/3498964136 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+4707 (secure 0 0 0) 0x7f2810056cb0 con 0x7f28240fd330 2024-04-26T21:21:51.233 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:21:51.233 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/1543850087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1543850087},{"type":"v1","addr":"172.21.15.84:6829","nonce":1543850087}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:21:35.894623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14456,"mds_1":24231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14456":{"gid":14456,"name":"cephfs.smithi084.hbjunw","rank":0,"incarnation":3,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6827/1450914842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1450914842},{"type":"v1","addr":"172.21.15.84:6827","nonce":1450914842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24231":{"gid":24231,"name":"cephfs.smithi120.qnkxcn","rank":1,"incarnation":6,"state":"up:active","state_seq":5,"addr":"172.21.15.120:6825/3398077484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3398077484},{"type":"v1","addr":"172.21.15.120:6825","nonce":3398077484}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-04-26T21:21:51.233 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 11 2024-04-26T21:21:51.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.234+0000 7f2829c00640 1 -- 172.21.15.84:0/3498964136 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2808069210 msgr2=0x7f280806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:51.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.234+0000 7f2829c00640 1 --2- 172.21.15.84:0/3498964136 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2808069210 0x7f280806b6c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f28140317e0 tx=0x7f2814009da0 comp rx=0 tx=0).stop 2024-04-26T21:21:51.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.234+0000 7f2829c00640 1 -- 172.21.15.84:0/3498964136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28240fd330 msgr2=0x7f282410d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:51.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.234+0000 7f2829c00640 1 --2- 172.21.15.84:0/3498964136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28240fd330 0x7f282410d040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f281000c790 tx=0x7f28100043c0 comp rx=0 tx=0).stop 2024-04-26T21:21:51.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.234+0000 7f2829c00640 1 -- 172.21.15.84:0/3498964136 shutdown_connections 2024-04-26T21:21:51.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.234+0000 7f2829c00640 1 --2- 172.21.15.84:0/3498964136 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2808069210 0x7f280806b6c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:51.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.234+0000 7f2829c00640 1 --2- 172.21.15.84:0/3498964136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28240fd330 0x7f282410d040 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:51.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.234+0000 7f2829c00640 1 --2- 172.21.15.84:0/3498964136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f28240fc060 0x7f282410cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:51.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.234+0000 7f2829c00640 1 -- 172.21.15.84:0/3498964136 >> 172.21.15.84:0/3498964136 conn(0x7f28240f7820 msgr2=0x7f28240f8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:51.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.234+0000 7f2829c00640 1 -- 172.21.15.84:0/3498964136 shutdown_connections 2024-04-26T21:21:51.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:51.234+0000 7f2829c00640 1 -- 172.21.15.84:0/3498964136 wait complete. 2024-04-26T21:21:51.253 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 11, 'max_mds': 2, 'flags': 18} 2024-04-26T21:21:51.253 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-26T21:21:51.279 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-26T21:21:51.279 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-04-26T21:21:51.280 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-26T21:21:51.280 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T21:21:51.280 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T21:21:51.280 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-26T21:21:51.280 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T21:21:51.280 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T21:21:51.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:21:51.280 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-04-26T21:21:51.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:21:51.333 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2024-04-26T21:21:51.417 INFO:teuthology.orchestra.run.smithi084.stderr:Cannot find device "ceph-brx" 2024-04-26T21:21:51.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:21:51.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:21:51.421 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-04-26T21:21:51.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:21:51.480 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link delete ceph-brx 2024-04-26T21:21:51.573 INFO:teuthology.orchestra.run.smithi120.stderr:Cannot find device "ceph-brx" 2024-04-26T21:21:51.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:21:51.577 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-26T21:21:51.578 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-26T21:21:51.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:51 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:51.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:51 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:21:51.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:51 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:51.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:51 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3498964136' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T21:21:52.055 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:21:52.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:51 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:52.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:51 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:21:52.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:51 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:21:52.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:51 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/3498964136' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T21:21:53.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:52 smithi084 ceph-mon[25539]: pgmap v233: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:52 smithi120 ceph-mon[32741]: pgmap v233: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:54.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.177+0000 7fa32e800700 1 -- 172.21.15.84:0/1162696379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3280fd0a0 msgr2=0x7fa328109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:54.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.177+0000 7fa32e800700 1 --2- 172.21.15.84:0/1162696379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3280fd0a0 0x7fa328109350 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa314004940 tx=0x7fa314009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:54.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.177+0000 7fa32e800700 1 -- 172.21.15.84:0/1162696379 shutdown_connections 2024-04-26T21:21:54.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.177+0000 7fa32e800700 1 --2- 172.21.15.84:0/1162696379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3280fd0a0 0x7fa328109350 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:54.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.177+0000 7fa32e800700 1 --2- 172.21.15.84:0/1162696379 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3280fc790 0x7fa3280fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:54.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.177+0000 7fa32e800700 1 -- 172.21.15.84:0/1162696379 >> 172.21.15.84:0/1162696379 conn(0x7fa328071d00 msgr2=0x7fa328072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:54.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.178+0000 7fa32e800700 1 -- 172.21.15.84:0/1162696379 shutdown_connections 2024-04-26T21:21:54.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.178+0000 7fa32e800700 1 -- 172.21.15.84:0/1162696379 wait complete. 2024-04-26T21:21:54.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.179+0000 7fa32e800700 1 Processor -- start 2024-04-26T21:21:54.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.179+0000 7fa32e800700 1 -- start start 2024-04-26T21:21:54.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.179+0000 7fa32e800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3280fc790 0x7fa328115e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:54.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.180+0000 7fa32e800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3280fd0a0 0x7fa328116370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:54.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.180+0000 7fa32e800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3281169c0 con 0x7fa3280fc790 2024-04-26T21:21:54.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.180+0000 7fa32e800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32810fd90 con 0x7fa3280fd0a0 2024-04-26T21:21:54.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.180+0000 7fa327400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3280fc790 0x7fa328115e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:54.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.180+0000 7fa327400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3280fc790 0x7fa328115e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38954/0 (socket says 172.21.15.84:38954) 2024-04-26T21:21:54.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.180+0000 7fa327400700 1 -- 172.21.15.84:0/1054025679 learned_addr learned my addr 172.21.15.84:0/1054025679 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:21:54.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.180+0000 7fa326a00700 1 --2- 172.21.15.84:0/1054025679 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3280fd0a0 0x7fa328116370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:54.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.180+0000 7fa327400700 1 -- 172.21.15.84:0/1054025679 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3280fd0a0 msgr2=0x7fa328116370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:54.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.180+0000 7fa327400700 1 --2- 172.21.15.84:0/1054025679 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3280fd0a0 0x7fa328116370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:54.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.180+0000 7fa327400700 1 -- 172.21.15.84:0/1054025679 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa314005040 con 0x7fa3280fc790 2024-04-26T21:21:54.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.181+0000 7fa327400700 1 --2- 172.21.15.84:0/1054025679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3280fc790 0x7fa328115e30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa318002a50 tx=0x7fa3180046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:54.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.181+0000 7fa31f400700 1 -- 172.21.15.84:0/1054025679 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa318007cc0 con 0x7fa3280fc790 2024-04-26T21:21:54.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.181+0000 7fa31f400700 1 -- 172.21.15.84:0/1054025679 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa31800f040 con 0x7fa3280fc790 2024-04-26T21:21:54.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.181+0000 7fa32e800700 1 -- 172.21.15.84:0/1054025679 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa328110070 con 0x7fa3280fc790 2024-04-26T21:21:54.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.181+0000 7fa31f400700 1 -- 172.21.15.84:0/1054025679 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa318009640 con 0x7fa3280fc790 2024-04-26T21:21:54.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.181+0000 7fa32e800700 1 -- 172.21.15.84:0/1054025679 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3281105b0 con 0x7fa3280fc790 2024-04-26T21:21:54.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.182+0000 7fa32e800700 1 -- 172.21.15.84:0/1054025679 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3280fc330 con 0x7fa3280fc790 2024-04-26T21:21:54.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.184+0000 7fa31f400700 1 -- 172.21.15.84:0/1054025679 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fa3180097a0 con 0x7fa3280fc790 2024-04-26T21:21:54.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.185+0000 7fa31f400700 1 --2- 172.21.15.84:0/1054025679 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fa30c0692a0 0x7fa30c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:54.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.185+0000 7fa31f400700 1 -- 172.21.15.84:0/1054025679 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa318087650 con 0x7fa3280fc790 2024-04-26T21:21:54.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.185+0000 7fa326a00700 1 --2- 172.21.15.84:0/1054025679 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fa30c0692a0 0x7fa30c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:54.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.186+0000 7fa326a00700 1 --2- 172.21.15.84:0/1054025679 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fa30c0692a0 0x7fa30c06b750 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa314004f90 tx=0x7fa314009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:54.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.191+0000 7fa31f400700 1 -- 172.21.15.84:0/1054025679 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa318057370 con 0x7fa3280fc790 2024-04-26T21:21:54.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.456+0000 7fa32e800700 1 -- 172.21.15.84:0/1054025679 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa32804bed0 con 0x7fa3280fc790 2024-04-26T21:21:54.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.457+0000 7fa31f400700 1 -- 172.21.15.84:0/1054025679 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v11) v1 ==== 53+0+83 (secure 0 0 0) 0x7fa318056f00 con 0x7fa3280fc790 2024-04-26T21:21:54.459 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-26T21:21:54.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.460+0000 7fa32e800700 1 -- 172.21.15.84:0/1054025679 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fa30c0692a0 msgr2=0x7fa30c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:54.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.460+0000 7fa32e800700 1 --2- 172.21.15.84:0/1054025679 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fa30c0692a0 0x7fa30c06b750 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa314004f90 tx=0x7fa314009e30 comp rx=0 tx=0).stop 2024-04-26T21:21:54.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.460+0000 7fa32e800700 1 -- 172.21.15.84:0/1054025679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3280fc790 msgr2=0x7fa328115e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:54.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.460+0000 7fa32e800700 1 --2- 172.21.15.84:0/1054025679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3280fc790 0x7fa328115e30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa318002a50 tx=0x7fa3180046b0 comp rx=0 tx=0).stop 2024-04-26T21:21:54.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.460+0000 7fa32e800700 1 -- 172.21.15.84:0/1054025679 shutdown_connections 2024-04-26T21:21:54.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.460+0000 7fa32e800700 1 --2- 172.21.15.84:0/1054025679 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fa30c0692a0 0x7fa30c06b750 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:54.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.460+0000 7fa32e800700 1 --2- 172.21.15.84:0/1054025679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3280fc790 0x7fa328115e30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:54.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.460+0000 7fa32e800700 1 --2- 172.21.15.84:0/1054025679 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3280fd0a0 0x7fa328116370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:54.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.460+0000 7fa32e800700 1 -- 172.21.15.84:0/1054025679 >> 172.21.15.84:0/1054025679 conn(0x7fa328071d00 msgr2=0x7fa3280f9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:54.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.460+0000 7fa32e800700 1 -- 172.21.15.84:0/1054025679 shutdown_connections 2024-04-26T21:21:54.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:54.460+0000 7fa32e800700 1 -- 172.21.15.84:0/1054025679 wait complete. 2024-04-26T21:21:55.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:54 smithi084 ceph-mon[25539]: pgmap v234: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:55.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:54 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1054025679' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T21:21:55.317 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T21:21:55.318 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T21:21:55.318 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2024-04-26T21:21:55.318 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T21:21:55.318 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T21:21:55.318 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T21:21:55.318 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T21:21:55.318 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T21:21:55.318 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T21:21:55.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:21:55.319 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2024-04-26T21:21:55.376 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:21:55.376 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:21:55.376 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:21:55.376 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:21:55.376 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2024-04-26T21:21:55.376 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:21:55.376 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:21:55.376 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:21:55.376 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2024-04-26T21:21:55.376 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:21:55.377 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:21:55.377 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2024-04-26T21:21:55.377 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:21:55.377 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:21:55.377 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T21:21:55.377 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:21:55.377 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T21:21:55.377 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42064sec preferred_lft 42064sec 2024-04-26T21:21:55.377 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2024-04-26T21:21:55.377 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:21:55.378 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T21:21:55.378 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:21:55.378 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-04-26T21:21:55.378 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2024-04-26T21:21:55.378 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2024-04-26T21:21:55.378 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2024-04-26T21:21:55.378 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T21:21:55.378 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-04-26T21:21:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:54 smithi120 ceph-mon[32741]: pgmap v234: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:54 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/1054025679' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T21:21:55.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:21:55.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:21:55.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:21:55.853 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T21:21:55.921 INFO:teuthology.orchestra.run.smithi084.stdout:1 2024-04-26T21:21:55.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:21:55.924 DEBUG:teuthology.orchestra.run.smithi084:> route 2024-04-26T21:21:55.979 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2024-04-26T21:21:55.980 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T21:21:55.980 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T21:21:55.980 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T21:21:55.980 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T21:21:55.982 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:21:55.982 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-04-26T21:21:55.982 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T21:21:55.982 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T21:21:55.982 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T21:21:55.983 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-04-26T21:21:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:21:56.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:21:56.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:21:56.723 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-04-26T21:21:56.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:21:56.775 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2024-04-26T21:21:56.825 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:21:56.825 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-04-26T21:21:56.825 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:21:56.825 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T21:21:56.825 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-04-26T21:21:56.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:21:57.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:21:57.015 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T21:21:57.015 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:21:57.015 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-04-26T21:21:57.015 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T21:21:57.015 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T21:21:57.015 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T21:21:57.015 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T21:21:57.015 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T21:21:57.015 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-04-26T21:21:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:21:57.134 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:57 smithi120 ceph-mon[32741]: pgmap v235: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:57.134 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:57 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:21:57.214 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:57 smithi084 ceph-mon[25539]: pgmap v235: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:57.215 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:57 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:21:57.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:21:57.310 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:21:57.310 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-04-26T21:21:57.310 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2024-04-26T21:21:57.310 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T21:21:57.310 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-04-26T21:21:57.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:21:57.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:21:57.509 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T21:21:57.509 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:21:57.509 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T21:21:57.554 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T21:21:57.555 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:21:57.555 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T21:21:57.646 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2024-04-26T21:21:57.715 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:21:57.767 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2024-04-26T21:21:57.768 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2024-04-26T21:21:57.768 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2024-04-26T21:21:57.768 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2024-04-26T21:21:57.768 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2024-04-26T21:21:57.768 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2024-04-26T21:21:57.768 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2024-04-26T21:21:57.768 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2024-04-26T21:21:57.768 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2024-04-26T21:21:57.768 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/bpf 2024-04-26T21:21:57.768 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2024-04-26T21:21:57.768 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2024-04-26T21:21:57.768 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:21:57.768 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2024-04-26T21:21:57.768 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2024-04-26T21:21:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2024-04-26T21:21:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2024-04-26T21:21:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2024-04-26T21:21:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2024-04-26T21:21:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2024-04-26T21:21:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-26T21:21:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-26T21:21:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2024-04-26T21:21:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2024-04-26T21:21:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2024-04-26T21:21:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay 2024-04-26T21:21:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/9712e2ba4edad1ef9d8a3b913b1dfc3efaa3248667cf10b41e3d2a59fd8a0674/merged 2024-04-26T21:21:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/b8af7bb0579895df228bd8503e7bf8f438050b66b32f4c27648e158ffa47f262/merged 2024-04-26T21:21:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/0 2024-04-26T21:21:57.770 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:21:57.770 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/c73fa85f4b20031f09597810f5104177f7bdbf64c56cd1bdc9ec07f0d0e9e30b/merged 2024-04-26T21:21:57.770 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/38a276ecaf1ed18810f8668ee505ddab970df85466590a68c3f36a01b42fedda/merged 2024-04-26T21:21:57.770 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/c039e7005d1e16c2037fd95d2558bf82d008dfe06a9a0af5aac84c2acaaa92dc/merged 2024-04-26T21:21:57.770 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/c8064997fb7c8705bd3d4a7f1a1a6d9e926e84f3afcc4d8168f775a7fc12ed3e/merged 2024-04-26T21:21:57.770 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/f5f633d9c9c19718fff92271005329d8d112b255c58a4c1aee6d8aeb09d11847/merged 2024-04-26T21:21:57.770 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/e8665d4d6a65c172712a23274975ef07f1ac9bc09330bd7125416b7844649fb3/merged 2024-04-26T21:21:57.770 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/37314fdab92471851556b293b0c7626e8f634afb62b5745199e2bb3baad9a4c6/merged 2024-04-26T21:21:57.770 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/ffd60868b7d9e91a7d0af6e23994dd571eed15c51fca7a4a6ef8e5ae7c37491a/merged 2024-04-26T21:21:57.770 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/e7677917bdc853301c5b160acc89316b701e421b3659800e2a096d90be94a3a4/merged 2024-04-26T21:21:57.770 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/27155885dcc7f1d50f2cf96aba90c3444fd25c696fff5e6bad768b2e3ff0213c/merged 2024-04-26T21:21:57.771 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2024-04-26T21:21:57.771 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:21:57.771 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:21:57.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:21:57.772 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2024-04-26T21:21:57.817 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T21:21:57.817 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T21:21:57.862 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2024-04-26T21:21:57.932 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:21:57.976 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2024-04-26T21:21:57.976 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2024-04-26T21:21:57.977 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2024-04-26T21:21:57.977 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2024-04-26T21:21:57.977 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2024-04-26T21:21:57.977 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2024-04-26T21:21:57.977 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2024-04-26T21:21:57.977 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2024-04-26T21:21:57.977 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2024-04-26T21:21:57.977 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/bpf 2024-04-26T21:21:57.977 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2024-04-26T21:21:57.977 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2024-04-26T21:21:57.977 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:21:57.977 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2024-04-26T21:21:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2024-04-26T21:21:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2024-04-26T21:21:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2024-04-26T21:21:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2024-04-26T21:21:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2024-04-26T21:21:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2024-04-26T21:21:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-26T21:21:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-26T21:21:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2024-04-26T21:21:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2024-04-26T21:21:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2024-04-26T21:21:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay 2024-04-26T21:21:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/9712e2ba4edad1ef9d8a3b913b1dfc3efaa3248667cf10b41e3d2a59fd8a0674/merged 2024-04-26T21:21:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/b8af7bb0579895df228bd8503e7bf8f438050b66b32f4c27648e158ffa47f262/merged 2024-04-26T21:21:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/0 2024-04-26T21:21:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:21:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/c73fa85f4b20031f09597810f5104177f7bdbf64c56cd1bdc9ec07f0d0e9e30b/merged 2024-04-26T21:21:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/38a276ecaf1ed18810f8668ee505ddab970df85466590a68c3f36a01b42fedda/merged 2024-04-26T21:21:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/c039e7005d1e16c2037fd95d2558bf82d008dfe06a9a0af5aac84c2acaaa92dc/merged 2024-04-26T21:21:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/c8064997fb7c8705bd3d4a7f1a1a6d9e926e84f3afcc4d8168f775a7fc12ed3e/merged 2024-04-26T21:21:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/f5f633d9c9c19718fff92271005329d8d112b255c58a4c1aee6d8aeb09d11847/merged 2024-04-26T21:21:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/e8665d4d6a65c172712a23274975ef07f1ac9bc09330bd7125416b7844649fb3/merged 2024-04-26T21:21:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/37314fdab92471851556b293b0c7626e8f634afb62b5745199e2bb3baad9a4c6/merged 2024-04-26T21:21:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/ffd60868b7d9e91a7d0af6e23994dd571eed15c51fca7a4a6ef8e5ae7c37491a/merged 2024-04-26T21:21:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/e7677917bdc853301c5b160acc89316b701e421b3659800e2a096d90be94a3a4/merged 2024-04-26T21:21:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/27155885dcc7f1d50f2cf96aba90c3444fd25c696fff5e6bad768b2e3ff0213c/merged 2024-04-26T21:21:57.980 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2024-04-26T21:21:57.980 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:21:57.980 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:21:57.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:21:57.981 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2024-04-26T21:21:58.066 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:2024-04-26T21:21:58.066+0000 7fc732ab1300 -1 init, newargv = 0x55f7d7e8bc50 newargc=15 2024-04-26T21:21:58.066 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[72906]: starting ceph client 2024-04-26T21:21:58.086 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[72906]: starting fuse 2024-04-26T21:21:59.166 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2024-04-26T21:21:59.259 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:21:59.314 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2024-04-26T21:21:59.315 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2024-04-26T21:21:59.315 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2024-04-26T21:21:59.315 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2024-04-26T21:21:59.315 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2024-04-26T21:21:59.315 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2024-04-26T21:21:59.315 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2024-04-26T21:21:59.315 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2024-04-26T21:21:59.315 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2024-04-26T21:21:59.315 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/bpf 2024-04-26T21:21:59.315 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2024-04-26T21:21:59.315 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2024-04-26T21:21:59.316 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:21:59.316 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2024-04-26T21:21:59.316 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2024-04-26T21:21:59.316 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2024-04-26T21:21:59.316 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2024-04-26T21:21:59.316 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2024-04-26T21:21:59.316 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2024-04-26T21:21:59.316 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2024-04-26T21:21:59.316 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-26T21:21:59.316 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-26T21:21:59.316 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2024-04-26T21:21:59.316 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2024-04-26T21:21:59.316 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2024-04-26T21:21:59.316 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay 2024-04-26T21:21:59.317 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/9712e2ba4edad1ef9d8a3b913b1dfc3efaa3248667cf10b41e3d2a59fd8a0674/merged 2024-04-26T21:21:59.317 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/b8af7bb0579895df228bd8503e7bf8f438050b66b32f4c27648e158ffa47f262/merged 2024-04-26T21:21:59.317 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/0 2024-04-26T21:21:59.317 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:21:59.317 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/c73fa85f4b20031f09597810f5104177f7bdbf64c56cd1bdc9ec07f0d0e9e30b/merged 2024-04-26T21:21:59.317 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/38a276ecaf1ed18810f8668ee505ddab970df85466590a68c3f36a01b42fedda/merged 2024-04-26T21:21:59.317 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/c039e7005d1e16c2037fd95d2558bf82d008dfe06a9a0af5aac84c2acaaa92dc/merged 2024-04-26T21:21:59.317 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/c8064997fb7c8705bd3d4a7f1a1a6d9e926e84f3afcc4d8168f775a7fc12ed3e/merged 2024-04-26T21:21:59.317 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/f5f633d9c9c19718fff92271005329d8d112b255c58a4c1aee6d8aeb09d11847/merged 2024-04-26T21:21:59.317 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/e8665d4d6a65c172712a23274975ef07f1ac9bc09330bd7125416b7844649fb3/merged 2024-04-26T21:21:59.317 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/37314fdab92471851556b293b0c7626e8f634afb62b5745199e2bb3baad9a4c6/merged 2024-04-26T21:21:59.317 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/ffd60868b7d9e91a7d0af6e23994dd571eed15c51fca7a4a6ef8e5ae7c37491a/merged 2024-04-26T21:21:59.317 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/e7677917bdc853301c5b160acc89316b701e421b3659800e2a096d90be94a3a4/merged 2024-04-26T21:21:59.317 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/27155885dcc7f1d50f2cf96aba90c3444fd25c696fff5e6bad768b2e3ff0213c/merged 2024-04-26T21:21:59.317 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2024-04-26T21:21:59.318 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:21:59.318 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:21:59.318 INFO:teuthology.orchestra.run.smithi084.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-26T21:21:59.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:21:59.319 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2024-04-26T21:21:59.367 INFO:teuthology.orchestra.run.smithi084.stdout:144 2024-04-26T21:21:59.368 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [144] 2024-04-26T21:21:59.368 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2024-04-26T21:21:59.368 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2024-04-26T21:21:59.368 DEBUG:teuthology.orchestra.run.smithi084:> import re 2024-04-26T21:21:59.368 DEBUG:teuthology.orchestra.run.smithi084:> import os 2024-04-26T21:21:59.368 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2024-04-26T21:21:59.368 DEBUG:teuthology.orchestra.run.smithi084:> 2024-04-26T21:21:59.368 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2024-04-26T21:21:59.368 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T21:21:59.369 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2024-04-26T21:21:59.369 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T21:21:59.369 DEBUG:teuthology.orchestra.run.smithi084:> 2024-04-26T21:21:59.369 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2024-04-26T21:21:59.369 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2024-04-26T21:21:59.369 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2024-04-26T21:21:59.369 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2024-04-26T21:21:59.369 DEBUG:teuthology.orchestra.run.smithi084:> 2024-04-26T21:21:59.369 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2024-04-26T21:21:59.369 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T21:21:59.369 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T21:21:59.369 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T21:21:59.369 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2024-04-26T21:21:59.369 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2024-04-26T21:21:59.369 DEBUG:teuthology.orchestra.run.smithi084:> return f 2024-04-26T21:21:59.369 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T21:21:59.369 DEBUG:teuthology.orchestra.run.smithi084:> 2024-04-26T21:21:59.370 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.0")) 2024-04-26T21:21:59.370 DEBUG:teuthology.orchestra.run.smithi084:> ' 2024-04-26T21:21:59.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:21:59 smithi084 ceph-mon[25539]: pgmap v236: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:21:59 smithi120 ceph-mon[32741]: pgmap v236: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:21:59.532 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.0.72906.asok 2024-04-26T21:21:59.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:21:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:21:59.549 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.72906.asok 2024-04-26T21:21:59.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:21:59.549 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.72906.asok status 2024-04-26T21:21:59.770 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:21:59.770 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2024-04-26T21:21:59.770 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "2be3efa97a7972f8e925bd899b474329979b74d6", 2024-04-26T21:21:59.770 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)", 2024-04-26T21:21:59.770 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "0", 2024-04-26T21:21:59.770 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2024-04-26T21:21:59.770 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T21:21:59.770 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "72906", 2024-04-26T21:21:59.771 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2024-04-26T21:21:59.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:21:59.771 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2024-04-26T21:21:59.771 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2024-04-26T21:21:59.771 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 14520, 2024-04-26T21:21:59.771 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2024-04-26T21:21:59.771 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2024-04-26T21:21:59.771 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2024-04-26T21:21:59.771 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 14520 2024-04-26T21:21:59.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:21:59.771 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2024-04-26T21:21:59.771 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2024-04-26T21:21:59.771 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2024-04-26T21:21:59.771 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2483101042 2024-04-26T21:21:59.771 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:21:59.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:21:59.772 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2024-04-26T21:21:59.772 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2024-04-26T21:21:59.772 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2024-04-26T21:21:59.772 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2483101042 2024-04-26T21:21:59.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:21:59.772 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.14520 192.168.0.1:0/2483101042", 2024-04-26T21:21:59.772 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/2483101042", 2024-04-26T21:21:59.772 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2024-04-26T21:21:59.772 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 11, 2024-04-26T21:21:59.772 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 45, 2024-04-26T21:21:59.772 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2024-04-26T21:21:59.772 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2024-04-26T21:21:59.772 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2024-04-26T21:21:59.773 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:21:59.783 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-26T21:22:00.264 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:22:01.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:01 smithi084 ceph-mon[25539]: pgmap v237: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-26T21:22:01.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:01 smithi120 ceph-mon[32741]: pgmap v237: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-26T21:22:02.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.506+0000 7efcaf400700 1 -- 172.21.15.84:0/3942243167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca8071f30 msgr2=0x7efca8070300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:02.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.506+0000 7efcaf400700 1 --2- 172.21.15.84:0/3942243167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca8071f30 0x7efca8070300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009d10 tx=0x7efc9c004d10 comp rx=0 tx=0).stop 2024-04-26T21:22:02.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.506+0000 7efcaf400700 1 -- 172.21.15.84:0/3942243167 shutdown_connections 2024-04-26T21:22:02.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.506+0000 7efcaf400700 1 --2- 172.21.15.84:0/3942243167 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efca8070840 0x7efca8070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:02.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.506+0000 7efcaf400700 1 --2- 172.21.15.84:0/3942243167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca8071f30 0x7efca8070300 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:02.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.506+0000 7efcaf400700 1 -- 172.21.15.84:0/3942243167 >> 172.21.15.84:0/3942243167 conn(0x7efca80f8990 msgr2=0x7efca80fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:02.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.506+0000 7efcaf400700 1 -- 172.21.15.84:0/3942243167 shutdown_connections 2024-04-26T21:22:02.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.506+0000 7efcaf400700 1 -- 172.21.15.84:0/3942243167 wait complete. 2024-04-26T21:22:02.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.507+0000 7efcaf400700 1 Processor -- start 2024-04-26T21:22:02.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.507+0000 7efcaf400700 1 -- start start 2024-04-26T21:22:02.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.508+0000 7efcaf400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efca8070840 0x7efca811a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:02.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.508+0000 7efcaf400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca8071f30 0x7efca811a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:02.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.508+0000 7efcaf400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca811ad10 con 0x7efca8071f30 2024-04-26T21:22:02.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.508+0000 7efcaf400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca81142f0 con 0x7efca8070840 2024-04-26T21:22:02.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.508+0000 7efca7e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca8071f30 0x7efca811a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:02.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.508+0000 7efca7e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca8071f30 0x7efca811a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49358/0 (socket says 172.21.15.84:49358) 2024-04-26T21:22:02.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.508+0000 7efca7e00700 1 -- 172.21.15.84:0/2325651622 learned_addr learned my addr 172.21.15.84:0/2325651622 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:22:02.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.508+0000 7efcaca00700 1 --2- 172.21.15.84:0/2325651622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efca8070840 0x7efca811a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:02.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.508+0000 7efca7e00700 1 -- 172.21.15.84:0/2325651622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efca8070840 msgr2=0x7efca811a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:02.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.508+0000 7efca7e00700 1 --2- 172.21.15.84:0/2325651622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efca8070840 0x7efca811a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:02.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.508+0000 7efca7e00700 1 -- 172.21.15.84:0/2325651622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c009940 con 0x7efca8071f30 2024-04-26T21:22:02.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.509+0000 7efca7e00700 1 --2- 172.21.15.84:0/2325651622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca8071f30 0x7efca811a6c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7efc94002a50 tx=0x7efc940046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:02.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.509+0000 7efca4c00700 1 -- 172.21.15.84:0/2325651622 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc94007cc0 con 0x7efca8071f30 2024-04-26T21:22:02.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.509+0000 7efca4c00700 1 -- 172.21.15.84:0/2325651622 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc9400f040 con 0x7efca8071f30 2024-04-26T21:22:02.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.509+0000 7efca4c00700 1 -- 172.21.15.84:0/2325651622 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc94009640 con 0x7efca8071f30 2024-04-26T21:22:02.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.509+0000 7efcaf400700 1 -- 172.21.15.84:0/2325651622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca81145d0 con 0x7efca8071f30 2024-04-26T21:22:02.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.509+0000 7efcaf400700 1 -- 172.21.15.84:0/2325651622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca8114b10 con 0x7efca8071f30 2024-04-26T21:22:02.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.510+0000 7efcaf400700 1 -- 172.21.15.84:0/2325651622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca8071a40 con 0x7efca8071f30 2024-04-26T21:22:02.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.511+0000 7efca4c00700 1 -- 172.21.15.84:0/2325651622 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7efc940097a0 con 0x7efca8071f30 2024-04-26T21:22:02.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.512+0000 7efca4c00700 1 --2- 172.21.15.84:0/2325651622 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efc900692a0 0x7efc9006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:02.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.512+0000 7efca4c00700 1 -- 172.21.15.84:0/2325651622 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7efc94087070 con 0x7efca8071f30 2024-04-26T21:22:02.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.513+0000 7efcaca00700 1 --2- 172.21.15.84:0/2325651622 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efc900692a0 0x7efc9006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:02.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.513+0000 7efcaca00700 1 --2- 172.21.15.84:0/2325651622 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efc900692a0 0x7efc9006b750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efc9c0048e0 tx=0x7efc9c004d10 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:02.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.517+0000 7efca4c00700 1 -- 172.21.15.84:0/2325651622 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7efc94056d10 con 0x7efca8071f30 2024-04-26T21:22:02.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.776+0000 7efcaf400700 1 -- 172.21.15.84:0/2325651622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efca804c710 con 0x7efca8071f30 2024-04-26T21:22:02.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.777+0000 7efca4c00700 1 -- 172.21.15.84:0/2325651622 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v11) v1 ==== 53+0+83 (secure 0 0 0) 0x7efc940568a0 con 0x7efca8071f30 2024-04-26T21:22:02.831 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-26T21:22:02.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.780+0000 7efcaf400700 1 -- 172.21.15.84:0/2325651622 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efc900692a0 msgr2=0x7efc9006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:02.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.780+0000 7efcaf400700 1 --2- 172.21.15.84:0/2325651622 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efc900692a0 0x7efc9006b750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efc9c0048e0 tx=0x7efc9c004d10 comp rx=0 tx=0).stop 2024-04-26T21:22:02.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.780+0000 7efcaf400700 1 -- 172.21.15.84:0/2325651622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca8071f30 msgr2=0x7efca811a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:02.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.780+0000 7efcaf400700 1 --2- 172.21.15.84:0/2325651622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca8071f30 0x7efca811a6c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7efc94002a50 tx=0x7efc940046b0 comp rx=0 tx=0).stop 2024-04-26T21:22:02.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.780+0000 7efcaf400700 1 -- 172.21.15.84:0/2325651622 shutdown_connections 2024-04-26T21:22:02.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.780+0000 7efcaf400700 1 --2- 172.21.15.84:0/2325651622 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efc900692a0 0x7efc9006b750 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:02.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.780+0000 7efcaf400700 1 --2- 172.21.15.84:0/2325651622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efca8070840 0x7efca811a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:02.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.780+0000 7efcaf400700 1 --2- 172.21.15.84:0/2325651622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca8071f30 0x7efca811a6c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:02.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.780+0000 7efcaf400700 1 -- 172.21.15.84:0/2325651622 >> 172.21.15.84:0/2325651622 conn(0x7efca80f8990 msgr2=0x7efca80f9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:02.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.780+0000 7efcaf400700 1 -- 172.21.15.84:0/2325651622 shutdown_connections 2024-04-26T21:22:02.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:02.780+0000 7efcaf400700 1 -- 172.21.15.84:0/2325651622 wait complete. 2024-04-26T21:22:03.157 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:03 smithi084 ceph-mon[25539]: pgmap v238: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-26T21:22:03.157 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:03 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2325651622' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T21:22:03.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:03 smithi120 ceph-mon[32741]: pgmap v238: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-26T21:22:03.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:03 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2325651622' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T21:22:03.709 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T21:22:03.709 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T21:22:03.709 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2024-04-26T21:22:03.709 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-26T21:22:03.709 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T21:22:03.709 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T21:22:03.710 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T21:22:03.710 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T21:22:03.710 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T21:22:03.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:22:03.710 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2024-04-26T21:22:03.770 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:22:03.770 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:22:03.770 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:22:03.770 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:22:03.770 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2024-04-26T21:22:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:22:03.771 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:22:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:22:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2024-04-26T21:22:03.771 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:22:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:22:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2024-04-26T21:22:03.771 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:22:03.771 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2024-04-26T21:22:03.771 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T21:22:03.772 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2024-04-26T21:22:03.772 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T21:22:03.772 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 42047sec preferred_lft 42047sec 2024-04-26T21:22:03.772 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2024-04-26T21:22:03.772 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:22:03.772 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T21:22:03.772 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:22:03.772 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-04-26T21:22:03.772 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add name ceph-brx type bridge 2024-04-26T21:22:03.772 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip addr flush dev ceph-brx 2024-04-26T21:22:03.773 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set ceph-brx up 2024-04-26T21:22:03.773 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T21:22:03.773 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-04-26T21:22:03.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:22:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:22:04.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:22:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:22:04.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:22:04.283 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T21:22:04.350 INFO:teuthology.orchestra.run.smithi120.stdout:1 2024-04-26T21:22:04.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:22:04.354 DEBUG:teuthology.orchestra.run.smithi120:> route 2024-04-26T21:22:04.408 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2024-04-26T21:22:04.409 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T21:22:04.409 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T21:22:04.409 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T21:22:04.409 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T21:22:04.409 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:22:04.409 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-04-26T21:22:04.409 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T21:22:04.409 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T21:22:04.409 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T21:22:04.410 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-04-26T21:22:04.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:22:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:22:05.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:22:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:22:05.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:22:05.169 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-04-26T21:22:05.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:22:05.227 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list-id 2024-04-26T21:22:05.280 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:22:05.280 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-04-26T21:22:05.281 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:22:05.281 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-26T21:22:05.281 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-04-26T21:22:05.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:22:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:22:05.410 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:05 smithi120 ceph-mon[32741]: pgmap v239: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-04-26T21:22:05.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:05 smithi084 ceph-mon[25539]: pgmap v239: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-04-26T21:22:05.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:22:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:22:05.465 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-26T21:22:05.465 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:22:05.465 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-04-26T21:22:05.465 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-26T21:22:05.465 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T21:22:05.465 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-26T21:22:05.465 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-26T21:22:05.465 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-26T21:22:05.466 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-04-26T21:22:05.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:22:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:22:05.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:22:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:22:05.748 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:22:05.748 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-04-26T21:22:05.748 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.0 up 2024-04-26T21:22:05.748 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T21:22:05.749 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-04-26T21:22:05.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:22:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:22:05.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:22:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:22:05.949 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-26T21:22:05.950 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:22:05.950 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-26T21:22:05.992 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-26T21:22:05.993 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:22:05.993 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-26T21:22:06.086 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2024-04-26T21:22:06.165 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:22:06.218 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2024-04-26T21:22:06.218 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2024-04-26T21:22:06.218 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2024-04-26T21:22:06.218 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2024-04-26T21:22:06.219 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2024-04-26T21:22:06.219 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2024-04-26T21:22:06.219 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2024-04-26T21:22:06.219 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2024-04-26T21:22:06.219 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2024-04-26T21:22:06.219 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2024-04-26T21:22:06.219 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2024-04-26T21:22:06.219 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/selinux 2024-04-26T21:22:06.219 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:22:06.219 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2024-04-26T21:22:06.219 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2024-04-26T21:22:06.219 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2024-04-26T21:22:06.219 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2024-04-26T21:22:06.220 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2024-04-26T21:22:06.220 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2024-04-26T21:22:06.220 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysctl.service 2024-04-26T21:22:06.220 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-26T21:22:06.220 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-26T21:22:06.220 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/nfs/rpc_pipefs 2024-04-26T21:22:06.220 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2024-04-26T21:22:06.220 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2024-04-26T21:22:06.220 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/0 2024-04-26T21:22:06.220 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:22:06.220 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay 2024-04-26T21:22:06.220 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/1120fc9158a6c2893720338dd16bc3f723a86610d8dcb0603bb5bf5ef9831a26/merged 2024-04-26T21:22:06.220 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/f76866580057e4b6a469fe67c2b0ea281098629b46b08c71a7a1fe40d36a17b3/merged 2024-04-26T21:22:06.220 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/3d77498d5a41f4e67679ce2b107d22346caa89e4ec20bdb634ea875085f1c46c/merged 2024-04-26T21:22:06.220 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/f8e86e852a63205241919073be479b0a3ca8ffc1a4228201a6dd472eb64f73a3/merged 2024-04-26T21:22:06.221 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/2961cd8d210a8b4c9722c15a658d78e42f6aedd826fc953269380c5ff1a0bdf8/merged 2024-04-26T21:22:06.221 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/86ee0945321a19e8f2c362cc916eff5cf3118c6a91f62fe78e8fe8ffd40327cd/merged 2024-04-26T21:22:06.221 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/0489c7f5b3e2ce5666af5e13ceeda34a452bc93c0b7cc9bf6dd9c1ade0c9358d/merged 2024-04-26T21:22:06.221 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/15ddf0da144ca397f0682c4284251d1d196095e3e3f9b86505fb6b988a80e72c/merged 2024-04-26T21:22:06.221 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/bf93863de47ca32d52145bdafd69efd3d2579c5646633666ffbcf599db948e2b/merged 2024-04-26T21:22:06.221 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2024-04-26T21:22:06.221 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:22:06.221 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:22:06.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:22:06.222 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2024-04-26T21:22:06.276 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T21:22:06.276 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-26T21:22:06.280 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2024-04-26T21:22:06.348 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:22:06.393 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2024-04-26T21:22:06.393 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2024-04-26T21:22:06.393 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2024-04-26T21:22:06.393 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2024-04-26T21:22:06.393 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2024-04-26T21:22:06.393 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2024-04-26T21:22:06.394 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2024-04-26T21:22:06.394 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2024-04-26T21:22:06.394 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2024-04-26T21:22:06.394 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2024-04-26T21:22:06.394 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2024-04-26T21:22:06.394 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/selinux 2024-04-26T21:22:06.394 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:22:06.394 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2024-04-26T21:22:06.394 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2024-04-26T21:22:06.394 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2024-04-26T21:22:06.394 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2024-04-26T21:22:06.394 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2024-04-26T21:22:06.394 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2024-04-26T21:22:06.395 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysctl.service 2024-04-26T21:22:06.395 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-26T21:22:06.395 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-26T21:22:06.395 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/nfs/rpc_pipefs 2024-04-26T21:22:06.395 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2024-04-26T21:22:06.395 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2024-04-26T21:22:06.395 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/0 2024-04-26T21:22:06.395 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:22:06.395 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay 2024-04-26T21:22:06.395 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/1120fc9158a6c2893720338dd16bc3f723a86610d8dcb0603bb5bf5ef9831a26/merged 2024-04-26T21:22:06.395 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/f76866580057e4b6a469fe67c2b0ea281098629b46b08c71a7a1fe40d36a17b3/merged 2024-04-26T21:22:06.395 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/3d77498d5a41f4e67679ce2b107d22346caa89e4ec20bdb634ea875085f1c46c/merged 2024-04-26T21:22:06.395 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/f8e86e852a63205241919073be479b0a3ca8ffc1a4228201a6dd472eb64f73a3/merged 2024-04-26T21:22:06.395 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/2961cd8d210a8b4c9722c15a658d78e42f6aedd826fc953269380c5ff1a0bdf8/merged 2024-04-26T21:22:06.396 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/86ee0945321a19e8f2c362cc916eff5cf3118c6a91f62fe78e8fe8ffd40327cd/merged 2024-04-26T21:22:06.396 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/0489c7f5b3e2ce5666af5e13ceeda34a452bc93c0b7cc9bf6dd9c1ade0c9358d/merged 2024-04-26T21:22:06.396 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/15ddf0da144ca397f0682c4284251d1d196095e3e3f9b86505fb6b988a80e72c/merged 2024-04-26T21:22:06.396 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/bf93863de47ca32d52145bdafd69efd3d2579c5646633666ffbcf599db948e2b/merged 2024-04-26T21:22:06.396 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2024-04-26T21:22:06.396 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:22:06.396 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:22:06.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:22:06.397 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2024-04-26T21:22:06.532 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:2024-04-26T21:22:06.531+0000 7fdfeb4e9300 -1 init, newargv = 0x555d0f340be0 newargc=15 2024-04-26T21:22:06.533 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:ceph-fuse[58312]: starting ceph client 2024-04-26T21:22:06.549 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:ceph-fuse[58312]: starting fuse 2024-04-26T21:22:07.314 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:07 smithi084 ceph-mon[25539]: pgmap v240: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-04-26T21:22:07.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:07 smithi120 ceph-mon[32741]: pgmap v240: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-04-26T21:22:07.586 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2024-04-26T21:22:07.677 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:22:07.731 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2024-04-26T21:22:07.731 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2024-04-26T21:22:07.731 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2024-04-26T21:22:07.731 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2024-04-26T21:22:07.731 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2024-04-26T21:22:07.731 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2024-04-26T21:22:07.732 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2024-04-26T21:22:07.732 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2024-04-26T21:22:07.732 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2024-04-26T21:22:07.732 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2024-04-26T21:22:07.732 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2024-04-26T21:22:07.732 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/selinux 2024-04-26T21:22:07.732 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:22:07.732 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2024-04-26T21:22:07.732 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2024-04-26T21:22:07.732 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2024-04-26T21:22:07.732 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2024-04-26T21:22:07.732 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2024-04-26T21:22:07.732 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2024-04-26T21:22:07.732 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysctl.service 2024-04-26T21:22:07.733 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-26T21:22:07.733 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-26T21:22:07.733 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/nfs/rpc_pipefs 2024-04-26T21:22:07.733 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2024-04-26T21:22:07.733 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2024-04-26T21:22:07.733 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/0 2024-04-26T21:22:07.733 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:22:07.733 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay 2024-04-26T21:22:07.733 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/1120fc9158a6c2893720338dd16bc3f723a86610d8dcb0603bb5bf5ef9831a26/merged 2024-04-26T21:22:07.733 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/f76866580057e4b6a469fe67c2b0ea281098629b46b08c71a7a1fe40d36a17b3/merged 2024-04-26T21:22:07.733 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/3d77498d5a41f4e67679ce2b107d22346caa89e4ec20bdb634ea875085f1c46c/merged 2024-04-26T21:22:07.733 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/f8e86e852a63205241919073be479b0a3ca8ffc1a4228201a6dd472eb64f73a3/merged 2024-04-26T21:22:07.733 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/2961cd8d210a8b4c9722c15a658d78e42f6aedd826fc953269380c5ff1a0bdf8/merged 2024-04-26T21:22:07.733 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/86ee0945321a19e8f2c362cc916eff5cf3118c6a91f62fe78e8fe8ffd40327cd/merged 2024-04-26T21:22:07.734 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/0489c7f5b3e2ce5666af5e13ceeda34a452bc93c0b7cc9bf6dd9c1ade0c9358d/merged 2024-04-26T21:22:07.734 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/15ddf0da144ca397f0682c4284251d1d196095e3e3f9b86505fb6b988a80e72c/merged 2024-04-26T21:22:07.734 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/bf93863de47ca32d52145bdafd69efd3d2579c5646633666ffbcf599db948e2b/merged 2024-04-26T21:22:07.734 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2024-04-26T21:22:07.734 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:22:07.734 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:22:07.734 INFO:teuthology.orchestra.run.smithi120.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-26T21:22:07.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:22:07.735 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2024-04-26T21:22:07.784 INFO:teuthology.orchestra.run.smithi120.stdout:111 2024-04-26T21:22:07.784 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [111] 2024-04-26T21:22:07.784 DEBUG:teuthology.orchestra.run.smithi120:> sudo stdin-killer -- python3 -c ' 2024-04-26T21:22:07.784 DEBUG:teuthology.orchestra.run.smithi120:> import glob 2024-04-26T21:22:07.784 DEBUG:teuthology.orchestra.run.smithi120:> import re 2024-04-26T21:22:07.784 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-04-26T21:22:07.785 DEBUG:teuthology.orchestra.run.smithi120:> import subprocess 2024-04-26T21:22:07.785 DEBUG:teuthology.orchestra.run.smithi120:> 2024-04-26T21:22:07.785 DEBUG:teuthology.orchestra.run.smithi120:> def _find_admin_socket(client_name): 2024-04-26T21:22:07.785 DEBUG:teuthology.orchestra.run.smithi120:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-26T21:22:07.785 DEBUG:teuthology.orchestra.run.smithi120:> files = glob.glob(asok_path) 2024-04-26T21:22:07.785 DEBUG:teuthology.orchestra.run.smithi120:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-26T21:22:07.785 DEBUG:teuthology.orchestra.run.smithi120:> 2024-04-26T21:22:07.785 DEBUG:teuthology.orchestra.run.smithi120:> # Given a non-glob path, it better be there 2024-04-26T21:22:07.785 DEBUG:teuthology.orchestra.run.smithi120:> if "*" not in asok_path: 2024-04-26T21:22:07.785 DEBUG:teuthology.orchestra.run.smithi120:> assert(len(files) == 1) 2024-04-26T21:22:07.785 DEBUG:teuthology.orchestra.run.smithi120:> return files[0] 2024-04-26T21:22:07.785 DEBUG:teuthology.orchestra.run.smithi120:> 2024-04-26T21:22:07.785 DEBUG:teuthology.orchestra.run.smithi120:> for f in files: 2024-04-26T21:22:07.785 DEBUG:teuthology.orchestra.run.smithi120:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T21:22:07.785 DEBUG:teuthology.orchestra.run.smithi120:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T21:22:07.786 DEBUG:teuthology.orchestra.run.smithi120:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T21:22:07.786 DEBUG:teuthology.orchestra.run.smithi120:> contents = proc_f.read() 2024-04-26T21:22:07.786 DEBUG:teuthology.orchestra.run.smithi120:> if mountpoint in contents: 2024-04-26T21:22:07.786 DEBUG:teuthology.orchestra.run.smithi120:> return f 2024-04-26T21:22:07.786 DEBUG:teuthology.orchestra.run.smithi120:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T21:22:07.786 DEBUG:teuthology.orchestra.run.smithi120:> 2024-04-26T21:22:07.786 DEBUG:teuthology.orchestra.run.smithi120:> print(_find_admin_socket("client.1")) 2024-04-26T21:22:07.786 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-04-26T21:22:07.942 INFO:teuthology.orchestra.run.smithi120.stdout:/var/run/ceph/ceph-client.1.58312.asok 2024-04-26T21:22:07.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T21:22:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:22:07.962 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.58312.asok 2024-04-26T21:22:07.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:22:07.962 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.58312.asok status 2024-04-26T21:22:08.187 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T21:22:08.187 INFO:teuthology.orchestra.run.smithi120.stdout: "metadata": { 2024-04-26T21:22:08.187 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_sha1": "2be3efa97a7972f8e925bd899b474329979b74d6", 2024-04-26T21:22:08.187 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_version": "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)", 2024-04-26T21:22:08.187 INFO:teuthology.orchestra.run.smithi120.stdout: "entity_id": "1", 2024-04-26T21:22:08.187 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": "smithi120", 2024-04-26T21:22:08.187 INFO:teuthology.orchestra.run.smithi120.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-26T21:22:08.187 INFO:teuthology.orchestra.run.smithi120.stdout: "pid": "58312", 2024-04-26T21:22:08.187 INFO:teuthology.orchestra.run.smithi120.stdout: "root": "/" 2024-04-26T21:22:08.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T21:22:08.188 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_count": 0, 2024-04-26T21:22:08.188 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_pinned_count": 0, 2024-04-26T21:22:08.188 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 24273, 2024-04-26T21:22:08.188 INFO:teuthology.orchestra.run.smithi120.stdout: "inst": { 2024-04-26T21:22:08.188 INFO:teuthology.orchestra.run.smithi120.stdout: "name": { 2024-04-26T21:22:08.188 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "client", 2024-04-26T21:22:08.188 INFO:teuthology.orchestra.run.smithi120.stdout: "num": 24273 2024-04-26T21:22:08.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T21:22:08.188 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2024-04-26T21:22:08.188 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-04-26T21:22:08.188 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.1:0", 2024-04-26T21:22:08.188 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1517871093 2024-04-26T21:22:08.189 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T21:22:08.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T21:22:08.189 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2024-04-26T21:22:08.189 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-04-26T21:22:08.189 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.1:0", 2024-04-26T21:22:08.189 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1517871093 2024-04-26T21:22:08.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T21:22:08.189 INFO:teuthology.orchestra.run.smithi120.stdout: "inst_str": "client.24273 192.168.0.1:0/1517871093", 2024-04-26T21:22:08.189 INFO:teuthology.orchestra.run.smithi120.stdout: "addr_str": "192.168.0.1:0/1517871093", 2024-04-26T21:22:08.189 INFO:teuthology.orchestra.run.smithi120.stdout: "inode_count": 1, 2024-04-26T21:22:08.189 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_epoch": 11, 2024-04-26T21:22:08.189 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch": 45, 2024-04-26T21:22:08.189 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch_barrier": 0, 2024-04-26T21:22:08.189 INFO:teuthology.orchestra.run.smithi120.stdout: "blocklisted": false, 2024-04-26T21:22:08.189 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs" 2024-04-26T21:22:08.189 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T21:22:08.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:22:08.202 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2024-04-26T21:22:08.202 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T21:22:08.258 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2024-04-26T21:22:08.259 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T21:22:08.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:22:08.259 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T21:22:08.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:22:08.342 DEBUG:teuthology.orchestra.run.smithi120:> stat --file-system '--printf=%T 2024-04-26T21:22:08.342 DEBUG:teuthology.orchestra.run.smithi120:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-26T21:22:08.401 INFO:teuthology.orchestra.run.smithi120.stdout:fuseblk 2024-04-26T21:22:08.402 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-26T21:22:08.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:22:08.402 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-26T21:22:08.553 INFO:teuthology.run_tasks:Running task print... 2024-04-26T21:22:08.563 INFO:teuthology.task.print:**** done client 2024-04-26T21:22:08.563 INFO:teuthology.run_tasks:Running task parallel... 2024-04-26T21:22:08.573 INFO:teuthology.task.parallel:starting parallel... 2024-04-26T21:22:08.573 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-26T21:22:08.574 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-26T21:22:08.574 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi084.front.sepia.ceph.com 2024-04-26T21:22:08.574 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-04-26T21:22:08.575 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-26T21:22:08.575 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-04-26T21:22:08.578 INFO:tasks.workunit:Pulling workunits from ref bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:22:08.579 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T21:22:08.579 INFO:tasks.workunit:timeout=3h 2024-04-26T21:22:08.579 INFO:tasks.workunit:cleanup=True 2024-04-26T21:22:08.579 DEBUG:teuthology.orchestra.run.smithi084:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T21:22:08.629 INFO:teuthology.orchestra.run.smithi084.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-26T21:22:08.629 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-26T21:22:08.629 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 90h/144d Inode: 1 Links: 2 2024-04-26T21:22:08.629 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:22:08.629 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-26T21:22:08.629 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-26T21:22:08.629 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-04-26 21:21:19.083410801 +0000 2024-04-26T21:22:08.629 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-04-26 21:22:08.334738902 +0000 2024-04-26T21:22:08.629 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2024-04-26T21:22:08.629 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-26T21:22:08.629 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-26T21:22:08.756 DEBUG:teuthology.orchestra.run.smithi120:> stat -- /home/ubuntu/cephtest/mnt.1 2024-04-26T21:22:08.819 INFO:teuthology.orchestra.run.smithi120.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-04-26T21:22:08.819 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-26T21:22:08.819 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6fh/111d Inode: 1 Links: 3 2024-04-26T21:22:08.819 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:22:08.819 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-26T21:22:08.819 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-26T21:22:08.820 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-04-26 21:22:08.743209661 +0000 2024-04-26T21:22:08.820 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-04-26 21:22:08.743209661 +0000 2024-04-26T21:22:08.820 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-04-26T21:22:08.820 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-04-26T21:22:08.820 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-04-26T21:22:08.922 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:22:08.922 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:22:08.964 INFO:tasks.workunit.client.0.smithi084.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T21:22:08.979 INFO:tasks.workunit.client.1.smithi120.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-04-26T21:22:09.014 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:22:09.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:09 smithi084 ceph-mon[25539]: pgmap v241: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-04-26T21:22:09.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:09 smithi120 ceph-mon[32741]: pgmap v241: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-04-26T21:22:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.161+0000 7f4f8cc00700 1 -- 172.21.15.84:0/2617517642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f88070890 msgr2=0x7f4f88070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.161+0000 7f4f8cc00700 1 --2- 172.21.15.84:0/2617517642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f88070890 0x7f4f88070d00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4f70004940 tx=0x7f4f70009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.161+0000 7f4f8cc00700 1 -- 172.21.15.84:0/2617517642 shutdown_connections 2024-04-26T21:22:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.161+0000 7f4f8cc00700 1 --2- 172.21.15.84:0/2617517642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f88070890 0x7f4f88070d00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.161+0000 7f4f8cc00700 1 --2- 172.21.15.84:0/2617517642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f88071e40 0x7f4f88070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.161+0000 7f4f8cc00700 1 -- 172.21.15.84:0/2617517642 >> 172.21.15.84:0/2617517642 conn(0x7f4f880f8540 msgr2=0x7f4f880fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.162+0000 7f4f8cc00700 1 -- 172.21.15.84:0/2617517642 shutdown_connections 2024-04-26T21:22:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.162+0000 7f4f8cc00700 1 -- 172.21.15.84:0/2617517642 wait complete. 2024-04-26T21:22:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.162+0000 7f4f8cc00700 1 Processor -- start 2024-04-26T21:22:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.163+0000 7f4f8cc00700 1 -- start start 2024-04-26T21:22:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.163+0000 7f4f8cc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f88070890 0x7f4f88113fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.163+0000 7f4f8cc00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f88071e40 0x7f4f88114500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.163+0000 7f4f8cc00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f88114b90 con 0x7f4f88071e40 2024-04-26T21:22:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.163+0000 7f4f8cc00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f881194e0 con 0x7f4f88070890 2024-04-26T21:22:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.163+0000 7f4f7d400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f88071e40 0x7f4f88114500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.164+0000 7f4f7d400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f88071e40 0x7f4f88114500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49376/0 (socket says 172.21.15.84:49376) 2024-04-26T21:22:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.164+0000 7f4f7d400700 1 -- 172.21.15.84:0/3700936801 learned_addr learned my addr 172.21.15.84:0/3700936801 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:22:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.164+0000 7f4f85e00700 1 --2- 172.21.15.84:0/3700936801 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f88070890 0x7f4f88113fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.164+0000 7f4f7d400700 1 -- 172.21.15.84:0/3700936801 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f88070890 msgr2=0x7f4f88113fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.164+0000 7f4f7d400700 1 --2- 172.21.15.84:0/3700936801 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f88070890 0x7f4f88113fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.164+0000 7f4f7d400700 1 -- 172.21.15.84:0/3700936801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f70005040 con 0x7f4f88071e40 2024-04-26T21:22:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.164+0000 7f4f7d400700 1 --2- 172.21.15.84:0/3700936801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f88071e40 0x7f4f88114500 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009150 tx=0x7f4f70009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:11.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.164+0000 7f4f7ea00700 1 -- 172.21.15.84:0/3700936801 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f7000e040 con 0x7f4f88071e40 2024-04-26T21:22:11.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.165+0000 7f4f7ea00700 1 -- 172.21.15.84:0/3700936801 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f7000bbf0 con 0x7f4f88071e40 2024-04-26T21:22:11.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.165+0000 7f4f8cc00700 1 -- 172.21.15.84:0/3700936801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f881196e0 con 0x7f4f88071e40 2024-04-26T21:22:11.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.165+0000 7f4f7ea00700 1 -- 172.21.15.84:0/3700936801 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f7001c630 con 0x7f4f88071e40 2024-04-26T21:22:11.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.165+0000 7f4f8cc00700 1 -- 172.21.15.84:0/3700936801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f88119c50 con 0x7f4f88071e40 2024-04-26T21:22:11.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.166+0000 7f4f8cc00700 1 -- 172.21.15.84:0/3700936801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f8804c710 con 0x7f4f88071e40 2024-04-26T21:22:11.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.167+0000 7f4f7ea00700 1 -- 172.21.15.84:0/3700936801 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4f7000bd60 con 0x7f4f88071e40 2024-04-26T21:22:11.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.168+0000 7f4f7ea00700 1 --2- 172.21.15.84:0/3700936801 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f4f6c0692a0 0x7f4f6c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:11.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.168+0000 7f4f7ea00700 1 -- 172.21.15.84:0/3700936801 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4f70088690 con 0x7f4f88071e40 2024-04-26T21:22:11.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.168+0000 7f4f85e00700 1 --2- 172.21.15.84:0/3700936801 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f4f6c0692a0 0x7f4f6c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:11.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.169+0000 7f4f85e00700 1 --2- 172.21.15.84:0/3700936801 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f4f6c0692a0 0x7f4f6c06b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4f88071b80 tx=0x7f4f78009620 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:11.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.173+0000 7f4f7ea00700 1 -- 172.21.15.84:0/3700936801 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4f70058460 con 0x7f4f88071e40 2024-04-26T21:22:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.392+0000 7f4f8cc00700 1 -- 172.21.15.84:0/3700936801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f4f8810bf60 con 0x7f4f88071e40 2024-04-26T21:22:11.393 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:11 smithi084 ceph-mon[25539]: pgmap v242: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-26T21:22:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:11.393+0000 7f4f7ea00700 1 -- 172.21.15.84:0/3700936801 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7f4f70057ff0 con 0x7f4f88071e40 2024-04-26T21:22:11.395 INFO:teuthology.orchestra.run.smithi084.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2024-04-26T21:22:11.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:11 smithi120 ceph-mon[32741]: pgmap v242: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-26T21:22:12.195 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-26T21:22:12.196 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi084.front.sepia.ceph.com 2024-04-26T21:22:12.196 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-04-26T21:22:12.311 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:12 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:22:12.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:12 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:22:12.722 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:22:13.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:13 smithi084 ceph-mon[25539]: pgmap v243: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-04-26T21:22:13.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:13 smithi120 ceph-mon[32741]: pgmap v243: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-04-26T21:22:14.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.801+0000 7f0e3ca00700 1 -- 172.21.15.84:0/3998062935 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e2c00bcb0 con 0x7f0e400fdfd0 2024-04-26T21:22:14.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.802+0000 7f0e44a00700 1 -- 172.21.15.84:0/3998062935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e400fdfd0 msgr2=0x7f0e400fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:14.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.802+0000 7f0e44a00700 1 --2- 172.21.15.84:0/3998062935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e400fdfd0 0x7f0e400fe440 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c004940 tx=0x7f0e2c009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:14.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.802+0000 7f0e44a00700 1 -- 172.21.15.84:0/3998062935 shutdown_connections 2024-04-26T21:22:14.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.802+0000 7f0e44a00700 1 --2- 172.21.15.84:0/3998062935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e400fdfd0 0x7f0e400fe440 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:14.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.802+0000 7f0e44a00700 1 --2- 172.21.15.84:0/3998062935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e400fce60 0x7f0e400fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:14.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.802+0000 7f0e44a00700 1 -- 172.21.15.84:0/3998062935 >> 172.21.15.84:0/3998062935 conn(0x7f0e400f8540 msgr2=0x7f0e400fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:14.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.802+0000 7f0e44a00700 1 -- 172.21.15.84:0/3998062935 shutdown_connections 2024-04-26T21:22:14.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.802+0000 7f0e44a00700 1 -- 172.21.15.84:0/3998062935 wait complete. 2024-04-26T21:22:14.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.803+0000 7f0e44a00700 1 Processor -- start 2024-04-26T21:22:14.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.803+0000 7f0e44a00700 1 -- start start 2024-04-26T21:22:14.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.803+0000 7f0e44a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e400fce60 0x7f0e4010fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:14.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.803+0000 7f0e44a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e400fdfd0 0x7f0e40110090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:14.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.803+0000 7f0e44a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e40110690 con 0x7f0e400fce60 2024-04-26T21:22:14.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.803+0000 7f0e44a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e40110800 con 0x7f0e400fdfd0 2024-04-26T21:22:14.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.804+0000 7f0e3de00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e400fce60 0x7f0e4010fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:14.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.804+0000 7f0e3de00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e400fce60 0x7f0e4010fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41856/0 (socket says 172.21.15.84:41856) 2024-04-26T21:22:14.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.804+0000 7f0e3de00700 1 -- 172.21.15.84:0/1766553030 learned_addr learned my addr 172.21.15.84:0/1766553030 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:22:14.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.804+0000 7f0e3d400700 1 --2- 172.21.15.84:0/1766553030 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e400fdfd0 0x7f0e40110090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:14.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.804+0000 7f0e3de00700 1 -- 172.21.15.84:0/1766553030 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e400fdfd0 msgr2=0x7f0e40110090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:14.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.804+0000 7f0e3de00700 1 --2- 172.21.15.84:0/1766553030 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e400fdfd0 0x7f0e40110090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:14.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.804+0000 7f0e3de00700 1 -- 172.21.15.84:0/1766553030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c005040 con 0x7f0e400fce60 2024-04-26T21:22:14.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.805+0000 7f0e3de00700 1 --2- 172.21.15.84:0/1766553030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e400fce60 0x7f0e4010fb50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000c8c0 tx=0x7f0e300044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:14.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.805+0000 7f0e36000700 1 -- 172.21.15.84:0/1766553030 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e3000a980 con 0x7f0e400fce60 2024-04-26T21:22:14.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.805+0000 7f0e36000700 1 -- 172.21.15.84:0/1766553030 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0e3000ce60 con 0x7f0e400fce60 2024-04-26T21:22:14.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.805+0000 7f0e36000700 1 -- 172.21.15.84:0/1766553030 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e300115e0 con 0x7f0e400fce60 2024-04-26T21:22:14.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.805+0000 7f0e44a00700 1 -- 172.21.15.84:0/1766553030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e40115260 con 0x7f0e400fce60 2024-04-26T21:22:14.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.805+0000 7f0e44a00700 1 -- 172.21.15.84:0/1766553030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e401157d0 con 0x7f0e400fce60 2024-04-26T21:22:14.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.806+0000 7f0e44a00700 1 -- 172.21.15.84:0/1766553030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e40101960 con 0x7f0e400fce60 2024-04-26T21:22:14.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.807+0000 7f0e36000700 1 -- 172.21.15.84:0/1766553030 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f0e30012400 con 0x7f0e400fce60 2024-04-26T21:22:14.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.808+0000 7f0e36000700 1 --2- 172.21.15.84:0/1766553030 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f0e240692a0 0x7f0e2406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:14.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.808+0000 7f0e36000700 1 -- 172.21.15.84:0/1766553030 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0e300872a0 con 0x7f0e400fce60 2024-04-26T21:22:14.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.808+0000 7f0e3d400700 1 --2- 172.21.15.84:0/1766553030 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f0e240692a0 0x7f0e2406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:14.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.809+0000 7f0e3d400700 1 --2- 172.21.15.84:0/1766553030 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f0e240692a0 0x7f0e2406b750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c000c00 tx=0x7f0e2c009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:14.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:14.813+0000 7f0e36000700 1 -- 172.21.15.84:0/1766553030 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0e30057060 con 0x7f0e400fce60 2024-04-26T21:22:15.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:15.024+0000 7f0e44a00700 1 -- 172.21.15.84:0/1766553030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f0e4004c710 con 0x7f0e400fce60 2024-04-26T21:22:15.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:15.025+0000 7f0e36000700 1 -- 172.21.15.84:0/1766553030 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f0e300126b0 con 0x7f0e400fce60 2024-04-26T21:22:15.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:15.027+0000 7f0e44a00700 1 -- 172.21.15.84:0/1766553030 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f0e240692a0 msgr2=0x7f0e2406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:15.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:15.027+0000 7f0e44a00700 1 --2- 172.21.15.84:0/1766553030 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f0e240692a0 0x7f0e2406b750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c000c00 tx=0x7f0e2c009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:15.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:15.028+0000 7f0e44a00700 1 -- 172.21.15.84:0/1766553030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e400fce60 msgr2=0x7f0e4010fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:15.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:15.028+0000 7f0e44a00700 1 --2- 172.21.15.84:0/1766553030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e400fce60 0x7f0e4010fb50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000c8c0 tx=0x7f0e300044c0 comp rx=0 tx=0).stop 2024-04-26T21:22:15.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:15.028+0000 7f0e44a00700 1 -- 172.21.15.84:0/1766553030 shutdown_connections 2024-04-26T21:22:15.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:15.028+0000 7f0e44a00700 1 --2- 172.21.15.84:0/1766553030 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f0e240692a0 0x7f0e2406b750 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:15.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:15.028+0000 7f0e44a00700 1 --2- 172.21.15.84:0/1766553030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e400fce60 0x7f0e4010fb50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:15.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:15.028+0000 7f0e44a00700 1 --2- 172.21.15.84:0/1766553030 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e400fdfd0 0x7f0e40110090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:15.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:15.028+0000 7f0e44a00700 1 -- 172.21.15.84:0/1766553030 >> 172.21.15.84:0/1766553030 conn(0x7f0e400f8540 msgr2=0x7f0e400f9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:15.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:15.028+0000 7f0e44a00700 1 -- 172.21.15.84:0/1766553030 shutdown_connections 2024-04-26T21:22:15.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:15.028+0000 7f0e44a00700 1 -- 172.21.15.84:0/1766553030 wait complete. 2024-04-26T21:22:15.385 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:15 smithi084 ceph-mon[25539]: pgmap v244: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-04-26T21:22:15.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:15 smithi120 ceph-mon[32741]: pgmap v244: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-04-26T21:22:15.757 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-04-26T21:22:16.221 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:22:17.375 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:17 smithi084 ceph-mon[25539]: pgmap v245: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-26T21:22:17.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:17 smithi120 ceph-mon[32741]: pgmap v245: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-26T21:22:18.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.359+0000 7f627e800700 1 -- 172.21.15.84:0/4190797827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62780feff0 msgr2=0x7f62780ff400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:18.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.359+0000 7f627e800700 1 --2- 172.21.15.84:0/4190797827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62780feff0 0x7f62780ff400 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6268004940 tx=0x7f6268009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:18.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.359+0000 7f627e800700 1 -- 172.21.15.84:0/4190797827 shutdown_connections 2024-04-26T21:22:18.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.359+0000 7f627e800700 1 --2- 172.21.15.84:0/4190797827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62781002a0 0x7f6278100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:18.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.359+0000 7f627e800700 1 --2- 172.21.15.84:0/4190797827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62780feff0 0x7f62780ff400 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:18.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.359+0000 7f627e800700 1 -- 172.21.15.84:0/4190797827 >> 172.21.15.84:0/4190797827 conn(0x7f62780fa8f0 msgr2=0x7f62780fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:18.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.359+0000 7f627e800700 1 -- 172.21.15.84:0/4190797827 shutdown_connections 2024-04-26T21:22:18.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.359+0000 7f627e800700 1 -- 172.21.15.84:0/4190797827 wait complete. 2024-04-26T21:22:18.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.360+0000 7f627e800700 1 Processor -- start 2024-04-26T21:22:18.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.360+0000 7f627e800700 1 -- start start 2024-04-26T21:22:18.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.361+0000 7f627e800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62780feff0 0x7f627810faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:18.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.361+0000 7f627e800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62781002a0 0x7f627810ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:18.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.361+0000 7f627e800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62781105e0 con 0x7f62780feff0 2024-04-26T21:22:18.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.361+0000 7f627e800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6278110750 con 0x7f62781002a0 2024-04-26T21:22:18.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.361+0000 7f6277400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62780feff0 0x7f627810faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:18.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.361+0000 7f6277400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62780feff0 0x7f627810faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41874/0 (socket says 172.21.15.84:41874) 2024-04-26T21:22:18.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.361+0000 7f6277400700 1 -- 172.21.15.84:0/2111561105 learned_addr learned my addr 172.21.15.84:0/2111561105 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:22:18.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.361+0000 7f6276a00700 1 --2- 172.21.15.84:0/2111561105 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62781002a0 0x7f627810ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:18.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.361+0000 7f6277400700 1 -- 172.21.15.84:0/2111561105 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62781002a0 msgr2=0x7f627810ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:18.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.361+0000 7f6277400700 1 --2- 172.21.15.84:0/2111561105 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62781002a0 0x7f627810ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:18.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.361+0000 7f6277400700 1 -- 172.21.15.84:0/2111561105 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6268005040 con 0x7f62780feff0 2024-04-26T21:22:18.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.362+0000 7f6277400700 1 --2- 172.21.15.84:0/2111561105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62780feff0 0x7f627810faa0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6268013870 tx=0x7f6268009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:18.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.362+0000 7f626f400700 1 -- 172.21.15.84:0/2111561105 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6268021070 con 0x7f62780feff0 2024-04-26T21:22:18.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.362+0000 7f627e800700 1 -- 172.21.15.84:0/2111561105 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6278115150 con 0x7f62780feff0 2024-04-26T21:22:18.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.362+0000 7f626f400700 1 -- 172.21.15.84:0/2111561105 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f626801c400 con 0x7f62780feff0 2024-04-26T21:22:18.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.362+0000 7f626f400700 1 -- 172.21.15.84:0/2111561105 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f626800e070 con 0x7f62780feff0 2024-04-26T21:22:18.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.362+0000 7f627e800700 1 -- 172.21.15.84:0/2111561105 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6278115690 con 0x7f62780feff0 2024-04-26T21:22:18.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.364+0000 7f627e800700 1 -- 172.21.15.84:0/2111561105 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627804c710 con 0x7f62780feff0 2024-04-26T21:22:18.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.364+0000 7f626f400700 1 -- 172.21.15.84:0/2111561105 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f626801ca20 con 0x7f62780feff0 2024-04-26T21:22:18.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.365+0000 7f626f400700 1 --2- 172.21.15.84:0/2111561105 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f625c0692a0 0x7f625c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:18.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.365+0000 7f626f400700 1 -- 172.21.15.84:0/2111561105 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6268088620 con 0x7f62780feff0 2024-04-26T21:22:18.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.365+0000 7f6276a00700 1 --2- 172.21.15.84:0/2111561105 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f625c0692a0 0x7f625c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:18.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.366+0000 7f6276a00700 1 --2- 172.21.15.84:0/2111561105 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f625c0692a0 0x7f625c06b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6264004600 tx=0x7f626400b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:18.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.371+0000 7f626f400700 1 -- 172.21.15.84:0/2111561105 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6268058340 con 0x7f62780feff0 2024-04-26T21:22:18.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.584+0000 7f627e800700 1 -- 172.21.15.84:0/2111561105 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f6278107ae0 con 0x7f62780feff0 2024-04-26T21:22:18.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.585+0000 7f626f400700 1 -- 172.21.15.84:0/2111561105 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f6268004490 con 0x7f62780feff0 2024-04-26T21:22:18.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.588+0000 7f627e800700 1 -- 172.21.15.84:0/2111561105 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f625c0692a0 msgr2=0x7f625c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:18.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.588+0000 7f627e800700 1 --2- 172.21.15.84:0/2111561105 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f625c0692a0 0x7f625c06b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6264004600 tx=0x7f626400b040 comp rx=0 tx=0).stop 2024-04-26T21:22:18.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.588+0000 7f627e800700 1 -- 172.21.15.84:0/2111561105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62780feff0 msgr2=0x7f627810faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:18.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.588+0000 7f627e800700 1 --2- 172.21.15.84:0/2111561105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62780feff0 0x7f627810faa0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6268013870 tx=0x7f6268009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:18.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.589+0000 7f627e800700 1 -- 172.21.15.84:0/2111561105 shutdown_connections 2024-04-26T21:22:18.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.589+0000 7f627e800700 1 --2- 172.21.15.84:0/2111561105 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f625c0692a0 0x7f625c06b750 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:18.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.589+0000 7f627e800700 1 --2- 172.21.15.84:0/2111561105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62780feff0 0x7f627810faa0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:18.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.589+0000 7f627e800700 1 --2- 172.21.15.84:0/2111561105 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62781002a0 0x7f627810ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:18.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.589+0000 7f627e800700 1 -- 172.21.15.84:0/2111561105 >> 172.21.15.84:0/2111561105 conn(0x7f62780fa8f0 msgr2=0x7f62780fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:18.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.589+0000 7f627e800700 1 -- 172.21.15.84:0/2111561105 shutdown_connections 2024-04-26T21:22:18.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:18.589+0000 7f627e800700 1 -- 172.21.15.84:0/2111561105 wait complete. 2024-04-26T21:22:19.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:19 smithi084 ceph-mon[25539]: pgmap v246: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-26T21:22:19.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:19 smithi120 ceph-mon[32741]: pgmap v246: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-26T21:22:19.507 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph config set global log_to_journald false --force' 2024-04-26T21:22:19.978 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:22:21.157 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:21 smithi084 ceph-mon[25539]: pgmap v247: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-04-26T21:22:21.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:21 smithi120 ceph-mon[32741]: pgmap v247: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-04-26T21:22:22.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.082+0000 7f5472600700 1 -- 172.21.15.84:0/2815923773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f546c0fbcb0 msgr2=0x7f546c0fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.082+0000 7f5472600700 1 --2- 172.21.15.84:0/2815923773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f546c0fbcb0 0x7f546c0fc0c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f545c004940 tx=0x7f545c009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.083+0000 7f5472600700 1 -- 172.21.15.84:0/2815923773 shutdown_connections 2024-04-26T21:22:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.083+0000 7f5472600700 1 --2- 172.21.15.84:0/2815923773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f546c0fcf60 0x7f546c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.083+0000 7f5472600700 1 --2- 172.21.15.84:0/2815923773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f546c0fbcb0 0x7f546c0fc0c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.083+0000 7f5472600700 1 -- 172.21.15.84:0/2815923773 >> 172.21.15.84:0/2815923773 conn(0x7f546c0f7430 msgr2=0x7f546c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.083+0000 7f5472600700 1 -- 172.21.15.84:0/2815923773 shutdown_connections 2024-04-26T21:22:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.083+0000 7f5472600700 1 -- 172.21.15.84:0/2815923773 wait complete. 2024-04-26T21:22:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.084+0000 7f5472600700 1 Processor -- start 2024-04-26T21:22:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.084+0000 7f5472600700 1 -- start start 2024-04-26T21:22:22.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.084+0000 7f5472600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f546c0fbcb0 0x7f546c10fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.084+0000 7f5472600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f546c0fcf60 0x7f546c1100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.084+0000 7f5472600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c1106a0 con 0x7f546c0fbcb0 2024-04-26T21:22:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.084+0000 7f5472600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c110810 con 0x7f546c0fcf60 2024-04-26T21:22:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.085+0000 7f546b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f546c0fbcb0 0x7f546c10fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.085+0000 7f546b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f546c0fbcb0 0x7f546c10fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53802/0 (socket says 172.21.15.84:53802) 2024-04-26T21:22:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.085+0000 7f546b400700 1 -- 172.21.15.84:0/945405583 learned_addr learned my addr 172.21.15.84:0/945405583 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:22:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.085+0000 7f5463e00700 1 --2- 172.21.15.84:0/945405583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f546c0fcf60 0x7f546c1100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.085+0000 7f546b400700 1 -- 172.21.15.84:0/945405583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f546c0fcf60 msgr2=0x7f546c1100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.085+0000 7f546b400700 1 --2- 172.21.15.84:0/945405583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f546c0fcf60 0x7f546c1100a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.085+0000 7f546b400700 1 -- 172.21.15.84:0/945405583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c005040 con 0x7f546c0fbcb0 2024-04-26T21:22:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.086+0000 7f546b400700 1 --2- 172.21.15.84:0/945405583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f546c0fbcb0 0x7f546c10fb60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f545c00b3b0 tx=0x7f545c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.086+0000 7f5463400700 1 -- 172.21.15.84:0/945405583 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f545c00e040 con 0x7f546c0fbcb0 2024-04-26T21:22:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.086+0000 7f5463400700 1 -- 172.21.15.84:0/945405583 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f545c00bcc0 con 0x7f546c0fbcb0 2024-04-26T21:22:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.086+0000 7f5472600700 1 -- 172.21.15.84:0/945405583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f546c115210 con 0x7f546c0fbcb0 2024-04-26T21:22:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.086+0000 7f5463400700 1 -- 172.21.15.84:0/945405583 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f545c01c630 con 0x7f546c0fbcb0 2024-04-26T21:22:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.086+0000 7f5472600700 1 -- 172.21.15.84:0/945405583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546c1157d0 con 0x7f546c0fbcb0 2024-04-26T21:22:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.087+0000 7f5472600700 1 -- 172.21.15.84:0/945405583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f546c1018f0 con 0x7f546c0fbcb0 2024-04-26T21:22:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.088+0000 7f5463400700 1 -- 172.21.15.84:0/945405583 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f545c013980 con 0x7f546c0fbcb0 2024-04-26T21:22:22.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.089+0000 7f5463400700 1 --2- 172.21.15.84:0/945405583 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f54500692a0 0x7f545006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:22.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.089+0000 7f5463400700 1 -- 172.21.15.84:0/945405583 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f545c088060 con 0x7f546c0fbcb0 2024-04-26T21:22:22.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.090+0000 7f5463e00700 1 --2- 172.21.15.84:0/945405583 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f54500692a0 0x7f545006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:22.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.090+0000 7f5463e00700 1 --2- 172.21.15.84:0/945405583 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f54500692a0 0x7f545006b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5454004990 tx=0x7f5454009ee0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:22.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.094+0000 7f5463400700 1 -- 172.21.15.84:0/945405583 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f545c057d00 con 0x7f546c0fbcb0 2024-04-26T21:22:22.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.306+0000 7f5472600700 1 -- 172.21.15.84:0/945405583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f546c1047a0 con 0x7f546c0fbcb0 2024-04-26T21:22:22.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.306+0000 7f5463400700 1 -- 172.21.15.84:0/945405583 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f545c057890 con 0x7f546c0fbcb0 2024-04-26T21:22:22.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.310+0000 7f5472600700 1 -- 172.21.15.84:0/945405583 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f54500692a0 msgr2=0x7f545006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:22.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.310+0000 7f5472600700 1 --2- 172.21.15.84:0/945405583 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f54500692a0 0x7f545006b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5454004990 tx=0x7f5454009ee0 comp rx=0 tx=0).stop 2024-04-26T21:22:22.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.310+0000 7f5472600700 1 -- 172.21.15.84:0/945405583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f546c0fbcb0 msgr2=0x7f546c10fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:22.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.310+0000 7f5472600700 1 --2- 172.21.15.84:0/945405583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f546c0fbcb0 0x7f546c10fb60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f545c00b3b0 tx=0x7f545c009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.310+0000 7f5472600700 1 -- 172.21.15.84:0/945405583 shutdown_connections 2024-04-26T21:22:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.310+0000 7f5472600700 1 --2- 172.21.15.84:0/945405583 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f54500692a0 0x7f545006b750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.310+0000 7f5472600700 1 --2- 172.21.15.84:0/945405583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f546c0fbcb0 0x7f546c10fb60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.310+0000 7f5472600700 1 --2- 172.21.15.84:0/945405583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f546c0fcf60 0x7f546c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.310+0000 7f5472600700 1 -- 172.21.15.84:0/945405583 >> 172.21.15.84:0/945405583 conn(0x7f546c0f7430 msgr2=0x7f546c0667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.311+0000 7f5472600700 1 -- 172.21.15.84:0/945405583 shutdown_connections 2024-04-26T21:22:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:22.311+0000 7f5472600700 1 -- 172.21.15.84:0/945405583 wait complete. 2024-04-26T21:22:23.190 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-04-26T21:22:23.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:23 smithi084 ceph-mon[25539]: pgmap v248: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-26T21:22:23.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:23 smithi120 ceph-mon[32741]: pgmap v248: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-26T21:22:23.677 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:22:25.346 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:25 smithi084 ceph-mon[25539]: pgmap v249: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-04-26T21:22:25.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:25 smithi120 ceph-mon[32741]: pgmap v249: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-04-26T21:22:25.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.616+0000 7f6e46a00700 1 -- 172.21.15.84:0/2204600414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e400fce60 msgr2=0x7f6e400fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:25.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.616+0000 7f6e46a00700 1 --2- 172.21.15.84:0/2204600414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e400fce60 0x7f6e400fd270 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6e30004940 tx=0x7f6e30009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:25.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.616+0000 7f6e46a00700 1 -- 172.21.15.84:0/2204600414 shutdown_connections 2024-04-26T21:22:25.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.616+0000 7f6e46a00700 1 --2- 172.21.15.84:0/2204600414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e400fdfd0 0x7f6e400fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:25.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.616+0000 7f6e46a00700 1 --2- 172.21.15.84:0/2204600414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e400fce60 0x7f6e400fd270 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:25.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.616+0000 7f6e46a00700 1 -- 172.21.15.84:0/2204600414 >> 172.21.15.84:0/2204600414 conn(0x7f6e400f8540 msgr2=0x7f6e400fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:25.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.616+0000 7f6e46a00700 1 -- 172.21.15.84:0/2204600414 shutdown_connections 2024-04-26T21:22:25.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.616+0000 7f6e46a00700 1 -- 172.21.15.84:0/2204600414 wait complete. 2024-04-26T21:22:25.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.617+0000 7f6e46a00700 1 Processor -- start 2024-04-26T21:22:25.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.617+0000 7f6e46a00700 1 -- start start 2024-04-26T21:22:25.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.617+0000 7f6e46a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e400fce60 0x7f6e4010d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:25.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.617+0000 7f6e46a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e400fdfd0 0x7f6e4010de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:25.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.617+0000 7f6e46a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4010e470 con 0x7f6e400fce60 2024-04-26T21:22:25.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.617+0000 7f6e46a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4010e5e0 con 0x7f6e400fdfd0 2024-04-26T21:22:25.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.618+0000 7f6e3fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e400fce60 0x7f6e4010d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:25.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.618+0000 7f6e3fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e400fce60 0x7f6e4010d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53818/0 (socket says 172.21.15.84:53818) 2024-04-26T21:22:25.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.618+0000 7f6e3fe00700 1 -- 172.21.15.84:0/1713034419 learned_addr learned my addr 172.21.15.84:0/1713034419 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:22:25.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.618+0000 7f6e3f400700 1 --2- 172.21.15.84:0/1713034419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e400fdfd0 0x7f6e4010de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:25.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.618+0000 7f6e3fe00700 1 -- 172.21.15.84:0/1713034419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e400fdfd0 msgr2=0x7f6e4010de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:25.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.618+0000 7f6e3fe00700 1 --2- 172.21.15.84:0/1713034419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e400fdfd0 0x7f6e4010de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:25.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.618+0000 7f6e3fe00700 1 -- 172.21.15.84:0/1713034419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e30005040 con 0x7f6e400fce60 2024-04-26T21:22:25.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.619+0000 7f6e3fe00700 1 --2- 172.21.15.84:0/1713034419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e400fce60 0x7f6e4010d930 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000b3b0 tx=0x7f6e30009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:25.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.619+0000 7f6e37e00700 1 -- 172.21.15.84:0/1713034419 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e3000e040 con 0x7f6e400fce60 2024-04-26T21:22:25.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.619+0000 7f6e37e00700 1 -- 172.21.15.84:0/1713034419 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e30004290 con 0x7f6e400fce60 2024-04-26T21:22:25.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.619+0000 7f6e46a00700 1 -- 172.21.15.84:0/1713034419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e40112fe0 con 0x7f6e400fce60 2024-04-26T21:22:25.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.619+0000 7f6e37e00700 1 -- 172.21.15.84:0/1713034419 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e3001c630 con 0x7f6e400fce60 2024-04-26T21:22:25.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.619+0000 7f6e46a00700 1 -- 172.21.15.84:0/1713034419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e40113510 con 0x7f6e400fce60 2024-04-26T21:22:25.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.620+0000 7f6e46a00700 1 -- 172.21.15.84:0/1713034419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4004c710 con 0x7f6e400fce60 2024-04-26T21:22:25.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.621+0000 7f6e37e00700 1 -- 172.21.15.84:0/1713034419 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f6e3000bbf0 con 0x7f6e400fce60 2024-04-26T21:22:25.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.622+0000 7f6e37e00700 1 --2- 172.21.15.84:0/1713034419 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f6e240692a0 0x7f6e2406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:25.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.622+0000 7f6e37e00700 1 -- 172.21.15.84:0/1713034419 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6e30088600 con 0x7f6e400fce60 2024-04-26T21:22:25.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.623+0000 7f6e3f400700 1 --2- 172.21.15.84:0/1713034419 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f6e240692a0 0x7f6e2406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:25.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.623+0000 7f6e3f400700 1 --2- 172.21.15.84:0/1713034419 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f6e240692a0 0x7f6e2406b750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0041d0 tx=0x7f6e2c009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:25.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.627+0000 7f6e37e00700 1 -- 172.21.15.84:0/1713034419 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6e300583a0 con 0x7f6e400fce60 2024-04-26T21:22:25.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.857+0000 7f6e46a00700 1 -- 172.21.15.84:0/1713034419 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e401023e0 con 0x7f6e240692a0 2024-04-26T21:22:25.871 INFO:teuthology.orchestra.run.smithi084.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:22:25.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.869+0000 7f6e37e00700 1 -- 172.21.15.84:0/1713034419 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f6e401023e0 con 0x7f6e240692a0 2024-04-26T21:22:25.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.871+0000 7f6e46a00700 1 -- 172.21.15.84:0/1713034419 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f6e240692a0 msgr2=0x7f6e2406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:25.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.871+0000 7f6e46a00700 1 --2- 172.21.15.84:0/1713034419 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f6e240692a0 0x7f6e2406b750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0041d0 tx=0x7f6e2c009040 comp rx=0 tx=0).stop 2024-04-26T21:22:25.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.871+0000 7f6e46a00700 1 -- 172.21.15.84:0/1713034419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e400fce60 msgr2=0x7f6e4010d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:25.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.871+0000 7f6e46a00700 1 --2- 172.21.15.84:0/1713034419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e400fce60 0x7f6e4010d930 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000b3b0 tx=0x7f6e30009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:25.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.871+0000 7f6e46a00700 1 -- 172.21.15.84:0/1713034419 shutdown_connections 2024-04-26T21:22:25.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.872+0000 7f6e46a00700 1 --2- 172.21.15.84:0/1713034419 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f6e240692a0 0x7f6e2406b750 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:25.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.872+0000 7f6e46a00700 1 --2- 172.21.15.84:0/1713034419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e400fce60 0x7f6e4010d930 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:25.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.872+0000 7f6e46a00700 1 --2- 172.21.15.84:0/1713034419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e400fdfd0 0x7f6e4010de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:25.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.872+0000 7f6e46a00700 1 -- 172.21.15.84:0/1713034419 >> 172.21.15.84:0/1713034419 conn(0x7f6e400f8540 msgr2=0x7f6e400f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:25.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.872+0000 7f6e46a00700 1 -- 172.21.15.84:0/1713034419 shutdown_connections 2024-04-26T21:22:25.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:25.872+0000 7f6e46a00700 1 -- 172.21.15.84:0/1713034419 wait complete. 2024-04-26T21:22:26.759 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-26T21:22:26.760 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi084.front.sepia.ceph.com 2024-04-26T21:22:26.760 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-04-26T21:22:27.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:26 smithi084 ceph-mon[25539]: pgmap v250: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-26T21:22:27.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:26 smithi084 ceph-mon[25539]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:22:27.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:26 smithi084 ceph-mon[25539]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:22:27.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:26 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:22:27.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:26 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:22:27.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:26 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:22:27.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:26 smithi120 ceph-mon[32741]: pgmap v250: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-26T21:22:27.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:26 smithi120 ceph-mon[32741]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:22:27.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:26 smithi120 ceph-mon[32741]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:22:27.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:26 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:22:27.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:26 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:22:27.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:26 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:22:27.233 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:22:28.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:27 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:22:28.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:27 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:22:28.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:27 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:22:28.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:27 smithi084 ceph-mon[25539]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:22:28.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:27 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:22:28.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:27 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:22:28.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:27 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:22:28.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:27 smithi120 ceph-mon[32741]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:22:29.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:28 smithi084 ceph-mon[25539]: pgmap v251: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-26T21:22:29.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:28 smithi120 ceph-mon[32741]: pgmap v251: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-26T21:22:29.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.705+0000 7fac2e800700 1 -- 172.21.15.84:0/1012680691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac280ff720 msgr2=0x7fac28100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:29.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.705+0000 7fac2e800700 1 --2- 172.21.15.84:0/1012680691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac280ff720 0x7fac28100080 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fac14004940 tx=0x7fac14009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:29.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.706+0000 7fac2e800700 1 -- 172.21.15.84:0/1012680691 shutdown_connections 2024-04-26T21:22:29.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.706+0000 7fac2e800700 1 --2- 172.21.15.84:0/1012680691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac280ff720 0x7fac28100080 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:29.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.706+0000 7fac2e800700 1 --2- 172.21.15.84:0/1012680691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac280fedd0 0x7fac280ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:29.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.706+0000 7fac2e800700 1 -- 172.21.15.84:0/1012680691 >> 172.21.15.84:0/1012680691 conn(0x7fac280fa570 msgr2=0x7fac280fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:29.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.706+0000 7fac2e800700 1 -- 172.21.15.84:0/1012680691 shutdown_connections 2024-04-26T21:22:29.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.706+0000 7fac2e800700 1 -- 172.21.15.84:0/1012680691 wait complete. 2024-04-26T21:22:29.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.707+0000 7fac2e800700 1 Processor -- start 2024-04-26T21:22:29.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.707+0000 7fac2e800700 1 -- start start 2024-04-26T21:22:29.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.708+0000 7fac2e800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac280fedd0 0x7fac2810fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:29.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.708+0000 7fac2e800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac280ff720 0x7fac2810ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:29.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.708+0000 7fac2e800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac281105c0 con 0x7fac280ff720 2024-04-26T21:22:29.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.708+0000 7fac2e800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac28110e10 con 0x7fac280fedd0 2024-04-26T21:22:29.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.708+0000 7fac2ca00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac280ff720 0x7fac2810ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:29.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.708+0000 7fac2ca00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac280ff720 0x7fac2810ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53826/0 (socket says 172.21.15.84:53826) 2024-04-26T21:22:29.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.708+0000 7fac2ca00700 1 -- 172.21.15.84:0/3204228884 learned_addr learned my addr 172.21.15.84:0/3204228884 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:22:29.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.708+0000 7fac2d400700 1 --2- 172.21.15.84:0/3204228884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac280fedd0 0x7fac2810fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:29.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.709+0000 7fac2ca00700 1 -- 172.21.15.84:0/3204228884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac280fedd0 msgr2=0x7fac2810fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:29.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.709+0000 7fac2ca00700 1 --2- 172.21.15.84:0/3204228884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac280fedd0 0x7fac2810fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:29.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.709+0000 7fac2ca00700 1 -- 172.21.15.84:0/3204228884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac14005040 con 0x7fac280ff720 2024-04-26T21:22:29.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.709+0000 7fac2d400700 1 --2- 172.21.15.84:0/3204228884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac280fedd0 0x7fac2810fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:22:29.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.709+0000 7fac2ca00700 1 --2- 172.21.15.84:0/3204228884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac280ff720 0x7fac2810ffc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fac1400b970 tx=0x7fac14009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:29.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.709+0000 7fac25600700 1 -- 172.21.15.84:0/3204228884 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac1400e040 con 0x7fac280ff720 2024-04-26T21:22:29.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.709+0000 7fac25600700 1 -- 172.21.15.84:0/3204228884 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fac14004290 con 0x7fac280ff720 2024-04-26T21:22:29.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.709+0000 7fac25600700 1 -- 172.21.15.84:0/3204228884 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac1401c630 con 0x7fac280ff720 2024-04-26T21:22:29.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.709+0000 7fac2e800700 1 -- 172.21.15.84:0/3204228884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac28111090 con 0x7fac280ff720 2024-04-26T21:22:29.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.710+0000 7fac2e800700 1 -- 172.21.15.84:0/3204228884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac281115d0 con 0x7fac280ff720 2024-04-26T21:22:29.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.711+0000 7fac2e800700 1 -- 172.21.15.84:0/3204228884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2805f5c0 con 0x7fac280ff720 2024-04-26T21:22:29.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.712+0000 7fac25600700 1 -- 172.21.15.84:0/3204228884 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fac1400bbf0 con 0x7fac280ff720 2024-04-26T21:22:29.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.714+0000 7fac25600700 1 --2- 172.21.15.84:0/3204228884 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fac100692b0 0x7fac1006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:29.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.714+0000 7fac25600700 1 -- 172.21.15.84:0/3204228884 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fac14088520 con 0x7fac280ff720 2024-04-26T21:22:29.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.714+0000 7fac2d400700 1 --2- 172.21.15.84:0/3204228884 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fac100692b0 0x7fac1006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:29.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.715+0000 7fac2d400700 1 --2- 172.21.15.84:0/3204228884 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fac100692b0 0x7fac1006b760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fac280ffbd0 tx=0x7fac1c009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:29.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.718+0000 7fac25600700 1 -- 172.21.15.84:0/3204228884 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fac140582c0 con 0x7fac280ff720 2024-04-26T21:22:29.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.972+0000 7fac2e800700 1 -- 172.21.15.84:0/3204228884 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fac28111a00 con 0x7fac100692b0 2024-04-26T21:22:29.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.974+0000 7fac25600700 1 -- 172.21.15.84:0/3204228884 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fac28111a00 con 0x7fac100692b0 2024-04-26T21:22:29.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.976+0000 7fac2e800700 1 -- 172.21.15.84:0/3204228884 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fac100692b0 msgr2=0x7fac1006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:29.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.976+0000 7fac2e800700 1 --2- 172.21.15.84:0/3204228884 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fac100692b0 0x7fac1006b760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fac280ffbd0 tx=0x7fac1c009040 comp rx=0 tx=0).stop 2024-04-26T21:22:29.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.976+0000 7fac2e800700 1 -- 172.21.15.84:0/3204228884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac280ff720 msgr2=0x7fac2810ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:29.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.976+0000 7fac2e800700 1 --2- 172.21.15.84:0/3204228884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac280ff720 0x7fac2810ffc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fac1400b970 tx=0x7fac14009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:29.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.976+0000 7fac2e800700 1 -- 172.21.15.84:0/3204228884 shutdown_connections 2024-04-26T21:22:29.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.976+0000 7fac2e800700 1 --2- 172.21.15.84:0/3204228884 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fac100692b0 0x7fac1006b760 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:29.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.976+0000 7fac2e800700 1 --2- 172.21.15.84:0/3204228884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac280fedd0 0x7fac2810fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:29.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.976+0000 7fac2e800700 1 --2- 172.21.15.84:0/3204228884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac280ff720 0x7fac2810ffc0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:29.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.976+0000 7fac2e800700 1 -- 172.21.15.84:0/3204228884 >> 172.21.15.84:0/3204228884 conn(0x7fac280fa570 msgr2=0x7fac280fbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:29.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.977+0000 7fac2e800700 1 -- 172.21.15.84:0/3204228884 shutdown_connections 2024-04-26T21:22:29.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:29.977+0000 7fac2e800700 1 -- 172.21.15.84:0/3204228884 wait complete. 2024-04-26T21:22:29.995 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:22:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.142+0000 7fd1c5a00700 1 -- 172.21.15.84:0/2432217388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c0070830 msgr2=0x7fd1c0070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.142+0000 7fd1c5a00700 1 --2- 172.21.15.84:0/2432217388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c0070830 0x7fd1c0070ca0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac004940 tx=0x7fd1ac009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.142+0000 7fd1c5a00700 1 -- 172.21.15.84:0/2432217388 shutdown_connections 2024-04-26T21:22:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.142+0000 7fd1c5a00700 1 --2- 172.21.15.84:0/2432217388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c0070830 0x7fd1c0070ca0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.142+0000 7fd1c5a00700 1 --2- 172.21.15.84:0/2432217388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1c0071de0 0x7fd1c00702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:30.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.142+0000 7fd1c5a00700 1 -- 172.21.15.84:0/2432217388 >> 172.21.15.84:0/2432217388 conn(0x7fd1c00f8560 msgr2=0x7fd1c00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:30.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.143+0000 7fd1c5a00700 1 -- 172.21.15.84:0/2432217388 shutdown_connections 2024-04-26T21:22:30.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.143+0000 7fd1c5a00700 1 -- 172.21.15.84:0/2432217388 wait complete. 2024-04-26T21:22:30.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.143+0000 7fd1c5a00700 1 Processor -- start 2024-04-26T21:22:30.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.144+0000 7fd1c5a00700 1 -- start start 2024-04-26T21:22:30.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.144+0000 7fd1c5a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1c0070830 0x7fd1c010fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:30.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.144+0000 7fd1c5a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c0071de0 0x7fd1c0110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:30.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.144+0000 7fd1c5a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c0110780 con 0x7fd1c0071de0 2024-04-26T21:22:30.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.144+0000 7fd1c5a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c0110fd0 con 0x7fd1c0070830 2024-04-26T21:22:30.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.144+0000 7fd1be000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c0071de0 0x7fd1c0110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:30.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.144+0000 7fd1be000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c0071de0 0x7fd1c0110180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53834/0 (socket says 172.21.15.84:53834) 2024-04-26T21:22:30.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.144+0000 7fd1be000700 1 -- 172.21.15.84:0/39550189 learned_addr learned my addr 172.21.15.84:0/39550189 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:22:30.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.145+0000 7fd1bea00700 1 --2- 172.21.15.84:0/39550189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1c0070830 0x7fd1c010fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.145+0000 7fd1be000700 1 -- 172.21.15.84:0/39550189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1c0070830 msgr2=0x7fd1c010fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.145+0000 7fd1be000700 1 --2- 172.21.15.84:0/39550189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1c0070830 0x7fd1c010fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.145+0000 7fd1be000700 1 -- 172.21.15.84:0/39550189 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac005040 con 0x7fd1c0071de0 2024-04-26T21:22:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.145+0000 7fd1bea00700 1 --2- 172.21.15.84:0/39550189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1c0070830 0x7fd1c010fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:22:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.145+0000 7fd1be000700 1 --2- 172.21.15.84:0/39550189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c0071de0 0x7fd1c0110180 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac009150 tx=0x7fd1ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.145+0000 7fd1b6a00700 1 -- 172.21.15.84:0/39550189 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1ac00e040 con 0x7fd1c0071de0 2024-04-26T21:22:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.145+0000 7fd1c5a00700 1 -- 172.21.15.84:0/39550189 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c0111250 con 0x7fd1c0071de0 2024-04-26T21:22:30.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.145+0000 7fd1b6a00700 1 -- 172.21.15.84:0/39550189 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd1ac00bcc0 con 0x7fd1c0071de0 2024-04-26T21:22:30.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.145+0000 7fd1b6a00700 1 -- 172.21.15.84:0/39550189 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1ac01c630 con 0x7fd1c0071de0 2024-04-26T21:22:30.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.146+0000 7fd1c5a00700 1 -- 172.21.15.84:0/39550189 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c0111790 con 0x7fd1c0071de0 2024-04-26T21:22:30.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.147+0000 7fd1c5a00700 1 -- 172.21.15.84:0/39550189 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c005f5c0 con 0x7fd1c0071de0 2024-04-26T21:22:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.148+0000 7fd1b6a00700 1 -- 172.21.15.84:0/39550189 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fd1ac013420 con 0x7fd1c0071de0 2024-04-26T21:22:30.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.149+0000 7fd1b6a00700 1 --2- 172.21.15.84:0/39550189 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fd1a40692a0 0x7fd1a406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:30.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.149+0000 7fd1b6a00700 1 -- 172.21.15.84:0/39550189 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd1ac087ff0 con 0x7fd1c0071de0 2024-04-26T21:22:30.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.149+0000 7fd1bea00700 1 --2- 172.21.15.84:0/39550189 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fd1a40692a0 0x7fd1a406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:30.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.150+0000 7fd1bea00700 1 --2- 172.21.15.84:0/39550189 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fd1a40692a0 0x7fd1a406b750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0009fd0 tx=0x7fd1b000b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:30.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.153+0000 7fd1b6a00700 1 -- 172.21.15.84:0/39550189 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd1ac057d30 con 0x7fd1c0071de0 2024-04-26T21:22:30.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.426+0000 7fd1c5a00700 1 -- 172.21.15.84:0/39550189 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1c0111ae0 con 0x7fd1a40692a0 2024-04-26T21:22:30.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.428+0000 7fd1b6a00700 1 -- 172.21.15.84:0/39550189 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fd1c0111ae0 con 0x7fd1a40692a0 2024-04-26T21:22:30.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.430+0000 7fd1c5a00700 1 -- 172.21.15.84:0/39550189 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fd1a40692a0 msgr2=0x7fd1a406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:30.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.430+0000 7fd1c5a00700 1 --2- 172.21.15.84:0/39550189 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fd1a40692a0 0x7fd1a406b750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0009fd0 tx=0x7fd1b000b040 comp rx=0 tx=0).stop 2024-04-26T21:22:30.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.430+0000 7fd1c5a00700 1 -- 172.21.15.84:0/39550189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c0071de0 msgr2=0x7fd1c0110180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:30.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.430+0000 7fd1c5a00700 1 --2- 172.21.15.84:0/39550189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c0071de0 0x7fd1c0110180 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac009150 tx=0x7fd1ac009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:30.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.430+0000 7fd1c5a00700 1 -- 172.21.15.84:0/39550189 shutdown_connections 2024-04-26T21:22:30.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.430+0000 7fd1c5a00700 1 --2- 172.21.15.84:0/39550189 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fd1a40692a0 0x7fd1a406b750 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:30.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.430+0000 7fd1c5a00700 1 --2- 172.21.15.84:0/39550189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1c0070830 0x7fd1c010fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:30.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.430+0000 7fd1c5a00700 1 --2- 172.21.15.84:0/39550189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1c0071de0 0x7fd1c0110180 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:30.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.430+0000 7fd1c5a00700 1 -- 172.21.15.84:0/39550189 >> 172.21.15.84:0/39550189 conn(0x7fd1c00f8560 msgr2=0x7fd1c00f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:30.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.431+0000 7fd1c5a00700 1 -- 172.21.15.84:0/39550189 shutdown_connections 2024-04-26T21:22:30.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.431+0000 7fd1c5a00700 1 -- 172.21.15.84:0/39550189 wait complete. 2024-04-26T21:22:30.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.585+0000 7fbfb9a00700 1 -- 172.21.15.84:0/488044168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfb4103230 msgr2=0x7fbfb4103640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:30.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.585+0000 7fbfb9a00700 1 --2- 172.21.15.84:0/488044168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfb4103230 0x7fbfb4103640 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4009ce0 tx=0x7fbfa4004d10 comp rx=0 tx=0).stop 2024-04-26T21:22:30.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.585+0000 7fbfb9a00700 1 -- 172.21.15.84:0/488044168 shutdown_connections 2024-04-26T21:22:30.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.585+0000 7fbfb9a00700 1 --2- 172.21.15.84:0/488044168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfb41044e0 0x7fbfb4104950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:30.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.585+0000 7fbfb9a00700 1 --2- 172.21.15.84:0/488044168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfb4103230 0x7fbfb4103640 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:30.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.585+0000 7fbfb9a00700 1 -- 172.21.15.84:0/488044168 >> 172.21.15.84:0/488044168 conn(0x7fbfb4072510 msgr2=0x7fbfb4074940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:30.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.585+0000 7fbfb9a00700 1 -- 172.21.15.84:0/488044168 shutdown_connections 2024-04-26T21:22:30.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.585+0000 7fbfb9a00700 1 -- 172.21.15.84:0/488044168 wait complete. 2024-04-26T21:22:30.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.586+0000 7fbfb9a00700 1 Processor -- start 2024-04-26T21:22:30.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.586+0000 7fbfb9a00700 1 -- start start 2024-04-26T21:22:30.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.587+0000 7fbfb9a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfb4103230 0x7fbfb4113fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:30.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.587+0000 7fbfb9a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfb41044e0 0x7fbfb41144f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:30.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.587+0000 7fbfb9a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb4114b80 con 0x7fbfb4103230 2024-04-26T21:22:30.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.587+0000 7fbfb9a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb4115370 con 0x7fbfb41044e0 2024-04-26T21:22:30.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.587+0000 7fbfb3e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfb4103230 0x7fbfb4113fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:30.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.587+0000 7fbfb3e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfb4103230 0x7fbfb4113fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53854/0 (socket says 172.21.15.84:53854) 2024-04-26T21:22:30.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.587+0000 7fbfb3e00700 1 -- 172.21.15.84:0/14171301 learned_addr learned my addr 172.21.15.84:0/14171301 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:22:30.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.587+0000 7fbfab400700 1 --2- 172.21.15.84:0/14171301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfb41044e0 0x7fbfb41144f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:30.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.588+0000 7fbfb3e00700 1 -- 172.21.15.84:0/14171301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfb41044e0 msgr2=0x7fbfb41144f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:30.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.588+0000 7fbfb3e00700 1 --2- 172.21.15.84:0/14171301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfb41044e0 0x7fbfb41144f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:30.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.588+0000 7fbfb3e00700 1 -- 172.21.15.84:0/14171301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa4009940 con 0x7fbfb4103230 2024-04-26T21:22:30.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.588+0000 7fbfb3e00700 1 --2- 172.21.15.84:0/14171301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfb4103230 0x7fbfb4113fb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4005010 tx=0x7fbfa4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.588+0000 7fbfb0c00700 1 -- 172.21.15.84:0/14171301 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfa400e040 con 0x7fbfb4103230 2024-04-26T21:22:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.589+0000 7fbfb0c00700 1 -- 172.21.15.84:0/14171301 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbfa40128e0 con 0x7fbfb4103230 2024-04-26T21:22:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.589+0000 7fbfb0c00700 1 -- 172.21.15.84:0/14171301 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfa401c910 con 0x7fbfb4103230 2024-04-26T21:22:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.589+0000 7fbfb9a00700 1 -- 172.21.15.84:0/14171301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb41155f0 con 0x7fbfb4103230 2024-04-26T21:22:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.589+0000 7fbfb9a00700 1 -- 172.21.15.84:0/14171301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb4115bb0 con 0x7fbfb4103230 2024-04-26T21:22:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.590+0000 7fbfb9a00700 1 -- 172.21.15.84:0/14171301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb4076060 con 0x7fbfb4103230 2024-04-26T21:22:30.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.591+0000 7fbfb0c00700 1 -- 172.21.15.84:0/14171301 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fbfa4012410 con 0x7fbfb4103230 2024-04-26T21:22:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.592+0000 7fbfb0c00700 1 --2- 172.21.15.84:0/14171301 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fbf980692a0 0x7fbf9806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.592+0000 7fbfb0c00700 1 -- 172.21.15.84:0/14171301 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fbfa4088e40 con 0x7fbfb4103230 2024-04-26T21:22:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.593+0000 7fbfab400700 1 --2- 172.21.15.84:0/14171301 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fbf980692a0 0x7fbf9806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:30.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.594+0000 7fbfab400700 1 --2- 172.21.15.84:0/14171301 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fbf980692a0 0x7fbf9806b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c006fd0 tx=0x7fbf9c008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:30.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.601+0000 7fbfb0c00700 1 -- 172.21.15.84:0/14171301 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbfa4058c00 con 0x7fbfb4103230 2024-04-26T21:22:30.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.829+0000 7fbfb9a00700 1 -- 172.21.15.84:0/14171301 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbfb4115ee0 con 0x7fbf980692a0 2024-04-26T21:22:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.840+0000 7fbfb0c00700 1 -- 172.21.15.84:0/14171301 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7fbfb4115ee0 con 0x7fbf980692a0 2024-04-26T21:22:30.842 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:22:30.842 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (6m) 40s ago 8m 13.3M - 0.25.0 c8568f914cd2 e17e61753bb1 2024-04-26T21:22:30.842 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (8m) 40s ago 8m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 a111b0ee8187 2024-04-26T21:22:30.842 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (7m) 47s ago 7m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 66f4d21263a1 2024-04-26T21:22:30.842 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (6m) 40s ago 7m 73.9M - 9.4.7 954c08fa6188 67caa0766f89 2024-04-26T21:22:30.843 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (72s) 40s ago 72s 13.3M - 17.2.7-907-g2be3efa9 1c5834633715 485d7884e1d5 2024-04-26T21:22:30.843 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (63s) 40s ago 63s 10.5M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:22:30.843 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (68s) 47s ago 68s 12.7M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:22:30.843 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (59s) 47s ago 59s 10.4M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:22:30.843 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:9283 running (9m) 40s ago 9m 480M - 17.2.7-907-g2be3efa9 1c5834633715 98242b12bd6c 2024-04-26T21:22:30.843 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283 running (6m) 47s ago 6m 432M - 17.2.7-907-g2be3efa9 1c5834633715 29dc99fc0efb 2024-04-26T21:22:30.843 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (9m) 40s ago 10m 44.7M 2048M 17.2.7-907-g2be3efa9 1c5834633715 24cc2d798ea7 2024-04-26T21:22:30.843 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (6m) 47s ago 6m 35.0M 2048M 17.2.7-907-g2be3efa9 1c5834633715 72c786fd622b 2024-04-26T21:22:30.843 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (8m) 40s ago 8m 7470k - 1.5.0 0da6a335fe13 8fdbcc05a9dd 2024-04-26T21:22:30.843 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (6m) 47s ago 6m 7482k - 1.5.0 0da6a335fe13 1b07a56a6ace 2024-04-26T21:22:30.843 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (5m) 40s ago 5m 45.2M 4288M 17.2.7-907-g2be3efa9 1c5834633715 3a2e74d7e51a 2024-04-26T21:22:30.843 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (5m) 40s ago 5m 44.9M 4288M 17.2.7-907-g2be3efa9 1c5834633715 d283a0a93213 2024-04-26T21:22:30.843 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (4m) 40s ago 4m 43.1M 4288M 17.2.7-907-g2be3efa9 1c5834633715 5899468fc5c8 2024-04-26T21:22:30.843 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (4m) 47s ago 4m 43.1M 5312M 17.2.7-907-g2be3efa9 1c5834633715 b8a14c87d730 2024-04-26T21:22:30.843 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (3m) 47s ago 3m 40.8M 5312M 17.2.7-907-g2be3efa9 1c5834633715 4d294df735a3 2024-04-26T21:22:30.844 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (2m) 47s ago 2m 40.7M 5312M 17.2.7-907-g2be3efa9 1c5834633715 9b60997971a8 2024-04-26T21:22:30.844 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (5m) 40s ago 7m 46.1M - 2.43.0 a07b618ecd1d 7b6983aea888 2024-04-26T21:22:30.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.843+0000 7fbfb9a00700 1 -- 172.21.15.84:0/14171301 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fbf980692a0 msgr2=0x7fbf9806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:30.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.843+0000 7fbfb9a00700 1 --2- 172.21.15.84:0/14171301 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fbf980692a0 0x7fbf9806b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c006fd0 tx=0x7fbf9c008040 comp rx=0 tx=0).stop 2024-04-26T21:22:30.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.843+0000 7fbfb9a00700 1 -- 172.21.15.84:0/14171301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfb4103230 msgr2=0x7fbfb4113fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:30.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.843+0000 7fbfb9a00700 1 --2- 172.21.15.84:0/14171301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfb4103230 0x7fbfb4113fb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4005010 tx=0x7fbfa4004d10 comp rx=0 tx=0).stop 2024-04-26T21:22:30.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.843+0000 7fbfb9a00700 1 -- 172.21.15.84:0/14171301 shutdown_connections 2024-04-26T21:22:30.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.843+0000 7fbfb9a00700 1 --2- 172.21.15.84:0/14171301 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fbf980692a0 0x7fbf9806b750 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:30.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.843+0000 7fbfb9a00700 1 --2- 172.21.15.84:0/14171301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfb4103230 0x7fbfb4113fb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:30.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.843+0000 7fbfb9a00700 1 --2- 172.21.15.84:0/14171301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfb41044e0 0x7fbfb41144f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:30.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.843+0000 7fbfb9a00700 1 -- 172.21.15.84:0/14171301 >> 172.21.15.84:0/14171301 conn(0x7fbfb4072510 msgr2=0x7fbfb4074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:30.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.844+0000 7fbfb9a00700 1 -- 172.21.15.84:0/14171301 shutdown_connections 2024-04-26T21:22:30.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.844+0000 7fbfb9a00700 1 -- 172.21.15.84:0/14171301 wait complete. 2024-04-26T21:22:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.998+0000 7fbd4a800700 1 -- 172.21.15.84:0/889550183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd44071de0 msgr2=0x7fbd440702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.998+0000 7fbd4a800700 1 --2- 172.21.15.84:0/889550183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd44071de0 0x7fbd440702f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbd38004940 tx=0x7fbd38009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.998+0000 7fbd4a800700 1 -- 172.21.15.84:0/889550183 shutdown_connections 2024-04-26T21:22:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.998+0000 7fbd4a800700 1 --2- 172.21.15.84:0/889550183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd44070830 0x7fbd44070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.998+0000 7fbd4a800700 1 --2- 172.21.15.84:0/889550183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd44071de0 0x7fbd440702f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.998+0000 7fbd4a800700 1 -- 172.21.15.84:0/889550183 >> 172.21.15.84:0/889550183 conn(0x7fbd440f8370 msgr2=0x7fbd440fa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.999+0000 7fbd4a800700 1 -- 172.21.15.84:0/889550183 shutdown_connections 2024-04-26T21:22:31.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.999+0000 7fbd4a800700 1 -- 172.21.15.84:0/889550183 wait complete. 2024-04-26T21:22:31.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.999+0000 7fbd4a800700 1 Processor -- start 2024-04-26T21:22:31.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:30.999+0000 7fbd4a800700 1 -- start start 2024-04-26T21:22:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.000+0000 7fbd4a800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd44070830 0x7fbd4410fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.000+0000 7fbd4a800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd44071de0 0x7fbd4410ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.000+0000 7fbd4a800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd441105d0 con 0x7fbd44070830 2024-04-26T21:22:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.000+0000 7fbd4a800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd44110e20 con 0x7fbd44071de0 2024-04-26T21:22:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.000+0000 7fbd49400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd44070830 0x7fbd4410fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.000+0000 7fbd49400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd44070830 0x7fbd4410fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53880/0 (socket says 172.21.15.84:53880) 2024-04-26T21:22:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.000+0000 7fbd49400700 1 -- 172.21.15.84:0/216324275 learned_addr learned my addr 172.21.15.84:0/216324275 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:22:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.001+0000 7fbd48a00700 1 --2- 172.21.15.84:0/216324275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd44071de0 0x7fbd4410ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.001+0000 7fbd49400700 1 -- 172.21.15.84:0/216324275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd44071de0 msgr2=0x7fbd4410ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.001+0000 7fbd49400700 1 --2- 172.21.15.84:0/216324275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd44071de0 0x7fbd4410ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.001+0000 7fbd49400700 1 -- 172.21.15.84:0/216324275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd38005040 con 0x7fbd44070830 2024-04-26T21:22:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.001+0000 7fbd48a00700 1 --2- 172.21.15.84:0/216324275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd44071de0 0x7fbd4410ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:22:31.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.001+0000 7fbd49400700 1 --2- 172.21.15.84:0/216324275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd44070830 0x7fbd4410fa90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbd38000c00 tx=0x7fbd38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:31.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.001+0000 7fbd41600700 1 -- 172.21.15.84:0/216324275 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd3800e040 con 0x7fbd44070830 2024-04-26T21:22:31.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.002+0000 7fbd41600700 1 -- 172.21.15.84:0/216324275 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbd3800bcc0 con 0x7fbd44070830 2024-04-26T21:22:31.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.002+0000 7fbd4a800700 1 -- 172.21.15.84:0/216324275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd441110a0 con 0x7fbd44070830 2024-04-26T21:22:31.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.002+0000 7fbd41600700 1 -- 172.21.15.84:0/216324275 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd3801c630 con 0x7fbd44070830 2024-04-26T21:22:31.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.002+0000 7fbd4a800700 1 -- 172.21.15.84:0/216324275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd441115e0 con 0x7fbd44070830 2024-04-26T21:22:31.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.003+0000 7fbd4a800700 1 -- 172.21.15.84:0/216324275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4405f5c0 con 0x7fbd44070830 2024-04-26T21:22:31.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.004+0000 7fbd41600700 1 -- 172.21.15.84:0/216324275 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fbd38013980 con 0x7fbd44070830 2024-04-26T21:22:31.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.005+0000 7fbd41600700 1 --2- 172.21.15.84:0/216324275 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fbd2c0692a0 0x7fbd2c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:31.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.005+0000 7fbd41600700 1 -- 172.21.15.84:0/216324275 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fbd38088450 con 0x7fbd44070830 2024-04-26T21:22:31.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.005+0000 7fbd48a00700 1 --2- 172.21.15.84:0/216324275 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fbd2c0692a0 0x7fbd2c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:31.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.006+0000 7fbd48a00700 1 --2- 172.21.15.84:0/216324275 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fbd2c0692a0 0x7fbd2c06b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbd30007fd0 tx=0x7fbd30009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:31.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.010+0000 7fbd41600700 1 -- 172.21.15.84:0/216324275 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbd38058360 con 0x7fbd44070830 2024-04-26T21:22:31.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:30 smithi084 ceph-mon[25539]: pgmap v252: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-26T21:22:31.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:30 smithi084 ceph-mon[25539]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:22:31.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.331+0000 7fbd4a800700 1 -- 172.21.15.84:0/216324275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbd44107910 con 0x7fbd44070830 2024-04-26T21:22:31.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.332+0000 7fbd41600700 1 -- 172.21.15.84:0/216324275 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fbd38057ef0 con 0x7fbd44070830 2024-04-26T21:22:31.334 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:22:31.334 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:22:31.334 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-26T21:22:31.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:22:31.334 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:22:31.334 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-26T21:22:31.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:22:31.335 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:22:31.335 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-26T21:22:31.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:22:31.335 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:22:31.335 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-26T21:22:31.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:22:31.335 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:22:31.335 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 14 2024-04-26T21:22:31.335 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:22:31.335 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:22:31.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.336+0000 7fbd4a800700 1 -- 172.21.15.84:0/216324275 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fbd2c0692a0 msgr2=0x7fbd2c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:31.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.336+0000 7fbd4a800700 1 --2- 172.21.15.84:0/216324275 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fbd2c0692a0 0x7fbd2c06b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbd30007fd0 tx=0x7fbd30009040 comp rx=0 tx=0).stop 2024-04-26T21:22:31.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.336+0000 7fbd4a800700 1 -- 172.21.15.84:0/216324275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd44070830 msgr2=0x7fbd4410fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:31.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.336+0000 7fbd4a800700 1 --2- 172.21.15.84:0/216324275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd44070830 0x7fbd4410fa90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbd38000c00 tx=0x7fbd38009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:31.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.336+0000 7fbd4a800700 1 -- 172.21.15.84:0/216324275 shutdown_connections 2024-04-26T21:22:31.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.336+0000 7fbd4a800700 1 --2- 172.21.15.84:0/216324275 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fbd2c0692a0 0x7fbd2c06b750 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:31.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.336+0000 7fbd4a800700 1 --2- 172.21.15.84:0/216324275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd44070830 0x7fbd4410fa90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:31.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.336+0000 7fbd4a800700 1 --2- 172.21.15.84:0/216324275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd44071de0 0x7fbd4410ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:31.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.336+0000 7fbd4a800700 1 -- 172.21.15.84:0/216324275 >> 172.21.15.84:0/216324275 conn(0x7fbd440f8370 msgr2=0x7fbd440f9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:31.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.336+0000 7fbd4a800700 1 -- 172.21.15.84:0/216324275 shutdown_connections 2024-04-26T21:22:31.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.336+0000 7fbd4a800700 1 -- 172.21.15.84:0/216324275 wait complete. 2024-04-26T21:22:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:30 smithi120 ceph-mon[32741]: pgmap v252: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-26T21:22:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:30 smithi120 ceph-mon[32741]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:22:31.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.509+0000 7f1147c00700 1 -- 172.21.15.84:0/440968937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11400fff50 msgr2=0x7f1140102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:31.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.509+0000 7f1147c00700 1 --2- 172.21.15.84:0/440968937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11400fff50 0x7f1140102330 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f112c004940 tx=0x7f112c009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:31.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.509+0000 7f1147c00700 1 -- 172.21.15.84:0/440968937 shutdown_connections 2024-04-26T21:22:31.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.509+0000 7f1147c00700 1 --2- 172.21.15.84:0/440968937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11400fff50 0x7f1140102330 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:31.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.509+0000 7f1147c00700 1 --2- 172.21.15.84:0/440968937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1140066af0 0x7f11400ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:31.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.509+0000 7f1147c00700 1 -- 172.21.15.84:0/440968937 >> 172.21.15.84:0/440968937 conn(0x7f11400f7420 msgr2=0x7f11400f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:31.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.510+0000 7f1147c00700 1 -- 172.21.15.84:0/440968937 shutdown_connections 2024-04-26T21:22:31.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.510+0000 7f1147c00700 1 -- 172.21.15.84:0/440968937 wait complete. 2024-04-26T21:22:31.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.511+0000 7f1147c00700 1 Processor -- start 2024-04-26T21:22:31.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.511+0000 7f1147c00700 1 -- start start 2024-04-26T21:22:31.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.511+0000 7f1147c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1140066af0 0x7f114010da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:31.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.511+0000 7f1147c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11400fff50 0x7f114010dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:31.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.511+0000 7f1147c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114010e5a0 con 0x7f11400fff50 2024-04-26T21:22:31.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.511+0000 7f1147c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114010eda0 con 0x7f1140066af0 2024-04-26T21:22:31.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.512+0000 7f113fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11400fff50 0x7f114010dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:31.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.512+0000 7f113fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11400fff50 0x7f114010dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53908/0 (socket says 172.21.15.84:53908) 2024-04-26T21:22:31.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.512+0000 7f113fe00700 1 -- 172.21.15.84:0/1974478958 learned_addr learned my addr 172.21.15.84:0/1974478958 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:22:31.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.512+0000 7f1145200700 1 --2- 172.21.15.84:0/1974478958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1140066af0 0x7f114010da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:31.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.512+0000 7f113fe00700 1 -- 172.21.15.84:0/1974478958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1140066af0 msgr2=0x7f114010da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:31.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.512+0000 7f113fe00700 1 --2- 172.21.15.84:0/1974478958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1140066af0 0x7f114010da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.512+0000 7f113fe00700 1 -- 172.21.15.84:0/1974478958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c005040 con 0x7f11400fff50 2024-04-26T21:22:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.512+0000 7f1145200700 1 --2- 172.21.15.84:0/1974478958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1140066af0 0x7f114010da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:22:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.513+0000 7f113fe00700 1 --2- 172.21.15.84:0/1974478958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11400fff50 0x7f114010dfa0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f112c009150 tx=0x7f112c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.513+0000 7f113cc00700 1 -- 172.21.15.84:0/1974478958 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f112c00e040 con 0x7f11400fff50 2024-04-26T21:22:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.513+0000 7f113cc00700 1 -- 172.21.15.84:0/1974478958 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f112c00bbf0 con 0x7f11400fff50 2024-04-26T21:22:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.513+0000 7f1147c00700 1 -- 172.21.15.84:0/1974478958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114010f020 con 0x7f11400fff50 2024-04-26T21:22:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.513+0000 7f113cc00700 1 -- 172.21.15.84:0/1974478958 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f112c01c630 con 0x7f11400fff50 2024-04-26T21:22:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.513+0000 7f1147c00700 1 -- 172.21.15.84:0/1974478958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114010f560 con 0x7f11400fff50 2024-04-26T21:22:31.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.514+0000 7f1147c00700 1 -- 172.21.15.84:0/1974478958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11200052e0 con 0x7f11400fff50 2024-04-26T21:22:31.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.515+0000 7f113cc00700 1 -- 172.21.15.84:0/1974478958 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f112c01c8a0 con 0x7f11400fff50 2024-04-26T21:22:31.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.517+0000 7f113cc00700 1 --2- 172.21.15.84:0/1974478958 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f11280692b0 0x7f112806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:31.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.517+0000 7f113cc00700 1 -- 172.21.15.84:0/1974478958 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f112c0884d0 con 0x7f11400fff50 2024-04-26T21:22:31.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.517+0000 7f1145200700 1 --2- 172.21.15.84:0/1974478958 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f11280692b0 0x7f112806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:31.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.518+0000 7f1145200700 1 --2- 172.21.15.84:0/1974478958 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f11280692b0 0x7f112806b760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1134009fd0 tx=0x7f113400b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:31.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.521+0000 7f113cc00700 1 -- 172.21.15.84:0/1974478958 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f112c0582e0 con 0x7f11400fff50 2024-04-26T21:22:31.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.803+0000 7f1147c00700 1 -- 172.21.15.84:0/1974478958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1120005da0 con 0x7f11400fff50 2024-04-26T21:22:31.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.804+0000 7f113cc00700 1 -- 172.21.15.84:0/1974478958 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1818 (secure 0 0 0) 0x7f112c057e70 con 0x7f11400fff50 2024-04-26T21:22:31.807 INFO:teuthology.orchestra.run.smithi084.stdout:e11 2024-04-26T21:22:31.807 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:22:31.807 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:22:31.807 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:22:31.807 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:22:31.807 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:22:31.807 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:22:31.807 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 11 2024-04-26T21:22:31.807 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:22:31.807 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:22:31.807 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:21:35.894623+0000 2024-04-26T21:22:31.807 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:22:31.807 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:22:31.808 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:22:31.808 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:22:31.808 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:22:31.808 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:22:31.808 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:22:31.808 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:22:31.808 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:22:31.808 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:22:31.808 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:22:31.808 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456,1=24231} 2024-04-26T21:22:31.808 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:22:31.808 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:22:31.808 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:22:31.808 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:22:31.809 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:22:31.809 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:22:31.809 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:22:31.809 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:22:31.809 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:22:31.809 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:22:31.809 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:22:31.809 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:22:31.809 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:22:31.809 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:22:31.809 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:22:31.809 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:22:31.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.808+0000 7f1147c00700 1 -- 172.21.15.84:0/1974478958 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f11280692b0 msgr2=0x7f112806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:31.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.808+0000 7f1147c00700 1 --2- 172.21.15.84:0/1974478958 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f11280692b0 0x7f112806b760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1134009fd0 tx=0x7f113400b040 comp rx=0 tx=0).stop 2024-04-26T21:22:31.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.808+0000 7f1147c00700 1 -- 172.21.15.84:0/1974478958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11400fff50 msgr2=0x7f114010dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:31.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.808+0000 7f1147c00700 1 --2- 172.21.15.84:0/1974478958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11400fff50 0x7f114010dfa0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f112c009150 tx=0x7f112c009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:31.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.809+0000 7f1147c00700 1 -- 172.21.15.84:0/1974478958 shutdown_connections 2024-04-26T21:22:31.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.809+0000 7f1147c00700 1 --2- 172.21.15.84:0/1974478958 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f11280692b0 0x7f112806b760 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:31.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.809+0000 7f1147c00700 1 --2- 172.21.15.84:0/1974478958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1140066af0 0x7f114010da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:31.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.809+0000 7f1147c00700 1 --2- 172.21.15.84:0/1974478958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11400fff50 0x7f114010dfa0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:31.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.809+0000 7f1147c00700 1 -- 172.21.15.84:0/1974478958 >> 172.21.15.84:0/1974478958 conn(0x7f11400f7420 msgr2=0x7f11400f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:31.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.809+0000 7f1147c00700 1 -- 172.21.15.84:0/1974478958 shutdown_connections 2024-04-26T21:22:31.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.809+0000 7f1147c00700 1 -- 172.21.15.84:0/1974478958 wait complete. 2024-04-26T21:22:31.811 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 11 2024-04-26T21:22:31.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.965+0000 7f930dc00700 1 -- 172.21.15.84:0/2188042441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93080fdfd0 msgr2=0x7f93080fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:31.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.965+0000 7f930dc00700 1 --2- 172.21.15.84:0/2188042441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93080fdfd0 0x7f93080fe440 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f92f4004940 tx=0x7f92f4009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:31.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.965+0000 7f930dc00700 1 -- 172.21.15.84:0/2188042441 shutdown_connections 2024-04-26T21:22:31.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.965+0000 7f930dc00700 1 --2- 172.21.15.84:0/2188042441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93080fdfd0 0x7f93080fe440 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:31.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.965+0000 7f930dc00700 1 --2- 172.21.15.84:0/2188042441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93080fce60 0x7f93080fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:31.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.965+0000 7f930dc00700 1 -- 172.21.15.84:0/2188042441 >> 172.21.15.84:0/2188042441 conn(0x7f93080f8560 msgr2=0x7f93080fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:31.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.965+0000 7f930dc00700 1 -- 172.21.15.84:0/2188042441 shutdown_connections 2024-04-26T21:22:31.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.966+0000 7f930dc00700 1 -- 172.21.15.84:0/2188042441 wait complete. 2024-04-26T21:22:31.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.967+0000 7f930dc00700 1 Processor -- start 2024-04-26T21:22:31.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.967+0000 7f930dc00700 1 -- start start 2024-04-26T21:22:31.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.967+0000 7f930dc00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93080fce60 0x7f930810fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:31.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.967+0000 7f930dc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93080fdfd0 0x7f9308110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:31.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.967+0000 7f930dc00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9308110740 con 0x7f93080fce60 2024-04-26T21:22:31.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.967+0000 7f930dc00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9308110f90 con 0x7f93080fdfd0 2024-04-26T21:22:31.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.968+0000 7f9306a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93080fce60 0x7f930810fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:31.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.968+0000 7f9306a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93080fce60 0x7f930810fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40208/0 (socket says 172.21.15.84:40208) 2024-04-26T21:22:31.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.968+0000 7f9306a00700 1 -- 172.21.15.84:0/1625040726 learned_addr learned my addr 172.21.15.84:0/1625040726 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:22:31.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.968+0000 7f9306000700 1 --2- 172.21.15.84:0/1625040726 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93080fdfd0 0x7f9308110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:31.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.968+0000 7f9306a00700 1 -- 172.21.15.84:0/1625040726 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93080fdfd0 msgr2=0x7f9308110140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:31.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.968+0000 7f9306a00700 1 --2- 172.21.15.84:0/1625040726 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93080fdfd0 0x7f9308110140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:31.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.968+0000 7f9306a00700 1 -- 172.21.15.84:0/1625040726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f4005040 con 0x7f93080fce60 2024-04-26T21:22:31.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.968+0000 7f9306a00700 1 --2- 172.21.15.84:0/1625040726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93080fce60 0x7f930810fc00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f92f8002a50 tx=0x7f92f80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:31.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.969+0000 7f92fea00700 1 -- 172.21.15.84:0/1625040726 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92f8007cc0 con 0x7f93080fce60 2024-04-26T21:22:31.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.969+0000 7f92fea00700 1 -- 172.21.15.84:0/1625040726 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92f800f040 con 0x7f93080fce60 2024-04-26T21:22:31.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.969+0000 7f930dc00700 1 -- 172.21.15.84:0/1625040726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9308111270 con 0x7f93080fce60 2024-04-26T21:22:31.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.969+0000 7f92fea00700 1 -- 172.21.15.84:0/1625040726 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92f8009640 con 0x7f93080fce60 2024-04-26T21:22:31.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.969+0000 7f930dc00700 1 -- 172.21.15.84:0/1625040726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93081117b0 con 0x7f93080fce60 2024-04-26T21:22:31.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.970+0000 7f930dc00700 1 -- 172.21.15.84:0/1625040726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9308101960 con 0x7f93080fce60 2024-04-26T21:22:31.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.972+0000 7f92fea00700 1 -- 172.21.15.84:0/1625040726 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f92f80097a0 con 0x7f93080fce60 2024-04-26T21:22:31.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.973+0000 7f92fea00700 1 --2- 172.21.15.84:0/1625040726 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f92ec0692b0 0x7f92ec06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:31.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.973+0000 7f92fea00700 1 -- 172.21.15.84:0/1625040726 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f92f8086ec0 con 0x7f93080fce60 2024-04-26T21:22:31.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.973+0000 7f9306000700 1 --2- 172.21.15.84:0/1625040726 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f92ec0692b0 0x7f92ec06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:31.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.974+0000 7f9306000700 1 --2- 172.21.15.84:0/1625040726 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f92ec0692b0 0x7f92ec06b760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f92f4004f90 tx=0x7f92f4009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:31.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:31.980+0000 7f92fea00700 1 -- 172.21.15.84:0/1625040726 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f92f8056c80 con 0x7f93080fce60 2024-04-26T21:22:32.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:31 smithi084 ceph-mon[25539]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:22:32.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:31 smithi084 ceph-mon[25539]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:22:32.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:31 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/216324275' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:22:32.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:31 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1974478958' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:22:32.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.222+0000 7f930dc00700 1 -- 172.21.15.84:0/1625040726 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9308111a20 con 0x7f92ec0692b0 2024-04-26T21:22:32.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.224+0000 7f92fea00700 1 -- 172.21.15.84:0/1625040726 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f9308111a20 con 0x7f92ec0692b0 2024-04-26T21:22:32.225 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:22:32.225 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T21:22:32.225 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:22:32.226 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:22:32.226 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [], 2024-04-26T21:22:32.226 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "", 2024-04-26T21:22:32.226 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 image", 2024-04-26T21:22:32.226 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:22:32.226 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:22:32.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.227+0000 7f930dc00700 1 -- 172.21.15.84:0/1625040726 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f92ec0692b0 msgr2=0x7f92ec06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:32.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.227+0000 7f930dc00700 1 --2- 172.21.15.84:0/1625040726 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f92ec0692b0 0x7f92ec06b760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f92f4004f90 tx=0x7f92f4009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:32.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.227+0000 7f930dc00700 1 -- 172.21.15.84:0/1625040726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93080fce60 msgr2=0x7f930810fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:32.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.227+0000 7f930dc00700 1 --2- 172.21.15.84:0/1625040726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93080fce60 0x7f930810fc00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f92f8002a50 tx=0x7f92f80046b0 comp rx=0 tx=0).stop 2024-04-26T21:22:32.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.227+0000 7f930dc00700 1 -- 172.21.15.84:0/1625040726 shutdown_connections 2024-04-26T21:22:32.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.227+0000 7f930dc00700 1 --2- 172.21.15.84:0/1625040726 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f92ec0692b0 0x7f92ec06b760 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:32.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.227+0000 7f930dc00700 1 --2- 172.21.15.84:0/1625040726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93080fce60 0x7f930810fc00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:32.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.227+0000 7f930dc00700 1 --2- 172.21.15.84:0/1625040726 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93080fdfd0 0x7f9308110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:32.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.227+0000 7f930dc00700 1 -- 172.21.15.84:0/1625040726 >> 172.21.15.84:0/1625040726 conn(0x7f93080f8560 msgr2=0x7f93080f9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:32.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.227+0000 7f930dc00700 1 -- 172.21.15.84:0/1625040726 shutdown_connections 2024-04-26T21:22:32.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.227+0000 7f930dc00700 1 -- 172.21.15.84:0/1625040726 wait complete. 2024-04-26T21:22:32.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.384+0000 7fa55fe00700 1 -- 172.21.15.84:0/413966173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa560100060 msgr2=0x7fa5601004d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:32.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.384+0000 7fa55fe00700 1 --2- 172.21.15.84:0/413966173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa560100060 0x7fa5601004d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa54c004940 tx=0x7fa54c009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:32.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.384+0000 7fa55fe00700 1 -- 172.21.15.84:0/413966173 shutdown_connections 2024-04-26T21:22:32.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.384+0000 7fa55fe00700 1 --2- 172.21.15.84:0/413966173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa560100060 0x7fa5601004d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:32.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.384+0000 7fa55fe00700 1 --2- 172.21.15.84:0/413966173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5600fee60 0x7fa5600ff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:32.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.384+0000 7fa55fe00700 1 -- 172.21.15.84:0/413966173 >> 172.21.15.84:0/413966173 conn(0x7fa5600fa570 msgr2=0x7fa5600fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:32.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.384+0000 7fa55fe00700 1 -- 172.21.15.84:0/413966173 shutdown_connections 2024-04-26T21:22:32.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.384+0000 7fa55fe00700 1 -- 172.21.15.84:0/413966173 wait complete. 2024-04-26T21:22:32.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.385+0000 7fa55fe00700 1 Processor -- start 2024-04-26T21:22:32.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.386+0000 7fa55fe00700 1 -- start start 2024-04-26T21:22:32.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.386+0000 7fa55fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5600fee60 0x7fa56010fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:32.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.386+0000 7fa55fe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa560100060 0x7fa56010ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:32.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.386+0000 7fa55fe00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5601105d0 con 0x7fa5600fee60 2024-04-26T21:22:32.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.386+0000 7fa55fe00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa560110dd0 con 0x7fa560100060 2024-04-26T21:22:32.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.386+0000 7fa55ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5600fee60 0x7fa56010fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:32.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.386+0000 7fa55ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5600fee60 0x7fa56010fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40224/0 (socket says 172.21.15.84:40224) 2024-04-26T21:22:32.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.386+0000 7fa55ea00700 1 -- 172.21.15.84:0/2522637650 learned_addr learned my addr 172.21.15.84:0/2522637650 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:22:32.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.387+0000 7fa55e000700 1 --2- 172.21.15.84:0/2522637650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa560100060 0x7fa56010ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:32.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.387+0000 7fa55ea00700 1 -- 172.21.15.84:0/2522637650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa560100060 msgr2=0x7fa56010ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:32.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.387+0000 7fa55ea00700 1 --2- 172.21.15.84:0/2522637650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa560100060 0x7fa56010ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:32.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.387+0000 7fa55ea00700 1 -- 172.21.15.84:0/2522637650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c005040 con 0x7fa5600fee60 2024-04-26T21:22:32.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.387+0000 7fa55e000700 1 --2- 172.21.15.84:0/2522637650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa560100060 0x7fa56010ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:22:32.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.387+0000 7fa55ea00700 1 --2- 172.21.15.84:0/2522637650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5600fee60 0x7fa56010fa90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa55000c8e0 tx=0x7fa5500044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:32.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.387+0000 7fa556a00700 1 -- 172.21.15.84:0/2522637650 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa55000a940 con 0x7fa5600fee60 2024-04-26T21:22:32.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.387+0000 7fa556a00700 1 -- 172.21.15.84:0/2522637650 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa55000ce80 con 0x7fa5600fee60 2024-04-26T21:22:32.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.387+0000 7fa55fe00700 1 -- 172.21.15.84:0/2522637650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5601110b0 con 0x7fa5600fee60 2024-04-26T21:22:32.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.388+0000 7fa55fe00700 1 -- 172.21.15.84:0/2522637650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5601115f0 con 0x7fa5600fee60 2024-04-26T21:22:32.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.388+0000 7fa556a00700 1 -- 172.21.15.84:0/2522637650 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5500113a0 con 0x7fa5600fee60 2024-04-26T21:22:32.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.389+0000 7fa55fe00700 1 -- 172.21.15.84:0/2522637650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5400052e0 con 0x7fa5600fee60 2024-04-26T21:22:32.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.390+0000 7fa556a00700 1 -- 172.21.15.84:0/2522637650 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fa5500127e0 con 0x7fa5600fee60 2024-04-26T21:22:32.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.391+0000 7fa556a00700 1 --2- 172.21.15.84:0/2522637650 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fa5440692b0 0x7fa54406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:32.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.391+0000 7fa556a00700 1 -- 172.21.15.84:0/2522637650 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa550087100 con 0x7fa5600fee60 2024-04-26T21:22:32.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.391+0000 7fa55e000700 1 --2- 172.21.15.84:0/2522637650 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fa5440692b0 0x7fa54406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:32.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.392+0000 7fa55e000700 1 --2- 172.21.15.84:0/2522637650 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fa5440692b0 0x7fa54406b760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00b7a0 tx=0x7fa54c009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:32.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.395+0000 7fa556a00700 1 -- 172.21.15.84:0/2522637650 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa550056f60 con 0x7fa5600fee60 2024-04-26T21:22:32.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:31 smithi120 ceph-mon[32741]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:22:32.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:31 smithi120 ceph-mon[32741]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:22:32.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:31 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/216324275' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:22:32.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:31 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/1974478958' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:22:32.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.710+0000 7fa55fe00700 1 -- 172.21.15.84:0/2522637650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa540005590 con 0x7fa5600fee60 2024-04-26T21:22:32.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.710+0000 7fa556a00700 1 -- 172.21.15.84:0/2522637650 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fa550056af0 con 0x7fa5600fee60 2024-04-26T21:22:32.712 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:22:32.712 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:22:32.712 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:22:32.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.713+0000 7fa55fe00700 1 -- 172.21.15.84:0/2522637650 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fa5440692b0 msgr2=0x7fa54406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:32.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.713+0000 7fa55fe00700 1 --2- 172.21.15.84:0/2522637650 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fa5440692b0 0x7fa54406b760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00b7a0 tx=0x7fa54c009e30 comp rx=0 tx=0).stop 2024-04-26T21:22:32.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.713+0000 7fa55fe00700 1 -- 172.21.15.84:0/2522637650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5600fee60 msgr2=0x7fa56010fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:32.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.713+0000 7fa55fe00700 1 --2- 172.21.15.84:0/2522637650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5600fee60 0x7fa56010fa90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa55000c8e0 tx=0x7fa5500044c0 comp rx=0 tx=0).stop 2024-04-26T21:22:32.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.713+0000 7fa55fe00700 1 -- 172.21.15.84:0/2522637650 shutdown_connections 2024-04-26T21:22:32.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.713+0000 7fa55fe00700 1 --2- 172.21.15.84:0/2522637650 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fa5440692b0 0x7fa54406b760 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:32.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.713+0000 7fa55fe00700 1 --2- 172.21.15.84:0/2522637650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5600fee60 0x7fa56010fa90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:32.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.713+0000 7fa55fe00700 1 --2- 172.21.15.84:0/2522637650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa560100060 0x7fa56010ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:32.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.713+0000 7fa55fe00700 1 -- 172.21.15.84:0/2522637650 >> 172.21.15.84:0/2522637650 conn(0x7fa5600fa570 msgr2=0x7fa5600fbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:32.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.714+0000 7fa55fe00700 1 -- 172.21.15.84:0/2522637650 shutdown_connections 2024-04-26T21:22:32.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:22:32.714+0000 7fa55fe00700 1 -- 172.21.15.84:0/2522637650 wait complete. 2024-04-26T21:22:32.963 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:32 smithi084 ceph-mon[25539]: pgmap v253: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-26T21:22:32.963 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:32 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2522637650' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:22:33.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:32 smithi120 ceph-mon[32741]: pgmap v253: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-26T21:22:33.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:32 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2522637650' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:22:34.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:33 smithi084 ceph-mon[25539]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:22:34.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:33 smithi120 ceph-mon[32741]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:22:35.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:34 smithi084 ceph-mon[25539]: pgmap v254: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-26T21:22:35.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:34 smithi120 ceph-mon[32741]: pgmap v254: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-26T21:22:37.237 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:36 smithi084 ceph-mon[25539]: pgmap v255: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:37.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:36 smithi120 ceph-mon[32741]: pgmap v255: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:39.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:38 smithi084 ceph-mon[25539]: pgmap v256: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:39.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:38 smithi120 ceph-mon[32741]: pgmap v256: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:41.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:40 smithi084 ceph-mon[25539]: pgmap v257: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:41.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:40 smithi120 ceph-mon[32741]: pgmap v257: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:42.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:42 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:22:42.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:42 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:22:43.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:43 smithi084 ceph-mon[25539]: pgmap v258: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:43.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:43 smithi120 ceph-mon[32741]: pgmap v258: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:45 smithi084 ceph-mon[25539]: pgmap v259: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:45 smithi120 ceph-mon[32741]: pgmap v259: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:47.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:47 smithi084 ceph-mon[25539]: pgmap v260: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:47 smithi120 ceph-mon[32741]: pgmap v260: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:49.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:49 smithi084 ceph-mon[25539]: pgmap v261: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:49.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:49 smithi120 ceph-mon[32741]: pgmap v261: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:51.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:51 smithi084 ceph-mon[25539]: pgmap v262: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:51 smithi120 ceph-mon[32741]: pgmap v262: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:53.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:53 smithi084 ceph-mon[25539]: pgmap v263: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:53 smithi120 ceph-mon[32741]: pgmap v263: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:55.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:55 smithi084 ceph-mon[25539]: pgmap v264: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:55 smithi120 ceph-mon[32741]: pgmap v264: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:57.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:57 smithi084 ceph-mon[25539]: pgmap v265: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:57.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:57 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:22:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:57 smithi120 ceph-mon[32741]: pgmap v265: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:57 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:22:59.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:22:59 smithi084 ceph-mon[25539]: pgmap v266: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:22:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:22:59 smithi120 ceph-mon[32741]: pgmap v266: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:01.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:01 smithi084 ceph-mon[25539]: pgmap v267: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:01.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:01 smithi120 ceph-mon[32741]: pgmap v267: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:02.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.898+0000 7f6775800700 1 -- 172.21.15.84:0/3427102722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67700fcf10 msgr2=0x7f67700fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:02.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.898+0000 7f6775800700 1 --2- 172.21.15.84:0/3427102722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67700fcf10 0x7f67700fd320 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6760004940 tx=0x7f6760009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:02.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.899+0000 7f6775800700 1 -- 172.21.15.84:0/3427102722 shutdown_connections 2024-04-26T21:23:02.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.899+0000 7f6775800700 1 --2- 172.21.15.84:0/3427102722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67700fe080 0x7f67700fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:02.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.899+0000 7f6775800700 1 --2- 172.21.15.84:0/3427102722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67700fcf10 0x7f67700fd320 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:02.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.899+0000 7f6775800700 1 -- 172.21.15.84:0/3427102722 >> 172.21.15.84:0/3427102722 conn(0x7f67700f8560 msgr2=0x7f67700fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:02.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.899+0000 7f6775800700 1 -- 172.21.15.84:0/3427102722 shutdown_connections 2024-04-26T21:23:02.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.899+0000 7f6775800700 1 -- 172.21.15.84:0/3427102722 wait complete. 2024-04-26T21:23:02.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.900+0000 7f6775800700 1 Processor -- start 2024-04-26T21:23:02.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.900+0000 7f6775800700 1 -- start start 2024-04-26T21:23:02.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.901+0000 7f6775800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67700fcf10 0x7f677010d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:02.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.901+0000 7f6775800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67700fe080 0x7f677010dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:02.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.901+0000 7f6775800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677010e4a0 con 0x7f67700fe080 2024-04-26T21:23:02.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.901+0000 7f6775800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677010ecf0 con 0x7f67700fcf10 2024-04-26T21:23:02.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.901+0000 7f676e000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67700fe080 0x7f677010dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:02.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.901+0000 7f676e000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67700fe080 0x7f677010dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59904/0 (socket says 172.21.15.84:59904) 2024-04-26T21:23:02.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.901+0000 7f676e000700 1 -- 172.21.15.84:0/2545776204 learned_addr learned my addr 172.21.15.84:0/2545776204 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:23:02.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.901+0000 7f676ea00700 1 --2- 172.21.15.84:0/2545776204 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67700fcf10 0x7f677010d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:02.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.902+0000 7f676e000700 1 -- 172.21.15.84:0/2545776204 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67700fcf10 msgr2=0x7f677010d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:02.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.902+0000 7f676e000700 1 --2- 172.21.15.84:0/2545776204 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67700fcf10 0x7f677010d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:02.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.902+0000 7f676e000700 1 -- 172.21.15.84:0/2545776204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6760005040 con 0x7f67700fe080 2024-04-26T21:23:02.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.902+0000 7f676e000700 1 --2- 172.21.15.84:0/2545776204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67700fe080 0x7f677010dea0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f675c00eb40 tx=0x7f675c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:02.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.902+0000 7f6766a00700 1 -- 172.21.15.84:0/2545776204 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f675c007cc0 con 0x7f67700fe080 2024-04-26T21:23:02.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.903+0000 7f6775800700 1 -- 172.21.15.84:0/2545776204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677010ef70 con 0x7f67700fe080 2024-04-26T21:23:02.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.903+0000 7f6766a00700 1 -- 172.21.15.84:0/2545776204 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f675c00f040 con 0x7f67700fe080 2024-04-26T21:23:02.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.903+0000 7f6766a00700 1 -- 172.21.15.84:0/2545776204 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f675c00ca10 con 0x7f67700fe080 2024-04-26T21:23:02.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.903+0000 7f6775800700 1 -- 172.21.15.84:0/2545776204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677010f4b0 con 0x7f67700fe080 2024-04-26T21:23:02.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.904+0000 7f6775800700 1 -- 172.21.15.84:0/2545776204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677005f5c0 con 0x7f67700fe080 2024-04-26T21:23:02.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.905+0000 7f6766a00700 1 -- 172.21.15.84:0/2545776204 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f675c00cc80 con 0x7f67700fe080 2024-04-26T21:23:02.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.906+0000 7f6766a00700 1 --2- 172.21.15.84:0/2545776204 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f67540692b0 0x7f675406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:02.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.906+0000 7f6766a00700 1 -- 172.21.15.84:0/2545776204 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f675c086d90 con 0x7f67700fe080 2024-04-26T21:23:02.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.907+0000 7f676ea00700 1 --2- 172.21.15.84:0/2545776204 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f67540692b0 0x7f675406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:02.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.908+0000 7f676ea00700 1 --2- 172.21.15.84:0/2545776204 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f67540692b0 0x7f675406b760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6760009fd0 tx=0x7f6760009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:02.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:02.912+0000 7f6766a00700 1 -- 172.21.15.84:0/2545776204 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f675c04e250 con 0x7f67700fe080 2024-04-26T21:23:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.240+0000 7f6775800700 1 -- 172.21.15.84:0/2545776204 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f677010f850 con 0x7f67540692b0 2024-04-26T21:23:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.242+0000 7f6766a00700 1 -- 172.21.15.84:0/2545776204 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f677010f850 con 0x7f67540692b0 2024-04-26T21:23:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.244+0000 7f6775800700 1 -- 172.21.15.84:0/2545776204 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f67540692b0 msgr2=0x7f675406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.244+0000 7f6775800700 1 --2- 172.21.15.84:0/2545776204 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f67540692b0 0x7f675406b760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6760009fd0 tx=0x7f6760009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.244+0000 7f6775800700 1 -- 172.21.15.84:0/2545776204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67700fe080 msgr2=0x7f677010dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.244+0000 7f6775800700 1 --2- 172.21.15.84:0/2545776204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67700fe080 0x7f677010dea0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f675c00eb40 tx=0x7f675c00b040 comp rx=0 tx=0).stop 2024-04-26T21:23:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.244+0000 7f6775800700 1 -- 172.21.15.84:0/2545776204 shutdown_connections 2024-04-26T21:23:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.244+0000 7f6775800700 1 --2- 172.21.15.84:0/2545776204 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f67540692b0 0x7f675406b760 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:03.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.244+0000 7f6775800700 1 --2- 172.21.15.84:0/2545776204 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67700fcf10 0x7f677010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:03.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.244+0000 7f6775800700 1 --2- 172.21.15.84:0/2545776204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67700fe080 0x7f677010dea0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:03.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.244+0000 7f6775800700 1 -- 172.21.15.84:0/2545776204 >> 172.21.15.84:0/2545776204 conn(0x7f67700f8560 msgr2=0x7f67700f9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:03.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.245+0000 7f6775800700 1 -- 172.21.15.84:0/2545776204 shutdown_connections 2024-04-26T21:23:03.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.245+0000 7f6775800700 1 -- 172.21.15.84:0/2545776204 wait complete. 2024-04-26T21:23:03.265 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:23:03.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:03 smithi084 ceph-mon[25539]: pgmap v268: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:03.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.426+0000 7fc6ef000700 1 -- 172.21.15.84:0/3573210344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e80fefd0 msgr2=0x7fc6e80ff3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:03.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.426+0000 7fc6ef000700 1 --2- 172.21.15.84:0/3573210344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e80fefd0 0x7fc6e80ff3e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8004940 tx=0x7fc6d8009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:03.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.426+0000 7fc6ef000700 1 -- 172.21.15.84:0/3573210344 shutdown_connections 2024-04-26T21:23:03.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.426+0000 7fc6ef000700 1 --2- 172.21.15.84:0/3573210344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6e8100280 0x7fc6e81006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:03.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.426+0000 7fc6ef000700 1 --2- 172.21.15.84:0/3573210344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e80fefd0 0x7fc6e80ff3e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:03.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.426+0000 7fc6ef000700 1 -- 172.21.15.84:0/3573210344 >> 172.21.15.84:0/3573210344 conn(0x7fc6e80fa8f0 msgr2=0x7fc6e80fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:03.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.427+0000 7fc6ef000700 1 -- 172.21.15.84:0/3573210344 shutdown_connections 2024-04-26T21:23:03.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.427+0000 7fc6ef000700 1 -- 172.21.15.84:0/3573210344 wait complete. 2024-04-26T21:23:03.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.428+0000 7fc6ef000700 1 Processor -- start 2024-04-26T21:23:03.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.428+0000 7fc6ef000700 1 -- start start 2024-04-26T21:23:03.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.428+0000 7fc6ef000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6e80fefd0 0x7fc6e810b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:03.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.428+0000 7fc6ef000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e8100280 0x7fc6e810bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:03.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.429+0000 7fc6ef000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e810c2e0 con 0x7fc6e8100280 2024-04-26T21:23:03.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.429+0000 7fc6ef000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e810cb30 con 0x7fc6e80fefd0 2024-04-26T21:23:03.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.429+0000 7fc6e7e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6e80fefd0 0x7fc6e810b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:03.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.429+0000 7fc6e7e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6e80fefd0 0x7fc6e810b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:41476/0 (socket says 172.21.15.84:41476) 2024-04-26T21:23:03.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.429+0000 7fc6e7e00700 1 -- 172.21.15.84:0/486027575 learned_addr learned my addr 172.21.15.84:0/486027575 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:23:03.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.429+0000 7fc6e7400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e8100280 0x7fc6e810bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:03.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.429+0000 7fc6e7e00700 1 -- 172.21.15.84:0/486027575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e8100280 msgr2=0x7fc6e810bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:03.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.429+0000 7fc6e7e00700 1 --2- 172.21.15.84:0/486027575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e8100280 0x7fc6e810bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:03.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.429+0000 7fc6e7e00700 1 -- 172.21.15.84:0/486027575 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d8005040 con 0x7fc6e80fefd0 2024-04-26T21:23:03.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.430+0000 7fc6e7e00700 1 --2- 172.21.15.84:0/486027575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6e80fefd0 0x7fc6e810b750 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8013870 tx=0x7fc6d8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:03.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.430+0000 7fc6dfe00700 1 -- 172.21.15.84:0/486027575 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6d800e070 con 0x7fc6e80fefd0 2024-04-26T21:23:03.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.430+0000 7fc6ef000700 1 -- 172.21.15.84:0/486027575 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e810cdb0 con 0x7fc6e80fefd0 2024-04-26T21:23:03.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.430+0000 7fc6dfe00700 1 -- 172.21.15.84:0/486027575 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6d8013de0 con 0x7fc6e80fefd0 2024-04-26T21:23:03.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.430+0000 7fc6dfe00700 1 -- 172.21.15.84:0/486027575 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6d801ce70 con 0x7fc6e80fefd0 2024-04-26T21:23:03.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.430+0000 7fc6ef000700 1 -- 172.21.15.84:0/486027575 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e810d290 con 0x7fc6e80fefd0 2024-04-26T21:23:03.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:03 smithi120 ceph-mon[32741]: pgmap v268: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:03.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.432+0000 7fc6ef000700 1 -- 172.21.15.84:0/486027575 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e805f5c0 con 0x7fc6e80fefd0 2024-04-26T21:23:03.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.433+0000 7fc6dfe00700 1 -- 172.21.15.84:0/486027575 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fc6d801c690 con 0x7fc6e80fefd0 2024-04-26T21:23:03.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.434+0000 7fc6dfe00700 1 --2- 172.21.15.84:0/486027575 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc6cc0692b0 0x7fc6cc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:03.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.434+0000 7fc6dfe00700 1 -- 172.21.15.84:0/486027575 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fc6d8088980 con 0x7fc6e80fefd0 2024-04-26T21:23:03.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.435+0000 7fc6e7400700 1 --2- 172.21.15.84:0/486027575 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc6cc0692b0 0x7fc6cc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:03.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.436+0000 7fc6e7400700 1 --2- 172.21.15.84:0/486027575 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc6cc0692b0 0x7fc6cc06b760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009b80 tx=0x7fc6d400b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:03.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.444+0000 7fc6dfe00700 1 -- 172.21.15.84:0/486027575 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc6d8054b90 con 0x7fc6e80fefd0 2024-04-26T21:23:03.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.863+0000 7fc6ef000700 1 -- 172.21.15.84:0/486027575 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6e810d570 con 0x7fc6cc0692b0 2024-04-26T21:23:03.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.864+0000 7fc6dfe00700 1 -- 172.21.15.84:0/486027575 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fc6e810d570 con 0x7fc6cc0692b0 2024-04-26T21:23:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.868+0000 7fc6ef000700 1 -- 172.21.15.84:0/486027575 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc6cc0692b0 msgr2=0x7fc6cc06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.868+0000 7fc6ef000700 1 --2- 172.21.15.84:0/486027575 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc6cc0692b0 0x7fc6cc06b760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009b80 tx=0x7fc6d400b040 comp rx=0 tx=0).stop 2024-04-26T21:23:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.868+0000 7fc6ef000700 1 -- 172.21.15.84:0/486027575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6e80fefd0 msgr2=0x7fc6e810b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:03.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.868+0000 7fc6ef000700 1 --2- 172.21.15.84:0/486027575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6e80fefd0 0x7fc6e810b750 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8013870 tx=0x7fc6d8009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:03.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.868+0000 7fc6ef000700 1 -- 172.21.15.84:0/486027575 shutdown_connections 2024-04-26T21:23:03.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.868+0000 7fc6ef000700 1 --2- 172.21.15.84:0/486027575 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fc6cc0692b0 0x7fc6cc06b760 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:03.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.868+0000 7fc6ef000700 1 --2- 172.21.15.84:0/486027575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6e80fefd0 0x7fc6e810b750 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:03.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.868+0000 7fc6ef000700 1 --2- 172.21.15.84:0/486027575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e8100280 0x7fc6e810bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:03.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.868+0000 7fc6ef000700 1 -- 172.21.15.84:0/486027575 >> 172.21.15.84:0/486027575 conn(0x7fc6e80fa8f0 msgr2=0x7fc6e80fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:03.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.869+0000 7fc6ef000700 1 -- 172.21.15.84:0/486027575 shutdown_connections 2024-04-26T21:23:03.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:03.869+0000 7fc6ef000700 1 -- 172.21.15.84:0/486027575 wait complete. 2024-04-26T21:23:04.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.067+0000 7fe372c00700 1 -- 172.21.15.84:0/2978692014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe36c070830 msgr2=0x7fe36c070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:04.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.067+0000 7fe372c00700 1 --2- 172.21.15.84:0/2978692014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe36c070830 0x7fe36c070ca0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe358004940 tx=0x7fe358009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:04.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.067+0000 7fe372c00700 1 -- 172.21.15.84:0/2978692014 shutdown_connections 2024-04-26T21:23:04.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.067+0000 7fe372c00700 1 --2- 172.21.15.84:0/2978692014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe36c070830 0x7fe36c070ca0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:04.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.067+0000 7fe372c00700 1 --2- 172.21.15.84:0/2978692014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe36c071de0 0x7fe36c0702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:04.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.067+0000 7fe372c00700 1 -- 172.21.15.84:0/2978692014 >> 172.21.15.84:0/2978692014 conn(0x7fe36c0f8340 msgr2=0x7fe36c0fa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:04.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.067+0000 7fe372c00700 1 -- 172.21.15.84:0/2978692014 shutdown_connections 2024-04-26T21:23:04.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.067+0000 7fe372c00700 1 -- 172.21.15.84:0/2978692014 wait complete. 2024-04-26T21:23:04.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.068+0000 7fe372c00700 1 Processor -- start 2024-04-26T21:23:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.069+0000 7fe372c00700 1 -- start start 2024-04-26T21:23:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.069+0000 7fe372c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe36c070830 0x7fe36c06e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.069+0000 7fe372c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe36c071de0 0x7fe36c06e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.070+0000 7fe372c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c06ff50 con 0x7fe36c070830 2024-04-26T21:23:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.070+0000 7fe372c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c06ede0 con 0x7fe36c071de0 2024-04-26T21:23:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.070+0000 7fe371800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe36c070830 0x7fe36c06e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.070+0000 7fe371800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe36c070830 0x7fe36c06e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59938/0 (socket says 172.21.15.84:59938) 2024-04-26T21:23:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.070+0000 7fe371800700 1 -- 172.21.15.84:0/959993442 learned_addr learned my addr 172.21.15.84:0/959993442 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:23:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.070+0000 7fe370e00700 1 --2- 172.21.15.84:0/959993442 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe36c071de0 0x7fe36c06e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.070+0000 7fe371800700 1 -- 172.21.15.84:0/959993442 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe36c071de0 msgr2=0x7fe36c06e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.070+0000 7fe371800700 1 --2- 172.21.15.84:0/959993442 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe36c071de0 0x7fe36c06e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.070+0000 7fe371800700 1 -- 172.21.15.84:0/959993442 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe358005040 con 0x7fe36c070830 2024-04-26T21:23:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.071+0000 7fe371800700 1 --2- 172.21.15.84:0/959993442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe36c070830 0x7fe36c06e360 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe36000eb70 tx=0x7fe36000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.072+0000 7fe369600700 1 -- 172.21.15.84:0/959993442 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe360007cc0 con 0x7fe36c070830 2024-04-26T21:23:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.072+0000 7fe372c00700 1 -- 172.21.15.84:0/959993442 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe36c06f060 con 0x7fe36c070830 2024-04-26T21:23:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.072+0000 7fe372c00700 1 -- 172.21.15.84:0/959993442 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe36c10cfa0 con 0x7fe36c070830 2024-04-26T21:23:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.073+0000 7fe369600700 1 -- 172.21.15.84:0/959993442 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe36000f040 con 0x7fe36c070830 2024-04-26T21:23:04.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.073+0000 7fe372c00700 1 -- 172.21.15.84:0/959993442 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe36c0fc000 con 0x7fe36c070830 2024-04-26T21:23:04.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.074+0000 7fe369600700 1 -- 172.21.15.84:0/959993442 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe36000ca20 con 0x7fe36c070830 2024-04-26T21:23:04.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.076+0000 7fe369600700 1 -- 172.21.15.84:0/959993442 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe36000cc40 con 0x7fe36c070830 2024-04-26T21:23:04.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.077+0000 7fe369600700 1 --2- 172.21.15.84:0/959993442 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe3540693b0 0x7fe35406b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:04.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.077+0000 7fe369600700 1 -- 172.21.15.84:0/959993442 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe360086c70 con 0x7fe36c070830 2024-04-26T21:23:04.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.078+0000 7fe370e00700 1 --2- 172.21.15.84:0/959993442 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe3540693b0 0x7fe35406b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:04.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.079+0000 7fe370e00700 1 --2- 172.21.15.84:0/959993442 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe3540693b0 0x7fe35406b860 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe35800b0d0 tx=0x7fe358009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.084+0000 7fe369600700 1 -- 172.21.15.84:0/959993442 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe36004e250 con 0x7fe36c070830 2024-04-26T21:23:04.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.452+0000 7fe372c00700 1 -- 172.21.15.84:0/959993442 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe36c103c00 con 0x7fe3540693b0 2024-04-26T21:23:04.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.463+0000 7fe369600700 1 -- 172.21.15.84:0/959993442 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fe36c103c00 con 0x7fe3540693b0 2024-04-26T21:23:04.464 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:23:04.464 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (6m) 74s ago 8m 13.3M - 0.25.0 c8568f914cd2 e17e61753bb1 2024-04-26T21:23:04.464 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (9m) 74s ago 9m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 a111b0ee8187 2024-04-26T21:23:04.465 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (7m) 80s ago 7m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 66f4d21263a1 2024-04-26T21:23:04.465 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (6m) 74s ago 8m 73.9M - 9.4.7 954c08fa6188 67caa0766f89 2024-04-26T21:23:04.465 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (106s) 74s ago 105s 13.3M - 17.2.7-907-g2be3efa9 1c5834633715 485d7884e1d5 2024-04-26T21:23:04.465 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (97s) 74s ago 96s 10.5M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:23:04.465 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (102s) 80s ago 102s 12.7M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:23:04.465 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (93s) 80s ago 93s 10.4M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:23:04.465 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:9283 running (10m) 74s ago 10m 480M - 17.2.7-907-g2be3efa9 1c5834633715 98242b12bd6c 2024-04-26T21:23:04.466 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283 running (7m) 80s ago 7m 432M - 17.2.7-907-g2be3efa9 1c5834633715 29dc99fc0efb 2024-04-26T21:23:04.466 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (10m) 74s ago 10m 44.7M 2048M 17.2.7-907-g2be3efa9 1c5834633715 24cc2d798ea7 2024-04-26T21:23:04.466 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (7m) 80s ago 7m 35.0M 2048M 17.2.7-907-g2be3efa9 1c5834633715 72c786fd622b 2024-04-26T21:23:04.466 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (8m) 74s ago 8m 7470k - 1.5.0 0da6a335fe13 8fdbcc05a9dd 2024-04-26T21:23:04.466 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (7m) 80s ago 7m 7482k - 1.5.0 0da6a335fe13 1b07a56a6ace 2024-04-26T21:23:04.467 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (6m) 74s ago 6m 45.2M 4288M 17.2.7-907-g2be3efa9 1c5834633715 3a2e74d7e51a 2024-04-26T21:23:04.467 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (5m) 74s ago 5m 44.9M 4288M 17.2.7-907-g2be3efa9 1c5834633715 d283a0a93213 2024-04-26T21:23:04.467 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (5m) 74s ago 5m 43.1M 4288M 17.2.7-907-g2be3efa9 1c5834633715 5899468fc5c8 2024-04-26T21:23:04.467 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (4m) 80s ago 4m 43.1M 5312M 17.2.7-907-g2be3efa9 1c5834633715 b8a14c87d730 2024-04-26T21:23:04.467 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (4m) 80s ago 4m 40.8M 5312M 17.2.7-907-g2be3efa9 1c5834633715 4d294df735a3 2024-04-26T21:23:04.467 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (3m) 80s ago 3m 40.7M 5312M 17.2.7-907-g2be3efa9 1c5834633715 9b60997971a8 2024-04-26T21:23:04.467 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (6m) 74s ago 8m 46.1M - 2.43.0 a07b618ecd1d 7b6983aea888 2024-04-26T21:23:04.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.465+0000 7fe372c00700 1 -- 172.21.15.84:0/959993442 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe3540693b0 msgr2=0x7fe35406b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:04.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.465+0000 7fe372c00700 1 --2- 172.21.15.84:0/959993442 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe3540693b0 0x7fe35406b860 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe35800b0d0 tx=0x7fe358009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:04.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.465+0000 7fe372c00700 1 -- 172.21.15.84:0/959993442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe36c070830 msgr2=0x7fe36c06e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:04.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.465+0000 7fe372c00700 1 --2- 172.21.15.84:0/959993442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe36c070830 0x7fe36c06e360 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe36000eb70 tx=0x7fe36000b040 comp rx=0 tx=0).stop 2024-04-26T21:23:04.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.466+0000 7fe372c00700 1 -- 172.21.15.84:0/959993442 shutdown_connections 2024-04-26T21:23:04.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.466+0000 7fe372c00700 1 --2- 172.21.15.84:0/959993442 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe3540693b0 0x7fe35406b860 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:04.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.466+0000 7fe372c00700 1 --2- 172.21.15.84:0/959993442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe36c070830 0x7fe36c06e360 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:04.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.466+0000 7fe372c00700 1 --2- 172.21.15.84:0/959993442 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe36c071de0 0x7fe36c06e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:04.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.466+0000 7fe372c00700 1 -- 172.21.15.84:0/959993442 >> 172.21.15.84:0/959993442 conn(0x7fe36c0f8340 msgr2=0x7fe36c0f99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:04.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.466+0000 7fe372c00700 1 -- 172.21.15.84:0/959993442 shutdown_connections 2024-04-26T21:23:04.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.466+0000 7fe372c00700 1 -- 172.21.15.84:0/959993442 wait complete. 2024-04-26T21:23:04.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.669+0000 7f6a0ce00700 1 -- 172.21.15.84:0/2923701023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a080ff720 msgr2=0x7f6a08100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:04.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.669+0000 7f6a0ce00700 1 --2- 172.21.15.84:0/2923701023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a080ff720 0x7f6a08100080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f69f4004880 tx=0x7f69f4009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:04.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.669+0000 7f6a0ce00700 1 -- 172.21.15.84:0/2923701023 shutdown_connections 2024-04-26T21:23:04.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.669+0000 7f6a0ce00700 1 --2- 172.21.15.84:0/2923701023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a080ff720 0x7f6a08100080 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:04.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.669+0000 7f6a0ce00700 1 --2- 172.21.15.84:0/2923701023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a080fedd0 0x7f6a080ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:04.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.669+0000 7f6a0ce00700 1 -- 172.21.15.84:0/2923701023 >> 172.21.15.84:0/2923701023 conn(0x7f6a080fa570 msgr2=0x7f6a080fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:04.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.671+0000 7f6a0ce00700 1 -- 172.21.15.84:0/2923701023 shutdown_connections 2024-04-26T21:23:04.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.671+0000 7f6a0ce00700 1 -- 172.21.15.84:0/2923701023 wait complete. 2024-04-26T21:23:04.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.672+0000 7f6a0ce00700 1 Processor -- start 2024-04-26T21:23:04.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.672+0000 7f6a0ce00700 1 -- start start 2024-04-26T21:23:04.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.672+0000 7f6a0ce00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a080fedd0 0x7f6a0810fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:04.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.672+0000 7f6a0ce00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a080ff720 0x7f6a0810ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:04.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.672+0000 7f6a0ce00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a081105c0 con 0x7f6a080ff720 2024-04-26T21:23:04.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.672+0000 7f6a0ce00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a08110e10 con 0x7f6a080fedd0 2024-04-26T21:23:04.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.673+0000 7f6a07400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a080fedd0 0x7f6a0810fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:04.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.673+0000 7f6a07400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a080fedd0 0x7f6a0810fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:41514/0 (socket says 172.21.15.84:41514) 2024-04-26T21:23:04.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.673+0000 7f6a07400700 1 -- 172.21.15.84:0/2098754139 learned_addr learned my addr 172.21.15.84:0/2098754139 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:23:04.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.673+0000 7f6a06a00700 1 --2- 172.21.15.84:0/2098754139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a080ff720 0x7f6a0810ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:04.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.673+0000 7f6a07400700 1 -- 172.21.15.84:0/2098754139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a080ff720 msgr2=0x7f6a0810ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:04.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.673+0000 7f6a07400700 1 --2- 172.21.15.84:0/2098754139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a080ff720 0x7f6a0810ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:04.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.673+0000 7f6a07400700 1 -- 172.21.15.84:0/2098754139 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f8005040 con 0x7f6a080fedd0 2024-04-26T21:23:04.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.674+0000 7f6a07400700 1 --2- 172.21.15.84:0/2098754139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a080fedd0 0x7f6a0810fa80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f69f80096b0 tx=0x7f69f8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:04.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.674+0000 7f69ff400700 1 -- 172.21.15.84:0/2098754139 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69f800e840 con 0x7f6a080fedd0 2024-04-26T21:23:04.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.674+0000 7f69ff400700 1 -- 172.21.15.84:0/2098754139 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f69f800f040 con 0x7f6a080fedd0 2024-04-26T21:23:04.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.674+0000 7f69ff400700 1 -- 172.21.15.84:0/2098754139 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69f8013dc0 con 0x7f6a080fedd0 2024-04-26T21:23:04.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.675+0000 7f6a0ce00700 1 -- 172.21.15.84:0/2098754139 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f4005040 con 0x7f6a080fedd0 2024-04-26T21:23:04.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.675+0000 7f6a0ce00700 1 -- 172.21.15.84:0/2098754139 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a08111440 con 0x7f6a080fedd0 2024-04-26T21:23:04.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.676+0000 7f6a0ce00700 1 -- 172.21.15.84:0/2098754139 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0805f5c0 con 0x7f6a080fedd0 2024-04-26T21:23:04.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.678+0000 7f69ff400700 1 -- 172.21.15.84:0/2098754139 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f69f800e9a0 con 0x7f6a080fedd0 2024-04-26T21:23:04.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.679+0000 7f69ff400700 1 --2- 172.21.15.84:0/2098754139 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f69ec0692b0 0x7f69ec06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:04.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.679+0000 7f69ff400700 1 -- 172.21.15.84:0/2098754139 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f69f8087090 con 0x7f6a080fedd0 2024-04-26T21:23:04.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.680+0000 7f6a06a00700 1 --2- 172.21.15.84:0/2098754139 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f69ec0692b0 0x7f69ec06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:04.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.681+0000 7f6a06a00700 1 --2- 172.21.15.84:0/2098754139 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f69ec0692b0 0x7f69ec06b760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f69f4000c00 tx=0x7f69f4009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:04.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:04.687+0000 7f69ff400700 1 -- 172.21.15.84:0/2098754139 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f69f8056db0 con 0x7f6a080fedd0 2024-04-26T21:23:05.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.239+0000 7f6a0ce00700 1 -- 172.21.15.84:0/2098754139 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6a081117b0 con 0x7f6a080fedd0 2024-04-26T21:23:05.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.240+0000 7f69ff400700 1 -- 172.21.15.84:0/2098754139 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f69f8056940 con 0x7f6a080fedd0 2024-04-26T21:23:05.244 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:23:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:23:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-26T21:23:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:23:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:23:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-26T21:23:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:23:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:23:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-26T21:23:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:23:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:23:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-26T21:23:05.245 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:23:05.245 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:23:05.245 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 14 2024-04-26T21:23:05.245 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:23:05.245 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:23:05.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.244+0000 7f6a0ce00700 1 -- 172.21.15.84:0/2098754139 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f69ec0692b0 msgr2=0x7f69ec06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:05.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.244+0000 7f6a0ce00700 1 --2- 172.21.15.84:0/2098754139 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f69ec0692b0 0x7f69ec06b760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f69f4000c00 tx=0x7f69f4009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:05.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.244+0000 7f6a0ce00700 1 -- 172.21.15.84:0/2098754139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a080fedd0 msgr2=0x7f6a0810fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:05.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.244+0000 7f6a0ce00700 1 --2- 172.21.15.84:0/2098754139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a080fedd0 0x7f6a0810fa80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f69f80096b0 tx=0x7f69f8009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:05.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.244+0000 7f6a0ce00700 1 -- 172.21.15.84:0/2098754139 shutdown_connections 2024-04-26T21:23:05.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.244+0000 7f6a0ce00700 1 --2- 172.21.15.84:0/2098754139 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f69ec0692b0 0x7f69ec06b760 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:05.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.244+0000 7f6a0ce00700 1 --2- 172.21.15.84:0/2098754139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a080fedd0 0x7f6a0810fa80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:05.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.244+0000 7f6a0ce00700 1 --2- 172.21.15.84:0/2098754139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a080ff720 0x7f6a0810ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:05.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.244+0000 7f6a0ce00700 1 -- 172.21.15.84:0/2098754139 >> 172.21.15.84:0/2098754139 conn(0x7f6a080fa570 msgr2=0x7f6a080fbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:05.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.245+0000 7f6a0ce00700 1 -- 172.21.15.84:0/2098754139 shutdown_connections 2024-04-26T21:23:05.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.245+0000 7f6a0ce00700 1 -- 172.21.15.84:0/2098754139 wait complete. 2024-04-26T21:23:05.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:05 smithi084 ceph-mon[25539]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:23:05.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:05 smithi084 ceph-mon[25539]: pgmap v269: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:05.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:05 smithi084 ceph-mon[25539]: from='client.24303 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:23:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:05 smithi120 ceph-mon[32741]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:23:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:05 smithi120 ceph-mon[32741]: pgmap v269: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:05 smithi120 ceph-mon[32741]: from='client.24303 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:23:05.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.451+0000 7efcf7e00700 1 -- 172.21.15.84:0/2736179621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcf80fdec0 msgr2=0x7efcf80fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:05.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.451+0000 7efcf7e00700 1 --2- 172.21.15.84:0/2736179621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcf80fdec0 0x7efcf80fe330 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efce4004880 tx=0x7efce4009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:05.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.452+0000 7efcf7e00700 1 -- 172.21.15.84:0/2736179621 shutdown_connections 2024-04-26T21:23:05.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.452+0000 7efcf7e00700 1 --2- 172.21.15.84:0/2736179621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcf80fdec0 0x7efcf80fe330 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:05.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.452+0000 7efcf7e00700 1 --2- 172.21.15.84:0/2736179621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcf80fcc10 0x7efcf80fd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:05.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.452+0000 7efcf7e00700 1 -- 172.21.15.84:0/2736179621 >> 172.21.15.84:0/2736179621 conn(0x7efcf80f8370 msgr2=0x7efcf80fa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:05.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.452+0000 7efcf7e00700 1 -- 172.21.15.84:0/2736179621 shutdown_connections 2024-04-26T21:23:05.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.452+0000 7efcf7e00700 1 -- 172.21.15.84:0/2736179621 wait complete. 2024-04-26T21:23:05.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.453+0000 7efcf7e00700 1 Processor -- start 2024-04-26T21:23:05.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.453+0000 7efcf7e00700 1 -- start start 2024-04-26T21:23:05.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.453+0000 7efcf7e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcf80fcc10 0x7efcf8113f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:05.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.454+0000 7efcf7e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcf80fdec0 0x7efcf8114460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:05.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.454+0000 7efcf7e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf81151d0 con 0x7efcf80fdec0 2024-04-26T21:23:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.454+0000 7efcf7e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf8115340 con 0x7efcf80fcc10 2024-04-26T21:23:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.454+0000 7efcf6a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcf80fcc10 0x7efcf8113f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.454+0000 7efcf6a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcf80fcc10 0x7efcf8113f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:41542/0 (socket says 172.21.15.84:41542) 2024-04-26T21:23:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.454+0000 7efcf6a00700 1 -- 172.21.15.84:0/2237516994 learned_addr learned my addr 172.21.15.84:0/2237516994 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:23:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.454+0000 7efcf6000700 1 --2- 172.21.15.84:0/2237516994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcf80fdec0 0x7efcf8114460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:05.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.455+0000 7efcf6a00700 1 -- 172.21.15.84:0/2237516994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcf80fdec0 msgr2=0x7efcf8114460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:05.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.455+0000 7efcf6a00700 1 --2- 172.21.15.84:0/2237516994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcf80fdec0 0x7efcf8114460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:05.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.455+0000 7efcf6a00700 1 -- 172.21.15.84:0/2237516994 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce4005040 con 0x7efcf80fcc10 2024-04-26T21:23:05.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.455+0000 7efcf6000700 1 --2- 172.21.15.84:0/2237516994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcf80fdec0 0x7efcf8114460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:23:05.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.457+0000 7efcf6a00700 1 --2- 172.21.15.84:0/2237516994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcf80fcc10 0x7efcf8113f20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efce80041d0 tx=0x7efce800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:05.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.457+0000 7efceea00700 1 -- 172.21.15.84:0/2237516994 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efce8007cc0 con 0x7efcf80fcc10 2024-04-26T21:23:05.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.457+0000 7efceea00700 1 -- 172.21.15.84:0/2237516994 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efce800f040 con 0x7efcf80fcc10 2024-04-26T21:23:05.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.457+0000 7efceea00700 1 -- 172.21.15.84:0/2237516994 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efce800ca50 con 0x7efcf80fcc10 2024-04-26T21:23:05.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.458+0000 7efcf7e00700 1 -- 172.21.15.84:0/2237516994 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf8115560 con 0x7efcf80fcc10 2024-04-26T21:23:05.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.458+0000 7efcf7e00700 1 -- 172.21.15.84:0/2237516994 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf8115b20 con 0x7efcf80fcc10 2024-04-26T21:23:05.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.460+0000 7efcf7e00700 1 -- 172.21.15.84:0/2237516994 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf8101850 con 0x7efcf80fcc10 2024-04-26T21:23:05.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.461+0000 7efceea00700 1 -- 172.21.15.84:0/2237516994 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7efce800cbb0 con 0x7efcf80fcc10 2024-04-26T21:23:05.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.462+0000 7efceea00700 1 --2- 172.21.15.84:0/2237516994 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efcdc0692b0 0x7efcdc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:05.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.462+0000 7efceea00700 1 -- 172.21.15.84:0/2237516994 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7efce8086c00 con 0x7efcf80fcc10 2024-04-26T21:23:05.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.463+0000 7efcf6000700 1 --2- 172.21.15.84:0/2237516994 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efcdc0692b0 0x7efcdc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:05.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.464+0000 7efcf6000700 1 --2- 172.21.15.84:0/2237516994 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efcdc0692b0 0x7efcdc06b760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efce4000c00 tx=0x7efce4009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:05.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.470+0000 7efceea00700 1 -- 172.21.15.84:0/2237516994 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7efce804e250 con 0x7efcf80fcc10 2024-04-26T21:23:05.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.889+0000 7efcf7e00700 1 -- 172.21.15.84:0/2237516994 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efcf8105700 con 0x7efcf80fcc10 2024-04-26T21:23:05.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.890+0000 7efceea00700 1 -- 172.21.15.84:0/2237516994 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1818 (secure 0 0 0) 0x7efce8019730 con 0x7efcf80fcc10 2024-04-26T21:23:05.891 INFO:teuthology.orchestra.run.smithi084.stdout:e11 2024-04-26T21:23:05.891 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:23:05.891 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:23:05.891 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:23:05.891 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:23:05.892 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:23:05.892 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:23:05.892 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 11 2024-04-26T21:23:05.892 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:23:05.892 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:23:05.892 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:21:35.894623+0000 2024-04-26T21:23:05.892 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:23:05.892 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:23:05.892 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:23:05.892 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:23:05.892 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:23:05.892 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:23:05.892 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:23:05.893 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:23:05.893 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:23:05.893 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:23:05.893 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:23:05.893 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456,1=24231} 2024-04-26T21:23:05.893 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:23:05.893 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:23:05.893 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:23:05.893 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:23:05.893 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:23:05.893 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:23:05.893 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:23:05.894 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:23:05.894 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:23:05.894 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:23:05.894 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:23:05.894 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:23:05.894 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:23:05.894 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:23:05.894 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:23:05.894 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:23:05.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.894+0000 7efcf7e00700 1 -- 172.21.15.84:0/2237516994 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efcdc0692b0 msgr2=0x7efcdc06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:05.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.894+0000 7efcf7e00700 1 --2- 172.21.15.84:0/2237516994 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efcdc0692b0 0x7efcdc06b760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efce4000c00 tx=0x7efce4009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:05.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.894+0000 7efcf7e00700 1 -- 172.21.15.84:0/2237516994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcf80fcc10 msgr2=0x7efcf8113f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:05.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.894+0000 7efcf7e00700 1 --2- 172.21.15.84:0/2237516994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcf80fcc10 0x7efcf8113f20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efce80041d0 tx=0x7efce800b040 comp rx=0 tx=0).stop 2024-04-26T21:23:05.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.895+0000 7efcf7e00700 1 -- 172.21.15.84:0/2237516994 shutdown_connections 2024-04-26T21:23:05.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.895+0000 7efcf7e00700 1 --2- 172.21.15.84:0/2237516994 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efcdc0692b0 0x7efcdc06b760 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:05.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.895+0000 7efcf7e00700 1 --2- 172.21.15.84:0/2237516994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcf80fcc10 0x7efcf8113f20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:05.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.895+0000 7efcf7e00700 1 --2- 172.21.15.84:0/2237516994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcf80fdec0 0x7efcf8114460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:05.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.895+0000 7efcf7e00700 1 -- 172.21.15.84:0/2237516994 >> 172.21.15.84:0/2237516994 conn(0x7efcf80f8370 msgr2=0x7efcf80f9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:05.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.895+0000 7efcf7e00700 1 -- 172.21.15.84:0/2237516994 shutdown_connections 2024-04-26T21:23:05.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:05.895+0000 7efcf7e00700 1 -- 172.21.15.84:0/2237516994 wait complete. 2024-04-26T21:23:05.898 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 11 2024-04-26T21:23:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.104+0000 7fb159200700 1 -- 172.21.15.84:0/2262511731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb154066260 msgr2=0x7fb1540ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.104+0000 7fb159200700 1 --2- 172.21.15.84:0/2262511731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb154066260 0x7fb1540ffa00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb144004940 tx=0x7fb144009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.104+0000 7fb159200700 1 -- 172.21.15.84:0/2262511731 shutdown_connections 2024-04-26T21:23:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.104+0000 7fb159200700 1 --2- 172.21.15.84:0/2262511731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1540fff40 0x7fb154102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.104+0000 7fb159200700 1 --2- 172.21.15.84:0/2262511731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb154066260 0x7fb1540ffa00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.104+0000 7fb159200700 1 -- 172.21.15.84:0/2262511731 >> 172.21.15.84:0/2262511731 conn(0x7fb1540f7430 msgr2=0x7fb1540f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:06.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.105+0000 7fb159200700 1 -- 172.21.15.84:0/2262511731 shutdown_connections 2024-04-26T21:23:06.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.105+0000 7fb159200700 1 -- 172.21.15.84:0/2262511731 wait complete. 2024-04-26T21:23:06.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.106+0000 7fb159200700 1 Processor -- start 2024-04-26T21:23:06.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.106+0000 7fb159200700 1 -- start start 2024-04-26T21:23:06.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.107+0000 7fb159200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb154066260 0x7fb15410b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:06.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.107+0000 7fb159200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1540fff40 0x7fb15410bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:06.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.107+0000 7fb159200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15410c3a0 con 0x7fb154066260 2024-04-26T21:23:06.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.107+0000 7fb159200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15410cb50 con 0x7fb1540fff40 2024-04-26T21:23:06.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.107+0000 7fb151e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb154066260 0x7fb15410b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:06.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.108+0000 7fb151400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1540fff40 0x7fb15410bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:06.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.108+0000 7fb151400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1540fff40 0x7fb15410bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:41552/0 (socket says 172.21.15.84:41552) 2024-04-26T21:23:06.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.108+0000 7fb151400700 1 -- 172.21.15.84:0/2598074187 learned_addr learned my addr 172.21.15.84:0/2598074187 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:23:06.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.109+0000 7fb151e00700 1 -- 172.21.15.84:0/2598074187 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1540fff40 msgr2=0x7fb15410bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:06.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.109+0000 7fb151e00700 1 --2- 172.21.15.84:0/2598074187 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1540fff40 0x7fb15410bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:06.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.109+0000 7fb151e00700 1 -- 172.21.15.84:0/2598074187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb144005040 con 0x7fb154066260 2024-04-26T21:23:06.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.109+0000 7fb151e00700 1 --2- 172.21.15.84:0/2598074187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb154066260 0x7fb15410b810 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb144000c00 tx=0x7fb144009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:06.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.110+0000 7fb14a000700 1 -- 172.21.15.84:0/2598074187 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb14400e070 con 0x7fb154066260 2024-04-26T21:23:06.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.110+0000 7fb14a000700 1 -- 172.21.15.84:0/2598074187 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb144013de0 con 0x7fb154066260 2024-04-26T21:23:06.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.110+0000 7fb14a000700 1 -- 172.21.15.84:0/2598074187 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb14400be30 con 0x7fb154066260 2024-04-26T21:23:06.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.110+0000 7fb159200700 1 -- 172.21.15.84:0/2598074187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb15410cd50 con 0x7fb154066260 2024-04-26T21:23:06.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.110+0000 7fb159200700 1 -- 172.21.15.84:0/2598074187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15410d290 con 0x7fb154066260 2024-04-26T21:23:06.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.112+0000 7fb159200700 1 -- 172.21.15.84:0/2598074187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb15405f5c0 con 0x7fb154066260 2024-04-26T21:23:06.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.114+0000 7fb14a000700 1 -- 172.21.15.84:0/2598074187 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb14400b680 con 0x7fb154066260 2024-04-26T21:23:06.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.115+0000 7fb14a000700 1 --2- 172.21.15.84:0/2598074187 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fb1380692b0 0x7fb13806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:06.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.115+0000 7fb14a000700 1 -- 172.21.15.84:0/2598074187 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb144087a20 con 0x7fb154066260 2024-04-26T21:23:06.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.116+0000 7fb151400700 1 --2- 172.21.15.84:0/2598074187 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fb1380692b0 0x7fb13806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:06.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.117+0000 7fb151400700 1 --2- 172.21.15.84:0/2598074187 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fb1380692b0 0x7fb13806b760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb140008fd0 tx=0x7fb14000b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:06.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.123+0000 7fb14a000700 1 -- 172.21.15.84:0/2598074187 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb144053d30 con 0x7fb154066260 2024-04-26T21:23:06.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:06 smithi120 ceph-mon[32741]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:23:06.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:06 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2098754139' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:23:06.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:06 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2237516994' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:23:06.472 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:06 smithi084 ceph-mon[25539]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:23:06.472 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:06 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2098754139' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:23:06.472 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:06 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2237516994' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:23:06.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.471+0000 7fb159200700 1 -- 172.21.15.84:0/2598074187 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb15410d6a0 con 0x7fb1380692b0 2024-04-26T21:23:06.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.472+0000 7fb14a000700 1 -- 172.21.15.84:0/2598074187 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fb15410d6a0 con 0x7fb1380692b0 2024-04-26T21:23:06.473 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:23:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T21:23:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:23:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:23:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [], 2024-04-26T21:23:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "", 2024-04-26T21:23:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 image", 2024-04-26T21:23:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:23:06.473 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:23:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.476+0000 7fb159200700 1 -- 172.21.15.84:0/2598074187 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fb1380692b0 msgr2=0x7fb13806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.476+0000 7fb159200700 1 --2- 172.21.15.84:0/2598074187 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fb1380692b0 0x7fb13806b760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb140008fd0 tx=0x7fb14000b040 comp rx=0 tx=0).stop 2024-04-26T21:23:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.476+0000 7fb159200700 1 -- 172.21.15.84:0/2598074187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb154066260 msgr2=0x7fb15410b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.476+0000 7fb159200700 1 --2- 172.21.15.84:0/2598074187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb154066260 0x7fb15410b810 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb144000c00 tx=0x7fb144009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.476+0000 7fb159200700 1 -- 172.21.15.84:0/2598074187 shutdown_connections 2024-04-26T21:23:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.476+0000 7fb159200700 1 --2- 172.21.15.84:0/2598074187 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fb1380692b0 0x7fb13806b760 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.476+0000 7fb159200700 1 --2- 172.21.15.84:0/2598074187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb154066260 0x7fb15410b810 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.476+0000 7fb159200700 1 --2- 172.21.15.84:0/2598074187 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1540fff40 0x7fb15410bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.476+0000 7fb159200700 1 -- 172.21.15.84:0/2598074187 >> 172.21.15.84:0/2598074187 conn(0x7fb1540f7430 msgr2=0x7fb1540f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.476+0000 7fb159200700 1 -- 172.21.15.84:0/2598074187 shutdown_connections 2024-04-26T21:23:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.476+0000 7fb159200700 1 -- 172.21.15.84:0/2598074187 wait complete. 2024-04-26T21:23:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.683+0000 7efdcde00700 1 -- 172.21.15.84:0/370379583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc80fdeb0 msgr2=0x7efdc80fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.683+0000 7efdcde00700 1 --2- 172.21.15.84:0/370379583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc80fdeb0 0x7efdc80fe320 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efdb4004940 tx=0x7efdb4009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.685+0000 7efdcde00700 1 -- 172.21.15.84:0/370379583 shutdown_connections 2024-04-26T21:23:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.685+0000 7efdcde00700 1 --2- 172.21.15.84:0/370379583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc80fdeb0 0x7efdc80fe320 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.685+0000 7efdcde00700 1 --2- 172.21.15.84:0/370379583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdc80fcc00 0x7efdc80fd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.685+0000 7efdcde00700 1 -- 172.21.15.84:0/370379583 >> 172.21.15.84:0/370379583 conn(0x7efdc80f8380 msgr2=0x7efdc80fa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.686+0000 7efdcde00700 1 -- 172.21.15.84:0/370379583 shutdown_connections 2024-04-26T21:23:06.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.686+0000 7efdcde00700 1 -- 172.21.15.84:0/370379583 wait complete. 2024-04-26T21:23:06.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.687+0000 7efdcde00700 1 Processor -- start 2024-04-26T21:23:06.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.688+0000 7efdcde00700 1 -- start start 2024-04-26T21:23:06.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.688+0000 7efdcde00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc80fcc00 0x7efdc81040e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:06.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.688+0000 7efdcde00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdc80fdeb0 0x7efdc8104620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:06.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.688+0000 7efdcde00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc8104c70 con 0x7efdc80fcc00 2024-04-26T21:23:06.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.688+0000 7efdcde00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc81054c0 con 0x7efdc80fdeb0 2024-04-26T21:23:06.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.689+0000 7efdcca00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc80fcc00 0x7efdc81040e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:06.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.689+0000 7efdcca00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc80fcc00 0x7efdc81040e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60002/0 (socket says 172.21.15.84:60002) 2024-04-26T21:23:06.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.689+0000 7efdcca00700 1 -- 172.21.15.84:0/1317578118 learned_addr learned my addr 172.21.15.84:0/1317578118 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:23:06.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.689+0000 7efdc7e00700 1 --2- 172.21.15.84:0/1317578118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdc80fdeb0 0x7efdc8104620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:06.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.690+0000 7efdcca00700 1 -- 172.21.15.84:0/1317578118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdc80fdeb0 msgr2=0x7efdc8104620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:06.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.690+0000 7efdcca00700 1 --2- 172.21.15.84:0/1317578118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdc80fdeb0 0x7efdc8104620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:06.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.690+0000 7efdcca00700 1 -- 172.21.15.84:0/1317578118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb4005040 con 0x7efdc80fcc00 2024-04-26T21:23:06.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.690+0000 7efdcca00700 1 --2- 172.21.15.84:0/1317578118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc80fcc00 0x7efdc81040e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00eb40 tx=0x7efdbc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:06.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.691+0000 7efdc4c00700 1 -- 172.21.15.84:0/1317578118 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdbc007cc0 con 0x7efdc80fcc00 2024-04-26T21:23:06.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.691+0000 7efdc4c00700 1 -- 172.21.15.84:0/1317578118 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efdbc00f040 con 0x7efdc80fcc00 2024-04-26T21:23:06.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.691+0000 7efdc4c00700 1 -- 172.21.15.84:0/1317578118 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdbc00ca10 con 0x7efdc80fcc00 2024-04-26T21:23:06.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.691+0000 7efdcde00700 1 -- 172.21.15.84:0/1317578118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc8105740 con 0x7efdc80fcc00 2024-04-26T21:23:06.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.691+0000 7efdcde00700 1 -- 172.21.15.84:0/1317578118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc8105c80 con 0x7efdc80fcc00 2024-04-26T21:23:06.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.693+0000 7efdcde00700 1 -- 172.21.15.84:0/1317578118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc804bed0 con 0x7efdc80fcc00 2024-04-26T21:23:06.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.695+0000 7efdc4c00700 1 -- 172.21.15.84:0/1317578118 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7efdbc00cb70 con 0x7efdc80fcc00 2024-04-26T21:23:06.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.696+0000 7efdc4c00700 1 --2- 172.21.15.84:0/1317578118 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efdb00692b0 0x7efdb006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:06.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.696+0000 7efdc4c00700 1 -- 172.21.15.84:0/1317578118 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7efdbc086d40 con 0x7efdc80fcc00 2024-04-26T21:23:06.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.697+0000 7efdc7e00700 1 --2- 172.21.15.84:0/1317578118 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efdb00692b0 0x7efdb006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:06.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.698+0000 7efdc7e00700 1 --2- 172.21.15.84:0/1317578118 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efdb00692b0 0x7efdb006b760 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efdb400b0d0 tx=0x7efdb4009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:06.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:06.701+0000 7efdc4c00700 1 -- 172.21.15.84:0/1317578118 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7efdbc04e250 con 0x7efdc80fcc00 2024-04-26T21:23:07.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:07.178+0000 7efdcde00700 1 -- 172.21.15.84:0/1317578118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efdc8071b50 con 0x7efdc80fcc00 2024-04-26T21:23:07.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:07.179+0000 7efdc4c00700 1 -- 172.21.15.84:0/1317578118 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7efdbc053080 con 0x7efdc80fcc00 2024-04-26T21:23:07.180 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:23:07.180 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:23:07.180 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:23:07.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:07.182+0000 7efdcde00700 1 -- 172.21.15.84:0/1317578118 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efdb00692b0 msgr2=0x7efdb006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:07.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:07.182+0000 7efdcde00700 1 --2- 172.21.15.84:0/1317578118 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efdb00692b0 0x7efdb006b760 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efdb400b0d0 tx=0x7efdb4009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:07.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:07.182+0000 7efdcde00700 1 -- 172.21.15.84:0/1317578118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc80fcc00 msgr2=0x7efdc81040e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:07.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:07.182+0000 7efdcde00700 1 --2- 172.21.15.84:0/1317578118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc80fcc00 0x7efdc81040e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00eb40 tx=0x7efdbc00b040 comp rx=0 tx=0).stop 2024-04-26T21:23:07.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:07.183+0000 7efdcde00700 1 -- 172.21.15.84:0/1317578118 shutdown_connections 2024-04-26T21:23:07.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:07.183+0000 7efdcde00700 1 --2- 172.21.15.84:0/1317578118 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7efdb00692b0 0x7efdb006b760 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:07.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:07.183+0000 7efdcde00700 1 --2- 172.21.15.84:0/1317578118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc80fcc00 0x7efdc81040e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:07.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:07.183+0000 7efdcde00700 1 --2- 172.21.15.84:0/1317578118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdc80fdeb0 0x7efdc8104620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:07.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:07.183+0000 7efdcde00700 1 -- 172.21.15.84:0/1317578118 >> 172.21.15.84:0/1317578118 conn(0x7efdc80f8380 msgr2=0x7efdc80f9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:07.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:07.183+0000 7efdcde00700 1 -- 172.21.15.84:0/1317578118 shutdown_connections 2024-04-26T21:23:07.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:07.183+0000 7efdcde00700 1 -- 172.21.15.84:0/1317578118 wait complete. 2024-04-26T21:23:07.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:07 smithi120 ceph-mon[32741]: pgmap v270: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:07.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:07 smithi084 ceph-mon[25539]: pgmap v270: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:08.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:08 smithi120 ceph-mon[32741]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:23:08.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:08 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/1317578118' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:23:08.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:08 smithi084 ceph-mon[25539]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:23:08.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:08 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1317578118' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:23:09.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:09 smithi120 ceph-mon[32741]: pgmap v271: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:09.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:09 smithi084 ceph-mon[25539]: pgmap v271: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:11.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:11 smithi084 ceph-mon[25539]: pgmap v272: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:11.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:11 smithi120 ceph-mon[32741]: pgmap v272: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:12.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:12 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:23:12.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:12 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:23:13.501 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:13 smithi084 ceph-mon[25539]: pgmap v273: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:13.673 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:13 smithi120 ceph-mon[32741]: pgmap v273: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:15.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:15 smithi084 ceph-mon[25539]: pgmap v274: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:15.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:15 smithi120 ceph-mon[32741]: pgmap v274: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:16.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:16 smithi084 ceph-mon[25539]: pgmap v275: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:16.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:16 smithi120 ceph-mon[32741]: pgmap v275: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:18.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:18 smithi084 ceph-mon[25539]: pgmap v276: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:18.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:18 smithi120 ceph-mon[32741]: pgmap v276: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:20.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:20 smithi084 ceph-mon[25539]: pgmap v277: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:20.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:20 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:23:20.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:20 smithi084 ceph-mon[25539]: Upgrade: Target is version 19.0.0-3306-gbc612ffb (unknown) 2024-04-26T21:23:20.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:20 smithi084 ceph-mon[25539]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2'] 2024-04-26T21:23:20.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:20 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:23:20.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:20 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:23:20.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:20 smithi084 ceph-mon[25539]: Upgrade: Need to upgrade myself (mgr.smithi084.gyasul) 2024-04-26T21:23:20.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:20 smithi084 ceph-mon[25539]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 on smithi120 2024-04-26T21:23:20.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:20 smithi120 ceph-mon[32741]: pgmap v277: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:20.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:20 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:23:20.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:20 smithi120 ceph-mon[32741]: Upgrade: Target is version 19.0.0-3306-gbc612ffb (unknown) 2024-04-26T21:23:20.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:20 smithi120 ceph-mon[32741]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2'] 2024-04-26T21:23:20.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:20 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:23:20.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:20 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:23:20.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:20 smithi120 ceph-mon[32741]: Upgrade: Need to upgrade myself (mgr.smithi084.gyasul) 2024-04-26T21:23:20.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:20 smithi120 ceph-mon[32741]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 on smithi120 2024-04-26T21:23:22.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:22 smithi084 ceph-mon[25539]: pgmap v278: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:22.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:22 smithi120 ceph-mon[32741]: pgmap v278: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:24.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:24 smithi084 ceph-mon[25539]: pgmap v279: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:24.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:24 smithi120 ceph-mon[32741]: pgmap v279: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:26.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:26 smithi084 ceph-mon[25539]: pgmap v280: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:26.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:26 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:23:26.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:26 smithi120 ceph-mon[32741]: pgmap v280: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:26.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:26 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:23:28.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:28 smithi084 ceph-mon[25539]: pgmap v281: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:28.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:28 smithi120 ceph-mon[32741]: pgmap v281: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:30.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:30 smithi084 ceph-mon[25539]: pgmap v282: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:30.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:30 smithi120 ceph-mon[32741]: pgmap v282: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:32.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:32 smithi084 ceph-mon[25539]: pgmap v283: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:32.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:32 smithi120 ceph-mon[32741]: pgmap v283: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:34.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:34 smithi084 ceph-mon[25539]: pgmap v284: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:34.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:34 smithi120 ceph-mon[32741]: pgmap v284: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:36.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:36 smithi084 ceph-mon[25539]: pgmap v285: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:36.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:36 smithi120 ceph-mon[32741]: pgmap v285: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:37.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.347+0000 7f2ad1800700 1 -- 172.21.15.84:0/1691724766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2acc0fdff0 msgr2=0x7f2acc0fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:37.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.347+0000 7f2ad1800700 1 --2- 172.21.15.84:0/1691724766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2acc0fdff0 0x7f2acc0fe460 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8004940 tx=0x7f2ab8009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:37.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.347+0000 7f2ad1800700 1 -- 172.21.15.84:0/1691724766 shutdown_connections 2024-04-26T21:23:37.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.347+0000 7f2ad1800700 1 --2- 172.21.15.84:0/1691724766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2acc0fdff0 0x7f2acc0fe460 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.347+0000 7f2ad1800700 1 --2- 172.21.15.84:0/1691724766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2acc0fce80 0x7f2acc0fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.347+0000 7f2ad1800700 1 -- 172.21.15.84:0/1691724766 >> 172.21.15.84:0/1691724766 conn(0x7f2acc0f8540 msgr2=0x7f2acc0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:37.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.347+0000 7f2ad1800700 1 -- 172.21.15.84:0/1691724766 shutdown_connections 2024-04-26T21:23:37.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.347+0000 7f2ad1800700 1 -- 172.21.15.84:0/1691724766 wait complete. 2024-04-26T21:23:37.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.348+0000 7f2ad1800700 1 Processor -- start 2024-04-26T21:23:37.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.349+0000 7f2ad1800700 1 -- start start 2024-04-26T21:23:37.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.349+0000 7f2ad1800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2acc0fce80 0x7f2acc071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:37.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.349+0000 7f2ad1800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2acc0fdff0 0x7f2acc0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:37.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.349+0000 7f2ad1800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc072200 con 0x7f2acc0fdff0 2024-04-26T21:23:37.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.349+0000 7f2ad1800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0707f0 con 0x7f2acc0fce80 2024-04-26T21:23:37.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.349+0000 7f2aca000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2acc0fdff0 0x7f2acc0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:37.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.349+0000 7f2aca000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2acc0fdff0 0x7f2acc0702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58280/0 (socket says 172.21.15.84:58280) 2024-04-26T21:23:37.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.350+0000 7f2aca000700 1 -- 172.21.15.84:0/3244420838 learned_addr learned my addr 172.21.15.84:0/3244420838 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:23:37.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.350+0000 7f2acaa00700 1 --2- 172.21.15.84:0/3244420838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2acc0fce80 0x7f2acc071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:37.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.350+0000 7f2aca000700 1 -- 172.21.15.84:0/3244420838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2acc0fce80 msgr2=0x7f2acc071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:37.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.350+0000 7f2aca000700 1 --2- 172.21.15.84:0/3244420838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2acc0fce80 0x7f2acc071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.350+0000 7f2aca000700 1 -- 172.21.15.84:0/3244420838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab8005040 con 0x7f2acc0fdff0 2024-04-26T21:23:37.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.350+0000 7f2aca000700 1 --2- 172.21.15.84:0/3244420838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2acc0fdff0 0x7f2acc0702b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800b3b0 tx=0x7f2ab8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:37.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.351+0000 7f2ac2a00700 1 -- 172.21.15.84:0/3244420838 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ab800e040 con 0x7f2acc0fdff0 2024-04-26T21:23:37.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.351+0000 7f2ac2a00700 1 -- 172.21.15.84:0/3244420838 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ab8004290 con 0x7f2acc0fdff0 2024-04-26T21:23:37.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.351+0000 7f2ad1800700 1 -- 172.21.15.84:0/3244420838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2acc070a40 con 0x7f2acc0fdff0 2024-04-26T21:23:37.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.351+0000 7f2ac2a00700 1 -- 172.21.15.84:0/3244420838 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ab801c3f0 con 0x7f2acc0fdff0 2024-04-26T21:23:37.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.351+0000 7f2ad1800700 1 -- 172.21.15.84:0/3244420838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2acc071000 con 0x7f2acc0fdff0 2024-04-26T21:23:37.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.352+0000 7f2ad1800700 1 -- 172.21.15.84:0/3244420838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2acc04c710 con 0x7f2acc0fdff0 2024-04-26T21:23:37.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.354+0000 7f2ac2a00700 1 -- 172.21.15.84:0/3244420838 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f2ab800bbf0 con 0x7f2acc0fdff0 2024-04-26T21:23:37.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.355+0000 7f2ac2a00700 1 --2- 172.21.15.84:0/3244420838 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2ab00692a0 0x7f2ab006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:37.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.355+0000 7f2ac2a00700 1 -- 172.21.15.84:0/3244420838 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2ab80884c0 con 0x7f2acc0fdff0 2024-04-26T21:23:37.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.355+0000 7f2acaa00700 1 --2- 172.21.15.84:0/3244420838 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2ab00692a0 0x7f2ab006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:37.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.356+0000 7f2acaa00700 1 --2- 172.21.15.84:0/3244420838 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2ab00692a0 0x7f2ab006b750 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2abc004f40 tx=0x7f2abc00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:37.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.360+0000 7f2ac2a00700 1 -- 172.21.15.84:0/3244420838 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2ab8058260 con 0x7f2acc0fdff0 2024-04-26T21:23:37.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.610+0000 7f2ad1800700 1 -- 172.21.15.84:0/3244420838 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2acc102310 con 0x7f2ab00692a0 2024-04-26T21:23:37.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.612+0000 7f2ac2a00700 1 -- 172.21.15.84:0/3244420838 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f2acc102310 con 0x7f2ab00692a0 2024-04-26T21:23:37.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.615+0000 7f2ad1800700 1 -- 172.21.15.84:0/3244420838 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2ab00692a0 msgr2=0x7f2ab006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:37.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.616+0000 7f2ad1800700 1 --2- 172.21.15.84:0/3244420838 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2ab00692a0 0x7f2ab006b750 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2abc004f40 tx=0x7f2abc00b040 comp rx=0 tx=0).stop 2024-04-26T21:23:37.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.616+0000 7f2ad1800700 1 -- 172.21.15.84:0/3244420838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2acc0fdff0 msgr2=0x7f2acc0702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:37.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.616+0000 7f2ad1800700 1 --2- 172.21.15.84:0/3244420838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2acc0fdff0 0x7f2acc0702b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800b3b0 tx=0x7f2ab8009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:37.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.616+0000 7f2ad1800700 1 -- 172.21.15.84:0/3244420838 shutdown_connections 2024-04-26T21:23:37.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.616+0000 7f2ad1800700 1 --2- 172.21.15.84:0/3244420838 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2ab00692a0 0x7f2ab006b750 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.616+0000 7f2ad1800700 1 --2- 172.21.15.84:0/3244420838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2acc0fce80 0x7f2acc071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.616+0000 7f2ad1800700 1 --2- 172.21.15.84:0/3244420838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2acc0fdff0 0x7f2acc0702b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.616+0000 7f2ad1800700 1 -- 172.21.15.84:0/3244420838 >> 172.21.15.84:0/3244420838 conn(0x7f2acc0f8540 msgr2=0x7f2acc0f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:37.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.616+0000 7f2ad1800700 1 -- 172.21.15.84:0/3244420838 shutdown_connections 2024-04-26T21:23:37.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.616+0000 7f2ad1800700 1 -- 172.21.15.84:0/3244420838 wait complete. 2024-04-26T21:23:37.635 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:23:37.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.783+0000 7fe0d4c00700 1 -- 172.21.15.84:0/735158354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0d00fbcb0 msgr2=0x7fe0d00fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:37.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.783+0000 7fe0d4c00700 1 --2- 172.21.15.84:0/735158354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0d00fbcb0 0x7fe0d00fc0c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0004940 tx=0x7fe0c0009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:37.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.783+0000 7fe0d4c00700 1 -- 172.21.15.84:0/735158354 shutdown_connections 2024-04-26T21:23:37.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.783+0000 7fe0d4c00700 1 --2- 172.21.15.84:0/735158354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0d00fcf60 0x7fe0d00fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.783+0000 7fe0d4c00700 1 --2- 172.21.15.84:0/735158354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0d00fbcb0 0x7fe0d00fc0c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.783+0000 7fe0d4c00700 1 -- 172.21.15.84:0/735158354 >> 172.21.15.84:0/735158354 conn(0x7fe0d00f7430 msgr2=0x7fe0d00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:37.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.783+0000 7fe0d4c00700 1 -- 172.21.15.84:0/735158354 shutdown_connections 2024-04-26T21:23:37.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.783+0000 7fe0d4c00700 1 -- 172.21.15.84:0/735158354 wait complete. 2024-04-26T21:23:37.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.784+0000 7fe0d4c00700 1 Processor -- start 2024-04-26T21:23:37.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.784+0000 7fe0d4c00700 1 -- start start 2024-04-26T21:23:37.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.785+0000 7fe0d4c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0d00fbcb0 0x7fe0d010fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:37.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.785+0000 7fe0d4c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0d00fcf60 0x7fe0d0110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:37.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.785+0000 7fe0d4c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d0110810 con 0x7fe0d00fcf60 2024-04-26T21:23:37.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.785+0000 7fe0d4c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d0111000 con 0x7fe0d00fbcb0 2024-04-26T21:23:37.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.785+0000 7fe0cd400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0d00fcf60 0x7fe0d0110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:37.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.785+0000 7fe0cd400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0d00fcf60 0x7fe0d0110180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58298/0 (socket says 172.21.15.84:58298) 2024-04-26T21:23:37.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.785+0000 7fe0cd400700 1 -- 172.21.15.84:0/2133278410 learned_addr learned my addr 172.21.15.84:0/2133278410 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:23:37.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.786+0000 7fe0cd400700 1 -- 172.21.15.84:0/2133278410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0d00fbcb0 msgr2=0x7fe0d010fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:37.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.786+0000 7fe0cd400700 1 --2- 172.21.15.84:0/2133278410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0d00fbcb0 0x7fe0d010fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.786+0000 7fe0cd400700 1 -- 172.21.15.84:0/2133278410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c0005040 con 0x7fe0d00fcf60 2024-04-26T21:23:37.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.786+0000 7fe0cd400700 1 --2- 172.21.15.84:0/2133278410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0d00fcf60 0x7fe0d0110180 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00b790 tx=0x7fe0bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:37.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.786+0000 7fe0c6000700 1 -- 172.21.15.84:0/2133278410 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0bc00f770 con 0x7fe0d00fcf60 2024-04-26T21:23:37.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.786+0000 7fe0c6000700 1 -- 172.21.15.84:0/2133278410 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe0bc00fda0 con 0x7fe0d00fcf60 2024-04-26T21:23:37.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.786+0000 7fe0c6000700 1 -- 172.21.15.84:0/2133278410 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0bc00d310 con 0x7fe0d00fcf60 2024-04-26T21:23:37.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.786+0000 7fe0d4c00700 1 -- 172.21.15.84:0/2133278410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d01112e0 con 0x7fe0d00fcf60 2024-04-26T21:23:37.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.786+0000 7fe0d4c00700 1 -- 172.21.15.84:0/2133278410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d0111850 con 0x7fe0d00fcf60 2024-04-26T21:23:37.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.787+0000 7fe0d4c00700 1 -- 172.21.15.84:0/2133278410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d01018f0 con 0x7fe0d00fcf60 2024-04-26T21:23:37.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.790+0000 7fe0c6000700 1 -- 172.21.15.84:0/2133278410 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe0bc010420 con 0x7fe0d00fcf60 2024-04-26T21:23:37.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.791+0000 7fe0c6000700 1 --2- 172.21.15.84:0/2133278410 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe0b40692a0 0x7fe0b406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:37.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.791+0000 7fe0c6000700 1 -- 172.21.15.84:0/2133278410 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe0bc087940 con 0x7fe0d00fcf60 2024-04-26T21:23:37.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.791+0000 7fe0cde00700 1 --2- 172.21.15.84:0/2133278410 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe0b40692a0 0x7fe0b406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:37.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.792+0000 7fe0cde00700 1 --2- 172.21.15.84:0/2133278410 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe0b40692a0 0x7fe0b406b750 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0004f90 tx=0x7fe0c0009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:37.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:37.794+0000 7fe0c6000700 1 -- 172.21.15.84:0/2133278410 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe0bc0576e0 con 0x7fe0d00fcf60 2024-04-26T21:23:38.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.027+0000 7fe0d4c00700 1 -- 172.21.15.84:0/2133278410 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0d0111b20 con 0x7fe0b40692a0 2024-04-26T21:23:38.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.029+0000 7fe0c6000700 1 -- 172.21.15.84:0/2133278410 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fe0d0111b20 con 0x7fe0b40692a0 2024-04-26T21:23:38.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.032+0000 7fe0d4c00700 1 -- 172.21.15.84:0/2133278410 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe0b40692a0 msgr2=0x7fe0b406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:38.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.032+0000 7fe0d4c00700 1 --2- 172.21.15.84:0/2133278410 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe0b40692a0 0x7fe0b406b750 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0004f90 tx=0x7fe0c0009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:38.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.032+0000 7fe0d4c00700 1 -- 172.21.15.84:0/2133278410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0d00fcf60 msgr2=0x7fe0d0110180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:38.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.032+0000 7fe0d4c00700 1 --2- 172.21.15.84:0/2133278410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0d00fcf60 0x7fe0d0110180 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00b790 tx=0x7fe0bc009250 comp rx=0 tx=0).stop 2024-04-26T21:23:38.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.032+0000 7fe0d4c00700 1 -- 172.21.15.84:0/2133278410 shutdown_connections 2024-04-26T21:23:38.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.032+0000 7fe0d4c00700 1 --2- 172.21.15.84:0/2133278410 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe0b40692a0 0x7fe0b406b750 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.032+0000 7fe0d4c00700 1 --2- 172.21.15.84:0/2133278410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0d00fbcb0 0x7fe0d010fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.032+0000 7fe0d4c00700 1 --2- 172.21.15.84:0/2133278410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0d00fcf60 0x7fe0d0110180 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.032+0000 7fe0d4c00700 1 -- 172.21.15.84:0/2133278410 >> 172.21.15.84:0/2133278410 conn(0x7fe0d00f7430 msgr2=0x7fe0d0065b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:38.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.032+0000 7fe0d4c00700 1 -- 172.21.15.84:0/2133278410 shutdown_connections 2024-04-26T21:23:38.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.032+0000 7fe0d4c00700 1 -- 172.21.15.84:0/2133278410 wait complete. 2024-04-26T21:23:38.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.188+0000 7eff32c00700 1 -- 172.21.15.84:0/3157651157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff2c070890 msgr2=0x7eff2c070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:38.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.188+0000 7eff32c00700 1 --2- 172.21.15.84:0/3157651157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff2c070890 0x7eff2c070d00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7eff18004940 tx=0x7eff18009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:38.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.188+0000 7eff32c00700 1 -- 172.21.15.84:0/3157651157 shutdown_connections 2024-04-26T21:23:38.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.188+0000 7eff32c00700 1 --2- 172.21.15.84:0/3157651157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff2c070890 0x7eff2c070d00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.188+0000 7eff32c00700 1 --2- 172.21.15.84:0/3157651157 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff2c071f40 0x7eff2c070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.188+0000 7eff32c00700 1 -- 172.21.15.84:0/3157651157 >> 172.21.15.84:0/3157651157 conn(0x7eff2c0f83b0 msgr2=0x7eff2c0fa7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:38.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.188+0000 7eff32c00700 1 -- 172.21.15.84:0/3157651157 shutdown_connections 2024-04-26T21:23:38.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.188+0000 7eff32c00700 1 -- 172.21.15.84:0/3157651157 wait complete. 2024-04-26T21:23:38.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.189+0000 7eff32c00700 1 Processor -- start 2024-04-26T21:23:38.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.189+0000 7eff32c00700 1 -- start start 2024-04-26T21:23:38.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.189+0000 7eff32c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff2c070890 0x7eff2c10fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:38.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.189+0000 7eff32c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff2c071f40 0x7eff2c110000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:38.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.189+0000 7eff32c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c110600 con 0x7eff2c071f40 2024-04-26T21:23:38.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.189+0000 7eff32c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c110e50 con 0x7eff2c070890 2024-04-26T21:23:38.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.189+0000 7eff30e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff2c071f40 0x7eff2c110000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:38.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.190+0000 7eff30e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff2c071f40 0x7eff2c110000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58314/0 (socket says 172.21.15.84:58314) 2024-04-26T21:23:38.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.190+0000 7eff30e00700 1 -- 172.21.15.84:0/3334711204 learned_addr learned my addr 172.21.15.84:0/3334711204 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:23:38.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.190+0000 7eff31800700 1 --2- 172.21.15.84:0/3334711204 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff2c070890 0x7eff2c10fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:38.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.190+0000 7eff30e00700 1 -- 172.21.15.84:0/3334711204 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff2c070890 msgr2=0x7eff2c10fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:38.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.190+0000 7eff30e00700 1 --2- 172.21.15.84:0/3334711204 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff2c070890 0x7eff2c10fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.190+0000 7eff30e00700 1 -- 172.21.15.84:0/3334711204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff18005040 con 0x7eff2c071f40 2024-04-26T21:23:38.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.190+0000 7eff30e00700 1 --2- 172.21.15.84:0/3334711204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff2c071f40 0x7eff2c110000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7eff18009150 tx=0x7eff18009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:38.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.190+0000 7eff29600700 1 -- 172.21.15.84:0/3334711204 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff1800e040 con 0x7eff2c071f40 2024-04-26T21:23:38.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.191+0000 7eff32c00700 1 -- 172.21.15.84:0/3334711204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2c1110d0 con 0x7eff2c071f40 2024-04-26T21:23:38.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.191+0000 7eff29600700 1 -- 172.21.15.84:0/3334711204 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff1800bb90 con 0x7eff2c071f40 2024-04-26T21:23:38.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.191+0000 7eff29600700 1 -- 172.21.15.84:0/3334711204 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff1801c630 con 0x7eff2c071f40 2024-04-26T21:23:38.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.191+0000 7eff32c00700 1 -- 172.21.15.84:0/3334711204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2c111610 con 0x7eff2c071f40 2024-04-26T21:23:38.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.193+0000 7eff32c00700 1 -- 172.21.15.84:0/3334711204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2c05f5c0 con 0x7eff2c071f40 2024-04-26T21:23:38.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.193+0000 7eff29600700 1 -- 172.21.15.84:0/3334711204 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7eff1800bd00 con 0x7eff2c071f40 2024-04-26T21:23:38.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.194+0000 7eff29600700 1 --2- 172.21.15.84:0/3334711204 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7eff140692b0 0x7eff1406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:38.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.195+0000 7eff29600700 1 -- 172.21.15.84:0/3334711204 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7eff18088250 con 0x7eff2c071f40 2024-04-26T21:23:38.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.195+0000 7eff31800700 1 --2- 172.21.15.84:0/3334711204 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7eff140692b0 0x7eff1406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:38.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.196+0000 7eff31800700 1 --2- 172.21.15.84:0/3334711204 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7eff140692b0 0x7eff1406b760 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7eff2c071c80 tx=0x7eff2400b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:38.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.199+0000 7eff29600700 1 -- 172.21.15.84:0/3334711204 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7eff18057ff0 con 0x7eff2c071f40 2024-04-26T21:23:38.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.419+0000 7eff32c00700 1 -- 172.21.15.84:0/3334711204 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7eff2c111980 con 0x7eff140692b0 2024-04-26T21:23:38.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.434+0000 7eff29600700 1 -- 172.21.15.84:0/3334711204 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7eff2c111980 con 0x7eff140692b0 2024-04-26T21:23:38.436 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:23:38.436 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (7m) 108s ago 9m 13.3M - 0.25.0 c8568f914cd2 e17e61753bb1 2024-04-26T21:23:38.436 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (9m) 108s ago 9m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 a111b0ee8187 2024-04-26T21:23:38.436 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (8m) 114s ago 8m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 66f4d21263a1 2024-04-26T21:23:38.436 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (7m) 108s ago 8m 73.9M - 9.4.7 954c08fa6188 67caa0766f89 2024-04-26T21:23:38.436 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (2m) 108s ago 2m 13.3M - 17.2.7-907-g2be3efa9 1c5834633715 485d7884e1d5 2024-04-26T21:23:38.436 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (2m) 108s ago 2m 10.5M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:23:38.436 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (2m) 114s ago 2m 12.7M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:23:38.436 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (2m) 114s ago 2m 10.4M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:23:38.436 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:9283 running (10m) 108s ago 10m 480M - 17.2.7-907-g2be3efa9 1c5834633715 98242b12bd6c 2024-04-26T21:23:38.437 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283 running (7m) 114s ago 7m 432M - 17.2.7-907-g2be3efa9 1c5834633715 29dc99fc0efb 2024-04-26T21:23:38.437 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (11m) 108s ago 11m 44.7M 2048M 17.2.7-907-g2be3efa9 1c5834633715 24cc2d798ea7 2024-04-26T21:23:38.437 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (7m) 114s ago 7m 35.0M 2048M 17.2.7-907-g2be3efa9 1c5834633715 72c786fd622b 2024-04-26T21:23:38.437 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (9m) 108s ago 9m 7470k - 1.5.0 0da6a335fe13 8fdbcc05a9dd 2024-04-26T21:23:38.437 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (8m) 114s ago 8m 7482k - 1.5.0 0da6a335fe13 1b07a56a6ace 2024-04-26T21:23:38.437 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (6m) 108s ago 6m 45.2M 4288M 17.2.7-907-g2be3efa9 1c5834633715 3a2e74d7e51a 2024-04-26T21:23:38.437 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (6m) 108s ago 6m 44.9M 4288M 17.2.7-907-g2be3efa9 1c5834633715 d283a0a93213 2024-04-26T21:23:38.437 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (5m) 108s ago 5m 43.1M 4288M 17.2.7-907-g2be3efa9 1c5834633715 5899468fc5c8 2024-04-26T21:23:38.437 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (5m) 114s ago 5m 43.1M 5312M 17.2.7-907-g2be3efa9 1c5834633715 b8a14c87d730 2024-04-26T21:23:38.437 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (4m) 114s ago 4m 40.8M 5312M 17.2.7-907-g2be3efa9 1c5834633715 4d294df735a3 2024-04-26T21:23:38.437 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (4m) 114s ago 4m 40.7M 5312M 17.2.7-907-g2be3efa9 1c5834633715 9b60997971a8 2024-04-26T21:23:38.437 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (7m) 108s ago 8m 46.1M - 2.43.0 a07b618ecd1d 7b6983aea888 2024-04-26T21:23:38.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.436+0000 7eff32c00700 1 -- 172.21.15.84:0/3334711204 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7eff140692b0 msgr2=0x7eff1406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:38.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.436+0000 7eff32c00700 1 --2- 172.21.15.84:0/3334711204 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7eff140692b0 0x7eff1406b760 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7eff2c071c80 tx=0x7eff2400b040 comp rx=0 tx=0).stop 2024-04-26T21:23:38.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.436+0000 7eff32c00700 1 -- 172.21.15.84:0/3334711204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff2c071f40 msgr2=0x7eff2c110000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:38.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.436+0000 7eff32c00700 1 --2- 172.21.15.84:0/3334711204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff2c071f40 0x7eff2c110000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7eff18009150 tx=0x7eff18009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:38.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.437+0000 7eff32c00700 1 -- 172.21.15.84:0/3334711204 shutdown_connections 2024-04-26T21:23:38.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.437+0000 7eff32c00700 1 --2- 172.21.15.84:0/3334711204 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7eff140692b0 0x7eff1406b760 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.437+0000 7eff32c00700 1 --2- 172.21.15.84:0/3334711204 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff2c070890 0x7eff2c10fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.437+0000 7eff32c00700 1 --2- 172.21.15.84:0/3334711204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff2c071f40 0x7eff2c110000 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.437+0000 7eff32c00700 1 -- 172.21.15.84:0/3334711204 >> 172.21.15.84:0/3334711204 conn(0x7eff2c0f83b0 msgr2=0x7eff2c0f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:38.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.437+0000 7eff32c00700 1 -- 172.21.15.84:0/3334711204 shutdown_connections 2024-04-26T21:23:38.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.437+0000 7eff32c00700 1 -- 172.21.15.84:0/3334711204 wait complete. 2024-04-26T21:23:38.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.588+0000 7f6cb1a00700 1 -- 172.21.15.84:0/2182389356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cac100280 msgr2=0x7f6cac1006f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:38.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.588+0000 7f6cb1a00700 1 --2- 172.21.15.84:0/2182389356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cac100280 0x7f6cac1006f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6c98004940 tx=0x7f6c98009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:38.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.588+0000 7f6cb1a00700 1 -- 172.21.15.84:0/2182389356 shutdown_connections 2024-04-26T21:23:38.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.588+0000 7f6cb1a00700 1 --2- 172.21.15.84:0/2182389356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cac100280 0x7f6cac1006f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.588+0000 7f6cb1a00700 1 --2- 172.21.15.84:0/2182389356 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cac0fefd0 0x7f6cac0ff3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.588+0000 7f6cb1a00700 1 -- 172.21.15.84:0/2182389356 >> 172.21.15.84:0/2182389356 conn(0x7f6cac0fa8f0 msgr2=0x7f6cac0fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:38.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.588+0000 7f6cb1a00700 1 -- 172.21.15.84:0/2182389356 shutdown_connections 2024-04-26T21:23:38.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.588+0000 7f6cb1a00700 1 -- 172.21.15.84:0/2182389356 wait complete. 2024-04-26T21:23:38.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.589+0000 7f6cb1a00700 1 Processor -- start 2024-04-26T21:23:38.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.589+0000 7f6cb1a00700 1 -- start start 2024-04-26T21:23:38.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.589+0000 7f6cb1a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cac0fefd0 0x7f6cac10fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:38.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.589+0000 7f6cb1a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cac100280 0x7f6cac110150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:38.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.589+0000 7f6cb1a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac110750 con 0x7f6cac100280 2024-04-26T21:23:38.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.590+0000 7f6cb1a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac110fa0 con 0x7f6cac0fefd0 2024-04-26T21:23:38.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.590+0000 7f6caa000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cac100280 0x7f6cac110150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:38.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.590+0000 7f6caa000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cac100280 0x7f6cac110150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58330/0 (socket says 172.21.15.84:58330) 2024-04-26T21:23:38.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.590+0000 7f6caa000700 1 -- 172.21.15.84:0/2777562833 learned_addr learned my addr 172.21.15.84:0/2777562833 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:23:38.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.590+0000 7f6caaa00700 1 --2- 172.21.15.84:0/2777562833 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cac0fefd0 0x7f6cac10fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:38.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.590+0000 7f6caa000700 1 -- 172.21.15.84:0/2777562833 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cac0fefd0 msgr2=0x7f6cac10fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:38.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.590+0000 7f6caa000700 1 --2- 172.21.15.84:0/2777562833 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cac0fefd0 0x7f6cac10fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.590+0000 7f6caa000700 1 -- 172.21.15.84:0/2777562833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c98005040 con 0x7f6cac100280 2024-04-26T21:23:38.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.590+0000 7f6caa000700 1 --2- 172.21.15.84:0/2777562833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cac100280 0x7f6cac110150 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009150 tx=0x7f6c98009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:38.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.591+0000 7f6ca2a00700 1 -- 172.21.15.84:0/2777562833 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c9800e040 con 0x7f6cac100280 2024-04-26T21:23:38.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.591+0000 7f6ca2a00700 1 -- 172.21.15.84:0/2777562833 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c9800bbf0 con 0x7f6cac100280 2024-04-26T21:23:38.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.591+0000 7f6cb1a00700 1 -- 172.21.15.84:0/2777562833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cac111220 con 0x7f6cac100280 2024-04-26T21:23:38.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.591+0000 7f6ca2a00700 1 -- 172.21.15.84:0/2777562833 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c9801c630 con 0x7f6cac100280 2024-04-26T21:23:38.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.591+0000 7f6cb1a00700 1 -- 172.21.15.84:0/2777562833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cac111760 con 0x7f6cac100280 2024-04-26T21:23:38.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.592+0000 7f6cb1a00700 1 -- 172.21.15.84:0/2777562833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cac05f5c0 con 0x7f6cac100280 2024-04-26T21:23:38.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.593+0000 7f6ca2a00700 1 -- 172.21.15.84:0/2777562833 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f6c9800bd60 con 0x7f6cac100280 2024-04-26T21:23:38.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.594+0000 7f6ca2a00700 1 --2- 172.21.15.84:0/2777562833 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f6c900692b0 0x7f6c9006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:38.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.594+0000 7f6ca2a00700 1 -- 172.21.15.84:0/2777562833 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6c98088fe0 con 0x7f6cac100280 2024-04-26T21:23:38.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.594+0000 7f6caaa00700 1 --2- 172.21.15.84:0/2777562833 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f6c900692b0 0x7f6c9006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:38.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.595+0000 7f6caaa00700 1 --2- 172.21.15.84:0/2777562833 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f6c900692b0 0x7f6c9006b760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c004990 tx=0x7f6c9c009ee0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:38.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.598+0000 7f6ca2a00700 1 -- 172.21.15.84:0/2777562833 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6c98058e40 con 0x7f6cac100280 2024-04-26T21:23:38.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.901+0000 7f6cb1a00700 1 -- 172.21.15.84:0/2777562833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6cac107ac0 con 0x7f6cac100280 2024-04-26T21:23:38.903 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:38 smithi084 ceph-mon[25539]: pgmap v286: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:38.903 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:38 smithi084 ceph-mon[25539]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:23:38.903 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:38 smithi084 ceph-mon[25539]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:23:38.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.902+0000 7f6ca2a00700 1 -- 172.21.15.84:0/2777562833 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f6c98024360 con 0x7f6cac100280 2024-04-26T21:23:38.904 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:23:38.904 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:23:38.904 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-26T21:23:38.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:23:38.905 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:23:38.905 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-26T21:23:38.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:23:38.905 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:23:38.905 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-26T21:23:38.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:23:38.905 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:23:38.905 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-26T21:23:38.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:23:38.905 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:23:38.905 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 14 2024-04-26T21:23:38.906 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:23:38.906 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:23:38.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.905+0000 7f6cb1a00700 1 -- 172.21.15.84:0/2777562833 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f6c900692b0 msgr2=0x7f6c9006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:38.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.905+0000 7f6cb1a00700 1 --2- 172.21.15.84:0/2777562833 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f6c900692b0 0x7f6c9006b760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c004990 tx=0x7f6c9c009ee0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.905+0000 7f6cb1a00700 1 -- 172.21.15.84:0/2777562833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cac100280 msgr2=0x7f6cac110150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:38.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.905+0000 7f6cb1a00700 1 --2- 172.21.15.84:0/2777562833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cac100280 0x7f6cac110150 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009150 tx=0x7f6c98009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:38.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.906+0000 7f6cb1a00700 1 -- 172.21.15.84:0/2777562833 shutdown_connections 2024-04-26T21:23:38.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.906+0000 7f6cb1a00700 1 --2- 172.21.15.84:0/2777562833 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f6c900692b0 0x7f6c9006b760 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.906+0000 7f6cb1a00700 1 --2- 172.21.15.84:0/2777562833 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cac0fefd0 0x7f6cac10fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.906+0000 7f6cb1a00700 1 --2- 172.21.15.84:0/2777562833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cac100280 0x7f6cac110150 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.906+0000 7f6cb1a00700 1 -- 172.21.15.84:0/2777562833 >> 172.21.15.84:0/2777562833 conn(0x7f6cac0fa8f0 msgr2=0x7f6cac0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:38.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.906+0000 7f6cb1a00700 1 -- 172.21.15.84:0/2777562833 shutdown_connections 2024-04-26T21:23:38.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:38.906+0000 7f6cb1a00700 1 -- 172.21.15.84:0/2777562833 wait complete. 2024-04-26T21:23:38.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:38 smithi120 ceph-mon[32741]: pgmap v286: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:38.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:38 smithi120 ceph-mon[32741]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:23:38.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:38 smithi120 ceph-mon[32741]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:23:39.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.057+0000 7f2b05e00700 1 -- 172.21.15.84:0/3271476365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b001033f0 msgr2=0x7f2b00103800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:39.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.057+0000 7f2b05e00700 1 --2- 172.21.15.84:0/3271476365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b001033f0 0x7f2b00103800 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2af0004940 tx=0x7f2af0009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:39.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.057+0000 7f2b05e00700 1 -- 172.21.15.84:0/3271476365 shutdown_connections 2024-04-26T21:23:39.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.057+0000 7f2b05e00700 1 --2- 172.21.15.84:0/3271476365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b001046a0 0x7f2b00104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.057+0000 7f2b05e00700 1 --2- 172.21.15.84:0/3271476365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b001033f0 0x7f2b00103800 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.057+0000 7f2b05e00700 1 -- 172.21.15.84:0/3271476365 >> 172.21.15.84:0/3271476365 conn(0x7f2b000725e0 msgr2=0x7f2b00074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:39.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.057+0000 7f2b05e00700 1 -- 172.21.15.84:0/3271476365 shutdown_connections 2024-04-26T21:23:39.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.057+0000 7f2b05e00700 1 -- 172.21.15.84:0/3271476365 wait complete. 2024-04-26T21:23:39.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.058+0000 7f2b05e00700 1 Processor -- start 2024-04-26T21:23:39.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.058+0000 7f2b05e00700 1 -- start start 2024-04-26T21:23:39.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.058+0000 7f2b05e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b001033f0 0x7f2b00113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:39.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.058+0000 7f2b05e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b001046a0 0x7f2b00114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:39.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.058+0000 7f2b05e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00114a40 con 0x7f2b001033f0 2024-04-26T21:23:39.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.058+0000 7f2b05e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00114bb0 con 0x7f2b001046a0 2024-04-26T21:23:39.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.058+0000 7f2afea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b001033f0 0x7f2b00113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:39.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.058+0000 7f2afea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b001033f0 0x7f2b00113f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58344/0 (socket says 172.21.15.84:58344) 2024-04-26T21:23:39.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.058+0000 7f2afea00700 1 -- 172.21.15.84:0/586709505 learned_addr learned my addr 172.21.15.84:0/586709505 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:23:39.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.059+0000 7f2afe000700 1 --2- 172.21.15.84:0/586709505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b001046a0 0x7f2b00114440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:39.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.059+0000 7f2afea00700 1 -- 172.21.15.84:0/586709505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b001046a0 msgr2=0x7f2b00114440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:39.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.059+0000 7f2afea00700 1 --2- 172.21.15.84:0/586709505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b001046a0 0x7f2b00114440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.059+0000 7f2afea00700 1 -- 172.21.15.84:0/586709505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af0005040 con 0x7f2b001033f0 2024-04-26T21:23:39.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.059+0000 7f2afea00700 1 --2- 172.21.15.84:0/586709505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b001033f0 0x7f2b00113f00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2af0009150 tx=0x7f2af0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:39.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.060+0000 7f2af6a00700 1 -- 172.21.15.84:0/586709505 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2af000e040 con 0x7f2b001033f0 2024-04-26T21:23:39.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.060+0000 7f2af6a00700 1 -- 172.21.15.84:0/586709505 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2af000bbf0 con 0x7f2b001033f0 2024-04-26T21:23:39.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.060+0000 7f2b05e00700 1 -- 172.21.15.84:0/586709505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b001195b0 con 0x7f2b001033f0 2024-04-26T21:23:39.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.060+0000 7f2af6a00700 1 -- 172.21.15.84:0/586709505 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2af001c630 con 0x7f2b001033f0 2024-04-26T21:23:39.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.060+0000 7f2b05e00700 1 -- 172.21.15.84:0/586709505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b00119b70 con 0x7f2b001033f0 2024-04-26T21:23:39.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.061+0000 7f2b05e00700 1 -- 172.21.15.84:0/586709505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b0004c710 con 0x7f2b001033f0 2024-04-26T21:23:39.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.062+0000 7f2af6a00700 1 -- 172.21.15.84:0/586709505 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f2af000bd60 con 0x7f2b001033f0 2024-04-26T21:23:39.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.063+0000 7f2af6a00700 1 --2- 172.21.15.84:0/586709505 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2ae40692a0 0x7f2ae406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:39.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.063+0000 7f2af6a00700 1 -- 172.21.15.84:0/586709505 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2af00885c0 con 0x7f2b001033f0 2024-04-26T21:23:39.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.063+0000 7f2afe000700 1 --2- 172.21.15.84:0/586709505 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2ae40692a0 0x7f2ae406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:39.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.064+0000 7f2afe000700 1 --2- 172.21.15.84:0/586709505 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2ae40692a0 0x7f2ae406b750 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2aec004990 tx=0x7f2aec009ee0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:39.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.067+0000 7f2af6a00700 1 -- 172.21.15.84:0/586709505 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2af0058410 con 0x7f2b001033f0 2024-04-26T21:23:39.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.331+0000 7f2b05e00700 1 -- 172.21.15.84:0/586709505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2b00119fe0 con 0x7f2b001033f0 2024-04-26T21:23:39.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.332+0000 7f2af6a00700 1 -- 172.21.15.84:0/586709505 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1818 (secure 0 0 0) 0x7f2af0057fa0 con 0x7f2b001033f0 2024-04-26T21:23:39.335 INFO:teuthology.orchestra.run.smithi084.stdout:e11 2024-04-26T21:23:39.335 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:23:39.335 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:23:39.335 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:23:39.335 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:23:39.335 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:23:39.335 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:23:39.335 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 11 2024-04-26T21:23:39.335 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:23:39.335 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:23:39.335 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:21:35.894623+0000 2024-04-26T21:23:39.336 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:23:39.336 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:23:39.336 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:23:39.336 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:23:39.336 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:23:39.336 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:23:39.336 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:23:39.336 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:23:39.336 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:23:39.336 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:23:39.336 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:23:39.336 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456,1=24231} 2024-04-26T21:23:39.336 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:23:39.337 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:23:39.337 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:23:39.337 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:23:39.337 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:23:39.337 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:23:39.337 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:23:39.337 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:23:39.337 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:23:39.337 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:23:39.337 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:23:39.337 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:23:39.338 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:23:39.338 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:23:39.338 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:23:39.338 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:23:39.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.336+0000 7f2b05e00700 1 -- 172.21.15.84:0/586709505 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2ae40692a0 msgr2=0x7f2ae406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:39.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.336+0000 7f2b05e00700 1 --2- 172.21.15.84:0/586709505 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2ae40692a0 0x7f2ae406b750 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2aec004990 tx=0x7f2aec009ee0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.336+0000 7f2b05e00700 1 -- 172.21.15.84:0/586709505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b001033f0 msgr2=0x7f2b00113f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:39.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.336+0000 7f2b05e00700 1 --2- 172.21.15.84:0/586709505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b001033f0 0x7f2b00113f00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2af0009150 tx=0x7f2af0009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:39.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.337+0000 7f2b05e00700 1 -- 172.21.15.84:0/586709505 shutdown_connections 2024-04-26T21:23:39.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.337+0000 7f2b05e00700 1 --2- 172.21.15.84:0/586709505 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f2ae40692a0 0x7f2ae406b750 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.337+0000 7f2b05e00700 1 --2- 172.21.15.84:0/586709505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b001033f0 0x7f2b00113f00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.337+0000 7f2b05e00700 1 --2- 172.21.15.84:0/586709505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b001046a0 0x7f2b00114440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.337+0000 7f2b05e00700 1 -- 172.21.15.84:0/586709505 >> 172.21.15.84:0/586709505 conn(0x7f2b000725e0 msgr2=0x7f2b00073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:39.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.337+0000 7f2b05e00700 1 -- 172.21.15.84:0/586709505 shutdown_connections 2024-04-26T21:23:39.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.337+0000 7f2b05e00700 1 -- 172.21.15.84:0/586709505 wait complete. 2024-04-26T21:23:39.340 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 11 2024-04-26T21:23:39.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.484+0000 7f976fa00700 1 -- 172.21.15.84:0/782721963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97680fdfd0 msgr2=0x7f97680fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:39.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.484+0000 7f976fa00700 1 --2- 172.21.15.84:0/782721963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97680fdfd0 0x7f97680fe440 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9754004940 tx=0x7f9754009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:39.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.484+0000 7f976fa00700 1 -- 172.21.15.84:0/782721963 shutdown_connections 2024-04-26T21:23:39.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.484+0000 7f976fa00700 1 --2- 172.21.15.84:0/782721963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97680fdfd0 0x7f97680fe440 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.484+0000 7f976fa00700 1 --2- 172.21.15.84:0/782721963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97680fce60 0x7f97680fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.484+0000 7f976fa00700 1 -- 172.21.15.84:0/782721963 >> 172.21.15.84:0/782721963 conn(0x7f97680f8560 msgr2=0x7f97680fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:39.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.484+0000 7f976fa00700 1 -- 172.21.15.84:0/782721963 shutdown_connections 2024-04-26T21:23:39.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.484+0000 7f976fa00700 1 -- 172.21.15.84:0/782721963 wait complete. 2024-04-26T21:23:39.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.485+0000 7f976fa00700 1 Processor -- start 2024-04-26T21:23:39.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.485+0000 7f976fa00700 1 -- start start 2024-04-26T21:23:39.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.485+0000 7f976fa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97680fce60 0x7f976810fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:39.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.485+0000 7f976fa00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97680fdfd0 0x7f9768110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:39.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.485+0000 7f976fa00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9768110740 con 0x7f97680fce60 2024-04-26T21:23:39.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.485+0000 7f976fa00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9768110f90 con 0x7f97680fdfd0 2024-04-26T21:23:39.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.486+0000 7f976d000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97680fce60 0x7f976810fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:39.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.486+0000 7f976d000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97680fce60 0x7f976810fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58364/0 (socket says 172.21.15.84:58364) 2024-04-26T21:23:39.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.486+0000 7f976d000700 1 -- 172.21.15.84:0/994863398 learned_addr learned my addr 172.21.15.84:0/994863398 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:23:39.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.486+0000 7f9767e00700 1 --2- 172.21.15.84:0/994863398 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97680fdfd0 0x7f9768110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:39.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.486+0000 7f976d000700 1 -- 172.21.15.84:0/994863398 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97680fdfd0 msgr2=0x7f9768110140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:39.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.486+0000 7f976d000700 1 --2- 172.21.15.84:0/994863398 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97680fdfd0 0x7f9768110140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.486+0000 7f976d000700 1 -- 172.21.15.84:0/994863398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9754005040 con 0x7f97680fce60 2024-04-26T21:23:39.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.486+0000 7f976d000700 1 --2- 172.21.15.84:0/994863398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97680fce60 0x7f976810fc00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f975c00c830 tx=0x7f975c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:39.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.487+0000 7f9764c00700 1 -- 172.21.15.84:0/994863398 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f975c00a760 con 0x7f97680fce60 2024-04-26T21:23:39.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.487+0000 7f9764c00700 1 -- 172.21.15.84:0/994863398 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f975c00ad90 con 0x7f97680fce60 2024-04-26T21:23:39.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.487+0000 7f976fa00700 1 -- 172.21.15.84:0/994863398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9768111270 con 0x7f97680fce60 2024-04-26T21:23:39.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.487+0000 7f9764c00700 1 -- 172.21.15.84:0/994863398 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f975c0113a0 con 0x7f97680fce60 2024-04-26T21:23:39.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.487+0000 7f976fa00700 1 -- 172.21.15.84:0/994863398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97681117b0 con 0x7f97680fce60 2024-04-26T21:23:39.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.488+0000 7f976fa00700 1 -- 172.21.15.84:0/994863398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9768101960 con 0x7f97680fce60 2024-04-26T21:23:39.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.489+0000 7f9764c00700 1 -- 172.21.15.84:0/994863398 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f975c012400 con 0x7f97680fce60 2024-04-26T21:23:39.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.490+0000 7f9764c00700 1 --2- 172.21.15.84:0/994863398 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f97500692b0 0x7f975006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:39.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.490+0000 7f9764c00700 1 -- 172.21.15.84:0/994863398 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f975c087150 con 0x7f97680fce60 2024-04-26T21:23:39.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.490+0000 7f9767e00700 1 --2- 172.21.15.84:0/994863398 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f97500692b0 0x7f975006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:39.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.491+0000 7f9767e00700 1 --2- 172.21.15.84:0/994863398 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f97500692b0 0x7f975006b760 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f975400b970 tx=0x7f9754009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:39.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.495+0000 7f9764c00700 1 -- 172.21.15.84:0/994863398 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f975c056fb0 con 0x7f97680fce60 2024-04-26T21:23:39.626 INFO:tasks.workunit.client.1.smithi120.stderr:Updating files: 56% (6938/12271) Updating files: 57% (6995/12271) Updating files: 58% (7118/12271) Updating files: 59% (7240/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 93% (11441/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-26T21:23:39.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.723+0000 7f976fa00700 1 -- 172.21.15.84:0/994863398 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9768111a80 con 0x7f97500692b0 2024-04-26T21:23:39.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.726+0000 7f9764c00700 1 -- 172.21.15.84:0/994863398 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f9768111a80 con 0x7f97500692b0 2024-04-26T21:23:39.727 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:23:39.727 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:23:39.728 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:23:39.728 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:23:39.728 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [], 2024-04-26T21:23:39.728 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "0/21 daemons upgraded", 2024-04-26T21:23:39.728 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 image on host smithi120", 2024-04-26T21:23:39.728 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:23:39.728 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:23:39.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.728+0000 7f976fa00700 1 -- 172.21.15.84:0/994863398 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f97500692b0 msgr2=0x7f975006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:39.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.728+0000 7f976fa00700 1 --2- 172.21.15.84:0/994863398 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f97500692b0 0x7f975006b760 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f975400b970 tx=0x7f9754009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:39.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.729+0000 7f976fa00700 1 -- 172.21.15.84:0/994863398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97680fce60 msgr2=0x7f976810fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:39.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.729+0000 7f976fa00700 1 --2- 172.21.15.84:0/994863398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97680fce60 0x7f976810fc00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f975c00c830 tx=0x7f975c004470 comp rx=0 tx=0).stop 2024-04-26T21:23:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.729+0000 7f976fa00700 1 -- 172.21.15.84:0/994863398 shutdown_connections 2024-04-26T21:23:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.729+0000 7f976fa00700 1 --2- 172.21.15.84:0/994863398 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f97500692b0 0x7f975006b760 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.729+0000 7f976fa00700 1 --2- 172.21.15.84:0/994863398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97680fce60 0x7f976810fc00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.729+0000 7f976fa00700 1 --2- 172.21.15.84:0/994863398 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97680fdfd0 0x7f9768110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.729+0000 7f976fa00700 1 -- 172.21.15.84:0/994863398 >> 172.21.15.84:0/994863398 conn(0x7f97680f8560 msgr2=0x7f97680f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.730+0000 7f976fa00700 1 -- 172.21.15.84:0/994863398 shutdown_connections 2024-04-26T21:23:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.730+0000 7f976fa00700 1 -- 172.21.15.84:0/994863398 wait complete. 2024-04-26T21:23:39.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.870+0000 7fe798c00700 1 -- 172.21.15.84:0/2091517460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe794102370 msgr2=0x7fe794104750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:39.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.870+0000 7fe798c00700 1 --2- 172.21.15.84:0/2091517460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe794102370 0x7fe794104750 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe77c004940 tx=0x7fe77c009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:39.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.870+0000 7fe798c00700 1 -- 172.21.15.84:0/2091517460 shutdown_connections 2024-04-26T21:23:39.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.870+0000 7fe798c00700 1 --2- 172.21.15.84:0/2091517460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe794102370 0x7fe794104750 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.870+0000 7fe798c00700 1 --2- 172.21.15.84:0/2091517460 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe794066b50 0x7fe794101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.870+0000 7fe798c00700 1 -- 172.21.15.84:0/2091517460 >> 172.21.15.84:0/2091517460 conn(0x7fe7940f74c0 msgr2=0x7fe7940f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:39.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.870+0000 7fe798c00700 1 -- 172.21.15.84:0/2091517460 shutdown_connections 2024-04-26T21:23:39.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.870+0000 7fe798c00700 1 -- 172.21.15.84:0/2091517460 wait complete. 2024-04-26T21:23:39.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.871+0000 7fe798c00700 1 Processor -- start 2024-04-26T21:23:39.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.871+0000 7fe798c00700 1 -- start start 2024-04-26T21:23:39.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.872+0000 7fe798c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe794066b50 0x7fe79410fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:39.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.872+0000 7fe798c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe794102370 0x7fe794110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:39.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.872+0000 7fe798c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe794110790 con 0x7fe794102370 2024-04-26T21:23:39.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.872+0000 7fe798c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe794110fe0 con 0x7fe794066b50 2024-04-26T21:23:39.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.872+0000 7fe78be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe794102370 0x7fe794110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:39.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.872+0000 7fe78be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe794102370 0x7fe794110190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58368/0 (socket says 172.21.15.84:58368) 2024-04-26T21:23:39.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.872+0000 7fe78be00700 1 -- 172.21.15.84:0/1993249174 learned_addr learned my addr 172.21.15.84:0/1993249174 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:23:39.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.872+0000 7fe791e00700 1 --2- 172.21.15.84:0/1993249174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe794066b50 0x7fe79410fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:39.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.872+0000 7fe78be00700 1 -- 172.21.15.84:0/1993249174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe794066b50 msgr2=0x7fe79410fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:39.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.872+0000 7fe78be00700 1 --2- 172.21.15.84:0/1993249174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe794066b50 0x7fe79410fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.873+0000 7fe78be00700 1 -- 172.21.15.84:0/1993249174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c005040 con 0x7fe794102370 2024-04-26T21:23:39.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.873+0000 7fe78be00700 1 --2- 172.21.15.84:0/1993249174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe794102370 0x7fe794110190 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009150 tx=0x7fe77c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:39.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.873+0000 7fe78a000700 1 -- 172.21.15.84:0/1993249174 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe77c00e040 con 0x7fe794102370 2024-04-26T21:23:39.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.873+0000 7fe78a000700 1 -- 172.21.15.84:0/1993249174 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe77c00bbf0 con 0x7fe794102370 2024-04-26T21:23:39.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.873+0000 7fe798c00700 1 -- 172.21.15.84:0/1993249174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe794111260 con 0x7fe794102370 2024-04-26T21:23:39.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.873+0000 7fe78a000700 1 -- 172.21.15.84:0/1993249174 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe77c01c630 con 0x7fe794102370 2024-04-26T21:23:39.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.873+0000 7fe798c00700 1 -- 172.21.15.84:0/1993249174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7941117a0 con 0x7fe794102370 2024-04-26T21:23:39.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.874+0000 7fe798c00700 1 -- 172.21.15.84:0/1993249174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79405f5c0 con 0x7fe794102370 2024-04-26T21:23:39.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.875+0000 7fe78a000700 1 -- 172.21.15.84:0/1993249174 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe77c00bd60 con 0x7fe794102370 2024-04-26T21:23:39.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.876+0000 7fe78a000700 1 --2- 172.21.15.84:0/1993249174 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe7780692b0 0x7fe77806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:39.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.876+0000 7fe78a000700 1 -- 172.21.15.84:0/1993249174 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe77c088590 con 0x7fe794102370 2024-04-26T21:23:39.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.876+0000 7fe791e00700 1 --2- 172.21.15.84:0/1993249174 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe7780692b0 0x7fe77806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:39.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.877+0000 7fe791e00700 1 --2- 172.21.15.84:0/1993249174 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe7780692b0 0x7fe77806b760 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe784007fd0 tx=0x7fe784009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:39.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:39.881+0000 7fe78a000700 1 -- 172.21.15.84:0/1993249174 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe77c058330 con 0x7fe794102370 2024-04-26T21:23:39.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:39 smithi084 ceph-mon[25539]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:23:39.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:39 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2777562833' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:23:39.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:39 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/586709505' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:23:39.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:39 smithi120 ceph-mon[32741]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:23:39.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:39 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2777562833' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:23:39.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:39 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/586709505' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:23:40.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:40.158+0000 7fe798c00700 1 -- 172.21.15.84:0/1993249174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe79404bed0 con 0x7fe794102370 2024-04-26T21:23:40.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:40.159+0000 7fe78a000700 1 -- 172.21.15.84:0/1993249174 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fe77c054020 con 0x7fe794102370 2024-04-26T21:23:40.160 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:23:40.161 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:23:40.161 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:23:40.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:40.161+0000 7fe798c00700 1 -- 172.21.15.84:0/1993249174 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe7780692b0 msgr2=0x7fe77806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:40.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:40.161+0000 7fe798c00700 1 --2- 172.21.15.84:0/1993249174 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe7780692b0 0x7fe77806b760 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe784007fd0 tx=0x7fe784009040 comp rx=0 tx=0).stop 2024-04-26T21:23:40.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:40.161+0000 7fe798c00700 1 -- 172.21.15.84:0/1993249174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe794102370 msgr2=0x7fe794110190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:40.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:40.161+0000 7fe798c00700 1 --2- 172.21.15.84:0/1993249174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe794102370 0x7fe794110190 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009150 tx=0x7fe77c009e30 comp rx=0 tx=0).stop 2024-04-26T21:23:40.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:40.162+0000 7fe798c00700 1 -- 172.21.15.84:0/1993249174 shutdown_connections 2024-04-26T21:23:40.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:40.162+0000 7fe798c00700 1 --2- 172.21.15.84:0/1993249174 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fe7780692b0 0x7fe77806b760 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:40.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:40.162+0000 7fe798c00700 1 --2- 172.21.15.84:0/1993249174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe794066b50 0x7fe79410fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:40.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:40.162+0000 7fe798c00700 1 --2- 172.21.15.84:0/1993249174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe794102370 0x7fe794110190 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:40.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:40.162+0000 7fe798c00700 1 -- 172.21.15.84:0/1993249174 >> 172.21.15.84:0/1993249174 conn(0x7fe7940f74c0 msgr2=0x7fe7940f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:40.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:40.162+0000 7fe798c00700 1 -- 172.21.15.84:0/1993249174 shutdown_connections 2024-04-26T21:23:40.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:23:40.162+0000 7fe798c00700 1 -- 172.21.15.84:0/1993249174 wait complete. 2024-04-26T21:23:40.502 INFO:tasks.workunit.client.1.smithi120.stderr:Note: switching to 'bc612ffb9c1d5bc27536bc917a705262a36d4387'. 2024-04-26T21:23:40.502 INFO:tasks.workunit.client.1.smithi120.stderr: 2024-04-26T21:23:40.502 INFO:tasks.workunit.client.1.smithi120.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T21:23:40.503 INFO:tasks.workunit.client.1.smithi120.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T21:23:40.503 INFO:tasks.workunit.client.1.smithi120.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T21:23:40.503 INFO:tasks.workunit.client.1.smithi120.stderr: 2024-04-26T21:23:40.503 INFO:tasks.workunit.client.1.smithi120.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T21:23:40.503 INFO:tasks.workunit.client.1.smithi120.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T21:23:40.503 INFO:tasks.workunit.client.1.smithi120.stderr: 2024-04-26T21:23:40.503 INFO:tasks.workunit.client.1.smithi120.stderr: git switch -c 2024-04-26T21:23:40.503 INFO:tasks.workunit.client.1.smithi120.stderr: 2024-04-26T21:23:40.503 INFO:tasks.workunit.client.1.smithi120.stderr:Or undo this operation with: 2024-04-26T21:23:40.503 INFO:tasks.workunit.client.1.smithi120.stderr: 2024-04-26T21:23:40.503 INFO:tasks.workunit.client.1.smithi120.stderr: git switch - 2024-04-26T21:23:40.503 INFO:tasks.workunit.client.1.smithi120.stderr: 2024-04-26T21:23:40.503 INFO:tasks.workunit.client.1.smithi120.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T21:23:40.503 INFO:tasks.workunit.client.1.smithi120.stderr: 2024-04-26T21:23:40.504 INFO:tasks.workunit.client.1.smithi120.stderr:HEAD is now at bc612ffb9c1 Merge PR #55144 into wip-rishabh-testing-20240426.111959 2024-04-26T21:23:40.517 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-04-26T21:23:40.573 INFO:tasks.workunit.client.1.smithi120.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T21:23:40.580 INFO:tasks.workunit.client.1.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-26T21:23:40.580 INFO:tasks.workunit.client.1.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T21:23:40.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:40 smithi084 ceph-mon[25539]: pgmap v287: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:40.914 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:40 smithi084 ceph-mon[25539]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:23:40.914 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:40 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1993249174' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:23:40.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:40 smithi120 ceph-mon[32741]: pgmap v287: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:40.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:40 smithi120 ceph-mon[32741]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:23:40.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:40 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/1993249174' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:23:41.536 INFO:tasks.workunit.client.1.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T21:23:41.645 INFO:tasks.workunit.client.1.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T21:23:41.731 INFO:tasks.workunit.client.1.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-26T21:23:41.735 INFO:tasks.workunit.client.1.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-26T21:23:41.736 INFO:tasks.workunit.client.1.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T21:23:41.828 INFO:tasks.workunit.client.1.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-26T21:23:41.837 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T21:23:41.837 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-04-26T21:23:41.889 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-04-26T21:23:41.892 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-26T21:23:41.892 DEBUG:teuthology.orchestra.run.smithi120:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc612ffb9c1d5bc27536bc917a705262a36d4387 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-04-26T21:23:41.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:41 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:23:41.990 INFO:tasks.workunit.client.1.smithi120.stderr:+ mkdir -p fsstress 2024-04-26T21:23:42.000 INFO:tasks.workunit.client.1.smithi120.stderr:+ pushd fsstress 2024-04-26T21:23:42.005 INFO:tasks.workunit.client.1.smithi120.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-26T21:23:42.005 INFO:tasks.workunit.client.1.smithi120.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-26T21:23:42.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:41 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:23:42.756 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 62% (7611/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-26T21:23:42.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:42 smithi120 ceph-mon[32741]: pgmap v288: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:43.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:42 smithi084 ceph-mon[25539]: pgmap v288: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:23:43.709 INFO:tasks.workunit.client.1.smithi120.stderr:+ tar xzf ltp-full.tgz 2024-04-26T21:23:43.874 INFO:tasks.workunit.client.0.smithi084.stderr:Note: switching to 'bc612ffb9c1d5bc27536bc917a705262a36d4387'. 2024-04-26T21:23:43.874 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-04-26T21:23:43.874 INFO:tasks.workunit.client.0.smithi084.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T21:23:43.874 INFO:tasks.workunit.client.0.smithi084.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T21:23:43.874 INFO:tasks.workunit.client.0.smithi084.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T21:23:43.874 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-04-26T21:23:43.875 INFO:tasks.workunit.client.0.smithi084.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T21:23:43.875 INFO:tasks.workunit.client.0.smithi084.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T21:23:43.875 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-04-26T21:23:43.875 INFO:tasks.workunit.client.0.smithi084.stderr: git switch -c 2024-04-26T21:23:43.875 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-04-26T21:23:43.875 INFO:tasks.workunit.client.0.smithi084.stderr:Or undo this operation with: 2024-04-26T21:23:43.875 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-04-26T21:23:43.875 INFO:tasks.workunit.client.0.smithi084.stderr: git switch - 2024-04-26T21:23:43.875 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-04-26T21:23:43.875 INFO:tasks.workunit.client.0.smithi084.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T21:23:43.875 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-04-26T21:23:43.875 INFO:tasks.workunit.client.0.smithi084.stderr:HEAD is now at bc612ffb9c1 Merge PR #55144 into wip-rishabh-testing-20240426.111959 2024-04-26T21:23:43.890 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T21:23:43.997 INFO:tasks.workunit.client.0.smithi084.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T21:23:44.003 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T21:23:44.003 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T21:23:44.930 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T21:23:44.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:44 smithi120 ceph-mon[32741]: pgmap v289: 65 pgs: 65 active+clean; 600 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-04-26T21:23:45.039 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T21:23:45.127 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T21:23:45.133 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T21:23:45.133 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T21:23:45.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:44 smithi084 ceph-mon[25539]: pgmap v289: 65 pgs: 65 active+clean; 600 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-04-26T21:23:45.221 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T21:23:45.229 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-26T21:23:45.229 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T21:23:45.275 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-26T21:23:45.276 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-26T21:23:45.277 DEBUG:teuthology.orchestra.run.smithi084:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc612ffb9c1d5bc27536bc917a705262a36d4387 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-26T21:23:45.401 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir -p fsstress 2024-04-26T21:23:45.406 INFO:tasks.workunit.client.0.smithi084.stderr:+ pushd fsstress 2024-04-26T21:23:45.409 INFO:tasks.workunit.client.0.smithi084.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T21:23:45.409 INFO:tasks.workunit.client.0.smithi084.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-26T21:23:46.999 INFO:tasks.workunit.client.0.smithi084.stderr:+ tar xzf ltp-full.tgz 2024-04-26T21:23:47.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:46 smithi084 ceph-mon[25539]: pgmap v290: 65 pgs: 65 active+clean; 600 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-04-26T21:23:47.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:46 smithi120 ceph-mon[32741]: pgmap v290: 65 pgs: 65 active+clean; 600 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-04-26T21:23:49.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:48 smithi084 ceph-mon[25539]: pgmap v291: 65 pgs: 65 active+clean; 600 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-04-26T21:23:49.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:48 smithi120 ceph-mon[32741]: pgmap v291: 65 pgs: 65 active+clean; 600 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-04-26T21:23:51.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:50 smithi084 ceph-mon[25539]: pgmap v292: 65 pgs: 65 active+clean; 23 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.9 MiB/s wr, 18 op/s 2024-04-26T21:23:51.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:50 smithi120 ceph-mon[32741]: pgmap v292: 65 pgs: 65 active+clean; 23 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.9 MiB/s wr, 18 op/s 2024-04-26T21:23:53.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:52 smithi084 ceph-mon[25539]: pgmap v293: 65 pgs: 65 active+clean; 23 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.9 MiB/s wr, 18 op/s 2024-04-26T21:23:53.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:52 smithi120 ceph-mon[32741]: pgmap v293: 65 pgs: 65 active+clean; 23 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.9 MiB/s wr, 18 op/s 2024-04-26T21:23:55.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:54 smithi084 ceph-mon[25539]: pgmap v294: 65 pgs: 65 active+clean; 26 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 48 op/s 2024-04-26T21:23:55.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:54 smithi084 ceph-mon[25539]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:23:55.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:54 smithi120 ceph-mon[32741]: pgmap v294: 65 pgs: 65 active+clean; 26 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 48 op/s 2024-04-26T21:23:55.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:54 smithi120 ceph-mon[32741]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:23:56.984 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:56 smithi120 ceph-mon[32741]: pgmap v295: 65 pgs: 65 active+clean; 26 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 48 op/s 2024-04-26T21:23:56.984 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:56 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:23:57.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:56 smithi084 ceph-mon[25539]: pgmap v295: 65 pgs: 65 active+clean; 26 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 48 op/s 2024-04-26T21:23:57.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:56 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:23:59.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:23:58 smithi084 ceph-mon[25539]: pgmap v296: 65 pgs: 65 active+clean; 26 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 48 op/s 2024-04-26T21:23:59.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:23:58 smithi120 ceph-mon[32741]: pgmap v296: 65 pgs: 65 active+clean; 26 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 48 op/s 2024-04-26T21:24:01.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:00 smithi084 ceph-mon[25539]: pgmap v297: 65 pgs: 65 active+clean; 34 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.8 MiB/s wr, 81 op/s 2024-04-26T21:24:01.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:00 smithi120 ceph-mon[32741]: pgmap v297: 65 pgs: 65 active+clean; 34 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.8 MiB/s wr, 81 op/s 2024-04-26T21:24:03.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:02 smithi084 ceph-mon[25539]: pgmap v298: 65 pgs: 65 active+clean; 34 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 960 KiB/s wr, 63 op/s 2024-04-26T21:24:03.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:02 smithi120 ceph-mon[32741]: pgmap v298: 65 pgs: 65 active+clean; 34 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 960 KiB/s wr, 63 op/s 2024-04-26T21:24:05.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:04 smithi084 ceph-mon[25539]: pgmap v299: 65 pgs: 65 active+clean; 39 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 86 op/s 2024-04-26T21:24:05.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:04 smithi120 ceph-mon[32741]: pgmap v299: 65 pgs: 65 active+clean; 39 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 86 op/s 2024-04-26T21:24:07.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:06 smithi084 ceph-mon[25539]: pgmap v300: 65 pgs: 65 active+clean; 39 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 55 op/s 2024-04-26T21:24:07.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:06 smithi120 ceph-mon[32741]: pgmap v300: 65 pgs: 65 active+clean; 39 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 55 op/s 2024-04-26T21:24:08.761 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:08 smithi120 ceph-mon[32741]: Upgrade: Updating mgr.smithi120.zjaduj 2024-04-26T21:24:08.762 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:08 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:08.762 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:08 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.zjaduj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:24:08.762 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:08 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:24:08.762 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:08 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:24:08.762 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:08 smithi120 ceph-mon[32741]: Deploying daemon mgr.smithi120.zjaduj on smithi120 2024-04-26T21:24:08.762 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:08 smithi120 ceph-mon[32741]: pgmap v301: 65 pgs: 65 active+clean; 39 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 55 op/s 2024-04-26T21:24:08.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:08 smithi084 ceph-mon[25539]: Upgrade: Updating mgr.smithi120.zjaduj 2024-04-26T21:24:08.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:08 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:08.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:08 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.zjaduj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:24:08.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:08 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:24:08.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:08 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:24:08.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:08 smithi084 ceph-mon[25539]: Deploying daemon mgr.smithi120.zjaduj on smithi120 2024-04-26T21:24:08.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:08 smithi084 ceph-mon[25539]: pgmap v301: 65 pgs: 65 active+clean; 39 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 55 op/s 2024-04-26T21:24:10.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.347+0000 7feee0400700 1 -- 172.21.15.84:0/1283401732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feed80fce60 msgr2=0x7feed80fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:10.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.347+0000 7feee0400700 1 --2- 172.21.15.84:0/1283401732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feed80fce60 0x7feed80fd270 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7feecc004940 tx=0x7feecc009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:10.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.347+0000 7feee0400700 1 -- 172.21.15.84:0/1283401732 shutdown_connections 2024-04-26T21:24:10.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.347+0000 7feee0400700 1 --2- 172.21.15.84:0/1283401732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed80fdfd0 0x7feed80fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:10.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.347+0000 7feee0400700 1 --2- 172.21.15.84:0/1283401732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feed80fce60 0x7feed80fd270 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:10.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.347+0000 7feee0400700 1 -- 172.21.15.84:0/1283401732 >> 172.21.15.84:0/1283401732 conn(0x7feed80f8540 msgr2=0x7feed80fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:10.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.347+0000 7feee0400700 1 -- 172.21.15.84:0/1283401732 shutdown_connections 2024-04-26T21:24:10.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.347+0000 7feee0400700 1 -- 172.21.15.84:0/1283401732 wait complete. 2024-04-26T21:24:10.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.348+0000 7feee0400700 1 Processor -- start 2024-04-26T21:24:10.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.348+0000 7feee0400700 1 -- start start 2024-04-26T21:24:10.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.349+0000 7feee0400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed80fce60 0x7feed810fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:10.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.349+0000 7feee0400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feed80fdfd0 0x7feed8110060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:10.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.349+0000 7feee0400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed8110660 con 0x7feed80fdfd0 2024-04-26T21:24:10.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.349+0000 7feee0400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed81107d0 con 0x7feed80fce60 2024-04-26T21:24:10.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.349+0000 7feedd000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feed80fdfd0 0x7feed8110060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:10.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.349+0000 7feedd000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feed80fdfd0 0x7feed8110060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55980/0 (socket says 172.21.15.84:55980) 2024-04-26T21:24:10.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.349+0000 7feedd000700 1 -- 172.21.15.84:0/1460056435 learned_addr learned my addr 172.21.15.84:0/1460056435 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:24:10.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.349+0000 7feedda00700 1 --2- 172.21.15.84:0/1460056435 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed80fce60 0x7feed810fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:10.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.350+0000 7feedd000700 1 -- 172.21.15.84:0/1460056435 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed80fce60 msgr2=0x7feed810fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:10.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.350+0000 7feedd000700 1 --2- 172.21.15.84:0/1460056435 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed80fce60 0x7feed810fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:10.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.350+0000 7feedd000700 1 -- 172.21.15.84:0/1460056435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc005040 con 0x7feed80fdfd0 2024-04-26T21:24:10.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.350+0000 7feedda00700 1 --2- 172.21.15.84:0/1460056435 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed80fce60 0x7feed810fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:24:10.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.350+0000 7feedd000700 1 --2- 172.21.15.84:0/1460056435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feed80fdfd0 0x7feed8110060 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7feec4002a50 tx=0x7feec40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:10.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.350+0000 7feed5600700 1 -- 172.21.15.84:0/1460056435 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feec4007cc0 con 0x7feed80fdfd0 2024-04-26T21:24:10.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.350+0000 7feed5600700 1 -- 172.21.15.84:0/1460056435 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feec400f040 con 0x7feed80fdfd0 2024-04-26T21:24:10.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.350+0000 7feed5600700 1 -- 172.21.15.84:0/1460056435 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feec4009640 con 0x7feed80fdfd0 2024-04-26T21:24:10.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.350+0000 7feee0400700 1 -- 172.21.15.84:0/1460056435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed8115230 con 0x7feed80fdfd0 2024-04-26T21:24:10.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.350+0000 7feee0400700 1 -- 172.21.15.84:0/1460056435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed81157f0 con 0x7feed80fdfd0 2024-04-26T21:24:10.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.351+0000 7feee0400700 1 -- 172.21.15.84:0/1460056435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed8101960 con 0x7feed80fdfd0 2024-04-26T21:24:10.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.353+0000 7feed5600700 1 -- 172.21.15.84:0/1460056435 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7feec40097a0 con 0x7feed80fdfd0 2024-04-26T21:24:10.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.354+0000 7feed5600700 1 --2- 172.21.15.84:0/1460056435 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7feec00692a0 0x7feec006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:10.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.354+0000 7feed5600700 1 -- 172.21.15.84:0/1460056435 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7feec4086fd0 con 0x7feed80fdfd0 2024-04-26T21:24:10.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.354+0000 7feedda00700 1 --2- 172.21.15.84:0/1460056435 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7feec00692a0 0x7feec006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:10.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.355+0000 7feedda00700 1 --2- 172.21.15.84:0/1460056435 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7feec00692a0 0x7feec006b750 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feecc00b020 tx=0x7feecc009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:10.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.359+0000 7feed5600700 1 -- 172.21.15.84:0/1460056435 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7feec4056d10 con 0x7feed80fdfd0 2024-04-26T21:24:10.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.632+0000 7feee0400700 1 -- 172.21.15.84:0/1460056435 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feed802b410 con 0x7feec00692a0 2024-04-26T21:24:10.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.633+0000 7feed5600700 1 -- 172.21.15.84:0/1460056435 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7feed802b410 con 0x7feec00692a0 2024-04-26T21:24:10.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.637+0000 7feee0400700 1 -- 172.21.15.84:0/1460056435 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7feec00692a0 msgr2=0x7feec006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:10.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.637+0000 7feee0400700 1 --2- 172.21.15.84:0/1460056435 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7feec00692a0 0x7feec006b750 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feecc00b020 tx=0x7feecc009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:10.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.637+0000 7feee0400700 1 -- 172.21.15.84:0/1460056435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feed80fdfd0 msgr2=0x7feed8110060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:10.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.637+0000 7feee0400700 1 --2- 172.21.15.84:0/1460056435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feed80fdfd0 0x7feed8110060 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7feec4002a50 tx=0x7feec40046b0 comp rx=0 tx=0).stop 2024-04-26T21:24:10.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.637+0000 7feee0400700 1 -- 172.21.15.84:0/1460056435 shutdown_connections 2024-04-26T21:24:10.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.637+0000 7feee0400700 1 --2- 172.21.15.84:0/1460056435 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7feec00692a0 0x7feec006b750 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:10.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.637+0000 7feee0400700 1 --2- 172.21.15.84:0/1460056435 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed80fce60 0x7feed810fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:10.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.637+0000 7feee0400700 1 --2- 172.21.15.84:0/1460056435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feed80fdfd0 0x7feed8110060 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:10.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.637+0000 7feee0400700 1 -- 172.21.15.84:0/1460056435 >> 172.21.15.84:0/1460056435 conn(0x7feed80f8540 msgr2=0x7feed80f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:10.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.637+0000 7feee0400700 1 -- 172.21.15.84:0/1460056435 shutdown_connections 2024-04-26T21:24:10.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.637+0000 7feee0400700 1 -- 172.21.15.84:0/1460056435 wait complete. 2024-04-26T21:24:10.655 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:24:10.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.802+0000 7f463e000700 1 -- 172.21.15.84:0/3435102622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46380ffee0 msgr2=0x7f4638102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:10.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.802+0000 7f463e000700 1 --2- 172.21.15.84:0/3435102622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46380ffee0 0x7f4638102300 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4624004940 tx=0x7f4624009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:10.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.802+0000 7f463e000700 1 -- 172.21.15.84:0/3435102622 shutdown_connections 2024-04-26T21:24:10.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.802+0000 7f463e000700 1 --2- 172.21.15.84:0/3435102622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46380ffee0 0x7f4638102300 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:10.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.802+0000 7f463e000700 1 --2- 172.21.15.84:0/3435102622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4638066ed0 0x7f46380ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:10.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.802+0000 7f463e000700 1 -- 172.21.15.84:0/3435102622 >> 172.21.15.84:0/3435102622 conn(0x7f46380f7430 msgr2=0x7f46380f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:10.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.802+0000 7f463e000700 1 -- 172.21.15.84:0/3435102622 shutdown_connections 2024-04-26T21:24:10.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.802+0000 7f463e000700 1 -- 172.21.15.84:0/3435102622 wait complete. 2024-04-26T21:24:10.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.803+0000 7f463e000700 1 Processor -- start 2024-04-26T21:24:10.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.804+0000 7f463e000700 1 -- start start 2024-04-26T21:24:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.804+0000 7f463e000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4638066ed0 0x7f46380fd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.804+0000 7f463e000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46380ffee0 0x7f46380fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.804+0000 7f463e000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46380fd7f0 con 0x7f46380ffee0 2024-04-26T21:24:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.804+0000 7f463e000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46380fbde0 con 0x7f4638066ed0 2024-04-26T21:24:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.804+0000 7f4636a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46380ffee0 0x7f46380fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.804+0000 7f4636a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46380ffee0 0x7f46380fb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55986/0 (socket says 172.21.15.84:55986) 2024-04-26T21:24:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.804+0000 7f4636a00700 1 -- 172.21.15.84:0/2534194306 learned_addr learned my addr 172.21.15.84:0/2534194306 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:24:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.805+0000 7f4637400700 1 --2- 172.21.15.84:0/2534194306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4638066ed0 0x7f46380fd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.805+0000 7f4636a00700 1 -- 172.21.15.84:0/2534194306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4638066ed0 msgr2=0x7f46380fd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.805+0000 7f4636a00700 1 --2- 172.21.15.84:0/2534194306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4638066ed0 0x7f46380fd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.805+0000 7f4636a00700 1 -- 172.21.15.84:0/2534194306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4624005040 con 0x7f46380ffee0 2024-04-26T21:24:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.805+0000 7f4636a00700 1 --2- 172.21.15.84:0/2534194306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46380ffee0 0x7f46380fb8a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4624009150 tx=0x7f4624009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:10.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.806+0000 7f462f400700 1 -- 172.21.15.84:0/2534194306 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f462400e040 con 0x7f46380ffee0 2024-04-26T21:24:10.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.806+0000 7f462f400700 1 -- 172.21.15.84:0/2534194306 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f462400bbf0 con 0x7f46380ffee0 2024-04-26T21:24:10.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.806+0000 7f462f400700 1 -- 172.21.15.84:0/2534194306 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f462401c630 con 0x7f46380ffee0 2024-04-26T21:24:10.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.806+0000 7f463e000700 1 -- 172.21.15.84:0/2534194306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46380fc030 con 0x7f46380ffee0 2024-04-26T21:24:10.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.806+0000 7f463e000700 1 -- 172.21.15.84:0/2534194306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46380fc5f0 con 0x7f46380ffee0 2024-04-26T21:24:10.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.807+0000 7f463e000700 1 -- 172.21.15.84:0/2534194306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463804c710 con 0x7f46380ffee0 2024-04-26T21:24:10.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.808+0000 7f462f400700 1 -- 172.21.15.84:0/2534194306 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f462400bd60 con 0x7f46380ffee0 2024-04-26T21:24:10.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.809+0000 7f462f400700 1 --2- 172.21.15.84:0/2534194306 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f461c0692a0 0x7f461c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:10.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.809+0000 7f462f400700 1 -- 172.21.15.84:0/2534194306 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f46240884e0 con 0x7f46380ffee0 2024-04-26T21:24:10.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.810+0000 7f4637400700 1 --2- 172.21.15.84:0/2534194306 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f461c0692a0 0x7f461c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:10.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.811+0000 7f4637400700 1 --2- 172.21.15.84:0/2534194306 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f461c0692a0 0x7f461c06b750 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4638066c10 tx=0x7f462800b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:10.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:10.814+0000 7f462f400700 1 -- 172.21.15.84:0/2534194306 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4624058330 con 0x7f46380ffee0 2024-04-26T21:24:10.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:10 smithi084 ceph-mon[25539]: pgmap v302: 65 pgs: 65 active+clean; 45 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.7 MiB/s wr, 89 op/s 2024-04-26T21:24:10.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:10 smithi120 ceph-mon[32741]: pgmap v302: 65 pgs: 65 active+clean; 45 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.7 MiB/s wr, 89 op/s 2024-04-26T21:24:11.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.084+0000 7f463e000700 1 -- 172.21.15.84:0/2534194306 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f46380f8f20 con 0x7f461c0692a0 2024-04-26T21:24:11.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.087+0000 7f462f400700 1 -- 172.21.15.84:0/2534194306 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f46380f8f20 con 0x7f461c0692a0 2024-04-26T21:24:11.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.090+0000 7f463e000700 1 -- 172.21.15.84:0/2534194306 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f461c0692a0 msgr2=0x7f461c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:11.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.090+0000 7f463e000700 1 --2- 172.21.15.84:0/2534194306 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f461c0692a0 0x7f461c06b750 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4638066c10 tx=0x7f462800b040 comp rx=0 tx=0).stop 2024-04-26T21:24:11.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.090+0000 7f463e000700 1 -- 172.21.15.84:0/2534194306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46380ffee0 msgr2=0x7f46380fb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:11.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.090+0000 7f463e000700 1 --2- 172.21.15.84:0/2534194306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46380ffee0 0x7f46380fb8a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4624009150 tx=0x7f4624009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:11.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.090+0000 7f463e000700 1 -- 172.21.15.84:0/2534194306 shutdown_connections 2024-04-26T21:24:11.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.090+0000 7f463e000700 1 --2- 172.21.15.84:0/2534194306 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f461c0692a0 0x7f461c06b750 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:11.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.090+0000 7f463e000700 1 --2- 172.21.15.84:0/2534194306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4638066ed0 0x7f46380fd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:11.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.090+0000 7f463e000700 1 --2- 172.21.15.84:0/2534194306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46380ffee0 0x7f46380fb8a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:11.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.090+0000 7f463e000700 1 -- 172.21.15.84:0/2534194306 >> 172.21.15.84:0/2534194306 conn(0x7f46380f7430 msgr2=0x7f46380f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:11.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.090+0000 7f463e000700 1 -- 172.21.15.84:0/2534194306 shutdown_connections 2024-04-26T21:24:11.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.091+0000 7f463e000700 1 -- 172.21.15.84:0/2534194306 wait complete. 2024-04-26T21:24:11.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.251+0000 7f4dee200700 1 -- 172.21.15.84:0/3240713135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4de8100080 msgr2=0x7f4de81004f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:11.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.251+0000 7f4dee200700 1 --2- 172.21.15.84:0/3240713135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4de8100080 0x7f4de81004f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4004940 tx=0x7f4dd4009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:11.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.251+0000 7f4dee200700 1 -- 172.21.15.84:0/3240713135 shutdown_connections 2024-04-26T21:24:11.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.251+0000 7f4dee200700 1 --2- 172.21.15.84:0/3240713135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4de8100080 0x7f4de81004f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:11.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.251+0000 7f4dee200700 1 --2- 172.21.15.84:0/3240713135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4de80fee80 0x7f4de80ff290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:11.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.251+0000 7f4dee200700 1 -- 172.21.15.84:0/3240713135 >> 172.21.15.84:0/3240713135 conn(0x7f4de80fa730 msgr2=0x7f4de80fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:11.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.251+0000 7f4dee200700 1 -- 172.21.15.84:0/3240713135 shutdown_connections 2024-04-26T21:24:11.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.251+0000 7f4dee200700 1 -- 172.21.15.84:0/3240713135 wait complete. 2024-04-26T21:24:11.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.252+0000 7f4dee200700 1 Processor -- start 2024-04-26T21:24:11.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.252+0000 7f4dee200700 1 -- start start 2024-04-26T21:24:11.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.253+0000 7f4dee200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4de80fee80 0x7f4de810fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:11.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.253+0000 7f4dee200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4de8100080 0x7f4de810ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:11.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.253+0000 7f4dee200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de81105a0 con 0x7f4de80fee80 2024-04-26T21:24:11.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.253+0000 7f4dee200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de8110df0 con 0x7f4de8100080 2024-04-26T21:24:11.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.253+0000 7f4dece00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4de80fee80 0x7f4de810fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:11.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.253+0000 7f4dece00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4de80fee80 0x7f4de810fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56018/0 (socket says 172.21.15.84:56018) 2024-04-26T21:24:11.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.253+0000 7f4dece00700 1 -- 172.21.15.84:0/2676914056 learned_addr learned my addr 172.21.15.84:0/2676914056 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:24:11.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.253+0000 7f4de7e00700 1 --2- 172.21.15.84:0/2676914056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4de8100080 0x7f4de810ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:11.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.254+0000 7f4dece00700 1 -- 172.21.15.84:0/2676914056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4de8100080 msgr2=0x7f4de810ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:11.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.254+0000 7f4dece00700 1 --2- 172.21.15.84:0/2676914056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4de8100080 0x7f4de810ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:11.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.254+0000 7f4dece00700 1 -- 172.21.15.84:0/2676914056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd4005040 con 0x7f4de80fee80 2024-04-26T21:24:11.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.254+0000 7f4dece00700 1 --2- 172.21.15.84:0/2676914056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4de80fee80 0x7f4de810fa60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00c800 tx=0x7f4ddc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:11.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.254+0000 7f4de4c00700 1 -- 172.21.15.84:0/2676914056 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ddc0106f0 con 0x7f4de80fee80 2024-04-26T21:24:11.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.254+0000 7f4de4c00700 1 -- 172.21.15.84:0/2676914056 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ddc010d20 con 0x7f4de80fee80 2024-04-26T21:24:11.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.254+0000 7f4dee200700 1 -- 172.21.15.84:0/2676914056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de81110d0 con 0x7f4de80fee80 2024-04-26T21:24:11.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.254+0000 7f4de4c00700 1 -- 172.21.15.84:0/2676914056 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ddc0113a0 con 0x7f4de80fee80 2024-04-26T21:24:11.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.254+0000 7f4dee200700 1 -- 172.21.15.84:0/2676914056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de8111610 con 0x7f4de80fee80 2024-04-26T21:24:11.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.256+0000 7f4dee200700 1 -- 172.21.15.84:0/2676914056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de80fe230 con 0x7f4de80fee80 2024-04-26T21:24:11.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.257+0000 7f4de4c00700 1 -- 172.21.15.84:0/2676914056 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4ddc012400 con 0x7f4de80fee80 2024-04-26T21:24:11.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.258+0000 7f4de4c00700 1 --2- 172.21.15.84:0/2676914056 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f4dd00692a0 0x7f4dd006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:11.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.258+0000 7f4de4c00700 1 -- 172.21.15.84:0/2676914056 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4ddc087120 con 0x7f4de80fee80 2024-04-26T21:24:11.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.258+0000 7f4de7e00700 1 --2- 172.21.15.84:0/2676914056 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f4dd00692a0 0x7f4dd006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:11.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.259+0000 7f4de7e00700 1 --2- 172.21.15.84:0/2676914056 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f4dd00692a0 0x7f4dd006b750 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4009fd0 tx=0x7f4dd4009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:11.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.263+0000 7f4de4c00700 1 -- 172.21.15.84:0/2676914056 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4ddc056ec0 con 0x7f4de80fee80 2024-04-26T21:24:11.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.528+0000 7f4dee200700 1 -- 172.21.15.84:0/2676914056 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4de8111aa0 con 0x7f4dd00692a0 2024-04-26T21:24:11.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.554+0000 7f4de4c00700 1 -- 172.21.15.84:0/2676914056 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f4de8111aa0 con 0x7f4dd00692a0 2024-04-26T21:24:11.555 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:24:11.555 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (7m) 2m ago 9m 13.3M - 0.25.0 c8568f914cd2 e17e61753bb1 2024-04-26T21:24:11.555 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (10m) 2m ago 10m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 a111b0ee8187 2024-04-26T21:24:11.555 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (8m) 2m ago 8m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 66f4d21263a1 2024-04-26T21:24:11.555 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (7m) 2m ago 9m 73.9M - 9.4.7 954c08fa6188 67caa0766f89 2024-04-26T21:24:11.555 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (2m) 2m ago 2m 13.3M - 17.2.7-907-g2be3efa9 1c5834633715 485d7884e1d5 2024-04-26T21:24:11.555 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (2m) 2m ago 2m 10.5M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:24:11.555 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (2m) 2m ago 2m 12.7M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:24:11.555 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (2m) 2m ago 2m 10.4M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:24:11.556 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:9283 running (11m) 2m ago 11m 480M - 17.2.7-907-g2be3efa9 1c5834633715 98242b12bd6c 2024-04-26T21:24:11.556 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283 running (8m) 2m ago 8m 432M - 17.2.7-907-g2be3efa9 1c5834633715 29dc99fc0efb 2024-04-26T21:24:11.556 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (11m) 2m ago 11m 44.7M 2048M 17.2.7-907-g2be3efa9 1c5834633715 24cc2d798ea7 2024-04-26T21:24:11.556 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (8m) 2m ago 8m 35.0M 2048M 17.2.7-907-g2be3efa9 1c5834633715 72c786fd622b 2024-04-26T21:24:11.556 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (10m) 2m ago 10m 7470k - 1.5.0 0da6a335fe13 8fdbcc05a9dd 2024-04-26T21:24:11.556 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (8m) 2m ago 8m 7482k - 1.5.0 0da6a335fe13 1b07a56a6ace 2024-04-26T21:24:11.556 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (7m) 2m ago 7m 45.2M 4288M 17.2.7-907-g2be3efa9 1c5834633715 3a2e74d7e51a 2024-04-26T21:24:11.556 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (6m) 2m ago 6m 44.9M 4288M 17.2.7-907-g2be3efa9 1c5834633715 d283a0a93213 2024-04-26T21:24:11.556 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (6m) 2m ago 6m 43.1M 4288M 17.2.7-907-g2be3efa9 1c5834633715 5899468fc5c8 2024-04-26T21:24:11.556 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (5m) 2m ago 5m 43.1M 5312M 17.2.7-907-g2be3efa9 1c5834633715 b8a14c87d730 2024-04-26T21:24:11.556 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (5m) 2m ago 5m 40.8M 5312M 17.2.7-907-g2be3efa9 1c5834633715 4d294df735a3 2024-04-26T21:24:11.556 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (4m) 2m ago 4m 40.7M 5312M 17.2.7-907-g2be3efa9 1c5834633715 9b60997971a8 2024-04-26T21:24:11.556 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (7m) 2m ago 9m 46.1M - 2.43.0 a07b618ecd1d 7b6983aea888 2024-04-26T21:24:11.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.557+0000 7f4dee200700 1 -- 172.21.15.84:0/2676914056 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f4dd00692a0 msgr2=0x7f4dd006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:11.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.557+0000 7f4dee200700 1 --2- 172.21.15.84:0/2676914056 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f4dd00692a0 0x7f4dd006b750 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4009fd0 tx=0x7f4dd4009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:11.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.557+0000 7f4dee200700 1 -- 172.21.15.84:0/2676914056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4de80fee80 msgr2=0x7f4de810fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:11.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.557+0000 7f4dee200700 1 --2- 172.21.15.84:0/2676914056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4de80fee80 0x7f4de810fa60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00c800 tx=0x7f4ddc004470 comp rx=0 tx=0).stop 2024-04-26T21:24:11.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.557+0000 7f4dee200700 1 -- 172.21.15.84:0/2676914056 shutdown_connections 2024-04-26T21:24:11.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.557+0000 7f4dee200700 1 --2- 172.21.15.84:0/2676914056 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f4dd00692a0 0x7f4dd006b750 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:11.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.557+0000 7f4dee200700 1 --2- 172.21.15.84:0/2676914056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4de80fee80 0x7f4de810fa60 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:11.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.557+0000 7f4dee200700 1 --2- 172.21.15.84:0/2676914056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4de8100080 0x7f4de810ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:11.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.557+0000 7f4dee200700 1 -- 172.21.15.84:0/2676914056 >> 172.21.15.84:0/2676914056 conn(0x7f4de80fa730 msgr2=0x7f4de80fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:11.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.558+0000 7f4dee200700 1 -- 172.21.15.84:0/2676914056 shutdown_connections 2024-04-26T21:24:11.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.558+0000 7f4dee200700 1 -- 172.21.15.84:0/2676914056 wait complete. 2024-04-26T21:24:11.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.726+0000 7f8b55400700 1 -- 172.21.15.84:0/843882136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b500fdee0 msgr2=0x7f8b500fe350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:11.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.726+0000 7f8b55400700 1 --2- 172.21.15.84:0/843882136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b500fdee0 0x7f8b500fe350 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c004940 tx=0x7f8b3c009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:11.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.726+0000 7f8b55400700 1 -- 172.21.15.84:0/843882136 shutdown_connections 2024-04-26T21:24:11.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.726+0000 7f8b55400700 1 --2- 172.21.15.84:0/843882136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b500fdee0 0x7f8b500fe350 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:11.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.726+0000 7f8b55400700 1 --2- 172.21.15.84:0/843882136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b500fcc30 0x7f8b500fd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:11.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.726+0000 7f8b55400700 1 -- 172.21.15.84:0/843882136 >> 172.21.15.84:0/843882136 conn(0x7f8b500f83d0 msgr2=0x7f8b500fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:11.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.726+0000 7f8b55400700 1 -- 172.21.15.84:0/843882136 shutdown_connections 2024-04-26T21:24:11.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.726+0000 7f8b55400700 1 -- 172.21.15.84:0/843882136 wait complete. 2024-04-26T21:24:11.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.727+0000 7f8b55400700 1 Processor -- start 2024-04-26T21:24:11.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.727+0000 7f8b55400700 1 -- start start 2024-04-26T21:24:11.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.728+0000 7f8b55400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b500fcc30 0x7f8b5010fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:11.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.728+0000 7f8b55400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b500fdee0 0x7f8b5010ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:11.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.728+0000 7f8b55400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b501105b0 con 0x7f8b500fdee0 2024-04-26T21:24:11.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.728+0000 7f8b55400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b50110e00 con 0x7f8b500fcc30 2024-04-26T21:24:11.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.728+0000 7f8b4de00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b500fdee0 0x7f8b5010ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:11.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.728+0000 7f8b4de00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b500fdee0 0x7f8b5010ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56022/0 (socket says 172.21.15.84:56022) 2024-04-26T21:24:11.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.728+0000 7f8b4de00700 1 -- 172.21.15.84:0/2147691714 learned_addr learned my addr 172.21.15.84:0/2147691714 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:24:11.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.729+0000 7f8b4e800700 1 --2- 172.21.15.84:0/2147691714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b500fcc30 0x7f8b5010fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:11.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.729+0000 7f8b4de00700 1 -- 172.21.15.84:0/2147691714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b500fcc30 msgr2=0x7f8b5010fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:11.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.729+0000 7f8b4de00700 1 --2- 172.21.15.84:0/2147691714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b500fcc30 0x7f8b5010fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:11.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.729+0000 7f8b4de00700 1 -- 172.21.15.84:0/2147691714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c005040 con 0x7f8b500fdee0 2024-04-26T21:24:11.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.729+0000 7f8b4de00700 1 --2- 172.21.15.84:0/2147691714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b500fdee0 0x7f8b5010ffb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009150 tx=0x7f8b3c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:11.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.730+0000 7f8b46a00700 1 -- 172.21.15.84:0/2147691714 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b3c00e040 con 0x7f8b500fdee0 2024-04-26T21:24:11.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.730+0000 7f8b46a00700 1 -- 172.21.15.84:0/2147691714 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b3c00bbf0 con 0x7f8b500fdee0 2024-04-26T21:24:11.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.730+0000 7f8b46a00700 1 -- 172.21.15.84:0/2147691714 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b3c01c630 con 0x7f8b500fdee0 2024-04-26T21:24:11.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.730+0000 7f8b55400700 1 -- 172.21.15.84:0/2147691714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b50111080 con 0x7f8b500fdee0 2024-04-26T21:24:11.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.730+0000 7f8b55400700 1 -- 172.21.15.84:0/2147691714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b501115c0 con 0x7f8b500fdee0 2024-04-26T21:24:11.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.731+0000 7f8b55400700 1 -- 172.21.15.84:0/2147691714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b50101870 con 0x7f8b500fdee0 2024-04-26T21:24:11.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.732+0000 7f8b46a00700 1 -- 172.21.15.84:0/2147691714 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f8b3c00bd60 con 0x7f8b500fdee0 2024-04-26T21:24:11.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.733+0000 7f8b46a00700 1 --2- 172.21.15.84:0/2147691714 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f8b340692b0 0x7f8b3406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:11.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.733+0000 7f8b46a00700 1 -- 172.21.15.84:0/2147691714 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8b3c0885b0 con 0x7f8b500fdee0 2024-04-26T21:24:11.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.734+0000 7f8b4e800700 1 --2- 172.21.15.84:0/2147691714 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f8b340692b0 0x7f8b3406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:11.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.734+0000 7f8b4e800700 1 --2- 172.21.15.84:0/2147691714 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f8b340692b0 0x7f8b3406b760 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8b40007fd0 tx=0x7f8b40009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:11.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:11.739+0000 7f8b46a00700 1 -- 172.21.15.84:0/2147691714 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8b3c058350 con 0x7f8b500fdee0 2024-04-26T21:24:11.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:11 smithi084 ceph-mon[25539]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:24:11.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:11 smithi084 ceph-mon[25539]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:24:11.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:11 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:24:11.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:11 smithi120 ceph-mon[32741]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:24:11.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:11 smithi120 ceph-mon[32741]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:24:11.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:11 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:24:12.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.108+0000 7f8b55400700 1 -- 172.21.15.84:0/2147691714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8b5005f5c0 con 0x7f8b500fdee0 2024-04-26T21:24:12.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.110+0000 7f8b46a00700 1 -- 172.21.15.84:0/2147691714 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f8b3c057ee0 con 0x7f8b500fdee0 2024-04-26T21:24:12.110 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:24:12.110 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:24:12.111 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-26T21:24:12.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:24:12.111 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:24:12.111 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-26T21:24:12.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:24:12.111 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:24:12.111 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-26T21:24:12.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:24:12.111 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:24:12.111 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-26T21:24:12.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:24:12.111 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:24:12.111 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 14 2024-04-26T21:24:12.111 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:24:12.112 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:24:12.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.113+0000 7f8b55400700 1 -- 172.21.15.84:0/2147691714 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f8b340692b0 msgr2=0x7f8b3406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:12.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.113+0000 7f8b55400700 1 --2- 172.21.15.84:0/2147691714 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f8b340692b0 0x7f8b3406b760 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8b40007fd0 tx=0x7f8b40009040 comp rx=0 tx=0).stop 2024-04-26T21:24:12.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.113+0000 7f8b55400700 1 -- 172.21.15.84:0/2147691714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b500fdee0 msgr2=0x7f8b5010ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:12.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.113+0000 7f8b55400700 1 --2- 172.21.15.84:0/2147691714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b500fdee0 0x7f8b5010ffb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009150 tx=0x7f8b3c009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:12.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.114+0000 7f8b55400700 1 -- 172.21.15.84:0/2147691714 shutdown_connections 2024-04-26T21:24:12.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.114+0000 7f8b55400700 1 --2- 172.21.15.84:0/2147691714 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f8b340692b0 0x7f8b3406b760 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:12.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.114+0000 7f8b55400700 1 --2- 172.21.15.84:0/2147691714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b500fcc30 0x7f8b5010fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:12.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.114+0000 7f8b55400700 1 --2- 172.21.15.84:0/2147691714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b500fdee0 0x7f8b5010ffb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:12.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.114+0000 7f8b55400700 1 -- 172.21.15.84:0/2147691714 >> 172.21.15.84:0/2147691714 conn(0x7f8b500f83d0 msgr2=0x7f8b500f99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:12.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.114+0000 7f8b55400700 1 -- 172.21.15.84:0/2147691714 shutdown_connections 2024-04-26T21:24:12.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.114+0000 7f8b55400700 1 -- 172.21.15.84:0/2147691714 wait complete. 2024-04-26T21:24:12.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.276+0000 7f06aca00700 1 -- 172.21.15.84:0/4249324378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06a80662c0 msgr2=0x7f06a8101be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:12.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.276+0000 7f06aca00700 1 --2- 172.21.15.84:0/4249324378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06a80662c0 0x7f06a8101be0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0698004940 tx=0x7f0698009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:12.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.277+0000 7f06aca00700 1 -- 172.21.15.84:0/4249324378 shutdown_connections 2024-04-26T21:24:12.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.277+0000 7f06aca00700 1 --2- 172.21.15.84:0/4249324378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06a8102120 0x7f06a8104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:12.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.277+0000 7f06aca00700 1 --2- 172.21.15.84:0/4249324378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06a80662c0 0x7f06a8101be0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:12.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.277+0000 7f06aca00700 1 -- 172.21.15.84:0/4249324378 >> 172.21.15.84:0/4249324378 conn(0x7f06a80f7250 msgr2=0x7f06a80f9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:12.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.277+0000 7f06aca00700 1 -- 172.21.15.84:0/4249324378 shutdown_connections 2024-04-26T21:24:12.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.277+0000 7f06aca00700 1 -- 172.21.15.84:0/4249324378 wait complete. 2024-04-26T21:24:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.278+0000 7f06aca00700 1 Processor -- start 2024-04-26T21:24:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.278+0000 7f06aca00700 1 -- start start 2024-04-26T21:24:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.278+0000 7f06aca00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06a80662c0 0x7f06a8113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.278+0000 7f06aca00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06a8102120 0x7f06a81144b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.278+0000 7f06aca00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a8115170 con 0x7f06a80662c0 2024-04-26T21:24:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.278+0000 7f06aca00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a81152e0 con 0x7f06a8102120 2024-04-26T21:24:12.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.279+0000 7f06a6800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06a80662c0 0x7f06a8113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:12.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.279+0000 7f06a6800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06a80662c0 0x7f06a8113f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33078/0 (socket says 172.21.15.84:33078) 2024-04-26T21:24:12.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.279+0000 7f06a6800700 1 -- 172.21.15.84:0/3088598215 learned_addr learned my addr 172.21.15.84:0/3088598215 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:24:12.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.279+0000 7f06a6800700 1 -- 172.21.15.84:0/3088598215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06a8102120 msgr2=0x7f06a81144b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:12.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.279+0000 7f06a6800700 1 --2- 172.21.15.84:0/3088598215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06a8102120 0x7f06a81144b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:12.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.279+0000 7f06a6800700 1 -- 172.21.15.84:0/3088598215 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0698005040 con 0x7f06a80662c0 2024-04-26T21:24:12.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.280+0000 7f06a6800700 1 --2- 172.21.15.84:0/3088598215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06a80662c0 0x7f06a8113f70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f069800b970 tx=0x7f0698009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:12.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.280+0000 7f069ea00700 1 -- 172.21.15.84:0/3088598215 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f069800e040 con 0x7f06a80662c0 2024-04-26T21:24:12.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.280+0000 7f069ea00700 1 -- 172.21.15.84:0/3088598215 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0698004290 con 0x7f06a80662c0 2024-04-26T21:24:12.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.280+0000 7f069ea00700 1 -- 172.21.15.84:0/3088598215 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f069801c630 con 0x7f06a80662c0 2024-04-26T21:24:12.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.280+0000 7f06aca00700 1 -- 172.21.15.84:0/3088598215 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a8115560 con 0x7f06a80662c0 2024-04-26T21:24:12.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.280+0000 7f06aca00700 1 -- 172.21.15.84:0/3088598215 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a8115ad0 con 0x7f06a80662c0 2024-04-26T21:24:12.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.282+0000 7f06aca00700 1 -- 172.21.15.84:0/3088598215 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a8108160 con 0x7f06a80662c0 2024-04-26T21:24:12.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.283+0000 7f069ea00700 1 -- 172.21.15.84:0/3088598215 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f069800bbf0 con 0x7f06a80662c0 2024-04-26T21:24:12.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.283+0000 7f069ea00700 1 --2- 172.21.15.84:0/3088598215 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f068c0692b0 0x7f068c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:12.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.284+0000 7f069ea00700 1 -- 172.21.15.84:0/3088598215 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0698088640 con 0x7f06a80662c0 2024-04-26T21:24:12.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.284+0000 7f06a5e00700 1 --2- 172.21.15.84:0/3088598215 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f068c0692b0 0x7f068c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:12.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.285+0000 7f06a5e00700 1 --2- 172.21.15.84:0/3088598215 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f068c0692b0 0x7f068c06b760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0694006fd0 tx=0x7f0694006db0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:12.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.289+0000 7f069ea00700 1 -- 172.21.15.84:0/3088598215 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0698058360 con 0x7f06a80662c0 2024-04-26T21:24:12.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.638+0000 7f06aca00700 1 -- 172.21.15.84:0/3088598215 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f06a8115e00 con 0x7f06a80662c0 2024-04-26T21:24:12.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.638+0000 7f069ea00700 1 -- 172.21.15.84:0/3088598215 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1835 (secure 0 0 0) 0x7f0698013e60 con 0x7f06a80662c0 2024-04-26T21:24:12.640 INFO:teuthology.orchestra.run.smithi084.stdout:e12 2024-04-26T21:24:12.640 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:24:12.641 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:24:12.641 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:24:12.641 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:24:12.641 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:24:12.641 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:24:12.641 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 12 2024-04-26T21:24:12.641 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:24:12.641 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:24:12.641 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:23:53.700069+0000 2024-04-26T21:24:12.641 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:24:12.641 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:24:12.641 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:24:12.641 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:24:12.641 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:24:12.642 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:24:12.642 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:24:12.642 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:24:12.642 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:24:12.642 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:24:12.642 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:24:12.642 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456,1=24231} 2024-04-26T21:24:12.642 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:24:12.642 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:24:12.642 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:24:12.642 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:24:12.642 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:24:12.642 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:24:12.642 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:24:12.643 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:24:12.643 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:24:12.643 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:24:12.643 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:24:12.643 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:24:12.643 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:24:12.643 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:24:12.643 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:24:12.643 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:24:12.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.642+0000 7f06aca00700 1 -- 172.21.15.84:0/3088598215 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f068c0692b0 msgr2=0x7f068c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:12.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.642+0000 7f06aca00700 1 --2- 172.21.15.84:0/3088598215 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f068c0692b0 0x7f068c06b760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0694006fd0 tx=0x7f0694006db0 comp rx=0 tx=0).stop 2024-04-26T21:24:12.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.642+0000 7f06aca00700 1 -- 172.21.15.84:0/3088598215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06a80662c0 msgr2=0x7f06a8113f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:12.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.642+0000 7f06aca00700 1 --2- 172.21.15.84:0/3088598215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06a80662c0 0x7f06a8113f70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f069800b970 tx=0x7f0698009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:12.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.642+0000 7f06aca00700 1 -- 172.21.15.84:0/3088598215 shutdown_connections 2024-04-26T21:24:12.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.642+0000 7f06aca00700 1 --2- 172.21.15.84:0/3088598215 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f068c0692b0 0x7f068c06b760 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:12.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.642+0000 7f06aca00700 1 --2- 172.21.15.84:0/3088598215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06a80662c0 0x7f06a8113f70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:12.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.642+0000 7f06aca00700 1 --2- 172.21.15.84:0/3088598215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06a8102120 0x7f06a81144b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:12.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.642+0000 7f06aca00700 1 -- 172.21.15.84:0/3088598215 >> 172.21.15.84:0/3088598215 conn(0x7f06a80f7250 msgr2=0x7f06a80f7670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:12.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.643+0000 7f06aca00700 1 -- 172.21.15.84:0/3088598215 shutdown_connections 2024-04-26T21:24:12.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.643+0000 7f06aca00700 1 -- 172.21.15.84:0/3088598215 wait complete. 2024-04-26T21:24:12.648 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 12 2024-04-26T21:24:12.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.838+0000 7f9f91800700 1 -- 172.21.15.84:0/3670852796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f8c0fce60 msgr2=0x7f9f8c0fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:12.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.838+0000 7f9f91800700 1 --2- 172.21.15.84:0/3670852796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f8c0fce60 0x7f9f8c0fd270 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c004940 tx=0x7f9f7c009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:12.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.839+0000 7f9f91800700 1 -- 172.21.15.84:0/3670852796 shutdown_connections 2024-04-26T21:24:12.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.839+0000 7f9f91800700 1 --2- 172.21.15.84:0/3670852796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f8c0fdfd0 0x7f9f8c0fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:12.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.839+0000 7f9f91800700 1 --2- 172.21.15.84:0/3670852796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f8c0fce60 0x7f9f8c0fd270 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:12.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.839+0000 7f9f91800700 1 -- 172.21.15.84:0/3670852796 >> 172.21.15.84:0/3670852796 conn(0x7f9f8c0f8500 msgr2=0x7f9f8c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:12.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.839+0000 7f9f91800700 1 -- 172.21.15.84:0/3670852796 shutdown_connections 2024-04-26T21:24:12.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.839+0000 7f9f91800700 1 -- 172.21.15.84:0/3670852796 wait complete. 2024-04-26T21:24:12.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.840+0000 7f9f91800700 1 Processor -- start 2024-04-26T21:24:12.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.840+0000 7f9f91800700 1 -- start start 2024-04-26T21:24:12.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.840+0000 7f9f91800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f8c0fce60 0x7f9f8c10fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:12.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.841+0000 7f9f91800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f8c0fdfd0 0x7f9f8c110120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:12.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.841+0000 7f9f91800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c110720 con 0x7f9f8c0fce60 2024-04-26T21:24:12.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.841+0000 7f9f91800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c110f20 con 0x7f9f8c0fdfd0 2024-04-26T21:24:12.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.841+0000 7f9f8aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f8c0fce60 0x7f9f8c10fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:12.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.841+0000 7f9f8aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f8c0fce60 0x7f9f8c10fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33106/0 (socket says 172.21.15.84:33106) 2024-04-26T21:24:12.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.841+0000 7f9f8aa00700 1 -- 172.21.15.84:0/1456961021 learned_addr learned my addr 172.21.15.84:0/1456961021 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:24:12.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.841+0000 7f9f8a000700 1 --2- 172.21.15.84:0/1456961021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f8c0fdfd0 0x7f9f8c110120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:12.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.842+0000 7f9f8aa00700 1 -- 172.21.15.84:0/1456961021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f8c0fdfd0 msgr2=0x7f9f8c110120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:12.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.842+0000 7f9f8aa00700 1 --2- 172.21.15.84:0/1456961021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f8c0fdfd0 0x7f9f8c110120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:12.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.842+0000 7f9f8aa00700 1 -- 172.21.15.84:0/1456961021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c005040 con 0x7f9f8c0fce60 2024-04-26T21:24:12.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.842+0000 7f9f8a000700 1 --2- 172.21.15.84:0/1456961021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f8c0fdfd0 0x7f9f8c110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:24:12.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.842+0000 7f9f8aa00700 1 --2- 172.21.15.84:0/1456961021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f8c0fce60 0x7f9f8c10fbe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00b0d0 tx=0x7f9f7c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:12.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.842+0000 7f9f82a00700 1 -- 172.21.15.84:0/1456961021 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f7c00e070 con 0x7f9f8c0fce60 2024-04-26T21:24:12.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.842+0000 7f9f82a00700 1 -- 172.21.15.84:0/1456961021 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f7c00b410 con 0x7f9f8c0fce60 2024-04-26T21:24:12.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.842+0000 7f9f82a00700 1 -- 172.21.15.84:0/1456961021 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f7c012600 con 0x7f9f8c0fce60 2024-04-26T21:24:12.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.842+0000 7f9f91800700 1 -- 172.21.15.84:0/1456961021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8c1111a0 con 0x7f9f8c0fce60 2024-04-26T21:24:12.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.843+0000 7f9f91800700 1 -- 172.21.15.84:0/1456961021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8c1116e0 con 0x7f9f8c0fce60 2024-04-26T21:24:12.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.844+0000 7f9f91800700 1 -- 172.21.15.84:0/1456961021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f8c05f5c0 con 0x7f9f8c0fce60 2024-04-26T21:24:12.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.846+0000 7f9f82a00700 1 -- 172.21.15.84:0/1456961021 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f9f7c00ba80 con 0x7f9f8c0fce60 2024-04-26T21:24:12.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.848+0000 7f9f82a00700 1 --2- 172.21.15.84:0/1456961021 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f9f700692b0 0x7f9f7006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:12.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.848+0000 7f9f82a00700 1 -- 172.21.15.84:0/1456961021 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9f7c087d50 con 0x7f9f8c0fce60 2024-04-26T21:24:12.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.848+0000 7f9f8a000700 1 --2- 172.21.15.84:0/1456961021 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f9f700692b0 0x7f9f7006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:12.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.849+0000 7f9f8a000700 1 --2- 172.21.15.84:0/1456961021 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f9f700692b0 0x7f9f7006b760 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9f78004600 tx=0x7f9f7800b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:12.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:12.855+0000 7f9f82a00700 1 -- 172.21.15.84:0/1456961021 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9f7c057c60 con 0x7f9f8c0fce60 2024-04-26T21:24:12.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:12 smithi084 ceph-mon[25539]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:24:12.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:12 smithi084 ceph-mon[25539]: pgmap v303: 65 pgs: 65 active+clean; 45 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 980 KiB/s wr, 56 op/s 2024-04-26T21:24:12.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:12 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2147691714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:24:12.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:12 smithi120 ceph-mon[32741]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:24:12.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:12 smithi120 ceph-mon[32741]: pgmap v303: 65 pgs: 65 active+clean; 45 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 980 KiB/s wr, 56 op/s 2024-04-26T21:24:12.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:12 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2147691714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:24:13.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.127+0000 7f9f91800700 1 -- 172.21.15.84:0/1456961021 --> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f8c111ad0 con 0x7f9f700692b0 2024-04-26T21:24:13.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.130+0000 7f9f82a00700 1 -- 172.21.15.84:0/1456961021 <== mgr.14212 v2:172.21.15.84:6800/3574511298 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f9f8c111ad0 con 0x7f9f700692b0 2024-04-26T21:24:13.131 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:24:13.131 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:24:13.131 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:24:13.131 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:24:13.131 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [], 2024-04-26T21:24:13.131 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "0/21 daemons upgraded", 2024-04-26T21:24:13.131 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading mgr daemons", 2024-04-26T21:24:13.131 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:24:13.131 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:24:13.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.133+0000 7f9f91800700 1 -- 172.21.15.84:0/1456961021 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f9f700692b0 msgr2=0x7f9f7006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:13.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.133+0000 7f9f91800700 1 --2- 172.21.15.84:0/1456961021 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f9f700692b0 0x7f9f7006b760 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9f78004600 tx=0x7f9f7800b040 comp rx=0 tx=0).stop 2024-04-26T21:24:13.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.133+0000 7f9f91800700 1 -- 172.21.15.84:0/1456961021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f8c0fce60 msgr2=0x7f9f8c10fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:13.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.133+0000 7f9f91800700 1 --2- 172.21.15.84:0/1456961021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f8c0fce60 0x7f9f8c10fbe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00b0d0 tx=0x7f9f7c009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.134+0000 7f9f91800700 1 -- 172.21.15.84:0/1456961021 shutdown_connections 2024-04-26T21:24:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.134+0000 7f9f91800700 1 --2- 172.21.15.84:0/1456961021 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7f9f700692b0 0x7f9f7006b760 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.134+0000 7f9f91800700 1 --2- 172.21.15.84:0/1456961021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f8c0fce60 0x7f9f8c10fbe0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.134+0000 7f9f91800700 1 --2- 172.21.15.84:0/1456961021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f8c0fdfd0 0x7f9f8c110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.134+0000 7f9f91800700 1 -- 172.21.15.84:0/1456961021 >> 172.21.15.84:0/1456961021 conn(0x7f9f8c0f8500 msgr2=0x7f9f8c0f9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.134+0000 7f9f91800700 1 -- 172.21.15.84:0/1456961021 shutdown_connections 2024-04-26T21:24:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.134+0000 7f9f91800700 1 -- 172.21.15.84:0/1456961021 wait complete. 2024-04-26T21:24:13.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.300+0000 7fcbf7400700 1 -- 172.21.15.84:0/189538887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf0066b50 msgr2=0x7fcbf00ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:13.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.300+0000 7fcbf7400700 1 --2- 172.21.15.84:0/189538887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf0066b50 0x7fcbf00ff9b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4004940 tx=0x7fcbe4009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:13.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.300+0000 7fcbf7400700 1 -- 172.21.15.84:0/189538887 shutdown_connections 2024-04-26T21:24:13.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.300+0000 7fcbf7400700 1 --2- 172.21.15.84:0/189538887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbf00ffef0 0x7fcbf0102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:13.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.300+0000 7fcbf7400700 1 --2- 172.21.15.84:0/189538887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf0066b50 0x7fcbf00ff9b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:13.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.300+0000 7fcbf7400700 1 -- 172.21.15.84:0/189538887 >> 172.21.15.84:0/189538887 conn(0x7fcbf00f7420 msgr2=0x7fcbf00f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:13.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.300+0000 7fcbf7400700 1 -- 172.21.15.84:0/189538887 shutdown_connections 2024-04-26T21:24:13.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.300+0000 7fcbf7400700 1 -- 172.21.15.84:0/189538887 wait complete. 2024-04-26T21:24:13.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.301+0000 7fcbf7400700 1 Processor -- start 2024-04-26T21:24:13.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.301+0000 7fcbf7400700 1 -- start start 2024-04-26T21:24:13.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.302+0000 7fcbf7400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf0066b50 0x7fcbf010da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:13.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.302+0000 7fcbf7400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbf00ffef0 0x7fcbf010dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:13.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.302+0000 7fcbf7400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf010e660 con 0x7fcbf0066b50 2024-04-26T21:24:13.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.302+0000 7fcbf7400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf010ee00 con 0x7fcbf00ffef0 2024-04-26T21:24:13.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.302+0000 7fcbf4a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf0066b50 0x7fcbf010da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:13.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.302+0000 7fcbf4a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf0066b50 0x7fcbf010da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33126/0 (socket says 172.21.15.84:33126) 2024-04-26T21:24:13.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.302+0000 7fcbf4a00700 1 -- 172.21.15.84:0/2676819173 learned_addr learned my addr 172.21.15.84:0/2676819173 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:24:13.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.302+0000 7fcbefe00700 1 --2- 172.21.15.84:0/2676819173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbf00ffef0 0x7fcbf010dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:13.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.303+0000 7fcbf4a00700 1 -- 172.21.15.84:0/2676819173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbf00ffef0 msgr2=0x7fcbf010dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:13.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.303+0000 7fcbf4a00700 1 --2- 172.21.15.84:0/2676819173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbf00ffef0 0x7fcbf010dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:13.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.303+0000 7fcbf4a00700 1 -- 172.21.15.84:0/2676819173 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe4005040 con 0x7fcbf0066b50 2024-04-26T21:24:13.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.303+0000 7fcbf4a00700 1 --2- 172.21.15.84:0/2676819173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf0066b50 0x7fcbf010da90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400b970 tx=0x7fcbe4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:13.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.303+0000 7fcbecc00700 1 -- 172.21.15.84:0/2676819173 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbe400e040 con 0x7fcbf0066b50 2024-04-26T21:24:13.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.303+0000 7fcbecc00700 1 -- 172.21.15.84:0/2676819173 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcbe4004290 con 0x7fcbf0066b50 2024-04-26T21:24:13.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.303+0000 7fcbecc00700 1 -- 172.21.15.84:0/2676819173 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbe401c630 con 0x7fcbf0066b50 2024-04-26T21:24:13.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.303+0000 7fcbf7400700 1 -- 172.21.15.84:0/2676819173 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf010f080 con 0x7fcbf0066b50 2024-04-26T21:24:13.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.304+0000 7fcbf7400700 1 -- 172.21.15.84:0/2676819173 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf010f640 con 0x7fcbf0066b50 2024-04-26T21:24:13.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.305+0000 7fcbf7400700 1 -- 172.21.15.84:0/2676819173 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf005f5c0 con 0x7fcbf0066b50 2024-04-26T21:24:13.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.306+0000 7fcbecc00700 1 -- 172.21.15.84:0/2676819173 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fcbe400bbf0 con 0x7fcbf0066b50 2024-04-26T21:24:13.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.307+0000 7fcbecc00700 1 --2- 172.21.15.84:0/2676819173 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fcbd80692b0 0x7fcbd806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:13.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.307+0000 7fcbecc00700 1 -- 172.21.15.84:0/2676819173 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fcbe4088510 con 0x7fcbf0066b50 2024-04-26T21:24:13.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.308+0000 7fcbefe00700 1 --2- 172.21.15.84:0/2676819173 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fcbd80692b0 0x7fcbd806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:13.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.308+0000 7fcbefe00700 1 --2- 172.21.15.84:0/2676819173 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fcbd80692b0 0x7fcbd806b760 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc006fd0 tx=0x7fcbdc008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.312+0000 7fcbecc00700 1 -- 172.21.15.84:0/2676819173 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fcbe40582b0 con 0x7fcbf0066b50 2024-04-26T21:24:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.683+0000 7fcbf7400700 1 -- 172.21.15.84:0/2676819173 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcbf004bed0 con 0x7fcbf0066b50 2024-04-26T21:24:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.684+0000 7fcbecc00700 1 -- 172.21.15.84:0/2676819173 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fcbe4013e60 con 0x7fcbf0066b50 2024-04-26T21:24:13.685 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:24:13.685 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:24:13.685 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:24:13.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.688+0000 7fcbf7400700 1 -- 172.21.15.84:0/2676819173 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fcbd80692b0 msgr2=0x7fcbd806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:13.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.688+0000 7fcbf7400700 1 --2- 172.21.15.84:0/2676819173 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fcbd80692b0 0x7fcbd806b760 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc006fd0 tx=0x7fcbdc008040 comp rx=0 tx=0).stop 2024-04-26T21:24:13.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.688+0000 7fcbf7400700 1 -- 172.21.15.84:0/2676819173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf0066b50 msgr2=0x7fcbf010da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:13.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.688+0000 7fcbf7400700 1 --2- 172.21.15.84:0/2676819173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf0066b50 0x7fcbf010da90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400b970 tx=0x7fcbe4009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:13.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.688+0000 7fcbf7400700 1 -- 172.21.15.84:0/2676819173 shutdown_connections 2024-04-26T21:24:13.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.688+0000 7fcbf7400700 1 --2- 172.21.15.84:0/2676819173 >> [v2:172.21.15.84:6800/3574511298,v1:172.21.15.84:6801/3574511298] conn(0x7fcbd80692b0 0x7fcbd806b760 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:13.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.688+0000 7fcbf7400700 1 --2- 172.21.15.84:0/2676819173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbf0066b50 0x7fcbf010da90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:13.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.688+0000 7fcbf7400700 1 --2- 172.21.15.84:0/2676819173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbf00ffef0 0x7fcbf010dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:13.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.688+0000 7fcbf7400700 1 -- 172.21.15.84:0/2676819173 >> 172.21.15.84:0/2676819173 conn(0x7fcbf00f7420 msgr2=0x7fcbf00f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:13.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.688+0000 7fcbf7400700 1 -- 172.21.15.84:0/2676819173 shutdown_connections 2024-04-26T21:24:13.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:13.688+0000 7fcbf7400700 1 -- 172.21.15.84:0/2676819173 wait complete. 2024-04-26T21:24:13.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:13 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3088598215' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:24:13.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:13 smithi084 ceph-mon[25539]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:24:13.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:13 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/3088598215' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:24:13.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:13 smithi120 ceph-mon[32741]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:24:14.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:14 smithi084 ceph-mon[25539]: pgmap v304: 65 pgs: 65 active+clean; 57 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.9 MiB/s wr, 87 op/s 2024-04-26T21:24:14.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:14 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2676819173' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:24:14.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:14 smithi120 ceph-mon[32741]: pgmap v304: 65 pgs: 65 active+clean; 57 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.9 MiB/s wr, 87 op/s 2024-04-26T21:24:14.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:14 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2676819173' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:24:16.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:16 smithi084 ceph-mon[25539]: pgmap v305: 65 pgs: 65 active+clean; 57 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.5 MiB/s wr, 64 op/s 2024-04-26T21:24:16.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:16 smithi120 ceph-mon[32741]: pgmap v305: 65 pgs: 65 active+clean; 57 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.5 MiB/s wr, 64 op/s 2024-04-26T21:24:18.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:18 smithi084 ceph-mon[25539]: pgmap v306: 65 pgs: 65 active+clean; 57 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.5 MiB/s wr, 64 op/s 2024-04-26T21:24:18.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:18 smithi120 ceph-mon[32741]: pgmap v306: 65 pgs: 65 active+clean; 57 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.5 MiB/s wr, 64 op/s 2024-04-26T21:24:20.927 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:20 smithi120 ceph-mon[32741]: pgmap v307: 65 pgs: 65 active+clean; 64 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 81 op/s 2024-04-26T21:24:21.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:20 smithi084 ceph-mon[25539]: pgmap v307: 65 pgs: 65 active+clean; 64 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 81 op/s 2024-04-26T21:24:22.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:22 smithi120 ceph-mon[32741]: pgmap v308: 65 pgs: 65 active+clean; 64 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 47 op/s 2024-04-26T21:24:23.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:22 smithi084 ceph-mon[25539]: pgmap v308: 65 pgs: 65 active+clean; 64 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 47 op/s 2024-04-26T21:24:24.135 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:23 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:24.135 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:23 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:24.135 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:23 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:24:24.135 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:23 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:24.135 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:23 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:24.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:23 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:24.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:23 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:24.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:23 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:24:24.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:23 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:24.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:23 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:25.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:24 smithi084 ceph-mon[25539]: pgmap v309: 65 pgs: 65 active+clean; 76 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.6 MiB/s wr, 84 op/s 2024-04-26T21:24:25.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:24 smithi120 ceph-mon[32741]: pgmap v309: 65 pgs: 65 active+clean; 76 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.6 MiB/s wr, 84 op/s 2024-04-26T21:24:26.893 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:26 smithi120 ceph-mon[32741]: pgmap v310: 65 pgs: 65 active+clean; 76 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 54 op/s 2024-04-26T21:24:26.894 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:26 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:24:27.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:26 smithi084 ceph-mon[25539]: pgmap v310: 65 pgs: 65 active+clean; 76 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 54 op/s 2024-04-26T21:24:27.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:26 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:24:29.104 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:28 smithi120 ceph-mon[32741]: pgmap v311: 65 pgs: 65 active+clean; 76 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 54 op/s 2024-04-26T21:24:29.104 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:28 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:29.104 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:28 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:28 smithi084 ceph-mon[25539]: pgmap v311: 65 pgs: 65 active+clean; 76 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 54 op/s 2024-04-26T21:24:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:28 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:29.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:28 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:30.661 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:30 smithi120 ceph-mon[32741]: pgmap v312: 65 pgs: 65 active+clean; 90 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.8 MiB/s wr, 112 op/s 2024-04-26T21:24:30.661 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:30 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:30.661 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:30 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:30.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:30 smithi084 ceph-mon[25539]: pgmap v312: 65 pgs: 65 active+clean; 90 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.8 MiB/s wr, 112 op/s 2024-04-26T21:24:30.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:30 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:30.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:30 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:32.850 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:32 smithi120 ceph-mon[32741]: pgmap v313: 65 pgs: 65 active+clean; 90 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 96 op/s 2024-04-26T21:24:32.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:32 smithi084 ceph-mon[25539]: pgmap v313: 65 pgs: 65 active+clean; 90 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 96 op/s 2024-04-26T21:24:33.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:33 smithi084 ceph-mon[25539]: Standby manager daemon smithi120.zjaduj restarted 2024-04-26T21:24:33.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:33 smithi084 ceph-mon[25539]: Standby manager daemon smithi120.zjaduj started 2024-04-26T21:24:33.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:33 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.zjaduj/crt"}]: dispatch 2024-04-26T21:24:33.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:33 smithi120 ceph-mon[32741]: Standby manager daemon smithi120.zjaduj restarted 2024-04-26T21:24:33.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:33 smithi120 ceph-mon[32741]: Standby manager daemon smithi120.zjaduj started 2024-04-26T21:24:33.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:33 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.zjaduj/crt"}]: dispatch 2024-04-26T21:24:34.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:34 smithi084 ceph-mon[25539]: pgmap v314: 65 pgs: 65 active+clean; 102 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 134 op/s 2024-04-26T21:24:34.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:34 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:24:34.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:34 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.zjaduj/key"}]: dispatch 2024-04-26T21:24:34.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:34 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:24:34.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:34 smithi084 ceph-mon[25539]: mgrmap e20: smithi084.gyasul(active, since 9m), standbys: smithi120.zjaduj 2024-04-26T21:24:34.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:34 smithi120 ceph-mon[32741]: pgmap v314: 65 pgs: 65 active+clean; 102 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 134 op/s 2024-04-26T21:24:34.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:34 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:24:34.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:34 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.zjaduj/key"}]: dispatch 2024-04-26T21:24:34.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:34 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:24:34.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:34 smithi120 ceph-mon[32741]: mgrmap e20: smithi084.gyasul(active, since 9m), standbys: smithi120.zjaduj 2024-04-26T21:24:36.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:36.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:36.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:24:36.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:24:36.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:36.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:24:36.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr fail", "who": "smithi084.gyasul"}]: dispatch 2024-04-26T21:24:36.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: Activating manager daemon smithi120.zjaduj 2024-04-26T21:24:36.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: osdmap e46: 6 total, 6 up, 6 in 2024-04-26T21:24:36.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "mgr fail", "who": "smithi084.gyasul"}]': finished 2024-04-26T21:24:36.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: mgrmap e21: smithi120.zjaduj(active, starting, since 0.0195581s) 2024-04-26T21:24:36.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-04-26T21:24:36.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:24:36.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.hbjunw"}]: dispatch 2024-04-26T21:24:36.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.rtrqtr"}]: dispatch 2024-04-26T21:24:36.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.qnkxcn"}]: dispatch 2024-04-26T21:24:36.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.ufqfoh"}]: dispatch 2024-04-26T21:24:36.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mgr metadata", "who": "smithi120.zjaduj", "id": "smithi120.zjaduj"}]: dispatch 2024-04-26T21:24:36.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:24:36.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:24:36.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:24:36.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:24:36.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:24:36.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:24:36.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T21:24:36.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T21:24:36.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T21:24:36.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: Manager daemon smithi120.zjaduj is now available 2024-04-26T21:24:36.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:24:36.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:24:36.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi120.zjaduj/mirror_snapshot_schedule"}]: dispatch 2024-04-26T21:24:36.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi120.zjaduj/mirror_snapshot_schedule"}]: dispatch 2024-04-26T21:24:36.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi120.zjaduj/trash_purge_schedule"}]: dispatch 2024-04-26T21:24:36.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:36 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi120.zjaduj/trash_purge_schedule"}]: dispatch 2024-04-26T21:24:36.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:36.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:36.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:24:36.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:24:36.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' 2024-04-26T21:24:36.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:24:36.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr fail", "who": "smithi084.gyasul"}]: dispatch 2024-04-26T21:24:36.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: Activating manager daemon smithi120.zjaduj 2024-04-26T21:24:36.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: osdmap e46: 6 total, 6 up, 6 in 2024-04-26T21:24:36.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14212 172.21.15.84:0/1107586132' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "mgr fail", "who": "smithi084.gyasul"}]': finished 2024-04-26T21:24:36.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: mgrmap e21: smithi120.zjaduj(active, starting, since 0.0195581s) 2024-04-26T21:24:36.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-04-26T21:24:36.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:24:36.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.hbjunw"}]: dispatch 2024-04-26T21:24:36.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.rtrqtr"}]: dispatch 2024-04-26T21:24:36.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.qnkxcn"}]: dispatch 2024-04-26T21:24:36.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.ufqfoh"}]: dispatch 2024-04-26T21:24:36.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mgr metadata", "who": "smithi120.zjaduj", "id": "smithi120.zjaduj"}]: dispatch 2024-04-26T21:24:36.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:24:36.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:24:36.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:24:36.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:24:36.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:24:36.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:24:36.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T21:24:36.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T21:24:36.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T21:24:36.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: Manager daemon smithi120.zjaduj is now available 2024-04-26T21:24:36.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:24:36.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:24:36.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi120.zjaduj/mirror_snapshot_schedule"}]: dispatch 2024-04-26T21:24:36.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi120.zjaduj/mirror_snapshot_schedule"}]: dispatch 2024-04-26T21:24:36.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi120.zjaduj/trash_purge_schedule"}]: dispatch 2024-04-26T21:24:36.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:36 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi120.zjaduj/trash_purge_schedule"}]: dispatch 2024-04-26T21:24:37.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:37 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:37.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:37 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:37.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:37 smithi084 ceph-mon[25539]: Deploying cephadm binary to smithi120 2024-04-26T21:24:37.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:37 smithi084 ceph-mon[25539]: Deploying cephadm binary to smithi084 2024-04-26T21:24:37.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:37 smithi084 ceph-mon[25539]: mgrmap e22: smithi120.zjaduj(active, since 1.01666s) 2024-04-26T21:24:37.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:37 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:37.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:37 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:37.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:37 smithi120 ceph-mon[32741]: Deploying cephadm binary to smithi120 2024-04-26T21:24:37.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:37 smithi120 ceph-mon[32741]: Deploying cephadm binary to smithi084 2024-04-26T21:24:37.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:37 smithi120 ceph-mon[32741]: mgrmap e22: smithi120.zjaduj(active, since 1.01666s) 2024-04-26T21:24:38.567 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:38 smithi084 ceph-mon[25539]: pgmap v3: 65 pgs: 65 active+clean; 106 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:24:38.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:38 smithi120 ceph-mon[32741]: pgmap v3: 65 pgs: 65 active+clean; 106 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:24:39.382 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:39 smithi084 ceph-mon[25539]: pgmap v4: 65 pgs: 65 active+clean; 106 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:24:39.382 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:39 smithi084 ceph-mon[25539]: [26/Apr/2024:21:24:37] ENGINE Bus STARTING 2024-04-26T21:24:39.382 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:39 smithi084 ceph-mon[25539]: [26/Apr/2024:21:24:37] ENGINE Serving on https://172.21.15.120:7150 2024-04-26T21:24:39.382 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:39 smithi084 ceph-mon[25539]: [26/Apr/2024:21:24:37] ENGINE Serving on http://172.21.15.120:8765 2024-04-26T21:24:39.382 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:39 smithi084 ceph-mon[25539]: [26/Apr/2024:21:24:37] ENGINE Bus STARTED 2024-04-26T21:24:39.382 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:39 smithi084 ceph-mon[25539]: mgrmap e23: smithi120.zjaduj(active, since 3s) 2024-04-26T21:24:39.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:39 smithi120 ceph-mon[32741]: pgmap v4: 65 pgs: 65 active+clean; 106 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:24:39.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:39 smithi120 ceph-mon[32741]: [26/Apr/2024:21:24:37] ENGINE Bus STARTING 2024-04-26T21:24:39.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:39 smithi120 ceph-mon[32741]: [26/Apr/2024:21:24:37] ENGINE Serving on https://172.21.15.120:7150 2024-04-26T21:24:39.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:39 smithi120 ceph-mon[32741]: [26/Apr/2024:21:24:37] ENGINE Serving on http://172.21.15.120:8765 2024-04-26T21:24:39.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:39 smithi120 ceph-mon[32741]: [26/Apr/2024:21:24:37] ENGINE Bus STARTED 2024-04-26T21:24:39.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:39 smithi120 ceph-mon[32741]: mgrmap e23: smithi120.zjaduj(active, since 3s) 2024-04-26T21:24:41.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:41 smithi084 ceph-mon[25539]: pgmap v5: 65 pgs: 65 active+clean; 106 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:24:41.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:41 smithi084 ceph-mon[25539]: mgrmap e24: smithi120.zjaduj(active, since 4s) 2024-04-26T21:24:41.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:41 smithi120 ceph-mon[32741]: pgmap v5: 65 pgs: 65 active+clean; 106 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:24:41.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:41 smithi120 ceph-mon[32741]: mgrmap e24: smithi120.zjaduj(active, since 4s) 2024-04-26T21:24:43.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:43 smithi084 ceph-mon[25539]: pgmap v6: 65 pgs: 65 active+clean; 109 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 784 KiB/s wr, 93 op/s 2024-04-26T21:24:43.676 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:43 smithi120 ceph-mon[32741]: pgmap v6: 65 pgs: 65 active+clean; 109 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 784 KiB/s wr, 93 op/s 2024-04-26T21:24:43.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.869+0000 7fd0d6a00700 1 -- 172.21.15.84:0/1158750546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fcc10 msgr2=0x7fd0d00fd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:43.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.869+0000 7fd0d6a00700 1 --2- 172.21.15.84:0/1158750546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fcc10 0x7fd0d00fd020 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4004880 tx=0x7fd0c4009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:43.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.870+0000 7fd0d6a00700 1 -- 172.21.15.84:0/1158750546 shutdown_connections 2024-04-26T21:24:43.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.870+0000 7fd0d6a00700 1 --2- 172.21.15.84:0/1158750546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0d00fdec0 0x7fd0d00fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:43.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.870+0000 7fd0d6a00700 1 --2- 172.21.15.84:0/1158750546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fcc10 0x7fd0d00fd020 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:43.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.870+0000 7fd0d6a00700 1 -- 172.21.15.84:0/1158750546 >> 172.21.15.84:0/1158750546 conn(0x7fd0d00f83b0 msgr2=0x7fd0d00fa7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:43.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.870+0000 7fd0d6a00700 1 -- 172.21.15.84:0/1158750546 shutdown_connections 2024-04-26T21:24:43.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.870+0000 7fd0d6a00700 1 -- 172.21.15.84:0/1158750546 wait complete. 2024-04-26T21:24:43.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.871+0000 7fd0d6a00700 1 Processor -- start 2024-04-26T21:24:43.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.871+0000 7fd0d6a00700 1 -- start start 2024-04-26T21:24:43.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.871+0000 7fd0d6a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fcc10 0x7fd0d010fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:43.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.871+0000 7fd0d6a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0d00fdec0 0x7fd0d010ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:43.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.871+0000 7fd0d6a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d0110590 con 0x7fd0d00fcc10 2024-04-26T21:24:43.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.871+0000 7fd0d6a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d0110de0 con 0x7fd0d00fdec0 2024-04-26T21:24:43.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.872+0000 7fd0d5600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fcc10 0x7fd0d010fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:43.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.872+0000 7fd0d5600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fcc10 0x7fd0d010fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51624/0 (socket says 172.21.15.84:51624) 2024-04-26T21:24:43.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.872+0000 7fd0d5600700 1 -- 172.21.15.84:0/819958873 learned_addr learned my addr 172.21.15.84:0/819958873 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:24:43.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.872+0000 7fd0d4c00700 1 --2- 172.21.15.84:0/819958873 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0d00fdec0 0x7fd0d010ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:43.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.872+0000 7fd0d5600700 1 -- 172.21.15.84:0/819958873 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0d00fdec0 msgr2=0x7fd0d010ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:43.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.872+0000 7fd0d5600700 1 --2- 172.21.15.84:0/819958873 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0d00fdec0 0x7fd0d010ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:43.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.872+0000 7fd0d5600700 1 -- 172.21.15.84:0/819958873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c4005040 con 0x7fd0d00fcc10 2024-04-26T21:24:43.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.873+0000 7fd0d5600700 1 --2- 172.21.15.84:0/819958873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fcc10 0x7fd0d010fa50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4008cd0 tx=0x7fd0c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:43.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.873+0000 7fd0cd600700 1 -- 172.21.15.84:0/819958873 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0c400e030 con 0x7fd0d00fcc10 2024-04-26T21:24:43.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.873+0000 7fd0cd600700 1 -- 172.21.15.84:0/819958873 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd0c4013e60 con 0x7fd0d00fcc10 2024-04-26T21:24:43.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.873+0000 7fd0cd600700 1 -- 172.21.15.84:0/819958873 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0c40123c0 con 0x7fd0d00fcc10 2024-04-26T21:24:43.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.873+0000 7fd0d6a00700 1 -- 172.21.15.84:0/819958873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d0111060 con 0x7fd0d00fcc10 2024-04-26T21:24:43.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.873+0000 7fd0d6a00700 1 -- 172.21.15.84:0/819958873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d01115a0 con 0x7fd0d00fcc10 2024-04-26T21:24:43.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.875+0000 7fd0d6a00700 1 -- 172.21.15.84:0/819958873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d0101850 con 0x7fd0d00fcc10 2024-04-26T21:24:43.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.875+0000 7fd0cd600700 1 -- 172.21.15.84:0/819958873 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) v1 ==== 46568+0+0 (secure 0 0 0) 0x7fd0c401c400 con 0x7fd0d00fcc10 2024-04-26T21:24:43.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.876+0000 7fd0cd600700 1 --2- 172.21.15.84:0/819958873 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fd0b8039480 0x7fd0b803b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:43.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.876+0000 7fd0cd600700 1 -- 172.21.15.84:0/819958873 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fd0c404ebb0 con 0x7fd0d00fcc10 2024-04-26T21:24:43.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.877+0000 7fd0d4c00700 1 --2- 172.21.15.84:0/819958873 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fd0b8039480 0x7fd0b803b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:43.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.878+0000 7fd0d4c00700 1 --2- 172.21.15.84:0/819958873 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fd0b8039480 0x7fd0b803b930 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009b80 tx=0x7fd0bc00b040 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:43.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:43.884+0000 7fd0cd600700 1 -- 172.21.15.84:0/819958873 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fd0c401b770 con 0x7fd0d00fcc10 2024-04-26T21:24:44.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.174+0000 7fd0d6a00700 1 -- 172.21.15.84:0/819958873 --> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0d0111880 con 0x7fd0b8039480 2024-04-26T21:24:44.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.179+0000 7fd0cd600700 1 -- 172.21.15.84:0/819958873 <== mgr.14662 v2:172.21.15.120:6828/3773295163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fd0d0111880 con 0x7fd0b8039480 2024-04-26T21:24:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.183+0000 7fd0d6a00700 1 -- 172.21.15.84:0/819958873 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fd0b8039480 msgr2=0x7fd0b803b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.183+0000 7fd0d6a00700 1 --2- 172.21.15.84:0/819958873 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fd0b8039480 0x7fd0b803b930 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009b80 tx=0x7fd0bc00b040 comp rx=0 tx=0).stop 2024-04-26T21:24:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.183+0000 7fd0d6a00700 1 -- 172.21.15.84:0/819958873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fcc10 msgr2=0x7fd0d010fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.183+0000 7fd0d6a00700 1 --2- 172.21.15.84:0/819958873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fcc10 0x7fd0d010fa50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4008cd0 tx=0x7fd0c4009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.183+0000 7fd0d6a00700 1 -- 172.21.15.84:0/819958873 shutdown_connections 2024-04-26T21:24:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.183+0000 7fd0d6a00700 1 --2- 172.21.15.84:0/819958873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fcc10 0x7fd0d010fa50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.183+0000 7fd0d6a00700 1 --2- 172.21.15.84:0/819958873 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fd0b8039480 0x7fd0b803b930 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.183+0000 7fd0d6a00700 1 --2- 172.21.15.84:0/819958873 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0d00fdec0 0x7fd0d010ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.183+0000 7fd0d6a00700 1 -- 172.21.15.84:0/819958873 >> 172.21.15.84:0/819958873 conn(0x7fd0d00f83b0 msgr2=0x7fd0d00f9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:44.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.184+0000 7fd0d6a00700 1 -- 172.21.15.84:0/819958873 shutdown_connections 2024-04-26T21:24:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.184+0000 7fd0d6a00700 1 -- 172.21.15.84:0/819958873 wait complete. 2024-04-26T21:24:44.203 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:24:44.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.364+0000 7f7763400700 1 -- 172.21.15.84:0/1132184439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f775c0ffee0 msgr2=0x7f775c102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:44.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.364+0000 7f7763400700 1 --2- 172.21.15.84:0/1132184439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f775c0ffee0 0x7f775c102300 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7748004940 tx=0x7f7748009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:44.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.364+0000 7f7763400700 1 -- 172.21.15.84:0/1132184439 shutdown_connections 2024-04-26T21:24:44.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.364+0000 7f7763400700 1 --2- 172.21.15.84:0/1132184439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f775c0ffee0 0x7f775c102300 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:44.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.364+0000 7f7763400700 1 --2- 172.21.15.84:0/1132184439 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f775c0662c0 0x7f775c0ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:44.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.364+0000 7f7763400700 1 -- 172.21.15.84:0/1132184439 >> 172.21.15.84:0/1132184439 conn(0x7f775c0f7430 msgr2=0x7f775c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:44.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.364+0000 7f7763400700 1 -- 172.21.15.84:0/1132184439 shutdown_connections 2024-04-26T21:24:44.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.364+0000 7f7763400700 1 -- 172.21.15.84:0/1132184439 wait complete. 2024-04-26T21:24:44.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.365+0000 7f7763400700 1 Processor -- start 2024-04-26T21:24:44.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.365+0000 7f7763400700 1 -- start start 2024-04-26T21:24:44.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.365+0000 7f7763400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f775c0662c0 0x7f775c10fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:44.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.365+0000 7f7763400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f775c0ffee0 0x7f775c110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:44.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.366+0000 7f7763400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775c110790 con 0x7f775c0ffee0 2024-04-26T21:24:44.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.366+0000 7f7763400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775c110fe0 con 0x7f775c0662c0 2024-04-26T21:24:44.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.366+0000 7f775be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f775c0ffee0 0x7f775c110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:44.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.366+0000 7f775be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f775c0ffee0 0x7f775c110190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51642/0 (socket says 172.21.15.84:51642) 2024-04-26T21:24:44.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.366+0000 7f775be00700 1 -- 172.21.15.84:0/1032334291 learned_addr learned my addr 172.21.15.84:0/1032334291 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:24:44.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.366+0000 7f7760a00700 1 --2- 172.21.15.84:0/1032334291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f775c0662c0 0x7f775c10fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:44.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.367+0000 7f775be00700 1 -- 172.21.15.84:0/1032334291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f775c0662c0 msgr2=0x7f775c10fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:44.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.367+0000 7f775be00700 1 --2- 172.21.15.84:0/1032334291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f775c0662c0 0x7f775c10fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:44.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.367+0000 7f775be00700 1 -- 172.21.15.84:0/1032334291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7748005040 con 0x7f775c0ffee0 2024-04-26T21:24:44.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.367+0000 7f775be00700 1 --2- 172.21.15.84:0/1032334291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f775c0ffee0 0x7f775c110190 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f774800b3b0 tx=0x7f7748009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:44.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.368+0000 7f7758c00700 1 -- 172.21.15.84:0/1032334291 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f774800e040 con 0x7f775c0ffee0 2024-04-26T21:24:44.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.368+0000 7f7763400700 1 -- 172.21.15.84:0/1032334291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775c111260 con 0x7f775c0ffee0 2024-04-26T21:24:44.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.368+0000 7f7758c00700 1 -- 172.21.15.84:0/1032334291 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7748004290 con 0x7f775c0ffee0 2024-04-26T21:24:44.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.368+0000 7f7758c00700 1 -- 172.21.15.84:0/1032334291 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f774801c3f0 con 0x7f775c0ffee0 2024-04-26T21:24:44.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.368+0000 7f7763400700 1 -- 172.21.15.84:0/1032334291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f775c1117a0 con 0x7f775c0ffee0 2024-04-26T21:24:44.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.369+0000 7f7763400700 1 -- 172.21.15.84:0/1032334291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f775c0f8f60 con 0x7f775c0ffee0 2024-04-26T21:24:44.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.370+0000 7f7758c00700 1 -- 172.21.15.84:0/1032334291 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) v1 ==== 46568+0+0 (secure 0 0 0) 0x7f774800bbf0 con 0x7f775c0ffee0 2024-04-26T21:24:44.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.371+0000 7f7758c00700 1 --2- 172.21.15.84:0/1032334291 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f7744039480 0x7f774403b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:44.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.371+0000 7f7758c00700 1 -- 172.21.15.84:0/1032334291 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f774804e4e0 con 0x7f775c0ffee0 2024-04-26T21:24:44.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.372+0000 7f7760a00700 1 --2- 172.21.15.84:0/1032334291 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f7744039480 0x7f774403b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:44.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.374+0000 7f7760a00700 1 --2- 172.21.15.84:0/1032334291 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f7744039480 0x7f774403b930 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f775c066000 tx=0x7f775000b040 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:44.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.377+0000 7f7758c00700 1 -- 172.21.15.84:0/1032334291 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f7748023300 con 0x7f775c0ffee0 2024-04-26T21:24:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.681+0000 7f7763400700 1 -- 172.21.15.84:0/1032334291 --> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f775c111ad0 con 0x7f7744039480 2024-04-26T21:24:44.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.683+0000 7f7758c00700 1 -- 172.21.15.84:0/1032334291 <== mgr.14662 v2:172.21.15.120:6828/3773295163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f775c111ad0 con 0x7f7744039480 2024-04-26T21:24:44.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.687+0000 7f7763400700 1 -- 172.21.15.84:0/1032334291 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f7744039480 msgr2=0x7f774403b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:44.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.687+0000 7f7763400700 1 --2- 172.21.15.84:0/1032334291 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f7744039480 0x7f774403b930 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f775c066000 tx=0x7f775000b040 comp rx=0 tx=0).stop 2024-04-26T21:24:44.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.687+0000 7f7763400700 1 -- 172.21.15.84:0/1032334291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f775c0ffee0 msgr2=0x7f775c110190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:44.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.687+0000 7f7763400700 1 --2- 172.21.15.84:0/1032334291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f775c0ffee0 0x7f775c110190 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f774800b3b0 tx=0x7f7748009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:44.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.688+0000 7f7763400700 1 -- 172.21.15.84:0/1032334291 shutdown_connections 2024-04-26T21:24:44.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.688+0000 7f7763400700 1 --2- 172.21.15.84:0/1032334291 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f7744039480 0x7f774403b930 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:44.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.688+0000 7f7763400700 1 --2- 172.21.15.84:0/1032334291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f775c0662c0 0x7f775c10fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:44.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.688+0000 7f7763400700 1 --2- 172.21.15.84:0/1032334291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f775c0ffee0 0x7f775c110190 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:44.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.688+0000 7f7763400700 1 -- 172.21.15.84:0/1032334291 >> 172.21.15.84:0/1032334291 conn(0x7f775c0f7430 msgr2=0x7f775c0fbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:44.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.689+0000 7f7763400700 1 -- 172.21.15.84:0/1032334291 shutdown_connections 2024-04-26T21:24:44.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.689+0000 7f7763400700 1 -- 172.21.15.84:0/1032334291 wait complete. 2024-04-26T21:24:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.866+0000 7faa15400700 1 -- 172.21.15.84:0/3304920482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa100fcf10 msgr2=0x7faa100fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.866+0000 7faa15400700 1 --2- 172.21.15.84:0/3304920482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa100fcf10 0x7faa100fd320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faa00004940 tx=0x7faa00009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.866+0000 7faa15400700 1 -- 172.21.15.84:0/3304920482 shutdown_connections 2024-04-26T21:24:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.866+0000 7faa15400700 1 --2- 172.21.15.84:0/3304920482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa100fe080 0x7faa100fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.866+0000 7faa15400700 1 --2- 172.21.15.84:0/3304920482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa100fcf10 0x7faa100fd320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.866+0000 7faa15400700 1 -- 172.21.15.84:0/3304920482 >> 172.21.15.84:0/3304920482 conn(0x7faa100f8560 msgr2=0x7faa100fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.866+0000 7faa15400700 1 -- 172.21.15.84:0/3304920482 shutdown_connections 2024-04-26T21:24:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.867+0000 7faa15400700 1 -- 172.21.15.84:0/3304920482 wait complete. 2024-04-26T21:24:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.869+0000 7faa15400700 1 Processor -- start 2024-04-26T21:24:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.869+0000 7faa15400700 1 -- start start 2024-04-26T21:24:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.870+0000 7faa15400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa100fcf10 0x7faa10071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.870+0000 7faa15400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa100fe080 0x7faa100702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.870+0000 7faa15400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa10070860 con 0x7faa100fe080 2024-04-26T21:24:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.870+0000 7faa15400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa100709d0 con 0x7faa100fcf10 2024-04-26T21:24:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.870+0000 7faa0de00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa100fe080 0x7faa100702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.870+0000 7faa0de00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa100fe080 0x7faa100702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51658/0 (socket says 172.21.15.84:51658) 2024-04-26T21:24:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.870+0000 7faa0de00700 1 -- 172.21.15.84:0/3865249033 learned_addr learned my addr 172.21.15.84:0/3865249033 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:24:44.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.870+0000 7faa0e800700 1 --2- 172.21.15.84:0/3865249033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa100fcf10 0x7faa10071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:44.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.871+0000 7faa0e800700 1 -- 172.21.15.84:0/3865249033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa100fe080 msgr2=0x7faa100702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:44.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.871+0000 7faa0e800700 1 --2- 172.21.15.84:0/3865249033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa100fe080 0x7faa100702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.871+0000 7faa0e800700 1 -- 172.21.15.84:0/3865249033 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa00005040 con 0x7faa100fcf10 2024-04-26T21:24:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.871+0000 7faa0e800700 1 --2- 172.21.15.84:0/3865249033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa100fcf10 0x7faa10071de0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faa0000b0d0 tx=0x7faa00009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.872+0000 7faa06a00700 1 -- 172.21.15.84:0/3865249033 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa0000e070 con 0x7faa100fcf10 2024-04-26T21:24:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.872+0000 7faa15400700 1 -- 172.21.15.84:0/3865249033 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa10070c50 con 0x7faa100fcf10 2024-04-26T21:24:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.872+0000 7faa06a00700 1 -- 172.21.15.84:0/3865249033 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa0000b410 con 0x7faa100fcf10 2024-04-26T21:24:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.872+0000 7faa06a00700 1 -- 172.21.15.84:0/3865249033 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa00012600 con 0x7faa100fcf10 2024-04-26T21:24:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.872+0000 7faa15400700 1 -- 172.21.15.84:0/3865249033 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa101159b0 con 0x7faa100fcf10 2024-04-26T21:24:44.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.874+0000 7faa15400700 1 -- 172.21.15.84:0/3865249033 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1005f5c0 con 0x7faa100fcf10 2024-04-26T21:24:44.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.874+0000 7faa06a00700 1 -- 172.21.15.84:0/3865249033 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 24) v1 ==== 46568+0+0 (secure 0 0 0) 0x7faa00013af0 con 0x7faa100fcf10 2024-04-26T21:24:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.874+0000 7faa06a00700 1 --2- 172.21.15.84:0/3865249033 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fa9f4039480 0x7fa9f403b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.874+0000 7faa06a00700 1 -- 172.21.15.84:0/3865249033 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7faa0004dba0 con 0x7faa100fcf10 2024-04-26T21:24:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.876+0000 7faa0de00700 1 --2- 172.21.15.84:0/3865249033 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fa9f4039480 0x7fa9f403b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:44.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.876+0000 7faa0de00700 1 --2- 172.21.15.84:0/3865249033 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fa9f4039480 0x7fa9f403b930 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc004cc0 tx=0x7fa9fc00b040 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:44.882+0000 7faa06a00700 1 -- 172.21.15.84:0/3865249033 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7faa00012760 con 0x7faa100fcf10 2024-04-26T21:24:45.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.187+0000 7faa15400700 1 -- 172.21.15.84:0/3865249033 --> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faa10102350 con 0x7fa9f4039480 2024-04-26T21:24:45.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.234+0000 7faa06a00700 1 -- 172.21.15.84:0/3865249033 <== mgr.14662 v2:172.21.15.120:6828/3773295163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7faa10102350 con 0x7fa9f4039480 2024-04-26T21:24:45.237 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:24:45.237 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (8m) 2m ago 10m 13.3M - 0.25.0 c8568f914cd2 e17e61753bb1 2024-04-26T21:24:45.237 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (10m) 2m ago 10m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 a111b0ee8187 2024-04-26T21:24:45.237 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (9m) 17s ago 9m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 66f4d21263a1 2024-04-26T21:24:45.237 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (8m) 2m ago 10m 73.9M - 9.4.7 954c08fa6188 67caa0766f89 2024-04-26T21:24:45.237 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (3m) 2m ago 3m 13.3M - 17.2.7-907-g2be3efa9 1c5834633715 485d7884e1d5 2024-04-26T21:24:45.237 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (3m) 2m ago 3m 10.5M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:24:45.237 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (3m) 17s ago 3m 61.4M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:24:45.237 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (3m) 17s ago 3m 11.3M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:24:45.238 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:9283 running (12m) 2m ago 12m 480M - 17.2.7-907-g2be3efa9 1c5834633715 98242b12bd6c 2024-04-26T21:24:45.238 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283 running (24s) 17s ago 9m 46.7M - 19.0.0-3306-gbc612ffb 55dc54019ad8 1a0fbef33353 2024-04-26T21:24:45.238 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (12m) 2m ago 12m 44.7M 2048M 17.2.7-907-g2be3efa9 1c5834633715 24cc2d798ea7 2024-04-26T21:24:45.238 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (8m) 17s ago 8m 36.1M 2048M 17.2.7-907-g2be3efa9 1c5834633715 72c786fd622b 2024-04-26T21:24:45.238 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (10m) 2m ago 10m 7470k - 1.5.0 0da6a335fe13 8fdbcc05a9dd 2024-04-26T21:24:45.238 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (9m) 17s ago 9m 7520k - 1.5.0 0da6a335fe13 1b07a56a6ace 2024-04-26T21:24:45.238 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (8m) 2m ago 8m 45.2M 4288M 17.2.7-907-g2be3efa9 1c5834633715 3a2e74d7e51a 2024-04-26T21:24:45.238 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (7m) 2m ago 7m 44.9M 4288M 17.2.7-907-g2be3efa9 1c5834633715 d283a0a93213 2024-04-26T21:24:45.238 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (6m) 2m ago 6m 43.1M 4288M 17.2.7-907-g2be3efa9 1c5834633715 5899468fc5c8 2024-04-26T21:24:45.238 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (6m) 17s ago 6m 64.1M 5312M 17.2.7-907-g2be3efa9 1c5834633715 b8a14c87d730 2024-04-26T21:24:45.238 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (5m) 17s ago 5m 60.5M 5312M 17.2.7-907-g2be3efa9 1c5834633715 4d294df735a3 2024-04-26T21:24:45.238 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (5m) 17s ago 5m 61.2M 5312M 17.2.7-907-g2be3efa9 1c5834633715 9b60997971a8 2024-04-26T21:24:45.238 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (8m) 2m ago 9m 46.1M - 2.43.0 a07b618ecd1d 7b6983aea888 2024-04-26T21:24:45.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.238+0000 7faa15400700 1 -- 172.21.15.84:0/3865249033 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fa9f4039480 msgr2=0x7fa9f403b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:45.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.238+0000 7faa15400700 1 --2- 172.21.15.84:0/3865249033 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fa9f4039480 0x7fa9f403b930 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc004cc0 tx=0x7fa9fc00b040 comp rx=0 tx=0).stop 2024-04-26T21:24:45.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.238+0000 7faa15400700 1 -- 172.21.15.84:0/3865249033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa100fcf10 msgr2=0x7faa10071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:45.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.238+0000 7faa15400700 1 --2- 172.21.15.84:0/3865249033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa100fcf10 0x7faa10071de0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faa0000b0d0 tx=0x7faa00009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:45.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.238+0000 7faa15400700 1 -- 172.21.15.84:0/3865249033 shutdown_connections 2024-04-26T21:24:45.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.238+0000 7faa15400700 1 --2- 172.21.15.84:0/3865249033 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fa9f4039480 0x7fa9f403b930 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:45.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.238+0000 7faa15400700 1 --2- 172.21.15.84:0/3865249033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa100fcf10 0x7faa10071de0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:45.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.238+0000 7faa15400700 1 --2- 172.21.15.84:0/3865249033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa100fe080 0x7faa100702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:45.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.238+0000 7faa15400700 1 -- 172.21.15.84:0/3865249033 >> 172.21.15.84:0/3865249033 conn(0x7faa100f8560 msgr2=0x7faa100f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:45.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.239+0000 7faa15400700 1 -- 172.21.15.84:0/3865249033 shutdown_connections 2024-04-26T21:24:45.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.239+0000 7faa15400700 1 -- 172.21.15.84:0/3865249033 wait complete. 2024-04-26T21:24:45.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.417+0000 7fa494800700 1 -- 172.21.15.84:0/1293953511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa48c066260 msgr2=0x7fa48c0ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:45.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.417+0000 7fa494800700 1 --2- 172.21.15.84:0/1293953511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa48c066260 0x7fa48c0ffa00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa480004940 tx=0x7fa480009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:45.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.417+0000 7fa494800700 1 -- 172.21.15.84:0/1293953511 shutdown_connections 2024-04-26T21:24:45.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.417+0000 7fa494800700 1 --2- 172.21.15.84:0/1293953511 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa48c0fff40 0x7fa48c102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:45.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.417+0000 7fa494800700 1 --2- 172.21.15.84:0/1293953511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa48c066260 0x7fa48c0ffa00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:45.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.417+0000 7fa494800700 1 -- 172.21.15.84:0/1293953511 >> 172.21.15.84:0/1293953511 conn(0x7fa48c0f7430 msgr2=0x7fa48c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:45.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.418+0000 7fa494800700 1 -- 172.21.15.84:0/1293953511 shutdown_connections 2024-04-26T21:24:45.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.418+0000 7fa494800700 1 -- 172.21.15.84:0/1293953511 wait complete. 2024-04-26T21:24:45.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.419+0000 7fa494800700 1 Processor -- start 2024-04-26T21:24:45.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.419+0000 7fa494800700 1 -- start start 2024-04-26T21:24:45.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.419+0000 7fa494800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa48c066260 0x7fa48c10fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:45.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.419+0000 7fa494800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa48c0fff40 0x7fa48c1101c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:45.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.419+0000 7fa494800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c110850 con 0x7fa48c0fff40 2024-04-26T21:24:45.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.419+0000 7fa494800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c110ff0 con 0x7fa48c066260 2024-04-26T21:24:45.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.420+0000 7fa491400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa48c0fff40 0x7fa48c1101c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:45.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.420+0000 7fa491400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa48c0fff40 0x7fa48c1101c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51682/0 (socket says 172.21.15.84:51682) 2024-04-26T21:24:45.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.420+0000 7fa491400700 1 -- 172.21.15.84:0/708052091 learned_addr learned my addr 172.21.15.84:0/708052091 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:24:45.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.420+0000 7fa491e00700 1 --2- 172.21.15.84:0/708052091 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa48c066260 0x7fa48c10fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:45.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.420+0000 7fa491400700 1 -- 172.21.15.84:0/708052091 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa48c066260 msgr2=0x7fa48c10fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:45.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.420+0000 7fa491400700 1 --2- 172.21.15.84:0/708052091 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa48c066260 0x7fa48c10fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:45.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.420+0000 7fa491400700 1 -- 172.21.15.84:0/708052091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa480005040 con 0x7fa48c0fff40 2024-04-26T21:24:45.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.420+0000 7fa491e00700 1 --2- 172.21.15.84:0/708052091 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa48c066260 0x7fa48c10fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:24:45.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.421+0000 7fa491400700 1 --2- 172.21.15.84:0/708052091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa48c0fff40 0x7fa48c1101c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00b790 tx=0x7fa47c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:45.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.421+0000 7fa486000700 1 -- 172.21.15.84:0/708052091 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa47c00f770 con 0x7fa48c0fff40 2024-04-26T21:24:45.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.421+0000 7fa486000700 1 -- 172.21.15.84:0/708052091 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa47c00fda0 con 0x7fa48c0fff40 2024-04-26T21:24:45.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.421+0000 7fa494800700 1 -- 172.21.15.84:0/708052091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48c1112d0 con 0x7fa48c0fff40 2024-04-26T21:24:45.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.421+0000 7fa494800700 1 -- 172.21.15.84:0/708052091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48c111890 con 0x7fa48c0fff40 2024-04-26T21:24:45.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.421+0000 7fa486000700 1 -- 172.21.15.84:0/708052091 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa47c00d310 con 0x7fa48c0fff40 2024-04-26T21:24:45.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.422+0000 7fa494800700 1 -- 172.21.15.84:0/708052091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4700052e0 con 0x7fa48c0fff40 2024-04-26T21:24:45.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.423+0000 7fa486000700 1 -- 172.21.15.84:0/708052091 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) v1 ==== 46568+0+0 (secure 0 0 0) 0x7fa47c00d5b0 con 0x7fa48c0fff40 2024-04-26T21:24:45.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.423+0000 7fa486000700 1 --2- 172.21.15.84:0/708052091 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fa474039480 0x7fa47403b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:45.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.423+0000 7fa486000700 1 -- 172.21.15.84:0/708052091 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fa47c04d000 con 0x7fa48c0fff40 2024-04-26T21:24:45.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.424+0000 7fa491e00700 1 --2- 172.21.15.84:0/708052091 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fa474039480 0x7fa47403b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:45.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.425+0000 7fa491e00700 1 --2- 172.21.15.84:0/708052091 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fa474039480 0x7fa47403b930 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa48000b3b0 tx=0x7fa480009e30 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:45.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.429+0000 7fa486000700 1 -- 172.21.15.84:0/708052091 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fa47c020250 con 0x7fa48c0fff40 2024-04-26T21:24:45.485 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:45 smithi084 ceph-mon[25539]: pgmap v7: 65 pgs: 65 active+clean; 109 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 560 KiB/s wr, 66 op/s 2024-04-26T21:24:45.486 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:45 smithi084 ceph-mon[25539]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:24:45.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:45 smithi120 ceph-mon[32741]: pgmap v7: 65 pgs: 65 active+clean; 109 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 560 KiB/s wr, 66 op/s 2024-04-26T21:24:45.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:45 smithi120 ceph-mon[32741]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:24:45.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.788+0000 7fa494800700 1 -- 172.21.15.84:0/708052091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa470005860 con 0x7fa48c0fff40 2024-04-26T21:24:45.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.790+0000 7fa486000700 1 -- 172.21.15.84:0/708052091 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fa47c00eb70 con 0x7fa48c0fff40 2024-04-26T21:24:45.791 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:24:45.791 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:24:45.791 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-26T21:24:45.791 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:24:45.791 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:24:45.791 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 1 2024-04-26T21:24:45.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:24:45.792 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:24:45.792 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-26T21:24:45.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:24:45.792 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:24:45.792 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-26T21:24:45.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:24:45.792 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:24:45.792 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 12, 2024-04-26T21:24:45.792 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 1 2024-04-26T21:24:45.792 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:24:45.792 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:24:45.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.792+0000 7fa494800700 1 -- 172.21.15.84:0/708052091 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fa474039480 msgr2=0x7fa47403b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:45.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.792+0000 7fa494800700 1 --2- 172.21.15.84:0/708052091 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fa474039480 0x7fa47403b930 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa48000b3b0 tx=0x7fa480009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:45.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.792+0000 7fa494800700 1 -- 172.21.15.84:0/708052091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa48c0fff40 msgr2=0x7fa48c1101c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:45.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.792+0000 7fa494800700 1 --2- 172.21.15.84:0/708052091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa48c0fff40 0x7fa48c1101c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00b790 tx=0x7fa47c009250 comp rx=0 tx=0).stop 2024-04-26T21:24:45.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.793+0000 7fa494800700 1 -- 172.21.15.84:0/708052091 shutdown_connections 2024-04-26T21:24:45.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.793+0000 7fa494800700 1 --2- 172.21.15.84:0/708052091 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fa474039480 0x7fa47403b930 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:45.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.793+0000 7fa494800700 1 --2- 172.21.15.84:0/708052091 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa48c066260 0x7fa48c10fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:45.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.793+0000 7fa494800700 1 --2- 172.21.15.84:0/708052091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa48c0fff40 0x7fa48c1101c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:45.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.793+0000 7fa494800700 1 -- 172.21.15.84:0/708052091 >> 172.21.15.84:0/708052091 conn(0x7fa48c0f7430 msgr2=0x7fa48c0fba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:45.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.793+0000 7fa494800700 1 -- 172.21.15.84:0/708052091 shutdown_connections 2024-04-26T21:24:45.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.793+0000 7fa494800700 1 -- 172.21.15.84:0/708052091 wait complete. 2024-04-26T21:24:45.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.959+0000 7f150da00700 1 -- 172.21.15.84:0/3132817599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15080fbcb0 msgr2=0x7f15080fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:45.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.959+0000 7f150da00700 1 --2- 172.21.15.84:0/3132817599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15080fbcb0 0x7f15080fc0c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f14f8004c20 tx=0x7f14f8009ca0 comp rx=0 tx=0).stop 2024-04-26T21:24:45.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.959+0000 7f150da00700 1 -- 172.21.15.84:0/3132817599 shutdown_connections 2024-04-26T21:24:45.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.959+0000 7f150da00700 1 --2- 172.21.15.84:0/3132817599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15080fcf60 0x7f15080fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:45.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.959+0000 7f150da00700 1 --2- 172.21.15.84:0/3132817599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15080fbcb0 0x7f15080fc0c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:45.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.959+0000 7f150da00700 1 -- 172.21.15.84:0/3132817599 >> 172.21.15.84:0/3132817599 conn(0x7f15080f7430 msgr2=0x7f15080f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:45.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.959+0000 7f150da00700 1 -- 172.21.15.84:0/3132817599 shutdown_connections 2024-04-26T21:24:45.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.960+0000 7f150da00700 1 -- 172.21.15.84:0/3132817599 wait complete. 2024-04-26T21:24:45.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.962+0000 7f150da00700 1 Processor -- start 2024-04-26T21:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.962+0000 7f150da00700 1 -- start start 2024-04-26T21:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.962+0000 7f150da00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15080fbcb0 0x7f1508105f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.963+0000 7f150da00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15080fcf60 0x7f1508106480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.963+0000 7f150da00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1508106ad0 con 0x7f15080fbcb0 2024-04-26T21:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.963+0000 7f150da00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15081072d0 con 0x7f15080fcf60 2024-04-26T21:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.963+0000 7f14ffe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15080fcf60 0x7f1508106480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.963+0000 7f14ffe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15080fcf60 0x7f1508106480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:46044/0 (socket says 172.21.15.84:46044) 2024-04-26T21:24:45.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.963+0000 7f14ffe00700 1 -- 172.21.15.84:0/1534617986 learned_addr learned my addr 172.21.15.84:0/1534617986 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:24:45.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.964+0000 7f14ffe00700 1 -- 172.21.15.84:0/1534617986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15080fbcb0 msgr2=0x7f1508105f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:45.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.964+0000 7f14ffe00700 1 --2- 172.21.15.84:0/1534617986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15080fbcb0 0x7f1508105f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:45.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.964+0000 7f14ffe00700 1 -- 172.21.15.84:0/1534617986 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f80048f0 con 0x7f15080fcf60 2024-04-26T21:24:45.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.964+0000 7f14ffe00700 1 --2- 172.21.15.84:0/1534617986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15080fcf60 0x7f1508106480 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f14f00041d0 tx=0x7f14f000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:45.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.964+0000 7f14fea00700 1 -- 172.21.15.84:0/1534617986 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14f0007cc0 con 0x7f15080fcf60 2024-04-26T21:24:45.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.965+0000 7f14fea00700 1 -- 172.21.15.84:0/1534617986 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f14f000f040 con 0x7f15080fcf60 2024-04-26T21:24:45.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.965+0000 7f14fea00700 1 -- 172.21.15.84:0/1534617986 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14f000cb50 con 0x7f15080fcf60 2024-04-26T21:24:45.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.965+0000 7f150da00700 1 -- 172.21.15.84:0/1534617986 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15081074d0 con 0x7f15080fcf60 2024-04-26T21:24:45.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.965+0000 7f150da00700 1 -- 172.21.15.84:0/1534617986 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1508107a60 con 0x7f15080fcf60 2024-04-26T21:24:45.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.966+0000 7f14fea00700 1 -- 172.21.15.84:0/1534617986 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 24) v1 ==== 46568+0+0 (secure 0 0 0) 0x7f14f000ccb0 con 0x7f15080fcf60 2024-04-26T21:24:45.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.967+0000 7f150da00700 1 -- 172.21.15.84:0/1534617986 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15081018f0 con 0x7f15080fcf60 2024-04-26T21:24:45.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.967+0000 7f14fea00700 1 --2- 172.21.15.84:0/1534617986 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f14ec039470 0x7f14ec03b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:45.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.967+0000 7f14fea00700 1 -- 172.21.15.84:0/1534617986 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f14f004de60 con 0x7f15080fcf60 2024-04-26T21:24:45.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.968+0000 7f1506a00700 1 --2- 172.21.15.84:0/1534617986 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f14ec039470 0x7f14ec03b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:45.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.969+0000 7f1506a00700 1 --2- 172.21.15.84:0/1534617986 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f14ec039470 0x7f14ec03b920 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f14f8015040 tx=0x7f14f8009ca0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:45.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:45.978+0000 7f14fea00700 1 -- 172.21.15.84:0/1534617986 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f14f0052070 con 0x7f15080fcf60 2024-04-26T21:24:46.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.273+0000 7f14fea00700 1 -- 172.21.15.84:0/1534617986 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f14f0014bc0 con 0x7f15080fcf60 2024-04-26T21:24:46.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.334+0000 7f150da00700 1 -- 172.21.15.84:0/1534617986 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f150804bf50 con 0x7f15080fcf60 2024-04-26T21:24:46.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.335+0000 7f14fea00700 1 -- 172.21.15.84:0/1534617986 <== mon.1 v2:172.21.15.120:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1835 (secure 0 0 0) 0x7f150804bf50 con 0x7f15080fcf60 2024-04-26T21:24:46.337 INFO:teuthology.orchestra.run.smithi084.stdout:e12 2024-04-26T21:24:46.337 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:24:46.337 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:24:46.337 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:24:46.337 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:24:46.338 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:24:46.338 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:24:46.338 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 12 2024-04-26T21:24:46.338 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:24:46.338 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:24:46.338 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:23:53.700069+0000 2024-04-26T21:24:46.338 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:24:46.338 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:24:46.338 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:24:46.338 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:24:46.338 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:24:46.338 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:24:46.338 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:24:46.338 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:24:46.338 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:24:46.339 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:24:46.339 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:24:46.339 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456,1=24231} 2024-04-26T21:24:46.339 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:24:46.339 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:24:46.339 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:24:46.339 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:24:46.339 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:24:46.339 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:24:46.339 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:24:46.339 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:24:46.339 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:24:46.339 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:24:46.339 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:24:46.339 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:24:46.339 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:24:46.340 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:24:46.340 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:24:46.340 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:24:46.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.339+0000 7f150da00700 1 -- 172.21.15.84:0/1534617986 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f14ec039470 msgr2=0x7f14ec03b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:46.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.339+0000 7f150da00700 1 --2- 172.21.15.84:0/1534617986 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f14ec039470 0x7f14ec03b920 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f14f8015040 tx=0x7f14f8009ca0 comp rx=0 tx=0).stop 2024-04-26T21:24:46.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.339+0000 7f150da00700 1 -- 172.21.15.84:0/1534617986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15080fcf60 msgr2=0x7f1508106480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:46.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.339+0000 7f150da00700 1 --2- 172.21.15.84:0/1534617986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15080fcf60 0x7f1508106480 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f14f00041d0 tx=0x7f14f000b040 comp rx=0 tx=0).stop 2024-04-26T21:24:46.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.339+0000 7f150da00700 1 -- 172.21.15.84:0/1534617986 shutdown_connections 2024-04-26T21:24:46.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.339+0000 7f150da00700 1 --2- 172.21.15.84:0/1534617986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15080fbcb0 0x7f1508105f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:46.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.339+0000 7f150da00700 1 --2- 172.21.15.84:0/1534617986 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f14ec039470 0x7f14ec03b920 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:46.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.339+0000 7f150da00700 1 --2- 172.21.15.84:0/1534617986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15080fcf60 0x7f1508106480 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:46.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.339+0000 7f150da00700 1 -- 172.21.15.84:0/1534617986 >> 172.21.15.84:0/1534617986 conn(0x7f15080f7430 msgr2=0x7f1508065ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:46.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.340+0000 7f150da00700 1 -- 172.21.15.84:0/1534617986 shutdown_connections 2024-04-26T21:24:46.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.340+0000 7f150da00700 1 -- 172.21.15.84:0/1534617986 wait complete. 2024-04-26T21:24:46.342 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 12 2024-04-26T21:24:46.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:46 smithi084 ceph-mon[25539]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:24:46.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:46 smithi084 ceph-mon[25539]: from='client.24399 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:24:46.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:46 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/708052091' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:24:46.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:46 smithi084 ceph-mon[25539]: Standby manager daemon smithi084.gyasul started 2024-04-26T21:24:46.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:46 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.84:0/2339699123' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi084.gyasul/crt"}]: dispatch 2024-04-26T21:24:46.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:46 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.84:0/2339699123' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:24:46.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:46 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.84:0/2339699123' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi084.gyasul/key"}]: dispatch 2024-04-26T21:24:46.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:46 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.84:0/2339699123' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:24:46.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.496+0000 7f8102200700 1 -- 172.21.15.84:0/3463666922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80fc100060 msgr2=0x7f80fc1004d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:46.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.496+0000 7f8102200700 1 --2- 172.21.15.84:0/3463666922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80fc100060 0x7f80fc1004d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f80e8004940 tx=0x7f80e8009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:46.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.496+0000 7f8102200700 1 -- 172.21.15.84:0/3463666922 shutdown_connections 2024-04-26T21:24:46.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.496+0000 7f8102200700 1 --2- 172.21.15.84:0/3463666922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80fc100060 0x7f80fc1004d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:46.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.496+0000 7f8102200700 1 --2- 172.21.15.84:0/3463666922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80fc0fee60 0x7f80fc0ff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:46.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.496+0000 7f8102200700 1 -- 172.21.15.84:0/3463666922 >> 172.21.15.84:0/3463666922 conn(0x7f80fc0fa730 msgr2=0x7f80fc0fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:46.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.496+0000 7f8102200700 1 -- 172.21.15.84:0/3463666922 shutdown_connections 2024-04-26T21:24:46.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.496+0000 7f8102200700 1 -- 172.21.15.84:0/3463666922 wait complete. 2024-04-26T21:24:46.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.497+0000 7f8102200700 1 Processor -- start 2024-04-26T21:24:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.497+0000 7f8102200700 1 -- start start 2024-04-26T21:24:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.497+0000 7f8102200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80fc0fee60 0x7f80fc10fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.497+0000 7f8102200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80fc100060 0x7f80fc10ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.497+0000 7f8102200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc110550 con 0x7f80fc100060 2024-04-26T21:24:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.497+0000 7f8102200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc110da0 con 0x7f80fc0fee60 2024-04-26T21:24:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.498+0000 7f80fbe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80fc100060 0x7f80fc10ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.498+0000 7f80fbe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80fc100060 0x7f80fc10ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51708/0 (socket says 172.21.15.84:51708) 2024-04-26T21:24:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.498+0000 7f80fbe00700 1 -- 172.21.15.84:0/1613940695 learned_addr learned my addr 172.21.15.84:0/1613940695 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:24:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.498+0000 7f8100e00700 1 --2- 172.21.15.84:0/1613940695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80fc0fee60 0x7f80fc10fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.498+0000 7f80fbe00700 1 -- 172.21.15.84:0/1613940695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80fc0fee60 msgr2=0x7f80fc10fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.498+0000 7f80fbe00700 1 --2- 172.21.15.84:0/1613940695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80fc0fee60 0x7f80fc10fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.498+0000 7f80fbe00700 1 -- 172.21.15.84:0/1613940695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e8005040 con 0x7f80fc100060 2024-04-26T21:24:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.498+0000 7f80fbe00700 1 --2- 172.21.15.84:0/1613940695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80fc100060 0x7f80fc10ff50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f80e800b3b0 tx=0x7f80e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.498+0000 7f80f8c00700 1 -- 172.21.15.84:0/1613940695 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80e800e040 con 0x7f80fc100060 2024-04-26T21:24:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.499+0000 7f80f8c00700 1 -- 172.21.15.84:0/1613940695 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f80e8004290 con 0x7f80fc100060 2024-04-26T21:24:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.499+0000 7f8102200700 1 -- 172.21.15.84:0/1613940695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80fc111020 con 0x7f80fc100060 2024-04-26T21:24:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.499+0000 7f80f8c00700 1 -- 172.21.15.84:0/1613940695 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80e801c630 con 0x7f80fc100060 2024-04-26T21:24:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.499+0000 7f8102200700 1 -- 172.21.15.84:0/1613940695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80fc111560 con 0x7f80fc100060 2024-04-26T21:24:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.500+0000 7f8102200700 1 -- 172.21.15.84:0/1613940695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80fc0fe230 con 0x7f80fc100060 2024-04-26T21:24:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.501+0000 7f80f8c00700 1 -- 172.21.15.84:0/1613940695 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f80e800bbf0 con 0x7f80fc100060 2024-04-26T21:24:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.501+0000 7f80f8c00700 1 --2- 172.21.15.84:0/1613940695 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f80e406bd00 0x7f80e406e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.502+0000 7f80f8c00700 1 -- 172.21.15.84:0/1613940695 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f80e808be40 con 0x7f80fc100060 2024-04-26T21:24:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.502+0000 7f8100e00700 1 --2- 172.21.15.84:0/1613940695 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f80e406bd00 0x7f80e406e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.503+0000 7f8100e00700 1 --2- 172.21.15.84:0/1613940695 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f80e406bd00 0x7f80e406e1b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0ffbd0 tx=0x7f80f0009040 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.506+0000 7f80f8c00700 1 -- 172.21.15.84:0/1613940695 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f80e8059020 con 0x7f80fc100060 2024-04-26T21:24:46.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:46 smithi120 ceph-mon[32741]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:24:46.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:46 smithi120 ceph-mon[32741]: from='client.24399 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:24:46.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:46 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/708052091' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:24:46.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:46 smithi120 ceph-mon[32741]: Standby manager daemon smithi084.gyasul started 2024-04-26T21:24:46.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:46 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.84:0/2339699123' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi084.gyasul/crt"}]: dispatch 2024-04-26T21:24:46.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:46 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.84:0/2339699123' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:24:46.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:46 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.84:0/2339699123' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi084.gyasul/key"}]: dispatch 2024-04-26T21:24:46.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:46 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.84:0/2339699123' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:24:46.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.776+0000 7f8102200700 1 -- 172.21.15.84:0/1613940695 --> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f80fc111870 con 0x7f80e406bd00 2024-04-26T21:24:46.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.780+0000 7f80f8c00700 1 -- 172.21.15.84:0/1613940695 <== mgr.14662 v2:172.21.15.120:6828/3773295163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f80fc111870 con 0x7f80e406bd00 2024-04-26T21:24:46.782 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:24:46.782 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:24:46.782 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:24:46.782 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:24:46.782 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [], 2024-04-26T21:24:46.782 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "1/21 daemons upgraded", 2024-04-26T21:24:46.783 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2024-04-26T21:24:46.783 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:24:46.783 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:24:46.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.783+0000 7f8102200700 1 -- 172.21.15.84:0/1613940695 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f80e406bd00 msgr2=0x7f80e406e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:46.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.783+0000 7f8102200700 1 --2- 172.21.15.84:0/1613940695 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f80e406bd00 0x7f80e406e1b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0ffbd0 tx=0x7f80f0009040 comp rx=0 tx=0).stop 2024-04-26T21:24:46.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.783+0000 7f8102200700 1 -- 172.21.15.84:0/1613940695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80fc100060 msgr2=0x7f80fc10ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:46.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.783+0000 7f8102200700 1 --2- 172.21.15.84:0/1613940695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80fc100060 0x7f80fc10ff50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f80e800b3b0 tx=0x7f80e8009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:46.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.783+0000 7f8102200700 1 -- 172.21.15.84:0/1613940695 shutdown_connections 2024-04-26T21:24:46.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.783+0000 7f8102200700 1 --2- 172.21.15.84:0/1613940695 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f80e406bd00 0x7f80e406e1b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:46.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.783+0000 7f8102200700 1 --2- 172.21.15.84:0/1613940695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80fc0fee60 0x7f80fc10fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:46.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.783+0000 7f8102200700 1 --2- 172.21.15.84:0/1613940695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80fc100060 0x7f80fc10ff50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:46.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.783+0000 7f8102200700 1 -- 172.21.15.84:0/1613940695 >> 172.21.15.84:0/1613940695 conn(0x7f80fc0fa730 msgr2=0x7f80fc0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:46.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.783+0000 7f8102200700 1 -- 172.21.15.84:0/1613940695 shutdown_connections 2024-04-26T21:24:46.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.783+0000 7f8102200700 1 -- 172.21.15.84:0/1613940695 wait complete. 2024-04-26T21:24:46.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.936+0000 7f5858200700 1 -- 172.21.15.84:0/150627407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5850071e40 msgr2=0x7f5850070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:46.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.936+0000 7f5858200700 1 --2- 172.21.15.84:0/150627407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5850071e40 0x7f5850070350 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5844004940 tx=0x7f5844009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:46.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.936+0000 7f5858200700 1 -- 172.21.15.84:0/150627407 shutdown_connections 2024-04-26T21:24:46.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.936+0000 7f5858200700 1 --2- 172.21.15.84:0/150627407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5850070890 0x7f5850070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:46.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.936+0000 7f5858200700 1 --2- 172.21.15.84:0/150627407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5850071e40 0x7f5850070350 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:46.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.936+0000 7f5858200700 1 -- 172.21.15.84:0/150627407 >> 172.21.15.84:0/150627407 conn(0x7f58500f8560 msgr2=0x7f58500fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:46.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.936+0000 7f5858200700 1 -- 172.21.15.84:0/150627407 shutdown_connections 2024-04-26T21:24:46.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.937+0000 7f5858200700 1 -- 172.21.15.84:0/150627407 wait complete. 2024-04-26T21:24:46.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.937+0000 7f5858200700 1 Processor -- start 2024-04-26T21:24:46.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.938+0000 7f5858200700 1 -- start start 2024-04-26T21:24:46.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.938+0000 7f5858200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5850070890 0x7f585010fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:46.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.938+0000 7f5858200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5850071e40 0x7f5850110120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:46.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.938+0000 7f5858200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5850110720 con 0x7f5850071e40 2024-04-26T21:24:46.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.938+0000 7f5858200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5850110f20 con 0x7f5850070890 2024-04-26T21:24:46.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.938+0000 7f5854e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5850071e40 0x7f5850110120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:46.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.938+0000 7f5854e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5850071e40 0x7f5850110120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51720/0 (socket says 172.21.15.84:51720) 2024-04-26T21:24:46.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.938+0000 7f5854e00700 1 -- 172.21.15.84:0/1234305344 learned_addr learned my addr 172.21.15.84:0/1234305344 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:24:46.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.938+0000 7f5855800700 1 --2- 172.21.15.84:0/1234305344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5850070890 0x7f585010fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:46.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.939+0000 7f5854e00700 1 -- 172.21.15.84:0/1234305344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5850070890 msgr2=0x7f585010fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:46.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.939+0000 7f5854e00700 1 --2- 172.21.15.84:0/1234305344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5850070890 0x7f585010fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:46.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.939+0000 7f5854e00700 1 -- 172.21.15.84:0/1234305344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5844005040 con 0x7f5850071e40 2024-04-26T21:24:46.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.939+0000 7f5854e00700 1 --2- 172.21.15.84:0/1234305344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5850071e40 0x7f5850110120 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f583c00eb40 tx=0x7f583c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:46.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.939+0000 7f584d600700 1 -- 172.21.15.84:0/1234305344 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f583c007cc0 con 0x7f5850071e40 2024-04-26T21:24:46.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.940+0000 7f584d600700 1 -- 172.21.15.84:0/1234305344 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f583c00f040 con 0x7f5850071e40 2024-04-26T21:24:46.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.940+0000 7f5858200700 1 -- 172.21.15.84:0/1234305344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58501111a0 con 0x7f5850071e40 2024-04-26T21:24:46.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.940+0000 7f5858200700 1 -- 172.21.15.84:0/1234305344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58501116e0 con 0x7f5850071e40 2024-04-26T21:24:46.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.940+0000 7f584d600700 1 -- 172.21.15.84:0/1234305344 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f583c00ca10 con 0x7f5850071e40 2024-04-26T21:24:46.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.941+0000 7f5858200700 1 -- 172.21.15.84:0/1234305344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585005f5c0 con 0x7f5850071e40 2024-04-26T21:24:46.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.943+0000 7f584d600700 1 -- 172.21.15.84:0/1234305344 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f583c00cc80 con 0x7f5850071e40 2024-04-26T21:24:46.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.944+0000 7f584d600700 1 --2- 172.21.15.84:0/1234305344 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f583806bcf0 0x7f583806e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:24:46.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.944+0000 7f584d600700 1 -- 172.21.15.84:0/1234305344 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f583c08a980 con 0x7f5850071e40 2024-04-26T21:24:46.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.945+0000 7f5855800700 1 --2- 172.21.15.84:0/1234305344 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f583806bcf0 0x7f583806e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:24:46.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.946+0000 7f5855800700 1 --2- 172.21.15.84:0/1234305344 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f583806bcf0 0x7f583806e1a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5844013870 tx=0x7f5844009e30 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:24:46.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:46.948+0000 7f584d600700 1 -- 172.21.15.84:0/1234305344 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f583c057ad0 con 0x7f5850071e40 2024-04-26T21:24:47.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:47.358+0000 7f5858200700 1 -- 172.21.15.84:0/1234305344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f585004bed0 con 0x7f5850071e40 2024-04-26T21:24:47.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:47.359+0000 7f584d600700 1 -- 172.21.15.84:0/1234305344 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f583c057660 con 0x7f5850071e40 2024-04-26T21:24:47.361 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:24:47.361 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:24:47.361 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:24:47.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:47.362+0000 7f5858200700 1 -- 172.21.15.84:0/1234305344 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f583806bcf0 msgr2=0x7f583806e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:47.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:47.362+0000 7f5858200700 1 --2- 172.21.15.84:0/1234305344 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f583806bcf0 0x7f583806e1a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5844013870 tx=0x7f5844009e30 comp rx=0 tx=0).stop 2024-04-26T21:24:47.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:47.362+0000 7f5858200700 1 -- 172.21.15.84:0/1234305344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5850071e40 msgr2=0x7f5850110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:24:47.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:47.362+0000 7f5858200700 1 --2- 172.21.15.84:0/1234305344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5850071e40 0x7f5850110120 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f583c00eb40 tx=0x7f583c00b040 comp rx=0 tx=0).stop 2024-04-26T21:24:47.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:47.362+0000 7f5858200700 1 -- 172.21.15.84:0/1234305344 shutdown_connections 2024-04-26T21:24:47.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:47.362+0000 7f5858200700 1 --2- 172.21.15.84:0/1234305344 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f583806bcf0 0x7f583806e1a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:47.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:47.362+0000 7f5858200700 1 --2- 172.21.15.84:0/1234305344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5850070890 0x7f585010fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:47.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:47.362+0000 7f5858200700 1 --2- 172.21.15.84:0/1234305344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5850071e40 0x7f5850110120 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:24:47.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:47.362+0000 7f5858200700 1 -- 172.21.15.84:0/1234305344 >> 172.21.15.84:0/1234305344 conn(0x7f58500f8560 msgr2=0x7f58500f9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:24:47.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:47.362+0000 7f5858200700 1 -- 172.21.15.84:0/1234305344 shutdown_connections 2024-04-26T21:24:47.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:24:47.363+0000 7f5858200700 1 -- 172.21.15.84:0/1234305344 wait complete. 2024-04-26T21:24:47.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:47 smithi084 ceph-mon[25539]: pgmap v8: 65 pgs: 65 active+clean; 109 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 435 KiB/s wr, 51 op/s 2024-04-26T21:24:47.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:47 smithi084 ceph-mon[25539]: mgrmap e25: smithi120.zjaduj(active, since 10s), standbys: smithi084.gyasul 2024-04-26T21:24:47.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:47 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mgr metadata", "who": "smithi084.gyasul", "id": "smithi084.gyasul"}]: dispatch 2024-04-26T21:24:47.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:47 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1534617986' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:24:47.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:47 smithi120 ceph-mon[32741]: pgmap v8: 65 pgs: 65 active+clean; 109 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 435 KiB/s wr, 51 op/s 2024-04-26T21:24:47.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:47 smithi120 ceph-mon[32741]: mgrmap e25: smithi120.zjaduj(active, since 10s), standbys: smithi084.gyasul 2024-04-26T21:24:47.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:47 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mgr metadata", "who": "smithi084.gyasul", "id": "smithi084.gyasul"}]: dispatch 2024-04-26T21:24:47.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:47 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/1534617986' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:24:48.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:48 smithi084 ceph-mon[25539]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:24:48.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:48 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1234305344' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:24:48.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:48 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:48.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:48 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:48.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:48 smithi120 ceph-mon[32741]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:24:48.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:48 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/1234305344' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:24:48.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:48 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:48.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:48 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:49.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:49 smithi084 ceph-mon[25539]: pgmap v9: 65 pgs: 65 active+clean; 117 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 1.1 MiB/s wr, 85 op/s 2024-04-26T21:24:49.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:49 smithi120 ceph-mon[32741]: pgmap v9: 65 pgs: 65 active+clean; 117 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 1.1 MiB/s wr, 85 op/s 2024-04-26T21:24:51.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:51 smithi084 ceph-mon[25539]: pgmap v10: 65 pgs: 65 active+clean; 117 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 1012 KiB/s wr, 78 op/s 2024-04-26T21:24:51.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:51 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:51.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:51 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:51.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:51 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:51.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:51 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:51.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:51 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:24:51.426 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:51 smithi120 ceph-mon[32741]: pgmap v10: 65 pgs: 65 active+clean; 117 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 1012 KiB/s wr, 78 op/s 2024-04-26T21:24:51.426 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:51 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:51.426 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:51 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:51.426 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:51 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:51.426 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:51 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:51.426 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:51 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:24:53.633 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:53 smithi120 ceph-mon[32741]: pgmap v11: 65 pgs: 65 active+clean; 126 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 1.7 MiB/s wr, 114 op/s 2024-04-26T21:24:53.633 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:53 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:53.633 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:53 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:53.633 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:53 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:53.633 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:53 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:53.633 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:53 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:53.633 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:53 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:53.633 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:53 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:53.633 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:53 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:53.633 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:53 smithi120 ceph-mon[32741]: Adjusting osd_memory_target on smithi084 to 1557M 2024-04-26T21:24:53.633 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:53 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:53.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:53 smithi084 ceph-mon[25539]: pgmap v11: 65 pgs: 65 active+clean; 126 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 1.7 MiB/s wr, 114 op/s 2024-04-26T21:24:53.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:53 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:53.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:53 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:53.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:53 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:53.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:53 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:53.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:53 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:53.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:53 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:53.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:53 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:53.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:53 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:53.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:53 smithi084 ceph-mon[25539]: Adjusting osd_memory_target on smithi084 to 1557M 2024-04-26T21:24:53.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:53 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:55.562 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:55 smithi120 ceph-mon[32741]: pgmap v12: 65 pgs: 65 active+clean; 126 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 75 op/s 2024-04-26T21:24:55.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:55 smithi084 ceph-mon[25539]: pgmap v12: 65 pgs: 65 active+clean; 126 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 75 op/s 2024-04-26T21:24:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:57 smithi120 ceph-mon[32741]: pgmap v13: 65 pgs: 65 active+clean; 126 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 75 op/s 2024-04-26T21:24:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:57 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:57 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:57 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:57.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:57 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:57.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:57 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:57.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:57 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:57.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:57 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:57.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:57 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:57.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:57 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:57.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:57 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:24:57.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:57 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:24:57.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:57 smithi084 ceph-mon[25539]: pgmap v13: 65 pgs: 65 active+clean; 126 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 75 op/s 2024-04-26T21:24:57.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:57 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:57.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:57 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:57.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:57 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:57.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:57 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:57.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:57 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:57.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:57 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:57.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:57 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:57.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:57 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:57.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:57 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:24:57.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:57 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:24:57.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:57 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:24:58.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:58 smithi084 ceph-mon[25539]: Adjusting osd_memory_target on smithi120 to 2581M 2024-04-26T21:24:58.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:58 smithi084 ceph-mon[25539]: Updating smithi084:/etc/ceph/ceph.conf 2024-04-26T21:24:58.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:58 smithi084 ceph-mon[25539]: Updating smithi120:/etc/ceph/ceph.conf 2024-04-26T21:24:58.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:58 smithi084 ceph-mon[25539]: Updating smithi120:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:24:58.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:58 smithi084 ceph-mon[25539]: Updating smithi084:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:24:58.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:58 smithi120 ceph-mon[32741]: Adjusting osd_memory_target on smithi120 to 2581M 2024-04-26T21:24:58.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:58 smithi120 ceph-mon[32741]: Updating smithi084:/etc/ceph/ceph.conf 2024-04-26T21:24:58.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:58 smithi120 ceph-mon[32741]: Updating smithi120:/etc/ceph/ceph.conf 2024-04-26T21:24:58.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:58 smithi120 ceph-mon[32741]: Updating smithi120:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:24:58.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:58 smithi120 ceph-mon[32741]: Updating smithi084:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:24:59.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:59 smithi084 ceph-mon[25539]: pgmap v14: 65 pgs: 65 active+clean; 136 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.3 MiB/s wr, 112 op/s 2024-04-26T21:24:59.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:59 smithi084 ceph-mon[25539]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:24:59.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:24:59 smithi084 ceph-mon[25539]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:24:59.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:59 smithi120 ceph-mon[32741]: pgmap v14: 65 pgs: 65 active+clean; 136 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.3 MiB/s wr, 112 op/s 2024-04-26T21:24:59.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:59 smithi120 ceph-mon[32741]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:24:59.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:24:59 smithi120 ceph-mon[32741]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:25:00.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:00 smithi084 ceph-mon[25539]: Updating smithi120:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:25:00.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:00 smithi084 ceph-mon[25539]: Updating smithi084:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:25:00.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:00 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:00.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:00 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:00.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:00 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:00.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:00 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:00.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:00 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:00.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:00 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:00.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:00 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:00.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:00 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:00.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:00 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:00.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:00 smithi120 ceph-mon[32741]: Updating smithi120:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:25:00.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:00 smithi120 ceph-mon[32741]: Updating smithi084:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:25:00.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:00 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:00.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:00 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:00.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:00 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:00.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:00 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:00.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:00 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:00.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:00 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:00.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:00 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:00.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:00 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:00.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:00 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:01.783 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:01 smithi084 ceph-mon[25539]: pgmap v15: 65 pgs: 65 active+clean; 136 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 72 op/s 2024-04-26T21:25:01.783 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:01 smithi084 ceph-mon[25539]: Reconfiguring node-exporter.smithi084 (dependencies changed)... 2024-04-26T21:25:01.783 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:01 smithi084 ceph-mon[25539]: Reconfiguring daemon node-exporter.smithi084 on smithi084 2024-04-26T21:25:01.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:01 smithi120 ceph-mon[32741]: pgmap v15: 65 pgs: 65 active+clean; 136 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 72 op/s 2024-04-26T21:25:01.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:01 smithi120 ceph-mon[32741]: Reconfiguring node-exporter.smithi084 (dependencies changed)... 2024-04-26T21:25:01.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:01 smithi120 ceph-mon[32741]: Reconfiguring daemon node-exporter.smithi084 on smithi084 2024-04-26T21:25:02.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:02 smithi084 ceph-mon[25539]: pgmap v16: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.7 MiB/s wr, 163 op/s 2024-04-26T21:25:02.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:02 smithi120 ceph-mon[32741]: pgmap v16: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.7 MiB/s wr, 163 op/s 2024-04-26T21:25:04.516 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:04 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:04.516 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:04 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:04.516 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:04 smithi084 ceph-mon[25539]: Reconfiguring alertmanager.smithi084 (dependencies changed)... 2024-04-26T21:25:04.516 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:04 smithi084 ceph-mon[25539]: Reconfiguring daemon alertmanager.smithi084 on smithi084 2024-04-26T21:25:04.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:04 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:04.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:04 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:04.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:04 smithi120 ceph-mon[32741]: Reconfiguring alertmanager.smithi084 (dependencies changed)... 2024-04-26T21:25:04.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:04 smithi120 ceph-mon[32741]: Reconfiguring daemon alertmanager.smithi084 on smithi084 2024-04-26T21:25:05.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:05 smithi084 ceph-mon[25539]: pgmap v17: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.9 MiB/s wr, 127 op/s 2024-04-26T21:25:05.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:05 smithi120 ceph-mon[32741]: pgmap v17: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.9 MiB/s wr, 127 op/s 2024-04-26T21:25:06.646 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:06 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:25:06.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:06 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:25:07.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:07 smithi120 ceph-mon[32741]: pgmap v18: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.9 MiB/s wr, 127 op/s 2024-04-26T21:25:07.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:07 smithi084 ceph-mon[25539]: pgmap v18: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.9 MiB/s wr, 127 op/s 2024-04-26T21:25:09.614 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:09 smithi084 ceph-mon[25539]: pgmap v19: 65 pgs: 65 active+clean; 158 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.7 MiB/s wr, 169 op/s 2024-04-26T21:25:09.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:09 smithi120 ceph-mon[32741]: pgmap v19: 65 pgs: 65 active+clean; 158 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.7 MiB/s wr, 169 op/s 2024-04-26T21:25:11.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:11 smithi084 ceph-mon[25539]: pgmap v20: 65 pgs: 65 active+clean; 158 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.9 MiB/s wr, 132 op/s 2024-04-26T21:25:11.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:11 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:11.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:11 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:11.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:11 smithi120 ceph-mon[32741]: pgmap v20: 65 pgs: 65 active+clean; 158 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.9 MiB/s wr, 132 op/s 2024-04-26T21:25:11.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:11 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:11.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:11 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:12.584 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:12 smithi084 ceph-mon[25539]: Reconfiguring grafana.smithi084 (dependencies changed)... 2024-04-26T21:25:12.584 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:12 smithi084 ceph-mon[25539]: Reconfiguring daemon grafana.smithi084 on smithi084 2024-04-26T21:25:12.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:12 smithi120 ceph-mon[32741]: Reconfiguring grafana.smithi084 (dependencies changed)... 2024-04-26T21:25:12.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:12 smithi120 ceph-mon[32741]: Reconfiguring daemon grafana.smithi084 on smithi084 2024-04-26T21:25:13.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:13 smithi084 ceph-mon[25539]: pgmap v21: 65 pgs: 65 active+clean; 168 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.7 MiB/s wr, 205 op/s 2024-04-26T21:25:13.675 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:13 smithi120 ceph-mon[32741]: pgmap v21: 65 pgs: 65 active+clean; 168 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.7 MiB/s wr, 205 op/s 2024-04-26T21:25:15.596 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:15 smithi084 ceph-mon[25539]: pgmap v22: 65 pgs: 65 active+clean; 168 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 114 op/s 2024-04-26T21:25:15.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:15 smithi120 ceph-mon[32741]: pgmap v22: 65 pgs: 65 active+clean; 168 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 114 op/s 2024-04-26T21:25:17.587 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:17 smithi084 ceph-mon[25539]: pgmap v23: 65 pgs: 65 active+clean; 168 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 114 op/s 2024-04-26T21:25:17.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.582+0000 7f9915800700 1 -- 172.21.15.84:0/1158053906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9910071ef0 msgr2=0x7f9910070400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:17.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.582+0000 7f9915800700 1 --2- 172.21.15.84:0/1158053906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9910071ef0 0x7f9910070400 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9900004940 tx=0x7f9900009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.583+0000 7f9915800700 1 -- 172.21.15.84:0/1158053906 shutdown_connections 2024-04-26T21:25:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.583+0000 7f9915800700 1 --2- 172.21.15.84:0/1158053906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9910070940 0x7f9910070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.583+0000 7f9915800700 1 --2- 172.21.15.84:0/1158053906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9910071ef0 0x7f9910070400 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.583+0000 7f9915800700 1 -- 172.21.15.84:0/1158053906 >> 172.21.15.84:0/1158053906 conn(0x7f99100f8560 msgr2=0x7f99100fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.583+0000 7f9915800700 1 -- 172.21.15.84:0/1158053906 shutdown_connections 2024-04-26T21:25:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.583+0000 7f9915800700 1 -- 172.21.15.84:0/1158053906 wait complete. 2024-04-26T21:25:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.584+0000 7f9915800700 1 Processor -- start 2024-04-26T21:25:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.584+0000 7f9915800700 1 -- start start 2024-04-26T21:25:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.584+0000 7f9915800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9910070940 0x7f9910067bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.585+0000 7f9915800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9910071ef0 0x7f9910068120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.585+0000 7f9915800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9910068770 con 0x7f9910070940 2024-04-26T21:25:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.585+0000 7f9915800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9910068aa0 con 0x7f9910071ef0 2024-04-26T21:25:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.586+0000 7f990ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9910070940 0x7f9910067bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:17.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.586+0000 7f990e000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9910071ef0 0x7f9910068120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:17.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.586+0000 7f990ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9910070940 0x7f9910067bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33830/0 (socket says 172.21.15.84:33830) 2024-04-26T21:25:17.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.586+0000 7f990ea00700 1 -- 172.21.15.84:0/2113811346 learned_addr learned my addr 172.21.15.84:0/2113811346 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:25:17.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.587+0000 7f990e000700 1 -- 172.21.15.84:0/2113811346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9910070940 msgr2=0x7f9910067bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:17.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.587+0000 7f990e000700 1 --2- 172.21.15.84:0/2113811346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9910070940 0x7f9910067bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:17.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.587+0000 7f990e000700 1 -- 172.21.15.84:0/2113811346 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9900005040 con 0x7f9910071ef0 2024-04-26T21:25:17.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.588+0000 7f990e000700 1 --2- 172.21.15.84:0/2113811346 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9910071ef0 0x7f9910068120 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00c7e0 tx=0x7f98fc0043c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:17.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.588+0000 7f9906a00700 1 -- 172.21.15.84:0/2113811346 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98fc0106f0 con 0x7f9910071ef0 2024-04-26T21:25:17.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.588+0000 7f9906a00700 1 -- 172.21.15.84:0/2113811346 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f98fc010d20 con 0x7f9910071ef0 2024-04-26T21:25:17.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.588+0000 7f9906a00700 1 -- 172.21.15.84:0/2113811346 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98fc0113a0 con 0x7f9910071ef0 2024-04-26T21:25:17.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.589+0000 7f9915800700 1 -- 172.21.15.84:0/2113811346 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9910068d20 con 0x7f9910071ef0 2024-04-26T21:25:17.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.589+0000 7f9915800700 1 -- 172.21.15.84:0/2113811346 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9910069290 con 0x7f9910071ef0 2024-04-26T21:25:17.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.590+0000 7f9915800700 1 -- 172.21.15.84:0/2113811346 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991005f5c0 con 0x7f9910071ef0 2024-04-26T21:25:17.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.592+0000 7f9906a00700 1 -- 172.21.15.84:0/2113811346 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f98fc012400 con 0x7f9910071ef0 2024-04-26T21:25:17.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.594+0000 7f9906a00700 1 --2- 172.21.15.84:0/2113811346 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f98f406bcf0 0x7f98f406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:17.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.594+0000 7f9906a00700 1 -- 172.21.15.84:0/2113811346 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f98fc08add0 con 0x7f9910071ef0 2024-04-26T21:25:17.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.595+0000 7f990ea00700 1 --2- 172.21.15.84:0/2113811346 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f98f406bcf0 0x7f98f406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:17.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.595+0000 7f990ea00700 1 --2- 172.21.15.84:0/2113811346 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f98f406bcf0 0x7f98f406e1a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9900009fd0 tx=0x7f9900009e30 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:17.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.602+0000 7f9906a00700 1 -- 172.21.15.84:0/2113811346 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f98fc0544f0 con 0x7f9910071ef0 2024-04-26T21:25:17.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:17 smithi120 ceph-mon[32741]: pgmap v23: 65 pgs: 65 active+clean; 168 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 114 op/s 2024-04-26T21:25:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.919+0000 7f9915800700 1 -- 172.21.15.84:0/2113811346 --> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9910069680 con 0x7f98f406bcf0 2024-04-26T21:25:17.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.923+0000 7f9906a00700 1 -- 172.21.15.84:0/2113811346 <== mgr.14662 v2:172.21.15.120:6828/3773295163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f9910069680 con 0x7f98f406bcf0 2024-04-26T21:25:17.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.926+0000 7f9915800700 1 -- 172.21.15.84:0/2113811346 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f98f406bcf0 msgr2=0x7f98f406e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:17.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.926+0000 7f9915800700 1 --2- 172.21.15.84:0/2113811346 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f98f406bcf0 0x7f98f406e1a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9900009fd0 tx=0x7f9900009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:17.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.926+0000 7f9915800700 1 -- 172.21.15.84:0/2113811346 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9910071ef0 msgr2=0x7f9910068120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:17.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.926+0000 7f9915800700 1 --2- 172.21.15.84:0/2113811346 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9910071ef0 0x7f9910068120 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00c7e0 tx=0x7f98fc0043c0 comp rx=0 tx=0).stop 2024-04-26T21:25:17.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.926+0000 7f9915800700 1 -- 172.21.15.84:0/2113811346 shutdown_connections 2024-04-26T21:25:17.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.926+0000 7f9915800700 1 --2- 172.21.15.84:0/2113811346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9910070940 0x7f9910067bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:17.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.926+0000 7f9915800700 1 --2- 172.21.15.84:0/2113811346 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f98f406bcf0 0x7f98f406e1a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:17.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.926+0000 7f9915800700 1 --2- 172.21.15.84:0/2113811346 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9910071ef0 0x7f9910068120 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:17.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.926+0000 7f9915800700 1 -- 172.21.15.84:0/2113811346 >> 172.21.15.84:0/2113811346 conn(0x7f99100f8560 msgr2=0x7f99100f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:17.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.926+0000 7f9915800700 1 -- 172.21.15.84:0/2113811346 shutdown_connections 2024-04-26T21:25:17.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:17.926+0000 7f9915800700 1 -- 172.21.15.84:0/2113811346 wait complete. 2024-04-26T21:25:17.944 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:25:18.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.107+0000 7fd7d3800700 1 -- 172.21.15.84:0/4278948076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc0fe080 msgr2=0x7fd7cc0fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:18.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.107+0000 7fd7d3800700 1 --2- 172.21.15.84:0/4278948076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc0fe080 0x7fd7cc0fe4f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8004940 tx=0x7fd7b8009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:18.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.107+0000 7fd7d3800700 1 -- 172.21.15.84:0/4278948076 shutdown_connections 2024-04-26T21:25:18.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.107+0000 7fd7d3800700 1 --2- 172.21.15.84:0/4278948076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc0fe080 0x7fd7cc0fe4f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:18.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.107+0000 7fd7d3800700 1 --2- 172.21.15.84:0/4278948076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7cc0fcf10 0x7fd7cc0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:18.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.108+0000 7fd7d3800700 1 -- 172.21.15.84:0/4278948076 >> 172.21.15.84:0/4278948076 conn(0x7fd7cc0f8560 msgr2=0x7fd7cc0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:18.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.108+0000 7fd7d3800700 1 -- 172.21.15.84:0/4278948076 shutdown_connections 2024-04-26T21:25:18.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.108+0000 7fd7d3800700 1 -- 172.21.15.84:0/4278948076 wait complete. 2024-04-26T21:25:18.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.109+0000 7fd7d3800700 1 Processor -- start 2024-04-26T21:25:18.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.109+0000 7fd7d3800700 1 -- start start 2024-04-26T21:25:18.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.110+0000 7fd7d3800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7cc0fcf10 0x7fd7cc10fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:18.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.110+0000 7fd7d3800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc0fe080 0x7fd7cc1100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:18.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.110+0000 7fd7d3800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc1106b0 con 0x7fd7cc0fe080 2024-04-26T21:25:18.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.110+0000 7fd7d3800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc110f00 con 0x7fd7cc0fcf10 2024-04-26T21:25:18.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.110+0000 7fd7cbe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc0fe080 0x7fd7cc1100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:18.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.110+0000 7fd7cbe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc0fe080 0x7fd7cc1100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33846/0 (socket says 172.21.15.84:33846) 2024-04-26T21:25:18.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.110+0000 7fd7cbe00700 1 -- 172.21.15.84:0/2813502045 learned_addr learned my addr 172.21.15.84:0/2813502045 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:25:18.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.111+0000 7fd7d0e00700 1 --2- 172.21.15.84:0/2813502045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7cc0fcf10 0x7fd7cc10fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:18.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.111+0000 7fd7cbe00700 1 -- 172.21.15.84:0/2813502045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7cc0fcf10 msgr2=0x7fd7cc10fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:18.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.111+0000 7fd7cbe00700 1 --2- 172.21.15.84:0/2813502045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7cc0fcf10 0x7fd7cc10fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:18.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.111+0000 7fd7cbe00700 1 -- 172.21.15.84:0/2813502045 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b8005040 con 0x7fd7cc0fe080 2024-04-26T21:25:18.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.111+0000 7fd7cbe00700 1 --2- 172.21.15.84:0/2813502045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc0fe080 0x7fd7cc1100b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800b0d0 tx=0x7fd7b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:18.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.112+0000 7fd7c8c00700 1 -- 172.21.15.84:0/2813502045 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7b800e070 con 0x7fd7cc0fe080 2024-04-26T21:25:18.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.112+0000 7fd7d3800700 1 -- 172.21.15.84:0/2813502045 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7cc111180 con 0x7fd7cc0fe080 2024-04-26T21:25:18.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.112+0000 7fd7c8c00700 1 -- 172.21.15.84:0/2813502045 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7b800b410 con 0x7fd7cc0fe080 2024-04-26T21:25:18.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.112+0000 7fd7c8c00700 1 -- 172.21.15.84:0/2813502045 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7b8012600 con 0x7fd7cc0fe080 2024-04-26T21:25:18.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.112+0000 7fd7d3800700 1 -- 172.21.15.84:0/2813502045 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7cc1116c0 con 0x7fd7cc0fe080 2024-04-26T21:25:18.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.114+0000 7fd7d3800700 1 -- 172.21.15.84:0/2813502045 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7cc101a10 con 0x7fd7cc0fe080 2024-04-26T21:25:18.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.116+0000 7fd7c8c00700 1 -- 172.21.15.84:0/2813502045 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7fd7b800ba80 con 0x7fd7cc0fe080 2024-04-26T21:25:18.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.118+0000 7fd7c8c00700 1 --2- 172.21.15.84:0/2813502045 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fd7b406bd40 0x7fd7b406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:18.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.118+0000 7fd7c8c00700 1 -- 172.21.15.84:0/2813502045 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fd7b808b7c0 con 0x7fd7cc0fe080 2024-04-26T21:25:18.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.118+0000 7fd7d0e00700 1 --2- 172.21.15.84:0/2813502045 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fd7b406bd40 0x7fd7b406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:18.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.120+0000 7fd7d0e00700 1 --2- 172.21.15.84:0/2813502045 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fd7b406bd40 0x7fd7b406e1f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0004600 tx=0x7fd7c000b040 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:18.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.125+0000 7fd7c8c00700 1 -- 172.21.15.84:0/2813502045 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fd7b8058910 con 0x7fd7cc0fe080 2024-04-26T21:25:18.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.453+0000 7fd7d3800700 1 -- 172.21.15.84:0/2813502045 --> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7cc1119a0 con 0x7fd7b406bd40 2024-04-26T21:25:18.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.455+0000 7fd7c8c00700 1 -- 172.21.15.84:0/2813502045 <== mgr.14662 v2:172.21.15.120:6828/3773295163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fd7cc1119a0 con 0x7fd7b406bd40 2024-04-26T21:25:18.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.459+0000 7fd7d3800700 1 -- 172.21.15.84:0/2813502045 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fd7b406bd40 msgr2=0x7fd7b406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:18.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.459+0000 7fd7d3800700 1 --2- 172.21.15.84:0/2813502045 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fd7b406bd40 0x7fd7b406e1f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0004600 tx=0x7fd7c000b040 comp rx=0 tx=0).stop 2024-04-26T21:25:18.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.459+0000 7fd7d3800700 1 -- 172.21.15.84:0/2813502045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc0fe080 msgr2=0x7fd7cc1100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:18.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.459+0000 7fd7d3800700 1 --2- 172.21.15.84:0/2813502045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc0fe080 0x7fd7cc1100b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800b0d0 tx=0x7fd7b8009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:18.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.459+0000 7fd7d3800700 1 -- 172.21.15.84:0/2813502045 shutdown_connections 2024-04-26T21:25:18.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.459+0000 7fd7d3800700 1 --2- 172.21.15.84:0/2813502045 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fd7b406bd40 0x7fd7b406e1f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:18.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.459+0000 7fd7d3800700 1 --2- 172.21.15.84:0/2813502045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7cc0fcf10 0x7fd7cc10fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:18.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.459+0000 7fd7d3800700 1 --2- 172.21.15.84:0/2813502045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc0fe080 0x7fd7cc1100b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:18.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.459+0000 7fd7d3800700 1 -- 172.21.15.84:0/2813502045 >> 172.21.15.84:0/2813502045 conn(0x7fd7cc0f8560 msgr2=0x7fd7cc0f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:18.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.460+0000 7fd7d3800700 1 -- 172.21.15.84:0/2813502045 shutdown_connections 2024-04-26T21:25:18.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.460+0000 7fd7d3800700 1 -- 172.21.15.84:0/2813502045 wait complete. 2024-04-26T21:25:18.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.668+0000 7fd01e400700 1 -- 172.21.15.84:0/4148020658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd01806fd80 msgr2=0x7fd01806e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:18.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.669+0000 7fd01e400700 1 --2- 172.21.15.84:0/4148020658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd01806fd80 0x7fd01806e5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd008004940 tx=0x7fd008009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:18.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.672+0000 7fd01e400700 1 -- 172.21.15.84:0/4148020658 shutdown_connections 2024-04-26T21:25:18.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.672+0000 7fd01e400700 1 --2- 172.21.15.84:0/4148020658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd01806eb70 0x7fd01806efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:18.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.672+0000 7fd01e400700 1 --2- 172.21.15.84:0/4148020658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd01806fd80 0x7fd01806e5a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.672+0000 7fd01e400700 1 -- 172.21.15.84:0/4148020658 >> 172.21.15.84:0/4148020658 conn(0x7fd01806a360 msgr2=0x7fd01806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.672+0000 7fd01e400700 1 -- 172.21.15.84:0/4148020658 shutdown_connections 2024-04-26T21:25:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.672+0000 7fd01e400700 1 -- 172.21.15.84:0/4148020658 wait complete. 2024-04-26T21:25:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.673+0000 7fd01e400700 1 Processor -- start 2024-04-26T21:25:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.674+0000 7fd01e400700 1 -- start start 2024-04-26T21:25:18.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.674+0000 7fd01e400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd01806eb70 0x7fd018113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:18.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.674+0000 7fd01e400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd01806fd80 0x7fd0181144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:18.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.674+0000 7fd01e400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd018114aa0 con 0x7fd01806fd80 2024-04-26T21:25:18.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.674+0000 7fd01e400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd018114c10 con 0x7fd01806eb70 2024-04-26T21:25:18.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.675+0000 7fd017400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd01806eb70 0x7fd018113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:18.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.675+0000 7fd017400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd01806eb70 0x7fd018113f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:44068/0 (socket says 172.21.15.84:44068) 2024-04-26T21:25:18.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.675+0000 7fd017400700 1 -- 172.21.15.84:0/3650206441 learned_addr learned my addr 172.21.15.84:0/3650206441 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:25:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.675+0000 7fd017400700 1 -- 172.21.15.84:0/3650206441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd01806fd80 msgr2=0x7fd0181144a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.675+0000 7fd017400700 1 --2- 172.21.15.84:0/3650206441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd01806fd80 0x7fd0181144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.675+0000 7fd017400700 1 -- 172.21.15.84:0/3650206441 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd008005040 con 0x7fd01806eb70 2024-04-26T21:25:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.676+0000 7fd017400700 1 --2- 172.21.15.84:0/3650206441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd01806eb70 0x7fd018113f60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd00800b970 tx=0x7fd008009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.677+0000 7fd00f400700 1 -- 172.21.15.84:0/3650206441 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd00800e040 con 0x7fd01806eb70 2024-04-26T21:25:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.677+0000 7fd00f400700 1 -- 172.21.15.84:0/3650206441 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd008004290 con 0x7fd01806eb70 2024-04-26T21:25:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.677+0000 7fd00f400700 1 -- 172.21.15.84:0/3650206441 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd00801c630 con 0x7fd01806eb70 2024-04-26T21:25:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.678+0000 7fd01e400700 1 -- 172.21.15.84:0/3650206441 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd018119610 con 0x7fd01806eb70 2024-04-26T21:25:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.678+0000 7fd01e400700 1 -- 172.21.15.84:0/3650206441 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd018119bd0 con 0x7fd01806eb70 2024-04-26T21:25:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.679+0000 7fd01e400700 1 -- 172.21.15.84:0/3650206441 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd018109860 con 0x7fd01806eb70 2024-04-26T21:25:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.681+0000 7fd00f400700 1 -- 172.21.15.84:0/3650206441 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7fd00800bbf0 con 0x7fd01806eb70 2024-04-26T21:25:18.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.682+0000 7fd00f400700 1 --2- 172.21.15.84:0/3650206441 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fcffc06bd00 0x7fcffc06e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:18.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.682+0000 7fd00f400700 1 -- 172.21.15.84:0/3650206441 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fd00808c880 con 0x7fd01806eb70 2024-04-26T21:25:18.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.683+0000 7fd016a00700 1 --2- 172.21.15.84:0/3650206441 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fcffc06bd00 0x7fcffc06e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:18.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.684+0000 7fd016a00700 1 --2- 172.21.15.84:0/3650206441 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fcffc06bd00 0x7fcffc06e1b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd004004d00 tx=0x7fd004009ce0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:18.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:18.692+0000 7fd00f400700 1 -- 172.21.15.84:0/3650206441 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fd0080599a0 con 0x7fd01806eb70 2024-04-26T21:25:19.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.112+0000 7fd01e400700 1 -- 172.21.15.84:0/3650206441 --> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd01802b3b0 con 0x7fcffc06bd00 2024-04-26T21:25:19.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.134+0000 7fd00f400700 1 -- 172.21.15.84:0/3650206441 <== mgr.14662 v2:172.21.15.120:6828/3773295163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd01802b3b0 con 0x7fcffc06bd00 2024-04-26T21:25:19.137 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:25:19.137 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 starting - - - - 2024-04-26T21:25:19.137 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (11m) 29s ago 11m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 a111b0ee8187 2024-04-26T21:25:19.137 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (9m) 31s ago 9m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 66f4d21263a1 2024-04-26T21:25:19.138 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 starting - - - - 2024-04-26T21:25:19.138 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (4m) 29s ago 4m 85.8M - 17.2.7-907-g2be3efa9 1c5834633715 485d7884e1d5 2024-04-26T21:25:19.138 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (3m) 29s ago 3m 12.0M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:25:19.138 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (3m) 31s ago 3m 88.6M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:25:19.138 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (3m) 31s ago 3m 11.9M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:25:19.138 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:9283 running (12m) 29s ago 12m 330M - 17.2.7-907-g2be3efa9 1c5834633715 98242b12bd6c 2024-04-26T21:25:19.139 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283 running (57s) 31s ago 9m 488M - 19.0.0-3306-gbc612ffb 55dc54019ad8 1a0fbef33353 2024-04-26T21:25:19.139 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (12m) 29s ago 12m 50.7M 2048M 17.2.7-907-g2be3efa9 1c5834633715 24cc2d798ea7 2024-04-26T21:25:19.139 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (9m) 31s ago 9m 38.9M 2048M 17.2.7-907-g2be3efa9 1c5834633715 72c786fd622b 2024-04-26T21:25:19.139 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 starting - - - - 2024-04-26T21:25:19.139 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (9m) 31s ago 9m 7612k - 1.5.0 0da6a335fe13 1b07a56a6ace 2024-04-26T21:25:19.140 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (8m) 29s ago 8m 75.6M 1557M 17.2.7-907-g2be3efa9 1c5834633715 3a2e74d7e51a 2024-04-26T21:25:19.140 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (8m) 29s ago 8m 79.3M 1557M 17.2.7-907-g2be3efa9 1c5834633715 d283a0a93213 2024-04-26T21:25:19.140 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (7m) 29s ago 7m 62.5M 1557M 17.2.7-907-g2be3efa9 1c5834633715 5899468fc5c8 2024-04-26T21:25:19.140 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (6m) 31s ago 6m 74.6M 2581M 17.2.7-907-g2be3efa9 1c5834633715 b8a14c87d730 2024-04-26T21:25:19.140 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (6m) 31s ago 6m 70.1M 2581M 17.2.7-907-g2be3efa9 1c5834633715 4d294df735a3 2024-04-26T21:25:19.140 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (5m) 31s ago 5m 67.5M 2581M 17.2.7-907-g2be3efa9 1c5834633715 9b60997971a8 2024-04-26T21:25:19.141 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (8m) 29s ago 10m 52.2M - 2.43.0 a07b618ecd1d 7b6983aea888 2024-04-26T21:25:19.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.139+0000 7fd01e400700 1 -- 172.21.15.84:0/3650206441 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fcffc06bd00 msgr2=0x7fcffc06e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:19.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.139+0000 7fd01e400700 1 --2- 172.21.15.84:0/3650206441 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fcffc06bd00 0x7fcffc06e1b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd004004d00 tx=0x7fd004009ce0 comp rx=0 tx=0).stop 2024-04-26T21:25:19.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.139+0000 7fd01e400700 1 -- 172.21.15.84:0/3650206441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd01806eb70 msgr2=0x7fd018113f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:19.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.139+0000 7fd01e400700 1 --2- 172.21.15.84:0/3650206441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd01806eb70 0x7fd018113f60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd00800b970 tx=0x7fd008009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:19.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.139+0000 7fd01e400700 1 -- 172.21.15.84:0/3650206441 shutdown_connections 2024-04-26T21:25:19.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.139+0000 7fd01e400700 1 --2- 172.21.15.84:0/3650206441 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fcffc06bd00 0x7fcffc06e1b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:19.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.139+0000 7fd01e400700 1 --2- 172.21.15.84:0/3650206441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd01806eb70 0x7fd018113f60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:19.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.139+0000 7fd01e400700 1 --2- 172.21.15.84:0/3650206441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd01806fd80 0x7fd0181144a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:19.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.139+0000 7fd01e400700 1 -- 172.21.15.84:0/3650206441 >> 172.21.15.84:0/3650206441 conn(0x7fd01806a360 msgr2=0x7fd01806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:19.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.140+0000 7fd01e400700 1 -- 172.21.15.84:0/3650206441 shutdown_connections 2024-04-26T21:25:19.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.140+0000 7fd01e400700 1 -- 172.21.15.84:0/3650206441 wait complete. 2024-04-26T21:25:19.345 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:19 smithi084 ceph-mon[25539]: pgmap v24: 65 pgs: 65 active+clean; 174 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 182 op/s 2024-04-26T21:25:19.345 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:19 smithi084 ceph-mon[25539]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:25:19.345 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:19 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:19.345 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:19 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:19.346 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:19 smithi084 ceph-mon[25539]: Reconfiguring prometheus.smithi084 (dependencies changed)... 2024-04-26T21:25:19.346 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:19 smithi084 ceph-mon[25539]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:25:19.346 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:19 smithi084 ceph-mon[25539]: Reconfiguring daemon prometheus.smithi084 on smithi084 2024-04-26T21:25:19.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.340+0000 7f238ea00700 1 -- 172.21.15.84:0/3068324415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2388071e40 msgr2=0x7f2388070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:19.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.340+0000 7f238ea00700 1 --2- 172.21.15.84:0/3068324415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2388071e40 0x7f2388070350 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f237c004940 tx=0x7f237c009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:19.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.341+0000 7f238ea00700 1 -- 172.21.15.84:0/3068324415 shutdown_connections 2024-04-26T21:25:19.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.341+0000 7f238ea00700 1 --2- 172.21.15.84:0/3068324415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2388070890 0x7f2388070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:19.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.341+0000 7f238ea00700 1 --2- 172.21.15.84:0/3068324415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2388071e40 0x7f2388070350 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:19.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.341+0000 7f238ea00700 1 -- 172.21.15.84:0/3068324415 >> 172.21.15.84:0/3068324415 conn(0x7f23880f83b0 msgr2=0x7f23880fa7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:19.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.341+0000 7f238ea00700 1 -- 172.21.15.84:0/3068324415 shutdown_connections 2024-04-26T21:25:19.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.341+0000 7f238ea00700 1 -- 172.21.15.84:0/3068324415 wait complete. 2024-04-26T21:25:19.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.342+0000 7f238ea00700 1 Processor -- start 2024-04-26T21:25:19.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.342+0000 7f238ea00700 1 -- start start 2024-04-26T21:25:19.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.343+0000 7f238ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2388070890 0x7f2388113e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:19.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.343+0000 7f238ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2388071e40 0x7f2388114390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:19.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.344+0000 7f238ea00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2388115100 con 0x7f2388070890 2024-04-26T21:25:19.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.344+0000 7f238ea00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2388115270 con 0x7f2388071e40 2024-04-26T21:25:19.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.345+0000 7f238cc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2388071e40 0x7f2388114390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:19.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.346+0000 7f238cc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2388071e40 0x7f2388114390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:44076/0 (socket says 172.21.15.84:44076) 2024-04-26T21:25:19.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.346+0000 7f238cc00700 1 -- 172.21.15.84:0/3567678816 learned_addr learned my addr 172.21.15.84:0/3567678816 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:25:19.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.347+0000 7f238d600700 1 --2- 172.21.15.84:0/3567678816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2388070890 0x7f2388113e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:19.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.348+0000 7f238cc00700 1 -- 172.21.15.84:0/3567678816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2388070890 msgr2=0x7f2388113e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:19.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.348+0000 7f238cc00700 1 --2- 172.21.15.84:0/3567678816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2388070890 0x7f2388113e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:19.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.348+0000 7f238cc00700 1 -- 172.21.15.84:0/3567678816 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c005040 con 0x7f2388071e40 2024-04-26T21:25:19.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.348+0000 7f238cc00700 1 --2- 172.21.15.84:0/3567678816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2388071e40 0x7f2388114390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f237400eb40 tx=0x7f237400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:19.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.349+0000 7f2385600700 1 -- 172.21.15.84:0/3567678816 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2374007cc0 con 0x7f2388071e40 2024-04-26T21:25:19.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.349+0000 7f238ea00700 1 -- 172.21.15.84:0/3567678816 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2388115490 con 0x7f2388071e40 2024-04-26T21:25:19.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.349+0000 7f238ea00700 1 -- 172.21.15.84:0/3567678816 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2388115a50 con 0x7f2388071e40 2024-04-26T21:25:19.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.350+0000 7f238ea00700 1 -- 172.21.15.84:0/3567678816 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238805f5c0 con 0x7f2388071e40 2024-04-26T21:25:19.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.350+0000 7f2385600700 1 -- 172.21.15.84:0/3567678816 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f237400f040 con 0x7f2388071e40 2024-04-26T21:25:19.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.350+0000 7f2385600700 1 -- 172.21.15.84:0/3567678816 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23740095b0 con 0x7f2388071e40 2024-04-26T21:25:19.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.352+0000 7f2385600700 1 -- 172.21.15.84:0/3567678816 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f2374009710 con 0x7f2388071e40 2024-04-26T21:25:19.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.354+0000 7f2385600700 1 --2- 172.21.15.84:0/3567678816 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f237006be10 0x7f237006e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:19.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.354+0000 7f2385600700 1 -- 172.21.15.84:0/3567678816 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f237408aeb0 con 0x7f2388071e40 2024-04-26T21:25:19.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.355+0000 7f238d600700 1 --2- 172.21.15.84:0/3567678816 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f237006be10 0x7f237006e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:19.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.356+0000 7f238d600700 1 --2- 172.21.15.84:0/3567678816 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f237006be10 0x7f237006e2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f237c004890 tx=0x7f237c009e30 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:19.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.363+0000 7f2385600700 1 -- 172.21.15.84:0/3567678816 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f2374054550 con 0x7f2388071e40 2024-04-26T21:25:19.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:19 smithi120 ceph-mon[32741]: pgmap v24: 65 pgs: 65 active+clean; 174 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 182 op/s 2024-04-26T21:25:19.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:19 smithi120 ceph-mon[32741]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:25:19.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:19 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:19.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:19 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:19.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:19 smithi120 ceph-mon[32741]: Reconfiguring prometheus.smithi084 (dependencies changed)... 2024-04-26T21:25:19.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:19 smithi120 ceph-mon[32741]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:25:19.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:19 smithi120 ceph-mon[32741]: Reconfiguring daemon prometheus.smithi084 on smithi084 2024-04-26T21:25:19.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.765+0000 7f238ea00700 1 -- 172.21.15.84:0/3567678816 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f238810bd10 con 0x7f2388071e40 2024-04-26T21:25:19.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.766+0000 7f2385600700 1 -- 172.21.15.84:0/3567678816 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f2374057c10 con 0x7f2388071e40 2024-04-26T21:25:19.768 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:25:19.769 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:25:19.769 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-26T21:25:19.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:25:19.769 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:25:19.769 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 1, 2024-04-26T21:25:19.769 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 1 2024-04-26T21:25:19.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:25:19.769 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:25:19.769 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-26T21:25:19.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:25:19.769 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:25:19.769 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-26T21:25:19.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:25:19.770 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:25:19.770 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 13, 2024-04-26T21:25:19.770 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 1 2024-04-26T21:25:19.770 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:25:19.770 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:25:19.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.769+0000 7f238ea00700 1 -- 172.21.15.84:0/3567678816 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f237006be10 msgr2=0x7f237006e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:19.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.769+0000 7f238ea00700 1 --2- 172.21.15.84:0/3567678816 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f237006be10 0x7f237006e2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f237c004890 tx=0x7f237c009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:19.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.769+0000 7f238ea00700 1 -- 172.21.15.84:0/3567678816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2388071e40 msgr2=0x7f2388114390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:19.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.769+0000 7f238ea00700 1 --2- 172.21.15.84:0/3567678816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2388071e40 0x7f2388114390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f237400eb40 tx=0x7f237400b040 comp rx=0 tx=0).stop 2024-04-26T21:25:19.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.770+0000 7f238ea00700 1 -- 172.21.15.84:0/3567678816 shutdown_connections 2024-04-26T21:25:19.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.770+0000 7f238ea00700 1 --2- 172.21.15.84:0/3567678816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2388070890 0x7f2388113e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:19.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.770+0000 7f238ea00700 1 --2- 172.21.15.84:0/3567678816 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f237006be10 0x7f237006e2c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:19.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.770+0000 7f238ea00700 1 --2- 172.21.15.84:0/3567678816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2388071e40 0x7f2388114390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:19.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.770+0000 7f238ea00700 1 -- 172.21.15.84:0/3567678816 >> 172.21.15.84:0/3567678816 conn(0x7f23880f83b0 msgr2=0x7f23880f9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:19.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.770+0000 7f238ea00700 1 -- 172.21.15.84:0/3567678816 shutdown_connections 2024-04-26T21:25:19.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.770+0000 7f238ea00700 1 -- 172.21.15.84:0/3567678816 wait complete. 2024-04-26T21:25:19.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.913+0000 7f4952400700 1 -- 172.21.15.84:0/86379523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f494c070940 msgr2=0x7f494c070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:19.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.913+0000 7f4952400700 1 --2- 172.21.15.84:0/86379523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f494c070940 0x7f494c070db0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4938004940 tx=0x7f4938009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:19.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.913+0000 7f4952400700 1 -- 172.21.15.84:0/86379523 shutdown_connections 2024-04-26T21:25:19.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.913+0000 7f4952400700 1 --2- 172.21.15.84:0/86379523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f494c070940 0x7f494c070db0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:19.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.913+0000 7f4952400700 1 --2- 172.21.15.84:0/86379523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f494c071ef0 0x7f494c070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:19.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.913+0000 7f4952400700 1 -- 172.21.15.84:0/86379523 >> 172.21.15.84:0/86379523 conn(0x7f494c0f8560 msgr2=0x7f494c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:19.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.914+0000 7f4952400700 1 -- 172.21.15.84:0/86379523 shutdown_connections 2024-04-26T21:25:19.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.914+0000 7f4952400700 1 -- 172.21.15.84:0/86379523 wait complete. 2024-04-26T21:25:19.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.914+0000 7f4952400700 1 Processor -- start 2024-04-26T21:25:19.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.915+0000 7f4952400700 1 -- start start 2024-04-26T21:25:19.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.915+0000 7f4952400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f494c070940 0x7f494c10fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:19.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.915+0000 7f4952400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f494c071ef0 0x7f494c110120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:19.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.915+0000 7f4952400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c110720 con 0x7f494c071ef0 2024-04-26T21:25:19.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.915+0000 7f4952400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c110f70 con 0x7f494c070940 2024-04-26T21:25:19.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.915+0000 7f494aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f494c071ef0 0x7f494c110120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:19.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.915+0000 7f494aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f494c071ef0 0x7f494c110120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33900/0 (socket says 172.21.15.84:33900) 2024-04-26T21:25:19.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.915+0000 7f494aa00700 1 -- 172.21.15.84:0/1040668641 learned_addr learned my addr 172.21.15.84:0/1040668641 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:25:19.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.916+0000 7f494b400700 1 --2- 172.21.15.84:0/1040668641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f494c070940 0x7f494c10fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:19.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.916+0000 7f494aa00700 1 -- 172.21.15.84:0/1040668641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f494c070940 msgr2=0x7f494c10fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:19.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.916+0000 7f494aa00700 1 --2- 172.21.15.84:0/1040668641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f494c070940 0x7f494c10fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:19.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.916+0000 7f494aa00700 1 -- 172.21.15.84:0/1040668641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4938005040 con 0x7f494c071ef0 2024-04-26T21:25:19.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.916+0000 7f494aa00700 1 --2- 172.21.15.84:0/1040668641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f494c071ef0 0x7f494c110120 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f493800b3b0 tx=0x7f4938009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:19.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.916+0000 7f4943400700 1 -- 172.21.15.84:0/1040668641 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f493800e040 con 0x7f494c071ef0 2024-04-26T21:25:19.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.916+0000 7f4943400700 1 -- 172.21.15.84:0/1040668641 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4938004290 con 0x7f494c071ef0 2024-04-26T21:25:19.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.916+0000 7f4952400700 1 -- 172.21.15.84:0/1040668641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c1111f0 con 0x7f494c071ef0 2024-04-26T21:25:19.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.916+0000 7f4943400700 1 -- 172.21.15.84:0/1040668641 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f493801c630 con 0x7f494c071ef0 2024-04-26T21:25:19.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.917+0000 7f4952400700 1 -- 172.21.15.84:0/1040668641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c111730 con 0x7f494c071ef0 2024-04-26T21:25:19.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.918+0000 7f4952400700 1 -- 172.21.15.84:0/1040668641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494c05f5c0 con 0x7f494c071ef0 2024-04-26T21:25:19.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.919+0000 7f4943400700 1 -- 172.21.15.84:0/1040668641 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f493800bbf0 con 0x7f494c071ef0 2024-04-26T21:25:19.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.920+0000 7f4943400700 1 --2- 172.21.15.84:0/1040668641 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f493006bcf0 0x7f493006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:19.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.920+0000 7f4943400700 1 -- 172.21.15.84:0/1040668641 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f493808bf00 con 0x7f494c071ef0 2024-04-26T21:25:19.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.921+0000 7f494b400700 1 --2- 172.21.15.84:0/1040668641 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f493006bcf0 0x7f493006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:19.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.922+0000 7f494b400700 1 --2- 172.21.15.84:0/1040668641 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f493006bcf0 0x7f493006e1a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f493c007fd0 tx=0x7f493c009040 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:19.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:19.926+0000 7f4943400700 1 -- 172.21.15.84:0/1040668641 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f4938059020 con 0x7f494c071ef0 2024-04-26T21:25:20.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.243+0000 7f4952400700 1 -- 172.21.15.84:0/1040668641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f494c111380 con 0x7f494c071ef0 2024-04-26T21:25:20.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.244+0000 7f4943400700 1 -- 172.21.15.84:0/1040668641 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1835 (secure 0 0 0) 0x7f494c111380 con 0x7f494c071ef0 2024-04-26T21:25:20.246 INFO:teuthology.orchestra.run.smithi084.stdout:e12 2024-04-26T21:25:20.246 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:25:20.246 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:25:20.246 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:25:20.246 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:25:20.246 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:25:20.246 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:25:20.246 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 12 2024-04-26T21:25:20.247 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:25:20.247 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:25:20.247 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:23:53.700069+0000 2024-04-26T21:25:20.247 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:25:20.247 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:25:20.247 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:25:20.247 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:25:20.247 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:25:20.247 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:25:20.247 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:25:20.247 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:25:20.247 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:25:20.247 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:25:20.247 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:25:20.248 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456,1=24231} 2024-04-26T21:25:20.248 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:25:20.248 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:25:20.248 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:25:20.248 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:25:20.248 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:25:20.248 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:25:20.248 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:25:20.248 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:25:20.248 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:25:20.248 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:25:20.248 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:25:20.248 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:25:20.248 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:25:20.249 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:25:20.249 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:25:20.249 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:25:20.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.246+0000 7f4952400700 1 -- 172.21.15.84:0/1040668641 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f493006bcf0 msgr2=0x7f493006e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:20.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.246+0000 7f4952400700 1 --2- 172.21.15.84:0/1040668641 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f493006bcf0 0x7f493006e1a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f493c007fd0 tx=0x7f493c009040 comp rx=0 tx=0).stop 2024-04-26T21:25:20.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.246+0000 7f4952400700 1 -- 172.21.15.84:0/1040668641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f494c071ef0 msgr2=0x7f494c110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:20.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.246+0000 7f4952400700 1 --2- 172.21.15.84:0/1040668641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f494c071ef0 0x7f494c110120 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f493800b3b0 tx=0x7f4938009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:20.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.246+0000 7f4952400700 1 -- 172.21.15.84:0/1040668641 shutdown_connections 2024-04-26T21:25:20.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.246+0000 7f4952400700 1 --2- 172.21.15.84:0/1040668641 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f493006bcf0 0x7f493006e1a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:20.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.246+0000 7f4952400700 1 --2- 172.21.15.84:0/1040668641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f494c070940 0x7f494c10fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:20.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.246+0000 7f4952400700 1 --2- 172.21.15.84:0/1040668641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f494c071ef0 0x7f494c110120 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:20.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.246+0000 7f4952400700 1 -- 172.21.15.84:0/1040668641 >> 172.21.15.84:0/1040668641 conn(0x7f494c0f8560 msgr2=0x7f494c0f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:20.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.247+0000 7f4952400700 1 -- 172.21.15.84:0/1040668641 shutdown_connections 2024-04-26T21:25:20.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.247+0000 7f4952400700 1 -- 172.21.15.84:0/1040668641 wait complete. 2024-04-26T21:25:20.251 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 12 2024-04-26T21:25:20.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.409+0000 7f9aa5c00700 1 -- 172.21.15.84:0/1184715791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9aa00fcf10 msgr2=0x7f9aa00fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:20.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.409+0000 7f9aa5c00700 1 --2- 172.21.15.84:0/1184715791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9aa00fcf10 0x7f9aa00fd320 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9a90009ce0 tx=0x7f9a90004d10 comp rx=0 tx=0).stop 2024-04-26T21:25:20.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.409+0000 7f9aa5c00700 1 -- 172.21.15.84:0/1184715791 shutdown_connections 2024-04-26T21:25:20.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.409+0000 7f9aa5c00700 1 --2- 172.21.15.84:0/1184715791 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9aa00fe080 0x7f9aa00fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:20.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.409+0000 7f9aa5c00700 1 --2- 172.21.15.84:0/1184715791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9aa00fcf10 0x7f9aa00fd320 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:20.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.409+0000 7f9aa5c00700 1 -- 172.21.15.84:0/1184715791 >> 172.21.15.84:0/1184715791 conn(0x7f9aa00f8560 msgr2=0x7f9aa00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:20.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.410+0000 7f9aa5c00700 1 -- 172.21.15.84:0/1184715791 shutdown_connections 2024-04-26T21:25:20.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.410+0000 7f9aa5c00700 1 -- 172.21.15.84:0/1184715791 wait complete. 2024-04-26T21:25:20.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.411+0000 7f9aa5c00700 1 Processor -- start 2024-04-26T21:25:20.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.411+0000 7f9aa5c00700 1 -- start start 2024-04-26T21:25:20.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.411+0000 7f9aa5c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9aa00fcf10 0x7f9aa010fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:20.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.411+0000 7f9aa5c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9aa00fe080 0x7f9aa01103a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:20.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.411+0000 7f9aa5c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa01110f0 con 0x7f9aa00fe080 2024-04-26T21:25:20.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.411+0000 7f9aa5c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa0111260 con 0x7f9aa00fcf10 2024-04-26T21:25:20.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.412+0000 7f9a9e000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9aa00fe080 0x7f9aa01103a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:20.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.412+0000 7f9a9e000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9aa00fe080 0x7f9aa01103a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33918/0 (socket says 172.21.15.84:33918) 2024-04-26T21:25:20.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.412+0000 7f9a9e000700 1 -- 172.21.15.84:0/1505993101 learned_addr learned my addr 172.21.15.84:0/1505993101 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:25:20.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.412+0000 7f9a9ea00700 1 --2- 172.21.15.84:0/1505993101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9aa00fcf10 0x7f9aa010fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:20.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.412+0000 7f9a9e000700 1 -- 172.21.15.84:0/1505993101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9aa00fcf10 msgr2=0x7f9aa010fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:20.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.412+0000 7f9a9e000700 1 --2- 172.21.15.84:0/1505993101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9aa00fcf10 0x7f9aa010fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:20.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.412+0000 7f9a9e000700 1 -- 172.21.15.84:0/1505993101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a90009940 con 0x7f9aa00fe080 2024-04-26T21:25:20.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.412+0000 7f9a9e000700 1 --2- 172.21.15.84:0/1505993101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9aa00fe080 0x7f9aa01103a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00c830 tx=0x7f9a8c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:20.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.413+0000 7f9a96a00700 1 -- 172.21.15.84:0/1505993101 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a8c00a760 con 0x7f9aa00fe080 2024-04-26T21:25:20.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.413+0000 7f9aa5c00700 1 -- 172.21.15.84:0/1505993101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa0111540 con 0x7f9aa00fe080 2024-04-26T21:25:20.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.413+0000 7f9aa5c00700 1 -- 172.21.15.84:0/1505993101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa0111b00 con 0x7f9aa00fe080 2024-04-26T21:25:20.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.413+0000 7f9a96a00700 1 -- 172.21.15.84:0/1505993101 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a8c00ad90 con 0x7f9aa00fe080 2024-04-26T21:25:20.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.413+0000 7f9a96a00700 1 -- 172.21.15.84:0/1505993101 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a8c0113a0 con 0x7f9aa00fe080 2024-04-26T21:25:20.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.415+0000 7f9aa5c00700 1 -- 172.21.15.84:0/1505993101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a800052e0 con 0x7f9aa00fe080 2024-04-26T21:25:20.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.416+0000 7f9a96a00700 1 -- 172.21.15.84:0/1505993101 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f9a8c011600 con 0x7f9aa00fe080 2024-04-26T21:25:20.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.418+0000 7f9a96a00700 1 --2- 172.21.15.84:0/1505993101 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f9a8406bcf0 0x7f9a8406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:20.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.418+0000 7f9a96a00700 1 -- 172.21.15.84:0/1505993101 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f9a8c08a7d0 con 0x7f9aa00fe080 2024-04-26T21:25:20.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.419+0000 7f9a9ea00700 1 --2- 172.21.15.84:0/1505993101 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f9a8406bcf0 0x7f9a8406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:20.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.420+0000 7f9a9ea00700 1 --2- 172.21.15.84:0/1505993101 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f9a8406bcf0 0x7f9a8406e1a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9a90015040 tx=0x7f9a90004d10 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:20.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.422+0000 7f9a96a00700 1 -- 172.21.15.84:0/1505993101 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f9a8c057790 con 0x7f9aa00fe080 2024-04-26T21:25:20.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:20 smithi084 ceph-mon[25539]: from='client.24417 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:25:20.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:20 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3567678816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:25:20.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:20 smithi120 ceph-mon[32741]: from='client.24417 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:25:20.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:20 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/3567678816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:25:20.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.722+0000 7f9aa5c00700 1 -- 172.21.15.84:0/1505993101 --> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a80000bf0 con 0x7f9a8406bcf0 2024-04-26T21:25:20.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.727+0000 7f9a96a00700 1 -- 172.21.15.84:0/1505993101 <== mgr.14662 v2:172.21.15.120:6828/3773295163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f9a80000bf0 con 0x7f9a8406bcf0 2024-04-26T21:25:20.729 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:25:20.729 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:25:20.729 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:25:20.729 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:25:20.729 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [], 2024-04-26T21:25:20.729 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "1/21 daemons upgraded", 2024-04-26T21:25:20.729 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2024-04-26T21:25:20.729 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:25:20.729 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:25:20.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.730+0000 7f9aa5c00700 1 -- 172.21.15.84:0/1505993101 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f9a8406bcf0 msgr2=0x7f9a8406e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:20.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.730+0000 7f9aa5c00700 1 --2- 172.21.15.84:0/1505993101 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f9a8406bcf0 0x7f9a8406e1a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9a90015040 tx=0x7f9a90004d10 comp rx=0 tx=0).stop 2024-04-26T21:25:20.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.730+0000 7f9aa5c00700 1 -- 172.21.15.84:0/1505993101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9aa00fe080 msgr2=0x7f9aa01103a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:20.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.730+0000 7f9aa5c00700 1 --2- 172.21.15.84:0/1505993101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9aa00fe080 0x7f9aa01103a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00c830 tx=0x7f9a8c004470 comp rx=0 tx=0).stop 2024-04-26T21:25:20.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.731+0000 7f9aa5c00700 1 -- 172.21.15.84:0/1505993101 shutdown_connections 2024-04-26T21:25:20.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.731+0000 7f9aa5c00700 1 --2- 172.21.15.84:0/1505993101 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f9a8406bcf0 0x7f9a8406e1a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:20.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.731+0000 7f9aa5c00700 1 --2- 172.21.15.84:0/1505993101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9aa00fcf10 0x7f9aa010fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:20.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.731+0000 7f9aa5c00700 1 --2- 172.21.15.84:0/1505993101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9aa00fe080 0x7f9aa01103a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:20.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.731+0000 7f9aa5c00700 1 -- 172.21.15.84:0/1505993101 >> 172.21.15.84:0/1505993101 conn(0x7f9aa00f8560 msgr2=0x7f9aa00f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:20.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.731+0000 7f9aa5c00700 1 -- 172.21.15.84:0/1505993101 shutdown_connections 2024-04-26T21:25:20.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.731+0000 7f9aa5c00700 1 -- 172.21.15.84:0/1505993101 wait complete. 2024-04-26T21:25:20.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.899+0000 7fe196e00700 1 -- 172.21.15.84:0/2782011499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190100280 msgr2=0x7fe1901006f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:20.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.899+0000 7fe196e00700 1 --2- 172.21.15.84:0/2782011499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190100280 0x7fe1901006f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe17c004940 tx=0x7fe17c009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:20.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.899+0000 7fe196e00700 1 -- 172.21.15.84:0/2782011499 shutdown_connections 2024-04-26T21:25:20.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.899+0000 7fe196e00700 1 --2- 172.21.15.84:0/2782011499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190100280 0x7fe1901006f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:20.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.899+0000 7fe196e00700 1 --2- 172.21.15.84:0/2782011499 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1900fefd0 0x7fe1900ff3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:20.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.899+0000 7fe196e00700 1 -- 172.21.15.84:0/2782011499 >> 172.21.15.84:0/2782011499 conn(0x7fe1900fa8f0 msgr2=0x7fe1900fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:20.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.900+0000 7fe196e00700 1 -- 172.21.15.84:0/2782011499 shutdown_connections 2024-04-26T21:25:20.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.900+0000 7fe196e00700 1 -- 172.21.15.84:0/2782011499 wait complete. 2024-04-26T21:25:20.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.901+0000 7fe196e00700 1 Processor -- start 2024-04-26T21:25:20.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.901+0000 7fe196e00700 1 -- start start 2024-04-26T21:25:20.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.901+0000 7fe196e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1900fefd0 0x7fe19010fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:20.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.901+0000 7fe196e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190100280 0x7fe190110150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:20.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.901+0000 7fe196e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe190110750 con 0x7fe190100280 2024-04-26T21:25:20.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.901+0000 7fe196e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe190110fa0 con 0x7fe1900fefd0 2024-04-26T21:25:20.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.902+0000 7fe18f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190100280 0x7fe190110150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:20.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.902+0000 7fe18f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190100280 0x7fe190110150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33930/0 (socket says 172.21.15.84:33930) 2024-04-26T21:25:20.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.902+0000 7fe18f400700 1 -- 172.21.15.84:0/1686561498 learned_addr learned my addr 172.21.15.84:0/1686561498 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:25:20.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.902+0000 7fe18fe00700 1 --2- 172.21.15.84:0/1686561498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1900fefd0 0x7fe19010fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:20.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.902+0000 7fe18f400700 1 -- 172.21.15.84:0/1686561498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1900fefd0 msgr2=0x7fe19010fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:20.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.902+0000 7fe18f400700 1 --2- 172.21.15.84:0/1686561498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1900fefd0 0x7fe19010fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:20.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.902+0000 7fe18f400700 1 -- 172.21.15.84:0/1686561498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c005040 con 0x7fe190100280 2024-04-26T21:25:20.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.902+0000 7fe18fe00700 1 --2- 172.21.15.84:0/1686561498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1900fefd0 0x7fe19010fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:25:20.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.903+0000 7fe18f400700 1 --2- 172.21.15.84:0/1686561498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190100280 0x7fe190110150 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009150 tx=0x7fe17c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:20.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.903+0000 7fe187e00700 1 -- 172.21.15.84:0/1686561498 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe17c00e040 con 0x7fe190100280 2024-04-26T21:25:20.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.903+0000 7fe187e00700 1 -- 172.21.15.84:0/1686561498 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe17c00bbf0 con 0x7fe190100280 2024-04-26T21:25:20.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.903+0000 7fe196e00700 1 -- 172.21.15.84:0/1686561498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe190111220 con 0x7fe190100280 2024-04-26T21:25:20.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.903+0000 7fe187e00700 1 -- 172.21.15.84:0/1686561498 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe17c01c630 con 0x7fe190100280 2024-04-26T21:25:20.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.903+0000 7fe196e00700 1 -- 172.21.15.84:0/1686561498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe190111760 con 0x7fe190100280 2024-04-26T21:25:20.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.904+0000 7fe196e00700 1 -- 172.21.15.84:0/1686561498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19005f5c0 con 0x7fe190100280 2024-04-26T21:25:20.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.905+0000 7fe187e00700 1 -- 172.21.15.84:0/1686561498 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7fe17c00bd60 con 0x7fe190100280 2024-04-26T21:25:20.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.906+0000 7fe187e00700 1 --2- 172.21.15.84:0/1686561498 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fe17406bcf0 0x7fe17406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:20.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.906+0000 7fe187e00700 1 -- 172.21.15.84:0/1686561498 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fe17c08beb0 con 0x7fe190100280 2024-04-26T21:25:20.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.907+0000 7fe18fe00700 1 --2- 172.21.15.84:0/1686561498 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fe17406bcf0 0x7fe17406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:20.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.909+0000 7fe18fe00700 1 --2- 172.21.15.84:0/1686561498 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fe17406bcf0 0x7fe17406e1a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe180007fd0 tx=0x7fe180009040 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:20.912+0000 7fe187e00700 1 -- 172.21.15.84:0/1686561498 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fe17c059080 con 0x7fe190100280 2024-04-26T21:25:21.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:21.298+0000 7fe196e00700 1 -- 172.21.15.84:0/1686561498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe190111a90 con 0x7fe190100280 2024-04-26T21:25:21.300 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:21 smithi084 ceph-mon[25539]: pgmap v25: 65 pgs: 65 active+clean; 174 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 140 op/s 2024-04-26T21:25:21.300 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:21 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1040668641' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:25:21.300 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:21 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:25:21.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:21.299+0000 7fe187e00700 1 -- 172.21.15.84:0/1686561498 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fe17c058c10 con 0x7fe190100280 2024-04-26T21:25:21.301 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:25:21.301 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:25:21.301 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:25:21.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:21.302+0000 7fe196e00700 1 -- 172.21.15.84:0/1686561498 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fe17406bcf0 msgr2=0x7fe17406e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:21.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:21.302+0000 7fe196e00700 1 --2- 172.21.15.84:0/1686561498 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fe17406bcf0 0x7fe17406e1a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe180007fd0 tx=0x7fe180009040 comp rx=0 tx=0).stop 2024-04-26T21:25:21.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:21.302+0000 7fe196e00700 1 -- 172.21.15.84:0/1686561498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190100280 msgr2=0x7fe190110150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:21.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:21.302+0000 7fe196e00700 1 --2- 172.21.15.84:0/1686561498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190100280 0x7fe190110150 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009150 tx=0x7fe17c009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:21.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:21.302+0000 7fe196e00700 1 -- 172.21.15.84:0/1686561498 shutdown_connections 2024-04-26T21:25:21.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:21.302+0000 7fe196e00700 1 --2- 172.21.15.84:0/1686561498 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fe17406bcf0 0x7fe17406e1a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:21.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:21.302+0000 7fe196e00700 1 --2- 172.21.15.84:0/1686561498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1900fefd0 0x7fe19010fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:21.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:21.302+0000 7fe196e00700 1 --2- 172.21.15.84:0/1686561498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe190100280 0x7fe190110150 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:21.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:21.302+0000 7fe196e00700 1 -- 172.21.15.84:0/1686561498 >> 172.21.15.84:0/1686561498 conn(0x7fe1900fa8f0 msgr2=0x7fe1900fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:21.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:21.302+0000 7fe196e00700 1 -- 172.21.15.84:0/1686561498 shutdown_connections 2024-04-26T21:25:21.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:21.302+0000 7fe196e00700 1 -- 172.21.15.84:0/1686561498 wait complete. 2024-04-26T21:25:21.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:21 smithi120 ceph-mon[32741]: pgmap v25: 65 pgs: 65 active+clean; 174 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 140 op/s 2024-04-26T21:25:21.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:21 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/1040668641' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:25:21.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:21 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:25:22.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:22 smithi084 ceph-mon[25539]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:25:22.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:22 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1686561498' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:25:22.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:22 smithi120 ceph-mon[32741]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:25:22.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:22 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/1686561498' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:25:23.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:23 smithi084 ceph-mon[25539]: pgmap v26: 65 pgs: 65 active+clean; 182 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 242 op/s 2024-04-26T21:25:23.676 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:23 smithi120 ceph-mon[32741]: pgmap v26: 65 pgs: 65 active+clean; 182 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 242 op/s 2024-04-26T21:25:25.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:25 smithi084 ceph-mon[25539]: pgmap v27: 65 pgs: 65 active+clean; 182 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.3 MiB/s wr, 170 op/s 2024-04-26T21:25:25.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:25 smithi120 ceph-mon[32741]: pgmap v27: 65 pgs: 65 active+clean; 182 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.3 MiB/s wr, 170 op/s 2024-04-26T21:25:27.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:27 smithi084 ceph-mon[25539]: pgmap v28: 65 pgs: 65 active+clean; 182 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.3 MiB/s wr, 170 op/s 2024-04-26T21:25:27.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:27 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:27.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:27 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:27.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:27 smithi084 ceph-mon[25539]: Reconfiguring node-exporter.smithi120 (dependencies changed)... 2024-04-26T21:25:27.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:27 smithi084 ceph-mon[25539]: Reconfiguring daemon node-exporter.smithi120 on smithi120 2024-04-26T21:25:27.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:27 smithi120 ceph-mon[32741]: pgmap v28: 65 pgs: 65 active+clean; 182 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.3 MiB/s wr, 170 op/s 2024-04-26T21:25:27.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:27 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:27.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:27 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:27.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:27 smithi120 ceph-mon[32741]: Reconfiguring node-exporter.smithi120 (dependencies changed)... 2024-04-26T21:25:27.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:27 smithi120 ceph-mon[32741]: Reconfiguring daemon node-exporter.smithi120 on smithi120 2024-04-26T21:25:29.317 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:29 smithi120 ceph-mon[32741]: pgmap v29: 65 pgs: 65 active+clean; 192 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 245 op/s 2024-04-26T21:25:29.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:29 smithi084 ceph-mon[25539]: pgmap v29: 65 pgs: 65 active+clean; 192 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 245 op/s 2024-04-26T21:25:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:30 smithi084 ceph-mon[25539]: pgmap v30: 65 pgs: 65 active+clean; 192 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 177 op/s 2024-04-26T21:25:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:30 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:30 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:30 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-26T21:25:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:30 smithi084 ceph-mon[25539]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-26T21:25:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:30 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-26T21:25:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:30 smithi084 ceph-mon[25539]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-26T21:25:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:30 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:25:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:30 smithi084 ceph-mon[25539]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:25:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:30 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:25:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:30 smithi084 ceph-mon[25539]: Upgrade: Need to upgrade myself (mgr.smithi120.zjaduj) 2024-04-26T21:25:31.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:30 smithi084 ceph-mon[25539]: Upgrade: Need to upgrade myself (mgr.smithi120.zjaduj) 2024-04-26T21:25:31.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:30 smithi120 ceph-mon[32741]: pgmap v30: 65 pgs: 65 active+clean; 192 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 177 op/s 2024-04-26T21:25:31.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:30 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:31.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:30 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:31.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:30 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-26T21:25:31.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:30 smithi120 ceph-mon[32741]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-26T21:25:31.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:30 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-26T21:25:31.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:30 smithi120 ceph-mon[32741]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-26T21:25:31.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:30 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:25:31.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:30 smithi120 ceph-mon[32741]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:25:31.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:30 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:25:31.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:30 smithi120 ceph-mon[32741]: Upgrade: Need to upgrade myself (mgr.smithi120.zjaduj) 2024-04-26T21:25:31.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:30 smithi120 ceph-mon[32741]: Upgrade: Need to upgrade myself (mgr.smithi120.zjaduj) 2024-04-26T21:25:33.093 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:32 smithi084 ceph-mon[25539]: pgmap v31: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.5 MiB/s wr, 238 op/s 2024-04-26T21:25:33.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:32 smithi120 ceph-mon[32741]: pgmap v31: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.5 MiB/s wr, 238 op/s 2024-04-26T21:25:35.569 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:35 smithi084 ceph-mon[25539]: pgmap v32: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.7 MiB/s wr, 136 op/s 2024-04-26T21:25:35.569 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:35 smithi084 ceph-mon[25539]: Upgrade: Updating mgr.smithi084.gyasul 2024-04-26T21:25:35.569 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:35 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:35.569 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:35 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi084.gyasul", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:25:35.569 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:35 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi084.gyasul", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:25:35.569 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:35 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:25:35.569 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:35 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:25:35.569 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:35 smithi084 ceph-mon[25539]: Deploying daemon mgr.smithi084.gyasul on smithi084 2024-04-26T21:25:35.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:35 smithi120 ceph-mon[32741]: pgmap v32: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.7 MiB/s wr, 136 op/s 2024-04-26T21:25:35.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:35 smithi120 ceph-mon[32741]: Upgrade: Updating mgr.smithi084.gyasul 2024-04-26T21:25:35.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:35 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:35.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:35 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi084.gyasul", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:25:35.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:35 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi084.gyasul", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:25:35.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:35 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:25:35.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:35 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:25:35.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:35 smithi120 ceph-mon[32741]: Deploying daemon mgr.smithi084.gyasul on smithi084 2024-04-26T21:25:36.018 INFO:tasks.workunit.client.1.smithi120.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-26T21:25:36.052 INFO:tasks.workunit.client.1.smithi120.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-26T21:25:36.052 INFO:tasks.workunit.client.1.smithi120.stderr:+ make 2024-04-26T21:25:36.316 INFO:tasks.workunit.client.1.smithi120.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-26T21:25:36.608 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:36 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:25:36.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:36 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:25:37.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:37 smithi084 ceph-mon[25539]: pgmap v33: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.7 MiB/s wr, 136 op/s 2024-04-26T21:25:37.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:37 smithi120 ceph-mon[32741]: pgmap v33: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.7 MiB/s wr, 136 op/s 2024-04-26T21:25:37.703 INFO:tasks.workunit.client.1.smithi120.stderr:++ readlink -f fsstress 2024-04-26T21:25:37.736 INFO:tasks.workunit.client.1.smithi120.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-26T21:25:37.736 INFO:tasks.workunit.client.1.smithi120.stderr:+ popd 2024-04-26T21:25:37.736 INFO:tasks.workunit.client.1.smithi120.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-26T21:25:37.737 INFO:tasks.workunit.client.1.smithi120.stderr:+ popd 2024-04-26T21:25:37.737 INFO:tasks.workunit.client.1.smithi120.stdout:~/cephtest/mnt.1/client.1/tmp 2024-04-26T21:25:37.737 INFO:tasks.workunit.client.1.smithi120.stderr:++ mktemp -d -p . 2024-04-26T21:25:37.737 INFO:tasks.workunit.client.1.smithi120.stderr:+ T=./tmp.4gxmboSRzN 2024-04-26T21:25:37.738 INFO:tasks.workunit.client.1.smithi120.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.4gxmboSRzN -l 1 -n 1000 -p 10 -v 2024-04-26T21:25:37.738 INFO:tasks.workunit.client.1.smithi120.stdout:seed = 1713847478 2024-04-26T21:25:37.740 INFO:tasks.workunit.client.1.smithi120.stdout:0/0: chown . 253340 1 2024-04-26T21:25:37.740 INFO:tasks.workunit.client.1.smithi120.stdout:0/1: readlink - no filename 2024-04-26T21:25:37.740 INFO:tasks.workunit.client.1.smithi120.stdout:0/2: dread - no filename 2024-04-26T21:25:37.740 INFO:tasks.workunit.client.1.smithi120.stdout:0/3: rename - no filename 2024-04-26T21:25:37.740 INFO:tasks.workunit.client.1.smithi120.stdout:0/4: write - no filename 2024-04-26T21:25:37.740 INFO:tasks.workunit.client.1.smithi120.stdout:0/5: dwrite - no filename 2024-04-26T21:25:37.740 INFO:tasks.workunit.client.1.smithi120.stdout:0/6: stat - no entries 2024-04-26T21:25:37.742 INFO:tasks.workunit.client.1.smithi120.stdout:1/0: truncate - no filename 2024-04-26T21:25:37.742 INFO:tasks.workunit.client.1.smithi120.stdout:1/1: rename - no filename 2024-04-26T21:25:37.742 INFO:tasks.workunit.client.1.smithi120.stdout:1/2: dread - no filename 2024-04-26T21:25:37.742 INFO:tasks.workunit.client.1.smithi120.stdout:1/3: rename - no filename 2024-04-26T21:25:37.743 INFO:tasks.workunit.client.1.smithi120.stdout:0/7: mkdir d0 0 2024-04-26T21:25:37.754 INFO:tasks.workunit.client.1.smithi120.stdout:1/4: mknod c0 0 2024-04-26T21:25:37.754 INFO:tasks.workunit.client.1.smithi120.stdout:1/5: readlink - no filename 2024-04-26T21:25:37.754 INFO:tasks.workunit.client.1.smithi120.stdout:1/6: dread - no filename 2024-04-26T21:25:37.754 INFO:tasks.workunit.client.1.smithi120.stdout:1/7: dwrite - no filename 2024-04-26T21:25:37.756 INFO:tasks.workunit.client.1.smithi120.stdout:2/0: mknod c0 0 2024-04-26T21:25:37.758 INFO:tasks.workunit.client.1.smithi120.stdout:2/1: stat c0 0 2024-04-26T21:25:37.758 INFO:tasks.workunit.client.1.smithi120.stdout:3/0: dread - no filename 2024-04-26T21:25:37.760 INFO:tasks.workunit.client.1.smithi120.stdout:1/8: unlink c0 0 2024-04-26T21:25:37.760 INFO:tasks.workunit.client.1.smithi120.stdout:1/9: stat - no entries 2024-04-26T21:25:37.763 INFO:tasks.workunit.client.1.smithi120.stdout:2/2: creat f1 x:0 0 0 2024-04-26T21:25:37.764 INFO:tasks.workunit.client.1.smithi120.stdout:2/3: dread - f1 zero size 2024-04-26T21:25:37.765 INFO:tasks.workunit.client.1.smithi120.stdout:1/10: mknod c1 0 2024-04-26T21:25:37.765 INFO:tasks.workunit.client.1.smithi120.stdout:1/11: dread - no filename 2024-04-26T21:25:37.767 INFO:tasks.workunit.client.1.smithi120.stdout:5/0: link - no file 2024-04-26T21:25:37.769 INFO:tasks.workunit.client.1.smithi120.stdout:3/1: creat f0 x:0 0 0 2024-04-26T21:25:37.771 INFO:tasks.workunit.client.1.smithi120.stdout:2/4: mknod c2 0 2024-04-26T21:25:37.772 INFO:tasks.workunit.client.1.smithi120.stdout:1/12: mknod c2 0 2024-04-26T21:25:37.772 INFO:tasks.workunit.client.1.smithi120.stdout:1/13: dread - no filename 2024-04-26T21:25:37.772 INFO:tasks.workunit.client.1.smithi120.stdout:1/14: dread - no filename 2024-04-26T21:25:37.772 INFO:tasks.workunit.client.1.smithi120.stdout:1/15: readlink - no filename 2024-04-26T21:25:37.773 INFO:tasks.workunit.client.1.smithi120.stdout:4/0: creat f0 x:0 0 0 2024-04-26T21:25:37.774 INFO:tasks.workunit.client.1.smithi120.stdout:4/1: write f0 [471840,14774] 0 2024-04-26T21:25:37.776 INFO:tasks.workunit.client.1.smithi120.stdout:3/2: symlink l1 0 2024-04-26T21:25:37.776 INFO:tasks.workunit.client.1.smithi120.stdout:4/2: chown f0 250912 1 2024-04-26T21:25:37.776 INFO:tasks.workunit.client.1.smithi120.stdout:6/0: chown . 2965 1 2024-04-26T21:25:37.776 INFO:tasks.workunit.client.1.smithi120.stdout:6/1: truncate - no filename 2024-04-26T21:25:37.776 INFO:tasks.workunit.client.1.smithi120.stdout:6/2: dwrite - no filename 2024-04-26T21:25:37.777 INFO:tasks.workunit.client.1.smithi120.stdout:6/3: truncate - no filename 2024-04-26T21:25:37.777 INFO:tasks.workunit.client.1.smithi120.stdout:3/3: readlink l1 0 2024-04-26T21:25:37.777 INFO:tasks.workunit.client.1.smithi120.stdout:2/5: creat f3 x:0 0 0 2024-04-26T21:25:37.779 INFO:tasks.workunit.client.1.smithi120.stdout:1/16: rename c1 to c3 0 2024-04-26T21:25:37.779 INFO:tasks.workunit.client.1.smithi120.stdout:2/6: write f3 [951339,130274] 0 2024-04-26T21:25:37.780 INFO:tasks.workunit.client.1.smithi120.stdout:4/3: fdatasync f0 0 2024-04-26T21:25:37.780 INFO:tasks.workunit.client.1.smithi120.stdout:5/1: creat f0 x:0 0 0 2024-04-26T21:25:37.781 INFO:tasks.workunit.client.1.smithi120.stdout:5/2: stat f0 0 2024-04-26T21:25:37.782 INFO:tasks.workunit.client.1.smithi120.stdout:7/0: write - no filename 2024-04-26T21:25:37.782 INFO:tasks.workunit.client.1.smithi120.stdout:7/1: dread - no filename 2024-04-26T21:25:37.782 INFO:tasks.workunit.client.1.smithi120.stdout:7/2: readlink - no filename 2024-04-26T21:25:37.783 INFO:tasks.workunit.client.1.smithi120.stdout:7/3: write - no filename 2024-04-26T21:25:37.783 INFO:tasks.workunit.client.1.smithi120.stdout:7/4: dwrite - no filename 2024-04-26T21:25:37.783 INFO:tasks.workunit.client.1.smithi120.stdout:7/5: link - no file 2024-04-26T21:25:37.785 INFO:tasks.workunit.client.1.smithi120.stdout:2/7: mkdir d4 0 2024-04-26T21:25:37.788 INFO:tasks.workunit.client.1.smithi120.stdout:6/4: mknod c0 0 2024-04-26T21:25:37.788 INFO:tasks.workunit.client.1.smithi120.stdout:6/5: write - no filename 2024-04-26T21:25:37.791 INFO:tasks.workunit.client.1.smithi120.stdout:8/0: chown . 21942848 1 2024-04-26T21:25:37.793 INFO:tasks.workunit.client.1.smithi120.stdout:8/1: chown . 242 1 2024-04-26T21:25:37.793 INFO:tasks.workunit.client.1.smithi120.stdout:2/8: getdents d4 0 2024-04-26T21:25:37.795 INFO:tasks.workunit.client.1.smithi120.stdout:6/6: creat f1 x:0 0 0 2024-04-26T21:25:37.804 INFO:tasks.workunit.client.1.smithi120.stdout:6/7: truncate f1 429636 0 2024-04-26T21:25:37.804 INFO:tasks.workunit.client.1.smithi120.stdout:8/2: creat f0 x:0 0 0 2024-04-26T21:25:37.805 INFO:tasks.workunit.client.1.smithi120.stdout:9/0: mkdir d0 0 2024-04-26T21:25:37.805 INFO:tasks.workunit.client.1.smithi120.stdout:9/1: write - no filename 2024-04-26T21:25:37.807 INFO:tasks.workunit.client.1.smithi120.stdout:2/9: symlink d4/l5 0 2024-04-26T21:25:37.812 INFO:tasks.workunit.client.1.smithi120.stdout:8/3: chown f0 59876291 1 2024-04-26T21:25:37.813 INFO:tasks.workunit.client.1.smithi120.stdout:2/10: readlink d4/l5 0 2024-04-26T21:25:37.816 INFO:tasks.workunit.client.1.smithi120.stdout:3/4: dwrite f0 [0,4194304] 0 2024-04-26T21:25:37.818 INFO:tasks.workunit.client.1.smithi120.stdout:6/8: dread f1 [0,4194304] 0 2024-04-26T21:25:37.819 INFO:tasks.workunit.client.1.smithi120.stdout:9/2: creat d0/f1 x:0 0 0 2024-04-26T21:25:37.822 INFO:tasks.workunit.client.1.smithi120.stdout:2/11: write f3 [1607403,25014] 0 2024-04-26T21:25:37.824 INFO:tasks.workunit.client.1.smithi120.stdout:5/3: dwrite f0 [0,4194304] 0 2024-04-26T21:25:37.824 INFO:tasks.workunit.client.1.smithi120.stdout:6/9: stat f1 0 2024-04-26T21:25:37.824 INFO:tasks.workunit.client.1.smithi120.stdout:8/4: mknod c1 0 2024-04-26T21:25:37.825 INFO:tasks.workunit.client.1.smithi120.stdout:3/5: mknod c2 0 2024-04-26T21:25:37.828 INFO:tasks.workunit.client.1.smithi120.stdout:9/3: mkdir d0/d2 0 2024-04-26T21:25:37.829 INFO:tasks.workunit.client.1.smithi120.stdout:4/4: dwrite f0 [0,4194304] 0 2024-04-26T21:25:37.829 INFO:tasks.workunit.client.1.smithi120.stdout:2/12: chown d4 315001 1 2024-04-26T21:25:37.829 INFO:tasks.workunit.client.1.smithi120.stdout:3/6: readlink l1 0 2024-04-26T21:25:37.830 INFO:tasks.workunit.client.1.smithi120.stdout:9/4: dread - d0/f1 zero size 2024-04-26T21:25:37.834 INFO:tasks.workunit.client.1.smithi120.stdout:5/4: rename f0 to f1 0 2024-04-26T21:25:37.836 INFO:tasks.workunit.client.1.smithi120.stdout:8/5: unlink c1 0 2024-04-26T21:25:37.840 INFO:tasks.workunit.client.1.smithi120.stdout:4/5: creat f1 x:0 0 0 2024-04-26T21:25:37.840 INFO:tasks.workunit.client.1.smithi120.stdout:4/6: readlink - no filename 2024-04-26T21:25:37.842 INFO:tasks.workunit.client.1.smithi120.stdout:2/13: symlink d4/l6 0 2024-04-26T21:25:37.843 INFO:tasks.workunit.client.1.smithi120.stdout:8/6: creat f2 x:0 0 0 2024-04-26T21:25:37.848 INFO:tasks.workunit.client.1.smithi120.stdout:4/7: write f0 [1743454,41742] 0 2024-04-26T21:25:37.848 INFO:tasks.workunit.client.1.smithi120.stdout:2/14: chown c2 0 1 2024-04-26T21:25:37.866 INFO:tasks.workunit.client.1.smithi120.stdout:8/7: symlink l3 0 2024-04-26T21:25:37.870 INFO:tasks.workunit.client.1.smithi120.stdout:4/8: write f0 [3914875,95925] 0 2024-04-26T21:25:37.881 INFO:tasks.workunit.client.1.smithi120.stdout:9/5: dwrite d0/f1 [0,4194304] 0 2024-04-26T21:25:37.889 INFO:tasks.workunit.client.1.smithi120.stdout:6/10: dwrite f1 [0,4194304] 0 2024-04-26T21:25:37.889 INFO:tasks.workunit.client.1.smithi120.stdout:8/8: rename f0 to f4 0 2024-04-26T21:25:37.890 INFO:tasks.workunit.client.1.smithi120.stdout:9/6: chown d0/d2 10 1 2024-04-26T21:25:37.894 INFO:tasks.workunit.client.1.smithi120.stdout:9/7: chown d0/d2 918832 1 2024-04-26T21:25:37.895 INFO:tasks.workunit.client.1.smithi120.stdout:4/9: creat f2 x:0 0 0 2024-04-26T21:25:37.899 INFO:tasks.workunit.client.1.smithi120.stdout:3/7: dwrite f0 [0,4194304] 0 2024-04-26T21:25:37.904 INFO:tasks.workunit.client.1.smithi120.stdout:5/5: dread f1 [0,4194304] 0 2024-04-26T21:25:37.907 INFO:tasks.workunit.client.1.smithi120.stdout:9/8: write d0/f1 [1321414,98775] 0 2024-04-26T21:25:37.909 INFO:tasks.workunit.client.1.smithi120.stdout:8/9: mkdir d5 0 2024-04-26T21:25:37.910 INFO:tasks.workunit.client.1.smithi120.stdout:6/11: unlink c0 0 2024-04-26T21:25:37.910 INFO:tasks.workunit.client.1.smithi120.stdout:2/15: dwrite f1 [0,4194304] 0 2024-04-26T21:25:37.911 INFO:tasks.workunit.client.1.smithi120.stdout:1/17: unlink c3 0 2024-04-26T21:25:37.913 INFO:tasks.workunit.client.1.smithi120.stdout:5/6: write f1 [1933041,53507] 0 2024-04-26T21:25:37.914 INFO:tasks.workunit.client.1.smithi120.stdout:6/12: mknod c2 0 2024-04-26T21:25:37.920 INFO:tasks.workunit.client.1.smithi120.stdout:3/8: rename f0 to f3 0 2024-04-26T21:25:37.921 INFO:tasks.workunit.client.1.smithi120.stdout:1/18: creat f4 x:0 0 0 2024-04-26T21:25:37.923 INFO:tasks.workunit.client.1.smithi120.stdout:8/10: mkdir d5/d6 0 2024-04-26T21:25:37.923 INFO:tasks.workunit.client.1.smithi120.stdout:9/9: getdents d0/d2 0 2024-04-26T21:25:37.925 INFO:tasks.workunit.client.1.smithi120.stdout:8/11: stat l3 0 2024-04-26T21:25:37.926 INFO:tasks.workunit.client.1.smithi120.stdout:3/9: mknod c4 0 2024-04-26T21:25:37.935 INFO:tasks.workunit.client.1.smithi120.stdout:3/10: creat f5 x:0 0 0 2024-04-26T21:25:37.935 INFO:tasks.workunit.client.1.smithi120.stdout:9/10: getdents d0/d2 0 2024-04-26T21:25:37.935 INFO:tasks.workunit.client.1.smithi120.stdout:2/16: dread f3 [0,4194304] 0 2024-04-26T21:25:37.936 INFO:tasks.workunit.client.1.smithi120.stdout:4/10: dwrite f0 [0,4194304] 0 2024-04-26T21:25:37.937 INFO:tasks.workunit.client.1.smithi120.stdout:3/11: dread - f5 zero size 2024-04-26T21:25:37.941 INFO:tasks.workunit.client.1.smithi120.stdout:8/12: link l3 d5/d6/l7 0 2024-04-26T21:25:37.942 INFO:tasks.workunit.client.1.smithi120.stdout:2/17: mknod d4/c7 0 2024-04-26T21:25:37.948 INFO:tasks.workunit.client.1.smithi120.stdout:3/12: creat f6 x:0 0 0 2024-04-26T21:25:37.951 INFO:tasks.workunit.client.1.smithi120.stdout:5/7: dread f1 [0,4194304] 0 2024-04-26T21:25:37.951 INFO:tasks.workunit.client.1.smithi120.stdout:3/13: symlink l7 0 2024-04-26T21:25:37.952 INFO:tasks.workunit.client.1.smithi120.stdout:6/13: dread f1 [0,4194304] 0 2024-04-26T21:25:37.957 INFO:tasks.workunit.client.1.smithi120.stdout:9/11: getdents d0 0 2024-04-26T21:25:37.958 INFO:tasks.workunit.client.1.smithi120.stdout:1/19: dwrite f4 [0,4194304] 0 2024-04-26T21:25:37.960 INFO:tasks.workunit.client.1.smithi120.stdout:3/14: rename f3 to f8 0 2024-04-26T21:25:37.961 INFO:tasks.workunit.client.1.smithi120.stdout:8/13: link l3 d5/d6/l8 0 2024-04-26T21:25:37.966 INFO:tasks.workunit.client.1.smithi120.stdout:6/14: write f1 [5184155,96122] 0 2024-04-26T21:25:37.977 INFO:tasks.workunit.client.1.smithi120.stdout:8/14: symlink d5/d6/l9 0 2024-04-26T21:25:37.981 INFO:tasks.workunit.client.1.smithi120.stdout:4/11: dwrite f1 [0,4194304] 0 2024-04-26T21:25:37.981 INFO:tasks.workunit.client.1.smithi120.stdout:2/18: dread f1 [0,4194304] 0 2024-04-26T21:25:37.982 INFO:tasks.workunit.client.1.smithi120.stdout:4/12: stat f1 0 2024-04-26T21:25:37.984 INFO:tasks.workunit.client.1.smithi120.stdout:3/15: rename f8 to f9 0 2024-04-26T21:25:37.985 INFO:tasks.workunit.client.1.smithi120.stdout:3/16: rmdir - no directory 2024-04-26T21:25:37.985 INFO:tasks.workunit.client.1.smithi120.stdout:3/17: rmdir - no directory 2024-04-26T21:25:37.986 INFO:tasks.workunit.client.1.smithi120.stdout:2/19: symlink d4/l8 0 2024-04-26T21:25:37.988 INFO:tasks.workunit.client.1.smithi120.stdout:4/13: rename f1 to f3 0 2024-04-26T21:25:37.992 INFO:tasks.workunit.client.1.smithi120.stdout:4/14: truncate f2 930999 0 2024-04-26T21:25:37.992 INFO:tasks.workunit.client.1.smithi120.stdout:1/20: dread f4 [0,4194304] 0 2024-04-26T21:25:37.994 INFO:tasks.workunit.client.1.smithi120.stdout:5/8: dwrite f1 [4194304,4194304] 0 2024-04-26T21:25:37.994 INFO:tasks.workunit.client.1.smithi120.stdout:2/20: symlink d4/l9 0 2024-04-26T21:25:37.994 INFO:tasks.workunit.client.1.smithi120.stdout:4/15: truncate f2 1056847 0 2024-04-26T21:25:37.996 INFO:tasks.workunit.client.1.smithi120.stdout:9/12: dwrite d0/f1 [0,4194304] 0 2024-04-26T21:25:37.997 INFO:tasks.workunit.client.1.smithi120.stdout:4/16: chown f2 0 1 2024-04-26T21:25:37.997 INFO:tasks.workunit.client.1.smithi120.stdout:4/17: rmdir - no directory 2024-04-26T21:25:38.001 INFO:tasks.workunit.client.1.smithi120.stdout:4/18: fsync f2 0 2024-04-26T21:25:38.001 INFO:tasks.workunit.client.1.smithi120.stdout:2/21: mkdir d4/da 0 2024-04-26T21:25:38.004 INFO:tasks.workunit.client.1.smithi120.stdout:9/13: mknod d0/c3 0 2024-04-26T21:25:38.008 INFO:tasks.workunit.client.1.smithi120.stdout:9/14: mknod d0/c4 0 2024-04-26T21:25:38.011 INFO:tasks.workunit.client.1.smithi120.stdout:2/22: write f1 [3840629,104071] 0 2024-04-26T21:25:38.026 INFO:tasks.workunit.client.1.smithi120.stdout:3/18: dwrite f5 [0,4194304] 0 2024-04-26T21:25:38.029 INFO:tasks.workunit.client.1.smithi120.stdout:3/19: readlink l7 0 2024-04-26T21:25:38.033 INFO:tasks.workunit.client.1.smithi120.stdout:5/9: dread f1 [0,4194304] 0 2024-04-26T21:25:38.035 INFO:tasks.workunit.client.1.smithi120.stdout:1/21: dwrite f4 [0,4194304] 0 2024-04-26T21:25:38.037 INFO:tasks.workunit.client.1.smithi120.stdout:5/10: chown f1 22 1 2024-04-26T21:25:38.039 INFO:tasks.workunit.client.1.smithi120.stdout:3/20: link f6 fa 0 2024-04-26T21:25:38.040 INFO:tasks.workunit.client.1.smithi120.stdout:5/11: mkdir d2 0 2024-04-26T21:25:38.041 INFO:tasks.workunit.client.1.smithi120.stdout:4/19: dwrite f3 [0,4194304] 0 2024-04-26T21:25:38.041 INFO:tasks.workunit.client.1.smithi120.stdout:3/21: chown l7 637 1 2024-04-26T21:25:38.041 INFO:tasks.workunit.client.1.smithi120.stdout:9/15: dread d0/f1 [0,4194304] 0 2024-04-26T21:25:38.041 INFO:tasks.workunit.client.1.smithi120.stdout:1/22: link c2 c5 0 2024-04-26T21:25:38.042 INFO:tasks.workunit.client.1.smithi120.stdout:5/12: read f1 [834453,95991] 0 2024-04-26T21:25:38.042 INFO:tasks.workunit.client.1.smithi120.stdout:1/23: stat f4 0 2024-04-26T21:25:38.043 INFO:tasks.workunit.client.1.smithi120.stdout:3/22: fdatasync f9 0 2024-04-26T21:25:38.043 INFO:tasks.workunit.client.1.smithi120.stdout:4/20: symlink l4 0 2024-04-26T21:25:38.044 INFO:tasks.workunit.client.1.smithi120.stdout:5/13: chown f1 24533 1 2024-04-26T21:25:38.044 INFO:tasks.workunit.client.1.smithi120.stdout:2/23: dread f1 [0,4194304] 0 2024-04-26T21:25:38.045 INFO:tasks.workunit.client.1.smithi120.stdout:9/16: write d0/f1 [2470259,11405] 0 2024-04-26T21:25:38.046 INFO:tasks.workunit.client.1.smithi120.stdout:3/23: mknod cb 0 2024-04-26T21:25:38.048 INFO:tasks.workunit.client.1.smithi120.stdout:4/21: creat f5 x:0 0 0 2024-04-26T21:25:38.048 INFO:tasks.workunit.client.1.smithi120.stdout:1/24: stat c5 0 2024-04-26T21:25:38.053 INFO:tasks.workunit.client.1.smithi120.stdout:4/22: rename f3 to f6 0 2024-04-26T21:25:38.054 INFO:tasks.workunit.client.1.smithi120.stdout:4/23: write f2 [1033005,22189] 0 2024-04-26T21:25:38.055 INFO:tasks.workunit.client.1.smithi120.stdout:1/25: mkdir d6 0 2024-04-26T21:25:38.059 INFO:tasks.workunit.client.1.smithi120.stdout:2/24: symlink d4/da/lb 0 2024-04-26T21:25:38.059 INFO:tasks.workunit.client.1.smithi120.stdout:4/24: rename l4 to l7 0 2024-04-26T21:25:38.061 INFO:tasks.workunit.client.1.smithi120.stdout:4/25: dread - f5 zero size 2024-04-26T21:25:38.063 INFO:tasks.workunit.client.1.smithi120.stdout:1/26: mkdir d6/d7 0 2024-04-26T21:25:38.066 INFO:tasks.workunit.client.1.smithi120.stdout:1/27: rename d6 to d6/d7/d8 22 2024-04-26T21:25:38.067 INFO:tasks.workunit.client.1.smithi120.stdout:5/14: dread f1 [0,4194304] 0 2024-04-26T21:25:38.068 INFO:tasks.workunit.client.1.smithi120.stdout:1/28: truncate f4 4316976 0 2024-04-26T21:25:38.071 INFO:tasks.workunit.client.1.smithi120.stdout:5/15: write f1 [4442851,82603] 0 2024-04-26T21:25:38.071 INFO:tasks.workunit.client.1.smithi120.stdout:3/24: dwrite f6 [0,4194304] 0 2024-04-26T21:25:38.075 INFO:tasks.workunit.client.1.smithi120.stdout:5/16: creat d2/f3 x:0 0 0 2024-04-26T21:25:38.077 INFO:tasks.workunit.client.1.smithi120.stdout:5/17: chown f1 8 1 2024-04-26T21:25:38.078 INFO:tasks.workunit.client.1.smithi120.stdout:5/18: dread - d2/f3 zero size 2024-04-26T21:25:38.081 INFO:tasks.workunit.client.1.smithi120.stdout:5/19: write d2/f3 [709682,28072] 0 2024-04-26T21:25:38.086 INFO:tasks.workunit.client.1.smithi120.stdout:5/20: creat d2/f4 x:0 0 0 2024-04-26T21:25:38.090 INFO:tasks.workunit.client.1.smithi120.stdout:2/25: truncate f3 481204 0 2024-04-26T21:25:38.091 INFO:tasks.workunit.client.1.smithi120.stdout:4/26: truncate f0 3944945 0 2024-04-26T21:25:38.093 INFO:tasks.workunit.client.1.smithi120.stdout:1/29: dwrite f4 [4194304,4194304] 0 2024-04-26T21:25:38.096 INFO:tasks.workunit.client.1.smithi120.stdout:4/27: creat f8 x:0 0 0 2024-04-26T21:25:38.098 INFO:tasks.workunit.client.1.smithi120.stdout:4/28: read f6 [2489011,2081] 0 2024-04-26T21:25:38.098 INFO:tasks.workunit.client.1.smithi120.stdout:4/29: fdatasync f2 0 2024-04-26T21:25:38.099 INFO:tasks.workunit.client.1.smithi120.stdout:1/30: mkdir d6/d9 0 2024-04-26T21:25:38.099 INFO:tasks.workunit.client.1.smithi120.stdout:4/30: read - f5 zero size 2024-04-26T21:25:38.102 INFO:tasks.workunit.client.1.smithi120.stdout:2/26: dread f3 [0,4194304] 0 2024-04-26T21:25:38.102 INFO:tasks.workunit.client.1.smithi120.stdout:5/21: getdents d2 0 2024-04-26T21:25:38.105 INFO:tasks.workunit.client.1.smithi120.stdout:2/27: read f3 [299648,113401] 0 2024-04-26T21:25:38.106 INFO:tasks.workunit.client.1.smithi120.stdout:4/31: write f2 [1795227,112979] 0 2024-04-26T21:25:38.109 INFO:tasks.workunit.client.1.smithi120.stdout:5/22: unlink d2/f4 0 2024-04-26T21:25:38.110 INFO:tasks.workunit.client.1.smithi120.stdout:1/31: mkdir d6/d7/da 0 2024-04-26T21:25:38.110 INFO:tasks.workunit.client.1.smithi120.stdout:1/32: readlink - no filename 2024-04-26T21:25:38.112 INFO:tasks.workunit.client.1.smithi120.stdout:1/33: write f4 [7266719,98238] 0 2024-04-26T21:25:38.116 INFO:tasks.workunit.client.1.smithi120.stdout:5/23: rename d2/f3 to d2/f5 0 2024-04-26T21:25:38.118 INFO:tasks.workunit.client.1.smithi120.stdout:4/32: dread f2 [0,4194304] 0 2024-04-26T21:25:38.120 INFO:tasks.workunit.client.1.smithi120.stdout:5/24: mknod d2/c6 0 2024-04-26T21:25:38.121 INFO:tasks.workunit.client.1.smithi120.stdout:5/25: read f1 [7188909,120390] 0 2024-04-26T21:25:38.123 INFO:tasks.workunit.client.1.smithi120.stdout:5/26: mknod d2/c7 0 2024-04-26T21:25:38.126 INFO:tasks.workunit.client.1.smithi120.stdout:5/27: write f1 [6957944,109562] 0 2024-04-26T21:25:38.127 INFO:tasks.workunit.client.1.smithi120.stdout:2/28: write f3 [1314075,43094] 0 2024-04-26T21:25:38.131 INFO:tasks.workunit.client.1.smithi120.stdout:1/34: truncate f4 1427671 0 2024-04-26T21:25:38.133 INFO:tasks.workunit.client.1.smithi120.stdout:2/29: write f1 [178653,115216] 0 2024-04-26T21:25:38.136 INFO:tasks.workunit.client.1.smithi120.stdout:1/35: write f4 [1894978,35238] 0 2024-04-26T21:25:38.138 INFO:tasks.workunit.client.1.smithi120.stdout:2/30: symlink d4/da/lc 0 2024-04-26T21:25:38.141 INFO:tasks.workunit.client.1.smithi120.stdout:1/36: write f4 [1837386,15991] 0 2024-04-26T21:25:38.141 INFO:tasks.workunit.client.1.smithi120.stdout:1/37: readlink - no filename 2024-04-26T21:25:38.142 INFO:tasks.workunit.client.1.smithi120.stdout:2/31: mkdir d4/dd 0 2024-04-26T21:25:38.146 INFO:tasks.workunit.client.1.smithi120.stdout:2/32: mknod d4/da/ce 0 2024-04-26T21:25:38.147 INFO:tasks.workunit.client.1.smithi120.stdout:1/38: creat d6/d7/da/fb x:0 0 0 2024-04-26T21:25:38.149 INFO:tasks.workunit.client.1.smithi120.stdout:2/33: chown f3 416032760 1 2024-04-26T21:25:38.150 INFO:tasks.workunit.client.1.smithi120.stdout:4/33: dwrite f0 [0,4194304] 0 2024-04-26T21:25:38.150 INFO:tasks.workunit.client.1.smithi120.stdout:1/39: dread - d6/d7/da/fb zero size 2024-04-26T21:25:38.151 INFO:tasks.workunit.client.1.smithi120.stdout:5/28: dwrite d2/f5 [0,4194304] 0 2024-04-26T21:25:38.153 INFO:tasks.workunit.client.1.smithi120.stdout:2/34: creat d4/da/ff x:0 0 0 2024-04-26T21:25:38.162 INFO:tasks.workunit.client.1.smithi120.stdout:1/40: rename f4 to d6/fc 0 2024-04-26T21:25:38.162 INFO:tasks.workunit.client.1.smithi120.stdout:2/35: creat d4/f10 x:0 0 0 2024-04-26T21:25:38.163 INFO:tasks.workunit.client.1.smithi120.stdout:5/29: getdents d2 0 2024-04-26T21:25:38.164 INFO:tasks.workunit.client.1.smithi120.stdout:1/41: write d6/d7/da/fb [834623,14901] 0 2024-04-26T21:25:38.165 INFO:tasks.workunit.client.1.smithi120.stdout:2/36: symlink d4/l11 0 2024-04-26T21:25:38.169 INFO:tasks.workunit.client.1.smithi120.stdout:2/37: write f1 [1226354,102952] 0 2024-04-26T21:25:38.170 INFO:tasks.workunit.client.1.smithi120.stdout:1/42: mkdir d6/d7/da/dd 0 2024-04-26T21:25:38.172 INFO:tasks.workunit.client.1.smithi120.stdout:5/30: rename d2/f5 to d2/f8 0 2024-04-26T21:25:38.178 INFO:tasks.workunit.client.1.smithi120.stdout:4/34: dwrite f0 [0,4194304] 0 2024-04-26T21:25:38.179 INFO:tasks.workunit.client.1.smithi120.stdout:2/38: link c0 d4/c12 0 2024-04-26T21:25:38.181 INFO:tasks.workunit.client.1.smithi120.stdout:1/43: creat d6/d7/da/dd/fe x:0 0 0 2024-04-26T21:25:38.184 INFO:tasks.workunit.client.1.smithi120.stdout:2/39: creat d4/f13 x:0 0 0 2024-04-26T21:25:38.185 INFO:tasks.workunit.client.1.smithi120.stdout:5/31: truncate f1 5524141 0 2024-04-26T21:25:38.189 INFO:tasks.workunit.client.1.smithi120.stdout:2/40: mkdir d4/dd/d14 0 2024-04-26T21:25:38.191 INFO:tasks.workunit.client.1.smithi120.stdout:2/41: truncate f3 2214448 0 2024-04-26T21:25:38.194 INFO:tasks.workunit.client.1.smithi120.stdout:2/42: mkdir d4/dd/d14/d15 0 2024-04-26T21:25:38.195 INFO:tasks.workunit.client.1.smithi120.stdout:4/35: dread f6 [0,4194304] 0 2024-04-26T21:25:38.195 INFO:tasks.workunit.client.1.smithi120.stdout:2/43: readlink d4/l5 0 2024-04-26T21:25:38.197 INFO:tasks.workunit.client.1.smithi120.stdout:4/36: creat f9 x:0 0 0 2024-04-26T21:25:38.197 INFO:tasks.workunit.client.1.smithi120.stdout:1/44: fsync d6/d7/da/dd/fe 0 2024-04-26T21:25:38.199 INFO:tasks.workunit.client.1.smithi120.stdout:4/37: chown l7 432 1 2024-04-26T21:25:38.201 INFO:tasks.workunit.client.1.smithi120.stdout:2/44: symlink d4/dd/d14/d15/l16 0 2024-04-26T21:25:38.202 INFO:tasks.workunit.client.1.smithi120.stdout:1/45: rmdir d6 39 2024-04-26T21:25:38.203 INFO:tasks.workunit.client.1.smithi120.stdout:4/38: symlink la 0 2024-04-26T21:25:38.204 INFO:tasks.workunit.client.1.smithi120.stdout:2/45: mknod d4/dd/d14/d15/c17 0 2024-04-26T21:25:38.208 INFO:tasks.workunit.client.1.smithi120.stdout:5/32: write f1 [1107463,3954] 0 2024-04-26T21:25:38.210 INFO:tasks.workunit.client.1.smithi120.stdout:2/46: unlink c0 0 2024-04-26T21:25:38.212 INFO:tasks.workunit.client.1.smithi120.stdout:2/47: dread - d4/f10 zero size 2024-04-26T21:25:38.213 INFO:tasks.workunit.client.1.smithi120.stdout:1/46: dread d6/fc [0,4194304] 0 2024-04-26T21:25:38.215 INFO:tasks.workunit.client.1.smithi120.stdout:5/33: rename f1 to d2/f9 0 2024-04-26T21:25:38.216 INFO:tasks.workunit.client.1.smithi120.stdout:2/48: creat d4/dd/d14/d15/f18 x:0 0 0 2024-04-26T21:25:38.217 INFO:tasks.workunit.client.1.smithi120.stdout:5/34: creat d2/fa x:0 0 0 2024-04-26T21:25:38.219 INFO:tasks.workunit.client.1.smithi120.stdout:2/49: mknod d4/dd/c19 0 2024-04-26T21:25:38.220 INFO:tasks.workunit.client.1.smithi120.stdout:5/35: mkdir d2/db 0 2024-04-26T21:25:38.221 INFO:tasks.workunit.client.1.smithi120.stdout:2/50: chown d4/l5 6 1 2024-04-26T21:25:38.221 INFO:tasks.workunit.client.1.smithi120.stdout:4/39: dwrite f5 [0,4194304] 0 2024-04-26T21:25:38.223 INFO:tasks.workunit.client.1.smithi120.stdout:5/36: mkdir d2/dc 0 2024-04-26T21:25:38.228 INFO:tasks.workunit.client.1.smithi120.stdout:4/40: mknod cb 0 2024-04-26T21:25:38.233 INFO:tasks.workunit.client.1.smithi120.stdout:4/41: creat fc x:0 0 0 2024-04-26T21:25:38.238 INFO:tasks.workunit.client.1.smithi120.stdout:1/47: dwrite d6/d7/da/dd/fe [0,4194304] 0 2024-04-26T21:25:38.239 INFO:tasks.workunit.client.1.smithi120.stdout:5/37: truncate d2/f9 297596 0 2024-04-26T21:25:38.241 INFO:tasks.workunit.client.1.smithi120.stdout:4/42: rename la to ld 0 2024-04-26T21:25:38.242 INFO:tasks.workunit.client.1.smithi120.stdout:1/48: write d6/d7/da/fb [899000,130286] 0 2024-04-26T21:25:38.243 INFO:tasks.workunit.client.1.smithi120.stdout:4/43: stat f9 0 2024-04-26T21:25:38.247 INFO:tasks.workunit.client.1.smithi120.stdout:2/51: symlink d4/dd/l1a 0 2024-04-26T21:25:38.249 INFO:tasks.workunit.client.1.smithi120.stdout:5/38: creat d2/dc/fd x:0 0 0 2024-04-26T21:25:38.251 INFO:tasks.workunit.client.1.smithi120.stdout:4/44: creat fe x:0 0 0 2024-04-26T21:25:38.261 INFO:tasks.workunit.client.1.smithi120.stdout:2/52: mkdir d4/d1b 0 2024-04-26T21:25:38.261 INFO:tasks.workunit.client.1.smithi120.stdout:4/45: fsync f6 0 2024-04-26T21:25:38.263 INFO:tasks.workunit.client.1.smithi120.stdout:1/49: dwrite d6/d7/da/dd/fe [4194304,4194304] 0 2024-04-26T21:25:38.266 INFO:tasks.workunit.client.1.smithi120.stdout:1/50: creat d6/d7/ff x:0 0 0 2024-04-26T21:25:38.267 INFO:tasks.workunit.client.1.smithi120.stdout:1/51: read - d6/d7/ff zero size 2024-04-26T21:25:38.272 INFO:tasks.workunit.client.1.smithi120.stdout:2/53: link d4/l8 d4/da/l1c 0 2024-04-26T21:25:38.272 INFO:tasks.workunit.client.1.smithi120.stdout:1/52: mknod d6/d7/da/dd/c10 0 2024-04-26T21:25:38.273 INFO:tasks.workunit.client.1.smithi120.stdout:1/53: readlink - no filename 2024-04-26T21:25:38.274 INFO:tasks.workunit.client.1.smithi120.stdout:1/54: write d6/d7/ff [247371,125586] 0 2024-04-26T21:25:38.275 INFO:tasks.workunit.client.1.smithi120.stdout:4/46: fsync fe 0 2024-04-26T21:25:38.277 INFO:tasks.workunit.client.1.smithi120.stdout:2/54: symlink d4/d1b/l1d 0 2024-04-26T21:25:38.281 INFO:tasks.workunit.client.1.smithi120.stdout:5/39: dread d2/f9 [0,4194304] 0 2024-04-26T21:25:38.281 INFO:tasks.workunit.client.1.smithi120.stdout:4/47: mknod cf 0 2024-04-26T21:25:38.286 INFO:tasks.workunit.client.1.smithi120.stdout:2/55: link d4/l11 d4/dd/l1e 0 2024-04-26T21:25:38.288 INFO:tasks.workunit.client.1.smithi120.stdout:2/56: write f3 [585398,55692] 0 2024-04-26T21:25:38.290 INFO:tasks.workunit.client.1.smithi120.stdout:2/57: fsync f1 0 2024-04-26T21:25:38.294 INFO:tasks.workunit.client.1.smithi120.stdout:2/58: dread - d4/f10 zero size 2024-04-26T21:25:38.299 INFO:tasks.workunit.client.1.smithi120.stdout:1/55: dwrite d6/d7/da/dd/fe [4194304,4194304] 0 2024-04-26T21:25:38.301 INFO:tasks.workunit.client.1.smithi120.stdout:2/59: symlink d4/l1f 0 2024-04-26T21:25:38.305 INFO:tasks.workunit.client.1.smithi120.stdout:5/40: dwrite d2/dc/fd [0,4194304] 0 2024-04-26T21:25:38.305 INFO:tasks.workunit.client.1.smithi120.stdout:2/60: mknod d4/dd/d14/c20 0 2024-04-26T21:25:38.306 INFO:tasks.workunit.client.1.smithi120.stdout:4/48: dwrite f5 [0,4194304] 0 2024-04-26T21:25:38.312 INFO:tasks.workunit.client.1.smithi120.stdout:4/49: dread f2 [0,4194304] 0 2024-04-26T21:25:38.314 INFO:tasks.workunit.client.1.smithi120.stdout:5/41: rmdir d2 39 2024-04-26T21:25:38.316 INFO:tasks.workunit.client.1.smithi120.stdout:4/50: write f8 [432653,113921] 0 2024-04-26T21:25:38.318 INFO:tasks.workunit.client.1.smithi120.stdout:2/61: creat d4/dd/f21 x:0 0 0 2024-04-26T21:25:38.320 INFO:tasks.workunit.client.1.smithi120.stdout:2/62: write f1 [4966912,67815] 0 2024-04-26T21:25:38.323 INFO:tasks.workunit.client.1.smithi120.stdout:2/63: truncate d4/f10 508170 0 2024-04-26T21:25:38.324 INFO:tasks.workunit.client.1.smithi120.stdout:4/51: dread f2 [0,4194304] 0 2024-04-26T21:25:38.329 INFO:tasks.workunit.client.1.smithi120.stdout:5/42: rename d2/c7 to d2/db/ce 0 2024-04-26T21:25:38.333 INFO:tasks.workunit.client.1.smithi120.stdout:4/52: mkdir d10 0 2024-04-26T21:25:38.334 INFO:tasks.workunit.client.1.smithi120.stdout:2/64: dread f1 [0,4194304] 0 2024-04-26T21:25:38.334 INFO:tasks.workunit.client.1.smithi120.stdout:5/43: fsync d2/f8 0 2024-04-26T21:25:38.335 INFO:tasks.workunit.client.1.smithi120.stdout:5/44: chown d2/c6 25450 1 2024-04-26T21:25:38.336 INFO:tasks.workunit.client.1.smithi120.stdout:2/65: creat d4/da/f22 x:0 0 0 2024-04-26T21:25:38.338 INFO:tasks.workunit.client.1.smithi120.stdout:5/45: mknod d2/db/cf 0 2024-04-26T21:25:38.339 INFO:tasks.workunit.client.1.smithi120.stdout:5/46: chown d2/f9 208615924 1 2024-04-26T21:25:38.339 INFO:tasks.workunit.client.1.smithi120.stdout:2/66: rmdir d4/dd/d14/d15 39 2024-04-26T21:25:38.341 INFO:tasks.workunit.client.1.smithi120.stdout:5/47: write d2/fa [125175,33160] 0 2024-04-26T21:25:38.341 INFO:tasks.workunit.client.1.smithi120.stdout:2/67: mknod d4/d1b/c23 0 2024-04-26T21:25:38.342 INFO:tasks.workunit.client.1.smithi120.stdout:5/48: chown d2/db/cf 14892 1 2024-04-26T21:25:38.344 INFO:tasks.workunit.client.1.smithi120.stdout:2/68: chown d4/f13 4 1 2024-04-26T21:25:38.347 INFO:tasks.workunit.client.1.smithi120.stdout:2/69: write d4/f10 [177671,8937] 0 2024-04-26T21:25:38.348 INFO:tasks.workunit.client.1.smithi120.stdout:2/70: stat f3 0 2024-04-26T21:25:38.352 INFO:tasks.workunit.client.1.smithi120.stdout:4/53: dwrite fc [0,4194304] 0 2024-04-26T21:25:38.352 INFO:tasks.workunit.client.1.smithi120.stdout:5/49: getdents d2 0 2024-04-26T21:25:38.352 INFO:tasks.workunit.client.1.smithi120.stdout:4/54: stat f0 0 2024-04-26T21:25:38.355 INFO:tasks.workunit.client.1.smithi120.stdout:2/71: rename d4/dd/d14/c20 to d4/da/c24 0 2024-04-26T21:25:38.355 INFO:tasks.workunit.client.1.smithi120.stdout:5/50: rmdir d2 39 2024-04-26T21:25:38.357 INFO:tasks.workunit.client.1.smithi120.stdout:2/72: write d4/dd/f21 [1025497,73601] 0 2024-04-26T21:25:38.358 INFO:tasks.workunit.client.1.smithi120.stdout:2/73: chown d4/da 0 1 2024-04-26T21:25:38.360 INFO:tasks.workunit.client.1.smithi120.stdout:4/55: unlink fc 0 2024-04-26T21:25:38.361 INFO:tasks.workunit.client.1.smithi120.stdout:5/51: creat d2/db/f10 x:0 0 0 2024-04-26T21:25:38.364 INFO:tasks.workunit.client.1.smithi120.stdout:2/74: mkdir d4/d1b/d25 0 2024-04-26T21:25:38.366 INFO:tasks.workunit.client.1.smithi120.stdout:4/56: creat d10/f11 x:0 0 0 2024-04-26T21:25:38.367 INFO:tasks.workunit.client.1.smithi120.stdout:2/75: symlink d4/d1b/l26 0 2024-04-26T21:25:38.368 INFO:tasks.workunit.client.1.smithi120.stdout:2/76: fdatasync d4/f10 0 2024-04-26T21:25:38.388 INFO:tasks.workunit.client.1.smithi120.stdout:2/77: dwrite d4/f13 [0,4194304] 0 2024-04-26T21:25:38.408 INFO:tasks.workunit.client.1.smithi120.stdout:2/78: dwrite d4/f10 [0,4194304] 0 2024-04-26T21:25:38.410 INFO:tasks.workunit.client.1.smithi120.stdout:2/79: write d4/f13 [1357445,82550] 0 2024-04-26T21:25:38.413 INFO:tasks.workunit.client.1.smithi120.stdout:2/80: creat d4/dd/f27 x:0 0 0 2024-04-26T21:25:38.414 INFO:tasks.workunit.client.1.smithi120.stdout:2/81: write d4/f13 [3714934,87278] 0 2024-04-26T21:25:38.417 INFO:tasks.workunit.client.1.smithi120.stdout:2/82: write d4/dd/f21 [94834,28547] 0 2024-04-26T21:25:38.422 INFO:tasks.workunit.client.1.smithi120.stdout:2/83: creat d4/dd/d14/d15/f28 x:0 0 0 2024-04-26T21:25:38.424 INFO:tasks.workunit.client.1.smithi120.stdout:2/84: dread - d4/dd/d14/d15/f18 zero size 2024-04-26T21:25:38.426 INFO:tasks.workunit.client.1.smithi120.stdout:2/85: readlink d4/l6 0 2024-04-26T21:25:38.448 INFO:tasks.workunit.client.1.smithi120.stdout:2/86: dwrite d4/da/f22 [0,4194304] 0 2024-04-26T21:25:38.449 INFO:tasks.workunit.client.1.smithi120.stdout:2/87: readlink d4/l6 0 2024-04-26T21:25:38.452 INFO:tasks.workunit.client.1.smithi120.stdout:2/88: mkdir d4/d1b/d25/d29 0 2024-04-26T21:25:39.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:39 smithi084 ceph-mon[25539]: pgmap v34: 65 pgs: 65 active+clean; 218 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.0 MiB/s wr, 188 op/s 2024-04-26T21:25:39.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:39 smithi120 ceph-mon[32741]: pgmap v34: 65 pgs: 65 active+clean; 218 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.0 MiB/s wr, 188 op/s 2024-04-26T21:25:39.858 INFO:tasks.workunit.client.1.smithi120.stdout:0/8: sync 2024-04-26T21:25:39.858 INFO:tasks.workunit.client.1.smithi120.stdout:0/9: write - no filename 2024-04-26T21:25:39.858 INFO:tasks.workunit.client.1.smithi120.stdout:0/10: write - no filename 2024-04-26T21:25:39.864 INFO:tasks.workunit.client.1.smithi120.stdout:0/11: mknod d0/c1 0 2024-04-26T21:25:39.865 INFO:tasks.workunit.client.1.smithi120.stdout:0/12: dread - no filename 2024-04-26T21:25:39.865 INFO:tasks.workunit.client.1.smithi120.stdout:0/13: readlink - no filename 2024-04-26T21:25:39.866 INFO:tasks.workunit.client.1.smithi120.stdout:0/14: stat d0/c1 0 2024-04-26T21:25:39.977 INFO:tasks.workunit.client.1.smithi120.stdout:6/15: sync 2024-04-26T21:25:39.977 INFO:tasks.workunit.client.1.smithi120.stdout:3/25: sync 2024-04-26T21:25:39.978 INFO:tasks.workunit.client.1.smithi120.stdout:4/57: sync 2024-04-26T21:25:39.978 INFO:tasks.workunit.client.1.smithi120.stdout:9/17: sync 2024-04-26T21:25:39.978 INFO:tasks.workunit.client.1.smithi120.stdout:7/6: sync 2024-04-26T21:25:39.978 INFO:tasks.workunit.client.1.smithi120.stdout:2/89: sync 2024-04-26T21:25:39.978 INFO:tasks.workunit.client.1.smithi120.stdout:8/15: sync 2024-04-26T21:25:39.978 INFO:tasks.workunit.client.1.smithi120.stdout:1/56: sync 2024-04-26T21:25:39.978 INFO:tasks.workunit.client.1.smithi120.stdout:5/52: sync 2024-04-26T21:25:39.979 INFO:tasks.workunit.client.1.smithi120.stdout:6/16: chown c2 104843 1 2024-04-26T21:25:39.983 INFO:tasks.workunit.client.1.smithi120.stdout:1/57: fsync d6/d7/da/dd/fe 0 2024-04-26T21:25:39.983 INFO:tasks.workunit.client.1.smithi120.stdout:3/26: mknod cc 0 2024-04-26T21:25:39.986 INFO:tasks.workunit.client.1.smithi120.stdout:8/16: write f4 [684338,30580] 0 2024-04-26T21:25:39.988 INFO:tasks.workunit.client.1.smithi120.stdout:4/58: mkdir d10/d12 0 2024-04-26T21:25:39.995 INFO:tasks.workunit.client.1.smithi120.stdout:5/53: truncate d2/f9 675582 0 2024-04-26T21:25:39.999 INFO:tasks.workunit.client.1.smithi120.stdout:1/58: dread d6/d7/da/fb [0,4194304] 0 2024-04-26T21:25:40.000 INFO:tasks.workunit.client.1.smithi120.stdout:4/59: readlink ld 0 2024-04-26T21:25:40.001 INFO:tasks.workunit.client.1.smithi120.stdout:7/7: mknod c0 0 2024-04-26T21:25:40.001 INFO:tasks.workunit.client.1.smithi120.stdout:7/8: dread - no filename 2024-04-26T21:25:40.004 INFO:tasks.workunit.client.1.smithi120.stdout:5/54: symlink d2/l11 0 2024-04-26T21:25:40.006 INFO:tasks.workunit.client.1.smithi120.stdout:7/9: chown c0 1167 1 2024-04-26T21:25:40.006 INFO:tasks.workunit.client.1.smithi120.stdout:7/10: write - no filename 2024-04-26T21:25:40.006 INFO:tasks.workunit.client.1.smithi120.stdout:7/11: write - no filename 2024-04-26T21:25:40.006 INFO:tasks.workunit.client.1.smithi120.stdout:7/12: rmdir - no directory 2024-04-26T21:25:40.007 INFO:tasks.workunit.client.1.smithi120.stdout:1/59: chown d6/fc 0 1 2024-04-26T21:25:40.007 INFO:tasks.workunit.client.1.smithi120.stdout:6/17: link c2 c3 0 2024-04-26T21:25:40.011 INFO:tasks.workunit.client.1.smithi120.stdout:6/18: fdatasync f1 0 2024-04-26T21:25:40.013 INFO:tasks.workunit.client.1.smithi120.stdout:5/55: chown d2/fa 3 1 2024-04-26T21:25:40.016 INFO:tasks.workunit.client.1.smithi120.stdout:2/90: dwrite d4/da/ff [0,4194304] 0 2024-04-26T21:25:40.019 INFO:tasks.workunit.client.1.smithi120.stdout:3/27: dwrite f9 [0,4194304] 0 2024-04-26T21:25:40.020 INFO:tasks.workunit.client.1.smithi120.stdout:7/13: rename c0 to c1 0 2024-04-26T21:25:40.020 INFO:tasks.workunit.client.1.smithi120.stdout:7/14: readlink - no filename 2024-04-26T21:25:40.023 INFO:tasks.workunit.client.1.smithi120.stdout:8/17: dwrite f2 [0,4194304] 0 2024-04-26T21:25:40.023 INFO:tasks.workunit.client.1.smithi120.stdout:2/91: fdatasync d4/f10 0 2024-04-26T21:25:40.023 INFO:tasks.workunit.client.1.smithi120.stdout:5/56: mknod d2/db/c12 0 2024-04-26T21:25:40.027 INFO:tasks.workunit.client.1.smithi120.stdout:4/60: link cb d10/d12/c13 0 2024-04-26T21:25:40.030 INFO:tasks.workunit.client.1.smithi120.stdout:2/92: stat d4/dd/d14/d15 0 2024-04-26T21:25:40.030 INFO:tasks.workunit.client.1.smithi120.stdout:1/60: symlink d6/d9/l11 0 2024-04-26T21:25:40.031 INFO:tasks.workunit.client.1.smithi120.stdout:9/18: dwrite d0/f1 [0,4194304] 0 2024-04-26T21:25:40.033 INFO:tasks.workunit.client.1.smithi120.stdout:9/19: chown d0/f1 62112514 1 2024-04-26T21:25:40.109 INFO:tasks.workunit.client.1.smithi120.stdout:9/20: fdatasync d0/f1 0 2024-04-26T21:25:40.110 INFO:tasks.workunit.client.1.smithi120.stdout:5/57: dread d2/fa [0,4194304] 0 2024-04-26T21:25:40.110 INFO:tasks.workunit.client.1.smithi120.stdout:8/18: mkdir d5/d6/da 0 2024-04-26T21:25:40.113 INFO:tasks.workunit.client.1.smithi120.stdout:9/21: fsync d0/f1 0 2024-04-26T21:25:40.113 INFO:tasks.workunit.client.1.smithi120.stdout:2/93: creat d4/dd/f2a x:0 0 0 2024-04-26T21:25:40.117 INFO:tasks.workunit.client.1.smithi120.stdout:2/94: fsync d4/f10 0 2024-04-26T21:25:40.122 INFO:tasks.workunit.client.1.smithi120.stdout:3/28: dread f5 [0,4194304] 0 2024-04-26T21:25:40.128 INFO:tasks.workunit.client.1.smithi120.stdout:2/95: write d4/dd/d14/d15/f18 [157363,51791] 0 2024-04-26T21:25:40.136 INFO:tasks.workunit.client.1.smithi120.stdout:4/61: dwrite fe [0,4194304] 0 2024-04-26T21:25:40.137 INFO:tasks.workunit.client.1.smithi120.stdout:6/19: truncate f1 3639006 0 2024-04-26T21:25:40.138 INFO:tasks.workunit.client.1.smithi120.stdout:6/20: readlink - no filename 2024-04-26T21:25:40.138 INFO:tasks.workunit.client.1.smithi120.stdout:6/21: readlink - no filename 2024-04-26T21:25:40.142 INFO:tasks.workunit.client.1.smithi120.stdout:1/61: dwrite d6/fc [0,4194304] 0 2024-04-26T21:25:40.142 INFO:tasks.workunit.client.1.smithi120.stdout:5/58: rename d2/db/f10 to d2/f13 0 2024-04-26T21:25:40.145 INFO:tasks.workunit.client.1.smithi120.stdout:0/15: sync 2024-04-26T21:25:40.151 INFO:tasks.workunit.client.1.smithi120.stdout:6/22: mkdir d4 0 2024-04-26T21:25:40.156 INFO:tasks.workunit.client.1.smithi120.stdout:3/29: dwrite fa [0,4194304] 0 2024-04-26T21:25:40.157 INFO:tasks.workunit.client.1.smithi120.stdout:5/59: read d2/fa [151325,105500] 0 2024-04-26T21:25:40.157 INFO:tasks.workunit.client.1.smithi120.stdout:1/62: mknod d6/d7/c12 0 2024-04-26T21:25:40.158 INFO:tasks.workunit.client.1.smithi120.stdout:9/22: link d0/c4 d0/c5 0 2024-04-26T21:25:40.161 INFO:tasks.workunit.client.1.smithi120.stdout:8/19: rename d5/d6/l8 to d5/d6/da/lb 0 2024-04-26T21:25:40.164 INFO:tasks.workunit.client.1.smithi120.stdout:1/63: readlink d6/d9/l11 0 2024-04-26T21:25:40.168 INFO:tasks.workunit.client.1.smithi120.stdout:0/16: getdents d0 0 2024-04-26T21:25:40.170 INFO:tasks.workunit.client.1.smithi120.stdout:9/23: mkdir d0/d6 0 2024-04-26T21:25:40.172 INFO:tasks.workunit.client.1.smithi120.stdout:6/23: link c2 d4/c5 0 2024-04-26T21:25:40.173 INFO:tasks.workunit.client.1.smithi120.stdout:5/60: creat d2/db/f14 x:0 0 0 2024-04-26T21:25:40.174 INFO:tasks.workunit.client.1.smithi120.stdout:5/61: stat d2/fa 0 2024-04-26T21:25:40.174 INFO:tasks.workunit.client.1.smithi120.stdout:1/64: rename c5 to d6/d9/c13 0 2024-04-26T21:25:40.175 INFO:tasks.workunit.client.1.smithi120.stdout:2/96: dread d4/da/f22 [0,4194304] 0 2024-04-26T21:25:40.178 INFO:tasks.workunit.client.1.smithi120.stdout:0/17: creat d0/f2 x:0 0 0 2024-04-26T21:25:40.180 INFO:tasks.workunit.client.1.smithi120.stdout:1/65: mkdir d6/d14 0 2024-04-26T21:25:40.181 INFO:tasks.workunit.client.1.smithi120.stdout:4/62: dwrite d10/f11 [0,4194304] 0 2024-04-26T21:25:40.181 INFO:tasks.workunit.client.1.smithi120.stdout:9/24: rmdir d0 39 2024-04-26T21:25:40.183 INFO:tasks.workunit.client.1.smithi120.stdout:5/62: mknod d2/dc/c15 0 2024-04-26T21:25:40.183 INFO:tasks.workunit.client.1.smithi120.stdout:0/18: chown d0/f2 15919 1 2024-04-26T21:25:40.189 INFO:tasks.workunit.client.1.smithi120.stdout:2/97: write d4/da/f22 [1401784,13614] 0 2024-04-26T21:25:40.191 INFO:tasks.workunit.client.1.smithi120.stdout:1/66: truncate d6/d7/ff 907100 0 2024-04-26T21:25:40.192 INFO:tasks.workunit.client.1.smithi120.stdout:5/63: rmdir d2 39 2024-04-26T21:25:40.192 INFO:tasks.workunit.client.1.smithi120.stdout:8/20: rename d5/d6/da to d5/d6/dc 0 2024-04-26T21:25:40.193 INFO:tasks.workunit.client.1.smithi120.stdout:2/98: chown d4/dd 6902 1 2024-04-26T21:25:40.193 INFO:tasks.workunit.client.1.smithi120.stdout:3/30: dwrite f5 [0,4194304] 0 2024-04-26T21:25:40.194 INFO:tasks.workunit.client.1.smithi120.stdout:2/99: stat d4/d1b/l1d 0 2024-04-26T21:25:40.197 INFO:tasks.workunit.client.1.smithi120.stdout:4/63: creat d10/d12/f14 x:0 0 0 2024-04-26T21:25:40.198 INFO:tasks.workunit.client.1.smithi120.stdout:2/100: dread - d4/dd/f27 zero size 2024-04-26T21:25:40.199 INFO:tasks.workunit.client.1.smithi120.stdout:8/21: creat d5/d6/fd x:0 0 0 2024-04-26T21:25:40.202 INFO:tasks.workunit.client.1.smithi120.stdout:4/64: creat d10/d12/f15 x:0 0 0 2024-04-26T21:25:40.204 INFO:tasks.workunit.client.1.smithi120.stdout:9/25: getdents d0/d6 0 2024-04-26T21:25:40.204 INFO:tasks.workunit.client.1.smithi120.stdout:5/64: chown d2/f9 7095661 1 2024-04-26T21:25:40.209 INFO:tasks.workunit.client.1.smithi120.stdout:8/22: chown d5/d6/dc/lb 475 1 2024-04-26T21:25:40.210 INFO:tasks.workunit.client.1.smithi120.stdout:6/24: dread f1 [0,4194304] 0 2024-04-26T21:25:40.210 INFO:tasks.workunit.client.1.smithi120.stdout:5/65: write d2/f13 [114617,16118] 0 2024-04-26T21:25:40.212 INFO:tasks.workunit.client.1.smithi120.stdout:8/23: chown l3 20 1 2024-04-26T21:25:40.213 INFO:tasks.workunit.client.1.smithi120.stdout:4/65: rename cb to d10/d12/c16 0 2024-04-26T21:25:40.215 INFO:tasks.workunit.client.1.smithi120.stdout:9/26: symlink d0/d6/l7 0 2024-04-26T21:25:40.218 INFO:tasks.workunit.client.1.smithi120.stdout:6/25: chown c2 813994162 1 2024-04-26T21:25:40.218 INFO:tasks.workunit.client.1.smithi120.stdout:3/31: dread f6 [0,4194304] 0 2024-04-26T21:25:40.219 INFO:tasks.workunit.client.1.smithi120.stdout:5/66: creat d2/db/f16 x:0 0 0 2024-04-26T21:25:40.220 INFO:tasks.workunit.client.1.smithi120.stdout:8/24: creat d5/d6/fe x:0 0 0 2024-04-26T21:25:40.221 INFO:tasks.workunit.client.1.smithi120.stdout:0/19: dwrite d0/f2 [0,4194304] 0 2024-04-26T21:25:40.222 INFO:tasks.workunit.client.1.smithi120.stdout:3/32: mkdir dd 0 2024-04-26T21:25:40.223 INFO:tasks.workunit.client.1.smithi120.stdout:0/20: chown d0/c1 81663 1 2024-04-26T21:25:40.225 INFO:tasks.workunit.client.1.smithi120.stdout:6/26: truncate f1 4407931 0 2024-04-26T21:25:40.227 INFO:tasks.workunit.client.1.smithi120.stdout:5/67: write d2/fa [310808,47070] 0 2024-04-26T21:25:40.229 INFO:tasks.workunit.client.1.smithi120.stdout:5/68: chown d2/fa 10 1 2024-04-26T21:25:40.232 INFO:tasks.workunit.client.1.smithi120.stdout:2/101: truncate d4/f13 2667225 0 2024-04-26T21:25:40.232 INFO:tasks.workunit.client.1.smithi120.stdout:5/69: dread - d2/db/f16 zero size 2024-04-26T21:25:40.232 INFO:tasks.workunit.client.1.smithi120.stdout:4/66: rmdir d10 39 2024-04-26T21:25:40.233 INFO:tasks.workunit.client.1.smithi120.stdout:3/33: fdatasync fa 0 2024-04-26T21:25:40.236 INFO:tasks.workunit.client.1.smithi120.stdout:9/27: truncate d0/f1 3393110 0 2024-04-26T21:25:40.237 INFO:tasks.workunit.client.1.smithi120.stdout:3/34: write f6 [3250200,40230] 0 2024-04-26T21:25:40.237 INFO:tasks.workunit.client.1.smithi120.stdout:5/70: read d2/f9 [15601,64785] 0 2024-04-26T21:25:40.238 INFO:tasks.workunit.client.1.smithi120.stdout:0/21: rmdir d0 39 2024-04-26T21:25:40.243 INFO:tasks.workunit.client.1.smithi120.stdout:5/71: truncate d2/fa 361899 0 2024-04-26T21:25:40.244 INFO:tasks.workunit.client.1.smithi120.stdout:8/25: dwrite f4 [0,4194304] 0 2024-04-26T21:25:40.244 INFO:tasks.workunit.client.1.smithi120.stdout:7/15: sync 2024-04-26T21:25:40.244 INFO:tasks.workunit.client.1.smithi120.stdout:7/16: rmdir - no directory 2024-04-26T21:25:40.244 INFO:tasks.workunit.client.1.smithi120.stdout:3/35: unlink cc 0 2024-04-26T21:25:40.246 INFO:tasks.workunit.client.1.smithi120.stdout:2/102: dread d4/dd/d14/d15/f18 [0,4194304] 0 2024-04-26T21:25:40.252 INFO:tasks.workunit.client.1.smithi120.stdout:4/67: creat d10/d12/f17 x:0 0 0 2024-04-26T21:25:40.257 INFO:tasks.workunit.client.1.smithi120.stdout:8/26: mknod d5/cf 0 2024-04-26T21:25:40.259 INFO:tasks.workunit.client.1.smithi120.stdout:6/27: link d4/c5 d4/c6 0 2024-04-26T21:25:40.260 INFO:tasks.workunit.client.1.smithi120.stdout:8/27: chown d5/d6/l9 1041546793 1 2024-04-26T21:25:40.263 INFO:tasks.workunit.client.1.smithi120.stdout:0/22: mkdir d0/d3 0 2024-04-26T21:25:40.264 INFO:tasks.workunit.client.1.smithi120.stdout:3/36: getdents dd 0 2024-04-26T21:25:40.264 INFO:tasks.workunit.client.1.smithi120.stdout:2/103: creat d4/dd/d14/d15/f2b x:0 0 0 2024-04-26T21:25:40.265 INFO:tasks.workunit.client.1.smithi120.stdout:4/68: rename d10/d12/f17 to d10/d12/f18 0 2024-04-26T21:25:40.267 INFO:tasks.workunit.client.1.smithi120.stdout:5/72: dwrite d2/f8 [0,4194304] 0 2024-04-26T21:25:40.269 INFO:tasks.workunit.client.1.smithi120.stdout:8/28: creat d5/d6/dc/f10 x:0 0 0 2024-04-26T21:25:40.271 INFO:tasks.workunit.client.1.smithi120.stdout:6/28: read f1 [3891925,74685] 0 2024-04-26T21:25:40.271 INFO:tasks.workunit.client.1.smithi120.stdout:9/28: write d0/f1 [2585719,29966] 0 2024-04-26T21:25:40.271 INFO:tasks.workunit.client.1.smithi120.stdout:4/69: truncate d10/d12/f15 269881 0 2024-04-26T21:25:40.275 INFO:tasks.workunit.client.1.smithi120.stdout:3/37: mkdir dd/de 0 2024-04-26T21:25:40.276 INFO:tasks.workunit.client.1.smithi120.stdout:0/23: mknod d0/d3/c4 0 2024-04-26T21:25:40.277 INFO:tasks.workunit.client.1.smithi120.stdout:9/29: fsync d0/f1 0 2024-04-26T21:25:40.278 INFO:tasks.workunit.client.1.smithi120.stdout:4/70: creat d10/d12/f19 x:0 0 0 2024-04-26T21:25:40.279 INFO:tasks.workunit.client.1.smithi120.stdout:4/71: dread - d10/d12/f18 zero size 2024-04-26T21:25:40.282 INFO:tasks.workunit.client.1.smithi120.stdout:5/73: read d2/f13 [55,91361] 0 2024-04-26T21:25:40.291 INFO:tasks.workunit.client.1.smithi120.stdout:6/29: mkdir d4/d7 0 2024-04-26T21:25:40.291 INFO:tasks.workunit.client.1.smithi120.stdout:8/29: rename d5/d6/dc to d5/d6/d11 0 2024-04-26T21:25:40.295 INFO:tasks.workunit.client.1.smithi120.stdout:0/24: creat d0/d3/f5 x:0 0 0 2024-04-26T21:25:40.295 INFO:tasks.workunit.client.1.smithi120.stdout:9/30: creat d0/d6/f8 x:0 0 0 2024-04-26T21:25:40.296 INFO:tasks.workunit.client.1.smithi120.stdout:4/72: creat d10/d12/f1a x:0 0 0 2024-04-26T21:25:40.296 INFO:tasks.workunit.client.1.smithi120.stdout:4/73: stat f9 0 2024-04-26T21:25:40.297 INFO:tasks.workunit.client.1.smithi120.stdout:5/74: creat d2/f17 x:0 0 0 2024-04-26T21:25:40.298 INFO:tasks.workunit.client.1.smithi120.stdout:3/38: mkdir dd/de/df 0 2024-04-26T21:25:40.299 INFO:tasks.workunit.client.1.smithi120.stdout:9/31: truncate d0/d6/f8 51245 0 2024-04-26T21:25:40.300 INFO:tasks.workunit.client.1.smithi120.stdout:6/30: fsync f1 0 2024-04-26T21:25:40.303 INFO:tasks.workunit.client.1.smithi120.stdout:6/31: read f1 [2942415,16127] 0 2024-04-26T21:25:40.303 INFO:tasks.workunit.client.1.smithi120.stdout:0/25: unlink d0/c1 0 2024-04-26T21:25:40.304 INFO:tasks.workunit.client.1.smithi120.stdout:5/75: dread d2/fa [0,4194304] 0 2024-04-26T21:25:40.306 INFO:tasks.workunit.client.1.smithi120.stdout:0/26: stat d0/d3/f5 0 2024-04-26T21:25:40.308 INFO:tasks.workunit.client.1.smithi120.stdout:3/39: symlink dd/de/l10 0 2024-04-26T21:25:40.310 INFO:tasks.workunit.client.1.smithi120.stdout:3/40: stat dd/de/df 0 2024-04-26T21:25:40.313 INFO:tasks.workunit.client.1.smithi120.stdout:6/32: chown c3 2462 1 2024-04-26T21:25:40.313 INFO:tasks.workunit.client.1.smithi120.stdout:8/30: dwrite d5/d6/fd [0,4194304] 0 2024-04-26T21:25:40.314 INFO:tasks.workunit.client.1.smithi120.stdout:6/33: chown c3 51302 1 2024-04-26T21:25:40.315 INFO:tasks.workunit.client.1.smithi120.stdout:0/27: mknod d0/d3/c6 0 2024-04-26T21:25:40.316 INFO:tasks.workunit.client.1.smithi120.stdout:9/32: getdents d0/d2 0 2024-04-26T21:25:40.316 INFO:tasks.workunit.client.1.smithi120.stdout:6/34: chown d4/c5 6486 1 2024-04-26T21:25:40.318 INFO:tasks.workunit.client.1.smithi120.stdout:0/28: stat d0/d3/c4 0 2024-04-26T21:25:40.322 INFO:tasks.workunit.client.1.smithi120.stdout:6/35: creat d4/f8 x:0 0 0 2024-04-26T21:25:40.323 INFO:tasks.workunit.client.1.smithi120.stdout:9/33: rename d0/d2 to d0/d9 0 2024-04-26T21:25:40.325 INFO:tasks.workunit.client.1.smithi120.stdout:0/29: rename d0/d3/f5 to d0/d3/f7 0 2024-04-26T21:25:40.326 INFO:tasks.workunit.client.1.smithi120.stdout:6/36: dread - d4/f8 zero size 2024-04-26T21:25:40.328 INFO:tasks.workunit.client.1.smithi120.stdout:9/34: creat d0/fa x:0 0 0 2024-04-26T21:25:40.330 INFO:tasks.workunit.client.1.smithi120.stdout:3/41: dread f9 [0,4194304] 0 2024-04-26T21:25:40.330 INFO:tasks.workunit.client.1.smithi120.stdout:6/37: chown d4/c6 126345 1 2024-04-26T21:25:40.333 INFO:tasks.workunit.client.1.smithi120.stdout:0/30: creat d0/f8 x:0 0 0 2024-04-26T21:25:40.335 INFO:tasks.workunit.client.1.smithi120.stdout:8/31: dread f4 [0,4194304] 0 2024-04-26T21:25:40.336 INFO:tasks.workunit.client.1.smithi120.stdout:9/35: write d0/f1 [824270,106284] 0 2024-04-26T21:25:40.342 INFO:tasks.workunit.client.1.smithi120.stdout:0/31: creat d0/d3/f9 x:0 0 0 2024-04-26T21:25:40.342 INFO:tasks.workunit.client.1.smithi120.stdout:5/76: dwrite d2/f13 [0,4194304] 0 2024-04-26T21:25:40.343 INFO:tasks.workunit.client.1.smithi120.stdout:6/38: mknod d4/d7/c9 0 2024-04-26T21:25:40.344 INFO:tasks.workunit.client.1.smithi120.stdout:5/77: chown d2/l11 4462 1 2024-04-26T21:25:40.345 INFO:tasks.workunit.client.1.smithi120.stdout:9/36: truncate d0/f1 3473292 0 2024-04-26T21:25:40.348 INFO:tasks.workunit.client.1.smithi120.stdout:6/39: rename c2 to d4/d7/ca 0 2024-04-26T21:25:40.353 INFO:tasks.workunit.client.1.smithi120.stdout:6/40: mkdir d4/db 0 2024-04-26T21:25:40.358 INFO:tasks.workunit.client.1.smithi120.stdout:3/42: dread f6 [0,4194304] 0 2024-04-26T21:25:40.359 INFO:tasks.workunit.client.1.smithi120.stdout:0/32: rmdir d0/d3 39 2024-04-26T21:25:40.362 INFO:tasks.workunit.client.1.smithi120.stdout:6/41: chown c3 6 1 2024-04-26T21:25:40.367 INFO:tasks.workunit.client.1.smithi120.stdout:5/78: dread d2/f13 [0,4194304] 0 2024-04-26T21:25:40.370 INFO:tasks.workunit.client.1.smithi120.stdout:3/43: link f5 dd/de/f11 0 2024-04-26T21:25:40.373 INFO:tasks.workunit.client.1.smithi120.stdout:6/42: unlink d4/d7/c9 0 2024-04-26T21:25:40.375 INFO:tasks.workunit.client.1.smithi120.stdout:3/44: fdatasync f6 0 2024-04-26T21:25:40.375 INFO:tasks.workunit.client.1.smithi120.stdout:8/32: dwrite d5/d6/fe [0,4194304] 0 2024-04-26T21:25:40.377 INFO:tasks.workunit.client.1.smithi120.stdout:1/67: sync 2024-04-26T21:25:40.381 INFO:tasks.workunit.client.1.smithi120.stdout:9/37: dwrite d0/fa [0,4194304] 0 2024-04-26T21:25:40.381 INFO:tasks.workunit.client.1.smithi120.stdout:8/33: mkdir d5/d6/d12 0 2024-04-26T21:25:40.381 INFO:tasks.workunit.client.1.smithi120.stdout:5/79: link d2/l11 d2/db/l18 0 2024-04-26T21:25:40.391 INFO:tasks.workunit.client.1.smithi120.stdout:0/33: dread d0/f2 [0,4194304] 0 2024-04-26T21:25:40.399 INFO:tasks.workunit.client.1.smithi120.stdout:0/34: rmdir d0 39 2024-04-26T21:25:40.409 INFO:tasks.workunit.client.1.smithi120.stdout:5/80: write d2/f9 [489442,29205] 0 2024-04-26T21:25:40.411 INFO:tasks.workunit.client.1.smithi120.stdout:9/38: dread d0/fa [0,4194304] 0 2024-04-26T21:25:40.418 INFO:tasks.workunit.client.1.smithi120.stdout:6/43: dwrite d4/f8 [0,4194304] 0 2024-04-26T21:25:40.422 INFO:tasks.workunit.client.1.smithi120.stdout:0/35: creat d0/d3/fa x:0 0 0 2024-04-26T21:25:40.425 INFO:tasks.workunit.client.1.smithi120.stdout:9/39: mknod d0/d9/cb 0 2024-04-26T21:25:40.426 INFO:tasks.workunit.client.1.smithi120.stdout:8/34: dwrite d5/d6/d11/f10 [0,4194304] 0 2024-04-26T21:25:40.427 INFO:tasks.workunit.client.1.smithi120.stdout:0/36: dread - d0/f8 zero size 2024-04-26T21:25:40.428 INFO:tasks.workunit.client.1.smithi120.stdout:6/44: chown d4/c5 2932 1 2024-04-26T21:25:40.430 INFO:tasks.workunit.client.1.smithi120.stdout:1/68: dwrite d6/d7/da/fb [0,4194304] 0 2024-04-26T21:25:40.436 INFO:tasks.workunit.client.1.smithi120.stdout:0/37: dread - d0/f8 zero size 2024-04-26T21:25:40.436 INFO:tasks.workunit.client.1.smithi120.stdout:6/45: chown f1 4732 1 2024-04-26T21:25:40.437 INFO:tasks.workunit.client.1.smithi120.stdout:0/38: readlink - no filename 2024-04-26T21:25:40.437 INFO:tasks.workunit.client.1.smithi120.stdout:9/40: chown d0/c4 6337 1 2024-04-26T21:25:40.441 INFO:tasks.workunit.client.1.smithi120.stdout:6/46: chown d4/f8 4 1 2024-04-26T21:25:40.443 INFO:tasks.workunit.client.1.smithi120.stdout:9/41: chown d0/d9/cb 2 1 2024-04-26T21:25:40.444 INFO:tasks.workunit.client.1.smithi120.stdout:0/39: unlink d0/f2 0 2024-04-26T21:25:40.445 INFO:tasks.workunit.client.1.smithi120.stdout:1/69: creat d6/f15 x:0 0 0 2024-04-26T21:25:40.452 INFO:tasks.workunit.client.1.smithi120.stdout:6/47: getdents d4/d7 0 2024-04-26T21:25:40.454 INFO:tasks.workunit.client.1.smithi120.stdout:1/70: creat d6/d14/f16 x:0 0 0 2024-04-26T21:25:40.455 INFO:tasks.workunit.client.1.smithi120.stdout:5/81: dwrite d2/fa [0,4194304] 0 2024-04-26T21:25:40.462 INFO:tasks.workunit.client.1.smithi120.stdout:7/17: sync 2024-04-26T21:25:40.462 INFO:tasks.workunit.client.1.smithi120.stdout:7/18: write - no filename 2024-04-26T21:25:40.474 INFO:tasks.workunit.client.1.smithi120.stdout:1/71: mknod d6/d7/da/c17 0 2024-04-26T21:25:40.477 INFO:tasks.workunit.client.1.smithi120.stdout:5/82: rename d2/f8 to d2/db/f19 0 2024-04-26T21:25:40.478 INFO:tasks.workunit.client.1.smithi120.stdout:8/35: dwrite d5/d6/fe [0,4194304] 0 2024-04-26T21:25:40.480 INFO:tasks.workunit.client.1.smithi120.stdout:7/19: rename c1 to c2 0 2024-04-26T21:25:40.482 INFO:tasks.workunit.client.1.smithi120.stdout:1/72: write d6/d7/da/fb [4445456,112302] 0 2024-04-26T21:25:40.486 INFO:tasks.workunit.client.1.smithi120.stdout:5/83: creat d2/db/f1a x:0 0 0 2024-04-26T21:25:40.486 INFO:tasks.workunit.client.1.smithi120.stdout:7/20: creat f3 x:0 0 0 2024-04-26T21:25:40.489 INFO:tasks.workunit.client.1.smithi120.stdout:9/42: dwrite d0/f1 [0,4194304] 0 2024-04-26T21:25:40.493 INFO:tasks.workunit.client.1.smithi120.stdout:6/48: dread d4/f8 [0,4194304] 0 2024-04-26T21:25:40.494 INFO:tasks.workunit.client.1.smithi120.stdout:5/84: write d2/db/f16 [32056,13382] 0 2024-04-26T21:25:40.497 INFO:tasks.workunit.client.1.smithi120.stdout:1/73: unlink d6/d9/c13 0 2024-04-26T21:25:40.499 INFO:tasks.workunit.client.1.smithi120.stdout:1/74: read d6/fc [2718745,18355] 0 2024-04-26T21:25:40.500 INFO:tasks.workunit.client.1.smithi120.stdout:5/85: dread - d2/db/f14 zero size 2024-04-26T21:25:40.510 INFO:tasks.workunit.client.1.smithi120.stdout:6/49: symlink d4/db/lc 0 2024-04-26T21:25:40.515 INFO:tasks.workunit.client.1.smithi120.stdout:1/75: read d6/fc [3127169,59951] 0 2024-04-26T21:25:40.528 INFO:tasks.workunit.client.1.smithi120.stdout:6/50: mkdir d4/d7/dd 0 2024-04-26T21:25:40.530 INFO:tasks.workunit.client.1.smithi120.stdout:1/76: readlink d6/d9/l11 0 2024-04-26T21:25:40.538 INFO:tasks.workunit.client.1.smithi120.stdout:8/36: dwrite d5/d6/d11/f10 [0,4194304] 0 2024-04-26T21:25:40.543 INFO:tasks.workunit.client.1.smithi120.stdout:4/74: sync 2024-04-26T21:25:40.544 INFO:tasks.workunit.client.1.smithi120.stdout:7/21: dwrite f3 [0,4194304] 0 2024-04-26T21:25:40.545 INFO:tasks.workunit.client.1.smithi120.stdout:2/104: sync 2024-04-26T21:25:40.551 INFO:tasks.workunit.client.1.smithi120.stdout:5/86: dwrite d2/f17 [0,4194304] 0 2024-04-26T21:25:40.552 INFO:tasks.workunit.client.1.smithi120.stdout:7/22: write f3 [2839406,117335] 0 2024-04-26T21:25:40.553 INFO:tasks.workunit.client.1.smithi120.stdout:9/43: dwrite d0/d6/f8 [0,4194304] 0 2024-04-26T21:25:40.594 INFO:tasks.workunit.client.1.smithi120.stdout:8/37: write f4 [1149989,96819] 0 2024-04-26T21:25:40.596 INFO:tasks.workunit.client.1.smithi120.stdout:8/38: fsync d5/d6/d11/f10 0 2024-04-26T21:25:40.596 INFO:tasks.workunit.client.1.smithi120.stdout:0/40: sync 2024-04-26T21:25:40.597 INFO:tasks.workunit.client.1.smithi120.stdout:3/45: sync 2024-04-26T21:25:40.597 INFO:tasks.workunit.client.1.smithi120.stdout:4/75: unlink f2 0 2024-04-26T21:25:40.599 INFO:tasks.workunit.client.1.smithi120.stdout:0/41: write d0/d3/fa [914020,93889] 0 2024-04-26T21:25:40.600 INFO:tasks.workunit.client.1.smithi120.stdout:7/23: chown c2 12 1 2024-04-26T21:25:40.601 INFO:tasks.workunit.client.1.smithi120.stdout:5/87: mkdir d2/d1b 0 2024-04-26T21:25:40.601 INFO:tasks.workunit.client.1.smithi120.stdout:2/105: unlink d4/dd/d14/d15/l16 0 2024-04-26T21:25:40.605 INFO:tasks.workunit.client.1.smithi120.stdout:8/39: symlink d5/d6/l13 0 2024-04-26T21:25:40.606 INFO:tasks.workunit.client.1.smithi120.stdout:4/76: mknod d10/d12/c1b 0 2024-04-26T21:25:40.608 INFO:tasks.workunit.client.1.smithi120.stdout:8/40: write d5/d6/fd [266900,64329] 0 2024-04-26T21:25:40.609 INFO:tasks.workunit.client.1.smithi120.stdout:7/24: symlink l4 0 2024-04-26T21:25:40.613 INFO:tasks.workunit.client.1.smithi120.stdout:1/77: link d6/d7/da/c17 d6/d14/c18 0 2024-04-26T21:25:40.616 INFO:tasks.workunit.client.1.smithi120.stdout:4/77: mknod d10/c1c 0 2024-04-26T21:25:40.617 INFO:tasks.workunit.client.1.smithi120.stdout:6/51: dwrite d4/f8 [0,4194304] 0 2024-04-26T21:25:40.618 INFO:tasks.workunit.client.1.smithi120.stdout:9/44: link d0/d9/cb d0/d9/cc 0 2024-04-26T21:25:40.620 INFO:tasks.workunit.client.1.smithi120.stdout:3/46: mkdir dd/de/df/d12 0 2024-04-26T21:25:40.624 INFO:tasks.workunit.client.1.smithi120.stdout:8/41: creat d5/d6/f14 x:0 0 0 2024-04-26T21:25:40.631 INFO:tasks.workunit.client.1.smithi120.stdout:6/52: fdatasync f1 0 2024-04-26T21:25:40.636 INFO:tasks.workunit.client.1.smithi120.stdout:0/42: rename d0/d3/f7 to d0/fb 0 2024-04-26T21:25:40.638 INFO:tasks.workunit.client.1.smithi120.stdout:8/42: write f4 [475700,93647] 0 2024-04-26T21:25:40.641 INFO:tasks.workunit.client.1.smithi120.stdout:2/106: dwrite f3 [0,4194304] 0 2024-04-26T21:25:40.648 INFO:tasks.workunit.client.1.smithi120.stdout:4/78: link d10/d12/f15 d10/d12/f1d 0 2024-04-26T21:25:40.649 INFO:tasks.workunit.client.1.smithi120.stdout:2/107: fsync d4/f10 0 2024-04-26T21:25:40.655 INFO:tasks.workunit.client.1.smithi120.stdout:0/43: mkdir d0/d3/dc 0 2024-04-26T21:25:40.665 INFO:tasks.workunit.client.1.smithi120.stdout:0/44: read - d0/fb zero size 2024-04-26T21:25:40.666 INFO:tasks.workunit.client.1.smithi120.stdout:2/108: read - d4/dd/f2a zero size 2024-04-26T21:25:40.672 INFO:tasks.workunit.client.1.smithi120.stdout:5/88: dwrite d2/f9 [0,4194304] 0 2024-04-26T21:25:40.672 INFO:tasks.workunit.client.1.smithi120.stdout:4/79: creat d10/f1e x:0 0 0 2024-04-26T21:25:40.672 INFO:tasks.workunit.client.1.smithi120.stdout:3/47: dread fa [0,4194304] 0 2024-04-26T21:25:40.678 INFO:tasks.workunit.client.1.smithi120.stdout:2/109: chown d4/dd/d14/d15/f2b 7922 1 2024-04-26T21:25:40.679 INFO:tasks.workunit.client.1.smithi120.stdout:4/80: write d10/f1e [220038,130873] 0 2024-04-26T21:25:40.679 INFO:tasks.workunit.client.1.smithi120.stdout:1/78: rmdir d6 39 2024-04-26T21:25:40.683 INFO:tasks.workunit.client.1.smithi120.stdout:7/25: truncate f3 631095 0 2024-04-26T21:25:40.683 INFO:tasks.workunit.client.1.smithi120.stdout:9/45: dwrite d0/d6/f8 [0,4194304] 0 2024-04-26T21:25:40.687 INFO:tasks.workunit.client.1.smithi120.stdout:4/81: write d10/d12/f19 [879304,101167] 0 2024-04-26T21:25:40.690 INFO:tasks.workunit.client.1.smithi120.stdout:3/48: rename c2 to dd/c13 0 2024-04-26T21:25:40.694 INFO:tasks.workunit.client.1.smithi120.stdout:4/82: chown f9 38717213 1 2024-04-26T21:25:40.700 INFO:tasks.workunit.client.1.smithi120.stdout:0/45: mkdir d0/d3/dc/dd 0 2024-04-26T21:25:40.700 INFO:tasks.workunit.client.1.smithi120.stdout:3/49: creat dd/f14 x:0 0 0 2024-04-26T21:25:40.701 INFO:tasks.workunit.client.1.smithi120.stdout:8/43: dwrite d5/d6/fd [0,4194304] 0 2024-04-26T21:25:40.706 INFO:tasks.workunit.client.1.smithi120.stdout:4/83: mknod d10/c1f 0 2024-04-26T21:25:40.707 INFO:tasks.workunit.client.1.smithi120.stdout:1/79: write d6/f15 [1046735,67884] 0 2024-04-26T21:25:40.707 INFO:tasks.workunit.client.1.smithi120.stdout:3/50: creat dd/f15 x:0 0 0 2024-04-26T21:25:40.708 INFO:tasks.workunit.client.1.smithi120.stdout:5/89: link d2/l11 d2/dc/l1c 0 2024-04-26T21:25:40.708 INFO:tasks.workunit.client.1.smithi120.stdout:6/53: dwrite f1 [0,4194304] 0 2024-04-26T21:25:40.714 INFO:tasks.workunit.client.1.smithi120.stdout:4/84: readlink ld 0 2024-04-26T21:25:40.722 INFO:tasks.workunit.client.1.smithi120.stdout:1/80: stat d6/d7/da/fb 0 2024-04-26T21:25:40.722 INFO:tasks.workunit.client.1.smithi120.stdout:3/51: write fa [3567034,98239] 0 2024-04-26T21:25:40.722 INFO:tasks.workunit.client.1.smithi120.stdout:7/26: read f3 [315113,26944] 0 2024-04-26T21:25:40.723 INFO:tasks.workunit.client.1.smithi120.stdout:5/90: truncate d2/db/f14 262453 0 2024-04-26T21:25:40.723 INFO:tasks.workunit.client.1.smithi120.stdout:4/85: mknod d10/c20 0 2024-04-26T21:25:40.732 INFO:tasks.workunit.client.1.smithi120.stdout:4/86: mknod d10/d12/c21 0 2024-04-26T21:25:40.735 INFO:tasks.workunit.client.1.smithi120.stdout:7/27: creat f5 x:0 0 0 2024-04-26T21:25:40.741 INFO:tasks.workunit.client.1.smithi120.stdout:7/28: chown f5 40 1 2024-04-26T21:25:40.743 INFO:tasks.workunit.client.1.smithi120.stdout:4/87: write d10/f11 [4914275,57088] 0 2024-04-26T21:25:40.745 INFO:tasks.workunit.client.1.smithi120.stdout:2/110: dwrite d4/dd/d14/d15/f18 [0,4194304] 0 2024-04-26T21:25:40.745 INFO:tasks.workunit.client.1.smithi120.stdout:9/46: dread d0/d6/f8 [0,4194304] 0 2024-04-26T21:25:40.746 INFO:tasks.workunit.client.1.smithi120.stdout:1/81: creat d6/d7/da/f19 x:0 0 0 2024-04-26T21:25:40.746 INFO:tasks.workunit.client.1.smithi120.stdout:5/91: chown d2/dc/l1c 53277173 1 2024-04-26T21:25:40.750 INFO:tasks.workunit.client.1.smithi120.stdout:6/54: dread f1 [0,4194304] 0 2024-04-26T21:25:40.751 INFO:tasks.workunit.client.1.smithi120.stdout:9/47: chown d0/c4 325 1 2024-04-26T21:25:40.753 INFO:tasks.workunit.client.1.smithi120.stdout:7/29: creat f6 x:0 0 0 2024-04-26T21:25:40.754 INFO:tasks.workunit.client.1.smithi120.stdout:1/82: mknod d6/c1a 0 2024-04-26T21:25:40.755 INFO:tasks.workunit.client.1.smithi120.stdout:2/111: chown d4/dd/f21 703474 1 2024-04-26T21:25:40.756 INFO:tasks.workunit.client.1.smithi120.stdout:8/44: dwrite d5/d6/fe [0,4194304] 0 2024-04-26T21:25:40.756 INFO:tasks.workunit.client.1.smithi120.stdout:4/88: rename d10/d12/f15 to d10/d12/f22 0 2024-04-26T21:25:40.759 INFO:tasks.workunit.client.1.smithi120.stdout:7/30: mkdir d7 0 2024-04-26T21:25:40.767 INFO:tasks.workunit.client.1.smithi120.stdout:5/92: mkdir d2/dc/d1d 0 2024-04-26T21:25:40.767 INFO:tasks.workunit.client.1.smithi120.stdout:1/83: fsync d6/d7/da/fb 0 2024-04-26T21:25:40.770 INFO:tasks.workunit.client.1.smithi120.stdout:9/48: rename d0/d9 to d0/dd 0 2024-04-26T21:25:40.772 INFO:tasks.workunit.client.1.smithi120.stdout:5/93: fdatasync d2/dc/fd 0 2024-04-26T21:25:40.779 INFO:tasks.workunit.client.1.smithi120.stdout:2/112: rename d4/da to d4/d1b/d25/d2c 0 2024-04-26T21:25:40.779 INFO:tasks.workunit.client.1.smithi120.stdout:7/31: creat d7/f8 x:0 0 0 2024-04-26T21:25:40.781 INFO:tasks.workunit.client.1.smithi120.stdout:1/84: write d6/d7/ff [530316,83674] 0 2024-04-26T21:25:40.784 INFO:tasks.workunit.client.1.smithi120.stdout:3/52: dwrite f5 [0,4194304] 0 2024-04-26T21:25:40.785 INFO:tasks.workunit.client.1.smithi120.stdout:9/49: truncate d0/f1 5053723 0 2024-04-26T21:25:40.787 INFO:tasks.workunit.client.1.smithi120.stdout:7/32: creat d7/f9 x:0 0 0 2024-04-26T21:25:40.788 INFO:tasks.workunit.client.1.smithi120.stdout:5/94: mkdir d2/dc/d1d/d1e 0 2024-04-26T21:25:40.795 INFO:tasks.workunit.client.1.smithi120.stdout:1/85: fdatasync d6/fc 0 2024-04-26T21:25:40.796 INFO:tasks.workunit.client.1.smithi120.stdout:3/53: creat dd/de/df/f16 x:0 0 0 2024-04-26T21:25:40.798 INFO:tasks.workunit.client.1.smithi120.stdout:5/95: mkdir d2/dc/d1d/d1f 0 2024-04-26T21:25:40.799 INFO:tasks.workunit.client.1.smithi120.stdout:6/55: dwrite d4/f8 [0,4194304] 0 2024-04-26T21:25:40.802 INFO:tasks.workunit.client.1.smithi120.stdout:1/86: fsync d6/f15 0 2024-04-26T21:25:40.802 INFO:tasks.workunit.client.1.smithi120.stdout:8/45: dwrite f2 [4194304,4194304] 0 2024-04-26T21:25:40.803 INFO:tasks.workunit.client.1.smithi120.stdout:7/33: link d7/f9 d7/fa 0 2024-04-26T21:25:40.805 INFO:tasks.workunit.client.1.smithi120.stdout:4/89: dread f6 [0,4194304] 0 2024-04-26T21:25:40.805 INFO:tasks.workunit.client.1.smithi120.stdout:5/96: chown d2/db/f16 26 1 2024-04-26T21:25:40.807 INFO:tasks.workunit.client.1.smithi120.stdout:2/113: link d4/dd/d14/d15/f28 d4/dd/d14/d15/f2d 0 2024-04-26T21:25:40.809 INFO:tasks.workunit.client.1.smithi120.stdout:1/87: write d6/f15 [1723967,28537] 0 2024-04-26T21:25:40.811 INFO:tasks.workunit.client.1.smithi120.stdout:8/46: getdents d5/d6/d12 0 2024-04-26T21:25:40.813 INFO:tasks.workunit.client.1.smithi120.stdout:4/90: chown d10/d12/c21 301936 1 2024-04-26T21:25:40.813 INFO:tasks.workunit.client.1.smithi120.stdout:7/34: symlink d7/lb 0 2024-04-26T21:25:40.814 INFO:tasks.workunit.client.1.smithi120.stdout:1/88: chown d6 163054123 1 2024-04-26T21:25:40.817 INFO:tasks.workunit.client.1.smithi120.stdout:8/47: creat d5/f15 x:0 0 0 2024-04-26T21:25:40.818 INFO:tasks.workunit.client.1.smithi120.stdout:2/114: mkdir d4/d1b/d2e 0 2024-04-26T21:25:40.818 INFO:tasks.workunit.client.1.smithi120.stdout:7/35: write f5 [791577,122907] 0 2024-04-26T21:25:40.820 INFO:tasks.workunit.client.1.smithi120.stdout:1/89: mkdir d6/d7/d1b 0 2024-04-26T21:25:40.820 INFO:tasks.workunit.client.1.smithi120.stdout:8/48: chown d5/d6/fe 39177 1 2024-04-26T21:25:40.820 INFO:tasks.workunit.client.1.smithi120.stdout:7/36: fsync d7/f8 0 2024-04-26T21:25:40.823 INFO:tasks.workunit.client.1.smithi120.stdout:8/49: write d5/d6/f14 [331262,28154] 0 2024-04-26T21:25:40.823 INFO:tasks.workunit.client.1.smithi120.stdout:3/54: dread fa [0,4194304] 0 2024-04-26T21:25:40.824 INFO:tasks.workunit.client.1.smithi120.stdout:4/91: truncate f6 1299431 0 2024-04-26T21:25:40.825 INFO:tasks.workunit.client.1.smithi120.stdout:7/37: symlink d7/lc 0 2024-04-26T21:25:40.825 INFO:tasks.workunit.client.1.smithi120.stdout:5/97: link d2/db/ce d2/db/c20 0 2024-04-26T21:25:40.827 INFO:tasks.workunit.client.1.smithi120.stdout:1/90: creat d6/d9/f1c x:0 0 0 2024-04-26T21:25:40.828 INFO:tasks.workunit.client.1.smithi120.stdout:3/55: rename l1 to dd/l17 0 2024-04-26T21:25:40.830 INFO:tasks.workunit.client.1.smithi120.stdout:4/92: mknod d10/d12/c23 0 2024-04-26T21:25:40.830 INFO:tasks.workunit.client.1.smithi120.stdout:5/98: mkdir d2/dc/d1d/d21 0 2024-04-26T21:25:40.832 INFO:tasks.workunit.client.1.smithi120.stdout:5/99: chown d2/db/c12 0 1 2024-04-26T21:25:40.832 INFO:tasks.workunit.client.1.smithi120.stdout:1/91: mkdir d6/d7/d1d 0 2024-04-26T21:25:40.833 INFO:tasks.workunit.client.1.smithi120.stdout:5/100: chown d2/dc/fd 62 1 2024-04-26T21:25:40.837 INFO:tasks.workunit.client.1.smithi120.stdout:8/50: rename d5/d6/fe to d5/f16 0 2024-04-26T21:25:40.838 INFO:tasks.workunit.client.1.smithi120.stdout:4/93: creat d10/f24 x:0 0 0 2024-04-26T21:25:40.839 INFO:tasks.workunit.client.1.smithi120.stdout:8/51: chown d5/f15 7276991 1 2024-04-26T21:25:40.839 INFO:tasks.workunit.client.1.smithi120.stdout:5/101: mkdir d2/d1b/d22 0 2024-04-26T21:25:40.842 INFO:tasks.workunit.client.1.smithi120.stdout:5/102: fsync d2/db/f16 0 2024-04-26T21:25:40.847 INFO:tasks.workunit.client.1.smithi120.stdout:6/56: truncate f1 3304954 0 2024-04-26T21:25:40.847 INFO:tasks.workunit.client.1.smithi120.stdout:5/103: write d2/fa [570498,46153] 0 2024-04-26T21:25:40.853 INFO:tasks.workunit.client.1.smithi120.stdout:4/94: fsync f6 0 2024-04-26T21:25:40.853 INFO:tasks.workunit.client.1.smithi120.stdout:5/104: chown d2/db/c12 155 1 2024-04-26T21:25:40.859 INFO:tasks.workunit.client.1.smithi120.stdout:6/57: creat d4/db/fe x:0 0 0 2024-04-26T21:25:40.859 INFO:tasks.workunit.client.1.smithi120.stdout:5/105: symlink d2/d1b/l23 0 2024-04-26T21:25:40.861 INFO:tasks.workunit.client.1.smithi120.stdout:2/115: truncate d4/dd/f21 1079516 0 2024-04-26T21:25:40.863 INFO:tasks.workunit.client.1.smithi120.stdout:4/95: truncate d10/f24 819862 0 2024-04-26T21:25:40.867 INFO:tasks.workunit.client.1.smithi120.stdout:3/56: dwrite f9 [0,4194304] 0 2024-04-26T21:25:40.868 INFO:tasks.workunit.client.1.smithi120.stdout:5/106: readlink d2/d1b/l23 0 2024-04-26T21:25:40.868 INFO:tasks.workunit.client.1.smithi120.stdout:1/92: dwrite d6/d9/f1c [0,4194304] 0 2024-04-26T21:25:40.871 INFO:tasks.workunit.client.1.smithi120.stdout:6/58: fdatasync d4/db/fe 0 2024-04-26T21:25:40.872 INFO:tasks.workunit.client.1.smithi120.stdout:8/52: dread f2 [4194304,4194304] 0 2024-04-26T21:25:40.877 INFO:tasks.workunit.client.1.smithi120.stdout:4/96: stat d10/d12/f1d 0 2024-04-26T21:25:40.877 INFO:tasks.workunit.client.1.smithi120.stdout:3/57: unlink dd/c13 0 2024-04-26T21:25:40.879 INFO:tasks.workunit.client.1.smithi120.stdout:6/59: chown d4/d7/ca 1851855 1 2024-04-26T21:25:40.879 INFO:tasks.workunit.client.1.smithi120.stdout:1/93: creat d6/d9/f1e x:0 0 0 2024-04-26T21:25:40.880 INFO:tasks.workunit.client.1.smithi120.stdout:2/116: truncate d4/dd/f27 1026385 0 2024-04-26T21:25:40.881 INFO:tasks.workunit.client.1.smithi120.stdout:8/53: truncate d5/f15 1026449 0 2024-04-26T21:25:40.885 INFO:tasks.workunit.client.1.smithi120.stdout:3/58: write dd/de/f11 [2301461,74008] 0 2024-04-26T21:25:40.887 INFO:tasks.workunit.client.1.smithi120.stdout:1/94: write d6/f15 [298862,56776] 0 2024-04-26T21:25:40.887 INFO:tasks.workunit.client.1.smithi120.stdout:6/60: dread - d4/db/fe zero size 2024-04-26T21:25:40.887 INFO:tasks.workunit.client.1.smithi120.stdout:7/38: dwrite f3 [0,4194304] 0 2024-04-26T21:25:40.890 INFO:tasks.workunit.client.1.smithi120.stdout:6/61: chown d4/d7/ca 1964 1 2024-04-26T21:25:40.893 INFO:tasks.workunit.client.1.smithi120.stdout:2/117: truncate d4/dd/d14/d15/f28 1037655 0 2024-04-26T21:25:40.893 INFO:tasks.workunit.client.1.smithi120.stdout:5/107: link d2/db/ce d2/d1b/d22/c24 0 2024-04-26T21:25:40.895 INFO:tasks.workunit.client.1.smithi120.stdout:1/95: write d6/d7/ff [813886,119276] 0 2024-04-26T21:25:40.896 INFO:tasks.workunit.client.1.smithi120.stdout:7/39: rename f5 to d7/fd 0 2024-04-26T21:25:40.901 INFO:tasks.workunit.client.1.smithi120.stdout:5/108: write d2/f13 [3433556,46063] 0 2024-04-26T21:25:40.902 INFO:tasks.workunit.client.1.smithi120.stdout:2/118: chown d4/l5 3 1 2024-04-26T21:25:40.903 INFO:tasks.workunit.client.1.smithi120.stdout:6/62: rename c3 to d4/db/cf 0 2024-04-26T21:25:40.904 INFO:tasks.workunit.client.1.smithi120.stdout:4/97: dread d10/d12/f19 [0,4194304] 0 2024-04-26T21:25:40.904 INFO:tasks.workunit.client.1.smithi120.stdout:2/119: readlink d4/d1b/l1d 0 2024-04-26T21:25:40.904 INFO:tasks.workunit.client.1.smithi120.stdout:7/40: creat d7/fe x:0 0 0 2024-04-26T21:25:40.905 INFO:tasks.workunit.client.1.smithi120.stdout:1/96: mknod d6/d7/da/dd/c1f 0 2024-04-26T21:25:40.906 INFO:tasks.workunit.client.1.smithi120.stdout:4/98: readlink l7 0 2024-04-26T21:25:40.906 INFO:tasks.workunit.client.1.smithi120.stdout:6/63: readlink d4/db/lc 0 2024-04-26T21:25:40.909 INFO:tasks.workunit.client.1.smithi120.stdout:8/54: dread f2 [0,4194304] 0 2024-04-26T21:25:40.913 INFO:tasks.workunit.client.1.smithi120.stdout:0/46: sync 2024-04-26T21:25:40.913 INFO:tasks.workunit.client.1.smithi120.stdout:2/120: symlink d4/dd/d14/l2f 0 2024-04-26T21:25:40.915 INFO:tasks.workunit.client.1.smithi120.stdout:7/41: rename d7/f9 to d7/ff 0 2024-04-26T21:25:40.915 INFO:tasks.workunit.client.1.smithi120.stdout:7/42: stat f6 0 2024-04-26T21:25:40.915 INFO:tasks.workunit.client.1.smithi120.stdout:8/55: rename f2 to d5/d6/d12/f17 0 2024-04-26T21:25:40.917 INFO:tasks.workunit.client.1.smithi120.stdout:1/97: creat d6/d7/d1d/f20 x:0 0 0 2024-04-26T21:25:40.918 INFO:tasks.workunit.client.1.smithi120.stdout:2/121: chown d4/d1b/d25/d2c/lb 509225178 1 2024-04-26T21:25:40.921 INFO:tasks.workunit.client.1.smithi120.stdout:5/109: getdents d2/dc 0 2024-04-26T21:25:40.921 INFO:tasks.workunit.client.1.smithi120.stdout:0/47: mknod d0/d3/dc/ce 0 2024-04-26T21:25:40.923 INFO:tasks.workunit.client.1.smithi120.stdout:8/56: mkdir d5/d18 0 2024-04-26T21:25:40.925 INFO:tasks.workunit.client.1.smithi120.stdout:1/98: read d6/fc [2646282,29942] 0 2024-04-26T21:25:40.931 INFO:tasks.workunit.client.1.smithi120.stdout:5/110: dread d2/db/f14 [0,4194304] 0 2024-04-26T21:25:40.934 INFO:tasks.workunit.client.1.smithi120.stdout:1/99: symlink d6/d9/l21 0 2024-04-26T21:25:40.934 INFO:tasks.workunit.client.1.smithi120.stdout:8/57: getdents d5/d18 0 2024-04-26T21:25:40.938 INFO:tasks.workunit.client.1.smithi120.stdout:2/122: rename d4/d1b/d25/d2c/l1c to d4/dd/d14/d15/l30 0 2024-04-26T21:25:40.940 INFO:tasks.workunit.client.1.smithi120.stdout:6/64: dwrite d4/f8 [0,4194304] 0 2024-04-26T21:25:40.941 INFO:tasks.workunit.client.1.smithi120.stdout:4/99: dwrite f0 [0,4194304] 0 2024-04-26T21:25:40.941 INFO:tasks.workunit.client.1.smithi120.stdout:8/58: creat d5/f19 x:0 0 0 2024-04-26T21:25:40.944 INFO:tasks.workunit.client.1.smithi120.stdout:1/100: chown d6/d9/l21 63 1 2024-04-26T21:25:40.948 INFO:tasks.workunit.client.1.smithi120.stdout:8/59: read d5/f15 [462189,72775] 0 2024-04-26T21:25:40.949 INFO:tasks.workunit.client.1.smithi120.stdout:5/111: creat d2/dc/d1d/d1e/f25 x:0 0 0 2024-04-26T21:25:40.952 INFO:tasks.workunit.client.1.smithi120.stdout:7/43: dwrite f6 [0,4194304] 0 2024-04-26T21:25:40.956 INFO:tasks.workunit.client.1.smithi120.stdout:2/123: creat d4/d1b/d25/f31 x:0 0 0 2024-04-26T21:25:40.956 INFO:tasks.workunit.client.1.smithi120.stdout:7/44: dread - d7/f8 zero size 2024-04-26T21:25:40.958 INFO:tasks.workunit.client.1.smithi120.stdout:6/65: rename d4/d7 to d4/db/d10 0 2024-04-26T21:25:40.960 INFO:tasks.workunit.client.1.smithi120.stdout:0/48: dwrite d0/d3/fa [0,4194304] 0 2024-04-26T21:25:40.969 INFO:tasks.workunit.client.1.smithi120.stdout:8/60: creat d5/d6/d12/f1a x:0 0 0 2024-04-26T21:25:40.970 INFO:tasks.workunit.client.1.smithi120.stdout:7/45: mkdir d7/d10 0 2024-04-26T21:25:40.973 INFO:tasks.workunit.client.1.smithi120.stdout:8/61: chown d5/d6/f14 2 1 2024-04-26T21:25:40.974 INFO:tasks.workunit.client.1.smithi120.stdout:6/66: mknod d4/db/d10/c11 0 2024-04-26T21:25:40.982 INFO:tasks.workunit.client.1.smithi120.stdout:8/62: write d5/d6/d11/f10 [3976132,89971] 0 2024-04-26T21:25:40.982 INFO:tasks.workunit.client.1.smithi120.stdout:4/100: link d10/d12/c23 d10/c25 0 2024-04-26T21:25:40.987 INFO:tasks.workunit.client.1.smithi120.stdout:4/101: chown d10/f11 0 1 2024-04-26T21:25:40.988 INFO:tasks.workunit.client.1.smithi120.stdout:6/67: creat d4/db/d10/f12 x:0 0 0 2024-04-26T21:25:40.989 INFO:tasks.workunit.client.1.smithi120.stdout:7/46: creat d7/d10/f11 x:0 0 0 2024-04-26T21:25:40.992 INFO:tasks.workunit.client.1.smithi120.stdout:5/112: dwrite d2/f13 [0,4194304] 0 2024-04-26T21:25:40.993 INFO:tasks.workunit.client.1.smithi120.stdout:2/124: dwrite d4/d1b/d25/d2c/ff [0,4194304] 0 2024-04-26T21:25:40.995 INFO:tasks.workunit.client.1.smithi120.stdout:7/47: mkdir d7/d10/d12 0 2024-04-26T21:25:40.995 INFO:tasks.workunit.client.1.smithi120.stdout:6/68: dread - d4/db/d10/f12 zero size 2024-04-26T21:25:40.996 INFO:tasks.workunit.client.1.smithi120.stdout:0/49: dwrite d0/d3/fa [0,4194304] 0 2024-04-26T21:25:40.998 INFO:tasks.workunit.client.1.smithi120.stdout:7/48: chown d7/fd 10008 1 2024-04-26T21:25:40.999 INFO:tasks.workunit.client.1.smithi120.stdout:0/50: stat d0/d3/dc/dd 0 2024-04-26T21:25:41.002 INFO:tasks.workunit.client.1.smithi120.stdout:7/49: write d7/f8 [736895,11670] 0 2024-04-26T21:25:41.003 INFO:tasks.workunit.client.1.smithi120.stdout:6/69: mknod d4/c13 0 2024-04-26T21:25:41.006 INFO:tasks.workunit.client.1.smithi120.stdout:8/63: dread d5/f16 [0,4194304] 0 2024-04-26T21:25:41.011 INFO:tasks.workunit.client.1.smithi120.stdout:0/51: mkdir d0/df 0 2024-04-26T21:25:41.012 INFO:tasks.workunit.client.1.smithi120.stdout:7/50: mknod d7/c13 0 2024-04-26T21:25:41.013 INFO:tasks.workunit.client.1.smithi120.stdout:7/51: chown d7/d10 106711336 1 2024-04-26T21:25:41.013 INFO:tasks.workunit.client.1.smithi120.stdout:4/102: getdents d10/d12 0 2024-04-26T21:25:41.017 INFO:tasks.workunit.client.1.smithi120.stdout:5/113: dread d2/db/f19 [0,4194304] 0 2024-04-26T21:25:41.018 INFO:tasks.workunit.client.1.smithi120.stdout:5/114: chown d2/c6 1735583866 1 2024-04-26T21:25:41.019 INFO:tasks.workunit.client.1.smithi120.stdout:2/125: dread d4/d1b/d25/d2c/ff [0,4194304] 0 2024-04-26T21:25:41.020 INFO:tasks.workunit.client.1.smithi120.stdout:2/126: write d4/d1b/d25/f31 [997862,4316] 0 2024-04-26T21:25:41.023 INFO:tasks.workunit.client.1.smithi120.stdout:8/64: mknod d5/d18/c1b 0 2024-04-26T21:25:41.029 INFO:tasks.workunit.client.1.smithi120.stdout:4/103: rename d10/d12/f1a to d10/f26 0 2024-04-26T21:25:41.029 INFO:tasks.workunit.client.1.smithi120.stdout:5/115: readlink d2/dc/l1c 0 2024-04-26T21:25:41.032 INFO:tasks.workunit.client.1.smithi120.stdout:6/70: write f1 [927603,115309] 0 2024-04-26T21:25:41.038 INFO:tasks.workunit.client.1.smithi120.stdout:4/104: creat d10/d12/f27 x:0 0 0 2024-04-26T21:25:41.039 INFO:tasks.workunit.client.1.smithi120.stdout:2/127: rename d4/dd/d14/d15/f18 to d4/d1b/d25/f32 0 2024-04-26T21:25:41.042 INFO:tasks.workunit.client.1.smithi120.stdout:0/52: rename d0/f8 to d0/f10 0 2024-04-26T21:25:41.044 INFO:tasks.workunit.client.1.smithi120.stdout:0/53: chown d0/fb 162444 1 2024-04-26T21:25:41.046 INFO:tasks.workunit.client.1.smithi120.stdout:7/52: truncate d7/fd 472106 0 2024-04-26T21:25:41.046 INFO:tasks.workunit.client.1.smithi120.stdout:6/71: creat d4/f14 x:0 0 0 2024-04-26T21:25:41.048 INFO:tasks.workunit.client.1.smithi120.stdout:6/72: stat d4/db 0 2024-04-26T21:25:41.049 INFO:tasks.workunit.client.1.smithi120.stdout:5/116: dwrite d2/f17 [0,4194304] 0 2024-04-26T21:25:41.049 INFO:tasks.workunit.client.1.smithi120.stdout:7/53: chown d7/fa 6010533 1 2024-04-26T21:25:41.061 INFO:tasks.workunit.client.1.smithi120.stdout:8/65: truncate d5/d6/d12/f17 8200780 0 2024-04-26T21:25:41.062 INFO:tasks.workunit.client.1.smithi120.stdout:6/73: rename d4/f8 to d4/db/d10/f15 0 2024-04-26T21:25:41.065 INFO:tasks.workunit.client.1.smithi120.stdout:7/54: creat d7/d10/d12/f14 x:0 0 0 2024-04-26T21:25:41.065 INFO:tasks.workunit.client.1.smithi120.stdout:4/105: truncate f5 1487890 0 2024-04-26T21:25:41.069 INFO:tasks.workunit.client.1.smithi120.stdout:7/55: dread - d7/ff zero size 2024-04-26T21:25:41.071 INFO:tasks.workunit.client.1.smithi120.stdout:4/106: mkdir d10/d28 0 2024-04-26T21:25:41.072 INFO:tasks.workunit.client.1.smithi120.stdout:6/74: write d4/db/fe [571567,74656] 0 2024-04-26T21:25:41.074 INFO:tasks.workunit.client.1.smithi120.stdout:8/66: symlink d5/l1c 0 2024-04-26T21:25:41.074 INFO:tasks.workunit.client.1.smithi120.stdout:0/54: dwrite d0/d3/f9 [0,4194304] 0 2024-04-26T21:25:41.084 INFO:tasks.workunit.client.1.smithi120.stdout:0/55: write d0/d3/fa [3444286,37944] 0 2024-04-26T21:25:41.084 INFO:tasks.workunit.client.1.smithi120.stdout:5/117: dwrite d2/db/f16 [0,4194304] 0 2024-04-26T21:25:41.084 INFO:tasks.workunit.client.1.smithi120.stdout:7/56: creat d7/d10/d12/f15 x:0 0 0 2024-04-26T21:25:41.085 INFO:tasks.workunit.client.1.smithi120.stdout:8/67: symlink d5/d6/l1d 0 2024-04-26T21:25:41.092 INFO:tasks.workunit.client.1.smithi120.stdout:4/107: creat d10/d28/f29 x:0 0 0 2024-04-26T21:25:41.093 INFO:tasks.workunit.client.1.smithi120.stdout:6/75: symlink d4/db/d10/dd/l16 0 2024-04-26T21:25:41.094 INFO:tasks.workunit.client.1.smithi120.stdout:7/57: creat d7/d10/d12/f16 x:0 0 0 2024-04-26T21:25:41.095 INFO:tasks.workunit.client.1.smithi120.stdout:4/108: chown d10/d12 328124865 1 2024-04-26T21:25:41.096 INFO:tasks.workunit.client.1.smithi120.stdout:2/128: dwrite d4/dd/f21 [0,4194304] 0 2024-04-26T21:25:41.097 INFO:tasks.workunit.client.1.smithi120.stdout:8/68: rename d5/d6/f14 to d5/d6/f1e 0 2024-04-26T21:25:41.099 INFO:tasks.workunit.client.1.smithi120.stdout:8/69: truncate d5/f19 998978 0 2024-04-26T21:25:41.105 INFO:tasks.workunit.client.1.smithi120.stdout:8/70: creat d5/d6/f1f x:0 0 0 2024-04-26T21:25:41.106 INFO:tasks.workunit.client.1.smithi120.stdout:5/118: dread d2/db/f19 [0,4194304] 0 2024-04-26T21:25:41.106 INFO:tasks.workunit.client.1.smithi120.stdout:9/50: sync 2024-04-26T21:25:41.107 INFO:tasks.workunit.client.1.smithi120.stdout:0/56: rename d0/d3/dc/ce to d0/c11 0 2024-04-26T21:25:41.110 INFO:tasks.workunit.client.1.smithi120.stdout:7/58: dread d7/f8 [0,4194304] 0 2024-04-26T21:25:41.110 INFO:tasks.workunit.client.1.smithi120.stdout:9/51: rmdir d0 39 2024-04-26T21:25:41.114 INFO:tasks.workunit.client.1.smithi120.stdout:4/109: rename f0 to d10/d12/f2a 0 2024-04-26T21:25:41.115 INFO:tasks.workunit.client.1.smithi120.stdout:2/129: link d4/dd/d14/d15/c17 d4/dd/d14/d15/c33 0 2024-04-26T21:25:41.116 INFO:tasks.workunit.client.1.smithi120.stdout:6/76: getdents d4/db/d10 0 2024-04-26T21:25:41.117 INFO:tasks.workunit.client.1.smithi120.stdout:0/57: write d0/f10 [762578,34268] 0 2024-04-26T21:25:41.122 INFO:tasks.workunit.client.1.smithi120.stdout:0/58: truncate d0/f10 1480204 0 2024-04-26T21:25:41.122 INFO:tasks.workunit.client.1.smithi120.stdout:8/71: rename d5/cf to d5/d6/d11/c20 0 2024-04-26T21:25:41.125 INFO:tasks.workunit.client.1.smithi120.stdout:4/110: creat d10/d28/f2b x:0 0 0 2024-04-26T21:25:41.125 INFO:tasks.workunit.client.1.smithi120.stdout:0/59: fdatasync d0/d3/fa 0 2024-04-26T21:25:41.125 INFO:tasks.workunit.client.1.smithi120.stdout:7/59: dread f6 [0,4194304] 0 2024-04-26T21:25:41.126 INFO:tasks.workunit.client.1.smithi120.stdout:6/77: mknod d4/db/d10/dd/c17 0 2024-04-26T21:25:41.128 INFO:tasks.workunit.client.1.smithi120.stdout:4/111: write d10/f1e [1052248,109075] 0 2024-04-26T21:25:41.130 INFO:tasks.workunit.client.1.smithi120.stdout:5/119: rename d2/f9 to d2/d1b/f26 0 2024-04-26T21:25:41.131 INFO:tasks.workunit.client.1.smithi120.stdout:4/112: readlink l7 0 2024-04-26T21:25:41.133 INFO:tasks.workunit.client.1.smithi120.stdout:0/60: write d0/fb [554738,49130] 0 2024-04-26T21:25:41.133 INFO:tasks.workunit.client.1.smithi120.stdout:4/113: truncate f9 776905 0 2024-04-26T21:25:41.133 INFO:tasks.workunit.client.1.smithi120.stdout:3/59: sync 2024-04-26T21:25:41.135 INFO:tasks.workunit.client.1.smithi120.stdout:2/130: creat d4/f34 x:0 0 0 2024-04-26T21:25:41.138 INFO:tasks.workunit.client.1.smithi120.stdout:5/120: creat d2/db/f27 x:0 0 0 2024-04-26T21:25:41.139 INFO:tasks.workunit.client.1.smithi120.stdout:0/61: write d0/fb [837925,89258] 0 2024-04-26T21:25:41.139 INFO:tasks.workunit.client.1.smithi120.stdout:2/131: write d4/f10 [2969780,124757] 0 2024-04-26T21:25:41.140 INFO:tasks.workunit.client.1.smithi120.stdout:9/52: dread d0/fa [0,4194304] 0 2024-04-26T21:25:41.145 INFO:tasks.workunit.client.1.smithi120.stdout:4/114: creat d10/d12/f2c x:0 0 0 2024-04-26T21:25:41.147 INFO:tasks.workunit.client.1.smithi120.stdout:5/121: creat d2/db/f28 x:0 0 0 2024-04-26T21:25:41.152 INFO:tasks.workunit.client.1.smithi120.stdout:7/60: dread f6 [0,4194304] 0 2024-04-26T21:25:41.152 INFO:tasks.workunit.client.1.smithi120.stdout:9/53: write d0/d6/f8 [2328199,10807] 0 2024-04-26T21:25:41.153 INFO:tasks.workunit.client.1.smithi120.stdout:5/122: mkdir d2/d1b/d29 0 2024-04-26T21:25:41.157 INFO:tasks.workunit.client.1.smithi120.stdout:8/72: dread d5/f16 [0,4194304] 0 2024-04-26T21:25:41.157 INFO:tasks.workunit.client.1.smithi120.stdout:9/54: rmdir d0 39 2024-04-26T21:25:41.160 INFO:tasks.workunit.client.1.smithi120.stdout:7/61: dread - d7/fa zero size 2024-04-26T21:25:41.160 INFO:tasks.workunit.client.1.smithi120.stdout:4/115: truncate f5 1749039 0 2024-04-26T21:25:41.168 INFO:tasks.workunit.client.1.smithi120.stdout:4/116: dread - d10/d12/f14 zero size 2024-04-26T21:25:41.173 INFO:tasks.workunit.client.1.smithi120.stdout:3/60: dread dd/de/f11 [0,4194304] 0 2024-04-26T21:25:41.174 INFO:tasks.workunit.client.1.smithi120.stdout:7/62: write d7/d10/d12/f15 [165045,32799] 0 2024-04-26T21:25:41.174 INFO:tasks.workunit.client.1.smithi120.stdout:6/78: dwrite d4/db/d10/f12 [0,4194304] 0 2024-04-26T21:25:41.177 INFO:tasks.workunit.client.1.smithi120.stdout:9/55: chown d0/d6/l7 317 1 2024-04-26T21:25:41.179 INFO:tasks.workunit.client.1.smithi120.stdout:4/117: creat d10/f2d x:0 0 0 2024-04-26T21:25:41.182 INFO:tasks.workunit.client.1.smithi120.stdout:1/101: sync 2024-04-26T21:25:41.183 INFO:tasks.workunit.client.1.smithi120.stdout:7/63: mknod d7/d10/c17 0 2024-04-26T21:25:41.186 INFO:tasks.workunit.client.1.smithi120.stdout:2/132: dwrite f3 [4194304,4194304] 0 2024-04-26T21:25:41.187 INFO:tasks.workunit.client.1.smithi120.stdout:9/56: symlink d0/dd/le 0 2024-04-26T21:25:41.194 INFO:tasks.workunit.client.1.smithi120.stdout:6/79: creat d4/db/d10/dd/f18 x:0 0 0 2024-04-26T21:25:41.198 INFO:tasks.workunit.client.1.smithi120.stdout:0/62: dwrite d0/d3/fa [4194304,4194304] 0 2024-04-26T21:25:41.201 INFO:tasks.workunit.client.1.smithi120.stdout:4/118: dread d10/d12/f1d [0,4194304] 0 2024-04-26T21:25:41.204 INFO:tasks.workunit.client.1.smithi120.stdout:9/57: write d0/d6/f8 [2077217,29878] 0 2024-04-26T21:25:41.208 INFO:tasks.workunit.client.1.smithi120.stdout:5/123: dread d2/f17 [0,4194304] 0 2024-04-26T21:25:41.209 INFO:tasks.workunit.client.1.smithi120.stdout:2/133: write d4/dd/d14/d15/f2b [398074,77003] 0 2024-04-26T21:25:41.214 INFO:tasks.workunit.client.1.smithi120.stdout:0/63: chown d0/d3/f9 11971693 1 2024-04-26T21:25:41.220 INFO:tasks.workunit.client.1.smithi120.stdout:5/124: truncate d2/db/f28 1024212 0 2024-04-26T21:25:41.225 INFO:tasks.workunit.client.1.smithi120.stdout:1/102: rename d6/d7/da/c17 to d6/d14/c22 0 2024-04-26T21:25:41.230 INFO:tasks.workunit.client.1.smithi120.stdout:3/61: dread fa [0,4194304] 0 2024-04-26T21:25:41.234 INFO:tasks.workunit.client.1.smithi120.stdout:1/103: mknod d6/d14/c23 0 2024-04-26T21:25:41.234 INFO:tasks.workunit.client.1.smithi120.stdout:8/73: dwrite d5/d6/d12/f17 [8388608,4194304] 0 2024-04-26T21:25:41.239 INFO:tasks.workunit.client.1.smithi120.stdout:5/125: chown d2/db/f1a 856 1 2024-04-26T21:25:41.250 INFO:tasks.workunit.client.1.smithi120.stdout:8/74: truncate d5/f19 1145782 0 2024-04-26T21:25:41.250 INFO:tasks.workunit.client.1.smithi120.stdout:1/104: chown d6/d7/da/f19 1069666084 1 2024-04-26T21:25:41.257 INFO:tasks.workunit.client.1.smithi120.stdout:7/64: dwrite d7/f8 [0,4194304] 0 2024-04-26T21:25:41.257 INFO:tasks.workunit.client.1.smithi120.stdout:5/126: write d2/dc/d1d/d1e/f25 [427722,128026] 0 2024-04-26T21:25:41.258 INFO:tasks.workunit.client.1.smithi120.stdout:8/75: creat d5/f21 x:0 0 0 2024-04-26T21:25:41.261 INFO:tasks.workunit.client.1.smithi120.stdout:9/58: dread d0/fa [0,4194304] 0 2024-04-26T21:25:41.268 INFO:tasks.workunit.client.1.smithi120.stdout:8/76: creat d5/d18/f22 x:0 0 0 2024-04-26T21:25:41.269 INFO:tasks.workunit.client.1.smithi120.stdout:2/134: dread f1 [0,4194304] 0 2024-04-26T21:25:41.270 INFO:tasks.workunit.client.1.smithi120.stdout:6/80: dwrite d4/db/d10/f15 [0,4194304] 0 2024-04-26T21:25:41.270 INFO:tasks.workunit.client.1.smithi120.stdout:0/64: dread d0/d3/fa [4194304,4194304] 0 2024-04-26T21:25:41.271 INFO:tasks.workunit.client.1.smithi120.stdout:9/59: rename d0/c4 to d0/dd/cf 0 2024-04-26T21:25:41.273 INFO:tasks.workunit.client.1.smithi120.stdout:0/65: readlink - no filename 2024-04-26T21:25:41.274 INFO:tasks.workunit.client.1.smithi120.stdout:7/65: rename d7/d10/c17 to d7/d10/c18 0 2024-04-26T21:25:41.274 INFO:tasks.workunit.client.1.smithi120.stdout:4/119: dwrite d10/f11 [0,4194304] 0 2024-04-26T21:25:41.275 INFO:tasks.workunit.client.1.smithi120.stdout:2/135: read d4/d1b/d25/f32 [4038942,97517] 0 2024-04-26T21:25:41.278 INFO:tasks.workunit.client.1.smithi120.stdout:3/62: dread f5 [0,4194304] 0 2024-04-26T21:25:41.278 INFO:tasks.workunit.client.1.smithi120.stdout:2/136: stat d4/d1b/d25/d2c 0 2024-04-26T21:25:41.279 INFO:tasks.workunit.client.1.smithi120.stdout:5/127: rename d2/db/f1a to d2/d1b/d29/f2a 0 2024-04-26T21:25:41.282 INFO:tasks.workunit.client.1.smithi120.stdout:3/63: fdatasync f9 0 2024-04-26T21:25:41.283 INFO:tasks.workunit.client.1.smithi120.stdout:4/120: creat d10/d28/f2e x:0 0 0 2024-04-26T21:25:41.284 INFO:tasks.workunit.client.1.smithi120.stdout:8/77: dread d5/f19 [0,4194304] 0 2024-04-26T21:25:41.286 INFO:tasks.workunit.client.1.smithi120.stdout:5/128: stat d2/d1b/d22 0 2024-04-26T21:25:41.286 INFO:tasks.workunit.client.1.smithi120.stdout:7/66: rmdir d7 39 2024-04-26T21:25:41.290 INFO:tasks.workunit.client.1.smithi120.stdout:1/105: dread d6/d7/da/dd/fe [0,4194304] 0 2024-04-26T21:25:41.293 INFO:tasks.workunit.client.1.smithi120.stdout:8/78: unlink d5/f21 0 2024-04-26T21:25:41.294 INFO:tasks.workunit.client.1.smithi120.stdout:3/64: mkdir dd/de/d18 0 2024-04-26T21:25:41.294 INFO:tasks.workunit.client.1.smithi120.stdout:6/81: dread d4/db/fe [0,4194304] 0 2024-04-26T21:25:41.296 INFO:tasks.workunit.client.1.smithi120.stdout:2/137: creat d4/d1b/d2e/f35 x:0 0 0 2024-04-26T21:25:41.297 INFO:tasks.workunit.client.1.smithi120.stdout:0/66: getdents d0 0 2024-04-26T21:25:41.298 INFO:tasks.workunit.client.1.smithi120.stdout:5/129: rename d2/db/f19 to d2/d1b/d22/f2b 0 2024-04-26T21:25:41.300 INFO:tasks.workunit.client.1.smithi120.stdout:5/130: chown d2/d1b/d22 1040 1 2024-04-26T21:25:41.302 INFO:tasks.workunit.client.1.smithi120.stdout:8/79: rmdir d5/d18 39 2024-04-26T21:25:41.304 INFO:tasks.workunit.client.1.smithi120.stdout:3/65: fdatasync dd/de/f11 0 2024-04-26T21:25:41.306 INFO:tasks.workunit.client.1.smithi120.stdout:6/82: creat d4/db/d10/f19 x:0 0 0 2024-04-26T21:25:41.308 INFO:tasks.workunit.client.1.smithi120.stdout:1/106: symlink d6/d7/d1b/l24 0 2024-04-26T21:25:41.310 INFO:tasks.workunit.client.1.smithi120.stdout:0/67: mkdir d0/d3/dc/d12 0 2024-04-26T21:25:41.311 INFO:tasks.workunit.client.1.smithi120.stdout:5/131: truncate d2/db/f28 1229461 0 2024-04-26T21:25:41.316 INFO:tasks.workunit.client.1.smithi120.stdout:5/132: read - d2/d1b/d29/f2a zero size 2024-04-26T21:25:41.318 INFO:tasks.workunit.client.1.smithi120.stdout:6/83: mkdir d4/db/d10/d1a 0 2024-04-26T21:25:41.318 INFO:tasks.workunit.client.1.smithi120.stdout:3/66: mknod dd/de/df/c19 0 2024-04-26T21:25:41.319 INFO:tasks.workunit.client.1.smithi120.stdout:4/121: dwrite d10/f24 [0,4194304] 0 2024-04-26T21:25:41.323 INFO:tasks.workunit.client.1.smithi120.stdout:0/68: mkdir d0/d3/d13 0 2024-04-26T21:25:41.325 INFO:tasks.workunit.client.1.smithi120.stdout:7/67: dwrite d7/f8 [4194304,4194304] 0 2024-04-26T21:25:41.325 INFO:tasks.workunit.client.1.smithi120.stdout:2/138: write d4/dd/d14/d15/f2d [112144,15591] 0 2024-04-26T21:25:41.325 INFO:tasks.workunit.client.1.smithi120.stdout:4/122: read - d10/d12/f27 zero size 2024-04-26T21:25:41.330 INFO:tasks.workunit.client.1.smithi120.stdout:6/84: chown d4/db/d10/d1a 3185187 1 2024-04-26T21:25:41.330 INFO:tasks.workunit.client.1.smithi120.stdout:8/80: getdents d5/d6/d11 0 2024-04-26T21:25:41.330 INFO:tasks.workunit.client.1.smithi120.stdout:3/67: write fa [1587254,73834] 0 2024-04-26T21:25:41.333 INFO:tasks.workunit.client.1.smithi120.stdout:5/133: unlink d2/dc/d1d/d1e/f25 0 2024-04-26T21:25:41.334 INFO:tasks.workunit.client.1.smithi120.stdout:2/139: stat d4/l8 0 2024-04-26T21:25:41.334 INFO:tasks.workunit.client.1.smithi120.stdout:0/69: creat d0/f14 x:0 0 0 2024-04-26T21:25:41.336 INFO:tasks.workunit.client.1.smithi120.stdout:4/123: creat d10/d12/f2f x:0 0 0 2024-04-26T21:25:41.338 INFO:tasks.workunit.client.1.smithi120.stdout:8/81: symlink d5/d6/l23 0 2024-04-26T21:25:41.340 INFO:tasks.workunit.client.1.smithi120.stdout:6/85: fdatasync d4/db/fe 0 2024-04-26T21:25:41.342 INFO:tasks.workunit.client.1.smithi120.stdout:3/68: stat dd/l17 0 2024-04-26T21:25:41.345 INFO:tasks.workunit.client.1.smithi120.stdout:4/124: chown d10/d12/f2c 15 1 2024-04-26T21:25:41.349 INFO:tasks.workunit.client.1.smithi120.stdout:8/82: read d5/d6/d11/f10 [4165737,33465] 0 2024-04-26T21:25:41.349 INFO:tasks.workunit.client.1.smithi120.stdout:1/107: dwrite d6/d9/f1c [4194304,4194304] 0 2024-04-26T21:25:41.351 INFO:tasks.workunit.client.1.smithi120.stdout:2/140: truncate d4/dd/f2a 170681 0 2024-04-26T21:25:41.354 INFO:tasks.workunit.client.1.smithi120.stdout:7/68: getdents d7 0 2024-04-26T21:25:41.358 INFO:tasks.workunit.client.1.smithi120.stdout:1/108: write d6/d9/f1c [9210027,20491] 0 2024-04-26T21:25:41.358 INFO:tasks.workunit.client.1.smithi120.stdout:6/86: write d4/db/d10/dd/f18 [160108,58739] 0 2024-04-26T21:25:41.360 INFO:tasks.workunit.client.1.smithi120.stdout:2/141: write d4/dd/f21 [3438763,16802] 0 2024-04-26T21:25:41.360 INFO:tasks.workunit.client.1.smithi120.stdout:0/70: chown d0/d3/dc 109 1 2024-04-26T21:25:41.360 INFO:tasks.workunit.client.1.smithi120.stdout:4/125: rename ld to d10/d28/l30 0 2024-04-26T21:25:41.363 INFO:tasks.workunit.client.1.smithi120.stdout:8/83: write d5/d18/f22 [212689,95511] 0 2024-04-26T21:25:41.364 INFO:tasks.workunit.client.1.smithi120.stdout:3/69: creat dd/de/d18/f1a x:0 0 0 2024-04-26T21:25:41.366 INFO:tasks.workunit.client.1.smithi120.stdout:4/126: read - d10/d12/f14 zero size 2024-04-26T21:25:41.368 INFO:tasks.workunit.client.1.smithi120.stdout:6/87: read - d4/db/d10/f19 zero size 2024-04-26T21:25:41.368 INFO:tasks.workunit.client.1.smithi120.stdout:1/109: fdatasync d6/d9/f1e 0 2024-04-26T21:25:41.370 INFO:tasks.workunit.client.1.smithi120.stdout:7/69: write d7/d10/f11 [959626,75642] 0 2024-04-26T21:25:41.374 INFO:tasks.workunit.client.1.smithi120.stdout:8/84: unlink d5/d6/d12/f1a 0 2024-04-26T21:25:41.375 INFO:tasks.workunit.client.1.smithi120.stdout:5/134: dwrite d2/dc/fd [0,4194304] 0 2024-04-26T21:25:41.379 INFO:tasks.workunit.client.1.smithi120.stdout:4/127: write d10/f2d [400150,114950] 0 2024-04-26T21:25:41.381 INFO:tasks.workunit.client.1.smithi120.stdout:8/85: write d5/d6/fd [2015104,96860] 0 2024-04-26T21:25:41.381 INFO:tasks.workunit.client.1.smithi120.stdout:0/71: link d0/f10 d0/d3/dc/f15 0 2024-04-26T21:25:41.381 INFO:tasks.workunit.client.1.smithi120.stdout:3/70: symlink dd/de/df/d12/l1b 0 2024-04-26T21:25:41.381 INFO:tasks.workunit.client.1.smithi120.stdout:7/70: chown d7/fa 0 1 2024-04-26T21:25:41.382 INFO:tasks.workunit.client.1.smithi120.stdout:6/88: creat d4/db/f1b x:0 0 0 2024-04-26T21:25:41.383 INFO:tasks.workunit.client.1.smithi120.stdout:6/89: stat d4/f14 0 2024-04-26T21:25:41.385 INFO:tasks.workunit.client.1.smithi120.stdout:7/71: dread - d7/d10/d12/f16 zero size 2024-04-26T21:25:41.385 INFO:tasks.workunit.client.1.smithi120.stdout:3/71: write dd/de/d18/f1a [942151,103952] 0 2024-04-26T21:25:41.386 INFO:tasks.workunit.client.1.smithi120.stdout:8/86: chown l3 104632 1 2024-04-26T21:25:41.389 INFO:tasks.workunit.client.1.smithi120.stdout:2/142: dread f3 [0,4194304] 0 2024-04-26T21:25:41.390 INFO:tasks.workunit.client.1.smithi120.stdout:7/72: write d7/d10/f11 [656479,85538] 0 2024-04-26T21:25:41.405 INFO:tasks.workunit.client.1.smithi120.stdout:0/72: link d0/c11 d0/d3/dc/d12/c16 0 2024-04-26T21:25:41.407 INFO:tasks.workunit.client.1.smithi120.stdout:3/72: dread dd/de/d18/f1a [0,4194304] 0 2024-04-26T21:25:41.409 INFO:tasks.workunit.client.1.smithi120.stdout:0/73: dread - d0/f14 zero size 2024-04-26T21:25:41.410 INFO:tasks.workunit.client.1.smithi120.stdout:7/73: chown d7/d10/c18 6 1 2024-04-26T21:25:41.410 INFO:tasks.workunit.client.1.smithi120.stdout:1/110: dwrite d6/d7/da/dd/fe [4194304,4194304] 0 2024-04-26T21:25:41.413 INFO:tasks.workunit.client.1.smithi120.stdout:4/128: write d10/d12/f1d [1070771,3480] 0 2024-04-26T21:25:41.414 INFO:tasks.workunit.client.1.smithi120.stdout:8/87: dread d5/f16 [0,4194304] 0 2024-04-26T21:25:41.419 INFO:tasks.workunit.client.1.smithi120.stdout:7/74: chown d7/lc 0 1 2024-04-26T21:25:41.425 INFO:tasks.workunit.client.1.smithi120.stdout:0/74: mknod d0/c17 0 2024-04-26T21:25:41.425 INFO:tasks.workunit.client.1.smithi120.stdout:8/88: mknod d5/d6/d11/c24 0 2024-04-26T21:25:41.430 INFO:tasks.workunit.client.1.smithi120.stdout:6/90: dwrite d4/f14 [0,4194304] 0 2024-04-26T21:25:41.432 INFO:tasks.workunit.client.1.smithi120.stdout:5/135: dwrite d2/d1b/d29/f2a [0,4194304] 0 2024-04-26T21:25:41.432 INFO:tasks.workunit.client.1.smithi120.stdout:7/75: mkdir d7/d19 0 2024-04-26T21:25:41.438 INFO:tasks.workunit.client.1.smithi120.stdout:0/75: fsync d0/d3/fa 0 2024-04-26T21:25:41.440 INFO:tasks.workunit.client.1.smithi120.stdout:8/89: creat d5/d6/f25 x:0 0 0 2024-04-26T21:25:41.442 INFO:tasks.workunit.client.1.smithi120.stdout:5/136: write d2/fa [4398034,130561] 0 2024-04-26T21:25:41.443 INFO:tasks.workunit.client.1.smithi120.stdout:2/143: dwrite f3 [0,4194304] 0 2024-04-26T21:25:41.445 INFO:tasks.workunit.client.1.smithi120.stdout:6/91: creat d4/db/d10/dd/f1c x:0 0 0 2024-04-26T21:25:41.455 INFO:tasks.workunit.client.1.smithi120.stdout:4/129: dread d10/d12/f22 [0,4194304] 0 2024-04-26T21:25:41.460 INFO:tasks.workunit.client.1.smithi120.stdout:6/92: dread d4/db/fe [0,4194304] 0 2024-04-26T21:25:41.460 INFO:tasks.workunit.client.1.smithi120.stdout:5/137: rmdir d2/db 39 2024-04-26T21:25:41.461 INFO:tasks.workunit.client.1.smithi120.stdout:0/76: mknod d0/d3/d13/c18 0 2024-04-26T21:25:41.465 INFO:tasks.workunit.client.1.smithi120.stdout:4/130: truncate d10/f2d 1113749 0 2024-04-26T21:25:41.467 INFO:tasks.workunit.client.1.smithi120.stdout:5/138: chown d2/d1b/l23 7081 1 2024-04-26T21:25:41.468 INFO:tasks.workunit.client.1.smithi120.stdout:1/111: dwrite d6/d7/da/fb [0,4194304] 0 2024-04-26T21:25:41.472 INFO:tasks.workunit.client.1.smithi120.stdout:0/77: symlink d0/l19 0 2024-04-26T21:25:41.475 INFO:tasks.workunit.client.1.smithi120.stdout:6/93: symlink d4/db/d10/dd/l1d 0 2024-04-26T21:25:41.485 INFO:tasks.workunit.client.1.smithi120.stdout:4/131: creat d10/d28/f31 x:0 0 0 2024-04-26T21:25:41.499 INFO:tasks.workunit.client.0.smithi084.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-26T21:25:41.514 INFO:tasks.workunit.client.0.smithi084.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T21:25:41.514 INFO:tasks.workunit.client.0.smithi084.stderr:+ make 2024-04-26T21:25:41.549 INFO:tasks.workunit.client.1.smithi120.stdout:9/60: sync 2024-04-26T21:25:41.552 INFO:tasks.workunit.client.1.smithi120.stdout:7/76: dwrite d7/d10/d12/f15 [0,4194304] 0 2024-04-26T21:25:41.564 INFO:tasks.workunit.client.1.smithi120.stdout:8/90: dwrite d5/d6/f1e [0,4194304] 0 2024-04-26T21:25:41.569 INFO:tasks.workunit.client.1.smithi120.stdout:2/144: dwrite d4/f13 [0,4194304] 0 2024-04-26T21:25:41.576 INFO:tasks.workunit.client.1.smithi120.stdout:5/139: dwrite d2/d1b/f26 [0,4194304] 0 2024-04-26T21:25:41.576 INFO:tasks.workunit.client.1.smithi120.stdout:6/94: dread f1 [0,4194304] 0 2024-04-26T21:25:41.582 INFO:tasks.workunit.client.1.smithi120.stdout:6/95: write d4/db/fe [917473,112864] 0 2024-04-26T21:25:41.586 INFO:tasks.workunit.client.1.smithi120.stdout:6/96: write d4/db/d10/dd/f1c [393307,85416] 0 2024-04-26T21:25:41.607 INFO:tasks.workunit.client.1.smithi120.stdout:2/145: dwrite d4/dd/d14/d15/f2b [0,4194304] 0 2024-04-26T21:25:41.622 INFO:tasks.workunit.client.1.smithi120.stdout:6/97: dwrite d4/db/d10/f19 [0,4194304] 0 2024-04-26T21:25:41.623 INFO:tasks.workunit.client.1.smithi120.stdout:0/78: creat d0/d3/dc/d12/f1a x:0 0 0 2024-04-26T21:25:41.625 INFO:tasks.workunit.client.1.smithi120.stdout:9/61: mknod d0/dd/c10 0 2024-04-26T21:25:41.628 INFO:tasks.workunit.client.1.smithi120.stdout:8/91: rmdir d5/d6/d12 39 2024-04-26T21:25:41.630 INFO:tasks.workunit.client.1.smithi120.stdout:7/77: mkdir d7/d10/d12/d1a 0 2024-04-26T21:25:41.634 INFO:tasks.workunit.client.1.smithi120.stdout:8/92: chown d5/d6/fd 277614358 1 2024-04-26T21:25:41.635 INFO:tasks.workunit.client.1.smithi120.stdout:2/146: dread f3 [4194304,4194304] 0 2024-04-26T21:25:41.636 INFO:tasks.workunit.client.1.smithi120.stdout:5/140: creat d2/dc/d1d/d1f/f2c x:0 0 0 2024-04-26T21:25:41.638 INFO:tasks.workunit.client.1.smithi120.stdout:6/98: rename d4/db/cf to d4/db/c1e 0 2024-04-26T21:25:41.640 INFO:tasks.workunit.client.1.smithi120.stdout:3/73: sync 2024-04-26T21:25:41.642 INFO:tasks.workunit.client.1.smithi120.stdout:6/99: readlink d4/db/d10/dd/l1d 0 2024-04-26T21:25:41.642 INFO:tasks.workunit.client.1.smithi120.stdout:0/79: truncate d0/d3/fa 2469274 0 2024-04-26T21:25:41.644 INFO:tasks.workunit.client.1.smithi120.stdout:5/141: symlink d2/dc/d1d/d1f/l2d 0 2024-04-26T21:25:41.646 INFO:tasks.workunit.client.1.smithi120.stdout:2/147: mknod d4/d1b/d25/c36 0 2024-04-26T21:25:41.647 INFO:tasks.workunit.client.1.smithi120.stdout:7/78: mknod d7/d10/d12/d1a/c1b 0 2024-04-26T21:25:41.649 INFO:tasks.workunit.client.1.smithi120.stdout:6/100: fdatasync f1 0 2024-04-26T21:25:41.652 INFO:tasks.workunit.client.1.smithi120.stdout:4/132: dwrite d10/d12/f18 [0,4194304] 0 2024-04-26T21:25:41.653 INFO:tasks.workunit.client.1.smithi120.stdout:6/101: chown d4/db/lc 7 1 2024-04-26T21:25:41.654 INFO:tasks.workunit.client.1.smithi120.stdout:8/93: symlink d5/l26 0 2024-04-26T21:25:41.658 INFO:tasks.workunit.client.1.smithi120.stdout:5/142: chown d2/db/f28 51862810 1 2024-04-26T21:25:41.658 INFO:tasks.workunit.client.1.smithi120.stdout:4/133: chown d10/d12/f14 356972429 1 2024-04-26T21:25:41.658 INFO:tasks.workunit.client.1.smithi120.stdout:3/74: truncate dd/de/f11 1007095 0 2024-04-26T21:25:41.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:41 smithi084 ceph-mon[25539]: pgmap v35: 65 pgs: 65 active+clean; 218 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 113 op/s 2024-04-26T21:25:41.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:41 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:41.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:41 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:41.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:41 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:25:41.662 INFO:tasks.workunit.client.1.smithi120.stdout:7/79: rename d7/lc to d7/l1c 0 2024-04-26T21:25:41.665 INFO:tasks.workunit.client.1.smithi120.stdout:6/102: creat d4/f1f x:0 0 0 2024-04-26T21:25:41.665 INFO:tasks.workunit.client.1.smithi120.stdout:9/62: dwrite d0/f1 [4194304,4194304] 0 2024-04-26T21:25:41.665 INFO:tasks.workunit.client.1.smithi120.stdout:0/80: mkdir d0/d3/dc/dd/d1b 0 2024-04-26T21:25:41.666 INFO:tasks.workunit.client.1.smithi120.stdout:2/148: creat d4/d1b/d25/d29/f37 x:0 0 0 2024-04-26T21:25:41.671 INFO:tasks.workunit.client.1.smithi120.stdout:5/143: write d2/d1b/d22/f2b [2446438,104775] 0 2024-04-26T21:25:41.673 INFO:tasks.workunit.client.1.smithi120.stdout:8/94: mkdir d5/d6/d12/d27 0 2024-04-26T21:25:41.677 INFO:tasks.workunit.client.1.smithi120.stdout:7/80: creat d7/d10/d12/f1d x:0 0 0 2024-04-26T21:25:41.679 INFO:tasks.workunit.client.1.smithi120.stdout:7/81: read - d7/fa zero size 2024-04-26T21:25:41.681 INFO:tasks.workunit.client.1.smithi120.stdout:7/82: chown f3 173 1 2024-04-26T21:25:41.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:41 smithi120 ceph-mon[32741]: pgmap v35: 65 pgs: 65 active+clean; 218 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 113 op/s 2024-04-26T21:25:41.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:41 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:41.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:41 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:41.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:41 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:25:41.684 INFO:tasks.workunit.client.1.smithi120.stdout:8/95: symlink d5/d6/d11/l28 0 2024-04-26T21:25:41.686 INFO:tasks.workunit.client.1.smithi120.stdout:0/81: dread d0/fb [0,4194304] 0 2024-04-26T21:25:41.687 INFO:tasks.workunit.client.1.smithi120.stdout:7/83: read d7/fd [418177,39170] 0 2024-04-26T21:25:41.689 INFO:tasks.workunit.client.1.smithi120.stdout:8/96: stat d5/d6/d11/f10 0 2024-04-26T21:25:41.693 INFO:tasks.workunit.client.1.smithi120.stdout:3/75: getdents dd/de/df 0 2024-04-26T21:25:41.700 INFO:tasks.workunit.client.1.smithi120.stdout:6/103: dread d4/f14 [0,4194304] 0 2024-04-26T21:25:41.702 INFO:tasks.workunit.client.1.smithi120.stdout:3/76: dread - dd/de/df/f16 zero size 2024-04-26T21:25:41.707 INFO:tasks.workunit.client.1.smithi120.stdout:7/84: mknod d7/c1e 0 2024-04-26T21:25:41.708 INFO:tasks.workunit.client.1.smithi120.stdout:0/82: rename d0/fb to d0/d3/dc/f1c 0 2024-04-26T21:25:41.709 INFO:tasks.workunit.client.1.smithi120.stdout:5/144: dwrite d2/db/f28 [0,4194304] 0 2024-04-26T21:25:41.712 INFO:tasks.workunit.client.1.smithi120.stdout:0/83: fsync d0/f14 0 2024-04-26T21:25:41.715 INFO:tasks.workunit.client.1.smithi120.stdout:5/145: fdatasync d2/dc/fd 0 2024-04-26T21:25:41.717 INFO:tasks.workunit.client.1.smithi120.stdout:3/77: symlink dd/de/d18/l1c 0 2024-04-26T21:25:41.718 INFO:tasks.workunit.client.1.smithi120.stdout:7/85: mkdir d7/d10/d12/d1f 0 2024-04-26T21:25:41.721 INFO:tasks.workunit.client.1.smithi120.stdout:0/84: stat d0/d3/fa 0 2024-04-26T21:25:41.722 INFO:tasks.workunit.client.1.smithi120.stdout:3/78: read f5 [604639,51289] 0 2024-04-26T21:25:41.724 INFO:tasks.workunit.client.1.smithi120.stdout:9/63: dread d0/f1 [0,4194304] 0 2024-04-26T21:25:41.725 INFO:tasks.workunit.client.1.smithi120.stdout:8/97: dwrite d5/d6/f1f [0,4194304] 0 2024-04-26T21:25:41.729 INFO:tasks.workunit.client.1.smithi120.stdout:9/64: symlink d0/l11 0 2024-04-26T21:25:41.730 INFO:tasks.workunit.client.1.smithi120.stdout:2/149: dread d4/f10 [0,4194304] 0 2024-04-26T21:25:41.735 INFO:tasks.workunit.client.1.smithi120.stdout:6/104: dwrite f1 [0,4194304] 0 2024-04-26T21:25:41.737 INFO:tasks.workunit.client.1.smithi120.stdout:2/150: creat d4/d1b/f38 x:0 0 0 2024-04-26T21:25:41.738 INFO:tasks.workunit.client.1.smithi120.stdout:0/85: write d0/d3/dc/f15 [1283095,57772] 0 2024-04-26T21:25:41.738 INFO:tasks.workunit.client.1.smithi120.stdout:3/79: write dd/de/f11 [1611305,31432] 0 2024-04-26T21:25:41.740 INFO:tasks.workunit.client.1.smithi120.stdout:9/65: write d0/f1 [6233985,64366] 0 2024-04-26T21:25:41.754 INFO:tasks.workunit.client.1.smithi120.stdout:3/80: chown dd/f15 61870295 1 2024-04-26T21:25:41.754 INFO:tasks.workunit.client.1.smithi120.stdout:0/86: fsync d0/f10 0 2024-04-26T21:25:41.755 INFO:tasks.workunit.client.1.smithi120.stdout:7/86: dwrite d7/d10/d12/f1d [0,4194304] 0 2024-04-26T21:25:41.759 INFO:tasks.workunit.client.1.smithi120.stdout:9/66: chown d0/c5 29009 1 2024-04-26T21:25:41.760 INFO:tasks.workunit.client.1.smithi120.stdout:3/81: mkdir dd/d1d 0 2024-04-26T21:25:41.762 INFO:tasks.workunit.client.1.smithi120.stdout:2/151: rename d4/d1b/d25/d2c/ce to d4/d1b/d25/c39 0 2024-04-26T21:25:41.763 INFO:tasks.workunit.client.1.smithi120.stdout:7/87: dread - d7/d10/d12/f16 zero size 2024-04-26T21:25:41.765 INFO:tasks.workunit.client.1.smithi120.stdout:0/87: rmdir d0/d3/dc/d12 39 2024-04-26T21:25:41.767 INFO:tasks.workunit.client.1.smithi120.stdout:2/152: chown d4/d1b/d25/d2c 188431 1 2024-04-26T21:25:41.770 INFO:tasks.workunit.client.1.smithi120.stdout:2/153: chown d4/f10 45 1 2024-04-26T21:25:41.773 INFO:tasks.workunit.client.1.smithi120.stdout:7/88: symlink d7/l20 0 2024-04-26T21:25:41.773 INFO:tasks.workunit.client.1.smithi120.stdout:8/98: dwrite d5/d6/d12/f17 [0,4194304] 0 2024-04-26T21:25:41.776 INFO:tasks.workunit.client.1.smithi120.stdout:6/105: dwrite d4/db/d10/f12 [0,4194304] 0 2024-04-26T21:25:41.784 INFO:tasks.workunit.client.1.smithi120.stdout:2/154: creat d4/f3a x:0 0 0 2024-04-26T21:25:41.785 INFO:tasks.workunit.client.1.smithi120.stdout:7/89: symlink d7/d10/d12/d1a/l21 0 2024-04-26T21:25:41.788 INFO:tasks.workunit.client.1.smithi120.stdout:3/82: dread dd/de/f11 [0,4194304] 0 2024-04-26T21:25:41.790 INFO:tasks.workunit.client.1.smithi120.stdout:0/88: dread d0/d3/fa [0,4194304] 0 2024-04-26T21:25:41.793 INFO:tasks.workunit.client.1.smithi120.stdout:8/99: creat d5/f29 x:0 0 0 2024-04-26T21:25:41.794 INFO:tasks.workunit.client.1.smithi120.stdout:2/155: write f1 [1307884,65733] 0 2024-04-26T21:25:41.795 INFO:tasks.workunit.client.1.smithi120.stdout:0/89: rmdir d0 39 2024-04-26T21:25:41.795 INFO:tasks.workunit.client.1.smithi120.stdout:7/90: creat d7/f22 x:0 0 0 2024-04-26T21:25:41.796 INFO:tasks.workunit.client.1.smithi120.stdout:3/83: mkdir dd/de/df/d1e 0 2024-04-26T21:25:41.800 INFO:tasks.workunit.client.1.smithi120.stdout:8/100: truncate d5/f29 253921 0 2024-04-26T21:25:41.800 INFO:tasks.workunit.client.1.smithi120.stdout:9/67: dwrite d0/d6/f8 [0,4194304] 0 2024-04-26T21:25:41.802 INFO:tasks.workunit.client.1.smithi120.stdout:8/101: stat d5/f16 0 2024-04-26T21:25:41.804 INFO:tasks.workunit.client.1.smithi120.stdout:3/84: creat dd/d1d/f1f x:0 0 0 2024-04-26T21:25:41.804 INFO:tasks.workunit.client.1.smithi120.stdout:7/91: chown d7/d10/d12/f16 7 1 2024-04-26T21:25:41.805 INFO:tasks.workunit.client.1.smithi120.stdout:0/90: symlink d0/d3/d13/l1d 0 2024-04-26T21:25:41.809 INFO:tasks.workunit.client.1.smithi120.stdout:0/91: rename d0/d3 to d0/d3/dc/dd/d1e 22 2024-04-26T21:25:41.810 INFO:tasks.workunit.client.1.smithi120.stdout:7/92: mknod d7/d10/d12/d1f/c23 0 2024-04-26T21:25:41.811 INFO:tasks.workunit.client.1.smithi120.stdout:0/92: chown d0/d3/d13/l1d 38283132 1 2024-04-26T21:25:41.812 INFO:tasks.workunit.client.1.smithi120.stdout:2/156: dread d4/dd/d14/d15/f2d [0,4194304] 0 2024-04-26T21:25:41.815 INFO:tasks.workunit.client.1.smithi120.stdout:2/157: chown d4/l6 180 1 2024-04-26T21:25:41.819 INFO:tasks.workunit.client.1.smithi120.stdout:8/102: getdents d5/d6/d11 0 2024-04-26T21:25:41.820 INFO:tasks.workunit.client.1.smithi120.stdout:6/106: truncate d4/db/d10/f12 1027963 0 2024-04-26T21:25:41.822 INFO:tasks.workunit.client.1.smithi120.stdout:2/158: mknod d4/d1b/c3b 0 2024-04-26T21:25:41.823 INFO:tasks.workunit.client.1.smithi120.stdout:7/93: creat d7/d19/f24 x:0 0 0 2024-04-26T21:25:41.824 INFO:tasks.workunit.client.1.smithi120.stdout:2/159: readlink d4/l1f 0 2024-04-26T21:25:41.826 INFO:tasks.workunit.client.1.smithi120.stdout:8/103: creat d5/d6/d11/f2a x:0 0 0 2024-04-26T21:25:41.826 INFO:tasks.workunit.client.1.smithi120.stdout:9/68: dread d0/d6/f8 [0,4194304] 0 2024-04-26T21:25:41.827 INFO:tasks.workunit.client.1.smithi120.stdout:0/93: write d0/f14 [2456,30503] 0 2024-04-26T21:25:41.827 INFO:tasks.workunit.client.1.smithi120.stdout:7/94: write d7/d10/d12/f16 [421443,97015] 0 2024-04-26T21:25:41.828 INFO:tasks.workunit.client.1.smithi120.stdout:6/107: chown d4/db/d10/f12 2901558 1 2024-04-26T21:25:41.829 INFO:tasks.workunit.client.1.smithi120.stdout:1/112: sync 2024-04-26T21:25:41.830 INFO:tasks.workunit.client.1.smithi120.stdout:9/69: chown d0/c5 22 1 2024-04-26T21:25:41.832 INFO:tasks.workunit.client.1.smithi120.stdout:2/160: write d4/dd/d14/d15/f2d [261107,35132] 0 2024-04-26T21:25:41.834 INFO:tasks.workunit.client.1.smithi120.stdout:8/104: mknod d5/d6/d11/c2b 0 2024-04-26T21:25:41.835 INFO:tasks.workunit.client.1.smithi120.stdout:6/108: symlink d4/db/l20 0 2024-04-26T21:25:41.837 INFO:tasks.workunit.client.1.smithi120.stdout:6/109: readlink d4/db/d10/dd/l16 0 2024-04-26T21:25:41.837 INFO:tasks.workunit.client.1.smithi120.stdout:9/70: creat d0/dd/f12 x:0 0 0 2024-04-26T21:25:41.840 INFO:tasks.workunit.client.1.smithi120.stdout:6/110: write d4/db/f1b [421946,86193] 0 2024-04-26T21:25:41.840 INFO:tasks.workunit.client.1.smithi120.stdout:0/94: creat d0/d3/d13/f1f x:0 0 0 2024-04-26T21:25:41.842 INFO:tasks.workunit.client.1.smithi120.stdout:0/95: fdatasync d0/f14 0 2024-04-26T21:25:41.842 INFO:tasks.workunit.client.1.smithi120.stdout:2/161: mkdir d4/dd/d14/d3c 0 2024-04-26T21:25:41.842 INFO:tasks.workunit.client.1.smithi120.stdout:7/95: dread d7/fd [0,4194304] 0 2024-04-26T21:25:41.844 INFO:tasks.workunit.client.1.smithi120.stdout:1/113: rename d6/d14/c22 to d6/d7/da/c25 0 2024-04-26T21:25:41.847 INFO:tasks.workunit.client.1.smithi120.stdout:0/96: creat d0/d3/d13/f20 x:0 0 0 2024-04-26T21:25:41.849 INFO:tasks.workunit.client.1.smithi120.stdout:7/96: creat d7/d10/d12/d1a/f25 x:0 0 0 2024-04-26T21:25:41.852 INFO:tasks.workunit.client.1.smithi120.stdout:6/111: rename d4/db/c1e to d4/db/d10/d1a/c21 0 2024-04-26T21:25:41.854 INFO:tasks.workunit.client.1.smithi120.stdout:6/112: write d4/db/fe [581118,114447] 0 2024-04-26T21:25:41.858 INFO:tasks.workunit.client.1.smithi120.stdout:7/97: symlink d7/d10/d12/d1f/l26 0 2024-04-26T21:25:41.860 INFO:tasks.workunit.client.1.smithi120.stdout:0/97: rename d0/d3/fa to d0/d3/dc/dd/f21 0 2024-04-26T21:25:41.860 INFO:tasks.workunit.client.1.smithi120.stdout:7/98: dread - d7/d10/d12/d1a/f25 zero size 2024-04-26T21:25:41.861 INFO:tasks.workunit.client.1.smithi120.stdout:8/105: fsync d5/d6/d11/f2a 0 2024-04-26T21:25:41.862 INFO:tasks.workunit.client.1.smithi120.stdout:7/99: chown d7/d10/d12/d1f/l26 3 1 2024-04-26T21:25:41.864 INFO:tasks.workunit.client.1.smithi120.stdout:0/98: truncate d0/d3/d13/f20 729183 0 2024-04-26T21:25:41.864 INFO:tasks.workunit.client.1.smithi120.stdout:8/106: fdatasync d5/d6/d12/f17 0 2024-04-26T21:25:41.865 INFO:tasks.workunit.client.1.smithi120.stdout:6/113: mkdir d4/db/d10/d22 0 2024-04-26T21:25:41.865 INFO:tasks.workunit.client.1.smithi120.stdout:0/99: write d0/d3/dc/f15 [2417471,60953] 0 2024-04-26T21:25:41.867 INFO:tasks.workunit.client.1.smithi120.stdout:7/100: unlink d7/fa 0 2024-04-26T21:25:41.869 INFO:tasks.workunit.client.1.smithi120.stdout:7/101: chown d7/d10/d12/d1f/c23 19917 1 2024-04-26T21:25:41.872 INFO:tasks.workunit.client.1.smithi120.stdout:7/102: write d7/d10/d12/f16 [433753,83093] 0 2024-04-26T21:25:41.872 INFO:tasks.workunit.client.1.smithi120.stdout:8/107: mknod d5/d6/c2c 0 2024-04-26T21:25:41.874 INFO:tasks.workunit.client.1.smithi120.stdout:8/108: read d5/d6/f1e [3108333,23296] 0 2024-04-26T21:25:41.874 INFO:tasks.workunit.client.1.smithi120.stdout:2/162: truncate d4/dd/f27 302884 0 2024-04-26T21:25:41.878 INFO:tasks.workunit.client.1.smithi120.stdout:0/100: creat d0/d3/dc/f22 x:0 0 0 2024-04-26T21:25:41.879 INFO:tasks.workunit.client.1.smithi120.stdout:7/103: creat d7/d10/d12/d1a/f27 x:0 0 0 2024-04-26T21:25:41.880 INFO:tasks.workunit.client.1.smithi120.stdout:0/101: readlink d0/d3/d13/l1d 0 2024-04-26T21:25:41.880 INFO:tasks.workunit.client.1.smithi120.stdout:7/104: read - d7/f22 zero size 2024-04-26T21:25:41.880 INFO:tasks.workunit.client.1.smithi120.stdout:8/109: symlink d5/d6/d12/l2d 0 2024-04-26T21:25:41.882 INFO:tasks.workunit.client.1.smithi120.stdout:2/163: rmdir d4/d1b/d2e 39 2024-04-26T21:25:41.884 INFO:tasks.workunit.client.1.smithi120.stdout:0/102: creat d0/d3/f23 x:0 0 0 2024-04-26T21:25:41.885 INFO:tasks.workunit.client.1.smithi120.stdout:2/164: truncate d4/f34 274753 0 2024-04-26T21:25:41.885 INFO:tasks.workunit.client.1.smithi120.stdout:7/105: mkdir d7/d10/d12/d1f/d28 0 2024-04-26T21:25:41.887 INFO:tasks.workunit.client.1.smithi120.stdout:8/110: mkdir d5/d2e 0 2024-04-26T21:25:41.891 INFO:tasks.workunit.client.1.smithi120.stdout:7/106: rename d7/d10/d12/d1a/f25 to d7/f29 0 2024-04-26T21:25:41.892 INFO:tasks.workunit.client.1.smithi120.stdout:0/103: mkdir d0/d3/dc/dd/d1b/d24 0 2024-04-26T21:25:41.892 INFO:tasks.workunit.client.1.smithi120.stdout:8/111: write d5/d6/d11/f2a [1038584,2886] 0 2024-04-26T21:25:41.897 INFO:tasks.workunit.client.1.smithi120.stdout:0/104: write d0/d3/d13/f1f [144604,43714] 0 2024-04-26T21:25:41.898 INFO:tasks.workunit.client.1.smithi120.stdout:7/107: truncate d7/d10/d12/d1a/f27 420878 0 2024-04-26T21:25:41.899 INFO:tasks.workunit.client.1.smithi120.stdout:8/112: rmdir d5 39 2024-04-26T21:25:41.899 INFO:tasks.workunit.client.1.smithi120.stdout:7/108: fsync f3 0 2024-04-26T21:25:41.904 INFO:tasks.workunit.client.1.smithi120.stdout:7/109: rename d7/d10/d12 to d7/d10/d12/d1f/d28/d2a 22 2024-04-26T21:25:41.905 INFO:tasks.workunit.client.1.smithi120.stdout:0/105: symlink d0/d3/dc/d12/l25 0 2024-04-26T21:25:41.907 INFO:tasks.workunit.client.1.smithi120.stdout:8/113: chown d5/d6/f1f 3 1 2024-04-26T21:25:41.910 INFO:tasks.workunit.client.1.smithi120.stdout:7/110: write d7/f22 [660814,100366] 0 2024-04-26T21:25:41.910 INFO:tasks.workunit.client.1.smithi120.stdout:0/106: unlink d0/d3/d13/l1d 0 2024-04-26T21:25:41.911 INFO:tasks.workunit.client.1.smithi120.stdout:8/114: chown d5/l26 176070 1 2024-04-26T21:25:41.916 INFO:tasks.workunit.client.1.smithi120.stdout:0/107: write d0/d3/dc/d12/f1a [188760,88283] 0 2024-04-26T21:25:41.916 INFO:tasks.workunit.client.1.smithi120.stdout:2/165: dwrite d4/dd/d14/d15/f2d [0,4194304] 0 2024-04-26T21:25:41.917 INFO:tasks.workunit.client.1.smithi120.stdout:8/115: symlink d5/d6/l2f 0 2024-04-26T21:25:41.921 INFO:tasks.workunit.client.1.smithi120.stdout:2/166: write d4/f13 [2620383,29705] 0 2024-04-26T21:25:41.922 INFO:tasks.workunit.client.1.smithi120.stdout:8/116: write d5/d18/f22 [802522,97570] 0 2024-04-26T21:25:41.930 INFO:tasks.workunit.client.1.smithi120.stdout:2/167: fsync f3 0 2024-04-26T21:25:41.930 INFO:tasks.workunit.client.1.smithi120.stdout:0/108: read d0/d3/d13/f1f [110816,119052] 0 2024-04-26T21:25:41.932 INFO:tasks.workunit.client.1.smithi120.stdout:2/168: mkdir d4/d1b/d25/d3d 0 2024-04-26T21:25:41.933 INFO:tasks.workunit.client.1.smithi120.stdout:0/109: mknod d0/d3/dc/d12/c26 0 2024-04-26T21:25:41.936 INFO:tasks.workunit.client.1.smithi120.stdout:7/111: dwrite f6 [0,4194304] 0 2024-04-26T21:25:41.937 INFO:tasks.workunit.client.1.smithi120.stdout:0/110: fsync d0/d3/dc/f15 0 2024-04-26T21:25:41.940 INFO:tasks.workunit.client.1.smithi120.stdout:2/169: write d4/d1b/d25/d2c/ff [2278320,115496] 0 2024-04-26T21:25:41.943 INFO:tasks.workunit.client.1.smithi120.stdout:0/111: creat d0/d3/dc/f27 x:0 0 0 2024-04-26T21:25:41.943 INFO:tasks.workunit.client.1.smithi120.stdout:2/170: read d4/dd/d14/d15/f2d [4258,124012] 0 2024-04-26T21:25:41.949 INFO:tasks.workunit.client.1.smithi120.stdout:7/112: write d7/fd [1391153,61207] 0 2024-04-26T21:25:41.951 INFO:tasks.workunit.client.1.smithi120.stdout:2/171: write d4/dd/d14/d15/f2d [5214613,123339] 0 2024-04-26T21:25:41.952 INFO:tasks.workunit.client.1.smithi120.stdout:7/113: symlink d7/d10/l2b 0 2024-04-26T21:25:41.962 INFO:tasks.workunit.client.1.smithi120.stdout:7/114: write d7/d10/d12/f14 [369127,78694] 0 2024-04-26T21:25:41.972 INFO:tasks.workunit.client.1.smithi120.stdout:0/112: dwrite d0/d3/d13/f20 [0,4194304] 0 2024-04-26T21:25:41.974 INFO:tasks.workunit.client.1.smithi120.stdout:7/115: link d7/d10/d12/f15 d7/d10/d12/d1f/d28/f2c 0 2024-04-26T21:25:41.974 INFO:tasks.workunit.client.1.smithi120.stdout:2/172: fdatasync d4/dd/d14/d15/f28 0 2024-04-26T21:25:41.977 INFO:tasks.workunit.client.1.smithi120.stdout:7/116: read - d7/ff zero size 2024-04-26T21:25:41.977 INFO:tasks.workunit.client.1.smithi120.stdout:0/113: write d0/d3/d13/f1f [618695,16757] 0 2024-04-26T21:25:41.982 INFO:tasks.workunit.client.1.smithi120.stdout:2/173: write d4/dd/d14/d15/f2b [3559611,94906] 0 2024-04-26T21:25:41.984 INFO:tasks.workunit.client.1.smithi120.stdout:0/114: mknod d0/d3/d13/c28 0 2024-04-26T21:25:41.984 INFO:tasks.workunit.client.1.smithi120.stdout:8/117: dread f4 [0,4194304] 0 2024-04-26T21:25:41.987 INFO:tasks.workunit.client.1.smithi120.stdout:8/118: dread d5/f29 [0,4194304] 0 2024-04-26T21:25:41.987 INFO:tasks.workunit.client.1.smithi120.stdout:7/117: dread d7/d10/d12/f14 [0,4194304] 0 2024-04-26T21:25:41.989 INFO:tasks.workunit.client.1.smithi120.stdout:2/174: unlink d4/d1b/d25/d2c/lb 0 2024-04-26T21:25:41.996 INFO:tasks.workunit.client.1.smithi120.stdout:2/175: mkdir d4/d1b/d25/d2c/d3e 0 2024-04-26T21:25:42.003 INFO:tasks.workunit.client.1.smithi120.stdout:0/115: write d0/d3/dc/dd/f21 [1760988,95813] 0 2024-04-26T21:25:42.006 INFO:tasks.workunit.client.1.smithi120.stdout:0/116: chown d0/f10 6606622 1 2024-04-26T21:25:42.010 INFO:tasks.workunit.client.1.smithi120.stdout:0/117: truncate d0/f14 1078376 0 2024-04-26T21:25:42.011 INFO:tasks.workunit.client.1.smithi120.stdout:8/119: dwrite d5/d6/f1f [0,4194304] 0 2024-04-26T21:25:42.011 INFO:tasks.workunit.client.0.smithi084.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-26T21:25:42.012 INFO:tasks.workunit.client.1.smithi120.stdout:7/118: dwrite f3 [0,4194304] 0 2024-04-26T21:25:42.014 INFO:tasks.workunit.client.1.smithi120.stdout:0/118: chown d0/d3/dc/dd/f21 1364325872 1 2024-04-26T21:25:42.022 INFO:tasks.workunit.client.1.smithi120.stdout:0/119: rmdir d0/d3/dc/dd/d1b 39 2024-04-26T21:25:42.022 INFO:tasks.workunit.client.1.smithi120.stdout:2/176: dwrite d4/dd/f27 [0,4194304] 0 2024-04-26T21:25:42.022 INFO:tasks.workunit.client.1.smithi120.stdout:0/120: fsync d0/d3/dc/f27 0 2024-04-26T21:25:42.023 INFO:tasks.workunit.client.1.smithi120.stdout:2/177: dread - d4/f3a zero size 2024-04-26T21:25:42.026 INFO:tasks.workunit.client.1.smithi120.stdout:0/121: creat d0/d3/f29 x:0 0 0 2024-04-26T21:25:42.034 INFO:tasks.workunit.client.1.smithi120.stdout:8/120: dwrite d5/d6/f25 [0,4194304] 0 2024-04-26T21:25:42.035 INFO:tasks.workunit.client.1.smithi120.stdout:0/122: creat d0/d3/dc/f2a x:0 0 0 2024-04-26T21:25:42.038 INFO:tasks.workunit.client.1.smithi120.stdout:8/121: write d5/d6/f25 [313386,64700] 0 2024-04-26T21:25:42.039 INFO:tasks.workunit.client.1.smithi120.stdout:7/119: write d7/d10/d12/f15 [4261581,35536] 0 2024-04-26T21:25:42.041 INFO:tasks.workunit.client.1.smithi120.stdout:2/178: dread d4/dd/f27 [0,4194304] 0 2024-04-26T21:25:42.043 INFO:tasks.workunit.client.1.smithi120.stdout:0/123: fdatasync d0/d3/dc/f1c 0 2024-04-26T21:25:42.045 INFO:tasks.workunit.client.1.smithi120.stdout:8/122: rmdir d5/d18 39 2024-04-26T21:25:42.045 INFO:tasks.workunit.client.1.smithi120.stdout:8/123: stat d5/d2e 0 2024-04-26T21:25:42.045 INFO:tasks.workunit.client.1.smithi120.stdout:7/120: rename c2 to d7/d10/d12/c2d 0 2024-04-26T21:25:42.046 INFO:tasks.workunit.client.1.smithi120.stdout:2/179: unlink d4/l8 0 2024-04-26T21:25:42.048 INFO:tasks.workunit.client.1.smithi120.stdout:8/124: fsync d5/d18/f22 0 2024-04-26T21:25:42.049 INFO:tasks.workunit.client.1.smithi120.stdout:0/124: mknod d0/d3/dc/c2b 0 2024-04-26T21:25:42.051 INFO:tasks.workunit.client.1.smithi120.stdout:2/180: rename d4/f13 to d4/dd/f3f 0 2024-04-26T21:25:42.055 INFO:tasks.workunit.client.1.smithi120.stdout:7/121: creat d7/d10/d12/d1f/d28/f2e x:0 0 0 2024-04-26T21:25:42.056 INFO:tasks.workunit.client.1.smithi120.stdout:8/125: creat d5/f30 x:0 0 0 2024-04-26T21:25:42.057 INFO:tasks.workunit.client.1.smithi120.stdout:0/125: creat d0/f2c x:0 0 0 2024-04-26T21:25:42.058 INFO:tasks.workunit.client.1.smithi120.stdout:7/122: chown d7/d10/d12/d1a/l21 0 1 2024-04-26T21:25:42.059 INFO:tasks.workunit.client.1.smithi120.stdout:0/126: truncate d0/f2c 980445 0 2024-04-26T21:25:42.070 INFO:tasks.workunit.client.1.smithi120.stdout:2/181: dread d4/dd/f27 [0,4194304] 0 2024-04-26T21:25:42.072 INFO:tasks.workunit.client.1.smithi120.stdout:2/182: stat d4/dd/d14/d3c 0 2024-04-26T21:25:42.082 INFO:tasks.workunit.client.1.smithi120.stdout:8/126: dwrite d5/d6/d11/f10 [0,4194304] 0 2024-04-26T21:25:42.082 INFO:tasks.workunit.client.1.smithi120.stdout:7/123: dwrite d7/f22 [0,4194304] 0 2024-04-26T21:25:42.087 INFO:tasks.workunit.client.1.smithi120.stdout:8/127: dread d5/f29 [0,4194304] 0 2024-04-26T21:25:42.088 INFO:tasks.workunit.client.1.smithi120.stdout:0/127: dwrite d0/d3/dc/f2a [0,4194304] 0 2024-04-26T21:25:42.088 INFO:tasks.workunit.client.1.smithi120.stdout:7/124: mkdir d7/d10/d12/d2f 0 2024-04-26T21:25:42.095 INFO:tasks.workunit.client.1.smithi120.stdout:8/128: creat d5/d6/d11/f31 x:0 0 0 2024-04-26T21:25:42.097 INFO:tasks.workunit.client.1.smithi120.stdout:8/129: dread - d5/f30 zero size 2024-04-26T21:25:42.099 INFO:tasks.workunit.client.1.smithi120.stdout:2/183: dwrite f1 [0,4194304] 0 2024-04-26T21:25:42.100 INFO:tasks.workunit.client.1.smithi120.stdout:2/184: chown d4/d1b/d25/d3d 414 1 2024-04-26T21:25:42.106 INFO:tasks.workunit.client.1.smithi120.stdout:0/128: creat d0/d3/dc/dd/f2d x:0 0 0 2024-04-26T21:25:42.106 INFO:tasks.workunit.client.1.smithi120.stdout:2/185: symlink d4/d1b/d25/l40 0 2024-04-26T21:25:42.106 INFO:tasks.workunit.client.1.smithi120.stdout:4/134: sync 2024-04-26T21:25:42.106 INFO:tasks.workunit.client.1.smithi120.stdout:8/130: write d5/f16 [1544783,45463] 0 2024-04-26T21:25:42.113 INFO:tasks.workunit.client.1.smithi120.stdout:8/131: mkdir d5/d6/d11/d32 0 2024-04-26T21:25:42.117 INFO:tasks.workunit.client.1.smithi120.stdout:4/135: creat d10/d28/f32 x:0 0 0 2024-04-26T21:25:42.118 INFO:tasks.workunit.client.1.smithi120.stdout:7/125: dwrite d7/d10/d12/f14 [0,4194304] 0 2024-04-26T21:25:42.122 INFO:tasks.workunit.client.1.smithi120.stdout:2/186: rename f3 to d4/d1b/f41 0 2024-04-26T21:25:42.125 INFO:tasks.workunit.client.1.smithi120.stdout:0/129: creat d0/d3/dc/f2e x:0 0 0 2024-04-26T21:25:42.126 INFO:tasks.workunit.client.1.smithi120.stdout:0/130: write d0/f14 [1731713,12245] 0 2024-04-26T21:25:42.129 INFO:tasks.workunit.client.1.smithi120.stdout:8/132: creat d5/d6/d12/d27/f33 x:0 0 0 2024-04-26T21:25:42.129 INFO:tasks.workunit.client.1.smithi120.stdout:8/133: readlink l3 0 2024-04-26T21:25:42.131 INFO:tasks.workunit.client.1.smithi120.stdout:7/126: dread d7/f22 [0,4194304] 0 2024-04-26T21:25:42.132 INFO:tasks.workunit.client.1.smithi120.stdout:0/131: unlink d0/d3/dc/f2e 0 2024-04-26T21:25:42.132 INFO:tasks.workunit.client.1.smithi120.stdout:7/127: dread - d7/f29 zero size 2024-04-26T21:25:42.135 INFO:tasks.workunit.client.1.smithi120.stdout:7/128: write d7/d10/d12/d1f/d28/f2e [51709,29577] 0 2024-04-26T21:25:42.135 INFO:tasks.workunit.client.1.smithi120.stdout:2/187: dread d4/d1b/d25/f32 [0,4194304] 0 2024-04-26T21:25:42.135 INFO:tasks.workunit.client.1.smithi120.stdout:7/129: stat d7/l20 0 2024-04-26T21:25:42.136 INFO:tasks.workunit.client.1.smithi120.stdout:8/134: mkdir d5/d6/d34 0 2024-04-26T21:25:42.141 INFO:tasks.workunit.client.1.smithi120.stdout:7/130: creat d7/d10/f30 x:0 0 0 2024-04-26T21:25:42.143 INFO:tasks.workunit.client.1.smithi120.stdout:8/135: rename d5/l1c to d5/d6/d11/l35 0 2024-04-26T21:25:42.143 INFO:tasks.workunit.client.1.smithi120.stdout:7/131: write d7/d10/d12/f14 [560611,80116] 0 2024-04-26T21:25:42.147 INFO:tasks.workunit.client.1.smithi120.stdout:0/132: link d0/d3/dc/f27 d0/d3/dc/dd/d1b/d24/f2f 0 2024-04-26T21:25:42.148 INFO:tasks.workunit.client.1.smithi120.stdout:7/132: mknod d7/d10/c31 0 2024-04-26T21:25:42.152 INFO:tasks.workunit.client.1.smithi120.stdout:8/136: getdents d5/d6/d34 0 2024-04-26T21:25:42.152 INFO:tasks.workunit.client.1.smithi120.stdout:0/133: dread d0/d3/d13/f1f [0,4194304] 0 2024-04-26T21:25:42.153 INFO:tasks.workunit.client.1.smithi120.stdout:0/134: fsync d0/f10 0 2024-04-26T21:25:42.153 INFO:tasks.workunit.client.1.smithi120.stdout:7/133: symlink d7/d10/d12/d1f/d28/l32 0 2024-04-26T21:25:42.154 INFO:tasks.workunit.client.1.smithi120.stdout:8/137: dread d5/f29 [0,4194304] 0 2024-04-26T21:25:42.154 INFO:tasks.workunit.client.1.smithi120.stdout:0/135: fdatasync d0/d3/f9 0 2024-04-26T21:25:42.156 INFO:tasks.workunit.client.1.smithi120.stdout:2/188: link d4/dd/d14/d15/c17 d4/c42 0 2024-04-26T21:25:42.156 INFO:tasks.workunit.client.1.smithi120.stdout:0/136: stat d0/d3/dc/d12/c26 0 2024-04-26T21:25:42.157 INFO:tasks.workunit.client.1.smithi120.stdout:7/134: truncate d7/d19/f24 947490 0 2024-04-26T21:25:42.158 INFO:tasks.workunit.client.1.smithi120.stdout:0/137: dread - d0/d3/f29 zero size 2024-04-26T21:25:42.158 INFO:tasks.workunit.client.1.smithi120.stdout:8/138: symlink d5/d6/d12/l36 0 2024-04-26T21:25:42.158 INFO:tasks.workunit.client.1.smithi120.stdout:2/189: write d4/d1b/d25/f31 [2044409,16113] 0 2024-04-26T21:25:42.160 INFO:tasks.workunit.client.1.smithi120.stdout:0/138: truncate d0/f14 2675579 0 2024-04-26T21:25:42.161 INFO:tasks.workunit.client.1.smithi120.stdout:2/190: chown d4/dd/d14/l2f 1 1 2024-04-26T21:25:42.161 INFO:tasks.workunit.client.1.smithi120.stdout:7/135: mkdir d7/d10/d12/d1a/d33 0 2024-04-26T21:25:42.164 INFO:tasks.workunit.client.1.smithi120.stdout:0/139: dread d0/d3/dc/f1c [0,4194304] 0 2024-04-26T21:25:42.164 INFO:tasks.workunit.client.1.smithi120.stdout:8/139: mkdir d5/d6/d34/d37 0 2024-04-26T21:25:42.174 INFO:tasks.workunit.client.1.smithi120.stdout:2/191: creat d4/dd/d14/d15/f43 x:0 0 0 2024-04-26T21:25:42.176 INFO:tasks.workunit.client.1.smithi120.stdout:2/192: chown d4/d1b/d25/f31 2469088 1 2024-04-26T21:25:42.179 INFO:tasks.workunit.client.1.smithi120.stdout:0/140: dwrite d0/d3/dc/d12/f1a [0,4194304] 0 2024-04-26T21:25:42.180 INFO:tasks.workunit.client.1.smithi120.stdout:0/141: fsync d0/d3/dc/f2a 0 2024-04-26T21:25:42.181 INFO:tasks.workunit.client.1.smithi120.stdout:0/142: fdatasync d0/f10 0 2024-04-26T21:25:42.182 INFO:tasks.workunit.client.1.smithi120.stdout:2/193: unlink d4/dd/d14/d15/f28 0 2024-04-26T21:25:42.184 INFO:tasks.workunit.client.1.smithi120.stdout:7/136: truncate d7/d10/d12/f16 69927 0 2024-04-26T21:25:42.184 INFO:tasks.workunit.client.1.smithi120.stdout:7/137: fsync f6 0 2024-04-26T21:25:42.186 INFO:tasks.workunit.client.1.smithi120.stdout:2/194: write d4/f10 [5041543,65925] 0 2024-04-26T21:25:42.186 INFO:tasks.workunit.client.1.smithi120.stdout:7/138: dread - d7/d10/f30 zero size 2024-04-26T21:25:42.187 INFO:tasks.workunit.client.1.smithi120.stdout:8/140: truncate d5/d6/f25 3081611 0 2024-04-26T21:25:42.189 INFO:tasks.workunit.client.1.smithi120.stdout:8/141: rmdir d5/d18 39 2024-04-26T21:25:42.194 INFO:tasks.workunit.client.1.smithi120.stdout:7/139: mkdir d7/d10/d12/d1a/d33/d34 0 2024-04-26T21:25:42.197 INFO:tasks.workunit.client.1.smithi120.stdout:8/142: creat d5/d6/d12/d27/f38 x:0 0 0 2024-04-26T21:25:42.199 INFO:tasks.workunit.client.1.smithi120.stdout:0/143: dwrite d0/d3/f29 [0,4194304] 0 2024-04-26T21:25:42.210 INFO:tasks.workunit.client.1.smithi120.stdout:2/195: dwrite d4/d1b/d25/f31 [0,4194304] 0 2024-04-26T21:25:42.218 INFO:tasks.workunit.client.1.smithi120.stdout:2/196: mknod d4/dd/c44 0 2024-04-26T21:25:42.224 INFO:tasks.workunit.client.1.smithi120.stdout:0/144: dread d0/d3/d13/f20 [0,4194304] 0 2024-04-26T21:25:42.230 INFO:tasks.workunit.client.1.smithi120.stdout:2/197: getdents d4 0 2024-04-26T21:25:42.231 INFO:tasks.workunit.client.1.smithi120.stdout:8/143: dwrite d5/d6/d11/f2a [0,4194304] 0 2024-04-26T21:25:42.233 INFO:tasks.workunit.client.1.smithi120.stdout:7/140: dwrite d7/ff [0,4194304] 0 2024-04-26T21:25:42.234 INFO:tasks.workunit.client.1.smithi120.stdout:7/141: readlink d7/d10/l2b 0 2024-04-26T21:25:42.238 INFO:tasks.workunit.client.1.smithi120.stdout:7/142: chown d7/f22 1682 1 2024-04-26T21:25:42.242 INFO:tasks.workunit.client.1.smithi120.stdout:8/144: creat d5/d6/d34/f39 x:0 0 0 2024-04-26T21:25:42.244 INFO:tasks.workunit.client.1.smithi120.stdout:8/145: truncate d5/f29 451249 0 2024-04-26T21:25:42.247 INFO:tasks.workunit.client.1.smithi120.stdout:7/143: link d7/f22 d7/d19/f35 0 2024-04-26T21:25:42.251 INFO:tasks.workunit.client.1.smithi120.stdout:8/146: write d5/d6/d11/f31 [399524,25301] 0 2024-04-26T21:25:42.255 INFO:tasks.workunit.client.1.smithi120.stdout:7/144: creat d7/d10/d12/d1f/f36 x:0 0 0 2024-04-26T21:25:42.256 INFO:tasks.workunit.client.1.smithi120.stdout:8/147: creat d5/d2e/f3a x:0 0 0 2024-04-26T21:25:42.257 INFO:tasks.workunit.client.1.smithi120.stdout:0/145: dwrite d0/d3/f29 [0,4194304] 0 2024-04-26T21:25:42.259 INFO:tasks.workunit.client.1.smithi120.stdout:2/198: dwrite d4/d1b/f41 [4194304,4194304] 0 2024-04-26T21:25:42.261 INFO:tasks.workunit.client.1.smithi120.stdout:8/148: dread - d5/d6/d34/f39 zero size 2024-04-26T21:25:42.262 INFO:tasks.workunit.client.1.smithi120.stdout:7/145: truncate d7/d10/d12/d1f/f36 490945 0 2024-04-26T21:25:42.265 INFO:tasks.workunit.client.1.smithi120.stdout:0/146: creat d0/f30 x:0 0 0 2024-04-26T21:25:42.268 INFO:tasks.workunit.client.1.smithi120.stdout:8/149: mkdir d5/d6/d11/d32/d3b 0 2024-04-26T21:25:42.268 INFO:tasks.workunit.client.1.smithi120.stdout:8/150: chown d5/d2e 58277894 1 2024-04-26T21:25:42.270 INFO:tasks.workunit.client.1.smithi120.stdout:2/199: creat d4/dd/d14/d15/f45 x:0 0 0 2024-04-26T21:25:42.270 INFO:tasks.workunit.client.1.smithi120.stdout:7/146: mkdir d7/d10/d12/d1a/d33/d34/d37 0 2024-04-26T21:25:42.271 INFO:tasks.workunit.client.1.smithi120.stdout:0/147: mkdir d0/d3/dc/d12/d31 0 2024-04-26T21:25:42.277 INFO:tasks.workunit.client.1.smithi120.stdout:0/148: symlink d0/d3/dc/d12/d31/l32 0 2024-04-26T21:25:42.280 INFO:tasks.workunit.client.1.smithi120.stdout:0/149: creat d0/d3/dc/d12/d31/f33 x:0 0 0 2024-04-26T21:25:42.284 INFO:tasks.workunit.client.1.smithi120.stdout:7/147: dread d7/d10/d12/f14 [0,4194304] 0 2024-04-26T21:25:42.286 INFO:tasks.workunit.client.1.smithi120.stdout:8/151: truncate d5/f16 3499932 0 2024-04-26T21:25:42.288 INFO:tasks.workunit.client.1.smithi120.stdout:8/152: write d5/d6/d11/f31 [1258549,32495] 0 2024-04-26T21:25:42.289 INFO:tasks.workunit.client.1.smithi120.stdout:8/153: chown d5/d6/d34 59319 1 2024-04-26T21:25:42.289 INFO:tasks.workunit.client.1.smithi120.stdout:2/200: chown d4/dd/d14/d15/f43 202921192 1 2024-04-26T21:25:42.294 INFO:tasks.workunit.client.1.smithi120.stdout:2/201: dread - d4/d1b/d2e/f35 zero size 2024-04-26T21:25:42.295 INFO:tasks.workunit.client.1.smithi120.stdout:8/154: rename d5/d6/l7 to d5/d6/d12/l3c 0 2024-04-26T21:25:42.302 INFO:tasks.workunit.client.1.smithi120.stdout:2/202: creat d4/d1b/d25/d2c/f46 x:0 0 0 2024-04-26T21:25:42.303 INFO:tasks.workunit.client.1.smithi120.stdout:0/150: dwrite d0/d3/dc/dd/d1b/d24/f2f [0,4194304] 0 2024-04-26T21:25:42.305 INFO:tasks.workunit.client.1.smithi120.stdout:2/203: write d4/d1b/d25/d29/f37 [1010655,102081] 0 2024-04-26T21:25:42.305 INFO:tasks.workunit.client.1.smithi120.stdout:7/148: dwrite d7/d10/d12/d1f/f36 [0,4194304] 0 2024-04-26T21:25:42.317 INFO:tasks.workunit.client.1.smithi120.stdout:2/204: link f1 d4/dd/d14/d3c/f47 0 2024-04-26T21:25:42.318 INFO:tasks.workunit.client.1.smithi120.stdout:0/151: creat d0/d3/dc/dd/f34 x:0 0 0 2024-04-26T21:25:42.319 INFO:tasks.workunit.client.1.smithi120.stdout:8/155: dwrite d5/d6/d12/f17 [0,4194304] 0 2024-04-26T21:25:42.321 INFO:tasks.workunit.client.1.smithi120.stdout:2/205: chown d4/d1b/d25/d2c/f46 7342 1 2024-04-26T21:25:42.323 INFO:tasks.workunit.client.1.smithi120.stdout:8/156: write d5/d6/d11/f31 [2033206,7417] 0 2024-04-26T21:25:42.324 INFO:tasks.workunit.client.1.smithi120.stdout:0/152: creat d0/f35 x:0 0 0 2024-04-26T21:25:42.325 INFO:tasks.workunit.client.1.smithi120.stdout:2/206: symlink d4/d1b/d2e/l48 0 2024-04-26T21:25:42.329 INFO:tasks.workunit.client.1.smithi120.stdout:2/207: write d4/d1b/d25/f31 [1797978,121315] 0 2024-04-26T21:25:42.329 INFO:tasks.workunit.client.1.smithi120.stdout:7/149: dwrite d7/d10/d12/d1f/d28/f2c [0,4194304] 0 2024-04-26T21:25:42.331 INFO:tasks.workunit.client.1.smithi120.stdout:1/114: sync 2024-04-26T21:25:42.331 INFO:tasks.workunit.client.1.smithi120.stdout:9/71: sync 2024-04-26T21:25:42.331 INFO:tasks.workunit.client.1.smithi120.stdout:3/85: sync 2024-04-26T21:25:42.332 INFO:tasks.workunit.client.1.smithi120.stdout:8/157: symlink d5/d6/l3d 0 2024-04-26T21:25:42.335 INFO:tasks.workunit.client.1.smithi120.stdout:7/150: creat d7/d10/d12/d1a/d33/d34/f38 x:0 0 0 2024-04-26T21:25:42.336 INFO:tasks.workunit.client.1.smithi120.stdout:8/158: dread - d5/d2e/f3a zero size 2024-04-26T21:25:42.336 INFO:tasks.workunit.client.1.smithi120.stdout:0/153: mknod d0/d3/dc/dd/d1b/d24/c36 0 2024-04-26T21:25:42.340 INFO:tasks.workunit.client.1.smithi120.stdout:7/151: write d7/d10/d12/d1a/d33/d34/f38 [894093,31027] 0 2024-04-26T21:25:42.340 INFO:tasks.workunit.client.1.smithi120.stdout:0/154: write d0/d3/dc/dd/f21 [2338556,106733] 0 2024-04-26T21:25:42.347 INFO:tasks.workunit.client.1.smithi120.stdout:9/72: rename d0/dd/cb to d0/c13 0 2024-04-26T21:25:42.358 INFO:tasks.workunit.client.1.smithi120.stdout:3/86: dwrite dd/de/d18/f1a [0,4194304] 0 2024-04-26T21:25:42.366 INFO:tasks.workunit.client.1.smithi120.stdout:1/115: rename d6/d14/c18 to d6/c26 0 2024-04-26T21:25:42.367 INFO:tasks.workunit.client.1.smithi120.stdout:9/73: chown d0/dd/cc 518208048 1 2024-04-26T21:25:42.370 INFO:tasks.workunit.client.1.smithi120.stdout:2/208: write d4/dd/d14/d15/f2d [6125814,104865] 0 2024-04-26T21:25:42.372 INFO:tasks.workunit.client.1.smithi120.stdout:8/159: link d5/d6/d11/l35 d5/d6/d34/l3e 0 2024-04-26T21:25:42.372 INFO:tasks.workunit.client.1.smithi120.stdout:3/87: creat dd/d1d/f20 x:0 0 0 2024-04-26T21:25:42.374 INFO:tasks.workunit.client.1.smithi120.stdout:8/160: fsync d5/d6/fd 0 2024-04-26T21:25:42.374 INFO:tasks.workunit.client.1.smithi120.stdout:3/88: dread - dd/d1d/f1f zero size 2024-04-26T21:25:42.377 INFO:tasks.workunit.client.1.smithi120.stdout:1/116: symlink d6/d7/da/dd/l27 0 2024-04-26T21:25:42.377 INFO:tasks.workunit.client.1.smithi120.stdout:9/74: write d0/fa [3018116,42736] 0 2024-04-26T21:25:42.379 INFO:tasks.workunit.client.1.smithi120.stdout:0/155: link d0/d3/c6 d0/d3/d13/c37 0 2024-04-26T21:25:42.379 INFO:tasks.workunit.client.1.smithi120.stdout:6/114: sync 2024-04-26T21:25:42.379 INFO:tasks.workunit.client.1.smithi120.stdout:5/146: sync 2024-04-26T21:25:42.379 INFO:tasks.workunit.client.1.smithi120.stdout:4/136: sync 2024-04-26T21:25:42.380 INFO:tasks.workunit.client.1.smithi120.stdout:9/75: write d0/fa [684777,19006] 0 2024-04-26T21:25:42.382 INFO:tasks.workunit.client.1.smithi120.stdout:2/209: creat d4/d1b/d25/d2c/f49 x:0 0 0 2024-04-26T21:25:42.383 INFO:tasks.workunit.client.1.smithi120.stdout:7/152: getdents d7/d19 0 2024-04-26T21:25:42.385 INFO:tasks.workunit.client.1.smithi120.stdout:3/89: unlink dd/de/df/c19 0 2024-04-26T21:25:42.385 INFO:tasks.workunit.client.1.smithi120.stdout:1/117: creat d6/d7/da/f28 x:0 0 0 2024-04-26T21:25:42.385 INFO:tasks.workunit.client.1.smithi120.stdout:0/156: chown d0/d3/d13/c28 373 1 2024-04-26T21:25:42.386 INFO:tasks.workunit.client.1.smithi120.stdout:6/115: creat d4/db/f23 x:0 0 0 2024-04-26T21:25:42.387 INFO:tasks.workunit.client.1.smithi120.stdout:3/90: dread - dd/d1d/f20 zero size 2024-04-26T21:25:42.387 INFO:tasks.workunit.client.1.smithi120.stdout:4/137: symlink d10/d28/l33 0 2024-04-26T21:25:42.389 INFO:tasks.workunit.client.1.smithi120.stdout:1/118: write d6/d7/da/f28 [379043,8653] 0 2024-04-26T21:25:42.390 INFO:tasks.workunit.client.1.smithi120.stdout:4/138: read - d10/d12/f27 zero size 2024-04-26T21:25:42.390 INFO:tasks.workunit.client.1.smithi120.stdout:5/147: dread d2/db/f14 [0,4194304] 0 2024-04-26T21:25:42.391 INFO:tasks.workunit.client.1.smithi120.stdout:2/210: creat d4/d1b/d25/d3d/f4a x:0 0 0 2024-04-26T21:25:42.393 INFO:tasks.workunit.client.1.smithi120.stdout:6/116: unlink d4/db/d10/dd/c17 0 2024-04-26T21:25:42.395 INFO:tasks.workunit.client.1.smithi120.stdout:3/91: rename dd/f14 to dd/de/df/d12/f21 0 2024-04-26T21:25:42.396 INFO:tasks.workunit.client.1.smithi120.stdout:1/119: stat d6/d7/da/c25 0 2024-04-26T21:25:42.397 INFO:tasks.workunit.client.1.smithi120.stdout:6/117: mknod d4/c24 0 2024-04-26T21:25:42.399 INFO:tasks.workunit.client.1.smithi120.stdout:4/139: fdatasync f5 0 2024-04-26T21:25:42.399 INFO:tasks.workunit.client.1.smithi120.stdout:6/118: fdatasync f1 0 2024-04-26T21:25:42.399 INFO:tasks.workunit.client.1.smithi120.stdout:0/157: link d0/d3/d13/f20 d0/d3/dc/dd/d1b/f38 0 2024-04-26T21:25:42.400 INFO:tasks.workunit.client.1.smithi120.stdout:5/148: mkdir d2/dc/d1d/d2e 0 2024-04-26T21:25:42.401 INFO:tasks.workunit.client.1.smithi120.stdout:8/161: dwrite d5/d6/d11/f2a [0,4194304] 0 2024-04-26T21:25:42.403 INFO:tasks.workunit.client.1.smithi120.stdout:9/76: dread d0/d6/f8 [0,4194304] 0 2024-04-26T21:25:42.404 INFO:tasks.workunit.client.1.smithi120.stdout:1/120: unlink d6/d14/c23 0 2024-04-26T21:25:42.405 INFO:tasks.workunit.client.1.smithi120.stdout:5/149: write d2/dc/fd [207198,23998] 0 2024-04-26T21:25:42.408 INFO:tasks.workunit.client.1.smithi120.stdout:4/140: symlink d10/d28/l34 0 2024-04-26T21:25:42.410 INFO:tasks.workunit.client.1.smithi120.stdout:1/121: dread - d6/d14/f16 zero size 2024-04-26T21:25:42.410 INFO:tasks.workunit.client.1.smithi120.stdout:2/211: creat d4/d1b/d25/d2c/d3e/f4b x:0 0 0 2024-04-26T21:25:42.414 INFO:tasks.workunit.client.1.smithi120.stdout:8/162: rename d5 to d5/d6/d3f 22 2024-04-26T21:25:42.415 INFO:tasks.workunit.client.1.smithi120.stdout:9/77: mkdir d0/d14 0 2024-04-26T21:25:42.418 INFO:tasks.workunit.client.1.smithi120.stdout:4/141: readlink d10/d28/l30 0 2024-04-26T21:25:42.419 INFO:tasks.workunit.client.1.smithi120.stdout:5/150: creat d2/dc/d1d/d1e/f2f x:0 0 0 2024-04-26T21:25:42.420 INFO:tasks.workunit.client.1.smithi120.stdout:1/122: symlink d6/d7/da/l29 0 2024-04-26T21:25:42.422 INFO:tasks.workunit.client.1.smithi120.stdout:4/142: fdatasync d10/f11 0 2024-04-26T21:25:42.423 INFO:tasks.workunit.client.1.smithi120.stdout:2/212: symlink d4/d1b/d25/l4c 0 2024-04-26T21:25:42.425 INFO:tasks.workunit.client.1.smithi120.stdout:4/143: stat d10/f1e 0 2024-04-26T21:25:42.427 INFO:tasks.workunit.client.1.smithi120.stdout:9/78: rename d0/dd/cf to d0/d14/c15 0 2024-04-26T21:25:42.428 INFO:tasks.workunit.client.1.smithi120.stdout:1/123: chown d6/d7/d1b 5104981 1 2024-04-26T21:25:42.429 INFO:tasks.workunit.client.1.smithi120.stdout:8/163: creat d5/d18/f40 x:0 0 0 2024-04-26T21:25:42.433 INFO:tasks.workunit.client.1.smithi120.stdout:2/213: write d4/dd/f2a [289429,83017] 0 2024-04-26T21:25:42.436 INFO:tasks.workunit.client.1.smithi120.stdout:5/151: write d2/db/f27 [120388,14750] 0 2024-04-26T21:25:42.436 INFO:tasks.workunit.client.1.smithi120.stdout:0/158: dread d0/f10 [0,4194304] 0 2024-04-26T21:25:42.436 INFO:tasks.workunit.client.1.smithi120.stdout:4/144: creat d10/d12/f35 x:0 0 0 2024-04-26T21:25:42.438 INFO:tasks.workunit.client.1.smithi120.stdout:3/92: dwrite fa [4194304,4194304] 0 2024-04-26T21:25:42.441 INFO:tasks.workunit.client.1.smithi120.stdout:1/124: creat d6/f2a x:0 0 0 2024-04-26T21:25:42.443 INFO:tasks.workunit.client.1.smithi120.stdout:2/214: read d4/d1b/f41 [4249000,7388] 0 2024-04-26T21:25:42.443 INFO:tasks.workunit.client.1.smithi120.stdout:4/145: mknod d10/c36 0 2024-04-26T21:25:42.447 INFO:tasks.workunit.client.1.smithi120.stdout:5/152: write d2/db/f28 [3428851,29767] 0 2024-04-26T21:25:42.452 INFO:tasks.workunit.client.1.smithi120.stdout:4/146: chown d10/d12/f27 867 1 2024-04-26T21:25:42.452 INFO:tasks.workunit.client.1.smithi120.stdout:0/159: mkdir d0/d3/dc/dd/d1b/d39 0 2024-04-26T21:25:42.454 INFO:tasks.workunit.client.1.smithi120.stdout:3/93: read - dd/de/df/f16 zero size 2024-04-26T21:25:42.454 INFO:tasks.workunit.client.1.smithi120.stdout:9/79: link d0/dd/c10 d0/dd/c16 0 2024-04-26T21:25:42.455 INFO:tasks.workunit.client.1.smithi120.stdout:0/160: dread - d0/d3/f23 zero size 2024-04-26T21:25:42.457 INFO:tasks.workunit.client.1.smithi120.stdout:4/147: mknod d10/d28/c37 0 2024-04-26T21:25:42.459 INFO:tasks.workunit.client.1.smithi120.stdout:6/119: dread d4/db/d10/f15 [0,4194304] 0 2024-04-26T21:25:42.461 INFO:tasks.workunit.client.1.smithi120.stdout:2/215: creat d4/d1b/d25/d29/f4d x:0 0 0 2024-04-26T21:25:42.461 INFO:tasks.workunit.client.1.smithi120.stdout:9/80: write d0/fa [3637964,3918] 0 2024-04-26T21:25:42.461 INFO:tasks.workunit.client.1.smithi120.stdout:1/125: getdents d6/d7/da/dd 0 2024-04-26T21:25:42.464 INFO:tasks.workunit.client.1.smithi120.stdout:2/216: chown d4/d1b/d25/d2c/d3e 27 1 2024-04-26T21:25:42.464 INFO:tasks.workunit.client.1.smithi120.stdout:9/81: write d0/f1 [1990980,62107] 0 2024-04-26T21:25:42.467 INFO:tasks.workunit.client.1.smithi120.stdout:0/161: link d0/f35 d0/df/f3a 0 2024-04-26T21:25:42.467 INFO:tasks.workunit.client.1.smithi120.stdout:1/126: mknod d6/d7/da/dd/c2b 0 2024-04-26T21:25:42.469 INFO:tasks.workunit.client.1.smithi120.stdout:2/217: mknod d4/d1b/d2e/c4e 0 2024-04-26T21:25:42.473 INFO:tasks.workunit.client.1.smithi120.stdout:5/153: dread d2/d1b/f26 [0,4194304] 0 2024-04-26T21:25:42.473 INFO:tasks.workunit.client.1.smithi120.stdout:6/120: mkdir d4/db/d25 0 2024-04-26T21:25:42.474 INFO:tasks.workunit.client.1.smithi120.stdout:4/148: truncate d10/d12/f27 238597 0 2024-04-26T21:25:42.480 INFO:tasks.workunit.client.1.smithi120.stdout:4/149: fdatasync d10/d28/f32 0 2024-04-26T21:25:42.482 INFO:tasks.workunit.client.1.smithi120.stdout:9/82: link d0/l11 d0/d6/l17 0 2024-04-26T21:25:42.482 INFO:tasks.workunit.client.1.smithi120.stdout:2/218: mkdir d4/d1b/d4f 0 2024-04-26T21:25:42.482 INFO:tasks.workunit.client.1.smithi120.stdout:3/94: dread dd/de/f11 [0,4194304] 0 2024-04-26T21:25:42.492 INFO:tasks.workunit.client.1.smithi120.stdout:1/127: getdents d6/d7/d1d 0 2024-04-26T21:25:42.494 INFO:tasks.workunit.client.1.smithi120.stdout:6/121: rename d4/db/d10/dd/f1c to d4/db/d10/dd/f26 0 2024-04-26T21:25:42.497 INFO:tasks.workunit.client.1.smithi120.stdout:8/164: dwrite d5/d6/d12/d27/f33 [0,4194304] 0 2024-04-26T21:25:42.500 INFO:tasks.workunit.client.1.smithi120.stdout:5/154: rename d2/dc/d1d/d1e to d2/d30 0 2024-04-26T21:25:42.512 INFO:tasks.workunit.client.1.smithi120.stdout:3/95: truncate fa 6286608 0 2024-04-26T21:25:42.512 INFO:tasks.workunit.client.1.smithi120.stdout:8/165: chown d5/d6/d11/c24 863 1 2024-04-26T21:25:42.516 INFO:tasks.workunit.client.1.smithi120.stdout:0/162: dread d0/f14 [0,4194304] 0 2024-04-26T21:25:42.516 INFO:tasks.workunit.client.1.smithi120.stdout:7/153: sync 2024-04-26T21:25:42.528 INFO:tasks.workunit.client.1.smithi120.stdout:2/219: dwrite d4/dd/f21 [0,4194304] 0 2024-04-26T21:25:42.529 INFO:tasks.workunit.client.1.smithi120.stdout:0/163: stat d0/d3/d13/c18 0 2024-04-26T21:25:42.531 INFO:tasks.workunit.client.1.smithi120.stdout:4/150: dwrite d10/d12/f2f [0,4194304] 0 2024-04-26T21:25:42.533 INFO:tasks.workunit.client.1.smithi120.stdout:7/154: rename d7/d10/d12/d2f to d7/d10/d12/d2f/d39 22 2024-04-26T21:25:42.536 INFO:tasks.workunit.client.1.smithi120.stdout:8/166: dread d5/f19 [0,4194304] 0 2024-04-26T21:25:42.540 INFO:tasks.workunit.client.1.smithi120.stdout:2/220: read - d4/dd/d14/d15/f43 zero size 2024-04-26T21:25:42.540 INFO:tasks.workunit.client.1.smithi120.stdout:1/128: dwrite d6/f15 [0,4194304] 0 2024-04-26T21:25:42.545 INFO:tasks.workunit.client.1.smithi120.stdout:6/122: dread d4/db/d10/f15 [0,4194304] 0 2024-04-26T21:25:42.547 INFO:tasks.workunit.client.1.smithi120.stdout:9/83: dwrite d0/fa [0,4194304] 0 2024-04-26T21:25:42.558 INFO:tasks.workunit.client.1.smithi120.stdout:7/155: creat d7/d10/d12/d1f/f3a x:0 0 0 2024-04-26T21:25:42.569 INFO:tasks.workunit.client.1.smithi120.stdout:1/129: write d6/d7/da/f28 [1053848,128951] 0 2024-04-26T21:25:42.569 INFO:tasks.workunit.client.1.smithi120.stdout:6/123: chown d4/c5 1371 1 2024-04-26T21:25:42.569 INFO:tasks.workunit.client.1.smithi120.stdout:4/151: write d10/d12/f19 [479899,32124] 0 2024-04-26T21:25:42.572 INFO:tasks.workunit.client.1.smithi120.stdout:5/155: dwrite d2/d1b/d29/f2a [4194304,4194304] 0 2024-04-26T21:25:42.573 INFO:tasks.workunit.client.1.smithi120.stdout:7/156: chown d7/d10/d12 826952 1 2024-04-26T21:25:42.574 INFO:tasks.workunit.client.1.smithi120.stdout:9/84: creat d0/f18 x:0 0 0 2024-04-26T21:25:42.581 INFO:tasks.workunit.client.1.smithi120.stdout:2/221: rename d4/dd to d4/d1b/d2e/d50 0 2024-04-26T21:25:42.583 INFO:tasks.workunit.client.1.smithi120.stdout:4/152: read - d10/d28/f2b zero size 2024-04-26T21:25:42.585 INFO:tasks.workunit.client.1.smithi120.stdout:3/96: dwrite dd/f15 [0,4194304] 0 2024-04-26T21:25:42.586 INFO:tasks.workunit.client.1.smithi120.stdout:4/153: stat d10/d28/f2e 0 2024-04-26T21:25:42.586 INFO:tasks.workunit.client.1.smithi120.stdout:6/124: mkdir d4/d27 0 2024-04-26T21:25:42.589 INFO:tasks.workunit.client.1.smithi120.stdout:3/97: stat f9 0 2024-04-26T21:25:42.590 INFO:tasks.workunit.client.1.smithi120.stdout:5/156: unlink d2/db/ce 0 2024-04-26T21:25:42.597 INFO:tasks.workunit.client.1.smithi120.stdout:4/154: fsync d10/d12/f1d 0 2024-04-26T21:25:42.598 INFO:tasks.workunit.client.1.smithi120.stdout:7/157: rename f6 to d7/d10/d12/d1a/d33/d34/d37/f3b 0 2024-04-26T21:25:42.602 INFO:tasks.workunit.client.1.smithi120.stdout:6/125: mkdir d4/db/d10/dd/d28 0 2024-04-26T21:25:42.604 INFO:tasks.workunit.client.1.smithi120.stdout:0/164: dwrite d0/d3/d13/f20 [0,4194304] 0 2024-04-26T21:25:42.607 INFO:tasks.workunit.client.1.smithi120.stdout:7/158: chown d7/d10/d12/d1f/d28/f2e 63975 1 2024-04-26T21:25:42.608 INFO:tasks.workunit.client.1.smithi120.stdout:6/126: stat d4/db/d25 0 2024-04-26T21:25:42.609 INFO:tasks.workunit.client.1.smithi120.stdout:5/157: dread d2/db/f14 [0,4194304] 0 2024-04-26T21:25:42.613 INFO:tasks.workunit.client.1.smithi120.stdout:2/222: symlink d4/d1b/d25/d29/l51 0 2024-04-26T21:25:42.614 INFO:tasks.workunit.client.1.smithi120.stdout:5/158: readlink d2/l11 0 2024-04-26T21:25:42.615 INFO:tasks.workunit.client.1.smithi120.stdout:9/85: dwrite d0/f18 [0,4194304] 0 2024-04-26T21:25:42.616 INFO:tasks.workunit.client.1.smithi120.stdout:0/165: truncate d0/df/f3a 615908 0 2024-04-26T21:25:42.619 INFO:tasks.workunit.client.1.smithi120.stdout:2/223: rename d4 to d4/d1b/d2e/d50/d14/d3c/d52 22 2024-04-26T21:25:42.621 INFO:tasks.workunit.client.1.smithi120.stdout:7/159: write d7/d10/d12/f14 [4373729,114936] 0 2024-04-26T21:25:42.625 INFO:tasks.workunit.client.1.smithi120.stdout:1/130: dwrite d6/d7/da/fb [0,4194304] 0 2024-04-26T21:25:42.627 INFO:tasks.workunit.client.1.smithi120.stdout:2/224: write d4/d1b/d2e/d50/f21 [1676653,6922] 0 2024-04-26T21:25:42.629 INFO:tasks.workunit.client.1.smithi120.stdout:0/166: rmdir d0/d3/dc/dd 39 2024-04-26T21:25:42.634 INFO:tasks.workunit.client.1.smithi120.stdout:3/98: dwrite f9 [0,4194304] 0 2024-04-26T21:25:42.652 INFO:tasks.workunit.client.1.smithi120.stdout:4/155: dwrite d10/d12/f2f [4194304,4194304] 0 2024-04-26T21:25:42.652 INFO:tasks.workunit.client.1.smithi120.stdout:1/131: read - d6/d14/f16 zero size 2024-04-26T21:25:42.652 INFO:tasks.workunit.client.1.smithi120.stdout:0/167: unlink d0/d3/f29 0 2024-04-26T21:25:42.665 INFO:tasks.workunit.client.1.smithi120.stdout:6/127: dwrite d4/db/f23 [0,4194304] 0 2024-04-26T21:25:42.666 INFO:tasks.workunit.client.1.smithi120.stdout:1/132: fsync d6/d7/da/dd/fe 0 2024-04-26T21:25:42.671 INFO:tasks.workunit.client.1.smithi120.stdout:3/99: rename dd/d1d/f1f to dd/de/d18/f22 0 2024-04-26T21:25:42.683 INFO:tasks.workunit.client.1.smithi120.stdout:4/156: write d10/d12/f2a [1652486,107377] 0 2024-04-26T21:25:42.686 INFO:tasks.workunit.client.1.smithi120.stdout:6/128: mknod d4/db/d10/c29 0 2024-04-26T21:25:42.695 INFO:tasks.workunit.client.1.smithi120.stdout:6/129: stat d4/db/d10/dd/f18 0 2024-04-26T21:25:42.697 INFO:tasks.workunit.client.1.smithi120.stdout:3/100: rename dd/de/d18/f1a to dd/d1d/f23 0 2024-04-26T21:25:42.704 INFO:tasks.workunit.client.1.smithi120.stdout:8/167: sync 2024-04-26T21:25:42.705 INFO:tasks.workunit.client.1.smithi120.stdout:9/86: dread d0/f1 [0,4194304] 0 2024-04-26T21:25:42.706 INFO:tasks.workunit.client.1.smithi120.stdout:8/168: readlink d5/d6/l13 0 2024-04-26T21:25:42.707 INFO:tasks.workunit.client.1.smithi120.stdout:5/159: dread d2/fa [0,4194304] 0 2024-04-26T21:25:42.711 INFO:tasks.workunit.client.1.smithi120.stdout:7/160: dwrite d7/d10/d12/d1a/d33/d34/d37/f3b [0,4194304] 0 2024-04-26T21:25:42.716 INFO:tasks.workunit.client.1.smithi120.stdout:0/168: dwrite d0/d3/dc/f1c [0,4194304] 0 2024-04-26T21:25:42.719 INFO:tasks.workunit.client.1.smithi120.stdout:4/157: getdents d10/d28 0 2024-04-26T21:25:42.721 INFO:tasks.workunit.client.1.smithi120.stdout:7/161: chown d7/d10/d12/d1f/l26 0 1 2024-04-26T21:25:42.727 INFO:tasks.workunit.client.1.smithi120.stdout:3/101: rename dd/d1d to dd/de/d18/d24 0 2024-04-26T21:25:42.730 INFO:tasks.workunit.client.1.smithi120.stdout:4/158: symlink d10/l38 0 2024-04-26T21:25:42.732 INFO:tasks.workunit.client.1.smithi120.stdout:7/162: readlink d7/d10/d12/d1f/d28/l32 0 2024-04-26T21:25:42.739 INFO:tasks.workunit.client.1.smithi120.stdout:2/225: dread d4/d1b/f41 [0,4194304] 0 2024-04-26T21:25:42.745 INFO:tasks.workunit.client.1.smithi120.stdout:8/169: dread d5/d6/d11/f31 [0,4194304] 0 2024-04-26T21:25:42.746 INFO:tasks.workunit.client.1.smithi120.stdout:3/102: creat dd/de/d18/f25 x:0 0 0 2024-04-26T21:25:42.748 INFO:tasks.workunit.client.1.smithi120.stdout:1/133: dwrite d6/d7/da/f19 [0,4194304] 0 2024-04-26T21:25:42.750 INFO:tasks.workunit.client.1.smithi120.stdout:6/130: dwrite d4/db/fe [0,4194304] 0 2024-04-26T21:25:42.751 INFO:tasks.workunit.client.1.smithi120.stdout:7/163: write d7/d10/d12/d1a/d33/d34/d37/f3b [2443569,63334] 0 2024-04-26T21:25:42.752 INFO:tasks.workunit.client.1.smithi120.stdout:8/170: chown d5/d6/d11/c24 1822629644 1 2024-04-26T21:25:42.755 INFO:tasks.workunit.client.1.smithi120.stdout:5/160: dwrite d2/db/f28 [0,4194304] 0 2024-04-26T21:25:42.756 INFO:tasks.workunit.client.1.smithi120.stdout:1/134: truncate d6/d7/d1d/f20 190318 0 2024-04-26T21:25:42.759 INFO:tasks.workunit.client.1.smithi120.stdout:9/87: rename d0/d6/l17 to d0/d14/l19 0 2024-04-26T21:25:42.769 INFO:tasks.workunit.client.1.smithi120.stdout:3/103: symlink dd/l26 0 2024-04-26T21:25:42.772 INFO:tasks.workunit.client.1.smithi120.stdout:3/104: chown dd/de/df/d1e 0 1 2024-04-26T21:25:42.773 INFO:tasks.workunit.client.1.smithi120.stdout:7/164: symlink d7/d10/d12/d1f/d28/l3c 0 2024-04-26T21:25:42.775 INFO:tasks.workunit.client.1.smithi120.stdout:5/161: dwrite d2/dc/d1d/d1f/f2c [0,4194304] 0 2024-04-26T21:25:42.775 INFO:tasks.workunit.client.1.smithi120.stdout:1/135: mkdir d6/d7/d1d/d2c 0 2024-04-26T21:25:42.777 INFO:tasks.workunit.client.1.smithi120.stdout:9/88: fdatasync d0/d6/f8 0 2024-04-26T21:25:42.782 INFO:tasks.workunit.client.1.smithi120.stdout:3/105: mkdir dd/d27 0 2024-04-26T21:25:42.783 INFO:tasks.workunit.client.1.smithi120.stdout:8/171: link d5/f30 d5/d18/f41 0 2024-04-26T21:25:42.783 INFO:tasks.workunit.client.1.smithi120.stdout:1/136: mkdir d6/d7/d2d 0 2024-04-26T21:25:42.786 INFO:tasks.workunit.client.1.smithi120.stdout:7/165: creat d7/d10/d12/d1f/d28/f3d x:0 0 0 2024-04-26T21:25:42.787 INFO:tasks.workunit.client.1.smithi120.stdout:9/89: symlink d0/d6/l1a 0 2024-04-26T21:25:42.789 INFO:tasks.workunit.client.1.smithi120.stdout:2/226: dwrite d4/d1b/d2e/d50/d14/d15/f45 [0,4194304] 0 2024-04-26T21:25:42.794 INFO:tasks.workunit.client.1.smithi120.stdout:6/131: fsync d4/db/fe 0 2024-04-26T21:25:42.798 INFO:tasks.workunit.client.1.smithi120.stdout:1/137: write d6/d14/f16 [1036938,110151] 0 2024-04-26T21:25:42.798 INFO:tasks.workunit.client.1.smithi120.stdout:4/159: truncate f9 115735 0 2024-04-26T21:25:42.802 INFO:tasks.workunit.client.1.smithi120.stdout:2/227: unlink d4/d1b/d25/d2c/d3e/f4b 0 2024-04-26T21:25:42.804 INFO:tasks.workunit.client.1.smithi120.stdout:5/162: dread d2/db/f28 [0,4194304] 0 2024-04-26T21:25:42.805 INFO:tasks.workunit.client.1.smithi120.stdout:1/138: write d6/d7/da/fb [2615324,82916] 0 2024-04-26T21:25:42.808 INFO:tasks.workunit.client.1.smithi120.stdout:0/169: truncate d0/d3/dc/f27 2305086 0 2024-04-26T21:25:42.810 INFO:tasks.workunit.client.1.smithi120.stdout:6/132: mknod d4/db/c2a 0 2024-04-26T21:25:42.812 INFO:tasks.workunit.client.1.smithi120.stdout:4/160: fdatasync d10/f26 0 2024-04-26T21:25:42.816 INFO:tasks.workunit.client.1.smithi120.stdout:1/139: chown d6/d7/da/dd/c1f 378 1 2024-04-26T21:25:42.816 INFO:tasks.workunit.client.1.smithi120.stdout:5/163: truncate d2/db/f27 260233 0 2024-04-26T21:25:42.817 INFO:tasks.workunit.client.1.smithi120.stdout:3/106: dread f9 [0,4194304] 0 2024-04-26T21:25:42.817 INFO:tasks.workunit.client.1.smithi120.stdout:7/166: rmdir d7/d10/d12/d1f/d28 39 2024-04-26T21:25:42.818 INFO:tasks.workunit.client.1.smithi120.stdout:0/170: creat d0/d3/dc/d12/f3b x:0 0 0 2024-04-26T21:25:42.818 INFO:tasks.workunit.client.1.smithi120.stdout:4/161: dread - d10/d12/f35 zero size 2024-04-26T21:25:42.822 INFO:tasks.workunit.client.1.smithi120.stdout:3/107: write dd/de/d18/f25 [976606,104365] 0 2024-04-26T21:25:42.825 INFO:tasks.workunit.client.1.smithi120.stdout:2/228: rename d4/d1b/d25/d2c/c24 to d4/d1b/d25/c53 0 2024-04-26T21:25:42.826 INFO:tasks.workunit.client.1.smithi120.stdout:9/90: dwrite d0/fa [0,4194304] 0 2024-04-26T21:25:42.832 INFO:tasks.workunit.client.1.smithi120.stdout:4/162: write d10/d28/f29 [1004843,35791] 0 2024-04-26T21:25:42.834 INFO:tasks.workunit.client.1.smithi120.stdout:9/91: fdatasync d0/f1 0 2024-04-26T21:25:42.835 INFO:tasks.workunit.client.1.smithi120.stdout:4/163: stat d10/d28/f2b 0 2024-04-26T21:25:42.838 INFO:tasks.workunit.client.1.smithi120.stdout:7/167: write d7/d10/d12/d1a/d33/d34/d37/f3b [2602579,33741] 0 2024-04-26T21:25:42.839 INFO:tasks.workunit.client.1.smithi120.stdout:1/140: rename d6/c1a to d6/d7/d1b/c2e 0 2024-04-26T21:25:42.839 INFO:tasks.workunit.client.1.smithi120.stdout:3/108: truncate dd/de/d18/f22 388583 0 2024-04-26T21:25:42.841 INFO:tasks.workunit.client.1.smithi120.stdout:4/164: mknod d10/d12/c39 0 2024-04-26T21:25:42.843 INFO:tasks.workunit.client.1.smithi120.stdout:9/92: write d0/fa [4102888,32670] 0 2024-04-26T21:25:42.843 INFO:tasks.workunit.client.1.smithi120.stdout:2/229: write d4/d1b/d2e/d50/d14/d15/f43 [736674,35643] 0 2024-04-26T21:25:42.847 INFO:tasks.workunit.client.1.smithi120.stdout:4/165: write d10/d12/f14 [475984,31476] 0 2024-04-26T21:25:42.851 INFO:tasks.workunit.client.1.smithi120.stdout:6/133: dwrite d4/db/fe [0,4194304] 0 2024-04-26T21:25:42.852 INFO:tasks.workunit.client.1.smithi120.stdout:2/230: readlink d4/l9 0 2024-04-26T21:25:42.853 INFO:tasks.workunit.client.1.smithi120.stdout:8/172: dwrite d5/f19 [0,4194304] 0 2024-04-26T21:25:42.854 INFO:tasks.workunit.client.1.smithi120.stdout:9/93: read d0/fa [2291248,39612] 0 2024-04-26T21:25:42.857 INFO:tasks.workunit.client.1.smithi120.stdout:0/171: dwrite d0/f30 [0,4194304] 0 2024-04-26T21:25:42.859 INFO:tasks.workunit.client.1.smithi120.stdout:4/166: write d10/d12/f19 [612811,68588] 0 2024-04-26T21:25:42.860 INFO:tasks.workunit.client.1.smithi120.stdout:2/231: mkdir d4/d1b/d2e/d50/d54 0 2024-04-26T21:25:42.863 INFO:tasks.workunit.client.1.smithi120.stdout:6/134: mkdir d4/db/d10/d1a/d2b 0 2024-04-26T21:25:42.868 INFO:tasks.workunit.client.1.smithi120.stdout:2/232: readlink d4/d1b/d2e/d50/l1e 0 2024-04-26T21:25:42.870 INFO:tasks.workunit.client.1.smithi120.stdout:4/167: chown f9 1317 1 2024-04-26T21:25:42.873 INFO:tasks.workunit.client.1.smithi120.stdout:6/135: getdents d4/db/d10/dd/d28 0 2024-04-26T21:25:42.875 INFO:tasks.workunit.client.1.smithi120.stdout:1/141: dwrite d6/d9/f1c [0,4194304] 0 2024-04-26T21:25:42.877 INFO:tasks.workunit.client.1.smithi120.stdout:2/233: write d4/d1b/d25/d29/f4d [254852,127202] 0 2024-04-26T21:25:42.886 INFO:tasks.workunit.client.1.smithi120.stdout:7/168: truncate d7/fd 977996 0 2024-04-26T21:25:42.886 INFO:tasks.workunit.client.1.smithi120.stdout:0/172: getdents d0/d3/dc/dd/d1b 0 2024-04-26T21:25:42.886 INFO:tasks.workunit.client.1.smithi120.stdout:1/142: write d6/d14/f16 [930816,59972] 0 2024-04-26T21:25:42.886 INFO:tasks.workunit.client.1.smithi120.stdout:9/94: dread d0/d6/f8 [0,4194304] 0 2024-04-26T21:25:42.887 INFO:tasks.workunit.client.1.smithi120.stdout:4/168: rename d10/f1e to d10/d12/f3a 0 2024-04-26T21:25:42.892 INFO:tasks.workunit.client.1.smithi120.stdout:1/143: read d6/d7/da/fb [4143124,21264] 0 2024-04-26T21:25:42.895 INFO:tasks.workunit.client.1.smithi120.stdout:6/136: mknod d4/db/d10/d1a/d2b/c2c 0 2024-04-26T21:25:42.895 INFO:tasks.workunit.client.1.smithi120.stdout:3/109: dwrite f6 [0,4194304] 0 2024-04-26T21:25:42.897 INFO:tasks.workunit.client.1.smithi120.stdout:0/173: stat d0/d3/dc/dd/d1b/f38 0 2024-04-26T21:25:42.898 INFO:tasks.workunit.client.1.smithi120.stdout:9/95: write d0/dd/f12 [604197,5086] 0 2024-04-26T21:25:42.901 INFO:tasks.workunit.client.1.smithi120.stdout:6/137: unlink d4/db/d10/f12 0 2024-04-26T21:25:42.903 INFO:tasks.workunit.client.1.smithi120.stdout:8/173: dwrite d5/f16 [0,4194304] 0 2024-04-26T21:25:42.908 INFO:tasks.workunit.client.1.smithi120.stdout:1/144: write d6/d9/f1e [139137,125672] 0 2024-04-26T21:25:42.910 INFO:tasks.workunit.client.1.smithi120.stdout:6/138: write f1 [1567505,3449] 0 2024-04-26T21:25:42.917 INFO:tasks.workunit.client.1.smithi120.stdout:4/169: dwrite d10/d12/f2a [0,4194304] 0 2024-04-26T21:25:42.919 INFO:tasks.workunit.client.1.smithi120.stdout:0/174: fsync d0/d3/dc/dd/d1b/d24/f2f 0 2024-04-26T21:25:42.919 INFO:tasks.workunit.client.1.smithi120.stdout:7/169: dread d7/d10/d12/d1f/d28/f2c [0,4194304] 0 2024-04-26T21:25:42.921 INFO:tasks.workunit.client.1.smithi120.stdout:6/139: creat d4/db/d25/f2d x:0 0 0 2024-04-26T21:25:42.926 INFO:tasks.workunit.client.1.smithi120.stdout:1/145: creat d6/d7/d1d/d2c/f2f x:0 0 0 2024-04-26T21:25:42.928 INFO:tasks.workunit.client.1.smithi120.stdout:4/170: mknod d10/d28/c3b 0 2024-04-26T21:25:42.933 INFO:tasks.workunit.client.1.smithi120.stdout:6/140: write d4/db/f23 [4931175,27847] 0 2024-04-26T21:25:42.934 INFO:tasks.workunit.client.1.smithi120.stdout:0/175: readlink d0/d3/dc/d12/d31/l32 0 2024-04-26T21:25:42.936 INFO:tasks.workunit.client.1.smithi120.stdout:9/96: dwrite d0/f1 [0,4194304] 0 2024-04-26T21:25:42.940 INFO:tasks.workunit.client.1.smithi120.stdout:4/171: rmdir d10/d28 39 2024-04-26T21:25:42.940 INFO:tasks.workunit.client.1.smithi120.stdout:3/110: dwrite dd/de/d18/d24/f23 [0,4194304] 0 2024-04-26T21:25:42.943 INFO:tasks.workunit.client.1.smithi120.stdout:0/176: write d0/f10 [1517514,27330] 0 2024-04-26T21:25:42.946 INFO:tasks.workunit.client.1.smithi120.stdout:1/146: rename d6/f2a to d6/d7/d2d/f30 0 2024-04-26T21:25:42.949 INFO:tasks.workunit.client.1.smithi120.stdout:9/97: symlink d0/l1b 0 2024-04-26T21:25:42.950 INFO:tasks.workunit.client.1.smithi120.stdout:3/111: readlink dd/l17 0 2024-04-26T21:25:42.950 INFO:tasks.workunit.client.1.smithi120.stdout:4/172: creat d10/d12/f3c x:0 0 0 2024-04-26T21:25:42.952 INFO:tasks.workunit.client.1.smithi120.stdout:6/141: creat d4/d27/f2e x:0 0 0 2024-04-26T21:25:42.953 INFO:tasks.workunit.client.1.smithi120.stdout:3/112: stat dd/de/df/d12/l1b 0 2024-04-26T21:25:42.956 INFO:tasks.workunit.client.1.smithi120.stdout:9/98: mkdir d0/d6/d1c 0 2024-04-26T21:25:42.960 INFO:tasks.workunit.client.1.smithi120.stdout:6/142: write d4/db/d10/dd/f26 [117044,46858] 0 2024-04-26T21:25:42.964 INFO:tasks.workunit.client.1.smithi120.stdout:3/113: mkdir dd/de/df/d1e/d28 0 2024-04-26T21:25:42.965 INFO:tasks.workunit.client.1.smithi120.stdout:9/99: symlink d0/l1d 0 2024-04-26T21:25:42.968 INFO:tasks.workunit.client.1.smithi120.stdout:1/147: getdents d6/d7/da/dd 0 2024-04-26T21:25:42.971 INFO:tasks.workunit.client.1.smithi120.stdout:4/173: getdents d10/d12 0 2024-04-26T21:25:42.972 INFO:tasks.workunit.client.1.smithi120.stdout:9/100: symlink d0/d14/l1e 0 2024-04-26T21:25:42.977 INFO:tasks.workunit.client.1.smithi120.stdout:9/101: chown d0/d14/c15 0 1 2024-04-26T21:25:42.978 INFO:tasks.workunit.client.1.smithi120.stdout:4/174: link d10/d12/f18 d10/d28/f3d 0 2024-04-26T21:25:42.981 INFO:tasks.workunit.client.1.smithi120.stdout:9/102: symlink d0/d6/l1f 0 2024-04-26T21:25:42.981 INFO:tasks.workunit.client.1.smithi120.stdout:8/174: dread f4 [0,4194304] 0 2024-04-26T21:25:42.982 INFO:tasks.workunit.client.1.smithi120.stdout:9/103: readlink d0/d6/l7 0 2024-04-26T21:25:42.983 INFO:tasks.workunit.client.1.smithi120.stdout:0/177: dwrite d0/d3/dc/f27 [0,4194304] 0 2024-04-26T21:25:42.985 INFO:tasks.workunit.client.1.smithi120.stdout:6/143: dwrite d4/db/f1b [0,4194304] 0 2024-04-26T21:25:42.985 INFO:tasks.workunit.client.1.smithi120.stdout:4/175: read d10/d12/f18 [1167207,54573] 0 2024-04-26T21:25:42.987 INFO:tasks.workunit.client.1.smithi120.stdout:6/144: write d4/f1f [550882,95741] 0 2024-04-26T21:25:42.989 INFO:tasks.workunit.client.1.smithi120.stdout:9/104: symlink d0/d6/l20 0 2024-04-26T21:25:42.994 INFO:tasks.workunit.client.1.smithi120.stdout:9/105: write d0/f1 [9226499,65523] 0 2024-04-26T21:25:42.998 INFO:tasks.workunit.client.1.smithi120.stdout:8/175: truncate d5/d6/f25 2892384 0 2024-04-26T21:25:43.002 INFO:tasks.workunit.client.1.smithi120.stdout:9/106: symlink d0/d6/d1c/l21 0 2024-04-26T21:25:43.003 INFO:tasks.workunit.client.1.smithi120.stdout:0/178: getdents d0/d3/dc/d12 0 2024-04-26T21:25:43.008 INFO:tasks.workunit.client.1.smithi120.stdout:8/176: mkdir d5/d6/d34/d42 0 2024-04-26T21:25:43.012 INFO:tasks.workunit.client.1.smithi120.stdout:0/179: write d0/d3/dc/dd/f34 [216999,19580] 0 2024-04-26T21:25:43.025 INFO:tasks.workunit.client.1.smithi120.stdout:0/180: link d0/d3/dc/f15 d0/d3/f3c 0 2024-04-26T21:25:43.025 INFO:tasks.workunit.client.1.smithi120.stdout:5/164: sync 2024-04-26T21:25:43.028 INFO:tasks.workunit.client.1.smithi120.stdout:4/176: dwrite d10/d12/f3a [0,4194304] 0 2024-04-26T21:25:43.028 INFO:tasks.workunit.client.1.smithi120.stdout:9/107: dread d0/f1 [4194304,4194304] 0 2024-04-26T21:25:43.028 INFO:tasks.workunit.client.1.smithi120.stdout:0/181: dread - d0/d3/f23 zero size 2024-04-26T21:25:43.035 INFO:tasks.workunit.client.1.smithi120.stdout:9/108: write d0/fa [2434192,72941] 0 2024-04-26T21:25:43.036 INFO:tasks.workunit.client.1.smithi120.stdout:0/182: chown d0/d3/dc/dd/f2d 36553459 1 2024-04-26T21:25:43.042 INFO:tasks.workunit.client.1.smithi120.stdout:6/145: dread d4/db/d10/f19 [0,4194304] 0 2024-04-26T21:25:43.042 INFO:tasks.workunit.client.1.smithi120.stdout:8/177: dwrite d5/d6/d12/d27/f33 [0,4194304] 0 2024-04-26T21:25:43.045 INFO:tasks.workunit.client.1.smithi120.stdout:9/109: rename d0/d6/d1c/l21 to d0/l22 0 2024-04-26T21:25:43.048 INFO:tasks.workunit.client.1.smithi120.stdout:6/146: rename d4/c5 to d4/c2f 0 2024-04-26T21:25:43.050 INFO:tasks.workunit.client.1.smithi120.stdout:9/110: readlink d0/l11 0 2024-04-26T21:25:43.051 INFO:tasks.workunit.client.1.smithi120.stdout:5/165: truncate d2/db/f28 2237592 0 2024-04-26T21:25:43.052 INFO:tasks.workunit.client.1.smithi120.stdout:0/183: write d0/df/f3a [1571937,12447] 0 2024-04-26T21:25:43.054 INFO:tasks.workunit.client.1.smithi120.stdout:9/111: symlink d0/d6/l23 0 2024-04-26T21:25:43.055 INFO:tasks.workunit.client.1.smithi120.stdout:5/166: write d2/f13 [1547650,28953] 0 2024-04-26T21:25:43.057 INFO:tasks.workunit.client.1.smithi120.stdout:4/177: dwrite d10/d12/f27 [0,4194304] 0 2024-04-26T21:25:43.060 INFO:tasks.workunit.client.1.smithi120.stdout:4/178: readlink d10/d28/l34 0 2024-04-26T21:25:43.061 INFO:tasks.workunit.client.1.smithi120.stdout:7/170: dread d7/f8 [4194304,4194304] 0 2024-04-26T21:25:43.061 INFO:tasks.workunit.client.1.smithi120.stdout:0/184: creat d0/d3/f3d x:0 0 0 2024-04-26T21:25:43.065 INFO:tasks.workunit.client.1.smithi120.stdout:9/112: creat d0/d14/f24 x:0 0 0 2024-04-26T21:25:43.068 INFO:tasks.workunit.client.1.smithi120.stdout:5/167: rename d2/dc/d1d/d1f/l2d to d2/d1b/d29/l31 0 2024-04-26T21:25:43.069 INFO:tasks.workunit.client.1.smithi120.stdout:4/179: creat d10/d28/f3e x:0 0 0 2024-04-26T21:25:43.071 INFO:tasks.workunit.client.1.smithi120.stdout:9/113: symlink d0/dd/l25 0 2024-04-26T21:25:43.073 INFO:tasks.workunit.client.0.smithi084.stderr:++ readlink -f fsstress 2024-04-26T21:25:43.073 INFO:tasks.workunit.client.1.smithi120.stdout:5/168: fsync d2/fa 0 2024-04-26T21:25:43.073 INFO:tasks.workunit.client.1.smithi120.stdout:8/178: dwrite d5/d6/d12/f17 [0,4194304] 0 2024-04-26T21:25:43.075 INFO:tasks.workunit.client.1.smithi120.stdout:9/114: fdatasync d0/d14/f24 0 2024-04-26T21:25:43.076 INFO:tasks.workunit.client.1.smithi120.stdout:4/180: symlink d10/d28/l3f 0 2024-04-26T21:25:43.077 INFO:tasks.workunit.client.1.smithi120.stdout:7/171: getdents d7/d19 0 2024-04-26T21:25:43.078 INFO:tasks.workunit.client.1.smithi120.stdout:5/169: mknod d2/d1b/d29/c32 0 2024-04-26T21:25:43.078 INFO:tasks.workunit.client.0.smithi084.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-26T21:25:43.078 INFO:tasks.workunit.client.0.smithi084.stderr:+ popd 2024-04-26T21:25:43.079 INFO:tasks.workunit.client.1.smithi120.stdout:8/179: read d5/f15 [527150,10183] 0 2024-04-26T21:25:43.080 INFO:tasks.workunit.client.1.smithi120.stdout:5/170: fsync d2/dc/fd 0 2024-04-26T21:25:43.083 INFO:tasks.workunit.client.0.smithi084.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T21:25:43.083 INFO:tasks.workunit.client.0.smithi084.stderr:+ popd 2024-04-26T21:25:43.085 INFO:tasks.workunit.client.0.smithi084.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-26T21:25:43.086 INFO:tasks.workunit.client.0.smithi084.stderr:++ mktemp -d -p . 2024-04-26T21:25:43.087 INFO:tasks.workunit.client.1.smithi120.stdout:4/181: link f9 d10/d12/f40 0 2024-04-26T21:25:43.087 INFO:tasks.workunit.client.1.smithi120.stdout:0/185: dread d0/f14 [0,4194304] 0 2024-04-26T21:25:43.088 INFO:tasks.workunit.client.1.smithi120.stdout:4/182: readlink d10/d28/l33 0 2024-04-26T21:25:43.092 INFO:tasks.workunit.client.1.smithi120.stdout:6/147: truncate d4/db/d10/f15 1973324 0 2024-04-26T21:25:43.095 INFO:tasks.workunit.client.1.smithi120.stdout:7/172: link d7/d10/d12/d1f/d28/f2e d7/d10/d12/d1f/d28/f3e 0 2024-04-26T21:25:43.097 INFO:tasks.workunit.client.1.smithi120.stdout:8/180: symlink d5/d6/d11/d32/d3b/l43 0 2024-04-26T21:25:43.097 INFO:tasks.workunit.client.1.smithi120.stdout:9/115: dwrite d0/d14/f24 [0,4194304] 0 2024-04-26T21:25:43.098 INFO:tasks.workunit.client.0.smithi084.stderr:+ T=./tmp.xVAnkYFrMT 2024-04-26T21:25:43.098 INFO:tasks.workunit.client.0.smithi084.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.xVAnkYFrMT -l 1 -n 1000 -p 10 -v 2024-04-26T21:25:43.099 INFO:tasks.workunit.client.1.smithi120.stdout:6/148: dread d4/db/d10/dd/f18 [0,4194304] 0 2024-04-26T21:25:43.099 INFO:tasks.workunit.client.1.smithi120.stdout:4/183: rmdir d10/d12 39 2024-04-26T21:25:43.103 INFO:tasks.workunit.client.1.smithi120.stdout:5/171: truncate d2/dc/fd 3112924 0 2024-04-26T21:25:43.105 INFO:tasks.workunit.client.1.smithi120.stdout:4/184: rmdir d10 39 2024-04-26T21:25:43.107 INFO:tasks.workunit.client.1.smithi120.stdout:0/186: creat d0/d3/dc/dd/d1b/d39/f3e x:0 0 0 2024-04-26T21:25:43.109 INFO:tasks.workunit.client.1.smithi120.stdout:8/181: creat d5/d6/d12/f44 x:0 0 0 2024-04-26T21:25:43.109 INFO:tasks.workunit.client.1.smithi120.stdout:6/149: creat d4/db/d10/dd/f30 x:0 0 0 2024-04-26T21:25:43.110 INFO:tasks.workunit.client.0.smithi084.stdout:seed = 1714269088 2024-04-26T21:25:43.110 INFO:tasks.workunit.client.1.smithi120.stdout:5/172: creat d2/dc/d1d/f33 x:0 0 0 2024-04-26T21:25:43.112 INFO:tasks.workunit.client.1.smithi120.stdout:5/173: read d2/db/f14 [58940,91131] 0 2024-04-26T21:25:43.112 INFO:tasks.workunit.client.1.smithi120.stdout:4/185: fdatasync d10/f24 0 2024-04-26T21:25:43.118 INFO:tasks.workunit.client.0.smithi084.stdout:0/0: dwrite - no filename 2024-04-26T21:25:43.118 INFO:tasks.workunit.client.0.smithi084.stdout:0/1: dwrite - no filename 2024-04-26T21:25:43.119 INFO:tasks.workunit.client.0.smithi084.stdout:0/2: write - no filename 2024-04-26T21:25:43.119 INFO:tasks.workunit.client.0.smithi084.stdout:0/3: dread - no filename 2024-04-26T21:25:43.119 INFO:tasks.workunit.client.0.smithi084.stdout:0/4: dread - no filename 2024-04-26T21:25:43.119 INFO:tasks.workunit.client.0.smithi084.stdout:0/5: truncate - no filename 2024-04-26T21:25:43.119 INFO:tasks.workunit.client.0.smithi084.stdout:0/6: dwrite - no filename 2024-04-26T21:25:43.119 INFO:tasks.workunit.client.0.smithi084.stdout:0/7: dwrite - no filename 2024-04-26T21:25:43.121 INFO:tasks.workunit.client.0.smithi084.stdout:3/0: write - no filename 2024-04-26T21:25:43.123 INFO:tasks.workunit.client.0.smithi084.stdout:0/8: creat f0 x:0 0 0 2024-04-26T21:25:43.125 INFO:tasks.workunit.client.0.smithi084.stdout:4/0: dwrite - no filename 2024-04-26T21:25:43.127 INFO:tasks.workunit.client.0.smithi084.stdout:3/1: creat f0 x:0 0 0 2024-04-26T21:25:43.128 INFO:tasks.workunit.client.0.smithi084.stdout:0/9: creat f1 x:0 0 0 2024-04-26T21:25:43.128 INFO:tasks.workunit.client.0.smithi084.stdout:5/0: fsync - no filename 2024-04-26T21:25:43.128 INFO:tasks.workunit.client.0.smithi084.stdout:5/1: write - no filename 2024-04-26T21:25:43.128 INFO:tasks.workunit.client.0.smithi084.stdout:5/2: fdatasync - no filename 2024-04-26T21:25:43.128 INFO:tasks.workunit.client.0.smithi084.stdout:5/3: write - no filename 2024-04-26T21:25:43.128 INFO:tasks.workunit.client.0.smithi084.stdout:5/4: rmdir - no directory 2024-04-26T21:25:43.128 INFO:tasks.workunit.client.0.smithi084.stdout:5/5: read - no filename 2024-04-26T21:25:43.128 INFO:tasks.workunit.client.0.smithi084.stdout:5/6: fdatasync - no filename 2024-04-26T21:25:43.129 INFO:tasks.workunit.client.0.smithi084.stdout:4/1: symlink l0 0 2024-04-26T21:25:43.131 INFO:tasks.workunit.client.0.smithi084.stdout:6/0: rmdir - no directory 2024-04-26T21:25:43.131 INFO:tasks.workunit.client.0.smithi084.stdout:6/1: write - no filename 2024-04-26T21:25:43.131 INFO:tasks.workunit.client.0.smithi084.stdout:6/2: dwrite - no filename 2024-04-26T21:25:43.131 INFO:tasks.workunit.client.0.smithi084.stdout:5/7: mkdir d0 0 2024-04-26T21:25:43.131 INFO:tasks.workunit.client.0.smithi084.stdout:5/8: fsync - no filename 2024-04-26T21:25:43.131 INFO:tasks.workunit.client.1.smithi120.stdout:0/187: rename d0/d3/f23 to d0/df/f3f 0 2024-04-26T21:25:43.131 INFO:tasks.workunit.client.1.smithi120.stdout:6/150: write d4/f14 [2511901,69060] 0 2024-04-26T21:25:43.132 INFO:tasks.workunit.client.1.smithi120.stdout:8/182: creat d5/d6/d11/d32/f45 x:0 0 0 2024-04-26T21:25:43.132 INFO:tasks.workunit.client.1.smithi120.stdout:5/174: write d2/db/f27 [146940,50578] 0 2024-04-26T21:25:43.133 INFO:tasks.workunit.client.0.smithi084.stdout:3/2: write f0 [1004143,38955] 0 2024-04-26T21:25:43.134 INFO:tasks.workunit.client.1.smithi120.stdout:0/188: readlink d0/l19 0 2024-04-26T21:25:43.134 INFO:tasks.workunit.client.0.smithi084.stdout:0/10: truncate f1 1046622 0 2024-04-26T21:25:43.135 INFO:tasks.workunit.client.0.smithi084.stdout:4/2: symlink l1 0 2024-04-26T21:25:43.135 INFO:tasks.workunit.client.0.smithi084.stdout:4/3: write - no filename 2024-04-26T21:25:43.135 INFO:tasks.workunit.client.0.smithi084.stdout:4/4: read - no filename 2024-04-26T21:25:43.136 INFO:tasks.workunit.client.1.smithi120.stdout:7/173: write d7/f22 [3402537,87883] 0 2024-04-26T21:25:43.136 INFO:tasks.workunit.client.0.smithi084.stdout:4/5: chown l0 5108681 1 2024-04-26T21:25:43.137 INFO:tasks.workunit.client.1.smithi120.stdout:5/175: stat d2/d1b/d29 0 2024-04-26T21:25:43.139 INFO:tasks.workunit.client.0.smithi084.stdout:6/3: creat f0 x:0 0 0 2024-04-26T21:25:43.140 INFO:tasks.workunit.client.0.smithi084.stdout:0/11: mkdir d2 0 2024-04-26T21:25:43.140 INFO:tasks.workunit.client.0.smithi084.stdout:8/0: dread - no filename 2024-04-26T21:25:43.140 INFO:tasks.workunit.client.0.smithi084.stdout:8/1: write - no filename 2024-04-26T21:25:43.141 INFO:tasks.workunit.client.1.smithi120.stdout:5/176: write d2/dc/d1d/f33 [75382,74351] 0 2024-04-26T21:25:43.141 INFO:tasks.workunit.client.0.smithi084.stdout:5/9: mknod d0/c1 0 2024-04-26T21:25:43.141 INFO:tasks.workunit.client.0.smithi084.stdout:0/12: stat f0 0 2024-04-26T21:25:43.142 INFO:tasks.workunit.client.1.smithi120.stdout:6/151: rename d4/db/d10/f19 to d4/f31 0 2024-04-26T21:25:43.144 INFO:tasks.workunit.client.1.smithi120.stdout:6/152: write f1 [2347064,99017] 0 2024-04-26T21:25:43.144 INFO:tasks.workunit.client.1.smithi120.stdout:5/177: stat d2/db/cf 0 2024-04-26T21:25:43.144 INFO:tasks.workunit.client.0.smithi084.stdout:9/0: write - no filename 2024-04-26T21:25:43.144 INFO:tasks.workunit.client.0.smithi084.stdout:9/1: write - no filename 2024-04-26T21:25:43.146 INFO:tasks.workunit.client.0.smithi084.stdout:9/2: chown . 1538348427 1 2024-04-26T21:25:43.146 INFO:tasks.workunit.client.0.smithi084.stdout:9/3: write - no filename 2024-04-26T21:25:43.146 INFO:tasks.workunit.client.0.smithi084.stdout:9/4: write - no filename 2024-04-26T21:25:43.147 INFO:tasks.workunit.client.0.smithi084.stdout:9/5: unlink - no file 2024-04-26T21:25:43.147 INFO:tasks.workunit.client.0.smithi084.stdout:9/6: dwrite - no filename 2024-04-26T21:25:43.147 INFO:tasks.workunit.client.0.smithi084.stdout:7/0: mknod c0 0 2024-04-26T21:25:43.147 INFO:tasks.workunit.client.0.smithi084.stdout:7/1: write - no filename 2024-04-26T21:25:43.147 INFO:tasks.workunit.client.1.smithi120.stdout:7/174: mknod d7/d10/d12/c3f 0 2024-04-26T21:25:43.148 INFO:tasks.workunit.client.0.smithi084.stdout:8/2: getdents . 0 2024-04-26T21:25:43.149 INFO:tasks.workunit.client.1.smithi120.stdout:6/153: unlink d4/db/c2a 0 2024-04-26T21:25:43.149 INFO:tasks.workunit.client.0.smithi084.stdout:8/3: chown . 13 1 2024-04-26T21:25:43.152 INFO:tasks.workunit.client.1.smithi120.stdout:8/183: link d5/d6/l1d d5/d6/d12/d27/l46 0 2024-04-26T21:25:43.154 INFO:tasks.workunit.client.1.smithi120.stdout:5/178: mkdir d2/dc/d1d/d1f/d34 0 2024-04-26T21:25:43.154 INFO:tasks.workunit.client.1.smithi120.stdout:6/154: truncate d4/db/d25/f2d 219785 0 2024-04-26T21:25:43.155 INFO:tasks.workunit.client.0.smithi084.stdout:3/3: dread f0 [0,4194304] 0 2024-04-26T21:25:43.156 INFO:tasks.workunit.client.1.smithi120.stdout:7/175: symlink d7/d10/d12/d1f/l40 0 2024-04-26T21:25:43.156 INFO:tasks.workunit.client.0.smithi084.stdout:2/0: rename - no filename 2024-04-26T21:25:43.157 INFO:tasks.workunit.client.0.smithi084.stdout:9/7: creat f0 x:0 0 0 2024-04-26T21:25:43.158 INFO:tasks.workunit.client.1.smithi120.stdout:8/184: chown d5/d6/l9 18275337 1 2024-04-26T21:25:43.158 INFO:tasks.workunit.client.0.smithi084.stdout:9/8: chown f0 728 1 2024-04-26T21:25:43.161 INFO:tasks.workunit.client.0.smithi084.stdout:0/13: rmdir d2 0 2024-04-26T21:25:43.161 INFO:tasks.workunit.client.1.smithi120.stdout:6/155: link f1 d4/d27/f32 0 2024-04-26T21:25:43.162 INFO:tasks.workunit.client.1.smithi120.stdout:7/176: fdatasync d7/d10/d12/f1d 0 2024-04-26T21:25:43.163 INFO:tasks.workunit.client.1.smithi120.stdout:5/179: creat d2/d1b/f35 x:0 0 0 2024-04-26T21:25:43.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:42 smithi084 ceph-mon[25539]: pgmap v36: 65 pgs: 65 active+clean; 458 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 823 KiB/s rd, 36 MiB/s wr, 197 op/s 2024-04-26T21:25:43.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:42 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:43.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:42 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:43.164 INFO:tasks.workunit.client.0.smithi084.stdout:3/4: mkdir d1 0 2024-04-26T21:25:43.165 INFO:tasks.workunit.client.0.smithi084.stdout:0/14: write f1 [682879,112094] 0 2024-04-26T21:25:43.165 INFO:tasks.workunit.client.0.smithi084.stdout:3/5: chown f0 56398618 1 2024-04-26T21:25:43.165 INFO:tasks.workunit.client.0.smithi084.stdout:1/0: mknod c0 0 2024-04-26T21:25:43.165 INFO:tasks.workunit.client.0.smithi084.stdout:1/1: dwrite - no filename 2024-04-26T21:25:43.166 INFO:tasks.workunit.client.1.smithi120.stdout:4/186: dwrite d10/d12/f2a [0,4194304] 0 2024-04-26T21:25:43.167 INFO:tasks.workunit.client.0.smithi084.stdout:8/4: creat f0 x:0 0 0 2024-04-26T21:25:43.172 INFO:tasks.workunit.client.1.smithi120.stdout:0/189: dwrite d0/df/f3f [0,4194304] 0 2024-04-26T21:25:43.177 INFO:tasks.workunit.client.1.smithi120.stdout:4/187: rename f8 to d10/d28/f41 0 2024-04-26T21:25:43.179 INFO:tasks.workunit.client.0.smithi084.stdout:0/15: symlink l3 0 2024-04-26T21:25:43.181 INFO:tasks.workunit.client.1.smithi120.stdout:8/185: truncate d5/d6/f25 2687275 0 2024-04-26T21:25:43.181 INFO:tasks.workunit.client.1.smithi120.stdout:0/190: fdatasync d0/d3/f9 0 2024-04-26T21:25:43.181 INFO:tasks.workunit.client.0.smithi084.stdout:2/1: creat f0 x:0 0 0 2024-04-26T21:25:43.181 INFO:tasks.workunit.client.0.smithi084.stdout:2/2: readlink - no filename 2024-04-26T21:25:43.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:42 smithi120 ceph-mon[32741]: pgmap v36: 65 pgs: 65 active+clean; 458 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 823 KiB/s rd, 36 MiB/s wr, 197 op/s 2024-04-26T21:25:43.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:42 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:43.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:42 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:43.182 INFO:tasks.workunit.client.1.smithi120.stdout:7/177: creat d7/d10/d12/d2f/f41 x:0 0 0 2024-04-26T21:25:43.183 INFO:tasks.workunit.client.0.smithi084.stdout:0/16: dread - f0 zero size 2024-04-26T21:25:43.185 INFO:tasks.workunit.client.1.smithi120.stdout:6/156: link d4/db/lc d4/db/d10/d22/l33 0 2024-04-26T21:25:43.187 INFO:tasks.workunit.client.0.smithi084.stdout:3/6: creat d1/f2 x:0 0 0 2024-04-26T21:25:43.189 INFO:tasks.workunit.client.1.smithi120.stdout:6/157: chown f1 2167 1 2024-04-26T21:25:43.199 INFO:tasks.workunit.client.1.smithi120.stdout:5/180: dwrite d2/dc/d1d/f33 [0,4194304] 0 2024-04-26T21:25:43.203 INFO:tasks.workunit.client.1.smithi120.stdout:8/186: dwrite d5/d6/f1f [0,4194304] 0 2024-04-26T21:25:43.208 INFO:tasks.workunit.client.1.smithi120.stdout:8/187: read d5/d6/d12/f17 [1096391,21811] 0 2024-04-26T21:25:43.214 INFO:tasks.workunit.client.1.smithi120.stdout:1/148: sync 2024-04-26T21:25:43.214 INFO:tasks.workunit.client.1.smithi120.stdout:3/114: sync 2024-04-26T21:25:43.214 INFO:tasks.workunit.client.1.smithi120.stdout:2/234: sync 2024-04-26T21:25:43.226 INFO:tasks.workunit.client.1.smithi120.stdout:3/115: dread f5 [0,4194304] 0 2024-04-26T21:25:43.228 INFO:tasks.workunit.client.1.smithi120.stdout:3/116: dread - dd/de/df/d12/f21 zero size 2024-04-26T21:25:43.230 INFO:tasks.workunit.client.1.smithi120.stdout:3/117: fsync dd/de/d18/f25 0 2024-04-26T21:25:43.251 INFO:tasks.workunit.client.1.smithi120.stdout:4/188: rename d10/d28/c37 to d10/c42 0 2024-04-26T21:25:43.251 INFO:tasks.workunit.client.0.smithi084.stdout:2/3: mknod c1 0 2024-04-26T21:25:43.252 INFO:tasks.workunit.client.0.smithi084.stdout:0/17: creat f4 x:0 0 0 2024-04-26T21:25:43.258 INFO:tasks.workunit.client.0.smithi084.stdout:3/7: chown f0 63980583 1 2024-04-26T21:25:43.259 INFO:tasks.workunit.client.1.smithi120.stdout:8/188: truncate d5/d6/f1e 4757118 0 2024-04-26T21:25:43.262 INFO:tasks.workunit.client.0.smithi084.stdout:9/9: dwrite f0 [0,4194304] 0 2024-04-26T21:25:43.265 INFO:tasks.workunit.client.0.smithi084.stdout:8/5: dwrite f0 [0,4194304] 0 2024-04-26T21:25:43.266 INFO:tasks.workunit.client.0.smithi084.stdout:4/6: getdents . 0 2024-04-26T21:25:43.267 INFO:tasks.workunit.client.0.smithi084.stdout:6/4: getdents . 0 2024-04-26T21:25:43.267 INFO:tasks.workunit.client.0.smithi084.stdout:4/7: readlink l1 0 2024-04-26T21:25:43.267 INFO:tasks.workunit.client.1.smithi120.stdout:0/191: rename d0/d3/dc/d12/d31/l32 to d0/d3/dc/dd/d1b/d39/l40 0 2024-04-26T21:25:43.269 INFO:tasks.workunit.client.0.smithi084.stdout:6/5: dread - f0 zero size 2024-04-26T21:25:43.269 INFO:tasks.workunit.client.0.smithi084.stdout:7/2: getdents . 0 2024-04-26T21:25:43.270 INFO:tasks.workunit.client.1.smithi120.stdout:4/189: creat d10/d12/f43 x:0 0 0 2024-04-26T21:25:43.271 INFO:tasks.workunit.client.0.smithi084.stdout:2/4: symlink l2 0 2024-04-26T21:25:43.272 INFO:tasks.workunit.client.0.smithi084.stdout:9/10: creat f1 x:0 0 0 2024-04-26T21:25:43.274 INFO:tasks.workunit.client.0.smithi084.stdout:3/8: rename f0 to d1/f3 0 2024-04-26T21:25:43.274 INFO:tasks.workunit.client.0.smithi084.stdout:4/8: mknod c2 0 2024-04-26T21:25:43.274 INFO:tasks.workunit.client.0.smithi084.stdout:4/9: write - no filename 2024-04-26T21:25:43.274 INFO:tasks.workunit.client.0.smithi084.stdout:4/10: dwrite - no filename 2024-04-26T21:25:43.275 INFO:tasks.workunit.client.0.smithi084.stdout:8/6: creat f1 x:0 0 0 2024-04-26T21:25:43.276 INFO:tasks.workunit.client.0.smithi084.stdout:7/3: symlink l1 0 2024-04-26T21:25:43.276 INFO:tasks.workunit.client.0.smithi084.stdout:7/4: write - no filename 2024-04-26T21:25:43.276 INFO:tasks.workunit.client.0.smithi084.stdout:2/5: mknod c3 0 2024-04-26T21:25:43.277 INFO:tasks.workunit.client.0.smithi084.stdout:7/5: chown c0 863 1 2024-04-26T21:25:43.278 INFO:tasks.workunit.client.0.smithi084.stdout:3/9: chown d1/f3 7 1 2024-04-26T21:25:43.281 INFO:tasks.workunit.client.0.smithi084.stdout:2/6: mknod c4 0 2024-04-26T21:25:43.281 INFO:tasks.workunit.client.0.smithi084.stdout:4/11: rename l0 to l3 0 2024-04-26T21:25:43.283 INFO:tasks.workunit.client.1.smithi120.stdout:1/149: rename d6/d7/d2d/f30 to d6/d7/d1d/d2c/f31 0 2024-04-26T21:25:43.283 INFO:tasks.workunit.client.0.smithi084.stdout:7/6: symlink l2 0 2024-04-26T21:25:43.283 INFO:tasks.workunit.client.0.smithi084.stdout:7/7: dread - no filename 2024-04-26T21:25:43.283 INFO:tasks.workunit.client.0.smithi084.stdout:3/10: symlink d1/l4 0 2024-04-26T21:25:43.284 INFO:tasks.workunit.client.0.smithi084.stdout:7/8: chown l1 45905704 1 2024-04-26T21:25:43.284 INFO:tasks.workunit.client.0.smithi084.stdout:7/9: fdatasync - no filename 2024-04-26T21:25:43.285 INFO:tasks.workunit.client.0.smithi084.stdout:2/7: symlink l5 0 2024-04-26T21:25:43.285 INFO:tasks.workunit.client.0.smithi084.stdout:7/10: stat l2 0 2024-04-26T21:25:43.286 INFO:tasks.workunit.client.1.smithi120.stdout:0/192: write d0/d3/d13/f1f [961035,19726] 0 2024-04-26T21:25:43.286 INFO:tasks.workunit.client.0.smithi084.stdout:2/8: read - f0 zero size 2024-04-26T21:25:43.290 INFO:tasks.workunit.client.0.smithi084.stdout:2/9: mkdir d6 0 2024-04-26T21:25:43.290 INFO:tasks.workunit.client.1.smithi120.stdout:7/178: truncate d7/d19/f24 414733 0 2024-04-26T21:25:43.291 INFO:tasks.workunit.client.0.smithi084.stdout:0/18: dread f1 [0,4194304] 0 2024-04-26T21:25:43.293 INFO:tasks.workunit.client.1.smithi120.stdout:7/179: fdatasync d7/d10/d12/d1f/f3a 0 2024-04-26T21:25:43.293 INFO:tasks.workunit.client.1.smithi120.stdout:1/150: symlink d6/d14/l32 0 2024-04-26T21:25:43.293 INFO:tasks.workunit.client.1.smithi120.stdout:6/158: dwrite f1 [0,4194304] 0 2024-04-26T21:25:43.295 INFO:tasks.workunit.client.1.smithi120.stdout:1/151: fdatasync d6/d9/f1c 0 2024-04-26T21:25:43.295 INFO:tasks.workunit.client.0.smithi084.stdout:2/10: mkdir d6/d7 0 2024-04-26T21:25:43.296 INFO:tasks.workunit.client.1.smithi120.stdout:7/180: chown d7/d10/d12/d2f/f41 36 1 2024-04-26T21:25:43.297 INFO:tasks.workunit.client.1.smithi120.stdout:3/118: truncate f6 6171487 0 2024-04-26T21:25:43.305 INFO:tasks.workunit.client.1.smithi120.stdout:3/119: symlink dd/de/df/d1e/l29 0 2024-04-26T21:25:43.305 INFO:tasks.workunit.client.1.smithi120.stdout:5/181: dwrite d2/dc/fd [0,4194304] 0 2024-04-26T21:25:43.306 INFO:tasks.workunit.client.1.smithi120.stdout:6/159: link d4/db/d25/f2d d4/d27/f34 0 2024-04-26T21:25:43.308 INFO:tasks.workunit.client.0.smithi084.stdout:7/11: getdents . 0 2024-04-26T21:25:43.308 INFO:tasks.workunit.client.0.smithi084.stdout:7/12: dread - no filename 2024-04-26T21:25:43.309 INFO:tasks.workunit.client.1.smithi120.stdout:5/182: write d2/dc/d1d/f33 [1483371,59191] 0 2024-04-26T21:25:43.310 INFO:tasks.workunit.client.0.smithi084.stdout:6/6: dwrite f0 [0,4194304] 0 2024-04-26T21:25:43.310 INFO:tasks.workunit.client.0.smithi084.stdout:3/11: rmdir d1 39 2024-04-26T21:25:43.310 INFO:tasks.workunit.client.1.smithi120.stdout:3/120: mkdir dd/d2a 0 2024-04-26T21:25:43.317 INFO:tasks.workunit.client.0.smithi084.stdout:7/13: mknod c3 0 2024-04-26T21:25:43.317 INFO:tasks.workunit.client.0.smithi084.stdout:7/14: write - no filename 2024-04-26T21:25:43.320 INFO:tasks.workunit.client.0.smithi084.stdout:6/7: getdents . 0 2024-04-26T21:25:43.320 INFO:tasks.workunit.client.1.smithi120.stdout:1/152: dread d6/d14/f16 [0,4194304] 0 2024-04-26T21:25:43.321 INFO:tasks.workunit.client.1.smithi120.stdout:3/121: rename cb to dd/de/df/d12/c2b 0 2024-04-26T21:25:43.321 INFO:tasks.workunit.client.1.smithi120.stdout:3/122: fsync dd/f15 0 2024-04-26T21:25:43.323 INFO:tasks.workunit.client.0.smithi084.stdout:6/8: write f0 [1245389,36530] 0 2024-04-26T21:25:43.327 INFO:tasks.workunit.client.0.smithi084.stdout:3/12: getdents d1 0 2024-04-26T21:25:43.327 INFO:tasks.workunit.client.1.smithi120.stdout:1/153: symlink d6/d7/da/dd/l33 0 2024-04-26T21:25:43.327 INFO:tasks.workunit.client.1.smithi120.stdout:6/160: dread d4/db/fe [0,4194304] 0 2024-04-26T21:25:43.329 INFO:tasks.workunit.client.0.smithi084.stdout:6/9: chown f0 205377234 1 2024-04-26T21:25:43.329 INFO:tasks.workunit.client.0.smithi084.stdout:2/11: dwrite f0 [0,4194304] 0 2024-04-26T21:25:43.329 INFO:tasks.workunit.client.0.smithi084.stdout:3/13: fsync d1/f2 0 2024-04-26T21:25:43.330 INFO:tasks.workunit.client.0.smithi084.stdout:6/10: chown f0 2411 1 2024-04-26T21:25:43.330 INFO:tasks.workunit.client.1.smithi120.stdout:3/123: write dd/de/f11 [2525093,58343] 0 2024-04-26T21:25:43.331 INFO:tasks.workunit.client.0.smithi084.stdout:6/11: chown f0 247914 1 2024-04-26T21:25:43.332 INFO:tasks.workunit.client.0.smithi084.stdout:3/14: write d1/f2 [863228,54088] 0 2024-04-26T21:25:43.335 INFO:tasks.workunit.client.1.smithi120.stdout:6/161: creat d4/db/f35 x:0 0 0 2024-04-26T21:25:43.336 INFO:tasks.workunit.client.1.smithi120.stdout:3/124: unlink dd/de/f11 0 2024-04-26T21:25:43.337 INFO:tasks.workunit.client.0.smithi084.stdout:3/15: symlink d1/l5 0 2024-04-26T21:25:43.340 INFO:tasks.workunit.client.1.smithi120.stdout:5/183: dwrite d2/db/f27 [0,4194304] 0 2024-04-26T21:25:43.342 INFO:tasks.workunit.client.1.smithi120.stdout:3/125: write dd/de/df/f16 [65130,17846] 0 2024-04-26T21:25:43.343 INFO:tasks.workunit.client.1.smithi120.stdout:9/116: sync 2024-04-26T21:25:43.351 INFO:tasks.workunit.client.1.smithi120.stdout:7/181: write d7/d10/d12/d1f/d28/f3e [818371,23062] 0 2024-04-26T21:25:43.351 INFO:tasks.workunit.client.1.smithi120.stdout:5/184: read - d2/d1b/f35 zero size 2024-04-26T21:25:43.354 INFO:tasks.workunit.client.0.smithi084.stdout:6/12: dwrite f0 [0,4194304] 0 2024-04-26T21:25:43.356 INFO:tasks.workunit.client.1.smithi120.stdout:7/182: creat d7/d10/d12/f42 x:0 0 0 2024-04-26T21:25:43.359 INFO:tasks.workunit.client.1.smithi120.stdout:1/154: write d6/d7/da/fb [3886078,25199] 0 2024-04-26T21:25:43.362 INFO:tasks.workunit.client.1.smithi120.stdout:6/162: dwrite f1 [0,4194304] 0 2024-04-26T21:25:43.362 INFO:tasks.workunit.client.1.smithi120.stdout:5/185: getdents d2/dc/d1d/d1f/d34 0 2024-04-26T21:25:43.365 INFO:tasks.workunit.client.1.smithi120.stdout:1/155: rmdir d6/d7 39 2024-04-26T21:25:43.365 INFO:tasks.workunit.client.0.smithi084.stdout:6/13: link f0 f1 0 2024-04-26T21:25:43.365 INFO:tasks.workunit.client.0.smithi084.stdout:2/12: fsync f0 0 2024-04-26T21:25:43.366 INFO:tasks.workunit.client.0.smithi084.stdout:2/13: readlink l2 0 2024-04-26T21:25:43.369 INFO:tasks.workunit.client.0.smithi084.stdout:3/16: dread d1/f2 [0,4194304] 0 2024-04-26T21:25:43.369 INFO:tasks.workunit.client.1.smithi120.stdout:9/117: dwrite d0/f18 [0,4194304] 0 2024-04-26T21:25:43.371 INFO:tasks.workunit.client.0.smithi084.stdout:6/14: write f1 [3742009,120012] 0 2024-04-26T21:25:43.372 INFO:tasks.workunit.client.1.smithi120.stdout:9/118: write d0/f18 [3677022,5486] 0 2024-04-26T21:25:43.373 INFO:tasks.workunit.client.0.smithi084.stdout:2/14: mkdir d6/d7/d8 0 2024-04-26T21:25:43.378 INFO:tasks.workunit.client.1.smithi120.stdout:0/193: dread d0/d3/f9 [0,4194304] 0 2024-04-26T21:25:43.378 INFO:tasks.workunit.client.1.smithi120.stdout:5/186: mkdir d2/dc/d1d/d1f/d36 0 2024-04-26T21:25:43.378 INFO:tasks.workunit.client.1.smithi120.stdout:9/119: creat d0/f26 x:0 0 0 2024-04-26T21:25:43.379 INFO:tasks.workunit.client.1.smithi120.stdout:1/156: creat d6/d7/d2d/f34 x:0 0 0 2024-04-26T21:25:43.383 INFO:tasks.workunit.client.1.smithi120.stdout:7/183: dwrite d7/d10/d12/f42 [0,4194304] 0 2024-04-26T21:25:43.384 INFO:tasks.workunit.client.1.smithi120.stdout:9/120: symlink d0/l27 0 2024-04-26T21:25:43.384 INFO:tasks.workunit.client.1.smithi120.stdout:1/157: fsync d6/f15 0 2024-04-26T21:25:43.386 INFO:tasks.workunit.client.1.smithi120.stdout:5/187: read d2/db/f16 [3821377,106909] 0 2024-04-26T21:25:43.387 INFO:tasks.workunit.client.1.smithi120.stdout:9/121: write d0/fa [1933844,86591] 0 2024-04-26T21:25:43.388 INFO:tasks.workunit.client.1.smithi120.stdout:9/122: readlink d0/l1b 0 2024-04-26T21:25:43.388 INFO:tasks.workunit.client.1.smithi120.stdout:0/194: rename d0/d3/dc/dd/f2d to d0/d3/f41 0 2024-04-26T21:25:43.391 INFO:tasks.workunit.client.1.smithi120.stdout:9/123: write d0/d6/f8 [861833,68048] 0 2024-04-26T21:25:43.391 INFO:tasks.workunit.client.0.smithi084.stdout:6/15: dread f0 [0,4194304] 0 2024-04-26T21:25:43.394 INFO:tasks.workunit.client.0.smithi084.stdout:2/15: dwrite f0 [0,4194304] 0 2024-04-26T21:25:43.398 INFO:tasks.workunit.client.0.smithi084.stdout:6/16: mknod c2 0 2024-04-26T21:25:43.400 INFO:tasks.workunit.client.1.smithi120.stdout:1/158: mkdir d6/d7/da/dd/d35 0 2024-04-26T21:25:43.402 INFO:tasks.workunit.client.1.smithi120.stdout:0/195: creat d0/d3/dc/d12/f42 x:0 0 0 2024-04-26T21:25:43.405 INFO:tasks.workunit.client.0.smithi084.stdout:6/17: mkdir d3 0 2024-04-26T21:25:43.405 INFO:tasks.workunit.client.0.smithi084.stdout:6/18: readlink - no filename 2024-04-26T21:25:43.405 INFO:tasks.workunit.client.1.smithi120.stdout:1/159: chown d6/d7/da/c25 94 1 2024-04-26T21:25:43.406 INFO:tasks.workunit.client.1.smithi120.stdout:0/196: stat d0/d3/dc/d12/f3b 0 2024-04-26T21:25:43.409 INFO:tasks.workunit.client.1.smithi120.stdout:7/184: getdents d7/d10/d12/d2f 0 2024-04-26T21:25:43.413 INFO:tasks.workunit.client.1.smithi120.stdout:0/197: fdatasync d0/d3/dc/f22 0 2024-04-26T21:25:43.413 INFO:tasks.workunit.client.1.smithi120.stdout:6/163: write d4/db/d10/f15 [2067323,65566] 0 2024-04-26T21:25:43.416 INFO:tasks.workunit.client.0.smithi084.stdout:2/16: dwrite f0 [0,4194304] 0 2024-04-26T21:25:43.418 INFO:tasks.workunit.client.0.smithi084.stdout:2/17: read f0 [2583677,58349] 0 2024-04-26T21:25:43.419 INFO:tasks.workunit.client.1.smithi120.stdout:6/164: fsync d4/f14 0 2024-04-26T21:25:43.419 INFO:tasks.workunit.client.0.smithi084.stdout:3/17: truncate d1/f2 605508 0 2024-04-26T21:25:43.420 INFO:tasks.workunit.client.1.smithi120.stdout:9/124: dwrite d0/f26 [0,4194304] 0 2024-04-26T21:25:43.423 INFO:tasks.workunit.client.1.smithi120.stdout:0/198: creat d0/d3/dc/d12/d31/f43 x:0 0 0 2024-04-26T21:25:43.425 INFO:tasks.workunit.client.1.smithi120.stdout:5/188: dwrite d2/f17 [0,4194304] 0 2024-04-26T21:25:43.432 INFO:tasks.workunit.client.1.smithi120.stdout:6/165: unlink d4/db/d10/dd/l16 0 2024-04-26T21:25:43.436 INFO:tasks.workunit.client.1.smithi120.stdout:1/160: dread d6/d9/f1c [0,4194304] 0 2024-04-26T21:25:43.437 INFO:tasks.workunit.client.1.smithi120.stdout:9/125: link d0/l22 d0/l28 0 2024-04-26T21:25:43.442 INFO:tasks.workunit.client.1.smithi120.stdout:0/199: rename d0/d3/dc/f15 to d0/d3/dc/f44 0 2024-04-26T21:25:43.443 INFO:tasks.workunit.client.1.smithi120.stdout:5/189: dwrite d2/d1b/d29/f2a [4194304,4194304] 0 2024-04-26T21:25:43.443 INFO:tasks.workunit.client.1.smithi120.stdout:1/161: symlink d6/d7/da/l36 0 2024-04-26T21:25:43.445 INFO:tasks.workunit.client.0.smithi084.stdout:2/18: dwrite f0 [0,4194304] 0 2024-04-26T21:25:43.447 INFO:tasks.workunit.client.1.smithi120.stdout:9/126: symlink d0/dd/l29 0 2024-04-26T21:25:43.449 INFO:tasks.workunit.client.0.smithi084.stdout:3/18: dwrite d1/f3 [0,4194304] 0 2024-04-26T21:25:43.453 INFO:tasks.workunit.client.1.smithi120.stdout:6/166: dwrite d4/db/f1b [0,4194304] 0 2024-04-26T21:25:43.456 INFO:tasks.workunit.client.1.smithi120.stdout:5/190: symlink d2/d1b/l37 0 2024-04-26T21:25:43.458 INFO:tasks.workunit.client.1.smithi120.stdout:1/162: mknod d6/d9/c37 0 2024-04-26T21:25:43.459 INFO:tasks.workunit.client.1.smithi120.stdout:9/127: symlink d0/d6/l2a 0 2024-04-26T21:25:43.461 INFO:tasks.workunit.client.1.smithi120.stdout:9/128: readlink d0/d6/l1a 0 2024-04-26T21:25:43.462 INFO:tasks.workunit.client.1.smithi120.stdout:5/191: creat d2/dc/f38 x:0 0 0 2024-04-26T21:25:43.463 INFO:tasks.workunit.client.0.smithi084.stdout:2/19: link c3 d6/c9 0 2024-04-26T21:25:43.464 INFO:tasks.workunit.client.1.smithi120.stdout:0/200: creat d0/d3/dc/dd/f45 x:0 0 0 2024-04-26T21:25:43.466 INFO:tasks.workunit.client.1.smithi120.stdout:9/129: write d0/d14/f24 [4052570,59734] 0 2024-04-26T21:25:43.472 INFO:tasks.workunit.client.0.smithi084.stdout:2/20: creat d6/fa x:0 0 0 2024-04-26T21:25:43.474 INFO:tasks.workunit.client.0.smithi084.stdout:2/21: write d6/fa [959868,18350] 0 2024-04-26T21:25:43.474 INFO:tasks.workunit.client.1.smithi120.stdout:1/163: getdents d6/d7 0 2024-04-26T21:25:43.477 INFO:tasks.workunit.client.0.smithi084.stdout:2/22: truncate d6/fa 1566582 0 2024-04-26T21:25:43.477 INFO:tasks.workunit.client.1.smithi120.stdout:2/235: sync 2024-04-26T21:25:43.480 INFO:tasks.workunit.client.0.smithi084.stdout:2/23: creat d6/d7/fb x:0 0 0 2024-04-26T21:25:43.481 INFO:tasks.workunit.client.1.smithi120.stdout:1/164: unlink d6/d7/d1b/l24 0 2024-04-26T21:25:43.482 INFO:tasks.workunit.client.0.smithi084.stdout:2/24: dread - d6/d7/fb zero size 2024-04-26T21:25:43.484 INFO:tasks.workunit.client.1.smithi120.stdout:2/236: truncate f1 87734 0 2024-04-26T21:25:43.488 INFO:tasks.workunit.client.1.smithi120.stdout:2/237: mkdir d4/d1b/d4f/d55 0 2024-04-26T21:25:43.489 INFO:tasks.workunit.client.1.smithi120.stdout:5/192: dwrite d2/db/f16 [0,4194304] 0 2024-04-26T21:25:43.491 INFO:tasks.workunit.client.1.smithi120.stdout:9/130: dread d0/f26 [0,4194304] 0 2024-04-26T21:25:43.491 INFO:tasks.workunit.client.1.smithi120.stdout:5/193: chown d2/dc/l1c 3 1 2024-04-26T21:25:43.495 INFO:tasks.workunit.client.1.smithi120.stdout:2/238: write d4/f34 [823262,113849] 0 2024-04-26T21:25:43.495 INFO:tasks.workunit.client.1.smithi120.stdout:5/194: symlink d2/db/l39 0 2024-04-26T21:25:43.495 INFO:tasks.workunit.client.1.smithi120.stdout:9/131: truncate d0/f26 4340223 0 2024-04-26T21:25:43.497 INFO:tasks.workunit.client.1.smithi120.stdout:2/239: dread - d4/d1b/d2e/f35 zero size 2024-04-26T21:25:43.502 INFO:tasks.workunit.client.0.smithi084.stdout:2/25: dwrite d6/fa [0,4194304] 0 2024-04-26T21:25:43.506 INFO:tasks.workunit.client.1.smithi120.stdout:5/195: symlink d2/d1b/l3a 0 2024-04-26T21:25:43.507 INFO:tasks.workunit.client.1.smithi120.stdout:7/185: dread d7/ff [0,4194304] 0 2024-04-26T21:25:43.511 INFO:tasks.workunit.client.1.smithi120.stdout:1/165: dwrite d6/d7/d1d/d2c/f2f [0,4194304] 0 2024-04-26T21:25:43.518 INFO:tasks.workunit.client.1.smithi120.stdout:2/240: rename d4/d1b/d25/d3d to d4/d1b/d56 0 2024-04-26T21:25:43.519 INFO:tasks.workunit.client.1.smithi120.stdout:0/201: truncate d0/df/f3f 482204 0 2024-04-26T21:25:43.522 INFO:tasks.workunit.client.1.smithi120.stdout:2/241: chown d4/d1b/d25/d2c/f46 253013133 1 2024-04-26T21:25:43.524 INFO:tasks.workunit.client.1.smithi120.stdout:7/186: mkdir d7/d10/d12/d2f/d43 0 2024-04-26T21:25:43.526 INFO:tasks.workunit.client.1.smithi120.stdout:2/242: chown d4/d1b/d2e/d50/d14 403 1 2024-04-26T21:25:43.527 INFO:tasks.workunit.client.1.smithi120.stdout:0/202: write d0/d3/dc/d12/f1a [2242108,97868] 0 2024-04-26T21:25:43.529 INFO:tasks.workunit.client.1.smithi120.stdout:5/196: dread d2/f17 [0,4194304] 0 2024-04-26T21:25:43.531 INFO:tasks.workunit.client.1.smithi120.stdout:1/166: link d6/d9/l21 d6/d7/l38 0 2024-04-26T21:25:43.534 INFO:tasks.workunit.client.1.smithi120.stdout:9/132: dwrite d0/d6/f8 [0,4194304] 0 2024-04-26T21:25:43.535 INFO:tasks.workunit.client.0.smithi084.stdout:3/19: dwrite d1/f2 [0,4194304] 0 2024-04-26T21:25:43.536 INFO:tasks.workunit.client.1.smithi120.stdout:7/187: creat d7/d19/f44 x:0 0 0 2024-04-26T21:25:43.538 INFO:tasks.workunit.client.1.smithi120.stdout:5/197: mkdir d2/d30/d3b 0 2024-04-26T21:25:43.539 INFO:tasks.workunit.client.0.smithi084.stdout:3/20: write d1/f3 [545344,126855] 0 2024-04-26T21:25:43.545 INFO:tasks.workunit.client.1.smithi120.stdout:2/243: creat d4/d1b/d2e/f57 x:0 0 0 2024-04-26T21:25:43.546 INFO:tasks.workunit.client.1.smithi120.stdout:1/167: mknod d6/d14/c39 0 2024-04-26T21:25:43.547 INFO:tasks.workunit.client.0.smithi084.stdout:3/21: rename d1/l5 to d1/l6 0 2024-04-26T21:25:43.548 INFO:tasks.workunit.client.1.smithi120.stdout:1/168: read - d6/d7/d2d/f34 zero size 2024-04-26T21:25:43.550 INFO:tasks.workunit.client.0.smithi084.stdout:2/26: dwrite d6/d7/fb [0,4194304] 0 2024-04-26T21:25:43.557 INFO:tasks.workunit.client.0.smithi084.stdout:2/27: rename d6/fa to d6/d7/d8/fc 0 2024-04-26T21:25:43.571 INFO:tasks.workunit.client.1.smithi120.stdout:1/169: dwrite d6/d7/d1d/d2c/f2f [4194304,4194304] 0 2024-04-26T21:25:43.574 INFO:tasks.workunit.client.1.smithi120.stdout:1/170: chown d6/d7/c12 5244 1 2024-04-26T21:25:43.577 INFO:tasks.workunit.client.1.smithi120.stdout:1/171: write d6/d9/f1e [302002,65610] 0 2024-04-26T21:25:43.577 INFO:tasks.workunit.client.0.smithi084.stdout:3/22: fdatasync d1/f2 0 2024-04-26T21:25:43.579 INFO:tasks.workunit.client.0.smithi084.stdout:3/23: chown d1/f2 41 1 2024-04-26T21:25:43.579 INFO:tasks.workunit.client.1.smithi120.stdout:1/172: truncate d6/d9/f1e 819252 0 2024-04-26T21:25:43.585 INFO:tasks.workunit.client.1.smithi120.stdout:7/188: rename d7/d10/d12/d1f/d28/l32 to d7/d10/d12/d2f/l45 0 2024-04-26T21:25:43.590 INFO:tasks.workunit.client.0.smithi084.stdout:2/28: truncate f0 1440979 0 2024-04-26T21:25:43.594 INFO:tasks.workunit.client.0.smithi084.stdout:3/24: dread d1/f3 [0,4194304] 0 2024-04-26T21:25:43.595 INFO:tasks.workunit.client.0.smithi084.stdout:2/29: rename l2 to d6/d7/ld 0 2024-04-26T21:25:43.596 INFO:tasks.workunit.client.0.smithi084.stdout:2/30: chown d6/d7/d8 5816553 1 2024-04-26T21:25:43.606 INFO:tasks.workunit.client.0.smithi084.stdout:2/31: creat d6/d7/d8/fe x:0 0 0 2024-04-26T21:25:43.607 INFO:tasks.workunit.client.1.smithi120.stdout:7/189: mknod d7/d10/c46 0 2024-04-26T21:25:43.607 INFO:tasks.workunit.client.1.smithi120.stdout:7/190: chown d7 231654095 1 2024-04-26T21:25:43.609 INFO:tasks.workunit.client.1.smithi120.stdout:5/198: link d2/d1b/d29/c32 d2/db/c3c 0 2024-04-26T21:25:43.611 INFO:tasks.workunit.client.1.smithi120.stdout:7/191: write d7/d10/d12/d1a/d33/d34/d37/f3b [3564171,86124] 0 2024-04-26T21:25:43.613 INFO:tasks.workunit.client.1.smithi120.stdout:4/190: sync 2024-04-26T21:25:43.613 INFO:tasks.workunit.client.1.smithi120.stdout:8/189: sync 2024-04-26T21:25:43.613 INFO:tasks.workunit.client.1.smithi120.stdout:3/126: sync 2024-04-26T21:25:43.614 INFO:tasks.workunit.client.1.smithi120.stdout:2/244: rename d4/l11 to d4/d1b/d2e/l58 0 2024-04-26T21:25:43.616 INFO:tasks.workunit.client.0.smithi084.stdout:3/25: dwrite d1/f3 [0,4194304] 0 2024-04-26T21:25:43.617 INFO:tasks.workunit.client.1.smithi120.stdout:4/191: dread - d10/d28/f3e zero size 2024-04-26T21:25:43.617 INFO:tasks.workunit.client.0.smithi084.stdout:2/32: rmdir d6 39 2024-04-26T21:25:43.625 INFO:tasks.workunit.client.1.smithi120.stdout:1/173: dwrite d6/d7/d1d/d2c/f31 [0,4194304] 0 2024-04-26T21:25:43.626 INFO:tasks.workunit.client.1.smithi120.stdout:1/174: read d6/d14/f16 [268459,37139] 0 2024-04-26T21:25:43.632 INFO:tasks.workunit.client.1.smithi120.stdout:5/199: dwrite d2/db/f27 [0,4194304] 0 2024-04-26T21:25:43.635 INFO:tasks.workunit.client.1.smithi120.stdout:0/203: truncate d0/d3/dc/d12/f1a 4183648 0 2024-04-26T21:25:43.636 INFO:tasks.workunit.client.1.smithi120.stdout:7/192: link l4 d7/d19/l47 0 2024-04-26T21:25:43.645 INFO:tasks.workunit.client.1.smithi120.stdout:9/133: truncate d0/f18 2027981 0 2024-04-26T21:25:43.647 INFO:tasks.workunit.client.1.smithi120.stdout:8/190: link d5/d6/l9 d5/d6/d34/d37/l47 0 2024-04-26T21:25:43.648 INFO:tasks.workunit.client.1.smithi120.stdout:8/191: write d5/d18/f40 [56994,43213] 0 2024-04-26T21:25:43.651 INFO:tasks.workunit.client.0.smithi084.stdout:2/33: dread d6/d7/d8/fc [0,4194304] 0 2024-04-26T21:25:43.653 INFO:tasks.workunit.client.1.smithi120.stdout:0/204: creat d0/d3/dc/dd/d1b/d39/f46 x:0 0 0 2024-04-26T21:25:43.657 INFO:tasks.workunit.client.1.smithi120.stdout:4/192: link d10/d12/f18 d10/f44 0 2024-04-26T21:25:43.658 INFO:tasks.workunit.client.0.smithi084.stdout:3/26: dwrite d1/f2 [0,4194304] 0 2024-04-26T21:25:43.658 INFO:tasks.workunit.client.1.smithi120.stdout:0/205: fdatasync d0/d3/dc/f2a 0 2024-04-26T21:25:43.660 INFO:tasks.workunit.client.0.smithi084.stdout:3/27: chown d1/f3 456 1 2024-04-26T21:25:43.663 INFO:tasks.workunit.client.1.smithi120.stdout:7/193: dwrite d7/d10/d12/d1f/f3a [0,4194304] 0 2024-04-26T21:25:43.666 INFO:tasks.workunit.client.1.smithi120.stdout:0/206: creat d0/d3/dc/d12/f47 x:0 0 0 2024-04-26T21:25:43.667 INFO:tasks.workunit.client.1.smithi120.stdout:4/193: rename d10/f44 to d10/d12/f45 0 2024-04-26T21:25:43.676 INFO:tasks.workunit.client.1.smithi120.stdout:4/194: dread d10/d12/f40 [0,4194304] 0 2024-04-26T21:25:43.678 INFO:tasks.workunit.client.1.smithi120.stdout:0/207: creat d0/d3/dc/dd/d1b/f48 x:0 0 0 2024-04-26T21:25:43.678 INFO:tasks.workunit.client.1.smithi120.stdout:7/194: creat d7/d10/d12/d1f/f48 x:0 0 0 2024-04-26T21:25:43.681 INFO:tasks.workunit.client.1.smithi120.stdout:3/127: truncate dd/de/d18/d24/f23 2929007 0 2024-04-26T21:25:43.683 INFO:tasks.workunit.client.1.smithi120.stdout:5/200: truncate d2/dc/fd 1946985 0 2024-04-26T21:25:43.688 INFO:tasks.workunit.client.1.smithi120.stdout:4/195: mknod d10/c46 0 2024-04-26T21:25:43.689 INFO:tasks.workunit.client.1.smithi120.stdout:0/208: symlink d0/d3/dc/dd/l49 0 2024-04-26T21:25:43.691 INFO:tasks.workunit.client.1.smithi120.stdout:4/196: dread - d10/d12/f3c zero size 2024-04-26T21:25:43.691 INFO:tasks.workunit.client.1.smithi120.stdout:2/245: getdents d4/d1b/d25/d2c 0 2024-04-26T21:25:43.693 INFO:tasks.workunit.client.1.smithi120.stdout:0/209: write d0/d3/d13/f20 [2095281,16838] 0 2024-04-26T21:25:43.694 INFO:tasks.workunit.client.1.smithi120.stdout:2/246: chown d4/d1b/l26 57983626 1 2024-04-26T21:25:43.696 INFO:tasks.workunit.client.1.smithi120.stdout:0/210: chown d0/d3/dc/f44 21 1 2024-04-26T21:25:43.698 INFO:tasks.workunit.client.1.smithi120.stdout:7/195: getdents d7 0 2024-04-26T21:25:43.698 INFO:tasks.workunit.client.1.smithi120.stdout:4/197: truncate d10/d12/f2c 650663 0 2024-04-26T21:25:43.699 INFO:tasks.workunit.client.1.smithi120.stdout:8/192: dread d5/d6/fd [0,4194304] 0 2024-04-26T21:25:43.700 INFO:tasks.workunit.client.1.smithi120.stdout:5/201: creat d2/f3d x:0 0 0 2024-04-26T21:25:43.702 INFO:tasks.workunit.client.1.smithi120.stdout:7/196: fdatasync d7/fd 0 2024-04-26T21:25:43.702 INFO:tasks.workunit.client.1.smithi120.stdout:0/211: dread - d0/d3/dc/d12/d31/f33 zero size 2024-04-26T21:25:43.702 INFO:tasks.workunit.client.1.smithi120.stdout:2/247: truncate d4/d1b/d25/d2c/f49 168822 0 2024-04-26T21:25:43.709 INFO:tasks.workunit.client.1.smithi120.stdout:8/193: write d5/d6/d11/d32/f45 [884441,78526] 0 2024-04-26T21:25:43.710 INFO:tasks.workunit.client.1.smithi120.stdout:0/212: mkdir d0/d3/dc/d12/d4a 0 2024-04-26T21:25:43.711 INFO:tasks.workunit.client.1.smithi120.stdout:2/248: fdatasync d4/d1b/d2e/d50/d14/d15/f2d 0 2024-04-26T21:25:43.712 INFO:tasks.workunit.client.1.smithi120.stdout:4/198: fdatasync d10/d12/f18 0 2024-04-26T21:25:43.715 INFO:tasks.workunit.client.1.smithi120.stdout:7/197: truncate d7/d10/d12/d1f/f3a 4737964 0 2024-04-26T21:25:43.716 INFO:tasks.workunit.client.1.smithi120.stdout:0/213: chown d0/d3/dc/dd/f45 74 1 2024-04-26T21:25:43.719 INFO:tasks.workunit.client.1.smithi120.stdout:7/198: dread - d7/d10/d12/d1f/f48 zero size 2024-04-26T21:25:43.724 INFO:tasks.workunit.client.1.smithi120.stdout:4/199: getdents d10/d28 0 2024-04-26T21:25:43.724 INFO:tasks.workunit.client.1.smithi120.stdout:0/214: write d0/d3/dc/f27 [5224880,109239] 0 2024-04-26T21:25:43.726 INFO:tasks.workunit.client.1.smithi120.stdout:2/249: write d4/d1b/d2e/d50/d14/d15/f43 [515450,74531] 0 2024-04-26T21:25:43.727 INFO:tasks.workunit.client.1.smithi120.stdout:3/128: dwrite fa [0,4194304] 0 2024-04-26T21:25:43.731 INFO:tasks.workunit.client.1.smithi120.stdout:5/202: dwrite d2/d30/f2f [0,4194304] 0 2024-04-26T21:25:43.733 INFO:tasks.workunit.client.1.smithi120.stdout:8/194: dread f4 [0,4194304] 0 2024-04-26T21:25:43.735 INFO:tasks.workunit.client.1.smithi120.stdout:7/199: symlink d7/d10/d12/d1a/d33/d34/d37/l49 0 2024-04-26T21:25:43.737 INFO:tasks.workunit.client.1.smithi120.stdout:0/215: chown d0/d3/dc/dd/d1b/f48 338950 1 2024-04-26T21:25:43.739 INFO:tasks.workunit.client.1.smithi120.stdout:8/195: stat d5/d6/d12/f44 0 2024-04-26T21:25:43.741 INFO:tasks.workunit.client.1.smithi120.stdout:2/250: creat d4/d1b/d2e/d50/d14/f59 x:0 0 0 2024-04-26T21:25:43.742 INFO:tasks.workunit.client.1.smithi120.stdout:5/203: creat d2/dc/f3e x:0 0 0 2024-04-26T21:25:43.744 INFO:tasks.workunit.client.1.smithi120.stdout:7/200: mknod d7/d10/c4a 0 2024-04-26T21:25:43.751 INFO:tasks.workunit.client.1.smithi120.stdout:3/129: dread dd/de/d18/d24/f23 [0,4194304] 0 2024-04-26T21:25:43.751 INFO:tasks.workunit.client.1.smithi120.stdout:8/196: unlink d5/d6/d11/l35 0 2024-04-26T21:25:43.751 INFO:tasks.workunit.client.1.smithi120.stdout:7/201: mknod d7/d10/d12/d2f/c4b 0 2024-04-26T21:25:43.753 INFO:tasks.workunit.client.1.smithi120.stdout:2/251: unlink d4/d1b/d2e/d50/d14/d3c/f47 0 2024-04-26T21:25:43.754 INFO:tasks.workunit.client.1.smithi120.stdout:3/130: mkdir dd/de/d18/d2c 0 2024-04-26T21:25:43.754 INFO:tasks.workunit.client.1.smithi120.stdout:7/202: truncate d7/fe 904845 0 2024-04-26T21:25:43.755 INFO:tasks.workunit.client.1.smithi120.stdout:8/197: truncate d5/f15 1372 0 2024-04-26T21:25:43.756 INFO:tasks.workunit.client.1.smithi120.stdout:5/204: rename d2/dc/f3e to d2/f3f 0 2024-04-26T21:25:43.757 INFO:tasks.workunit.client.0.smithi084.stdout:3/28: creat d1/f7 x:0 0 0 2024-04-26T21:25:43.758 INFO:tasks.workunit.client.1.smithi120.stdout:2/252: creat d4/d1b/d56/f5a x:0 0 0 2024-04-26T21:25:43.760 INFO:tasks.workunit.client.0.smithi084.stdout:3/29: creat d1/f8 x:0 0 0 2024-04-26T21:25:43.763 INFO:tasks.workunit.client.1.smithi120.stdout:8/198: rmdir d5/d6/d11/d32 39 2024-04-26T21:25:43.766 INFO:tasks.workunit.client.0.smithi084.stdout:3/30: creat d1/f9 x:0 0 0 2024-04-26T21:25:43.767 INFO:tasks.workunit.client.1.smithi120.stdout:3/131: unlink dd/de/df/d1e/l29 0 2024-04-26T21:25:43.767 INFO:tasks.workunit.client.1.smithi120.stdout:6/167: sync 2024-04-26T21:25:43.768 INFO:tasks.workunit.client.1.smithi120.stdout:0/216: write d0/df/f3f [1378300,117597] 0 2024-04-26T21:25:43.770 INFO:tasks.workunit.client.0.smithi084.stdout:3/31: mknod d1/ca 0 2024-04-26T21:25:43.771 INFO:tasks.workunit.client.0.smithi084.stdout:3/32: fdatasync d1/f8 0 2024-04-26T21:25:43.771 INFO:tasks.workunit.client.1.smithi120.stdout:8/199: dread - d5/d6/d12/f44 zero size 2024-04-26T21:25:43.774 INFO:tasks.workunit.client.1.smithi120.stdout:0/217: chown d0/d3/dc/d12/c26 945788070 1 2024-04-26T21:25:43.775 INFO:tasks.workunit.client.1.smithi120.stdout:8/200: dread - d5/d2e/f3a zero size 2024-04-26T21:25:43.776 INFO:tasks.workunit.client.1.smithi120.stdout:7/203: dread d7/d10/d12/d1a/d33/d34/f38 [0,4194304] 0 2024-04-26T21:25:43.777 INFO:tasks.workunit.client.1.smithi120.stdout:2/253: dread d4/d1b/d25/d29/f37 [0,4194304] 0 2024-04-26T21:25:43.778 INFO:tasks.workunit.client.1.smithi120.stdout:4/200: dread d10/f24 [0,4194304] 0 2024-04-26T21:25:43.780 INFO:tasks.workunit.client.1.smithi120.stdout:6/168: truncate d4/d27/f34 55382 0 2024-04-26T21:25:43.785 INFO:tasks.workunit.client.1.smithi120.stdout:4/201: write d10/d12/f22 [1861193,7165] 0 2024-04-26T21:25:43.785 INFO:tasks.workunit.client.1.smithi120.stdout:3/132: dread f5 [0,4194304] 0 2024-04-26T21:25:43.785 INFO:tasks.workunit.client.1.smithi120.stdout:7/204: mkdir d7/d10/d12/d1f/d28/d4c 0 2024-04-26T21:25:43.787 INFO:tasks.workunit.client.1.smithi120.stdout:6/169: creat d4/db/d10/dd/f36 x:0 0 0 2024-04-26T21:25:43.789 INFO:tasks.workunit.client.1.smithi120.stdout:5/205: truncate d2/db/f27 1880768 0 2024-04-26T21:25:43.792 INFO:tasks.workunit.client.1.smithi120.stdout:5/206: stat d2/d1b/l3a 0 2024-04-26T21:25:43.792 INFO:tasks.workunit.client.1.smithi120.stdout:7/205: fdatasync d7/d10/d12/d1a/f27 0 2024-04-26T21:25:43.794 INFO:tasks.workunit.client.1.smithi120.stdout:6/170: write d4/db/f1b [4769438,130519] 0 2024-04-26T21:25:43.795 INFO:tasks.workunit.client.1.smithi120.stdout:0/218: truncate d0/d3/dc/f2a 762695 0 2024-04-26T21:25:43.799 INFO:tasks.workunit.client.1.smithi120.stdout:3/133: fdatasync dd/de/d18/f22 0 2024-04-26T21:25:43.799 INFO:tasks.workunit.client.1.smithi120.stdout:2/254: link d4/d1b/d25/d2c/f46 d4/d1b/d2e/d50/f5b 0 2024-04-26T21:25:43.801 INFO:tasks.workunit.client.1.smithi120.stdout:5/207: chown d2/dc/d1d/d1f/d34 6 1 2024-04-26T21:25:43.805 INFO:tasks.workunit.client.1.smithi120.stdout:3/134: write f5 [1898335,95399] 0 2024-04-26T21:25:43.807 INFO:tasks.workunit.client.1.smithi120.stdout:8/201: dwrite d5/d6/d11/f10 [0,4194304] 0 2024-04-26T21:25:43.808 INFO:tasks.workunit.client.1.smithi120.stdout:7/206: mknod d7/d10/d12/d1f/d28/c4d 0 2024-04-26T21:25:43.809 INFO:tasks.workunit.client.1.smithi120.stdout:5/208: write d2/d30/f2f [2927568,35667] 0 2024-04-26T21:25:43.813 INFO:tasks.workunit.client.1.smithi120.stdout:2/255: write d4/d1b/d2e/d50/d14/d15/f2d [2560039,65571] 0 2024-04-26T21:25:43.814 INFO:tasks.workunit.client.1.smithi120.stdout:5/209: chown d2/db/f16 112408698 1 2024-04-26T21:25:43.818 INFO:tasks.workunit.client.0.smithi084.stdout:3/33: rmdir d1 39 2024-04-26T21:25:43.821 INFO:tasks.workunit.client.0.smithi084.stdout:2/34: dwrite f0 [0,4194304] 0 2024-04-26T21:25:43.822 INFO:tasks.workunit.client.1.smithi120.stdout:4/202: dwrite d10/d12/f14 [0,4194304] 0 2024-04-26T21:25:43.822 INFO:tasks.workunit.client.1.smithi120.stdout:2/256: chown d4/c42 0 1 2024-04-26T21:25:43.822 INFO:tasks.workunit.client.1.smithi120.stdout:3/135: getdents dd/de/d18/d24 0 2024-04-26T21:25:43.828 INFO:tasks.workunit.client.0.smithi084.stdout:3/34: symlink d1/lb 0 2024-04-26T21:25:43.828 INFO:tasks.workunit.client.0.smithi084.stdout:2/35: mkdir d6/df 0 2024-04-26T21:25:43.828 INFO:tasks.workunit.client.1.smithi120.stdout:6/171: dwrite d4/db/d10/dd/f18 [0,4194304] 0 2024-04-26T21:25:43.829 INFO:tasks.workunit.client.1.smithi120.stdout:4/203: fsync d10/d12/f43 0 2024-04-26T21:25:43.829 INFO:tasks.workunit.client.1.smithi120.stdout:8/202: link d5/d6/c2c d5/d6/d11/d32/d3b/c48 0 2024-04-26T21:25:43.830 INFO:tasks.workunit.client.0.smithi084.stdout:3/35: read - d1/f7 zero size 2024-04-26T21:25:43.830 INFO:tasks.workunit.client.1.smithi120.stdout:5/210: creat d2/dc/d1d/d1f/d36/f40 x:0 0 0 2024-04-26T21:25:43.830 INFO:tasks.workunit.client.1.smithi120.stdout:6/172: chown f1 43617 1 2024-04-26T21:25:43.831 INFO:tasks.workunit.client.0.smithi084.stdout:2/36: write d6/d7/fb [917425,28575] 0 2024-04-26T21:25:43.835 INFO:tasks.workunit.client.0.smithi084.stdout:2/37: mkdir d6/d7/d10 0 2024-04-26T21:25:43.840 INFO:tasks.workunit.client.1.smithi120.stdout:6/173: mknod d4/db/c37 0 2024-04-26T21:25:43.840 INFO:tasks.workunit.client.1.smithi120.stdout:5/211: creat d2/db/f41 x:0 0 0 2024-04-26T21:25:43.844 INFO:tasks.workunit.client.0.smithi084.stdout:2/38: rmdir d6/df 0 2024-04-26T21:25:43.846 INFO:tasks.workunit.client.1.smithi120.stdout:2/257: rename d4/d1b/d2e/d50/d54 to d4/d1b/d5c 0 2024-04-26T21:25:43.846 INFO:tasks.workunit.client.1.smithi120.stdout:5/212: fsync d2/d1b/f26 0 2024-04-26T21:25:43.847 INFO:tasks.workunit.client.0.smithi084.stdout:2/39: write d6/d7/d8/fc [2261785,108184] 0 2024-04-26T21:25:43.856 INFO:tasks.workunit.client.1.smithi120.stdout:5/213: fdatasync d2/db/f14 0 2024-04-26T21:25:43.859 INFO:tasks.workunit.client.1.smithi120.stdout:3/136: dwrite fa [4194304,4194304] 0 2024-04-26T21:25:43.859 INFO:tasks.workunit.client.1.smithi120.stdout:2/258: readlink d4/d1b/d2e/d50/d14/l2f 0 2024-04-26T21:25:43.860 INFO:tasks.workunit.client.1.smithi120.stdout:8/203: dwrite d5/d6/f1f [4194304,4194304] 0 2024-04-26T21:25:43.862 INFO:tasks.workunit.client.0.smithi084.stdout:2/40: getdents d6/d7 0 2024-04-26T21:25:43.865 INFO:tasks.workunit.client.0.smithi084.stdout:2/41: read d6/d7/d8/fc [3113204,73441] 0 2024-04-26T21:25:43.868 INFO:tasks.workunit.client.1.smithi120.stdout:5/214: link d2/f3d d2/d1b/d22/f42 0 2024-04-26T21:25:43.869 INFO:tasks.workunit.client.0.smithi084.stdout:2/42: mknod d6/d7/d8/c11 0 2024-04-26T21:25:43.871 INFO:tasks.workunit.client.1.smithi120.stdout:6/174: dread d4/db/d10/dd/f18 [0,4194304] 0 2024-04-26T21:25:43.872 INFO:tasks.workunit.client.0.smithi084.stdout:2/43: write d6/d7/d8/fc [3357624,19573] 0 2024-04-26T21:25:43.872 INFO:tasks.workunit.client.1.smithi120.stdout:3/137: dread dd/de/d18/f25 [0,4194304] 0 2024-04-26T21:25:43.873 INFO:tasks.workunit.client.1.smithi120.stdout:6/175: stat d4/db/f35 0 2024-04-26T21:25:43.875 INFO:tasks.workunit.client.1.smithi120.stdout:8/204: unlink d5/d6/d34/l3e 0 2024-04-26T21:25:43.876 INFO:tasks.workunit.client.0.smithi084.stdout:2/44: write d6/d7/d8/fc [4649478,122176] 0 2024-04-26T21:25:43.876 INFO:tasks.workunit.client.1.smithi120.stdout:3/138: chown dd/de/df/d12/l1b 748 1 2024-04-26T21:25:43.876 INFO:tasks.workunit.client.1.smithi120.stdout:2/259: read d4/d1b/d2e/d50/d14/d15/f43 [606497,64672] 0 2024-04-26T21:25:43.877 INFO:tasks.workunit.client.1.smithi120.stdout:5/215: mknod d2/dc/d1d/d2e/c43 0 2024-04-26T21:25:43.877 INFO:tasks.workunit.client.0.smithi084.stdout:2/45: read - d6/d7/d8/fe zero size 2024-04-26T21:25:43.879 INFO:tasks.workunit.client.1.smithi120.stdout:3/139: write fa [6237185,120486] 0 2024-04-26T21:25:43.887 INFO:tasks.workunit.client.1.smithi120.stdout:6/176: dread f1 [0,4194304] 0 2024-04-26T21:25:43.889 INFO:tasks.workunit.client.1.smithi120.stdout:6/177: chown d4/db/d10/d1a 647 1 2024-04-26T21:25:43.891 INFO:tasks.workunit.client.1.smithi120.stdout:8/205: getdents d5/d6/d12 0 2024-04-26T21:25:43.892 INFO:tasks.workunit.client.1.smithi120.stdout:2/260: write d4/d1b/f41 [607823,1300] 0 2024-04-26T21:25:43.893 INFO:tasks.workunit.client.1.smithi120.stdout:5/216: truncate d2/dc/d1d/d1f/f2c 101280 0 2024-04-26T21:25:43.893 INFO:tasks.workunit.client.0.smithi084.stdout:2/46: dread d6/d7/d8/fc [0,4194304] 0 2024-04-26T21:25:43.896 INFO:tasks.workunit.client.0.smithi084.stdout:2/47: creat d6/f12 x:0 0 0 2024-04-26T21:25:43.897 INFO:tasks.workunit.client.0.smithi084.stdout:2/48: readlink d6/d7/ld 0 2024-04-26T21:25:43.897 INFO:tasks.workunit.client.1.smithi120.stdout:2/261: symlink d4/d1b/d4f/l5d 0 2024-04-26T21:25:43.898 INFO:tasks.workunit.client.1.smithi120.stdout:8/206: creat d5/d6/d34/d42/f49 x:0 0 0 2024-04-26T21:25:43.899 INFO:tasks.workunit.client.1.smithi120.stdout:6/178: link d4/db/d10/ca d4/db/d10/d1a/c38 0 2024-04-26T21:25:43.899 INFO:tasks.workunit.client.0.smithi084.stdout:2/49: symlink d6/d7/l13 0 2024-04-26T21:25:43.900 INFO:tasks.workunit.client.1.smithi120.stdout:6/179: fsync d4/f31 0 2024-04-26T21:25:43.901 INFO:tasks.workunit.client.1.smithi120.stdout:3/140: dwrite dd/de/d18/d24/f23 [0,4194304] 0 2024-04-26T21:25:43.901 INFO:tasks.workunit.client.1.smithi120.stdout:2/262: mkdir d4/d1b/d25/d2c/d3e/d5e 0 2024-04-26T21:25:43.903 INFO:tasks.workunit.client.1.smithi120.stdout:8/207: mkdir d5/d6/d34/d42/d4a 0 2024-04-26T21:25:43.904 INFO:tasks.workunit.client.1.smithi120.stdout:3/141: dread - dd/de/df/d12/f21 zero size 2024-04-26T21:25:43.907 INFO:tasks.workunit.client.1.smithi120.stdout:2/263: mkdir d4/d1b/d2e/d5f 0 2024-04-26T21:25:43.911 INFO:tasks.workunit.client.1.smithi120.stdout:6/180: symlink d4/db/d10/dd/d28/l39 0 2024-04-26T21:25:43.911 INFO:tasks.workunit.client.1.smithi120.stdout:5/217: dwrite d2/db/f16 [0,4194304] 0 2024-04-26T21:25:43.912 INFO:tasks.workunit.client.1.smithi120.stdout:6/181: write d4/f14 [4319158,69483] 0 2024-04-26T21:25:43.916 INFO:tasks.workunit.client.1.smithi120.stdout:3/142: dread f5 [0,4194304] 0 2024-04-26T21:25:43.917 INFO:tasks.workunit.client.1.smithi120.stdout:6/182: chown d4/c2f 460514663 1 2024-04-26T21:25:43.919 INFO:tasks.workunit.client.0.smithi084.stdout:2/50: dwrite d6/d7/d8/fc [0,4194304] 0 2024-04-26T21:25:43.920 INFO:tasks.workunit.client.1.smithi120.stdout:3/143: write dd/de/d18/d24/f23 [4086900,102927] 0 2024-04-26T21:25:43.921 INFO:tasks.workunit.client.1.smithi120.stdout:6/183: write d4/db/fe [4888535,170] 0 2024-04-26T21:25:43.924 INFO:tasks.workunit.client.0.smithi084.stdout:2/51: creat d6/f14 x:0 0 0 2024-04-26T21:25:43.927 INFO:tasks.workunit.client.1.smithi120.stdout:3/144: rename f9 to dd/de/df/d1e/d28/f2d 0 2024-04-26T21:25:43.939 INFO:tasks.workunit.client.1.smithi120.stdout:2/264: truncate d4/d1b/d2e/d50/f3f 4046331 0 2024-04-26T21:25:43.939 INFO:tasks.workunit.client.1.smithi120.stdout:5/218: truncate d2/d1b/d29/f2a 8226414 0 2024-04-26T21:25:43.941 INFO:tasks.workunit.client.1.smithi120.stdout:6/184: dwrite d4/db/d10/f15 [0,4194304] 0 2024-04-26T21:25:43.946 INFO:tasks.workunit.client.1.smithi120.stdout:5/219: mkdir d2/dc/d1d/d1f/d36/d44 0 2024-04-26T21:25:43.946 INFO:tasks.workunit.client.0.smithi084.stdout:2/52: dwrite d6/d7/fb [0,4194304] 0 2024-04-26T21:25:43.947 INFO:tasks.workunit.client.1.smithi120.stdout:8/208: dread d5/d6/f1e [0,4194304] 0 2024-04-26T21:25:43.949 INFO:tasks.workunit.client.1.smithi120.stdout:5/220: truncate d2/d1b/f26 4849230 0 2024-04-26T21:25:43.954 INFO:tasks.workunit.client.0.smithi084.stdout:2/53: mkdir d6/d7/d10/d15 0 2024-04-26T21:25:43.955 INFO:tasks.workunit.client.1.smithi120.stdout:5/221: read - d2/d1b/d22/f42 zero size 2024-04-26T21:25:43.959 INFO:tasks.workunit.client.1.smithi120.stdout:8/209: unlink d5/f29 0 2024-04-26T21:25:43.961 INFO:tasks.workunit.client.0.smithi084.stdout:2/54: fsync d6/f12 0 2024-04-26T21:25:43.962 INFO:tasks.workunit.client.1.smithi120.stdout:6/185: dwrite d4/d27/f32 [0,4194304] 0 2024-04-26T21:25:43.966 INFO:tasks.workunit.client.1.smithi120.stdout:8/210: creat d5/d18/f4b x:0 0 0 2024-04-26T21:25:43.967 INFO:tasks.workunit.client.1.smithi120.stdout:5/222: link d2/f17 d2/dc/d1d/d21/f45 0 2024-04-26T21:25:43.970 INFO:tasks.workunit.client.1.smithi120.stdout:6/186: mknod d4/c3a 0 2024-04-26T21:25:43.971 INFO:tasks.workunit.client.1.smithi120.stdout:2/265: dwrite d4/d1b/d25/d2c/f46 [0,4194304] 0 2024-04-26T21:25:43.974 INFO:tasks.workunit.client.1.smithi120.stdout:6/187: write d4/db/d10/f15 [4682897,119082] 0 2024-04-26T21:25:43.974 INFO:tasks.workunit.client.1.smithi120.stdout:8/211: fdatasync d5/f30 0 2024-04-26T21:25:43.975 INFO:tasks.workunit.client.1.smithi120.stdout:2/266: write d4/d1b/d2e/d50/f5b [755286,64229] 0 2024-04-26T21:25:43.979 INFO:tasks.workunit.client.1.smithi120.stdout:6/188: fsync d4/db/d10/dd/f36 0 2024-04-26T21:25:43.979 INFO:tasks.workunit.client.1.smithi120.stdout:6/189: dread - d4/d27/f2e zero size 2024-04-26T21:25:43.981 INFO:tasks.workunit.client.0.smithi084.stdout:2/55: dread d6/d7/fb [0,4194304] 0 2024-04-26T21:25:43.982 INFO:tasks.workunit.client.0.smithi084.stdout:2/56: chown c1 128031361 1 2024-04-26T21:25:43.984 INFO:tasks.workunit.client.1.smithi120.stdout:8/212: mknod d5/d2e/c4c 0 2024-04-26T21:25:43.986 INFO:tasks.workunit.client.1.smithi120.stdout:8/213: fsync d5/d6/d34/d42/f49 0 2024-04-26T21:25:43.987 INFO:tasks.workunit.client.1.smithi120.stdout:8/214: chown d5/d18/f22 81 1 2024-04-26T21:25:43.989 INFO:tasks.workunit.client.1.smithi120.stdout:8/215: chown d5/d18/f41 4156 1 2024-04-26T21:25:43.991 INFO:tasks.workunit.client.1.smithi120.stdout:2/267: dwrite d4/d1b/d2e/d50/d14/d15/f45 [0,4194304] 0 2024-04-26T21:25:43.994 INFO:tasks.workunit.client.1.smithi120.stdout:8/216: rename d5/d6/fd to d5/d6/d11/d32/d3b/f4d 0 2024-04-26T21:25:43.996 INFO:tasks.workunit.client.1.smithi120.stdout:2/268: creat d4/d1b/d2e/d50/d14/d3c/f60 x:0 0 0 2024-04-26T21:25:43.997 INFO:tasks.workunit.client.1.smithi120.stdout:8/217: mknod d5/d18/c4e 0 2024-04-26T21:25:43.998 INFO:tasks.workunit.client.1.smithi120.stdout:2/269: rmdir d4 39 2024-04-26T21:25:43.999 INFO:tasks.workunit.client.1.smithi120.stdout:5/223: truncate d2/d1b/f26 379423 0 2024-04-26T21:25:44.000 INFO:tasks.workunit.client.0.smithi084.stdout:2/57: dwrite d6/d7/fb [0,4194304] 0 2024-04-26T21:25:44.004 INFO:tasks.workunit.client.1.smithi120.stdout:2/270: unlink d4/d1b/d2e/l48 0 2024-04-26T21:25:44.009 INFO:tasks.workunit.client.0.smithi084.stdout:2/58: unlink l5 0 2024-04-26T21:25:44.010 INFO:tasks.workunit.client.1.smithi120.stdout:2/271: write d4/d1b/d2e/d50/d14/d15/f45 [857930,70447] 0 2024-04-26T21:25:44.012 INFO:tasks.workunit.client.1.smithi120.stdout:8/218: rmdir d5/d18 39 2024-04-26T21:25:44.016 INFO:tasks.workunit.client.1.smithi120.stdout:8/219: truncate d5/d6/f1e 4071558 0 2024-04-26T21:25:44.018 INFO:tasks.workunit.client.1.smithi120.stdout:2/272: getdents d4/d1b/d2e/d50/d14 0 2024-04-26T21:25:44.023 INFO:tasks.workunit.client.1.smithi120.stdout:2/273: rename d4/d1b/d25/d2c/ff to d4/d1b/d25/d2c/d3e/d5e/f61 0 2024-04-26T21:25:44.025 INFO:tasks.workunit.client.0.smithi084.stdout:2/59: dwrite d6/d7/fb [0,4194304] 0 2024-04-26T21:25:44.028 INFO:tasks.workunit.client.0.smithi084.stdout:2/60: write d6/f14 [381354,27051] 0 2024-04-26T21:25:44.030 INFO:tasks.workunit.client.1.smithi120.stdout:2/274: rmdir d4/d1b/d4f/d55 0 2024-04-26T21:25:44.032 INFO:tasks.workunit.client.0.smithi084.stdout:2/61: chown d6/c9 5876309 1 2024-04-26T21:25:44.035 INFO:tasks.workunit.client.0.smithi084.stdout:2/62: symlink d6/d7/d8/l16 0 2024-04-26T21:25:44.039 INFO:tasks.workunit.client.1.smithi120.stdout:8/220: dread d5/d6/d11/f2a [0,4194304] 0 2024-04-26T21:25:44.041 INFO:tasks.workunit.client.1.smithi120.stdout:8/221: chown d5/d6/d12/d27/f33 1472 1 2024-04-26T21:25:44.048 INFO:tasks.workunit.client.0.smithi084.stdout:2/63: dwrite f0 [0,4194304] 0 2024-04-26T21:25:44.058 INFO:tasks.workunit.client.0.smithi084.stdout:2/64: dread d6/d7/fb [0,4194304] 0 2024-04-26T21:25:44.061 INFO:tasks.workunit.client.0.smithi084.stdout:2/65: symlink d6/d7/l17 0 2024-04-26T21:25:44.062 INFO:tasks.workunit.client.0.smithi084.stdout:2/66: read d6/d7/fb [2670049,18338] 0 2024-04-26T21:25:44.064 INFO:tasks.workunit.client.0.smithi084.stdout:2/67: write f0 [4311991,43491] 0 2024-04-26T21:25:44.080 INFO:tasks.workunit.client.0.smithi084.stdout:2/68: dwrite d6/d7/d8/fe [0,4194304] 0 2024-04-26T21:25:44.081 INFO:tasks.workunit.client.0.smithi084.stdout:2/69: fsync d6/f12 0 2024-04-26T21:25:44.104 INFO:tasks.workunit.client.0.smithi084.stdout:2/70: dwrite d6/f12 [0,4194304] 0 2024-04-26T21:25:44.117 INFO:tasks.workunit.client.0.smithi084.stdout:2/71: dread d6/d7/d8/fe [0,4194304] 0 2024-04-26T21:25:44.122 INFO:tasks.workunit.client.0.smithi084.stdout:2/72: symlink d6/d7/d10/d15/l18 0 2024-04-26T21:25:44.127 INFO:tasks.workunit.client.0.smithi084.stdout:2/73: fdatasync d6/f12 0 2024-04-26T21:25:44.130 INFO:tasks.workunit.client.0.smithi084.stdout:2/74: rmdir d6/d7/d8 39 2024-04-26T21:25:44.130 INFO:tasks.workunit.client.1.smithi120.stdout:9/134: sync 2024-04-26T21:25:44.130 INFO:tasks.workunit.client.1.smithi120.stdout:1/175: sync 2024-04-26T21:25:44.133 INFO:tasks.workunit.client.1.smithi120.stdout:1/176: read d6/d14/f16 [332336,61529] 0 2024-04-26T21:25:44.137 INFO:tasks.workunit.client.1.smithi120.stdout:1/177: creat d6/f3a x:0 0 0 2024-04-26T21:25:44.140 INFO:tasks.workunit.client.1.smithi120.stdout:1/178: write d6/d7/d1d/f20 [1017009,87647] 0 2024-04-26T21:25:44.143 INFO:tasks.workunit.client.1.smithi120.stdout:1/179: mkdir d6/d7/d1b/d3b 0 2024-04-26T21:25:44.145 INFO:tasks.workunit.client.1.smithi120.stdout:1/180: dread - d6/d7/d2d/f34 zero size 2024-04-26T21:25:44.152 INFO:tasks.workunit.client.0.smithi084.stdout:2/75: dwrite d6/f14 [0,4194304] 0 2024-04-26T21:25:44.161 INFO:tasks.workunit.client.0.smithi084.stdout:2/76: rename d6/d7/d10 to d6/d19 0 2024-04-26T21:25:44.167 INFO:tasks.workunit.client.0.smithi084.stdout:2/77: read d6/d7/d8/fc [587843,60653] 0 2024-04-26T21:25:44.168 INFO:tasks.workunit.client.0.smithi084.stdout:2/78: chown d6/d19/d15 479964 1 2024-04-26T21:25:44.169 INFO:tasks.workunit.client.1.smithi120.stdout:9/135: dread d0/fa [0,4194304] 0 2024-04-26T21:25:44.173 INFO:tasks.workunit.client.1.smithi120.stdout:9/136: mknod d0/d6/c2b 0 2024-04-26T21:25:44.176 INFO:tasks.workunit.client.1.smithi120.stdout:1/181: dwrite d6/d9/f1c [4194304,4194304] 0 2024-04-26T21:25:44.177 INFO:tasks.workunit.client.1.smithi120.stdout:9/137: symlink d0/dd/l2c 0 2024-04-26T21:25:44.179 INFO:tasks.workunit.client.1.smithi120.stdout:1/182: mkdir d6/d14/d3c 0 2024-04-26T21:25:44.183 INFO:tasks.workunit.client.1.smithi120.stdout:1/183: creat d6/d7/d1b/f3d x:0 0 0 2024-04-26T21:25:44.184 INFO:tasks.workunit.client.1.smithi120.stdout:9/138: getdents d0/d14 0 2024-04-26T21:25:44.186 INFO:tasks.workunit.client.1.smithi120.stdout:1/184: chown d6/d7/d1b/d3b 5673186 1 2024-04-26T21:25:44.208 INFO:tasks.workunit.client.1.smithi120.stdout:1/185: dwrite d6/f15 [0,4194304] 0 2024-04-26T21:25:44.213 INFO:tasks.workunit.client.1.smithi120.stdout:9/139: dwrite d0/f1 [0,4194304] 0 2024-04-26T21:25:44.218 INFO:tasks.workunit.client.1.smithi120.stdout:9/140: mkdir d0/d14/d2d 0 2024-04-26T21:25:44.225 INFO:tasks.workunit.client.0.smithi084.stdout:2/79: creat d6/d19/d15/f1a x:0 0 0 2024-04-26T21:25:44.226 INFO:tasks.workunit.client.1.smithi120.stdout:9/141: stat d0/l22 0 2024-04-26T21:25:44.229 INFO:tasks.workunit.client.1.smithi120.stdout:9/142: fsync d0/fa 0 2024-04-26T21:25:44.234 INFO:tasks.workunit.client.1.smithi120.stdout:9/143: creat d0/f2e x:0 0 0 2024-04-26T21:25:44.234 INFO:tasks.workunit.client.1.smithi120.stdout:1/186: dwrite d6/d7/ff [0,4194304] 0 2024-04-26T21:25:44.237 INFO:tasks.workunit.client.1.smithi120.stdout:9/144: creat d0/d14/d2d/f2f x:0 0 0 2024-04-26T21:25:44.238 INFO:tasks.workunit.client.1.smithi120.stdout:1/187: symlink d6/d7/da/dd/l3e 0 2024-04-26T21:25:44.238 INFO:tasks.workunit.client.1.smithi120.stdout:9/145: chown d0/d14/f24 60858774 1 2024-04-26T21:25:44.240 INFO:tasks.workunit.client.1.smithi120.stdout:1/188: read d6/d7/d1d/f20 [755584,91274] 0 2024-04-26T21:25:44.249 INFO:tasks.workunit.client.1.smithi120.stdout:0/219: sync 2024-04-26T21:25:44.251 INFO:tasks.workunit.client.1.smithi120.stdout:9/146: getdents d0/dd 0 2024-04-26T21:25:44.252 INFO:tasks.workunit.client.0.smithi084.stdout:2/80: dwrite d6/f12 [0,4194304] 0 2024-04-26T21:25:44.257 INFO:tasks.workunit.client.1.smithi120.stdout:1/189: dread d6/f15 [0,4194304] 0 2024-04-26T21:25:44.261 INFO:tasks.workunit.client.1.smithi120.stdout:1/190: symlink d6/l3f 0 2024-04-26T21:25:44.264 INFO:tasks.workunit.client.1.smithi120.stdout:1/191: mknod d6/d9/c40 0 2024-04-26T21:25:44.266 INFO:tasks.workunit.client.1.smithi120.stdout:9/147: dread d0/d6/f8 [0,4194304] 0 2024-04-26T21:25:44.267 INFO:tasks.workunit.client.1.smithi120.stdout:1/192: write d6/f15 [3249736,84858] 0 2024-04-26T21:25:44.268 INFO:tasks.workunit.client.1.smithi120.stdout:0/220: dwrite d0/d3/dc/f27 [0,4194304] 0 2024-04-26T21:25:44.273 INFO:tasks.workunit.client.1.smithi120.stdout:9/148: mknod d0/dd/c30 0 2024-04-26T21:25:44.280 INFO:tasks.workunit.client.1.smithi120.stdout:1/193: dread d6/f15 [0,4194304] 0 2024-04-26T21:25:44.281 INFO:tasks.workunit.client.1.smithi120.stdout:1/194: stat d6/d7/d1d 0 2024-04-26T21:25:44.282 INFO:tasks.workunit.client.1.smithi120.stdout:0/221: rmdir d0/d3/dc/dd 39 2024-04-26T21:25:44.283 INFO:tasks.workunit.client.1.smithi120.stdout:0/222: chown d0/c17 30 1 2024-04-26T21:25:44.283 INFO:tasks.workunit.client.1.smithi120.stdout:9/149: dread d0/f1 [0,4194304] 0 2024-04-26T21:25:44.285 INFO:tasks.workunit.client.1.smithi120.stdout:9/150: write d0/f2e [415126,19718] 0 2024-04-26T21:25:44.287 INFO:tasks.workunit.client.1.smithi120.stdout:9/151: write d0/dd/f12 [303819,116826] 0 2024-04-26T21:25:44.288 INFO:tasks.workunit.client.1.smithi120.stdout:0/223: mkdir d0/d3/dc/dd/d4b 0 2024-04-26T21:25:44.289 INFO:tasks.workunit.client.1.smithi120.stdout:0/224: readlink d0/d3/dc/d12/l25 0 2024-04-26T21:25:44.291 INFO:tasks.workunit.client.1.smithi120.stdout:9/152: symlink d0/dd/l31 0 2024-04-26T21:25:44.293 INFO:tasks.workunit.client.1.smithi120.stdout:0/225: symlink d0/d3/dc/dd/d1b/d39/l4c 0 2024-04-26T21:25:44.328 INFO:tasks.workunit.client.1.smithi120.stdout:9/153: symlink d0/d14/l32 0 2024-04-26T21:25:44.330 INFO:tasks.workunit.client.1.smithi120.stdout:0/226: truncate d0/d3/f9 5141815 0 2024-04-26T21:25:44.340 INFO:tasks.workunit.client.1.smithi120.stdout:0/227: dread d0/df/f3f [0,4194304] 0 2024-04-26T21:25:44.342 INFO:tasks.workunit.client.1.smithi120.stdout:9/154: truncate d0/f2e 343304 0 2024-04-26T21:25:44.355 INFO:tasks.workunit.client.1.smithi120.stdout:7/207: sync 2024-04-26T21:25:44.371 INFO:tasks.workunit.client.1.smithi120.stdout:9/155: rename d0/dd/cc to d0/d14/c33 0 2024-04-26T21:25:44.371 INFO:tasks.workunit.client.1.smithi120.stdout:7/208: mkdir d7/d10/d12/d4e 0 2024-04-26T21:25:44.372 INFO:tasks.workunit.client.1.smithi120.stdout:0/228: dwrite d0/d3/d13/f1f [0,4194304] 0 2024-04-26T21:25:44.382 INFO:tasks.workunit.client.1.smithi120.stdout:9/156: write d0/f1 [4414819,84459] 0 2024-04-26T21:25:44.384 INFO:tasks.workunit.client.1.smithi120.stdout:0/229: creat d0/d3/dc/d12/d4a/f4d x:0 0 0 2024-04-26T21:25:44.389 INFO:tasks.workunit.client.1.smithi120.stdout:9/157: read - d0/d14/d2d/f2f zero size 2024-04-26T21:25:44.392 INFO:tasks.workunit.client.1.smithi120.stdout:9/158: readlink d0/d6/l7 0 2024-04-26T21:25:44.393 INFO:tasks.workunit.client.1.smithi120.stdout:0/230: chown d0/d3/dc/d12/f1a 101 1 2024-04-26T21:25:44.397 INFO:tasks.workunit.client.1.smithi120.stdout:9/159: read d0/f18 [1714071,13989] 0 2024-04-26T21:25:44.403 INFO:tasks.workunit.client.1.smithi120.stdout:9/160: mkdir d0/dd/d34 0 2024-04-26T21:25:44.411 INFO:tasks.workunit.client.1.smithi120.stdout:9/161: creat d0/d14/f35 x:0 0 0 2024-04-26T21:25:44.421 INFO:tasks.workunit.client.1.smithi120.stdout:3/145: sync 2024-04-26T21:25:44.421 INFO:tasks.workunit.client.1.smithi120.stdout:6/190: sync 2024-04-26T21:25:44.422 INFO:tasks.workunit.client.1.smithi120.stdout:5/224: sync 2024-04-26T21:25:44.422 INFO:tasks.workunit.client.1.smithi120.stdout:1/195: sync 2024-04-26T21:25:44.422 INFO:tasks.workunit.client.1.smithi120.stdout:2/275: sync 2024-04-26T21:25:44.422 INFO:tasks.workunit.client.1.smithi120.stdout:8/222: sync 2024-04-26T21:25:44.422 INFO:tasks.workunit.client.1.smithi120.stdout:4/204: sync 2024-04-26T21:25:44.427 INFO:tasks.workunit.client.1.smithi120.stdout:1/196: write d6/f3a [237610,107853] 0 2024-04-26T21:25:44.427 INFO:tasks.workunit.client.1.smithi120.stdout:6/191: write d4/db/fe [1383472,120503] 0 2024-04-26T21:25:44.429 INFO:tasks.workunit.client.1.smithi120.stdout:3/146: creat dd/de/f2e x:0 0 0 2024-04-26T21:25:44.430 INFO:tasks.workunit.client.1.smithi120.stdout:1/197: read d6/f15 [1704200,8995] 0 2024-04-26T21:25:44.432 INFO:tasks.workunit.client.1.smithi120.stdout:6/192: truncate d4/d27/f2e 1043637 0 2024-04-26T21:25:44.433 INFO:tasks.workunit.client.1.smithi120.stdout:7/209: dread d7/d10/d12/f1d [0,4194304] 0 2024-04-26T21:25:44.433 INFO:tasks.workunit.client.1.smithi120.stdout:1/198: chown d6/d14/l32 406722606 1 2024-04-26T21:25:44.435 INFO:tasks.workunit.client.1.smithi120.stdout:8/223: mkdir d5/d6/d12/d27/d4f 0 2024-04-26T21:25:44.437 INFO:tasks.workunit.client.1.smithi120.stdout:0/231: dread d0/d3/d13/f20 [0,4194304] 0 2024-04-26T21:25:44.437 INFO:tasks.workunit.client.1.smithi120.stdout:6/193: creat d4/db/d10/f3b x:0 0 0 2024-04-26T21:25:44.443 INFO:tasks.workunit.client.1.smithi120.stdout:3/147: dread f5 [0,4194304] 0 2024-04-26T21:25:44.444 INFO:tasks.workunit.client.1.smithi120.stdout:4/205: rename d10/d12/f2a to d10/f47 0 2024-04-26T21:25:44.444 INFO:tasks.workunit.client.1.smithi120.stdout:6/194: mknod d4/d27/c3c 0 2024-04-26T21:25:44.448 INFO:tasks.workunit.client.1.smithi120.stdout:0/232: creat d0/d3/f4e x:0 0 0 2024-04-26T21:25:44.454 INFO:tasks.workunit.client.1.smithi120.stdout:2/276: dwrite d4/d1b/d25/d2c/f22 [4194304,4194304] 0 2024-04-26T21:25:44.460 INFO:tasks.workunit.client.1.smithi120.stdout:2/277: write d4/d1b/d56/f4a [1021273,113214] 0 2024-04-26T21:25:44.463 INFO:tasks.workunit.client.1.smithi120.stdout:0/233: write d0/d3/d13/f20 [3510152,34787] 0 2024-04-26T21:25:44.466 INFO:tasks.workunit.client.1.smithi120.stdout:7/210: dwrite d7/d19/f44 [0,4194304] 0 2024-04-26T21:25:44.473 INFO:tasks.workunit.client.1.smithi120.stdout:8/224: dwrite f4 [0,4194304] 0 2024-04-26T21:25:44.476 INFO:tasks.workunit.client.1.smithi120.stdout:2/278: symlink d4/d1b/d2e/d50/l62 0 2024-04-26T21:25:44.480 INFO:tasks.workunit.client.1.smithi120.stdout:7/211: rmdir d7/d10/d12/d1a/d33/d34 39 2024-04-26T21:25:44.480 INFO:tasks.workunit.client.1.smithi120.stdout:5/225: dread d2/fa [0,4194304] 0 2024-04-26T21:25:44.485 INFO:tasks.workunit.client.1.smithi120.stdout:0/234: link d0/d3/d13/f1f d0/d3/f4f 0 2024-04-26T21:25:44.486 INFO:tasks.workunit.client.1.smithi120.stdout:2/279: mkdir d4/d1b/d25/d2c/d3e/d5e/d63 0 2024-04-26T21:25:44.486 INFO:tasks.workunit.client.1.smithi120.stdout:3/148: dwrite dd/de/df/d12/f21 [0,4194304] 0 2024-04-26T21:25:44.487 INFO:tasks.workunit.client.1.smithi120.stdout:8/225: chown d5/d6/l9 159254425 1 2024-04-26T21:25:44.489 INFO:tasks.workunit.client.1.smithi120.stdout:1/199: dread d6/d7/da/fb [0,4194304] 0 2024-04-26T21:25:44.490 INFO:tasks.workunit.client.1.smithi120.stdout:2/280: fsync d4/f34 0 2024-04-26T21:25:44.490 INFO:tasks.workunit.client.1.smithi120.stdout:6/195: dwrite d4/db/d10/f15 [4194304,4194304] 0 2024-04-26T21:25:44.492 INFO:tasks.workunit.client.1.smithi120.stdout:5/226: symlink d2/dc/d1d/d21/l46 0 2024-04-26T21:25:44.494 INFO:tasks.workunit.client.1.smithi120.stdout:1/200: fsync d6/d7/ff 0 2024-04-26T21:25:44.495 INFO:tasks.workunit.client.1.smithi120.stdout:0/235: fsync d0/d3/dc/f44 0 2024-04-26T21:25:44.495 INFO:tasks.workunit.client.1.smithi120.stdout:2/281: write d4/d1b/d2e/f35 [489569,29347] 0 2024-04-26T21:25:44.499 INFO:tasks.workunit.client.1.smithi120.stdout:8/226: unlink d5/d18/f41 0 2024-04-26T21:25:44.501 INFO:tasks.workunit.client.1.smithi120.stdout:6/196: mkdir d4/d3d 0 2024-04-26T21:25:44.503 INFO:tasks.workunit.client.1.smithi120.stdout:0/236: creat d0/d3/dc/dd/d1b/d39/f50 x:0 0 0 2024-04-26T21:25:44.506 INFO:tasks.workunit.client.1.smithi120.stdout:1/201: symlink d6/l41 0 2024-04-26T21:25:44.507 INFO:tasks.workunit.client.1.smithi120.stdout:0/237: dread - d0/d3/f41 zero size 2024-04-26T21:25:44.508 INFO:tasks.workunit.client.1.smithi120.stdout:6/197: rename d4/db/l20 to d4/d27/l3e 0 2024-04-26T21:25:44.510 INFO:tasks.workunit.client.1.smithi120.stdout:8/227: symlink d5/d6/l50 0 2024-04-26T21:25:44.513 INFO:tasks.workunit.client.1.smithi120.stdout:0/238: mkdir d0/d3/d51 0 2024-04-26T21:25:44.515 INFO:tasks.workunit.client.1.smithi120.stdout:6/198: readlink d4/db/d10/d22/l33 0 2024-04-26T21:25:44.517 INFO:tasks.workunit.client.1.smithi120.stdout:0/239: dread - d0/d3/dc/dd/d1b/d39/f46 zero size 2024-04-26T21:25:44.519 INFO:tasks.workunit.client.1.smithi120.stdout:6/199: mknod d4/db/d10/c3f 0 2024-04-26T21:25:44.523 INFO:tasks.workunit.client.1.smithi120.stdout:0/240: symlink d0/d3/dc/d12/l52 0 2024-04-26T21:25:44.526 INFO:tasks.workunit.client.1.smithi120.stdout:6/200: rmdir d4/db/d10/d22 39 2024-04-26T21:25:44.527 INFO:tasks.workunit.client.1.smithi120.stdout:7/212: truncate f3 453858 0 2024-04-26T21:25:44.530 INFO:tasks.workunit.client.1.smithi120.stdout:0/241: rename d0/f30 to d0/d3/dc/dd/d1b/d39/f53 0 2024-04-26T21:25:44.531 INFO:tasks.workunit.client.1.smithi120.stdout:8/228: dwrite d5/d6/d12/d27/f33 [0,4194304] 0 2024-04-26T21:25:44.533 INFO:tasks.workunit.client.1.smithi120.stdout:5/227: write d2/d1b/d22/f42 [745419,107680] 0 2024-04-26T21:25:44.533 INFO:tasks.workunit.client.1.smithi120.stdout:0/242: read d0/d3/f3c [613630,97187] 0 2024-04-26T21:25:44.538 INFO:tasks.workunit.client.1.smithi120.stdout:0/243: read - d0/d3/f4e zero size 2024-04-26T21:25:44.539 INFO:tasks.workunit.client.1.smithi120.stdout:8/229: creat d5/d6/d12/d27/f51 x:0 0 0 2024-04-26T21:25:44.539 INFO:tasks.workunit.client.1.smithi120.stdout:5/228: write d2/f13 [3739452,100392] 0 2024-04-26T21:25:44.541 INFO:tasks.workunit.client.1.smithi120.stdout:8/230: chown d5/d18 1 1 2024-04-26T21:25:44.542 INFO:tasks.workunit.client.1.smithi120.stdout:3/149: truncate f5 1909894 0 2024-04-26T21:25:44.549 INFO:tasks.workunit.client.1.smithi120.stdout:4/206: dread d10/d12/f27 [0,4194304] 0 2024-04-26T21:25:44.549 INFO:tasks.workunit.client.1.smithi120.stdout:1/202: truncate d6/d7/d1d/d2c/f31 953215 0 2024-04-26T21:25:44.550 INFO:tasks.workunit.client.1.smithi120.stdout:3/150: creat dd/de/f2f x:0 0 0 2024-04-26T21:25:44.551 INFO:tasks.workunit.client.1.smithi120.stdout:6/201: dwrite d4/db/f35 [0,4194304] 0 2024-04-26T21:25:44.554 INFO:tasks.workunit.client.1.smithi120.stdout:5/229: mkdir d2/d1b/d22/d47 0 2024-04-26T21:25:44.555 INFO:tasks.workunit.client.1.smithi120.stdout:3/151: dread - dd/de/d18/d24/f20 zero size 2024-04-26T21:25:44.558 INFO:tasks.workunit.client.1.smithi120.stdout:3/152: write dd/f15 [4411813,112844] 0 2024-04-26T21:25:44.559 INFO:tasks.workunit.client.1.smithi120.stdout:7/213: dwrite d7/d10/d12/d1f/f48 [0,4194304] 0 2024-04-26T21:25:44.563 INFO:tasks.workunit.client.1.smithi120.stdout:1/203: creat d6/d7/da/dd/f42 x:0 0 0 2024-04-26T21:25:44.566 INFO:tasks.workunit.client.1.smithi120.stdout:6/202: write d4/db/d10/dd/f18 [3325034,115343] 0 2024-04-26T21:25:44.568 INFO:tasks.workunit.client.1.smithi120.stdout:3/153: rmdir dd/de/d18 39 2024-04-26T21:25:44.568 INFO:tasks.workunit.client.1.smithi120.stdout:0/244: creat d0/d3/dc/dd/f54 x:0 0 0 2024-04-26T21:25:44.570 INFO:tasks.workunit.client.1.smithi120.stdout:8/231: rename d5/d6/d12 to d5/d6/d11/d52 0 2024-04-26T21:25:44.574 INFO:tasks.workunit.client.1.smithi120.stdout:7/214: read d7/d10/d12/f14 [1267503,92469] 0 2024-04-26T21:25:44.576 INFO:tasks.workunit.client.1.smithi120.stdout:3/154: stat dd/de/d18/f22 0 2024-04-26T21:25:44.576 INFO:tasks.workunit.client.1.smithi120.stdout:9/162: sync 2024-04-26T21:25:44.579 INFO:tasks.workunit.client.1.smithi120.stdout:8/232: creat d5/d6/d11/d52/d27/f53 x:0 0 0 2024-04-26T21:25:44.582 INFO:tasks.workunit.client.1.smithi120.stdout:0/245: symlink d0/d3/dc/dd/d1b/d39/l55 0 2024-04-26T21:25:44.583 INFO:tasks.workunit.client.1.smithi120.stdout:1/204: link d6/d7/da/dd/c1f d6/d7/d1b/c43 0 2024-04-26T21:25:44.583 INFO:tasks.workunit.client.1.smithi120.stdout:6/203: symlink d4/d3d/l40 0 2024-04-26T21:25:44.583 INFO:tasks.workunit.client.1.smithi120.stdout:3/155: mknod dd/de/df/d1e/c30 0 2024-04-26T21:25:44.584 INFO:tasks.workunit.client.1.smithi120.stdout:0/246: dread - d0/d3/f3d zero size 2024-04-26T21:25:44.585 INFO:tasks.workunit.client.1.smithi120.stdout:4/207: rename d10/d28/c3b to d10/c48 0 2024-04-26T21:25:44.587 INFO:tasks.workunit.client.1.smithi120.stdout:7/215: symlink d7/d10/d12/d1f/l4f 0 2024-04-26T21:25:44.588 INFO:tasks.workunit.client.1.smithi120.stdout:4/208: fsync d10/f11 0 2024-04-26T21:25:44.588 INFO:tasks.workunit.client.1.smithi120.stdout:9/163: dread d0/f2e [0,4194304] 0 2024-04-26T21:25:44.589 INFO:tasks.workunit.client.1.smithi120.stdout:5/230: write d2/dc/fd [530139,9853] 0 2024-04-26T21:25:44.595 INFO:tasks.workunit.client.1.smithi120.stdout:0/247: dread d0/d3/dc/dd/f34 [0,4194304] 0 2024-04-26T21:25:44.598 INFO:tasks.workunit.client.1.smithi120.stdout:9/164: creat d0/d6/f36 x:0 0 0 2024-04-26T21:25:44.599 INFO:tasks.workunit.client.1.smithi120.stdout:4/209: creat d10/d28/f49 x:0 0 0 2024-04-26T21:25:44.600 INFO:tasks.workunit.client.1.smithi120.stdout:3/156: getdents dd/de/df 0 2024-04-26T21:25:44.605 INFO:tasks.workunit.client.1.smithi120.stdout:5/231: mkdir d2/d48 0 2024-04-26T21:25:44.605 INFO:tasks.workunit.client.1.smithi120.stdout:9/165: mknod d0/d6/c37 0 2024-04-26T21:25:44.606 INFO:tasks.workunit.client.1.smithi120.stdout:8/233: dwrite d5/d6/d11/d52/d27/f38 [0,4194304] 0 2024-04-26T21:25:44.608 INFO:tasks.workunit.client.1.smithi120.stdout:5/232: readlink d2/l11 0 2024-04-26T21:25:44.611 INFO:tasks.workunit.client.1.smithi120.stdout:4/210: symlink d10/l4a 0 2024-04-26T21:25:44.614 INFO:tasks.workunit.client.1.smithi120.stdout:8/234: rmdir d5/d6/d34 39 2024-04-26T21:25:44.615 INFO:tasks.workunit.client.1.smithi120.stdout:3/157: read dd/de/df/d1e/d28/f2d [3279929,128146] 0 2024-04-26T21:25:44.616 INFO:tasks.workunit.client.1.smithi120.stdout:7/216: dwrite d7/d10/d12/f42 [4194304,4194304] 0 2024-04-26T21:25:44.618 INFO:tasks.workunit.client.1.smithi120.stdout:2/282: sync 2024-04-26T21:25:44.618 INFO:tasks.workunit.client.1.smithi120.stdout:6/204: dwrite d4/db/d10/f15 [4194304,4194304] 0 2024-04-26T21:25:44.619 INFO:tasks.workunit.client.1.smithi120.stdout:0/248: getdents d0/d3 0 2024-04-26T21:25:44.621 INFO:tasks.workunit.client.1.smithi120.stdout:1/205: dread d6/d9/f1c [0,4194304] 0 2024-04-26T21:25:44.621 INFO:tasks.workunit.client.1.smithi120.stdout:4/211: chown d10/d12/c23 3420 1 2024-04-26T21:25:44.623 INFO:tasks.workunit.client.1.smithi120.stdout:3/158: creat dd/f31 x:0 0 0 2024-04-26T21:25:44.624 INFO:tasks.workunit.client.1.smithi120.stdout:0/249: mkdir d0/df/d56 0 2024-04-26T21:25:44.625 INFO:tasks.workunit.client.1.smithi120.stdout:2/283: chown d4/d1b/d2e/d50/l62 54021467 1 2024-04-26T21:25:44.625 INFO:tasks.workunit.client.1.smithi120.stdout:6/205: unlink d4/db/d10/f3b 0 2024-04-26T21:25:44.630 INFO:tasks.workunit.client.1.smithi120.stdout:8/235: truncate d5/d6/d11/d52/d27/f38 4596886 0 2024-04-26T21:25:44.635 INFO:tasks.workunit.client.1.smithi120.stdout:9/166: dread d0/f26 [0,4194304] 0 2024-04-26T21:25:44.637 INFO:tasks.workunit.client.1.smithi120.stdout:1/206: mknod d6/d7/d1b/d3b/c44 0 2024-04-26T21:25:44.638 INFO:tasks.workunit.client.1.smithi120.stdout:3/159: truncate dd/de/f2f 316961 0 2024-04-26T21:25:44.639 INFO:tasks.workunit.client.1.smithi120.stdout:0/250: mknod d0/df/c57 0 2024-04-26T21:25:44.642 INFO:tasks.workunit.client.1.smithi120.stdout:8/236: read - d5/d6/d11/d52/d27/f53 zero size 2024-04-26T21:25:44.643 INFO:tasks.workunit.client.1.smithi120.stdout:5/233: link d2/d1b/d29/l31 d2/dc/d1d/d2e/l49 0 2024-04-26T21:25:44.644 INFO:tasks.workunit.client.1.smithi120.stdout:0/251: readlink d0/d3/dc/d12/l25 0 2024-04-26T21:25:44.646 INFO:tasks.workunit.client.1.smithi120.stdout:4/212: link d10/d12/f1d d10/d28/f4b 0 2024-04-26T21:25:44.647 INFO:tasks.workunit.client.1.smithi120.stdout:9/167: chown d0/dd/c10 81 1 2024-04-26T21:25:44.651 INFO:tasks.workunit.client.1.smithi120.stdout:3/160: rmdir dd/de/d18/d24 39 2024-04-26T21:25:44.657 INFO:tasks.workunit.client.1.smithi120.stdout:8/237: rmdir d5/d6/d11/d32/d3b 39 2024-04-26T21:25:44.657 INFO:tasks.workunit.client.1.smithi120.stdout:1/207: write d6/d14/f16 [110009,92535] 0 2024-04-26T21:25:44.658 INFO:tasks.workunit.client.1.smithi120.stdout:2/284: getdents d4/d1b/d2e/d50/d14 0 2024-04-26T21:25:44.663 INFO:tasks.workunit.client.1.smithi120.stdout:9/168: fdatasync d0/fa 0 2024-04-26T21:25:44.663 INFO:tasks.workunit.client.1.smithi120.stdout:1/208: stat d6/d14/d3c 0 2024-04-26T21:25:44.663 INFO:tasks.workunit.client.1.smithi120.stdout:3/161: dread - dd/de/f2e zero size 2024-04-26T21:25:44.666 INFO:tasks.workunit.client.1.smithi120.stdout:9/169: symlink d0/d14/d2d/l38 0 2024-04-26T21:25:44.667 INFO:tasks.workunit.client.1.smithi120.stdout:5/234: truncate d2/f3f 115088 0 2024-04-26T21:25:44.671 INFO:tasks.workunit.client.1.smithi120.stdout:7/217: dwrite d7/d10/d12/d1f/f3a [4194304,4194304] 0 2024-04-26T21:25:44.672 INFO:tasks.workunit.client.1.smithi120.stdout:9/170: fdatasync d0/d14/f24 0 2024-04-26T21:25:44.678 INFO:tasks.workunit.client.1.smithi120.stdout:2/285: getdents d4/d1b/d25/d2c/d3e/d5e/d63 0 2024-04-26T21:25:44.680 INFO:tasks.workunit.client.1.smithi120.stdout:1/209: symlink d6/d7/d1d/d2c/l45 0 2024-04-26T21:25:44.681 INFO:tasks.workunit.client.1.smithi120.stdout:7/218: dread - d7/d10/f30 zero size 2024-04-26T21:25:44.682 INFO:tasks.workunit.client.1.smithi120.stdout:3/162: mknod dd/de/d18/c32 0 2024-04-26T21:25:44.684 INFO:tasks.workunit.client.1.smithi120.stdout:9/171: creat d0/d6/f39 x:0 0 0 2024-04-26T21:25:44.686 INFO:tasks.workunit.client.1.smithi120.stdout:6/206: dread d4/d27/f32 [0,4194304] 0 2024-04-26T21:25:44.689 INFO:tasks.workunit.client.1.smithi120.stdout:9/172: stat d0/dd/d34 0 2024-04-26T21:25:44.692 INFO:tasks.workunit.client.1.smithi120.stdout:2/286: creat d4/f64 x:0 0 0 2024-04-26T21:25:44.692 INFO:tasks.workunit.client.1.smithi120.stdout:4/213: dwrite d10/d28/f2b [0,4194304] 0 2024-04-26T21:25:44.695 INFO:tasks.workunit.client.1.smithi120.stdout:8/238: truncate d5/d6/f1f 5890110 0 2024-04-26T21:25:44.697 INFO:tasks.workunit.client.1.smithi120.stdout:6/207: write d4/db/d10/dd/f36 [481300,31225] 0 2024-04-26T21:25:44.698 INFO:tasks.workunit.client.1.smithi120.stdout:4/214: chown d10/l4a 9877196 1 2024-04-26T21:25:44.699 INFO:tasks.workunit.client.1.smithi120.stdout:6/208: stat d4/db 0 2024-04-26T21:25:44.699 INFO:tasks.workunit.client.1.smithi120.stdout:8/239: chown d5/d6/l2f 28148289 1 2024-04-26T21:25:44.699 INFO:tasks.workunit.client.1.smithi120.stdout:3/163: dread f5 [0,4194304] 0 2024-04-26T21:25:44.701 INFO:tasks.workunit.client.1.smithi120.stdout:2/287: mkdir d4/d1b/d56/d65 0 2024-04-26T21:25:44.701 INFO:tasks.workunit.client.1.smithi120.stdout:9/173: rmdir d0/d6/d1c 0 2024-04-26T21:25:44.701 INFO:tasks.workunit.client.1.smithi120.stdout:4/215: fdatasync d10/f26 0 2024-04-26T21:25:44.704 INFO:tasks.workunit.client.1.smithi120.stdout:3/164: chown dd/de/d18/d2c 147 1 2024-04-26T21:25:44.704 INFO:tasks.workunit.client.1.smithi120.stdout:6/209: rmdir d4/db/d10 39 2024-04-26T21:25:44.709 INFO:tasks.workunit.client.1.smithi120.stdout:3/165: chown dd/de/d18/c32 91 1 2024-04-26T21:25:44.709 INFO:tasks.workunit.client.1.smithi120.stdout:9/174: write d0/d14/d2d/f2f [947539,98302] 0 2024-04-26T21:25:44.713 INFO:tasks.workunit.client.1.smithi120.stdout:4/216: mknod d10/d12/c4c 0 2024-04-26T21:25:44.715 INFO:tasks.workunit.client.1.smithi120.stdout:1/210: dread d6/d7/da/fb [0,4194304] 0 2024-04-26T21:25:44.716 INFO:tasks.workunit.client.1.smithi120.stdout:9/175: mkdir d0/dd/d3a 0 2024-04-26T21:25:44.717 INFO:tasks.workunit.client.1.smithi120.stdout:4/217: chown d10/d28/f2e 5738 1 2024-04-26T21:25:44.717 INFO:tasks.workunit.client.1.smithi120.stdout:6/210: write d4/db/d10/dd/f26 [363033,91154] 0 2024-04-26T21:25:44.718 INFO:tasks.workunit.client.1.smithi120.stdout:2/288: dread d4/d1b/d25/d29/f4d [0,4194304] 0 2024-04-26T21:25:44.725 INFO:tasks.workunit.client.1.smithi120.stdout:2/289: dread - d4/f3a zero size 2024-04-26T21:25:44.726 INFO:tasks.workunit.client.1.smithi120.stdout:1/211: mknod d6/d14/c46 0 2024-04-26T21:25:44.727 INFO:tasks.workunit.client.1.smithi120.stdout:9/176: creat d0/d14/f3b x:0 0 0 2024-04-26T21:25:44.730 INFO:tasks.workunit.client.1.smithi120.stdout:2/290: creat d4/f66 x:0 0 0 2024-04-26T21:25:44.730 INFO:tasks.workunit.client.1.smithi120.stdout:6/211: getdents d4/db/d10/d1a/d2b 0 2024-04-26T21:25:44.731 INFO:tasks.workunit.client.1.smithi120.stdout:1/212: creat d6/d7/d1d/f47 x:0 0 0 2024-04-26T21:25:44.736 INFO:tasks.workunit.client.1.smithi120.stdout:1/213: write d6/f3a [253579,59406] 0 2024-04-26T21:25:44.740 INFO:tasks.workunit.client.1.smithi120.stdout:3/166: dwrite dd/de/d18/f22 [0,4194304] 0 2024-04-26T21:25:44.740 INFO:tasks.workunit.client.1.smithi120.stdout:6/212: unlink d4/d27/f34 0 2024-04-26T21:25:44.741 INFO:tasks.workunit.client.1.smithi120.stdout:6/213: readlink d4/db/lc 0 2024-04-26T21:25:44.743 INFO:tasks.workunit.client.1.smithi120.stdout:2/291: rename d4/d1b/d2e/d50/d14/f59 to d4/d1b/d56/d65/f67 0 2024-04-26T21:25:44.743 INFO:tasks.workunit.client.1.smithi120.stdout:9/177: truncate d0/f1 1959334 0 2024-04-26T21:25:44.745 INFO:tasks.workunit.client.1.smithi120.stdout:6/214: chown d4/db/d10/d22 28404618 1 2024-04-26T21:25:44.749 INFO:tasks.workunit.client.1.smithi120.stdout:9/178: creat d0/d14/f3c x:0 0 0 2024-04-26T21:25:44.749 INFO:tasks.workunit.client.1.smithi120.stdout:6/215: chown d4/c3a 11 1 2024-04-26T21:25:44.750 INFO:tasks.workunit.client.1.smithi120.stdout:3/167: write dd/de/df/d1e/d28/f2d [4220327,95957] 0 2024-04-26T21:25:44.750 INFO:tasks.workunit.client.1.smithi120.stdout:4/218: dwrite f5 [0,4194304] 0 2024-04-26T21:25:44.753 INFO:tasks.workunit.client.1.smithi120.stdout:9/179: chown d0/d14 245630 1 2024-04-26T21:25:44.756 INFO:tasks.workunit.client.1.smithi120.stdout:4/219: mknod d10/d28/c4d 0 2024-04-26T21:25:44.763 INFO:tasks.workunit.client.1.smithi120.stdout:9/180: mkdir d0/d6/d3d 0 2024-04-26T21:25:44.770 INFO:tasks.workunit.client.1.smithi120.stdout:9/181: unlink d0/f26 0 2024-04-26T21:25:44.773 INFO:tasks.workunit.client.1.smithi120.stdout:6/216: getdents d4/d27 0 2024-04-26T21:25:44.779 INFO:tasks.workunit.client.1.smithi120.stdout:9/182: symlink d0/dd/l3e 0 2024-04-26T21:25:44.780 INFO:tasks.workunit.client.1.smithi120.stdout:6/217: chown d4/db/f35 151517019 1 2024-04-26T21:25:44.782 INFO:tasks.workunit.client.1.smithi120.stdout:4/220: write d10/d12/f45 [467176,107816] 0 2024-04-26T21:25:44.783 INFO:tasks.workunit.client.1.smithi120.stdout:3/168: dwrite dd/f15 [4194304,4194304] 0 2024-04-26T21:25:44.790 INFO:tasks.workunit.client.1.smithi120.stdout:9/183: write d0/d14/d2d/f2f [1260620,112308] 0 2024-04-26T21:25:44.790 INFO:tasks.workunit.client.1.smithi120.stdout:2/292: dwrite d4/d1b/d2e/d50/d14/d15/f2d [4194304,4194304] 0 2024-04-26T21:25:44.791 INFO:tasks.workunit.client.1.smithi120.stdout:9/184: dread - d0/d14/f3b zero size 2024-04-26T21:25:44.793 INFO:tasks.workunit.client.1.smithi120.stdout:4/221: creat d10/d28/f4e x:0 0 0 2024-04-26T21:25:44.795 INFO:tasks.workunit.client.1.smithi120.stdout:6/218: truncate d4/db/d10/dd/f26 1498070 0 2024-04-26T21:25:44.798 INFO:tasks.workunit.client.1.smithi120.stdout:3/169: creat dd/d2a/f33 x:0 0 0 2024-04-26T21:25:44.800 INFO:tasks.workunit.client.1.smithi120.stdout:2/293: chown d4/d1b/d2e/d50/d14/d15/c17 967420 1 2024-04-26T21:25:44.802 INFO:tasks.workunit.client.1.smithi120.stdout:4/222: dread d10/d12/f40 [0,4194304] 0 2024-04-26T21:25:44.802 INFO:tasks.workunit.client.1.smithi120.stdout:9/185: creat d0/dd/d3a/f3f x:0 0 0 2024-04-26T21:25:44.803 INFO:tasks.workunit.client.1.smithi120.stdout:6/219: creat d4/f41 x:0 0 0 2024-04-26T21:25:44.803 INFO:tasks.workunit.client.1.smithi120.stdout:1/214: dwrite d6/d7/d1d/d2c/f31 [0,4194304] 0 2024-04-26T21:25:44.806 INFO:tasks.workunit.client.1.smithi120.stdout:4/223: dread - d10/d28/f4e zero size 2024-04-26T21:25:44.807 INFO:tasks.workunit.client.1.smithi120.stdout:0/252: sync 2024-04-26T21:25:44.809 INFO:tasks.workunit.client.1.smithi120.stdout:9/186: truncate d0/dd/f12 1231894 0 2024-04-26T21:25:44.811 INFO:tasks.workunit.client.1.smithi120.stdout:9/187: chown d0/d6/f8 724274 1 2024-04-26T21:25:44.812 INFO:tasks.workunit.client.1.smithi120.stdout:1/215: mkdir d6/d7/d2d/d48 0 2024-04-26T21:25:44.813 INFO:tasks.workunit.client.1.smithi120.stdout:9/188: stat d0/d14/d2d/l38 0 2024-04-26T21:25:44.816 INFO:tasks.workunit.client.1.smithi120.stdout:1/216: write d6/d14/f16 [2086796,72230] 0 2024-04-26T21:25:44.820 INFO:tasks.workunit.client.1.smithi120.stdout:4/224: rename d10/f11 to d10/f4f 0 2024-04-26T21:25:44.824 INFO:tasks.workunit.client.1.smithi120.stdout:6/220: truncate d4/d27/f2e 135166 0 2024-04-26T21:25:44.825 INFO:tasks.workunit.client.1.smithi120.stdout:4/225: readlink d10/d28/l3f 0 2024-04-26T21:25:44.827 INFO:tasks.workunit.client.1.smithi120.stdout:3/170: dread dd/de/df/d12/f21 [0,4194304] 0 2024-04-26T21:25:44.827 INFO:tasks.workunit.client.1.smithi120.stdout:9/189: creat d0/d6/d3d/f40 x:0 0 0 2024-04-26T21:25:44.829 INFO:tasks.workunit.client.1.smithi120.stdout:4/226: chown d10/c46 18761841 1 2024-04-26T21:25:44.834 INFO:tasks.workunit.client.1.smithi120.stdout:9/190: write d0/d14/f35 [530549,10341] 0 2024-04-26T21:25:44.834 INFO:tasks.workunit.client.1.smithi120.stdout:0/253: dread d0/d3/dc/f44 [0,4194304] 0 2024-04-26T21:25:44.835 INFO:tasks.workunit.client.1.smithi120.stdout:6/221: symlink d4/db/d10/dd/d28/l42 0 2024-04-26T21:25:44.835 INFO:tasks.workunit.client.1.smithi120.stdout:2/294: dwrite d4/d1b/d25/d2c/f49 [0,4194304] 0 2024-04-26T21:25:44.838 INFO:tasks.workunit.client.1.smithi120.stdout:4/227: mknod d10/d28/c50 0 2024-04-26T21:25:44.839 INFO:tasks.workunit.client.1.smithi120.stdout:3/171: creat dd/de/df/f34 x:0 0 0 2024-04-26T21:25:44.840 INFO:tasks.workunit.client.1.smithi120.stdout:0/254: write d0/d3/dc/d12/f47 [417185,108721] 0 2024-04-26T21:25:44.845 INFO:tasks.workunit.client.1.smithi120.stdout:4/228: truncate d10/d12/f14 4982828 0 2024-04-26T21:25:44.845 INFO:tasks.workunit.client.1.smithi120.stdout:4/229: creat d10/d12/f51 x:0 0 0 2024-04-26T21:25:44.848 INFO:tasks.workunit.client.1.smithi120.stdout:3/172: write dd/de/df/f16 [312360,15202] 0 2024-04-26T21:25:44.849 INFO:tasks.workunit.client.1.smithi120.stdout:0/255: creat d0/d3/d51/f58 x:0 0 0 2024-04-26T21:25:44.860 INFO:tasks.workunit.client.1.smithi120.stdout:0/256: dread d0/d3/dc/d12/f47 [0,4194304] 0 2024-04-26T21:25:44.862 INFO:tasks.workunit.client.1.smithi120.stdout:9/191: dread d0/d14/d2d/f2f [0,4194304] 0 2024-04-26T21:25:44.867 INFO:tasks.workunit.client.1.smithi120.stdout:9/192: chown d0/l1d 384239 1 2024-04-26T21:25:44.870 INFO:tasks.workunit.client.1.smithi120.stdout:6/222: dwrite d4/f41 [0,4194304] 0 2024-04-26T21:25:44.872 INFO:tasks.workunit.client.1.smithi120.stdout:1/217: dread d6/d7/da/f19 [0,4194304] 0 2024-04-26T21:25:44.875 INFO:tasks.workunit.client.1.smithi120.stdout:9/193: chown d0/d6/f8 0 1 2024-04-26T21:25:44.875 INFO:tasks.workunit.client.1.smithi120.stdout:0/257: fsync d0/df/f3f 0 2024-04-26T21:25:44.875 INFO:tasks.workunit.client.1.smithi120.stdout:2/295: dwrite d4/f10 [0,4194304] 0 2024-04-26T21:25:44.879 INFO:tasks.workunit.client.1.smithi120.stdout:4/230: dwrite d10/f2d [0,4194304] 0 2024-04-26T21:25:44.879 INFO:tasks.workunit.client.1.smithi120.stdout:6/223: write d4/f31 [3243370,696] 0 2024-04-26T21:25:44.881 INFO:tasks.workunit.client.1.smithi120.stdout:9/194: fdatasync d0/d14/f3c 0 2024-04-26T21:25:44.885 INFO:tasks.workunit.client.1.smithi120.stdout:4/231: truncate d10/d28/f29 1124464 0 2024-04-26T21:25:44.885 INFO:tasks.workunit.client.1.smithi120.stdout:6/224: write d4/db/d10/dd/f36 [45934,37077] 0 2024-04-26T21:25:44.886 INFO:tasks.workunit.client.1.smithi120.stdout:0/258: fsync d0/f10 0 2024-04-26T21:25:44.889 INFO:tasks.workunit.client.1.smithi120.stdout:9/195: creat d0/d14/d2d/f41 x:0 0 0 2024-04-26T21:25:44.890 INFO:tasks.workunit.client.1.smithi120.stdout:4/232: mknod d10/d28/c52 0 2024-04-26T21:25:44.892 INFO:tasks.workunit.client.1.smithi120.stdout:1/218: creat d6/d7/d2d/d48/f49 x:0 0 0 2024-04-26T21:25:44.894 INFO:tasks.workunit.client.1.smithi120.stdout:9/196: mknod d0/dd/d3a/c42 0 2024-04-26T21:25:44.897 INFO:tasks.workunit.client.1.smithi120.stdout:6/225: unlink d4/db/d10/d1a/c21 0 2024-04-26T21:25:44.904 INFO:tasks.workunit.client.1.smithi120.stdout:4/233: mknod d10/c53 0 2024-04-26T21:25:44.904 INFO:tasks.workunit.client.1.smithi120.stdout:6/226: mkdir d4/db/d10/dd/d43 0 2024-04-26T21:25:44.906 INFO:tasks.workunit.client.1.smithi120.stdout:4/234: stat d10/d28/f4b 0 2024-04-26T21:25:44.907 INFO:tasks.workunit.client.1.smithi120.stdout:1/219: link d6/d14/c39 d6/d7/da/c4a 0 2024-04-26T21:25:44.909 INFO:tasks.workunit.client.1.smithi120.stdout:4/235: creat d10/d12/f54 x:0 0 0 2024-04-26T21:25:44.912 INFO:tasks.workunit.client.1.smithi120.stdout:1/220: symlink d6/d7/da/dd/l4b 0 2024-04-26T21:25:44.917 INFO:tasks.workunit.client.1.smithi120.stdout:9/197: rmdir d0/d14/d2d 39 2024-04-26T21:25:44.918 INFO:tasks.workunit.client.1.smithi120.stdout:9/198: stat d0/f2e 0 2024-04-26T21:25:44.924 INFO:tasks.workunit.client.1.smithi120.stdout:9/199: symlink d0/d14/d2d/l43 0 2024-04-26T21:25:44.931 INFO:tasks.workunit.client.1.smithi120.stdout:9/200: fdatasync d0/d14/f3c 0 2024-04-26T21:25:44.935 INFO:tasks.workunit.client.1.smithi120.stdout:9/201: symlink d0/dd/l44 0 2024-04-26T21:25:44.939 INFO:tasks.workunit.client.1.smithi120.stdout:2/296: dread d4/d1b/f41 [0,4194304] 0 2024-04-26T21:25:44.941 INFO:tasks.workunit.client.1.smithi120.stdout:9/202: chown d0/d14/l19 30 1 2024-04-26T21:25:44.942 INFO:tasks.workunit.client.1.smithi120.stdout:6/227: dwrite d4/db/d25/f2d [0,4194304] 0 2024-04-26T21:25:44.943 INFO:tasks.workunit.client.1.smithi120.stdout:0/259: dread d0/d3/dc/d12/f1a [0,4194304] 0 2024-04-26T21:25:44.946 INFO:tasks.workunit.client.1.smithi120.stdout:1/221: dwrite d6/d14/f16 [0,4194304] 0 2024-04-26T21:25:44.946 INFO:tasks.workunit.client.1.smithi120.stdout:9/203: truncate d0/d6/f8 5058419 0 2024-04-26T21:25:44.947 INFO:tasks.workunit.client.1.smithi120.stdout:6/228: write d4/db/d10/dd/f18 [434320,80354] 0 2024-04-26T21:25:44.947 INFO:tasks.workunit.client.1.smithi120.stdout:4/236: dread fe [0,4194304] 0 2024-04-26T21:25:44.949 INFO:tasks.workunit.client.1.smithi120.stdout:9/204: dread - d0/d6/d3d/f40 zero size 2024-04-26T21:25:44.952 INFO:tasks.workunit.client.1.smithi120.stdout:9/205: chown d0/d14/d2d/l43 2464 1 2024-04-26T21:25:44.955 INFO:tasks.workunit.client.1.smithi120.stdout:1/222: chown d6/d7/da/dd/fe 0 1 2024-04-26T21:25:44.957 INFO:tasks.workunit.client.1.smithi120.stdout:9/206: mkdir d0/dd/d45 0 2024-04-26T21:25:44.959 INFO:tasks.workunit.client.1.smithi120.stdout:1/223: write d6/f15 [5083935,99627] 0 2024-04-26T21:25:44.961 INFO:tasks.workunit.client.1.smithi120.stdout:6/229: creat d4/db/d10/f44 x:0 0 0 2024-04-26T21:25:44.964 INFO:tasks.workunit.client.1.smithi120.stdout:9/207: getdents d0/dd/d34 0 2024-04-26T21:25:44.964 INFO:tasks.workunit.client.1.smithi120.stdout:4/237: truncate d10/d12/f1d 300680 0 2024-04-26T21:25:44.968 INFO:tasks.workunit.client.1.smithi120.stdout:2/297: dwrite d4/d1b/f38 [0,4194304] 0 2024-04-26T21:25:44.968 INFO:tasks.workunit.client.1.smithi120.stdout:6/230: write d4/f41 [4348868,11488] 0 2024-04-26T21:25:44.968 INFO:tasks.workunit.client.1.smithi120.stdout:4/238: fsync d10/d12/f45 0 2024-04-26T21:25:44.971 INFO:tasks.workunit.client.1.smithi120.stdout:1/224: symlink d6/d7/da/dd/d35/l4c 0 2024-04-26T21:25:44.971 INFO:tasks.workunit.client.1.smithi120.stdout:9/208: write d0/d14/f24 [1345930,107894] 0 2024-04-26T21:25:44.973 INFO:tasks.workunit.client.1.smithi120.stdout:4/239: creat d10/d12/f55 x:0 0 0 2024-04-26T21:25:44.974 INFO:tasks.workunit.client.1.smithi120.stdout:1/225: write d6/f3a [443831,45836] 0 2024-04-26T21:25:44.978 INFO:tasks.workunit.client.1.smithi120.stdout:0/260: dwrite d0/d3/dc/f22 [0,4194304] 0 2024-04-26T21:25:44.979 INFO:tasks.workunit.client.1.smithi120.stdout:4/240: fdatasync d10/d28/f31 0 2024-04-26T21:25:44.979 INFO:tasks.workunit.client.1.smithi120.stdout:9/209: dread d0/f2e [0,4194304] 0 2024-04-26T21:25:44.985 INFO:tasks.workunit.client.1.smithi120.stdout:6/231: rename d4/db/d10/c29 to d4/db/d10/dd/d28/c45 0 2024-04-26T21:25:44.989 INFO:tasks.workunit.client.1.smithi120.stdout:9/210: dread d0/d14/f35 [0,4194304] 0 2024-04-26T21:25:44.989 INFO:tasks.workunit.client.1.smithi120.stdout:6/232: chown d4/db/d10/dd/d28/l42 35111356 1 2024-04-26T21:25:44.993 INFO:tasks.workunit.client.1.smithi120.stdout:4/241: creat d10/d28/f56 x:0 0 0 2024-04-26T21:25:44.994 INFO:tasks.workunit.client.1.smithi120.stdout:0/261: fdatasync d0/d3/dc/dd/d1b/d39/f53 0 2024-04-26T21:25:44.996 INFO:tasks.workunit.client.1.smithi120.stdout:0/262: dread - d0/d3/dc/dd/f45 zero size 2024-04-26T21:25:44.996 INFO:tasks.workunit.client.1.smithi120.stdout:1/226: truncate d6/fc 3691210 0 2024-04-26T21:25:44.997 INFO:tasks.workunit.client.1.smithi120.stdout:0/263: write d0/f35 [1507043,94714] 0 2024-04-26T21:25:44.998 INFO:tasks.workunit.client.1.smithi120.stdout:6/233: rmdir d4/d3d 39 2024-04-26T21:25:44.999 INFO:tasks.workunit.client.1.smithi120.stdout:4/242: creat d10/d12/f57 x:0 0 0 2024-04-26T21:25:45.000 INFO:tasks.workunit.client.1.smithi120.stdout:0/264: chown d0/d3/dc/dd/d1b/d24/f2f 461268 1 2024-04-26T21:25:45.001 INFO:tasks.workunit.client.1.smithi120.stdout:4/243: write d10/f2d [1807951,56387] 0 2024-04-26T21:25:45.002 INFO:tasks.workunit.client.1.smithi120.stdout:1/227: unlink d6/d7/da/f19 0 2024-04-26T21:25:45.003 INFO:tasks.workunit.client.1.smithi120.stdout:9/211: truncate d0/f1 254187 0 2024-04-26T21:25:45.006 INFO:tasks.workunit.client.1.smithi120.stdout:0/265: rename d0/df/d56 to d0/df/d59 0 2024-04-26T21:25:45.006 INFO:tasks.workunit.client.1.smithi120.stdout:4/244: creat d10/d12/f58 x:0 0 0 2024-04-26T21:25:45.007 INFO:tasks.workunit.client.1.smithi120.stdout:6/234: creat d4/db/d10/dd/d43/f46 x:0 0 0 2024-04-26T21:25:45.007 INFO:tasks.workunit.client.1.smithi120.stdout:0/266: chown d0/d3/f4e 396 1 2024-04-26T21:25:45.008 INFO:tasks.workunit.client.1.smithi120.stdout:5/235: sync 2024-04-26T21:25:45.012 INFO:tasks.workunit.client.1.smithi120.stdout:9/212: rename d0/f2e to d0/dd/d3a/f46 0 2024-04-26T21:25:45.013 INFO:tasks.workunit.client.1.smithi120.stdout:6/235: read d4/d27/f2e [67964,62514] 0 2024-04-26T21:25:45.014 INFO:tasks.workunit.client.1.smithi120.stdout:0/267: write d0/d3/f41 [105327,20038] 0 2024-04-26T21:25:45.015 INFO:tasks.workunit.client.1.smithi120.stdout:0/268: readlink d0/l19 0 2024-04-26T21:25:45.017 INFO:tasks.workunit.client.1.smithi120.stdout:2/298: dread d4/d1b/d25/d2c/f22 [0,4194304] 0 2024-04-26T21:25:45.017 INFO:tasks.workunit.client.1.smithi120.stdout:9/213: creat d0/d6/f47 x:0 0 0 2024-04-26T21:25:45.019 INFO:tasks.workunit.client.1.smithi120.stdout:5/236: creat d2/d30/d3b/f4a x:0 0 0 2024-04-26T21:25:45.021 INFO:tasks.workunit.client.1.smithi120.stdout:2/299: truncate d4/d1b/d2e/f35 866073 0 2024-04-26T21:25:45.022 INFO:tasks.workunit.client.1.smithi120.stdout:5/237: write d2/dc/d1d/d1f/d36/f40 [612124,69045] 0 2024-04-26T21:25:45.031 INFO:tasks.workunit.client.1.smithi120.stdout:5/238: mknod d2/dc/d1d/d21/c4b 0 2024-04-26T21:25:45.032 INFO:tasks.workunit.client.1.smithi120.stdout:5/239: stat d2/d1b/d29 0 2024-04-26T21:25:45.033 INFO:tasks.workunit.client.1.smithi120.stdout:5/240: truncate d2/d1b/f35 76018 0 2024-04-26T21:25:45.035 INFO:tasks.workunit.client.1.smithi120.stdout:2/300: symlink d4/d1b/l68 0 2024-04-26T21:25:45.036 INFO:tasks.workunit.client.1.smithi120.stdout:6/236: truncate d4/db/f1b 199603 0 2024-04-26T21:25:45.038 INFO:tasks.workunit.client.1.smithi120.stdout:6/237: readlink d4/db/d10/dd/d28/l39 0 2024-04-26T21:25:45.039 INFO:tasks.workunit.client.1.smithi120.stdout:0/269: truncate d0/d3/dc/dd/d1b/d24/f2f 4311152 0 2024-04-26T21:25:45.041 INFO:tasks.workunit.client.1.smithi120.stdout:5/241: creat d2/dc/d1d/d1f/f4c x:0 0 0 2024-04-26T21:25:45.043 INFO:tasks.workunit.client.1.smithi120.stdout:0/270: dread - d0/d3/dc/dd/f54 zero size 2024-04-26T21:25:45.043 INFO:tasks.workunit.client.1.smithi120.stdout:4/245: dwrite d10/d12/f1d [0,4194304] 0 2024-04-26T21:25:45.044 INFO:tasks.workunit.client.1.smithi120.stdout:9/214: getdents d0/dd/d3a 0 2024-04-26T21:25:45.047 INFO:tasks.workunit.client.1.smithi120.stdout:9/215: chown d0/d14/l1e 353 1 2024-04-26T21:25:45.060 INFO:tasks.workunit.client.1.smithi120.stdout:2/301: dwrite d4/d1b/d2e/d50/f21 [0,4194304] 0 2024-04-26T21:25:45.067 INFO:tasks.workunit.client.1.smithi120.stdout:5/242: dread d2/d1b/f26 [0,4194304] 0 2024-04-26T21:25:45.068 INFO:tasks.workunit.client.1.smithi120.stdout:9/216: dread d0/fa [0,4194304] 0 2024-04-26T21:25:45.073 INFO:tasks.workunit.client.1.smithi120.stdout:5/243: mkdir d2/db/d4d 0 2024-04-26T21:25:45.073 INFO:tasks.workunit.client.1.smithi120.stdout:9/217: truncate d0/d14/f35 1316279 0 2024-04-26T21:25:45.073 INFO:tasks.workunit.client.1.smithi120.stdout:4/246: dwrite d10/d28/f32 [0,4194304] 0 2024-04-26T21:25:45.073 INFO:tasks.workunit.client.1.smithi120.stdout:6/238: dread d4/f31 [0,4194304] 0 2024-04-26T21:25:45.076 INFO:tasks.workunit.client.1.smithi120.stdout:9/218: chown d0/d6/l23 2349772 1 2024-04-26T21:25:45.077 INFO:tasks.workunit.client.1.smithi120.stdout:2/302: link d4/l9 d4/d1b/d25/d2c/d3e/d5e/l69 0 2024-04-26T21:25:45.079 INFO:tasks.workunit.client.1.smithi120.stdout:5/244: creat d2/db/d4d/f4e x:0 0 0 2024-04-26T21:25:45.080 INFO:tasks.workunit.client.1.smithi120.stdout:5/245: chown d2/db/d4d 815 1 2024-04-26T21:25:45.080 INFO:tasks.workunit.client.1.smithi120.stdout:9/219: truncate d0/d14/f3b 197254 0 2024-04-26T21:25:45.081 INFO:tasks.workunit.client.1.smithi120.stdout:2/303: fdatasync d4/d1b/d25/d2c/d3e/d5e/f61 0 2024-04-26T21:25:45.086 INFO:tasks.workunit.client.1.smithi120.stdout:2/304: creat d4/d1b/d4f/f6a x:0 0 0 2024-04-26T21:25:45.087 INFO:tasks.workunit.client.1.smithi120.stdout:5/246: getdents d2/d1b 0 2024-04-26T21:25:45.088 INFO:tasks.workunit.client.1.smithi120.stdout:9/220: dread d0/d14/d2d/f2f [0,4194304] 0 2024-04-26T21:25:45.093 INFO:tasks.workunit.client.1.smithi120.stdout:9/221: write d0/d14/f3b [471793,20862] 0 2024-04-26T21:25:45.094 INFO:tasks.workunit.client.1.smithi120.stdout:4/247: dwrite d10/d12/f51 [0,4194304] 0 2024-04-26T21:25:45.101 INFO:tasks.workunit.client.1.smithi120.stdout:0/271: dread d0/d3/dc/dd/d1b/d39/f53 [0,4194304] 0 2024-04-26T21:25:45.104 INFO:tasks.workunit.client.1.smithi120.stdout:9/222: mkdir d0/dd/d34/d48 0 2024-04-26T21:25:45.107 INFO:tasks.workunit.client.1.smithi120.stdout:9/223: write d0/d6/f8 [1963274,108419] 0 2024-04-26T21:25:45.108 INFO:tasks.workunit.client.1.smithi120.stdout:0/272: write d0/d3/dc/dd/d1b/d39/f50 [601799,33264] 0 2024-04-26T21:25:45.112 INFO:tasks.workunit.client.1.smithi120.stdout:2/305: dwrite f1 [0,4194304] 0 2024-04-26T21:25:45.112 INFO:tasks.workunit.client.1.smithi120.stdout:0/273: chown d0/d3/dc/dd/d1b 11983885 1 2024-04-26T21:25:45.114 INFO:tasks.workunit.client.1.smithi120.stdout:8/240: sync 2024-04-26T21:25:45.114 INFO:tasks.workunit.client.1.smithi120.stdout:7/219: sync 2024-04-26T21:25:45.114 INFO:tasks.workunit.client.1.smithi120.stdout:3/173: sync 2024-04-26T21:25:45.121 INFO:tasks.workunit.client.1.smithi120.stdout:9/224: link d0/d14/l19 d0/l49 0 2024-04-26T21:25:45.122 INFO:tasks.workunit.client.1.smithi120.stdout:7/220: chown d7/d10/d12/d1f/d28/f2c 6907 1 2024-04-26T21:25:45.124 INFO:tasks.workunit.client.1.smithi120.stdout:5/247: dwrite d2/db/f28 [0,4194304] 0 2024-04-26T21:25:45.124 INFO:tasks.workunit.client.1.smithi120.stdout:0/274: unlink d0/d3/dc/dd/d1b/d39/f46 0 2024-04-26T21:25:45.124 INFO:tasks.workunit.client.1.smithi120.stdout:8/241: truncate d5/d6/d11/d52/d27/f53 680647 0 2024-04-26T21:25:45.126 INFO:tasks.workunit.client.1.smithi120.stdout:2/306: getdents d4/d1b/d56/d65 0 2024-04-26T21:25:45.128 INFO:tasks.workunit.client.1.smithi120.stdout:0/275: mkdir d0/d3/d13/d5a 0 2024-04-26T21:25:45.130 INFO:tasks.workunit.client.1.smithi120.stdout:5/248: mknod d2/dc/d1d/d1f/c4f 0 2024-04-26T21:25:45.130 INFO:tasks.workunit.client.1.smithi120.stdout:0/276: write d0/f35 [927312,56182] 0 2024-04-26T21:25:45.131 INFO:tasks.workunit.client.1.smithi120.stdout:9/225: creat d0/dd/d45/f4a x:0 0 0 2024-04-26T21:25:45.132 INFO:tasks.workunit.client.1.smithi120.stdout:0/277: dread - d0/d3/dc/dd/d1b/d39/f3e zero size 2024-04-26T21:25:45.200 INFO:tasks.workunit.client.1.smithi120.stdout:2/307: unlink d4/d1b/d2e/d50/d14/d3c/f60 0 2024-04-26T21:25:45.202 INFO:tasks.workunit.client.1.smithi120.stdout:0/278: fsync d0/d3/d51/f58 0 2024-04-26T21:25:45.206 INFO:tasks.workunit.client.1.smithi120.stdout:5/249: fsync d2/dc/d1d/d1f/f2c 0 2024-04-26T21:25:45.210 INFO:tasks.workunit.client.1.smithi120.stdout:0/279: dread d0/d3/f41 [0,4194304] 0 2024-04-26T21:25:45.212 INFO:tasks.workunit.client.1.smithi120.stdout:4/248: dread d10/f4f [0,4194304] 0 2024-04-26T21:25:45.212 INFO:tasks.workunit.client.1.smithi120.stdout:0/280: stat d0/l19 0 2024-04-26T21:25:45.214 INFO:tasks.workunit.client.1.smithi120.stdout:5/250: read d2/dc/d1d/d1f/f2c [81054,57099] 0 2024-04-26T21:25:45.217 INFO:tasks.workunit.client.1.smithi120.stdout:4/249: write d10/f4f [553699,81329] 0 2024-04-26T21:25:45.222 INFO:tasks.workunit.client.1.smithi120.stdout:0/281: rename d0/d3/dc/dd/l49 to d0/df/d59/l5b 0 2024-04-26T21:25:45.223 INFO:tasks.workunit.client.1.smithi120.stdout:7/221: dwrite d7/d10/d12/f16 [0,4194304] 0 2024-04-26T21:25:45.225 INFO:tasks.workunit.client.1.smithi120.stdout:4/250: chown d10/d12/f58 185343 1 2024-04-26T21:25:45.238 INFO:tasks.workunit.client.1.smithi120.stdout:9/226: dwrite d0/d6/d3d/f40 [0,4194304] 0 2024-04-26T21:25:45.248 INFO:tasks.workunit.client.1.smithi120.stdout:9/227: chown d0/dd/d45 6686407 1 2024-04-26T21:25:45.253 INFO:tasks.workunit.client.1.smithi120.stdout:8/242: dwrite d5/d6/f25 [0,4194304] 0 2024-04-26T21:25:45.258 INFO:tasks.workunit.client.1.smithi120.stdout:2/308: dwrite d4/d1b/f38 [4194304,4194304] 0 2024-04-26T21:25:45.262 INFO:tasks.workunit.client.1.smithi120.stdout:9/228: read d0/d14/d2d/f2f [1085949,101287] 0 2024-04-26T21:25:45.262 INFO:tasks.workunit.client.1.smithi120.stdout:0/282: dwrite d0/f14 [0,4194304] 0 2024-04-26T21:25:45.265 INFO:tasks.workunit.client.1.smithi120.stdout:1/228: sync 2024-04-26T21:25:45.267 INFO:tasks.workunit.client.1.smithi120.stdout:4/251: dread d10/d12/f19 [0,4194304] 0 2024-04-26T21:25:45.272 INFO:tasks.workunit.client.1.smithi120.stdout:2/309: symlink d4/d1b/d2e/l6b 0 2024-04-26T21:25:45.273 INFO:tasks.workunit.client.1.smithi120.stdout:7/222: dwrite d7/d19/f35 [0,4194304] 0 2024-04-26T21:25:45.273 INFO:tasks.workunit.client.1.smithi120.stdout:5/251: dwrite d2/dc/d1d/f33 [0,4194304] 0 2024-04-26T21:25:45.274 INFO:tasks.workunit.client.1.smithi120.stdout:9/229: mkdir d0/d14/d2d/d4b 0 2024-04-26T21:25:45.277 INFO:tasks.workunit.client.1.smithi120.stdout:4/252: rmdir d10/d12 39 2024-04-26T21:25:45.279 INFO:tasks.workunit.client.1.smithi120.stdout:1/229: symlink d6/d14/l4d 0 2024-04-26T21:25:45.279 INFO:tasks.workunit.client.1.smithi120.stdout:7/223: truncate d7/d10/d12/f16 4618201 0 2024-04-26T21:25:45.282 INFO:tasks.workunit.client.1.smithi120.stdout:1/230: chown d6/d7/da/dd/fe 36 1 2024-04-26T21:25:45.286 INFO:tasks.workunit.client.1.smithi120.stdout:9/230: unlink d0/d14/f3b 0 2024-04-26T21:25:45.287 INFO:tasks.workunit.client.1.smithi120.stdout:6/239: sync 2024-04-26T21:25:45.289 INFO:tasks.workunit.client.1.smithi120.stdout:6/240: read d4/f31 [2349161,123518] 0 2024-04-26T21:25:45.291 INFO:tasks.workunit.client.1.smithi120.stdout:5/252: creat d2/d1b/d29/f50 x:0 0 0 2024-04-26T21:25:45.295 INFO:tasks.workunit.client.1.smithi120.stdout:0/283: mknod d0/d3/dc/dd/d4b/c5c 0 2024-04-26T21:25:45.296 INFO:tasks.workunit.client.1.smithi120.stdout:2/310: dwrite d4/d1b/d56/f5a [0,4194304] 0 2024-04-26T21:25:45.298 INFO:tasks.workunit.client.1.smithi120.stdout:1/231: read d6/d9/f1e [594079,127123] 0 2024-04-26T21:25:45.300 INFO:tasks.workunit.client.1.smithi120.stdout:4/253: dread d10/d28/f4b [0,4194304] 0 2024-04-26T21:25:45.301 INFO:tasks.workunit.client.1.smithi120.stdout:1/232: stat d6/d7/da/dd/c10 0 2024-04-26T21:25:45.303 INFO:tasks.workunit.client.1.smithi120.stdout:5/253: mknod d2/dc/d1d/d1f/c51 0 2024-04-26T21:25:45.304 INFO:tasks.workunit.client.1.smithi120.stdout:9/231: chown d0/l49 32443 1 2024-04-26T21:25:45.311 INFO:tasks.workunit.client.1.smithi120.stdout:2/311: chown d4/d1b/d2e/d50/f21 9870 1 2024-04-26T21:25:45.312 INFO:tasks.workunit.client.1.smithi120.stdout:1/233: write d6/d9/f1c [3674068,23828] 0 2024-04-26T21:25:45.313 INFO:tasks.workunit.client.1.smithi120.stdout:9/232: mknod d0/dd/c4c 0 2024-04-26T21:25:45.315 INFO:tasks.workunit.client.1.smithi120.stdout:5/254: mknod d2/dc/d1d/d21/c52 0 2024-04-26T21:25:45.320 INFO:tasks.workunit.client.1.smithi120.stdout:7/224: dwrite d7/d10/d12/d1f/f3a [0,4194304] 0 2024-04-26T21:25:45.322 INFO:tasks.workunit.client.1.smithi120.stdout:8/243: dwrite d5/d6/d11/d32/d3b/f4d [0,4194304] 0 2024-04-26T21:25:45.322 INFO:tasks.workunit.client.1.smithi120.stdout:1/234: chown d6/d7/d1b/c43 18257 1 2024-04-26T21:25:45.323 INFO:tasks.workunit.client.1.smithi120.stdout:5/255: dread d2/d1b/f35 [0,4194304] 0 2024-04-26T21:25:45.326 INFO:tasks.workunit.client.1.smithi120.stdout:2/312: write d4/d1b/d25/d2c/d3e/d5e/f61 [3923557,55213] 0 2024-04-26T21:25:45.330 INFO:tasks.workunit.client.1.smithi120.stdout:8/244: fsync d5/d6/d11/d52/d27/f33 0 2024-04-26T21:25:45.335 INFO:tasks.workunit.client.1.smithi120.stdout:0/284: dwrite d0/d3/dc/f1c [0,4194304] 0 2024-04-26T21:25:45.336 INFO:tasks.workunit.client.1.smithi120.stdout:4/254: dwrite fe [0,4194304] 0 2024-04-26T21:25:45.338 INFO:tasks.workunit.client.1.smithi120.stdout:7/225: mkdir d7/d10/d12/d1a/d50 0 2024-04-26T21:25:45.340 INFO:tasks.workunit.client.1.smithi120.stdout:1/235: mknod d6/d14/d3c/c4e 0 2024-04-26T21:25:45.344 INFO:tasks.workunit.client.1.smithi120.stdout:2/313: fdatasync d4/d1b/d2e/d50/f3f 0 2024-04-26T21:25:45.344 INFO:tasks.workunit.client.1.smithi120.stdout:0/285: fdatasync d0/df/f3f 0 2024-04-26T21:25:45.347 INFO:tasks.workunit.client.1.smithi120.stdout:8/245: getdents d5/d6/d11/d32/d3b 0 2024-04-26T21:25:45.349 INFO:tasks.workunit.client.1.smithi120.stdout:6/241: dread d4/db/f23 [0,4194304] 0 2024-04-26T21:25:45.350 INFO:tasks.workunit.client.1.smithi120.stdout:7/226: stat d7/d10/d12/d1f/d28/d4c 0 2024-04-26T21:25:45.353 INFO:tasks.workunit.client.1.smithi120.stdout:0/286: symlink d0/d3/dc/dd/d1b/d39/l5d 0 2024-04-26T21:25:45.358 INFO:tasks.workunit.client.1.smithi120.stdout:8/246: getdents d5/d6/d11 0 2024-04-26T21:25:45.360 INFO:tasks.workunit.client.1.smithi120.stdout:6/242: write d4/db/d10/dd/f26 [2084061,114705] 0 2024-04-26T21:25:45.361 INFO:tasks.workunit.client.1.smithi120.stdout:0/287: stat d0/d3/dc/d12/l52 0 2024-04-26T21:25:45.362 INFO:tasks.workunit.client.1.smithi120.stdout:8/247: readlink d5/d6/l3d 0 2024-04-26T21:25:45.363 INFO:tasks.workunit.client.1.smithi120.stdout:0/288: fsync d0/f2c 0 2024-04-26T21:25:45.364 INFO:tasks.workunit.client.1.smithi120.stdout:5/256: dwrite d2/dc/d1d/d1f/d36/f40 [0,4194304] 0 2024-04-26T21:25:45.367 INFO:tasks.workunit.client.1.smithi120.stdout:6/243: truncate d4/db/d10/dd/d43/f46 423829 0 2024-04-26T21:25:45.368 INFO:tasks.workunit.client.1.smithi120.stdout:7/227: dread d7/d10/d12/f14 [4194304,4194304] 0 2024-04-26T21:25:45.368 INFO:tasks.workunit.client.1.smithi120.stdout:4/255: dwrite d10/f47 [0,4194304] 0 2024-04-26T21:25:45.369 INFO:tasks.workunit.client.1.smithi120.stdout:6/244: readlink d4/db/lc 0 2024-04-26T21:25:45.370 INFO:tasks.workunit.client.1.smithi120.stdout:2/314: dread d4/d1b/f38 [0,4194304] 0 2024-04-26T21:25:45.373 INFO:tasks.workunit.client.1.smithi120.stdout:2/315: write d4/d1b/d25/d2c/d3e/d5e/f61 [3872276,18741] 0 2024-04-26T21:25:45.377 INFO:tasks.workunit.client.1.smithi120.stdout:6/245: dread d4/f1f [0,4194304] 0 2024-04-26T21:25:45.377 INFO:tasks.workunit.client.1.smithi120.stdout:3/174: sync 2024-04-26T21:25:45.380 INFO:tasks.workunit.client.1.smithi120.stdout:3/175: dread dd/de/f2f [0,4194304] 0 2024-04-26T21:25:45.388 INFO:tasks.workunit.client.1.smithi120.stdout:6/246: dread d4/f41 [0,4194304] 0 2024-04-26T21:25:45.394 INFO:tasks.workunit.client.1.smithi120.stdout:3/176: dwrite f6 [4194304,4194304] 0 2024-04-26T21:25:45.396 INFO:tasks.workunit.client.1.smithi120.stdout:3/177: fsync dd/de/d18/f22 0 2024-04-26T21:25:45.405 INFO:tasks.workunit.client.1.smithi120.stdout:3/178: dread dd/de/df/d12/f21 [0,4194304] 0 2024-04-26T21:25:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:45 smithi084 ceph-mon[25539]: pgmap v37: 65 pgs: 65 active+clean; 458 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 823 KiB/s rd, 35 MiB/s wr, 135 op/s 2024-04-26T21:25:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:45 smithi120 ceph-mon[32741]: pgmap v37: 65 pgs: 65 active+clean; 458 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 823 KiB/s rd, 35 MiB/s wr, 135 op/s 2024-04-26T21:25:45.441 INFO:tasks.workunit.client.1.smithi120.stdout:6/247: fdatasync d4/db/d10/dd/f26 0 2024-04-26T21:25:45.443 INFO:tasks.workunit.client.1.smithi120.stdout:9/233: dread d0/f18 [0,4194304] 0 2024-04-26T21:25:45.489 INFO:tasks.workunit.client.1.smithi120.stdout:1/236: sync 2024-04-26T21:25:45.491 INFO:tasks.workunit.client.1.smithi120.stdout:1/237: fdatasync d6/d14/f16 0 2024-04-26T21:25:45.493 INFO:tasks.workunit.client.1.smithi120.stdout:1/238: fsync d6/d7/da/dd/f42 0 2024-04-26T21:25:45.497 INFO:tasks.workunit.client.1.smithi120.stdout:1/239: truncate d6/d7/da/dd/f42 646781 0 2024-04-26T21:25:45.619 INFO:tasks.workunit.client.1.smithi120.stdout:5/257: fdatasync d2/f17 0 2024-04-26T21:25:45.628 INFO:tasks.workunit.client.1.smithi120.stdout:7/228: creat d7/d19/f51 x:0 0 0 2024-04-26T21:25:45.635 INFO:tasks.workunit.client.1.smithi120.stdout:5/258: dread d2/d1b/d22/f42 [0,4194304] 0 2024-04-26T21:25:45.639 INFO:tasks.workunit.client.1.smithi120.stdout:6/248: mknod d4/db/d25/c47 0 2024-04-26T21:25:45.639 INFO:tasks.workunit.client.1.smithi120.stdout:9/234: mkdir d0/d6/d4d 0 2024-04-26T21:25:45.642 INFO:tasks.workunit.client.1.smithi120.stdout:5/259: dread d2/f3f [0,4194304] 0 2024-04-26T21:25:45.642 INFO:tasks.workunit.client.1.smithi120.stdout:9/235: chown d0/d6/l7 110 1 2024-04-26T21:25:45.645 INFO:tasks.workunit.client.1.smithi120.stdout:8/248: symlink d5/d6/l54 0 2024-04-26T21:25:45.645 INFO:tasks.workunit.client.1.smithi120.stdout:0/289: rename d0/d3/dc/dd/d1b/d24/f2f to d0/d3/dc/d12/d31/f5e 0 2024-04-26T21:25:45.664 INFO:tasks.workunit.client.1.smithi120.stdout:9/236: dwrite d0/fa [0,4194304] 0 2024-04-26T21:25:45.794 INFO:tasks.workunit.client.1.smithi120.stdout:8/249: sync 2024-04-26T21:25:45.795 INFO:tasks.workunit.client.1.smithi120.stdout:5/260: sync 2024-04-26T21:25:45.870 INFO:tasks.workunit.client.1.smithi120.stdout:7/229: creat d7/d10/d12/d2f/f52 x:0 0 0 2024-04-26T21:25:45.873 INFO:tasks.workunit.client.1.smithi120.stdout:7/230: chown d7/d10/c46 4 1 2024-04-26T21:25:45.875 INFO:tasks.workunit.client.1.smithi120.stdout:7/231: fsync d7/d19/f44 0 2024-04-26T21:25:45.875 INFO:tasks.workunit.client.1.smithi120.stdout:3/179: link f6 dd/de/df/f35 0 2024-04-26T21:25:45.881 INFO:tasks.workunit.client.1.smithi120.stdout:3/180: read dd/de/df/d12/f21 [1537296,39648] 0 2024-04-26T21:25:45.884 INFO:tasks.workunit.client.1.smithi120.stdout:3/181: chown dd/de/df/d1e 19 1 2024-04-26T21:25:45.887 INFO:tasks.workunit.client.1.smithi120.stdout:3/182: stat dd/de/df/f16 0 2024-04-26T21:25:45.890 INFO:tasks.workunit.client.1.smithi120.stdout:0/290: symlink d0/d3/l5f 0 2024-04-26T21:25:45.892 INFO:tasks.workunit.client.1.smithi120.stdout:9/237: creat d0/d6/d3d/f4e x:0 0 0 2024-04-26T21:25:45.895 INFO:tasks.workunit.client.1.smithi120.stdout:8/250: mkdir d5/d2e/d55 0 2024-04-26T21:25:45.901 INFO:tasks.workunit.client.1.smithi120.stdout:1/240: link d6/d7/da/c25 d6/d7/d2d/c4f 0 2024-04-26T21:25:45.901 INFO:tasks.workunit.client.1.smithi120.stdout:8/251: chown d5/d6/l23 61258276 1 2024-04-26T21:25:45.903 INFO:tasks.workunit.client.1.smithi120.stdout:7/232: creat d7/d10/d12/d1f/d28/f53 x:0 0 0 2024-04-26T21:25:45.906 INFO:tasks.workunit.client.1.smithi120.stdout:8/252: dread - d5/d2e/f3a zero size 2024-04-26T21:25:45.908 INFO:tasks.workunit.client.1.smithi120.stdout:1/241: chown d6/d7/da/f28 43 1 2024-04-26T21:25:45.914 INFO:tasks.workunit.client.1.smithi120.stdout:6/249: dwrite f1 [0,4194304] 0 2024-04-26T21:25:45.915 INFO:tasks.workunit.client.1.smithi120.stdout:0/291: creat d0/d3/d13/f60 x:0 0 0 2024-04-26T21:25:45.915 INFO:tasks.workunit.client.1.smithi120.stdout:9/238: creat d0/f4f x:0 0 0 2024-04-26T21:25:45.920 INFO:tasks.workunit.client.1.smithi120.stdout:4/256: getdents d10/d12 0 2024-04-26T21:25:45.925 INFO:tasks.workunit.client.1.smithi120.stdout:0/292: truncate d0/f2c 1180383 0 2024-04-26T21:25:45.927 INFO:tasks.workunit.client.1.smithi120.stdout:7/233: creat d7/d10/d12/d1a/d50/f54 x:0 0 0 2024-04-26T21:25:45.929 INFO:tasks.workunit.client.1.smithi120.stdout:0/293: chown d0/d3/dc/dd/d4b 204 1 2024-04-26T21:25:45.933 INFO:tasks.workunit.client.1.smithi120.stdout:4/257: mkdir d10/d12/d59 0 2024-04-26T21:25:45.935 INFO:tasks.workunit.client.1.smithi120.stdout:0/294: truncate d0/d3/f3d 498259 0 2024-04-26T21:25:45.942 INFO:tasks.workunit.client.1.smithi120.stdout:8/253: dread d5/d6/d11/d32/f45 [0,4194304] 0 2024-04-26T21:25:45.944 INFO:tasks.workunit.client.1.smithi120.stdout:1/242: link d6/d7/d1d/d2c/f2f d6/d7/d1d/f50 0 2024-04-26T21:25:45.945 INFO:tasks.workunit.client.1.smithi120.stdout:6/250: dwrite d4/db/f35 [0,4194304] 0 2024-04-26T21:25:45.948 INFO:tasks.workunit.client.1.smithi120.stdout:6/251: write d4/db/fe [3461317,17430] 0 2024-04-26T21:25:45.949 INFO:tasks.workunit.client.1.smithi120.stdout:2/316: truncate d4/d1b/d2e/d50/d14/d15/f2b 1867380 0 2024-04-26T21:25:45.959 INFO:tasks.workunit.client.1.smithi120.stdout:4/258: symlink d10/l5a 0 2024-04-26T21:25:45.964 INFO:tasks.workunit.client.1.smithi120.stdout:3/183: dwrite dd/de/f2f [0,4194304] 0 2024-04-26T21:25:45.967 INFO:tasks.workunit.client.1.smithi120.stdout:3/184: dread - dd/f31 zero size 2024-04-26T21:25:45.968 INFO:tasks.workunit.client.1.smithi120.stdout:9/239: link d0/l22 d0/d6/d3d/l50 0 2024-04-26T21:25:45.971 INFO:tasks.workunit.client.1.smithi120.stdout:9/240: chown d0/d6/d3d/f40 224 1 2024-04-26T21:25:45.973 INFO:tasks.workunit.client.1.smithi120.stdout:1/243: creat d6/f51 x:0 0 0 2024-04-26T21:25:45.976 INFO:tasks.workunit.client.1.smithi120.stdout:2/317: getdents d4/d1b/d25/d2c/d3e/d5e/d63 0 2024-04-26T21:25:45.976 INFO:tasks.workunit.client.1.smithi120.stdout:8/254: dwrite d5/d6/d11/d52/d27/f51 [0,4194304] 0 2024-04-26T21:25:45.981 INFO:tasks.workunit.client.1.smithi120.stdout:7/234: truncate d7/ff 1432362 0 2024-04-26T21:25:45.983 INFO:tasks.workunit.client.1.smithi120.stdout:9/241: creat d0/dd/d45/f51 x:0 0 0 2024-04-26T21:25:45.985 INFO:tasks.workunit.client.1.smithi120.stdout:7/235: write d7/d19/f35 [1405558,72422] 0 2024-04-26T21:25:45.987 INFO:tasks.workunit.client.1.smithi120.stdout:1/244: mknod d6/d9/c52 0 2024-04-26T21:25:45.987 INFO:tasks.workunit.client.1.smithi120.stdout:0/295: write d0/d3/dc/f27 [679187,44869] 0 2024-04-26T21:25:45.992 INFO:tasks.workunit.client.1.smithi120.stdout:6/252: dwrite d4/f31 [0,4194304] 0 2024-04-26T21:25:45.992 INFO:tasks.workunit.client.1.smithi120.stdout:3/185: mkdir dd/de/d18/d36 0 2024-04-26T21:25:45.993 INFO:tasks.workunit.client.1.smithi120.stdout:4/259: dwrite d10/d12/f14 [0,4194304] 0 2024-04-26T21:25:45.995 INFO:tasks.workunit.client.1.smithi120.stdout:4/260: readlink l7 0 2024-04-26T21:25:45.998 INFO:tasks.workunit.client.1.smithi120.stdout:0/296: chown d0/f35 0 1 2024-04-26T21:25:45.998 INFO:tasks.workunit.client.1.smithi120.stdout:4/261: chown d10/l4a 1 1 2024-04-26T21:25:46.000 INFO:tasks.workunit.client.1.smithi120.stdout:2/318: dread f1 [0,4194304] 0 2024-04-26T21:25:46.001 INFO:tasks.workunit.client.1.smithi120.stdout:0/297: dread - d0/d3/dc/d12/d31/f43 zero size 2024-04-26T21:25:46.002 INFO:tasks.workunit.client.1.smithi120.stdout:8/255: truncate d5/f15 70232 0 2024-04-26T21:25:46.005 INFO:tasks.workunit.client.1.smithi120.stdout:6/253: creat d4/db/d10/dd/d43/f48 x:0 0 0 2024-04-26T21:25:46.008 INFO:tasks.workunit.client.1.smithi120.stdout:9/242: link d0/d6/f47 d0/d6/f52 0 2024-04-26T21:25:46.010 INFO:tasks.workunit.client.1.smithi120.stdout:6/254: write d4/db/d10/dd/f18 [5038911,11153] 0 2024-04-26T21:25:46.011 INFO:tasks.workunit.client.1.smithi120.stdout:3/186: mkdir dd/de/d18/d37 0 2024-04-26T21:25:46.016 INFO:tasks.workunit.client.1.smithi120.stdout:2/319: mkdir d4/d1b/d2e/d50/d14/d15/d6c 0 2024-04-26T21:25:46.016 INFO:tasks.workunit.client.1.smithi120.stdout:0/298: creat d0/d3/d13/d5a/f61 x:0 0 0 2024-04-26T21:25:46.016 INFO:tasks.workunit.client.1.smithi120.stdout:9/243: chown d0/dd/d3a/f3f 78398 1 2024-04-26T21:25:46.017 INFO:tasks.workunit.client.1.smithi120.stdout:8/256: read - d5/d6/d34/f39 zero size 2024-04-26T21:25:46.017 INFO:tasks.workunit.client.1.smithi120.stdout:6/255: symlink d4/db/d10/d1a/d2b/l49 0 2024-04-26T21:25:46.021 INFO:tasks.workunit.client.1.smithi120.stdout:8/257: dread - d5/d2e/f3a zero size 2024-04-26T21:25:46.022 INFO:tasks.workunit.client.1.smithi120.stdout:3/187: truncate dd/de/d18/f25 1871073 0 2024-04-26T21:25:46.022 INFO:tasks.workunit.client.1.smithi120.stdout:6/256: readlink d4/db/d10/d22/l33 0 2024-04-26T21:25:46.024 INFO:tasks.workunit.client.1.smithi120.stdout:8/258: stat d5/d6/d34/f39 0 2024-04-26T21:25:46.027 INFO:tasks.workunit.client.1.smithi120.stdout:9/244: mknod d0/d6/d4d/c53 0 2024-04-26T21:25:46.029 INFO:tasks.workunit.client.1.smithi120.stdout:6/257: creat d4/d27/f4a x:0 0 0 2024-04-26T21:25:46.030 INFO:tasks.workunit.client.1.smithi120.stdout:3/188: mknod dd/de/d18/d24/c38 0 2024-04-26T21:25:46.034 INFO:tasks.workunit.client.1.smithi120.stdout:0/299: getdents d0/d3/dc/d12 0 2024-04-26T21:25:46.037 INFO:tasks.workunit.client.1.smithi120.stdout:3/189: fsync dd/de/df/f16 0 2024-04-26T21:25:46.039 INFO:tasks.workunit.client.1.smithi120.stdout:6/258: creat d4/db/d25/f4b x:0 0 0 2024-04-26T21:25:46.041 INFO:tasks.workunit.client.1.smithi120.stdout:0/300: mknod d0/df/c62 0 2024-04-26T21:25:46.042 INFO:tasks.workunit.client.1.smithi120.stdout:7/236: dwrite d7/d19/f24 [0,4194304] 0 2024-04-26T21:25:46.042 INFO:tasks.workunit.client.1.smithi120.stdout:8/259: truncate d5/d6/d11/f2a 1590879 0 2024-04-26T21:25:46.045 INFO:tasks.workunit.client.1.smithi120.stdout:9/245: rmdir d0/dd/d34/d48 0 2024-04-26T21:25:46.045 INFO:tasks.workunit.client.1.smithi120.stdout:2/320: dwrite d4/d1b/d4f/f6a [0,4194304] 0 2024-04-26T21:25:46.049 INFO:tasks.workunit.client.1.smithi120.stdout:1/245: dread d6/d9/f1c [0,4194304] 0 2024-04-26T21:25:46.050 INFO:tasks.workunit.client.1.smithi120.stdout:5/261: sync 2024-04-26T21:25:46.052 INFO:tasks.workunit.client.1.smithi120.stdout:8/260: creat d5/d6/d11/d32/d3b/f56 x:0 0 0 2024-04-26T21:25:46.052 INFO:tasks.workunit.client.1.smithi120.stdout:9/246: write d0/dd/f12 [899178,95808] 0 2024-04-26T21:25:46.054 INFO:tasks.workunit.client.1.smithi120.stdout:2/321: mknod d4/d1b/d25/d2c/d3e/d5e/c6d 0 2024-04-26T21:25:46.054 INFO:tasks.workunit.client.1.smithi120.stdout:1/246: chown d6/d7/da/l29 36894 1 2024-04-26T21:25:46.060 INFO:tasks.workunit.client.1.smithi120.stdout:2/322: write d4/d1b/d2e/d50/d14/d15/f45 [802954,71099] 0 2024-04-26T21:25:46.061 INFO:tasks.workunit.client.1.smithi120.stdout:9/247: creat d0/f54 x:0 0 0 2024-04-26T21:25:46.062 INFO:tasks.workunit.client.1.smithi120.stdout:1/247: truncate d6/f51 803901 0 2024-04-26T21:25:46.064 INFO:tasks.workunit.client.1.smithi120.stdout:0/301: getdents d0/d3/dc/dd/d1b 0 2024-04-26T21:25:46.066 INFO:tasks.workunit.client.1.smithi120.stdout:5/262: creat d2/d1b/d22/d47/f53 x:0 0 0 2024-04-26T21:25:46.068 INFO:tasks.workunit.client.1.smithi120.stdout:1/248: chown d6/d7/d1b/c2e 198794 1 2024-04-26T21:25:46.069 INFO:tasks.workunit.client.1.smithi120.stdout:9/248: rename d0/d6/f8 to d0/d14/d2d/d4b/f55 0 2024-04-26T21:25:46.071 INFO:tasks.workunit.client.1.smithi120.stdout:7/237: dread d7/d19/f35 [0,4194304] 0 2024-04-26T21:25:46.071 INFO:tasks.workunit.client.1.smithi120.stdout:0/302: creat d0/df/f63 x:0 0 0 2024-04-26T21:25:46.074 INFO:tasks.workunit.client.1.smithi120.stdout:9/249: creat d0/dd/f56 x:0 0 0 2024-04-26T21:25:46.077 INFO:tasks.workunit.client.1.smithi120.stdout:3/190: dread dd/de/df/d12/f21 [0,4194304] 0 2024-04-26T21:25:46.077 INFO:tasks.workunit.client.1.smithi120.stdout:9/250: readlink d0/l1b 0 2024-04-26T21:25:46.078 INFO:tasks.workunit.client.1.smithi120.stdout:0/303: mkdir d0/d3/d13/d64 0 2024-04-26T21:25:46.078 INFO:tasks.workunit.client.1.smithi120.stdout:7/238: rename d7/l1c to d7/l55 0 2024-04-26T21:25:46.080 INFO:tasks.workunit.client.1.smithi120.stdout:5/263: mknod d2/c54 0 2024-04-26T21:25:46.082 INFO:tasks.workunit.client.1.smithi120.stdout:7/239: mkdir d7/d19/d56 0 2024-04-26T21:25:46.087 INFO:tasks.workunit.client.1.smithi120.stdout:8/261: write d5/d6/d11/f2a [2097147,101523] 0 2024-04-26T21:25:46.087 INFO:tasks.workunit.client.1.smithi120.stdout:3/191: creat dd/de/d18/d36/f39 x:0 0 0 2024-04-26T21:25:46.087 INFO:tasks.workunit.client.1.smithi120.stdout:5/264: symlink d2/db/l55 0 2024-04-26T21:25:46.089 INFO:tasks.workunit.client.1.smithi120.stdout:6/259: dread d4/f14 [0,4194304] 0 2024-04-26T21:25:46.089 INFO:tasks.workunit.client.1.smithi120.stdout:2/323: truncate d4/d1b/f41 1268205 0 2024-04-26T21:25:46.090 INFO:tasks.workunit.client.1.smithi120.stdout:9/251: link d0/fa d0/dd/d34/f57 0 2024-04-26T21:25:46.092 INFO:tasks.workunit.client.1.smithi120.stdout:0/304: symlink d0/d3/dc/l65 0 2024-04-26T21:25:46.092 INFO:tasks.workunit.client.1.smithi120.stdout:6/260: chown d4/db/d10/d22/l33 843307548 1 2024-04-26T21:25:46.094 INFO:tasks.workunit.client.1.smithi120.stdout:3/192: fdatasync f5 0 2024-04-26T21:25:46.095 INFO:tasks.workunit.client.1.smithi120.stdout:5/265: stat d2/dc/d1d/d2e/l49 0 2024-04-26T21:25:46.096 INFO:tasks.workunit.client.1.smithi120.stdout:2/324: symlink d4/d1b/d4f/l6e 0 2024-04-26T21:25:46.097 INFO:tasks.workunit.client.1.smithi120.stdout:7/240: mknod d7/d10/d12/d1a/d33/d34/c57 0 2024-04-26T21:25:46.099 INFO:tasks.workunit.client.1.smithi120.stdout:0/305: truncate d0/d3/dc/d12/d31/f33 789371 0 2024-04-26T21:25:46.099 INFO:tasks.workunit.client.1.smithi120.stdout:6/261: creat d4/db/d10/d1a/d2b/f4c x:0 0 0 2024-04-26T21:25:46.100 INFO:tasks.workunit.client.1.smithi120.stdout:7/241: fdatasync d7/d10/d12/f42 0 2024-04-26T21:25:46.103 INFO:tasks.workunit.client.1.smithi120.stdout:1/249: dread d6/d7/d1d/f50 [4194304,4194304] 0 2024-04-26T21:25:46.104 INFO:tasks.workunit.client.1.smithi120.stdout:3/193: fsync dd/de/d18/d36/f39 0 2024-04-26T21:25:46.106 INFO:tasks.workunit.client.1.smithi120.stdout:7/242: stat d7/d10/d12/d1f/f48 0 2024-04-26T21:25:46.108 INFO:tasks.workunit.client.1.smithi120.stdout:6/262: symlink d4/db/d25/l4d 0 2024-04-26T21:25:46.110 INFO:tasks.workunit.client.1.smithi120.stdout:3/194: creat dd/de/d18/d24/f3a x:0 0 0 2024-04-26T21:25:46.113 INFO:tasks.workunit.client.1.smithi120.stdout:6/263: mkdir d4/db/d10/dd/d4e 0 2024-04-26T21:25:46.114 INFO:tasks.workunit.client.1.smithi120.stdout:8/262: dread d5/d6/d11/d32/d3b/f4d [0,4194304] 0 2024-04-26T21:25:46.114 INFO:tasks.workunit.client.1.smithi120.stdout:5/266: write d2/f17 [2642426,119978] 0 2024-04-26T21:25:46.116 INFO:tasks.workunit.client.1.smithi120.stdout:0/306: link d0/d3/dc/dd/f45 d0/f66 0 2024-04-26T21:25:46.117 INFO:tasks.workunit.client.1.smithi120.stdout:9/252: dwrite d0/d14/f35 [0,4194304] 0 2024-04-26T21:25:46.121 INFO:tasks.workunit.client.1.smithi120.stdout:8/263: dread - d5/d6/d11/d32/d3b/f56 zero size 2024-04-26T21:25:46.121 INFO:tasks.workunit.client.1.smithi120.stdout:0/307: truncate d0/f66 704339 0 2024-04-26T21:25:46.122 INFO:tasks.workunit.client.1.smithi120.stdout:7/243: rmdir d7/d10/d12/d4e 0 2024-04-26T21:25:46.122 INFO:tasks.workunit.client.1.smithi120.stdout:5/267: stat d2/db/l39 0 2024-04-26T21:25:46.123 INFO:tasks.workunit.client.1.smithi120.stdout:9/253: read d0/dd/f12 [619611,845] 0 2024-04-26T21:25:46.123 INFO:tasks.workunit.client.1.smithi120.stdout:2/325: dwrite d4/d1b/d2e/d50/d14/d15/f45 [0,4194304] 0 2024-04-26T21:25:46.125 INFO:tasks.workunit.client.1.smithi120.stdout:6/264: mknod d4/db/d10/d1a/c4f 0 2024-04-26T21:25:46.127 INFO:tasks.workunit.client.1.smithi120.stdout:3/195: rmdir dd/de 39 2024-04-26T21:25:46.128 INFO:tasks.workunit.client.1.smithi120.stdout:1/250: getdents d6/d7/d1d/d2c 0 2024-04-26T21:25:46.128 INFO:tasks.workunit.client.1.smithi120.stdout:9/254: truncate d0/dd/d45/f4a 600125 0 2024-04-26T21:25:46.132 INFO:tasks.workunit.client.1.smithi120.stdout:0/308: symlink d0/d3/dc/dd/d1b/d39/l67 0 2024-04-26T21:25:46.136 INFO:tasks.workunit.client.1.smithi120.stdout:0/309: write d0/d3/d13/f20 [1997788,115317] 0 2024-04-26T21:25:46.138 INFO:tasks.workunit.client.1.smithi120.stdout:7/244: mknod d7/d10/d12/d1a/d33/c58 0 2024-04-26T21:25:46.138 INFO:tasks.workunit.client.1.smithi120.stdout:0/310: dread - d0/d3/d13/d5a/f61 zero size 2024-04-26T21:25:46.139 INFO:tasks.workunit.client.1.smithi120.stdout:9/255: fdatasync d0/dd/d45/f51 0 2024-04-26T21:25:46.140 INFO:tasks.workunit.client.1.smithi120.stdout:7/245: fdatasync d7/d10/d12/d1f/f3a 0 2024-04-26T21:25:46.140 INFO:tasks.workunit.client.1.smithi120.stdout:9/256: dread - d0/dd/f56 zero size 2024-04-26T21:25:46.140 INFO:tasks.workunit.client.1.smithi120.stdout:0/311: chown d0/d3/f3d 1506468 1 2024-04-26T21:25:46.141 INFO:tasks.workunit.client.1.smithi120.stdout:8/264: unlink d5/d6/d11/d52/d27/f33 0 2024-04-26T21:25:46.144 INFO:tasks.workunit.client.1.smithi120.stdout:2/326: link d4/d1b/d25/d2c/f22 d4/d1b/d56/d65/f6f 0 2024-04-26T21:25:46.145 INFO:tasks.workunit.client.1.smithi120.stdout:3/196: mkdir dd/de/df/d1e/d3b 0 2024-04-26T21:25:46.148 INFO:tasks.workunit.client.1.smithi120.stdout:7/246: mknod d7/c59 0 2024-04-26T21:25:46.148 INFO:tasks.workunit.client.1.smithi120.stdout:0/312: fsync d0/d3/d13/f20 0 2024-04-26T21:25:46.150 INFO:tasks.workunit.client.1.smithi120.stdout:9/257: fdatasync d0/dd/f12 0 2024-04-26T21:25:46.153 INFO:tasks.workunit.client.1.smithi120.stdout:1/251: dwrite d6/d7/d1d/f47 [0,4194304] 0 2024-04-26T21:25:46.161 INFO:tasks.workunit.client.1.smithi120.stdout:1/252: truncate d6/d9/f1e 197678 0 2024-04-26T21:25:46.161 INFO:tasks.workunit.client.1.smithi120.stdout:0/313: creat d0/d3/dc/d12/d4a/f68 x:0 0 0 2024-04-26T21:25:46.163 INFO:tasks.workunit.client.1.smithi120.stdout:6/265: rename d4/db/d10/d1a/c38 to d4/db/d10/c50 0 2024-04-26T21:25:46.168 INFO:tasks.workunit.client.1.smithi120.stdout:1/253: fdatasync d6/d7/da/fb 0 2024-04-26T21:25:46.169 INFO:tasks.workunit.client.1.smithi120.stdout:8/265: rename d5/f16 to d5/d6/d34/d42/d4a/f57 0 2024-04-26T21:25:46.172 INFO:tasks.workunit.client.1.smithi120.stdout:6/266: chown d4/db/d10/ca 4436676 1 2024-04-26T21:25:46.174 INFO:tasks.workunit.client.1.smithi120.stdout:2/327: write d4/d1b/d2e/d50/f3f [4413519,62146] 0 2024-04-26T21:25:46.175 INFO:tasks.workunit.client.1.smithi120.stdout:8/266: symlink d5/d2e/d55/l58 0 2024-04-26T21:25:46.175 INFO:tasks.workunit.client.1.smithi120.stdout:7/247: dwrite d7/d19/f51 [0,4194304] 0 2024-04-26T21:25:46.177 INFO:tasks.workunit.client.0.smithi084.stdout:5/10: sync 2024-04-26T21:25:46.177 INFO:tasks.workunit.client.0.smithi084.stdout:1/2: sync 2024-04-26T21:25:46.177 INFO:tasks.workunit.client.0.smithi084.stdout:5/11: fsync - no filename 2024-04-26T21:25:46.177 INFO:tasks.workunit.client.0.smithi084.stdout:5/12: readlink - no filename 2024-04-26T21:25:46.177 INFO:tasks.workunit.client.0.smithi084.stdout:6/19: sync 2024-04-26T21:25:46.178 INFO:tasks.workunit.client.0.smithi084.stdout:3/36: sync 2024-04-26T21:25:46.178 INFO:tasks.workunit.client.0.smithi084.stdout:7/15: sync 2024-04-26T21:25:46.178 INFO:tasks.workunit.client.0.smithi084.stdout:2/81: sync 2024-04-26T21:25:46.179 INFO:tasks.workunit.client.0.smithi084.stdout:4/12: sync 2024-04-26T21:25:46.179 INFO:tasks.workunit.client.0.smithi084.stdout:9/11: sync 2024-04-26T21:25:46.179 INFO:tasks.workunit.client.0.smithi084.stdout:8/7: sync 2024-04-26T21:25:46.179 INFO:tasks.workunit.client.0.smithi084.stdout:0/19: sync 2024-04-26T21:25:46.180 INFO:tasks.workunit.client.0.smithi084.stdout:1/3: mknod c1 0 2024-04-26T21:25:46.181 INFO:tasks.workunit.client.1.smithi120.stdout:9/258: dwrite d0/d14/f35 [0,4194304] 0 2024-04-26T21:25:46.182 INFO:tasks.workunit.client.0.smithi084.stdout:1/4: stat c1 0 2024-04-26T21:25:46.182 INFO:tasks.workunit.client.0.smithi084.stdout:1/5: read - no filename 2024-04-26T21:25:46.183 INFO:tasks.workunit.client.0.smithi084.stdout:5/13: creat d0/f2 x:0 0 0 2024-04-26T21:25:46.183 INFO:tasks.workunit.client.0.smithi084.stdout:0/20: chown f0 26153163 1 2024-04-26T21:25:46.184 INFO:tasks.workunit.client.0.smithi084.stdout:8/8: write f0 [4703795,84306] 0 2024-04-26T21:25:46.185 INFO:tasks.workunit.client.0.smithi084.stdout:4/13: symlink l4 0 2024-04-26T21:25:46.186 INFO:tasks.workunit.client.0.smithi084.stdout:7/16: rename l1 to l4 0 2024-04-26T21:25:46.187 INFO:tasks.workunit.client.0.smithi084.stdout:4/14: stat l1 0 2024-04-26T21:25:46.187 INFO:tasks.workunit.client.0.smithi084.stdout:8/9: chown f0 8090554 1 2024-04-26T21:25:46.187 INFO:tasks.workunit.client.0.smithi084.stdout:9/12: rename f0 to f2 0 2024-04-26T21:25:46.187 INFO:tasks.workunit.client.0.smithi084.stdout:6/20: write f0 [4167326,77321] 0 2024-04-26T21:25:46.190 INFO:tasks.workunit.client.0.smithi084.stdout:3/37: unlink d1/f8 0 2024-04-26T21:25:46.192 INFO:tasks.workunit.client.0.smithi084.stdout:1/6: mkdir d2 0 2024-04-26T21:25:46.193 INFO:tasks.workunit.client.0.smithi084.stdout:2/82: mkdir d6/d1b 0 2024-04-26T21:25:46.194 INFO:tasks.workunit.client.0.smithi084.stdout:5/14: mknod d0/c3 0 2024-04-26T21:25:46.196 INFO:tasks.workunit.client.0.smithi084.stdout:8/10: symlink l2 0 2024-04-26T21:25:46.196 INFO:tasks.workunit.client.0.smithi084.stdout:4/15: mkdir d5 0 2024-04-26T21:25:46.199 INFO:tasks.workunit.client.0.smithi084.stdout:4/16: chown l1 6412 1 2024-04-26T21:25:46.199 INFO:tasks.workunit.client.0.smithi084.stdout:3/38: mknod d1/cc 0 2024-04-26T21:25:46.201 INFO:tasks.workunit.client.0.smithi084.stdout:5/15: unlink d0/c1 0 2024-04-26T21:25:46.203 INFO:tasks.workunit.client.0.smithi084.stdout:6/21: creat d3/f4 x:0 0 0 2024-04-26T21:25:46.203 INFO:tasks.workunit.client.0.smithi084.stdout:3/39: dread - d1/f7 zero size 2024-04-26T21:25:46.204 INFO:tasks.workunit.client.0.smithi084.stdout:1/7: creat d2/f3 x:0 0 0 2024-04-26T21:25:46.210 INFO:tasks.workunit.client.0.smithi084.stdout:1/8: dread - d2/f3 zero size 2024-04-26T21:25:46.211 INFO:tasks.workunit.client.0.smithi084.stdout:5/16: write d0/f2 [282115,93024] 0 2024-04-26T21:25:46.214 INFO:tasks.workunit.client.0.smithi084.stdout:1/9: chown d2 369159 1 2024-04-26T21:25:46.214 INFO:tasks.workunit.client.0.smithi084.stdout:3/40: creat d1/fd x:0 0 0 2024-04-26T21:25:46.216 INFO:tasks.workunit.client.0.smithi084.stdout:0/21: dwrite f0 [0,4194304] 0 2024-04-26T21:25:46.218 INFO:tasks.workunit.client.0.smithi084.stdout:0/22: stat f1 0 2024-04-26T21:25:46.219 INFO:tasks.workunit.client.0.smithi084.stdout:4/17: link l3 d5/l6 0 2024-04-26T21:25:46.220 INFO:tasks.workunit.client.0.smithi084.stdout:3/41: readlink d1/l6 0 2024-04-26T21:25:46.221 INFO:tasks.workunit.client.0.smithi084.stdout:9/13: dwrite f1 [0,4194304] 0 2024-04-26T21:25:46.221 INFO:tasks.workunit.client.0.smithi084.stdout:0/23: unlink l3 0 2024-04-26T21:25:46.224 INFO:tasks.workunit.client.0.smithi084.stdout:9/14: truncate f1 4778654 0 2024-04-26T21:25:46.224 INFO:tasks.workunit.client.0.smithi084.stdout:3/42: dread - d1/f7 zero size 2024-04-26T21:25:46.227 INFO:tasks.workunit.client.0.smithi084.stdout:9/15: truncate f1 5523477 0 2024-04-26T21:25:46.227 INFO:tasks.workunit.client.0.smithi084.stdout:3/43: dread - d1/f9 zero size 2024-04-26T21:25:46.231 INFO:tasks.workunit.client.0.smithi084.stdout:4/18: unlink l3 0 2024-04-26T21:25:46.232 INFO:tasks.workunit.client.0.smithi084.stdout:0/24: dread f1 [0,4194304] 0 2024-04-26T21:25:46.238 INFO:tasks.workunit.client.0.smithi084.stdout:6/22: dread f0 [0,4194304] 0 2024-04-26T21:25:46.240 INFO:tasks.workunit.client.0.smithi084.stdout:3/44: write d1/f9 [675868,77258] 0 2024-04-26T21:25:46.241 INFO:tasks.workunit.client.1.smithi120.stdout:8/267: stat d5/d6/d11/f2a 0 2024-04-26T21:25:46.241 INFO:tasks.workunit.client.1.smithi120.stdout:6/267: chown d4/db/d10/ca 2771 1 2024-04-26T21:25:46.245 INFO:tasks.workunit.client.1.smithi120.stdout:9/259: stat d0/d14/d2d 0 2024-04-26T21:25:46.253 INFO:tasks.workunit.client.1.smithi120.stdout:6/268: chown d4/c6 687604 1 2024-04-26T21:25:46.258 INFO:tasks.workunit.client.1.smithi120.stdout:0/314: dwrite d0/d3/dc/d12/f47 [0,4194304] 0 2024-04-26T21:25:46.258 INFO:tasks.workunit.client.0.smithi084.stdout:3/45: write d1/fd [80907,13884] 0 2024-04-26T21:25:46.258 INFO:tasks.workunit.client.0.smithi084.stdout:0/25: mkdir d5 0 2024-04-26T21:25:46.259 INFO:tasks.workunit.client.1.smithi120.stdout:6/269: chown d4/db/d10/dd/d43/f46 90013 1 2024-04-26T21:25:46.261 INFO:tasks.workunit.client.0.smithi084.stdout:5/17: dwrite d0/f2 [0,4194304] 0 2024-04-26T21:25:46.261 INFO:tasks.workunit.client.0.smithi084.stdout:6/23: creat d3/f5 x:0 0 0 2024-04-26T21:25:46.262 INFO:tasks.workunit.client.1.smithi120.stdout:3/197: dwrite dd/de/df/f35 [4194304,4194304] 0 2024-04-26T21:25:46.264 INFO:tasks.workunit.client.0.smithi084.stdout:9/16: link f2 f3 0 2024-04-26T21:25:46.265 INFO:tasks.workunit.client.0.smithi084.stdout:1/10: dwrite d2/f3 [0,4194304] 0 2024-04-26T21:25:46.265 INFO:tasks.workunit.client.0.smithi084.stdout:4/19: mkdir d5/d7 0 2024-04-26T21:25:46.265 INFO:tasks.workunit.client.0.smithi084.stdout:6/24: chown f1 41 1 2024-04-26T21:25:46.270 INFO:tasks.workunit.client.0.smithi084.stdout:3/46: creat d1/fe x:0 0 0 2024-04-26T21:25:46.274 INFO:tasks.workunit.client.0.smithi084.stdout:3/47: chown d1/fd 20 1 2024-04-26T21:25:46.277 INFO:tasks.workunit.client.1.smithi120.stdout:0/315: link d0/d3/dc/dd/d1b/f38 d0/d3/d13/d64/f69 0 2024-04-26T21:25:46.278 INFO:tasks.workunit.client.1.smithi120.stdout:8/268: dwrite d5/d6/d11/d52/d27/f53 [0,4194304] 0 2024-04-26T21:25:46.280 INFO:tasks.workunit.client.1.smithi120.stdout:3/198: chown dd/de/df/d12/c2b 2 1 2024-04-26T21:25:46.280 INFO:tasks.workunit.client.0.smithi084.stdout:1/11: dread d2/f3 [0,4194304] 0 2024-04-26T21:25:46.283 INFO:tasks.workunit.client.1.smithi120.stdout:8/269: fsync f4 0 2024-04-26T21:25:46.287 INFO:tasks.workunit.client.1.smithi120.stdout:9/260: dwrite d0/d6/f39 [0,4194304] 0 2024-04-26T21:25:46.288 INFO:tasks.workunit.client.1.smithi120.stdout:0/316: unlink d0/d3/f3d 0 2024-04-26T21:25:46.293 INFO:tasks.workunit.client.1.smithi120.stdout:3/199: write dd/de/d18/f22 [3332356,99192] 0 2024-04-26T21:25:46.296 INFO:tasks.workunit.client.1.smithi120.stdout:0/317: chown d0/d3/dc/f44 4 1 2024-04-26T21:25:46.296 INFO:tasks.workunit.client.1.smithi120.stdout:3/200: read - dd/f31 zero size 2024-04-26T21:25:46.302 INFO:tasks.workunit.client.1.smithi120.stdout:9/261: rename d0/d6/d3d/f40 to d0/dd/d3a/f58 0 2024-04-26T21:25:46.306 INFO:tasks.workunit.client.1.smithi120.stdout:0/318: fdatasync d0/d3/d51/f58 0 2024-04-26T21:25:46.307 INFO:tasks.workunit.client.1.smithi120.stdout:9/262: read d0/dd/d45/f4a [289379,49391] 0 2024-04-26T21:25:46.311 INFO:tasks.workunit.client.1.smithi120.stdout:3/201: creat dd/de/d18/d24/f3c x:0 0 0 2024-04-26T21:25:46.316 INFO:tasks.workunit.client.1.smithi120.stdout:6/270: dwrite d4/db/d10/dd/d43/f46 [0,4194304] 0 2024-04-26T21:25:46.326 INFO:tasks.workunit.client.1.smithi120.stdout:6/271: rename d4/db/d10/c3f to d4/db/d10/dd/d4e/c51 0 2024-04-26T21:25:46.327 INFO:tasks.workunit.client.1.smithi120.stdout:0/319: getdents d0/d3/dc/d12 0 2024-04-26T21:25:46.332 INFO:tasks.workunit.client.1.smithi120.stdout:7/248: dread d7/d10/d12/d1f/f3a [4194304,4194304] 0 2024-04-26T21:25:46.332 INFO:tasks.workunit.client.1.smithi120.stdout:0/320: rmdir d0/d3/dc/d12 39 2024-04-26T21:25:46.334 INFO:tasks.workunit.client.1.smithi120.stdout:6/272: creat d4/db/d10/f52 x:0 0 0 2024-04-26T21:25:46.338 INFO:tasks.workunit.client.1.smithi120.stdout:6/273: write d4/db/fe [4463546,83590] 0 2024-04-26T21:25:46.342 INFO:tasks.workunit.client.1.smithi120.stdout:6/274: dread - d4/db/d10/f52 zero size 2024-04-26T21:25:46.343 INFO:tasks.workunit.client.1.smithi120.stdout:0/321: creat d0/d3/dc/d12/f6a x:0 0 0 2024-04-26T21:25:46.348 INFO:tasks.workunit.client.0.smithi084.stdout:0/26: rmdir d5 0 2024-04-26T21:25:46.349 INFO:tasks.workunit.client.0.smithi084.stdout:3/48: creat d1/ff x:0 0 0 2024-04-26T21:25:46.350 INFO:tasks.workunit.client.0.smithi084.stdout:4/20: chown d5/l6 4378 1 2024-04-26T21:25:46.350 INFO:tasks.workunit.client.0.smithi084.stdout:4/21: write - no filename 2024-04-26T21:25:46.353 INFO:tasks.workunit.client.0.smithi084.stdout:3/49: mkdir d1/d10 0 2024-04-26T21:25:46.353 INFO:tasks.workunit.client.0.smithi084.stdout:0/27: write f1 [1308084,71547] 0 2024-04-26T21:25:46.355 INFO:tasks.workunit.client.1.smithi120.stdout:9/263: dwrite d0/d14/f35 [0,4194304] 0 2024-04-26T21:25:46.356 INFO:tasks.workunit.client.0.smithi084.stdout:1/12: dread d2/f3 [0,4194304] 0 2024-04-26T21:25:46.357 INFO:tasks.workunit.client.0.smithi084.stdout:1/13: rename d2 to d2/d4 22 2024-04-26T21:25:46.357 INFO:tasks.workunit.client.1.smithi120.stdout:0/322: write d0/d3/dc/dd/d1b/d39/f53 [2435950,31084] 0 2024-04-26T21:25:46.364 INFO:tasks.workunit.client.0.smithi084.stdout:1/14: symlink d2/l5 0 2024-04-26T21:25:46.364 INFO:tasks.workunit.client.1.smithi120.stdout:9/264: chown d0/dd/d34/f57 8710 1 2024-04-26T21:25:46.366 INFO:tasks.workunit.client.0.smithi084.stdout:0/28: link f0 f6 0 2024-04-26T21:25:46.368 INFO:tasks.workunit.client.1.smithi120.stdout:8/270: dwrite d5/d6/f1f [0,4194304] 0 2024-04-26T21:25:46.368 INFO:tasks.workunit.client.1.smithi120.stdout:4/262: sync 2024-04-26T21:25:46.368 INFO:tasks.workunit.client.1.smithi120.stdout:7/249: dwrite d7/d10/d12/f1d [0,4194304] 0 2024-04-26T21:25:46.371 INFO:tasks.workunit.client.0.smithi084.stdout:1/15: write d2/f3 [969207,34932] 0 2024-04-26T21:25:46.373 INFO:tasks.workunit.client.1.smithi120.stdout:0/323: rmdir d0/d3/dc/dd/d1b/d39 39 2024-04-26T21:25:46.375 INFO:tasks.workunit.client.1.smithi120.stdout:8/271: chown d5/d18/c4e 32206542 1 2024-04-26T21:25:46.375 INFO:tasks.workunit.client.0.smithi084.stdout:0/29: mknod c7 0 2024-04-26T21:25:46.377 INFO:tasks.workunit.client.1.smithi120.stdout:9/265: write d0/f54 [264833,26514] 0 2024-04-26T21:25:46.379 INFO:tasks.workunit.client.1.smithi120.stdout:6/275: dwrite d4/db/d25/f4b [0,4194304] 0 2024-04-26T21:25:46.381 INFO:tasks.workunit.client.1.smithi120.stdout:9/266: stat d0/dd/l29 0 2024-04-26T21:25:46.385 INFO:tasks.workunit.client.0.smithi084.stdout:3/50: dwrite d1/f3 [4194304,4194304] 0 2024-04-26T21:25:46.386 INFO:tasks.workunit.client.1.smithi120.stdout:0/324: creat d0/d3/dc/dd/d1b/d24/f6b x:0 0 0 2024-04-26T21:25:46.388 INFO:tasks.workunit.client.1.smithi120.stdout:9/267: chown d0/dd/d3a/f58 320 1 2024-04-26T21:25:46.390 INFO:tasks.workunit.client.1.smithi120.stdout:6/276: dread - d4/db/d10/dd/f30 zero size 2024-04-26T21:25:46.390 INFO:tasks.workunit.client.1.smithi120.stdout:3/202: dread dd/de/d18/f22 [0,4194304] 0 2024-04-26T21:25:46.392 INFO:tasks.workunit.client.0.smithi084.stdout:3/51: unlink d1/ca 0 2024-04-26T21:25:46.392 INFO:tasks.workunit.client.1.smithi120.stdout:0/325: dread - d0/d3/dc/d12/d4a/f4d zero size 2024-04-26T21:25:46.393 INFO:tasks.workunit.client.1.smithi120.stdout:7/250: link d7/d10/c18 d7/d10/d12/d1a/d33/c5a 0 2024-04-26T21:25:46.397 INFO:tasks.workunit.client.1.smithi120.stdout:8/272: rename d5/d6/d11/c20 to d5/d6/d34/d37/c59 0 2024-04-26T21:25:46.397 INFO:tasks.workunit.client.1.smithi120.stdout:6/277: dread d4/d27/f2e [0,4194304] 0 2024-04-26T21:25:46.400 INFO:tasks.workunit.client.1.smithi120.stdout:9/268: truncate d0/dd/d3a/f46 440152 0 2024-04-26T21:25:46.402 INFO:tasks.workunit.client.0.smithi084.stdout:3/52: creat d1/d10/f11 x:0 0 0 2024-04-26T21:25:46.403 INFO:tasks.workunit.client.1.smithi120.stdout:8/273: readlink d5/d6/l23 0 2024-04-26T21:25:46.406 INFO:tasks.workunit.client.1.smithi120.stdout:6/278: write d4/db/f35 [768754,55626] 0 2024-04-26T21:25:46.406 INFO:tasks.workunit.client.0.smithi084.stdout:1/16: dwrite d2/f3 [0,4194304] 0 2024-04-26T21:25:46.410 INFO:tasks.workunit.client.1.smithi120.stdout:0/326: symlink d0/d3/dc/dd/d1b/d39/l6c 0 2024-04-26T21:25:46.410 INFO:tasks.workunit.client.1.smithi120.stdout:4/263: dwrite d10/d12/f43 [0,4194304] 0 2024-04-26T21:25:46.412 INFO:tasks.workunit.client.0.smithi084.stdout:3/53: symlink d1/d10/l12 0 2024-04-26T21:25:46.414 INFO:tasks.workunit.client.1.smithi120.stdout:9/269: unlink d0/d14/f3c 0 2024-04-26T21:25:46.414 INFO:tasks.workunit.client.1.smithi120.stdout:0/327: dread d0/d3/f41 [0,4194304] 0 2024-04-26T21:25:46.416 INFO:tasks.workunit.client.0.smithi084.stdout:0/30: dwrite f0 [0,4194304] 0 2024-04-26T21:25:46.420 INFO:tasks.workunit.client.0.smithi084.stdout:0/31: chown f0 1687608 1 2024-04-26T21:25:46.421 INFO:tasks.workunit.client.1.smithi120.stdout:7/251: creat d7/d10/d12/d1a/d33/f5b x:0 0 0 2024-04-26T21:25:46.421 INFO:tasks.workunit.client.0.smithi084.stdout:3/54: creat d1/d10/f13 x:0 0 0 2024-04-26T21:25:46.423 INFO:tasks.workunit.client.1.smithi120.stdout:0/328: chown d0/d3/dc/dd/d1b/d39/l67 529745121 1 2024-04-26T21:25:46.423 INFO:tasks.workunit.client.0.smithi084.stdout:8/11: getdents . 0 2024-04-26T21:25:46.424 INFO:tasks.workunit.client.0.smithi084.stdout:0/32: dread - f4 zero size 2024-04-26T21:25:46.426 INFO:tasks.workunit.client.1.smithi120.stdout:3/203: dwrite dd/de/df/d1e/d28/f2d [0,4194304] 0 2024-04-26T21:25:46.427 INFO:tasks.workunit.client.0.smithi084.stdout:8/12: stat f0 0 2024-04-26T21:25:46.427 INFO:tasks.workunit.client.0.smithi084.stdout:7/17: rename l4 to l5 0 2024-04-26T21:25:46.430 INFO:tasks.workunit.client.1.smithi120.stdout:7/252: creat d7/f5c x:0 0 0 2024-04-26T21:25:46.433 INFO:tasks.workunit.client.0.smithi084.stdout:3/55: mknod d1/d10/c14 0 2024-04-26T21:25:46.433 INFO:tasks.workunit.client.0.smithi084.stdout:0/33: creat f8 x:0 0 0 2024-04-26T21:25:46.436 INFO:tasks.workunit.client.0.smithi084.stdout:7/18: unlink c3 0 2024-04-26T21:25:46.437 INFO:tasks.workunit.client.1.smithi120.stdout:4/264: getdents d10/d28 0 2024-04-26T21:25:46.439 INFO:tasks.workunit.client.0.smithi084.stdout:0/34: creat f9 x:0 0 0 2024-04-26T21:25:46.440 INFO:tasks.workunit.client.1.smithi120.stdout:8/274: write d5/d6/d11/d52/f17 [4425124,6025] 0 2024-04-26T21:25:46.441 INFO:tasks.workunit.client.1.smithi120.stdout:7/253: symlink d7/d10/d12/d1f/d28/l5d 0 2024-04-26T21:25:46.445 INFO:tasks.workunit.client.1.smithi120.stdout:3/204: creat dd/d27/f3d x:0 0 0 2024-04-26T21:25:46.447 INFO:tasks.workunit.client.1.smithi120.stdout:6/279: dwrite d4/db/d10/dd/f18 [0,4194304] 0 2024-04-26T21:25:46.447 INFO:tasks.workunit.client.0.smithi084.stdout:7/19: mkdir d6 0 2024-04-26T21:25:46.448 INFO:tasks.workunit.client.1.smithi120.stdout:7/254: chown d7/d10/d12/d2f/c4b 258053 1 2024-04-26T21:25:46.449 INFO:tasks.workunit.client.0.smithi084.stdout:8/13: dwrite f0 [0,4194304] 0 2024-04-26T21:25:46.450 INFO:tasks.workunit.client.0.smithi084.stdout:8/14: read - f1 zero size 2024-04-26T21:25:46.451 INFO:tasks.workunit.client.0.smithi084.stdout:8/15: chown l2 510118660 1 2024-04-26T21:25:46.452 INFO:tasks.workunit.client.0.smithi084.stdout:0/35: dread f1 [0,4194304] 0 2024-04-26T21:25:46.454 INFO:tasks.workunit.client.1.smithi120.stdout:4/265: rmdir d10/d12/d59 0 2024-04-26T21:25:46.455 INFO:tasks.workunit.client.0.smithi084.stdout:0/36: stat f8 0 2024-04-26T21:25:46.457 INFO:tasks.workunit.client.0.smithi084.stdout:6/25: rmdir d3 39 2024-04-26T21:25:46.457 INFO:tasks.workunit.client.1.smithi120.stdout:7/255: chown l4 11 1 2024-04-26T21:25:46.459 INFO:tasks.workunit.client.1.smithi120.stdout:3/205: creat dd/de/d18/f3e x:0 0 0 2024-04-26T21:25:46.462 INFO:tasks.workunit.client.1.smithi120.stdout:7/256: write d7/f29 [946844,55508] 0 2024-04-26T21:25:46.463 INFO:tasks.workunit.client.1.smithi120.stdout:4/266: write d10/d28/f2b [2673631,85637] 0 2024-04-26T21:25:46.465 INFO:tasks.workunit.client.0.smithi084.stdout:8/16: mknod c3 0 2024-04-26T21:25:46.467 INFO:tasks.workunit.client.0.smithi084.stdout:8/17: write f0 [1700642,7432] 0 2024-04-26T21:25:46.470 INFO:tasks.workunit.client.1.smithi120.stdout:8/275: dread d5/d18/f40 [0,4194304] 0 2024-04-26T21:25:46.473 INFO:tasks.workunit.client.1.smithi120.stdout:3/206: write dd/de/df/f35 [108505,11652] 0 2024-04-26T21:25:46.475 INFO:tasks.workunit.client.0.smithi084.stdout:0/37: mknod ca 0 2024-04-26T21:25:46.475 INFO:tasks.workunit.client.0.smithi084.stdout:0/38: stat f6 0 2024-04-26T21:25:46.477 INFO:tasks.workunit.client.1.smithi120.stdout:0/329: dwrite d0/d3/f41 [0,4194304] 0 2024-04-26T21:25:46.477 INFO:tasks.workunit.client.1.smithi120.stdout:7/257: dread - d7/d10/d12/d1f/d28/f53 zero size 2024-04-26T21:25:46.479 INFO:tasks.workunit.client.0.smithi084.stdout:5/18: truncate d0/f2 3491929 0 2024-04-26T21:25:46.482 INFO:tasks.workunit.client.1.smithi120.stdout:8/276: chown d5/d6/d11/d52/l2d 127884925 1 2024-04-26T21:25:46.485 INFO:tasks.workunit.client.0.smithi084.stdout:6/26: creat d3/f6 x:0 0 0 2024-04-26T21:25:46.485 INFO:tasks.workunit.client.0.smithi084.stdout:6/27: readlink - no filename 2024-04-26T21:25:46.487 INFO:tasks.workunit.client.0.smithi084.stdout:0/39: symlink lb 0 2024-04-26T21:25:46.488 INFO:tasks.workunit.client.0.smithi084.stdout:0/40: chown c7 360008637 1 2024-04-26T21:25:46.488 INFO:tasks.workunit.client.1.smithi120.stdout:6/280: dread f1 [0,4194304] 0 2024-04-26T21:25:46.488 INFO:tasks.workunit.client.1.smithi120.stdout:3/207: write dd/de/d18/f3e [449185,113300] 0 2024-04-26T21:25:46.488 INFO:tasks.workunit.client.1.smithi120.stdout:7/258: read d7/f8 [6020887,103163] 0 2024-04-26T21:25:46.490 INFO:tasks.workunit.client.0.smithi084.stdout:5/19: creat d0/f4 x:0 0 0 2024-04-26T21:25:46.491 INFO:tasks.workunit.client.0.smithi084.stdout:5/20: fdatasync d0/f4 0 2024-04-26T21:25:46.492 INFO:tasks.workunit.client.0.smithi084.stdout:5/21: stat d0/f4 0 2024-04-26T21:25:46.493 INFO:tasks.workunit.client.1.smithi120.stdout:0/330: symlink d0/d3/d13/d64/l6d 0 2024-04-26T21:25:46.496 INFO:tasks.workunit.client.0.smithi084.stdout:0/41: creat fc x:0 0 0 2024-04-26T21:25:46.497 INFO:tasks.workunit.client.0.smithi084.stdout:0/42: read - fc zero size 2024-04-26T21:25:46.497 INFO:tasks.workunit.client.0.smithi084.stdout:0/43: rmdir - no directory 2024-04-26T21:25:46.497 INFO:tasks.workunit.client.1.smithi120.stdout:7/259: symlink d7/d10/d12/l5e 0 2024-04-26T21:25:46.498 INFO:tasks.workunit.client.0.smithi084.stdout:0/44: fdatasync f4 0 2024-04-26T21:25:46.498 INFO:tasks.workunit.client.0.smithi084.stdout:0/45: read - f8 zero size 2024-04-26T21:25:46.501 INFO:tasks.workunit.client.1.smithi120.stdout:0/331: symlink d0/l6e 0 2024-04-26T21:25:46.502 INFO:tasks.workunit.client.1.smithi120.stdout:3/208: getdents dd/d27 0 2024-04-26T21:25:46.505 INFO:tasks.workunit.client.1.smithi120.stdout:4/267: dread d10/d28/f4b [0,4194304] 0 2024-04-26T21:25:46.505 INFO:tasks.workunit.client.0.smithi084.stdout:0/46: creat fd x:0 0 0 2024-04-26T21:25:46.505 INFO:tasks.workunit.client.1.smithi120.stdout:7/260: creat d7/d19/d56/f5f x:0 0 0 2024-04-26T21:25:46.508 INFO:tasks.workunit.client.0.smithi084.stdout:2/83: sync 2024-04-26T21:25:46.509 INFO:tasks.workunit.client.1.smithi120.stdout:7/261: mkdir d7/d19/d60 0 2024-04-26T21:25:46.510 INFO:tasks.workunit.client.0.smithi084.stdout:7/20: rename l5 to d6/l7 0 2024-04-26T21:25:46.513 INFO:tasks.workunit.client.0.smithi084.stdout:0/47: unlink f1 0 2024-04-26T21:25:46.514 INFO:tasks.workunit.client.0.smithi084.stdout:0/48: truncate fc 594856 0 2024-04-26T21:25:46.514 INFO:tasks.workunit.client.0.smithi084.stdout:8/18: fsync f0 0 2024-04-26T21:25:46.515 INFO:tasks.workunit.client.0.smithi084.stdout:0/49: fsync f4 0 2024-04-26T21:25:46.516 INFO:tasks.workunit.client.1.smithi120.stdout:8/277: dread d5/d6/d11/d52/d27/f51 [0,4194304] 0 2024-04-26T21:25:46.516 INFO:tasks.workunit.client.0.smithi084.stdout:7/21: rmdir d6 39 2024-04-26T21:25:46.516 INFO:tasks.workunit.client.0.smithi084.stdout:7/22: dread - no filename 2024-04-26T21:25:46.516 INFO:tasks.workunit.client.0.smithi084.stdout:7/23: dread - no filename 2024-04-26T21:25:46.516 INFO:tasks.workunit.client.0.smithi084.stdout:7/24: truncate - no filename 2024-04-26T21:25:46.520 INFO:tasks.workunit.client.0.smithi084.stdout:3/56: truncate d1/f3 2120865 0 2024-04-26T21:25:46.520 INFO:tasks.workunit.client.0.smithi084.stdout:2/84: creat d6/d19/d15/f1c x:0 0 0 2024-04-26T21:25:46.521 INFO:tasks.workunit.client.1.smithi120.stdout:8/278: mknod d5/d18/c5a 0 2024-04-26T21:25:46.522 INFO:tasks.workunit.client.0.smithi084.stdout:6/28: rename f0 to d3/f7 0 2024-04-26T21:25:46.523 INFO:tasks.workunit.client.0.smithi084.stdout:0/50: mkdir de 0 2024-04-26T21:25:46.524 INFO:tasks.workunit.client.1.smithi120.stdout:7/262: getdents d7/d10/d12/d1f/d28 0 2024-04-26T21:25:46.524 INFO:tasks.workunit.client.0.smithi084.stdout:6/29: chown d3/f6 70046 1 2024-04-26T21:25:46.524 INFO:tasks.workunit.client.1.smithi120.stdout:6/281: truncate d4/db/d10/dd/d43/f46 2069651 0 2024-04-26T21:25:46.525 INFO:tasks.workunit.client.0.smithi084.stdout:0/51: dread - f4 zero size 2024-04-26T21:25:46.525 INFO:tasks.workunit.client.1.smithi120.stdout:0/332: truncate d0/d3/f41 865173 0 2024-04-26T21:25:46.526 INFO:tasks.workunit.client.1.smithi120.stdout:4/268: dwrite d10/d28/f32 [0,4194304] 0 2024-04-26T21:25:46.527 INFO:tasks.workunit.client.1.smithi120.stdout:3/209: truncate dd/de/df/f35 4792970 0 2024-04-26T21:25:46.527 INFO:tasks.workunit.client.1.smithi120.stdout:5/268: sync 2024-04-26T21:25:46.527 INFO:tasks.workunit.client.1.smithi120.stdout:1/254: sync 2024-04-26T21:25:46.527 INFO:tasks.workunit.client.1.smithi120.stdout:2/328: sync 2024-04-26T21:25:46.528 INFO:tasks.workunit.client.0.smithi084.stdout:3/57: mknod d1/c15 0 2024-04-26T21:25:46.528 INFO:tasks.workunit.client.0.smithi084.stdout:0/52: write f4 [337013,97078] 0 2024-04-26T21:25:46.528 INFO:tasks.workunit.client.0.smithi084.stdout:2/85: fdatasync d6/d7/fb 0 2024-04-26T21:25:46.532 INFO:tasks.workunit.client.0.smithi084.stdout:3/58: chown d1/c15 295555383 1 2024-04-26T21:25:46.534 INFO:tasks.workunit.client.0.smithi084.stdout:7/25: symlink d6/l8 0 2024-04-26T21:25:46.534 INFO:tasks.workunit.client.0.smithi084.stdout:2/86: write d6/d7/fb [1680613,87570] 0 2024-04-26T21:25:46.534 INFO:tasks.workunit.client.1.smithi120.stdout:0/333: symlink d0/l6f 0 2024-04-26T21:25:46.534 INFO:tasks.workunit.client.1.smithi120.stdout:1/255: rmdir d6/d7/d1b/d3b 39 2024-04-26T21:25:46.535 INFO:tasks.workunit.client.1.smithi120.stdout:7/263: mknod d7/d10/d12/d1f/d28/d4c/c61 0 2024-04-26T21:25:46.535 INFO:tasks.workunit.client.1.smithi120.stdout:2/329: symlink d4/d1b/d25/d29/l70 0 2024-04-26T21:25:46.537 INFO:tasks.workunit.client.0.smithi084.stdout:8/19: dwrite f0 [4194304,4194304] 0 2024-04-26T21:25:46.537 INFO:tasks.workunit.client.0.smithi084.stdout:3/59: truncate d1/ff 887345 0 2024-04-26T21:25:46.537 INFO:tasks.workunit.client.0.smithi084.stdout:6/30: mknod d3/c8 0 2024-04-26T21:25:46.538 INFO:tasks.workunit.client.1.smithi120.stdout:1/256: stat d6/d7/da/f28 0 2024-04-26T21:25:46.540 INFO:tasks.workunit.client.0.smithi084.stdout:7/26: mkdir d6/d9 0 2024-04-26T21:25:46.541 INFO:tasks.workunit.client.0.smithi084.stdout:5/22: getdents d0 0 2024-04-26T21:25:46.541 INFO:tasks.workunit.client.0.smithi084.stdout:8/20: mkdir d4 0 2024-04-26T21:25:46.541 INFO:tasks.workunit.client.1.smithi120.stdout:3/210: rename dd/de/df/f16 to dd/de/df/d1e/d28/f3f 0 2024-04-26T21:25:46.543 INFO:tasks.workunit.client.0.smithi084.stdout:0/53: creat de/ff x:0 0 0 2024-04-26T21:25:46.546 INFO:tasks.workunit.client.1.smithi120.stdout:6/282: dwrite d4/f31 [0,4194304] 0 2024-04-26T21:25:46.547 INFO:tasks.workunit.client.0.smithi084.stdout:5/23: symlink d0/l5 0 2024-04-26T21:25:46.549 INFO:tasks.workunit.client.0.smithi084.stdout:0/54: creat de/f10 x:0 0 0 2024-04-26T21:25:46.550 INFO:tasks.workunit.client.0.smithi084.stdout:6/31: link f1 d3/f9 0 2024-04-26T21:25:46.554 INFO:tasks.workunit.client.0.smithi084.stdout:7/27: creat d6/d9/fa x:0 0 0 2024-04-26T21:25:46.555 INFO:tasks.workunit.client.1.smithi120.stdout:5/269: write d2/f3d [506718,75095] 0 2024-04-26T21:25:46.556 INFO:tasks.workunit.client.0.smithi084.stdout:0/55: mknod de/c11 0 2024-04-26T21:25:46.557 INFO:tasks.workunit.client.1.smithi120.stdout:1/257: symlink d6/d14/l53 0 2024-04-26T21:25:46.558 INFO:tasks.workunit.client.0.smithi084.stdout:6/32: mknod d3/ca 0 2024-04-26T21:25:46.559 INFO:tasks.workunit.client.0.smithi084.stdout:5/24: write d0/f2 [2943246,109010] 0 2024-04-26T21:25:46.562 INFO:tasks.workunit.client.1.smithi120.stdout:3/211: dread dd/de/df/d1e/d28/f2d [0,4194304] 0 2024-04-26T21:25:46.564 INFO:tasks.workunit.client.1.smithi120.stdout:4/269: getdents d10/d12 0 2024-04-26T21:25:46.567 INFO:tasks.workunit.client.1.smithi120.stdout:4/270: write d10/d12/f45 [2622951,121985] 0 2024-04-26T21:25:46.567 INFO:tasks.workunit.client.0.smithi084.stdout:7/28: truncate d6/d9/fa 667170 0 2024-04-26T21:25:46.568 INFO:tasks.workunit.client.1.smithi120.stdout:3/212: stat dd/de/d18/d24/f20 0 2024-04-26T21:25:46.570 INFO:tasks.workunit.client.0.smithi084.stdout:5/25: creat d0/f6 x:0 0 0 2024-04-26T21:25:46.570 INFO:tasks.workunit.client.0.smithi084.stdout:8/21: dwrite f0 [4194304,4194304] 0 2024-04-26T21:25:46.571 INFO:tasks.workunit.client.0.smithi084.stdout:6/33: mknod d3/cb 0 2024-04-26T21:25:46.572 INFO:tasks.workunit.client.1.smithi120.stdout:6/283: symlink d4/db/d10/l53 0 2024-04-26T21:25:46.573 INFO:tasks.workunit.client.1.smithi120.stdout:1/258: mkdir d6/d7/da/dd/d54 0 2024-04-26T21:25:46.573 INFO:tasks.workunit.client.0.smithi084.stdout:7/29: write d6/d9/fa [1540601,97866] 0 2024-04-26T21:25:46.574 INFO:tasks.workunit.client.1.smithi120.stdout:3/213: write dd/de/d18/f25 [804846,9075] 0 2024-04-26T21:25:46.575 INFO:tasks.workunit.client.0.smithi084.stdout:8/22: fsync f1 0 2024-04-26T21:25:46.576 INFO:tasks.workunit.client.0.smithi084.stdout:5/26: read - d0/f6 zero size 2024-04-26T21:25:46.576 INFO:tasks.workunit.client.0.smithi084.stdout:2/87: dread d6/d7/d8/fc [0,4194304] 0 2024-04-26T21:25:46.580 INFO:tasks.workunit.client.0.smithi084.stdout:5/27: chown d0/l5 468732 1 2024-04-26T21:25:46.581 INFO:tasks.workunit.client.0.smithi084.stdout:7/30: symlink d6/lb 0 2024-04-26T21:25:46.581 INFO:tasks.workunit.client.0.smithi084.stdout:5/28: rename d0 to d0/d7 22 2024-04-26T21:25:46.583 INFO:tasks.workunit.client.0.smithi084.stdout:5/29: dread - d0/f6 zero size 2024-04-26T21:25:46.587 INFO:tasks.workunit.client.0.smithi084.stdout:6/34: link d3/f5 d3/fc 0 2024-04-26T21:25:46.591 INFO:tasks.workunit.client.0.smithi084.stdout:7/31: mkdir d6/dc 0 2024-04-26T21:25:46.591 INFO:tasks.workunit.client.1.smithi120.stdout:0/334: truncate d0/f35 1040195 0 2024-04-26T21:25:46.592 INFO:tasks.workunit.client.0.smithi084.stdout:9/17: sync 2024-04-26T21:25:46.593 INFO:tasks.workunit.client.1.smithi120.stdout:1/259: fdatasync d6/d7/d1d/d2c/f2f 0 2024-04-26T21:25:46.593 INFO:tasks.workunit.client.1.smithi120.stdout:6/284: read - d4/db/d10/dd/d43/f48 zero size 2024-04-26T21:25:46.593 INFO:tasks.workunit.client.1.smithi120.stdout:7/264: dread d7/fd [0,4194304] 0 2024-04-26T21:25:46.594 INFO:tasks.workunit.client.0.smithi084.stdout:8/23: creat d4/f5 x:0 0 0 2024-04-26T21:25:46.596 INFO:tasks.workunit.client.1.smithi120.stdout:4/271: rename f9 to d10/f5b 0 2024-04-26T21:25:46.599 INFO:tasks.workunit.client.1.smithi120.stdout:6/285: fdatasync d4/db/d10/dd/d43/f48 0 2024-04-26T21:25:46.600 INFO:tasks.workunit.client.0.smithi084.stdout:7/32: mknod d6/d9/cd 0 2024-04-26T21:25:46.601 INFO:tasks.workunit.client.1.smithi120.stdout:5/270: truncate d2/dc/d1d/d21/f45 3677478 0 2024-04-26T21:25:46.601 INFO:tasks.workunit.client.1.smithi120.stdout:0/335: read - d0/d3/dc/dd/d1b/d24/f6b zero size 2024-04-26T21:25:46.603 INFO:tasks.workunit.client.0.smithi084.stdout:9/18: symlink l4 0 2024-04-26T21:25:46.604 INFO:tasks.workunit.client.0.smithi084.stdout:5/30: dwrite d0/f2 [0,4194304] 0 2024-04-26T21:25:46.607 INFO:tasks.workunit.client.1.smithi120.stdout:1/260: getdents d6/d7/d2d/d48 0 2024-04-26T21:25:46.607 INFO:tasks.workunit.client.0.smithi084.stdout:8/24: unlink c3 0 2024-04-26T21:25:46.609 INFO:tasks.workunit.client.0.smithi084.stdout:0/56: getdents de 0 2024-04-26T21:25:46.609 INFO:tasks.workunit.client.1.smithi120.stdout:0/336: mkdir d0/d3/d51/d70 0 2024-04-26T21:25:46.609 INFO:tasks.workunit.client.1.smithi120.stdout:6/286: stat d4/db/d10/d1a/d2b/f4c 0 2024-04-26T21:25:46.609 INFO:tasks.workunit.client.1.smithi120.stdout:2/330: dwrite d4/d1b/d25/f32 [0,4194304] 0 2024-04-26T21:25:46.616 INFO:tasks.workunit.client.0.smithi084.stdout:0/57: creat de/f12 x:0 0 0 2024-04-26T21:25:46.617 INFO:tasks.workunit.client.1.smithi120.stdout:5/271: truncate d2/db/f14 388264 0 2024-04-26T21:25:46.618 INFO:tasks.workunit.client.0.smithi084.stdout:9/19: truncate f3 3725780 0 2024-04-26T21:25:46.619 INFO:tasks.workunit.client.1.smithi120.stdout:3/214: dwrite dd/de/d18/d24/f20 [0,4194304] 0 2024-04-26T21:25:46.620 INFO:tasks.workunit.client.0.smithi084.stdout:0/58: chown de 7614 1 2024-04-26T21:25:46.623 INFO:tasks.workunit.client.1.smithi120.stdout:5/272: fsync d2/d1b/d29/f50 0 2024-04-26T21:25:46.634 INFO:tasks.workunit.client.1.smithi120.stdout:1/261: mkdir d6/d7/d1b/d55 0 2024-04-26T21:25:46.635 INFO:tasks.workunit.client.0.smithi084.stdout:7/33: dwrite d6/d9/fa [0,4194304] 0 2024-04-26T21:25:46.635 INFO:tasks.workunit.client.1.smithi120.stdout:6/287: dread d4/db/d10/dd/f18 [0,4194304] 0 2024-04-26T21:25:46.636 INFO:tasks.workunit.client.1.smithi120.stdout:7/265: dwrite d7/d10/d12/d1f/f48 [0,4194304] 0 2024-04-26T21:25:46.637 INFO:tasks.workunit.client.0.smithi084.stdout:0/59: write f8 [960024,2313] 0 2024-04-26T21:25:46.638 INFO:tasks.workunit.client.0.smithi084.stdout:9/20: write f1 [445422,94455] 0 2024-04-26T21:25:46.639 INFO:tasks.workunit.client.1.smithi120.stdout:3/215: mkdir dd/d40 0 2024-04-26T21:25:46.644 INFO:tasks.workunit.client.0.smithi084.stdout:4/22: sync 2024-04-26T21:25:46.644 INFO:tasks.workunit.client.0.smithi084.stdout:1/17: sync 2024-04-26T21:25:46.644 INFO:tasks.workunit.client.1.smithi120.stdout:5/273: creat d2/d48/f56 x:0 0 0 2024-04-26T21:25:46.645 INFO:tasks.workunit.client.1.smithi120.stdout:1/262: rmdir d6/d9 39 2024-04-26T21:25:46.649 INFO:tasks.workunit.client.1.smithi120.stdout:5/274: rename d2/dc to d2/dc/d57 22 2024-04-26T21:25:46.651 INFO:tasks.workunit.client.1.smithi120.stdout:0/337: dwrite d0/d3/d13/f60 [0,4194304] 0 2024-04-26T21:25:46.651 INFO:tasks.workunit.client.1.smithi120.stdout:7/266: mknod d7/d10/c62 0 2024-04-26T21:25:46.652 INFO:tasks.workunit.client.1.smithi120.stdout:6/288: mkdir d4/db/d25/d54 0 2024-04-26T21:25:46.654 INFO:tasks.workunit.client.1.smithi120.stdout:6/289: fdatasync d4/db/d10/f52 0 2024-04-26T21:25:46.656 INFO:tasks.workunit.client.0.smithi084.stdout:5/31: dwrite d0/f4 [0,4194304] 0 2024-04-26T21:25:46.657 INFO:tasks.workunit.client.0.smithi084.stdout:4/23: stat l4 0 2024-04-26T21:25:46.657 INFO:tasks.workunit.client.0.smithi084.stdout:4/24: fsync - no filename 2024-04-26T21:25:46.657 INFO:tasks.workunit.client.0.smithi084.stdout:4/25: write - no filename 2024-04-26T21:25:46.658 INFO:tasks.workunit.client.1.smithi120.stdout:3/216: creat dd/de/d18/d24/f41 x:0 0 0 2024-04-26T21:25:46.658 INFO:tasks.workunit.client.1.smithi120.stdout:1/263: mkdir d6/d7/da/dd/d56 0 2024-04-26T21:25:46.658 INFO:tasks.workunit.client.1.smithi120.stdout:5/275: fdatasync d2/d30/f2f 0 2024-04-26T21:25:46.662 INFO:tasks.workunit.client.0.smithi084.stdout:7/34: creat d6/fe x:0 0 0 2024-04-26T21:25:46.663 INFO:tasks.workunit.client.1.smithi120.stdout:5/276: chown d2/l11 13308 1 2024-04-26T21:25:46.665 INFO:tasks.workunit.client.0.smithi084.stdout:1/18: write d2/f3 [4474894,105613] 0 2024-04-26T21:25:46.665 INFO:tasks.workunit.client.0.smithi084.stdout:3/60: dwrite d1/f3 [0,4194304] 0 2024-04-26T21:25:46.667 INFO:tasks.workunit.client.1.smithi120.stdout:6/290: fsync d4/db/f1b 0 2024-04-26T21:25:46.667 INFO:tasks.workunit.client.1.smithi120.stdout:7/267: creat d7/d10/d12/d2f/f63 x:0 0 0 2024-04-26T21:25:46.668 INFO:tasks.workunit.client.1.smithi120.stdout:5/277: write d2/dc/f38 [697746,54090] 0 2024-04-26T21:25:46.672 INFO:tasks.workunit.client.1.smithi120.stdout:7/268: write d7/d10/d12/f1d [2060034,28095] 0 2024-04-26T21:25:46.676 INFO:tasks.workunit.client.1.smithi120.stdout:3/217: symlink dd/de/d18/d36/l42 0 2024-04-26T21:25:46.676 INFO:tasks.workunit.client.1.smithi120.stdout:7/269: dread - d7/d10/f30 zero size 2024-04-26T21:25:46.676 INFO:tasks.workunit.client.1.smithi120.stdout:3/218: readlink dd/l26 0 2024-04-26T21:25:46.676 INFO:tasks.workunit.client.1.smithi120.stdout:3/219: readlink l7 0 2024-04-26T21:25:46.683 INFO:tasks.workunit.client.1.smithi120.stdout:0/338: mkdir d0/d3/d51/d70/d71 0 2024-04-26T21:25:46.683 INFO:tasks.workunit.client.1.smithi120.stdout:3/220: rmdir dd/de/df/d12 39 2024-04-26T21:25:46.685 INFO:tasks.workunit.client.1.smithi120.stdout:7/270: fsync d7/d10/d12/d1a/d33/d34/f38 0 2024-04-26T21:25:46.686 INFO:tasks.workunit.client.0.smithi084.stdout:0/60: symlink de/l13 0 2024-04-26T21:25:46.687 INFO:tasks.workunit.client.1.smithi120.stdout:7/271: chown d7/d10/d12/d1f/l40 7784 1 2024-04-26T21:25:46.687 INFO:tasks.workunit.client.0.smithi084.stdout:1/19: chown c1 28 1 2024-04-26T21:25:46.688 INFO:tasks.workunit.client.1.smithi120.stdout:3/221: readlink dd/de/d18/d36/l42 0 2024-04-26T21:25:46.688 INFO:tasks.workunit.client.0.smithi084.stdout:8/25: dwrite f0 [0,4194304] 0 2024-04-26T21:25:46.691 INFO:tasks.workunit.client.1.smithi120.stdout:1/264: rename d6/d9/f1e to d6/d7/da/dd/d56/f57 0 2024-04-26T21:25:46.692 INFO:tasks.workunit.client.1.smithi120.stdout:6/291: dwrite d4/db/d10/f15 [4194304,4194304] 0 2024-04-26T21:25:46.695 INFO:tasks.workunit.client.0.smithi084.stdout:6/35: dwrite d3/f7 [0,4194304] 0 2024-04-26T21:25:46.695 INFO:tasks.workunit.client.0.smithi084.stdout:0/61: write f6 [3372099,100933] 0 2024-04-26T21:25:46.696 INFO:tasks.workunit.client.1.smithi120.stdout:6/292: chown d4/c24 85496999 1 2024-04-26T21:25:46.696 INFO:tasks.workunit.client.0.smithi084.stdout:2/88: dwrite d6/d7/d8/fc [4194304,4194304] 0 2024-04-26T21:25:46.698 INFO:tasks.workunit.client.0.smithi084.stdout:2/89: fdatasync f0 0 2024-04-26T21:25:46.699 INFO:tasks.workunit.client.1.smithi120.stdout:2/331: dread d4/d1b/d25/f31 [0,4194304] 0 2024-04-26T21:25:46.699 INFO:tasks.workunit.client.1.smithi120.stdout:6/293: chown d4/db/d10/d1a/c4f 6830753 1 2024-04-26T21:25:46.703 INFO:tasks.workunit.client.1.smithi120.stdout:1/265: mkdir d6/d7/d1d/d2c/d58 0 2024-04-26T21:25:46.704 INFO:tasks.workunit.client.0.smithi084.stdout:2/90: stat d6/d7/d8/c11 0 2024-04-26T21:25:46.710 INFO:tasks.workunit.client.1.smithi120.stdout:3/222: unlink dd/de/df/f35 0 2024-04-26T21:25:46.711 INFO:tasks.workunit.client.1.smithi120.stdout:6/294: mknod d4/db/d10/d1a/c55 0 2024-04-26T21:25:46.713 INFO:tasks.workunit.client.0.smithi084.stdout:7/35: dread d6/d9/fa [0,4194304] 0 2024-04-26T21:25:46.715 INFO:tasks.workunit.client.1.smithi120.stdout:6/295: write d4/db/d10/d1a/d2b/f4c [256010,13717] 0 2024-04-26T21:25:46.717 INFO:tasks.workunit.client.1.smithi120.stdout:0/339: creat d0/f72 x:0 0 0 2024-04-26T21:25:46.720 INFO:tasks.workunit.client.0.smithi084.stdout:6/36: dread d3/f7 [0,4194304] 0 2024-04-26T21:25:46.721 INFO:tasks.workunit.client.0.smithi084.stdout:2/91: dread d6/f12 [0,4194304] 0 2024-04-26T21:25:46.722 INFO:tasks.workunit.client.1.smithi120.stdout:3/223: mkdir dd/de/d18/d24/d43 0 2024-04-26T21:25:46.726 INFO:tasks.workunit.client.1.smithi120.stdout:3/224: write dd/de/d18/d24/f3c [1001674,40681] 0 2024-04-26T21:25:46.726 INFO:tasks.workunit.client.1.smithi120.stdout:7/272: getdents d7/d10/d12/d1a/d50 0 2024-04-26T21:25:46.728 INFO:tasks.workunit.client.1.smithi120.stdout:0/340: mkdir d0/d3/dc/dd/d1b/d24/d73 0 2024-04-26T21:25:46.729 INFO:tasks.workunit.client.1.smithi120.stdout:2/332: getdents d4/d1b/d4f 0 2024-04-26T21:25:46.730 INFO:tasks.workunit.client.1.smithi120.stdout:3/225: chown dd/d27/f3d 203701 1 2024-04-26T21:25:46.733 INFO:tasks.workunit.client.1.smithi120.stdout:3/226: chown dd/de/d18/l1c 1356 1 2024-04-26T21:25:46.733 INFO:tasks.workunit.client.1.smithi120.stdout:0/341: write d0/d3/dc/f22 [899438,106664] 0 2024-04-26T21:25:46.737 INFO:tasks.workunit.client.0.smithi084.stdout:0/62: dread f8 [0,4194304] 0 2024-04-26T21:25:46.738 INFO:tasks.workunit.client.1.smithi120.stdout:2/333: write d4/d1b/d56/d65/f67 [309213,21538] 0 2024-04-26T21:25:46.738 INFO:tasks.workunit.client.1.smithi120.stdout:6/296: dwrite d4/db/f35 [0,4194304] 0 2024-04-26T21:25:46.740 INFO:tasks.workunit.client.1.smithi120.stdout:3/227: write dd/de/df/d1e/d28/f3f [980686,43498] 0 2024-04-26T21:25:46.740 INFO:tasks.workunit.client.1.smithi120.stdout:2/334: truncate d4/f66 401136 0 2024-04-26T21:25:46.742 INFO:tasks.workunit.client.1.smithi120.stdout:0/342: creat d0/d3/dc/d12/d4a/f74 x:0 0 0 2024-04-26T21:25:46.743 INFO:tasks.workunit.client.1.smithi120.stdout:3/228: chown dd/d2a/f33 11322890 1 2024-04-26T21:25:46.743 INFO:tasks.workunit.client.1.smithi120.stdout:6/297: mkdir d4/db/d10/d22/d56 0 2024-04-26T21:25:46.743 INFO:tasks.workunit.client.1.smithi120.stdout:9/270: sync 2024-04-26T21:25:46.743 INFO:tasks.workunit.client.1.smithi120.stdout:2/335: dread d4/f66 [0,4194304] 0 2024-04-26T21:25:46.748 INFO:tasks.workunit.client.1.smithi120.stdout:9/271: write d0/dd/f12 [1116124,64642] 0 2024-04-26T21:25:46.751 INFO:tasks.workunit.client.1.smithi120.stdout:6/298: mkdir d4/db/d10/d1a/d2b/d57 0 2024-04-26T21:25:46.756 INFO:tasks.workunit.client.1.smithi120.stdout:1/266: rmdir d6/d7/da/dd 39 2024-04-26T21:25:46.765 INFO:tasks.workunit.client.0.smithi084.stdout:9/21: dread f2 [0,4194304] 0 2024-04-26T21:25:46.786 INFO:tasks.workunit.client.1.smithi120.stdout:0/343: dwrite d0/d3/d51/f58 [0,4194304] 0 2024-04-26T21:25:46.791 INFO:tasks.workunit.client.1.smithi120.stdout:3/229: dwrite dd/de/df/f34 [0,4194304] 0 2024-04-26T21:25:46.793 INFO:tasks.workunit.client.1.smithi120.stdout:5/278: dwrite d2/db/f14 [0,4194304] 0 2024-04-26T21:25:46.794 INFO:tasks.workunit.client.1.smithi120.stdout:6/299: dwrite d4/db/f35 [0,4194304] 0 2024-04-26T21:25:46.801 INFO:tasks.workunit.client.1.smithi120.stdout:5/279: fsync d2/d30/f2f 0 2024-04-26T21:25:46.805 INFO:tasks.workunit.client.1.smithi120.stdout:0/344: symlink d0/d3/dc/dd/d1b/l75 0 2024-04-26T21:25:46.809 INFO:tasks.workunit.client.0.smithi084.stdout:8/26: mkdir d4/d6 0 2024-04-26T21:25:46.811 INFO:tasks.workunit.client.0.smithi084.stdout:1/20: rename d2/f3 to d2/f6 0 2024-04-26T21:25:46.812 INFO:tasks.workunit.client.1.smithi120.stdout:2/336: dread d4/d1b/d25/d2c/d3e/d5e/f61 [0,4194304] 0 2024-04-26T21:25:46.813 INFO:tasks.workunit.client.1.smithi120.stdout:6/300: mkdir d4/db/d10/dd/d43/d58 0 2024-04-26T21:25:46.814 INFO:tasks.workunit.client.1.smithi120.stdout:5/280: creat d2/dc/d1d/f58 x:0 0 0 2024-04-26T21:25:46.817 INFO:tasks.workunit.client.0.smithi084.stdout:7/36: creat d6/d9/ff x:0 0 0 2024-04-26T21:25:46.818 INFO:tasks.workunit.client.1.smithi120.stdout:6/301: creat d4/d27/f59 x:0 0 0 2024-04-26T21:25:46.818 INFO:tasks.workunit.client.0.smithi084.stdout:7/37: dread - d6/fe zero size 2024-04-26T21:25:46.820 INFO:tasks.workunit.client.0.smithi084.stdout:2/92: mknod d6/d7/d8/c1d 0 2024-04-26T21:25:46.820 INFO:tasks.workunit.client.0.smithi084.stdout:0/63: creat de/f14 x:0 0 0 2024-04-26T21:25:46.822 INFO:tasks.workunit.client.0.smithi084.stdout:2/93: read f0 [3360402,64003] 0 2024-04-26T21:25:46.822 INFO:tasks.workunit.client.1.smithi120.stdout:2/337: truncate d4/f64 55016 0 2024-04-26T21:25:46.824 INFO:tasks.workunit.client.0.smithi084.stdout:9/22: unlink f2 0 2024-04-26T21:25:46.824 INFO:tasks.workunit.client.1.smithi120.stdout:3/230: dwrite dd/d2a/f33 [0,4194304] 0 2024-04-26T21:25:46.824 INFO:tasks.workunit.client.0.smithi084.stdout:4/26: mknod d5/c8 0 2024-04-26T21:25:46.830 INFO:tasks.workunit.client.0.smithi084.stdout:1/21: write d2/f6 [4921100,61026] 0 2024-04-26T21:25:46.831 INFO:tasks.workunit.client.0.smithi084.stdout:1/22: chown c0 468259939 1 2024-04-26T21:25:46.834 INFO:tasks.workunit.client.1.smithi120.stdout:7/273: dread d7/f8 [0,4194304] 0 2024-04-26T21:25:46.835 INFO:tasks.workunit.client.1.smithi120.stdout:3/231: mkdir dd/de/d18/d2c/d44 0 2024-04-26T21:25:46.836 INFO:tasks.workunit.client.0.smithi084.stdout:0/64: symlink de/l15 0 2024-04-26T21:25:46.836 INFO:tasks.workunit.client.0.smithi084.stdout:7/38: write d6/d9/fa [2835989,76897] 0 2024-04-26T21:25:46.836 INFO:tasks.workunit.client.1.smithi120.stdout:6/302: creat d4/db/f5a x:0 0 0 2024-04-26T21:25:46.837 INFO:tasks.workunit.client.1.smithi120.stdout:7/274: readlink d7/d10/l2b 0 2024-04-26T21:25:46.839 INFO:tasks.workunit.client.0.smithi084.stdout:0/65: dread fc [0,4194304] 0 2024-04-26T21:25:46.840 INFO:tasks.workunit.client.0.smithi084.stdout:2/94: creat d6/d19/f1e x:0 0 0 2024-04-26T21:25:46.841 INFO:tasks.workunit.client.1.smithi120.stdout:2/338: creat d4/d1b/d2e/d50/d14/d15/f71 x:0 0 0 2024-04-26T21:25:46.842 INFO:tasks.workunit.client.0.smithi084.stdout:9/23: creat f5 x:0 0 0 2024-04-26T21:25:46.843 INFO:tasks.workunit.client.1.smithi120.stdout:7/275: mkdir d7/d64 0 2024-04-26T21:25:46.843 INFO:tasks.workunit.client.0.smithi084.stdout:1/23: mknod d2/c7 0 2024-04-26T21:25:46.847 INFO:tasks.workunit.client.0.smithi084.stdout:0/66: rename de/c11 to de/c16 0 2024-04-26T21:25:46.847 INFO:tasks.workunit.client.1.smithi120.stdout:3/232: creat dd/de/df/d1e/d28/f45 x:0 0 0 2024-04-26T21:25:46.848 INFO:tasks.workunit.client.1.smithi120.stdout:2/339: chown d4/d1b/d2e/d50/l62 0 1 2024-04-26T21:25:46.850 INFO:tasks.workunit.client.1.smithi120.stdout:7/276: mknod d7/d19/d60/c65 0 2024-04-26T21:25:46.856 INFO:tasks.workunit.client.0.smithi084.stdout:1/24: symlink d2/l8 0 2024-04-26T21:25:46.858 INFO:tasks.workunit.client.1.smithi120.stdout:5/281: dwrite d2/db/f27 [0,4194304] 0 2024-04-26T21:25:46.859 INFO:tasks.workunit.client.1.smithi120.stdout:5/282: fsync d2/d1b/d29/f50 0 2024-04-26T21:25:46.860 INFO:tasks.workunit.client.0.smithi084.stdout:7/39: mknod d6/dc/c10 0 2024-04-26T21:25:46.861 INFO:tasks.workunit.client.0.smithi084.stdout:7/40: dread - d6/d9/ff zero size 2024-04-26T21:25:46.863 INFO:tasks.workunit.client.0.smithi084.stdout:0/67: rename lb to de/l17 0 2024-04-26T21:25:46.865 INFO:tasks.workunit.client.1.smithi120.stdout:1/267: dread d6/d7/da/dd/fe [0,4194304] 0 2024-04-26T21:25:46.866 INFO:tasks.workunit.client.1.smithi120.stdout:5/283: rmdir d2/dc/d1d/d1f/d36 39 2024-04-26T21:25:46.866 INFO:tasks.workunit.client.1.smithi120.stdout:0/345: dread d0/d3/dc/f1c [0,4194304] 0 2024-04-26T21:25:46.872 INFO:tasks.workunit.client.1.smithi120.stdout:1/268: creat d6/d7/f59 x:0 0 0 2024-04-26T21:25:46.873 INFO:tasks.workunit.client.0.smithi084.stdout:7/41: creat d6/d9/f11 x:0 0 0 2024-04-26T21:25:46.873 INFO:tasks.workunit.client.1.smithi120.stdout:6/303: truncate f1 2684002 0 2024-04-26T21:25:46.875 INFO:tasks.workunit.client.0.smithi084.stdout:2/95: getdents d6/d7 0 2024-04-26T21:25:46.875 INFO:tasks.workunit.client.1.smithi120.stdout:3/233: truncate dd/de/f2f 549496 0 2024-04-26T21:25:46.876 INFO:tasks.workunit.client.1.smithi120.stdout:7/277: truncate d7/d10/d12/f1d 2872507 0 2024-04-26T21:25:46.877 INFO:tasks.workunit.client.1.smithi120.stdout:5/284: write d2/dc/d1d/f58 [355332,83028] 0 2024-04-26T21:25:46.877 INFO:tasks.workunit.client.1.smithi120.stdout:2/340: dwrite d4/d1b/d2e/d50/d14/d15/f45 [4194304,4194304] 0 2024-04-26T21:25:46.880 INFO:tasks.workunit.client.1.smithi120.stdout:8/279: sync 2024-04-26T21:25:46.881 INFO:tasks.workunit.client.0.smithi084.stdout:7/42: mkdir d6/d9/d12 0 2024-04-26T21:25:46.882 INFO:tasks.workunit.client.1.smithi120.stdout:1/269: dread - d6/d7/d2d/d48/f49 zero size 2024-04-26T21:25:46.882 INFO:tasks.workunit.client.0.smithi084.stdout:2/96: chown d6/d19/d15/f1c 19004209 1 2024-04-26T21:25:46.883 INFO:tasks.workunit.client.0.smithi084.stdout:1/25: dwrite d2/f6 [4194304,4194304] 0 2024-04-26T21:25:46.884 INFO:tasks.workunit.client.1.smithi120.stdout:3/234: write dd/de/f2e [297902,60539] 0 2024-04-26T21:25:46.885 INFO:tasks.workunit.client.0.smithi084.stdout:1/26: readlink d2/l5 0 2024-04-26T21:25:46.887 INFO:tasks.workunit.client.1.smithi120.stdout:3/235: chown dd/de/f2e 47918967 1 2024-04-26T21:25:46.888 INFO:tasks.workunit.client.1.smithi120.stdout:2/341: read d4/d1b/d2e/d50/d14/d15/f45 [739745,94673] 0 2024-04-26T21:25:46.889 INFO:tasks.workunit.client.0.smithi084.stdout:0/68: dwrite f6 [0,4194304] 0 2024-04-26T21:25:46.889 INFO:tasks.workunit.client.1.smithi120.stdout:6/304: mknod d4/db/d10/dd/d28/c5b 0 2024-04-26T21:25:46.890 INFO:tasks.workunit.client.0.smithi084.stdout:1/27: read d2/f6 [3288760,105096] 0 2024-04-26T21:25:46.890 INFO:tasks.workunit.client.1.smithi120.stdout:7/278: rename d7/l20 to d7/d19/d60/l66 0 2024-04-26T21:25:46.891 INFO:tasks.workunit.client.1.smithi120.stdout:5/285: rename d2/db/f16 to d2/db/f59 0 2024-04-26T21:25:46.892 INFO:tasks.workunit.client.1.smithi120.stdout:3/236: fdatasync dd/de/df/d1e/d28/f3f 0 2024-04-26T21:25:46.893 INFO:tasks.workunit.client.1.smithi120.stdout:7/279: fsync d7/d10/d12/d1f/f48 0 2024-04-26T21:25:46.894 INFO:tasks.workunit.client.0.smithi084.stdout:7/43: rename d6/fe to d6/dc/f13 0 2024-04-26T21:25:46.897 INFO:tasks.workunit.client.0.smithi084.stdout:7/44: chown d6/l8 18819095 1 2024-04-26T21:25:46.898 INFO:tasks.workunit.client.0.smithi084.stdout:7/45: rename d6 to d6/d14 22 2024-04-26T21:25:46.904 INFO:tasks.workunit.client.1.smithi120.stdout:8/280: dwrite d5/d6/d11/f10 [0,4194304] 0 2024-04-26T21:25:46.907 INFO:tasks.workunit.client.0.smithi084.stdout:2/97: dread d6/d7/d8/fe [0,4194304] 0 2024-04-26T21:25:46.908 INFO:tasks.workunit.client.1.smithi120.stdout:8/281: chown d5/d6/d11/d52/d27/f53 555380 1 2024-04-26T21:25:46.908 INFO:tasks.workunit.client.1.smithi120.stdout:2/342: rename d4/c42 to d4/d1b/d56/d65/c72 0 2024-04-26T21:25:46.909 INFO:tasks.workunit.client.0.smithi084.stdout:0/69: dread f0 [0,4194304] 0 2024-04-26T21:25:46.911 INFO:tasks.workunit.client.0.smithi084.stdout:1/28: dread d2/f6 [4194304,4194304] 0 2024-04-26T21:25:46.912 INFO:tasks.workunit.client.0.smithi084.stdout:0/70: write de/f14 [799701,86941] 0 2024-04-26T21:25:46.914 INFO:tasks.workunit.client.0.smithi084.stdout:2/98: mkdir d6/d19/d15/d1f 0 2024-04-26T21:25:46.915 INFO:tasks.workunit.client.1.smithi120.stdout:2/343: chown d4/d1b/d56/f5a 3174907 1 2024-04-26T21:25:46.915 INFO:tasks.workunit.client.1.smithi120.stdout:1/270: mkdir d6/d7/d1b/d3b/d5a 0 2024-04-26T21:25:46.915 INFO:tasks.workunit.client.1.smithi120.stdout:3/237: rename dd/de/d18/d2c/d44 to dd/de/d18/d36/d46 0 2024-04-26T21:25:46.916 INFO:tasks.workunit.client.1.smithi120.stdout:2/344: chown d4/d1b/d2e/d5f 1 1 2024-04-26T21:25:46.918 INFO:tasks.workunit.client.0.smithi084.stdout:1/29: mkdir d2/d9 0 2024-04-26T21:25:46.918 INFO:tasks.workunit.client.0.smithi084.stdout:7/46: dread d6/d9/fa [0,4194304] 0 2024-04-26T21:25:46.918 INFO:tasks.workunit.client.0.smithi084.stdout:2/99: chown d6/d7/l13 484629 1 2024-04-26T21:25:46.918 INFO:tasks.workunit.client.1.smithi120.stdout:7/280: truncate d7/d10/d12/d1f/f3a 1944158 0 2024-04-26T21:25:46.919 INFO:tasks.workunit.client.0.smithi084.stdout:0/71: mknod de/c18 0 2024-04-26T21:25:46.920 INFO:tasks.workunit.client.0.smithi084.stdout:2/100: write d6/d7/fb [1614270,25748] 0 2024-04-26T21:25:46.921 INFO:tasks.workunit.client.0.smithi084.stdout:5/32: sync 2024-04-26T21:25:46.922 INFO:tasks.workunit.client.1.smithi120.stdout:8/282: fdatasync d5/d6/f1e 0 2024-04-26T21:25:46.922 INFO:tasks.workunit.client.1.smithi120.stdout:2/345: readlink d4/d1b/d2e/d50/l1a 0 2024-04-26T21:25:46.922 INFO:tasks.workunit.client.0.smithi084.stdout:0/72: write de/ff [875126,71025] 0 2024-04-26T21:25:46.922 INFO:tasks.workunit.client.0.smithi084.stdout:2/101: stat d6/d7/l17 0 2024-04-26T21:25:46.924 INFO:tasks.workunit.client.0.smithi084.stdout:2/102: readlink d6/d7/d8/l16 0 2024-04-26T21:25:46.924 INFO:tasks.workunit.client.1.smithi120.stdout:7/281: chown d7/l55 3 1 2024-04-26T21:25:46.925 INFO:tasks.workunit.client.0.smithi084.stdout:2/103: read - d6/d19/f1e zero size 2024-04-26T21:25:46.925 INFO:tasks.workunit.client.1.smithi120.stdout:1/271: creat d6/d7/d1b/d55/f5b x:0 0 0 2024-04-26T21:25:46.927 INFO:tasks.workunit.client.0.smithi084.stdout:2/104: write d6/d7/d8/fc [4928096,77984] 0 2024-04-26T21:25:46.927 INFO:tasks.workunit.client.0.smithi084.stdout:7/47: creat d6/d9/f15 x:0 0 0 2024-04-26T21:25:46.929 INFO:tasks.workunit.client.0.smithi084.stdout:1/30: mknod d2/d9/ca 0 2024-04-26T21:25:46.930 INFO:tasks.workunit.client.1.smithi120.stdout:3/238: rename dd/de/d18/f25 to dd/de/d18/d24/d43/f47 0 2024-04-26T21:25:46.931 INFO:tasks.workunit.client.1.smithi120.stdout:7/282: readlink d7/d10/d12/l5e 0 2024-04-26T21:25:46.931 INFO:tasks.workunit.client.1.smithi120.stdout:1/272: fdatasync d6/d7/d2d/d48/f49 0 2024-04-26T21:25:46.932 INFO:tasks.workunit.client.1.smithi120.stdout:2/346: fsync d4/d1b/d25/f31 0 2024-04-26T21:25:46.932 INFO:tasks.workunit.client.1.smithi120.stdout:8/283: creat d5/d6/d34/d42/f5b x:0 0 0 2024-04-26T21:25:46.935 INFO:tasks.workunit.client.0.smithi084.stdout:0/73: write f0 [3522050,28131] 0 2024-04-26T21:25:46.936 INFO:tasks.workunit.client.0.smithi084.stdout:5/33: creat d0/f8 x:0 0 0 2024-04-26T21:25:46.937 INFO:tasks.workunit.client.1.smithi120.stdout:5/286: dwrite d2/d1b/d22/f2b [0,4194304] 0 2024-04-26T21:25:46.937 INFO:tasks.workunit.client.0.smithi084.stdout:0/74: write de/f14 [1008371,41908] 0 2024-04-26T21:25:46.940 INFO:tasks.workunit.client.1.smithi120.stdout:7/283: write d7/d19/f24 [948406,118444] 0 2024-04-26T21:25:46.943 INFO:tasks.workunit.client.1.smithi120.stdout:3/239: rename dd/d27 to dd/de/df/d12/d48 0 2024-04-26T21:25:46.943 INFO:tasks.workunit.client.0.smithi084.stdout:2/105: mkdir d6/d7/d8/d20 0 2024-04-26T21:25:46.943 INFO:tasks.workunit.client.1.smithi120.stdout:2/347: write d4/d1b/d2e/d50/d14/d15/f71 [125406,75962] 0 2024-04-26T21:25:46.944 INFO:tasks.workunit.client.1.smithi120.stdout:5/287: dread - d2/d48/f56 zero size 2024-04-26T21:25:46.948 INFO:tasks.workunit.client.1.smithi120.stdout:3/240: read - dd/de/d18/d24/f41 zero size 2024-04-26T21:25:46.949 INFO:tasks.workunit.client.0.smithi084.stdout:2/106: write d6/d7/fb [272095,47238] 0 2024-04-26T21:25:46.951 INFO:tasks.workunit.client.0.smithi084.stdout:5/34: symlink d0/l9 0 2024-04-26T21:25:46.952 INFO:tasks.workunit.client.1.smithi120.stdout:3/241: truncate dd/de/f2e 389890 0 2024-04-26T21:25:46.959 INFO:tasks.workunit.client.1.smithi120.stdout:8/284: dread d5/d6/d11/f10 [0,4194304] 0 2024-04-26T21:25:46.961 INFO:tasks.workunit.client.0.smithi084.stdout:5/35: truncate d0/f6 478029 0 2024-04-26T21:25:46.964 INFO:tasks.workunit.client.1.smithi120.stdout:5/288: dread d2/dc/d1d/d1f/f2c [0,4194304] 0 2024-04-26T21:25:46.964 INFO:tasks.workunit.client.1.smithi120.stdout:6/305: stat d4/d27/f32 0 2024-04-26T21:25:46.967 INFO:tasks.workunit.client.0.smithi084.stdout:5/36: truncate d0/f6 1073464 0 2024-04-26T21:25:46.969 INFO:tasks.workunit.client.0.smithi084.stdout:5/37: dread - d0/f8 zero size 2024-04-26T21:25:46.970 INFO:tasks.workunit.client.0.smithi084.stdout:6/37: write d3/f5 [1032660,76879] 0 2024-04-26T21:25:46.971 INFO:tasks.workunit.client.1.smithi120.stdout:7/284: dwrite d7/d10/d12/d1f/d28/f2c [0,4194304] 0 2024-04-26T21:25:46.973 INFO:tasks.workunit.client.1.smithi120.stdout:5/289: truncate d2/d1b/d29/f50 432571 0 2024-04-26T21:25:46.977 INFO:tasks.workunit.client.0.smithi084.stdout:3/61: sync 2024-04-26T21:25:46.977 INFO:tasks.workunit.client.0.smithi084.stdout:8/27: sync 2024-04-26T21:25:46.978 INFO:tasks.workunit.client.0.smithi084.stdout:0/75: dwrite fd [0,4194304] 0 2024-04-26T21:25:46.979 INFO:tasks.workunit.client.1.smithi120.stdout:7/285: creat d7/d10/d12/d2f/f67 x:0 0 0 2024-04-26T21:25:46.979 INFO:tasks.workunit.client.1.smithi120.stdout:2/348: write d4/d1b/d56/d65/f6f [3645725,26839] 0 2024-04-26T21:25:46.981 INFO:tasks.workunit.client.0.smithi084.stdout:0/76: fdatasync f6 0 2024-04-26T21:25:46.981 INFO:tasks.workunit.client.0.smithi084.stdout:1/31: dwrite d2/f6 [4194304,4194304] 0 2024-04-26T21:25:46.981 INFO:tasks.workunit.client.0.smithi084.stdout:3/62: chown d1/c15 57 1 2024-04-26T21:25:46.985 INFO:tasks.workunit.client.0.smithi084.stdout:5/38: creat d0/fa x:0 0 0 2024-04-26T21:25:46.985 INFO:tasks.workunit.client.0.smithi084.stdout:1/32: readlink d2/l5 0 2024-04-26T21:25:46.989 INFO:tasks.workunit.client.1.smithi120.stdout:7/286: chown d7/d10/f30 14 1 2024-04-26T21:25:46.991 INFO:tasks.workunit.client.0.smithi084.stdout:4/27: rename d5/d7 to d5/d7/d9 22 2024-04-26T21:25:46.991 INFO:tasks.workunit.client.0.smithi084.stdout:4/28: fsync - no filename 2024-04-26T21:25:46.991 INFO:tasks.workunit.client.0.smithi084.stdout:4/29: fdatasync - no filename 2024-04-26T21:25:46.993 INFO:tasks.workunit.client.0.smithi084.stdout:0/77: rename de/l15 to de/l19 0 2024-04-26T21:25:46.994 INFO:tasks.workunit.client.0.smithi084.stdout:5/39: write d0/f4 [2944996,105057] 0 2024-04-26T21:25:46.994 INFO:tasks.workunit.client.1.smithi120.stdout:8/285: dwrite d5/d6/d11/d52/d27/f38 [4194304,4194304] 0 2024-04-26T21:25:46.994 INFO:tasks.workunit.client.1.smithi120.stdout:5/290: chown d2/dc/d1d/d1f/d36/f40 32223 1 2024-04-26T21:25:46.997 INFO:tasks.workunit.client.0.smithi084.stdout:5/40: fdatasync d0/f2 0 2024-04-26T21:25:46.997 INFO:tasks.workunit.client.1.smithi120.stdout:5/291: stat d2/dc/d1d/d1f/c51 0 2024-04-26T21:25:46.998 INFO:tasks.workunit.client.0.smithi084.stdout:3/63: creat d1/d10/f16 x:0 0 0 2024-04-26T21:25:47.000 INFO:tasks.workunit.client.0.smithi084.stdout:2/107: dwrite d6/d7/d8/fe [0,4194304] 0 2024-04-26T21:25:47.001 INFO:tasks.workunit.client.0.smithi084.stdout:7/48: fsync d6/dc/f13 0 2024-04-26T21:25:47.007 INFO:tasks.workunit.client.0.smithi084.stdout:1/33: rename d2/f6 to d2/fb 0 2024-04-26T21:25:47.012 INFO:tasks.workunit.client.1.smithi120.stdout:8/286: creat d5/d2e/f5c x:0 0 0 2024-04-26T21:25:47.012 INFO:tasks.workunit.client.0.smithi084.stdout:7/49: truncate d6/dc/f13 569931 0 2024-04-26T21:25:47.013 INFO:tasks.workunit.client.0.smithi084.stdout:0/78: symlink de/l1a 0 2024-04-26T21:25:47.017 INFO:tasks.workunit.client.1.smithi120.stdout:8/287: write f4 [1574289,71829] 0 2024-04-26T21:25:47.017 INFO:tasks.workunit.client.0.smithi084.stdout:3/64: rename d1/d10/c14 to d1/c17 0 2024-04-26T21:25:47.017 INFO:tasks.workunit.client.0.smithi084.stdout:6/38: dwrite d3/f9 [0,4194304] 0 2024-04-26T21:25:47.018 INFO:tasks.workunit.client.0.smithi084.stdout:6/39: readlink - no filename 2024-04-26T21:25:47.019 INFO:tasks.workunit.client.0.smithi084.stdout:4/30: mknod d5/ca 0 2024-04-26T21:25:47.019 INFO:tasks.workunit.client.0.smithi084.stdout:4/31: write - no filename 2024-04-26T21:25:47.020 INFO:tasks.workunit.client.0.smithi084.stdout:1/34: rename d2/l5 to d2/lc 0 2024-04-26T21:25:47.021 INFO:tasks.workunit.client.1.smithi120.stdout:3/242: dread fa [0,4194304] 0 2024-04-26T21:25:47.022 INFO:tasks.workunit.client.0.smithi084.stdout:6/40: write d3/f7 [128511,111554] 0 2024-04-26T21:25:47.023 INFO:tasks.workunit.client.0.smithi084.stdout:2/108: mknod d6/d1b/c21 0 2024-04-26T21:25:47.024 INFO:tasks.workunit.client.0.smithi084.stdout:7/50: readlink d6/l7 0 2024-04-26T21:25:47.025 INFO:tasks.workunit.client.1.smithi120.stdout:1/273: dread d6/d7/d1d/d2c/f31 [0,4194304] 0 2024-04-26T21:25:47.026 INFO:tasks.workunit.client.0.smithi084.stdout:0/79: read fc [400918,117901] 0 2024-04-26T21:25:47.027 INFO:tasks.workunit.client.1.smithi120.stdout:3/243: fdatasync dd/de/d18/d36/f39 0 2024-04-26T21:25:47.029 INFO:tasks.workunit.client.0.smithi084.stdout:5/41: rmdir d0 39 2024-04-26T21:25:47.030 INFO:tasks.workunit.client.1.smithi120.stdout:2/349: rmdir d4/d1b/d2e/d50/d14/d3c 0 2024-04-26T21:25:47.030 INFO:tasks.workunit.client.1.smithi120.stdout:6/306: dread d4/db/f23 [0,4194304] 0 2024-04-26T21:25:47.031 INFO:tasks.workunit.client.1.smithi120.stdout:7/287: write d7/fd [25449,112740] 0 2024-04-26T21:25:47.032 INFO:tasks.workunit.client.0.smithi084.stdout:6/41: truncate d3/f5 1630422 0 2024-04-26T21:25:47.032 INFO:tasks.workunit.client.0.smithi084.stdout:6/42: readlink - no filename 2024-04-26T21:25:47.036 INFO:tasks.workunit.client.1.smithi120.stdout:2/350: write d4/d1b/d2e/f57 [558979,109417] 0 2024-04-26T21:25:47.037 INFO:tasks.workunit.client.1.smithi120.stdout:6/307: truncate d4/db/f5a 699954 0 2024-04-26T21:25:47.037 INFO:tasks.workunit.client.1.smithi120.stdout:7/288: chown d7/d19/d60 12 1 2024-04-26T21:25:47.038 INFO:tasks.workunit.client.1.smithi120.stdout:8/288: dread d5/d6/d11/d32/f45 [0,4194304] 0 2024-04-26T21:25:47.041 INFO:tasks.workunit.client.0.smithi084.stdout:9/24: dwrite f3 [0,4194304] 0 2024-04-26T21:25:47.044 INFO:tasks.workunit.client.0.smithi084.stdout:8/28: truncate f0 7077627 0 2024-04-26T21:25:47.044 INFO:tasks.workunit.client.0.smithi084.stdout:7/51: symlink d6/dc/l16 0 2024-04-26T21:25:47.045 INFO:tasks.workunit.client.1.smithi120.stdout:7/289: symlink d7/l68 0 2024-04-26T21:25:47.045 INFO:tasks.workunit.client.1.smithi120.stdout:6/308: write d4/db/f35 [2925376,74429] 0 2024-04-26T21:25:47.045 INFO:tasks.workunit.client.1.smithi120.stdout:1/274: mkdir d6/d7/d1b/d5c 0 2024-04-26T21:25:47.046 INFO:tasks.workunit.client.0.smithi084.stdout:6/43: mkdir d3/dd 0 2024-04-26T21:25:47.046 INFO:tasks.workunit.client.1.smithi120.stdout:4/272: sync 2024-04-26T21:25:47.047 INFO:tasks.workunit.client.1.smithi120.stdout:2/351: mknod d4/d1b/d25/c73 0 2024-04-26T21:25:47.047 INFO:tasks.workunit.client.1.smithi120.stdout:2/352: stat d4/f66 0 2024-04-26T21:25:47.048 INFO:tasks.workunit.client.1.smithi120.stdout:9/272: sync 2024-04-26T21:25:47.048 INFO:tasks.workunit.client.0.smithi084.stdout:2/109: mkdir d6/d19/d15/d1f/d22 0 2024-04-26T21:25:47.050 INFO:tasks.workunit.client.0.smithi084.stdout:1/35: link d2/d9/ca d2/cd 0 2024-04-26T21:25:47.052 INFO:tasks.workunit.client.1.smithi120.stdout:4/273: readlink d10/d28/l30 0 2024-04-26T21:25:47.052 INFO:tasks.workunit.client.0.smithi084.stdout:5/42: creat d0/fb x:0 0 0 2024-04-26T21:25:47.053 INFO:tasks.workunit.client.1.smithi120.stdout:1/275: write d6/d7/d1d/f50 [8870212,84067] 0 2024-04-26T21:25:47.055 INFO:tasks.workunit.client.1.smithi120.stdout:3/244: link l7 dd/de/d18/d37/l49 0 2024-04-26T21:25:47.056 INFO:tasks.workunit.client.1.smithi120.stdout:2/353: mknod d4/d1b/d4f/c74 0 2024-04-26T21:25:47.057 INFO:tasks.workunit.client.0.smithi084.stdout:7/52: unlink d6/d9/f15 0 2024-04-26T21:25:47.058 INFO:tasks.workunit.client.0.smithi084.stdout:4/32: link d5/ca d5/cb 0 2024-04-26T21:25:47.058 INFO:tasks.workunit.client.0.smithi084.stdout:4/33: dread - no filename 2024-04-26T21:25:47.059 INFO:tasks.workunit.client.0.smithi084.stdout:6/44: mkdir d3/de 0 2024-04-26T21:25:47.060 INFO:tasks.workunit.client.1.smithi120.stdout:6/309: mknod d4/d3d/c5c 0 2024-04-26T21:25:47.060 INFO:tasks.workunit.client.0.smithi084.stdout:6/45: write f1 [2014069,61357] 0 2024-04-26T21:25:47.063 INFO:tasks.workunit.client.0.smithi084.stdout:2/110: mknod d6/d19/d15/d1f/c23 0 2024-04-26T21:25:47.064 INFO:tasks.workunit.client.0.smithi084.stdout:2/111: readlink d6/d7/l17 0 2024-04-26T21:25:47.067 INFO:tasks.workunit.client.0.smithi084.stdout:3/65: getdents d1 0 2024-04-26T21:25:47.069 INFO:tasks.workunit.client.1.smithi120.stdout:5/292: dwrite d2/dc/d1d/d21/f45 [0,4194304] 0 2024-04-26T21:25:47.070 INFO:tasks.workunit.client.1.smithi120.stdout:3/245: mkdir dd/d2a/d4a 0 2024-04-26T21:25:47.071 INFO:tasks.workunit.client.1.smithi120.stdout:2/354: creat d4/d1b/d25/d2c/f75 x:0 0 0 2024-04-26T21:25:47.072 INFO:tasks.workunit.client.0.smithi084.stdout:7/53: rename d6/dc/f13 to d6/f17 0 2024-04-26T21:25:47.072 INFO:tasks.workunit.client.1.smithi120.stdout:1/276: rename d6/d7/d1b/d3b/d5a to d6/d7/d1d/d5d 0 2024-04-26T21:25:47.074 INFO:tasks.workunit.client.0.smithi084.stdout:7/54: truncate d6/f17 1312852 0 2024-04-26T21:25:47.076 INFO:tasks.workunit.client.0.smithi084.stdout:7/55: stat d6/d9 0 2024-04-26T21:25:47.082 INFO:tasks.workunit.client.1.smithi120.stdout:2/355: mknod d4/d1b/d56/d65/c76 0 2024-04-26T21:25:47.082 INFO:tasks.workunit.client.1.smithi120.stdout:1/277: creat d6/d7/da/dd/d35/f5e x:0 0 0 2024-04-26T21:25:47.083 INFO:tasks.workunit.client.0.smithi084.stdout:5/43: truncate d0/f2 1830886 0 2024-04-26T21:25:47.085 INFO:tasks.workunit.client.0.smithi084.stdout:6/46: mkdir d3/dd/df 0 2024-04-26T21:25:47.085 INFO:tasks.workunit.client.0.smithi084.stdout:5/44: fdatasync d0/fa 0 2024-04-26T21:25:47.086 INFO:tasks.workunit.client.0.smithi084.stdout:2/112: creat d6/d19/d15/d1f/d22/f24 x:0 0 0 2024-04-26T21:25:47.089 INFO:tasks.workunit.client.1.smithi120.stdout:5/293: creat d2/f5a x:0 0 0 2024-04-26T21:25:47.090 INFO:tasks.workunit.client.0.smithi084.stdout:3/66: link d1/fe d1/d10/f18 0 2024-04-26T21:25:47.090 INFO:tasks.workunit.client.0.smithi084.stdout:0/80: dwrite f8 [0,4194304] 0 2024-04-26T21:25:47.090 INFO:tasks.workunit.client.0.smithi084.stdout:4/34: symlink d5/d7/lc 0 2024-04-26T21:25:47.090 INFO:tasks.workunit.client.0.smithi084.stdout:4/35: fdatasync - no filename 2024-04-26T21:25:47.090 INFO:tasks.workunit.client.0.smithi084.stdout:4/36: dwrite - no filename 2024-04-26T21:25:47.090 INFO:tasks.workunit.client.0.smithi084.stdout:4/37: dwrite - no filename 2024-04-26T21:25:47.092 INFO:tasks.workunit.client.0.smithi084.stdout:3/67: stat d1/f7 0 2024-04-26T21:25:47.092 INFO:tasks.workunit.client.0.smithi084.stdout:2/113: write f0 [1712067,11287] 0 2024-04-26T21:25:47.092 INFO:tasks.workunit.client.0.smithi084.stdout:6/47: creat d3/f10 x:0 0 0 2024-04-26T21:25:47.092 INFO:tasks.workunit.client.0.smithi084.stdout:6/48: readlink - no filename 2024-04-26T21:25:47.094 INFO:tasks.workunit.client.0.smithi084.stdout:6/49: truncate d3/f10 146783 0 2024-04-26T21:25:47.095 INFO:tasks.workunit.client.1.smithi120.stdout:8/289: dwrite d5/d6/d11/f2a [0,4194304] 0 2024-04-26T21:25:47.095 INFO:tasks.workunit.client.0.smithi084.stdout:0/81: mknod de/c1b 0 2024-04-26T21:25:47.096 INFO:tasks.workunit.client.1.smithi120.stdout:0/346: sync 2024-04-26T21:25:47.096 INFO:tasks.workunit.client.0.smithi084.stdout:8/29: fsync f0 0 2024-04-26T21:25:47.102 INFO:tasks.workunit.client.0.smithi084.stdout:4/38: mknod d5/cd 0 2024-04-26T21:25:47.102 INFO:tasks.workunit.client.0.smithi084.stdout:4/39: write - no filename 2024-04-26T21:25:47.103 INFO:tasks.workunit.client.0.smithi084.stdout:8/30: dread - d4/f5 zero size 2024-04-26T21:25:47.104 INFO:tasks.workunit.client.0.smithi084.stdout:6/50: rename d3/f4 to d3/de/f11 0 2024-04-26T21:25:47.109 INFO:tasks.workunit.client.0.smithi084.stdout:7/56: rmdir d6/d9 39 2024-04-26T21:25:47.110 INFO:tasks.workunit.client.1.smithi120.stdout:1/278: mknod d6/d7/da/c5f 0 2024-04-26T21:25:47.110 INFO:tasks.workunit.client.1.smithi120.stdout:3/246: link dd/de/f2e dd/de/d18/f4b 0 2024-04-26T21:25:47.111 INFO:tasks.workunit.client.0.smithi084.stdout:7/57: chown c0 0 1 2024-04-26T21:25:47.112 INFO:tasks.workunit.client.0.smithi084.stdout:8/31: mkdir d4/d7 0 2024-04-26T21:25:47.115 INFO:tasks.workunit.client.0.smithi084.stdout:0/82: dread f4 [0,4194304] 0 2024-04-26T21:25:47.115 INFO:tasks.workunit.client.0.smithi084.stdout:9/25: truncate f1 4676755 0 2024-04-26T21:25:47.115 INFO:tasks.workunit.client.1.smithi120.stdout:0/347: readlink d0/d3/dc/dd/d1b/d39/l5d 0 2024-04-26T21:25:47.116 INFO:tasks.workunit.client.0.smithi084.stdout:8/32: dread - f1 zero size 2024-04-26T21:25:47.117 INFO:tasks.workunit.client.0.smithi084.stdout:1/36: truncate d2/fb 2728654 0 2024-04-26T21:25:47.119 INFO:tasks.workunit.client.1.smithi120.stdout:8/290: symlink d5/l5d 0 2024-04-26T21:25:47.122 INFO:tasks.workunit.client.0.smithi084.stdout:5/45: dwrite d0/f6 [0,4194304] 0 2024-04-26T21:25:47.127 INFO:tasks.workunit.client.0.smithi084.stdout:6/51: dwrite f1 [0,4194304] 0 2024-04-26T21:25:47.130 INFO:tasks.workunit.client.1.smithi120.stdout:9/273: dwrite d0/fa [0,4194304] 0 2024-04-26T21:25:47.131 INFO:tasks.workunit.client.1.smithi120.stdout:6/310: dwrite d4/db/d10/f15 [4194304,4194304] 0 2024-04-26T21:25:47.131 INFO:tasks.workunit.client.0.smithi084.stdout:6/52: chown d3/f7 55 1 2024-04-26T21:25:47.135 INFO:tasks.workunit.client.1.smithi120.stdout:8/291: fdatasync d5/d6/d11/d32/f45 0 2024-04-26T21:25:47.135 INFO:tasks.workunit.client.1.smithi120.stdout:7/290: dread d7/d19/f24 [0,4194304] 0 2024-04-26T21:25:47.136 INFO:tasks.workunit.client.1.smithi120.stdout:4/274: dread f5 [0,4194304] 0 2024-04-26T21:25:47.137 INFO:tasks.workunit.client.0.smithi084.stdout:4/40: creat d5/fe x:0 0 0 2024-04-26T21:25:47.137 INFO:tasks.workunit.client.1.smithi120.stdout:0/348: creat d0/d3/d13/f76 x:0 0 0 2024-04-26T21:25:47.138 INFO:tasks.workunit.client.1.smithi120.stdout:6/311: stat d4/d27/f32 0 2024-04-26T21:25:47.139 INFO:tasks.workunit.client.0.smithi084.stdout:9/26: mknod c6 0 2024-04-26T21:25:47.142 INFO:tasks.workunit.client.0.smithi084.stdout:4/41: truncate d5/fe 592938 0 2024-04-26T21:25:47.142 INFO:tasks.workunit.client.0.smithi084.stdout:7/58: write d6/d9/fa [1697322,79231] 0 2024-04-26T21:25:47.143 INFO:tasks.workunit.client.1.smithi120.stdout:3/247: creat dd/de/d18/d24/d43/f4c x:0 0 0 2024-04-26T21:25:47.144 INFO:tasks.workunit.client.1.smithi120.stdout:6/312: fdatasync d4/db/f35 0 2024-04-26T21:25:47.146 INFO:tasks.workunit.client.0.smithi084.stdout:8/33: link f0 d4/d6/f8 0 2024-04-26T21:25:47.150 INFO:tasks.workunit.client.0.smithi084.stdout:0/83: dwrite f8 [4194304,4194304] 0 2024-04-26T21:25:47.152 INFO:tasks.workunit.client.1.smithi120.stdout:5/294: dwrite d2/fa [0,4194304] 0 2024-04-26T21:25:47.152 INFO:tasks.workunit.client.1.smithi120.stdout:6/313: chown d4/f31 73 1 2024-04-26T21:25:47.154 INFO:tasks.workunit.client.1.smithi120.stdout:4/275: rmdir d10/d12 39 2024-04-26T21:25:47.154 INFO:tasks.workunit.client.1.smithi120.stdout:2/356: dwrite d4/d1b/d2e/d50/f2a [0,4194304] 0 2024-04-26T21:25:47.154 INFO:tasks.workunit.client.1.smithi120.stdout:9/274: fsync d0/d14/d2d/f41 0 2024-04-26T21:25:47.155 INFO:tasks.workunit.client.0.smithi084.stdout:0/84: write f0 [2506301,11340] 0 2024-04-26T21:25:47.156 INFO:tasks.workunit.client.0.smithi084.stdout:4/42: symlink d5/d7/lf 0 2024-04-26T21:25:47.157 INFO:tasks.workunit.client.0.smithi084.stdout:7/59: rmdir d6 39 2024-04-26T21:25:47.157 INFO:tasks.workunit.client.0.smithi084.stdout:6/53: dread d3/f5 [0,4194304] 0 2024-04-26T21:25:47.161 INFO:tasks.workunit.client.0.smithi084.stdout:8/34: mkdir d4/d7/d9 0 2024-04-26T21:25:47.165 INFO:tasks.workunit.client.0.smithi084.stdout:6/54: write d3/f7 [3134467,44678] 0 2024-04-26T21:25:47.165 INFO:tasks.workunit.client.0.smithi084.stdout:6/55: readlink - no filename 2024-04-26T21:25:47.166 INFO:tasks.workunit.client.1.smithi120.stdout:0/349: creat d0/d3/dc/dd/d1b/d24/f77 x:0 0 0 2024-04-26T21:25:47.167 INFO:tasks.workunit.client.1.smithi120.stdout:4/276: truncate d10/f26 261304 0 2024-04-26T21:25:47.167 INFO:tasks.workunit.client.1.smithi120.stdout:7/291: mknod d7/d10/d12/d1a/d50/c69 0 2024-04-26T21:25:47.167 INFO:tasks.workunit.client.1.smithi120.stdout:9/275: read d0/f54 [59185,11648] 0 2024-04-26T21:25:47.167 INFO:tasks.workunit.client.1.smithi120.stdout:2/357: chown d4/d1b/d25/l4c 2 1 2024-04-26T21:25:47.167 INFO:tasks.workunit.client.1.smithi120.stdout:1/279: rename d6/d7/da/f28 to d6/d7/d1b/f60 0 2024-04-26T21:25:47.167 INFO:tasks.workunit.client.1.smithi120.stdout:8/292: rmdir d5/d6/d34 39 2024-04-26T21:25:47.167 INFO:tasks.workunit.client.0.smithi084.stdout:9/27: link c6 c7 0 2024-04-26T21:25:47.167 INFO:tasks.workunit.client.0.smithi084.stdout:0/85: mkdir de/d1c 0 2024-04-26T21:25:47.169 INFO:tasks.workunit.client.0.smithi084.stdout:8/35: fdatasync d4/d6/f8 0 2024-04-26T21:25:47.170 INFO:tasks.workunit.client.1.smithi120.stdout:6/314: unlink d4/db/d10/l53 0 2024-04-26T21:25:47.171 INFO:tasks.workunit.client.0.smithi084.stdout:7/60: write d6/d9/ff [1002994,36536] 0 2024-04-26T21:25:47.173 INFO:tasks.workunit.client.0.smithi084.stdout:9/28: fdatasync f1 0 2024-04-26T21:25:47.174 INFO:tasks.workunit.client.0.smithi084.stdout:0/86: write f9 [958006,19404] 0 2024-04-26T21:25:47.174 INFO:tasks.workunit.client.0.smithi084.stdout:8/36: read f0 [6963366,101096] 0 2024-04-26T21:25:47.178 INFO:tasks.workunit.client.1.smithi120.stdout:7/292: write d7/f22 [2427272,13027] 0 2024-04-26T21:25:47.178 INFO:tasks.workunit.client.1.smithi120.stdout:4/277: write d10/d12/f43 [3652969,88863] 0 2024-04-26T21:25:47.179 INFO:tasks.workunit.client.0.smithi084.stdout:8/37: chown f0 743900 1 2024-04-26T21:25:47.180 INFO:tasks.workunit.client.1.smithi120.stdout:5/295: link d2/d1b/d29/f50 d2/d1b/d22/d47/f5b 0 2024-04-26T21:25:47.186 INFO:tasks.workunit.client.1.smithi120.stdout:8/293: creat d5/d6/d34/d42/d4a/f5e x:0 0 0 2024-04-26T21:25:47.189 INFO:tasks.workunit.client.1.smithi120.stdout:5/296: truncate d2/dc/d1d/f33 5128044 0 2024-04-26T21:25:47.189 INFO:tasks.workunit.client.1.smithi120.stdout:0/350: creat d0/d3/dc/dd/d1b/f78 x:0 0 0 2024-04-26T21:25:47.189 INFO:tasks.workunit.client.1.smithi120.stdout:1/280: fsync d6/d7/da/dd/d56/f57 0 2024-04-26T21:25:47.190 INFO:tasks.workunit.client.1.smithi120.stdout:8/294: rmdir d5/d6/d34 39 2024-04-26T21:25:47.191 INFO:tasks.workunit.client.0.smithi084.stdout:0/87: unlink fc 0 2024-04-26T21:25:47.192 INFO:tasks.workunit.client.0.smithi084.stdout:4/43: dwrite d5/fe [0,4194304] 0 2024-04-26T21:25:47.198 INFO:tasks.workunit.client.1.smithi120.stdout:1/281: write d6/d7/ff [1804206,121252] 0 2024-04-26T21:25:47.201 INFO:tasks.workunit.client.0.smithi084.stdout:1/37: dread d2/fb [0,4194304] 0 2024-04-26T21:25:47.202 INFO:tasks.workunit.client.1.smithi120.stdout:6/315: dread d4/db/d10/dd/f18 [0,4194304] 0 2024-04-26T21:25:47.208 INFO:tasks.workunit.client.0.smithi084.stdout:7/61: fsync d6/d9/ff 0 2024-04-26T21:25:47.209 INFO:tasks.workunit.client.0.smithi084.stdout:4/44: mkdir d5/d10 0 2024-04-26T21:25:47.210 INFO:tasks.workunit.client.1.smithi120.stdout:0/351: mkdir d0/df/d79 0 2024-04-26T21:25:47.217 INFO:tasks.workunit.client.0.smithi084.stdout:5/46: dwrite d0/f6 [4194304,4194304] 0 2024-04-26T21:25:47.218 INFO:tasks.workunit.client.1.smithi120.stdout:3/248: dwrite dd/de/d18/f22 [0,4194304] 0 2024-04-26T21:25:47.219 INFO:tasks.workunit.client.0.smithi084.stdout:0/88: dread f9 [0,4194304] 0 2024-04-26T21:25:47.220 INFO:tasks.workunit.client.0.smithi084.stdout:6/56: dwrite d3/f6 [0,4194304] 0 2024-04-26T21:25:47.221 INFO:tasks.workunit.client.1.smithi120.stdout:1/282: dread d6/f51 [0,4194304] 0 2024-04-26T21:25:47.225 INFO:tasks.workunit.client.0.smithi084.stdout:6/57: stat d3/dd 0 2024-04-26T21:25:47.231 INFO:tasks.workunit.client.1.smithi120.stdout:1/283: rmdir d6/d7/da 39 2024-04-26T21:25:47.231 INFO:tasks.workunit.client.1.smithi120.stdout:7/293: dwrite d7/d10/d12/d1a/d33/f5b [0,4194304] 0 2024-04-26T21:25:47.233 INFO:tasks.workunit.client.0.smithi084.stdout:5/47: mkdir d0/dc 0 2024-04-26T21:25:47.235 INFO:tasks.workunit.client.0.smithi084.stdout:5/48: stat d0/c3 0 2024-04-26T21:25:47.240 INFO:tasks.workunit.client.1.smithi120.stdout:3/249: dread - dd/de/df/d12/d48/f3d zero size 2024-04-26T21:25:47.242 INFO:tasks.workunit.client.1.smithi120.stdout:8/295: getdents d5/d6/d34/d42 0 2024-04-26T21:25:47.245 INFO:tasks.workunit.client.1.smithi120.stdout:8/296: write d5/d18/f22 [900095,44330] 0 2024-04-26T21:25:47.247 INFO:tasks.workunit.client.1.smithi120.stdout:7/294: truncate d7/ff 1083557 0 2024-04-26T21:25:47.249 INFO:tasks.workunit.client.1.smithi120.stdout:8/297: readlink d5/d6/l13 0 2024-04-26T21:25:47.250 INFO:tasks.workunit.client.0.smithi084.stdout:7/62: dwrite d6/f17 [0,4194304] 0 2024-04-26T21:25:47.252 INFO:tasks.workunit.client.1.smithi120.stdout:6/316: dread d4/db/f23 [0,4194304] 0 2024-04-26T21:25:47.254 INFO:tasks.workunit.client.1.smithi120.stdout:0/352: dwrite d0/d3/d13/f76 [0,4194304] 0 2024-04-26T21:25:47.254 INFO:tasks.workunit.client.1.smithi120.stdout:9/276: truncate d0/d14/d2d/d4b/f55 642295 0 2024-04-26T21:25:47.263 INFO:tasks.workunit.client.1.smithi120.stdout:2/358: truncate d4/d1b/d56/d65/f6f 6148074 0 2024-04-26T21:25:47.266 INFO:tasks.workunit.client.1.smithi120.stdout:0/353: creat d0/d3/d13/d5a/f7a x:0 0 0 2024-04-26T21:25:47.271 INFO:tasks.workunit.client.1.smithi120.stdout:8/298: symlink d5/d6/d11/d32/l5f 0 2024-04-26T21:25:47.272 INFO:tasks.workunit.client.0.smithi084.stdout:5/49: dread d0/f2 [0,4194304] 0 2024-04-26T21:25:47.272 INFO:tasks.workunit.client.0.smithi084.stdout:7/63: dwrite d6/d9/f11 [0,4194304] 0 2024-04-26T21:25:47.284 INFO:tasks.workunit.client.0.smithi084.stdout:6/58: creat d3/dd/df/f12 x:0 0 0 2024-04-26T21:25:47.286 INFO:tasks.workunit.client.0.smithi084.stdout:1/38: write d2/fb [2049576,45316] 0 2024-04-26T21:25:47.287 INFO:tasks.workunit.client.0.smithi084.stdout:9/29: write f1 [5361,116521] 0 2024-04-26T21:25:47.289 INFO:tasks.workunit.client.1.smithi120.stdout:9/277: getdents d0/d6/d4d 0 2024-04-26T21:25:47.290 INFO:tasks.workunit.client.0.smithi084.stdout:1/39: stat d2/d9 0 2024-04-26T21:25:47.299 INFO:tasks.workunit.client.1.smithi120.stdout:2/359: unlink d4/d1b/d2e/l58 0 2024-04-26T21:25:47.299 INFO:tasks.workunit.client.1.smithi120.stdout:7/295: dwrite d7/d10/d12/f15 [0,4194304] 0 2024-04-26T21:25:47.299 INFO:tasks.workunit.client.0.smithi084.stdout:8/38: dwrite f0 [0,4194304] 0 2024-04-26T21:25:47.299 INFO:tasks.workunit.client.0.smithi084.stdout:8/39: chown l2 0 1 2024-04-26T21:25:47.300 INFO:tasks.workunit.client.0.smithi084.stdout:5/50: creat d0/fd x:0 0 0 2024-04-26T21:25:47.302 INFO:tasks.workunit.client.0.smithi084.stdout:6/59: mkdir d3/de/d13 0 2024-04-26T21:25:47.302 INFO:tasks.workunit.client.0.smithi084.stdout:5/51: write d0/f4 [2923238,37663] 0 2024-04-26T21:25:47.304 INFO:tasks.workunit.client.1.smithi120.stdout:6/317: dread d4/f31 [0,4194304] 0 2024-04-26T21:25:47.304 INFO:tasks.workunit.client.1.smithi120.stdout:1/284: dwrite d6/d7/d1b/f60 [0,4194304] 0 2024-04-26T21:25:47.304 INFO:tasks.workunit.client.1.smithi120.stdout:0/354: creat d0/d3/dc/dd/f7b x:0 0 0 2024-04-26T21:25:47.305 INFO:tasks.workunit.client.1.smithi120.stdout:5/297: dread d2/dc/fd [0,4194304] 0 2024-04-26T21:25:47.307 INFO:tasks.workunit.client.1.smithi120.stdout:8/299: rename d5/d2e to d5/d6/d34/d37/d60 0 2024-04-26T21:25:47.310 INFO:tasks.workunit.client.1.smithi120.stdout:7/296: chown d7/fe 218 1 2024-04-26T21:25:47.312 INFO:tasks.workunit.client.1.smithi120.stdout:4/278: dwrite d10/d12/f40 [0,4194304] 0 2024-04-26T21:25:47.315 INFO:tasks.workunit.client.1.smithi120.stdout:1/285: rmdir d6/d9 39 2024-04-26T21:25:47.315 INFO:tasks.workunit.client.0.smithi084.stdout:1/40: link d2/fb d2/fe 0 2024-04-26T21:25:47.315 INFO:tasks.workunit.client.0.smithi084.stdout:6/60: dread d3/f6 [0,4194304] 0 2024-04-26T21:25:47.317 INFO:tasks.workunit.client.0.smithi084.stdout:1/41: chown d2/d9 6 1 2024-04-26T21:25:47.317 INFO:tasks.workunit.client.1.smithi120.stdout:5/298: chown d2/db/l18 15 1 2024-04-26T21:25:47.317 INFO:tasks.workunit.client.1.smithi120.stdout:8/300: symlink d5/d6/d11/l61 0 2024-04-26T21:25:47.320 INFO:tasks.workunit.client.0.smithi084.stdout:8/40: symlink d4/d7/d9/la 0 2024-04-26T21:25:47.321 INFO:tasks.workunit.client.1.smithi120.stdout:7/297: unlink d7/d10/d12/d1a/d50/c69 0 2024-04-26T21:25:47.326 INFO:tasks.workunit.client.0.smithi084.stdout:4/45: truncate d5/fe 242704 0 2024-04-26T21:25:47.327 INFO:tasks.workunit.client.0.smithi084.stdout:6/61: creat d3/f14 x:0 0 0 2024-04-26T21:25:47.328 INFO:tasks.workunit.client.1.smithi120.stdout:4/279: creat d10/d12/f5c x:0 0 0 2024-04-26T21:25:47.329 INFO:tasks.workunit.client.0.smithi084.stdout:8/41: dread f0 [4194304,4194304] 0 2024-04-26T21:25:47.329 INFO:tasks.workunit.client.0.smithi084.stdout:1/42: fdatasync d2/fb 0 2024-04-26T21:25:47.334 INFO:tasks.workunit.client.1.smithi120.stdout:6/318: rename d4/db/d25/d54 to d4/db/d10/dd/d4e/d5d 0 2024-04-26T21:25:47.334 INFO:tasks.workunit.client.1.smithi120.stdout:5/299: symlink d2/db/l5c 0 2024-04-26T21:25:47.336 INFO:tasks.workunit.client.1.smithi120.stdout:4/280: mknod d10/d12/c5d 0 2024-04-26T21:25:47.339 INFO:tasks.workunit.client.1.smithi120.stdout:9/278: dread d0/d6/f39 [0,4194304] 0 2024-04-26T21:25:47.342 INFO:tasks.workunit.client.0.smithi084.stdout:1/43: creat d2/ff x:0 0 0 2024-04-26T21:25:47.342 INFO:tasks.workunit.client.1.smithi120.stdout:5/300: chown d2/f13 2 1 2024-04-26T21:25:47.344 INFO:tasks.workunit.client.0.smithi084.stdout:8/42: mkdir d4/d6/db 0 2024-04-26T21:25:47.345 INFO:tasks.workunit.client.0.smithi084.stdout:6/62: dwrite f1 [0,4194304] 0 2024-04-26T21:25:47.346 INFO:tasks.workunit.client.0.smithi084.stdout:6/63: chown d3/f5 26 1 2024-04-26T21:25:47.351 INFO:tasks.workunit.client.0.smithi084.stdout:8/43: symlink d4/lc 0 2024-04-26T21:25:47.352 INFO:tasks.workunit.client.0.smithi084.stdout:1/44: dread d2/fb [0,4194304] 0 2024-04-26T21:25:47.352 INFO:tasks.workunit.client.0.smithi084.stdout:8/44: chown d4/d7/d9/la 2354 1 2024-04-26T21:25:47.353 INFO:tasks.workunit.client.1.smithi120.stdout:3/250: truncate dd/d2a/f33 2656276 0 2024-04-26T21:25:47.353 INFO:tasks.workunit.client.1.smithi120.stdout:2/360: link d4/d1b/c23 d4/d1b/d5c/c77 0 2024-04-26T21:25:47.353 INFO:tasks.workunit.client.0.smithi084.stdout:3/68: sync 2024-04-26T21:25:47.353 INFO:tasks.workunit.client.0.smithi084.stdout:2/114: sync 2024-04-26T21:25:47.357 INFO:tasks.workunit.client.0.smithi084.stdout:1/45: creat d2/f10 x:0 0 0 2024-04-26T21:25:47.359 INFO:tasks.workunit.client.0.smithi084.stdout:3/69: dread d1/f9 [0,4194304] 0 2024-04-26T21:25:47.362 INFO:tasks.workunit.client.0.smithi084.stdout:8/45: dread d4/d6/f8 [4194304,4194304] 0 2024-04-26T21:25:47.364 INFO:tasks.workunit.client.0.smithi084.stdout:2/115: creat d6/d19/f25 x:0 0 0 2024-04-26T21:25:47.366 INFO:tasks.workunit.client.0.smithi084.stdout:1/46: creat d2/d9/f11 x:0 0 0 2024-04-26T21:25:47.366 INFO:tasks.workunit.client.0.smithi084.stdout:3/70: rmdir d1 39 2024-04-26T21:25:47.367 INFO:tasks.workunit.client.0.smithi084.stdout:7/64: fdatasync d6/f17 0 2024-04-26T21:25:47.370 INFO:tasks.workunit.client.0.smithi084.stdout:0/89: truncate f8 1462696 0 2024-04-26T21:25:47.371 INFO:tasks.workunit.client.1.smithi120.stdout:0/355: dread d0/d3/dc/f2a [0,4194304] 0 2024-04-26T21:25:47.372 INFO:tasks.workunit.client.1.smithi120.stdout:3/251: write dd/de/df/f34 [2132787,19395] 0 2024-04-26T21:25:47.372 INFO:tasks.workunit.client.1.smithi120.stdout:8/301: dwrite d5/d6/d11/d32/f45 [0,4194304] 0 2024-04-26T21:25:47.377 INFO:tasks.workunit.client.0.smithi084.stdout:6/64: rename d3/dd to d3/de/d15 0 2024-04-26T21:25:47.380 INFO:tasks.workunit.client.1.smithi120.stdout:9/279: creat d0/dd/d34/f59 x:0 0 0 2024-04-26T21:25:47.380 INFO:tasks.workunit.client.1.smithi120.stdout:1/286: dwrite d6/d7/d1d/f47 [4194304,4194304] 0 2024-04-26T21:25:47.382 INFO:tasks.workunit.client.0.smithi084.stdout:3/71: symlink d1/d10/l19 0 2024-04-26T21:25:47.387 INFO:tasks.workunit.client.0.smithi084.stdout:5/52: rmdir d0 39 2024-04-26T21:25:47.387 INFO:tasks.workunit.client.1.smithi120.stdout:2/361: truncate d4/d1b/d25/d2c/f75 938984 0 2024-04-26T21:25:47.392 INFO:tasks.workunit.client.1.smithi120.stdout:8/302: unlink d5/d6/f1f 0 2024-04-26T21:25:47.392 INFO:tasks.workunit.client.0.smithi084.stdout:6/65: unlink d3/cb 0 2024-04-26T21:25:47.394 INFO:tasks.workunit.client.1.smithi120.stdout:0/356: chown d0/d3/dc/d12/d31/f5e 0 1 2024-04-26T21:25:47.394 INFO:tasks.workunit.client.1.smithi120.stdout:5/301: dread d2/d1b/d22/f42 [0,4194304] 0 2024-04-26T21:25:47.398 INFO:tasks.workunit.client.1.smithi120.stdout:6/319: dwrite d4/db/d10/dd/d43/f48 [0,4194304] 0 2024-04-26T21:25:47.402 INFO:tasks.workunit.client.1.smithi120.stdout:2/362: read d4/d1b/d56/d65/f67 [151257,29353] 0 2024-04-26T21:25:47.406 INFO:tasks.workunit.client.1.smithi120.stdout:7/298: dwrite d7/d10/d12/f14 [4194304,4194304] 0 2024-04-26T21:25:47.410 INFO:tasks.workunit.client.1.smithi120.stdout:8/303: write d5/d6/d11/f10 [3037278,15892] 0 2024-04-26T21:25:47.415 INFO:tasks.workunit.client.1.smithi120.stdout:8/304: stat d5/l5d 0 2024-04-26T21:25:47.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:47 smithi084 ceph-mon[25539]: pgmap v38: 65 pgs: 65 active+clean; 458 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 823 KiB/s rd, 35 MiB/s wr, 135 op/s 2024-04-26T21:25:47.415 INFO:tasks.workunit.client.0.smithi084.stdout:0/90: creat de/d1c/f1d x:0 0 0 2024-04-26T21:25:47.416 INFO:tasks.workunit.client.0.smithi084.stdout:1/47: fsync d2/fe 0 2024-04-26T21:25:47.416 INFO:tasks.workunit.client.0.smithi084.stdout:7/65: rename d6/l7 to d6/l18 0 2024-04-26T21:25:47.418 INFO:tasks.workunit.client.1.smithi120.stdout:1/287: mknod d6/d7/da/c61 0 2024-04-26T21:25:47.418 INFO:tasks.workunit.client.1.smithi120.stdout:6/320: chown d4/db/d10/dd/f36 54265205 1 2024-04-26T21:25:47.419 INFO:tasks.workunit.client.0.smithi084.stdout:4/46: fsync d5/fe 0 2024-04-26T21:25:47.420 INFO:tasks.workunit.client.0.smithi084.stdout:9/30: truncate f3 189993 0 2024-04-26T21:25:47.420 INFO:tasks.workunit.client.1.smithi120.stdout:7/299: stat d7/d10/d12/d1f/d28/f3e 0 2024-04-26T21:25:47.424 INFO:tasks.workunit.client.0.smithi084.stdout:2/116: write d6/f12 [2055927,126337] 0 2024-04-26T21:25:47.427 INFO:tasks.workunit.client.0.smithi084.stdout:2/117: readlink d6/d7/l13 0 2024-04-26T21:25:47.428 INFO:tasks.workunit.client.1.smithi120.stdout:7/300: creat d7/d10/f6a x:0 0 0 2024-04-26T21:25:47.432 INFO:tasks.workunit.client.1.smithi120.stdout:0/357: rename d0/d3/dc/dd/d1b/l75 to d0/l7c 0 2024-04-26T21:25:47.432 INFO:tasks.workunit.client.0.smithi084.stdout:3/72: dwrite d1/ff [0,4194304] 0 2024-04-26T21:25:47.432 INFO:tasks.workunit.client.0.smithi084.stdout:2/118: chown d6/d7/fb 111834383 1 2024-04-26T21:25:47.434 INFO:tasks.workunit.client.1.smithi120.stdout:2/363: mknod d4/d1b/d2e/d5f/c78 0 2024-04-26T21:25:47.436 INFO:tasks.workunit.client.1.smithi120.stdout:9/280: truncate d0/dd/d34/f57 805881 0 2024-04-26T21:25:47.437 INFO:tasks.workunit.client.0.smithi084.stdout:2/119: write d6/d19/f25 [114581,123958] 0 2024-04-26T21:25:47.441 INFO:tasks.workunit.client.0.smithi084.stdout:6/66: dwrite d3/f10 [0,4194304] 0 2024-04-26T21:25:47.442 INFO:tasks.workunit.client.0.smithi084.stdout:0/91: creat de/f1e x:0 0 0 2024-04-26T21:25:47.444 INFO:tasks.workunit.client.0.smithi084.stdout:1/48: readlink d2/lc 0 2024-04-26T21:25:47.444 INFO:tasks.workunit.client.0.smithi084.stdout:2/120: chown d6/d7/l17 972666657 1 2024-04-26T21:25:47.444 INFO:tasks.workunit.client.0.smithi084.stdout:1/49: chown c0 190118 1 2024-04-26T21:25:47.446 INFO:tasks.workunit.client.0.smithi084.stdout:5/53: dread d0/f6 [4194304,4194304] 0 2024-04-26T21:25:47.447 INFO:tasks.workunit.client.1.smithi120.stdout:3/252: truncate dd/de/df/d1e/d28/f2d 2701250 0 2024-04-26T21:25:47.447 INFO:tasks.workunit.client.0.smithi084.stdout:2/121: write d6/d7/d8/fe [52747,95379] 0 2024-04-26T21:25:47.448 INFO:tasks.workunit.client.0.smithi084.stdout:5/54: chown d0/dc 988 1 2024-04-26T21:25:47.449 INFO:tasks.workunit.client.0.smithi084.stdout:2/122: chown d6/d7/d8/c1d 0 1 2024-04-26T21:25:47.449 INFO:tasks.workunit.client.1.smithi120.stdout:6/321: getdents d4/db/d10/dd/d4e/d5d 0 2024-04-26T21:25:47.450 INFO:tasks.workunit.client.1.smithi120.stdout:9/281: unlink d0/d6/f52 0 2024-04-26T21:25:47.450 INFO:tasks.workunit.client.0.smithi084.stdout:2/123: dread - d6/d19/d15/f1c zero size 2024-04-26T21:25:47.451 INFO:tasks.workunit.client.1.smithi120.stdout:8/305: dwrite d5/f19 [0,4194304] 0 2024-04-26T21:25:47.457 INFO:tasks.workunit.client.0.smithi084.stdout:3/73: rename d1/f9 to d1/f1a 0 2024-04-26T21:25:47.459 INFO:tasks.workunit.client.0.smithi084.stdout:3/74: write d1/f2 [3078278,23956] 0 2024-04-26T21:25:47.462 INFO:tasks.workunit.client.1.smithi120.stdout:9/282: chown d0/dd/l29 4009 1 2024-04-26T21:25:47.462 INFO:tasks.workunit.client.1.smithi120.stdout:3/253: mknod dd/d2a/d4a/c4d 0 2024-04-26T21:25:47.465 INFO:tasks.workunit.client.0.smithi084.stdout:0/92: stat de/c16 0 2024-04-26T21:25:47.465 INFO:tasks.workunit.client.0.smithi084.stdout:7/66: mkdir d6/d9/d12/d19 0 2024-04-26T21:25:47.466 INFO:tasks.workunit.client.1.smithi120.stdout:7/301: dwrite d7/f5c [0,4194304] 0 2024-04-26T21:25:47.467 INFO:tasks.workunit.client.0.smithi084.stdout:1/50: creat d2/f12 x:0 0 0 2024-04-26T21:25:47.467 INFO:tasks.workunit.client.1.smithi120.stdout:6/322: symlink d4/db/d10/d1a/d2b/d57/l5e 0 2024-04-26T21:25:47.467 INFO:tasks.workunit.client.1.smithi120.stdout:8/306: write d5/d6/d11/d52/d27/f38 [9061349,65695] 0 2024-04-26T21:25:47.468 INFO:tasks.workunit.client.0.smithi084.stdout:7/67: truncate d6/d9/f11 5119144 0 2024-04-26T21:25:47.468 INFO:tasks.workunit.client.0.smithi084.stdout:1/51: truncate d2/f10 525539 0 2024-04-26T21:25:47.469 INFO:tasks.workunit.client.0.smithi084.stdout:1/52: fdatasync d2/f12 0 2024-04-26T21:25:47.473 INFO:tasks.workunit.client.1.smithi120.stdout:5/302: dread d2/d30/f2f [0,4194304] 0 2024-04-26T21:25:47.482 INFO:tasks.workunit.client.0.smithi084.stdout:2/124: creat d6/d19/f26 x:0 0 0 2024-04-26T21:25:47.483 INFO:tasks.workunit.client.1.smithi120.stdout:5/303: write d2/d30/d3b/f4a [275036,124547] 0 2024-04-26T21:25:47.484 INFO:tasks.workunit.client.0.smithi084.stdout:2/125: truncate d6/f12 4991836 0 2024-04-26T21:25:47.484 INFO:tasks.workunit.client.0.smithi084.stdout:3/75: mknod d1/d10/c1b 0 2024-04-26T21:25:47.484 INFO:tasks.workunit.client.0.smithi084.stdout:6/67: dwrite d3/de/f11 [0,4194304] 0 2024-04-26T21:25:47.485 INFO:tasks.workunit.client.1.smithi120.stdout:7/302: rename d7/d19/d56 to d7/d10/d12/d1f/d28/d4c/d6b 0 2024-04-26T21:25:47.488 INFO:tasks.workunit.client.0.smithi084.stdout:7/68: rename d6/l8 to d6/d9/d12/d19/l1a 0 2024-04-26T21:25:47.489 INFO:tasks.workunit.client.0.smithi084.stdout:5/55: link d0/f8 d0/fe 0 2024-04-26T21:25:47.491 INFO:tasks.workunit.client.0.smithi084.stdout:5/56: chown d0/f2 1 1 2024-04-26T21:25:47.491 INFO:tasks.workunit.client.0.smithi084.stdout:4/47: rename d5/c8 to d5/c11 0 2024-04-26T21:25:47.494 INFO:tasks.workunit.client.1.smithi120.stdout:8/307: creat d5/f62 x:0 0 0 2024-04-26T21:25:47.494 INFO:tasks.workunit.client.0.smithi084.stdout:2/126: creat d6/d7/f27 x:0 0 0 2024-04-26T21:25:47.494 INFO:tasks.workunit.client.1.smithi120.stdout:5/304: mknod d2/d1b/d29/c5d 0 2024-04-26T21:25:47.495 INFO:tasks.workunit.client.0.smithi084.stdout:3/76: symlink d1/d10/l1c 0 2024-04-26T21:25:47.499 INFO:tasks.workunit.client.0.smithi084.stdout:1/53: rename d2/f12 to d2/d9/f13 0 2024-04-26T21:25:47.501 INFO:tasks.workunit.client.1.smithi120.stdout:8/308: chown d5/d6/d34 1 1 2024-04-26T21:25:47.503 INFO:tasks.workunit.client.0.smithi084.stdout:1/54: chown d2/f10 526288395 1 2024-04-26T21:25:47.503 INFO:tasks.workunit.client.1.smithi120.stdout:7/303: mkdir d7/d10/d12/d1f/d28/d4c/d6c 0 2024-04-26T21:25:47.504 INFO:tasks.workunit.client.0.smithi084.stdout:4/48: chown d5/l6 10 1 2024-04-26T21:25:47.504 INFO:tasks.workunit.client.0.smithi084.stdout:3/77: creat d1/f1d x:0 0 0 2024-04-26T21:25:47.505 INFO:tasks.workunit.client.1.smithi120.stdout:1/288: dread d6/d7/da/fb [0,4194304] 0 2024-04-26T21:25:47.506 INFO:tasks.workunit.client.0.smithi084.stdout:6/68: rename d3/de/d13 to d3/de/d15/d16 0 2024-04-26T21:25:47.507 INFO:tasks.workunit.client.0.smithi084.stdout:1/55: unlink d2/lc 0 2024-04-26T21:25:47.508 INFO:tasks.workunit.client.1.smithi120.stdout:0/358: dwrite d0/f66 [0,4194304] 0 2024-04-26T21:25:47.508 INFO:tasks.workunit.client.0.smithi084.stdout:4/49: chown d5/cb 15250 1 2024-04-26T21:25:47.509 INFO:tasks.workunit.client.0.smithi084.stdout:3/78: rename d1/c17 to d1/c1e 0 2024-04-26T21:25:47.510 INFO:tasks.workunit.client.0.smithi084.stdout:4/50: stat l4 0 2024-04-26T21:25:47.511 INFO:tasks.workunit.client.1.smithi120.stdout:2/364: dwrite d4/d1b/d2e/d50/f2a [0,4194304] 0 2024-04-26T21:25:47.511 INFO:tasks.workunit.client.0.smithi084.stdout:6/69: fsync d3/fc 0 2024-04-26T21:25:47.511 INFO:tasks.workunit.client.1.smithi120.stdout:8/309: write d5/d18/f4b [16052,19242] 0 2024-04-26T21:25:47.512 INFO:tasks.workunit.client.0.smithi084.stdout:3/79: dread - d1/d10/f16 zero size 2024-04-26T21:25:47.513 INFO:tasks.workunit.client.0.smithi084.stdout:4/51: truncate d5/fe 1261825 0 2024-04-26T21:25:47.517 INFO:tasks.workunit.client.0.smithi084.stdout:6/70: mknod d3/de/d15/d16/c17 0 2024-04-26T21:25:47.518 INFO:tasks.workunit.client.0.smithi084.stdout:1/56: dread d2/fe [0,4194304] 0 2024-04-26T21:25:47.520 INFO:tasks.workunit.client.0.smithi084.stdout:1/57: write d2/fb [3389163,21884] 0 2024-04-26T21:25:47.521 INFO:tasks.workunit.client.1.smithi120.stdout:2/365: write d4/d1b/d25/d2c/f49 [4659494,124511] 0 2024-04-26T21:25:47.523 INFO:tasks.workunit.client.1.smithi120.stdout:3/254: dwrite dd/de/df/d12/d48/f3d [0,4194304] 0 2024-04-26T21:25:47.523 INFO:tasks.workunit.client.0.smithi084.stdout:3/80: rename d1/f2 to d1/d10/f1f 0 2024-04-26T21:25:47.529 INFO:tasks.workunit.client.0.smithi084.stdout:9/31: chown f3 287212859 1 2024-04-26T21:25:47.530 INFO:tasks.workunit.client.0.smithi084.stdout:3/81: creat d1/d10/f20 x:0 0 0 2024-04-26T21:25:47.532 INFO:tasks.workunit.client.1.smithi120.stdout:7/304: mknod d7/d10/d12/d1a/d33/d34/c6d 0 2024-04-26T21:25:47.533 INFO:tasks.workunit.client.0.smithi084.stdout:3/82: write d1/fd [429608,34492] 0 2024-04-26T21:25:47.534 INFO:tasks.workunit.client.1.smithi120.stdout:0/359: mkdir d0/d3/dc/dd/d1b/d24/d7d 0 2024-04-26T21:25:47.534 INFO:tasks.workunit.client.0.smithi084.stdout:4/52: dwrite d5/fe [0,4194304] 0 2024-04-26T21:25:47.536 INFO:tasks.workunit.client.0.smithi084.stdout:9/32: symlink l8 0 2024-04-26T21:25:47.536 INFO:tasks.workunit.client.0.smithi084.stdout:7/69: read d6/d9/ff [69351,45734] 0 2024-04-26T21:25:47.538 INFO:tasks.workunit.client.0.smithi084.stdout:9/33: fsync f1 0 2024-04-26T21:25:47.538 INFO:tasks.workunit.client.1.smithi120.stdout:1/289: mkdir d6/d7/d1b/d5c/d62 0 2024-04-26T21:25:47.540 INFO:tasks.workunit.client.1.smithi120.stdout:5/305: dread d2/db/f27 [0,4194304] 0 2024-04-26T21:25:47.541 INFO:tasks.workunit.client.1.smithi120.stdout:0/360: chown d0/d3/d13/d5a/f61 7 1 2024-04-26T21:25:47.541 INFO:tasks.workunit.client.1.smithi120.stdout:8/310: symlink d5/d6/d11/d32/l63 0 2024-04-26T21:25:47.541 INFO:tasks.workunit.client.1.smithi120.stdout:1/290: fsync d6/f3a 0 2024-04-26T21:25:47.544 INFO:tasks.workunit.client.0.smithi084.stdout:3/83: creat d1/d10/f21 x:0 0 0 2024-04-26T21:25:47.545 INFO:tasks.workunit.client.1.smithi120.stdout:2/366: symlink d4/d1b/l79 0 2024-04-26T21:25:47.545 INFO:tasks.workunit.client.1.smithi120.stdout:3/255: creat dd/de/d18/d37/f4e x:0 0 0 2024-04-26T21:25:47.548 INFO:tasks.workunit.client.1.smithi120.stdout:7/305: symlink d7/d10/d12/d1a/d33/d34/d37/l6e 0 2024-04-26T21:25:47.548 INFO:tasks.workunit.client.1.smithi120.stdout:2/367: stat d4/d1b/d56/d65/f67 0 2024-04-26T21:25:47.549 INFO:tasks.workunit.client.1.smithi120.stdout:8/311: rmdir d5/d6/d34/d42 39 2024-04-26T21:25:47.549 INFO:tasks.workunit.client.1.smithi120.stdout:5/306: mknod d2/d1b/d29/c5e 0 2024-04-26T21:25:47.550 INFO:tasks.workunit.client.0.smithi084.stdout:3/84: fsync d1/fd 0 2024-04-26T21:25:47.550 INFO:tasks.workunit.client.0.smithi084.stdout:0/93: truncate f9 687384 0 2024-04-26T21:25:47.552 INFO:tasks.workunit.client.0.smithi084.stdout:3/85: readlink d1/l4 0 2024-04-26T21:25:47.554 INFO:tasks.workunit.client.1.smithi120.stdout:6/323: dread d4/db/d10/dd/d43/f46 [0,4194304] 0 2024-04-26T21:25:47.555 INFO:tasks.workunit.client.1.smithi120.stdout:5/307: fsync d2/db/f14 0 2024-04-26T21:25:47.555 INFO:tasks.workunit.client.1.smithi120.stdout:0/361: mknod d0/d3/dc/dd/d1b/d39/c7e 0 2024-04-26T21:25:47.557 INFO:tasks.workunit.client.1.smithi120.stdout:5/308: stat d2 0 2024-04-26T21:25:47.558 INFO:tasks.workunit.client.1.smithi120.stdout:7/306: write d7/d10/d12/d1f/f36 [1081626,117377] 0 2024-04-26T21:25:47.559 INFO:tasks.workunit.client.0.smithi084.stdout:1/58: rmdir d2/d9 39 2024-04-26T21:25:47.562 INFO:tasks.workunit.client.1.smithi120.stdout:1/291: rename d6/d14/d3c/c4e to d6/d7/d2d/d48/c63 0 2024-04-26T21:25:47.562 INFO:tasks.workunit.client.0.smithi084.stdout:3/86: creat d1/f22 x:0 0 0 2024-04-26T21:25:47.563 INFO:tasks.workunit.client.1.smithi120.stdout:7/307: chown d7/d10/d12/f15 193361 1 2024-04-26T21:25:47.566 INFO:tasks.workunit.client.0.smithi084.stdout:0/94: unlink de/l17 0 2024-04-26T21:25:47.566 INFO:tasks.workunit.client.0.smithi084.stdout:4/53: dread d5/fe [0,4194304] 0 2024-04-26T21:25:47.567 INFO:tasks.workunit.client.1.smithi120.stdout:5/309: mkdir d2/db/d4d/d5f 0 2024-04-26T21:25:47.567 INFO:tasks.workunit.client.1.smithi120.stdout:3/256: creat dd/d40/f4f x:0 0 0 2024-04-26T21:25:47.568 INFO:tasks.workunit.client.1.smithi120.stdout:8/312: chown d5/d6/d34/d42/d4a/f57 67 1 2024-04-26T21:25:47.569 INFO:tasks.workunit.client.0.smithi084.stdout:9/34: dwrite f1 [0,4194304] 0 2024-04-26T21:25:47.569 INFO:tasks.workunit.client.0.smithi084.stdout:7/70: dread d6/d9/f11 [0,4194304] 0 2024-04-26T21:25:47.570 INFO:tasks.workunit.client.0.smithi084.stdout:1/59: unlink d2/fe 0 2024-04-26T21:25:47.573 INFO:tasks.workunit.client.1.smithi120.stdout:7/308: rmdir d7/d10/d12/d1f/d28/d4c 39 2024-04-26T21:25:47.574 INFO:tasks.workunit.client.0.smithi084.stdout:7/71: truncate d6/f17 5092256 0 2024-04-26T21:25:47.574 INFO:tasks.workunit.client.1.smithi120.stdout:3/257: write dd/de/d18/d24/f41 [900112,57022] 0 2024-04-26T21:25:47.575 INFO:tasks.workunit.client.0.smithi084.stdout:3/87: creat d1/f23 x:0 0 0 2024-04-26T21:25:47.576 INFO:tasks.workunit.client.0.smithi084.stdout:5/57: dwrite d0/f2 [0,4194304] 0 2024-04-26T21:25:47.577 INFO:tasks.workunit.client.0.smithi084.stdout:3/88: dread - d1/f7 zero size 2024-04-26T21:25:47.578 INFO:tasks.workunit.client.1.smithi120.stdout:5/310: rename d2/d1b/l3a to d2/d48/l60 0 2024-04-26T21:25:47.580 INFO:tasks.workunit.client.1.smithi120.stdout:2/368: getdents d4/d1b/d2e 0 2024-04-26T21:25:47.581 INFO:tasks.workunit.client.1.smithi120.stdout:6/324: dwrite d4/db/f35 [0,4194304] 0 2024-04-26T21:25:47.590 INFO:tasks.workunit.client.0.smithi084.stdout:7/72: dread d6/d9/fa [0,4194304] 0 2024-04-26T21:25:47.590 INFO:tasks.workunit.client.0.smithi084.stdout:5/58: dread d0/f2 [0,4194304] 0 2024-04-26T21:25:47.592 INFO:tasks.workunit.client.1.smithi120.stdout:8/313: unlink l3 0 2024-04-26T21:25:47.592 INFO:tasks.workunit.client.1.smithi120.stdout:3/258: creat dd/d40/f50 x:0 0 0 2024-04-26T21:25:47.593 INFO:tasks.workunit.client.1.smithi120.stdout:5/311: symlink d2/d30/l61 0 2024-04-26T21:25:47.595 INFO:tasks.workunit.client.0.smithi084.stdout:4/54: creat d5/d10/f12 x:0 0 0 2024-04-26T21:25:47.595 INFO:tasks.workunit.client.0.smithi084.stdout:3/89: fsync d1/d10/f1f 0 2024-04-26T21:25:47.596 INFO:tasks.workunit.client.0.smithi084.stdout:4/55: chown l1 12564375 1 2024-04-26T21:25:47.597 INFO:tasks.workunit.client.0.smithi084.stdout:1/60: creat d2/d9/f14 x:0 0 0 2024-04-26T21:25:47.597 INFO:tasks.workunit.client.0.smithi084.stdout:3/90: chown d1/f1a 2 1 2024-04-26T21:25:47.598 INFO:tasks.workunit.client.0.smithi084.stdout:4/56: chown l1 22337919 1 2024-04-26T21:25:47.599 INFO:tasks.workunit.client.1.smithi120.stdout:6/325: creat d4/db/d10/dd/d4e/f5f x:0 0 0 2024-04-26T21:25:47.600 INFO:tasks.workunit.client.0.smithi084.stdout:7/73: creat d6/d9/d12/d19/f1b x:0 0 0 2024-04-26T21:25:47.600 INFO:tasks.workunit.client.0.smithi084.stdout:1/61: chown d2/d9/f14 27352689 1 2024-04-26T21:25:47.602 INFO:tasks.workunit.client.1.smithi120.stdout:2/369: mknod d4/d1b/d2e/d50/d14/c7a 0 2024-04-26T21:25:47.603 INFO:tasks.workunit.client.0.smithi084.stdout:4/57: unlink d5/l6 0 2024-04-26T21:25:47.604 INFO:tasks.workunit.client.0.smithi084.stdout:5/59: mkdir d0/dc/df 0 2024-04-26T21:25:47.607 INFO:tasks.workunit.client.0.smithi084.stdout:4/58: creat d5/d10/f13 x:0 0 0 2024-04-26T21:25:47.608 INFO:tasks.workunit.client.0.smithi084.stdout:7/74: mkdir d6/d1c 0 2024-04-26T21:25:47.608 INFO:tasks.workunit.client.1.smithi120.stdout:3/259: read dd/f15 [3546646,84402] 0 2024-04-26T21:25:47.610 INFO:tasks.workunit.client.1.smithi120.stdout:0/362: truncate d0/d3/dc/f22 1076621 0 2024-04-26T21:25:47.610 INFO:tasks.workunit.client.0.smithi084.stdout:7/75: read - d6/d9/d12/d19/f1b zero size 2024-04-26T21:25:47.611 INFO:tasks.workunit.client.0.smithi084.stdout:5/60: symlink d0/l10 0 2024-04-26T21:25:47.611 INFO:tasks.workunit.client.1.smithi120.stdout:2/370: symlink d4/d1b/d56/d65/l7b 0 2024-04-26T21:25:47.612 INFO:tasks.workunit.client.1.smithi120.stdout:1/292: write d6/d7/da/dd/d56/f57 [788285,6138] 0 2024-04-26T21:25:47.612 INFO:tasks.workunit.client.1.smithi120.stdout:0/363: chown d0/d3/dc/dd/d1b 1273 1 2024-04-26T21:25:47.613 INFO:tasks.workunit.client.1.smithi120.stdout:5/312: symlink d2/dc/d1d/d1f/d34/l62 0 2024-04-26T21:25:47.614 INFO:tasks.workunit.client.0.smithi084.stdout:5/61: write d0/f4 [5204672,10966] 0 2024-04-26T21:25:47.615 INFO:tasks.workunit.client.1.smithi120.stdout:0/364: readlink d0/d3/l5f 0 2024-04-26T21:25:47.615 INFO:tasks.workunit.client.1.smithi120.stdout:3/260: unlink dd/de/df/d12/l1b 0 2024-04-26T21:25:47.617 INFO:tasks.workunit.client.0.smithi084.stdout:3/91: dread d1/ff [0,4194304] 0 2024-04-26T21:25:47.617 INFO:tasks.workunit.client.0.smithi084.stdout:4/59: link d5/d7/lc d5/l14 0 2024-04-26T21:25:47.617 INFO:tasks.workunit.client.0.smithi084.stdout:7/76: creat d6/d1c/f1d x:0 0 0 2024-04-26T21:25:47.618 INFO:tasks.workunit.client.1.smithi120.stdout:2/371: creat d4/d1b/d4f/f7c x:0 0 0 2024-04-26T21:25:47.619 INFO:tasks.workunit.client.1.smithi120.stdout:0/365: dread - d0/d3/dc/d12/f6a zero size 2024-04-26T21:25:47.619 INFO:tasks.workunit.client.0.smithi084.stdout:5/62: unlink d0/fb 0 2024-04-26T21:25:47.621 INFO:tasks.workunit.client.0.smithi084.stdout:3/92: fsync d1/ff 0 2024-04-26T21:25:47.621 INFO:tasks.workunit.client.0.smithi084.stdout:5/63: chown d0/fa 8569012 1 2024-04-26T21:25:47.621 INFO:tasks.workunit.client.1.smithi120.stdout:0/366: chown d0/d3/d13/d5a/f61 50471382 1 2024-04-26T21:25:47.624 INFO:tasks.workunit.client.1.smithi120.stdout:5/313: mkdir d2/d48/d63 0 2024-04-26T21:25:47.625 INFO:tasks.workunit.client.0.smithi084.stdout:3/93: chown d1/d10/l12 8726 1 2024-04-26T21:25:47.627 INFO:tasks.workunit.client.1.smithi120.stdout:5/314: write d2/db/f14 [2053412,50104] 0 2024-04-26T21:25:47.627 INFO:tasks.workunit.client.0.smithi084.stdout:9/35: getdents . 0 2024-04-26T21:25:47.630 INFO:tasks.workunit.client.1.smithi120.stdout:3/261: creat dd/de/d18/d24/d43/f51 x:0 0 0 2024-04-26T21:25:47.633 INFO:tasks.workunit.client.0.smithi084.stdout:7/77: dread d6/d9/ff [0,4194304] 0 2024-04-26T21:25:47.635 INFO:tasks.workunit.client.0.smithi084.stdout:9/36: unlink f5 0 2024-04-26T21:25:47.636 INFO:tasks.workunit.client.1.smithi120.stdout:2/372: read d4/d1b/d2e/d50/d14/d15/f43 [320944,3733] 0 2024-04-26T21:25:47.636 INFO:tasks.workunit.client.1.smithi120.stdout:5/315: symlink d2/d30/l64 0 2024-04-26T21:25:47.638 INFO:tasks.workunit.client.1.smithi120.stdout:3/262: symlink dd/de/df/d1e/d3b/l52 0 2024-04-26T21:25:47.641 INFO:tasks.workunit.client.1.smithi120.stdout:8/314: write d5/f30 [521220,111006] 0 2024-04-26T21:25:47.641 INFO:tasks.workunit.client.0.smithi084.stdout:7/78: chown d6/d9/d12/d19 519777 1 2024-04-26T21:25:47.643 INFO:tasks.workunit.client.1.smithi120.stdout:2/373: symlink d4/d1b/d25/d29/l7d 0 2024-04-26T21:25:47.647 INFO:tasks.workunit.client.1.smithi120.stdout:3/263: rmdir dd/de/df/d12/d48 39 2024-04-26T21:25:47.647 INFO:tasks.workunit.client.1.smithi120.stdout:2/374: chown d4/d1b/d56 141722 1 2024-04-26T21:25:47.648 INFO:tasks.workunit.client.1.smithi120.stdout:6/326: dread f1 [0,4194304] 0 2024-04-26T21:25:47.649 INFO:tasks.workunit.client.1.smithi120.stdout:5/316: truncate d2/d48/f56 816519 0 2024-04-26T21:25:47.650 INFO:tasks.workunit.client.1.smithi120.stdout:7/309: dwrite d7/ff [0,4194304] 0 2024-04-26T21:25:47.652 INFO:tasks.workunit.client.0.smithi084.stdout:4/60: dwrite d5/fe [0,4194304] 0 2024-04-26T21:25:47.655 INFO:tasks.workunit.client.1.smithi120.stdout:5/317: write d2/dc/d1d/f58 [490621,116720] 0 2024-04-26T21:25:47.656 INFO:tasks.workunit.client.1.smithi120.stdout:7/310: readlink d7/d10/d12/l5e 0 2024-04-26T21:25:47.658 INFO:tasks.workunit.client.0.smithi084.stdout:7/79: symlink d6/d9/d12/d19/l1e 0 2024-04-26T21:25:47.658 INFO:tasks.workunit.client.1.smithi120.stdout:0/367: dwrite d0/df/f3f [0,4194304] 0 2024-04-26T21:25:47.665 INFO:tasks.workunit.client.1.smithi120.stdout:3/264: creat dd/de/d18/d24/d43/f53 x:0 0 0 2024-04-26T21:25:47.667 INFO:tasks.workunit.client.1.smithi120.stdout:5/318: creat d2/dc/d1d/d1f/d36/f65 x:0 0 0 2024-04-26T21:25:47.668 INFO:tasks.workunit.client.1.smithi120.stdout:1/293: truncate d6/d7/d1d/f50 6168964 0 2024-04-26T21:25:47.670 INFO:tasks.workunit.client.1.smithi120.stdout:4/281: sync 2024-04-26T21:25:47.672 INFO:tasks.workunit.client.1.smithi120.stdout:2/375: read d4/d1b/d2e/d50/f3f [3938923,57845] 0 2024-04-26T21:25:47.673 INFO:tasks.workunit.client.0.smithi084.stdout:7/80: write d6/d9/d12/d19/f1b [736569,7712] 0 2024-04-26T21:25:47.675 INFO:tasks.workunit.client.0.smithi084.stdout:5/64: dwrite d0/fa [0,4194304] 0 2024-04-26T21:25:47.679 INFO:tasks.workunit.client.0.smithi084.stdout:3/94: dwrite d1/f3 [0,4194304] 0 2024-04-26T21:25:47.679 INFO:tasks.workunit.client.0.smithi084.stdout:4/61: mkdir d5/d10/d15 0 2024-04-26T21:25:47.680 INFO:tasks.workunit.client.1.smithi120.stdout:7/311: creat d7/d10/d12/d1f/d28/f6f x:0 0 0 2024-04-26T21:25:47.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:47 smithi120 ceph-mon[32741]: pgmap v38: 65 pgs: 65 active+clean; 458 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 823 KiB/s rd, 35 MiB/s wr, 135 op/s 2024-04-26T21:25:47.684 INFO:tasks.workunit.client.1.smithi120.stdout:7/312: chown d7/f22 47 1 2024-04-26T21:25:47.684 INFO:tasks.workunit.client.0.smithi084.stdout:0/95: dwrite f8 [0,4194304] 0 2024-04-26T21:25:47.685 INFO:tasks.workunit.client.0.smithi084.stdout:5/65: dread - d0/fe zero size 2024-04-26T21:25:47.685 INFO:tasks.workunit.client.1.smithi120.stdout:3/265: rename dd/de/d18/d24/d43/f51 to dd/de/d18/d24/f54 0 2024-04-26T21:25:47.687 INFO:tasks.workunit.client.1.smithi120.stdout:8/315: read d5/d6/d11/d52/d27/f53 [3566564,90652] 0 2024-04-26T21:25:47.688 INFO:tasks.workunit.client.0.smithi084.stdout:5/66: chown d0/f6 496 1 2024-04-26T21:25:47.688 INFO:tasks.workunit.client.0.smithi084.stdout:9/37: dread f1 [0,4194304] 0 2024-04-26T21:25:47.693 INFO:tasks.workunit.client.1.smithi120.stdout:7/313: write d7/d10/d12/d1f/d28/f2e [778186,40593] 0 2024-04-26T21:25:47.697 INFO:tasks.workunit.client.1.smithi120.stdout:8/316: creat d5/d6/d34/d37/f64 x:0 0 0 2024-04-26T21:25:47.698 INFO:tasks.workunit.client.0.smithi084.stdout:4/62: creat d5/d7/f16 x:0 0 0 2024-04-26T21:25:47.702 INFO:tasks.workunit.client.1.smithi120.stdout:6/327: dwrite d4/f1f [0,4194304] 0 2024-04-26T21:25:47.702 INFO:tasks.workunit.client.0.smithi084.stdout:5/67: write d0/f6 [460077,61474] 0 2024-04-26T21:25:47.707 INFO:tasks.workunit.client.0.smithi084.stdout:4/63: mkdir d5/d7/d17 0 2024-04-26T21:25:47.707 INFO:tasks.workunit.client.0.smithi084.stdout:9/38: creat f9 x:0 0 0 2024-04-26T21:25:47.708 INFO:tasks.workunit.client.1.smithi120.stdout:2/376: dwrite d4/d1b/d25/d2c/f46 [0,4194304] 0 2024-04-26T21:25:47.710 INFO:tasks.workunit.client.0.smithi084.stdout:7/81: dwrite d6/d1c/f1d [0,4194304] 0 2024-04-26T21:25:47.711 INFO:tasks.workunit.client.1.smithi120.stdout:4/282: dwrite f5 [0,4194304] 0 2024-04-26T21:25:47.713 INFO:tasks.workunit.client.1.smithi120.stdout:3/266: rename dd/de/d18/d24/f20 to dd/de/df/d12/d48/f55 0 2024-04-26T21:25:47.713 INFO:tasks.workunit.client.1.smithi120.stdout:8/317: creat d5/d6/d34/d37/d60/f65 x:0 0 0 2024-04-26T21:25:47.715 INFO:tasks.workunit.client.0.smithi084.stdout:4/64: creat d5/d10/f18 x:0 0 0 2024-04-26T21:25:47.715 INFO:tasks.workunit.client.1.smithi120.stdout:6/328: mkdir d4/db/d10/dd/d4e/d60 0 2024-04-26T21:25:47.715 INFO:tasks.workunit.client.1.smithi120.stdout:7/314: creat d7/d10/d12/d1f/d28/d4c/d6b/f70 x:0 0 0 2024-04-26T21:25:47.716 INFO:tasks.workunit.client.0.smithi084.stdout:7/82: write d6/d9/f11 [1471683,5806] 0 2024-04-26T21:25:47.717 INFO:tasks.workunit.client.1.smithi120.stdout:4/283: write d10/d12/f57 [459600,107194] 0 2024-04-26T21:25:47.719 INFO:tasks.workunit.client.0.smithi084.stdout:9/39: mkdir da 0 2024-04-26T21:25:47.719 INFO:tasks.workunit.client.1.smithi120.stdout:2/377: write d4/d1b/d25/d29/f37 [2122546,35067] 0 2024-04-26T21:25:47.721 INFO:tasks.workunit.client.0.smithi084.stdout:7/83: rmdir d6 39 2024-04-26T21:25:47.724 INFO:tasks.workunit.client.0.smithi084.stdout:4/65: getdents d5/d10/d15 0 2024-04-26T21:25:47.725 INFO:tasks.workunit.client.1.smithi120.stdout:8/318: symlink d5/d6/d11/d52/d27/l66 0 2024-04-26T21:25:47.725 INFO:tasks.workunit.client.1.smithi120.stdout:3/267: mkdir dd/de/df/d1e/d3b/d56 0 2024-04-26T21:25:47.727 INFO:tasks.workunit.client.1.smithi120.stdout:3/268: stat dd/l17 0 2024-04-26T21:25:47.727 INFO:tasks.workunit.client.0.smithi084.stdout:7/84: chown d6/dc/c10 6270 1 2024-04-26T21:25:47.728 INFO:tasks.workunit.client.0.smithi084.stdout:4/66: write d5/d7/f16 [515355,69271] 0 2024-04-26T21:25:47.729 INFO:tasks.workunit.client.1.smithi120.stdout:8/319: chown d5/l5d 1645 1 2024-04-26T21:25:47.730 INFO:tasks.workunit.client.1.smithi120.stdout:5/319: write d2/d1b/d29/f2a [3775628,1523] 0 2024-04-26T21:25:47.734 INFO:tasks.workunit.client.1.smithi120.stdout:8/320: fsync d5/d6/d11/d52/d27/f38 0 2024-04-26T21:25:47.742 INFO:tasks.workunit.client.0.smithi084.stdout:9/40: link f3 da/fb 0 2024-04-26T21:25:47.744 INFO:tasks.workunit.client.0.smithi084.stdout:7/85: rename l2 to d6/l1f 0 2024-04-26T21:25:47.745 INFO:tasks.workunit.client.0.smithi084.stdout:4/67: rename d5/ca to d5/c19 0 2024-04-26T21:25:47.746 INFO:tasks.workunit.client.1.smithi120.stdout:3/269: rename dd/de/df/f34 to dd/de/df/f57 0 2024-04-26T21:25:47.746 INFO:tasks.workunit.client.1.smithi120.stdout:8/321: mkdir d5/d6/d11/d52/d27/d4f/d67 0 2024-04-26T21:25:47.747 INFO:tasks.workunit.client.1.smithi120.stdout:2/378: dwrite d4/f10 [0,4194304] 0 2024-04-26T21:25:47.750 INFO:tasks.workunit.client.0.smithi084.stdout:9/41: creat da/fc x:0 0 0 2024-04-26T21:25:47.752 INFO:tasks.workunit.client.1.smithi120.stdout:3/270: symlink dd/d40/l58 0 2024-04-26T21:25:47.754 INFO:tasks.workunit.client.1.smithi120.stdout:2/379: creat d4/d1b/d25/d2c/d3e/f7e x:0 0 0 2024-04-26T21:25:47.755 INFO:tasks.workunit.client.1.smithi120.stdout:5/320: dread d2/dc/d1d/d21/f45 [0,4194304] 0 2024-04-26T21:25:47.758 INFO:tasks.workunit.client.0.smithi084.stdout:7/86: fsync d6/d9/f11 0 2024-04-26T21:25:47.759 INFO:tasks.workunit.client.0.smithi084.stdout:9/42: symlink da/ld 0 2024-04-26T21:25:47.759 INFO:tasks.workunit.client.0.smithi084.stdout:7/87: stat d6/dc 0 2024-04-26T21:25:47.762 INFO:tasks.workunit.client.1.smithi120.stdout:5/321: dread d2/f3d [0,4194304] 0 2024-04-26T21:25:47.764 INFO:tasks.workunit.client.0.smithi084.stdout:4/68: creat d5/f1a x:0 0 0 2024-04-26T21:25:47.765 INFO:tasks.workunit.client.0.smithi084.stdout:9/43: mkdir da/de 0 2024-04-26T21:25:47.767 INFO:tasks.workunit.client.1.smithi120.stdout:5/322: truncate d2/db/d4d/f4e 838675 0 2024-04-26T21:25:47.769 INFO:tasks.workunit.client.0.smithi084.stdout:9/44: symlink da/lf 0 2024-04-26T21:25:47.770 INFO:tasks.workunit.client.1.smithi120.stdout:1/294: dread d6/d14/f16 [0,4194304] 0 2024-04-26T21:25:47.773 INFO:tasks.workunit.client.0.smithi084.stdout:9/45: creat da/f10 x:0 0 0 2024-04-26T21:25:47.774 INFO:tasks.workunit.client.1.smithi120.stdout:5/323: stat d2/d1b/d29/c32 0 2024-04-26T21:25:47.775 INFO:tasks.workunit.client.1.smithi120.stdout:1/295: symlink d6/d7/da/dd/l64 0 2024-04-26T21:25:47.775 INFO:tasks.workunit.client.0.smithi084.stdout:9/46: chown f9 3420809 1 2024-04-26T21:25:47.779 INFO:tasks.workunit.client.1.smithi120.stdout:1/296: chown d6/d7/da/dd/d35/f5e 231 1 2024-04-26T21:25:47.780 INFO:tasks.workunit.client.1.smithi120.stdout:8/322: dwrite d5/d6/d11/d32/d3b/f56 [0,4194304] 0 2024-04-26T21:25:47.783 INFO:tasks.workunit.client.0.smithi084.stdout:7/88: dwrite d6/d9/d12/d19/f1b [0,4194304] 0 2024-04-26T21:25:47.783 INFO:tasks.workunit.client.1.smithi120.stdout:5/324: rename d2/db to d2/dc/d1d/d21/d66 0 2024-04-26T21:25:47.785 INFO:tasks.workunit.client.0.smithi084.stdout:7/89: readlink d6/dc/l16 0 2024-04-26T21:25:47.786 INFO:tasks.workunit.client.1.smithi120.stdout:8/323: chown d5/d18/f4b 100990033 1 2024-04-26T21:25:47.786 INFO:tasks.workunit.client.1.smithi120.stdout:5/325: readlink d2/d1b/l37 0 2024-04-26T21:25:47.786 INFO:tasks.workunit.client.1.smithi120.stdout:3/271: dwrite dd/de/d18/d24/f3c [0,4194304] 0 2024-04-26T21:25:47.786 INFO:tasks.workunit.client.1.smithi120.stdout:8/324: fsync d5/f62 0 2024-04-26T21:25:47.801 INFO:tasks.workunit.client.1.smithi120.stdout:8/325: unlink d5/d6/d34/d37/l47 0 2024-04-26T21:25:47.807 INFO:tasks.workunit.client.0.smithi084.stdout:9/47: dwrite da/f10 [0,4194304] 0 2024-04-26T21:25:47.808 INFO:tasks.workunit.client.1.smithi120.stdout:5/326: mkdir d2/dc/d1d/d1f/d36/d67 0 2024-04-26T21:25:47.808 INFO:tasks.workunit.client.1.smithi120.stdout:2/380: write d4/d1b/d2e/d50/d14/d15/f2b [1440425,11742] 0 2024-04-26T21:25:47.808 INFO:tasks.workunit.client.1.smithi120.stdout:6/329: dread d4/db/d10/dd/f26 [0,4194304] 0 2024-04-26T21:25:47.808 INFO:tasks.workunit.client.1.smithi120.stdout:8/326: write d5/d6/d11/f10 [1441339,33173] 0 2024-04-26T21:25:47.812 INFO:tasks.workunit.client.1.smithi120.stdout:8/327: chown d5/d6/l3d 4 1 2024-04-26T21:25:47.812 INFO:tasks.workunit.client.1.smithi120.stdout:2/381: chown d4/d1b/d25/d2c/d3e/d5e/f61 119 1 2024-04-26T21:25:47.814 INFO:tasks.workunit.client.0.smithi084.stdout:5/68: write d0/f8 [613932,47203] 0 2024-04-26T21:25:47.815 INFO:tasks.workunit.client.1.smithi120.stdout:6/330: creat d4/db/d10/dd/d28/f61 x:0 0 0 2024-04-26T21:25:47.817 INFO:tasks.workunit.client.0.smithi084.stdout:7/90: dwrite d6/d9/ff [0,4194304] 0 2024-04-26T21:25:47.822 INFO:tasks.workunit.client.1.smithi120.stdout:6/331: creat d4/db/d10/d22/f62 x:0 0 0 2024-04-26T21:25:47.824 INFO:tasks.workunit.client.1.smithi120.stdout:8/328: mknod d5/d6/d11/d32/d3b/c68 0 2024-04-26T21:25:47.826 INFO:tasks.workunit.client.1.smithi120.stdout:8/329: write d5/f19 [1178126,109760] 0 2024-04-26T21:25:47.826 INFO:tasks.workunit.client.1.smithi120.stdout:2/382: mknod d4/d1b/d2e/d50/d14/d15/d6c/c7f 0 2024-04-26T21:25:47.832 INFO:tasks.workunit.client.1.smithi120.stdout:5/327: dwrite d2/dc/d1d/d21/d66/f41 [0,4194304] 0 2024-04-26T21:25:47.832 INFO:tasks.workunit.client.1.smithi120.stdout:6/332: link d4/f1f d4/db/d10/dd/d43/f63 0 2024-04-26T21:25:47.835 INFO:tasks.workunit.client.1.smithi120.stdout:2/383: chown d4/d1b/d2e/d50/d14/l2f 1118713089 1 2024-04-26T21:25:47.837 INFO:tasks.workunit.client.0.smithi084.stdout:4/69: getdents d5/d10 0 2024-04-26T21:25:47.838 INFO:tasks.workunit.client.0.smithi084.stdout:5/69: dwrite d0/f6 [4194304,4194304] 0 2024-04-26T21:25:47.843 INFO:tasks.workunit.client.1.smithi120.stdout:8/330: creat d5/d6/d34/d37/f69 x:0 0 0 2024-04-26T21:25:47.843 INFO:tasks.workunit.client.1.smithi120.stdout:1/297: dread d6/fc [0,4194304] 0 2024-04-26T21:25:47.844 INFO:tasks.workunit.client.1.smithi120.stdout:5/328: creat d2/d30/d3b/f68 x:0 0 0 2024-04-26T21:25:47.844 INFO:tasks.workunit.client.1.smithi120.stdout:6/333: truncate d4/d27/f2e 999220 0 2024-04-26T21:25:47.845 INFO:tasks.workunit.client.0.smithi084.stdout:7/91: dwrite d6/d9/d12/d19/f1b [0,4194304] 0 2024-04-26T21:25:47.846 INFO:tasks.workunit.client.0.smithi084.stdout:7/92: chown d6/d9 192 1 2024-04-26T21:25:47.850 INFO:tasks.workunit.client.0.smithi084.stdout:4/70: creat d5/d10/f1b x:0 0 0 2024-04-26T21:25:47.850 INFO:tasks.workunit.client.0.smithi084.stdout:5/70: rmdir d0/dc 39 2024-04-26T21:25:47.851 INFO:tasks.workunit.client.1.smithi120.stdout:2/384: mknod d4/d1b/d2e/d50/d14/d15/c80 0 2024-04-26T21:25:47.851 INFO:tasks.workunit.client.0.smithi084.stdout:5/71: readlink d0/l10 0 2024-04-26T21:25:47.854 INFO:tasks.workunit.client.0.smithi084.stdout:8/46: sync 2024-04-26T21:25:47.855 INFO:tasks.workunit.client.0.smithi084.stdout:7/93: mkdir d6/d9/d12/d19/d20 0 2024-04-26T21:25:47.857 INFO:tasks.workunit.client.1.smithi120.stdout:1/298: symlink d6/d7/da/dd/d56/l65 0 2024-04-26T21:25:47.858 INFO:tasks.workunit.client.0.smithi084.stdout:7/94: read d6/d1c/f1d [3971735,22746] 0 2024-04-26T21:25:47.862 INFO:tasks.workunit.client.0.smithi084.stdout:8/47: write d4/d6/f8 [5590334,54426] 0 2024-04-26T21:25:47.864 INFO:tasks.workunit.client.0.smithi084.stdout:4/71: symlink d5/l1c 0 2024-04-26T21:25:47.865 INFO:tasks.workunit.client.1.smithi120.stdout:2/385: rename d4/d1b/d56/d65/f6f to d4/d1b/d25/d2c/d3e/f81 0 2024-04-26T21:25:47.866 INFO:tasks.workunit.client.0.smithi084.stdout:9/48: truncate f1 2891528 0 2024-04-26T21:25:47.866 INFO:tasks.workunit.client.0.smithi084.stdout:4/72: stat d5/d10/f12 0 2024-04-26T21:25:47.867 INFO:tasks.workunit.client.0.smithi084.stdout:4/73: read - d5/f1a zero size 2024-04-26T21:25:47.867 INFO:tasks.workunit.client.0.smithi084.stdout:5/72: fsync d0/fe 0 2024-04-26T21:25:47.871 INFO:tasks.workunit.client.1.smithi120.stdout:6/334: getdents d4/db/d25 0 2024-04-26T21:25:47.873 INFO:tasks.workunit.client.1.smithi120.stdout:1/299: link d6/d7/da/dd/d35/f5e d6/d7/d2d/d48/f66 0 2024-04-26T21:25:47.876 INFO:tasks.workunit.client.0.smithi084.stdout:7/95: rename d6/d9/d12/d19/l1a to d6/d9/d12/d19/d20/l21 0 2024-04-26T21:25:47.877 INFO:tasks.workunit.client.0.smithi084.stdout:7/96: chown d6/d9/ff 351069046 1 2024-04-26T21:25:47.877 INFO:tasks.workunit.client.1.smithi120.stdout:6/335: stat d4/db/d10/dd/d28/c5b 0 2024-04-26T21:25:47.878 INFO:tasks.workunit.client.1.smithi120.stdout:3/272: dwrite dd/de/f2e [0,4194304] 0 2024-04-26T21:25:47.878 INFO:tasks.workunit.client.0.smithi084.stdout:9/49: dread da/f10 [0,4194304] 0 2024-04-26T21:25:47.878 INFO:tasks.workunit.client.0.smithi084.stdout:7/97: fsync d6/f17 0 2024-04-26T21:25:47.878 INFO:tasks.workunit.client.1.smithi120.stdout:5/329: dwrite d2/d1b/d22/f42 [0,4194304] 0 2024-04-26T21:25:47.887 INFO:tasks.workunit.client.1.smithi120.stdout:6/336: write d4/db/d10/dd/d43/f48 [762016,121181] 0 2024-04-26T21:25:47.888 INFO:tasks.workunit.client.1.smithi120.stdout:2/386: dread d4/d1b/d25/d2c/f46 [0,4194304] 0 2024-04-26T21:25:47.888 INFO:tasks.workunit.client.0.smithi084.stdout:5/73: creat d0/f11 x:0 0 0 2024-04-26T21:25:47.889 INFO:tasks.workunit.client.0.smithi084.stdout:8/48: getdents d4/d7/d9 0 2024-04-26T21:25:47.889 INFO:tasks.workunit.client.0.smithi084.stdout:9/50: stat f1 0 2024-04-26T21:25:47.889 INFO:tasks.workunit.client.1.smithi120.stdout:2/387: stat d4/d1b/d25/d2c/lc 0 2024-04-26T21:25:47.890 INFO:tasks.workunit.client.0.smithi084.stdout:8/49: fdatasync f1 0 2024-04-26T21:25:47.890 INFO:tasks.workunit.client.1.smithi120.stdout:1/300: rename d6/d7/da to d6/d7/d1d/d5d/d67 0 2024-04-26T21:25:47.891 INFO:tasks.workunit.client.1.smithi120.stdout:5/330: symlink d2/dc/d1d/d1f/d36/l69 0 2024-04-26T21:25:47.894 INFO:tasks.workunit.client.0.smithi084.stdout:7/98: dread d6/d9/f11 [0,4194304] 0 2024-04-26T21:25:47.894 INFO:tasks.workunit.client.1.smithi120.stdout:5/331: write d2/fa [1614088,108159] 0 2024-04-26T21:25:47.895 INFO:tasks.workunit.client.0.smithi084.stdout:9/51: fsync da/fb 0 2024-04-26T21:25:47.899 INFO:tasks.workunit.client.1.smithi120.stdout:6/337: unlink d4/db/d10/dd/d28/c45 0 2024-04-26T21:25:47.900 INFO:tasks.workunit.client.1.smithi120.stdout:2/388: write d4/d1b/d2e/d50/f21 [5197978,9817] 0 2024-04-26T21:25:47.901 INFO:tasks.workunit.client.0.smithi084.stdout:7/99: mknod d6/d1c/c22 0 2024-04-26T21:25:47.903 INFO:tasks.workunit.client.1.smithi120.stdout:6/338: rename d4/db/d10 to d4/db/d10/d1a/d2b/d57/d64 22 2024-04-26T21:25:47.904 INFO:tasks.workunit.client.0.smithi084.stdout:5/74: dread d0/f2 [0,4194304] 0 2024-04-26T21:25:47.904 INFO:tasks.workunit.client.1.smithi120.stdout:3/273: getdents dd 0 2024-04-26T21:25:47.905 INFO:tasks.workunit.client.0.smithi084.stdout:5/75: chown d0/l5 864 1 2024-04-26T21:25:47.905 INFO:tasks.workunit.client.0.smithi084.stdout:5/76: readlink d0/l10 0 2024-04-26T21:25:47.909 INFO:tasks.workunit.client.1.smithi120.stdout:1/301: getdents d6/d7/d1d/d5d/d67 0 2024-04-26T21:25:47.909 INFO:tasks.workunit.client.0.smithi084.stdout:8/50: dwrite d4/d6/f8 [4194304,4194304] 0 2024-04-26T21:25:47.912 INFO:tasks.workunit.client.1.smithi120.stdout:2/389: creat d4/d1b/d25/d2c/d3e/d5e/d63/f82 x:0 0 0 2024-04-26T21:25:47.913 INFO:tasks.workunit.client.1.smithi120.stdout:6/339: rename d4/d3d/l40 to d4/l65 0 2024-04-26T21:25:47.914 INFO:tasks.workunit.client.0.smithi084.stdout:8/51: creat d4/d7/d9/fd x:0 0 0 2024-04-26T21:25:47.915 INFO:tasks.workunit.client.1.smithi120.stdout:5/332: dwrite d2/dc/f38 [0,4194304] 0 2024-04-26T21:25:47.916 INFO:tasks.workunit.client.0.smithi084.stdout:8/52: chown d4/d7/d9/fd 721 1 2024-04-26T21:25:47.917 INFO:tasks.workunit.client.1.smithi120.stdout:6/340: creat d4/d27/f66 x:0 0 0 2024-04-26T21:25:47.917 INFO:tasks.workunit.client.0.smithi084.stdout:9/52: rename f1 to da/de/f11 0 2024-04-26T21:25:47.918 INFO:tasks.workunit.client.1.smithi120.stdout:2/390: write d4/d1b/d2e/d50/d14/d15/f2b [1897345,20381] 0 2024-04-26T21:25:47.918 INFO:tasks.workunit.client.0.smithi084.stdout:8/53: rename d4 to d4/d7/d9/de 22 2024-04-26T21:25:47.918 INFO:tasks.workunit.client.0.smithi084.stdout:5/77: mknod d0/dc/df/c12 0 2024-04-26T21:25:47.919 INFO:tasks.workunit.client.1.smithi120.stdout:5/333: rmdir d2/d1b 39 2024-04-26T21:25:47.923 INFO:tasks.workunit.client.0.smithi084.stdout:9/53: creat da/de/f12 x:0 0 0 2024-04-26T21:25:47.927 INFO:tasks.workunit.client.1.smithi120.stdout:1/302: getdents d6/d7/d1d/d5d/d67/dd 0 2024-04-26T21:25:47.930 INFO:tasks.workunit.client.1.smithi120.stdout:9/283: sync 2024-04-26T21:25:47.930 INFO:tasks.workunit.client.1.smithi120.stdout:5/334: mkdir d2/dc/d1d/d21/d66/d6a 0 2024-04-26T21:25:47.932 INFO:tasks.workunit.client.1.smithi120.stdout:1/303: rmdir d6/d7 39 2024-04-26T21:25:47.934 INFO:tasks.workunit.client.1.smithi120.stdout:9/284: symlink d0/d6/d4d/l5a 0 2024-04-26T21:25:47.937 INFO:tasks.workunit.client.1.smithi120.stdout:5/335: mkdir d2/d1b/d22/d6b 0 2024-04-26T21:25:47.938 INFO:tasks.workunit.client.1.smithi120.stdout:9/285: mknod d0/dd/d45/c5b 0 2024-04-26T21:25:47.941 INFO:tasks.workunit.client.1.smithi120.stdout:9/286: dread d0/dd/d45/f4a [0,4194304] 0 2024-04-26T21:25:47.943 INFO:tasks.workunit.client.0.smithi084.stdout:5/78: dwrite d0/fd [0,4194304] 0 2024-04-26T21:25:47.945 INFO:tasks.workunit.client.1.smithi120.stdout:9/287: mkdir d0/dd/d3a/d5c 0 2024-04-26T21:25:47.953 INFO:tasks.workunit.client.1.smithi120.stdout:6/341: rename d4/d27 to d4/db/d10/d1a/d2b/d57/d67 0 2024-04-26T21:25:47.954 INFO:tasks.workunit.client.0.smithi084.stdout:9/54: dwrite da/fc [0,4194304] 0 2024-04-26T21:25:47.956 INFO:tasks.workunit.client.0.smithi084.stdout:8/54: dwrite d4/d7/d9/fd [0,4194304] 0 2024-04-26T21:25:47.959 INFO:tasks.workunit.client.1.smithi120.stdout:5/336: rename d2/d1b/d29 to d2/dc/d1d/d1f/d36/d44/d6c 0 2024-04-26T21:25:47.959 INFO:tasks.workunit.client.1.smithi120.stdout:2/391: dread d4/d1b/f38 [0,4194304] 0 2024-04-26T21:25:47.960 INFO:tasks.workunit.client.1.smithi120.stdout:6/342: mknod d4/db/d10/d1a/d2b/c68 0 2024-04-26T21:25:47.962 INFO:tasks.workunit.client.1.smithi120.stdout:3/274: dread dd/de/df/d12/f21 [0,4194304] 0 2024-04-26T21:25:47.964 INFO:tasks.workunit.client.0.smithi084.stdout:8/55: stat d4/d7/d9/la 0 2024-04-26T21:25:47.964 INFO:tasks.workunit.client.0.smithi084.stdout:9/55: write f3 [22338,87627] 0 2024-04-26T21:25:47.964 INFO:tasks.workunit.client.0.smithi084.stdout:8/56: fsync d4/d6/f8 0 2024-04-26T21:25:47.967 INFO:tasks.workunit.client.0.smithi084.stdout:9/56: stat da/de/f11 0 2024-04-26T21:25:47.968 INFO:tasks.workunit.client.0.smithi084.stdout:9/57: stat da/de 0 2024-04-26T21:25:47.979 INFO:tasks.workunit.client.1.smithi120.stdout:3/275: dwrite dd/d40/f4f [0,4194304] 0 2024-04-26T21:25:47.994 INFO:tasks.workunit.client.0.smithi084.stdout:8/57: fsync d4/d7/d9/fd 0 2024-04-26T21:25:47.999 INFO:tasks.workunit.client.0.smithi084.stdout:2/127: sync 2024-04-26T21:25:48.013 INFO:tasks.workunit.client.1.smithi120.stdout:5/337: rename d2/d1b/d22/f42 to d2/dc/f6d 0 2024-04-26T21:25:48.016 INFO:tasks.workunit.client.1.smithi120.stdout:5/338: dread d2/d1b/d22/d47/f5b [0,4194304] 0 2024-04-26T21:25:48.018 INFO:tasks.workunit.client.1.smithi120.stdout:3/276: readlink dd/de/d18/d37/l49 0 2024-04-26T21:25:48.021 INFO:tasks.workunit.client.1.smithi120.stdout:3/277: creat dd/d2a/d4a/f59 x:0 0 0 2024-04-26T21:25:48.024 INFO:tasks.workunit.client.1.smithi120.stdout:6/343: rename d4/db/d10/c50 to d4/c69 0 2024-04-26T21:25:48.025 INFO:tasks.workunit.client.1.smithi120.stdout:3/278: creat dd/de/d18/d24/f5a x:0 0 0 2024-04-26T21:25:48.027 INFO:tasks.workunit.client.1.smithi120.stdout:6/344: dread d4/db/f5a [0,4194304] 0 2024-04-26T21:25:48.029 INFO:tasks.workunit.client.1.smithi120.stdout:2/392: rename d4/d1b/l79 to d4/d1b/d2e/d50/d14/d15/d6c/l83 0 2024-04-26T21:25:48.029 INFO:tasks.workunit.client.1.smithi120.stdout:5/339: dwrite d2/d30/d3b/f68 [0,4194304] 0 2024-04-26T21:25:48.031 INFO:tasks.workunit.client.1.smithi120.stdout:3/279: symlink dd/l5b 0 2024-04-26T21:25:48.032 INFO:tasks.workunit.client.1.smithi120.stdout:2/393: truncate d4/d1b/f38 8953928 0 2024-04-26T21:25:48.032 INFO:tasks.workunit.client.1.smithi120.stdout:5/340: read d2/f3f [37556,67635] 0 2024-04-26T21:25:48.035 INFO:tasks.workunit.client.1.smithi120.stdout:5/341: truncate d2/f5a 919708 0 2024-04-26T21:25:48.035 INFO:tasks.workunit.client.1.smithi120.stdout:6/345: rename d4/c2f to d4/db/d10/dd/c6a 0 2024-04-26T21:25:48.036 INFO:tasks.workunit.client.1.smithi120.stdout:2/394: rmdir d4/d1b/d5c 39 2024-04-26T21:25:48.051 INFO:tasks.workunit.client.1.smithi120.stdout:6/346: dwrite d4/db/d10/dd/d28/f61 [0,4194304] 0 2024-04-26T21:25:48.052 INFO:tasks.workunit.client.1.smithi120.stdout:5/342: dwrite d2/dc/d1d/d21/d66/d4d/f4e [0,4194304] 0 2024-04-26T21:25:48.053 INFO:tasks.workunit.client.1.smithi120.stdout:3/280: creat dd/de/d18/d37/f5c x:0 0 0 2024-04-26T21:25:48.055 INFO:tasks.workunit.client.1.smithi120.stdout:3/281: write dd/de/d18/f3e [755581,63657] 0 2024-04-26T21:25:48.060 INFO:tasks.workunit.client.1.smithi120.stdout:5/343: symlink d2/dc/d1d/d1f/d34/l6e 0 2024-04-26T21:25:48.061 INFO:tasks.workunit.client.1.smithi120.stdout:6/347: creat d4/db/f6b x:0 0 0 2024-04-26T21:25:48.062 INFO:tasks.workunit.client.1.smithi120.stdout:3/282: write dd/de/f2e [569461,70756] 0 2024-04-26T21:25:48.066 INFO:tasks.workunit.client.1.smithi120.stdout:6/348: mkdir d4/db/d10/d22/d6c 0 2024-04-26T21:25:48.066 INFO:tasks.workunit.client.1.smithi120.stdout:5/344: creat d2/d48/f6f x:0 0 0 2024-04-26T21:25:48.066 INFO:tasks.workunit.client.0.smithi084.stdout:8/58: mknod d4/d7/cf 0 2024-04-26T21:25:48.068 INFO:tasks.workunit.client.1.smithi120.stdout:6/349: chown d4/db/d10/d22/d56 5432 1 2024-04-26T21:25:48.069 INFO:tasks.workunit.client.1.smithi120.stdout:3/283: mknod dd/de/df/d1e/d3b/d56/c5d 0 2024-04-26T21:25:48.071 INFO:tasks.workunit.client.1.smithi120.stdout:3/284: chown dd/de/d18/d37 265753 1 2024-04-26T21:25:48.071 INFO:tasks.workunit.client.0.smithi084.stdout:2/128: fsync d6/d7/fb 0 2024-04-26T21:25:48.071 INFO:tasks.workunit.client.1.smithi120.stdout:6/350: write d4/db/d10/d1a/d2b/f4c [1267998,100506] 0 2024-04-26T21:25:48.073 INFO:tasks.workunit.client.1.smithi120.stdout:3/285: dread - dd/de/d18/d37/f4e zero size 2024-04-26T21:25:48.073 INFO:tasks.workunit.client.0.smithi084.stdout:8/59: link d4/d7/cf d4/d7/c10 0 2024-04-26T21:25:48.074 INFO:tasks.workunit.client.1.smithi120.stdout:5/345: creat d2/f70 x:0 0 0 2024-04-26T21:25:48.074 INFO:tasks.workunit.client.0.smithi084.stdout:2/129: write d6/d19/d15/f1c [591671,62723] 0 2024-04-26T21:25:48.076 INFO:tasks.workunit.client.1.smithi120.stdout:6/351: mkdir d4/db/d25/d6d 0 2024-04-26T21:25:48.078 INFO:tasks.workunit.client.0.smithi084.stdout:9/58: write da/de/f11 [3371681,89364] 0 2024-04-26T21:25:48.079 INFO:tasks.workunit.client.1.smithi120.stdout:3/286: creat dd/f5e x:0 0 0 2024-04-26T21:25:48.080 INFO:tasks.workunit.client.1.smithi120.stdout:5/346: truncate d2/d1b/d22/d47/f5b 1210242 0 2024-04-26T21:25:48.080 INFO:tasks.workunit.client.1.smithi120.stdout:6/352: chown d4/db/d10/d1a/d2b/d57/d67/f66 59 1 2024-04-26T21:25:48.080 INFO:tasks.workunit.client.0.smithi084.stdout:2/130: rename c3 to d6/d19/d15/d1f/d22/c28 0 2024-04-26T21:25:48.081 INFO:tasks.workunit.client.0.smithi084.stdout:9/59: unlink da/lf 0 2024-04-26T21:25:48.082 INFO:tasks.workunit.client.1.smithi120.stdout:6/353: write d4/db/d10/f44 [198761,16337] 0 2024-04-26T21:25:48.084 INFO:tasks.workunit.client.0.smithi084.stdout:9/60: chown da/fc 160 1 2024-04-26T21:25:48.086 INFO:tasks.workunit.client.1.smithi120.stdout:6/354: creat d4/d3d/f6e x:0 0 0 2024-04-26T21:25:48.086 INFO:tasks.workunit.client.1.smithi120.stdout:3/287: getdents dd/de/d18/d36/d46 0 2024-04-26T21:25:48.087 INFO:tasks.workunit.client.0.smithi084.stdout:2/131: rename d6/c9 to d6/d7/d8/c29 0 2024-04-26T21:25:48.088 INFO:tasks.workunit.client.0.smithi084.stdout:8/60: dread d4/d7/d9/fd [0,4194304] 0 2024-04-26T21:25:48.089 INFO:tasks.workunit.client.0.smithi084.stdout:8/61: fsync f1 0 2024-04-26T21:25:48.090 INFO:tasks.workunit.client.0.smithi084.stdout:8/62: dread - d4/f5 zero size 2024-04-26T21:25:48.091 INFO:tasks.workunit.client.0.smithi084.stdout:8/63: chown d4/d6/db 61530 1 2024-04-26T21:25:48.094 INFO:tasks.workunit.client.0.smithi084.stdout:8/64: symlink d4/d6/db/l11 0 2024-04-26T21:25:48.095 INFO:tasks.workunit.client.0.smithi084.stdout:2/132: truncate d6/d7/fb 1512467 0 2024-04-26T21:25:48.096 INFO:tasks.workunit.client.0.smithi084.stdout:8/65: chown d4/d7/d9/fd 5 1 2024-04-26T21:25:48.097 INFO:tasks.workunit.client.0.smithi084.stdout:8/66: write d4/f5 [772249,71401] 0 2024-04-26T21:25:48.098 INFO:tasks.workunit.client.1.smithi120.stdout:5/347: dwrite d2/dc/d1d/d1f/d36/d44/d6c/f2a [0,4194304] 0 2024-04-26T21:25:48.101 INFO:tasks.workunit.client.0.smithi084.stdout:8/67: creat d4/f12 x:0 0 0 2024-04-26T21:25:48.102 INFO:tasks.workunit.client.1.smithi120.stdout:3/288: truncate dd/de/d18/d24/f23 621210 0 2024-04-26T21:25:48.105 INFO:tasks.workunit.client.1.smithi120.stdout:5/348: write d2/d30/d3b/f68 [1819789,66836] 0 2024-04-26T21:25:48.105 INFO:tasks.workunit.client.0.smithi084.stdout:2/133: rmdir d6 39 2024-04-26T21:25:48.111 INFO:tasks.workunit.client.0.smithi084.stdout:2/134: dread - d6/d19/f1e zero size 2024-04-26T21:25:48.113 INFO:tasks.workunit.client.1.smithi120.stdout:3/289: link dd/de/f2f dd/d2a/f5f 0 2024-04-26T21:25:48.117 INFO:tasks.workunit.client.0.smithi084.stdout:8/68: dread d4/d7/d9/fd [0,4194304] 0 2024-04-26T21:25:48.117 INFO:tasks.workunit.client.0.smithi084.stdout:8/69: creat d4/f13 x:0 0 0 2024-04-26T21:25:48.121 INFO:tasks.workunit.client.0.smithi084.stdout:8/70: creat d4/d7/f14 x:0 0 0 2024-04-26T21:25:48.122 INFO:tasks.workunit.client.1.smithi120.stdout:5/349: dwrite d2/d30/f2f [0,4194304] 0 2024-04-26T21:25:48.122 INFO:tasks.workunit.client.0.smithi084.stdout:2/135: dread d6/d7/d8/fe [0,4194304] 0 2024-04-26T21:25:48.123 INFO:tasks.workunit.client.0.smithi084.stdout:8/71: unlink f1 0 2024-04-26T21:25:48.124 INFO:tasks.workunit.client.1.smithi120.stdout:5/350: chown d2/d1b/l23 4 1 2024-04-26T21:25:48.127 INFO:tasks.workunit.client.0.smithi084.stdout:8/72: mkdir d4/d7/d15 0 2024-04-26T21:25:48.129 INFO:tasks.workunit.client.0.smithi084.stdout:2/136: dread d6/d19/d15/f1c [0,4194304] 0 2024-04-26T21:25:48.131 INFO:tasks.workunit.client.0.smithi084.stdout:2/137: rmdir d6/d19/d15 39 2024-04-26T21:25:48.131 INFO:tasks.workunit.client.1.smithi120.stdout:5/351: write d2/d1b/f26 [635632,103835] 0 2024-04-26T21:25:48.132 INFO:tasks.workunit.client.1.smithi120.stdout:3/290: dwrite f5 [0,4194304] 0 2024-04-26T21:25:48.137 INFO:tasks.workunit.client.1.smithi120.stdout:5/352: creat d2/d30/d3b/f71 x:0 0 0 2024-04-26T21:25:48.137 INFO:tasks.workunit.client.0.smithi084.stdout:2/138: mkdir d6/d19/d15/d1f/d22/d2a 0 2024-04-26T21:25:48.146 INFO:tasks.workunit.client.0.smithi084.stdout:8/73: dwrite d4/d7/d9/fd [0,4194304] 0 2024-04-26T21:25:48.150 INFO:tasks.workunit.client.1.smithi120.stdout:5/353: dwrite d2/dc/d1d/d21/d66/f14 [0,4194304] 0 2024-04-26T21:25:48.163 INFO:tasks.workunit.client.0.smithi084.stdout:2/139: dwrite d6/d19/d15/f1a [0,4194304] 0 2024-04-26T21:25:48.175 INFO:tasks.workunit.client.0.smithi084.stdout:8/74: dwrite d4/d6/f8 [0,4194304] 0 2024-04-26T21:25:48.176 INFO:tasks.workunit.client.0.smithi084.stdout:8/75: dread - d4/f12 zero size 2024-04-26T21:25:48.177 INFO:tasks.workunit.client.0.smithi084.stdout:2/140: link f0 d6/d7/f2b 0 2024-04-26T21:25:48.178 INFO:tasks.workunit.client.1.smithi120.stdout:5/354: truncate d2/dc/d1d/d21/d66/f14 604337 0 2024-04-26T21:25:48.182 INFO:tasks.workunit.client.0.smithi084.stdout:8/76: truncate d4/d7/f14 432753 0 2024-04-26T21:25:48.182 INFO:tasks.workunit.client.0.smithi084.stdout:2/141: creat d6/d1b/f2c x:0 0 0 2024-04-26T21:25:48.185 INFO:tasks.workunit.client.1.smithi120.stdout:5/355: creat d2/d1b/d22/d6b/f72 x:0 0 0 2024-04-26T21:25:48.186 INFO:tasks.workunit.client.0.smithi084.stdout:2/142: unlink d6/d7/f2b 0 2024-04-26T21:25:48.188 INFO:tasks.workunit.client.0.smithi084.stdout:2/143: write d6/d1b/f2c [665073,70907] 0 2024-04-26T21:25:48.197 INFO:tasks.workunit.client.1.smithi120.stdout:5/356: truncate d2/f3d 1266276 0 2024-04-26T21:25:48.200 INFO:tasks.workunit.client.0.smithi084.stdout:8/77: fsync f0 0 2024-04-26T21:25:48.202 INFO:tasks.workunit.client.0.smithi084.stdout:8/78: chown d4/d7/f14 3 1 2024-04-26T21:25:48.203 INFO:tasks.workunit.client.0.smithi084.stdout:8/79: write d4/f13 [689548,107835] 0 2024-04-26T21:25:48.204 INFO:tasks.workunit.client.1.smithi120.stdout:5/357: link d2/dc/d1d/d2e/c43 d2/dc/d1d/d21/d66/d4d/d5f/c73 0 2024-04-26T21:25:48.205 INFO:tasks.workunit.client.1.smithi120.stdout:5/358: read - d2/d48/f6f zero size 2024-04-26T21:25:48.206 INFO:tasks.workunit.client.0.smithi084.stdout:3/95: sync 2024-04-26T21:25:48.206 INFO:tasks.workunit.client.0.smithi084.stdout:8/80: chown f0 9503 1 2024-04-26T21:25:48.208 INFO:tasks.workunit.client.1.smithi120.stdout:5/359: write d2/dc/d1d/d21/d66/f14 [1227082,95987] 0 2024-04-26T21:25:48.208 INFO:tasks.workunit.client.0.smithi084.stdout:8/81: fdatasync d4/f13 0 2024-04-26T21:25:48.210 INFO:tasks.workunit.client.1.smithi120.stdout:5/360: chown d2/d1b/d22/d6b 527371 1 2024-04-26T21:25:48.211 INFO:tasks.workunit.client.1.smithi120.stdout:5/361: readlink d2/dc/d1d/d2e/l49 0 2024-04-26T21:25:48.213 INFO:tasks.workunit.client.1.smithi120.stdout:5/362: dread - d2/d1b/d22/d6b/f72 zero size 2024-04-26T21:25:48.217 INFO:tasks.workunit.client.1.smithi120.stdout:5/363: symlink d2/d48/l74 0 2024-04-26T21:25:48.219 INFO:tasks.workunit.client.0.smithi084.stdout:8/82: dread d4/d7/d9/fd [0,4194304] 0 2024-04-26T21:25:48.220 INFO:tasks.workunit.client.1.smithi120.stdout:5/364: read d2/d1b/d22/f2b [3061577,81368] 0 2024-04-26T21:25:48.222 INFO:tasks.workunit.client.1.smithi120.stdout:5/365: symlink d2/d30/l75 0 2024-04-26T21:25:48.224 INFO:tasks.workunit.client.1.smithi120.stdout:5/366: chown d2/dc/l1c 95684781 1 2024-04-26T21:25:48.228 INFO:tasks.workunit.client.1.smithi120.stdout:5/367: creat d2/dc/d1d/d1f/d36/f76 x:0 0 0 2024-04-26T21:25:48.228 INFO:tasks.workunit.client.0.smithi084.stdout:8/83: dread d4/d6/f8 [4194304,4194304] 0 2024-04-26T21:25:48.229 INFO:tasks.workunit.client.0.smithi084.stdout:8/84: read f0 [1180543,104243] 0 2024-04-26T21:25:48.244 INFO:tasks.workunit.client.1.smithi120.stdout:0/368: sync 2024-04-26T21:25:48.245 INFO:tasks.workunit.client.0.smithi084.stdout:2/144: link d6/d7/l17 d6/d19/l2d 0 2024-04-26T21:25:48.247 INFO:tasks.workunit.client.0.smithi084.stdout:3/96: mkdir d1/d24 0 2024-04-26T21:25:48.248 INFO:tasks.workunit.client.1.smithi120.stdout:0/369: chown d0/d3/dc/dd/f34 71 1 2024-04-26T21:25:48.250 INFO:tasks.workunit.client.1.smithi120.stdout:0/370: fdatasync d0/f10 0 2024-04-26T21:25:48.251 INFO:tasks.workunit.client.1.smithi120.stdout:5/368: dwrite d2/dc/d1d/d1f/d36/d44/d6c/f50 [0,4194304] 0 2024-04-26T21:25:48.253 INFO:tasks.workunit.client.0.smithi084.stdout:3/97: creat d1/d24/f25 x:0 0 0 2024-04-26T21:25:48.253 INFO:tasks.workunit.client.0.smithi084.stdout:8/85: dwrite d4/f12 [0,4194304] 0 2024-04-26T21:25:48.253 INFO:tasks.workunit.client.1.smithi120.stdout:0/371: dread - d0/d3/dc/dd/d1b/f48 zero size 2024-04-26T21:25:48.254 INFO:tasks.workunit.client.0.smithi084.stdout:2/145: unlink d6/d7/d8/c1d 0 2024-04-26T21:25:48.256 INFO:tasks.workunit.client.0.smithi084.stdout:8/86: write d4/d6/f8 [4260478,49248] 0 2024-04-26T21:25:48.257 INFO:tasks.workunit.client.1.smithi120.stdout:5/369: mkdir d2/dc/d1d/d21/d77 0 2024-04-26T21:25:48.262 INFO:tasks.workunit.client.0.smithi084.stdout:8/87: write d4/d7/d9/fd [1312218,76873] 0 2024-04-26T21:25:48.267 INFO:tasks.workunit.client.0.smithi084.stdout:2/146: dread d6/d7/fb [0,4194304] 0 2024-04-26T21:25:48.271 INFO:tasks.workunit.client.0.smithi084.stdout:2/147: readlink d6/d19/l2d 0 2024-04-26T21:25:48.273 INFO:tasks.workunit.client.0.smithi084.stdout:9/61: sync 2024-04-26T21:25:48.274 INFO:tasks.workunit.client.0.smithi084.stdout:1/62: sync 2024-04-26T21:25:48.274 INFO:tasks.workunit.client.0.smithi084.stdout:6/71: sync 2024-04-26T21:25:48.274 INFO:tasks.workunit.client.0.smithi084.stdout:0/96: sync 2024-04-26T21:25:48.275 INFO:tasks.workunit.client.0.smithi084.stdout:5/79: sync 2024-04-26T21:25:48.275 INFO:tasks.workunit.client.0.smithi084.stdout:4/74: sync 2024-04-26T21:25:48.275 INFO:tasks.workunit.client.0.smithi084.stdout:7/100: sync 2024-04-26T21:25:48.282 INFO:tasks.workunit.client.0.smithi084.stdout:2/148: mknod d6/d7/c2e 0 2024-04-26T21:25:48.285 INFO:tasks.workunit.client.0.smithi084.stdout:7/101: chown d6/d9/cd 24 1 2024-04-26T21:25:48.290 INFO:tasks.workunit.client.0.smithi084.stdout:6/72: mkdir d3/d18 0 2024-04-26T21:25:48.290 INFO:tasks.workunit.client.0.smithi084.stdout:4/75: symlink d5/d7/l1d 0 2024-04-26T21:25:48.291 INFO:tasks.workunit.client.0.smithi084.stdout:3/98: dwrite d1/d10/f1f [0,4194304] 0 2024-04-26T21:25:48.292 INFO:tasks.workunit.client.0.smithi084.stdout:4/76: read d5/fe [2576583,108206] 0 2024-04-26T21:25:48.292 INFO:tasks.workunit.client.1.smithi120.stdout:0/372: dread d0/d3/d51/f58 [0,4194304] 0 2024-04-26T21:25:48.296 INFO:tasks.workunit.client.0.smithi084.stdout:9/62: creat da/de/f13 x:0 0 0 2024-04-26T21:25:48.299 INFO:tasks.workunit.client.0.smithi084.stdout:3/99: creat d1/f26 x:0 0 0 2024-04-26T21:25:48.300 INFO:tasks.workunit.client.1.smithi120.stdout:0/373: mkdir d0/d3/dc/d12/d4a/d7f 0 2024-04-26T21:25:48.302 INFO:tasks.workunit.client.0.smithi084.stdout:8/88: dwrite d4/d7/d9/fd [0,4194304] 0 2024-04-26T21:25:48.304 INFO:tasks.workunit.client.0.smithi084.stdout:9/63: write f3 [694967,109941] 0 2024-04-26T21:25:48.306 INFO:tasks.workunit.client.0.smithi084.stdout:2/149: mknod d6/d19/d15/d1f/d22/d2a/c2f 0 2024-04-26T21:25:48.309 INFO:tasks.workunit.client.0.smithi084.stdout:6/73: symlink d3/de/d15/d16/l19 0 2024-04-26T21:25:48.310 INFO:tasks.workunit.client.1.smithi120.stdout:0/374: rename d0/d3/dc/d12/d4a/d7f to d0/d3/dc/dd/d80 0 2024-04-26T21:25:48.314 INFO:tasks.workunit.client.0.smithi084.stdout:8/89: unlink l2 0 2024-04-26T21:25:48.317 INFO:tasks.workunit.client.1.smithi120.stdout:0/375: truncate d0/d3/dc/dd/d1b/d39/f3e 107628 0 2024-04-26T21:25:48.318 INFO:tasks.workunit.client.0.smithi084.stdout:9/64: creat da/f14 x:0 0 0 2024-04-26T21:25:48.322 INFO:tasks.workunit.client.1.smithi120.stdout:0/376: mkdir d0/d3/d13/d81 0 2024-04-26T21:25:48.327 INFO:tasks.workunit.client.1.smithi120.stdout:0/377: mknod d0/d3/dc/d12/c82 0 2024-04-26T21:25:48.329 INFO:tasks.workunit.client.0.smithi084.stdout:2/150: creat d6/d19/f30 x:0 0 0 2024-04-26T21:25:48.329 INFO:tasks.workunit.client.1.smithi120.stdout:0/378: stat d0/d3/dc/dd/d1b/d39/l4c 0 2024-04-26T21:25:48.331 INFO:tasks.workunit.client.1.smithi120.stdout:0/379: truncate d0/f66 4580005 0 2024-04-26T21:25:48.335 INFO:tasks.workunit.client.0.smithi084.stdout:3/100: getdents d1/d24 0 2024-04-26T21:25:48.335 INFO:tasks.workunit.client.0.smithi084.stdout:0/97: dwrite de/f1e [0,4194304] 0 2024-04-26T21:25:48.336 INFO:tasks.workunit.client.0.smithi084.stdout:5/80: dwrite d0/f11 [0,4194304] 0 2024-04-26T21:25:48.337 INFO:tasks.workunit.client.0.smithi084.stdout:1/63: dwrite d2/d9/f11 [0,4194304] 0 2024-04-26T21:25:48.338 INFO:tasks.workunit.client.0.smithi084.stdout:3/101: read - d1/f26 zero size 2024-04-26T21:25:48.340 INFO:tasks.workunit.client.0.smithi084.stdout:6/74: rename d3/de/d15/d16 to d3/de/d1a 0 2024-04-26T21:25:48.342 INFO:tasks.workunit.client.0.smithi084.stdout:9/65: creat da/de/f15 x:0 0 0 2024-04-26T21:25:48.342 INFO:tasks.workunit.client.0.smithi084.stdout:1/64: dread - d2/ff zero size 2024-04-26T21:25:48.347 INFO:tasks.workunit.client.0.smithi084.stdout:2/151: fsync d6/d19/f30 0 2024-04-26T21:25:48.347 INFO:tasks.workunit.client.0.smithi084.stdout:3/102: read - d1/d10/f11 zero size 2024-04-26T21:25:48.347 INFO:tasks.workunit.client.1.smithi120.stdout:0/380: dwrite d0/d3/dc/dd/f7b [0,4194304] 0 2024-04-26T21:25:48.352 INFO:tasks.workunit.client.0.smithi084.stdout:7/102: dread d6/d9/fa [0,4194304] 0 2024-04-26T21:25:48.354 INFO:tasks.workunit.client.0.smithi084.stdout:0/98: rename f8 to de/f1f 0 2024-04-26T21:25:48.359 INFO:tasks.workunit.client.1.smithi120.stdout:0/381: mknod d0/d3/d13/c83 0 2024-04-26T21:25:48.359 INFO:tasks.workunit.client.0.smithi084.stdout:2/152: mknod d6/d19/d15/d1f/c31 0 2024-04-26T21:25:48.363 INFO:tasks.workunit.client.0.smithi084.stdout:1/65: mkdir d2/d9/d15 0 2024-04-26T21:25:48.364 INFO:tasks.workunit.client.1.smithi120.stdout:0/382: mknod d0/d3/dc/d12/d4a/c84 0 2024-04-26T21:25:48.374 INFO:tasks.workunit.client.0.smithi084.stdout:2/153: creat d6/d19/d15/d1f/f32 x:0 0 0 2024-04-26T21:25:48.378 INFO:tasks.workunit.client.0.smithi084.stdout:7/103: write d6/d9/ff [3432182,26892] 0 2024-04-26T21:25:48.386 INFO:tasks.workunit.client.1.smithi120.stdout:0/383: dread d0/d3/dc/d12/f47 [0,4194304] 0 2024-04-26T21:25:48.388 INFO:tasks.workunit.client.1.smithi120.stdout:0/384: chown d0/d3/dc/d12/l25 251 1 2024-04-26T21:25:48.389 INFO:tasks.workunit.client.1.smithi120.stdout:0/385: dread - d0/d3/dc/d12/d4a/f74 zero size 2024-04-26T21:25:48.393 INFO:tasks.workunit.client.0.smithi084.stdout:2/154: creat d6/f33 x:0 0 0 2024-04-26T21:25:48.394 INFO:tasks.workunit.client.1.smithi120.stdout:0/386: creat d0/d3/d13/d81/f85 x:0 0 0 2024-04-26T21:25:48.394 INFO:tasks.workunit.client.0.smithi084.stdout:5/81: dwrite d0/fe [0,4194304] 0 2024-04-26T21:25:48.398 INFO:tasks.workunit.client.1.smithi120.stdout:0/387: symlink d0/d3/dc/l86 0 2024-04-26T21:25:48.409 INFO:tasks.workunit.client.0.smithi084.stdout:2/155: creat d6/d19/d15/d1f/f34 x:0 0 0 2024-04-26T21:25:48.409 INFO:tasks.workunit.client.0.smithi084.stdout:0/99: dread fd [0,4194304] 0 2024-04-26T21:25:48.412 INFO:tasks.workunit.client.1.smithi120.stdout:0/388: dread d0/d3/dc/dd/f21 [0,4194304] 0 2024-04-26T21:25:48.412 INFO:tasks.workunit.client.1.smithi120.stdout:4/284: sync 2024-04-26T21:25:48.412 INFO:tasks.workunit.client.1.smithi120.stdout:7/315: sync 2024-04-26T21:25:48.415 INFO:tasks.workunit.client.1.smithi120.stdout:7/316: write d7/d10/d12/f16 [2928776,8301] 0 2024-04-26T21:25:48.416 INFO:tasks.workunit.client.1.smithi120.stdout:4/285: read d10/d12/f18 [2748853,88482] 0 2024-04-26T21:25:48.417 INFO:tasks.workunit.client.0.smithi084.stdout:5/82: symlink d0/dc/df/l13 0 2024-04-26T21:25:48.420 INFO:tasks.workunit.client.1.smithi120.stdout:7/317: chown d7/d10/d12/d2f/f63 6 1 2024-04-26T21:25:48.421 INFO:tasks.workunit.client.0.smithi084.stdout:3/103: dwrite d1/f3 [0,4194304] 0 2024-04-26T21:25:48.427 INFO:tasks.workunit.client.0.smithi084.stdout:0/100: unlink de/l1a 0 2024-04-26T21:25:48.427 INFO:tasks.workunit.client.1.smithi120.stdout:4/286: read d10/d12/f14 [2791252,71299] 0 2024-04-26T21:25:48.429 INFO:tasks.workunit.client.0.smithi084.stdout:6/75: dwrite d3/de/d15/df/f12 [0,4194304] 0 2024-04-26T21:25:48.429 INFO:tasks.workunit.client.0.smithi084.stdout:9/66: dwrite da/de/f12 [0,4194304] 0 2024-04-26T21:25:48.430 INFO:tasks.workunit.client.1.smithi120.stdout:7/318: rename d7/f29 to d7/d10/d12/d1f/d28/d4c/d6c/f71 0 2024-04-26T21:25:48.436 INFO:tasks.workunit.client.0.smithi084.stdout:2/156: write f0 [301184,28281] 0 2024-04-26T21:25:48.437 INFO:tasks.workunit.client.0.smithi084.stdout:9/67: write da/fc [4760078,128943] 0 2024-04-26T21:25:48.439 INFO:tasks.workunit.client.0.smithi084.stdout:3/104: mkdir d1/d24/d27 0 2024-04-26T21:25:48.439 INFO:tasks.workunit.client.0.smithi084.stdout:1/66: dwrite d2/d9/f11 [0,4194304] 0 2024-04-26T21:25:48.444 INFO:tasks.workunit.client.1.smithi120.stdout:4/287: rename d10/d28/f32 to d10/f5e 0 2024-04-26T21:25:48.445 INFO:tasks.workunit.client.0.smithi084.stdout:8/90: sync 2024-04-26T21:25:48.446 INFO:tasks.workunit.client.0.smithi084.stdout:4/77: sync 2024-04-26T21:25:48.449 INFO:tasks.workunit.client.0.smithi084.stdout:7/104: dread d6/d9/fa [0,4194304] 0 2024-04-26T21:25:48.449 INFO:tasks.workunit.client.0.smithi084.stdout:7/105: chown d6/d9/d12/d19 199052579 1 2024-04-26T21:25:48.450 INFO:tasks.workunit.client.0.smithi084.stdout:8/91: write f0 [3261234,82105] 0 2024-04-26T21:25:48.451 INFO:tasks.workunit.client.1.smithi120.stdout:4/288: link d10/d28/f49 d10/d28/f5f 0 2024-04-26T21:25:48.451 INFO:tasks.workunit.client.0.smithi084.stdout:4/78: truncate d5/d10/f18 729045 0 2024-04-26T21:25:48.451 INFO:tasks.workunit.client.0.smithi084.stdout:9/68: mkdir da/de/d16 0 2024-04-26T21:25:48.452 INFO:tasks.workunit.client.0.smithi084.stdout:1/67: creat d2/d9/f16 x:0 0 0 2024-04-26T21:25:48.453 INFO:tasks.workunit.client.1.smithi120.stdout:0/389: dread d0/f14 [0,4194304] 0 2024-04-26T21:25:48.453 INFO:tasks.workunit.client.0.smithi084.stdout:3/105: creat d1/d10/f28 x:0 0 0 2024-04-26T21:25:48.454 INFO:tasks.workunit.client.0.smithi084.stdout:6/76: write d3/f5 [1412435,108255] 0 2024-04-26T21:25:48.459 INFO:tasks.workunit.client.1.smithi120.stdout:4/289: rename d10/d12/f18 to d10/d12/f60 0 2024-04-26T21:25:48.459 INFO:tasks.workunit.client.0.smithi084.stdout:6/77: read d3/f6 [2300063,1587] 0 2024-04-26T21:25:48.461 INFO:tasks.workunit.client.1.smithi120.stdout:4/290: rmdir d10 39 2024-04-26T21:25:48.463 INFO:tasks.workunit.client.0.smithi084.stdout:1/68: rmdir d2 39 2024-04-26T21:25:48.463 INFO:tasks.workunit.client.1.smithi120.stdout:0/390: symlink d0/d3/dc/l87 0 2024-04-26T21:25:48.464 INFO:tasks.workunit.client.0.smithi084.stdout:5/83: truncate d0/fe 849972 0 2024-04-26T21:25:48.464 INFO:tasks.workunit.client.0.smithi084.stdout:7/106: symlink d6/l23 0 2024-04-26T21:25:48.466 INFO:tasks.workunit.client.1.smithi120.stdout:4/291: dread - d10/d28/f3e zero size 2024-04-26T21:25:48.467 INFO:tasks.workunit.client.1.smithi120.stdout:0/391: creat d0/d3/d51/f88 x:0 0 0 2024-04-26T21:25:48.469 INFO:tasks.workunit.client.0.smithi084.stdout:5/84: read d0/fa [1303439,109247] 0 2024-04-26T21:25:48.469 INFO:tasks.workunit.client.1.smithi120.stdout:4/292: symlink d10/d28/l61 0 2024-04-26T21:25:48.471 INFO:tasks.workunit.client.1.smithi120.stdout:4/293: chown d10/d28/f3d 2586 1 2024-04-26T21:25:48.474 INFO:tasks.workunit.client.1.smithi120.stdout:0/392: rename d0/d3/d13/c83 to d0/d3/d51/d70/d71/c89 0 2024-04-26T21:25:48.474 INFO:tasks.workunit.client.0.smithi084.stdout:8/92: dread d4/f5 [0,4194304] 0 2024-04-26T21:25:48.475 INFO:tasks.workunit.client.0.smithi084.stdout:3/106: write d1/f1a [179426,86841] 0 2024-04-26T21:25:48.475 INFO:tasks.workunit.client.0.smithi084.stdout:6/78: creat d3/de/d15/df/f1b x:0 0 0 2024-04-26T21:25:48.475 INFO:tasks.workunit.client.0.smithi084.stdout:9/69: dread da/fc [4194304,4194304] 0 2024-04-26T21:25:48.476 INFO:tasks.workunit.client.1.smithi120.stdout:0/393: chown d0/d3/dc/dd/d1b/f38 6245 1 2024-04-26T21:25:48.476 INFO:tasks.workunit.client.0.smithi084.stdout:7/107: write d6/d9/ff [3724432,119469] 0 2024-04-26T21:25:48.477 INFO:tasks.workunit.client.1.smithi120.stdout:4/294: write d10/d28/f3d [1103527,105088] 0 2024-04-26T21:25:48.477 INFO:tasks.workunit.client.0.smithi084.stdout:9/70: chown da 355 1 2024-04-26T21:25:48.482 INFO:tasks.workunit.client.0.smithi084.stdout:1/69: mkdir d2/d9/d17 0 2024-04-26T21:25:48.483 INFO:tasks.workunit.client.1.smithi120.stdout:0/394: rmdir d0/d3/d13/d81 39 2024-04-26T21:25:48.486 INFO:tasks.workunit.client.0.smithi084.stdout:3/107: dread - d1/d10/f20 zero size 2024-04-26T21:25:48.487 INFO:tasks.workunit.client.1.smithi120.stdout:4/295: creat d10/d12/f62 x:0 0 0 2024-04-26T21:25:48.488 INFO:tasks.workunit.client.0.smithi084.stdout:8/93: write d4/f12 [958713,59160] 0 2024-04-26T21:25:48.491 INFO:tasks.workunit.client.1.smithi120.stdout:4/296: symlink d10/d28/l63 0 2024-04-26T21:25:48.492 INFO:tasks.workunit.client.1.smithi120.stdout:0/395: truncate d0/d3/d13/f20 3969241 0 2024-04-26T21:25:48.493 INFO:tasks.workunit.client.1.smithi120.stdout:0/396: dread - d0/d3/dc/d12/f3b zero size 2024-04-26T21:25:48.494 INFO:tasks.workunit.client.1.smithi120.stdout:4/297: mknod d10/d12/c64 0 2024-04-26T21:25:48.496 INFO:tasks.workunit.client.0.smithi084.stdout:2/157: dwrite d6/d19/d15/d1f/f32 [0,4194304] 0 2024-04-26T21:25:48.496 INFO:tasks.workunit.client.0.smithi084.stdout:3/108: rename d1/d24 to d1/d24/d29 22 2024-04-26T21:25:48.496 INFO:tasks.workunit.client.0.smithi084.stdout:1/70: chown d2/cd 3905 1 2024-04-26T21:25:48.497 INFO:tasks.workunit.client.1.smithi120.stdout:0/397: stat d0/d3/dc/dd/d1b/d24/d73 0 2024-04-26T21:25:48.497 INFO:tasks.workunit.client.0.smithi084.stdout:6/79: dread - d3/de/d15/df/f1b zero size 2024-04-26T21:25:48.499 INFO:tasks.workunit.client.0.smithi084.stdout:5/85: truncate d0/fa 722711 0 2024-04-26T21:25:48.501 INFO:tasks.workunit.client.0.smithi084.stdout:9/71: truncate da/f10 3116984 0 2024-04-26T21:25:48.503 INFO:tasks.workunit.client.0.smithi084.stdout:6/80: chown d3/de/d15/df 1410 1 2024-04-26T21:25:48.503 INFO:tasks.workunit.client.0.smithi084.stdout:8/94: creat d4/d7/f16 x:0 0 0 2024-04-26T21:25:48.505 INFO:tasks.workunit.client.1.smithi120.stdout:0/398: creat d0/d3/dc/dd/d1b/f8a x:0 0 0 2024-04-26T21:25:48.505 INFO:tasks.workunit.client.0.smithi084.stdout:0/101: dwrite de/f1f [0,4194304] 0 2024-04-26T21:25:48.505 INFO:tasks.workunit.client.0.smithi084.stdout:3/109: symlink d1/l2a 0 2024-04-26T21:25:48.507 INFO:tasks.workunit.client.1.smithi120.stdout:0/399: readlink d0/d3/dc/d12/l25 0 2024-04-26T21:25:48.507 INFO:tasks.workunit.client.0.smithi084.stdout:7/108: link d6/l23 d6/dc/l24 0 2024-04-26T21:25:48.507 INFO:tasks.workunit.client.0.smithi084.stdout:8/95: chown d4/lc 512394966 1 2024-04-26T21:25:48.507 INFO:tasks.workunit.client.0.smithi084.stdout:3/110: stat d1/f7 0 2024-04-26T21:25:48.512 INFO:tasks.workunit.client.0.smithi084.stdout:9/72: link f3 da/f17 0 2024-04-26T21:25:48.512 INFO:tasks.workunit.client.0.smithi084.stdout:4/79: dwrite d5/d7/f16 [0,4194304] 0 2024-04-26T21:25:48.517 INFO:tasks.workunit.client.0.smithi084.stdout:7/109: chown d6/l18 23556 1 2024-04-26T21:25:48.518 INFO:tasks.workunit.client.0.smithi084.stdout:8/96: mknod d4/d7/d9/c17 0 2024-04-26T21:25:48.519 INFO:tasks.workunit.client.0.smithi084.stdout:0/102: mkdir de/d20 0 2024-04-26T21:25:48.520 INFO:tasks.workunit.client.0.smithi084.stdout:6/81: creat d3/de/d15/f1c x:0 0 0 2024-04-26T21:25:48.526 INFO:tasks.workunit.client.0.smithi084.stdout:7/110: mknod d6/d9/c25 0 2024-04-26T21:25:48.526 INFO:tasks.workunit.client.0.smithi084.stdout:9/73: write da/f17 [1546726,66226] 0 2024-04-26T21:25:48.526 INFO:tasks.workunit.client.0.smithi084.stdout:6/82: fdatasync d3/f14 0 2024-04-26T21:25:48.526 INFO:tasks.workunit.client.0.smithi084.stdout:3/111: rename d1/d10/f21 to d1/d24/d27/f2b 0 2024-04-26T21:25:48.530 INFO:tasks.workunit.client.0.smithi084.stdout:5/86: chown d0/fa 3 1 2024-04-26T21:25:48.536 INFO:tasks.workunit.client.0.smithi084.stdout:2/158: dwrite d6/d19/d15/d1f/d22/f24 [0,4194304] 0 2024-04-26T21:25:48.536 INFO:tasks.workunit.client.0.smithi084.stdout:4/80: mknod d5/d7/d17/c1e 0 2024-04-26T21:25:48.537 INFO:tasks.workunit.client.1.smithi120.stdout:0/400: dwrite d0/df/f3a [0,4194304] 0 2024-04-26T21:25:48.538 INFO:tasks.workunit.client.0.smithi084.stdout:6/83: fsync d3/f6 0 2024-04-26T21:25:48.538 INFO:tasks.workunit.client.0.smithi084.stdout:0/103: rmdir de 39 2024-04-26T21:25:48.539 INFO:tasks.workunit.client.1.smithi120.stdout:0/401: dread - d0/d3/d51/f88 zero size 2024-04-26T21:25:48.539 INFO:tasks.workunit.client.0.smithi084.stdout:9/74: symlink da/de/l18 0 2024-04-26T21:25:48.542 INFO:tasks.workunit.client.0.smithi084.stdout:6/84: fdatasync d3/f7 0 2024-04-26T21:25:48.542 INFO:tasks.workunit.client.0.smithi084.stdout:5/87: creat d0/dc/f14 x:0 0 0 2024-04-26T21:25:48.542 INFO:tasks.workunit.client.1.smithi120.stdout:0/402: symlink d0/df/l8b 0 2024-04-26T21:25:48.542 INFO:tasks.workunit.client.0.smithi084.stdout:3/112: dread d1/fd [0,4194304] 0 2024-04-26T21:25:48.545 INFO:tasks.workunit.client.0.smithi084.stdout:8/97: creat d4/d7/d15/f18 x:0 0 0 2024-04-26T21:25:48.547 INFO:tasks.workunit.client.0.smithi084.stdout:7/111: mkdir d6/d26 0 2024-04-26T21:25:48.548 INFO:tasks.workunit.client.1.smithi120.stdout:0/403: creat d0/d3/dc/dd/d80/f8c x:0 0 0 2024-04-26T21:25:48.551 INFO:tasks.workunit.client.1.smithi120.stdout:1/304: sync 2024-04-26T21:25:48.551 INFO:tasks.workunit.client.1.smithi120.stdout:8/331: sync 2024-04-26T21:25:48.560 INFO:tasks.workunit.client.1.smithi120.stdout:4/298: dread d10/d28/f4b [0,4194304] 0 2024-04-26T21:25:48.561 INFO:tasks.workunit.client.0.smithi084.stdout:5/88: dread d0/fe [0,4194304] 0 2024-04-26T21:25:48.562 INFO:tasks.workunit.client.0.smithi084.stdout:9/75: rmdir da/de 39 2024-04-26T21:25:48.562 INFO:tasks.workunit.client.0.smithi084.stdout:4/81: mkdir d5/d1f 0 2024-04-26T21:25:48.565 INFO:tasks.workunit.client.0.smithi084.stdout:8/98: creat d4/d7/d9/f19 x:0 0 0 2024-04-26T21:25:48.568 INFO:tasks.workunit.client.0.smithi084.stdout:2/159: creat d6/d7/d8/d20/f35 x:0 0 0 2024-04-26T21:25:48.568 INFO:tasks.workunit.client.0.smithi084.stdout:9/76: chown da/fc 516602720 1 2024-04-26T21:25:48.568 INFO:tasks.workunit.client.0.smithi084.stdout:6/85: creat d3/d18/f1d x:0 0 0 2024-04-26T21:25:48.577 INFO:tasks.workunit.client.0.smithi084.stdout:8/99: creat d4/d6/f1a x:0 0 0 2024-04-26T21:25:48.580 INFO:tasks.workunit.client.0.smithi084.stdout:3/113: dwrite d1/d10/f16 [0,4194304] 0 2024-04-26T21:25:48.582 INFO:tasks.workunit.client.1.smithi120.stdout:6/355: sync 2024-04-26T21:25:48.582 INFO:tasks.workunit.client.1.smithi120.stdout:5/370: sync 2024-04-26T21:25:48.582 INFO:tasks.workunit.client.1.smithi120.stdout:9/288: sync 2024-04-26T21:25:48.583 INFO:tasks.workunit.client.1.smithi120.stdout:3/291: sync 2024-04-26T21:25:48.583 INFO:tasks.workunit.client.1.smithi120.stdout:2/395: sync 2024-04-26T21:25:48.583 INFO:tasks.workunit.client.1.smithi120.stdout:7/319: sync 2024-04-26T21:25:48.584 INFO:tasks.workunit.client.0.smithi084.stdout:3/114: readlink d1/l2a 0 2024-04-26T21:25:48.586 INFO:tasks.workunit.client.0.smithi084.stdout:2/160: mkdir d6/d7/d8/d20/d36 0 2024-04-26T21:25:48.587 INFO:tasks.workunit.client.1.smithi120.stdout:2/396: chown d4/d1b/d2e/d50/d14/d15/f2b 2917983 1 2024-04-26T21:25:48.588 INFO:tasks.workunit.client.1.smithi120.stdout:7/320: write d7/d10/d12/d1f/d28/d4c/d6b/f5f [186061,103075] 0 2024-04-26T21:25:48.589 INFO:tasks.workunit.client.0.smithi084.stdout:7/112: dwrite d6/d9/ff [0,4194304] 0 2024-04-26T21:25:48.592 INFO:tasks.workunit.client.1.smithi120.stdout:7/321: write d7/d10/d12/d1a/d33/d34/f38 [1632616,76989] 0 2024-04-26T21:25:48.596 INFO:tasks.workunit.client.0.smithi084.stdout:4/82: rename d5/l14 to d5/d7/d17/l20 0 2024-04-26T21:25:48.596 INFO:tasks.workunit.client.0.smithi084.stdout:8/100: unlink d4/d7/d9/f19 0 2024-04-26T21:25:48.599 INFO:tasks.workunit.client.1.smithi120.stdout:7/322: chown d7/l55 2893 1 2024-04-26T21:25:48.607 INFO:tasks.workunit.client.0.smithi084.stdout:9/77: creat da/f19 x:0 0 0 2024-04-26T21:25:48.607 INFO:tasks.workunit.client.0.smithi084.stdout:8/101: fdatasync d4/d7/f16 0 2024-04-26T21:25:48.607 INFO:tasks.workunit.client.0.smithi084.stdout:2/161: symlink d6/d19/d15/d1f/l37 0 2024-04-26T21:25:48.608 INFO:tasks.workunit.client.0.smithi084.stdout:1/71: sync 2024-04-26T21:25:48.612 INFO:tasks.workunit.client.0.smithi084.stdout:7/113: creat d6/dc/f27 x:0 0 0 2024-04-26T21:25:48.616 INFO:tasks.workunit.client.0.smithi084.stdout:4/83: write d5/fe [2671518,35618] 0 2024-04-26T21:25:48.617 INFO:tasks.workunit.client.1.smithi120.stdout:9/289: chown d0/fa 0 1 2024-04-26T21:25:48.618 INFO:tasks.workunit.client.1.smithi120.stdout:7/323: dwrite d7/d10/f6a [0,4194304] 0 2024-04-26T21:25:48.619 INFO:tasks.workunit.client.1.smithi120.stdout:5/371: creat d2/d30/f78 x:0 0 0 2024-04-26T21:25:48.622 INFO:tasks.workunit.client.1.smithi120.stdout:9/290: write d0/d6/f36 [1027709,6461] 0 2024-04-26T21:25:48.623 INFO:tasks.workunit.client.0.smithi084.stdout:1/72: read d2/d9/f11 [2224663,129909] 0 2024-04-26T21:25:48.624 INFO:tasks.workunit.client.0.smithi084.stdout:2/162: symlink d6/l38 0 2024-04-26T21:25:48.625 INFO:tasks.workunit.client.1.smithi120.stdout:0/404: dwrite d0/d3/f4f [4194304,4194304] 0 2024-04-26T21:25:48.628 INFO:tasks.workunit.client.0.smithi084.stdout:5/89: dread d0/f11 [0,4194304] 0 2024-04-26T21:25:48.644 INFO:tasks.workunit.client.0.smithi084.stdout:7/114: chown d6/d1c/f1d 21481910 1 2024-04-26T21:25:48.644 INFO:tasks.workunit.client.1.smithi120.stdout:8/332: truncate d5/f15 136285 0 2024-04-26T21:25:48.645 INFO:tasks.workunit.client.0.smithi084.stdout:0/104: dwrite f9 [0,4194304] 0 2024-04-26T21:25:48.647 INFO:tasks.workunit.client.1.smithi120.stdout:4/299: mkdir d10/d65 0 2024-04-26T21:25:48.651 INFO:tasks.workunit.client.1.smithi120.stdout:8/333: truncate d5/d18/f4b 638997 0 2024-04-26T21:25:48.651 INFO:tasks.workunit.client.1.smithi120.stdout:4/300: read d10/f47 [730061,82907] 0 2024-04-26T21:25:48.652 INFO:tasks.workunit.client.0.smithi084.stdout:4/84: mkdir d5/d10/d15/d21 0 2024-04-26T21:25:48.652 INFO:tasks.workunit.client.0.smithi084.stdout:6/86: dwrite d3/de/f11 [4194304,4194304] 0 2024-04-26T21:25:48.654 INFO:tasks.workunit.client.0.smithi084.stdout:3/115: dwrite d1/fe [0,4194304] 0 2024-04-26T21:25:48.655 INFO:tasks.workunit.client.0.smithi084.stdout:2/163: truncate d6/d19/d15/f1c 1377770 0 2024-04-26T21:25:48.656 INFO:tasks.workunit.client.1.smithi120.stdout:3/292: symlink dd/de/df/l60 0 2024-04-26T21:25:48.661 INFO:tasks.workunit.client.0.smithi084.stdout:0/105: chown de/c16 245 1 2024-04-26T21:25:48.662 INFO:tasks.workunit.client.0.smithi084.stdout:1/73: creat d2/d9/d17/f18 x:0 0 0 2024-04-26T21:25:48.663 INFO:tasks.workunit.client.0.smithi084.stdout:7/115: symlink d6/d26/l28 0 2024-04-26T21:25:48.664 INFO:tasks.workunit.client.1.smithi120.stdout:3/293: truncate dd/de/d18/d24/f54 967737 0 2024-04-26T21:25:48.665 INFO:tasks.workunit.client.0.smithi084.stdout:6/87: rmdir d3/de 39 2024-04-26T21:25:48.666 INFO:tasks.workunit.client.0.smithi084.stdout:1/74: chown c0 302162360 1 2024-04-26T21:25:48.667 INFO:tasks.workunit.client.0.smithi084.stdout:5/90: link d0/c3 d0/dc/c15 0 2024-04-26T21:25:48.668 INFO:tasks.workunit.client.0.smithi084.stdout:3/116: write d1/d24/d27/f2b [186033,85372] 0 2024-04-26T21:25:48.669 INFO:tasks.workunit.client.1.smithi120.stdout:7/324: creat d7/d10/d12/d1a/d33/d34/d37/f72 x:0 0 0 2024-04-26T21:25:48.670 INFO:tasks.workunit.client.1.smithi120.stdout:1/305: write d6/d7/d1d/f20 [149661,22640] 0 2024-04-26T21:25:48.671 INFO:tasks.workunit.client.0.smithi084.stdout:3/117: readlink d1/l6 0 2024-04-26T21:25:48.671 INFO:tasks.workunit.client.0.smithi084.stdout:0/106: creat de/f21 x:0 0 0 2024-04-26T21:25:48.672 INFO:tasks.workunit.client.0.smithi084.stdout:8/102: dwrite d4/d7/d9/fd [0,4194304] 0 2024-04-26T21:25:48.674 INFO:tasks.workunit.client.1.smithi120.stdout:1/306: write d6/d14/f16 [4179807,95396] 0 2024-04-26T21:25:48.675 INFO:tasks.workunit.client.0.smithi084.stdout:9/78: dread da/de/f12 [0,4194304] 0 2024-04-26T21:25:48.675 INFO:tasks.workunit.client.1.smithi120.stdout:8/334: dwrite f4 [0,4194304] 0 2024-04-26T21:25:48.676 INFO:tasks.workunit.client.1.smithi120.stdout:0/405: dread d0/d3/d13/f1f [0,4194304] 0 2024-04-26T21:25:48.679 INFO:tasks.workunit.client.0.smithi084.stdout:8/103: fsync d4/d7/f14 0 2024-04-26T21:25:48.680 INFO:tasks.workunit.client.1.smithi120.stdout:4/301: rename d10/d28/c50 to d10/d65/c66 0 2024-04-26T21:25:48.681 INFO:tasks.workunit.client.0.smithi084.stdout:2/164: rename d6/d7/d8 to d6/d19/d15/d1f/d39 0 2024-04-26T21:25:48.682 INFO:tasks.workunit.client.1.smithi120.stdout:4/302: fsync fe 0 2024-04-26T21:25:48.683 INFO:tasks.workunit.client.1.smithi120.stdout:2/397: link f1 d4/d1b/d2e/d50/d14/d15/f84 0 2024-04-26T21:25:48.684 INFO:tasks.workunit.client.1.smithi120.stdout:5/372: mkdir d2/dc/d1d/d21/d77/d79 0 2024-04-26T21:25:48.685 INFO:tasks.workunit.client.1.smithi120.stdout:5/373: fsync d2/d1b/f26 0 2024-04-26T21:25:48.686 INFO:tasks.workunit.client.1.smithi120.stdout:7/325: mknod d7/d10/d12/d1f/d28/d4c/c73 0 2024-04-26T21:25:48.696 INFO:tasks.workunit.client.1.smithi120.stdout:9/291: unlink d0/l27 0 2024-04-26T21:25:48.697 INFO:tasks.workunit.client.1.smithi120.stdout:9/292: chown d0/dd/c4c 654 1 2024-04-26T21:25:48.697 INFO:tasks.workunit.client.0.smithi084.stdout:4/85: link l1 d5/d10/d15/d21/l22 0 2024-04-26T21:25:48.697 INFO:tasks.workunit.client.0.smithi084.stdout:6/88: symlink d3/de/d1a/l1e 0 2024-04-26T21:25:48.707 INFO:tasks.workunit.client.1.smithi120.stdout:5/374: dwrite d2/dc/d1d/f58 [0,4194304] 0 2024-04-26T21:25:48.707 INFO:tasks.workunit.client.0.smithi084.stdout:2/165: rename d6/f12 to d6/d19/d15/d1f/d39/d20/f3a 0 2024-04-26T21:25:48.713 INFO:tasks.workunit.client.0.smithi084.stdout:9/79: link da/de/f15 da/f1a 0 2024-04-26T21:25:48.714 INFO:tasks.workunit.client.0.smithi084.stdout:0/107: dwrite de/ff [0,4194304] 0 2024-04-26T21:25:48.714 INFO:tasks.workunit.client.0.smithi084.stdout:6/89: truncate d3/de/d15/df/f1b 838103 0 2024-04-26T21:25:48.719 INFO:tasks.workunit.client.0.smithi084.stdout:5/91: getdents d0/dc/df 0 2024-04-26T21:25:48.720 INFO:tasks.workunit.client.1.smithi120.stdout:0/406: rmdir d0/d3/dc/dd 39 2024-04-26T21:25:48.722 INFO:tasks.workunit.client.0.smithi084.stdout:2/166: symlink d6/d19/d15/l3b 0 2024-04-26T21:25:48.724 INFO:tasks.workunit.client.0.smithi084.stdout:3/118: getdents d1/d24 0 2024-04-26T21:25:48.728 INFO:tasks.workunit.client.1.smithi120.stdout:3/294: creat dd/f61 x:0 0 0 2024-04-26T21:25:48.728 INFO:tasks.workunit.client.0.smithi084.stdout:0/108: readlink de/l19 0 2024-04-26T21:25:48.729 INFO:tasks.workunit.client.1.smithi120.stdout:5/375: mknod d2/d1b/c7a 0 2024-04-26T21:25:48.729 INFO:tasks.workunit.client.0.smithi084.stdout:1/75: dread d2/d9/f11 [0,4194304] 0 2024-04-26T21:25:48.733 INFO:tasks.workunit.client.1.smithi120.stdout:8/335: creat d5/d6/d11/d52/f6a x:0 0 0 2024-04-26T21:25:48.734 INFO:tasks.workunit.client.1.smithi120.stdout:6/356: truncate d4/db/d10/d1a/d2b/f4c 93147 0 2024-04-26T21:25:48.735 INFO:tasks.workunit.client.0.smithi084.stdout:5/92: stat d0/dc/c15 0 2024-04-26T21:25:48.737 INFO:tasks.workunit.client.0.smithi084.stdout:6/90: rename d3/ca to d3/c1f 0 2024-04-26T21:25:48.738 INFO:tasks.workunit.client.1.smithi120.stdout:2/398: creat d4/d1b/f85 x:0 0 0 2024-04-26T21:25:48.739 INFO:tasks.workunit.client.1.smithi120.stdout:6/357: write d4/db/f6b [560961,25706] 0 2024-04-26T21:25:48.739 INFO:tasks.workunit.client.1.smithi120.stdout:5/376: write d2/f3f [541666,62532] 0 2024-04-26T21:25:48.739 INFO:tasks.workunit.client.0.smithi084.stdout:1/76: dread - d2/d9/f13 zero size 2024-04-26T21:25:48.741 INFO:tasks.workunit.client.0.smithi084.stdout:5/93: readlink d0/l10 0 2024-04-26T21:25:48.746 INFO:tasks.workunit.client.1.smithi120.stdout:0/407: creat d0/d3/dc/f8d x:0 0 0 2024-04-26T21:25:48.748 INFO:tasks.workunit.client.0.smithi084.stdout:4/86: dwrite d5/d10/f12 [0,4194304] 0 2024-04-26T21:25:48.749 INFO:tasks.workunit.client.0.smithi084.stdout:1/77: read - d2/ff zero size 2024-04-26T21:25:48.749 INFO:tasks.workunit.client.0.smithi084.stdout:5/94: rmdir d0/dc 39 2024-04-26T21:25:48.752 INFO:tasks.workunit.client.1.smithi120.stdout:2/399: creat d4/d1b/d25/f86 x:0 0 0 2024-04-26T21:25:48.753 INFO:tasks.workunit.client.1.smithi120.stdout:9/293: dwrite d0/d6/f39 [0,4194304] 0 2024-04-26T21:25:48.755 INFO:tasks.workunit.client.1.smithi120.stdout:3/295: link dd/d40/l58 dd/d2a/d4a/l62 0 2024-04-26T21:25:48.755 INFO:tasks.workunit.client.1.smithi120.stdout:5/377: creat d2/dc/d1d/d21/d66/d4d/f7b x:0 0 0 2024-04-26T21:25:48.757 INFO:tasks.workunit.client.0.smithi084.stdout:1/78: chown d2/d9/d15 47510074 1 2024-04-26T21:25:48.757 INFO:tasks.workunit.client.0.smithi084.stdout:6/91: rename f1 to d3/d18/f20 0 2024-04-26T21:25:48.758 INFO:tasks.workunit.client.1.smithi120.stdout:9/294: write d0/d6/d3d/f4e [540803,54842] 0 2024-04-26T21:25:48.761 INFO:tasks.workunit.client.0.smithi084.stdout:1/79: fsync d2/ff 0 2024-04-26T21:25:48.761 INFO:tasks.workunit.client.0.smithi084.stdout:5/95: unlink d0/f4 0 2024-04-26T21:25:48.761 INFO:tasks.workunit.client.1.smithi120.stdout:0/408: symlink d0/d3/dc/d12/d4a/l8e 0 2024-04-26T21:25:48.763 INFO:tasks.workunit.client.1.smithi120.stdout:7/326: dread d7/d10/d12/d1a/d33/d34/d37/f3b [0,4194304] 0 2024-04-26T21:25:48.766 INFO:tasks.workunit.client.1.smithi120.stdout:9/295: fsync d0/dd/d45/f51 0 2024-04-26T21:25:48.767 INFO:tasks.workunit.client.1.smithi120.stdout:7/327: fdatasync d7/f22 0 2024-04-26T21:25:48.767 INFO:tasks.workunit.client.0.smithi084.stdout:2/167: dread d6/d19/d15/d1f/d39/fc [0,4194304] 0 2024-04-26T21:25:48.767 INFO:tasks.workunit.client.1.smithi120.stdout:1/307: dwrite d6/d9/f1c [4194304,4194304] 0 2024-04-26T21:25:48.768 INFO:tasks.workunit.client.0.smithi084.stdout:7/116: dwrite d6/d1c/f1d [4194304,4194304] 0 2024-04-26T21:25:48.768 INFO:tasks.workunit.client.0.smithi084.stdout:6/92: chown d3/d18/f20 1262 1 2024-04-26T21:25:48.769 INFO:tasks.workunit.client.0.smithi084.stdout:9/80: dwrite da/f14 [0,4194304] 0 2024-04-26T21:25:48.769 INFO:tasks.workunit.client.1.smithi120.stdout:0/409: fdatasync d0/d3/d13/f60 0 2024-04-26T21:25:48.770 INFO:tasks.workunit.client.0.smithi084.stdout:1/80: read d2/d9/f11 [423039,17678] 0 2024-04-26T21:25:48.770 INFO:tasks.workunit.client.1.smithi120.stdout:5/378: creat d2/d48/d63/f7c x:0 0 0 2024-04-26T21:25:48.772 INFO:tasks.workunit.client.0.smithi084.stdout:6/93: truncate d3/f14 533631 0 2024-04-26T21:25:48.773 INFO:tasks.workunit.client.1.smithi120.stdout:2/400: dread d4/f66 [0,4194304] 0 2024-04-26T21:25:48.775 INFO:tasks.workunit.client.0.smithi084.stdout:4/87: creat d5/f23 x:0 0 0 2024-04-26T21:25:48.775 INFO:tasks.workunit.client.0.smithi084.stdout:7/117: chown d6/d1c/c22 11 1 2024-04-26T21:25:48.781 INFO:tasks.workunit.client.0.smithi084.stdout:1/81: fdatasync d2/d9/f13 0 2024-04-26T21:25:48.781 INFO:tasks.workunit.client.0.smithi084.stdout:6/94: chown d3/de/d1a/c17 503 1 2024-04-26T21:25:48.781 INFO:tasks.workunit.client.0.smithi084.stdout:2/168: unlink d6/d19/d15/l18 0 2024-04-26T21:25:48.782 INFO:tasks.workunit.client.0.smithi084.stdout:5/96: creat d0/f16 x:0 0 0 2024-04-26T21:25:48.785 INFO:tasks.workunit.client.0.smithi084.stdout:6/95: write d3/fc [381155,8930] 0 2024-04-26T21:25:48.786 INFO:tasks.workunit.client.0.smithi084.stdout:5/97: write d0/fd [1417713,68934] 0 2024-04-26T21:25:48.786 INFO:tasks.workunit.client.1.smithi120.stdout:9/296: creat d0/d14/d2d/f5d x:0 0 0 2024-04-26T21:25:48.787 INFO:tasks.workunit.client.0.smithi084.stdout:7/118: write d6/d9/fa [2606892,92193] 0 2024-04-26T21:25:48.787 INFO:tasks.workunit.client.1.smithi120.stdout:5/379: write d2/d48/f6f [429786,96601] 0 2024-04-26T21:25:48.790 INFO:tasks.workunit.client.0.smithi084.stdout:9/81: creat da/de/d16/f1b x:0 0 0 2024-04-26T21:25:48.791 INFO:tasks.workunit.client.1.smithi120.stdout:5/380: read - d2/d30/d3b/f71 zero size 2024-04-26T21:25:48.792 INFO:tasks.workunit.client.0.smithi084.stdout:9/82: write f3 [796863,19847] 0 2024-04-26T21:25:48.792 INFO:tasks.workunit.client.1.smithi120.stdout:1/308: symlink d6/d7/l68 0 2024-04-26T21:25:48.792 INFO:tasks.workunit.client.0.smithi084.stdout:2/169: symlink d6/l3c 0 2024-04-26T21:25:48.795 INFO:tasks.workunit.client.0.smithi084.stdout:2/170: dread - d6/d7/f27 zero size 2024-04-26T21:25:48.796 INFO:tasks.workunit.client.1.smithi120.stdout:0/410: mknod d0/d3/d13/d64/c8f 0 2024-04-26T21:25:48.797 INFO:tasks.workunit.client.0.smithi084.stdout:1/82: mkdir d2/d19 0 2024-04-26T21:25:48.797 INFO:tasks.workunit.client.0.smithi084.stdout:2/171: dread - d6/d7/f27 zero size 2024-04-26T21:25:48.797 INFO:tasks.workunit.client.1.smithi120.stdout:3/296: dwrite dd/d2a/d4a/f59 [0,4194304] 0 2024-04-26T21:25:48.800 INFO:tasks.workunit.client.1.smithi120.stdout:9/297: mkdir d0/d5e 0 2024-04-26T21:25:48.800 INFO:tasks.workunit.client.0.smithi084.stdout:6/96: creat d3/de/d15/df/f21 x:0 0 0 2024-04-26T21:25:48.801 INFO:tasks.workunit.client.0.smithi084.stdout:9/83: creat da/de/d16/f1c x:0 0 0 2024-04-26T21:25:48.803 INFO:tasks.workunit.client.1.smithi120.stdout:1/309: mkdir d6/d7/d2d/d48/d69 0 2024-04-26T21:25:48.804 INFO:tasks.workunit.client.0.smithi084.stdout:5/98: mkdir d0/d17 0 2024-04-26T21:25:48.804 INFO:tasks.workunit.client.0.smithi084.stdout:4/88: dread d5/d7/f16 [0,4194304] 0 2024-04-26T21:25:48.809 INFO:tasks.workunit.client.0.smithi084.stdout:6/97: creat d3/de/d1a/f22 x:0 0 0 2024-04-26T21:25:48.813 INFO:tasks.workunit.client.1.smithi120.stdout:7/328: dwrite d7/d10/d12/d2f/f67 [0,4194304] 0 2024-04-26T21:25:48.815 INFO:tasks.workunit.client.0.smithi084.stdout:4/89: chown d5/c19 990 1 2024-04-26T21:25:48.817 INFO:tasks.workunit.client.0.smithi084.stdout:7/119: dwrite d6/d9/f11 [4194304,4194304] 0 2024-04-26T21:25:48.819 INFO:tasks.workunit.client.0.smithi084.stdout:6/98: mkdir d3/de/d15/d23 0 2024-04-26T21:25:48.822 INFO:tasks.workunit.client.1.smithi120.stdout:6/358: truncate d4/db/d25/f4b 936257 0 2024-04-26T21:25:48.823 INFO:tasks.workunit.client.0.smithi084.stdout:7/120: mknod d6/d26/c29 0 2024-04-26T21:25:48.823 INFO:tasks.workunit.client.1.smithi120.stdout:9/298: fsync d0/dd/d3a/f46 0 2024-04-26T21:25:48.830 INFO:tasks.workunit.client.1.smithi120.stdout:6/359: chown d4/db/d10/d1a/d2b/d57/d67/l3e 119259 1 2024-04-26T21:25:48.830 INFO:tasks.workunit.client.1.smithi120.stdout:5/381: rmdir d2/d48/d63 39 2024-04-26T21:25:48.831 INFO:tasks.workunit.client.0.smithi084.stdout:2/172: rename d6/d19 to d6/d7/d3d 0 2024-04-26T21:25:48.833 INFO:tasks.workunit.client.1.smithi120.stdout:7/329: mkdir d7/d10/d12/d1f/d28/d4c/d6c/d74 0 2024-04-26T21:25:48.833 INFO:tasks.workunit.client.1.smithi120.stdout:5/382: stat d2/d30/l64 0 2024-04-26T21:25:48.833 INFO:tasks.workunit.client.0.smithi084.stdout:2/173: dread - d6/d7/d3d/d15/d1f/d39/d20/f35 zero size 2024-04-26T21:25:48.835 INFO:tasks.workunit.client.1.smithi120.stdout:2/401: write f1 [2163775,12620] 0 2024-04-26T21:25:48.835 INFO:tasks.workunit.client.0.smithi084.stdout:6/99: rename d3/f7 to d3/de/d15/f24 0 2024-04-26T21:25:48.838 INFO:tasks.workunit.client.1.smithi120.stdout:3/297: getdents dd/de/df 0 2024-04-26T21:25:48.838 INFO:tasks.workunit.client.1.smithi120.stdout:0/411: dwrite d0/d3/dc/dd/f54 [0,4194304] 0 2024-04-26T21:25:48.840 INFO:tasks.workunit.client.0.smithi084.stdout:2/174: mkdir d6/d3e 0 2024-04-26T21:25:48.841 INFO:tasks.workunit.client.1.smithi120.stdout:7/330: write d7/d10/d12/d1f/d28/f2c [5243143,32796] 0 2024-04-26T21:25:48.842 INFO:tasks.workunit.client.1.smithi120.stdout:2/402: chown d4/d1b/d25/f86 2757 1 2024-04-26T21:25:48.844 INFO:tasks.workunit.client.1.smithi120.stdout:6/360: creat d4/db/d10/dd/d4e/d5d/f6f x:0 0 0 2024-04-26T21:25:48.845 INFO:tasks.workunit.client.1.smithi120.stdout:7/331: write d7/ff [2902359,54369] 0 2024-04-26T21:25:48.848 INFO:tasks.workunit.client.1.smithi120.stdout:2/403: stat d4/d1b/d2e/d50/d14/d15/c80 0 2024-04-26T21:25:48.851 INFO:tasks.workunit.client.0.smithi084.stdout:2/175: unlink d6/d7/d3d/d15/d1f/d39/c11 0 2024-04-26T21:25:48.854 INFO:tasks.workunit.client.1.smithi120.stdout:3/298: chown dd/d2a/f5f 59895 1 2024-04-26T21:25:48.855 INFO:tasks.workunit.client.1.smithi120.stdout:2/404: write d4/d1b/d2e/f57 [919494,107741] 0 2024-04-26T21:25:48.859 INFO:tasks.workunit.client.0.smithi084.stdout:5/99: dwrite d0/fe [0,4194304] 0 2024-04-26T21:25:48.864 INFO:tasks.workunit.client.0.smithi084.stdout:1/83: dwrite d2/fb [0,4194304] 0 2024-04-26T21:25:48.867 INFO:tasks.workunit.client.0.smithi084.stdout:6/100: dwrite d3/f6 [0,4194304] 0 2024-04-26T21:25:48.867 INFO:tasks.workunit.client.1.smithi120.stdout:9/299: link d0/d14/l32 d0/dd/d3a/d5c/l5f 0 2024-04-26T21:25:48.871 INFO:tasks.workunit.client.1.smithi120.stdout:1/310: truncate d6/d7/d1d/f47 468154 0 2024-04-26T21:25:48.871 INFO:tasks.workunit.client.0.smithi084.stdout:1/84: mkdir d2/d9/d17/d1a 0 2024-04-26T21:25:48.872 INFO:tasks.workunit.client.1.smithi120.stdout:3/299: symlink dd/de/df/d1e/l63 0 2024-04-26T21:25:48.873 INFO:tasks.workunit.client.0.smithi084.stdout:6/101: dread - d3/de/d1a/f22 zero size 2024-04-26T21:25:48.873 INFO:tasks.workunit.client.0.smithi084.stdout:6/102: fsync d3/d18/f1d 0 2024-04-26T21:25:48.874 INFO:tasks.workunit.client.1.smithi120.stdout:5/383: dwrite d2/d1b/d22/d47/f53 [0,4194304] 0 2024-04-26T21:25:48.875 INFO:tasks.workunit.client.1.smithi120.stdout:7/332: dwrite d7/d10/d12/f14 [0,4194304] 0 2024-04-26T21:25:48.876 INFO:tasks.workunit.client.1.smithi120.stdout:2/405: rmdir d4/d1b/d2e/d50/d14/d15/d6c 39 2024-04-26T21:25:48.881 INFO:tasks.workunit.client.1.smithi120.stdout:9/300: creat d0/d6/f60 x:0 0 0 2024-04-26T21:25:48.881 INFO:tasks.workunit.client.0.smithi084.stdout:1/85: mkdir d2/d1b 0 2024-04-26T21:25:48.882 INFO:tasks.workunit.client.1.smithi120.stdout:0/412: dwrite d0/d3/dc/d12/d4a/f4d [0,4194304] 0 2024-04-26T21:25:48.886 INFO:tasks.workunit.client.1.smithi120.stdout:3/300: chown dd/d40/l58 3229 1 2024-04-26T21:25:48.887 INFO:tasks.workunit.client.0.smithi084.stdout:6/103: mknod d3/de/d15/d23/c25 0 2024-04-26T21:25:48.887 INFO:tasks.workunit.client.1.smithi120.stdout:7/333: mknod d7/c75 0 2024-04-26T21:25:48.893 INFO:tasks.workunit.client.1.smithi120.stdout:5/384: creat d2/dc/d1d/d21/f7d x:0 0 0 2024-04-26T21:25:48.894 INFO:tasks.workunit.client.1.smithi120.stdout:2/406: symlink d4/d1b/d2e/d50/d14/l87 0 2024-04-26T21:25:48.895 INFO:tasks.workunit.client.1.smithi120.stdout:0/413: rmdir d0/d3/dc 39 2024-04-26T21:25:48.896 INFO:tasks.workunit.client.1.smithi120.stdout:6/361: dwrite d4/db/d10/dd/d43/f46 [0,4194304] 0 2024-04-26T21:25:48.899 INFO:tasks.workunit.client.0.smithi084.stdout:6/104: dread - d3/de/d15/df/f21 zero size 2024-04-26T21:25:48.900 INFO:tasks.workunit.client.1.smithi120.stdout:9/301: mknod d0/d14/d2d/c61 0 2024-04-26T21:25:48.900 INFO:tasks.workunit.client.1.smithi120.stdout:7/334: rmdir d7/d10/d12/d1f 39 2024-04-26T21:25:48.904 INFO:tasks.workunit.client.1.smithi120.stdout:0/414: write d0/d3/d13/d81/f85 [808197,72572] 0 2024-04-26T21:25:48.904 INFO:tasks.workunit.client.1.smithi120.stdout:9/302: dread - d0/d6/f60 zero size 2024-04-26T21:25:48.905 INFO:tasks.workunit.client.0.smithi084.stdout:2/176: dwrite d6/d7/d3d/f26 [0,4194304] 0 2024-04-26T21:25:48.908 INFO:tasks.workunit.client.0.smithi084.stdout:5/100: dwrite d0/f6 [0,4194304] 0 2024-04-26T21:25:48.914 INFO:tasks.workunit.client.0.smithi084.stdout:2/177: write d6/d7/d3d/d15/d1f/f32 [870647,104963] 0 2024-04-26T21:25:48.915 INFO:tasks.workunit.client.1.smithi120.stdout:7/335: chown d7/d10/d12/d1f/d28/d4c/d6c 0 1 2024-04-26T21:25:48.916 INFO:tasks.workunit.client.1.smithi120.stdout:6/362: creat d4/db/d10/d22/d6c/f70 x:0 0 0 2024-04-26T21:25:48.917 INFO:tasks.workunit.client.0.smithi084.stdout:1/86: dread d2/fb [0,4194304] 0 2024-04-26T21:25:48.918 INFO:tasks.workunit.client.0.smithi084.stdout:2/178: chown d6/d7/c2e 194851 1 2024-04-26T21:25:48.919 INFO:tasks.workunit.client.1.smithi120.stdout:3/301: dwrite dd/de/df/d1e/d28/f3f [0,4194304] 0 2024-04-26T21:25:48.919 INFO:tasks.workunit.client.1.smithi120.stdout:9/303: write d0/dd/d3a/f58 [1381813,96650] 0 2024-04-26T21:25:48.924 INFO:tasks.workunit.client.1.smithi120.stdout:5/385: getdents d2/dc/d1d/d21/d66/d4d/d5f 0 2024-04-26T21:25:48.924 INFO:tasks.workunit.client.1.smithi120.stdout:6/363: dread - d4/db/d10/d22/d6c/f70 zero size 2024-04-26T21:25:48.926 INFO:tasks.workunit.client.0.smithi084.stdout:6/105: rename d3/de/f11 to d3/f26 0 2024-04-26T21:25:48.927 INFO:tasks.workunit.client.1.smithi120.stdout:6/364: readlink d4/db/d10/d1a/d2b/l49 0 2024-04-26T21:25:48.927 INFO:tasks.workunit.client.1.smithi120.stdout:0/415: link d0/f66 d0/f90 0 2024-04-26T21:25:48.928 INFO:tasks.workunit.client.0.smithi084.stdout:2/179: unlink d6/d7/d3d/d15/l3b 0 2024-04-26T21:25:48.929 INFO:tasks.workunit.client.0.smithi084.stdout:2/180: readlink d6/d7/d3d/d15/d1f/d39/l16 0 2024-04-26T21:25:48.930 INFO:tasks.workunit.client.0.smithi084.stdout:1/87: rmdir d2/d9/d17/d1a 0 2024-04-26T21:25:48.931 INFO:tasks.workunit.client.1.smithi120.stdout:9/304: creat d0/dd/f62 x:0 0 0 2024-04-26T21:25:48.932 INFO:tasks.workunit.client.1.smithi120.stdout:7/336: fsync d7/d10/d12/d1f/d28/f3d 0 2024-04-26T21:25:48.933 INFO:tasks.workunit.client.1.smithi120.stdout:5/386: fdatasync d2/dc/d1d/d21/d66/f27 0 2024-04-26T21:25:48.937 INFO:tasks.workunit.client.0.smithi084.stdout:1/88: symlink d2/d1b/l1c 0 2024-04-26T21:25:48.938 INFO:tasks.workunit.client.0.smithi084.stdout:1/89: dread - d2/ff zero size 2024-04-26T21:25:48.938 INFO:tasks.workunit.client.1.smithi120.stdout:9/305: chown d0/d6/l20 7697 1 2024-04-26T21:25:48.938 INFO:tasks.workunit.client.0.smithi084.stdout:2/181: creat d6/d7/f3f x:0 0 0 2024-04-26T21:25:48.940 INFO:tasks.workunit.client.1.smithi120.stdout:6/365: rename d4/db/d10/dd/d43/f46 to d4/db/d10/dd/d4e/f71 0 2024-04-26T21:25:48.940 INFO:tasks.workunit.client.1.smithi120.stdout:5/387: write d2/dc/d1d/d1f/d36/f76 [187974,82451] 0 2024-04-26T21:25:48.943 INFO:tasks.workunit.client.1.smithi120.stdout:5/388: chown d2/d48/l74 243096 1 2024-04-26T21:25:48.943 INFO:tasks.workunit.client.0.smithi084.stdout:2/182: symlink d6/d7/d3d/d15/d1f/d39/d20/l40 0 2024-04-26T21:25:48.944 INFO:tasks.workunit.client.0.smithi084.stdout:1/90: getdents d2/d9 0 2024-04-26T21:25:48.945 INFO:tasks.workunit.client.1.smithi120.stdout:7/337: unlink d7/d10/d12/d1a/c1b 0 2024-04-26T21:25:48.948 INFO:tasks.workunit.client.1.smithi120.stdout:6/366: creat d4/db/d10/dd/d4e/f72 x:0 0 0 2024-04-26T21:25:48.949 INFO:tasks.workunit.client.0.smithi084.stdout:1/91: mknod d2/d9/d15/c1d 0 2024-04-26T21:25:48.949 INFO:tasks.workunit.client.0.smithi084.stdout:2/183: rmdir d6/d7/d3d/d15/d1f/d39/d20 39 2024-04-26T21:25:48.954 INFO:tasks.workunit.client.1.smithi120.stdout:0/416: creat d0/d3/dc/dd/d1b/f91 x:0 0 0 2024-04-26T21:25:48.958 INFO:tasks.workunit.client.0.smithi084.stdout:2/184: truncate d6/d7/d3d/d15/d1f/d39/d20/f35 800402 0 2024-04-26T21:25:48.960 INFO:tasks.workunit.client.1.smithi120.stdout:5/389: getdents d2/d48 0 2024-04-26T21:25:48.962 INFO:tasks.workunit.client.1.smithi120.stdout:9/306: dwrite d0/dd/d3a/f58 [0,4194304] 0 2024-04-26T21:25:48.968 INFO:tasks.workunit.client.1.smithi120.stdout:6/367: write d4/db/d10/d1a/d2b/d57/d67/f32 [2483278,78740] 0 2024-04-26T21:25:48.971 INFO:tasks.workunit.client.1.smithi120.stdout:5/390: link d2/d48/l60 d2/dc/d1d/d1f/d34/l7e 0 2024-04-26T21:25:48.971 INFO:tasks.workunit.client.1.smithi120.stdout:0/417: read d0/d3/dc/dd/d1b/f38 [617749,405] 0 2024-04-26T21:25:48.973 INFO:tasks.workunit.client.0.smithi084.stdout:1/92: write d2/d9/f11 [80357,13790] 0 2024-04-26T21:25:48.974 INFO:tasks.workunit.client.0.smithi084.stdout:2/185: truncate d6/f14 2993226 0 2024-04-26T21:25:48.974 INFO:tasks.workunit.client.1.smithi120.stdout:6/368: mkdir d4/db/d25/d6d/d73 0 2024-04-26T21:25:48.974 INFO:tasks.workunit.client.1.smithi120.stdout:5/391: chown d2/dc/d1d/d21/d66/d4d/f7b 790576 1 2024-04-26T21:25:48.976 INFO:tasks.workunit.client.1.smithi120.stdout:0/418: mknod d0/d3/dc/dd/d4b/c92 0 2024-04-26T21:25:48.977 INFO:tasks.workunit.client.1.smithi120.stdout:3/302: dread dd/d2a/f33 [0,4194304] 0 2024-04-26T21:25:48.979 INFO:tasks.workunit.client.0.smithi084.stdout:2/186: fdatasync d6/d7/d3d/d15/d1f/d39/fc 0 2024-04-26T21:25:48.980 INFO:tasks.workunit.client.0.smithi084.stdout:1/93: creat d2/d19/f1e x:0 0 0 2024-04-26T21:25:48.981 INFO:tasks.workunit.client.1.smithi120.stdout:5/392: truncate d2/dc/d1d/d21/f45 4749553 0 2024-04-26T21:25:48.984 INFO:tasks.workunit.client.0.smithi084.stdout:1/94: creat d2/d9/d15/f1f x:0 0 0 2024-04-26T21:25:48.984 INFO:tasks.workunit.client.0.smithi084.stdout:2/187: truncate d6/d7/fb 448324 0 2024-04-26T21:25:48.986 INFO:tasks.workunit.client.0.smithi084.stdout:2/188: write d6/d1b/f2c [1291687,70117] 0 2024-04-26T21:25:48.991 INFO:tasks.workunit.client.0.smithi084.stdout:2/189: mkdir d6/d7/d3d/d15/d1f/d41 0 2024-04-26T21:25:48.993 INFO:tasks.workunit.client.1.smithi120.stdout:9/307: dwrite d0/f4f [0,4194304] 0 2024-04-26T21:25:48.994 INFO:tasks.workunit.client.1.smithi120.stdout:6/369: dwrite f1 [0,4194304] 0 2024-04-26T21:25:48.999 INFO:tasks.workunit.client.1.smithi120.stdout:6/370: write d4/db/d10/dd/f36 [1068545,893] 0 2024-04-26T21:25:48.999 INFO:tasks.workunit.client.0.smithi084.stdout:2/190: rename d6/d7/d3d/d15/f1c to d6/d7/d3d/d15/d1f/d22/d2a/f42 0 2024-04-26T21:25:49.000 INFO:tasks.workunit.client.1.smithi120.stdout:5/393: dread d2/dc/d1d/f58 [0,4194304] 0 2024-04-26T21:25:49.000 INFO:tasks.workunit.client.0.smithi084.stdout:1/95: dwrite d2/d19/f1e [0,4194304] 0 2024-04-26T21:25:49.004 INFO:tasks.workunit.client.1.smithi120.stdout:1/311: dread d6/d7/d1d/d2c/f31 [0,4194304] 0 2024-04-26T21:25:49.005 INFO:tasks.workunit.client.0.smithi084.stdout:1/96: dread d2/f10 [0,4194304] 0 2024-04-26T21:25:49.007 INFO:tasks.workunit.client.1.smithi120.stdout:6/371: truncate d4/db/d10/d1a/d2b/d57/d67/f4a 155939 0 2024-04-26T21:25:49.012 INFO:tasks.workunit.client.0.smithi084.stdout:2/191: mkdir d6/d7/d3d/d15/d1f/d39/d43 0 2024-04-26T21:25:49.013 INFO:tasks.workunit.client.0.smithi084.stdout:2/192: chown d6 1207 1 2024-04-26T21:25:49.014 INFO:tasks.workunit.client.1.smithi120.stdout:7/338: dread d7/f8 [4194304,4194304] 0 2024-04-26T21:25:49.015 INFO:tasks.workunit.client.1.smithi120.stdout:7/339: stat d7/c75 0 2024-04-26T21:25:49.018 INFO:tasks.workunit.client.0.smithi084.stdout:2/193: creat d6/d7/d3d/d15/d1f/d22/d2a/f44 x:0 0 0 2024-04-26T21:25:49.019 INFO:tasks.workunit.client.1.smithi120.stdout:1/312: dread d6/f3a [0,4194304] 0 2024-04-26T21:25:49.020 INFO:tasks.workunit.client.0.smithi084.stdout:2/194: fsync d6/d7/d3d/f30 0 2024-04-26T21:25:49.021 INFO:tasks.workunit.client.1.smithi120.stdout:1/313: write d6/d14/f16 [106674,101893] 0 2024-04-26T21:25:49.022 INFO:tasks.workunit.client.0.smithi084.stdout:1/97: dread d2/d19/f1e [0,4194304] 0 2024-04-26T21:25:49.024 INFO:tasks.workunit.client.1.smithi120.stdout:1/314: write d6/d7/d2d/d48/f49 [113939,23504] 0 2024-04-26T21:25:49.024 INFO:tasks.workunit.client.0.smithi084.stdout:2/195: mkdir d6/d7/d3d/d15/d1f/d39/d20/d45 0 2024-04-26T21:25:49.024 INFO:tasks.workunit.client.0.smithi084.stdout:1/98: write d2/d9/f16 [264825,28852] 0 2024-04-26T21:25:49.025 INFO:tasks.workunit.client.0.smithi084.stdout:2/196: chown d6/d7/d3d 26182872 1 2024-04-26T21:25:49.031 INFO:tasks.workunit.client.0.smithi084.stdout:1/99: fsync d2/d9/f16 0 2024-04-26T21:25:49.031 INFO:tasks.workunit.client.0.smithi084.stdout:2/197: mknod d6/d7/c46 0 2024-04-26T21:25:49.033 INFO:tasks.workunit.client.0.smithi084.stdout:1/100: creat d2/d9/d15/f20 x:0 0 0 2024-04-26T21:25:49.034 INFO:tasks.workunit.client.0.smithi084.stdout:1/101: dread - d2/d9/d15/f20 zero size 2024-04-26T21:25:49.036 INFO:tasks.workunit.client.0.smithi084.stdout:1/102: write d2/d9/f11 [1578317,64060] 0 2024-04-26T21:25:49.038 INFO:tasks.workunit.client.0.smithi084.stdout:2/198: link d6/d7/c2e d6/d7/d3d/d15/d1f/d39/d20/d36/c47 0 2024-04-26T21:25:49.041 INFO:tasks.workunit.client.1.smithi120.stdout:0/419: symlink d0/d3/d51/l93 0 2024-04-26T21:25:49.041 INFO:tasks.workunit.client.0.smithi084.stdout:1/103: link d2/fb d2/d9/d17/f21 0 2024-04-26T21:25:49.043 INFO:tasks.workunit.client.0.smithi084.stdout:2/199: getdents d6 0 2024-04-26T21:25:49.044 INFO:tasks.workunit.client.1.smithi120.stdout:9/308: creat d0/dd/d45/f63 x:0 0 0 2024-04-26T21:25:49.044 INFO:tasks.workunit.client.0.smithi084.stdout:1/104: write d2/d9/d17/f18 [587789,116284] 0 2024-04-26T21:25:49.045 INFO:tasks.workunit.client.1.smithi120.stdout:5/394: creat d2/dc/f7f x:0 0 0 2024-04-26T21:25:49.045 INFO:tasks.workunit.client.0.smithi084.stdout:2/200: dread - d6/d7/d3d/f30 zero size 2024-04-26T21:25:49.045 INFO:tasks.workunit.client.1.smithi120.stdout:9/309: readlink d0/dd/l2c 0 2024-04-26T21:25:49.046 INFO:tasks.workunit.client.1.smithi120.stdout:6/372: creat d4/db/d10/dd/f74 x:0 0 0 2024-04-26T21:25:49.047 INFO:tasks.workunit.client.0.smithi084.stdout:1/105: write d2/f10 [1053310,1725] 0 2024-04-26T21:25:49.048 INFO:tasks.workunit.client.1.smithi120.stdout:5/395: readlink d2/dc/d1d/d1f/d36/d44/d6c/l31 0 2024-04-26T21:25:49.048 INFO:tasks.workunit.client.1.smithi120.stdout:7/340: unlink d7/d10/d12/d2f/f67 0 2024-04-26T21:25:49.049 INFO:tasks.workunit.client.1.smithi120.stdout:6/373: chown d4/db/d10/d22/d56 44266 1 2024-04-26T21:25:49.051 INFO:tasks.workunit.client.1.smithi120.stdout:7/341: dread - d7/d10/d12/d1a/d50/f54 zero size 2024-04-26T21:25:49.051 INFO:tasks.workunit.client.1.smithi120.stdout:5/396: fdatasync d2/dc/d1d/d21/d66/f27 0 2024-04-26T21:25:49.053 INFO:tasks.workunit.client.1.smithi120.stdout:3/303: unlink dd/f15 0 2024-04-26T21:25:49.053 INFO:tasks.workunit.client.0.smithi084.stdout:2/201: creat d6/d7/d3d/d15/d1f/d39/f48 x:0 0 0 2024-04-26T21:25:49.054 INFO:tasks.workunit.client.1.smithi120.stdout:7/342: readlink d7/d10/d12/d1f/l4f 0 2024-04-26T21:25:49.056 INFO:tasks.workunit.client.1.smithi120.stdout:0/420: unlink d0/d3/dc/dd/d1b/f48 0 2024-04-26T21:25:49.059 INFO:tasks.workunit.client.1.smithi120.stdout:0/421: read d0/d3/dc/f27 [3282145,119142] 0 2024-04-26T21:25:49.060 INFO:tasks.workunit.client.0.smithi084.stdout:1/106: dread d2/d19/f1e [0,4194304] 0 2024-04-26T21:25:49.061 INFO:tasks.workunit.client.1.smithi120.stdout:6/374: rename f1 to d4/db/d10/dd/d4e/f75 0 2024-04-26T21:25:49.064 INFO:tasks.workunit.client.0.smithi084.stdout:1/107: dread d2/d9/f16 [0,4194304] 0 2024-04-26T21:25:49.065 INFO:tasks.workunit.client.1.smithi120.stdout:3/304: mkdir dd/de/df/d1e/d28/d64 0 2024-04-26T21:25:49.066 INFO:tasks.workunit.client.0.smithi084.stdout:1/108: rmdir d2/d9 39 2024-04-26T21:25:49.069 INFO:tasks.workunit.client.1.smithi120.stdout:0/422: mkdir d0/d3/d13/d81/d94 0 2024-04-26T21:25:49.070 INFO:tasks.workunit.client.1.smithi120.stdout:0/423: read d0/d3/d51/f58 [2430554,121620] 0 2024-04-26T21:25:49.071 INFO:tasks.workunit.client.1.smithi120.stdout:5/397: rename d2/d30/l75 to d2/dc/d1d/l80 0 2024-04-26T21:25:49.071 INFO:tasks.workunit.client.1.smithi120.stdout:0/424: stat d0/d3/d13 0 2024-04-26T21:25:49.072 INFO:tasks.workunit.client.0.smithi084.stdout:2/202: dwrite d6/d7/f3f [0,4194304] 0 2024-04-26T21:25:49.075 INFO:tasks.workunit.client.1.smithi120.stdout:4/303: sync 2024-04-26T21:25:49.076 INFO:tasks.workunit.client.1.smithi120.stdout:4/304: chown d10/c1c 210 1 2024-04-26T21:25:49.076 INFO:tasks.workunit.client.1.smithi120.stdout:6/375: mkdir d4/db/d10/dd/d4e/d76 0 2024-04-26T21:25:49.081 INFO:tasks.workunit.client.1.smithi120.stdout:7/343: rename d7/d10/d12/f15 to d7/d19/d60/f76 0 2024-04-26T21:25:49.084 INFO:tasks.workunit.client.1.smithi120.stdout:1/315: link d6/d7/d2d/d48/c63 d6/d7/d2d/d48/c6a 0 2024-04-26T21:25:49.087 INFO:tasks.workunit.client.1.smithi120.stdout:9/310: dwrite d0/dd/d45/f4a [0,4194304] 0 2024-04-26T21:25:49.087 INFO:tasks.workunit.client.1.smithi120.stdout:0/425: write d0/d3/dc/dd/f34 [988419,93708] 0 2024-04-26T21:25:49.089 INFO:tasks.workunit.client.1.smithi120.stdout:4/305: creat d10/d12/f67 x:0 0 0 2024-04-26T21:25:49.091 INFO:tasks.workunit.client.0.smithi084.stdout:1/109: dwrite d2/d9/f13 [0,4194304] 0 2024-04-26T21:25:49.091 INFO:tasks.workunit.client.1.smithi120.stdout:7/344: read - d7/d10/d12/d2f/f41 zero size 2024-04-26T21:25:49.093 INFO:tasks.workunit.client.1.smithi120.stdout:1/316: mknod d6/d7/d1d/d5d/d67/dd/d56/c6b 0 2024-04-26T21:25:49.094 INFO:tasks.workunit.client.1.smithi120.stdout:9/311: creat d0/dd/d34/f64 x:0 0 0 2024-04-26T21:25:49.095 INFO:tasks.workunit.client.1.smithi120.stdout:7/345: read - d7/d10/d12/d2f/f52 zero size 2024-04-26T21:25:49.099 INFO:tasks.workunit.client.1.smithi120.stdout:6/376: dwrite d4/db/d10/dd/d4e/d5d/f6f [0,4194304] 0 2024-04-26T21:25:49.101 INFO:tasks.workunit.client.1.smithi120.stdout:0/426: rmdir d0/d3/d13/d5a 39 2024-04-26T21:25:49.103 INFO:tasks.workunit.client.1.smithi120.stdout:3/305: dwrite dd/de/df/d12/f21 [4194304,4194304] 0 2024-04-26T21:25:49.103 INFO:tasks.workunit.client.1.smithi120.stdout:5/398: rmdir d2/d30 39 2024-04-26T21:25:49.106 INFO:tasks.workunit.client.1.smithi120.stdout:4/306: symlink d10/d12/l68 0 2024-04-26T21:25:49.107 INFO:tasks.workunit.client.0.smithi084.stdout:2/203: dwrite d6/d7/f27 [0,4194304] 0 2024-04-26T21:25:49.110 INFO:tasks.workunit.client.1.smithi120.stdout:9/312: mkdir d0/d6/d4d/d65 0 2024-04-26T21:25:49.112 INFO:tasks.workunit.client.1.smithi120.stdout:1/317: mkdir d6/d7/d1d/d5d/d67/dd/d35/d6c 0 2024-04-26T21:25:49.115 INFO:tasks.workunit.client.1.smithi120.stdout:1/318: stat d6/d7/d1d/d5d 0 2024-04-26T21:25:49.115 INFO:tasks.workunit.client.1.smithi120.stdout:7/346: rename d7/c59 to d7/d10/d12/d1f/d28/d4c/d6c/d74/c77 0 2024-04-26T21:25:49.118 INFO:tasks.workunit.client.1.smithi120.stdout:6/377: creat d4/db/d25/d6d/f77 x:0 0 0 2024-04-26T21:25:49.119 INFO:tasks.workunit.client.1.smithi120.stdout:3/306: symlink dd/d2a/l65 0 2024-04-26T21:25:49.119 INFO:tasks.workunit.client.1.smithi120.stdout:0/427: fsync d0/d3/d51/f58 0 2024-04-26T21:25:49.124 INFO:tasks.workunit.client.0.smithi084.stdout:2/204: dread d6/d1b/f2c [0,4194304] 0 2024-04-26T21:25:49.126 INFO:tasks.workunit.client.1.smithi120.stdout:3/307: creat dd/d2a/f66 x:0 0 0 2024-04-26T21:25:49.126 INFO:tasks.workunit.client.1.smithi120.stdout:0/428: read - d0/d3/dc/d12/d31/f43 zero size 2024-04-26T21:25:49.129 INFO:tasks.workunit.client.1.smithi120.stdout:9/313: getdents d0/d14/d2d 0 2024-04-26T21:25:49.130 INFO:tasks.workunit.client.1.smithi120.stdout:4/307: dwrite d10/d28/f3d [0,4194304] 0 2024-04-26T21:25:49.131 INFO:tasks.workunit.client.1.smithi120.stdout:4/308: stat d10/l4a 0 2024-04-26T21:25:49.132 INFO:tasks.workunit.client.1.smithi120.stdout:7/347: getdents d7/d10 0 2024-04-26T21:25:49.133 INFO:tasks.workunit.client.1.smithi120.stdout:5/399: getdents d2/d30 0 2024-04-26T21:25:49.135 INFO:tasks.workunit.client.1.smithi120.stdout:0/429: mkdir d0/d3/d51/d95 0 2024-04-26T21:25:49.137 INFO:tasks.workunit.client.1.smithi120.stdout:5/400: write d2/dc/d1d/d21/d66/f14 [737756,120211] 0 2024-04-26T21:25:49.137 INFO:tasks.workunit.client.1.smithi120.stdout:0/430: stat d0/d3/dc/dd/d1b 0 2024-04-26T21:25:49.142 INFO:tasks.workunit.client.1.smithi120.stdout:6/378: rename d4/db/d25/f4b to d4/db/d10/dd/d28/f78 0 2024-04-26T21:25:49.142 INFO:tasks.workunit.client.1.smithi120.stdout:9/314: rmdir d0/d14/d2d/d4b 39 2024-04-26T21:25:49.142 INFO:tasks.workunit.client.1.smithi120.stdout:8/336: sync 2024-04-26T21:25:49.142 INFO:tasks.workunit.client.1.smithi120.stdout:2/407: sync 2024-04-26T21:25:49.143 INFO:tasks.workunit.client.0.smithi084.stdout:2/205: dread d6/d7/d3d/d15/d1f/d39/fe [0,4194304] 0 2024-04-26T21:25:49.143 INFO:tasks.workunit.client.1.smithi120.stdout:8/337: chown d5 1 1 2024-04-26T21:25:49.144 INFO:tasks.workunit.client.1.smithi120.stdout:7/348: rmdir d7/d10/d12/d1a/d50 39 2024-04-26T21:25:49.144 INFO:tasks.workunit.client.1.smithi120.stdout:2/408: chown d4/d1b/d2e/d50 748 1 2024-04-26T21:25:49.146 INFO:tasks.workunit.client.1.smithi120.stdout:3/308: rename dd/d2a/f66 to dd/de/df/d1e/d3b/f67 0 2024-04-26T21:25:49.146 INFO:tasks.workunit.client.1.smithi120.stdout:8/338: stat d5/d6/l13 0 2024-04-26T21:25:49.147 INFO:tasks.workunit.client.1.smithi120.stdout:1/319: write d6/d7/d1d/f50 [6133570,100959] 0 2024-04-26T21:25:49.147 INFO:tasks.workunit.client.1.smithi120.stdout:2/409: read d4/f64 [3017,4019] 0 2024-04-26T21:25:49.150 INFO:tasks.workunit.client.1.smithi120.stdout:9/315: truncate d0/d6/f60 271137 0 2024-04-26T21:25:49.151 INFO:tasks.workunit.client.1.smithi120.stdout:4/309: rename d10/l4a to d10/d12/l69 0 2024-04-26T21:25:49.153 INFO:tasks.workunit.client.0.smithi084.stdout:2/206: dread d6/d7/f27 [0,4194304] 0 2024-04-26T21:25:49.154 INFO:tasks.workunit.client.1.smithi120.stdout:1/320: mkdir d6/d7/d1b/d3b/d6d 0 2024-04-26T21:25:49.155 INFO:tasks.workunit.client.1.smithi120.stdout:9/316: fdatasync d0/fa 0 2024-04-26T21:25:49.158 INFO:tasks.workunit.client.0.smithi084.stdout:2/207: mknod d6/d7/d3d/d15/d1f/d39/d20/c49 0 2024-04-26T21:25:49.159 INFO:tasks.workunit.client.0.smithi084.stdout:2/208: write d6/d7/d3d/f25 [207591,17971] 0 2024-04-26T21:25:49.163 INFO:tasks.workunit.client.1.smithi120.stdout:1/321: rmdir d6/d14 39 2024-04-26T21:25:49.163 INFO:tasks.workunit.client.1.smithi120.stdout:7/349: getdents d7 0 2024-04-26T21:25:49.164 INFO:tasks.workunit.client.0.smithi084.stdout:2/209: mknod d6/d7/d3d/d15/d1f/c4a 0 2024-04-26T21:25:49.165 INFO:tasks.workunit.client.1.smithi120.stdout:9/317: rmdir d0/d14 39 2024-04-26T21:25:49.172 INFO:tasks.workunit.client.1.smithi120.stdout:0/431: rename d0/df/f3f to d0/d3/d13/f96 0 2024-04-26T21:25:49.172 INFO:tasks.workunit.client.1.smithi120.stdout:5/401: dwrite d2/dc/d1d/d1f/d36/f65 [0,4194304] 0 2024-04-26T21:25:49.173 INFO:tasks.workunit.client.0.smithi084.stdout:8/104: sync 2024-04-26T21:25:49.173 INFO:tasks.workunit.client.1.smithi120.stdout:1/322: dread d6/d7/d1d/d5d/d67/dd/f42 [0,4194304] 0 2024-04-26T21:25:49.174 INFO:tasks.workunit.client.0.smithi084.stdout:8/105: stat d4/f12 0 2024-04-26T21:25:49.174 INFO:tasks.workunit.client.1.smithi120.stdout:4/310: dread d10/d28/f29 [0,4194304] 0 2024-04-26T21:25:49.175 INFO:tasks.workunit.client.0.smithi084.stdout:2/210: getdents d6/d7/d3d/d15/d1f 0 2024-04-26T21:25:49.176 INFO:tasks.workunit.client.1.smithi120.stdout:9/318: chown d0/d14/f35 1 1 2024-04-26T21:25:49.177 INFO:tasks.workunit.client.1.smithi120.stdout:8/339: link d5/d6/d11/d52/d27/f38 d5/d6/d11/f6b 0 2024-04-26T21:25:49.179 INFO:tasks.workunit.client.0.smithi084.stdout:8/106: dread d4/f13 [0,4194304] 0 2024-04-26T21:25:49.181 INFO:tasks.workunit.client.1.smithi120.stdout:7/350: dread - d7/d10/d12/d1a/d50/f54 zero size 2024-04-26T21:25:49.182 INFO:tasks.workunit.client.0.smithi084.stdout:2/211: link d6/d7/f27 d6/d7/d3d/d15/d1f/d41/f4b 0 2024-04-26T21:25:49.184 INFO:tasks.workunit.client.1.smithi120.stdout:2/410: dread d4/d1b/f41 [0,4194304] 0 2024-04-26T21:25:49.184 INFO:tasks.workunit.client.0.smithi084.stdout:8/107: write d4/f5 [466376,61687] 0 2024-04-26T21:25:49.187 INFO:tasks.workunit.client.0.smithi084.stdout:2/212: mknod d6/d7/d3d/d15/d1f/d39/d20/c4c 0 2024-04-26T21:25:49.187 INFO:tasks.workunit.client.1.smithi120.stdout:5/402: read d2/dc/d1d/d21/d66/f41 [3731713,63110] 0 2024-04-26T21:25:49.187 INFO:tasks.workunit.client.1.smithi120.stdout:8/340: write d5/f19 [3426415,127892] 0 2024-04-26T21:25:49.194 INFO:tasks.workunit.client.1.smithi120.stdout:0/432: mkdir d0/d3/d51/d97 0 2024-04-26T21:25:49.195 INFO:tasks.workunit.client.0.smithi084.stdout:2/213: rename d6/l38 to d6/d7/d3d/d15/d1f/d39/d20/d45/l4d 0 2024-04-26T21:25:49.198 INFO:tasks.workunit.client.1.smithi120.stdout:6/379: rename d4/l65 to d4/d3d/l79 0 2024-04-26T21:25:49.199 INFO:tasks.workunit.client.1.smithi120.stdout:1/323: creat d6/d7/d1b/d5c/f6e x:0 0 0 2024-04-26T21:25:49.199 INFO:tasks.workunit.client.0.smithi084.stdout:2/214: chown d6/d7/d3d/d15/d1f/d39/d20/f3a 2092186637 1 2024-04-26T21:25:49.202 INFO:tasks.workunit.client.0.smithi084.stdout:2/215: fsync d6/d7/d3d/d15/d1f/d39/f48 0 2024-04-26T21:25:49.204 INFO:tasks.workunit.client.0.smithi084.stdout:2/216: chown c1 5363806 1 2024-04-26T21:25:49.204 INFO:tasks.workunit.client.0.smithi084.stdout:8/108: dwrite d4/d7/f14 [0,4194304] 0 2024-04-26T21:25:49.204 INFO:tasks.workunit.client.1.smithi120.stdout:9/319: mkdir d0/d66 0 2024-04-26T21:25:49.209 INFO:tasks.workunit.client.0.smithi084.stdout:8/109: unlink f0 0 2024-04-26T21:25:49.209 INFO:tasks.workunit.client.1.smithi120.stdout:9/320: readlink d0/dd/l3e 0 2024-04-26T21:25:49.212 INFO:tasks.workunit.client.1.smithi120.stdout:5/403: dread d2/dc/d1d/d21/d66/f14 [0,4194304] 0 2024-04-26T21:25:49.212 INFO:tasks.workunit.client.1.smithi120.stdout:3/309: rename dd/de/d18/d37/l49 to dd/de/df/d1e/d3b/d56/l68 0 2024-04-26T21:25:49.213 INFO:tasks.workunit.client.1.smithi120.stdout:1/324: mkdir d6/d14/d6f 0 2024-04-26T21:25:49.215 INFO:tasks.workunit.client.1.smithi120.stdout:4/311: write d10/f47 [2516463,62677] 0 2024-04-26T21:25:49.221 INFO:tasks.workunit.client.1.smithi120.stdout:1/325: mknod d6/d7/d1b/d3b/c70 0 2024-04-26T21:25:49.223 INFO:tasks.workunit.client.1.smithi120.stdout:9/321: creat d0/dd/d3a/d5c/f67 x:0 0 0 2024-04-26T21:25:49.223 INFO:tasks.workunit.client.1.smithi120.stdout:5/404: read d2/fa [3012811,56695] 0 2024-04-26T21:25:49.225 INFO:tasks.workunit.client.0.smithi084.stdout:2/217: rename d6/d7/d3d/d15/d1f/c31 to d6/d7/d3d/c4e 0 2024-04-26T21:25:49.225 INFO:tasks.workunit.client.1.smithi120.stdout:3/310: write dd/de/d18/d24/d43/f47 [2672617,46678] 0 2024-04-26T21:25:49.226 INFO:tasks.workunit.client.1.smithi120.stdout:8/341: dwrite d5/d6/d11/f2a [0,4194304] 0 2024-04-26T21:25:49.228 INFO:tasks.workunit.client.0.smithi084.stdout:8/110: dwrite d4/d7/d15/f18 [0,4194304] 0 2024-04-26T21:25:49.232 INFO:tasks.workunit.client.1.smithi120.stdout:5/405: write d2/d48/d63/f7c [877373,108074] 0 2024-04-26T21:25:49.232 INFO:tasks.workunit.client.1.smithi120.stdout:9/322: symlink d0/d6/d3d/l68 0 2024-04-26T21:25:49.235 INFO:tasks.workunit.client.1.smithi120.stdout:4/312: creat d10/f6a x:0 0 0 2024-04-26T21:25:49.238 INFO:tasks.workunit.client.1.smithi120.stdout:3/311: symlink dd/de/df/d1e/d3b/l69 0 2024-04-26T21:25:49.239 INFO:tasks.workunit.client.0.smithi084.stdout:2/218: mkdir d6/d7/d3d/d4f 0 2024-04-26T21:25:49.239 INFO:tasks.workunit.client.1.smithi120.stdout:1/326: symlink d6/d7/d1d/d5d/d67/l71 0 2024-04-26T21:25:49.240 INFO:tasks.workunit.client.0.smithi084.stdout:2/219: read d6/d7/d3d/d15/d1f/d41/f4b [918803,19947] 0 2024-04-26T21:25:49.242 INFO:tasks.workunit.client.1.smithi120.stdout:2/411: dread d4/d1b/d25/f31 [0,4194304] 0 2024-04-26T21:25:49.244 INFO:tasks.workunit.client.1.smithi120.stdout:8/342: mknod d5/d6/d34/c6c 0 2024-04-26T21:25:49.246 INFO:tasks.workunit.client.1.smithi120.stdout:3/312: dread - dd/d40/f50 zero size 2024-04-26T21:25:49.250 INFO:tasks.workunit.client.1.smithi120.stdout:7/351: dread d7/f8 [0,4194304] 0 2024-04-26T21:25:49.251 INFO:tasks.workunit.client.1.smithi120.stdout:1/327: mkdir d6/d14/d3c/d72 0 2024-04-26T21:25:49.251 INFO:tasks.workunit.client.1.smithi120.stdout:0/433: dwrite d0/d3/d13/f1f [4194304,4194304] 0 2024-04-26T21:25:49.253 INFO:tasks.workunit.client.1.smithi120.stdout:9/323: rename d0/dd/c4c to d0/dd/d45/c69 0 2024-04-26T21:25:49.254 INFO:tasks.workunit.client.1.smithi120.stdout:4/313: dread d10/d12/f2c [0,4194304] 0 2024-04-26T21:25:49.255 INFO:tasks.workunit.client.0.smithi084.stdout:2/220: link d6/d7/d3d/d15/d1f/d39/fe d6/d7/d3d/d15/d1f/d39/d20/f50 0 2024-04-26T21:25:49.256 INFO:tasks.workunit.client.1.smithi120.stdout:2/412: write d4/d1b/d4f/f7c [429321,83695] 0 2024-04-26T21:25:49.259 INFO:tasks.workunit.client.1.smithi120.stdout:1/328: dread - d6/d7/d1b/d55/f5b zero size 2024-04-26T21:25:49.259 INFO:tasks.workunit.client.1.smithi120.stdout:7/352: unlink d7/d10/d12/f14 0 2024-04-26T21:25:49.261 INFO:tasks.workunit.client.1.smithi120.stdout:5/406: rename d2/dc/d1d/d2e to d2/dc/d1d/d21/d81 0 2024-04-26T21:25:49.261 INFO:tasks.workunit.client.1.smithi120.stdout:3/313: write dd/de/d18/d24/f3a [710022,936] 0 2024-04-26T21:25:49.262 INFO:tasks.workunit.client.1.smithi120.stdout:8/343: creat d5/d6/d11/d52/d27/f6d x:0 0 0 2024-04-26T21:25:49.262 INFO:tasks.workunit.client.1.smithi120.stdout:9/324: symlink d0/dd/d3a/d5c/l6a 0 2024-04-26T21:25:49.263 INFO:tasks.workunit.client.1.smithi120.stdout:4/314: write d10/d12/f40 [244543,24967] 0 2024-04-26T21:25:49.263 INFO:tasks.workunit.client.0.smithi084.stdout:2/221: rename d6/f33 to d6/d7/d3d/d15/d1f/d39/d20/d45/f51 0 2024-04-26T21:25:49.268 INFO:tasks.workunit.client.1.smithi120.stdout:4/315: readlink d10/l5a 0 2024-04-26T21:25:49.269 INFO:tasks.workunit.client.1.smithi120.stdout:3/314: stat dd/de/df/d12/d48/f3d 0 2024-04-26T21:25:49.269 INFO:tasks.workunit.client.0.smithi084.stdout:2/222: dread d6/d7/d3d/d15/d1f/d39/d20/f35 [0,4194304] 0 2024-04-26T21:25:49.274 INFO:tasks.workunit.client.1.smithi120.stdout:7/353: mkdir d7/d10/d12/d1f/d28/d78 0 2024-04-26T21:25:49.276 INFO:tasks.workunit.client.1.smithi120.stdout:5/407: write d2/dc/d1d/d21/d66/f41 [1387830,107005] 0 2024-04-26T21:25:49.276 INFO:tasks.workunit.client.1.smithi120.stdout:4/316: mkdir d10/d6b 0 2024-04-26T21:25:49.283 INFO:tasks.workunit.client.1.smithi120.stdout:5/408: mkdir d2/d82 0 2024-04-26T21:25:49.283 INFO:tasks.workunit.client.1.smithi120.stdout:2/413: dread d4/d1b/f41 [0,4194304] 0 2024-04-26T21:25:49.286 INFO:tasks.workunit.client.1.smithi120.stdout:7/354: creat d7/d10/d12/d1a/d33/d34/d37/f79 x:0 0 0 2024-04-26T21:25:49.287 INFO:tasks.workunit.client.0.smithi084.stdout:2/223: unlink d6/d7/d3d/f30 0 2024-04-26T21:25:49.288 INFO:tasks.workunit.client.1.smithi120.stdout:5/409: write d2/d1b/d22/d47/f5b [1382901,2149] 0 2024-04-26T21:25:49.289 INFO:tasks.workunit.client.1.smithi120.stdout:4/317: getdents d10/d28 0 2024-04-26T21:25:49.290 INFO:tasks.workunit.client.1.smithi120.stdout:2/414: chown d4/d1b/d2e/d50/f27 4018474 1 2024-04-26T21:25:49.301 INFO:tasks.workunit.client.1.smithi120.stdout:7/355: creat d7/d10/d12/f7a x:0 0 0 2024-04-26T21:25:49.302 INFO:tasks.workunit.client.1.smithi120.stdout:4/318: creat d10/f6c x:0 0 0 2024-04-26T21:25:49.303 INFO:tasks.workunit.client.1.smithi120.stdout:3/315: write dd/de/f2f [536576,64334] 0 2024-04-26T21:25:49.304 INFO:tasks.workunit.client.1.smithi120.stdout:1/329: dwrite d6/d7/d1d/d5d/d67/dd/d56/f57 [0,4194304] 0 2024-04-26T21:25:49.307 INFO:tasks.workunit.client.1.smithi120.stdout:4/319: dread - d10/d12/f35 zero size 2024-04-26T21:25:49.308 INFO:tasks.workunit.client.0.smithi084.stdout:8/111: truncate d4/d6/f8 5377022 0 2024-04-26T21:25:49.310 INFO:tasks.workunit.client.1.smithi120.stdout:7/356: chown d7/d10/d12/d1a/f27 12389 1 2024-04-26T21:25:49.314 INFO:tasks.workunit.client.1.smithi120.stdout:1/330: dread - d6/d7/d1b/d5c/f6e zero size 2024-04-26T21:25:49.318 INFO:tasks.workunit.client.1.smithi120.stdout:1/331: chown d6/d7/d1b 15 1 2024-04-26T21:25:49.321 INFO:tasks.workunit.client.0.smithi084.stdout:8/112: rename d4/d7/cf to d4/d6/db/c1b 0 2024-04-26T21:25:49.321 INFO:tasks.workunit.client.1.smithi120.stdout:8/344: dwrite d5/d6/d11/f6b [8388608,4194304] 0 2024-04-26T21:25:49.325 INFO:tasks.workunit.client.1.smithi120.stdout:8/345: chown d5/d6/d34/d37/d60/d55 52660 1 2024-04-26T21:25:49.327 INFO:tasks.workunit.client.1.smithi120.stdout:7/357: mkdir d7/d10/d12/d1f/d28/d4c/d6b/d7b 0 2024-04-26T21:25:49.328 INFO:tasks.workunit.client.1.smithi120.stdout:1/332: mkdir d6/d7/d1d/d2c/d73 0 2024-04-26T21:25:49.329 INFO:tasks.workunit.client.1.smithi120.stdout:4/320: write d10/d12/f35 [848718,89012] 0 2024-04-26T21:25:49.329 INFO:tasks.workunit.client.1.smithi120.stdout:9/325: dread d0/d14/f24 [0,4194304] 0 2024-04-26T21:25:49.331 INFO:tasks.workunit.client.1.smithi120.stdout:4/321: dread - d10/d12/f67 zero size 2024-04-26T21:25:49.333 INFO:tasks.workunit.client.1.smithi120.stdout:0/434: dread d0/d3/d13/f76 [0,4194304] 0 2024-04-26T21:25:49.335 INFO:tasks.workunit.client.1.smithi120.stdout:7/358: write d7/d10/d12/d1a/d33/d34/d37/f79 [871777,2699] 0 2024-04-26T21:25:49.340 INFO:tasks.workunit.client.1.smithi120.stdout:9/326: creat d0/dd/d3a/f6b x:0 0 0 2024-04-26T21:25:49.340 INFO:tasks.workunit.client.1.smithi120.stdout:3/316: dread dd/de/df/d1e/d28/f3f [0,4194304] 0 2024-04-26T21:25:49.340 INFO:tasks.workunit.client.1.smithi120.stdout:4/322: creat d10/d65/f6d x:0 0 0 2024-04-26T21:25:49.346 INFO:tasks.workunit.client.1.smithi120.stdout:3/317: fdatasync f5 0 2024-04-26T21:25:49.346 INFO:tasks.workunit.client.1.smithi120.stdout:7/359: creat d7/d10/d12/d2f/f7c x:0 0 0 2024-04-26T21:25:49.346 INFO:tasks.workunit.client.1.smithi120.stdout:5/410: dread d2/dc/d1d/d21/d66/f27 [0,4194304] 0 2024-04-26T21:25:49.346 INFO:tasks.workunit.client.1.smithi120.stdout:8/346: rename d5/f19 to d5/d6/d11/d32/f6e 0 2024-04-26T21:25:49.347 INFO:tasks.workunit.client.0.smithi084.stdout:8/113: dwrite d4/d7/f16 [0,4194304] 0 2024-04-26T21:25:49.347 INFO:tasks.workunit.client.0.smithi084.stdout:3/119: sync 2024-04-26T21:25:49.347 INFO:tasks.workunit.client.0.smithi084.stdout:4/90: sync 2024-04-26T21:25:49.347 INFO:tasks.workunit.client.0.smithi084.stdout:0/109: sync 2024-04-26T21:25:49.349 INFO:tasks.workunit.client.0.smithi084.stdout:8/114: write d4/d7/f16 [2000098,27110] 0 2024-04-26T21:25:49.350 INFO:tasks.workunit.client.1.smithi120.stdout:4/323: read d10/d12/f2c [434657,71575] 0 2024-04-26T21:25:49.351 INFO:tasks.workunit.client.1.smithi120.stdout:0/435: link d0/d3/d13/f60 d0/df/d59/f98 0 2024-04-26T21:25:49.351 INFO:tasks.workunit.client.0.smithi084.stdout:4/91: write d5/d10/f1b [624671,18043] 0 2024-04-26T21:25:49.352 INFO:tasks.workunit.client.1.smithi120.stdout:2/415: dread d4/d1b/d25/d2c/f22 [0,4194304] 0 2024-04-26T21:25:49.353 INFO:tasks.workunit.client.0.smithi084.stdout:4/92: fdatasync d5/f1a 0 2024-04-26T21:25:49.356 INFO:tasks.workunit.client.1.smithi120.stdout:1/333: rename d6/d7/d1d/d5d/d67/dd/d35/f5e to d6/d9/f74 0 2024-04-26T21:25:49.358 INFO:tasks.workunit.client.1.smithi120.stdout:8/347: creat d5/d6/d11/d32/d3b/f6f x:0 0 0 2024-04-26T21:25:49.359 INFO:tasks.workunit.client.1.smithi120.stdout:2/416: mknod d4/d1b/d25/c88 0 2024-04-26T21:25:49.360 INFO:tasks.workunit.client.1.smithi120.stdout:5/411: symlink d2/dc/d1d/d21/d77/d79/l83 0 2024-04-26T21:25:49.361 INFO:tasks.workunit.client.0.smithi084.stdout:3/120: dread d1/f1a [0,4194304] 0 2024-04-26T21:25:49.362 INFO:tasks.workunit.client.0.smithi084.stdout:0/110: link ca de/d1c/c22 0 2024-04-26T21:25:49.362 INFO:tasks.workunit.client.1.smithi120.stdout:6/380: sync 2024-04-26T21:25:49.363 INFO:tasks.workunit.client.0.smithi084.stdout:4/93: creat d5/d7/f24 x:0 0 0 2024-04-26T21:25:49.363 INFO:tasks.workunit.client.1.smithi120.stdout:9/327: link d0/dd/f12 d0/d14/d2d/f6c 0 2024-04-26T21:25:49.364 INFO:tasks.workunit.client.1.smithi120.stdout:5/412: chown d2/f13 145 1 2024-04-26T21:25:49.369 INFO:tasks.workunit.client.1.smithi120.stdout:4/324: creat d10/d6b/f6e x:0 0 0 2024-04-26T21:25:49.369 INFO:tasks.workunit.client.0.smithi084.stdout:0/111: chown ca 957 1 2024-04-26T21:25:49.370 INFO:tasks.workunit.client.0.smithi084.stdout:8/115: dread d4/f12 [0,4194304] 0 2024-04-26T21:25:49.370 INFO:tasks.workunit.client.0.smithi084.stdout:3/121: unlink d1/c1e 0 2024-04-26T21:25:49.370 INFO:tasks.workunit.client.0.smithi084.stdout:0/112: dread - de/f21 zero size 2024-04-26T21:25:49.372 INFO:tasks.workunit.client.0.smithi084.stdout:3/122: dread - d1/d10/f13 zero size 2024-04-26T21:25:49.373 INFO:tasks.workunit.client.1.smithi120.stdout:1/334: symlink d6/d14/d6f/l75 0 2024-04-26T21:25:49.376 INFO:tasks.workunit.client.1.smithi120.stdout:6/381: symlink d4/d3d/l7a 0 2024-04-26T21:25:49.376 INFO:tasks.workunit.client.1.smithi120.stdout:9/328: unlink d0/d6/c2b 0 2024-04-26T21:25:49.377 INFO:tasks.workunit.client.1.smithi120.stdout:7/360: rename d7/d10/d12/d1f/d28/d78 to d7/d10/d12/d1f/d7d 0 2024-04-26T21:25:49.378 INFO:tasks.workunit.client.0.smithi084.stdout:8/116: creat d4/f1c x:0 0 0 2024-04-26T21:25:49.378 INFO:tasks.workunit.client.0.smithi084.stdout:8/117: chown d4/d7/d9 60 1 2024-04-26T21:25:49.378 INFO:tasks.workunit.client.0.smithi084.stdout:8/118: readlink d4/lc 0 2024-04-26T21:25:49.378 INFO:tasks.workunit.client.1.smithi120.stdout:3/318: getdents dd/de/df 0 2024-04-26T21:25:49.379 INFO:tasks.workunit.client.1.smithi120.stdout:1/335: creat d6/d7/d1d/d2c/f76 x:0 0 0 2024-04-26T21:25:49.383 INFO:tasks.workunit.client.1.smithi120.stdout:3/319: write dd/de/f2f [1046420,82482] 0 2024-04-26T21:25:49.384 INFO:tasks.workunit.client.0.smithi084.stdout:8/119: symlink d4/d6/db/l1d 0 2024-04-26T21:25:49.387 INFO:tasks.workunit.client.1.smithi120.stdout:9/329: rename d0/d6/d4d/c53 to d0/d6/d4d/c6d 0 2024-04-26T21:25:49.388 INFO:tasks.workunit.client.1.smithi120.stdout:5/413: dwrite d2/dc/d1d/d1f/d36/f40 [0,4194304] 0 2024-04-26T21:25:49.388 INFO:tasks.workunit.client.0.smithi084.stdout:8/120: mkdir d4/d6/db/d1e 0 2024-04-26T21:25:49.390 INFO:tasks.workunit.client.1.smithi120.stdout:3/320: dread dd/de/d18/d24/f54 [0,4194304] 0 2024-04-26T21:25:49.392 INFO:tasks.workunit.client.1.smithi120.stdout:3/321: chown dd/de/df/d1e/d28 1 1 2024-04-26T21:25:49.394 INFO:tasks.workunit.client.0.smithi084.stdout:3/123: dread d1/f3 [0,4194304] 0 2024-04-26T21:25:49.395 INFO:tasks.workunit.client.1.smithi120.stdout:7/361: unlink d7/d10/d12/d1f/d28/d4c/c73 0 2024-04-26T21:25:49.396 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:49 smithi084 ceph-mon[25539]: pgmap v39: 65 pgs: 65 active+clean; 890 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 17 MiB/s rd, 112 MiB/s wr, 260 op/s 2024-04-26T21:25:49.399 INFO:tasks.workunit.client.1.smithi120.stdout:4/325: creat d10/f6f x:0 0 0 2024-04-26T21:25:49.399 INFO:tasks.workunit.client.1.smithi120.stdout:0/436: truncate d0/d3/dc/dd/d1b/d39/f3e 76917 0 2024-04-26T21:25:49.399 INFO:tasks.workunit.client.0.smithi084.stdout:3/124: mkdir d1/d2c 0 2024-04-26T21:25:49.400 INFO:tasks.workunit.client.1.smithi120.stdout:1/336: dwrite d6/f3a [0,4194304] 0 2024-04-26T21:25:49.401 INFO:tasks.workunit.client.0.smithi084.stdout:4/94: dread d5/d10/f12 [0,4194304] 0 2024-04-26T21:25:49.401 INFO:tasks.workunit.client.1.smithi120.stdout:4/326: write d10/f2d [4629307,59366] 0 2024-04-26T21:25:49.402 INFO:tasks.workunit.client.1.smithi120.stdout:9/330: creat d0/dd/d34/f6e x:0 0 0 2024-04-26T21:25:49.404 INFO:tasks.workunit.client.1.smithi120.stdout:3/322: unlink dd/d40/f4f 0 2024-04-26T21:25:49.405 INFO:tasks.workunit.client.1.smithi120.stdout:2/417: dread d4/d1b/d2e/d50/d14/d15/f43 [0,4194304] 0 2024-04-26T21:25:49.406 INFO:tasks.workunit.client.0.smithi084.stdout:3/125: unlink d1/lb 0 2024-04-26T21:25:49.412 INFO:tasks.workunit.client.1.smithi120.stdout:0/437: mkdir d0/d3/d51/d70/d99 0 2024-04-26T21:25:49.413 INFO:tasks.workunit.client.0.smithi084.stdout:4/95: rmdir d5/d1f 0 2024-04-26T21:25:49.413 INFO:tasks.workunit.client.1.smithi120.stdout:5/414: mknod d2/dc/d1d/d1f/c84 0 2024-04-26T21:25:49.416 INFO:tasks.workunit.client.1.smithi120.stdout:8/348: dread d5/d6/d11/d52/d27/f38 [4194304,4194304] 0 2024-04-26T21:25:49.417 INFO:tasks.workunit.client.1.smithi120.stdout:1/337: creat d6/d7/d1d/d5d/d67/f77 x:0 0 0 2024-04-26T21:25:49.421 INFO:tasks.workunit.client.1.smithi120.stdout:2/418: read d4/d1b/d25/d2c/d3e/d5e/f61 [4036739,64008] 0 2024-04-26T21:25:49.423 INFO:tasks.workunit.client.0.smithi084.stdout:3/126: truncate d1/fd 151441 0 2024-04-26T21:25:49.424 INFO:tasks.workunit.client.0.smithi084.stdout:0/113: dwrite f4 [0,4194304] 0 2024-04-26T21:25:49.424 INFO:tasks.workunit.client.1.smithi120.stdout:0/438: mknod d0/df/c9a 0 2024-04-26T21:25:49.425 INFO:tasks.workunit.client.1.smithi120.stdout:0/439: stat d0/f10 0 2024-04-26T21:25:49.428 INFO:tasks.workunit.client.1.smithi120.stdout:0/440: readlink d0/d3/d51/l93 0 2024-04-26T21:25:49.429 INFO:tasks.workunit.client.0.smithi084.stdout:4/96: mkdir d5/d25 0 2024-04-26T21:25:49.433 INFO:tasks.workunit.client.1.smithi120.stdout:4/327: dwrite d10/f6c [0,4194304] 0 2024-04-26T21:25:49.433 INFO:tasks.workunit.client.0.smithi084.stdout:8/121: dwrite d4/d7/d9/fd [0,4194304] 0 2024-04-26T21:25:49.435 INFO:tasks.workunit.client.1.smithi120.stdout:7/362: dwrite d7/d19/d60/f76 [0,4194304] 0 2024-04-26T21:25:49.436 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:49 smithi120 ceph-mon[32741]: pgmap v39: 65 pgs: 65 active+clean; 890 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 17 MiB/s rd, 112 MiB/s wr, 260 op/s 2024-04-26T21:25:49.436 INFO:tasks.workunit.client.1.smithi120.stdout:9/331: creat d0/d14/d2d/d4b/f6f x:0 0 0 2024-04-26T21:25:49.437 INFO:tasks.workunit.client.0.smithi084.stdout:3/127: dread d1/d24/d27/f2b [0,4194304] 0 2024-04-26T21:25:49.438 INFO:tasks.workunit.client.0.smithi084.stdout:3/128: dread - d1/f7 zero size 2024-04-26T21:25:49.439 INFO:tasks.workunit.client.1.smithi120.stdout:7/363: write d7/d10/d12/d1f/d28/f6f [749190,128918] 0 2024-04-26T21:25:49.443 INFO:tasks.workunit.client.0.smithi084.stdout:3/129: write d1/fe [4368710,20204] 0 2024-04-26T21:25:49.443 INFO:tasks.workunit.client.1.smithi120.stdout:1/338: chown d6/d7/d1d/d5d/d67/c4a 2 1 2024-04-26T21:25:49.444 INFO:tasks.workunit.client.0.smithi084.stdout:4/97: mknod d5/d25/c26 0 2024-04-26T21:25:49.444 INFO:tasks.workunit.client.1.smithi120.stdout:6/382: truncate d4/db/d10/dd/d4e/d5d/f6f 2770867 0 2024-04-26T21:25:49.451 INFO:tasks.workunit.client.1.smithi120.stdout:1/339: chown d6/d7/d1d/d5d/d67/dd/l64 15580 1 2024-04-26T21:25:49.451 INFO:tasks.workunit.client.1.smithi120.stdout:9/332: mknod d0/dd/d3a/d5c/c70 0 2024-04-26T21:25:49.454 INFO:tasks.workunit.client.0.smithi084.stdout:0/114: dwrite de/f14 [0,4194304] 0 2024-04-26T21:25:49.454 INFO:tasks.workunit.client.1.smithi120.stdout:9/333: write d0/d6/f39 [649334,122057] 0 2024-04-26T21:25:49.455 INFO:tasks.workunit.client.0.smithi084.stdout:5/101: sync 2024-04-26T21:25:49.455 INFO:tasks.workunit.client.0.smithi084.stdout:9/84: sync 2024-04-26T21:25:49.456 INFO:tasks.workunit.client.1.smithi120.stdout:7/364: mknod d7/d10/d12/d1f/d28/d4c/c7e 0 2024-04-26T21:25:49.461 INFO:tasks.workunit.client.0.smithi084.stdout:8/122: symlink d4/d6/db/d1e/l1f 0 2024-04-26T21:25:49.461 INFO:tasks.workunit.client.0.smithi084.stdout:3/130: symlink d1/l2d 0 2024-04-26T21:25:49.461 INFO:tasks.workunit.client.0.smithi084.stdout:7/121: sync 2024-04-26T21:25:49.462 INFO:tasks.workunit.client.1.smithi120.stdout:8/349: rename d5/d18 to d5/d6/d11/d52/d70 0 2024-04-26T21:25:49.462 INFO:tasks.workunit.client.0.smithi084.stdout:4/98: creat d5/d7/d17/f27 x:0 0 0 2024-04-26T21:25:49.463 INFO:tasks.workunit.client.0.smithi084.stdout:7/122: write d6/dc/f27 [559847,93808] 0 2024-04-26T21:25:49.464 INFO:tasks.workunit.client.0.smithi084.stdout:4/99: chown d5/d10/d15 1644 1 2024-04-26T21:25:49.465 INFO:tasks.workunit.client.0.smithi084.stdout:0/115: mknod de/c23 0 2024-04-26T21:25:49.468 INFO:tasks.workunit.client.0.smithi084.stdout:4/100: truncate d5/fe 4969647 0 2024-04-26T21:25:49.470 INFO:tasks.workunit.client.1.smithi120.stdout:2/419: creat d4/d1b/f89 x:0 0 0 2024-04-26T21:25:49.471 INFO:tasks.workunit.client.0.smithi084.stdout:0/116: fdatasync de/ff 0 2024-04-26T21:25:49.474 INFO:tasks.workunit.client.1.smithi120.stdout:8/350: chown d5/f15 0 1 2024-04-26T21:25:49.475 INFO:tasks.workunit.client.1.smithi120.stdout:7/365: mknod d7/d10/d12/d1f/d28/d4c/d6c/c7f 0 2024-04-26T21:25:49.476 INFO:tasks.workunit.client.1.smithi120.stdout:0/441: dwrite d0/d3/dc/f1c [0,4194304] 0 2024-04-26T21:25:49.478 INFO:tasks.workunit.client.0.smithi084.stdout:3/131: truncate d1/ff 2335210 0 2024-04-26T21:25:49.479 INFO:tasks.workunit.client.0.smithi084.stdout:3/132: stat d1/d10/f18 0 2024-04-26T21:25:49.481 INFO:tasks.workunit.client.1.smithi120.stdout:5/415: dwrite d2/d1b/f35 [0,4194304] 0 2024-04-26T21:25:49.481 INFO:tasks.workunit.client.0.smithi084.stdout:3/133: stat d1/f3 0 2024-04-26T21:25:49.484 INFO:tasks.workunit.client.0.smithi084.stdout:8/123: rename d4/d7/d9/c17 to d4/d7/c20 0 2024-04-26T21:25:49.484 INFO:tasks.workunit.client.0.smithi084.stdout:3/134: readlink d1/d10/l12 0 2024-04-26T21:25:49.485 INFO:tasks.workunit.client.0.smithi084.stdout:5/102: dread d0/f2 [0,4194304] 0 2024-04-26T21:25:49.487 INFO:tasks.workunit.client.1.smithi120.stdout:3/323: dwrite f6 [0,4194304] 0 2024-04-26T21:25:49.487 INFO:tasks.workunit.client.1.smithi120.stdout:5/416: read d2/d1b/f26 [605881,120029] 0 2024-04-26T21:25:49.491 INFO:tasks.workunit.client.0.smithi084.stdout:0/117: creat de/d20/f24 x:0 0 0 2024-04-26T21:25:49.492 INFO:tasks.workunit.client.0.smithi084.stdout:8/124: creat d4/d7/d9/f21 x:0 0 0 2024-04-26T21:25:49.494 INFO:tasks.workunit.client.1.smithi120.stdout:5/417: write d2/f13 [64206,56457] 0 2024-04-26T21:25:49.494 INFO:tasks.workunit.client.1.smithi120.stdout:4/328: rename d10/d12/l68 to d10/l70 0 2024-04-26T21:25:49.495 INFO:tasks.workunit.client.0.smithi084.stdout:4/101: getdents d5/d25 0 2024-04-26T21:25:49.495 INFO:tasks.workunit.client.0.smithi084.stdout:5/103: dread - d0/dc/f14 zero size 2024-04-26T21:25:49.495 INFO:tasks.workunit.client.1.smithi120.stdout:7/366: rmdir d7 39 2024-04-26T21:25:49.497 INFO:tasks.workunit.client.1.smithi120.stdout:2/420: mknod d4/d1b/d2e/d50/c8a 0 2024-04-26T21:25:49.501 INFO:tasks.workunit.client.0.smithi084.stdout:0/118: symlink de/l25 0 2024-04-26T21:25:49.502 INFO:tasks.workunit.client.1.smithi120.stdout:3/324: mknod dd/de/d18/d2c/c6a 0 2024-04-26T21:25:49.505 INFO:tasks.workunit.client.0.smithi084.stdout:7/123: rename d6/d1c/f1d to d6/f2a 0 2024-04-26T21:25:49.507 INFO:tasks.workunit.client.1.smithi120.stdout:0/442: mkdir d0/d3/dc/dd/d9b 0 2024-04-26T21:25:49.508 INFO:tasks.workunit.client.1.smithi120.stdout:4/329: read d10/d12/f2c [179959,77218] 0 2024-04-26T21:25:49.509 INFO:tasks.workunit.client.0.smithi084.stdout:8/125: mkdir d4/d6/db/d1e/d22 0 2024-04-26T21:25:49.511 INFO:tasks.workunit.client.1.smithi120.stdout:6/383: dwrite d4/f1f [0,4194304] 0 2024-04-26T21:25:49.512 INFO:tasks.workunit.client.1.smithi120.stdout:8/351: rename d5/d6/d11/d32/d3b/f4d to d5/d6/d34/d42/f71 0 2024-04-26T21:25:49.513 INFO:tasks.workunit.client.1.smithi120.stdout:3/325: read - dd/de/d18/d37/f4e zero size 2024-04-26T21:25:49.514 INFO:tasks.workunit.client.1.smithi120.stdout:1/340: dwrite d6/d7/d2d/d48/f66 [0,4194304] 0 2024-04-26T21:25:49.514 INFO:tasks.workunit.client.1.smithi120.stdout:5/418: chown d2/dc/d1d/d1f/d36/d44/d6c/c32 519322 1 2024-04-26T21:25:49.515 INFO:tasks.workunit.client.0.smithi084.stdout:8/126: write d4/f13 [1353974,72944] 0 2024-04-26T21:25:49.516 INFO:tasks.workunit.client.0.smithi084.stdout:7/124: write d6/d9/fa [1081814,23616] 0 2024-04-26T21:25:49.519 INFO:tasks.workunit.client.1.smithi120.stdout:3/326: write dd/de/f2f [1692055,7896] 0 2024-04-26T21:25:49.522 INFO:tasks.workunit.client.0.smithi084.stdout:5/104: creat d0/d17/f18 x:0 0 0 2024-04-26T21:25:49.525 INFO:tasks.workunit.client.0.smithi084.stdout:3/135: write d1/d24/d27/f2b [953533,25120] 0 2024-04-26T21:25:49.525 INFO:tasks.workunit.client.1.smithi120.stdout:7/367: rename d7/f22 to d7/d10/d12/d1f/d28/d4c/d6b/d7b/f80 0 2024-04-26T21:25:49.528 INFO:tasks.workunit.client.1.smithi120.stdout:8/352: symlink d5/d6/d34/d37/l72 0 2024-04-26T21:25:49.530 INFO:tasks.workunit.client.1.smithi120.stdout:4/330: mkdir d10/d6b/d71 0 2024-04-26T21:25:49.531 INFO:tasks.workunit.client.1.smithi120.stdout:8/353: stat f4 0 2024-04-26T21:25:49.531 INFO:tasks.workunit.client.0.smithi084.stdout:5/105: chown d0/dc/f14 703639293 1 2024-04-26T21:25:49.535 INFO:tasks.workunit.client.1.smithi120.stdout:2/421: mknod d4/d1b/d2e/d50/d14/d15/d6c/c8b 0 2024-04-26T21:25:49.535 INFO:tasks.workunit.client.0.smithi084.stdout:8/127: rename d4/d6/db/l1d to d4/d6/db/l23 0 2024-04-26T21:25:49.536 INFO:tasks.workunit.client.0.smithi084.stdout:4/102: dwrite d5/d7/d17/f27 [0,4194304] 0 2024-04-26T21:25:49.537 INFO:tasks.workunit.client.1.smithi120.stdout:5/419: rename d2/dc/d1d/d21/d81 to d2/dc/d1d/d21/d66/d85 0 2024-04-26T21:25:49.539 INFO:tasks.workunit.client.1.smithi120.stdout:7/368: readlink d7/d10/d12/d2f/l45 0 2024-04-26T21:25:49.540 INFO:tasks.workunit.client.1.smithi120.stdout:4/331: mkdir d10/d65/d72 0 2024-04-26T21:25:49.542 INFO:tasks.workunit.client.1.smithi120.stdout:6/384: dread d4/db/d10/dd/d4e/f75 [0,4194304] 0 2024-04-26T21:25:49.543 INFO:tasks.workunit.client.1.smithi120.stdout:1/341: dread d6/d7/d1d/d5d/d67/dd/d56/f57 [0,4194304] 0 2024-04-26T21:25:49.543 INFO:tasks.workunit.client.1.smithi120.stdout:8/354: creat d5/d6/d11/d32/d3b/f73 x:0 0 0 2024-04-26T21:25:49.544 INFO:tasks.workunit.client.1.smithi120.stdout:3/327: dread fa [0,4194304] 0 2024-04-26T21:25:49.546 INFO:tasks.workunit.client.0.smithi084.stdout:0/119: dwrite de/f1f [0,4194304] 0 2024-04-26T21:25:49.546 INFO:tasks.workunit.client.0.smithi084.stdout:8/128: rmdir d4/d6/db 39 2024-04-26T21:25:49.550 INFO:tasks.workunit.client.0.smithi084.stdout:4/103: write d5/d10/f13 [58820,52891] 0 2024-04-26T21:25:49.550 INFO:tasks.workunit.client.1.smithi120.stdout:4/332: mkdir d10/d28/d73 0 2024-04-26T21:25:49.551 INFO:tasks.workunit.client.1.smithi120.stdout:0/443: write d0/d3/d13/f60 [1758026,92849] 0 2024-04-26T21:25:49.552 INFO:tasks.workunit.client.1.smithi120.stdout:3/328: creat dd/d2a/d4a/f6b x:0 0 0 2024-04-26T21:25:49.553 INFO:tasks.workunit.client.0.smithi084.stdout:0/120: mknod de/d1c/c26 0 2024-04-26T21:25:49.553 INFO:tasks.workunit.client.1.smithi120.stdout:1/342: symlink d6/d7/d1d/d5d/d67/l78 0 2024-04-26T21:25:49.556 INFO:tasks.workunit.client.0.smithi084.stdout:4/104: write d5/f23 [664061,55531] 0 2024-04-26T21:25:49.557 INFO:tasks.workunit.client.1.smithi120.stdout:8/355: rename d5/d6/d34/d42/d4a/f5e to d5/d6/d11/d52/d70/f74 0 2024-04-26T21:25:49.558 INFO:tasks.workunit.client.1.smithi120.stdout:6/385: symlink d4/l7b 0 2024-04-26T21:25:49.559 INFO:tasks.workunit.client.0.smithi084.stdout:8/129: creat d4/d6/f24 x:0 0 0 2024-04-26T21:25:49.560 INFO:tasks.workunit.client.0.smithi084.stdout:5/106: truncate d0/fe 807086 0 2024-04-26T21:25:49.561 INFO:tasks.workunit.client.0.smithi084.stdout:7/125: dwrite d6/f17 [0,4194304] 0 2024-04-26T21:25:49.562 INFO:tasks.workunit.client.1.smithi120.stdout:4/333: symlink d10/d65/d72/l74 0 2024-04-26T21:25:49.563 INFO:tasks.workunit.client.0.smithi084.stdout:0/121: mknod de/d20/c27 0 2024-04-26T21:25:49.565 INFO:tasks.workunit.client.1.smithi120.stdout:7/369: dread d7/fd [0,4194304] 0 2024-04-26T21:25:49.566 INFO:tasks.workunit.client.0.smithi084.stdout:8/130: write d4/d7/d15/f18 [2214371,11514] 0 2024-04-26T21:25:49.567 INFO:tasks.workunit.client.0.smithi084.stdout:8/131: stat d4 0 2024-04-26T21:25:49.569 INFO:tasks.workunit.client.1.smithi120.stdout:0/444: unlink d0/d3/l5f 0 2024-04-26T21:25:49.571 INFO:tasks.workunit.client.0.smithi084.stdout:7/126: mknod d6/d26/c2b 0 2024-04-26T21:25:49.572 INFO:tasks.workunit.client.0.smithi084.stdout:0/122: creat de/d20/f28 x:0 0 0 2024-04-26T21:25:49.572 INFO:tasks.workunit.client.0.smithi084.stdout:3/136: dwrite d1/f7 [0,4194304] 0 2024-04-26T21:25:49.577 INFO:tasks.workunit.client.1.smithi120.stdout:8/356: fsync d5/f15 0 2024-04-26T21:25:49.577 INFO:tasks.workunit.client.0.smithi084.stdout:8/132: write d4/f5 [1065799,130039] 0 2024-04-26T21:25:49.579 INFO:tasks.workunit.client.0.smithi084.stdout:3/137: chown d1/fe 2078177 1 2024-04-26T21:25:49.585 INFO:tasks.workunit.client.0.smithi084.stdout:7/127: creat d6/d9/d12/f2c x:0 0 0 2024-04-26T21:25:49.585 INFO:tasks.workunit.client.0.smithi084.stdout:3/138: unlink d1/f7 0 2024-04-26T21:25:49.588 INFO:tasks.workunit.client.0.smithi084.stdout:0/123: link de/f12 de/d20/f29 0 2024-04-26T21:25:49.590 INFO:tasks.workunit.client.0.smithi084.stdout:3/139: fdatasync d1/f3 0 2024-04-26T21:25:49.590 INFO:tasks.workunit.client.0.smithi084.stdout:8/133: chown d4/d6/f1a 30 1 2024-04-26T21:25:49.590 INFO:tasks.workunit.client.1.smithi120.stdout:6/386: creat d4/db/d10/dd/d4e/d60/f7c x:0 0 0 2024-04-26T21:25:49.591 INFO:tasks.workunit.client.0.smithi084.stdout:7/128: creat d6/d9/f2d x:0 0 0 2024-04-26T21:25:49.592 INFO:tasks.workunit.client.1.smithi120.stdout:5/420: truncate d2/dc/d1d/d1f/d36/d44/d6c/f50 2600236 0 2024-04-26T21:25:49.596 INFO:tasks.workunit.client.0.smithi084.stdout:4/105: dwrite d5/f23 [0,4194304] 0 2024-04-26T21:25:49.598 INFO:tasks.workunit.client.0.smithi084.stdout:3/140: creat d1/d10/f2e x:0 0 0 2024-04-26T21:25:49.600 INFO:tasks.workunit.client.0.smithi084.stdout:8/134: rename d4 to d4/d7/d9/d25 22 2024-04-26T21:25:49.600 INFO:tasks.workunit.client.0.smithi084.stdout:2/224: sync 2024-04-26T21:25:49.601 INFO:tasks.workunit.client.0.smithi084.stdout:3/141: chown d1/d10/f18 1213 1 2024-04-26T21:25:49.602 INFO:tasks.workunit.client.0.smithi084.stdout:6/106: sync 2024-04-26T21:25:49.602 INFO:tasks.workunit.client.0.smithi084.stdout:1/110: sync 2024-04-26T21:25:49.604 INFO:tasks.workunit.client.0.smithi084.stdout:4/106: write d5/d10/f12 [3641473,81997] 0 2024-04-26T21:25:49.605 INFO:tasks.workunit.client.1.smithi120.stdout:1/343: creat d6/f79 x:0 0 0 2024-04-26T21:25:49.605 INFO:tasks.workunit.client.1.smithi120.stdout:7/370: creat d7/d10/d12/d2f/d43/f81 x:0 0 0 2024-04-26T21:25:49.605 INFO:tasks.workunit.client.1.smithi120.stdout:0/445: symlink d0/l9c 0 2024-04-26T21:25:49.605 INFO:tasks.workunit.client.0.smithi084.stdout:1/111: stat d2/l8 0 2024-04-26T21:25:49.607 INFO:tasks.workunit.client.1.smithi120.stdout:3/329: rename dd/de/d18/d36 to dd/de/df/d12/d6c 0 2024-04-26T21:25:49.608 INFO:tasks.workunit.client.0.smithi084.stdout:2/225: chown d6/d7/d3d/d15/d1f/d39/fe 2 1 2024-04-26T21:25:49.608 INFO:tasks.workunit.client.0.smithi084.stdout:6/107: chown d3/de/d15/f24 0 1 2024-04-26T21:25:49.609 INFO:tasks.workunit.client.1.smithi120.stdout:8/357: mkdir d5/d6/d75 0 2024-04-26T21:25:49.613 INFO:tasks.workunit.client.1.smithi120.stdout:3/330: chown dd/de/d18/d2c/c6a 1228299 1 2024-04-26T21:25:49.614 INFO:tasks.workunit.client.0.smithi084.stdout:8/135: mknod d4/d6/c26 0 2024-04-26T21:25:49.614 INFO:tasks.workunit.client.0.smithi084.stdout:0/124: dread f4 [0,4194304] 0 2024-04-26T21:25:49.616 INFO:tasks.workunit.client.1.smithi120.stdout:6/387: dwrite d4/db/d10/d1a/d2b/d57/d67/f4a [0,4194304] 0 2024-04-26T21:25:49.616 INFO:tasks.workunit.client.1.smithi120.stdout:3/331: dread - dd/d40/f50 zero size 2024-04-26T21:25:49.618 INFO:tasks.workunit.client.1.smithi120.stdout:6/388: write d4/d3d/f6e [391955,67416] 0 2024-04-26T21:25:49.620 INFO:tasks.workunit.client.1.smithi120.stdout:7/371: rmdir d7/d10/d12/d1f 39 2024-04-26T21:25:49.620 INFO:tasks.workunit.client.0.smithi084.stdout:4/107: mknod d5/d7/c28 0 2024-04-26T21:25:49.621 INFO:tasks.workunit.client.0.smithi084.stdout:1/112: unlink d2/d9/d15/f20 0 2024-04-26T21:25:49.622 INFO:tasks.workunit.client.1.smithi120.stdout:6/389: chown d4/db/d10/dd/f36 283784487 1 2024-04-26T21:25:49.622 INFO:tasks.workunit.client.0.smithi084.stdout:6/108: rmdir d3/de/d15/d23 39 2024-04-26T21:25:49.624 INFO:tasks.workunit.client.1.smithi120.stdout:0/446: creat d0/df/f9d x:0 0 0 2024-04-26T21:25:49.625 INFO:tasks.workunit.client.0.smithi084.stdout:6/109: stat d3/de/d1a/l19 0 2024-04-26T21:25:49.627 INFO:tasks.workunit.client.1.smithi120.stdout:4/334: truncate d10/d12/f57 209808 0 2024-04-26T21:25:49.627 INFO:tasks.workunit.client.0.smithi084.stdout:0/125: rmdir de/d20 39 2024-04-26T21:25:49.629 INFO:tasks.workunit.client.1.smithi120.stdout:0/447: dread - d0/d3/dc/dd/d1b/f8a zero size 2024-04-26T21:25:49.630 INFO:tasks.workunit.client.0.smithi084.stdout:4/108: chown d5/d10/d15/d21/l22 65 1 2024-04-26T21:25:49.631 INFO:tasks.workunit.client.0.smithi084.stdout:5/107: dwrite d0/fa [0,4194304] 0 2024-04-26T21:25:49.634 INFO:tasks.workunit.client.0.smithi084.stdout:4/109: write d5/d10/f12 [2056409,56867] 0 2024-04-26T21:25:49.635 INFO:tasks.workunit.client.1.smithi120.stdout:7/372: unlink d7/d19/f35 0 2024-04-26T21:25:49.636 INFO:tasks.workunit.client.1.smithi120.stdout:8/358: dwrite d5/d6/d11/d32/d3b/f56 [0,4194304] 0 2024-04-26T21:25:49.638 INFO:tasks.workunit.client.0.smithi084.stdout:8/136: dread d4/d7/d15/f18 [0,4194304] 0 2024-04-26T21:25:49.638 INFO:tasks.workunit.client.1.smithi120.stdout:1/344: creat d6/d7/d1d/d5d/d67/dd/d54/f7a x:0 0 0 2024-04-26T21:25:49.640 INFO:tasks.workunit.client.0.smithi084.stdout:3/142: rename d1/d10 to d1/d2c/d2f 0 2024-04-26T21:25:49.641 INFO:tasks.workunit.client.1.smithi120.stdout:3/332: fdatasync dd/de/df/d1e/d28/f2d 0 2024-04-26T21:25:49.642 INFO:tasks.workunit.client.0.smithi084.stdout:6/110: write d3/d18/f20 [4283207,41345] 0 2024-04-26T21:25:49.642 INFO:tasks.workunit.client.0.smithi084.stdout:0/126: rmdir de/d1c 39 2024-04-26T21:25:49.644 INFO:tasks.workunit.client.0.smithi084.stdout:5/108: rmdir d0/dc 39 2024-04-26T21:25:49.645 INFO:tasks.workunit.client.0.smithi084.stdout:6/111: fsync d3/f6 0 2024-04-26T21:25:49.646 INFO:tasks.workunit.client.1.smithi120.stdout:6/390: symlink d4/db/d10/dd/d4e/d76/l7d 0 2024-04-26T21:25:49.649 INFO:tasks.workunit.client.0.smithi084.stdout:8/137: creat d4/d7/d9/f27 x:0 0 0 2024-04-26T21:25:49.649 INFO:tasks.workunit.client.1.smithi120.stdout:7/373: symlink d7/d10/l82 0 2024-04-26T21:25:49.650 INFO:tasks.workunit.client.1.smithi120.stdout:3/333: read dd/de/d18/d24/f3a [399737,128954] 0 2024-04-26T21:25:49.651 INFO:tasks.workunit.client.0.smithi084.stdout:8/138: dread - d4/d6/f24 zero size 2024-04-26T21:25:49.651 INFO:tasks.workunit.client.0.smithi084.stdout:3/143: creat d1/d24/d27/f30 x:0 0 0 2024-04-26T21:25:49.652 INFO:tasks.workunit.client.0.smithi084.stdout:0/127: write f4 [920486,9627] 0 2024-04-26T21:25:49.659 INFO:tasks.workunit.client.0.smithi084.stdout:4/110: mkdir d5/d10/d15/d21/d29 0 2024-04-26T21:25:49.661 INFO:tasks.workunit.client.1.smithi120.stdout:1/345: symlink d6/d7/d1d/d5d/d67/dd/l7b 0 2024-04-26T21:25:49.662 INFO:tasks.workunit.client.0.smithi084.stdout:2/226: rename d6/d7/c2e to d6/d1b/c52 0 2024-04-26T21:25:49.662 INFO:tasks.workunit.client.0.smithi084.stdout:1/113: getdents d2/d9/d15 0 2024-04-26T21:25:49.664 INFO:tasks.workunit.client.0.smithi084.stdout:8/139: mknod d4/d7/d15/c28 0 2024-04-26T21:25:49.665 INFO:tasks.workunit.client.0.smithi084.stdout:3/144: mkdir d1/d2c/d2f/d31 0 2024-04-26T21:25:49.665 INFO:tasks.workunit.client.0.smithi084.stdout:2/227: write f0 [4698602,4134] 0 2024-04-26T21:25:49.666 INFO:tasks.workunit.client.0.smithi084.stdout:1/114: write d2/d9/f16 [401812,60906] 0 2024-04-26T21:25:49.668 INFO:tasks.workunit.client.0.smithi084.stdout:3/145: chown d1/d24/d27 2 1 2024-04-26T21:25:49.668 INFO:tasks.workunit.client.0.smithi084.stdout:5/109: link d0/fd d0/dc/f19 0 2024-04-26T21:25:49.671 INFO:tasks.workunit.client.1.smithi120.stdout:5/421: truncate d2/dc/d1d/d21/d66/f28 712209 0 2024-04-26T21:25:49.671 INFO:tasks.workunit.client.1.smithi120.stdout:0/448: creat d0/d3/dc/dd/d1b/d24/d7d/f9e x:0 0 0 2024-04-26T21:25:49.673 INFO:tasks.workunit.client.0.smithi084.stdout:4/111: symlink d5/d10/d15/d21/l2a 0 2024-04-26T21:25:49.674 INFO:tasks.workunit.client.0.smithi084.stdout:2/228: read - d6/d7/d3d/d15/d1f/d39/f48 zero size 2024-04-26T21:25:49.676 INFO:tasks.workunit.client.0.smithi084.stdout:1/115: read d2/f10 [652931,51603] 0 2024-04-26T21:25:49.677 INFO:tasks.workunit.client.1.smithi120.stdout:3/334: unlink dd/de/df/d12/d48/f3d 0 2024-04-26T21:25:49.677 INFO:tasks.workunit.client.1.smithi120.stdout:1/346: rmdir d6/d7/d1b 39 2024-04-26T21:25:49.680 INFO:tasks.workunit.client.0.smithi084.stdout:3/146: dread - d1/d24/d27/f30 zero size 2024-04-26T21:25:49.681 INFO:tasks.workunit.client.1.smithi120.stdout:6/391: getdents d4/db/d10/dd/d43/d58 0 2024-04-26T21:25:49.683 INFO:tasks.workunit.client.0.smithi084.stdout:2/229: creat d6/f53 x:0 0 0 2024-04-26T21:25:49.684 INFO:tasks.workunit.client.0.smithi084.stdout:5/110: truncate d0/dc/f14 100762 0 2024-04-26T21:25:49.686 INFO:tasks.workunit.client.1.smithi120.stdout:5/422: creat d2/dc/d1d/d21/d77/f86 x:0 0 0 2024-04-26T21:25:49.686 INFO:tasks.workunit.client.0.smithi084.stdout:4/112: getdents d5/d25 0 2024-04-26T21:25:49.687 INFO:tasks.workunit.client.1.smithi120.stdout:0/449: mkdir d0/d3/dc/dd/d1b/d24/d7d/d9f 0 2024-04-26T21:25:49.688 INFO:tasks.workunit.client.0.smithi084.stdout:3/147: creat d1/d24/d27/f32 x:0 0 0 2024-04-26T21:25:49.689 INFO:tasks.workunit.client.1.smithi120.stdout:3/335: mkdir dd/de/df/d12/d48/d6d 0 2024-04-26T21:25:49.692 INFO:tasks.workunit.client.0.smithi084.stdout:0/128: dwrite de/f10 [0,4194304] 0 2024-04-26T21:25:49.693 INFO:tasks.workunit.client.1.smithi120.stdout:3/336: dread - dd/de/d18/d37/f5c zero size 2024-04-26T21:25:49.697 INFO:tasks.workunit.client.1.smithi120.stdout:7/374: rename d7/f5c to d7/d10/d12/d1a/d33/f83 0 2024-04-26T21:25:49.698 INFO:tasks.workunit.client.0.smithi084.stdout:4/113: fsync d5/d7/f16 0 2024-04-26T21:25:49.698 INFO:tasks.workunit.client.1.smithi120.stdout:8/359: write d5/d6/d11/f31 [1445812,122260] 0 2024-04-26T21:25:49.699 INFO:tasks.workunit.client.0.smithi084.stdout:3/148: symlink d1/d2c/l33 0 2024-04-26T21:25:49.701 INFO:tasks.workunit.client.1.smithi120.stdout:6/392: dwrite d4/db/f6b [0,4194304] 0 2024-04-26T21:25:49.702 INFO:tasks.workunit.client.1.smithi120.stdout:4/335: truncate d10/f2d 1918723 0 2024-04-26T21:25:49.706 INFO:tasks.workunit.client.0.smithi084.stdout:6/112: dread d3/f10 [0,4194304] 0 2024-04-26T21:25:49.706 INFO:tasks.workunit.client.0.smithi084.stdout:8/140: dread d4/d7/d15/f18 [0,4194304] 0 2024-04-26T21:25:49.708 INFO:tasks.workunit.client.1.smithi120.stdout:6/393: dread d4/db/f1b [0,4194304] 0 2024-04-26T21:25:49.711 INFO:tasks.workunit.client.0.smithi084.stdout:3/149: creat d1/d2c/d2f/f34 x:0 0 0 2024-04-26T21:25:49.712 INFO:tasks.workunit.client.0.smithi084.stdout:2/230: dread d6/d7/f3f [0,4194304] 0 2024-04-26T21:25:49.712 INFO:tasks.workunit.client.0.smithi084.stdout:1/116: dread d2/d9/d17/f21 [0,4194304] 0 2024-04-26T21:25:49.713 INFO:tasks.workunit.client.1.smithi120.stdout:6/394: chown d4/db/d10/dd/d4e/d76 0 1 2024-04-26T21:25:49.714 INFO:tasks.workunit.client.0.smithi084.stdout:5/111: getdents d0 0 2024-04-26T21:25:49.714 INFO:tasks.workunit.client.0.smithi084.stdout:3/150: dread - d1/d2c/d2f/f20 zero size 2024-04-26T21:25:49.715 INFO:tasks.workunit.client.1.smithi120.stdout:8/360: mknod d5/d6/d11/d52/d70/c76 0 2024-04-26T21:25:49.715 INFO:tasks.workunit.client.1.smithi120.stdout:4/336: creat d10/d28/f75 x:0 0 0 2024-04-26T21:25:49.716 INFO:tasks.workunit.client.0.smithi084.stdout:3/151: fdatasync d1/f23 0 2024-04-26T21:25:49.716 INFO:tasks.workunit.client.1.smithi120.stdout:4/337: stat d10/f6c 0 2024-04-26T21:25:49.717 INFO:tasks.workunit.client.1.smithi120.stdout:1/347: getdents d6/d14/d6f 0 2024-04-26T21:25:49.718 INFO:tasks.workunit.client.0.smithi084.stdout:5/112: write d0/fa [2491233,21161] 0 2024-04-26T21:25:49.720 INFO:tasks.workunit.client.0.smithi084.stdout:4/114: rename d5/d10/f12 to d5/f2b 0 2024-04-26T21:25:49.721 INFO:tasks.workunit.client.1.smithi120.stdout:5/423: rename d2/d48/d63/f7c to d2/d1b/d22/f87 0 2024-04-26T21:25:49.722 INFO:tasks.workunit.client.1.smithi120.stdout:8/361: truncate d5/d6/d11/d52/f6a 744952 0 2024-04-26T21:25:49.726 INFO:tasks.workunit.client.1.smithi120.stdout:4/338: unlink d10/d12/f43 0 2024-04-26T21:25:49.728 INFO:tasks.workunit.client.1.smithi120.stdout:1/348: creat d6/d7/d1d/d2c/f7c x:0 0 0 2024-04-26T21:25:49.729 INFO:tasks.workunit.client.1.smithi120.stdout:1/349: readlink d6/d7/d1d/d5d/d67/l78 0 2024-04-26T21:25:49.730 INFO:tasks.workunit.client.1.smithi120.stdout:6/395: creat d4/db/d25/d6d/d73/f7e x:0 0 0 2024-04-26T21:25:49.733 INFO:tasks.workunit.client.1.smithi120.stdout:1/350: symlink d6/d7/d2d/d48/l7d 0 2024-04-26T21:25:49.737 INFO:tasks.workunit.client.1.smithi120.stdout:6/396: creat d4/db/d10/dd/d4e/d5d/f7f x:0 0 0 2024-04-26T21:25:49.739 INFO:tasks.workunit.client.1.smithi120.stdout:8/362: link d5/d6/l23 d5/d6/l77 0 2024-04-26T21:25:49.744 INFO:tasks.workunit.client.1.smithi120.stdout:3/337: dread dd/de/d18/d24/d43/f47 [0,4194304] 0 2024-04-26T21:25:49.747 INFO:tasks.workunit.client.1.smithi120.stdout:5/424: dwrite d2/d1b/d22/d6b/f72 [0,4194304] 0 2024-04-26T21:25:49.748 INFO:tasks.workunit.client.0.smithi084.stdout:3/152: creat d1/d2c/f35 x:0 0 0 2024-04-26T21:25:49.749 INFO:tasks.workunit.client.0.smithi084.stdout:5/113: fdatasync d0/f11 0 2024-04-26T21:25:49.750 INFO:tasks.workunit.client.0.smithi084.stdout:3/153: dread - d1/f1d zero size 2024-04-26T21:25:49.750 INFO:tasks.workunit.client.0.smithi084.stdout:1/117: creat d2/f22 x:0 0 0 2024-04-26T21:25:49.754 INFO:tasks.workunit.client.1.smithi120.stdout:1/351: truncate d6/d7/d1d/d5d/d67/fb 4966155 0 2024-04-26T21:25:49.754 INFO:tasks.workunit.client.1.smithi120.stdout:8/363: chown d5/d6/d11/d32/f45 1698 1 2024-04-26T21:25:49.754 INFO:tasks.workunit.client.0.smithi084.stdout:2/231: creat d6/d7/d3d/f54 x:0 0 0 2024-04-26T21:25:49.755 INFO:tasks.workunit.client.0.smithi084.stdout:0/129: rename fd to de/d1c/f2a 0 2024-04-26T21:25:49.755 INFO:tasks.workunit.client.0.smithi084.stdout:1/118: read d2/d9/f11 [3029331,93651] 0 2024-04-26T21:25:49.755 INFO:tasks.workunit.client.1.smithi120.stdout:4/339: dwrite d10/d12/f67 [0,4194304] 0 2024-04-26T21:25:49.755 INFO:tasks.workunit.client.0.smithi084.stdout:5/114: creat d0/dc/f1a x:0 0 0 2024-04-26T21:25:49.757 INFO:tasks.workunit.client.1.smithi120.stdout:6/397: symlink d4/db/d10/d1a/d2b/l80 0 2024-04-26T21:25:49.757 INFO:tasks.workunit.client.1.smithi120.stdout:0/450: truncate d0/f35 536754 0 2024-04-26T21:25:49.758 INFO:tasks.workunit.client.1.smithi120.stdout:8/364: write d5/d6/d34/d37/f64 [894467,25059] 0 2024-04-26T21:25:49.758 INFO:tasks.workunit.client.0.smithi084.stdout:5/115: chown d0/l10 2337 1 2024-04-26T21:25:49.758 INFO:tasks.workunit.client.0.smithi084.stdout:4/115: rename d5/d10/d15/d21/l2a to d5/d10/d15/l2c 0 2024-04-26T21:25:49.759 INFO:tasks.workunit.client.1.smithi120.stdout:4/340: chown d10/d12 42 1 2024-04-26T21:25:49.760 INFO:tasks.workunit.client.1.smithi120.stdout:3/338: rmdir dd/d40 39 2024-04-26T21:25:49.764 INFO:tasks.workunit.client.1.smithi120.stdout:0/451: write d0/d3/dc/d12/d4a/f68 [688352,16120] 0 2024-04-26T21:25:49.765 INFO:tasks.workunit.client.0.smithi084.stdout:5/116: rename d0/l9 to d0/d17/l1b 0 2024-04-26T21:25:49.766 INFO:tasks.workunit.client.0.smithi084.stdout:4/116: read d5/fe [3698093,12289] 0 2024-04-26T21:25:49.766 INFO:tasks.workunit.client.1.smithi120.stdout:5/425: mknod d2/dc/d1d/d21/d66/d85/c88 0 2024-04-26T21:25:49.773 INFO:tasks.workunit.client.0.smithi084.stdout:2/232: dread d6/d7/d3d/f25 [0,4194304] 0 2024-04-26T21:25:49.773 INFO:tasks.workunit.client.1.smithi120.stdout:4/341: mknod d10/d65/d72/c76 0 2024-04-26T21:25:49.776 INFO:tasks.workunit.client.1.smithi120.stdout:3/339: dread dd/de/d18/f3e [0,4194304] 0 2024-04-26T21:25:49.778 INFO:tasks.workunit.client.0.smithi084.stdout:2/233: dread - d6/d7/d3d/d15/d1f/d39/d20/d45/f51 zero size 2024-04-26T21:25:49.780 INFO:tasks.workunit.client.0.smithi084.stdout:1/119: dwrite d2/d9/d15/f1f [0,4194304] 0 2024-04-26T21:25:49.781 INFO:tasks.workunit.client.0.smithi084.stdout:0/130: write de/d20/f29 [186657,36283] 0 2024-04-26T21:25:49.781 INFO:tasks.workunit.client.1.smithi120.stdout:3/340: fdatasync dd/de/df/d12/d6c/f39 0 2024-04-26T21:25:49.782 INFO:tasks.workunit.client.1.smithi120.stdout:5/426: rename d2/d1b/d22 to d2/d1b/d89 0 2024-04-26T21:25:49.783 INFO:tasks.workunit.client.1.smithi120.stdout:6/398: dwrite d4/db/d10/dd/f74 [0,4194304] 0 2024-04-26T21:25:49.784 INFO:tasks.workunit.client.1.smithi120.stdout:3/341: stat dd/de/d18/f3e 0 2024-04-26T21:25:49.784 INFO:tasks.workunit.client.0.smithi084.stdout:1/120: rename d2/d9 to d2/d9/d23 22 2024-04-26T21:25:49.786 INFO:tasks.workunit.client.0.smithi084.stdout:5/117: read d0/dc/f14 [55537,14646] 0 2024-04-26T21:25:49.787 INFO:tasks.workunit.client.1.smithi120.stdout:6/399: chown d4/db/d10/dd/d28 1 1 2024-04-26T21:25:49.787 INFO:tasks.workunit.client.0.smithi084.stdout:0/131: mkdir de/d2b 0 2024-04-26T21:25:49.788 INFO:tasks.workunit.client.0.smithi084.stdout:1/121: fsync d2/fb 0 2024-04-26T21:25:49.790 INFO:tasks.workunit.client.0.smithi084.stdout:5/118: chown d0/d17 7071 1 2024-04-26T21:25:49.790 INFO:tasks.workunit.client.0.smithi084.stdout:0/132: chown de/d1c/c26 3569 1 2024-04-26T21:25:49.792 INFO:tasks.workunit.client.0.smithi084.stdout:6/113: dread d3/d18/f20 [0,4194304] 0 2024-04-26T21:25:49.793 INFO:tasks.workunit.client.0.smithi084.stdout:1/122: chown d2/d9/d15/f1f 86305099 1 2024-04-26T21:25:49.799 INFO:tasks.workunit.client.1.smithi120.stdout:5/427: mkdir d2/d1b/d89/d47/d8a 0 2024-04-26T21:25:49.802 INFO:tasks.workunit.client.1.smithi120.stdout:8/365: rename d5/d6/d34/c6c to d5/d6/d11/d32/c78 0 2024-04-26T21:25:49.802 INFO:tasks.workunit.client.1.smithi120.stdout:3/342: dread - dd/d40/f50 zero size 2024-04-26T21:25:49.803 INFO:tasks.workunit.client.1.smithi120.stdout:0/452: write d0/d3/f9 [5459283,73726] 0 2024-04-26T21:25:49.804 INFO:tasks.workunit.client.1.smithi120.stdout:4/342: dwrite d10/d12/f62 [0,4194304] 0 2024-04-26T21:25:49.804 INFO:tasks.workunit.client.1.smithi120.stdout:6/400: creat d4/db/d10/dd/d4e/f81 x:0 0 0 2024-04-26T21:25:49.806 INFO:tasks.workunit.client.0.smithi084.stdout:4/117: dwrite d5/d7/f24 [0,4194304] 0 2024-04-26T21:25:49.807 INFO:tasks.workunit.client.1.smithi120.stdout:1/352: truncate d6/d7/d2d/d48/f66 3373348 0 2024-04-26T21:25:49.809 INFO:tasks.workunit.client.0.smithi084.stdout:5/119: getdents d0/d17 0 2024-04-26T21:25:49.810 INFO:tasks.workunit.client.0.smithi084.stdout:5/120: stat d0/dc/c15 0 2024-04-26T21:25:49.811 INFO:tasks.workunit.client.1.smithi120.stdout:5/428: creat d2/d30/f8b x:0 0 0 2024-04-26T21:25:49.811 INFO:tasks.workunit.client.0.smithi084.stdout:6/114: mknod d3/de/d15/d23/c27 0 2024-04-26T21:25:49.812 INFO:tasks.workunit.client.1.smithi120.stdout:6/401: chown d4/db/d10/d1a/d2b/d57/d67/f66 568768666 1 2024-04-26T21:25:49.813 INFO:tasks.workunit.client.0.smithi084.stdout:4/118: readlink d5/d10/d15/d21/l22 0 2024-04-26T21:25:49.816 INFO:tasks.workunit.client.0.smithi084.stdout:2/234: dwrite d6/d7/d3d/f25 [0,4194304] 0 2024-04-26T21:25:49.817 INFO:tasks.workunit.client.1.smithi120.stdout:8/366: rmdir d5/d6/d11/d52/d27/d4f 39 2024-04-26T21:25:49.817 INFO:tasks.workunit.client.1.smithi120.stdout:5/429: write d2/dc/d1d/d21/d66/d4d/f4e [2168610,121627] 0 2024-04-26T21:25:49.817 INFO:tasks.workunit.client.1.smithi120.stdout:1/353: write d6/d7/d1d/d5d/d67/dd/d54/f7a [862621,102780] 0 2024-04-26T21:25:49.820 INFO:tasks.workunit.client.1.smithi120.stdout:6/402: fdatasync d4/db/f1b 0 2024-04-26T21:25:49.821 INFO:tasks.workunit.client.0.smithi084.stdout:0/133: dwrite f4 [4194304,4194304] 0 2024-04-26T21:25:49.821 INFO:tasks.workunit.client.0.smithi084.stdout:5/121: write d0/f16 [880102,129296] 0 2024-04-26T21:25:49.827 INFO:tasks.workunit.client.1.smithi120.stdout:8/367: stat d5/d6/l23 0 2024-04-26T21:25:49.829 INFO:tasks.workunit.client.0.smithi084.stdout:6/115: mkdir d3/d28 0 2024-04-26T21:25:49.832 INFO:tasks.workunit.client.0.smithi084.stdout:1/123: dwrite d2/d9/d17/f21 [0,4194304] 0 2024-04-26T21:25:49.832 INFO:tasks.workunit.client.0.smithi084.stdout:2/235: fsync d6/d7/d3d/d15/d1f/d41/f4b 0 2024-04-26T21:25:49.834 INFO:tasks.workunit.client.0.smithi084.stdout:6/116: stat d3/de/d1a/l1e 0 2024-04-26T21:25:49.835 INFO:tasks.workunit.client.0.smithi084.stdout:4/119: rename d5/d10/d15/l2c to d5/d25/l2d 0 2024-04-26T21:25:49.836 INFO:tasks.workunit.client.0.smithi084.stdout:4/120: readlink l4 0 2024-04-26T21:25:49.838 INFO:tasks.workunit.client.0.smithi084.stdout:4/121: fsync d5/f23 0 2024-04-26T21:25:49.840 INFO:tasks.workunit.client.1.smithi120.stdout:4/343: dwrite d10/f6c [0,4194304] 0 2024-04-26T21:25:49.840 INFO:tasks.workunit.client.0.smithi084.stdout:1/124: unlink d2/ff 0 2024-04-26T21:25:49.843 INFO:tasks.workunit.client.0.smithi084.stdout:9/85: sync 2024-04-26T21:25:49.845 INFO:tasks.workunit.client.0.smithi084.stdout:6/117: creat d3/de/d15/d23/f29 x:0 0 0 2024-04-26T21:25:49.848 INFO:tasks.workunit.client.1.smithi120.stdout:0/453: dwrite d0/d3/dc/dd/d1b/f91 [0,4194304] 0 2024-04-26T21:25:49.850 INFO:tasks.workunit.client.1.smithi120.stdout:8/368: rmdir d5/d6/d11/d52/d27/d4f 39 2024-04-26T21:25:49.851 INFO:tasks.workunit.client.1.smithi120.stdout:1/354: write d6/d7/d1d/d5d/d67/dd/fe [8750186,65557] 0 2024-04-26T21:25:49.852 INFO:tasks.workunit.client.1.smithi120.stdout:3/343: dwrite dd/d2a/d4a/f6b [0,4194304] 0 2024-04-26T21:25:49.853 INFO:tasks.workunit.client.1.smithi120.stdout:0/454: symlink d0/df/la0 0 2024-04-26T21:25:49.854 INFO:tasks.workunit.client.1.smithi120.stdout:4/344: getdents d10/d6b/d71 0 2024-04-26T21:25:49.860 INFO:tasks.workunit.client.0.smithi084.stdout:1/125: symlink d2/d9/d15/l24 0 2024-04-26T21:25:49.861 INFO:tasks.workunit.client.1.smithi120.stdout:6/403: dread d4/db/d10/dd/d43/f63 [0,4194304] 0 2024-04-26T21:25:49.862 INFO:tasks.workunit.client.1.smithi120.stdout:1/355: write d6/d7/d1b/d55/f5b [1041545,94486] 0 2024-04-26T21:25:49.864 INFO:tasks.workunit.client.0.smithi084.stdout:4/122: mkdir d5/d2e 0 2024-04-26T21:25:49.867 INFO:tasks.workunit.client.1.smithi120.stdout:8/369: chown d5/d6/d11/d52/f44 6 1 2024-04-26T21:25:49.868 INFO:tasks.workunit.client.0.smithi084.stdout:0/134: dwrite de/d1c/f1d [0,4194304] 0 2024-04-26T21:25:49.869 INFO:tasks.workunit.client.0.smithi084.stdout:9/86: mknod da/c1d 0 2024-04-26T21:25:49.870 INFO:tasks.workunit.client.1.smithi120.stdout:4/345: rename d10/f5e to d10/d28/f77 0 2024-04-26T21:25:49.873 INFO:tasks.workunit.client.1.smithi120.stdout:6/404: creat d4/db/d10/d1a/d2b/f82 x:0 0 0 2024-04-26T21:25:49.877 INFO:tasks.workunit.client.0.smithi084.stdout:9/87: chown da/de/d16/f1b 2 1 2024-04-26T21:25:49.877 INFO:tasks.workunit.client.0.smithi084.stdout:0/135: stat de/d2b 0 2024-04-26T21:25:49.879 INFO:tasks.workunit.client.0.smithi084.stdout:9/88: chown da/ld 207622 1 2024-04-26T21:25:49.879 INFO:tasks.workunit.client.1.smithi120.stdout:1/356: symlink d6/l7e 0 2024-04-26T21:25:49.881 INFO:tasks.workunit.client.1.smithi120.stdout:0/455: creat d0/d3/dc/dd/d1b/fa1 x:0 0 0 2024-04-26T21:25:49.884 INFO:tasks.workunit.client.1.smithi120.stdout:9/334: sync 2024-04-26T21:25:49.885 INFO:tasks.workunit.client.1.smithi120.stdout:2/422: sync 2024-04-26T21:25:49.888 INFO:tasks.workunit.client.1.smithi120.stdout:6/405: rename d4/db/d10/dd/d4e/f71 to d4/d3d/f83 0 2024-04-26T21:25:49.891 INFO:tasks.workunit.client.0.smithi084.stdout:2/236: dwrite d6/f53 [0,4194304] 0 2024-04-26T21:25:49.893 INFO:tasks.workunit.client.1.smithi120.stdout:1/357: creat d6/d7/d1b/d3b/f7f x:0 0 0 2024-04-26T21:25:49.893 INFO:tasks.workunit.client.1.smithi120.stdout:8/370: link d5/d6/d11/d32/d3b/c68 d5/d6/d11/d32/d3b/c79 0 2024-04-26T21:25:49.895 INFO:tasks.workunit.client.1.smithi120.stdout:5/430: truncate d2/d30/d3b/f68 1049019 0 2024-04-26T21:25:49.895 INFO:tasks.workunit.client.1.smithi120.stdout:2/423: rmdir d4/d1b/d2e/d50/d14/d15/d6c 39 2024-04-26T21:25:49.895 INFO:tasks.workunit.client.1.smithi120.stdout:8/371: fsync d5/d6/d11/f10 0 2024-04-26T21:25:49.898 INFO:tasks.workunit.client.1.smithi120.stdout:4/346: dwrite d10/d12/f45 [0,4194304] 0 2024-04-26T21:25:49.899 INFO:tasks.workunit.client.1.smithi120.stdout:0/456: mknod d0/d3/dc/dd/d9b/ca2 0 2024-04-26T21:25:49.900 INFO:tasks.workunit.client.1.smithi120.stdout:9/335: link d0/d14/d2d/f41 d0/d6/d4d/d65/f71 0 2024-04-26T21:25:49.901 INFO:tasks.workunit.client.0.smithi084.stdout:2/237: chown d6/d7/d3d/d15/d1f/c4a 3707 1 2024-04-26T21:25:49.902 INFO:tasks.workunit.client.1.smithi120.stdout:6/406: link d4/db/f35 d4/db/d25/d6d/f84 0 2024-04-26T21:25:49.903 INFO:tasks.workunit.client.0.smithi084.stdout:4/123: dwrite d5/f1a [0,4194304] 0 2024-04-26T21:25:49.904 INFO:tasks.workunit.client.1.smithi120.stdout:8/372: unlink d5/d6/l50 0 2024-04-26T21:25:49.904 INFO:tasks.workunit.client.1.smithi120.stdout:3/344: fdatasync dd/d2a/d4a/f6b 0 2024-04-26T21:25:49.908 INFO:tasks.workunit.client.1.smithi120.stdout:4/347: fsync d10/d12/f2f 0 2024-04-26T21:25:49.910 INFO:tasks.workunit.client.1.smithi120.stdout:0/457: symlink d0/d3/d13/d81/la3 0 2024-04-26T21:25:49.910 INFO:tasks.workunit.client.1.smithi120.stdout:3/345: read dd/de/df/d1e/d28/f3f [1700038,12686] 0 2024-04-26T21:25:49.911 INFO:tasks.workunit.client.1.smithi120.stdout:9/336: fdatasync d0/fa 0 2024-04-26T21:25:49.911 INFO:tasks.workunit.client.0.smithi084.stdout:4/124: truncate d5/fe 5514193 0 2024-04-26T21:25:49.911 INFO:tasks.workunit.client.0.smithi084.stdout:6/118: write d3/de/d1a/f22 [3965,57940] 0 2024-04-26T21:25:49.912 INFO:tasks.workunit.client.1.smithi120.stdout:5/431: mkdir d2/dc/d1d/d21/d66/d6a/d8c 0 2024-04-26T21:25:49.912 INFO:tasks.workunit.client.1.smithi120.stdout:6/407: creat d4/db/d10/dd/d4e/f85 x:0 0 0 2024-04-26T21:25:49.916 INFO:tasks.workunit.client.1.smithi120.stdout:2/424: mknod d4/d1b/d2e/d50/d14/d15/c8c 0 2024-04-26T21:25:49.924 INFO:tasks.workunit.client.1.smithi120.stdout:3/346: creat dd/de/df/d12/d6c/d46/f6e x:0 0 0 2024-04-26T21:25:49.924 INFO:tasks.workunit.client.1.smithi120.stdout:9/337: rename d0/dd/d3a/d5c/c70 to d0/d6/d3d/c72 0 2024-04-26T21:25:49.925 INFO:tasks.workunit.client.0.smithi084.stdout:0/136: truncate f0 1814007 0 2024-04-26T21:25:49.925 INFO:tasks.workunit.client.0.smithi084.stdout:9/89: dread f3 [0,4194304] 0 2024-04-26T21:25:49.925 INFO:tasks.workunit.client.1.smithi120.stdout:2/425: rmdir d4/d1b/d2e/d5f 39 2024-04-26T21:25:49.927 INFO:tasks.workunit.client.0.smithi084.stdout:1/126: truncate d2/d9/d17/f21 1355096 0 2024-04-26T21:25:49.928 INFO:tasks.workunit.client.0.smithi084.stdout:1/127: stat d2/f10 0 2024-04-26T21:25:49.933 INFO:tasks.workunit.client.0.smithi084.stdout:2/238: link d6/d7/d3d/d15/d1f/d39/d20/f50 d6/d7/d3d/d15/f55 0 2024-04-26T21:25:49.933 INFO:tasks.workunit.client.1.smithi120.stdout:5/432: symlink d2/d1b/d89/l8d 0 2024-04-26T21:25:49.934 INFO:tasks.workunit.client.0.smithi084.stdout:9/90: mkdir da/de/d1e 0 2024-04-26T21:25:49.935 INFO:tasks.workunit.client.1.smithi120.stdout:6/408: rename d4/db/d10/d1a/c4f to d4/db/d10/dd/d4e/d76/c86 0 2024-04-26T21:25:49.936 INFO:tasks.workunit.client.0.smithi084.stdout:1/128: creat d2/d9/d15/f25 x:0 0 0 2024-04-26T21:25:49.938 INFO:tasks.workunit.client.1.smithi120.stdout:3/347: symlink dd/de/df/d1e/l6f 0 2024-04-26T21:25:49.938 INFO:tasks.workunit.client.1.smithi120.stdout:9/338: symlink d0/dd/d3a/l73 0 2024-04-26T21:25:49.939 INFO:tasks.workunit.client.0.smithi084.stdout:6/119: getdents d3/de/d15/d23 0 2024-04-26T21:25:49.941 INFO:tasks.workunit.client.1.smithi120.stdout:6/409: readlink d4/db/d10/d1a/d2b/d57/l5e 0 2024-04-26T21:25:49.941 INFO:tasks.workunit.client.1.smithi120.stdout:2/426: mkdir d4/d1b/d56/d65/d8d 0 2024-04-26T21:25:49.941 INFO:tasks.workunit.client.0.smithi084.stdout:1/129: write d2/d9/f14 [618270,51486] 0 2024-04-26T21:25:49.941 INFO:tasks.workunit.client.0.smithi084.stdout:6/120: stat d3 0 2024-04-26T21:25:49.942 INFO:tasks.workunit.client.0.smithi084.stdout:5/122: dread d0/f6 [4194304,4194304] 0 2024-04-26T21:25:49.942 INFO:tasks.workunit.client.0.smithi084.stdout:9/91: symlink da/de/d16/l1f 0 2024-04-26T21:25:49.943 INFO:tasks.workunit.client.1.smithi120.stdout:8/373: dwrite d5/d6/d11/d52/d27/f53 [0,4194304] 0 2024-04-26T21:25:49.944 INFO:tasks.workunit.client.0.smithi084.stdout:4/125: fdatasync d5/f1a 0 2024-04-26T21:25:49.945 INFO:tasks.workunit.client.0.smithi084.stdout:7/129: sync 2024-04-26T21:25:49.946 INFO:tasks.workunit.client.0.smithi084.stdout:1/130: mknod d2/d19/c26 0 2024-04-26T21:25:49.947 INFO:tasks.workunit.client.1.smithi120.stdout:5/433: creat d2/dc/d1d/d21/d77/d79/f8e x:0 0 0 2024-04-26T21:25:49.948 INFO:tasks.workunit.client.1.smithi120.stdout:0/458: dread d0/d3/dc/f22 [0,4194304] 0 2024-04-26T21:25:49.948 INFO:tasks.workunit.client.0.smithi084.stdout:2/239: creat d6/d7/d3d/d15/d1f/d41/f56 x:0 0 0 2024-04-26T21:25:49.951 INFO:tasks.workunit.client.0.smithi084.stdout:4/126: creat d5/d25/f2f x:0 0 0 2024-04-26T21:25:49.952 INFO:tasks.workunit.client.1.smithi120.stdout:9/339: dread - d0/d14/d2d/d4b/f6f zero size 2024-04-26T21:25:49.953 INFO:tasks.workunit.client.0.smithi084.stdout:4/127: chown d5/f23 75168704 1 2024-04-26T21:25:49.953 INFO:tasks.workunit.client.1.smithi120.stdout:2/427: rmdir d4/d1b/d25/d29 39 2024-04-26T21:25:49.954 INFO:tasks.workunit.client.0.smithi084.stdout:4/128: fdatasync d5/d25/f2f 0 2024-04-26T21:25:49.958 INFO:tasks.workunit.client.1.smithi120.stdout:3/348: creat dd/de/df/d1e/d3b/d56/f70 x:0 0 0 2024-04-26T21:25:49.958 INFO:tasks.workunit.client.1.smithi120.stdout:6/410: rmdir d4/db/d10/dd/d43 39 2024-04-26T21:25:49.958 INFO:tasks.workunit.client.1.smithi120.stdout:2/428: write d4/d1b/d2e/d50/d14/d15/f71 [208242,88765] 0 2024-04-26T21:25:49.959 INFO:tasks.workunit.client.0.smithi084.stdout:9/92: symlink da/de/d1e/l20 0 2024-04-26T21:25:49.960 INFO:tasks.workunit.client.1.smithi120.stdout:3/349: truncate dd/de/f2f 2620385 0 2024-04-26T21:25:49.961 INFO:tasks.workunit.client.0.smithi084.stdout:0/137: truncate de/d20/f29 183393 0 2024-04-26T21:25:49.962 INFO:tasks.workunit.client.0.smithi084.stdout:1/131: rmdir d2/d9/d15 39 2024-04-26T21:25:49.963 INFO:tasks.workunit.client.1.smithi120.stdout:2/429: write d4/d1b/d2e/d50/d14/d15/f71 [890530,114079] 0 2024-04-26T21:25:49.964 INFO:tasks.workunit.client.1.smithi120.stdout:0/459: mknod d0/d3/dc/dd/d1b/d39/ca4 0 2024-04-26T21:25:49.967 INFO:tasks.workunit.client.0.smithi084.stdout:7/130: rename d6/d9/d12/d19/f1b to d6/d9/f2e 0 2024-04-26T21:25:49.969 INFO:tasks.workunit.client.0.smithi084.stdout:1/132: rename d2/d1b to d2/d1b/d27 22 2024-04-26T21:25:49.970 INFO:tasks.workunit.client.1.smithi120.stdout:4/348: dread d10/f24 [0,4194304] 0 2024-04-26T21:25:49.970 INFO:tasks.workunit.client.1.smithi120.stdout:5/434: creat d2/d48/f8f x:0 0 0 2024-04-26T21:25:49.971 INFO:tasks.workunit.client.0.smithi084.stdout:6/121: link d3/de/d15/df/f1b d3/de/d15/d23/f2a 0 2024-04-26T21:25:49.971 INFO:tasks.workunit.client.0.smithi084.stdout:4/129: rmdir d5/d7 39 2024-04-26T21:25:49.971 INFO:tasks.workunit.client.1.smithi120.stdout:7/375: sync 2024-04-26T21:25:49.973 INFO:tasks.workunit.client.0.smithi084.stdout:1/133: dread - d2/f22 zero size 2024-04-26T21:25:49.975 INFO:tasks.workunit.client.0.smithi084.stdout:0/138: unlink de/d1c/c22 0 2024-04-26T21:25:49.976 INFO:tasks.workunit.client.1.smithi120.stdout:1/358: truncate d6/d7/d1d/d5d/d67/fb 1932477 0 2024-04-26T21:25:49.976 INFO:tasks.workunit.client.1.smithi120.stdout:9/340: fsync d0/d14/f24 0 2024-04-26T21:25:49.977 INFO:tasks.workunit.client.1.smithi120.stdout:1/359: chown d6/d9/c40 0 1 2024-04-26T21:25:49.977 INFO:tasks.workunit.client.1.smithi120.stdout:9/341: dread - d0/dd/f56 zero size 2024-04-26T21:25:49.978 INFO:tasks.workunit.client.0.smithi084.stdout:6/122: rename d3/f5 to d3/d18/f2b 0 2024-04-26T21:25:49.979 INFO:tasks.workunit.client.0.smithi084.stdout:9/93: rmdir da/de/d16 39 2024-04-26T21:25:49.979 INFO:tasks.workunit.client.0.smithi084.stdout:5/123: dwrite d0/f2 [0,4194304] 0 2024-04-26T21:25:49.980 INFO:tasks.workunit.client.1.smithi120.stdout:3/350: creat dd/d2a/f71 x:0 0 0 2024-04-26T21:25:49.980 INFO:tasks.workunit.client.1.smithi120.stdout:1/360: write d6/f15 [2738786,26927] 0 2024-04-26T21:25:49.981 INFO:tasks.workunit.client.1.smithi120.stdout:6/411: chown d4/c6 29291 1 2024-04-26T21:25:49.981 INFO:tasks.workunit.client.0.smithi084.stdout:6/123: fsync d3/f6 0 2024-04-26T21:25:49.982 INFO:tasks.workunit.client.0.smithi084.stdout:2/240: creat d6/d7/d3d/f57 x:0 0 0 2024-04-26T21:25:49.982 INFO:tasks.workunit.client.0.smithi084.stdout:6/124: write d3/f14 [790375,110378] 0 2024-04-26T21:25:49.984 INFO:tasks.workunit.client.0.smithi084.stdout:1/134: unlink d2/d9/f13 0 2024-04-26T21:25:49.985 INFO:tasks.workunit.client.1.smithi120.stdout:1/361: chown d6/d7/f59 682 1 2024-04-26T21:25:49.986 INFO:tasks.workunit.client.0.smithi084.stdout:1/135: fdatasync d2/d9/f14 0 2024-04-26T21:25:49.986 INFO:tasks.workunit.client.1.smithi120.stdout:6/412: write d4/db/d10/d1a/d2b/d57/d67/f66 [638370,4186] 0 2024-04-26T21:25:49.990 INFO:tasks.workunit.client.1.smithi120.stdout:1/362: stat d6/d7/d1d/d5d/d67/dd/c10 0 2024-04-26T21:25:49.990 INFO:tasks.workunit.client.0.smithi084.stdout:2/241: mknod d6/d1b/c58 0 2024-04-26T21:25:49.991 INFO:tasks.workunit.client.1.smithi120.stdout:4/349: mknod d10/d65/d72/c78 0 2024-04-26T21:25:49.995 INFO:tasks.workunit.client.1.smithi120.stdout:1/363: truncate d6/d7/f59 786783 0 2024-04-26T21:25:49.997 INFO:tasks.workunit.client.1.smithi120.stdout:8/374: write d5/d6/d34/d42/f49 [677968,16075] 0 2024-04-26T21:25:49.997 INFO:tasks.workunit.client.1.smithi120.stdout:7/376: read d7/d10/d12/d1f/f36 [4178178,30979] 0 2024-04-26T21:25:49.998 INFO:tasks.workunit.client.0.smithi084.stdout:4/130: symlink d5/d10/d15/d21/d29/l30 0 2024-04-26T21:25:49.998 INFO:tasks.workunit.client.1.smithi120.stdout:9/342: dread d0/d14/d2d/f6c [0,4194304] 0 2024-04-26T21:25:50.000 INFO:tasks.workunit.client.1.smithi120.stdout:3/351: mkdir dd/de/d18/d2c/d72 0 2024-04-26T21:25:50.002 INFO:tasks.workunit.client.1.smithi120.stdout:0/460: unlink d0/df/f3a 0 2024-04-26T21:25:50.003 INFO:tasks.workunit.client.1.smithi120.stdout:1/364: truncate d6/d7/d2d/d48/f49 828297 0 2024-04-26T21:25:50.004 INFO:tasks.workunit.client.0.smithi084.stdout:4/131: dread - d5/d25/f2f zero size 2024-04-26T21:25:50.005 INFO:tasks.workunit.client.1.smithi120.stdout:2/430: creat d4/d1b/d2e/d5f/f8e x:0 0 0 2024-04-26T21:25:50.005 INFO:tasks.workunit.client.1.smithi120.stdout:6/413: creat d4/db/d25/d6d/d73/f87 x:0 0 0 2024-04-26T21:25:50.006 INFO:tasks.workunit.client.1.smithi120.stdout:4/350: rmdir d10/d6b 39 2024-04-26T21:25:50.008 INFO:tasks.workunit.client.0.smithi084.stdout:5/124: link d0/d17/f18 d0/dc/f1c 0 2024-04-26T21:25:50.010 INFO:tasks.workunit.client.1.smithi120.stdout:1/365: fsync d6/d7/d1d/d2c/f2f 0 2024-04-26T21:25:50.010 INFO:tasks.workunit.client.1.smithi120.stdout:8/375: mkdir d5/d6/d34/d37/d60/d55/d7a 0 2024-04-26T21:25:50.011 INFO:tasks.workunit.client.1.smithi120.stdout:9/343: fsync d0/fa 0 2024-04-26T21:25:50.012 INFO:tasks.workunit.client.1.smithi120.stdout:1/366: fsync d6/f15 0 2024-04-26T21:25:50.012 INFO:tasks.workunit.client.0.smithi084.stdout:1/136: mkdir d2/d9/d15/d28 0 2024-04-26T21:25:50.012 INFO:tasks.workunit.client.0.smithi084.stdout:4/132: write d5/f2b [3945071,125843] 0 2024-04-26T21:25:50.013 INFO:tasks.workunit.client.0.smithi084.stdout:8/141: sync 2024-04-26T21:25:50.013 INFO:tasks.workunit.client.0.smithi084.stdout:3/154: sync 2024-04-26T21:25:50.015 INFO:tasks.workunit.client.0.smithi084.stdout:5/125: chown d0/d17/l1b 134 1 2024-04-26T21:25:50.018 INFO:tasks.workunit.client.1.smithi120.stdout:5/435: symlink d2/d48/l90 0 2024-04-26T21:25:50.020 INFO:tasks.workunit.client.1.smithi120.stdout:7/377: symlink d7/d10/d12/l84 0 2024-04-26T21:25:50.021 INFO:tasks.workunit.client.0.smithi084.stdout:5/126: chown d0/f16 10336671 1 2024-04-26T21:25:50.022 INFO:tasks.workunit.client.1.smithi120.stdout:8/376: dread d5/d6/d34/d37/f64 [0,4194304] 0 2024-04-26T21:25:50.025 INFO:tasks.workunit.client.1.smithi120.stdout:8/377: chown d5/d6/d34/d42/f49 226233 1 2024-04-26T21:25:50.025 INFO:tasks.workunit.client.1.smithi120.stdout:4/351: unlink d10/d28/f2e 0 2024-04-26T21:25:50.025 INFO:tasks.workunit.client.0.smithi084.stdout:8/142: mknod d4/d7/d15/c29 0 2024-04-26T21:25:50.025 INFO:tasks.workunit.client.0.smithi084.stdout:1/137: write d2/d9/d15/f1f [2503618,93126] 0 2024-04-26T21:25:50.025 INFO:tasks.workunit.client.0.smithi084.stdout:3/155: creat d1/d24/f36 x:0 0 0 2024-04-26T21:25:50.026 INFO:tasks.workunit.client.1.smithi120.stdout:4/352: stat d10/d28/f4e 0 2024-04-26T21:25:50.027 INFO:tasks.workunit.client.1.smithi120.stdout:3/352: rename dd/de/df/d1e/d3b/d56/f70 to dd/de/df/d12/d6c/d46/f73 0 2024-04-26T21:25:50.028 INFO:tasks.workunit.client.1.smithi120.stdout:3/353: fsync dd/d2a/f71 0 2024-04-26T21:25:50.029 INFO:tasks.workunit.client.0.smithi084.stdout:7/131: dread d6/d9/f2e [0,4194304] 0 2024-04-26T21:25:50.030 INFO:tasks.workunit.client.0.smithi084.stdout:2/242: dwrite d6/d7/d3d/f1e [0,4194304] 0 2024-04-26T21:25:50.031 INFO:tasks.workunit.client.0.smithi084.stdout:6/125: dwrite d3/d18/f20 [4194304,4194304] 0 2024-04-26T21:25:50.032 INFO:tasks.workunit.client.0.smithi084.stdout:8/143: mknod d4/d7/c2a 0 2024-04-26T21:25:50.033 INFO:tasks.workunit.client.1.smithi120.stdout:2/431: chown d4/d1b/d2e/d50/d14/d15/f2d 15 1 2024-04-26T21:25:50.037 INFO:tasks.workunit.client.0.smithi084.stdout:6/126: dread - d3/de/d15/f1c zero size 2024-04-26T21:25:50.042 INFO:tasks.workunit.client.1.smithi120.stdout:9/344: mknod d0/d14/d2d/d4b/c74 0 2024-04-26T21:25:50.042 INFO:tasks.workunit.client.0.smithi084.stdout:9/94: dwrite da/f10 [0,4194304] 0 2024-04-26T21:25:50.043 INFO:tasks.workunit.client.1.smithi120.stdout:0/461: creat d0/d3/d51/d97/fa5 x:0 0 0 2024-04-26T21:25:50.044 INFO:tasks.workunit.client.0.smithi084.stdout:5/127: truncate d0/f11 2047287 0 2024-04-26T21:25:50.045 INFO:tasks.workunit.client.0.smithi084.stdout:2/243: symlink d6/d7/d3d/d15/d1f/d39/l59 0 2024-04-26T21:25:50.048 INFO:tasks.workunit.client.1.smithi120.stdout:0/462: dread d0/d3/dc/f22 [0,4194304] 0 2024-04-26T21:25:50.053 INFO:tasks.workunit.client.1.smithi120.stdout:7/378: rmdir d7 39 2024-04-26T21:25:50.054 INFO:tasks.workunit.client.0.smithi084.stdout:5/128: rename d0/f8 to d0/d17/f1d 0 2024-04-26T21:25:50.055 INFO:tasks.workunit.client.1.smithi120.stdout:0/463: write d0/d3/dc/dd/d1b/d24/d7d/f9e [192062,87868] 0 2024-04-26T21:25:50.059 INFO:tasks.workunit.client.1.smithi120.stdout:3/354: mkdir dd/d2a/d74 0 2024-04-26T21:25:50.060 INFO:tasks.workunit.client.1.smithi120.stdout:2/432: stat d4/d1b/d25/c39 0 2024-04-26T21:25:50.060 INFO:tasks.workunit.client.1.smithi120.stdout:3/355: read fa [589262,31750] 0 2024-04-26T21:25:50.061 INFO:tasks.workunit.client.0.smithi084.stdout:2/244: mkdir d6/d7/d3d/d15/d1f/d39/d20/d45/d5a 0 2024-04-26T21:25:50.061 INFO:tasks.workunit.client.1.smithi120.stdout:9/345: creat d0/d6/d3d/f75 x:0 0 0 2024-04-26T21:25:50.062 INFO:tasks.workunit.client.1.smithi120.stdout:5/436: creat d2/d82/f91 x:0 0 0 2024-04-26T21:25:50.063 INFO:tasks.workunit.client.0.smithi084.stdout:8/144: truncate d4/d7/f14 3366586 0 2024-04-26T21:25:50.064 INFO:tasks.workunit.client.1.smithi120.stdout:9/346: fdatasync d0/d6/f36 0 2024-04-26T21:25:50.065 INFO:tasks.workunit.client.0.smithi084.stdout:9/95: rename da/de/l18 to da/de/d1e/l21 0 2024-04-26T21:25:50.067 INFO:tasks.workunit.client.0.smithi084.stdout:9/96: fsync f9 0 2024-04-26T21:25:50.067 INFO:tasks.workunit.client.0.smithi084.stdout:8/145: fsync d4/d6/f1a 0 2024-04-26T21:25:50.072 INFO:tasks.workunit.client.1.smithi120.stdout:6/414: getdents d4/db/d10/dd/d43/d58 0 2024-04-26T21:25:50.073 INFO:tasks.workunit.client.1.smithi120.stdout:0/464: write d0/d3/d13/d5a/f7a [244851,55274] 0 2024-04-26T21:25:50.073 INFO:tasks.workunit.client.0.smithi084.stdout:2/245: creat d6/d7/f5b x:0 0 0 2024-04-26T21:25:50.074 INFO:tasks.workunit.client.1.smithi120.stdout:4/353: creat d10/d6b/f79 x:0 0 0 2024-04-26T21:25:50.075 INFO:tasks.workunit.client.1.smithi120.stdout:2/433: unlink d4/d1b/d4f/l6e 0 2024-04-26T21:25:50.076 INFO:tasks.workunit.client.1.smithi120.stdout:7/379: fdatasync f3 0 2024-04-26T21:25:50.077 INFO:tasks.workunit.client.0.smithi084.stdout:5/129: symlink d0/dc/l1e 0 2024-04-26T21:25:50.078 INFO:tasks.workunit.client.0.smithi084.stdout:3/156: dwrite d1/fd [0,4194304] 0 2024-04-26T21:25:50.078 INFO:tasks.workunit.client.1.smithi120.stdout:8/378: creat d5/d6/d11/d52/d27/d4f/d67/f7b x:0 0 0 2024-04-26T21:25:50.082 INFO:tasks.workunit.client.1.smithi120.stdout:9/347: dwrite d0/d6/d3d/f75 [0,4194304] 0 2024-04-26T21:25:50.084 INFO:tasks.workunit.client.1.smithi120.stdout:1/367: rename d6/d7/d1b/c2e to d6/c80 0 2024-04-26T21:25:50.085 INFO:tasks.workunit.client.0.smithi084.stdout:6/127: dwrite d3/f26 [4194304,4194304] 0 2024-04-26T21:25:50.085 INFO:tasks.workunit.client.0.smithi084.stdout:6/128: chown c2 59692 1 2024-04-26T21:25:50.085 INFO:tasks.workunit.client.0.smithi084.stdout:6/129: write d3/de/d15/df/f12 [4146789,32204] 0 2024-04-26T21:25:50.085 INFO:tasks.workunit.client.0.smithi084.stdout:9/97: rmdir da/de/d16 39 2024-04-26T21:25:50.092 INFO:tasks.workunit.client.1.smithi120.stdout:6/415: symlink d4/db/d10/d1a/l88 0 2024-04-26T21:25:50.099 INFO:tasks.workunit.client.0.smithi084.stdout:5/130: rename d0/l10 to d0/dc/df/l1f 0 2024-04-26T21:25:50.100 INFO:tasks.workunit.client.0.smithi084.stdout:6/130: write d3/f10 [366691,29894] 0 2024-04-26T21:25:50.101 INFO:tasks.workunit.client.1.smithi120.stdout:2/434: fsync d4/d1b/d2e/d50/f3f 0 2024-04-26T21:25:50.102 INFO:tasks.workunit.client.0.smithi084.stdout:2/246: dread d6/d7/d3d/d15/d1f/d39/d20/f3a [4194304,4194304] 0 2024-04-26T21:25:50.102 INFO:tasks.workunit.client.0.smithi084.stdout:8/146: write d4/d7/f14 [2674004,5699] 0 2024-04-26T21:25:50.103 INFO:tasks.workunit.client.1.smithi120.stdout:2/435: readlink d4/d1b/d2e/d50/d14/l2f 0 2024-04-26T21:25:50.107 INFO:tasks.workunit.client.0.smithi084.stdout:2/247: fdatasync d6/d7/d3d/d15/d1f/d22/f24 0 2024-04-26T21:25:50.109 INFO:tasks.workunit.client.0.smithi084.stdout:3/157: rename d1/f26 to d1/d2c/d2f/d31/f37 0 2024-04-26T21:25:50.110 INFO:tasks.workunit.client.1.smithi120.stdout:3/356: rename dd/de/d18/d2c/d72 to dd/de/df/d1e/d3b/d56/d75 0 2024-04-26T21:25:50.113 INFO:tasks.workunit.client.1.smithi120.stdout:9/348: creat d0/d6/f76 x:0 0 0 2024-04-26T21:25:50.114 INFO:tasks.workunit.client.1.smithi120.stdout:6/416: creat d4/db/d10/dd/d28/f89 x:0 0 0 2024-04-26T21:25:50.114 INFO:tasks.workunit.client.0.smithi084.stdout:3/158: write d1/d2c/d2f/f13 [497572,40447] 0 2024-04-26T21:25:50.115 INFO:tasks.workunit.client.0.smithi084.stdout:7/132: dread d6/d9/f11 [0,4194304] 0 2024-04-26T21:25:50.116 INFO:tasks.workunit.client.1.smithi120.stdout:7/380: unlink d7/d10/d12/d1f/d28/d4c/c61 0 2024-04-26T21:25:50.116 INFO:tasks.workunit.client.1.smithi120.stdout:6/417: chown d4/db/d10/dd/d43/d58 17 1 2024-04-26T21:25:50.118 INFO:tasks.workunit.client.1.smithi120.stdout:5/437: link d2/dc/d1d/d21/d66/f14 d2/d48/d63/f92 0 2024-04-26T21:25:50.118 INFO:tasks.workunit.client.0.smithi084.stdout:7/133: stat d6/d1c/c22 0 2024-04-26T21:25:50.118 INFO:tasks.workunit.client.1.smithi120.stdout:7/381: chown d7/d10/d12/d1f/d28/l5d 0 1 2024-04-26T21:25:50.119 INFO:tasks.workunit.client.0.smithi084.stdout:9/98: dwrite da/de/d16/f1c [0,4194304] 0 2024-04-26T21:25:50.119 INFO:tasks.workunit.client.1.smithi120.stdout:5/438: read - d2/dc/d1d/d1f/f4c zero size 2024-04-26T21:25:50.124 INFO:tasks.workunit.client.1.smithi120.stdout:8/379: creat d5/d6/d34/d37/d60/d55/d7a/f7c x:0 0 0 2024-04-26T21:25:50.125 INFO:tasks.workunit.client.0.smithi084.stdout:3/159: mkdir d1/d38 0 2024-04-26T21:25:50.125 INFO:tasks.workunit.client.1.smithi120.stdout:2/436: truncate d4/d1b/f41 254597 0 2024-04-26T21:25:50.126 INFO:tasks.workunit.client.1.smithi120.stdout:7/382: chown d7/d10/d12/d1f/d28/d4c/d6b 1 1 2024-04-26T21:25:50.126 INFO:tasks.workunit.client.1.smithi120.stdout:3/357: rmdir dd/de/df 39 2024-04-26T21:25:50.127 INFO:tasks.workunit.client.0.smithi084.stdout:8/147: getdents d4/d6/db 0 2024-04-26T21:25:50.128 INFO:tasks.workunit.client.0.smithi084.stdout:5/131: getdents d0/d17 0 2024-04-26T21:25:50.129 INFO:tasks.workunit.client.1.smithi120.stdout:5/439: mkdir d2/d30/d93 0 2024-04-26T21:25:50.130 INFO:tasks.workunit.client.0.smithi084.stdout:3/160: mknod d1/d2c/c39 0 2024-04-26T21:25:50.131 INFO:tasks.workunit.client.1.smithi120.stdout:7/383: dread - d7/d10/d12/d2f/f41 zero size 2024-04-26T21:25:50.131 INFO:tasks.workunit.client.1.smithi120.stdout:0/465: getdents d0/d3/d51/d97 0 2024-04-26T21:25:50.132 INFO:tasks.workunit.client.0.smithi084.stdout:6/131: truncate d3/fc 939903 0 2024-04-26T21:25:50.133 INFO:tasks.workunit.client.0.smithi084.stdout:5/132: rmdir d0/d17 39 2024-04-26T21:25:50.133 INFO:tasks.workunit.client.0.smithi084.stdout:8/148: dread - d4/d7/d9/f21 zero size 2024-04-26T21:25:50.134 INFO:tasks.workunit.client.1.smithi120.stdout:6/418: fsync d4/db/d10/dd/d28/f78 0 2024-04-26T21:25:50.135 INFO:tasks.workunit.client.1.smithi120.stdout:9/349: mkdir d0/d14/d77 0 2024-04-26T21:25:50.137 INFO:tasks.workunit.client.1.smithi120.stdout:8/380: creat d5/d6/d11/d52/d27/d4f/f7d x:0 0 0 2024-04-26T21:25:50.138 INFO:tasks.workunit.client.0.smithi084.stdout:6/132: write d3/d18/f1d [45483,22980] 0 2024-04-26T21:25:50.138 INFO:tasks.workunit.client.0.smithi084.stdout:2/248: truncate d6/d7/d3d/d15/d1f/f32 1541199 0 2024-04-26T21:25:50.139 INFO:tasks.workunit.client.1.smithi120.stdout:9/350: chown d0/dd/f56 28 1 2024-04-26T21:25:50.141 INFO:tasks.workunit.client.1.smithi120.stdout:5/440: creat d2/d30/d3b/f94 x:0 0 0 2024-04-26T21:25:50.143 INFO:tasks.workunit.client.1.smithi120.stdout:4/354: dread d10/d12/f22 [0,4194304] 0 2024-04-26T21:25:50.143 INFO:tasks.workunit.client.1.smithi120.stdout:8/381: fsync d5/d6/d34/d37/f69 0 2024-04-26T21:25:50.146 INFO:tasks.workunit.client.1.smithi120.stdout:7/384: mknod d7/d10/d12/d1f/d28/d4c/d6c/c85 0 2024-04-26T21:25:50.148 INFO:tasks.workunit.client.1.smithi120.stdout:6/419: fsync d4/db/d10/d1a/d2b/d57/d67/f32 0 2024-04-26T21:25:50.149 INFO:tasks.workunit.client.1.smithi120.stdout:5/441: truncate d2/d48/f8f 128357 0 2024-04-26T21:25:50.151 INFO:tasks.workunit.client.1.smithi120.stdout:3/358: rename dd/de/df/d1e to dd/de/d18/d2c/d76 0 2024-04-26T21:25:50.152 INFO:tasks.workunit.client.1.smithi120.stdout:2/437: dwrite d4/d1b/d2e/f57 [0,4194304] 0 2024-04-26T21:25:50.155 INFO:tasks.workunit.client.1.smithi120.stdout:3/359: dread - dd/d2a/f71 zero size 2024-04-26T21:25:50.156 INFO:tasks.workunit.client.1.smithi120.stdout:8/382: mknod d5/d6/d11/c7e 0 2024-04-26T21:25:50.156 INFO:tasks.workunit.client.1.smithi120.stdout:4/355: write d10/d12/f19 [1396010,71445] 0 2024-04-26T21:25:50.157 INFO:tasks.workunit.client.1.smithi120.stdout:7/385: mknod d7/d10/d12/d1f/d28/d4c/d6b/d7b/c86 0 2024-04-26T21:25:50.162 INFO:tasks.workunit.client.1.smithi120.stdout:5/442: creat d2/d1b/d89/d6b/f95 x:0 0 0 2024-04-26T21:25:50.163 INFO:tasks.workunit.client.1.smithi120.stdout:9/351: rename d0/d14/c15 to d0/dd/d3a/d5c/c78 0 2024-04-26T21:25:50.163 INFO:tasks.workunit.client.1.smithi120.stdout:3/360: fdatasync fa 0 2024-04-26T21:25:50.163 INFO:tasks.workunit.client.1.smithi120.stdout:2/438: creat d4/d1b/d25/d2c/f8f x:0 0 0 2024-04-26T21:25:50.163 INFO:tasks.workunit.client.1.smithi120.stdout:9/352: read - d0/dd/d45/f63 zero size 2024-04-26T21:25:50.164 INFO:tasks.workunit.client.1.smithi120.stdout:6/420: symlink d4/db/d10/dd/d4e/d60/l8a 0 2024-04-26T21:25:50.164 INFO:tasks.workunit.client.1.smithi120.stdout:8/383: truncate d5/d6/d11/d52/d70/f22 1382615 0 2024-04-26T21:25:50.167 INFO:tasks.workunit.client.1.smithi120.stdout:5/443: mkdir d2/d82/d96 0 2024-04-26T21:25:50.168 INFO:tasks.workunit.client.1.smithi120.stdout:9/353: read - d0/d14/d2d/f41 zero size 2024-04-26T21:25:50.168 INFO:tasks.workunit.client.1.smithi120.stdout:8/384: readlink d5/d6/l23 0 2024-04-26T21:25:50.170 INFO:tasks.workunit.client.1.smithi120.stdout:4/356: rename d10/d12/c13 to d10/d65/c7a 0 2024-04-26T21:25:50.171 INFO:tasks.workunit.client.1.smithi120.stdout:6/421: creat d4/db/d10/d22/d6c/f8b x:0 0 0 2024-04-26T21:25:50.175 INFO:tasks.workunit.client.1.smithi120.stdout:9/354: unlink d0/dd/d3a/f3f 0 2024-04-26T21:25:50.176 INFO:tasks.workunit.client.1.smithi120.stdout:4/357: creat d10/d28/f7b x:0 0 0 2024-04-26T21:25:50.177 INFO:tasks.workunit.client.1.smithi120.stdout:0/466: dwrite d0/d3/d13/d64/f69 [0,4194304] 0 2024-04-26T21:25:50.180 INFO:tasks.workunit.client.1.smithi120.stdout:5/444: rmdir d2 39 2024-04-26T21:25:50.180 INFO:tasks.workunit.client.1.smithi120.stdout:9/355: write d0/d6/f76 [396256,84982] 0 2024-04-26T21:25:50.184 INFO:tasks.workunit.client.1.smithi120.stdout:9/356: chown d0/dd 2183 1 2024-04-26T21:25:50.184 INFO:tasks.workunit.client.1.smithi120.stdout:7/386: dread d7/d10/d12/d1f/f3a [0,4194304] 0 2024-04-26T21:25:50.185 INFO:tasks.workunit.client.1.smithi120.stdout:5/445: dread - d2/d30/d3b/f94 zero size 2024-04-26T21:25:50.187 INFO:tasks.workunit.client.1.smithi120.stdout:8/385: link d5/d6/d11/d32/d3b/f56 d5/d6/f7f 0 2024-04-26T21:25:50.187 INFO:tasks.workunit.client.1.smithi120.stdout:3/361: dwrite dd/de/d18/f4b [0,4194304] 0 2024-04-26T21:25:50.191 INFO:tasks.workunit.client.1.smithi120.stdout:0/467: symlink d0/d3/dc/d12/d4a/la6 0 2024-04-26T21:25:50.195 INFO:tasks.workunit.client.1.smithi120.stdout:5/446: rename d2/dc/d1d/d1f/d36/l69 to d2/d48/d63/l97 0 2024-04-26T21:25:50.198 INFO:tasks.workunit.client.1.smithi120.stdout:4/358: dread d10/d12/f22 [0,4194304] 0 2024-04-26T21:25:50.198 INFO:tasks.workunit.client.1.smithi120.stdout:6/422: truncate d4/db/d10/f15 2788396 0 2024-04-26T21:25:50.199 INFO:tasks.workunit.client.1.smithi120.stdout:8/386: symlink d5/l80 0 2024-04-26T21:25:50.201 INFO:tasks.workunit.client.0.smithi084.stdout:8/149: write d4/f12 [1840971,76156] 0 2024-04-26T21:25:50.202 INFO:tasks.workunit.client.1.smithi120.stdout:5/447: symlink d2/dc/d1d/d1f/d36/d44/l98 0 2024-04-26T21:25:50.204 INFO:tasks.workunit.client.1.smithi120.stdout:3/362: link dd/de/d18/d37/f5c dd/de/df/d12/d6c/f77 0 2024-04-26T21:25:50.206 INFO:tasks.workunit.client.0.smithi084.stdout:6/133: rename d3/de/d15 to d3/de/d15/df/d2c 22 2024-04-26T21:25:50.206 INFO:tasks.workunit.client.0.smithi084.stdout:5/133: creat d0/d17/f20 x:0 0 0 2024-04-26T21:25:50.206 INFO:tasks.workunit.client.0.smithi084.stdout:9/99: dwrite da/f10 [0,4194304] 0 2024-04-26T21:25:50.206 INFO:tasks.workunit.client.0.smithi084.stdout:7/134: dwrite d6/f17 [4194304,4194304] 0 2024-04-26T21:25:50.207 INFO:tasks.workunit.client.1.smithi120.stdout:7/387: dread d7/d10/d12/d1f/d28/f3e [0,4194304] 0 2024-04-26T21:25:50.210 INFO:tasks.workunit.client.1.smithi120.stdout:3/363: write dd/de/d18/d24/d43/f4c [444098,73405] 0 2024-04-26T21:25:50.215 INFO:tasks.workunit.client.0.smithi084.stdout:7/135: chown d6/dc/f27 3872 1 2024-04-26T21:25:50.215 INFO:tasks.workunit.client.0.smithi084.stdout:8/150: creat d4/d7/f2b x:0 0 0 2024-04-26T21:25:50.216 INFO:tasks.workunit.client.1.smithi120.stdout:9/357: write d0/d6/f47 [84245,68261] 0 2024-04-26T21:25:50.218 INFO:tasks.workunit.client.0.smithi084.stdout:6/134: write d3/de/d15/f1c [547234,100604] 0 2024-04-26T21:25:50.219 INFO:tasks.workunit.client.1.smithi120.stdout:0/468: dwrite d0/d3/d13/f60 [0,4194304] 0 2024-04-26T21:25:50.220 INFO:tasks.workunit.client.0.smithi084.stdout:8/151: dread - d4/d7/d9/f27 zero size 2024-04-26T21:25:50.223 INFO:tasks.workunit.client.1.smithi120.stdout:8/387: rename d5/d6/d34/d37/c59 to d5/d6/d75/c81 0 2024-04-26T21:25:50.224 INFO:tasks.workunit.client.1.smithi120.stdout:7/388: mknod d7/d10/d12/d1f/d28/d4c/d6c/d74/c87 0 2024-04-26T21:25:50.228 INFO:tasks.workunit.client.1.smithi120.stdout:9/358: mkdir d0/d6/d79 0 2024-04-26T21:25:50.229 INFO:tasks.workunit.client.0.smithi084.stdout:5/134: truncate d0/dc/f14 1026290 0 2024-04-26T21:25:50.229 INFO:tasks.workunit.client.1.smithi120.stdout:0/469: write d0/df/d59/f98 [2582838,89134] 0 2024-04-26T21:25:50.231 INFO:tasks.workunit.client.0.smithi084.stdout:6/135: rename d3/f14 to d3/d28/f2d 0 2024-04-26T21:25:50.233 INFO:tasks.workunit.client.0.smithi084.stdout:6/136: stat d3/de/d1a 0 2024-04-26T21:25:50.238 INFO:tasks.workunit.client.1.smithi120.stdout:6/423: rename d4/db/d25/d6d/d73/f7e to d4/db/d10/dd/d4e/d5d/f8c 0 2024-04-26T21:25:50.238 INFO:tasks.workunit.client.0.smithi084.stdout:6/137: fsync d3/de/d1a/f22 0 2024-04-26T21:25:50.239 INFO:tasks.workunit.client.0.smithi084.stdout:8/152: creat d4/d7/d9/f2c x:0 0 0 2024-04-26T21:25:50.241 INFO:tasks.workunit.client.0.smithi084.stdout:2/249: write d6/d7/d3d/d15/d1f/f32 [737045,2937] 0 2024-04-26T21:25:50.244 INFO:tasks.workunit.client.0.smithi084.stdout:2/250: fsync d6/f53 0 2024-04-26T21:25:50.245 INFO:tasks.workunit.client.0.smithi084.stdout:6/138: creat d3/de/d15/d23/f2e x:0 0 0 2024-04-26T21:25:50.246 INFO:tasks.workunit.client.1.smithi120.stdout:5/448: dread d2/f3d [0,4194304] 0 2024-04-26T21:25:50.248 INFO:tasks.workunit.client.1.smithi120.stdout:5/449: stat d2/dc/d1d/d21/d66/c3c 0 2024-04-26T21:25:50.249 INFO:tasks.workunit.client.0.smithi084.stdout:7/136: dread d6/d9/f11 [0,4194304] 0 2024-04-26T21:25:50.249 INFO:tasks.workunit.client.0.smithi084.stdout:6/139: write d3/f26 [8579968,105498] 0 2024-04-26T21:25:50.254 INFO:tasks.workunit.client.0.smithi084.stdout:7/137: dread - d6/d9/f2d zero size 2024-04-26T21:25:50.256 INFO:tasks.workunit.client.0.smithi084.stdout:2/251: creat d6/d7/d3d/f5c x:0 0 0 2024-04-26T21:25:50.256 INFO:tasks.workunit.client.0.smithi084.stdout:9/100: dwrite da/de/f13 [0,4194304] 0 2024-04-26T21:25:50.256 INFO:tasks.workunit.client.1.smithi120.stdout:0/470: readlink d0/df/d59/l5b 0 2024-04-26T21:25:50.258 INFO:tasks.workunit.client.1.smithi120.stdout:3/364: rename dd/de/d18/d2c/d76/d28/f2d to dd/de/d18/d37/f78 0 2024-04-26T21:25:50.263 INFO:tasks.workunit.client.1.smithi120.stdout:9/359: dread d0/f1 [0,4194304] 0 2024-04-26T21:25:50.263 INFO:tasks.workunit.client.0.smithi084.stdout:2/252: read d6/d7/d3d/d15/d1f/d39/d20/f3a [1000151,4542] 0 2024-04-26T21:25:50.264 INFO:tasks.workunit.client.1.smithi120.stdout:3/365: dread - dd/de/d18/d24/d43/f53 zero size 2024-04-26T21:25:50.267 INFO:tasks.workunit.client.1.smithi120.stdout:6/424: link d4/f31 d4/db/d10/d1a/d2b/f8d 0 2024-04-26T21:25:50.267 INFO:tasks.workunit.client.1.smithi120.stdout:0/471: rmdir d0/d3/d13/d81 39 2024-04-26T21:25:50.268 INFO:tasks.workunit.client.0.smithi084.stdout:5/135: dwrite d0/d17/f20 [0,4194304] 0 2024-04-26T21:25:50.270 INFO:tasks.workunit.client.0.smithi084.stdout:2/253: chown d6/d7/d3d/d15/d1f/d39/d20/d45/f51 10026969 1 2024-04-26T21:25:50.271 INFO:tasks.workunit.client.1.smithi120.stdout:6/425: stat d4/f1f 0 2024-04-26T21:25:50.272 INFO:tasks.workunit.client.1.smithi120.stdout:9/360: write d0/d14/f35 [4670583,104132] 0 2024-04-26T21:25:50.275 INFO:tasks.workunit.client.0.smithi084.stdout:3/161: dread d1/fe [0,4194304] 0 2024-04-26T21:25:50.275 INFO:tasks.workunit.client.0.smithi084.stdout:5/136: mkdir d0/dc/df/d21 0 2024-04-26T21:25:50.276 INFO:tasks.workunit.client.1.smithi120.stdout:4/359: dwrite d10/d12/f57 [0,4194304] 0 2024-04-26T21:25:50.277 INFO:tasks.workunit.client.1.smithi120.stdout:7/389: creat d7/d10/d12/d1f/f88 x:0 0 0 2024-04-26T21:25:50.278 INFO:tasks.workunit.client.1.smithi120.stdout:6/426: dread - d4/db/d10/dd/d4e/d5d/f7f zero size 2024-04-26T21:25:50.278 INFO:tasks.workunit.client.1.smithi120.stdout:3/366: creat dd/d2a/d4a/f79 x:0 0 0 2024-04-26T21:25:50.280 INFO:tasks.workunit.client.1.smithi120.stdout:7/390: write d7/d10/d12/f16 [4132391,17363] 0 2024-04-26T21:25:50.281 INFO:tasks.workunit.client.0.smithi084.stdout:8/153: dread d4/d7/d15/f18 [0,4194304] 0 2024-04-26T21:25:50.281 INFO:tasks.workunit.client.0.smithi084.stdout:3/162: truncate d1/f22 722559 0 2024-04-26T21:25:50.282 INFO:tasks.workunit.client.1.smithi120.stdout:9/361: unlink d0/dd/d45/c5b 0 2024-04-26T21:25:50.284 INFO:tasks.workunit.client.0.smithi084.stdout:7/138: dwrite d6/d9/f2d [0,4194304] 0 2024-04-26T21:25:50.285 INFO:tasks.workunit.client.1.smithi120.stdout:9/362: chown d0/f18 1600715 1 2024-04-26T21:25:50.286 INFO:tasks.workunit.client.1.smithi120.stdout:4/360: mkdir d10/d65/d7c 0 2024-04-26T21:25:50.287 INFO:tasks.workunit.client.1.smithi120.stdout:7/391: dread - d7/d10/d12/d2f/f7c zero size 2024-04-26T21:25:50.287 INFO:tasks.workunit.client.0.smithi084.stdout:8/154: stat d4/d7/d15/c29 0 2024-04-26T21:25:50.287 INFO:tasks.workunit.client.0.smithi084.stdout:7/139: readlink d6/d26/l28 0 2024-04-26T21:25:50.288 INFO:tasks.workunit.client.1.smithi120.stdout:7/392: fdatasync d7/d10/d12/f42 0 2024-04-26T21:25:50.289 INFO:tasks.workunit.client.0.smithi084.stdout:3/163: truncate d1/f22 1002162 0 2024-04-26T21:25:50.289 INFO:tasks.workunit.client.0.smithi084.stdout:7/140: chown d6/d9/d12/d19/l1e 147447875 1 2024-04-26T21:25:50.294 INFO:tasks.workunit.client.1.smithi120.stdout:0/472: dread d0/d3/f4f [4194304,4194304] 0 2024-04-26T21:25:50.296 INFO:tasks.workunit.client.0.smithi084.stdout:9/101: truncate da/fb 764259 0 2024-04-26T21:25:50.297 INFO:tasks.workunit.client.1.smithi120.stdout:3/367: link dd/de/df/d12/d48/f55 dd/de/d18/d24/f7a 0 2024-04-26T21:25:50.297 INFO:tasks.workunit.client.0.smithi084.stdout:2/254: creat d6/d7/d3d/d15/d1f/d39/d20/d36/f5d x:0 0 0 2024-04-26T21:25:50.298 INFO:tasks.workunit.client.1.smithi120.stdout:8/388: dread d5/d6/d11/f10 [0,4194304] 0 2024-04-26T21:25:50.301 INFO:tasks.workunit.client.0.smithi084.stdout:3/164: fsync d1/d2c/d2f/f1f 0 2024-04-26T21:25:50.304 INFO:tasks.workunit.client.1.smithi120.stdout:9/363: symlink d0/d6/d4d/d65/l7a 0 2024-04-26T21:25:50.308 INFO:tasks.workunit.client.1.smithi120.stdout:9/364: write d0/d14/d2d/d4b/f6f [600685,15494] 0 2024-04-26T21:25:50.310 INFO:tasks.workunit.client.1.smithi120.stdout:9/365: stat d0/d66 0 2024-04-26T21:25:50.311 INFO:tasks.workunit.client.0.smithi084.stdout:7/141: chown d6/d9/d12/d19/d20/l21 3835149 1 2024-04-26T21:25:50.313 INFO:tasks.workunit.client.0.smithi084.stdout:8/155: truncate d4/d6/f8 5547443 0 2024-04-26T21:25:50.313 INFO:tasks.workunit.client.1.smithi120.stdout:4/361: dwrite d10/f6c [4194304,4194304] 0 2024-04-26T21:25:50.314 INFO:tasks.workunit.client.0.smithi084.stdout:9/102: mkdir da/d22 0 2024-04-26T21:25:50.318 INFO:tasks.workunit.client.0.smithi084.stdout:3/165: mkdir d1/d24/d27/d3a 0 2024-04-26T21:25:50.318 INFO:tasks.workunit.client.1.smithi120.stdout:8/389: getdents d5/d6/d11/d52/d27/d4f 0 2024-04-26T21:25:50.319 INFO:tasks.workunit.client.0.smithi084.stdout:2/255: mkdir d6/d7/d3d/d15/d1f/d39/d43/d5e 0 2024-04-26T21:25:50.321 INFO:tasks.workunit.client.1.smithi120.stdout:3/368: dwrite dd/de/df/d12/f21 [0,4194304] 0 2024-04-26T21:25:50.325 INFO:tasks.workunit.client.1.smithi120.stdout:9/366: dread d0/d6/d3d/f75 [0,4194304] 0 2024-04-26T21:25:50.326 INFO:tasks.workunit.client.1.smithi120.stdout:3/369: chown dd/de/d18/d24/d43/f53 430913850 1 2024-04-26T21:25:50.329 INFO:tasks.workunit.client.0.smithi084.stdout:3/166: mkdir d1/d2c/d2f/d31/d3b 0 2024-04-26T21:25:50.331 INFO:tasks.workunit.client.1.smithi120.stdout:4/362: creat d10/d6b/f7d x:0 0 0 2024-04-26T21:25:50.334 INFO:tasks.workunit.client.1.smithi120.stdout:8/390: rmdir d5/d6/d11/d52/d70 39 2024-04-26T21:25:50.336 INFO:tasks.workunit.client.0.smithi084.stdout:9/103: write da/de/f12 [4491183,120697] 0 2024-04-26T21:25:50.338 INFO:tasks.workunit.client.0.smithi084.stdout:2/256: write d6/d7/d3d/d15/d1f/d39/d20/d36/f5d [319264,126179] 0 2024-04-26T21:25:50.338 INFO:tasks.workunit.client.1.smithi120.stdout:9/367: rmdir d0/dd/d3a 39 2024-04-26T21:25:50.345 INFO:tasks.workunit.client.1.smithi120.stdout:3/370: creat dd/de/d18/d2c/d76/d3b/d56/d75/f7b x:0 0 0 2024-04-26T21:25:50.345 INFO:tasks.workunit.client.0.smithi084.stdout:5/137: dwrite d0/fe [0,4194304] 0 2024-04-26T21:25:50.345 INFO:tasks.workunit.client.0.smithi084.stdout:3/167: creat d1/d2c/f3c x:0 0 0 2024-04-26T21:25:50.346 INFO:tasks.workunit.client.1.smithi120.stdout:7/393: write d7/d10/d12/d1f/f36 [812564,36935] 0 2024-04-26T21:25:50.349 INFO:tasks.workunit.client.1.smithi120.stdout:4/363: creat d10/d65/f7e x:0 0 0 2024-04-26T21:25:50.352 INFO:tasks.workunit.client.1.smithi120.stdout:0/473: truncate d0/d3/dc/d12/d4a/f4d 618455 0 2024-04-26T21:25:50.352 INFO:tasks.workunit.client.0.smithi084.stdout:3/168: dread - d1/d2c/f3c zero size 2024-04-26T21:25:50.353 INFO:tasks.workunit.client.0.smithi084.stdout:2/257: chown d6/d7/d3d/d15/d1f/d39/d20/d45/f51 884649944 1 2024-04-26T21:25:50.353 INFO:tasks.workunit.client.0.smithi084.stdout:9/104: creat da/f23 x:0 0 0 2024-04-26T21:25:50.356 INFO:tasks.workunit.client.1.smithi120.stdout:9/368: creat d0/d6/d3d/f7b x:0 0 0 2024-04-26T21:25:50.357 INFO:tasks.workunit.client.0.smithi084.stdout:8/156: dwrite d4/d7/d9/f21 [0,4194304] 0 2024-04-26T21:25:50.357 INFO:tasks.workunit.client.0.smithi084.stdout:9/105: stat da/de/f15 0 2024-04-26T21:25:50.359 INFO:tasks.workunit.client.1.smithi120.stdout:3/371: mkdir dd/de/d18/d37/d7c 0 2024-04-26T21:25:50.360 INFO:tasks.workunit.client.0.smithi084.stdout:3/169: chown d1/d2c/d2f/f18 442273437 1 2024-04-26T21:25:50.361 INFO:tasks.workunit.client.1.smithi120.stdout:0/474: fsync d0/d3/dc/dd/f21 0 2024-04-26T21:25:50.361 INFO:tasks.workunit.client.1.smithi120.stdout:4/364: dread d10/f6c [4194304,4194304] 0 2024-04-26T21:25:50.363 INFO:tasks.workunit.client.1.smithi120.stdout:8/391: write d5/d6/d11/d52/d70/f40 [753135,49358] 0 2024-04-26T21:25:50.366 INFO:tasks.workunit.client.0.smithi084.stdout:5/138: creat d0/f22 x:0 0 0 2024-04-26T21:25:50.368 INFO:tasks.workunit.client.0.smithi084.stdout:5/139: stat d0/dc/f19 0 2024-04-26T21:25:50.370 INFO:tasks.workunit.client.0.smithi084.stdout:7/142: dwrite d6/d9/d12/f2c [0,4194304] 0 2024-04-26T21:25:50.370 INFO:tasks.workunit.client.0.smithi084.stdout:8/157: truncate d4/d7/d9/f2c 681314 0 2024-04-26T21:25:50.371 INFO:tasks.workunit.client.0.smithi084.stdout:3/170: fdatasync d1/d2c/d2f/f2e 0 2024-04-26T21:25:50.374 INFO:tasks.workunit.client.0.smithi084.stdout:3/171: fdatasync d1/d24/d27/f30 0 2024-04-26T21:25:50.381 INFO:tasks.workunit.client.0.smithi084.stdout:8/158: unlink d4/d6/f1a 0 2024-04-26T21:25:50.381 INFO:tasks.workunit.client.0.smithi084.stdout:0/139: sync 2024-04-26T21:25:50.382 INFO:tasks.workunit.client.0.smithi084.stdout:9/106: unlink c6 0 2024-04-26T21:25:50.384 INFO:tasks.workunit.client.0.smithi084.stdout:7/143: symlink d6/l2f 0 2024-04-26T21:25:50.386 INFO:tasks.workunit.client.0.smithi084.stdout:0/140: chown de/d1c/f1d 0 1 2024-04-26T21:25:50.387 INFO:tasks.workunit.client.1.smithi120.stdout:9/369: write d0/f54 [1064844,80065] 0 2024-04-26T21:25:50.387 INFO:tasks.workunit.client.0.smithi084.stdout:0/141: stat de 0 2024-04-26T21:25:50.389 INFO:tasks.workunit.client.0.smithi084.stdout:8/159: symlink d4/d7/d9/l2d 0 2024-04-26T21:25:50.389 INFO:tasks.workunit.client.0.smithi084.stdout:7/144: chown d6/d9/d12/f2c 0 1 2024-04-26T21:25:50.390 INFO:tasks.workunit.client.0.smithi084.stdout:9/107: rename da to da/de/d24 22 2024-04-26T21:25:50.391 INFO:tasks.workunit.client.1.smithi120.stdout:3/372: dwrite dd/f5e [0,4194304] 0 2024-04-26T21:25:50.393 INFO:tasks.workunit.client.0.smithi084.stdout:7/145: chown d6/d9/d12 49204 1 2024-04-26T21:25:50.395 INFO:tasks.workunit.client.0.smithi084.stdout:0/142: write f4 [3338935,33424] 0 2024-04-26T21:25:50.395 INFO:tasks.workunit.client.1.smithi120.stdout:0/475: dwrite d0/d3/d51/f58 [4194304,4194304] 0 2024-04-26T21:25:50.397 INFO:tasks.workunit.client.1.smithi120.stdout:9/370: chown d0/d6/l2a 1 1 2024-04-26T21:25:50.399 INFO:tasks.workunit.client.0.smithi084.stdout:3/172: dwrite d1/d2c/d2f/f20 [0,4194304] 0 2024-04-26T21:25:50.399 INFO:tasks.workunit.client.0.smithi084.stdout:0/143: fdatasync de/d20/f24 0 2024-04-26T21:25:50.401 INFO:tasks.workunit.client.1.smithi120.stdout:8/392: dread d5/d6/d11/d52/d27/f53 [0,4194304] 0 2024-04-26T21:25:50.402 INFO:tasks.workunit.client.1.smithi120.stdout:4/365: dread d10/f2d [0,4194304] 0 2024-04-26T21:25:50.403 INFO:tasks.workunit.client.1.smithi120.stdout:7/394: dwrite d7/d10/d12/d1f/d28/f3e [0,4194304] 0 2024-04-26T21:25:50.404 INFO:tasks.workunit.client.0.smithi084.stdout:0/144: stat de/f21 0 2024-04-26T21:25:50.405 INFO:tasks.workunit.client.0.smithi084.stdout:3/173: dread - d1/d24/f36 zero size 2024-04-26T21:25:50.405 INFO:tasks.workunit.client.1.smithi120.stdout:9/371: write d0/dd/d45/f4a [4165435,88456] 0 2024-04-26T21:25:50.407 INFO:tasks.workunit.client.0.smithi084.stdout:5/140: dwrite d0/fd [0,4194304] 0 2024-04-26T21:25:50.408 INFO:tasks.workunit.client.1.smithi120.stdout:8/393: dread - d5/d6/d34/d37/f69 zero size 2024-04-26T21:25:50.409 INFO:tasks.workunit.client.1.smithi120.stdout:0/476: unlink d0/d3/dc/l87 0 2024-04-26T21:25:50.410 INFO:tasks.workunit.client.0.smithi084.stdout:9/108: rmdir da/d22 0 2024-04-26T21:25:50.410 INFO:tasks.workunit.client.0.smithi084.stdout:8/160: truncate d4/d6/f8 1041286 0 2024-04-26T21:25:50.411 INFO:tasks.workunit.client.1.smithi120.stdout:3/373: truncate dd/de/df/d12/d6c/d46/f6e 408791 0 2024-04-26T21:25:50.414 INFO:tasks.workunit.client.0.smithi084.stdout:0/145: symlink de/d2b/l2c 0 2024-04-26T21:25:50.416 INFO:tasks.workunit.client.1.smithi120.stdout:8/394: fdatasync d5/d6/d11/d32/d3b/f6f 0 2024-04-26T21:25:50.418 INFO:tasks.workunit.client.0.smithi084.stdout:8/161: chown d4/d7/d9/fd 228 1 2024-04-26T21:25:50.418 INFO:tasks.workunit.client.1.smithi120.stdout:7/395: rename d7/d10/d12/f42 to d7/d10/d12/d1f/d28/d4c/f89 0 2024-04-26T21:25:50.420 INFO:tasks.workunit.client.0.smithi084.stdout:9/109: mkdir da/de/d16/d25 0 2024-04-26T21:25:50.420 INFO:tasks.workunit.client.1.smithi120.stdout:3/374: symlink dd/de/df/d12/d6c/l7d 0 2024-04-26T21:25:50.424 INFO:tasks.workunit.client.0.smithi084.stdout:9/110: fsync da/de/f13 0 2024-04-26T21:25:50.424 INFO:tasks.workunit.client.1.smithi120.stdout:4/366: link d10/c1c d10/d65/d72/c7f 0 2024-04-26T21:25:50.424 INFO:tasks.workunit.client.1.smithi120.stdout:7/396: read d7/d10/d12/d1f/f36 [1615814,66479] 0 2024-04-26T21:25:50.424 INFO:tasks.workunit.client.1.smithi120.stdout:9/372: rmdir d0/d6/d79 0 2024-04-26T21:25:50.425 INFO:tasks.workunit.client.0.smithi084.stdout:0/146: symlink de/d2b/l2d 0 2024-04-26T21:25:50.425 INFO:tasks.workunit.client.1.smithi120.stdout:8/395: mknod d5/d6/d34/d37/d60/d55/d7a/c82 0 2024-04-26T21:25:50.426 INFO:tasks.workunit.client.0.smithi084.stdout:0/147: chown de/c1b 6699 1 2024-04-26T21:25:50.428 INFO:tasks.workunit.client.1.smithi120.stdout:3/375: dread dd/de/d18/d24/f54 [0,4194304] 0 2024-04-26T21:25:50.429 INFO:tasks.workunit.client.1.smithi120.stdout:9/373: fsync d0/f4f 0 2024-04-26T21:25:50.433 INFO:tasks.workunit.client.0.smithi084.stdout:3/174: dwrite d1/d24/d27/f32 [0,4194304] 0 2024-04-26T21:25:50.433 INFO:tasks.workunit.client.1.smithi120.stdout:8/396: truncate d5/d6/d34/d37/d60/f5c 32189 0 2024-04-26T21:25:50.435 INFO:tasks.workunit.client.1.smithi120.stdout:0/477: dread d0/d3/d13/d64/f69 [0,4194304] 0 2024-04-26T21:25:50.436 INFO:tasks.workunit.client.1.smithi120.stdout:4/367: creat d10/d65/d72/f80 x:0 0 0 2024-04-26T21:25:50.437 INFO:tasks.workunit.client.1.smithi120.stdout:7/397: rmdir d7/d19/d60 39 2024-04-26T21:25:50.439 INFO:tasks.workunit.client.0.smithi084.stdout:7/146: dread d6/d9/d12/f2c [0,4194304] 0 2024-04-26T21:25:50.440 INFO:tasks.workunit.client.1.smithi120.stdout:8/397: write d5/d6/d34/d42/f49 [1102346,110021] 0 2024-04-26T21:25:50.440 INFO:tasks.workunit.client.1.smithi120.stdout:3/376: write dd/de/d18/d24/f54 [1112870,88187] 0 2024-04-26T21:25:50.440 INFO:tasks.workunit.client.1.smithi120.stdout:4/368: read d10/f24 [3039419,50132] 0 2024-04-26T21:25:50.448 INFO:tasks.workunit.client.1.smithi120.stdout:9/374: dread d0/d14/d2d/f2f [0,4194304] 0 2024-04-26T21:25:50.450 INFO:tasks.workunit.client.1.smithi120.stdout:0/478: rename d0/d3/dc/f8d to d0/df/d59/fa7 0 2024-04-26T21:25:50.450 INFO:tasks.workunit.client.1.smithi120.stdout:9/375: dread - d0/dd/d34/f64 zero size 2024-04-26T21:25:50.452 INFO:tasks.workunit.client.0.smithi084.stdout:0/148: rmdir de 39 2024-04-26T21:25:50.454 INFO:tasks.workunit.client.0.smithi084.stdout:8/162: getdents d4/d6/db 0 2024-04-26T21:25:50.456 INFO:tasks.workunit.client.1.smithi120.stdout:8/398: mkdir d5/d6/d34/d37/d60/d55/d83 0 2024-04-26T21:25:50.456 INFO:tasks.workunit.client.1.smithi120.stdout:4/369: symlink d10/d6b/l81 0 2024-04-26T21:25:50.458 INFO:tasks.workunit.client.0.smithi084.stdout:9/111: symlink da/l26 0 2024-04-26T21:25:50.460 INFO:tasks.workunit.client.0.smithi084.stdout:8/163: truncate d4/d7/d9/f27 878826 0 2024-04-26T21:25:50.460 INFO:tasks.workunit.client.0.smithi084.stdout:8/164: chown d4/d7/d9 2589615 1 2024-04-26T21:25:50.461 INFO:tasks.workunit.client.1.smithi120.stdout:3/377: symlink dd/de/d18/l7e 0 2024-04-26T21:25:50.462 INFO:tasks.workunit.client.1.smithi120.stdout:3/378: fdatasync dd/f5e 0 2024-04-26T21:25:50.463 INFO:tasks.workunit.client.1.smithi120.stdout:8/399: fdatasync d5/d6/d34/d42/d4a/f57 0 2024-04-26T21:25:50.465 INFO:tasks.workunit.client.1.smithi120.stdout:4/370: rename d10/f24 to d10/d6b/d71/f82 0 2024-04-26T21:25:50.466 INFO:tasks.workunit.client.1.smithi120.stdout:7/398: link d7/d10/d12/d1f/d28/f3d d7/d64/f8a 0 2024-04-26T21:25:50.466 INFO:tasks.workunit.client.0.smithi084.stdout:3/175: truncate d1/f22 861807 0 2024-04-26T21:25:50.467 INFO:tasks.workunit.client.0.smithi084.stdout:0/149: mknod de/d20/c2e 0 2024-04-26T21:25:50.468 INFO:tasks.workunit.client.0.smithi084.stdout:5/141: dwrite d0/fa [0,4194304] 0 2024-04-26T21:25:50.469 INFO:tasks.workunit.client.1.smithi120.stdout:3/379: creat dd/d2a/f7f x:0 0 0 2024-04-26T21:25:50.471 INFO:tasks.workunit.client.0.smithi084.stdout:9/112: rename da/f10 to da/de/d1e/f27 0 2024-04-26T21:25:50.471 INFO:tasks.workunit.client.1.smithi120.stdout:9/376: link d0/f18 d0/f7c 0 2024-04-26T21:25:50.472 INFO:tasks.workunit.client.1.smithi120.stdout:7/399: mkdir d7/d10/d12/d1f/d7d/d8b 0 2024-04-26T21:25:50.473 INFO:tasks.workunit.client.1.smithi120.stdout:0/479: dwrite d0/d3/d51/d97/fa5 [0,4194304] 0 2024-04-26T21:25:50.474 INFO:tasks.workunit.client.1.smithi120.stdout:2/439: sync 2024-04-26T21:25:50.474 INFO:tasks.workunit.client.1.smithi120.stdout:1/368: sync 2024-04-26T21:25:50.474 INFO:tasks.workunit.client.1.smithi120.stdout:5/450: sync 2024-04-26T21:25:50.474 INFO:tasks.workunit.client.1.smithi120.stdout:6/427: sync 2024-04-26T21:25:50.475 INFO:tasks.workunit.client.1.smithi120.stdout:4/371: link d10/d12/f58 d10/d28/d73/f83 0 2024-04-26T21:25:50.477 INFO:tasks.workunit.client.1.smithi120.stdout:3/380: rmdir dd/de/d18/d24 39 2024-04-26T21:25:50.480 INFO:tasks.workunit.client.0.smithi084.stdout:7/147: dwrite d6/f2a [4194304,4194304] 0 2024-04-26T21:25:50.481 INFO:tasks.workunit.client.1.smithi120.stdout:0/480: stat d0/d3/dc/d12/f47 0 2024-04-26T21:25:50.482 INFO:tasks.workunit.client.1.smithi120.stdout:0/481: stat d0/d3/d51 0 2024-04-26T21:25:50.487 INFO:tasks.workunit.client.0.smithi084.stdout:8/165: dwrite d4/d6/f24 [0,4194304] 0 2024-04-26T21:25:50.490 INFO:tasks.workunit.client.1.smithi120.stdout:8/400: rename d5/d6/d34/d37/f64 to d5/d6/d34/d42/f84 0 2024-04-26T21:25:50.491 INFO:tasks.workunit.client.1.smithi120.stdout:2/440: chown d4/l1f 476322 1 2024-04-26T21:25:50.493 INFO:tasks.workunit.client.0.smithi084.stdout:4/133: sync 2024-04-26T21:25:50.493 INFO:tasks.workunit.client.0.smithi084.stdout:1/138: sync 2024-04-26T21:25:50.497 INFO:tasks.workunit.client.0.smithi084.stdout:0/150: dwrite de/f1e [0,4194304] 0 2024-04-26T21:25:50.497 INFO:tasks.workunit.client.0.smithi084.stdout:3/176: getdents d1/d24/d27/d3a 0 2024-04-26T21:25:50.500 INFO:tasks.workunit.client.0.smithi084.stdout:7/148: creat d6/d26/f30 x:0 0 0 2024-04-26T21:25:50.501 INFO:tasks.workunit.client.1.smithi120.stdout:8/401: mkdir d5/d6/d11/d52/d27/d4f/d67/d85 0 2024-04-26T21:25:50.502 INFO:tasks.workunit.client.0.smithi084.stdout:0/151: stat de/d1c/f1d 0 2024-04-26T21:25:50.505 INFO:tasks.workunit.client.0.smithi084.stdout:7/149: truncate d6/d9/d12/f2c 4825672 0 2024-04-26T21:25:50.505 INFO:tasks.workunit.client.1.smithi120.stdout:9/377: rename d0/dd/c30 to d0/c7d 0 2024-04-26T21:25:50.506 INFO:tasks.workunit.client.0.smithi084.stdout:0/152: chown de/l13 214 1 2024-04-26T21:25:50.510 INFO:tasks.workunit.client.0.smithi084.stdout:5/142: rename d0/f6 to d0/dc/df/f23 0 2024-04-26T21:25:50.512 INFO:tasks.workunit.client.0.smithi084.stdout:9/113: mknod da/de/c28 0 2024-04-26T21:25:50.518 INFO:tasks.workunit.client.0.smithi084.stdout:8/166: dwrite d4/d7/d9/f2c [0,4194304] 0 2024-04-26T21:25:50.521 INFO:tasks.workunit.client.1.smithi120.stdout:5/451: rename d2/f17 to d2/dc/d1d/d21/d66/d4d/f99 0 2024-04-26T21:25:50.522 INFO:tasks.workunit.client.1.smithi120.stdout:7/400: dwrite d7/d10/d12/d1a/d33/f5b [0,4194304] 0 2024-04-26T21:25:50.524 INFO:tasks.workunit.client.1.smithi120.stdout:8/402: creat d5/d6/d34/d37/d60/d55/f86 x:0 0 0 2024-04-26T21:25:50.524 INFO:tasks.workunit.client.0.smithi084.stdout:8/167: readlink d4/d6/db/l11 0 2024-04-26T21:25:50.524 INFO:tasks.workunit.client.0.smithi084.stdout:3/177: symlink d1/d24/d27/l3d 0 2024-04-26T21:25:50.525 INFO:tasks.workunit.client.0.smithi084.stdout:7/150: creat d6/dc/f31 x:0 0 0 2024-04-26T21:25:50.525 INFO:tasks.workunit.client.1.smithi120.stdout:4/372: dwrite d10/d12/f55 [0,4194304] 0 2024-04-26T21:25:50.526 INFO:tasks.workunit.client.0.smithi084.stdout:3/178: stat d1/d2c 0 2024-04-26T21:25:50.530 INFO:tasks.workunit.client.1.smithi120.stdout:6/428: dwrite d4/db/d10/d22/f62 [0,4194304] 0 2024-04-26T21:25:50.531 INFO:tasks.workunit.client.0.smithi084.stdout:4/134: rename d5/d25/c26 to d5/d10/d15/d21/d29/c31 0 2024-04-26T21:25:50.531 INFO:tasks.workunit.client.0.smithi084.stdout:3/179: truncate d1/d24/f25 733602 0 2024-04-26T21:25:50.533 INFO:tasks.workunit.client.1.smithi120.stdout:7/401: dread - d7/d10/d12/f7a zero size 2024-04-26T21:25:50.534 INFO:tasks.workunit.client.0.smithi084.stdout:9/114: creat da/de/d1e/f29 x:0 0 0 2024-04-26T21:25:50.536 INFO:tasks.workunit.client.1.smithi120.stdout:1/369: dread d6/d7/d1d/d5d/d67/fb [0,4194304] 0 2024-04-26T21:25:50.537 INFO:tasks.workunit.client.1.smithi120.stdout:0/482: dwrite d0/d3/dc/dd/d1b/fa1 [0,4194304] 0 2024-04-26T21:25:50.538 INFO:tasks.workunit.client.0.smithi084.stdout:7/151: mkdir d6/d9/d12/d19/d20/d32 0 2024-04-26T21:25:50.539 INFO:tasks.workunit.client.0.smithi084.stdout:4/135: dread d5/d10/f18 [0,4194304] 0 2024-04-26T21:25:50.540 INFO:tasks.workunit.client.0.smithi084.stdout:0/153: rename de/l25 to de/d2b/l2f 0 2024-04-26T21:25:50.541 INFO:tasks.workunit.client.1.smithi120.stdout:6/429: dread - d4/db/d10/dd/d4e/d5d/f8c zero size 2024-04-26T21:25:50.546 INFO:tasks.workunit.client.0.smithi084.stdout:5/143: link d0/f16 d0/dc/df/f24 0 2024-04-26T21:25:50.547 INFO:tasks.workunit.client.0.smithi084.stdout:7/152: creat d6/d9/d12/f33 x:0 0 0 2024-04-26T21:25:50.548 INFO:tasks.workunit.client.1.smithi120.stdout:4/373: mknod d10/d65/d72/c84 0 2024-04-26T21:25:50.548 INFO:tasks.workunit.client.1.smithi120.stdout:3/381: dwrite dd/d2a/f71 [0,4194304] 0 2024-04-26T21:25:50.548 INFO:tasks.workunit.client.1.smithi120.stdout:8/403: write d5/d6/d11/f6b [5886513,28350] 0 2024-04-26T21:25:50.548 INFO:tasks.workunit.client.1.smithi120.stdout:0/483: write d0/d3/dc/f44 [2191981,13773] 0 2024-04-26T21:25:50.549 INFO:tasks.workunit.client.0.smithi084.stdout:9/115: rename da/de/f15 to da/de/d16/d25/f2a 0 2024-04-26T21:25:50.552 INFO:tasks.workunit.client.1.smithi120.stdout:5/452: symlink d2/dc/d1d/d21/d66/d6a/l9a 0 2024-04-26T21:25:50.554 INFO:tasks.workunit.client.0.smithi084.stdout:4/136: write d5/d7/f16 [2082534,55065] 0 2024-04-26T21:25:50.554 INFO:tasks.workunit.client.0.smithi084.stdout:5/144: symlink d0/dc/df/l25 0 2024-04-26T21:25:50.557 INFO:tasks.workunit.client.0.smithi084.stdout:9/116: readlink l8 0 2024-04-26T21:25:50.558 INFO:tasks.workunit.client.0.smithi084.stdout:8/168: dwrite d4/d7/f14 [4194304,4194304] 0 2024-04-26T21:25:50.560 INFO:tasks.workunit.client.0.smithi084.stdout:7/153: read d6/d9/ff [1975458,84292] 0 2024-04-26T21:25:50.561 INFO:tasks.workunit.client.0.smithi084.stdout:3/180: link d1/c15 d1/d2c/d2f/d31/d3b/c3e 0 2024-04-26T21:25:50.562 INFO:tasks.workunit.client.1.smithi120.stdout:5/453: fdatasync d2/d30/f2f 0 2024-04-26T21:25:50.563 INFO:tasks.workunit.client.1.smithi120.stdout:2/441: rename d4/d1b/d2e/f35 to d4/d1b/d25/f90 0 2024-04-26T21:25:50.563 INFO:tasks.workunit.client.1.smithi120.stdout:8/404: dread d5/f15 [0,4194304] 0 2024-04-26T21:25:50.564 INFO:tasks.workunit.client.1.smithi120.stdout:3/382: mkdir dd/de/d18/d37/d80 0 2024-04-26T21:25:50.564 INFO:tasks.workunit.client.1.smithi120.stdout:6/430: unlink d4/db/d10/dd/d4e/d5d/f8c 0 2024-04-26T21:25:50.564 INFO:tasks.workunit.client.0.smithi084.stdout:4/137: stat d5/d10/d15/d21/l22 0 2024-04-26T21:25:50.566 INFO:tasks.workunit.client.0.smithi084.stdout:9/117: chown f3 10083 1 2024-04-26T21:25:50.570 INFO:tasks.workunit.client.0.smithi084.stdout:8/169: write d4/d7/f16 [2065640,60048] 0 2024-04-26T21:25:50.571 INFO:tasks.workunit.client.0.smithi084.stdout:3/181: unlink d1/d2c/d2f/f11 0 2024-04-26T21:25:50.571 INFO:tasks.workunit.client.0.smithi084.stdout:5/145: symlink d0/l26 0 2024-04-26T21:25:50.572 INFO:tasks.workunit.client.0.smithi084.stdout:6/140: sync 2024-04-26T21:25:50.572 INFO:tasks.workunit.client.0.smithi084.stdout:2/258: sync 2024-04-26T21:25:50.573 INFO:tasks.workunit.client.0.smithi084.stdout:3/182: dread - d1/f1d zero size 2024-04-26T21:25:50.574 INFO:tasks.workunit.client.0.smithi084.stdout:7/154: rename d6/l2f to d6/d9/d12/d19/d20/l34 0 2024-04-26T21:25:50.575 INFO:tasks.workunit.client.0.smithi084.stdout:4/138: mkdir d5/d7/d17/d32 0 2024-04-26T21:25:50.583 INFO:tasks.workunit.client.1.smithi120.stdout:3/383: dread - dd/de/d18/d24/d43/f53 zero size 2024-04-26T21:25:50.583 INFO:tasks.workunit.client.1.smithi120.stdout:5/454: symlink d2/d30/d3b/l9b 0 2024-04-26T21:25:50.585 INFO:tasks.workunit.client.0.smithi084.stdout:5/146: symlink d0/dc/df/l27 0 2024-04-26T21:25:50.586 INFO:tasks.workunit.client.1.smithi120.stdout:1/370: dwrite d6/d7/f59 [0,4194304] 0 2024-04-26T21:25:50.588 INFO:tasks.workunit.client.0.smithi084.stdout:5/147: read - d0/dc/f1c zero size 2024-04-26T21:25:50.591 INFO:tasks.workunit.client.1.smithi120.stdout:4/374: dwrite d10/d12/f51 [0,4194304] 0 2024-04-26T21:25:50.599 INFO:tasks.workunit.client.1.smithi120.stdout:0/484: dwrite d0/d3/d13/d81/f85 [0,4194304] 0 2024-04-26T21:25:50.600 INFO:tasks.workunit.client.1.smithi120.stdout:5/455: mkdir d2/dc/d1d/d21/d77/d9c 0 2024-04-26T21:25:50.601 INFO:tasks.workunit.client.0.smithi084.stdout:8/170: rename d4/d6/f8 to d4/d6/db/d1e/d22/f2e 0 2024-04-26T21:25:50.602 INFO:tasks.workunit.client.1.smithi120.stdout:5/456: fsync d2/d30/f2f 0 2024-04-26T21:25:50.602 INFO:tasks.workunit.client.1.smithi120.stdout:3/384: creat dd/de/d18/d2c/d76/d28/f81 x:0 0 0 2024-04-26T21:25:50.602 INFO:tasks.workunit.client.0.smithi084.stdout:3/183: dread d1/d2c/d2f/f13 [0,4194304] 0 2024-04-26T21:25:50.602 INFO:tasks.workunit.client.1.smithi120.stdout:0/485: chown d0/df/d59 77 1 2024-04-26T21:25:50.603 INFO:tasks.workunit.client.0.smithi084.stdout:6/141: truncate d3/d18/f2b 1579979 0 2024-04-26T21:25:50.603 INFO:tasks.workunit.client.0.smithi084.stdout:2/259: link d6/d1b/c21 d6/d7/d3d/d15/d1f/d39/d20/d45/c5f 0 2024-04-26T21:25:50.605 INFO:tasks.workunit.client.0.smithi084.stdout:5/148: chown d0/dc/df/d21 441507793 1 2024-04-26T21:25:50.606 INFO:tasks.workunit.client.1.smithi120.stdout:5/457: chown d2/dc/d1d/d21/d77/f86 3226374 1 2024-04-26T21:25:50.607 INFO:tasks.workunit.client.0.smithi084.stdout:4/139: link d5/c11 d5/d25/c33 0 2024-04-26T21:25:50.608 INFO:tasks.workunit.client.0.smithi084.stdout:2/260: read - d6/d7/d3d/f57 zero size 2024-04-26T21:25:50.609 INFO:tasks.workunit.client.0.smithi084.stdout:3/184: write d1/d2c/f3c [5205,41933] 0 2024-04-26T21:25:50.613 INFO:tasks.workunit.client.1.smithi120.stdout:9/378: rename d0/dd/d34/f57 to d0/dd/f7e 0 2024-04-26T21:25:50.617 INFO:tasks.workunit.client.1.smithi120.stdout:9/379: write d0/d14/f24 [1330858,80814] 0 2024-04-26T21:25:50.620 INFO:tasks.workunit.client.0.smithi084.stdout:8/171: rename d4/d7/d9 to d4/d6/db/d1e/d22/d2f 0 2024-04-26T21:25:50.623 INFO:tasks.workunit.client.1.smithi120.stdout:4/375: dwrite d10/d28/f2b [0,4194304] 0 2024-04-26T21:25:50.625 INFO:tasks.workunit.client.0.smithi084.stdout:9/118: dwrite da/fc [0,4194304] 0 2024-04-26T21:25:50.625 INFO:tasks.workunit.client.1.smithi120.stdout:9/380: read d0/d6/d3d/f4e [166058,22321] 0 2024-04-26T21:25:50.627 INFO:tasks.workunit.client.1.smithi120.stdout:1/371: read d6/d7/d1d/d2c/f31 [2113003,127870] 0 2024-04-26T21:25:50.628 INFO:tasks.workunit.client.0.smithi084.stdout:1/139: dread d2/d19/f1e [0,4194304] 0 2024-04-26T21:25:50.631 INFO:tasks.workunit.client.1.smithi120.stdout:9/381: fdatasync d0/dd/d45/f51 0 2024-04-26T21:25:50.632 INFO:tasks.workunit.client.0.smithi084.stdout:3/185: mkdir d1/d2c/d2f/d31/d3b/d3f 0 2024-04-26T21:25:50.634 INFO:tasks.workunit.client.0.smithi084.stdout:9/119: dread f3 [0,4194304] 0 2024-04-26T21:25:50.635 INFO:tasks.workunit.client.1.smithi120.stdout:6/431: write d4/db/d25/d6d/f84 [5210922,81128] 0 2024-04-26T21:25:50.636 INFO:tasks.workunit.client.0.smithi084.stdout:8/172: rename d4/d7/f2b to d4/d7/d15/f30 0 2024-04-26T21:25:50.636 INFO:tasks.workunit.client.0.smithi084.stdout:0/154: dread de/d1c/f2a [0,4194304] 0 2024-04-26T21:25:50.642 INFO:tasks.workunit.client.0.smithi084.stdout:8/173: stat d4/d6/db/d1e 0 2024-04-26T21:25:50.642 INFO:tasks.workunit.client.0.smithi084.stdout:7/155: dwrite d6/d9/ff [0,4194304] 0 2024-04-26T21:25:50.643 INFO:tasks.workunit.client.1.smithi120.stdout:4/376: dread d10/d12/f45 [0,4194304] 0 2024-04-26T21:25:50.648 INFO:tasks.workunit.client.0.smithi084.stdout:7/156: chown d6/d9/ff 348538 1 2024-04-26T21:25:50.652 INFO:tasks.workunit.client.1.smithi120.stdout:1/372: dwrite d6/d7/d1b/d3b/f7f [0,4194304] 0 2024-04-26T21:25:50.652 INFO:tasks.workunit.client.1.smithi120.stdout:0/486: mknod d0/d3/d51/d70/ca8 0 2024-04-26T21:25:50.656 INFO:tasks.workunit.client.0.smithi084.stdout:5/149: dread d0/f2 [0,4194304] 0 2024-04-26T21:25:50.657 INFO:tasks.workunit.client.0.smithi084.stdout:7/157: write d6/d9/f2d [2723135,28576] 0 2024-04-26T21:25:50.660 INFO:tasks.workunit.client.1.smithi120.stdout:5/458: mknod d2/dc/d1d/c9d 0 2024-04-26T21:25:50.661 INFO:tasks.workunit.client.1.smithi120.stdout:5/459: chown d2 2036 1 2024-04-26T21:25:50.665 INFO:tasks.workunit.client.0.smithi084.stdout:5/150: truncate d0/fa 4281943 0 2024-04-26T21:25:50.665 INFO:tasks.workunit.client.1.smithi120.stdout:7/402: dread d7/f8 [4194304,4194304] 0 2024-04-26T21:25:50.668 INFO:tasks.workunit.client.1.smithi120.stdout:6/432: unlink d4/db/d10/d1a/d2b/c68 0 2024-04-26T21:25:50.670 INFO:tasks.workunit.client.1.smithi120.stdout:6/433: write d4/db/f35 [3065993,86925] 0 2024-04-26T21:25:50.670 INFO:tasks.workunit.client.0.smithi084.stdout:8/174: rename d4/d7/c20 to d4/d6/db/d1e/d22/d2f/c31 0 2024-04-26T21:25:50.670 INFO:tasks.workunit.client.0.smithi084.stdout:6/142: dwrite d3/de/d15/df/f21 [0,4194304] 0 2024-04-26T21:25:50.674 INFO:tasks.workunit.client.1.smithi120.stdout:0/487: fsync d0/d3/dc/dd/f21 0 2024-04-26T21:25:50.674 INFO:tasks.workunit.client.0.smithi084.stdout:1/140: dread d2/d9/f11 [0,4194304] 0 2024-04-26T21:25:50.674 INFO:tasks.workunit.client.0.smithi084.stdout:7/158: getdents d6/d9/d12/d19/d20/d32 0 2024-04-26T21:25:50.675 INFO:tasks.workunit.client.1.smithi120.stdout:0/488: chown d0/d3/d51/l93 137687 1 2024-04-26T21:25:50.676 INFO:tasks.workunit.client.0.smithi084.stdout:5/151: write d0/fe [4993312,70477] 0 2024-04-26T21:25:50.676 INFO:tasks.workunit.client.0.smithi084.stdout:8/175: write d4/d6/db/d1e/d22/d2f/f2c [4902452,11549] 0 2024-04-26T21:25:50.677 INFO:tasks.workunit.client.0.smithi084.stdout:1/141: chown d2/cd 898874 1 2024-04-26T21:25:50.678 INFO:tasks.workunit.client.1.smithi120.stdout:8/405: rename d5/d6/d11/d52/l36 to d5/d6/d11/d52/d27/d4f/l87 0 2024-04-26T21:25:50.679 INFO:tasks.workunit.client.0.smithi084.stdout:9/120: dread da/de/d16/f1c [0,4194304] 0 2024-04-26T21:25:50.681 INFO:tasks.workunit.client.1.smithi120.stdout:5/460: symlink d2/d1b/d89/d6b/l9e 0 2024-04-26T21:25:50.685 INFO:tasks.workunit.client.1.smithi120.stdout:5/461: write d2/d30/d3b/f94 [961271,111022] 0 2024-04-26T21:25:50.693 INFO:tasks.workunit.client.1.smithi120.stdout:9/382: mknod d0/c7f 0 2024-04-26T21:25:50.702 INFO:tasks.workunit.client.1.smithi120.stdout:6/434: dwrite d4/db/d10/d22/d6c/f70 [0,4194304] 0 2024-04-26T21:25:50.703 INFO:tasks.workunit.client.0.smithi084.stdout:1/142: getdents d2 0 2024-04-26T21:25:50.704 INFO:tasks.workunit.client.0.smithi084.stdout:9/121: getdents da/de/d1e 0 2024-04-26T21:25:50.705 INFO:tasks.workunit.client.0.smithi084.stdout:7/159: dwrite d6/dc/f31 [0,4194304] 0 2024-04-26T21:25:50.706 INFO:tasks.workunit.client.0.smithi084.stdout:1/143: readlink d2/d1b/l1c 0 2024-04-26T21:25:50.708 INFO:tasks.workunit.client.1.smithi120.stdout:5/462: dread d2/d1b/f35 [0,4194304] 0 2024-04-26T21:25:50.708 INFO:tasks.workunit.client.1.smithi120.stdout:0/489: unlink d0/d3/dc/d12/d4a/la6 0 2024-04-26T21:25:50.708 INFO:tasks.workunit.client.1.smithi120.stdout:6/435: chown d4/db/d10/d1a/d2b 6 1 2024-04-26T21:25:50.709 INFO:tasks.workunit.client.1.smithi120.stdout:2/442: rename d4/d1b/d25/d29/l70 to d4/d1b/d4f/l91 0 2024-04-26T21:25:50.709 INFO:tasks.workunit.client.1.smithi120.stdout:5/463: chown d2/dc/d1d/d1f/d36/f40 8 1 2024-04-26T21:25:50.709 INFO:tasks.workunit.client.0.smithi084.stdout:7/160: read d6/d9/ff [2438304,43612] 0 2024-04-26T21:25:50.710 INFO:tasks.workunit.client.0.smithi084.stdout:6/143: dwrite d3/de/d1a/f22 [0,4194304] 0 2024-04-26T21:25:50.714 INFO:tasks.workunit.client.0.smithi084.stdout:6/144: readlink d3/de/d1a/l19 0 2024-04-26T21:25:50.716 INFO:tasks.workunit.client.0.smithi084.stdout:1/144: write d2/d9/d15/f1f [541941,121962] 0 2024-04-26T21:25:50.716 INFO:tasks.workunit.client.0.smithi084.stdout:8/176: getdents d4/d7 0 2024-04-26T21:25:50.719 INFO:tasks.workunit.client.0.smithi084.stdout:5/152: write d0/dc/df/f24 [1014587,64995] 0 2024-04-26T21:25:50.719 INFO:tasks.workunit.client.1.smithi120.stdout:7/403: mknod d7/d10/d12/d1f/d28/c8c 0 2024-04-26T21:25:50.720 INFO:tasks.workunit.client.0.smithi084.stdout:1/145: write d2/d9/d15/f25 [684680,93526] 0 2024-04-26T21:25:50.721 INFO:tasks.workunit.client.1.smithi120.stdout:7/404: dread - d7/d10/d12/d1f/f88 zero size 2024-04-26T21:25:50.723 INFO:tasks.workunit.client.0.smithi084.stdout:5/153: write d0/dc/df/f24 [133931,99721] 0 2024-04-26T21:25:50.729 INFO:tasks.workunit.client.1.smithi120.stdout:6/436: write d4/f1f [1391503,63975] 0 2024-04-26T21:25:50.736 INFO:tasks.workunit.client.0.smithi084.stdout:3/186: dread d1/d2c/d2f/f1f [0,4194304] 0 2024-04-26T21:25:50.737 INFO:tasks.workunit.client.0.smithi084.stdout:1/146: dread d2/d9/d17/f18 [0,4194304] 0 2024-04-26T21:25:50.740 INFO:tasks.workunit.client.0.smithi084.stdout:3/187: write d1/f3 [4946385,90729] 0 2024-04-26T21:25:50.741 INFO:tasks.workunit.client.1.smithi120.stdout:4/377: getdents d10/d28 0 2024-04-26T21:25:50.746 INFO:tasks.workunit.client.0.smithi084.stdout:1/147: write d2/d9/d17/f18 [562586,77143] 0 2024-04-26T21:25:50.746 INFO:tasks.workunit.client.1.smithi120.stdout:5/464: mkdir d2/d9f 0 2024-04-26T21:25:50.747 INFO:tasks.workunit.client.0.smithi084.stdout:3/188: write d1/d2c/d2f/f18 [4573233,47637] 0 2024-04-26T21:25:50.751 INFO:tasks.workunit.client.0.smithi084.stdout:5/154: dread d0/dc/df/f23 [4194304,4194304] 0 2024-04-26T21:25:50.752 INFO:tasks.workunit.client.0.smithi084.stdout:8/177: dwrite d4/d7/d15/f18 [0,4194304] 0 2024-04-26T21:25:50.754 INFO:tasks.workunit.client.0.smithi084.stdout:3/189: mknod d1/c40 0 2024-04-26T21:25:50.754 INFO:tasks.workunit.client.0.smithi084.stdout:1/148: creat d2/d9/d17/f29 x:0 0 0 2024-04-26T21:25:50.754 INFO:tasks.workunit.client.1.smithi120.stdout:7/405: readlink d7/d19/d60/l66 0 2024-04-26T21:25:50.756 INFO:tasks.workunit.client.0.smithi084.stdout:5/155: symlink d0/d17/l28 0 2024-04-26T21:25:50.760 INFO:tasks.workunit.client.0.smithi084.stdout:8/178: write d4/d7/d15/f18 [4518063,68089] 0 2024-04-26T21:25:50.760 INFO:tasks.workunit.client.0.smithi084.stdout:1/149: truncate d2/d9/d17/f29 314365 0 2024-04-26T21:25:50.761 INFO:tasks.workunit.client.0.smithi084.stdout:3/190: unlink d1/d2c/d2f/f34 0 2024-04-26T21:25:50.762 INFO:tasks.workunit.client.1.smithi120.stdout:3/385: truncate dd/de/d18/d2c/d76/d28/f3f 648999 0 2024-04-26T21:25:50.762 INFO:tasks.workunit.client.1.smithi120.stdout:5/465: symlink d2/d48/d63/la0 0 2024-04-26T21:25:50.764 INFO:tasks.workunit.client.0.smithi084.stdout:6/145: dread d3/fc [0,4194304] 0 2024-04-26T21:25:50.764 INFO:tasks.workunit.client.1.smithi120.stdout:2/443: creat d4/d1b/d2e/f92 x:0 0 0 2024-04-26T21:25:50.765 INFO:tasks.workunit.client.1.smithi120.stdout:6/437: fsync d4/db/d10/d1a/d2b/f4c 0 2024-04-26T21:25:50.766 INFO:tasks.workunit.client.1.smithi120.stdout:0/490: link d0/d3/dc/dd/d1b/d39/l5d d0/d3/dc/dd/d9b/la9 0 2024-04-26T21:25:50.768 INFO:tasks.workunit.client.1.smithi120.stdout:4/378: dwrite d10/d12/f40 [4194304,4194304] 0 2024-04-26T21:25:50.768 INFO:tasks.workunit.client.0.smithi084.stdout:5/156: unlink d0/dc/df/f23 0 2024-04-26T21:25:50.768 INFO:tasks.workunit.client.1.smithi120.stdout:1/373: write d6/d7/d2d/d48/f66 [189867,117739] 0 2024-04-26T21:25:50.769 INFO:tasks.workunit.client.0.smithi084.stdout:8/179: mknod d4/d6/db/c32 0 2024-04-26T21:25:50.773 INFO:tasks.workunit.client.0.smithi084.stdout:8/180: write d4/d7/d15/f18 [3076207,57618] 0 2024-04-26T21:25:50.774 INFO:tasks.workunit.client.0.smithi084.stdout:1/150: mkdir d2/d9/d17/d2a 0 2024-04-26T21:25:50.778 INFO:tasks.workunit.client.0.smithi084.stdout:3/191: creat d1/d2c/d2f/d31/d3b/f41 x:0 0 0 2024-04-26T21:25:50.783 INFO:tasks.workunit.client.0.smithi084.stdout:5/157: rename d0/dc/c15 to d0/dc/c29 0 2024-04-26T21:25:50.785 INFO:tasks.workunit.client.0.smithi084.stdout:1/151: rename d2/d9/f11 to d2/d9/d17/f2b 0 2024-04-26T21:25:50.785 INFO:tasks.workunit.client.0.smithi084.stdout:6/146: dwrite d3/d18/f20 [4194304,4194304] 0 2024-04-26T21:25:50.785 INFO:tasks.workunit.client.0.smithi084.stdout:5/158: chown d0/dc/f1a 1601 1 2024-04-26T21:25:50.788 INFO:tasks.workunit.client.0.smithi084.stdout:1/152: read - d2/f22 zero size 2024-04-26T21:25:50.789 INFO:tasks.workunit.client.0.smithi084.stdout:3/192: getdents d1/d24/d27 0 2024-04-26T21:25:50.791 INFO:tasks.workunit.client.0.smithi084.stdout:6/147: mkdir d3/de/d1a/d2f 0 2024-04-26T21:25:50.793 INFO:tasks.workunit.client.0.smithi084.stdout:6/148: write d3/de/d1a/f22 [1764037,5956] 0 2024-04-26T21:25:50.796 INFO:tasks.workunit.client.0.smithi084.stdout:1/153: unlink d2/d9/d17/f21 0 2024-04-26T21:25:50.796 INFO:tasks.workunit.client.0.smithi084.stdout:3/193: symlink d1/d24/d27/l42 0 2024-04-26T21:25:50.798 INFO:tasks.workunit.client.0.smithi084.stdout:8/181: dwrite d4/d6/db/d1e/d22/d2f/fd [4194304,4194304] 0 2024-04-26T21:25:50.805 INFO:tasks.workunit.client.0.smithi084.stdout:8/182: read d4/f5 [211798,96253] 0 2024-04-26T21:25:50.805 INFO:tasks.workunit.client.0.smithi084.stdout:6/149: dread d3/de/d15/df/f1b [0,4194304] 0 2024-04-26T21:25:50.808 INFO:tasks.workunit.client.0.smithi084.stdout:6/150: creat d3/de/d15/d23/f30 x:0 0 0 2024-04-26T21:25:50.812 INFO:tasks.workunit.client.0.smithi084.stdout:8/183: rename d4/d6/db/d1e/d22/d2f/f27 to d4/d6/db/d1e/d22/d2f/f33 0 2024-04-26T21:25:50.814 INFO:tasks.workunit.client.0.smithi084.stdout:6/151: mknod d3/d18/c31 0 2024-04-26T21:25:50.819 INFO:tasks.workunit.client.0.smithi084.stdout:8/184: write d4/d6/db/d1e/d22/d2f/f21 [46691,59165] 0 2024-04-26T21:25:50.819 INFO:tasks.workunit.client.0.smithi084.stdout:1/154: dwrite d2/d9/d17/f29 [0,4194304] 0 2024-04-26T21:25:50.822 INFO:tasks.workunit.client.0.smithi084.stdout:6/152: creat d3/de/d1a/f32 x:0 0 0 2024-04-26T21:25:50.822 INFO:tasks.workunit.client.0.smithi084.stdout:8/185: fsync d4/f12 0 2024-04-26T21:25:50.822 INFO:tasks.workunit.client.0.smithi084.stdout:3/194: dwrite d1/f1d [0,4194304] 0 2024-04-26T21:25:50.825 INFO:tasks.workunit.client.0.smithi084.stdout:6/153: creat d3/d28/f33 x:0 0 0 2024-04-26T21:25:50.826 INFO:tasks.workunit.client.0.smithi084.stdout:3/195: write d1/d2c/d2f/f16 [3017978,100314] 0 2024-04-26T21:25:50.826 INFO:tasks.workunit.client.0.smithi084.stdout:1/155: mkdir d2/d9/d17/d2a/d2c 0 2024-04-26T21:25:50.829 INFO:tasks.workunit.client.0.smithi084.stdout:6/154: chown d3/d18/c31 64042 1 2024-04-26T21:25:50.831 INFO:tasks.workunit.client.0.smithi084.stdout:8/186: write d4/d7/d15/f30 [921724,128143] 0 2024-04-26T21:25:50.833 INFO:tasks.workunit.client.0.smithi084.stdout:1/156: creat d2/d9/d17/d2a/d2c/f2d x:0 0 0 2024-04-26T21:25:50.834 INFO:tasks.workunit.client.0.smithi084.stdout:6/155: mknod d3/de/d1a/c34 0 2024-04-26T21:25:50.835 INFO:tasks.workunit.client.0.smithi084.stdout:8/187: mknod d4/d6/db/c34 0 2024-04-26T21:25:50.836 INFO:tasks.workunit.client.0.smithi084.stdout:3/196: link d1/d2c/d2f/f18 d1/d2c/d2f/d31/f43 0 2024-04-26T21:25:50.837 INFO:tasks.workunit.client.0.smithi084.stdout:1/157: creat d2/f2e x:0 0 0 2024-04-26T21:25:50.838 INFO:tasks.workunit.client.0.smithi084.stdout:3/197: write d1/f23 [996050,114348] 0 2024-04-26T21:25:50.840 INFO:tasks.workunit.client.0.smithi084.stdout:8/188: symlink d4/d6/l35 0 2024-04-26T21:25:50.852 INFO:tasks.workunit.client.0.smithi084.stdout:6/156: dwrite d3/de/d15/df/f21 [0,4194304] 0 2024-04-26T21:25:50.856 INFO:tasks.workunit.client.0.smithi084.stdout:3/198: dwrite d1/d2c/d2f/d31/d3b/f41 [0,4194304] 0 2024-04-26T21:25:50.857 INFO:tasks.workunit.client.0.smithi084.stdout:6/157: truncate d3/d18/f1d 974777 0 2024-04-26T21:25:50.858 INFO:tasks.workunit.client.0.smithi084.stdout:8/189: dwrite d4/f13 [0,4194304] 0 2024-04-26T21:25:50.861 INFO:tasks.workunit.client.0.smithi084.stdout:3/199: readlink d1/l4 0 2024-04-26T21:25:50.866 INFO:tasks.workunit.client.0.smithi084.stdout:6/158: creat d3/de/d15/d23/f35 x:0 0 0 2024-04-26T21:25:50.873 INFO:tasks.workunit.client.0.smithi084.stdout:3/200: creat d1/d2c/d2f/d31/d3b/f44 x:0 0 0 2024-04-26T21:25:50.873 INFO:tasks.workunit.client.0.smithi084.stdout:6/159: rmdir d3/de/d15/df 39 2024-04-26T21:25:50.873 INFO:tasks.workunit.client.0.smithi084.stdout:3/201: chown d1/d2c/c39 8 1 2024-04-26T21:25:50.876 INFO:tasks.workunit.client.0.smithi084.stdout:1/158: dwrite d2/d9/d17/f2b [4194304,4194304] 0 2024-04-26T21:25:50.886 INFO:tasks.workunit.client.0.smithi084.stdout:6/160: rename d3/de/d15/d23/f29 to d3/de/d1a/f36 0 2024-04-26T21:25:50.886 INFO:tasks.workunit.client.0.smithi084.stdout:1/159: creat d2/d9/d15/f2f x:0 0 0 2024-04-26T21:25:50.888 INFO:tasks.workunit.client.0.smithi084.stdout:6/161: read - d3/de/d15/d23/f2e zero size 2024-04-26T21:25:50.888 INFO:tasks.workunit.client.0.smithi084.stdout:3/202: dread d1/f1a [0,4194304] 0 2024-04-26T21:25:50.892 INFO:tasks.workunit.client.0.smithi084.stdout:3/203: readlink d1/l6 0 2024-04-26T21:25:50.893 INFO:tasks.workunit.client.0.smithi084.stdout:1/160: creat d2/f30 x:0 0 0 2024-04-26T21:25:50.895 INFO:tasks.workunit.client.0.smithi084.stdout:8/190: dwrite d4/f5 [0,4194304] 0 2024-04-26T21:25:50.896 INFO:tasks.workunit.client.0.smithi084.stdout:3/204: symlink d1/l45 0 2024-04-26T21:25:50.897 INFO:tasks.workunit.client.0.smithi084.stdout:6/162: truncate d3/de/d15/d23/f2e 510645 0 2024-04-26T21:25:50.899 INFO:tasks.workunit.client.0.smithi084.stdout:3/205: dread - d1/d2c/d2f/d31/f37 zero size 2024-04-26T21:25:50.901 INFO:tasks.workunit.client.0.smithi084.stdout:3/206: write d1/d2c/d2f/f16 [1350309,82841] 0 2024-04-26T21:25:50.902 INFO:tasks.workunit.client.0.smithi084.stdout:1/161: symlink d2/d1b/l31 0 2024-04-26T21:25:50.904 INFO:tasks.workunit.client.0.smithi084.stdout:3/207: fsync d1/d2c/d2f/f1f 0 2024-04-26T21:25:50.910 INFO:tasks.workunit.client.0.smithi084.stdout:3/208: mknod d1/d2c/d2f/d31/c46 0 2024-04-26T21:25:50.916 INFO:tasks.workunit.client.0.smithi084.stdout:3/209: read d1/d2c/d2f/d31/d3b/f41 [915313,43901] 0 2024-04-26T21:25:50.920 INFO:tasks.workunit.client.0.smithi084.stdout:6/163: dwrite d3/d18/f20 [0,4194304] 0 2024-04-26T21:25:50.921 INFO:tasks.workunit.client.0.smithi084.stdout:3/210: unlink d1/ff 0 2024-04-26T21:25:50.922 INFO:tasks.workunit.client.1.smithi120.stdout:9/383: write d0/dd/f12 [930170,62177] 0 2024-04-26T21:25:50.922 INFO:tasks.workunit.client.0.smithi084.stdout:8/191: dwrite d4/d7/d15/f30 [0,4194304] 0 2024-04-26T21:25:50.923 INFO:tasks.workunit.client.1.smithi120.stdout:6/438: fsync d4/f14 0 2024-04-26T21:25:50.926 INFO:tasks.workunit.client.0.smithi084.stdout:6/164: write d3/de/d15/d23/f35 [721352,54921] 0 2024-04-26T21:25:50.926 INFO:tasks.workunit.client.0.smithi084.stdout:1/162: dread d2/d9/d17/f29 [0,4194304] 0 2024-04-26T21:25:50.926 INFO:tasks.workunit.client.1.smithi120.stdout:4/379: unlink d10/d12/f67 0 2024-04-26T21:25:50.927 INFO:tasks.workunit.client.1.smithi120.stdout:3/386: rename dd/de/d18/l1c to dd/de/d18/d2c/d76/d28/l82 0 2024-04-26T21:25:50.928 INFO:tasks.workunit.client.0.smithi084.stdout:6/165: readlink d3/de/d1a/l1e 0 2024-04-26T21:25:50.928 INFO:tasks.workunit.client.0.smithi084.stdout:8/192: mknod d4/d6/db/d1e/d22/c36 0 2024-04-26T21:25:50.928 INFO:tasks.workunit.client.0.smithi084.stdout:3/211: chown d1/d2c/d2f/d31/d3b/c3e 2 1 2024-04-26T21:25:50.929 INFO:tasks.workunit.client.1.smithi120.stdout:7/406: dwrite d7/d19/f44 [0,4194304] 0 2024-04-26T21:25:50.930 INFO:tasks.workunit.client.1.smithi120.stdout:0/491: mkdir d0/d3/dc/dd/d1b/daa 0 2024-04-26T21:25:50.932 INFO:tasks.workunit.client.0.smithi084.stdout:8/193: rmdir d4/d6/db/d1e 39 2024-04-26T21:25:50.935 INFO:tasks.workunit.client.0.smithi084.stdout:6/166: write d3/de/d15/df/f21 [3188746,123902] 0 2024-04-26T21:25:50.936 INFO:tasks.workunit.client.1.smithi120.stdout:7/407: write d7/d10/d12/f16 [4339239,24180] 0 2024-04-26T21:25:50.937 INFO:tasks.workunit.client.0.smithi084.stdout:1/163: rename d2/f10 to d2/d19/f32 0 2024-04-26T21:25:50.939 INFO:tasks.workunit.client.1.smithi120.stdout:2/444: dwrite d4/d1b/d2e/d50/f21 [4194304,4194304] 0 2024-04-26T21:25:50.939 INFO:tasks.workunit.client.1.smithi120.stdout:1/374: creat d6/d7/d1b/f81 x:0 0 0 2024-04-26T21:25:50.940 INFO:tasks.workunit.client.0.smithi084.stdout:8/194: mkdir d4/d7/d15/d37 0 2024-04-26T21:25:50.941 INFO:tasks.workunit.client.1.smithi120.stdout:6/439: symlink d4/db/d10/dd/d4e/d76/l8e 0 2024-04-26T21:25:50.942 INFO:tasks.workunit.client.0.smithi084.stdout:6/167: mkdir d3/d18/d37 0 2024-04-26T21:25:50.947 INFO:tasks.workunit.client.1.smithi120.stdout:7/408: chown d7/d10/d12/l5e 1 1 2024-04-26T21:25:50.948 INFO:tasks.workunit.client.0.smithi084.stdout:3/212: rmdir d1/d2c/d2f/d31/d3b/d3f 0 2024-04-26T21:25:50.948 INFO:tasks.workunit.client.0.smithi084.stdout:6/168: write d3/de/d15/f24 [5231277,64267] 0 2024-04-26T21:25:50.948 INFO:tasks.workunit.client.0.smithi084.stdout:8/195: chown d4/d6/db/d1e/d22 26894 1 2024-04-26T21:25:50.949 INFO:tasks.workunit.client.1.smithi120.stdout:0/492: link d0/d3/d51/f58 d0/d3/dc/dd/d1b/d24/d73/fab 0 2024-04-26T21:25:50.950 INFO:tasks.workunit.client.0.smithi084.stdout:1/164: rename d2/d9/d15/c1d to d2/d9/d15/d28/c33 0 2024-04-26T21:25:50.952 INFO:tasks.workunit.client.0.smithi084.stdout:3/213: symlink d1/d2c/d2f/d31/l47 0 2024-04-26T21:25:50.952 INFO:tasks.workunit.client.1.smithi120.stdout:9/384: getdents d0/d14 0 2024-04-26T21:25:50.954 INFO:tasks.workunit.client.0.smithi084.stdout:6/169: creat d3/d18/f38 x:0 0 0 2024-04-26T21:25:50.957 INFO:tasks.workunit.client.1.smithi120.stdout:4/380: dwrite d10/d12/f62 [0,4194304] 0 2024-04-26T21:25:50.959 INFO:tasks.workunit.client.0.smithi084.stdout:6/170: truncate d3/de/d1a/f36 834620 0 2024-04-26T21:25:50.960 INFO:tasks.workunit.client.1.smithi120.stdout:1/375: symlink d6/d7/d1d/d5d/d67/dd/d56/l82 0 2024-04-26T21:25:50.963 INFO:tasks.workunit.client.0.smithi084.stdout:6/171: fsync d3/f10 0 2024-04-26T21:25:50.963 INFO:tasks.workunit.client.1.smithi120.stdout:0/493: symlink d0/d3/dc/d12/d31/lac 0 2024-04-26T21:25:50.964 INFO:tasks.workunit.client.0.smithi084.stdout:3/214: mknod d1/d2c/d2f/c48 0 2024-04-26T21:25:50.968 INFO:tasks.workunit.client.1.smithi120.stdout:1/376: chown d6/d7/d1b/d5c/f6e 3822 1 2024-04-26T21:25:50.971 INFO:tasks.workunit.client.1.smithi120.stdout:3/387: rename dd/de/d18/d2c/d76/d28 to dd/de/d83 0 2024-04-26T21:25:50.972 INFO:tasks.workunit.client.0.smithi084.stdout:8/196: dwrite d4/f12 [0,4194304] 0 2024-04-26T21:25:50.973 INFO:tasks.workunit.client.1.smithi120.stdout:7/409: getdents d7/d10/d12/d1a 0 2024-04-26T21:25:50.975 INFO:tasks.workunit.client.1.smithi120.stdout:9/385: getdents d0/d6/d4d/d65 0 2024-04-26T21:25:50.976 INFO:tasks.workunit.client.0.smithi084.stdout:6/172: unlink d3/f6 0 2024-04-26T21:25:50.976 INFO:tasks.workunit.client.0.smithi084.stdout:1/165: getdents d2/d9/d17/d2a/d2c 0 2024-04-26T21:25:50.978 INFO:tasks.workunit.client.0.smithi084.stdout:1/166: stat d2/d9/d17/f2b 0 2024-04-26T21:25:50.978 INFO:tasks.workunit.client.0.smithi084.stdout:8/197: chown d4/d6/db/l11 2306272 1 2024-04-26T21:25:50.982 INFO:tasks.workunit.client.1.smithi120.stdout:3/388: readlink dd/d2a/d4a/l62 0 2024-04-26T21:25:50.982 INFO:tasks.workunit.client.1.smithi120.stdout:6/440: write d4/db/f1b [600385,5391] 0 2024-04-26T21:25:50.982 INFO:tasks.workunit.client.1.smithi120.stdout:9/386: chown d0/dd/d45/f51 4013 1 2024-04-26T21:25:50.983 INFO:tasks.workunit.client.0.smithi084.stdout:8/198: readlink d4/d6/l35 0 2024-04-26T21:25:50.983 INFO:tasks.workunit.client.0.smithi084.stdout:1/167: chown d2/d9/d15/f1f 0 1 2024-04-26T21:25:50.985 INFO:tasks.workunit.client.0.smithi084.stdout:3/215: dread d1/d24/d27/f32 [0,4194304] 0 2024-04-26T21:25:50.986 INFO:tasks.workunit.client.1.smithi120.stdout:2/445: dwrite d4/d1b/d25/d2c/d3e/d5e/f61 [0,4194304] 0 2024-04-26T21:25:50.986 INFO:tasks.workunit.client.1.smithi120.stdout:0/494: rmdir d0/d3/d13/d81/d94 0 2024-04-26T21:25:50.986 INFO:tasks.workunit.client.1.smithi120.stdout:7/410: fsync d7/d10/d12/d1f/d28/f6f 0 2024-04-26T21:25:50.986 INFO:tasks.workunit.client.1.smithi120.stdout:3/389: fdatasync dd/d2a/f7f 0 2024-04-26T21:25:50.987 INFO:tasks.workunit.client.0.smithi084.stdout:6/173: truncate d3/de/d15/df/f1b 720799 0 2024-04-26T21:25:50.989 INFO:tasks.workunit.client.0.smithi084.stdout:6/174: write d3/d18/f38 [569789,5724] 0 2024-04-26T21:25:50.992 INFO:tasks.workunit.client.0.smithi084.stdout:3/216: write d1/d24/d27/f32 [2546921,109618] 0 2024-04-26T21:25:50.994 INFO:tasks.workunit.client.1.smithi120.stdout:0/495: mknod d0/df/d79/cad 0 2024-04-26T21:25:50.996 INFO:tasks.workunit.client.1.smithi120.stdout:6/441: dread - d4/db/d10/d1a/d2b/f82 zero size 2024-04-26T21:25:51.000 INFO:tasks.workunit.client.0.smithi084.stdout:6/175: mknod d3/c39 0 2024-04-26T21:25:51.002 INFO:tasks.workunit.client.0.smithi084.stdout:3/217: symlink d1/d38/l49 0 2024-04-26T21:25:51.005 INFO:tasks.workunit.client.0.smithi084.stdout:8/199: dwrite d4/d6/f24 [4194304,4194304] 0 2024-04-26T21:25:51.007 INFO:tasks.workunit.client.1.smithi120.stdout:0/496: mkdir d0/d3/dc/d12/dae 0 2024-04-26T21:25:51.009 INFO:tasks.workunit.client.1.smithi120.stdout:4/381: dwrite d10/f6f [0,4194304] 0 2024-04-26T21:25:51.012 INFO:tasks.workunit.client.1.smithi120.stdout:1/377: dwrite d6/d7/d1d/f50 [4194304,4194304] 0 2024-04-26T21:25:51.013 INFO:tasks.workunit.client.0.smithi084.stdout:1/168: dwrite d2/f22 [0,4194304] 0 2024-04-26T21:25:51.018 INFO:tasks.workunit.client.1.smithi120.stdout:4/382: write d10/f26 [465981,114396] 0 2024-04-26T21:25:51.022 INFO:tasks.workunit.client.1.smithi120.stdout:7/411: dwrite d7/d10/f30 [0,4194304] 0 2024-04-26T21:25:51.025 INFO:tasks.workunit.client.0.smithi084.stdout:1/169: write d2/d9/f16 [974700,108612] 0 2024-04-26T21:25:51.030 INFO:tasks.workunit.client.0.smithi084.stdout:8/200: mknod d4/d6/db/c38 0 2024-04-26T21:25:51.031 INFO:tasks.workunit.client.1.smithi120.stdout:6/442: rename d4/db/d25/d6d/d73 to d4/db/d10/d22/d56/d8f 0 2024-04-26T21:25:51.041 INFO:tasks.workunit.client.1.smithi120.stdout:3/390: dwrite dd/d2a/f71 [0,4194304] 0 2024-04-26T21:25:51.044 INFO:tasks.workunit.client.1.smithi120.stdout:6/443: stat d4/db/d10/d1a/c55 0 2024-04-26T21:25:51.046 INFO:tasks.workunit.client.0.smithi084.stdout:1/170: unlink d2/d9/d15/f1f 0 2024-04-26T21:25:51.049 INFO:tasks.workunit.client.0.smithi084.stdout:8/201: dwrite d4/d6/db/d1e/d22/d2f/f2c [0,4194304] 0 2024-04-26T21:25:51.053 INFO:tasks.workunit.client.1.smithi120.stdout:2/446: dwrite d4/d1b/d25/d2c/f22 [0,4194304] 0 2024-04-26T21:25:51.055 INFO:tasks.workunit.client.0.smithi084.stdout:4/140: sync 2024-04-26T21:25:51.056 INFO:tasks.workunit.client.0.smithi084.stdout:6/176: dread d3/de/d15/d23/f2a [0,4194304] 0 2024-04-26T21:25:51.059 INFO:tasks.workunit.client.1.smithi120.stdout:2/447: dread - d4/d1b/d25/d2c/f8f zero size 2024-04-26T21:25:51.061 INFO:tasks.workunit.client.1.smithi120.stdout:4/383: dwrite d10/d12/f5c [0,4194304] 0 2024-04-26T21:25:51.065 INFO:tasks.workunit.client.1.smithi120.stdout:7/412: truncate d7/d10/d12/d1f/d28/f3d 384554 0 2024-04-26T21:25:51.070 INFO:tasks.workunit.client.1.smithi120.stdout:4/384: read - d10/d65/d72/f80 zero size 2024-04-26T21:25:51.071 INFO:tasks.workunit.client.1.smithi120.stdout:2/448: unlink d4/d1b/d25/d2c/d3e/d5e/c6d 0 2024-04-26T21:25:51.074 INFO:tasks.workunit.client.1.smithi120.stdout:1/378: dread d6/d7/d1d/f47 [0,4194304] 0 2024-04-26T21:25:51.078 INFO:tasks.workunit.client.1.smithi120.stdout:6/444: rename d4/db/d10/dd/d43/f48 to d4/db/d10/dd/f90 0 2024-04-26T21:25:51.085 INFO:tasks.workunit.client.0.smithi084.stdout:1/171: dwrite d2/d19/f1e [0,4194304] 0 2024-04-26T21:25:51.085 INFO:tasks.workunit.client.0.smithi084.stdout:4/141: creat d5/d7/d17/d32/f34 x:0 0 0 2024-04-26T21:25:51.086 INFO:tasks.workunit.client.1.smithi120.stdout:3/391: dwrite dd/d40/f50 [0,4194304] 0 2024-04-26T21:25:51.086 INFO:tasks.workunit.client.1.smithi120.stdout:0/497: dread d0/f10 [0,4194304] 0 2024-04-26T21:25:51.086 INFO:tasks.workunit.client.1.smithi120.stdout:4/385: unlink d10/d12/f2f 0 2024-04-26T21:25:51.088 INFO:tasks.workunit.client.0.smithi084.stdout:3/218: dwrite d1/d2c/d2f/f18 [4194304,4194304] 0 2024-04-26T21:25:51.088 INFO:tasks.workunit.client.1.smithi120.stdout:7/413: rename d7/d10/d12/d2f/l45 to d7/d10/d12/d1f/d28/d4c/d6b/d7b/l8d 0 2024-04-26T21:25:51.091 INFO:tasks.workunit.client.1.smithi120.stdout:3/392: stat dd/de/d18/d24/f41 0 2024-04-26T21:25:51.092 INFO:tasks.workunit.client.0.smithi084.stdout:6/177: mknod d3/de/d1a/d2f/c3a 0 2024-04-26T21:25:51.094 INFO:tasks.workunit.client.0.smithi084.stdout:8/202: dread d4/f5 [0,4194304] 0 2024-04-26T21:25:51.095 INFO:tasks.workunit.client.0.smithi084.stdout:6/178: stat d3/d18/c31 0 2024-04-26T21:25:51.096 INFO:tasks.workunit.client.1.smithi120.stdout:3/393: write f6 [2308124,46524] 0 2024-04-26T21:25:51.096 INFO:tasks.workunit.client.1.smithi120.stdout:6/445: rename d4/db/d25/c47 to d4/db/d10/d22/d56/d8f/c91 0 2024-04-26T21:25:51.097 INFO:tasks.workunit.client.0.smithi084.stdout:4/142: mkdir d5/d25/d35 0 2024-04-26T21:25:51.099 INFO:tasks.workunit.client.0.smithi084.stdout:3/219: creat d1/d2c/d2f/f4a x:0 0 0 2024-04-26T21:25:51.100 INFO:tasks.workunit.client.0.smithi084.stdout:4/143: stat d5/d25/f2f 0 2024-04-26T21:25:51.102 INFO:tasks.workunit.client.0.smithi084.stdout:4/144: chown d5/d10/d15/d21 27856665 1 2024-04-26T21:25:51.103 INFO:tasks.workunit.client.0.smithi084.stdout:3/220: chown d1/d24/f25 7 1 2024-04-26T21:25:51.105 INFO:tasks.workunit.client.1.smithi120.stdout:1/379: dwrite d6/d9/f74 [0,4194304] 0 2024-04-26T21:25:51.105 INFO:tasks.workunit.client.1.smithi120.stdout:6/446: write d4/d3d/f83 [2171028,76458] 0 2024-04-26T21:25:51.106 INFO:tasks.workunit.client.0.smithi084.stdout:8/203: mkdir d4/d6/db/d1e/d22/d39 0 2024-04-26T21:25:51.110 INFO:tasks.workunit.client.0.smithi084.stdout:4/145: creat d5/d7/d17/f36 x:0 0 0 2024-04-26T21:25:51.110 INFO:tasks.workunit.client.1.smithi120.stdout:8/406: sync 2024-04-26T21:25:51.115 INFO:tasks.workunit.client.0.smithi084.stdout:6/179: dread d3/de/d15/f1c [0,4194304] 0 2024-04-26T21:25:51.118 INFO:tasks.workunit.client.0.smithi084.stdout:8/204: getdents d4/d7/d15/d37 0 2024-04-26T21:25:51.119 INFO:tasks.workunit.client.0.smithi084.stdout:6/180: chown d3/d28/f2d 4414 1 2024-04-26T21:25:51.122 INFO:tasks.workunit.client.1.smithi120.stdout:3/394: creat dd/de/d83/d64/f84 x:0 0 0 2024-04-26T21:25:51.122 INFO:tasks.workunit.client.1.smithi120.stdout:4/386: dread d10/d28/f29 [0,4194304] 0 2024-04-26T21:25:51.123 INFO:tasks.workunit.client.1.smithi120.stdout:1/380: symlink d6/d9/l83 0 2024-04-26T21:25:51.124 INFO:tasks.workunit.client.0.smithi084.stdout:2/261: sync 2024-04-26T21:25:51.125 INFO:tasks.workunit.client.0.smithi084.stdout:1/172: truncate d2/f22 3522976 0 2024-04-26T21:25:51.128 INFO:tasks.workunit.client.1.smithi120.stdout:7/414: dwrite d7/d10/d12/d1a/d50/f54 [0,4194304] 0 2024-04-26T21:25:51.128 INFO:tasks.workunit.client.1.smithi120.stdout:2/449: write d4/d1b/d2e/d50/f27 [3678387,74917] 0 2024-04-26T21:25:51.132 INFO:tasks.workunit.client.1.smithi120.stdout:8/407: mkdir d5/d6/d11/d52/d70/d88 0 2024-04-26T21:25:51.134 INFO:tasks.workunit.client.0.smithi084.stdout:6/181: truncate d3/de/d1a/f36 1432244 0 2024-04-26T21:25:51.136 INFO:tasks.workunit.client.0.smithi084.stdout:3/221: dwrite d1/f3 [0,4194304] 0 2024-04-26T21:25:51.137 INFO:tasks.workunit.client.1.smithi120.stdout:0/498: write d0/d3/d51/f58 [3419982,129641] 0 2024-04-26T21:25:51.139 INFO:tasks.workunit.client.0.smithi084.stdout:1/173: rmdir d2/d9/d17/d2a 39 2024-04-26T21:25:51.140 INFO:tasks.workunit.client.0.smithi084.stdout:3/222: chown d1/d24/f36 3 1 2024-04-26T21:25:51.142 INFO:tasks.workunit.client.0.smithi084.stdout:1/174: write d2/f2e [624175,85857] 0 2024-04-26T21:25:51.142 INFO:tasks.workunit.client.0.smithi084.stdout:4/146: dwrite d5/f1a [0,4194304] 0 2024-04-26T21:25:51.143 INFO:tasks.workunit.client.1.smithi120.stdout:6/447: dwrite d4/db/d10/dd/d4e/f72 [0,4194304] 0 2024-04-26T21:25:51.146 INFO:tasks.workunit.client.0.smithi084.stdout:4/147: write d5/d7/f24 [2326563,77624] 0 2024-04-26T21:25:51.149 INFO:tasks.workunit.client.0.smithi084.stdout:1/175: write d2/d9/d15/f2f [235325,119393] 0 2024-04-26T21:25:51.151 INFO:tasks.workunit.client.0.smithi084.stdout:6/182: mknod d3/de/d15/c3b 0 2024-04-26T21:25:51.152 INFO:tasks.workunit.client.0.smithi084.stdout:3/223: creat d1/d38/f4b x:0 0 0 2024-04-26T21:25:51.155 INFO:tasks.workunit.client.0.smithi084.stdout:1/176: fsync d2/d9/d17/d2a/d2c/f2d 0 2024-04-26T21:25:51.158 INFO:tasks.workunit.client.1.smithi120.stdout:8/408: creat d5/d6/d34/d37/d60/d55/f89 x:0 0 0 2024-04-26T21:25:51.158 INFO:tasks.workunit.client.1.smithi120.stdout:1/381: write d6/f51 [341531,7413] 0 2024-04-26T21:25:51.159 INFO:tasks.workunit.client.1.smithi120.stdout:4/387: write d10/f4f [4253476,26384] 0 2024-04-26T21:25:51.161 INFO:tasks.workunit.client.0.smithi084.stdout:3/224: rename d1/d24/d27/l42 to d1/d38/l4c 0 2024-04-26T21:25:51.164 INFO:tasks.workunit.client.0.smithi084.stdout:3/225: chown d1/d2c/d2f/d31 12 1 2024-04-26T21:25:51.164 INFO:tasks.workunit.client.0.smithi084.stdout:1/177: creat d2/d9/d17/d2a/d2c/f34 x:0 0 0 2024-04-26T21:25:51.166 INFO:tasks.workunit.client.1.smithi120.stdout:8/409: mknod d5/d6/d34/d37/c8a 0 2024-04-26T21:25:51.167 INFO:tasks.workunit.client.1.smithi120.stdout:7/415: truncate d7/d10/d12/d1a/d33/d34/d37/f79 1592214 0 2024-04-26T21:25:51.167 INFO:tasks.workunit.client.0.smithi084.stdout:8/205: truncate d4/d6/db/d1e/d22/d2f/f2c 2112095 0 2024-04-26T21:25:51.170 INFO:tasks.workunit.client.1.smithi120.stdout:4/388: symlink d10/d12/l85 0 2024-04-26T21:25:51.173 INFO:tasks.workunit.client.1.smithi120.stdout:1/382: creat d6/d9/f84 x:0 0 0 2024-04-26T21:25:51.174 INFO:tasks.workunit.client.0.smithi084.stdout:1/178: symlink d2/d9/d15/l35 0 2024-04-26T21:25:51.175 INFO:tasks.workunit.client.1.smithi120.stdout:9/387: sync 2024-04-26T21:25:51.176 INFO:tasks.workunit.client.1.smithi120.stdout:5/466: sync 2024-04-26T21:25:51.176 INFO:tasks.workunit.client.1.smithi120.stdout:3/395: dwrite f6 [0,4194304] 0 2024-04-26T21:25:51.176 INFO:tasks.workunit.client.0.smithi084.stdout:8/206: mkdir d4/d3a 0 2024-04-26T21:25:51.176 INFO:tasks.workunit.client.1.smithi120.stdout:7/416: write d7/d10/d12/d1a/d33/f5b [3685087,43475] 0 2024-04-26T21:25:51.177 INFO:tasks.workunit.client.1.smithi120.stdout:3/396: fdatasync dd/d2a/f5f 0 2024-04-26T21:25:51.179 INFO:tasks.workunit.client.1.smithi120.stdout:6/448: creat d4/db/d10/f92 x:0 0 0 2024-04-26T21:25:51.182 INFO:tasks.workunit.client.0.smithi084.stdout:8/207: rmdir d4/d7/d15 39 2024-04-26T21:25:51.183 INFO:tasks.workunit.client.1.smithi120.stdout:6/449: readlink d4/db/d10/d22/l33 0 2024-04-26T21:25:51.183 INFO:tasks.workunit.client.1.smithi120.stdout:0/499: link d0/d3/d51/d97/fa5 d0/d3/dc/d12/dae/faf 0 2024-04-26T21:25:51.184 INFO:tasks.workunit.client.0.smithi084.stdout:9/122: sync 2024-04-26T21:25:51.184 INFO:tasks.workunit.client.0.smithi084.stdout:0/155: sync 2024-04-26T21:25:51.184 INFO:tasks.workunit.client.0.smithi084.stdout:7/161: sync 2024-04-26T21:25:51.184 INFO:tasks.workunit.client.0.smithi084.stdout:5/159: sync 2024-04-26T21:25:51.184 INFO:tasks.workunit.client.0.smithi084.stdout:5/160: stat d0/dc 0 2024-04-26T21:25:51.185 INFO:tasks.workunit.client.0.smithi084.stdout:9/123: fdatasync da/de/f11 0 2024-04-26T21:25:51.190 INFO:tasks.workunit.client.0.smithi084.stdout:3/226: dread d1/d2c/d2f/f18 [0,4194304] 0 2024-04-26T21:25:51.190 INFO:tasks.workunit.client.0.smithi084.stdout:7/162: write d6/dc/f27 [1185565,89153] 0 2024-04-26T21:25:51.190 INFO:tasks.workunit.client.0.smithi084.stdout:1/179: creat d2/d9/d17/f36 x:0 0 0 2024-04-26T21:25:51.190 INFO:tasks.workunit.client.1.smithi120.stdout:2/450: dread d4/d1b/d56/f4a [0,4194304] 0 2024-04-26T21:25:51.191 INFO:tasks.workunit.client.0.smithi084.stdout:0/156: mkdir de/d20/d30 0 2024-04-26T21:25:51.194 INFO:tasks.workunit.client.1.smithi120.stdout:5/467: fdatasync d2/dc/d1d/d1f/f2c 0 2024-04-26T21:25:51.196 INFO:tasks.workunit.client.0.smithi084.stdout:5/161: mkdir d0/dc/df/d2a 0 2024-04-26T21:25:51.200 INFO:tasks.workunit.client.0.smithi084.stdout:7/163: creat d6/d9/f35 x:0 0 0 2024-04-26T21:25:51.202 INFO:tasks.workunit.client.0.smithi084.stdout:3/227: write d1/d2c/d2f/d31/f37 [916873,46170] 0 2024-04-26T21:25:51.202 INFO:tasks.workunit.client.1.smithi120.stdout:2/451: write d4/d1b/d2e/d50/f2a [651733,82151] 0 2024-04-26T21:25:51.203 INFO:tasks.workunit.client.1.smithi120.stdout:8/410: getdents d5/d6/d11/d52/d27/d4f 0 2024-04-26T21:25:51.211 INFO:tasks.workunit.client.0.smithi084.stdout:8/208: mkdir d4/d7/d15/d37/d3b 0 2024-04-26T21:25:51.212 INFO:tasks.workunit.client.0.smithi084.stdout:1/180: dwrite d2/d9/d15/f2f [0,4194304] 0 2024-04-26T21:25:51.213 INFO:tasks.workunit.client.1.smithi120.stdout:4/389: dread d10/d12/f5c [0,4194304] 0 2024-04-26T21:25:51.213 INFO:tasks.workunit.client.1.smithi120.stdout:5/468: read d2/d1b/d89/d47/f53 [2821499,15657] 0 2024-04-26T21:25:51.216 INFO:tasks.workunit.client.1.smithi120.stdout:4/390: dread - d10/f6a zero size 2024-04-26T21:25:51.217 INFO:tasks.workunit.client.0.smithi084.stdout:0/157: dwrite de/f21 [0,4194304] 0 2024-04-26T21:25:51.217 INFO:tasks.workunit.client.0.smithi084.stdout:9/124: symlink da/de/l2b 0 2024-04-26T21:25:51.218 INFO:tasks.workunit.client.0.smithi084.stdout:1/181: fsync d2/d9/d17/f2b 0 2024-04-26T21:25:51.219 INFO:tasks.workunit.client.1.smithi120.stdout:3/397: creat dd/de/d18/f85 x:0 0 0 2024-04-26T21:25:51.223 INFO:tasks.workunit.client.1.smithi120.stdout:7/417: dwrite d7/d10/d12/f7a [0,4194304] 0 2024-04-26T21:25:51.224 INFO:tasks.workunit.client.0.smithi084.stdout:8/209: mkdir d4/d7/d15/d3c 0 2024-04-26T21:25:51.226 INFO:tasks.workunit.client.0.smithi084.stdout:3/228: mknod d1/d24/d27/d3a/c4d 0 2024-04-26T21:25:51.228 INFO:tasks.workunit.client.1.smithi120.stdout:4/391: read d10/d12/f5c [1558249,56921] 0 2024-04-26T21:25:51.228 INFO:tasks.workunit.client.1.smithi120.stdout:1/383: dwrite d6/d7/d1b/f81 [0,4194304] 0 2024-04-26T21:25:51.228 INFO:tasks.workunit.client.1.smithi120.stdout:8/411: mknod d5/d6/c8b 0 2024-04-26T21:25:51.230 INFO:tasks.workunit.client.0.smithi084.stdout:7/164: dwrite d6/dc/f31 [4194304,4194304] 0 2024-04-26T21:25:51.231 INFO:tasks.workunit.client.0.smithi084.stdout:8/210: write d4/d6/f24 [4139794,92525] 0 2024-04-26T21:25:51.233 INFO:tasks.workunit.client.0.smithi084.stdout:7/165: chown d6/f2a 0 1 2024-04-26T21:25:51.237 INFO:tasks.workunit.client.0.smithi084.stdout:9/125: mknod da/c2c 0 2024-04-26T21:25:51.239 INFO:tasks.workunit.client.1.smithi120.stdout:8/412: dread d5/f15 [0,4194304] 0 2024-04-26T21:25:51.241 INFO:tasks.workunit.client.0.smithi084.stdout:1/182: dread d2/d19/f1e [0,4194304] 0 2024-04-26T21:25:51.242 INFO:tasks.workunit.client.1.smithi120.stdout:2/452: dread d4/f34 [0,4194304] 0 2024-04-26T21:25:51.249 INFO:tasks.workunit.client.0.smithi084.stdout:3/229: mkdir d1/d38/d4e 0 2024-04-26T21:25:51.251 INFO:tasks.workunit.client.0.smithi084.stdout:7/166: write d6/d9/f2e [5091960,101712] 0 2024-04-26T21:25:51.252 INFO:tasks.workunit.client.0.smithi084.stdout:9/126: truncate da/f17 1767971 0 2024-04-26T21:25:51.259 INFO:tasks.workunit.client.1.smithi120.stdout:3/398: mkdir dd/de/d18/d37/d7c/d86 0 2024-04-26T21:25:51.260 INFO:tasks.workunit.client.0.smithi084.stdout:3/230: rename d1/d24/d27/d3a/c4d to d1/d24/d27/c4f 0 2024-04-26T21:25:51.266 INFO:tasks.workunit.client.1.smithi120.stdout:9/388: dwrite d0/d6/d3d/f4e [0,4194304] 0 2024-04-26T21:25:51.266 INFO:tasks.workunit.client.1.smithi120.stdout:2/453: dread d4/f34 [0,4194304] 0 2024-04-26T21:25:51.267 INFO:tasks.workunit.client.0.smithi084.stdout:9/127: creat da/de/f2d x:0 0 0 2024-04-26T21:25:51.267 INFO:tasks.workunit.client.0.smithi084.stdout:7/167: link d6/d9/c25 d6/c36 0 2024-04-26T21:25:51.268 INFO:tasks.workunit.client.1.smithi120.stdout:7/418: getdents d7/d10/d12/d1a/d33 0 2024-04-26T21:25:51.268 INFO:tasks.workunit.client.1.smithi120.stdout:8/413: truncate d5/d6/d11/d52/d70/f4b 827271 0 2024-04-26T21:25:51.271 INFO:tasks.workunit.client.0.smithi084.stdout:9/128: rename da/l26 to da/de/d16/d25/l2e 0 2024-04-26T21:25:51.271 INFO:tasks.workunit.client.0.smithi084.stdout:3/231: dread d1/fe [4194304,4194304] 0 2024-04-26T21:25:51.274 INFO:tasks.workunit.client.0.smithi084.stdout:7/168: symlink d6/d9/d12/d19/d20/d32/l37 0 2024-04-26T21:25:51.275 INFO:tasks.workunit.client.0.smithi084.stdout:9/129: creat da/de/d1e/f2f x:0 0 0 2024-04-26T21:25:51.277 INFO:tasks.workunit.client.1.smithi120.stdout:6/450: dwrite d4/db/d10/d1a/d2b/f8d [0,4194304] 0 2024-04-26T21:25:51.277 INFO:tasks.workunit.client.1.smithi120.stdout:8/414: write d5/d6/d11/f6b [2367925,129930] 0 2024-04-26T21:25:51.279 INFO:tasks.workunit.client.0.smithi084.stdout:9/130: stat da/f23 0 2024-04-26T21:25:51.279 INFO:tasks.workunit.client.1.smithi120.stdout:5/469: dwrite d2/dc/d1d/d21/d77/d79/f8e [0,4194304] 0 2024-04-26T21:25:51.283 INFO:tasks.workunit.client.0.smithi084.stdout:9/131: creat da/de/d16/f30 x:0 0 0 2024-04-26T21:25:51.284 INFO:tasks.workunit.client.1.smithi120.stdout:7/419: getdents d7/d10 0 2024-04-26T21:25:51.286 INFO:tasks.workunit.client.0.smithi084.stdout:9/132: write da/de/d16/f1b [862386,130489] 0 2024-04-26T21:25:51.290 INFO:tasks.workunit.client.1.smithi120.stdout:8/415: truncate d5/d6/d11/d52/d27/f6d 689143 0 2024-04-26T21:25:51.293 INFO:tasks.workunit.client.0.smithi084.stdout:3/232: dread d1/d2c/d2f/f18 [4194304,4194304] 0 2024-04-26T21:25:51.300 INFO:tasks.workunit.client.0.smithi084.stdout:3/233: unlink d1/l2a 0 2024-04-26T21:25:51.300 INFO:tasks.workunit.client.1.smithi120.stdout:8/416: fdatasync d5/d6/f7f 0 2024-04-26T21:25:51.303 INFO:tasks.workunit.client.1.smithi120.stdout:5/470: truncate d2/d30/d3b/f68 463846 0 2024-04-26T21:25:51.303 INFO:tasks.workunit.client.0.smithi084.stdout:7/169: dwrite d6/f17 [0,4194304] 0 2024-04-26T21:25:51.308 INFO:tasks.workunit.client.1.smithi120.stdout:0/500: dread d0/d3/dc/d12/f47 [0,4194304] 0 2024-04-26T21:25:51.309 INFO:tasks.workunit.client.1.smithi120.stdout:3/399: dwrite dd/f5e [0,4194304] 0 2024-04-26T21:25:51.310 INFO:tasks.workunit.client.0.smithi084.stdout:8/211: truncate d4/d7/d15/f18 4367518 0 2024-04-26T21:25:51.318 INFO:tasks.workunit.client.1.smithi120.stdout:5/471: mknod d2/dc/d1d/d21/d77/ca1 0 2024-04-26T21:25:51.318 INFO:tasks.workunit.client.1.smithi120.stdout:4/392: dwrite d10/d12/f45 [4194304,4194304] 0 2024-04-26T21:25:51.327 INFO:tasks.workunit.client.1.smithi120.stdout:8/417: symlink d5/d6/d11/d52/d27/d4f/l8c 0 2024-04-26T21:25:51.327 INFO:tasks.workunit.client.1.smithi120.stdout:7/420: truncate d7/d10/d12/d1f/d28/f2c 4799182 0 2024-04-26T21:25:51.327 INFO:tasks.workunit.client.0.smithi084.stdout:9/133: dwrite da/f19 [0,4194304] 0 2024-04-26T21:25:51.329 INFO:tasks.workunit.client.1.smithi120.stdout:1/384: dread d6/d7/d1d/d5d/d67/dd/d56/f57 [0,4194304] 0 2024-04-26T21:25:51.329 INFO:tasks.workunit.client.1.smithi120.stdout:0/501: mknod d0/d3/cb0 0 2024-04-26T21:25:51.332 INFO:tasks.workunit.client.0.smithi084.stdout:3/234: dwrite d1/d2c/d2f/d31/f37 [0,4194304] 0 2024-04-26T21:25:51.334 INFO:tasks.workunit.client.0.smithi084.stdout:9/134: write da/de/d1e/f29 [275555,8164] 0 2024-04-26T21:25:51.337 INFO:tasks.workunit.client.1.smithi120.stdout:8/418: write d5/d6/d34/d37/f69 [294167,98457] 0 2024-04-26T21:25:51.342 INFO:tasks.workunit.client.0.smithi084.stdout:9/135: readlink da/de/d1e/l20 0 2024-04-26T21:25:51.343 INFO:tasks.workunit.client.1.smithi120.stdout:3/400: creat dd/d2a/d74/f87 x:0 0 0 2024-04-26T21:25:51.343 INFO:tasks.workunit.client.1.smithi120.stdout:7/421: mknod d7/d10/d12/d1a/c8e 0 2024-04-26T21:25:51.343 INFO:tasks.workunit.client.0.smithi084.stdout:7/170: dwrite d6/d9/d12/f2c [0,4194304] 0 2024-04-26T21:25:51.346 INFO:tasks.workunit.client.1.smithi120.stdout:2/454: dread d4/d1b/d25/d29/f37 [0,4194304] 0 2024-04-26T21:25:51.348 INFO:tasks.workunit.client.1.smithi120.stdout:8/419: write d5/d6/d34/d42/d4a/f57 [4176801,126537] 0 2024-04-26T21:25:51.350 INFO:tasks.workunit.client.1.smithi120.stdout:0/502: symlink d0/d3/d51/d95/lb1 0 2024-04-26T21:25:51.350 INFO:tasks.workunit.client.1.smithi120.stdout:1/385: mkdir d6/d7/d85 0 2024-04-26T21:25:51.353 INFO:tasks.workunit.client.0.smithi084.stdout:9/136: link da/f23 da/de/d1e/f31 0 2024-04-26T21:25:51.358 INFO:tasks.workunit.client.1.smithi120.stdout:7/422: fsync d7/d10/d12/d1f/d28/f3d 0 2024-04-26T21:25:51.359 INFO:tasks.workunit.client.1.smithi120.stdout:1/386: write d6/d7/d1d/f20 [1787048,35272] 0 2024-04-26T21:25:51.363 INFO:tasks.workunit.client.1.smithi120.stdout:0/503: mknod d0/df/d79/cb2 0 2024-04-26T21:25:51.366 INFO:tasks.workunit.client.0.smithi084.stdout:3/235: dwrite d1/d2c/d2f/f20 [0,4194304] 0 2024-04-26T21:25:51.368 INFO:tasks.workunit.client.1.smithi120.stdout:8/420: rename d5/d6/d11/d32/l63 to d5/d6/d34/d37/d60/d55/l8d 0 2024-04-26T21:25:51.369 INFO:tasks.workunit.client.1.smithi120.stdout:0/504: write d0/d3/dc/dd/f7b [1857489,66293] 0 2024-04-26T21:25:51.370 INFO:tasks.workunit.client.1.smithi120.stdout:1/387: mkdir d6/d7/d2d/d48/d86 0 2024-04-26T21:25:51.372 INFO:tasks.workunit.client.0.smithi084.stdout:8/212: truncate d4/f5 942807 0 2024-04-26T21:25:51.374 INFO:tasks.workunit.client.1.smithi120.stdout:7/423: creat d7/d10/d12/d1f/d28/d4c/d6b/f8f x:0 0 0 2024-04-26T21:25:51.374 INFO:tasks.workunit.client.1.smithi120.stdout:1/388: stat d6/d14/f16 0 2024-04-26T21:25:51.374 INFO:tasks.workunit.client.1.smithi120.stdout:5/472: dread d2/dc/d1d/d1f/d36/d44/d6c/f50 [0,4194304] 0 2024-04-26T21:25:51.374 INFO:tasks.workunit.client.0.smithi084.stdout:7/171: dwrite d6/d26/f30 [0,4194304] 0 2024-04-26T21:25:51.376 INFO:tasks.workunit.client.0.smithi084.stdout:3/236: chown d1/d2c/d2f/d31/d3b/f44 598894 1 2024-04-26T21:25:51.380 INFO:tasks.workunit.client.1.smithi120.stdout:8/421: mkdir d5/d8e 0 2024-04-26T21:25:51.380 INFO:tasks.workunit.client.0.smithi084.stdout:8/213: symlink d4/d6/db/d1e/d22/d2f/l3d 0 2024-04-26T21:25:51.381 INFO:tasks.workunit.client.1.smithi120.stdout:3/401: dwrite dd/de/d18/d24/f41 [0,4194304] 0 2024-04-26T21:25:51.381 INFO:tasks.workunit.client.1.smithi120.stdout:0/505: mknod d0/d3/dc/dd/d1b/d24/d7d/cb3 0 2024-04-26T21:25:51.385 INFO:tasks.workunit.client.1.smithi120.stdout:8/422: write d5/d6/d11/f31 [820885,114726] 0 2024-04-26T21:25:51.385 INFO:tasks.workunit.client.1.smithi120.stdout:5/473: creat d2/dc/d1d/d21/d66/fa2 x:0 0 0 2024-04-26T21:25:51.385 INFO:tasks.workunit.client.0.smithi084.stdout:7/172: mkdir d6/d9/d12/d19/d20/d38 0 2024-04-26T21:25:51.386 INFO:tasks.workunit.client.1.smithi120.stdout:1/389: creat d6/d7/d1d/d5d/d67/dd/d35/f87 x:0 0 0 2024-04-26T21:25:51.386 INFO:tasks.workunit.client.0.smithi084.stdout:3/237: dread d1/f22 [0,4194304] 0 2024-04-26T21:25:51.387 INFO:tasks.workunit.client.0.smithi084.stdout:9/137: dwrite da/de/d1e/f31 [0,4194304] 0 2024-04-26T21:25:51.390 INFO:tasks.workunit.client.0.smithi084.stdout:9/138: stat da/c2c 0 2024-04-26T21:25:51.390 INFO:tasks.workunit.client.1.smithi120.stdout:3/402: symlink dd/de/d18/d2c/d76/l88 0 2024-04-26T21:25:51.391 INFO:tasks.workunit.client.0.smithi084.stdout:8/214: creat d4/d7/d15/d37/d3b/f3e x:0 0 0 2024-04-26T21:25:51.393 INFO:tasks.workunit.client.1.smithi120.stdout:3/403: write dd/d2a/d74/f87 [99886,114337] 0 2024-04-26T21:25:51.398 INFO:tasks.workunit.client.0.smithi084.stdout:8/215: write d4/f12 [3029571,113723] 0 2024-04-26T21:25:51.403 INFO:tasks.workunit.client.0.smithi084.stdout:8/216: read d4/d7/f14 [4331032,46297] 0 2024-04-26T21:25:51.403 INFO:tasks.workunit.client.0.smithi084.stdout:7/173: rename d6/d9/d12/d19/d20/l21 to d6/d9/d12/l39 0 2024-04-26T21:25:51.409 INFO:tasks.workunit.client.1.smithi120.stdout:8/423: unlink d5/d6/d34/d37/d60/d55/l58 0 2024-04-26T21:25:51.411 INFO:tasks.workunit.client.1.smithi120.stdout:2/455: truncate d4/d1b/d2e/d50/d14/d15/f45 5296453 0 2024-04-26T21:25:51.411 INFO:tasks.workunit.client.0.smithi084.stdout:9/139: getdents da/de/d16 0 2024-04-26T21:25:51.413 INFO:tasks.workunit.client.1.smithi120.stdout:7/424: read d7/d19/f24 [1141264,7577] 0 2024-04-26T21:25:51.419 INFO:tasks.workunit.client.0.smithi084.stdout:3/238: dwrite d1/d2c/d2f/f2e [0,4194304] 0 2024-04-26T21:25:51.422 INFO:tasks.workunit.client.0.smithi084.stdout:9/140: mknod da/de/c32 0 2024-04-26T21:25:51.426 INFO:tasks.workunit.client.0.smithi084.stdout:9/141: chown da/de/f12 63979 1 2024-04-26T21:25:51.428 INFO:tasks.workunit.client.1.smithi120.stdout:5/474: creat d2/fa3 x:0 0 0 2024-04-26T21:25:51.432 INFO:tasks.workunit.client.1.smithi120.stdout:5/475: write d2/dc/f38 [3139709,114212] 0 2024-04-26T21:25:51.433 INFO:tasks.workunit.client.1.smithi120.stdout:4/393: sync 2024-04-26T21:25:51.433 INFO:tasks.workunit.client.1.smithi120.stdout:6/451: sync 2024-04-26T21:25:51.433 INFO:tasks.workunit.client.1.smithi120.stdout:9/389: sync 2024-04-26T21:25:51.435 INFO:tasks.workunit.client.0.smithi084.stdout:9/142: symlink da/de/d16/d25/l33 0 2024-04-26T21:25:51.436 INFO:tasks.workunit.client.0.smithi084.stdout:9/143: stat da/f1a 0 2024-04-26T21:25:51.437 INFO:tasks.workunit.client.1.smithi120.stdout:4/394: chown d10/f47 3 1 2024-04-26T21:25:51.437 INFO:tasks.workunit.client.1.smithi120.stdout:2/456: mkdir d4/d1b/d25/d93 0 2024-04-26T21:25:51.447 INFO:tasks.workunit.client.1.smithi120.stdout:1/390: write d6/d7/d1d/d5d/d67/dd/f42 [387658,34450] 0 2024-04-26T21:25:51.448 INFO:tasks.workunit.client.1.smithi120.stdout:5/476: dread d2/d1b/f26 [0,4194304] 0 2024-04-26T21:25:51.448 INFO:tasks.workunit.client.0.smithi084.stdout:9/144: creat da/f34 x:0 0 0 2024-04-26T21:25:51.450 INFO:tasks.workunit.client.1.smithi120.stdout:7/425: unlink d7/d10/d12/d1f/d28/d4c/d6c/c85 0 2024-04-26T21:25:51.450 INFO:tasks.workunit.client.1.smithi120.stdout:0/506: dread d0/d3/dc/d12/d31/f5e [0,4194304] 0 2024-04-26T21:25:51.450 INFO:tasks.workunit.client.1.smithi120.stdout:1/391: chown d6/d7/d1d/d5d/d67/dd/c1f 22911 1 2024-04-26T21:25:51.453 INFO:tasks.workunit.client.1.smithi120.stdout:7/426: write d7/d10/d12/f16 [332958,41288] 0 2024-04-26T21:25:51.453 INFO:tasks.workunit.client.0.smithi084.stdout:3/239: truncate d1/d2c/d2f/d31/f37 2108460 0 2024-04-26T21:25:51.454 INFO:tasks.workunit.client.0.smithi084.stdout:8/217: dwrite d4/f1c [0,4194304] 0 2024-04-26T21:25:51.455 INFO:tasks.workunit.client.0.smithi084.stdout:7/174: dwrite d6/dc/f31 [0,4194304] 0 2024-04-26T21:25:51.456 INFO:tasks.workunit.client.1.smithi120.stdout:7/427: write d7/d10/d12/d1f/d28/f53 [291518,104521] 0 2024-04-26T21:25:51.456 INFO:tasks.workunit.client.1.smithi120.stdout:3/404: creat dd/de/df/d12/f89 x:0 0 0 2024-04-26T21:25:51.460 INFO:tasks.workunit.client.0.smithi084.stdout:7/175: write d6/d9/f35 [833623,5977] 0 2024-04-26T21:25:51.463 INFO:tasks.workunit.client.1.smithi120.stdout:9/390: rename d0/l1d to d0/d5e/l80 0 2024-04-26T21:25:51.473 INFO:tasks.workunit.client.1.smithi120.stdout:8/424: creat d5/d6/d11/d32/f8f x:0 0 0 2024-04-26T21:25:51.476 INFO:tasks.workunit.client.1.smithi120.stdout:8/425: dread - d5/d6/d11/d32/d3b/f6f zero size 2024-04-26T21:25:51.476 INFO:tasks.workunit.client.0.smithi084.stdout:8/218: truncate d4/d6/db/d1e/d22/d2f/f2c 358871 0 2024-04-26T21:25:51.479 INFO:tasks.workunit.client.0.smithi084.stdout:3/240: dread d1/d2c/d2f/f1f [0,4194304] 0 2024-04-26T21:25:51.480 INFO:tasks.workunit.client.1.smithi120.stdout:6/452: creat d4/db/d10/d1a/d2b/f93 x:0 0 0 2024-04-26T21:25:51.481 INFO:tasks.workunit.client.0.smithi084.stdout:8/219: symlink d4/d7/d15/d37/d3b/l3f 0 2024-04-26T21:25:51.486 INFO:tasks.workunit.client.0.smithi084.stdout:3/241: truncate d1/d2c/d2f/d31/d3b/f44 239574 0 2024-04-26T21:25:51.488 INFO:tasks.workunit.client.1.smithi120.stdout:3/405: dread f5 [0,4194304] 0 2024-04-26T21:25:51.488 INFO:tasks.workunit.client.1.smithi120.stdout:4/395: mkdir d10/d65/d72/d86 0 2024-04-26T21:25:51.489 INFO:tasks.workunit.client.0.smithi084.stdout:3/242: mknod d1/c50 0 2024-04-26T21:25:51.493 INFO:tasks.workunit.client.1.smithi120.stdout:2/457: mknod d4/d1b/d4f/c94 0 2024-04-26T21:25:51.495 INFO:tasks.workunit.client.1.smithi120.stdout:5/477: mknod d2/dc/d1d/d21/d66/d85/ca4 0 2024-04-26T21:25:51.496 INFO:tasks.workunit.client.1.smithi120.stdout:2/458: chown d4/d1b/d25/d2c/f46 26 1 2024-04-26T21:25:51.496 INFO:tasks.workunit.client.0.smithi084.stdout:9/145: truncate da/de/d1e/f27 2091630 0 2024-04-26T21:25:51.497 INFO:tasks.workunit.client.0.smithi084.stdout:7/176: truncate d6/f2a 4193304 0 2024-04-26T21:25:51.500 INFO:tasks.workunit.client.1.smithi120.stdout:6/453: dwrite d4/d3d/f6e [0,4194304] 0 2024-04-26T21:25:51.501 INFO:tasks.workunit.client.0.smithi084.stdout:3/243: link d1/d2c/d2f/f18 d1/d24/d27/d3a/f51 0 2024-04-26T21:25:51.502 INFO:tasks.workunit.client.1.smithi120.stdout:6/454: chown d4/db/d10/dd/d4e/d76 11590750 1 2024-04-26T21:25:51.505 INFO:tasks.workunit.client.1.smithi120.stdout:0/507: unlink d0/d3/dc/d12/f47 0 2024-04-26T21:25:51.509 INFO:tasks.workunit.client.1.smithi120.stdout:8/426: symlink d5/d6/d11/d52/d70/l90 0 2024-04-26T21:25:51.512 INFO:tasks.workunit.client.0.smithi084.stdout:9/146: rename da/de/d1e/f27 to da/f35 0 2024-04-26T21:25:51.512 INFO:tasks.workunit.client.1.smithi120.stdout:5/478: mknod d2/d1b/d89/d47/ca5 0 2024-04-26T21:25:51.513 INFO:tasks.workunit.client.0.smithi084.stdout:3/244: dread d1/d24/f25 [0,4194304] 0 2024-04-26T21:25:51.513 INFO:tasks.workunit.client.1.smithi120.stdout:2/459: mkdir d4/d1b/d4f/d95 0 2024-04-26T21:25:51.515 INFO:tasks.workunit.client.1.smithi120.stdout:6/455: mkdir d4/db/d10/d22/d56/d94 0 2024-04-26T21:25:51.517 INFO:tasks.workunit.client.1.smithi120.stdout:6/456: chown d4/db/d10/dd/f30 50477 1 2024-04-26T21:25:51.517 INFO:tasks.workunit.client.1.smithi120.stdout:1/392: creat d6/d7/d1d/d2c/d73/f88 x:0 0 0 2024-04-26T21:25:51.518 INFO:tasks.workunit.client.0.smithi084.stdout:3/245: mkdir d1/d2c/d2f/d31/d52 0 2024-04-26T21:25:51.519 INFO:tasks.workunit.client.1.smithi120.stdout:9/391: symlink d0/d14/d77/l81 0 2024-04-26T21:25:51.519 INFO:tasks.workunit.client.0.smithi084.stdout:8/220: dwrite d4/f1c [4194304,4194304] 0 2024-04-26T21:25:51.521 INFO:tasks.workunit.client.1.smithi120.stdout:7/428: mknod d7/d10/d12/d1f/c90 0 2024-04-26T21:25:51.521 INFO:tasks.workunit.client.1.smithi120.stdout:4/396: creat d10/d65/d72/d86/f87 x:0 0 0 2024-04-26T21:25:51.524 INFO:tasks.workunit.client.1.smithi120.stdout:4/397: dread - d10/d65/d72/d86/f87 zero size 2024-04-26T21:25:51.525 INFO:tasks.workunit.client.0.smithi084.stdout:9/147: creat da/de/d16/d25/f36 x:0 0 0 2024-04-26T21:25:51.530 INFO:tasks.workunit.client.0.smithi084.stdout:7/177: write d6/d9/ff [4784984,15805] 0 2024-04-26T21:25:51.532 INFO:tasks.workunit.client.1.smithi120.stdout:0/508: symlink d0/d3/lb4 0 2024-04-26T21:25:51.533 INFO:tasks.workunit.client.0.smithi084.stdout:3/246: rename d1/d2c/d2f/f13 to d1/d24/d27/f53 0 2024-04-26T21:25:51.533 INFO:tasks.workunit.client.1.smithi120.stdout:6/457: mkdir d4/db/d10/d1a/d95 0 2024-04-26T21:25:51.536 INFO:tasks.workunit.client.1.smithi120.stdout:9/392: mknod d0/d6/c82 0 2024-04-26T21:25:51.537 INFO:tasks.workunit.client.1.smithi120.stdout:7/429: fsync d7/fe 0 2024-04-26T21:25:51.539 INFO:tasks.workunit.client.1.smithi120.stdout:4/398: mknod d10/d65/d72/c88 0 2024-04-26T21:25:51.543 INFO:tasks.workunit.client.1.smithi120.stdout:5/479: dwrite d2/dc/d1d/d1f/d36/f76 [0,4194304] 0 2024-04-26T21:25:51.545 INFO:tasks.workunit.client.0.smithi084.stdout:9/148: creat da/f37 x:0 0 0 2024-04-26T21:25:51.545 INFO:tasks.workunit.client.0.smithi084.stdout:8/221: dread d4/d6/f24 [0,4194304] 0 2024-04-26T21:25:51.549 INFO:tasks.workunit.client.1.smithi120.stdout:4/399: symlink d10/d65/l89 0 2024-04-26T21:25:51.550 INFO:tasks.workunit.client.0.smithi084.stdout:2/262: sync 2024-04-26T21:25:51.550 INFO:tasks.workunit.client.0.smithi084.stdout:7/178: mknod d6/d9/d12/d19/d20/d38/c3a 0 2024-04-26T21:25:51.554 INFO:tasks.workunit.client.0.smithi084.stdout:9/149: creat da/de/f38 x:0 0 0 2024-04-26T21:25:51.554 INFO:tasks.workunit.client.1.smithi120.stdout:1/393: dwrite d6/d9/f74 [0,4194304] 0 2024-04-26T21:25:51.558 INFO:tasks.workunit.client.0.smithi084.stdout:7/179: creat d6/dc/f3b x:0 0 0 2024-04-26T21:25:51.561 INFO:tasks.workunit.client.0.smithi084.stdout:3/247: dwrite d1/d2c/f3c [0,4194304] 0 2024-04-26T21:25:51.565 INFO:tasks.workunit.client.0.smithi084.stdout:2/263: creat d6/d7/d3d/d15/d1f/d39/d20/d45/f60 x:0 0 0 2024-04-26T21:25:51.565 INFO:tasks.workunit.client.1.smithi120.stdout:1/394: read d6/d7/d1d/d2c/f31 [99714,95833] 0 2024-04-26T21:25:51.567 INFO:tasks.workunit.client.1.smithi120.stdout:5/480: creat d2/dc/d1d/d21/d66/d6a/d8c/fa6 x:0 0 0 2024-04-26T21:25:51.568 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:51 smithi084 ceph-mon[25539]: pgmap v40: 65 pgs: 65 active+clean; 890 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 17 MiB/s rd, 110 MiB/s wr, 208 op/s 2024-04-26T21:25:51.568 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:51 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:25:51.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.566+0000 7f8620800700 1 -- 172.21.15.84:0/464393431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f861806ed90 msgr2=0x7f861810b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:51.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.566+0000 7f8620800700 1 --2- 172.21.15.84:0/464393431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f861806ed90 0x7f861810b190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8608004940 tx=0x7f8608009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:51.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.566+0000 7f8620800700 1 -- 172.21.15.84:0/464393431 shutdown_connections 2024-04-26T21:25:51.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.566+0000 7f8620800700 1 --2- 172.21.15.84:0/464393431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f861806ed90 0x7f861810b190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:51.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.566+0000 7f8620800700 1 --2- 172.21.15.84:0/464393431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f861806e440 0x7f861806e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:51.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.566+0000 7f8620800700 1 -- 172.21.15.84:0/464393431 >> 172.21.15.84:0/464393431 conn(0x7f8618069dc0 msgr2=0x7f861806c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:51.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.567+0000 7f8620800700 1 -- 172.21.15.84:0/464393431 shutdown_connections 2024-04-26T21:25:51.569 INFO:tasks.workunit.client.0.smithi084.stdout:9/150: symlink da/de/l39 0 2024-04-26T21:25:51.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.567+0000 7f8620800700 1 -- 172.21.15.84:0/464393431 wait complete. 2024-04-26T21:25:51.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.568+0000 7f8620800700 1 Processor -- start 2024-04-26T21:25:51.571 INFO:tasks.workunit.client.1.smithi120.stdout:8/427: rmdir d5/d6 39 2024-04-26T21:25:51.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.569+0000 7f8620800700 1 -- start start 2024-04-26T21:25:51.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.569+0000 7f8620800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f861806e440 0x7f86181069d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:51.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.569+0000 7f8620800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f861806ed90 0x7f8618105080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:51.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.569+0000 7f8620800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8618106fd0 con 0x7f861806ed90 2024-04-26T21:25:51.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.569+0000 7f8620800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8618119df0 con 0x7f861806e440 2024-04-26T21:25:51.573 INFO:tasks.workunit.client.0.smithi084.stdout:9/151: write da/f34 [190091,88375] 0 2024-04-26T21:25:51.573 INFO:tasks.workunit.client.1.smithi120.stdout:2/460: dread d4/d1b/f38 [4194304,4194304] 0 2024-04-26T21:25:51.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.572+0000 7f861de00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f861806e440 0x7f86181069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:51.574 INFO:tasks.workunit.client.1.smithi120.stdout:7/430: dread d7/fd [0,4194304] 0 2024-04-26T21:25:51.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.572+0000 7f861de00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f861806e440 0x7f86181069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:34236/0 (socket says 172.21.15.84:34236) 2024-04-26T21:25:51.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.572+0000 7f861de00700 1 -- 172.21.15.84:0/2744452579 learned_addr learned my addr 172.21.15.84:0/2744452579 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:25:51.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.573+0000 7f861d400700 1 --2- 172.21.15.84:0/2744452579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f861806ed90 0x7f8618105080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:51.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.573+0000 7f861de00700 1 -- 172.21.15.84:0/2744452579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f861806ed90 msgr2=0x7f8618105080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:51.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.573+0000 7f861de00700 1 --2- 172.21.15.84:0/2744452579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f861806ed90 0x7f8618105080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:51.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.573+0000 7f861de00700 1 -- 172.21.15.84:0/2744452579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8608005040 con 0x7f861806e440 2024-04-26T21:25:51.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.574+0000 7f861de00700 1 --2- 172.21.15.84:0/2744452579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f861806e440 0x7f86181069d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8614002a50 tx=0x7f86140046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:51.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.575+0000 7f860e000700 1 -- 172.21.15.84:0/2744452579 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8614007cc0 con 0x7f861806e440 2024-04-26T21:25:51.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.575+0000 7f860e000700 1 -- 172.21.15.84:0/2744452579 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f861400f040 con 0x7f861806e440 2024-04-26T21:25:51.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.575+0000 7f8620800700 1 -- 172.21.15.84:0/2744452579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86181055c0 con 0x7f861806e440 2024-04-26T21:25:51.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.576+0000 7f8620800700 1 -- 172.21.15.84:0/2744452579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8618105b80 con 0x7f861806e440 2024-04-26T21:25:51.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.576+0000 7f860e000700 1 -- 172.21.15.84:0/2744452579 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f861400daf0 con 0x7f861806e440 2024-04-26T21:25:51.580 INFO:tasks.workunit.client.0.smithi084.stdout:8/222: dread d4/d6/db/d1e/d22/d2f/f21 [0,4194304] 0 2024-04-26T21:25:51.580 INFO:tasks.workunit.client.1.smithi120.stdout:1/395: unlink d6/d14/d6f/l75 0 2024-04-26T21:25:51.583 INFO:tasks.workunit.client.0.smithi084.stdout:8/223: rmdir d4/d7/d15 39 2024-04-26T21:25:51.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.577+0000 7f8620800700 1 -- 172.21.15.84:0/2744452579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f861810e8b0 con 0x7f861806e440 2024-04-26T21:25:51.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.586+0000 7f860e000700 1 -- 172.21.15.84:0/2744452579 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f861400dd50 con 0x7f861806e440 2024-04-26T21:25:51.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.588+0000 7f860e000700 1 --2- 172.21.15.84:0/2744452579 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f860406bd30 0x7f860406e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:51.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.589+0000 7f860e000700 1 -- 172.21.15.84:0/2744452579 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f8614057b60 con 0x7f861806e440 2024-04-26T21:25:51.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.589+0000 7f861d400700 1 --2- 172.21.15.84:0/2744452579 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f860406bd30 0x7f860406e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:51.591 INFO:tasks.workunit.client.0.smithi084.stdout:8/224: creat d4/d6/f40 x:0 0 0 2024-04-26T21:25:51.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.590+0000 7f861d400700 1 --2- 172.21.15.84:0/2744452579 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f860406bd30 0x7f860406e1e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8608000c00 tx=0x7f8608009e30 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:51.593 INFO:tasks.workunit.client.0.smithi084.stdout:3/248: dread d1/d24/d27/d3a/f51 [0,4194304] 0 2024-04-26T21:25:51.594 INFO:tasks.workunit.client.1.smithi120.stdout:2/461: unlink d4/d1b/d4f/f6a 0 2024-04-26T21:25:51.598 INFO:tasks.workunit.client.0.smithi084.stdout:2/264: getdents d6/d7/d3d/d15/d1f/d39/d20/d45 0 2024-04-26T21:25:51.598 INFO:tasks.workunit.client.0.smithi084.stdout:7/180: fsync d6/dc/f3b 0 2024-04-26T21:25:51.599 INFO:tasks.workunit.client.1.smithi120.stdout:3/406: truncate dd/d40/f50 2935918 0 2024-04-26T21:25:51.599 INFO:tasks.workunit.client.1.smithi120.stdout:0/509: dread d0/d3/f9 [0,4194304] 0 2024-04-26T21:25:51.599 INFO:tasks.workunit.client.1.smithi120.stdout:2/462: stat d4/d1b/d2e/d50/f3f 0 2024-04-26T21:25:51.599 INFO:tasks.workunit.client.1.smithi120.stdout:0/510: readlink d0/df/la0 0 2024-04-26T21:25:51.599 INFO:tasks.workunit.client.1.smithi120.stdout:7/431: read d7/d10/d12/d1f/f36 [1735489,53128] 0 2024-04-26T21:25:51.600 INFO:tasks.workunit.client.0.smithi084.stdout:3/249: chown d1/d2c/d2f/d31/f43 872679 1 2024-04-26T21:25:51.600 INFO:tasks.workunit.client.0.smithi084.stdout:9/152: dwrite da/f23 [0,4194304] 0 2024-04-26T21:25:51.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:51.598+0000 7f860e000700 1 -- 172.21.15.84:0/2744452579 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f8614053e90 con 0x7f861806e440 2024-04-26T21:25:51.601 INFO:tasks.workunit.client.1.smithi120.stdout:5/481: mknod d2/d1b/d89/d47/d8a/ca7 0 2024-04-26T21:25:51.601 INFO:tasks.workunit.client.1.smithi120.stdout:0/511: read d0/f66 [2946007,62328] 0 2024-04-26T21:25:51.602 INFO:tasks.workunit.client.0.smithi084.stdout:8/225: creat d4/d6/db/d1e/d22/d2f/f41 x:0 0 0 2024-04-26T21:25:51.604 INFO:tasks.workunit.client.0.smithi084.stdout:7/181: creat d6/d9/d12/d19/f3c x:0 0 0 2024-04-26T21:25:51.605 INFO:tasks.workunit.client.0.smithi084.stdout:8/226: chown d4/d6/db/d1e/d22/d39 131988 1 2024-04-26T21:25:51.609 INFO:tasks.workunit.client.0.smithi084.stdout:3/250: creat d1/d2c/d2f/f54 x:0 0 0 2024-04-26T21:25:51.611 INFO:tasks.workunit.client.1.smithi120.stdout:3/407: creat dd/de/d18/d2c/f8a x:0 0 0 2024-04-26T21:25:51.611 INFO:tasks.workunit.client.0.smithi084.stdout:3/251: chown d1/d2c/d2f/d31/d3b/c3e 4273721 1 2024-04-26T21:25:51.611 INFO:tasks.workunit.client.0.smithi084.stdout:7/182: creat d6/d9/d12/f3d x:0 0 0 2024-04-26T21:25:51.615 INFO:tasks.workunit.client.0.smithi084.stdout:7/183: chown d6/f17 3612 1 2024-04-26T21:25:51.617 INFO:tasks.workunit.client.1.smithi120.stdout:1/396: dread d6/d9/f1c [0,4194304] 0 2024-04-26T21:25:51.620 INFO:tasks.workunit.client.0.smithi084.stdout:7/184: creat d6/d9/d12/f3e x:0 0 0 2024-04-26T21:25:51.620 INFO:tasks.workunit.client.1.smithi120.stdout:2/463: dwrite d4/d1b/d2e/d50/d14/d15/f71 [0,4194304] 0 2024-04-26T21:25:51.623 INFO:tasks.workunit.client.0.smithi084.stdout:7/185: symlink d6/d9/d12/l3f 0 2024-04-26T21:25:51.623 INFO:tasks.workunit.client.1.smithi120.stdout:9/393: truncate d0/d14/f35 3062654 0 2024-04-26T21:25:51.624 INFO:tasks.workunit.client.1.smithi120.stdout:5/482: rename d2/dc/d1d/c9d to d2/d30/ca8 0 2024-04-26T21:25:51.624 INFO:tasks.workunit.client.1.smithi120.stdout:1/397: truncate d6/d7/d1d/d2c/d73/f88 344272 0 2024-04-26T21:25:51.627 INFO:tasks.workunit.client.0.smithi084.stdout:8/227: link d4/d6/db/d1e/d22/d2f/c31 d4/d7/d15/d3c/c42 0 2024-04-26T21:25:51.630 INFO:tasks.workunit.client.1.smithi120.stdout:3/408: unlink dd/f61 0 2024-04-26T21:25:51.630 INFO:tasks.workunit.client.1.smithi120.stdout:3/409: chown dd/d2a 285963 1 2024-04-26T21:25:51.634 INFO:tasks.workunit.client.1.smithi120.stdout:2/464: dread d4/d1b/d25/f90 [0,4194304] 0 2024-04-26T21:25:51.634 INFO:tasks.workunit.client.0.smithi084.stdout:7/186: getdents d6 0 2024-04-26T21:25:51.636 INFO:tasks.workunit.client.0.smithi084.stdout:8/228: write d4/d6/f40 [166172,52588] 0 2024-04-26T21:25:51.638 INFO:tasks.workunit.client.0.smithi084.stdout:9/153: dwrite da/de/f11 [0,4194304] 0 2024-04-26T21:25:51.642 INFO:tasks.workunit.client.0.smithi084.stdout:7/187: unlink d6/d9/d12/l39 0 2024-04-26T21:25:51.643 INFO:tasks.workunit.client.0.smithi084.stdout:2/265: dwrite d6/d7/d3d/d15/d1f/d39/d20/f50 [4194304,4194304] 0 2024-04-26T21:25:51.647 INFO:tasks.workunit.client.0.smithi084.stdout:7/188: truncate d6/dc/f27 1440926 0 2024-04-26T21:25:51.648 INFO:tasks.workunit.client.0.smithi084.stdout:8/229: write d4/d6/db/d1e/d22/d2f/f41 [625386,3371] 0 2024-04-26T21:25:51.649 INFO:tasks.workunit.client.1.smithi120.stdout:2/465: dwrite d4/d1b/d2e/d50/f3f [0,4194304] 0 2024-04-26T21:25:51.650 INFO:tasks.workunit.client.0.smithi084.stdout:4/148: sync 2024-04-26T21:25:51.651 INFO:tasks.workunit.client.0.smithi084.stdout:3/252: dwrite d1/d2c/d2f/f16 [0,4194304] 0 2024-04-26T21:25:51.653 INFO:tasks.workunit.client.0.smithi084.stdout:7/189: chown d6/d26/c29 81224 1 2024-04-26T21:25:51.661 INFO:tasks.workunit.client.0.smithi084.stdout:4/149: mknod d5/d10/d15/d21/d29/c37 0 2024-04-26T21:25:51.663 INFO:tasks.workunit.client.1.smithi120.stdout:8/428: write d5/d6/d11/d52/f44 [807597,124196] 0 2024-04-26T21:25:51.664 INFO:tasks.workunit.client.0.smithi084.stdout:3/253: unlink d1/d2c/d2f/f4a 0 2024-04-26T21:25:51.671 INFO:tasks.workunit.client.0.smithi084.stdout:3/254: rmdir d1/d24 39 2024-04-26T21:25:51.675 INFO:tasks.workunit.client.1.smithi120.stdout:0/512: write d0/d3/dc/d12/f42 [105479,113684] 0 2024-04-26T21:25:51.677 INFO:tasks.workunit.client.1.smithi120.stdout:5/483: fdatasync d2/f3d 0 2024-04-26T21:25:51.679 INFO:tasks.workunit.client.0.smithi084.stdout:8/230: rename d4/d6/db/d1e/d22/d2f/c31 to d4/d6/db/c43 0 2024-04-26T21:25:51.681 INFO:tasks.workunit.client.0.smithi084.stdout:8/231: readlink d4/lc 0 2024-04-26T21:25:51.682 INFO:tasks.workunit.client.0.smithi084.stdout:4/150: link d5/d25/l2d d5/d7/l38 0 2024-04-26T21:25:51.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:51 smithi120 ceph-mon[32741]: pgmap v40: 65 pgs: 65 active+clean; 890 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 17 MiB/s rd, 110 MiB/s wr, 208 op/s 2024-04-26T21:25:51.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:51 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:25:51.683 INFO:tasks.workunit.client.0.smithi084.stdout:2/266: rename d6/d7/d3d/d15/d1f/d41/f56 to d6/d7/d3d/d15/d1f/d39/d20/d45/f61 0 2024-04-26T21:25:51.686 INFO:tasks.workunit.client.0.smithi084.stdout:4/151: chown d5/d25 0 1 2024-04-26T21:25:51.690 INFO:tasks.workunit.client.0.smithi084.stdout:9/154: dwrite da/f1a [0,4194304] 0 2024-04-26T21:25:51.690 INFO:tasks.workunit.client.0.smithi084.stdout:4/152: dread - d5/d7/d17/d32/f34 zero size 2024-04-26T21:25:51.692 INFO:tasks.workunit.client.0.smithi084.stdout:7/190: truncate d6/dc/f31 633860 0 2024-04-26T21:25:51.695 INFO:tasks.workunit.client.1.smithi120.stdout:3/410: unlink dd/d2a/d74/f87 0 2024-04-26T21:25:51.700 INFO:tasks.workunit.client.0.smithi084.stdout:7/191: mkdir d6/d26/d40 0 2024-04-26T21:25:51.700 INFO:tasks.workunit.client.1.smithi120.stdout:0/513: unlink d0/df/l8b 0 2024-04-26T21:25:51.702 INFO:tasks.workunit.client.0.smithi084.stdout:8/232: rename d4/d6/db/d1e/d22/d2f/f33 to d4/d7/d15/d37/d3b/f44 0 2024-04-26T21:25:51.704 INFO:tasks.workunit.client.0.smithi084.stdout:9/155: write da/f1a [438727,55825] 0 2024-04-26T21:25:51.705 INFO:tasks.workunit.client.1.smithi120.stdout:5/484: rmdir d2/dc/d1d/d21/d66/d4d/d5f 39 2024-04-26T21:25:51.708 INFO:tasks.workunit.client.0.smithi084.stdout:4/153: rename d5/d10/d15/d21/l22 to d5/d2e/l39 0 2024-04-26T21:25:51.709 INFO:tasks.workunit.client.0.smithi084.stdout:1/183: sync 2024-04-26T21:25:51.710 INFO:tasks.workunit.client.0.smithi084.stdout:5/162: sync 2024-04-26T21:25:51.710 INFO:tasks.workunit.client.0.smithi084.stdout:6/183: sync 2024-04-26T21:25:51.710 INFO:tasks.workunit.client.0.smithi084.stdout:0/158: sync 2024-04-26T21:25:51.710 INFO:tasks.workunit.client.0.smithi084.stdout:3/255: dread d1/d24/d27/d3a/f51 [4194304,4194304] 0 2024-04-26T21:25:51.711 INFO:tasks.workunit.client.0.smithi084.stdout:7/192: mkdir d6/d26/d40/d41 0 2024-04-26T21:25:51.715 INFO:tasks.workunit.client.0.smithi084.stdout:3/256: fdatasync d1/d24/d27/f2b 0 2024-04-26T21:25:51.715 INFO:tasks.workunit.client.0.smithi084.stdout:2/267: rmdir d6/d7/d3d/d15/d1f/d39/d43/d5e 0 2024-04-26T21:25:51.717 INFO:tasks.workunit.client.1.smithi120.stdout:2/466: mkdir d4/d1b/d56/d65/d8d/d96 0 2024-04-26T21:25:51.719 INFO:tasks.workunit.client.1.smithi120.stdout:8/429: link d5/d6/d34/d37/d60/f3a d5/d6/d34/d37/d60/d55/f91 0 2024-04-26T21:25:51.719 INFO:tasks.workunit.client.1.smithi120.stdout:2/467: chown d4/d1b/d2e/d50/d14 255737 1 2024-04-26T21:25:51.720 INFO:tasks.workunit.client.0.smithi084.stdout:7/193: chown d6/f17 713 1 2024-04-26T21:25:51.721 INFO:tasks.workunit.client.1.smithi120.stdout:3/411: creat dd/d2a/f8b x:0 0 0 2024-04-26T21:25:51.721 INFO:tasks.workunit.client.0.smithi084.stdout:0/159: symlink de/d2b/l31 0 2024-04-26T21:25:51.722 INFO:tasks.workunit.client.0.smithi084.stdout:6/184: rename d3/d18/f1d to d3/de/d1a/d2f/f3c 0 2024-04-26T21:25:51.723 INFO:tasks.workunit.client.0.smithi084.stdout:5/163: chown d0/dc/df/l1f 2670760 1 2024-04-26T21:25:51.726 INFO:tasks.workunit.client.0.smithi084.stdout:4/154: creat d5/d25/d35/f3a x:0 0 0 2024-04-26T21:25:51.726 INFO:tasks.workunit.client.0.smithi084.stdout:7/194: chown d6/d9/d12/d19/d20 6944814 1 2024-04-26T21:25:51.726 INFO:tasks.workunit.client.0.smithi084.stdout:1/184: symlink d2/d9/l37 0 2024-04-26T21:25:51.727 INFO:tasks.workunit.client.1.smithi120.stdout:9/394: creat d0/dd/f83 x:0 0 0 2024-04-26T21:25:51.730 INFO:tasks.workunit.client.0.smithi084.stdout:6/185: dread - d3/de/d15/d23/f30 zero size 2024-04-26T21:25:51.730 INFO:tasks.workunit.client.0.smithi084.stdout:5/164: write d0/fd [5132254,118061] 0 2024-04-26T21:25:51.730 INFO:tasks.workunit.client.0.smithi084.stdout:3/257: rename d1/d38 to d1/d2c/d2f/d31/d55 0 2024-04-26T21:25:51.731 INFO:tasks.workunit.client.1.smithi120.stdout:0/514: truncate d0/f2c 570272 0 2024-04-26T21:25:51.732 INFO:tasks.workunit.client.0.smithi084.stdout:0/160: rmdir de/d2b 39 2024-04-26T21:25:51.735 INFO:tasks.workunit.client.1.smithi120.stdout:1/398: rename d6/d7/d2d/d48/d69 to d6/d7/d1b/d89 0 2024-04-26T21:25:51.737 INFO:tasks.workunit.client.0.smithi084.stdout:6/186: fdatasync d3/de/d15/d23/f2e 0 2024-04-26T21:25:51.738 INFO:tasks.workunit.client.0.smithi084.stdout:6/187: readlink d3/de/d1a/l19 0 2024-04-26T21:25:51.740 INFO:tasks.workunit.client.0.smithi084.stdout:4/155: symlink d5/d10/d15/d21/l3b 0 2024-04-26T21:25:51.742 INFO:tasks.workunit.client.0.smithi084.stdout:5/165: getdents d0/dc/df/d2a 0 2024-04-26T21:25:51.742 INFO:tasks.workunit.client.1.smithi120.stdout:8/430: creat d5/d6/d11/d32/d3b/f92 x:0 0 0 2024-04-26T21:25:51.744 INFO:tasks.workunit.client.1.smithi120.stdout:3/412: mknod dd/de/d18/d24/d43/c8c 0 2024-04-26T21:25:51.746 INFO:tasks.workunit.client.1.smithi120.stdout:9/395: symlink d0/d6/d4d/l84 0 2024-04-26T21:25:51.748 INFO:tasks.workunit.client.1.smithi120.stdout:9/396: fdatasync d0/dd/d34/f59 0 2024-04-26T21:25:51.748 INFO:tasks.workunit.client.0.smithi084.stdout:3/258: fdatasync d1/d2c/d2f/f28 0 2024-04-26T21:25:51.749 INFO:tasks.workunit.client.0.smithi084.stdout:5/166: symlink d0/dc/df/d2a/l2b 0 2024-04-26T21:25:51.749 INFO:tasks.workunit.client.1.smithi120.stdout:0/515: fdatasync d0/d3/d13/f76 0 2024-04-26T21:25:51.752 INFO:tasks.workunit.client.0.smithi084.stdout:1/185: rename d2/d9/ca to d2/d9/d15/d28/c38 0 2024-04-26T21:25:51.753 INFO:tasks.workunit.client.1.smithi120.stdout:6/458: sync 2024-04-26T21:25:51.753 INFO:tasks.workunit.client.0.smithi084.stdout:4/156: truncate d5/d10/f18 1192113 0 2024-04-26T21:25:51.756 INFO:tasks.workunit.client.0.smithi084.stdout:8/233: dwrite d4/d7/d15/d37/d3b/f44 [0,4194304] 0 2024-04-26T21:25:51.758 INFO:tasks.workunit.client.1.smithi120.stdout:5/485: unlink d2/dc/d1d/d21/d66/c20 0 2024-04-26T21:25:51.760 INFO:tasks.workunit.client.1.smithi120.stdout:6/459: chown d4/db/d10/d1a/d2b/d57/d67/f4a 79830836 1 2024-04-26T21:25:51.760 INFO:tasks.workunit.client.0.smithi084.stdout:1/186: mknod d2/d9/d15/d28/c39 0 2024-04-26T21:25:51.764 INFO:tasks.workunit.client.1.smithi120.stdout:7/432: truncate d7/d10/d12/d1f/d28/f3e 1144607 0 2024-04-26T21:25:51.766 INFO:tasks.workunit.client.0.smithi084.stdout:1/187: fsync d2/d9/d15/f25 0 2024-04-26T21:25:51.767 INFO:tasks.workunit.client.1.smithi120.stdout:5/486: chown d2/dc/d1d/d21/d66/f59 7152 1 2024-04-26T21:25:51.770 INFO:tasks.workunit.client.0.smithi084.stdout:7/195: write d6/dc/f31 [594384,18132] 0 2024-04-26T21:25:51.770 INFO:tasks.workunit.client.0.smithi084.stdout:3/259: write d1/d24/f25 [1774060,130359] 0 2024-04-26T21:25:51.772 INFO:tasks.workunit.client.0.smithi084.stdout:8/234: write d4/d7/f14 [8080886,39704] 0 2024-04-26T21:25:51.772 INFO:tasks.workunit.client.0.smithi084.stdout:1/188: readlink d2/d1b/l1c 0 2024-04-26T21:25:51.773 INFO:tasks.workunit.client.0.smithi084.stdout:5/167: rename d0/d17/f18 to d0/f2c 0 2024-04-26T21:25:51.774 INFO:tasks.workunit.client.1.smithi120.stdout:9/397: dwrite d0/dd/f56 [0,4194304] 0 2024-04-26T21:25:51.774 INFO:tasks.workunit.client.1.smithi120.stdout:2/468: creat d4/d1b/d2e/d50/d14/d15/d6c/f97 x:0 0 0 2024-04-26T21:25:51.775 INFO:tasks.workunit.client.1.smithi120.stdout:8/431: fsync d5/d6/f7f 0 2024-04-26T21:25:51.780 INFO:tasks.workunit.client.1.smithi120.stdout:1/399: getdents d6/d7/d1b/d5c/d62 0 2024-04-26T21:25:51.786 INFO:tasks.workunit.client.1.smithi120.stdout:1/400: fdatasync d6/d7/d2d/d48/f66 0 2024-04-26T21:25:51.789 INFO:tasks.workunit.client.0.smithi084.stdout:1/189: mkdir d2/d9/d17/d3a 0 2024-04-26T21:25:51.790 INFO:tasks.workunit.client.1.smithi120.stdout:8/432: truncate d5/d6/f25 1463710 0 2024-04-26T21:25:51.793 INFO:tasks.workunit.client.0.smithi084.stdout:3/260: mknod d1/d24/d27/c56 0 2024-04-26T21:25:51.794 INFO:tasks.workunit.client.0.smithi084.stdout:7/196: write d6/dc/f3b [199819,40508] 0 2024-04-26T21:25:51.795 INFO:tasks.workunit.client.0.smithi084.stdout:8/235: creat d4/d6/db/d1e/f45 x:0 0 0 2024-04-26T21:25:51.796 INFO:tasks.workunit.client.1.smithi120.stdout:7/433: dwrite d7/d10/d12/d2f/d43/f81 [0,4194304] 0 2024-04-26T21:25:51.796 INFO:tasks.workunit.client.1.smithi120.stdout:1/401: read d6/d7/ff [2503674,123269] 0 2024-04-26T21:25:51.797 INFO:tasks.workunit.client.1.smithi120.stdout:8/433: symlink d5/d6/l93 0 2024-04-26T21:25:51.797 INFO:tasks.workunit.client.0.smithi084.stdout:0/161: dwrite f9 [0,4194304] 0 2024-04-26T21:25:51.801 INFO:tasks.workunit.client.0.smithi084.stdout:2/268: dwrite d6/d7/d3d/d15/d1f/d39/d20/f35 [0,4194304] 0 2024-04-26T21:25:51.802 INFO:tasks.workunit.client.0.smithi084.stdout:6/188: dwrite d3/de/d15/d23/f2e [0,4194304] 0 2024-04-26T21:25:51.807 INFO:tasks.workunit.client.1.smithi120.stdout:3/413: dread dd/d2a/d4a/f59 [0,4194304] 0 2024-04-26T21:25:51.809 INFO:tasks.workunit.client.1.smithi120.stdout:7/434: mkdir d7/d10/d12/d1a/d33/d34/d91 0 2024-04-26T21:25:51.810 INFO:tasks.workunit.client.0.smithi084.stdout:5/168: rmdir d0/dc/df/d21 0 2024-04-26T21:25:51.810 INFO:tasks.workunit.client.0.smithi084.stdout:4/157: dwrite d5/d25/d35/f3a [0,4194304] 0 2024-04-26T21:25:51.810 INFO:tasks.workunit.client.0.smithi084.stdout:7/197: chown d6/d26/f30 1281091 1 2024-04-26T21:25:51.813 INFO:tasks.workunit.client.0.smithi084.stdout:5/169: fdatasync d0/fa 0 2024-04-26T21:25:51.817 INFO:tasks.workunit.client.0.smithi084.stdout:2/269: stat d6/d7/l17 0 2024-04-26T21:25:51.821 INFO:tasks.workunit.client.0.smithi084.stdout:8/236: symlink d4/d6/db/l46 0 2024-04-26T21:25:51.823 INFO:tasks.workunit.client.1.smithi120.stdout:3/414: unlink dd/de/df/d12/d6c/d46/f73 0 2024-04-26T21:25:51.826 INFO:tasks.workunit.client.1.smithi120.stdout:5/487: dread d2/dc/d1d/d21/d66/f41 [0,4194304] 0 2024-04-26T21:25:51.827 INFO:tasks.workunit.client.0.smithi084.stdout:3/261: creat d1/d24/d27/d3a/f57 x:0 0 0 2024-04-26T21:25:51.828 INFO:tasks.workunit.client.1.smithi120.stdout:1/402: link d6/d7/d1d/d5d/d67/dd/d35/f87 d6/d7/d1b/f8a 0 2024-04-26T21:25:51.828 INFO:tasks.workunit.client.0.smithi084.stdout:4/158: rename d5/d7/d17/f36 to d5/d10/d15/d21/d29/f3c 0 2024-04-26T21:25:51.830 INFO:tasks.workunit.client.0.smithi084.stdout:8/237: write d4/f13 [4550493,6583] 0 2024-04-26T21:25:51.833 INFO:tasks.workunit.client.0.smithi084.stdout:1/190: dread d2/d19/f1e [0,4194304] 0 2024-04-26T21:25:51.833 INFO:tasks.workunit.client.1.smithi120.stdout:7/435: dwrite d7/d10/d12/d1f/f48 [0,4194304] 0 2024-04-26T21:25:51.836 INFO:tasks.workunit.client.0.smithi084.stdout:2/270: read d6/d7/d3d/f1e [946905,66715] 0 2024-04-26T21:25:51.838 INFO:tasks.workunit.client.0.smithi084.stdout:4/159: write d5/d7/f24 [5194847,70384] 0 2024-04-26T21:25:51.844 INFO:tasks.workunit.client.0.smithi084.stdout:6/189: dread d3/d18/f20 [4194304,4194304] 0 2024-04-26T21:25:51.844 INFO:tasks.workunit.client.0.smithi084.stdout:4/160: write d5/d25/f2f [858422,24857] 0 2024-04-26T21:25:51.846 INFO:tasks.workunit.client.1.smithi120.stdout:3/415: mkdir dd/de/d18/d8d 0 2024-04-26T21:25:51.849 INFO:tasks.workunit.client.1.smithi120.stdout:7/436: rename d7/d10/d12/d1f/d28/f53 to d7/d10/d12/d1f/d28/d4c/f92 0 2024-04-26T21:25:51.857 INFO:tasks.workunit.client.0.smithi084.stdout:2/271: getdents d6/d7/d3d/d4f 0 2024-04-26T21:25:51.858 INFO:tasks.workunit.client.1.smithi120.stdout:3/416: symlink dd/de/d18/d2c/d76/d3b/l8e 0 2024-04-26T21:25:51.861 INFO:tasks.workunit.client.1.smithi120.stdout:3/417: write dd/d2a/f7f [867953,38166] 0 2024-04-26T21:25:51.862 INFO:tasks.workunit.client.0.smithi084.stdout:6/190: mknod d3/c3d 0 2024-04-26T21:25:51.862 INFO:tasks.workunit.client.1.smithi120.stdout:5/488: dwrite d2/dc/d1d/d21/d66/f59 [4194304,4194304] 0 2024-04-26T21:25:51.868 INFO:tasks.workunit.client.1.smithi120.stdout:9/398: dwrite d0/f1 [0,4194304] 0 2024-04-26T21:25:51.869 INFO:tasks.workunit.client.1.smithi120.stdout:2/469: dread d4/d1b/f38 [0,4194304] 0 2024-04-26T21:25:51.869 INFO:tasks.workunit.client.0.smithi084.stdout:6/191: creat d3/de/f3e x:0 0 0 2024-04-26T21:25:51.872 INFO:tasks.workunit.client.1.smithi120.stdout:3/418: write dd/de/d18/d2c/d76/d3b/f67 [256602,41005] 0 2024-04-26T21:25:51.872 INFO:tasks.workunit.client.1.smithi120.stdout:5/489: creat d2/dc/d1d/d1f/d34/fa9 x:0 0 0 2024-04-26T21:25:51.873 INFO:tasks.workunit.client.0.smithi084.stdout:4/161: fsync d5/d7/f24 0 2024-04-26T21:25:51.874 INFO:tasks.workunit.client.1.smithi120.stdout:2/470: mknod d4/d1b/d4f/c98 0 2024-04-26T21:25:51.874 INFO:tasks.workunit.client.1.smithi120.stdout:9/399: write d0/dd/d34/f59 [1041028,11801] 0 2024-04-26T21:25:51.875 INFO:tasks.workunit.client.0.smithi084.stdout:6/192: readlink d3/de/d1a/l1e 0 2024-04-26T21:25:51.880 INFO:tasks.workunit.client.1.smithi120.stdout:9/400: truncate d0/d6/f76 1287658 0 2024-04-26T21:25:51.883 INFO:tasks.workunit.client.0.smithi084.stdout:3/262: dread d1/d2c/d2f/f1f [0,4194304] 0 2024-04-26T21:25:51.883 INFO:tasks.workunit.client.0.smithi084.stdout:6/193: readlink d3/de/d1a/l1e 0 2024-04-26T21:25:51.883 INFO:tasks.workunit.client.0.smithi084.stdout:1/191: dwrite d2/d9/d17/f18 [0,4194304] 0 2024-04-26T21:25:51.887 INFO:tasks.workunit.client.0.smithi084.stdout:7/198: dwrite d6/d9/d12/f3d [0,4194304] 0 2024-04-26T21:25:51.889 INFO:tasks.workunit.client.1.smithi120.stdout:5/490: mkdir d2/dc/d1d/d21/d66/d6a/d8c/daa 0 2024-04-26T21:25:51.891 INFO:tasks.workunit.client.1.smithi120.stdout:0/516: write d0/f2c [581582,48471] 0 2024-04-26T21:25:51.891 INFO:tasks.workunit.client.0.smithi084.stdout:0/162: truncate f4 5161621 0 2024-04-26T21:25:51.892 INFO:tasks.workunit.client.0.smithi084.stdout:1/192: dread - d2/f30 zero size 2024-04-26T21:25:51.894 INFO:tasks.workunit.client.0.smithi084.stdout:1/193: rename d2 to d2/d1b/d3b 22 2024-04-26T21:25:51.895 INFO:tasks.workunit.client.1.smithi120.stdout:0/517: stat d0/d3/dc/d12/dae 0 2024-04-26T21:25:51.899 INFO:tasks.workunit.client.0.smithi084.stdout:0/163: write de/f14 [1788944,106888] 0 2024-04-26T21:25:51.902 INFO:tasks.workunit.client.1.smithi120.stdout:9/401: dwrite d0/f1 [0,4194304] 0 2024-04-26T21:25:51.902 INFO:tasks.workunit.client.1.smithi120.stdout:2/471: dwrite f1 [0,4194304] 0 2024-04-26T21:25:51.908 INFO:tasks.workunit.client.1.smithi120.stdout:9/402: mkdir d0/d14/d2d/d4b/d85 0 2024-04-26T21:25:51.909 INFO:tasks.workunit.client.0.smithi084.stdout:6/194: rename d3/de/d1a/d2f/c3a to d3/d18/d37/c3f 0 2024-04-26T21:25:51.910 INFO:tasks.workunit.client.0.smithi084.stdout:7/199: symlink d6/d9/d12/d19/d20/d32/l42 0 2024-04-26T21:25:51.910 INFO:tasks.workunit.client.1.smithi120.stdout:5/491: creat d2/dc/d1d/d21/d66/d4d/fab x:0 0 0 2024-04-26T21:25:51.911 INFO:tasks.workunit.client.1.smithi120.stdout:2/472: mkdir d4/d1b/d5c/d99 0 2024-04-26T21:25:51.914 INFO:tasks.workunit.client.0.smithi084.stdout:7/200: read - d6/d9/d12/f33 zero size 2024-04-26T21:25:51.915 INFO:tasks.workunit.client.0.smithi084.stdout:4/162: link d5/d10/d15/d21/d29/c37 d5/d10/d15/c3d 0 2024-04-26T21:25:51.917 INFO:tasks.workunit.client.1.smithi120.stdout:9/403: write d0/dd/d3a/f58 [2171177,103119] 0 2024-04-26T21:25:51.922 INFO:tasks.workunit.client.0.smithi084.stdout:0/164: dread de/d20/f29 [0,4194304] 0 2024-04-26T21:25:51.923 INFO:tasks.workunit.client.0.smithi084.stdout:4/163: unlink d5/d7/f24 0 2024-04-26T21:25:51.925 INFO:tasks.workunit.client.1.smithi120.stdout:2/473: dread d4/d1b/d25/d29/f37 [0,4194304] 0 2024-04-26T21:25:51.926 INFO:tasks.workunit.client.0.smithi084.stdout:7/201: creat d6/d9/d12/d19/d20/d38/f43 x:0 0 0 2024-04-26T21:25:51.927 INFO:tasks.workunit.client.1.smithi120.stdout:5/492: rename d2/dc/d1d/d21/d66/d4d/f7b to d2/dc/d1d/d1f/fac 0 2024-04-26T21:25:51.928 INFO:tasks.workunit.client.0.smithi084.stdout:1/194: link d2/d9/d15/d28/c39 d2/d9/c3c 0 2024-04-26T21:25:51.930 INFO:tasks.workunit.client.0.smithi084.stdout:6/195: mkdir d3/de/d15/d40 0 2024-04-26T21:25:51.931 INFO:tasks.workunit.client.0.smithi084.stdout:4/164: truncate d5/d25/f2f 1650469 0 2024-04-26T21:25:51.934 INFO:tasks.workunit.client.0.smithi084.stdout:7/202: chown d6/l1f 128219 1 2024-04-26T21:25:51.934 INFO:tasks.workunit.client.0.smithi084.stdout:6/196: chown d3/de/d15/d40 111268613 1 2024-04-26T21:25:51.935 INFO:tasks.workunit.client.0.smithi084.stdout:0/165: rmdir de/d20/d30 0 2024-04-26T21:25:51.935 INFO:tasks.workunit.client.1.smithi120.stdout:9/404: mkdir d0/d14/d2d/d4b/d85/d86 0 2024-04-26T21:25:51.938 INFO:tasks.workunit.client.1.smithi120.stdout:5/493: symlink d2/d1b/d89/d47/d8a/lad 0 2024-04-26T21:25:51.939 INFO:tasks.workunit.client.1.smithi120.stdout:4/400: sync 2024-04-26T21:25:51.940 INFO:tasks.workunit.client.1.smithi120.stdout:5/494: chown d2/dc/d1d/d1f/f4c 395823 1 2024-04-26T21:25:51.940 INFO:tasks.workunit.client.0.smithi084.stdout:6/197: chown d3/de/d15/d23/f2a 95 1 2024-04-26T21:25:51.941 INFO:tasks.workunit.client.1.smithi120.stdout:4/401: write d10/f5b [1484163,67668] 0 2024-04-26T21:25:51.944 INFO:tasks.workunit.client.1.smithi120.stdout:2/474: creat d4/d1b/d25/d2c/d3e/f9a x:0 0 0 2024-04-26T21:25:51.945 INFO:tasks.workunit.client.1.smithi120.stdout:2/475: chown d4/d1b/d5c 6421007 1 2024-04-26T21:25:51.946 INFO:tasks.workunit.client.0.smithi084.stdout:3/263: dwrite d1/d2c/d2f/f1f [0,4194304] 0 2024-04-26T21:25:51.947 INFO:tasks.workunit.client.1.smithi120.stdout:9/405: chown d0/d14/c33 217731 1 2024-04-26T21:25:51.948 INFO:tasks.workunit.client.0.smithi084.stdout:5/170: dread d0/d17/f20 [0,4194304] 0 2024-04-26T21:25:51.952 INFO:tasks.workunit.client.0.smithi084.stdout:7/203: creat d6/d9/d12/d19/d20/f44 x:0 0 0 2024-04-26T21:25:51.952 INFO:tasks.workunit.client.1.smithi120.stdout:4/402: creat d10/d12/f8a x:0 0 0 2024-04-26T21:25:51.954 INFO:tasks.workunit.client.1.smithi120.stdout:4/403: readlink d10/d28/l3f 0 2024-04-26T21:25:51.955 INFO:tasks.workunit.client.0.smithi084.stdout:6/198: dread d3/de/d15/f1c [0,4194304] 0 2024-04-26T21:25:51.955 INFO:tasks.workunit.client.0.smithi084.stdout:7/204: chown d6/d9/d12 21892698 1 2024-04-26T21:25:51.956 INFO:tasks.workunit.client.1.smithi120.stdout:9/406: mkdir d0/dd/d45/d87 0 2024-04-26T21:25:51.959 INFO:tasks.workunit.client.1.smithi120.stdout:5/495: symlink d2/dc/d1d/d1f/lae 0 2024-04-26T21:25:51.960 INFO:tasks.workunit.client.1.smithi120.stdout:4/404: fdatasync d10/d12/f22 0 2024-04-26T21:25:51.961 INFO:tasks.workunit.client.0.smithi084.stdout:5/171: symlink d0/dc/l2d 0 2024-04-26T21:25:51.964 INFO:tasks.workunit.client.1.smithi120.stdout:5/496: creat d2/dc/d1d/faf x:0 0 0 2024-04-26T21:25:51.968 INFO:tasks.workunit.client.0.smithi084.stdout:6/199: write d3/de/d15/d23/f35 [819292,11884] 0 2024-04-26T21:25:51.970 INFO:tasks.workunit.client.1.smithi120.stdout:0/518: dread d0/d3/dc/dd/d1b/d24/d73/fab [0,4194304] 0 2024-04-26T21:25:51.971 INFO:tasks.workunit.client.1.smithi120.stdout:9/407: link d0/dd/f56 d0/d14/d2d/d4b/d85/f88 0 2024-04-26T21:25:51.974 INFO:tasks.workunit.client.0.smithi084.stdout:3/264: creat d1/f58 x:0 0 0 2024-04-26T21:25:51.978 INFO:tasks.workunit.client.0.smithi084.stdout:5/172: mknod d0/dc/df/d2a/c2e 0 2024-04-26T21:25:51.978 INFO:tasks.workunit.client.0.smithi084.stdout:1/195: dwrite d2/d9/d17/f18 [0,4194304] 0 2024-04-26T21:25:51.979 INFO:tasks.workunit.client.0.smithi084.stdout:2/272: dread d6/d7/d3d/f26 [0,4194304] 0 2024-04-26T21:25:51.979 INFO:tasks.workunit.client.0.smithi084.stdout:4/165: dwrite d5/d7/d17/d32/f34 [0,4194304] 0 2024-04-26T21:25:51.979 INFO:tasks.workunit.client.1.smithi120.stdout:4/405: link d10/f4f d10/d28/f8b 0 2024-04-26T21:25:51.986 INFO:tasks.workunit.client.1.smithi120.stdout:5/497: truncate d2/d48/f6f 1069832 0 2024-04-26T21:25:51.989 INFO:tasks.workunit.client.0.smithi084.stdout:5/173: creat d0/dc/f2f x:0 0 0 2024-04-26T21:25:51.989 INFO:tasks.workunit.client.0.smithi084.stdout:3/265: truncate d1/d24/d27/d3a/f57 929780 0 2024-04-26T21:25:51.990 INFO:tasks.workunit.client.0.smithi084.stdout:1/196: mknod d2/d1b/c3d 0 2024-04-26T21:25:51.997 INFO:tasks.workunit.client.0.smithi084.stdout:3/266: chown d1/d24/f36 79 1 2024-04-26T21:25:52.006 INFO:tasks.workunit.client.0.smithi084.stdout:5/174: symlink d0/l30 0 2024-04-26T21:25:52.006 INFO:tasks.workunit.client.0.smithi084.stdout:1/197: write d2/fb [1980167,73308] 0 2024-04-26T21:25:52.006 INFO:tasks.workunit.client.1.smithi120.stdout:5/498: dwrite d2/dc/d1d/d1f/d34/fa9 [0,4194304] 0 2024-04-26T21:25:52.008 INFO:tasks.workunit.client.0.smithi084.stdout:2/273: symlink d6/d7/d3d/d15/d1f/d39/d20/d36/l62 0 2024-04-26T21:25:52.011 INFO:tasks.workunit.client.1.smithi120.stdout:5/499: truncate d2/dc/d1d/f58 2205591 0 2024-04-26T21:25:52.016 INFO:tasks.workunit.client.0.smithi084.stdout:5/175: mkdir d0/dc/df/d31 0 2024-04-26T21:25:52.016 INFO:tasks.workunit.client.0.smithi084.stdout:7/205: dwrite d6/d9/d12/d19/d20/f44 [0,4194304] 0 2024-04-26T21:25:52.020 INFO:tasks.workunit.client.0.smithi084.stdout:6/200: dwrite d3/d18/f38 [0,4194304] 0 2024-04-26T21:25:52.021 INFO:tasks.workunit.client.1.smithi120.stdout:0/519: write d0/df/f63 [911824,85024] 0 2024-04-26T21:25:52.023 INFO:tasks.workunit.client.1.smithi120.stdout:5/500: creat d2/dc/d1d/d1f/fb0 x:0 0 0 2024-04-26T21:25:52.024 INFO:tasks.workunit.client.1.smithi120.stdout:0/520: read - d0/d3/dc/d12/d4a/f74 zero size 2024-04-26T21:25:52.025 INFO:tasks.workunit.client.1.smithi120.stdout:5/501: truncate d2/d30/f8b 435863 0 2024-04-26T21:25:52.025 INFO:tasks.workunit.client.0.smithi084.stdout:6/201: mkdir d3/de/d41 0 2024-04-26T21:25:52.025 INFO:tasks.workunit.client.0.smithi084.stdout:1/198: fdatasync d2/d9/d15/f2f 0 2024-04-26T21:25:52.027 INFO:tasks.workunit.client.1.smithi120.stdout:9/408: truncate d0/d6/f76 781740 0 2024-04-26T21:25:52.031 INFO:tasks.workunit.client.1.smithi120.stdout:9/409: dread - d0/d14/d2d/f41 zero size 2024-04-26T21:25:52.031 INFO:tasks.workunit.client.0.smithi084.stdout:6/202: rmdir d3/d28 39 2024-04-26T21:25:52.031 INFO:tasks.workunit.client.0.smithi084.stdout:0/166: dread de/f1f [0,4194304] 0 2024-04-26T21:25:52.032 INFO:tasks.workunit.client.0.smithi084.stdout:5/176: creat d0/f32 x:0 0 0 2024-04-26T21:25:52.033 INFO:tasks.workunit.client.1.smithi120.stdout:5/502: mknod d2/d48/cb1 0 2024-04-26T21:25:52.034 INFO:tasks.workunit.client.0.smithi084.stdout:1/199: truncate d2/d9/d17/f36 57209 0 2024-04-26T21:25:52.035 INFO:tasks.workunit.client.0.smithi084.stdout:0/167: chown de/f1f 1 1 2024-04-26T21:25:52.038 INFO:tasks.workunit.client.1.smithi120.stdout:5/503: mkdir d2/dc/d1d/d21/db2 0 2024-04-26T21:25:52.038 INFO:tasks.workunit.client.1.smithi120.stdout:9/410: creat d0/d5e/f89 x:0 0 0 2024-04-26T21:25:52.038 INFO:tasks.workunit.client.0.smithi084.stdout:6/203: creat d3/de/d1a/d2f/f42 x:0 0 0 2024-04-26T21:25:52.041 INFO:tasks.workunit.client.1.smithi120.stdout:9/411: mkdir d0/dd/d34/d8a 0 2024-04-26T21:25:52.042 INFO:tasks.workunit.client.1.smithi120.stdout:5/504: fdatasync d2/d48/d63/f92 0 2024-04-26T21:25:52.042 INFO:tasks.workunit.client.0.smithi084.stdout:0/168: truncate de/f12 210029 0 2024-04-26T21:25:52.044 INFO:tasks.workunit.client.0.smithi084.stdout:4/166: truncate d5/f1a 3280089 0 2024-04-26T21:25:52.045 INFO:tasks.workunit.client.0.smithi084.stdout:9/156: sync 2024-04-26T21:25:52.045 INFO:tasks.workunit.client.1.smithi120.stdout:4/406: dread d10/d12/f1d [0,4194304] 0 2024-04-26T21:25:52.045 INFO:tasks.workunit.client.0.smithi084.stdout:8/238: sync 2024-04-26T21:25:52.048 INFO:tasks.workunit.client.0.smithi084.stdout:3/267: truncate d1/f1a 280984 0 2024-04-26T21:25:52.049 INFO:tasks.workunit.client.0.smithi084.stdout:9/157: write da/f34 [592658,57199] 0 2024-04-26T21:25:52.050 INFO:tasks.workunit.client.0.smithi084.stdout:1/200: symlink d2/d9/d17/l3e 0 2024-04-26T21:25:52.051 INFO:tasks.workunit.client.0.smithi084.stdout:5/177: creat d0/f33 x:0 0 0 2024-04-26T21:25:52.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.055+0000 7f8620800700 1 -- 172.21.15.84:0/2744452579 --> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f861810aa40 con 0x7f860406bd30 2024-04-26T21:25:52.057 INFO:tasks.workunit.client.0.smithi084.stdout:6/204: rename d3/d28 to d3/de/d1a/d43 0 2024-04-26T21:25:52.059 INFO:tasks.workunit.client.1.smithi120.stdout:0/521: dread d0/f14 [0,4194304] 0 2024-04-26T21:25:52.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.059+0000 7f860e000700 1 -- 172.21.15.84:0/2744452579 <== mgr.14662 v2:172.21.15.120:6828/3773295163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f861810aa40 con 0x7f860406bd30 2024-04-26T21:25:52.062 INFO:tasks.workunit.client.1.smithi120.stdout:9/412: dwrite d0/d5e/f89 [0,4194304] 0 2024-04-26T21:25:52.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.066+0000 7f8620800700 1 -- 172.21.15.84:0/2744452579 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f860406bd30 msgr2=0x7f860406e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:52.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.066+0000 7f8620800700 1 --2- 172.21.15.84:0/2744452579 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f860406bd30 0x7f860406e1e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8608000c00 tx=0x7f8608009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:52.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.066+0000 7f8620800700 1 -- 172.21.15.84:0/2744452579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f861806e440 msgr2=0x7f86181069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:52.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.066+0000 7f8620800700 1 --2- 172.21.15.84:0/2744452579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f861806e440 0x7f86181069d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8614002a50 tx=0x7f86140046b0 comp rx=0 tx=0).stop 2024-04-26T21:25:52.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.066+0000 7f8620800700 1 -- 172.21.15.84:0/2744452579 shutdown_connections 2024-04-26T21:25:52.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.066+0000 7f8620800700 1 --2- 172.21.15.84:0/2744452579 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f860406bd30 0x7f860406e1e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:52.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.066+0000 7f8620800700 1 --2- 172.21.15.84:0/2744452579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f861806e440 0x7f86181069d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:52.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.066+0000 7f8620800700 1 --2- 172.21.15.84:0/2744452579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f861806ed90 0x7f8618105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:52.070 INFO:tasks.workunit.client.0.smithi084.stdout:8/239: rmdir d4/d6/db/d1e/d22/d2f 39 2024-04-26T21:25:52.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.066+0000 7f8620800700 1 -- 172.21.15.84:0/2744452579 >> 172.21.15.84:0/2744452579 conn(0x7f8618069dc0 msgr2=0x7f8618109320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:52.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.066+0000 7f8620800700 1 -- 172.21.15.84:0/2744452579 shutdown_connections 2024-04-26T21:25:52.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.067+0000 7f8620800700 1 -- 172.21.15.84:0/2744452579 wait complete. 2024-04-26T21:25:52.072 INFO:tasks.workunit.client.0.smithi084.stdout:2/274: truncate d6/d7/d3d/d15/d1f/d39/d20/f50 5818434 0 2024-04-26T21:25:52.075 INFO:tasks.workunit.client.1.smithi120.stdout:9/413: creat d0/d14/d2d/d4b/f8b x:0 0 0 2024-04-26T21:25:52.078 INFO:tasks.workunit.client.0.smithi084.stdout:3/268: symlink d1/d2c/d2f/d31/d55/d4e/l59 0 2024-04-26T21:25:52.078 INFO:tasks.workunit.client.0.smithi084.stdout:1/201: dread d2/d9/f16 [0,4194304] 0 2024-04-26T21:25:52.080 INFO:tasks.workunit.client.1.smithi120.stdout:4/407: write d10/d12/f3c [362586,31988] 0 2024-04-26T21:25:52.081 INFO:tasks.workunit.client.0.smithi084.stdout:1/202: stat d2/d9/d17/d2a/d2c 0 2024-04-26T21:25:52.083 INFO:tasks.workunit.client.0.smithi084.stdout:0/169: truncate de/f1e 786869 0 2024-04-26T21:25:52.086 INFO:tasks.workunit.client.1.smithi120.stdout:9/414: creat d0/d14/f8c x:0 0 0 2024-04-26T21:25:52.088 INFO:tasks.workunit.client.1.smithi120.stdout:6/460: sync 2024-04-26T21:25:52.090 INFO:tasks.workunit.client.0.smithi084.stdout:2/275: write d6/d7/d3d/d15/d1f/d39/d20/d45/f51 [742749,63094] 0 2024-04-26T21:25:52.090 INFO:tasks.workunit.client.1.smithi120.stdout:9/415: truncate d0/dd/f62 49513 0 2024-04-26T21:25:52.091 INFO:tasks.workunit.client.1.smithi120.stdout:9/416: fsync d0/f4f 0 2024-04-26T21:25:52.091 INFO:tasks.workunit.client.1.smithi120.stdout:6/461: chown d4/db/d10/d1a/d2b/d57/l5e 12760583 1 2024-04-26T21:25:52.092 INFO:tasks.workunit.client.0.smithi084.stdout:1/203: mknod d2/d9/d17/c3f 0 2024-04-26T21:25:52.094 INFO:tasks.workunit.client.1.smithi120.stdout:4/408: mkdir d10/d65/d8c 0 2024-04-26T21:25:52.095 INFO:tasks.workunit.client.1.smithi120.stdout:4/409: stat fe 0 2024-04-26T21:25:52.095 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:25:52.097 INFO:tasks.workunit.client.1.smithi120.stdout:6/462: mknod d4/db/d10/dd/d28/c96 0 2024-04-26T21:25:52.100 INFO:tasks.workunit.client.0.smithi084.stdout:0/170: mkdir de/d1c/d32 0 2024-04-26T21:25:52.100 INFO:tasks.workunit.client.0.smithi084.stdout:2/276: symlink d6/l63 0 2024-04-26T21:25:52.102 INFO:tasks.workunit.client.1.smithi120.stdout:4/410: mknod d10/d65/d72/d86/c8d 0 2024-04-26T21:25:52.104 INFO:tasks.workunit.client.0.smithi084.stdout:9/158: dwrite f9 [0,4194304] 0 2024-04-26T21:25:52.111 INFO:tasks.workunit.client.1.smithi120.stdout:6/463: rename d4/db/d10/dd/d4e/d5d to d4/db/d25/d6d/d97 0 2024-04-26T21:25:52.112 INFO:tasks.workunit.client.0.smithi084.stdout:2/277: write d6/d7/d3d/f5c [444354,85149] 0 2024-04-26T21:25:52.114 INFO:tasks.workunit.client.1.smithi120.stdout:9/417: getdents d0/d6 0 2024-04-26T21:25:52.114 INFO:tasks.workunit.client.1.smithi120.stdout:6/464: chown d4/db/d10/d1a/d2b/d57/d67/c3c 4911 1 2024-04-26T21:25:52.118 INFO:tasks.workunit.client.1.smithi120.stdout:6/465: write d4/db/d10/dd/d28/f61 [2520604,76213] 0 2024-04-26T21:25:52.119 INFO:tasks.workunit.client.0.smithi084.stdout:6/205: dwrite d3/f26 [4194304,4194304] 0 2024-04-26T21:25:52.119 INFO:tasks.workunit.client.1.smithi120.stdout:5/505: dread d2/dc/d1d/d21/d66/d4d/f99 [0,4194304] 0 2024-04-26T21:25:52.121 INFO:tasks.workunit.client.1.smithi120.stdout:5/506: chown d2/dc 147519201 1 2024-04-26T21:25:52.122 INFO:tasks.workunit.client.1.smithi120.stdout:6/466: chown d4/db/d10/dd/d4e/d76/l8e 4 1 2024-04-26T21:25:52.122 INFO:tasks.workunit.client.0.smithi084.stdout:8/240: dwrite d4/f13 [0,4194304] 0 2024-04-26T21:25:52.126 INFO:tasks.workunit.client.0.smithi084.stdout:3/269: dwrite d1/d24/d27/f30 [0,4194304] 0 2024-04-26T21:25:52.133 INFO:tasks.workunit.client.0.smithi084.stdout:2/278: chown d6/d7/d3d/f54 2 1 2024-04-26T21:25:52.134 INFO:tasks.workunit.client.1.smithi120.stdout:9/418: dwrite d0/dd/d3a/f6b [0,4194304] 0 2024-04-26T21:25:52.139 INFO:tasks.workunit.client.1.smithi120.stdout:6/467: truncate d4/db/d10/d1a/d2b/f4c 223805 0 2024-04-26T21:25:52.140 INFO:tasks.workunit.client.0.smithi084.stdout:5/178: dwrite d0/dc/f14 [0,4194304] 0 2024-04-26T21:25:52.145 INFO:tasks.workunit.client.1.smithi120.stdout:0/522: dread d0/d3/dc/f1c [0,4194304] 0 2024-04-26T21:25:52.146 INFO:tasks.workunit.client.1.smithi120.stdout:9/419: dread d0/d14/d2d/f2f [0,4194304] 0 2024-04-26T21:25:52.146 INFO:tasks.workunit.client.0.smithi084.stdout:3/270: fdatasync d1/d2c/d2f/f28 0 2024-04-26T21:25:52.146 INFO:tasks.workunit.client.0.smithi084.stdout:8/241: chown d4/f5 1664896 1 2024-04-26T21:25:52.147 INFO:tasks.workunit.client.1.smithi120.stdout:6/468: dread d4/db/d10/f44 [0,4194304] 0 2024-04-26T21:25:52.149 INFO:tasks.workunit.client.1.smithi120.stdout:0/523: write d0/d3/dc/f1c [303176,6043] 0 2024-04-26T21:25:52.150 INFO:tasks.workunit.client.0.smithi084.stdout:5/179: mknod d0/d17/c34 0 2024-04-26T21:25:52.152 INFO:tasks.workunit.client.0.smithi084.stdout:3/271: symlink d1/d24/l5a 0 2024-04-26T21:25:52.153 INFO:tasks.workunit.client.1.smithi120.stdout:6/469: mkdir d4/db/d10/d1a/d2b/d57/d67/d98 0 2024-04-26T21:25:52.159 INFO:tasks.workunit.client.1.smithi120.stdout:9/420: dread d0/dd/f12 [0,4194304] 0 2024-04-26T21:25:52.160 INFO:tasks.workunit.client.0.smithi084.stdout:8/242: creat d4/d6/f47 x:0 0 0 2024-04-26T21:25:52.165 INFO:tasks.workunit.client.0.smithi084.stdout:1/204: dwrite d2/d9/d17/d2a/d2c/f2d [0,4194304] 0 2024-04-26T21:25:52.165 INFO:tasks.workunit.client.1.smithi120.stdout:9/421: creat d0/dd/d3a/d5c/f8d x:0 0 0 2024-04-26T21:25:52.165 INFO:tasks.workunit.client.0.smithi084.stdout:2/279: read d6/f53 [4112292,111666] 0 2024-04-26T21:25:52.166 INFO:tasks.workunit.client.0.smithi084.stdout:3/272: symlink d1/d2c/d2f/l5b 0 2024-04-26T21:25:52.171 INFO:tasks.workunit.client.0.smithi084.stdout:3/273: chown d1/d2c/d2f 156 1 2024-04-26T21:25:52.171 INFO:tasks.workunit.client.0.smithi084.stdout:4/167: dread d5/fe [0,4194304] 0 2024-04-26T21:25:52.179 INFO:tasks.workunit.client.0.smithi084.stdout:1/205: creat d2/d19/f40 x:0 0 0 2024-04-26T21:25:52.179 INFO:tasks.workunit.client.0.smithi084.stdout:8/243: rmdir d4/d7/d15 39 2024-04-26T21:25:52.181 INFO:tasks.workunit.client.0.smithi084.stdout:0/171: dwrite de/f1e [0,4194304] 0 2024-04-26T21:25:52.182 INFO:tasks.workunit.client.0.smithi084.stdout:6/206: dwrite d3/d18/f20 [8388608,4194304] 0 2024-04-26T21:25:52.188 INFO:tasks.workunit.client.0.smithi084.stdout:2/280: symlink d6/d7/d3d/d4f/l64 0 2024-04-26T21:25:52.189 INFO:tasks.workunit.client.0.smithi084.stdout:0/172: read de/d1c/f2a [3707338,101035] 0 2024-04-26T21:25:52.193 INFO:tasks.workunit.client.0.smithi084.stdout:4/168: write d5/d10/d15/d21/d29/f3c [37341,24857] 0 2024-04-26T21:25:52.196 INFO:tasks.workunit.client.1.smithi120.stdout:5/507: dwrite d2/d30/d3b/f68 [0,4194304] 0 2024-04-26T21:25:52.201 INFO:tasks.workunit.client.1.smithi120.stdout:5/508: unlink d2/dc/d1d/d21/d66/c3c 0 2024-04-26T21:25:52.201 INFO:tasks.workunit.client.0.smithi084.stdout:6/207: rename d3/de/d1a/f22 to d3/de/d41/f44 0 2024-04-26T21:25:52.210 INFO:tasks.workunit.client.1.smithi120.stdout:5/509: truncate d2/dc/d1d/d21/d77/f86 694913 0 2024-04-26T21:25:52.212 INFO:tasks.workunit.client.0.smithi084.stdout:0/173: rename de/d20/f28 to de/d1c/f33 0 2024-04-26T21:25:52.213 INFO:tasks.workunit.client.0.smithi084.stdout:3/274: link d1/d2c/l33 d1/d2c/d2f/d31/d3b/l5c 0 2024-04-26T21:25:52.215 INFO:tasks.workunit.client.0.smithi084.stdout:1/206: getdents d2/d9/d15/d28 0 2024-04-26T21:25:52.217 INFO:tasks.workunit.client.1.smithi120.stdout:5/510: mkdir d2/d82/d96/db3 0 2024-04-26T21:25:52.218 INFO:tasks.workunit.client.1.smithi120.stdout:9/422: write d0/dd/f56 [3081214,112581] 0 2024-04-26T21:25:52.218 INFO:tasks.workunit.client.0.smithi084.stdout:1/207: write d2/f30 [296008,25810] 0 2024-04-26T21:25:52.219 INFO:tasks.workunit.client.0.smithi084.stdout:6/208: dread d3/de/d15/d23/f35 [0,4194304] 0 2024-04-26T21:25:52.221 INFO:tasks.workunit.client.0.smithi084.stdout:4/169: getdents d5/d7/d17 0 2024-04-26T21:25:52.221 INFO:tasks.workunit.client.1.smithi120.stdout:0/524: dwrite d0/d3/dc/dd/f21 [0,4194304] 0 2024-04-26T21:25:52.227 INFO:tasks.workunit.client.1.smithi120.stdout:9/423: creat d0/dd/d3a/d5c/f8e x:0 0 0 2024-04-26T21:25:52.228 INFO:tasks.workunit.client.0.smithi084.stdout:6/209: mkdir d3/de/d15/d45 0 2024-04-26T21:25:52.230 INFO:tasks.workunit.client.1.smithi120.stdout:5/511: getdents d2/dc/d1d/d21/d77/d9c 0 2024-04-26T21:25:52.232 INFO:tasks.workunit.client.1.smithi120.stdout:9/424: dread - d0/dd/d34/f64 zero size 2024-04-26T21:25:52.234 INFO:tasks.workunit.client.0.smithi084.stdout:2/281: write d6/d7/d3d/d15/d1f/d39/fe [1964052,16394] 0 2024-04-26T21:25:52.235 INFO:tasks.workunit.client.0.smithi084.stdout:1/208: getdents d2 0 2024-04-26T21:25:52.236 INFO:tasks.workunit.client.0.smithi084.stdout:3/275: link d1/d24/d27/c4f d1/d2c/c5d 0 2024-04-26T21:25:52.238 INFO:tasks.workunit.client.0.smithi084.stdout:6/210: symlink d3/de/d15/l46 0 2024-04-26T21:25:52.239 INFO:tasks.workunit.client.1.smithi120.stdout:9/425: rename d0/dd/d34/f64 to d0/d14/d2d/d4b/d85/d86/f8f 0 2024-04-26T21:25:52.244 INFO:tasks.workunit.client.1.smithi120.stdout:9/426: creat d0/f90 x:0 0 0 2024-04-26T21:25:52.251 INFO:tasks.workunit.client.1.smithi120.stdout:0/525: write d0/d3/dc/d12/d31/f33 [273812,70737] 0 2024-04-26T21:25:52.252 INFO:tasks.workunit.client.1.smithi120.stdout:9/427: creat d0/d14/d2d/f91 x:0 0 0 2024-04-26T21:25:52.254 INFO:tasks.workunit.client.0.smithi084.stdout:2/282: rename d6/d7/f5b to d6/d7/d3d/d15/d1f/d41/f65 0 2024-04-26T21:25:52.257 INFO:tasks.workunit.client.0.smithi084.stdout:6/211: mknod d3/de/c47 0 2024-04-26T21:25:52.259 INFO:tasks.workunit.client.0.smithi084.stdout:8/244: dread d4/d7/d15/f18 [0,4194304] 0 2024-04-26T21:25:52.263 INFO:tasks.workunit.client.0.smithi084.stdout:6/212: dread - d3/de/d1a/d2f/f42 zero size 2024-04-26T21:25:52.264 INFO:tasks.workunit.client.1.smithi120.stdout:0/526: write d0/d3/dc/dd/d1b/d39/f50 [1048264,112288] 0 2024-04-26T21:25:52.265 INFO:tasks.workunit.client.1.smithi120.stdout:9/428: dwrite d0/f90 [0,4194304] 0 2024-04-26T21:25:52.266 INFO:tasks.workunit.client.0.smithi084.stdout:2/283: creat d6/d7/d3d/d15/d1f/d39/d20/d45/f66 x:0 0 0 2024-04-26T21:25:52.266 INFO:tasks.workunit.client.0.smithi084.stdout:0/174: dwrite de/d1c/f2a [4194304,4194304] 0 2024-04-26T21:25:52.267 INFO:tasks.workunit.client.1.smithi120.stdout:0/527: write d0/d3/dc/d12/f6a [992602,54987] 0 2024-04-26T21:25:52.269 INFO:tasks.workunit.client.1.smithi120.stdout:9/429: creat d0/dd/d3a/f92 x:0 0 0 2024-04-26T21:25:52.271 INFO:tasks.workunit.client.1.smithi120.stdout:9/430: dread - d0/d6/d4d/d65/f71 zero size 2024-04-26T21:25:52.273 INFO:tasks.workunit.client.1.smithi120.stdout:1/403: sync 2024-04-26T21:25:52.273 INFO:tasks.workunit.client.1.smithi120.stdout:8/434: sync 2024-04-26T21:25:52.273 INFO:tasks.workunit.client.1.smithi120.stdout:9/431: fdatasync d0/dd/d3a/d5c/f8e 0 2024-04-26T21:25:52.275 INFO:tasks.workunit.client.1.smithi120.stdout:8/435: truncate d5/d6/d34/d42/f5b 194313 0 2024-04-26T21:25:52.276 INFO:tasks.workunit.client.1.smithi120.stdout:0/528: link d0/f72 d0/d3/d13/d81/fb5 0 2024-04-26T21:25:52.277 INFO:tasks.workunit.client.0.smithi084.stdout:3/276: dwrite d1/d24/d27/d3a/f57 [0,4194304] 0 2024-04-26T21:25:52.278 INFO:tasks.workunit.client.0.smithi084.stdout:8/245: mknod d4/d6/db/d1e/d22/c48 0 2024-04-26T21:25:52.278 INFO:tasks.workunit.client.1.smithi120.stdout:1/404: unlink d6/d7/d2d/d48/f49 0 2024-04-26T21:25:52.283 INFO:tasks.workunit.client.0.smithi084.stdout:6/213: creat d3/de/d1a/d43/f48 x:0 0 0 2024-04-26T21:25:52.283 INFO:tasks.workunit.client.1.smithi120.stdout:8/436: mkdir d5/d6/d34/d37/d94 0 2024-04-26T21:25:52.284 INFO:tasks.workunit.client.1.smithi120.stdout:0/529: symlink d0/d3/d51/lb6 0 2024-04-26T21:25:52.284 INFO:tasks.workunit.client.1.smithi120.stdout:1/405: creat d6/d9/f8b x:0 0 0 2024-04-26T21:25:52.285 INFO:tasks.workunit.client.0.smithi084.stdout:6/214: readlink d3/de/d1a/l1e 0 2024-04-26T21:25:52.287 INFO:tasks.workunit.client.0.smithi084.stdout:2/284: mkdir d6/d3e/d67 0 2024-04-26T21:25:52.288 INFO:tasks.workunit.client.1.smithi120.stdout:8/437: truncate d5/d6/d11/d32/f8f 310203 0 2024-04-26T21:25:52.290 INFO:tasks.workunit.client.0.smithi084.stdout:0/175: link de/d20/c27 de/d20/c34 0 2024-04-26T21:25:52.291 INFO:tasks.workunit.client.1.smithi120.stdout:8/438: truncate d5/d6/d11/d32/f45 5016359 0 2024-04-26T21:25:52.291 INFO:tasks.workunit.client.1.smithi120.stdout:1/406: rename d6/d7/d1b/d5c to d6/d7/d1b/d89/d8c 0 2024-04-26T21:25:52.292 INFO:tasks.workunit.client.0.smithi084.stdout:0/176: chown de/c18 847050925 1 2024-04-26T21:25:52.293 INFO:tasks.workunit.client.1.smithi120.stdout:0/530: mkdir d0/d3/dc/dd/d1b/d24/d73/db7 0 2024-04-26T21:25:52.293 INFO:tasks.workunit.client.0.smithi084.stdout:6/215: write d3/de/d1a/f36 [1123627,4505] 0 2024-04-26T21:25:52.296 INFO:tasks.workunit.client.0.smithi084.stdout:0/177: symlink de/d1c/l35 0 2024-04-26T21:25:52.299 INFO:tasks.workunit.client.0.smithi084.stdout:6/216: truncate d3/de/d1a/d43/f33 138545 0 2024-04-26T21:25:52.300 INFO:tasks.workunit.client.1.smithi120.stdout:1/407: creat d6/d7/d1b/d3b/d6d/f8d x:0 0 0 2024-04-26T21:25:52.301 INFO:tasks.workunit.client.0.smithi084.stdout:0/178: creat de/d20/f36 x:0 0 0 2024-04-26T21:25:52.301 INFO:tasks.workunit.client.1.smithi120.stdout:1/408: dread - d6/d7/d1b/f8a zero size 2024-04-26T21:25:52.302 INFO:tasks.workunit.client.1.smithi120.stdout:1/409: readlink d6/d7/l68 0 2024-04-26T21:25:52.306 INFO:tasks.workunit.client.0.smithi084.stdout:8/246: dread d4/d6/db/d1e/d22/f2e [0,4194304] 0 2024-04-26T21:25:52.307 INFO:tasks.workunit.client.1.smithi120.stdout:0/531: dwrite d0/d3/dc/d12/d4a/f74 [0,4194304] 0 2024-04-26T21:25:52.308 INFO:tasks.workunit.client.0.smithi084.stdout:8/247: write d4/f1c [8652284,46410] 0 2024-04-26T21:25:52.310 INFO:tasks.workunit.client.1.smithi120.stdout:0/532: write d0/d3/dc/dd/d1b/f8a [1031977,92262] 0 2024-04-26T21:25:52.314 INFO:tasks.workunit.client.0.smithi084.stdout:8/248: fsync d4/d6/f40 0 2024-04-26T21:25:52.314 INFO:tasks.workunit.client.0.smithi084.stdout:0/179: getdents de 0 2024-04-26T21:25:52.320 INFO:tasks.workunit.client.0.smithi084.stdout:0/180: symlink de/d20/l37 0 2024-04-26T21:25:52.323 INFO:tasks.workunit.client.1.smithi120.stdout:1/410: creat d6/d14/d6f/f8e x:0 0 0 2024-04-26T21:25:52.325 INFO:tasks.workunit.client.1.smithi120.stdout:1/411: write d6/d14/d6f/f8e [999712,93447] 0 2024-04-26T21:25:52.328 INFO:tasks.workunit.client.1.smithi120.stdout:1/412: stat d6/d7/d1d/d5d/d67 0 2024-04-26T21:25:52.328 INFO:tasks.workunit.client.0.smithi084.stdout:6/217: dread d3/f9 [4194304,4194304] 0 2024-04-26T21:25:52.329 INFO:tasks.workunit.client.0.smithi084.stdout:8/249: getdents d4/d7/d15/d37/d3b 0 2024-04-26T21:25:52.330 INFO:tasks.workunit.client.0.smithi084.stdout:2/285: dwrite d6/d7/d3d/d15/d1f/d22/f24 [0,4194304] 0 2024-04-26T21:25:52.332 INFO:tasks.workunit.client.1.smithi120.stdout:0/533: rename d0/d3/dc/dd/d1b/d24/f6b to d0/d3/dc/dd/d1b/d24/d7d/fb8 0 2024-04-26T21:25:52.333 INFO:tasks.workunit.client.1.smithi120.stdout:9/432: dread d0/d14/f35 [0,4194304] 0 2024-04-26T21:25:52.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.335+0000 7fd474000700 1 -- 172.21.15.84:0/844680449 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd46c0fdfd0 msgr2=0x7fd46c0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:52.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.335+0000 7fd474000700 1 --2- 172.21.15.84:0/844680449 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd46c0fdfd0 0x7fd46c0fe440 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd460004940 tx=0x7fd460009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:52.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.335+0000 7fd474000700 1 -- 172.21.15.84:0/844680449 shutdown_connections 2024-04-26T21:25:52.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.335+0000 7fd474000700 1 --2- 172.21.15.84:0/844680449 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd46c0fdfd0 0x7fd46c0fe440 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:52.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.335+0000 7fd474000700 1 --2- 172.21.15.84:0/844680449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd46c0fce60 0x7fd46c0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:52.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.335+0000 7fd474000700 1 -- 172.21.15.84:0/844680449 >> 172.21.15.84:0/844680449 conn(0x7fd46c0f8560 msgr2=0x7fd46c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:52.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.336+0000 7fd474000700 1 -- 172.21.15.84:0/844680449 shutdown_connections 2024-04-26T21:25:52.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.336+0000 7fd474000700 1 -- 172.21.15.84:0/844680449 wait complete. 2024-04-26T21:25:52.338 INFO:tasks.workunit.client.1.smithi120.stdout:1/413: mknod d6/d7/d1d/d5d/d67/dd/d35/c8f 0 2024-04-26T21:25:52.338 INFO:tasks.workunit.client.0.smithi084.stdout:6/218: creat d3/d18/d37/f49 x:0 0 0 2024-04-26T21:25:52.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.337+0000 7fd474000700 1 Processor -- start 2024-04-26T21:25:52.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.337+0000 7fd474000700 1 -- start start 2024-04-26T21:25:52.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.338+0000 7fd474000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd46c0fce60 0x7fd46c118430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:52.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.338+0000 7fd474000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd46c0fdfd0 0x7fd46c118970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:52.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.338+0000 7fd474000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c118f70 con 0x7fd46c0fce60 2024-04-26T21:25:52.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.338+0000 7fd474000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c1197c0 con 0x7fd46c0fdfd0 2024-04-26T21:25:52.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.338+0000 7fd470c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd46c0fdfd0 0x7fd46c118970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:52.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.338+0000 7fd470c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd46c0fdfd0 0x7fd46c118970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:54916/0 (socket says 172.21.15.84:54916) 2024-04-26T21:25:52.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.338+0000 7fd470c00700 1 -- 172.21.15.84:0/2711063065 learned_addr learned my addr 172.21.15.84:0/2711063065 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:25:52.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.339+0000 7fd470c00700 1 -- 172.21.15.84:0/2711063065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd46c0fce60 msgr2=0x7fd46c118430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:52.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.339+0000 7fd470c00700 1 --2- 172.21.15.84:0/2711063065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd46c0fce60 0x7fd46c118430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:52.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.339+0000 7fd470c00700 1 -- 172.21.15.84:0/2711063065 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd460005040 con 0x7fd46c0fdfd0 2024-04-26T21:25:52.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.340+0000 7fd470c00700 1 --2- 172.21.15.84:0/2711063065 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd46c0fdfd0 0x7fd46c118970 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd460009150 tx=0x7fd460009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:52.343 INFO:tasks.workunit.client.0.smithi084.stdout:2/286: mkdir d6/d7/d68 0 2024-04-26T21:25:52.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.344+0000 7fd469600700 1 -- 172.21.15.84:0/2711063065 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd46000e040 con 0x7fd46c0fdfd0 2024-04-26T21:25:52.346 INFO:tasks.workunit.client.0.smithi084.stdout:6/219: symlink d3/de/d1a/l4a 0 2024-04-26T21:25:52.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.344+0000 7fd469600700 1 -- 172.21.15.84:0/2711063065 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd46000bcc0 con 0x7fd46c0fdfd0 2024-04-26T21:25:52.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.344+0000 7fd469600700 1 -- 172.21.15.84:0/2711063065 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd46001c630 con 0x7fd46c0fdfd0 2024-04-26T21:25:52.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.344+0000 7fd474000700 1 -- 172.21.15.84:0/2711063065 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46c119a40 con 0x7fd46c0fdfd0 2024-04-26T21:25:52.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.345+0000 7fd474000700 1 -- 172.21.15.84:0/2711063065 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46c119f80 con 0x7fd46c0fdfd0 2024-04-26T21:25:52.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.348+0000 7fd474000700 1 -- 172.21.15.84:0/2711063065 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46c05f5c0 con 0x7fd46c0fdfd0 2024-04-26T21:25:52.350 INFO:tasks.workunit.client.1.smithi120.stdout:8/439: dread d5/d6/d11/d32/f6e [0,4194304] 0 2024-04-26T21:25:52.351 INFO:tasks.workunit.client.0.smithi084.stdout:8/250: dread d4/d6/f24 [4194304,4194304] 0 2024-04-26T21:25:52.355 INFO:tasks.workunit.client.1.smithi120.stdout:1/414: unlink d6/d7/l38 0 2024-04-26T21:25:52.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.351+0000 7fd469600700 1 -- 172.21.15.84:0/2711063065 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7fd460013420 con 0x7fd46c0fdfd0 2024-04-26T21:25:52.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.353+0000 7fd469600700 1 --2- 172.21.15.84:0/2711063065 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fd45406be90 0x7fd45406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:52.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.353+0000 7fd469600700 1 -- 172.21.15.84:0/2711063065 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fd46008b6b0 con 0x7fd46c0fdfd0 2024-04-26T21:25:52.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.354+0000 7fd471600700 1 --2- 172.21.15.84:0/2711063065 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fd45406be90 0x7fd45406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:52.358 INFO:tasks.workunit.client.0.smithi084.stdout:2/287: link d6/d7/d3d/d15/d1f/d39/fc d6/d7/d68/f69 0 2024-04-26T21:25:52.359 INFO:tasks.workunit.client.1.smithi120.stdout:8/440: mkdir d5/d6/d75/d95 0 2024-04-26T21:25:52.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.358+0000 7fd471600700 1 --2- 172.21.15.84:0/2711063065 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fd45406be90 0x7fd45406e340 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd458004d00 tx=0x7fd458009ce0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:52.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.358+0000 7fd469600700 1 -- 172.21.15.84:0/2711063065 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fd4600589a0 con 0x7fd46c0fdfd0 2024-04-26T21:25:52.365 INFO:tasks.workunit.client.0.smithi084.stdout:0/181: dwrite f4 [0,4194304] 0 2024-04-26T21:25:52.365 INFO:tasks.workunit.client.1.smithi120.stdout:1/415: creat d6/d7/d1d/d5d/f90 x:0 0 0 2024-04-26T21:25:52.366 INFO:tasks.workunit.client.0.smithi084.stdout:2/288: symlink d6/d7/d3d/d15/d1f/d39/d20/d45/d5a/l6a 0 2024-04-26T21:25:52.369 INFO:tasks.workunit.client.0.smithi084.stdout:0/182: readlink de/d2b/l2f 0 2024-04-26T21:25:52.370 INFO:tasks.workunit.client.1.smithi120.stdout:8/441: creat d5/d6/d34/d37/d60/d55/d7a/f96 x:0 0 0 2024-04-26T21:25:52.372 INFO:tasks.workunit.client.0.smithi084.stdout:0/183: symlink de/l38 0 2024-04-26T21:25:52.376 INFO:tasks.workunit.client.1.smithi120.stdout:1/416: unlink d6/d9/f74 0 2024-04-26T21:25:52.377 INFO:tasks.workunit.client.0.smithi084.stdout:6/220: dwrite d3/d18/f2b [0,4194304] 0 2024-04-26T21:25:52.392 INFO:tasks.workunit.client.1.smithi120.stdout:1/417: symlink d6/d7/d1d/d5d/d67/dd/d56/l91 0 2024-04-26T21:25:52.392 INFO:tasks.workunit.client.1.smithi120.stdout:8/442: creat d5/d6/d34/d37/d60/d55/d83/f97 x:0 0 0 2024-04-26T21:25:52.392 INFO:tasks.workunit.client.1.smithi120.stdout:9/433: dread d0/dd/d3a/f58 [0,4194304] 0 2024-04-26T21:25:52.393 INFO:tasks.workunit.client.1.smithi120.stdout:1/418: truncate d6/d7/d1b/d3b/f7f 4315048 0 2024-04-26T21:25:52.394 INFO:tasks.workunit.client.1.smithi120.stdout:1/419: chown d6/d7/d2d/d48/d86 36 1 2024-04-26T21:25:52.395 INFO:tasks.workunit.client.1.smithi120.stdout:8/443: creat d5/d6/d11/d32/d3b/f98 x:0 0 0 2024-04-26T21:25:52.395 INFO:tasks.workunit.client.0.smithi084.stdout:0/184: creat de/d2b/f39 x:0 0 0 2024-04-26T21:25:52.397 INFO:tasks.workunit.client.0.smithi084.stdout:0/185: stat de/d1c/f33 0 2024-04-26T21:25:52.399 INFO:tasks.workunit.client.0.smithi084.stdout:7/206: sync 2024-04-26T21:25:52.399 INFO:tasks.workunit.client.1.smithi120.stdout:8/444: creat d5/d6/d34/d42/d4a/f99 x:0 0 0 2024-04-26T21:25:52.400 INFO:tasks.workunit.client.1.smithi120.stdout:0/534: dread d0/d3/d13/f96 [0,4194304] 0 2024-04-26T21:25:52.402 INFO:tasks.workunit.client.0.smithi084.stdout:6/221: dread d3/de/d1a/f36 [0,4194304] 0 2024-04-26T21:25:52.402 INFO:tasks.workunit.client.0.smithi084.stdout:7/207: creat d6/d26/f45 x:0 0 0 2024-04-26T21:25:52.403 INFO:tasks.workunit.client.1.smithi120.stdout:0/535: rmdir d0/d3/d13/d81 39 2024-04-26T21:25:52.407 INFO:tasks.workunit.client.0.smithi084.stdout:7/208: mknod d6/d9/d12/d19/d20/d38/c46 0 2024-04-26T21:25:52.410 INFO:tasks.workunit.client.1.smithi120.stdout:8/445: getdents d5/d6/d34/d37/d60 0 2024-04-26T21:25:52.410 INFO:tasks.workunit.client.1.smithi120.stdout:9/434: dwrite d0/d14/d2d/d4b/d85/d86/f8f [0,4194304] 0 2024-04-26T21:25:52.412 INFO:tasks.workunit.client.0.smithi084.stdout:7/209: mkdir d6/dc/d47 0 2024-04-26T21:25:52.415 INFO:tasks.workunit.client.0.smithi084.stdout:0/186: dread de/f1f [0,4194304] 0 2024-04-26T21:25:52.417 INFO:tasks.workunit.client.1.smithi120.stdout:1/420: dread d6/d14/f16 [0,4194304] 0 2024-04-26T21:25:52.421 INFO:tasks.workunit.client.1.smithi120.stdout:1/421: write d6/d14/f16 [4122358,95914] 0 2024-04-26T21:25:52.422 INFO:tasks.workunit.client.0.smithi084.stdout:8/251: dread d4/d6/db/d1e/d22/d2f/fd [4194304,4194304] 0 2024-04-26T21:25:52.427 INFO:tasks.workunit.client.0.smithi084.stdout:2/289: dread d6/f14 [0,4194304] 0 2024-04-26T21:25:52.427 INFO:tasks.workunit.client.1.smithi120.stdout:8/446: link d5/d6/f25 d5/d6/d11/d32/d3b/f9a 0 2024-04-26T21:25:52.429 INFO:tasks.workunit.client.0.smithi084.stdout:6/222: dread d3/d18/f38 [0,4194304] 0 2024-04-26T21:25:52.429 INFO:tasks.workunit.client.1.smithi120.stdout:8/447: read d5/d6/d11/d32/f8f [279966,8422] 0 2024-04-26T21:25:52.431 INFO:tasks.workunit.client.1.smithi120.stdout:8/448: readlink d5/d6/l2f 0 2024-04-26T21:25:52.431 INFO:tasks.workunit.client.1.smithi120.stdout:1/422: mknod d6/d7/d1b/d89/d8c/c92 0 2024-04-26T21:25:52.433 INFO:tasks.workunit.client.1.smithi120.stdout:8/449: stat d5/d6/d11/f10 0 2024-04-26T21:25:52.437 INFO:tasks.workunit.client.0.smithi084.stdout:6/223: truncate d3/de/d1a/d43/f33 896556 0 2024-04-26T21:25:52.442 INFO:tasks.workunit.client.0.smithi084.stdout:0/187: creat de/d2b/f3a x:0 0 0 2024-04-26T21:25:52.445 INFO:tasks.workunit.client.0.smithi084.stdout:2/290: dread d6/d7/d3d/d15/d1f/d22/f24 [0,4194304] 0 2024-04-26T21:25:52.449 INFO:tasks.workunit.client.0.smithi084.stdout:7/210: creat d6/dc/d47/f48 x:0 0 0 2024-04-26T21:25:52.449 INFO:tasks.workunit.client.0.smithi084.stdout:8/252: mknod d4/d7/d15/d3c/c49 0 2024-04-26T21:25:52.450 INFO:tasks.workunit.client.0.smithi084.stdout:0/188: mknod de/d1c/c3b 0 2024-04-26T21:25:52.451 INFO:tasks.workunit.client.0.smithi084.stdout:0/189: fsync de/d1c/f2a 0 2024-04-26T21:25:52.453 INFO:tasks.workunit.client.0.smithi084.stdout:8/253: readlink d4/d6/db/l46 0 2024-04-26T21:25:52.455 INFO:tasks.workunit.client.1.smithi120.stdout:7/437: sync 2024-04-26T21:25:52.456 INFO:tasks.workunit.client.1.smithi120.stdout:3/419: sync 2024-04-26T21:25:52.460 INFO:tasks.workunit.client.1.smithi120.stdout:3/420: rename dd/de/df/d12/d48/d6d to dd/de/df/d12/d48/d6d/d8f 22 2024-04-26T21:25:52.462 INFO:tasks.workunit.client.1.smithi120.stdout:0/536: write d0/d3/dc/d12/d31/f5e [4936830,100834] 0 2024-04-26T21:25:52.466 INFO:tasks.workunit.client.1.smithi120.stdout:9/435: write d0/d6/d4d/d65/f71 [699488,81719] 0 2024-04-26T21:25:52.468 INFO:tasks.workunit.client.1.smithi120.stdout:3/421: symlink dd/de/d18/l90 0 2024-04-26T21:25:52.469 INFO:tasks.workunit.client.0.smithi084.stdout:8/254: mkdir d4/d6/db/d1e/d22/d39/d4a 0 2024-04-26T21:25:52.470 INFO:tasks.workunit.client.1.smithi120.stdout:0/537: creat d0/d3/d13/d64/fb9 x:0 0 0 2024-04-26T21:25:52.478 INFO:tasks.workunit.client.1.smithi120.stdout:7/438: getdents d7/d10/d12/d1f/d28/d4c/d6b 0 2024-04-26T21:25:52.482 INFO:tasks.workunit.client.1.smithi120.stdout:0/538: mkdir d0/d3/d13/d81/dba 0 2024-04-26T21:25:52.486 INFO:tasks.workunit.client.1.smithi120.stdout:8/450: dwrite d5/d6/f1e [0,4194304] 0 2024-04-26T21:25:52.487 INFO:tasks.workunit.client.1.smithi120.stdout:7/439: creat d7/d10/d12/d1a/d50/f93 x:0 0 0 2024-04-26T21:25:52.487 INFO:tasks.workunit.client.0.smithi084.stdout:2/291: truncate d6/d7/d3d/d15/d1f/d39/fe 2369086 0 2024-04-26T21:25:52.488 INFO:tasks.workunit.client.0.smithi084.stdout:8/255: dwrite d4/d7/d15/f30 [4194304,4194304] 0 2024-04-26T21:25:52.491 INFO:tasks.workunit.client.1.smithi120.stdout:1/423: dread d6/d7/d1d/d5d/d67/dd/fe [4194304,4194304] 0 2024-04-26T21:25:52.491 INFO:tasks.workunit.client.0.smithi084.stdout:2/292: rename d6 to d6/d7/d68/d6b 22 2024-04-26T21:25:52.492 INFO:tasks.workunit.client.0.smithi084.stdout:0/190: truncate de/f1e 1005804 0 2024-04-26T21:25:52.492 INFO:tasks.workunit.client.0.smithi084.stdout:6/224: unlink d3/c8 0 2024-04-26T21:25:52.493 INFO:tasks.workunit.client.0.smithi084.stdout:8/256: write d4/d7/f14 [5831145,35973] 0 2024-04-26T21:25:52.493 INFO:tasks.workunit.client.1.smithi120.stdout:1/424: chown d6/d7/d1d/d5d/d67/c4a 27567 1 2024-04-26T21:25:52.495 INFO:tasks.workunit.client.1.smithi120.stdout:9/436: dread d0/d6/f39 [0,4194304] 0 2024-04-26T21:25:52.495 INFO:tasks.workunit.client.0.smithi084.stdout:8/257: readlink d4/d6/db/l46 0 2024-04-26T21:25:52.497 INFO:tasks.workunit.client.0.smithi084.stdout:0/191: creat de/d1c/f3c x:0 0 0 2024-04-26T21:25:52.497 INFO:tasks.workunit.client.1.smithi120.stdout:3/422: link dd/l26 dd/de/df/l91 0 2024-04-26T21:25:52.501 INFO:tasks.workunit.client.1.smithi120.stdout:0/539: creat d0/d3/dc/dd/fbb x:0 0 0 2024-04-26T21:25:52.502 INFO:tasks.workunit.client.1.smithi120.stdout:1/425: rmdir d6/d7/d1d/d5d/d67/dd/d54 39 2024-04-26T21:25:52.505 INFO:tasks.workunit.client.0.smithi084.stdout:6/225: rename d3/f9 to d3/de/d15/df/f4b 0 2024-04-26T21:25:52.505 INFO:tasks.workunit.client.1.smithi120.stdout:1/426: fdatasync d6/d14/d6f/f8e 0 2024-04-26T21:25:52.506 INFO:tasks.workunit.client.0.smithi084.stdout:8/258: creat d4/d7/d15/d3c/f4b x:0 0 0 2024-04-26T21:25:52.506 INFO:tasks.workunit.client.1.smithi120.stdout:3/423: read - dd/f31 zero size 2024-04-26T21:25:52.509 INFO:tasks.workunit.client.0.smithi084.stdout:6/226: mkdir d3/de/d1a/d2f/d4c 0 2024-04-26T21:25:52.512 INFO:tasks.workunit.client.1.smithi120.stdout:3/424: dread dd/de/d18/d24/d43/f4c [0,4194304] 0 2024-04-26T21:25:52.513 INFO:tasks.workunit.client.0.smithi084.stdout:8/259: mknod d4/d6/db/d1e/c4c 0 2024-04-26T21:25:52.517 INFO:tasks.workunit.client.0.smithi084.stdout:0/192: rename de/f1e to de/d1c/d32/f3d 0 2024-04-26T21:25:52.521 INFO:tasks.workunit.client.1.smithi120.stdout:3/425: creat dd/d40/f92 x:0 0 0 2024-04-26T21:25:52.522 INFO:tasks.workunit.client.1.smithi120.stdout:3/426: chown dd/de/d83/d64 1 1 2024-04-26T21:25:52.526 INFO:tasks.workunit.client.0.smithi084.stdout:8/260: link d4/d7/d15/d3c/c42 d4/d6/db/d1e/d22/d2f/c4d 0 2024-04-26T21:25:52.528 INFO:tasks.workunit.client.0.smithi084.stdout:8/261: chown d4/d6/db 427 1 2024-04-26T21:25:52.529 INFO:tasks.workunit.client.0.smithi084.stdout:6/227: dread d3/de/d1a/d43/f2d [0,4194304] 0 2024-04-26T21:25:52.532 INFO:tasks.workunit.client.0.smithi084.stdout:8/262: write d4/f12 [4868897,14449] 0 2024-04-26T21:25:52.532 INFO:tasks.workunit.client.0.smithi084.stdout:6/228: chown d3/de/d1a/c17 30 1 2024-04-26T21:25:52.536 INFO:tasks.workunit.client.0.smithi084.stdout:8/263: mknod d4/c4e 0 2024-04-26T21:25:52.537 INFO:tasks.workunit.client.0.smithi084.stdout:0/193: write f6 [2592048,105160] 0 2024-04-26T21:25:52.538 INFO:tasks.workunit.client.0.smithi084.stdout:6/229: truncate d3/d18/f38 4811599 0 2024-04-26T21:25:52.541 INFO:tasks.workunit.client.0.smithi084.stdout:6/230: stat d3/de/d1a/l4a 0 2024-04-26T21:25:52.547 INFO:tasks.workunit.client.0.smithi084.stdout:6/231: creat d3/de/d15/d23/f4d x:0 0 0 2024-04-26T21:25:52.548 INFO:tasks.workunit.client.0.smithi084.stdout:2/293: dread d6/d7/d3d/d15/f55 [0,4194304] 0 2024-04-26T21:25:52.549 INFO:tasks.workunit.client.0.smithi084.stdout:6/232: chown d3/de/d15/d23/f2a 636 1 2024-04-26T21:25:52.553 INFO:tasks.workunit.client.0.smithi084.stdout:6/233: symlink d3/de/d1a/d43/l4e 0 2024-04-26T21:25:52.555 INFO:tasks.workunit.client.0.smithi084.stdout:2/294: write d6/d7/d3d/d15/d1f/d39/d20/d45/f60 [35542,82977] 0 2024-04-26T21:25:52.556 INFO:tasks.workunit.client.0.smithi084.stdout:6/234: readlink d3/de/d1a/d43/l4e 0 2024-04-26T21:25:52.558 INFO:tasks.workunit.client.0.smithi084.stdout:6/235: stat d3/c1f 0 2024-04-26T21:25:52.564 INFO:tasks.workunit.client.0.smithi084.stdout:0/194: dwrite de/d2b/f39 [0,4194304] 0 2024-04-26T21:25:52.569 INFO:tasks.workunit.client.0.smithi084.stdout:8/264: dread d4/f12 [0,4194304] 0 2024-04-26T21:25:52.572 INFO:tasks.workunit.client.0.smithi084.stdout:8/265: fsync d4/f5 0 2024-04-26T21:25:52.573 INFO:tasks.workunit.client.0.smithi084.stdout:0/195: mknod de/d1c/c3e 0 2024-04-26T21:25:52.575 INFO:tasks.workunit.client.0.smithi084.stdout:6/236: dwrite d3/fc [0,4194304] 0 2024-04-26T21:25:52.577 INFO:tasks.workunit.client.0.smithi084.stdout:0/196: creat de/d2b/f3f x:0 0 0 2024-04-26T21:25:52.578 INFO:tasks.workunit.client.0.smithi084.stdout:5/180: sync 2024-04-26T21:25:52.579 INFO:tasks.workunit.client.0.smithi084.stdout:9/159: sync 2024-04-26T21:25:52.580 INFO:tasks.workunit.client.0.smithi084.stdout:8/266: getdents d4/d6/db 0 2024-04-26T21:25:52.581 INFO:tasks.workunit.client.0.smithi084.stdout:6/237: creat d3/de/d1a/d43/f4f x:0 0 0 2024-04-26T21:25:52.582 INFO:tasks.workunit.client.0.smithi084.stdout:0/197: write de/d1c/f33 [765392,112002] 0 2024-04-26T21:25:52.583 INFO:tasks.workunit.client.0.smithi084.stdout:2/295: dwrite d6/d7/f3f [0,4194304] 0 2024-04-26T21:25:52.584 INFO:tasks.workunit.client.0.smithi084.stdout:8/267: dread - d4/d6/db/d1e/f45 zero size 2024-04-26T21:25:52.587 INFO:tasks.workunit.client.0.smithi084.stdout:5/181: symlink d0/dc/df/d2a/l35 0 2024-04-26T21:25:52.587 INFO:tasks.workunit.client.0.smithi084.stdout:6/238: dread - d3/de/d15/d23/f4d zero size 2024-04-26T21:25:52.589 INFO:tasks.workunit.client.0.smithi084.stdout:0/198: chown de/d20/c2e 2326359 1 2024-04-26T21:25:52.589 INFO:tasks.workunit.client.0.smithi084.stdout:2/296: rmdir d6/d7/d3d 39 2024-04-26T21:25:52.589 INFO:tasks.workunit.client.0.smithi084.stdout:9/160: link da/de/f2d da/f3a 0 2024-04-26T21:25:52.590 INFO:tasks.workunit.client.0.smithi084.stdout:0/199: fsync de/d20/f36 0 2024-04-26T21:25:52.591 INFO:tasks.workunit.client.0.smithi084.stdout:5/182: write d0/dc/f1a [763218,122572] 0 2024-04-26T21:25:52.592 INFO:tasks.workunit.client.0.smithi084.stdout:0/200: chown f6 6294 1 2024-04-26T21:25:52.592 INFO:tasks.workunit.client.0.smithi084.stdout:9/161: write da/de/d16/d25/f36 [469384,5026] 0 2024-04-26T21:25:52.594 INFO:tasks.workunit.client.0.smithi084.stdout:5/183: fdatasync d0/fd 0 2024-04-26T21:25:52.594 INFO:tasks.workunit.client.1.smithi120.stdout:7/440: write d7/d19/f51 [3946635,80734] 0 2024-04-26T21:25:52.596 INFO:tasks.workunit.client.0.smithi084.stdout:5/184: write d0/fe [5053268,46928] 0 2024-04-26T21:25:52.597 INFO:tasks.workunit.client.0.smithi084.stdout:9/162: read da/f1a [1491611,32550] 0 2024-04-26T21:25:52.598 INFO:tasks.workunit.client.1.smithi120.stdout:8/451: dwrite d5/f15 [0,4194304] 0 2024-04-26T21:25:52.599 INFO:tasks.workunit.client.0.smithi084.stdout:6/239: rename d3/de/d15/c3b to d3/d18/d37/c50 0 2024-04-26T21:25:52.601 INFO:tasks.workunit.client.0.smithi084.stdout:0/201: read f0 [885027,63320] 0 2024-04-26T21:25:52.602 INFO:tasks.workunit.client.1.smithi120.stdout:8/452: dread - d5/f62 zero size 2024-04-26T21:25:52.604 INFO:tasks.workunit.client.0.smithi084.stdout:2/297: mkdir d6/d7/d3d/d15/d1f/d6c 0 2024-04-26T21:25:52.605 INFO:tasks.workunit.client.1.smithi120.stdout:7/441: write d7/d10/d12/d1f/d28/d4c/d6b/f70 [979914,113850] 0 2024-04-26T21:25:52.610 INFO:tasks.workunit.client.0.smithi084.stdout:2/298: write d6/d7/d3d/f25 [2875806,28827] 0 2024-04-26T21:25:52.610 INFO:tasks.workunit.client.0.smithi084.stdout:9/163: truncate da/de/d1e/f31 5171700 0 2024-04-26T21:25:52.610 INFO:tasks.workunit.client.0.smithi084.stdout:0/202: rename de/l38 to de/d1c/d32/l40 0 2024-04-26T21:25:52.610 INFO:tasks.workunit.client.0.smithi084.stdout:6/240: dread d3/de/d1a/f36 [0,4194304] 0 2024-04-26T21:25:52.611 INFO:tasks.workunit.client.0.smithi084.stdout:5/185: symlink d0/dc/df/d31/l36 0 2024-04-26T21:25:52.614 INFO:tasks.workunit.client.0.smithi084.stdout:2/299: unlink d6/l3c 0 2024-04-26T21:25:52.615 INFO:tasks.workunit.client.0.smithi084.stdout:9/164: rmdir da/de/d1e 39 2024-04-26T21:25:52.615 INFO:tasks.workunit.client.1.smithi120.stdout:9/437: dwrite d0/fa [0,4194304] 0 2024-04-26T21:25:52.620 INFO:tasks.workunit.client.1.smithi120.stdout:7/442: mkdir d7/d10/d12/d1f/d7d/d8b/d94 0 2024-04-26T21:25:52.621 INFO:tasks.workunit.client.0.smithi084.stdout:6/241: rename d3/de/d15/df/f12 to d3/de/d41/f51 0 2024-04-26T21:25:52.623 INFO:tasks.workunit.client.1.smithi120.stdout:9/438: write d0/dd/d45/f4a [1290241,97832] 0 2024-04-26T21:25:52.624 INFO:tasks.workunit.client.1.smithi120.stdout:7/443: read d7/d64/f8a [175402,103955] 0 2024-04-26T21:25:52.628 INFO:tasks.workunit.client.1.smithi120.stdout:3/427: dread fa [0,4194304] 0 2024-04-26T21:25:52.629 INFO:tasks.workunit.client.0.smithi084.stdout:2/300: mkdir d6/d7/d3d/d15/d1f/d39/d20/d45/d6d 0 2024-04-26T21:25:52.629 INFO:tasks.workunit.client.0.smithi084.stdout:9/165: mknod da/c3b 0 2024-04-26T21:25:52.632 INFO:tasks.workunit.client.0.smithi084.stdout:6/242: fsync d3/de/d15/df/f4b 0 2024-04-26T21:25:52.632 INFO:tasks.workunit.client.0.smithi084.stdout:0/203: getdents de/d20 0 2024-04-26T21:25:52.635 INFO:tasks.workunit.client.0.smithi084.stdout:9/166: fdatasync da/f1a 0 2024-04-26T21:25:52.636 INFO:tasks.workunit.client.0.smithi084.stdout:0/204: mkdir de/d1c/d41 0 2024-04-26T21:25:52.637 INFO:tasks.workunit.client.0.smithi084.stdout:0/205: dread - de/d1c/f3c zero size 2024-04-26T21:25:52.641 INFO:tasks.workunit.client.0.smithi084.stdout:0/206: mknod de/c42 0 2024-04-26T21:25:52.643 INFO:tasks.workunit.client.0.smithi084.stdout:2/301: read d6/d7/d3d/d15/f1a [1458155,44930] 0 2024-04-26T21:25:52.646 INFO:tasks.workunit.client.0.smithi084.stdout:0/207: creat de/d2b/f43 x:0 0 0 2024-04-26T21:25:52.650 INFO:tasks.workunit.client.0.smithi084.stdout:2/302: link d6/d7/l17 d6/d7/d3d/d15/d1f/l6e 0 2024-04-26T21:25:52.651 INFO:tasks.workunit.client.1.smithi120.stdout:3/428: creat dd/de/df/d12/d48/f93 x:0 0 0 2024-04-26T21:25:52.652 INFO:tasks.workunit.client.0.smithi084.stdout:9/167: dread f9 [0,4194304] 0 2024-04-26T21:25:52.654 INFO:tasks.workunit.client.1.smithi120.stdout:6/470: sync 2024-04-26T21:25:52.654 INFO:tasks.workunit.client.1.smithi120.stdout:2/476: sync 2024-04-26T21:25:52.654 INFO:tasks.workunit.client.1.smithi120.stdout:5/512: sync 2024-04-26T21:25:52.654 INFO:tasks.workunit.client.1.smithi120.stdout:4/411: sync 2024-04-26T21:25:52.655 INFO:tasks.workunit.client.0.smithi084.stdout:2/303: creat d6/d7/d68/f6f x:0 0 0 2024-04-26T21:25:52.655 INFO:tasks.workunit.client.1.smithi120.stdout:9/439: mkdir d0/d66/d93 0 2024-04-26T21:25:52.656 INFO:tasks.workunit.client.1.smithi120.stdout:6/471: stat d4/db/d10/c11 0 2024-04-26T21:25:52.657 INFO:tasks.workunit.client.1.smithi120.stdout:9/440: readlink d0/dd/l44 0 2024-04-26T21:25:52.657 INFO:tasks.workunit.client.1.smithi120.stdout:4/412: dread - d10/d28/d73/f83 zero size 2024-04-26T21:25:52.657 INFO:tasks.workunit.client.1.smithi120.stdout:7/444: creat d7/d10/d12/f95 x:0 0 0 2024-04-26T21:25:52.658 INFO:tasks.workunit.client.0.smithi084.stdout:9/168: creat da/de/d16/d25/f3c x:0 0 0 2024-04-26T21:25:52.658 INFO:tasks.workunit.client.1.smithi120.stdout:4/413: stat d10/l38 0 2024-04-26T21:25:52.659 INFO:tasks.workunit.client.1.smithi120.stdout:9/441: dread - d0/dd/f83 zero size 2024-04-26T21:25:52.659 INFO:tasks.workunit.client.0.smithi084.stdout:2/304: chown d6/d7/d3d/d15/d1f/d39/c29 7 1 2024-04-26T21:25:52.660 INFO:tasks.workunit.client.1.smithi120.stdout:4/414: readlink d10/d65/d72/l74 0 2024-04-26T21:25:52.662 INFO:tasks.workunit.client.1.smithi120.stdout:9/442: write d0/d14/d2d/d4b/f8b [67389,65631] 0 2024-04-26T21:25:52.663 INFO:tasks.workunit.client.0.smithi084.stdout:2/305: stat d6/d7/d3d/d15/d1f/d22/d2a/c2f 0 2024-04-26T21:25:52.665 INFO:tasks.workunit.client.0.smithi084.stdout:9/169: rename da/de/f13 to da/de/f3d 0 2024-04-26T21:25:52.665 INFO:tasks.workunit.client.0.smithi084.stdout:5/186: truncate d0/fe 2683073 0 2024-04-26T21:25:52.667 INFO:tasks.workunit.client.0.smithi084.stdout:6/243: getdents d3/de/d15/df 0 2024-04-26T21:25:52.667 INFO:tasks.workunit.client.1.smithi120.stdout:5/513: creat d2/dc/d1d/d1f/d36/d44/fb4 x:0 0 0 2024-04-26T21:25:52.668 INFO:tasks.workunit.client.0.smithi084.stdout:9/170: dread - da/de/d16/d25/f3c zero size 2024-04-26T21:25:52.669 INFO:tasks.workunit.client.0.smithi084.stdout:2/306: truncate d6/d7/fb 867935 0 2024-04-26T21:25:52.671 INFO:tasks.workunit.client.0.smithi084.stdout:5/187: symlink d0/dc/df/l37 0 2024-04-26T21:25:52.672 INFO:tasks.workunit.client.1.smithi120.stdout:3/429: truncate dd/d2a/f5f 144486 0 2024-04-26T21:25:52.673 INFO:tasks.workunit.client.0.smithi084.stdout:2/307: chown d6/d7/d3d/d15/d1f/d22/c28 0 1 2024-04-26T21:25:52.673 INFO:tasks.workunit.client.0.smithi084.stdout:9/171: mknod da/de/d1e/c3e 0 2024-04-26T21:25:52.675 INFO:tasks.workunit.client.0.smithi084.stdout:2/308: dread - d6/d7/d3d/d15/d1f/f34 zero size 2024-04-26T21:25:52.676 INFO:tasks.workunit.client.0.smithi084.stdout:5/188: link d0/dc/df/d2a/l2b d0/dc/l38 0 2024-04-26T21:25:52.679 INFO:tasks.workunit.client.0.smithi084.stdout:5/189: mknod d0/dc/c39 0 2024-04-26T21:25:52.680 INFO:tasks.workunit.client.1.smithi120.stdout:6/472: dread d4/db/d10/dd/f18 [4194304,4194304] 0 2024-04-26T21:25:52.682 INFO:tasks.workunit.client.0.smithi084.stdout:5/190: readlink d0/dc/l38 0 2024-04-26T21:25:52.684 INFO:tasks.workunit.client.1.smithi120.stdout:4/415: creat d10/d12/f8e x:0 0 0 2024-04-26T21:25:52.685 INFO:tasks.workunit.client.1.smithi120.stdout:4/416: chown d10/f2d 0 1 2024-04-26T21:25:52.687 INFO:tasks.workunit.client.1.smithi120.stdout:9/443: creat d0/d6/d4d/d65/f94 x:0 0 0 2024-04-26T21:25:52.688 INFO:tasks.workunit.client.0.smithi084.stdout:2/309: rename d6/d7/l17 to d6/d7/d3d/l70 0 2024-04-26T21:25:52.690 INFO:tasks.workunit.client.0.smithi084.stdout:9/172: getdents da/de/d1e 0 2024-04-26T21:25:52.692 INFO:tasks.workunit.client.0.smithi084.stdout:2/310: creat d6/d7/d68/f71 x:0 0 0 2024-04-26T21:25:52.697 INFO:tasks.workunit.client.0.smithi084.stdout:2/311: mknod d6/d7/d68/c72 0 2024-04-26T21:25:52.702 INFO:tasks.workunit.client.0.smithi084.stdout:9/173: write da/f17 [2021676,130053] 0 2024-04-26T21:25:52.704 INFO:tasks.workunit.client.1.smithi120.stdout:2/477: creat d4/d1b/d2e/d50/d14/d15/f9b x:0 0 0 2024-04-26T21:25:52.705 INFO:tasks.workunit.client.0.smithi084.stdout:2/312: write d6/d7/d3d/d15/d1f/d39/fe [489486,119821] 0 2024-04-26T21:25:52.705 INFO:tasks.workunit.client.0.smithi084.stdout:5/191: dwrite d0/f32 [0,4194304] 0 2024-04-26T21:25:52.709 INFO:tasks.workunit.client.0.smithi084.stdout:9/174: rename da/de/d1e/c3e to da/de/d1e/c3f 0 2024-04-26T21:25:52.711 INFO:tasks.workunit.client.0.smithi084.stdout:2/313: chown d6/d7/d3d/d15/d1f/d39/d20/d36/f5d 108 1 2024-04-26T21:25:52.715 INFO:tasks.workunit.client.0.smithi084.stdout:2/314: symlink d6/d7/d3d/d15/d1f/d39/d20/l73 0 2024-04-26T21:25:52.716 INFO:tasks.workunit.client.1.smithi120.stdout:9/444: rename d0/dd/l31 to d0/dd/d45/l95 0 2024-04-26T21:25:52.718 INFO:tasks.workunit.client.1.smithi120.stdout:5/514: creat d2/dc/d1d/d21/d66/d6a/d8c/daa/fb5 x:0 0 0 2024-04-26T21:25:52.718 INFO:tasks.workunit.client.0.smithi084.stdout:1/209: sync 2024-04-26T21:25:52.718 INFO:tasks.workunit.client.0.smithi084.stdout:4/170: sync 2024-04-26T21:25:52.719 INFO:tasks.workunit.client.1.smithi120.stdout:9/445: truncate d0/dd/d3a/f92 911388 0 2024-04-26T21:25:52.720 INFO:tasks.workunit.client.1.smithi120.stdout:9/446: readlink d0/dd/l2c 0 2024-04-26T21:25:52.721 INFO:tasks.workunit.client.1.smithi120.stdout:3/430: mknod dd/de/df/d12/d48/d6d/c94 0 2024-04-26T21:25:52.723 INFO:tasks.workunit.client.1.smithi120.stdout:9/447: chown d0/d14/d2d/d4b/d85/d86/f8f 675 1 2024-04-26T21:25:52.725 INFO:tasks.workunit.client.1.smithi120.stdout:9/448: chown d0/dd/f62 4024 1 2024-04-26T21:25:52.725 INFO:tasks.workunit.client.0.smithi084.stdout:1/210: symlink d2/d19/l41 0 2024-04-26T21:25:52.726 INFO:tasks.workunit.client.0.smithi084.stdout:4/171: creat d5/d25/f3e x:0 0 0 2024-04-26T21:25:52.727 INFO:tasks.workunit.client.0.smithi084.stdout:2/315: mkdir d6/d7/d3d/d15/d1f/d39/d20/d45/d74 0 2024-04-26T21:25:52.732 INFO:tasks.workunit.client.1.smithi120.stdout:6/473: mkdir d4/d99 0 2024-04-26T21:25:52.735 INFO:tasks.workunit.client.0.smithi084.stdout:1/211: mknod d2/d9/d17/d2a/c42 0 2024-04-26T21:25:52.735 INFO:tasks.workunit.client.0.smithi084.stdout:5/192: dwrite d0/f16 [0,4194304] 0 2024-04-26T21:25:52.735 INFO:tasks.workunit.client.0.smithi084.stdout:4/172: mkdir d5/d10/d15/d21/d29/d3f 0 2024-04-26T21:25:52.737 INFO:tasks.workunit.client.0.smithi084.stdout:2/316: fdatasync d6/d7/d3d/d15/d1f/d39/d20/d45/f61 0 2024-04-26T21:25:52.739 INFO:tasks.workunit.client.1.smithi120.stdout:4/417: creat d10/d28/d73/f8f x:0 0 0 2024-04-26T21:25:52.740 INFO:tasks.workunit.client.1.smithi120.stdout:4/418: fsync d10/d65/f6d 0 2024-04-26T21:25:52.744 INFO:tasks.workunit.client.0.smithi084.stdout:4/173: link d5/d10/f13 d5/d10/d15/f40 0 2024-04-26T21:25:52.745 INFO:tasks.workunit.client.1.smithi120.stdout:5/515: rename d2/d30/f78 to d2/dc/fb6 0 2024-04-26T21:25:52.746 INFO:tasks.workunit.client.0.smithi084.stdout:5/193: chown d0/f33 57 1 2024-04-26T21:25:52.751 INFO:tasks.workunit.client.0.smithi084.stdout:9/175: dread da/f17 [0,4194304] 0 2024-04-26T21:25:52.751 INFO:tasks.workunit.client.1.smithi120.stdout:9/449: symlink d0/d14/d2d/d4b/l96 0 2024-04-26T21:25:52.751 INFO:tasks.workunit.client.1.smithi120.stdout:7/445: getdents d7/d10/d12/d1f/d7d/d8b 0 2024-04-26T21:25:52.753 INFO:tasks.workunit.client.0.smithi084.stdout:2/317: truncate f0 702434 0 2024-04-26T21:25:52.753 INFO:tasks.workunit.client.0.smithi084.stdout:5/194: write d0/f33 [263501,102833] 0 2024-04-26T21:25:52.755 INFO:tasks.workunit.client.0.smithi084.stdout:9/176: rmdir da 39 2024-04-26T21:25:52.759 INFO:tasks.workunit.client.0.smithi084.stdout:5/195: mknod d0/d17/c3a 0 2024-04-26T21:25:52.759 INFO:tasks.workunit.client.0.smithi084.stdout:2/318: write d6/d7/f3f [3208627,67957] 0 2024-04-26T21:25:52.762 INFO:tasks.workunit.client.0.smithi084.stdout:2/319: dread - d6/d7/d68/f71 zero size 2024-04-26T21:25:52.762 INFO:tasks.workunit.client.1.smithi120.stdout:6/474: mkdir d4/db/d10/d22/d6c/d9a 0 2024-04-26T21:25:52.763 INFO:tasks.workunit.client.0.smithi084.stdout:5/196: symlink d0/d17/l3b 0 2024-04-26T21:25:52.764 INFO:tasks.workunit.client.0.smithi084.stdout:1/212: dwrite d2/d9/d17/f29 [0,4194304] 0 2024-04-26T21:25:52.768 INFO:tasks.workunit.client.0.smithi084.stdout:5/197: write d0/fd [2116767,70266] 0 2024-04-26T21:25:52.768 INFO:tasks.workunit.client.0.smithi084.stdout:9/177: write f3 [694821,53887] 0 2024-04-26T21:25:52.769 INFO:tasks.workunit.client.0.smithi084.stdout:2/320: unlink d6/d7/d3d/d15/d1f/d22/d2a/f42 0 2024-04-26T21:25:52.775 INFO:tasks.workunit.client.0.smithi084.stdout:2/321: unlink d6/f53 0 2024-04-26T21:25:52.779 INFO:tasks.workunit.client.0.smithi084.stdout:1/213: rename d2/d9/d15/d28/c38 to d2/d9/d15/c43 0 2024-04-26T21:25:52.779 INFO:tasks.workunit.client.0.smithi084.stdout:9/178: mkdir da/de/d16/d40 0 2024-04-26T21:25:52.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.780+0000 7fd474000700 1 -- 172.21.15.84:0/2711063065 --> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd46c11a370 con 0x7fd45406be90 2024-04-26T21:25:52.782 INFO:tasks.workunit.client.0.smithi084.stdout:9/179: chown da/f14 770596460 1 2024-04-26T21:25:52.783 INFO:tasks.workunit.client.0.smithi084.stdout:1/214: write d2/d9/d17/f29 [2011427,15135] 0 2024-04-26T21:25:52.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.782+0000 7fd469600700 1 -- 172.21.15.84:0/2711063065 <== mgr.14662 v2:172.21.15.120:6828/3773295163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fd46c11a370 con 0x7fd45406be90 2024-04-26T21:25:52.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.786+0000 7fd474000700 1 -- 172.21.15.84:0/2711063065 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fd45406be90 msgr2=0x7fd45406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:52.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.786+0000 7fd474000700 1 --2- 172.21.15.84:0/2711063065 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fd45406be90 0x7fd45406e340 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd458004d00 tx=0x7fd458009ce0 comp rx=0 tx=0).stop 2024-04-26T21:25:52.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.786+0000 7fd474000700 1 -- 172.21.15.84:0/2711063065 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd46c0fdfd0 msgr2=0x7fd46c118970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:52.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.786+0000 7fd474000700 1 --2- 172.21.15.84:0/2711063065 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd46c0fdfd0 0x7fd46c118970 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd460009150 tx=0x7fd460009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:52.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.787+0000 7fd474000700 1 -- 172.21.15.84:0/2711063065 shutdown_connections 2024-04-26T21:25:52.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.787+0000 7fd474000700 1 --2- 172.21.15.84:0/2711063065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd46c0fce60 0x7fd46c118430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:52.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.787+0000 7fd474000700 1 --2- 172.21.15.84:0/2711063065 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fd45406be90 0x7fd45406e340 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:52.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.787+0000 7fd474000700 1 --2- 172.21.15.84:0/2711063065 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd46c0fdfd0 0x7fd46c118970 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:52.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.787+0000 7fd474000700 1 -- 172.21.15.84:0/2711063065 >> 172.21.15.84:0/2711063065 conn(0x7fd46c0f8560 msgr2=0x7fd46c0f9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:52.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.787+0000 7fd474000700 1 -- 172.21.15.84:0/2711063065 shutdown_connections 2024-04-26T21:25:52.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:52.787+0000 7fd474000700 1 -- 172.21.15.84:0/2711063065 wait complete. 2024-04-26T21:25:52.790 INFO:tasks.workunit.client.0.smithi084.stdout:9/180: mkdir da/de/d16/d25/d41 0 2024-04-26T21:25:52.792 INFO:tasks.workunit.client.0.smithi084.stdout:1/215: chown d2/d9/d15/l35 27 1 2024-04-26T21:25:52.793 INFO:tasks.workunit.client.1.smithi120.stdout:3/431: write dd/de/d83/f45 [1002599,122841] 0 2024-04-26T21:25:52.794 INFO:tasks.workunit.client.1.smithi120.stdout:7/446: mknod d7/d10/d12/d1f/d7d/d8b/d94/c96 0 2024-04-26T21:25:52.794 INFO:tasks.workunit.client.0.smithi084.stdout:9/181: mknod da/c42 0 2024-04-26T21:25:52.796 INFO:tasks.workunit.client.1.smithi120.stdout:2/478: getdents d4/d1b/d2e/d50/d14/d15 0 2024-04-26T21:25:52.796 INFO:tasks.workunit.client.1.smithi120.stdout:7/447: chown d7/d10/d12/d2f/f63 23372 1 2024-04-26T21:25:52.798 INFO:tasks.workunit.client.1.smithi120.stdout:2/479: write d4/d1b/d25/f31 [1014550,1162] 0 2024-04-26T21:25:52.798 INFO:tasks.workunit.client.0.smithi084.stdout:1/216: creat d2/d9/d17/f44 x:0 0 0 2024-04-26T21:25:52.800 INFO:tasks.workunit.client.0.smithi084.stdout:5/198: dwrite d0/fd [0,4194304] 0 2024-04-26T21:25:52.800 INFO:tasks.workunit.client.1.smithi120.stdout:6/475: mknod d4/db/c9b 0 2024-04-26T21:25:52.802 INFO:tasks.workunit.client.0.smithi084.stdout:1/217: truncate d2/d9/f14 778070 0 2024-04-26T21:25:52.803 INFO:tasks.workunit.client.1.smithi120.stdout:9/450: creat d0/d14/d2d/f97 x:0 0 0 2024-04-26T21:25:52.804 INFO:tasks.workunit.client.1.smithi120.stdout:3/432: symlink dd/d2a/d74/l95 0 2024-04-26T21:25:52.809 INFO:tasks.workunit.client.1.smithi120.stdout:7/448: rename d7/d10/d12/d1a/d33/d34/d91 to d7/d10/d97 0 2024-04-26T21:25:52.809 INFO:tasks.workunit.client.1.smithi120.stdout:4/419: link d10/d12/c16 d10/d65/c90 0 2024-04-26T21:25:52.810 INFO:tasks.workunit.client.1.smithi120.stdout:2/480: creat d4/d1b/d4f/f9c x:0 0 0 2024-04-26T21:25:52.813 INFO:tasks.workunit.client.1.smithi120.stdout:9/451: mkdir d0/dd/d3a/d5c/d98 0 2024-04-26T21:25:52.816 INFO:tasks.workunit.client.1.smithi120.stdout:9/452: write d0/dd/d34/f59 [1492187,71349] 0 2024-04-26T21:25:52.819 INFO:tasks.workunit.client.0.smithi084.stdout:2/322: truncate d6/d7/d3d/d15/d1f/d39/d20/f35 1295508 0 2024-04-26T21:25:52.819 INFO:tasks.workunit.client.1.smithi120.stdout:5/516: dread d2/dc/d1d/d1f/d36/f65 [0,4194304] 0 2024-04-26T21:25:52.822 INFO:tasks.workunit.client.1.smithi120.stdout:7/449: symlink d7/d10/d12/d1a/d33/l98 0 2024-04-26T21:25:52.822 INFO:tasks.workunit.client.1.smithi120.stdout:4/420: creat d10/d65/d72/f91 x:0 0 0 2024-04-26T21:25:52.823 INFO:tasks.workunit.client.0.smithi084.stdout:2/323: chown d6/d1b/c21 17928519 1 2024-04-26T21:25:52.824 INFO:tasks.workunit.client.1.smithi120.stdout:9/453: mkdir d0/d14/d2d/d4b/d85/d99 0 2024-04-26T21:25:52.825 INFO:tasks.workunit.client.1.smithi120.stdout:4/421: readlink d10/l70 0 2024-04-26T21:25:52.827 INFO:tasks.workunit.client.0.smithi084.stdout:9/182: dwrite da/f17 [0,4194304] 0 2024-04-26T21:25:52.827 INFO:tasks.workunit.client.1.smithi120.stdout:9/454: write d0/dd/d45/f63 [655759,93064] 0 2024-04-26T21:25:52.828 INFO:tasks.workunit.client.0.smithi084.stdout:1/218: dread d2/f2e [0,4194304] 0 2024-04-26T21:25:52.829 INFO:tasks.workunit.client.1.smithi120.stdout:2/481: dwrite d4/d1b/d2e/d50/f3f [0,4194304] 0 2024-04-26T21:25:52.829 INFO:tasks.workunit.client.1.smithi120.stdout:5/517: rename d2/dc/d1d/d21/d66/d4d to d2/dc/d1d/d21/d77/d79/db7 0 2024-04-26T21:25:52.831 INFO:tasks.workunit.client.0.smithi084.stdout:9/183: truncate da/f17 4540300 0 2024-04-26T21:25:52.833 INFO:tasks.workunit.client.1.smithi120.stdout:4/422: mknod d10/d28/d73/c92 0 2024-04-26T21:25:52.835 INFO:tasks.workunit.client.1.smithi120.stdout:9/455: write d0/d14/d2d/f2f [2059115,82775] 0 2024-04-26T21:25:52.835 INFO:tasks.workunit.client.0.smithi084.stdout:5/199: dwrite d0/fe [0,4194304] 0 2024-04-26T21:25:52.836 INFO:tasks.workunit.client.0.smithi084.stdout:1/219: mkdir d2/d9/d17/d2a/d2c/d45 0 2024-04-26T21:25:52.837 INFO:tasks.workunit.client.1.smithi120.stdout:2/482: creat d4/d1b/d56/d65/d8d/f9d x:0 0 0 2024-04-26T21:25:52.839 INFO:tasks.workunit.client.0.smithi084.stdout:9/184: mkdir da/de/d16/d25/d41/d43 0 2024-04-26T21:25:52.840 INFO:tasks.workunit.client.1.smithi120.stdout:5/518: mknod d2/dc/d1d/d21/d66/d85/cb8 0 2024-04-26T21:25:52.841 INFO:tasks.workunit.client.1.smithi120.stdout:4/423: truncate d10/d12/f35 1053761 0 2024-04-26T21:25:52.842 INFO:tasks.workunit.client.1.smithi120.stdout:5/519: fdatasync d2/dc/f38 0 2024-04-26T21:25:52.842 INFO:tasks.workunit.client.1.smithi120.stdout:9/456: write d0/d6/d4d/d65/f94 [900516,44532] 0 2024-04-26T21:25:52.843 INFO:tasks.workunit.client.1.smithi120.stdout:7/450: getdents d7/d10/d12/d1f/d28/d4c/d6b/d7b 0 2024-04-26T21:25:52.843 INFO:tasks.workunit.client.0.smithi084.stdout:2/324: write d6/d7/d3d/d15/d1f/d22/f24 [1413504,76090] 0 2024-04-26T21:25:52.846 INFO:tasks.workunit.client.0.smithi084.stdout:1/220: write d2/f2e [1617678,12188] 0 2024-04-26T21:25:52.847 INFO:tasks.workunit.client.1.smithi120.stdout:9/457: write d0/d14/d2d/f97 [759998,45568] 0 2024-04-26T21:25:52.849 INFO:tasks.workunit.client.0.smithi084.stdout:1/221: dread - d2/d9/d17/f44 zero size 2024-04-26T21:25:52.849 INFO:tasks.workunit.client.1.smithi120.stdout:9/458: chown d0/d6/d4d/d65 0 1 2024-04-26T21:25:52.850 INFO:tasks.workunit.client.0.smithi084.stdout:9/185: rename da/de/l39 to da/de/d16/l44 0 2024-04-26T21:25:52.851 INFO:tasks.workunit.client.1.smithi120.stdout:5/520: dread d2/d1b/f26 [0,4194304] 0 2024-04-26T21:25:52.851 INFO:tasks.workunit.client.1.smithi120.stdout:2/483: creat d4/d1b/d2e/d5f/f9e x:0 0 0 2024-04-26T21:25:52.855 INFO:tasks.workunit.client.1.smithi120.stdout:7/451: mkdir d7/d10/d97/d99 0 2024-04-26T21:25:52.856 INFO:tasks.workunit.client.0.smithi084.stdout:7/211: sync 2024-04-26T21:25:52.857 INFO:tasks.workunit.client.0.smithi084.stdout:8/268: sync 2024-04-26T21:25:52.857 INFO:tasks.workunit.client.0.smithi084.stdout:3/277: sync 2024-04-26T21:25:52.857 INFO:tasks.workunit.client.1.smithi120.stdout:3/433: write dd/d40/f50 [2055481,49820] 0 2024-04-26T21:25:52.858 INFO:tasks.workunit.client.0.smithi084.stdout:5/200: getdents d0/dc/df 0 2024-04-26T21:25:52.859 INFO:tasks.workunit.client.1.smithi120.stdout:7/452: dread d7/fe [0,4194304] 0 2024-04-26T21:25:52.860 INFO:tasks.workunit.client.0.smithi084.stdout:7/212: read d6/d9/d12/f3d [777810,54947] 0 2024-04-26T21:25:52.863 INFO:tasks.workunit.client.1.smithi120.stdout:5/521: mknod d2/dc/d1d/d1f/cb9 0 2024-04-26T21:25:52.864 INFO:tasks.workunit.client.1.smithi120.stdout:3/434: read dd/de/df/d12/d48/f55 [2319047,1105] 0 2024-04-26T21:25:52.864 INFO:tasks.workunit.client.0.smithi084.stdout:7/213: stat d6/c36 0 2024-04-26T21:25:52.867 INFO:tasks.workunit.client.1.smithi120.stdout:7/453: unlink d7/c13 0 2024-04-26T21:25:52.868 INFO:tasks.workunit.client.0.smithi084.stdout:5/201: creat d0/dc/df/d31/f3c x:0 0 0 2024-04-26T21:25:52.868 INFO:tasks.workunit.client.0.smithi084.stdout:8/269: read d4/d6/db/d1e/d22/d2f/f41 [36261,99017] 0 2024-04-26T21:25:52.872 INFO:tasks.workunit.client.0.smithi084.stdout:1/222: truncate d2/d9/d17/f18 566374 0 2024-04-26T21:25:52.873 INFO:tasks.workunit.client.1.smithi120.stdout:4/424: getdents d10/d12 0 2024-04-26T21:25:52.876 INFO:tasks.workunit.client.0.smithi084.stdout:5/202: readlink d0/d17/l28 0 2024-04-26T21:25:52.876 INFO:tasks.workunit.client.0.smithi084.stdout:1/223: readlink d2/d1b/l31 0 2024-04-26T21:25:52.878 INFO:tasks.workunit.client.0.smithi084.stdout:8/270: creat d4/f4f x:0 0 0 2024-04-26T21:25:52.882 INFO:tasks.workunit.client.0.smithi084.stdout:1/224: stat d2/d9/d17/f18 0 2024-04-26T21:25:52.883 INFO:tasks.workunit.client.1.smithi120.stdout:5/522: symlink d2/lba 0 2024-04-26T21:25:52.883 INFO:tasks.workunit.client.1.smithi120.stdout:3/435: getdents dd/de/d18/d37/d7c/d86 0 2024-04-26T21:25:52.885 INFO:tasks.workunit.client.0.smithi084.stdout:2/325: dwrite d6/f14 [0,4194304] 0 2024-04-26T21:25:52.887 INFO:tasks.workunit.client.0.smithi084.stdout:1/225: mknod d2/d9/c46 0 2024-04-26T21:25:52.888 INFO:tasks.workunit.client.1.smithi120.stdout:4/425: dwrite d10/d12/f45 [0,4194304] 0 2024-04-26T21:25:52.890 INFO:tasks.workunit.client.0.smithi084.stdout:1/226: dread - d2/d9/d17/d2a/d2c/f34 zero size 2024-04-26T21:25:52.891 INFO:tasks.workunit.client.1.smithi120.stdout:2/484: link d4/d1b/d2e/d50/d14/d15/c33 d4/d1b/d25/c9f 0 2024-04-26T21:25:52.892 INFO:tasks.workunit.client.0.smithi084.stdout:3/278: truncate d1/d2c/d2f/d31/d3b/f41 2480692 0 2024-04-26T21:25:52.893 INFO:tasks.workunit.client.0.smithi084.stdout:7/214: truncate d6/d9/f11 6869405 0 2024-04-26T21:25:52.893 INFO:tasks.workunit.client.1.smithi120.stdout:7/454: getdents d7/d10 0 2024-04-26T21:25:52.893 INFO:tasks.workunit.client.1.smithi120.stdout:5/523: read d2/dc/d1d/d1f/d36/d44/d6c/f2a [3417762,41697] 0 2024-04-26T21:25:52.895 INFO:tasks.workunit.client.0.smithi084.stdout:3/279: fsync d1/d2c/d2f/d31/d55/f4b 0 2024-04-26T21:25:52.896 INFO:tasks.workunit.client.1.smithi120.stdout:7/455: readlink d7/lb 0 2024-04-26T21:25:52.896 INFO:tasks.workunit.client.1.smithi120.stdout:3/436: symlink dd/de/d18/d8d/l96 0 2024-04-26T21:25:52.899 INFO:tasks.workunit.client.0.smithi084.stdout:1/227: mkdir d2/d9/d15/d28/d47 0 2024-04-26T21:25:52.900 INFO:tasks.workunit.client.1.smithi120.stdout:7/456: dread - d7/d10/d12/d1f/d28/d4c/d6b/f8f zero size 2024-04-26T21:25:52.901 INFO:tasks.workunit.client.1.smithi120.stdout:3/437: truncate dd/de/df/d12/d6c/f39 810700 0 2024-04-26T21:25:52.902 INFO:tasks.workunit.client.0.smithi084.stdout:7/215: write d6/dc/d47/f48 [620356,24829] 0 2024-04-26T21:25:52.902 INFO:tasks.workunit.client.1.smithi120.stdout:2/485: read d4/d1b/d2e/d50/d14/d15/f2b [582211,80600] 0 2024-04-26T21:25:52.904 INFO:tasks.workunit.client.0.smithi084.stdout:1/228: stat c1 0 2024-04-26T21:25:52.904 INFO:tasks.workunit.client.0.smithi084.stdout:2/326: getdents d6/d7/d3d/d15 0 2024-04-26T21:25:52.904 INFO:tasks.workunit.client.1.smithi120.stdout:5/524: creat d2/d1b/d89/d47/fbb x:0 0 0 2024-04-26T21:25:52.905 INFO:tasks.workunit.client.1.smithi120.stdout:3/438: write dd/d2a/d4a/f6b [2971928,50111] 0 2024-04-26T21:25:52.907 INFO:tasks.workunit.client.1.smithi120.stdout:5/525: chown d2/d1b/d89/d6b/f72 437084 1 2024-04-26T21:25:52.909 INFO:tasks.workunit.client.0.smithi084.stdout:8/271: truncate d4/f1c 124134 0 2024-04-26T21:25:52.909 INFO:tasks.workunit.client.0.smithi084.stdout:1/229: stat d2/c7 0 2024-04-26T21:25:52.911 INFO:tasks.workunit.client.0.smithi084.stdout:2/327: mkdir d6/d75 0 2024-04-26T21:25:52.913 INFO:tasks.workunit.client.0.smithi084.stdout:8/272: chown d4/d3a 3240017 1 2024-04-26T21:25:52.915 INFO:tasks.workunit.client.0.smithi084.stdout:5/203: dwrite d0/fe [4194304,4194304] 0 2024-04-26T21:25:52.915 INFO:tasks.workunit.client.0.smithi084.stdout:1/230: fsync d2/d19/f1e 0 2024-04-26T21:25:52.916 INFO:tasks.workunit.client.1.smithi120.stdout:7/457: rename d7/d10/d12/d1f/d28/d4c/d6b/f5f to d7/d10/d97/f9a 0 2024-04-26T21:25:52.919 INFO:tasks.workunit.client.1.smithi120.stdout:3/439: mknod dd/de/df/d12/d6c/d46/c97 0 2024-04-26T21:25:52.920 INFO:tasks.workunit.client.0.smithi084.stdout:8/273: fsync d4/d6/f24 0 2024-04-26T21:25:52.923 INFO:tasks.workunit.client.0.smithi084.stdout:5/204: mknod d0/c3d 0 2024-04-26T21:25:52.925 INFO:tasks.workunit.client.0.smithi084.stdout:2/328: creat d6/d7/d3d/d15/d1f/d39/d20/f76 x:0 0 0 2024-04-26T21:25:52.927 INFO:tasks.workunit.client.0.smithi084.stdout:5/205: readlink d0/dc/df/l13 0 2024-04-26T21:25:52.932 INFO:tasks.workunit.client.0.smithi084.stdout:8/274: fsync d4/d6/db/d1e/d22/d2f/f41 0 2024-04-26T21:25:52.935 INFO:tasks.workunit.client.0.smithi084.stdout:6/244: sync 2024-04-26T21:25:52.936 INFO:tasks.workunit.client.0.smithi084.stdout:0/208: sync 2024-04-26T21:25:52.936 INFO:tasks.workunit.client.0.smithi084.stdout:9/186: fdatasync f3 0 2024-04-26T21:25:52.939 INFO:tasks.workunit.client.0.smithi084.stdout:2/329: dread d6/d7/d3d/d15/d1f/d39/d20/d45/f60 [0,4194304] 0 2024-04-26T21:25:52.939 INFO:tasks.workunit.client.0.smithi084.stdout:5/206: creat d0/dc/df/d2a/f3e x:0 0 0 2024-04-26T21:25:52.940 INFO:tasks.workunit.client.0.smithi084.stdout:0/209: fdatasync de/d20/f24 0 2024-04-26T21:25:52.943 INFO:tasks.workunit.client.0.smithi084.stdout:5/207: read d0/d17/f20 [2280374,41882] 0 2024-04-26T21:25:52.946 INFO:tasks.workunit.client.1.smithi120.stdout:3/440: mknod dd/de/df/d12/c98 0 2024-04-26T21:25:52.947 INFO:tasks.workunit.client.0.smithi084.stdout:6/245: creat d3/de/d41/f52 x:0 0 0 2024-04-26T21:25:52.949 INFO:tasks.workunit.client.0.smithi084.stdout:3/280: dread d1/d2c/d2f/f1f [0,4194304] 0 2024-04-26T21:25:52.949 INFO:tasks.workunit.client.1.smithi120.stdout:5/526: link d2/dc/fd d2/d82/d96/fbc 0 2024-04-26T21:25:52.951 INFO:tasks.workunit.client.1.smithi120.stdout:5/527: truncate d2/d30/f2f 4335299 0 2024-04-26T21:25:52.952 INFO:tasks.workunit.client.1.smithi120.stdout:9/459: truncate d0/d14/d2d/d4b/d85/d86/f8f 1018474 0 2024-04-26T21:25:52.952 INFO:tasks.workunit.client.0.smithi084.stdout:2/330: getdents d6/d3e/d67 0 2024-04-26T21:25:52.953 INFO:tasks.workunit.client.0.smithi084.stdout:8/275: symlink d4/d6/db/d1e/d22/d39/d4a/l50 0 2024-04-26T21:25:52.953 INFO:tasks.workunit.client.0.smithi084.stdout:6/246: readlink d3/de/d1a/l19 0 2024-04-26T21:25:52.955 INFO:tasks.workunit.client.0.smithi084.stdout:0/210: creat de/d1c/d32/f44 x:0 0 0 2024-04-26T21:25:52.955 INFO:tasks.workunit.client.0.smithi084.stdout:5/208: symlink d0/dc/df/d31/l3f 0 2024-04-26T21:25:52.955 INFO:tasks.workunit.client.1.smithi120.stdout:7/458: link d7/d10/d12/d1f/d28/d4c/d6b/d7b/c86 d7/d10/d12/d1a/c9b 0 2024-04-26T21:25:52.958 INFO:tasks.workunit.client.1.smithi120.stdout:3/441: readlink dd/de/d83/l82 0 2024-04-26T21:25:52.959 INFO:tasks.workunit.client.1.smithi120.stdout:3/442: stat dd/de/df/d12 0 2024-04-26T21:25:52.959 INFO:tasks.workunit.client.0.smithi084.stdout:7/216: dwrite d6/d9/d12/d19/f3c [0,4194304] 0 2024-04-26T21:25:52.959 INFO:tasks.workunit.client.0.smithi084.stdout:6/247: fsync d3/fc 0 2024-04-26T21:25:52.960 INFO:tasks.workunit.client.1.smithi120.stdout:3/443: readlink dd/de/d18/d2c/d76/l88 0 2024-04-26T21:25:52.960 INFO:tasks.workunit.client.1.smithi120.stdout:8/453: sync 2024-04-26T21:25:52.961 INFO:tasks.workunit.client.1.smithi120.stdout:1/427: sync 2024-04-26T21:25:52.961 INFO:tasks.workunit.client.1.smithi120.stdout:0/540: sync 2024-04-26T21:25:52.961 INFO:tasks.workunit.client.1.smithi120.stdout:8/454: read - d5/f62 zero size 2024-04-26T21:25:52.963 INFO:tasks.workunit.client.1.smithi120.stdout:0/541: dread - d0/d3/d13/d81/fb5 zero size 2024-04-26T21:25:52.963 INFO:tasks.workunit.client.0.smithi084.stdout:7/217: fsync d6/d26/f30 0 2024-04-26T21:25:52.964 INFO:tasks.workunit.client.1.smithi120.stdout:1/428: write d6/d7/d1b/d3b/f7f [1550493,29655] 0 2024-04-26T21:25:52.965 INFO:tasks.workunit.client.1.smithi120.stdout:8/455: fdatasync d5/d6/d11/d52/d27/d4f/d67/f7b 0 2024-04-26T21:25:52.968 INFO:tasks.workunit.client.0.smithi084.stdout:9/187: dread da/de/d1e/f31 [0,4194304] 0 2024-04-26T21:25:52.970 INFO:tasks.workunit.client.0.smithi084.stdout:0/211: mkdir de/d2b/d45 0 2024-04-26T21:25:52.970 INFO:tasks.workunit.client.1.smithi120.stdout:2/486: dread d4/d1b/d25/d2c/d3e/d5e/f61 [0,4194304] 0 2024-04-26T21:25:52.970 INFO:tasks.workunit.client.1.smithi120.stdout:9/460: rename d0/d14/d2d/d4b/d85/d99 to d0/d14/d77/d9a 0 2024-04-26T21:25:52.974 INFO:tasks.workunit.client.0.smithi084.stdout:5/209: rename d0/f33 to d0/dc/df/d2a/f40 0 2024-04-26T21:25:52.974 INFO:tasks.workunit.client.1.smithi120.stdout:7/459: creat d7/d10/d12/d1f/d28/d4c/d6b/f9c x:0 0 0 2024-04-26T21:25:52.976 INFO:tasks.workunit.client.1.smithi120.stdout:7/460: chown d7/d10/d12/d2f/d43 538 1 2024-04-26T21:25:52.976 INFO:tasks.workunit.client.1.smithi120.stdout:2/487: read d4/f34 [51909,88088] 0 2024-04-26T21:25:52.977 INFO:tasks.workunit.client.0.smithi084.stdout:7/218: readlink d6/dc/l24 0 2024-04-26T21:25:52.979 INFO:tasks.workunit.client.0.smithi084.stdout:7/219: fdatasync d6/d26/f30 0 2024-04-26T21:25:52.980 INFO:tasks.workunit.client.0.smithi084.stdout:5/210: truncate d0/dc/df/d2a/f40 959308 0 2024-04-26T21:25:52.980 INFO:tasks.workunit.client.1.smithi120.stdout:4/426: write d10/d28/f4e [364451,116783] 0 2024-04-26T21:25:52.981 INFO:tasks.workunit.client.0.smithi084.stdout:6/248: symlink d3/l53 0 2024-04-26T21:25:52.982 INFO:tasks.workunit.client.1.smithi120.stdout:4/427: stat d10/d28/f77 0 2024-04-26T21:25:52.983 INFO:tasks.workunit.client.0.smithi084.stdout:9/188: creat da/f45 x:0 0 0 2024-04-26T21:25:52.984 INFO:tasks.workunit.client.1.smithi120.stdout:3/444: write dd/de/d18/d24/d43/f4c [369537,605] 0 2024-04-26T21:25:52.986 INFO:tasks.workunit.client.0.smithi084.stdout:9/189: truncate da/f37 239522 0 2024-04-26T21:25:52.988 INFO:tasks.workunit.client.0.smithi084.stdout:8/276: truncate d4/d6/db/d1e/d22/d2f/f2c 916642 0 2024-04-26T21:25:52.988 INFO:tasks.workunit.client.0.smithi084.stdout:7/220: creat d6/d9/d12/d19/f49 x:0 0 0 2024-04-26T21:25:52.988 INFO:tasks.workunit.client.0.smithi084.stdout:3/281: rename d1/d2c/d2f/d31/d3b/c3e to d1/c5e 0 2024-04-26T21:25:52.988 INFO:tasks.workunit.client.0.smithi084.stdout:6/249: symlink d3/d18/l54 0 2024-04-26T21:25:52.992 INFO:tasks.workunit.client.0.smithi084.stdout:6/250: stat d3/de/d15/d23/c25 0 2024-04-26T21:25:52.996 INFO:tasks.workunit.client.0.smithi084.stdout:6/251: write d3/de/d15/d23/f30 [1014345,79504] 0 2024-04-26T21:25:52.998 INFO:tasks.workunit.client.0.smithi084.stdout:9/190: creat da/f46 x:0 0 0 2024-04-26T21:25:52.998 INFO:tasks.workunit.client.1.smithi120.stdout:0/542: dread d0/d3/d13/f1f [0,4194304] 0 2024-04-26T21:25:53.000 INFO:tasks.workunit.client.1.smithi120.stdout:7/461: rename d7/d10/d12/d2f/c4b to d7/d10/d12/d1f/d28/d4c/d6b/c9d 0 2024-04-26T21:25:53.002 INFO:tasks.workunit.client.1.smithi120.stdout:4/428: rmdir d10 39 2024-04-26T21:25:53.003 INFO:tasks.workunit.client.1.smithi120.stdout:3/445: dwrite f5 [0,4194304] 0 2024-04-26T21:25:53.005 INFO:tasks.workunit.client.1.smithi120.stdout:1/429: link d6/d14/f16 d6/d7/d1d/d2c/f93 0 2024-04-26T21:25:53.007 INFO:tasks.workunit.client.1.smithi120.stdout:1/430: truncate d6/f79 359286 0 2024-04-26T21:25:53.007 INFO:tasks.workunit.client.1.smithi120.stdout:2/488: dread d4/d1b/d2e/d50/f2a [0,4194304] 0 2024-04-26T21:25:53.007 INFO:tasks.workunit.client.0.smithi084.stdout:5/211: dwrite d0/f16 [0,4194304] 0 2024-04-26T21:25:53.009 INFO:tasks.workunit.client.1.smithi120.stdout:0/543: mkdir d0/d3/dc/d12/d4a/dbc 0 2024-04-26T21:25:53.009 INFO:tasks.workunit.client.0.smithi084.stdout:1/231: dread d2/f22 [0,4194304] 0 2024-04-26T21:25:53.012 INFO:tasks.workunit.client.1.smithi120.stdout:0/544: write d0/d3/dc/dd/fbb [874161,123996] 0 2024-04-26T21:25:53.012 INFO:tasks.workunit.client.0.smithi084.stdout:5/212: stat d0/dc/df/l27 0 2024-04-26T21:25:53.013 INFO:tasks.workunit.client.0.smithi084.stdout:6/252: truncate d3/f10 1307587 0 2024-04-26T21:25:53.014 INFO:tasks.workunit.client.0.smithi084.stdout:8/277: dread d4/d6/f24 [4194304,4194304] 0 2024-04-26T21:25:53.020 INFO:tasks.workunit.client.0.smithi084.stdout:2/331: truncate d6/d7/d3d/d15/d1f/d39/fe 1398250 0 2024-04-26T21:25:53.020 INFO:tasks.workunit.client.0.smithi084.stdout:5/213: mkdir d0/dc/df/d2a/d41 0 2024-04-26T21:25:53.020 INFO:tasks.workunit.client.0.smithi084.stdout:1/232: truncate d2/d9/d17/f2b 8975008 0 2024-04-26T21:25:53.023 INFO:tasks.workunit.client.1.smithi120.stdout:7/462: creat d7/d10/d12/d1f/d28/d4c/d6b/d7b/f9e x:0 0 0 2024-04-26T21:25:53.026 INFO:tasks.workunit.client.0.smithi084.stdout:6/253: mkdir d3/de/d15/d23/d55 0 2024-04-26T21:25:53.026 INFO:tasks.workunit.client.0.smithi084.stdout:7/221: dwrite d6/d9/d12/d19/f49 [0,4194304] 0 2024-04-26T21:25:53.026 INFO:tasks.workunit.client.0.smithi084.stdout:3/282: rmdir d1/d2c/d2f/d31/d3b 39 2024-04-26T21:25:53.029 INFO:tasks.workunit.client.0.smithi084.stdout:5/214: rename d0/dc/l2d to d0/dc/df/l42 0 2024-04-26T21:25:53.030 INFO:tasks.workunit.client.0.smithi084.stdout:1/233: mkdir d2/d9/d17/d3a/d48 0 2024-04-26T21:25:53.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.030+0000 7f49c9e00700 1 -- 172.21.15.84:0/1955478060 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49c40fe080 msgr2=0x7f49c40fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:53.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.030+0000 7f49c9e00700 1 --2- 172.21.15.84:0/1955478060 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49c40fe080 0x7f49c40fe4f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f49b0004940 tx=0x7f49b0009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:53.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.030+0000 7f49c9e00700 1 -- 172.21.15.84:0/1955478060 shutdown_connections 2024-04-26T21:25:53.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.031+0000 7f49c9e00700 1 --2- 172.21.15.84:0/1955478060 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49c40fe080 0x7f49c40fe4f0 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f49b0004940 tx=0x7f49b0009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:53.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.031+0000 7f49c9e00700 1 --2- 172.21.15.84:0/1955478060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c40fcf10 0x7f49c40fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:53.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.031+0000 7f49c9e00700 1 -- 172.21.15.84:0/1955478060 >> 172.21.15.84:0/1955478060 conn(0x7f49c40f8560 msgr2=0x7f49c40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:53.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.035+0000 7f49c9e00700 1 -- 172.21.15.84:0/1955478060 shutdown_connections 2024-04-26T21:25:53.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.035+0000 7f49c9e00700 1 -- 172.21.15.84:0/1955478060 wait complete. 2024-04-26T21:25:53.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.036+0000 7f49c9e00700 1 Processor -- start 2024-04-26T21:25:53.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.036+0000 7f49c9e00700 1 -- start start 2024-04-26T21:25:53.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.037+0000 7f49c9e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49c40fcf10 0x7f49c4114150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:53.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.037+0000 7f49c9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c4114690 0x7f49c41154e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:53.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.037+0000 7f49c9e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c4114b50 con 0x7f49c4114690 2024-04-26T21:25:53.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.037+0000 7f49c9e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c4114c90 con 0x7f49c40fcf10 2024-04-26T21:25:53.040 INFO:tasks.workunit.client.0.smithi084.stdout:2/332: write d6/d7/d3d/d15/d1f/d39/d20/d45/f51 [1010812,109513] 0 2024-04-26T21:25:53.041 INFO:tasks.workunit.client.0.smithi084.stdout:9/191: dwrite da/de/f11 [0,4194304] 0 2024-04-26T21:25:53.041 INFO:tasks.workunit.client.0.smithi084.stdout:1/234: symlink d2/d9/d15/d28/l49 0 2024-04-26T21:25:53.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.037+0000 7f49c2a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49c40fcf10 0x7f49c4114150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:53.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.038+0000 7f49c2a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49c40fcf10 0x7f49c4114150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:54934/0 (socket says 172.21.15.84:54934) 2024-04-26T21:25:53.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.038+0000 7f49c2a00700 1 -- 172.21.15.84:0/2117136445 learned_addr learned my addr 172.21.15.84:0/2117136445 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:25:53.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.039+0000 7f49c2000700 1 --2- 172.21.15.84:0/2117136445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c4114690 0x7f49c41154e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:53.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.039+0000 7f49c2a00700 1 -- 172.21.15.84:0/2117136445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c4114690 msgr2=0x7f49c41154e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:53.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.039+0000 7f49c2a00700 1 --2- 172.21.15.84:0/2117136445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c4114690 0x7f49c41154e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:53.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.039+0000 7f49c2a00700 1 -- 172.21.15.84:0/2117136445 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b0005040 con 0x7f49c40fcf10 2024-04-26T21:25:53.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.040+0000 7f49c2a00700 1 --2- 172.21.15.84:0/2117136445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49c40fcf10 0x7f49c4114150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49b400eb40 tx=0x7f49b400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:53.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.040+0000 7f49baa00700 1 -- 172.21.15.84:0/2117136445 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49b4007e60 con 0x7f49c40fcf10 2024-04-26T21:25:53.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.041+0000 7f49baa00700 1 -- 172.21.15.84:0/2117136445 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f49b400f040 con 0x7f49c40fcf10 2024-04-26T21:25:53.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.041+0000 7f49c9e00700 1 -- 172.21.15.84:0/2117136445 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c4115ae0 con 0x7f49c40fcf10 2024-04-26T21:25:53.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.041+0000 7f49baa00700 1 -- 172.21.15.84:0/2117136445 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49b400cbf0 con 0x7f49c40fcf10 2024-04-26T21:25:53.047 INFO:tasks.workunit.client.0.smithi084.stdout:1/235: fdatasync d2/f30 0 2024-04-26T21:25:53.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.041+0000 7f49c9e00700 1 -- 172.21.15.84:0/2117136445 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c4116070 con 0x7f49c40fcf10 2024-04-26T21:25:53.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.042+0000 7f49c9e00700 1 -- 172.21.15.84:0/2117136445 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c4100a00 con 0x7f49c40fcf10 2024-04-26T21:25:53.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.044+0000 7f49baa00700 1 -- 172.21.15.84:0/2117136445 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f49b400cd50 con 0x7f49c40fcf10 2024-04-26T21:25:53.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.046+0000 7f49baa00700 1 --2- 172.21.15.84:0/2117136445 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f49a806be00 0x7f49a806e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:53.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.046+0000 7f49baa00700 1 -- 172.21.15.84:0/2117136445 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f49b408a780 con 0x7f49c40fcf10 2024-04-26T21:25:53.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.047+0000 7f49c2000700 1 --2- 172.21.15.84:0/2117136445 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f49a806be00 0x7f49a806e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:53.050 INFO:tasks.workunit.client.0.smithi084.stdout:8/278: dwrite d4/d6/f24 [0,4194304] 0 2024-04-26T21:25:53.053 INFO:tasks.workunit.client.0.smithi084.stdout:2/333: creat d6/d7/d68/f77 x:0 0 0 2024-04-26T21:25:53.055 INFO:tasks.workunit.client.0.smithi084.stdout:7/222: link d6/d9/d12/f33 d6/dc/d47/f4a 0 2024-04-26T21:25:53.055 INFO:tasks.workunit.client.0.smithi084.stdout:1/236: dread d2/d9/d17/f18 [0,4194304] 0 2024-04-26T21:25:53.056 INFO:tasks.workunit.client.0.smithi084.stdout:3/283: link d1/d2c/d2f/d31/d55/l49 d1/d2c/d2f/l5f 0 2024-04-26T21:25:53.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.055+0000 7f49baa00700 1 -- 172.21.15.84:0/2117136445 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f49b4050930 con 0x7f49c40fcf10 2024-04-26T21:25:53.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.056+0000 7f49c2000700 1 --2- 172.21.15.84:0/2117136445 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f49a806be00 0x7f49a806e2b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f49b0009040 tx=0x7f49b0009e30 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:53.061 INFO:tasks.workunit.client.0.smithi084.stdout:7/223: unlink d6/d26/l28 0 2024-04-26T21:25:53.064 INFO:tasks.workunit.client.1.smithi120.stdout:6/476: sync 2024-04-26T21:25:53.067 INFO:tasks.workunit.client.0.smithi084.stdout:7/224: dread - d6/d9/d12/f3e zero size 2024-04-26T21:25:53.068 INFO:tasks.workunit.client.0.smithi084.stdout:1/237: creat d2/d9/d17/d2a/d2c/d45/f4a x:0 0 0 2024-04-26T21:25:53.072 INFO:tasks.workunit.client.0.smithi084.stdout:1/238: readlink d2/d9/d17/l3e 0 2024-04-26T21:25:53.073 INFO:tasks.workunit.client.1.smithi120.stdout:2/489: mkdir d4/d1b/d2e/da0 0 2024-04-26T21:25:53.074 INFO:tasks.workunit.client.1.smithi120.stdout:5/528: write d2/dc/d1d/d1f/d36/d44/d6c/f50 [1590753,3179] 0 2024-04-26T21:25:53.074 INFO:tasks.workunit.client.1.smithi120.stdout:0/545: creat d0/d3/d13/d81/dba/fbd x:0 0 0 2024-04-26T21:25:53.074 INFO:tasks.workunit.client.0.smithi084.stdout:3/284: link d1/f23 d1/d2c/d2f/d31/d52/f60 0 2024-04-26T21:25:53.074 INFO:tasks.workunit.client.0.smithi084.stdout:5/215: dwrite d0/d17/f20 [0,4194304] 0 2024-04-26T21:25:53.074 INFO:tasks.workunit.client.0.smithi084.stdout:6/254: write d3/de/d15/d23/f2a [1238547,117226] 0 2024-04-26T21:25:53.077 INFO:tasks.workunit.client.0.smithi084.stdout:3/285: write d1/d2c/f3c [3553380,115005] 0 2024-04-26T21:25:53.078 INFO:tasks.workunit.client.0.smithi084.stdout:2/334: read d6/d7/d3d/d15/d1f/d39/d20/d45/f51 [261151,284] 0 2024-04-26T21:25:53.079 INFO:tasks.workunit.client.1.smithi120.stdout:6/477: mkdir d4/db/d10/d22/d56/d9c 0 2024-04-26T21:25:53.086 INFO:tasks.workunit.client.0.smithi084.stdout:4/174: sync 2024-04-26T21:25:53.086 INFO:tasks.workunit.client.0.smithi084.stdout:7/225: read d6/d9/ff [719343,96937] 0 2024-04-26T21:25:53.086 INFO:tasks.workunit.client.0.smithi084.stdout:6/255: write d3/de/d41/f51 [4522109,10411] 0 2024-04-26T21:25:53.088 INFO:tasks.workunit.client.1.smithi120.stdout:7/463: dwrite d7/d10/d12/d1f/d28/d4c/d6b/f8f [0,4194304] 0 2024-04-26T21:25:53.088 INFO:tasks.workunit.client.1.smithi120.stdout:0/546: dread d0/d3/d13/d5a/f7a [0,4194304] 0 2024-04-26T21:25:53.088 INFO:tasks.workunit.client.1.smithi120.stdout:6/478: readlink d4/db/d10/dd/d4e/d60/l8a 0 2024-04-26T21:25:53.090 INFO:tasks.workunit.client.1.smithi120.stdout:5/529: creat d2/dc/d1d/d21/d77/d79/fbd x:0 0 0 2024-04-26T21:25:53.091 INFO:tasks.workunit.client.0.smithi084.stdout:8/279: dwrite d4/f4f [0,4194304] 0 2024-04-26T21:25:53.093 INFO:tasks.workunit.client.1.smithi120.stdout:6/479: fsync d4/db/d10/d1a/d2b/d57/d67/f66 0 2024-04-26T21:25:53.094 INFO:tasks.workunit.client.0.smithi084.stdout:1/239: rename d2/f30 to d2/d9/d15/d28/d47/f4b 0 2024-04-26T21:25:53.098 INFO:tasks.workunit.client.1.smithi120.stdout:9/461: dwrite d0/d14/f35 [0,4194304] 0 2024-04-26T21:25:53.098 INFO:tasks.workunit.client.1.smithi120.stdout:2/490: rename d4/c12 to d4/d1b/d56/d65/d8d/ca1 0 2024-04-26T21:25:53.099 INFO:tasks.workunit.client.0.smithi084.stdout:7/226: creat d6/f4b x:0 0 0 2024-04-26T21:25:53.103 INFO:tasks.workunit.client.0.smithi084.stdout:4/175: symlink d5/d2e/l41 0 2024-04-26T21:25:53.104 INFO:tasks.workunit.client.0.smithi084.stdout:9/192: dread da/f35 [0,4194304] 0 2024-04-26T21:25:53.105 INFO:tasks.workunit.client.0.smithi084.stdout:4/176: fsync d5/d10/f1b 0 2024-04-26T21:25:53.106 INFO:tasks.workunit.client.0.smithi084.stdout:8/280: mknod d4/d6/db/d1e/c51 0 2024-04-26T21:25:53.108 INFO:tasks.workunit.client.1.smithi120.stdout:3/446: write dd/d2a/f5f [45389,81815] 0 2024-04-26T21:25:53.111 INFO:tasks.workunit.client.1.smithi120.stdout:4/429: write d10/d12/f3a [1205500,78723] 0 2024-04-26T21:25:53.112 INFO:tasks.workunit.client.1.smithi120.stdout:4/430: readlink d10/l38 0 2024-04-26T21:25:53.113 INFO:tasks.workunit.client.0.smithi084.stdout:3/286: creat d1/d2c/d2f/d31/f61 x:0 0 0 2024-04-26T21:25:53.113 INFO:tasks.workunit.client.0.smithi084.stdout:7/227: mknod d6/d1c/c4c 0 2024-04-26T21:25:53.114 INFO:tasks.workunit.client.1.smithi120.stdout:3/447: write dd/d2a/f71 [1009972,92605] 0 2024-04-26T21:25:53.119 INFO:tasks.workunit.client.1.smithi120.stdout:0/547: fsync d0/f35 0 2024-04-26T21:25:53.120 INFO:tasks.workunit.client.0.smithi084.stdout:7/228: write d6/dc/f27 [1428033,106708] 0 2024-04-26T21:25:53.121 INFO:tasks.workunit.client.0.smithi084.stdout:8/281: chown d4/d6/db/d1e/l1f 7482554 1 2024-04-26T21:25:53.123 INFO:tasks.workunit.client.0.smithi084.stdout:7/229: stat d6/d26/d40 0 2024-04-26T21:25:53.124 INFO:tasks.workunit.client.1.smithi120.stdout:2/491: creat d4/d1b/d25/d2c/fa2 x:0 0 0 2024-04-26T21:25:53.124 INFO:tasks.workunit.client.0.smithi084.stdout:9/193: link da/de/d16/f30 da/de/d1e/f47 0 2024-04-26T21:25:53.132 INFO:tasks.workunit.client.1.smithi120.stdout:6/480: rename d4/db/d10/d1a/d95 to d4/db/d25/d6d/d97/d9d 0 2024-04-26T21:25:53.132 INFO:tasks.workunit.client.0.smithi084.stdout:6/256: dwrite d3/de/d1a/d2f/f3c [0,4194304] 0 2024-04-26T21:25:53.133 INFO:tasks.workunit.client.0.smithi084.stdout:9/194: unlink f9 0 2024-04-26T21:25:53.135 INFO:tasks.workunit.client.1.smithi120.stdout:4/431: mknod d10/d65/d72/d86/c93 0 2024-04-26T21:25:53.136 INFO:tasks.workunit.client.1.smithi120.stdout:4/432: chown d10/d12/l85 51099 1 2024-04-26T21:25:53.138 INFO:tasks.workunit.client.1.smithi120.stdout:2/492: dread d4/d1b/d2e/d50/f3f [0,4194304] 0 2024-04-26T21:25:53.139 INFO:tasks.workunit.client.1.smithi120.stdout:9/462: mkdir d0/dd/d34/d8a/d9b 0 2024-04-26T21:25:53.142 INFO:tasks.workunit.client.0.smithi084.stdout:4/177: dwrite d5/f2b [0,4194304] 0 2024-04-26T21:25:53.143 INFO:tasks.workunit.client.1.smithi120.stdout:9/463: write d0/d6/d3d/f7b [222102,29065] 0 2024-04-26T21:25:53.146 INFO:tasks.workunit.client.0.smithi084.stdout:5/216: dwrite d0/f11 [0,4194304] 0 2024-04-26T21:25:53.148 INFO:tasks.workunit.client.1.smithi120.stdout:7/464: rename d7/d10/d12/d1a/d33/d34/f38 to d7/d10/d12/d2f/d43/f9f 0 2024-04-26T21:25:53.148 INFO:tasks.workunit.client.0.smithi084.stdout:9/195: unlink da/fc 0 2024-04-26T21:25:53.150 INFO:tasks.workunit.client.1.smithi120.stdout:6/481: fdatasync d4/db/d10/dd/f30 0 2024-04-26T21:25:53.154 INFO:tasks.workunit.client.1.smithi120.stdout:0/548: creat d0/d3/dc/dd/d1b/daa/fbe x:0 0 0 2024-04-26T21:25:53.156 INFO:tasks.workunit.client.0.smithi084.stdout:2/335: read d6/d7/d3d/d15/d1f/d39/d20/f50 [379361,112892] 0 2024-04-26T21:25:53.159 INFO:tasks.workunit.client.0.smithi084.stdout:1/240: creat d2/d19/f4c x:0 0 0 2024-04-26T21:25:53.161 INFO:tasks.workunit.client.0.smithi084.stdout:8/282: write d4/f5 [1701509,22852] 0 2024-04-26T21:25:53.161 INFO:tasks.workunit.client.1.smithi120.stdout:2/493: dwrite d4/d1b/d2e/d50/d14/d15/d6c/f97 [0,4194304] 0 2024-04-26T21:25:53.162 INFO:tasks.workunit.client.0.smithi084.stdout:7/230: truncate d6/d9/ff 784972 0 2024-04-26T21:25:53.163 INFO:tasks.workunit.client.1.smithi120.stdout:9/464: dread d0/f1 [0,4194304] 0 2024-04-26T21:25:53.165 INFO:tasks.workunit.client.0.smithi084.stdout:5/217: unlink d0/dc/df/l27 0 2024-04-26T21:25:53.170 INFO:tasks.workunit.client.1.smithi120.stdout:6/482: unlink d4/db/d10/d22/d56/d8f/f87 0 2024-04-26T21:25:53.172 INFO:tasks.workunit.client.0.smithi084.stdout:2/336: creat d6/d7/d68/f78 x:0 0 0 2024-04-26T21:25:53.173 INFO:tasks.workunit.client.1.smithi120.stdout:4/433: creat d10/d65/d8c/f94 x:0 0 0 2024-04-26T21:25:53.177 INFO:tasks.workunit.client.0.smithi084.stdout:7/231: creat d6/f4d x:0 0 0 2024-04-26T21:25:53.177 INFO:tasks.workunit.client.0.smithi084.stdout:6/257: dwrite d3/d18/f38 [0,4194304] 0 2024-04-26T21:25:53.180 INFO:tasks.workunit.client.0.smithi084.stdout:2/337: mkdir d6/d7/d3d/d79 0 2024-04-26T21:25:53.180 INFO:tasks.workunit.client.0.smithi084.stdout:6/258: chown d3/de/d15/f1c 53156330 1 2024-04-26T21:25:53.184 INFO:tasks.workunit.client.1.smithi120.stdout:0/549: rename d0/d3/f4e to d0/d3/dc/d12/d31/fbf 0 2024-04-26T21:25:53.184 INFO:tasks.workunit.client.0.smithi084.stdout:2/338: creat d6/d1b/f7a x:0 0 0 2024-04-26T21:25:53.185 INFO:tasks.workunit.client.1.smithi120.stdout:5/530: write d2/d48/d63/f92 [710061,86388] 0 2024-04-26T21:25:53.186 INFO:tasks.workunit.client.0.smithi084.stdout:8/283: fsync d4/f5 0 2024-04-26T21:25:53.188 INFO:tasks.workunit.client.1.smithi120.stdout:2/494: symlink d4/d1b/d2e/d50/d14/la3 0 2024-04-26T21:25:53.191 INFO:tasks.workunit.client.1.smithi120.stdout:5/531: write d2/d48/f8f [117209,26649] 0 2024-04-26T21:25:53.192 INFO:tasks.workunit.client.0.smithi084.stdout:6/259: creat d3/de/d1a/d2f/f56 x:0 0 0 2024-04-26T21:25:53.194 INFO:tasks.workunit.client.1.smithi120.stdout:5/532: chown d2/dc/d1d/d21/d66/f14 58 1 2024-04-26T21:25:53.196 INFO:tasks.workunit.client.1.smithi120.stdout:6/483: mkdir d4/db/d10/dd/d28/d9e 0 2024-04-26T21:25:53.196 INFO:tasks.workunit.client.1.smithi120.stdout:4/434: creat d10/d12/f95 x:0 0 0 2024-04-26T21:25:53.199 INFO:tasks.workunit.client.1.smithi120.stdout:7/465: creat d7/d10/d12/d1a/d33/fa0 x:0 0 0 2024-04-26T21:25:53.200 INFO:tasks.workunit.client.0.smithi084.stdout:1/241: dwrite d2/d19/f1e [0,4194304] 0 2024-04-26T21:25:53.203 INFO:tasks.workunit.client.1.smithi120.stdout:2/495: creat d4/d1b/d2e/d50/d14/d15/d6c/fa4 x:0 0 0 2024-04-26T21:25:53.205 INFO:tasks.workunit.client.1.smithi120.stdout:5/533: mkdir d2/d48/d63/dbe 0 2024-04-26T21:25:53.211 INFO:tasks.workunit.client.1.smithi120.stdout:7/466: symlink d7/d10/d12/d1f/d28/d4c/d6c/la1 0 2024-04-26T21:25:53.212 INFO:tasks.workunit.client.1.smithi120.stdout:2/496: unlink d4/d1b/d25/l40 0 2024-04-26T21:25:53.212 INFO:tasks.workunit.client.1.smithi120.stdout:6/484: creat d4/db/d10/dd/d28/d9e/f9f x:0 0 0 2024-04-26T21:25:53.216 INFO:tasks.workunit.client.0.smithi084.stdout:8/284: dwrite d4/f13 [0,4194304] 0 2024-04-26T21:25:53.216 INFO:tasks.workunit.client.1.smithi120.stdout:6/485: rmdir d4/db/d10/d1a/d2b/d57/d67 39 2024-04-26T21:25:53.217 INFO:tasks.workunit.client.1.smithi120.stdout:7/467: chown d7/d10/d12/d1f/d28/d4c/d6b/f70 107 1 2024-04-26T21:25:53.219 INFO:tasks.workunit.client.1.smithi120.stdout:6/486: fdatasync d4/db/d10/d22/d6c/f70 0 2024-04-26T21:25:53.220 INFO:tasks.workunit.client.1.smithi120.stdout:2/497: symlink d4/d1b/d2e/la5 0 2024-04-26T21:25:53.221 INFO:tasks.workunit.client.1.smithi120.stdout:4/435: dwrite d10/d12/f14 [4194304,4194304] 0 2024-04-26T21:25:53.224 INFO:tasks.workunit.client.1.smithi120.stdout:2/498: write d4/d1b/f85 [829675,13075] 0 2024-04-26T21:25:53.224 INFO:tasks.workunit.client.1.smithi120.stdout:4/436: dread - d10/d12/f8a zero size 2024-04-26T21:25:53.225 INFO:tasks.workunit.client.0.smithi084.stdout:8/285: chown d4/d6/db/l46 7 1 2024-04-26T21:25:53.229 INFO:tasks.workunit.client.0.smithi084.stdout:8/286: rmdir d4/d7 39 2024-04-26T21:25:53.230 INFO:tasks.workunit.client.0.smithi084.stdout:5/218: dread d0/f2 [0,4194304] 0 2024-04-26T21:25:53.230 INFO:tasks.workunit.client.1.smithi120.stdout:7/468: creat d7/d10/d12/d1f/d7d/fa2 x:0 0 0 2024-04-26T21:25:53.235 INFO:tasks.workunit.client.0.smithi084.stdout:1/242: dwrite d2/d9/d17/f2b [4194304,4194304] 0 2024-04-26T21:25:53.235 INFO:tasks.workunit.client.0.smithi084.stdout:5/219: dread - d0/dc/f2f zero size 2024-04-26T21:25:53.236 INFO:tasks.workunit.client.1.smithi120.stdout:6/487: dwrite d4/db/d25/d6d/f84 [0,4194304] 0 2024-04-26T21:25:53.239 INFO:tasks.workunit.client.0.smithi084.stdout:8/287: mkdir d4/d7/d15/d37/d52 0 2024-04-26T21:25:53.239 INFO:tasks.workunit.client.1.smithi120.stdout:4/437: mknod d10/c96 0 2024-04-26T21:25:53.243 INFO:tasks.workunit.client.0.smithi084.stdout:8/288: chown d4/d6/db/l11 10527955 1 2024-04-26T21:25:53.244 INFO:tasks.workunit.client.0.smithi084.stdout:1/243: creat d2/d19/f4d x:0 0 0 2024-04-26T21:25:53.246 INFO:tasks.workunit.client.1.smithi120.stdout:8/456: sync 2024-04-26T21:25:53.248 INFO:tasks.workunit.client.0.smithi084.stdout:1/244: dread d2/d9/d17/f18 [0,4194304] 0 2024-04-26T21:25:53.254 INFO:tasks.workunit.client.0.smithi084.stdout:1/245: rename d2/d9/d17/d3a/d48 to d2/d9/d17/d3a/d48/d4e 22 2024-04-26T21:25:53.254 INFO:tasks.workunit.client.0.smithi084.stdout:8/289: unlink d4/d7/d15/d37/d3b/f44 0 2024-04-26T21:25:53.256 INFO:tasks.workunit.client.1.smithi120.stdout:2/499: dwrite d4/d1b/f38 [4194304,4194304] 0 2024-04-26T21:25:53.258 INFO:tasks.workunit.client.1.smithi120.stdout:6/488: rename d4/db/d10/d22/d56/d8f/c91 to d4/db/d25/d6d/d97/ca0 0 2024-04-26T21:25:53.258 INFO:tasks.workunit.client.0.smithi084.stdout:8/290: mkdir d4/d7/d53 0 2024-04-26T21:25:53.259 INFO:tasks.workunit.client.1.smithi120.stdout:7/469: dwrite d7/fd [0,4194304] 0 2024-04-26T21:25:53.261 INFO:tasks.workunit.client.1.smithi120.stdout:8/457: creat d5/d6/d11/d52/d27/f9b x:0 0 0 2024-04-26T21:25:53.262 INFO:tasks.workunit.client.1.smithi120.stdout:2/500: mkdir d4/d1b/d5c/da6 0 2024-04-26T21:25:53.262 INFO:tasks.workunit.client.0.smithi084.stdout:1/246: creat d2/d9/d15/d28/d47/f4f x:0 0 0 2024-04-26T21:25:53.264 INFO:tasks.workunit.client.0.smithi084.stdout:8/291: mknod d4/d7/d15/c54 0 2024-04-26T21:25:53.267 INFO:tasks.workunit.client.1.smithi120.stdout:4/438: dread d10/d12/f35 [0,4194304] 0 2024-04-26T21:25:53.267 INFO:tasks.workunit.client.0.smithi084.stdout:5/220: dwrite d0/dc/df/f24 [0,4194304] 0 2024-04-26T21:25:53.267 INFO:tasks.workunit.client.0.smithi084.stdout:1/247: fsync d2/d9/d17/d2a/d2c/f34 0 2024-04-26T21:25:53.268 INFO:tasks.workunit.client.1.smithi120.stdout:4/439: dread - d10/d28/f31 zero size 2024-04-26T21:25:53.270 INFO:tasks.workunit.client.0.smithi084.stdout:5/221: fdatasync d0/dc/f2f 0 2024-04-26T21:25:53.271 INFO:tasks.workunit.client.1.smithi120.stdout:8/458: unlink d5/d6/d11/d52/d27/l66 0 2024-04-26T21:25:53.271 INFO:tasks.workunit.client.0.smithi084.stdout:1/248: readlink d2/d9/d15/l24 0 2024-04-26T21:25:53.271 INFO:tasks.workunit.client.0.smithi084.stdout:8/292: symlink d4/d6/db/d1e/d22/l55 0 2024-04-26T21:25:53.274 INFO:tasks.workunit.client.0.smithi084.stdout:8/293: write d4/f5 [1998114,104558] 0 2024-04-26T21:25:53.278 INFO:tasks.workunit.client.1.smithi120.stdout:4/440: symlink d10/d65/d72/d86/l97 0 2024-04-26T21:25:53.279 INFO:tasks.workunit.client.0.smithi084.stdout:1/249: link d2/d9/d17/f44 d2/d9/d17/d3a/d48/f50 0 2024-04-26T21:25:53.279 INFO:tasks.workunit.client.0.smithi084.stdout:8/294: symlink d4/d7/d53/l56 0 2024-04-26T21:25:53.281 INFO:tasks.workunit.client.0.smithi084.stdout:5/222: dread d0/dc/f1a [0,4194304] 0 2024-04-26T21:25:53.281 INFO:tasks.workunit.client.1.smithi120.stdout:2/501: creat d4/d1b/d2e/fa7 x:0 0 0 2024-04-26T21:25:53.285 INFO:tasks.workunit.client.1.smithi120.stdout:8/459: dwrite f4 [0,4194304] 0 2024-04-26T21:25:53.285 INFO:tasks.workunit.client.1.smithi120.stdout:4/441: creat d10/d6b/f98 x:0 0 0 2024-04-26T21:25:53.286 INFO:tasks.workunit.client.0.smithi084.stdout:5/223: write d0/dc/f2f [782506,60038] 0 2024-04-26T21:25:53.286 INFO:tasks.workunit.client.1.smithi120.stdout:6/489: link d4/db/d10/dd/d4e/c51 d4/db/d10/dd/d4e/ca1 0 2024-04-26T21:25:53.288 INFO:tasks.workunit.client.1.smithi120.stdout:8/460: chown d5/d6/d11/f10 735080755 1 2024-04-26T21:25:53.294 INFO:tasks.workunit.client.1.smithi120.stdout:4/442: rename d10/d28/f7b to d10/d65/d72/d86/f99 0 2024-04-26T21:25:53.294 INFO:tasks.workunit.client.0.smithi084.stdout:1/250: mknod d2/d9/d17/c51 0 2024-04-26T21:25:53.299 INFO:tasks.workunit.client.0.smithi084.stdout:2/339: write d6/d7/d3d/d15/f55 [1972409,58051] 0 2024-04-26T21:25:53.305 INFO:tasks.workunit.client.0.smithi084.stdout:6/260: truncate d3/de/d15/df/f1b 1176161 0 2024-04-26T21:25:53.305 INFO:tasks.workunit.client.0.smithi084.stdout:2/340: rmdir d6/d7/d3d 39 2024-04-26T21:25:53.306 INFO:tasks.workunit.client.1.smithi120.stdout:8/461: creat d5/d6/d34/d37/d60/f9c x:0 0 0 2024-04-26T21:25:53.308 INFO:tasks.workunit.client.1.smithi120.stdout:8/462: readlink d5/d6/d11/d52/d27/d4f/l87 0 2024-04-26T21:25:53.312 INFO:tasks.workunit.client.0.smithi084.stdout:0/212: sync 2024-04-26T21:25:53.314 INFO:tasks.workunit.client.0.smithi084.stdout:4/178: dwrite d5/fe [0,4194304] 0 2024-04-26T21:25:53.316 INFO:tasks.workunit.client.0.smithi084.stdout:8/295: dwrite d4/f4f [4194304,4194304] 0 2024-04-26T21:25:53.316 INFO:tasks.workunit.client.0.smithi084.stdout:6/261: creat d3/de/d1a/d43/f57 x:0 0 0 2024-04-26T21:25:53.321 INFO:tasks.workunit.client.1.smithi120.stdout:4/443: creat d10/d65/d72/d86/f9a x:0 0 0 2024-04-26T21:25:53.322 INFO:tasks.workunit.client.1.smithi120.stdout:4/444: dread - d10/d12/f8e zero size 2024-04-26T21:25:53.323 INFO:tasks.workunit.client.0.smithi084.stdout:4/179: write d5/f2b [3882559,27788] 0 2024-04-26T21:25:53.323 INFO:tasks.workunit.client.0.smithi084.stdout:6/262: read d3/fc [655896,120392] 0 2024-04-26T21:25:53.324 INFO:tasks.workunit.client.1.smithi120.stdout:4/445: dread - d10/d12/f8a zero size 2024-04-26T21:25:53.325 INFO:tasks.workunit.client.1.smithi120.stdout:4/446: chown d10/d65/d72/c84 70487 1 2024-04-26T21:25:53.326 INFO:tasks.workunit.client.0.smithi084.stdout:2/341: mknod d6/d7/d3d/d15/d1f/d41/c7b 0 2024-04-26T21:25:53.326 INFO:tasks.workunit.client.0.smithi084.stdout:0/213: mknod de/c46 0 2024-04-26T21:25:53.330 INFO:tasks.workunit.client.0.smithi084.stdout:6/263: chown d3/d18/f2b 196 1 2024-04-26T21:25:53.333 INFO:tasks.workunit.client.0.smithi084.stdout:5/224: dwrite d0/dc/df/f24 [0,4194304] 0 2024-04-26T21:25:53.334 INFO:tasks.workunit.client.1.smithi120.stdout:1/431: sync 2024-04-26T21:25:53.334 INFO:tasks.workunit.client.1.smithi120.stdout:3/448: sync 2024-04-26T21:25:53.336 INFO:tasks.workunit.client.1.smithi120.stdout:1/432: dread d6/d7/d1d/d2c/d73/f88 [0,4194304] 0 2024-04-26T21:25:53.337 INFO:tasks.workunit.client.0.smithi084.stdout:0/214: write de/d1c/f33 [1594761,72377] 0 2024-04-26T21:25:53.341 INFO:tasks.workunit.client.0.smithi084.stdout:2/342: unlink d6/d7/d3d/d15/d1f/c4a 0 2024-04-26T21:25:53.349 INFO:tasks.workunit.client.0.smithi084.stdout:6/264: rename d3/de/d15/d45 to d3/de/d1a/d2f/d4c/d58 0 2024-04-26T21:25:53.350 INFO:tasks.workunit.client.0.smithi084.stdout:5/225: creat d0/dc/f43 x:0 0 0 2024-04-26T21:25:53.351 INFO:tasks.workunit.client.1.smithi120.stdout:8/463: rename d5/d6/d34/d37/d60/d55 to d5/d6/d34/d42/d9d 0 2024-04-26T21:25:53.352 INFO:tasks.workunit.client.0.smithi084.stdout:5/226: fsync d0/fd 0 2024-04-26T21:25:53.352 INFO:tasks.workunit.client.0.smithi084.stdout:1/251: dwrite d2/d9/d17/f18 [0,4194304] 0 2024-04-26T21:25:53.355 INFO:tasks.workunit.client.1.smithi120.stdout:6/490: mknod d4/db/d10/d1a/d2b/d57/d67/d98/ca2 0 2024-04-26T21:25:53.361 INFO:tasks.workunit.client.1.smithi120.stdout:1/433: fsync d6/d7/d1d/d5d/d67/dd/fe 0 2024-04-26T21:25:53.363 INFO:tasks.workunit.client.1.smithi120.stdout:1/434: readlink d6/d7/d1d/d5d/d67/dd/l64 0 2024-04-26T21:25:53.366 INFO:tasks.workunit.client.0.smithi084.stdout:0/215: link de/c16 de/d2b/c47 0 2024-04-26T21:25:53.373 INFO:tasks.workunit.client.1.smithi120.stdout:6/491: mknod d4/db/d10/d22/ca3 0 2024-04-26T21:25:53.374 INFO:tasks.workunit.client.0.smithi084.stdout:3/287: sync 2024-04-26T21:25:53.374 INFO:tasks.workunit.client.0.smithi084.stdout:1/252: link c0 d2/d9/c52 0 2024-04-26T21:25:53.375 INFO:tasks.workunit.client.1.smithi120.stdout:6/492: fdatasync d4/db/d10/f92 0 2024-04-26T21:25:53.376 INFO:tasks.workunit.client.0.smithi084.stdout:2/343: truncate d6/d7/d3d/d15/d1f/d39/d20/f35 2184260 0 2024-04-26T21:25:53.378 INFO:tasks.workunit.client.0.smithi084.stdout:2/344: chown d6/d7/d3d/d4f 27055041 1 2024-04-26T21:25:53.379 INFO:tasks.workunit.client.1.smithi120.stdout:6/493: chown d4/db/d10/dd 45 1 2024-04-26T21:25:53.385 INFO:tasks.workunit.client.0.smithi084.stdout:6/265: dwrite d3/de/d15/df/f21 [0,4194304] 0 2024-04-26T21:25:53.385 INFO:tasks.workunit.client.0.smithi084.stdout:4/180: truncate d5/f2b 249157 0 2024-04-26T21:25:53.392 INFO:tasks.workunit.client.0.smithi084.stdout:1/253: mknod d2/d9/c53 0 2024-04-26T21:25:53.392 INFO:tasks.workunit.client.1.smithi120.stdout:1/435: mknod d6/d7/d1b/d3b/d6d/c94 0 2024-04-26T21:25:53.402 INFO:tasks.workunit.client.0.smithi084.stdout:5/227: dwrite d0/dc/f2f [0,4194304] 0 2024-04-26T21:25:53.402 INFO:tasks.workunit.client.0.smithi084.stdout:0/216: write de/f12 [1101083,59095] 0 2024-04-26T21:25:53.404 INFO:tasks.workunit.client.0.smithi084.stdout:4/181: mkdir d5/d7/d17/d42 0 2024-04-26T21:25:53.406 INFO:tasks.workunit.client.0.smithi084.stdout:5/228: chown d0/fe 3106214 1 2024-04-26T21:25:53.407 INFO:tasks.workunit.client.1.smithi120.stdout:1/436: symlink d6/d7/d1d/l95 0 2024-04-26T21:25:53.408 INFO:tasks.workunit.client.0.smithi084.stdout:3/288: link d1/d24/d27/d3a/f51 d1/d24/d27/d3a/f62 0 2024-04-26T21:25:53.408 INFO:tasks.workunit.client.0.smithi084.stdout:7/232: dread d6/d9/ff [0,4194304] 0 2024-04-26T21:25:53.411 INFO:tasks.workunit.client.0.smithi084.stdout:1/254: mkdir d2/d54 0 2024-04-26T21:25:53.412 INFO:tasks.workunit.client.1.smithi120.stdout:8/464: getdents d5/d6/d11/d52/d70 0 2024-04-26T21:25:53.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:53 smithi084 ceph-mon[25539]: pgmap v41: 65 pgs: 65 active+clean; 1.5 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 38 MiB/s rd, 210 MiB/s wr, 382 op/s 2024-04-26T21:25:53.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:53 smithi084 ceph-mon[25539]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:25:53.413 INFO:tasks.workunit.client.0.smithi084.stdout:7/233: stat d6/f4d 0 2024-04-26T21:25:53.418 INFO:tasks.workunit.client.1.smithi120.stdout:8/465: truncate d5/d6/d34/d42/d4a/f99 295268 0 2024-04-26T21:25:53.419 INFO:tasks.workunit.client.0.smithi084.stdout:3/289: chown d1/d2c/c5d 1308 1 2024-04-26T21:25:53.419 INFO:tasks.workunit.client.1.smithi120.stdout:5/534: getdents d2/d48/d63 0 2024-04-26T21:25:53.420 INFO:tasks.workunit.client.0.smithi084.stdout:7/234: write d6/d9/d12/d19/d20/f44 [3506756,17674] 0 2024-04-26T21:25:53.421 INFO:tasks.workunit.client.0.smithi084.stdout:1/255: readlink d2/d19/l41 0 2024-04-26T21:25:53.424 INFO:tasks.workunit.client.1.smithi120.stdout:9/465: dwrite d0/d14/d2d/d4b/f55 [0,4194304] 0 2024-04-26T21:25:53.425 INFO:tasks.workunit.client.1.smithi120.stdout:0/550: truncate d0/d3/f41 697947 0 2024-04-26T21:25:53.427 INFO:tasks.workunit.client.0.smithi084.stdout:4/182: rename d5/d10/d15/c3d to d5/d7/c43 0 2024-04-26T21:25:53.428 INFO:tasks.workunit.client.0.smithi084.stdout:6/266: rename d3/de/d1a/d2f to d3/de/d1a/d2f/d4c/d58/d59 22 2024-04-26T21:25:53.430 INFO:tasks.workunit.client.1.smithi120.stdout:0/551: dread - d0/d3/d13/d64/fb9 zero size 2024-04-26T21:25:53.433 INFO:tasks.workunit.client.0.smithi084.stdout:7/235: fdatasync d6/d9/d12/f33 0 2024-04-26T21:25:53.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:53 smithi120 ceph-mon[32741]: pgmap v41: 65 pgs: 65 active+clean; 1.5 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 38 MiB/s rd, 210 MiB/s wr, 382 op/s 2024-04-26T21:25:53.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:53 smithi120 ceph-mon[32741]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:25:53.434 INFO:tasks.workunit.client.1.smithi120.stdout:0/552: chown d0/d3/dc/dd/d1b/d24/d7d/cb3 17368367 1 2024-04-26T21:25:53.434 INFO:tasks.workunit.client.0.smithi084.stdout:0/217: getdents de 0 2024-04-26T21:25:53.439 INFO:tasks.workunit.client.0.smithi084.stdout:1/256: creat d2/d1b/f55 x:0 0 0 2024-04-26T21:25:53.440 INFO:tasks.workunit.client.0.smithi084.stdout:6/267: mknod d3/de/d15/df/c5a 0 2024-04-26T21:25:53.442 INFO:tasks.workunit.client.0.smithi084.stdout:1/257: readlink d2/d1b/l31 0 2024-04-26T21:25:53.442 INFO:tasks.workunit.client.0.smithi084.stdout:0/218: rmdir de 39 2024-04-26T21:25:53.442 INFO:tasks.workunit.client.1.smithi120.stdout:9/466: dwrite d0/d14/d2d/d4b/d85/f88 [0,4194304] 0 2024-04-26T21:25:53.443 INFO:tasks.workunit.client.0.smithi084.stdout:7/236: creat d6/d1c/f4e x:0 0 0 2024-04-26T21:25:53.452 INFO:tasks.workunit.client.0.smithi084.stdout:5/229: dread d0/d17/f20 [0,4194304] 0 2024-04-26T21:25:53.452 INFO:tasks.workunit.client.0.smithi084.stdout:6/268: rename d3/de/d1a/f32 to d3/d18/f5b 0 2024-04-26T21:25:53.452 INFO:tasks.workunit.client.0.smithi084.stdout:7/237: mkdir d6/d26/d40/d4f 0 2024-04-26T21:25:53.454 INFO:tasks.workunit.client.0.smithi084.stdout:0/219: mknod de/d2b/c48 0 2024-04-26T21:25:53.458 INFO:tasks.workunit.client.0.smithi084.stdout:1/258: truncate d2/f22 2327966 0 2024-04-26T21:25:53.459 INFO:tasks.workunit.client.0.smithi084.stdout:6/269: mkdir d3/de/d41/d5c 0 2024-04-26T21:25:53.459 INFO:tasks.workunit.client.1.smithi120.stdout:1/437: link d6/l3f d6/d7/d1d/d5d/d67/dd/d35/l96 0 2024-04-26T21:25:53.460 INFO:tasks.workunit.client.1.smithi120.stdout:5/535: mkdir d2/d30/d93/dbf 0 2024-04-26T21:25:53.462 INFO:tasks.workunit.client.0.smithi084.stdout:5/230: read d0/f11 [292858,82667] 0 2024-04-26T21:25:53.462 INFO:tasks.workunit.client.0.smithi084.stdout:0/220: fsync de/f12 0 2024-04-26T21:25:53.462 INFO:tasks.workunit.client.0.smithi084.stdout:7/238: symlink d6/dc/l50 0 2024-04-26T21:25:53.464 INFO:tasks.workunit.client.0.smithi084.stdout:3/290: dwrite d1/d2c/f3c [0,4194304] 0 2024-04-26T21:25:53.465 INFO:tasks.workunit.client.0.smithi084.stdout:6/270: chown d3/de/d1a/c34 1768497388 1 2024-04-26T21:25:53.470 INFO:tasks.workunit.client.1.smithi120.stdout:0/553: mknod d0/d3/cc0 0 2024-04-26T21:25:53.471 INFO:tasks.workunit.client.0.smithi084.stdout:2/345: truncate d6/d7/d3d/d15/d1f/d22/f24 926037 0 2024-04-26T21:25:53.472 INFO:tasks.workunit.client.0.smithi084.stdout:5/231: dread - d0/f22 zero size 2024-04-26T21:25:53.472 INFO:tasks.workunit.client.0.smithi084.stdout:2/346: write d6/d7/f3f [435921,19390] 0 2024-04-26T21:25:53.474 INFO:tasks.workunit.client.1.smithi120.stdout:7/470: dread d7/d19/f44 [0,4194304] 0 2024-04-26T21:25:53.475 INFO:tasks.workunit.client.1.smithi120.stdout:5/536: mknod d2/d1b/d89/d6b/cc0 0 2024-04-26T21:25:53.476 INFO:tasks.workunit.client.1.smithi120.stdout:0/554: stat d0/d3/dc/dd/d1b/daa 0 2024-04-26T21:25:53.476 INFO:tasks.workunit.client.0.smithi084.stdout:7/239: mkdir d6/d1c/d51 0 2024-04-26T21:25:53.478 INFO:tasks.workunit.client.0.smithi084.stdout:5/232: dread - d0/dc/df/d2a/f3e zero size 2024-04-26T21:25:53.484 INFO:tasks.workunit.client.1.smithi120.stdout:2/502: dread d4/d1b/d25/f32 [0,4194304] 0 2024-04-26T21:25:53.486 INFO:tasks.workunit.client.0.smithi084.stdout:6/271: fsync d3/d18/f5b 0 2024-04-26T21:25:53.490 INFO:tasks.workunit.client.0.smithi084.stdout:6/272: chown d3/de/d1a/d43/f48 0 1 2024-04-26T21:25:53.491 INFO:tasks.workunit.client.0.smithi084.stdout:5/233: rename d0/f11 to d0/dc/df/f44 0 2024-04-26T21:25:53.491 INFO:tasks.workunit.client.0.smithi084.stdout:7/240: dread d6/dc/f3b [0,4194304] 0 2024-04-26T21:25:53.491 INFO:tasks.workunit.client.0.smithi084.stdout:1/259: creat d2/f56 x:0 0 0 2024-04-26T21:25:53.496 INFO:tasks.workunit.client.0.smithi084.stdout:4/183: dread d5/d25/d35/f3a [0,4194304] 0 2024-04-26T21:25:53.499 INFO:tasks.workunit.client.0.smithi084.stdout:1/260: stat d2/d9/d15/d28/d47 0 2024-04-26T21:25:53.500 INFO:tasks.workunit.client.1.smithi120.stdout:8/466: rename d5/d6/d75/c81 to d5/d6/d34/c9e 0 2024-04-26T21:25:53.500 INFO:tasks.workunit.client.0.smithi084.stdout:7/241: getdents d6/d1c/d51 0 2024-04-26T21:25:53.501 INFO:tasks.workunit.client.0.smithi084.stdout:3/291: dwrite d1/d2c/d2f/f54 [0,4194304] 0 2024-04-26T21:25:53.503 INFO:tasks.workunit.client.0.smithi084.stdout:6/273: getdents d3/de/d41/d5c 0 2024-04-26T21:25:53.505 INFO:tasks.workunit.client.0.smithi084.stdout:7/242: chown d6/d26/d40/d4f 338195208 1 2024-04-26T21:25:53.506 INFO:tasks.workunit.client.0.smithi084.stdout:1/261: readlink d2/l8 0 2024-04-26T21:25:53.507 INFO:tasks.workunit.client.0.smithi084.stdout:4/184: write d5/d10/d15/f40 [1015591,110612] 0 2024-04-26T21:25:53.507 INFO:tasks.workunit.client.0.smithi084.stdout:4/185: stat d5 0 2024-04-26T21:25:53.511 INFO:tasks.workunit.client.0.smithi084.stdout:5/234: write d0/dc/f1c [357340,63807] 0 2024-04-26T21:25:53.511 INFO:tasks.workunit.client.0.smithi084.stdout:6/274: mkdir d3/de/d5d 0 2024-04-26T21:25:53.515 INFO:tasks.workunit.client.1.smithi120.stdout:7/471: creat d7/d10/d12/d1f/d7d/d8b/fa3 x:0 0 0 2024-04-26T21:25:53.516 INFO:tasks.workunit.client.0.smithi084.stdout:1/262: symlink d2/d9/d17/d2a/d2c/l57 0 2024-04-26T21:25:53.516 INFO:tasks.workunit.client.0.smithi084.stdout:7/243: symlink d6/d26/d40/d41/l52 0 2024-04-26T21:25:53.520 INFO:tasks.workunit.client.0.smithi084.stdout:5/235: mkdir d0/dc/df/d31/d45 0 2024-04-26T21:25:53.521 INFO:tasks.workunit.client.1.smithi120.stdout:4/447: getdents d10/d6b 0 2024-04-26T21:25:53.521 INFO:tasks.workunit.client.1.smithi120.stdout:4/448: readlink d10/l70 0 2024-04-26T21:25:53.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.519+0000 7f49c9e00700 1 -- 172.21.15.84:0/2117136445 --> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f49c4071b30 con 0x7f49a806be00 2024-04-26T21:25:53.523 INFO:tasks.workunit.client.0.smithi084.stdout:2/347: read d6/d7/d3d/f1e [2743728,43439] 0 2024-04-26T21:25:53.523 INFO:tasks.workunit.client.0.smithi084.stdout:9/196: sync 2024-04-26T21:25:53.525 INFO:tasks.workunit.client.0.smithi084.stdout:1/263: creat d2/d9/d15/f58 x:0 0 0 2024-04-26T21:25:53.525 INFO:tasks.workunit.client.0.smithi084.stdout:7/244: dread d6/dc/f3b [0,4194304] 0 2024-04-26T21:25:53.527 INFO:tasks.workunit.client.0.smithi084.stdout:6/275: getdents d3/de/d15/d23 0 2024-04-26T21:25:53.533 INFO:tasks.workunit.client.0.smithi084.stdout:7/245: dread - d6/d9/d12/f3e zero size 2024-04-26T21:25:53.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.533+0000 7f49baa00700 1 -- 172.21.15.84:0/2117136445 <== mgr.14662 v2:172.21.15.120:6828/3773295163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f49c4071b30 con 0x7f49a806be00 2024-04-26T21:25:53.537 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:25:53.537 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 starting - - - - 2024-04-26T21:25:53.537 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (11m) 63s ago 11m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 a111b0ee8187 2024-04-26T21:25:53.537 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (10m) 65s ago 10m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 66f4d21263a1 2024-04-26T21:25:53.537 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 starting - - - - 2024-04-26T21:25:53.537 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (4m) 63s ago 4m 85.8M - 17.2.7-907-g2be3efa9 1c5834633715 485d7884e1d5 2024-04-26T21:25:53.538 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (4m) 63s ago 4m 12.0M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:25:53.538 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (4m) 65s ago 4m 88.6M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:25:53.538 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (4m) 65s ago 4m 11.9M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:25:53.538 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 starting - - - - 2024-04-26T21:25:53.538 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283 running (92s) 65s ago 10m 488M - 19.0.0-3306-gbc612ffb 55dc54019ad8 1a0fbef33353 2024-04-26T21:25:53.538 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (13m) 63s ago 13m 50.7M 2048M 17.2.7-907-g2be3efa9 1c5834633715 24cc2d798ea7 2024-04-26T21:25:53.538 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (10m) 65s ago 10m 38.9M 2048M 17.2.7-907-g2be3efa9 1c5834633715 72c786fd622b 2024-04-26T21:25:53.538 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 starting - - - - 2024-04-26T21:25:53.538 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 starting - - - - 2024-04-26T21:25:53.539 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (9m) 63s ago 9m 75.6M 1557M 17.2.7-907-g2be3efa9 1c5834633715 3a2e74d7e51a 2024-04-26T21:25:53.539 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (8m) 63s ago 8m 79.3M 1557M 17.2.7-907-g2be3efa9 1c5834633715 d283a0a93213 2024-04-26T21:25:53.539 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (8m) 63s ago 8m 62.5M 1557M 17.2.7-907-g2be3efa9 1c5834633715 5899468fc5c8 2024-04-26T21:25:53.539 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (7m) 65s ago 7m 74.6M 2581M 17.2.7-907-g2be3efa9 1c5834633715 b8a14c87d730 2024-04-26T21:25:53.539 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (6m) 65s ago 6m 70.1M 2581M 17.2.7-907-g2be3efa9 1c5834633715 4d294df735a3 2024-04-26T21:25:53.539 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (6m) 65s ago 6m 67.5M 2581M 17.2.7-907-g2be3efa9 1c5834633715 9b60997971a8 2024-04-26T21:25:53.539 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 starting - - - - 2024-04-26T21:25:53.540 INFO:tasks.workunit.client.0.smithi084.stdout:3/292: dwrite d1/d2c/d2f/d31/f37 [0,4194304] 0 2024-04-26T21:25:53.540 INFO:tasks.workunit.client.0.smithi084.stdout:2/348: symlink d6/d7/d3d/d15/d1f/d39/l7c 0 2024-04-26T21:25:53.540 INFO:tasks.workunit.client.0.smithi084.stdout:6/276: dread d3/de/d1a/d43/f2d [0,4194304] 0 2024-04-26T21:25:53.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.539+0000 7f49c9e00700 1 -- 172.21.15.84:0/2117136445 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f49a806be00 msgr2=0x7f49a806e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:53.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.539+0000 7f49c9e00700 1 --2- 172.21.15.84:0/2117136445 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f49a806be00 0x7f49a806e2b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f49b0009040 tx=0x7f49b0009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:53.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.539+0000 7f49c9e00700 1 -- 172.21.15.84:0/2117136445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49c40fcf10 msgr2=0x7f49c4114150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:53.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.539+0000 7f49c9e00700 1 --2- 172.21.15.84:0/2117136445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49c40fcf10 0x7f49c4114150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49b400eb40 tx=0x7f49b400b040 comp rx=0 tx=0).stop 2024-04-26T21:25:53.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.539+0000 7f49c9e00700 1 -- 172.21.15.84:0/2117136445 shutdown_connections 2024-04-26T21:25:53.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.539+0000 7f49c9e00700 1 --2- 172.21.15.84:0/2117136445 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f49a806be00 0x7f49a806e2b0 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f49b0009040 tx=0x7f49b0009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:53.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.539+0000 7f49c9e00700 1 --2- 172.21.15.84:0/2117136445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49c40fcf10 0x7f49c4114150 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49b400eb40 tx=0x7f49b400b040 comp rx=0 tx=0).stop 2024-04-26T21:25:53.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.539+0000 7f49c9e00700 1 --2- 172.21.15.84:0/2117136445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c4114690 0x7f49c41154e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:53.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.539+0000 7f49c9e00700 1 -- 172.21.15.84:0/2117136445 >> 172.21.15.84:0/2117136445 conn(0x7f49c40f8560 msgr2=0x7f49c40f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:53.543 INFO:tasks.workunit.client.0.smithi084.stdout:5/236: rename d0/fa to d0/dc/df/d2a/f46 0 2024-04-26T21:25:53.544 INFO:tasks.workunit.client.1.smithi120.stdout:5/537: mknod d2/d82/d96/db3/cc1 0 2024-04-26T21:25:53.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.542+0000 7f49c9e00700 1 -- 172.21.15.84:0/2117136445 shutdown_connections 2024-04-26T21:25:53.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.543+0000 7f49c9e00700 1 -- 172.21.15.84:0/2117136445 wait complete. 2024-04-26T21:25:53.546 INFO:tasks.workunit.client.0.smithi084.stdout:9/197: mkdir da/de/d16/d25/d41/d43/d48 0 2024-04-26T21:25:53.546 INFO:tasks.workunit.client.0.smithi084.stdout:7/246: creat d6/d9/d12/d19/d20/d38/f53 x:0 0 0 2024-04-26T21:25:53.551 INFO:tasks.workunit.client.0.smithi084.stdout:9/198: chown da/de/d1e/l20 0 1 2024-04-26T21:25:53.553 INFO:tasks.workunit.client.1.smithi120.stdout:0/555: mkdir d0/d3/d13/dc1 0 2024-04-26T21:25:53.554 INFO:tasks.workunit.client.1.smithi120.stdout:7/472: write d7/d10/d12/d1f/d28/d4c/d6c/f71 [1001838,77244] 0 2024-04-26T21:25:53.556 INFO:tasks.workunit.client.0.smithi084.stdout:9/199: write da/f46 [236131,76553] 0 2024-04-26T21:25:53.557 INFO:tasks.workunit.client.0.smithi084.stdout:5/237: symlink d0/dc/df/l47 0 2024-04-26T21:25:53.565 INFO:tasks.workunit.client.0.smithi084.stdout:7/247: unlink d6/d9/d12/d19/d20/d38/f43 0 2024-04-26T21:25:53.567 INFO:tasks.workunit.client.0.smithi084.stdout:9/200: write da/de/d1e/f2f [691581,90100] 0 2024-04-26T21:25:53.569 INFO:tasks.workunit.client.0.smithi084.stdout:0/221: dread de/d1c/f1d [0,4194304] 0 2024-04-26T21:25:53.570 INFO:tasks.workunit.client.0.smithi084.stdout:3/293: creat d1/d2c/d2f/d31/f63 x:0 0 0 2024-04-26T21:25:53.572 INFO:tasks.workunit.client.0.smithi084.stdout:5/238: mkdir d0/dc/d48 0 2024-04-26T21:25:53.574 INFO:tasks.workunit.client.1.smithi120.stdout:3/449: sync 2024-04-26T21:25:53.579 INFO:tasks.workunit.client.0.smithi084.stdout:0/222: dread - de/d2b/f3a zero size 2024-04-26T21:25:53.581 INFO:tasks.workunit.client.0.smithi084.stdout:8/296: sync 2024-04-26T21:25:53.582 INFO:tasks.workunit.client.0.smithi084.stdout:9/201: creat da/de/d1e/f49 x:0 0 0 2024-04-26T21:25:53.586 INFO:tasks.workunit.client.0.smithi084.stdout:7/248: rename d6/d9/d12/d19/d20/d38/c46 to d6/d9/d12/d19/c54 0 2024-04-26T21:25:53.587 INFO:tasks.workunit.client.0.smithi084.stdout:1/264: dread d2/d9/d17/f18 [0,4194304] 0 2024-04-26T21:25:53.593 INFO:tasks.workunit.client.0.smithi084.stdout:0/223: stat de/d20/c34 0 2024-04-26T21:25:53.594 INFO:tasks.workunit.client.0.smithi084.stdout:3/294: write d1/d2c/d2f/d31/d3b/f44 [1107176,39090] 0 2024-04-26T21:25:53.594 INFO:tasks.workunit.client.0.smithi084.stdout:8/297: creat d4/d7/d53/f57 x:0 0 0 2024-04-26T21:25:53.598 INFO:tasks.workunit.client.0.smithi084.stdout:6/277: dwrite d3/de/d41/f52 [0,4194304] 0 2024-04-26T21:25:53.599 INFO:tasks.workunit.client.0.smithi084.stdout:7/249: creat d6/dc/f55 x:0 0 0 2024-04-26T21:25:53.602 INFO:tasks.workunit.client.0.smithi084.stdout:9/202: mkdir da/de/d16/d25/d41/d43/d4a 0 2024-04-26T21:25:53.605 INFO:tasks.workunit.client.0.smithi084.stdout:0/224: creat de/d1c/f49 x:0 0 0 2024-04-26T21:25:53.608 INFO:tasks.workunit.client.0.smithi084.stdout:6/278: fdatasync d3/de/d15/df/f4b 0 2024-04-26T21:25:53.609 INFO:tasks.workunit.client.0.smithi084.stdout:4/186: dread d5/d7/f16 [0,4194304] 0 2024-04-26T21:25:53.613 INFO:tasks.workunit.client.0.smithi084.stdout:1/265: symlink d2/d9/l59 0 2024-04-26T21:25:53.613 INFO:tasks.workunit.client.0.smithi084.stdout:5/239: dread d0/f16 [0,4194304] 0 2024-04-26T21:25:53.615 INFO:tasks.workunit.client.0.smithi084.stdout:6/279: dread - d3/de/d1a/d43/f48 zero size 2024-04-26T21:25:53.616 INFO:tasks.workunit.client.0.smithi084.stdout:6/280: chown d3/l53 140985069 1 2024-04-26T21:25:53.618 INFO:tasks.workunit.client.0.smithi084.stdout:9/203: dread da/f35 [0,4194304] 0 2024-04-26T21:25:53.621 INFO:tasks.workunit.client.0.smithi084.stdout:9/204: chown da/de/d16/d25/d41 1017 1 2024-04-26T21:25:53.625 INFO:tasks.workunit.client.0.smithi084.stdout:8/298: mknod d4/d6/db/d1e/d22/d39/d4a/c58 0 2024-04-26T21:25:53.629 INFO:tasks.workunit.client.0.smithi084.stdout:3/295: write d1/f1a [79507,78094] 0 2024-04-26T21:25:53.631 INFO:tasks.workunit.client.0.smithi084.stdout:0/225: rename de/f10 to de/d1c/f4a 0 2024-04-26T21:25:53.634 INFO:tasks.workunit.client.0.smithi084.stdout:1/266: dread d2/d9/d15/f25 [0,4194304] 0 2024-04-26T21:25:53.634 INFO:tasks.workunit.client.0.smithi084.stdout:2/349: dread d6/d7/f27 [0,4194304] 0 2024-04-26T21:25:53.634 INFO:tasks.workunit.client.0.smithi084.stdout:4/187: rmdir d5/d7/d17/d32 39 2024-04-26T21:25:53.635 INFO:tasks.workunit.client.0.smithi084.stdout:6/281: symlink d3/de/d1a/d2f/d4c/d58/l5e 0 2024-04-26T21:25:53.639 INFO:tasks.workunit.client.0.smithi084.stdout:9/205: rename da/f17 to da/de/d16/d40/f4b 0 2024-04-26T21:25:53.641 INFO:tasks.workunit.client.0.smithi084.stdout:5/240: mkdir d0/d49 0 2024-04-26T21:25:53.649 INFO:tasks.workunit.client.0.smithi084.stdout:5/241: chown d0/dc/df/l13 782093 1 2024-04-26T21:25:53.649 INFO:tasks.workunit.client.0.smithi084.stdout:2/350: write d6/d7/d3d/f26 [2037171,75540] 0 2024-04-26T21:25:53.653 INFO:tasks.workunit.client.0.smithi084.stdout:9/206: symlink da/de/d16/d40/l4c 0 2024-04-26T21:25:53.653 INFO:tasks.workunit.client.0.smithi084.stdout:2/351: stat d6/d1b/f2c 0 2024-04-26T21:25:53.653 INFO:tasks.workunit.client.0.smithi084.stdout:4/188: truncate d5/f23 1413190 0 2024-04-26T21:25:53.653 INFO:tasks.workunit.client.0.smithi084.stdout:1/267: mkdir d2/d9/d15/d28/d5a 0 2024-04-26T21:25:53.653 INFO:tasks.workunit.client.0.smithi084.stdout:9/207: chown da/f35 59837 1 2024-04-26T21:25:53.654 INFO:tasks.workunit.client.0.smithi084.stdout:6/282: mkdir d3/de/d15/d5f 0 2024-04-26T21:25:53.658 INFO:tasks.workunit.client.0.smithi084.stdout:3/296: rename d1/f3 to d1/d2c/d2f/d31/d52/f64 0 2024-04-26T21:25:53.658 INFO:tasks.workunit.client.0.smithi084.stdout:0/226: symlink de/d20/l4b 0 2024-04-26T21:25:53.659 INFO:tasks.workunit.client.0.smithi084.stdout:9/208: write da/de/d16/d25/f3c [458595,130012] 0 2024-04-26T21:25:53.664 INFO:tasks.workunit.client.0.smithi084.stdout:3/297: mknod d1/d2c/d2f/d31/d52/c65 0 2024-04-26T21:25:53.668 INFO:tasks.workunit.client.0.smithi084.stdout:2/352: mknod d6/d7/d3d/c7d 0 2024-04-26T21:25:53.668 INFO:tasks.workunit.client.0.smithi084.stdout:7/250: dread d6/d9/f2e [0,4194304] 0 2024-04-26T21:25:53.670 INFO:tasks.workunit.client.0.smithi084.stdout:1/268: rename d2/f22 to d2/d9/d15/f5b 0 2024-04-26T21:25:53.670 INFO:tasks.workunit.client.1.smithi120.stdout:6/494: write d4/db/d10/d1a/d2b/f4c [423740,1401] 0 2024-04-26T21:25:53.672 INFO:tasks.workunit.client.0.smithi084.stdout:4/189: mknod d5/d7/d17/d32/c44 0 2024-04-26T21:25:53.672 INFO:tasks.workunit.client.0.smithi084.stdout:0/227: write de/f12 [51637,126894] 0 2024-04-26T21:25:53.673 INFO:tasks.workunit.client.0.smithi084.stdout:5/242: dread d0/dc/df/f44 [0,4194304] 0 2024-04-26T21:25:53.673 INFO:tasks.workunit.client.0.smithi084.stdout:3/298: unlink d1/d2c/d2f/d31/d52/c65 0 2024-04-26T21:25:53.675 INFO:tasks.workunit.client.0.smithi084.stdout:1/269: chown d2/d9/d17 54 1 2024-04-26T21:25:53.677 INFO:tasks.workunit.client.1.smithi120.stdout:9/467: getdents d0/d14/d2d/d4b 0 2024-04-26T21:25:53.679 INFO:tasks.workunit.client.0.smithi084.stdout:2/353: creat d6/d1b/f7e x:0 0 0 2024-04-26T21:25:53.679 INFO:tasks.workunit.client.0.smithi084.stdout:7/251: write d6/d9/ff [541864,73495] 0 2024-04-26T21:25:53.680 INFO:tasks.workunit.client.0.smithi084.stdout:6/283: rename d3/de/d1a/d43/f33 to d3/de/d15/d40/f60 0 2024-04-26T21:25:53.684 INFO:tasks.workunit.client.0.smithi084.stdout:4/190: unlink d5/d7/d17/d32/c44 0 2024-04-26T21:25:53.686 INFO:tasks.workunit.client.0.smithi084.stdout:1/270: read d2/d9/d17/f36 [15655,73670] 0 2024-04-26T21:25:53.691 INFO:tasks.workunit.client.0.smithi084.stdout:5/243: rmdir d0/dc/df/d2a 39 2024-04-26T21:25:53.691 INFO:tasks.workunit.client.1.smithi120.stdout:2/503: getdents d4/d1b/d2e/da0 0 2024-04-26T21:25:53.695 INFO:tasks.workunit.client.1.smithi120.stdout:2/504: fdatasync d4/d1b/d2e/d50/d14/d15/f9b 0 2024-04-26T21:25:53.695 INFO:tasks.workunit.client.0.smithi084.stdout:5/244: fdatasync d0/fe 0 2024-04-26T21:25:53.695 INFO:tasks.workunit.client.0.smithi084.stdout:4/191: truncate d5/d7/d17/f27 4895443 0 2024-04-26T21:25:53.697 INFO:tasks.workunit.client.0.smithi084.stdout:5/245: chown d0/dc/d48 7 1 2024-04-26T21:25:53.698 INFO:tasks.workunit.client.0.smithi084.stdout:6/284: getdents d3/de/d5d 0 2024-04-26T21:25:53.700 INFO:tasks.workunit.client.0.smithi084.stdout:8/299: dwrite d4/d6/db/d1e/d22/d2f/f2c [0,4194304] 0 2024-04-26T21:25:53.701 INFO:tasks.workunit.client.0.smithi084.stdout:1/271: fsync d2/d9/d15/d28/d47/f4f 0 2024-04-26T21:25:53.706 INFO:tasks.workunit.client.0.smithi084.stdout:3/299: getdents d1/d24 0 2024-04-26T21:25:53.714 INFO:tasks.workunit.client.0.smithi084.stdout:9/209: dread da/de/d16/d40/f4b [0,4194304] 0 2024-04-26T21:25:53.716 INFO:tasks.workunit.client.0.smithi084.stdout:5/246: chown d0/dc/df/d2a 0 1 2024-04-26T21:25:53.716 INFO:tasks.workunit.client.0.smithi084.stdout:6/285: rename d3/de/d15/df/f21 to d3/de/f61 0 2024-04-26T21:25:53.719 INFO:tasks.workunit.client.0.smithi084.stdout:5/247: fdatasync d0/f32 0 2024-04-26T21:25:53.725 INFO:tasks.workunit.client.0.smithi084.stdout:4/192: getdents d5/d10/d15/d21/d29 0 2024-04-26T21:25:53.728 INFO:tasks.workunit.client.1.smithi120.stdout:7/473: mknod d7/d10/d12/d1a/d50/ca4 0 2024-04-26T21:25:53.728 INFO:tasks.workunit.client.0.smithi084.stdout:7/252: dwrite d6/dc/f27 [0,4194304] 0 2024-04-26T21:25:53.730 INFO:tasks.workunit.client.0.smithi084.stdout:3/300: creat d1/d2c/d2f/d31/d55/f66 x:0 0 0 2024-04-26T21:25:53.734 INFO:tasks.workunit.client.1.smithi120.stdout:3/450: creat dd/de/df/d12/d48/f99 x:0 0 0 2024-04-26T21:25:53.737 INFO:tasks.workunit.client.0.smithi084.stdout:5/248: dread d0/f2c [0,4194304] 0 2024-04-26T21:25:53.739 INFO:tasks.workunit.client.0.smithi084.stdout:4/193: fsync d5/f23 0 2024-04-26T21:25:53.743 INFO:tasks.workunit.client.1.smithi120.stdout:4/449: write d10/d12/f27 [242022,58635] 0 2024-04-26T21:25:53.745 INFO:tasks.workunit.client.0.smithi084.stdout:6/286: truncate d3/de/d15/df/f4b 1094256 0 2024-04-26T21:25:53.746 INFO:tasks.workunit.client.1.smithi120.stdout:4/450: dread - d10/d28/f56 zero size 2024-04-26T21:25:53.749 INFO:tasks.workunit.client.1.smithi120.stdout:4/451: write d10/d12/f57 [4657580,66813] 0 2024-04-26T21:25:53.751 INFO:tasks.workunit.client.0.smithi084.stdout:3/301: rename d1/d24/d27/f32 to d1/d2c/f67 0 2024-04-26T21:25:53.757 INFO:tasks.workunit.client.0.smithi084.stdout:7/253: creat d6/d26/d40/d4f/f56 x:0 0 0 2024-04-26T21:25:53.760 INFO:tasks.workunit.client.1.smithi120.stdout:3/451: dwrite dd/de/d18/d37/f4e [0,4194304] 0 2024-04-26T21:25:53.766 INFO:tasks.workunit.client.0.smithi084.stdout:2/354: dwrite d6/d7/d3d/d15/d1f/d22/d2a/f44 [0,4194304] 0 2024-04-26T21:25:53.767 INFO:tasks.workunit.client.0.smithi084.stdout:6/287: write d3/d18/f38 [1596632,96931] 0 2024-04-26T21:25:53.769 INFO:tasks.workunit.client.0.smithi084.stdout:7/254: dread - d6/d9/d12/d19/d20/d38/f53 zero size 2024-04-26T21:25:53.770 INFO:tasks.workunit.client.0.smithi084.stdout:4/194: mkdir d5/d7/d17/d45 0 2024-04-26T21:25:53.777 INFO:tasks.workunit.client.0.smithi084.stdout:2/355: chown d6/d7/f27 1 1 2024-04-26T21:25:53.777 INFO:tasks.workunit.client.0.smithi084.stdout:1/272: dwrite d2/d9/d17/f2b [4194304,4194304] 0 2024-04-26T21:25:53.780 INFO:tasks.workunit.client.0.smithi084.stdout:9/210: dwrite da/de/d16/f1c [4194304,4194304] 0 2024-04-26T21:25:53.788 INFO:tasks.workunit.client.0.smithi084.stdout:2/356: write d6/d7/d3d/d15/d1f/d39/d20/f76 [770054,43987] 0 2024-04-26T21:25:53.788 INFO:tasks.workunit.client.0.smithi084.stdout:4/195: mkdir d5/d7/d17/d32/d46 0 2024-04-26T21:25:53.788 INFO:tasks.workunit.client.0.smithi084.stdout:1/273: write d2/d9/d15/f58 [768521,25062] 0 2024-04-26T21:25:53.789 INFO:tasks.workunit.client.0.smithi084.stdout:1/274: chown d2/d1b/f55 68740 1 2024-04-26T21:25:53.790 INFO:tasks.workunit.client.0.smithi084.stdout:6/288: creat d3/de/d15/df/f62 x:0 0 0 2024-04-26T21:25:53.797 INFO:tasks.workunit.client.0.smithi084.stdout:2/357: chown d6/d7/d3d/d15/d1f/d39/f48 80 1 2024-04-26T21:25:53.799 INFO:tasks.workunit.client.0.smithi084.stdout:6/289: readlink d3/de/d1a/d2f/d4c/d58/l5e 0 2024-04-26T21:25:53.799 INFO:tasks.workunit.client.0.smithi084.stdout:0/228: dread de/d20/f29 [0,4194304] 0 2024-04-26T21:25:53.800 INFO:tasks.workunit.client.0.smithi084.stdout:9/211: readlink da/de/d16/d25/l2e 0 2024-04-26T21:25:53.805 INFO:tasks.workunit.client.1.smithi120.stdout:1/438: getdents d6/d7/d1d/d5d/d67/dd/d35 0 2024-04-26T21:25:53.806 INFO:tasks.workunit.client.1.smithi120.stdout:6/495: mknod d4/db/d10/d22/d6c/ca4 0 2024-04-26T21:25:53.812 INFO:tasks.workunit.client.1.smithi120.stdout:9/468: chown d0/dd/d3a/d5c/c78 1 1 2024-04-26T21:25:53.813 INFO:tasks.workunit.client.1.smithi120.stdout:9/469: chown d0/dd/d3a/d5c 111035 1 2024-04-26T21:25:53.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.812+0000 7f84ff400700 1 -- 172.21.15.84:0/504783107 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84f8070940 msgr2=0x7f84f8070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:53.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.812+0000 7f84ff400700 1 --2- 172.21.15.84:0/504783107 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84f8070940 0x7f84f8070db0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f84e4004940 tx=0x7f84e4009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:53.815 INFO:tasks.workunit.client.1.smithi120.stdout:9/470: readlink d0/dd/d3a/l73 0 2024-04-26T21:25:53.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.813+0000 7f84ff400700 1 -- 172.21.15.84:0/504783107 shutdown_connections 2024-04-26T21:25:53.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.813+0000 7f84ff400700 1 --2- 172.21.15.84:0/504783107 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84f8070940 0x7f84f8070db0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:53.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.813+0000 7f84ff400700 1 --2- 172.21.15.84:0/504783107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84f8071ef0 0x7f84f8070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:53.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.813+0000 7f84ff400700 1 -- 172.21.15.84:0/504783107 >> 172.21.15.84:0/504783107 conn(0x7f84f80f8560 msgr2=0x7f84f80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:53.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.813+0000 7f84ff400700 1 -- 172.21.15.84:0/504783107 shutdown_connections 2024-04-26T21:25:53.816 INFO:tasks.workunit.client.0.smithi084.stdout:9/212: write da/f34 [994521,56676] 0 2024-04-26T21:25:53.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.813+0000 7f84ff400700 1 -- 172.21.15.84:0/504783107 wait complete. 2024-04-26T21:25:53.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.814+0000 7f84ff400700 1 Processor -- start 2024-04-26T21:25:53.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.815+0000 7f84ff400700 1 -- start start 2024-04-26T21:25:53.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.816+0000 7f84ff400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84f8070940 0x7f84f81075e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:53.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.818+0000 7f84ff400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84f8071ef0 0x7f84f8107b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:53.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.818+0000 7f84ff400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f81092b0 con 0x7f84f8070940 2024-04-26T21:25:53.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.818+0000 7f84ff400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f8108060 con 0x7f84f8071ef0 2024-04-26T21:25:53.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.818+0000 7f84fca00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84f8070940 0x7f84f81075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:53.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.818+0000 7f84f7e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84f8071ef0 0x7f84f8107b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:53.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.818+0000 7f84f7e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84f8071ef0 0x7f84f8107b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:54944/0 (socket says 172.21.15.84:54944) 2024-04-26T21:25:53.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.818+0000 7f84f7e00700 1 -- 172.21.15.84:0/3465644079 learned_addr learned my addr 172.21.15.84:0/3465644079 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:25:53.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.818+0000 7f84f7e00700 1 -- 172.21.15.84:0/3465644079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84f8070940 msgr2=0x7f84f81075e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:53.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.818+0000 7f84f7e00700 1 --2- 172.21.15.84:0/3465644079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84f8070940 0x7f84f81075e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:53.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.818+0000 7f84f7e00700 1 -- 172.21.15.84:0/3465644079 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e4005040 con 0x7f84f8071ef0 2024-04-26T21:25:53.823 INFO:tasks.workunit.client.0.smithi084.stdout:2/358: creat d6/d7/d3d/d15/f7f x:0 0 0 2024-04-26T21:25:53.823 INFO:tasks.workunit.client.0.smithi084.stdout:5/249: getdents d0/dc/df 0 2024-04-26T21:25:53.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.823+0000 7f84f7e00700 1 --2- 172.21.15.84:0/3465644079 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84f8071ef0 0x7f84f8107b20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f84e4009150 tx=0x7f84e4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:53.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.824+0000 7f84f4c00700 1 -- 172.21.15.84:0/3465644079 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84e400e040 con 0x7f84f8071ef0 2024-04-26T21:25:53.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.825+0000 7f84ff400700 1 -- 172.21.15.84:0/3465644079 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f81082e0 con 0x7f84f8071ef0 2024-04-26T21:25:53.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.825+0000 7f84f4c00700 1 -- 172.21.15.84:0/3465644079 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f84e400bbf0 con 0x7f84f8071ef0 2024-04-26T21:25:53.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.825+0000 7f84ff400700 1 -- 172.21.15.84:0/3465644079 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f81226b0 con 0x7f84f8071ef0 2024-04-26T21:25:53.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.826+0000 7f84f4c00700 1 -- 172.21.15.84:0/3465644079 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84e401c630 con 0x7f84f8071ef0 2024-04-26T21:25:53.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.827+0000 7f84ff400700 1 -- 172.21.15.84:0/3465644079 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d80052e0 con 0x7f84f8071ef0 2024-04-26T21:25:53.830 INFO:tasks.workunit.client.0.smithi084.stdout:8/300: dread d4/d6/db/d1e/d22/d2f/fd [4194304,4194304] 0 2024-04-26T21:25:53.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.831+0000 7f84f4c00700 1 -- 172.21.15.84:0/3465644079 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f84e400bd60 con 0x7f84f8071ef0 2024-04-26T21:25:53.833 INFO:tasks.workunit.client.0.smithi084.stdout:9/213: fdatasync da/de/f3d 0 2024-04-26T21:25:53.835 INFO:tasks.workunit.client.0.smithi084.stdout:1/275: creat d2/d54/f5c x:0 0 0 2024-04-26T21:25:53.842 INFO:tasks.workunit.client.0.smithi084.stdout:2/359: mknod d6/d1b/c80 0 2024-04-26T21:25:53.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.835+0000 7f84f4c00700 1 --2- 172.21.15.84:0/3465644079 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f84e006be80 0x7f84e006e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:53.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.835+0000 7f84f4c00700 1 -- 172.21.15.84:0/3465644079 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f84e408c290 con 0x7f84f8071ef0 2024-04-26T21:25:53.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.835+0000 7f84fca00700 1 --2- 172.21.15.84:0/3465644079 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f84e006be80 0x7f84e006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:53.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.836+0000 7f84fca00700 1 --2- 172.21.15.84:0/3465644079 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f84e006be80 0x7f84e006e330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f84f8108ea0 tx=0x7f84ec0091a0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:53.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:53.838+0000 7f84f4c00700 1 -- 172.21.15.84:0/3465644079 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f84e4055880 con 0x7f84f8071ef0 2024-04-26T21:25:53.844 INFO:tasks.workunit.client.0.smithi084.stdout:3/302: rename d1/d2c/d2f/l5f to d1/d2c/d2f/d31/l68 0 2024-04-26T21:25:53.844 INFO:tasks.workunit.client.1.smithi120.stdout:0/556: getdents d0/d3/d51/d70/d99 0 2024-04-26T21:25:53.844 INFO:tasks.workunit.client.1.smithi120.stdout:7/474: fsync d7/d19/f24 0 2024-04-26T21:25:53.850 INFO:tasks.workunit.client.1.smithi120.stdout:4/452: rename d10/d12/c39 to d10/d65/d7c/c9b 0 2024-04-26T21:25:53.850 INFO:tasks.workunit.client.0.smithi084.stdout:2/360: write d6/d7/d3d/d15/d1f/f34 [497917,25651] 0 2024-04-26T21:25:53.851 INFO:tasks.workunit.client.1.smithi120.stdout:4/453: dread - d10/d28/f49 zero size 2024-04-26T21:25:53.852 INFO:tasks.workunit.client.1.smithi120.stdout:4/454: write d10/d12/f40 [5697453,42906] 0 2024-04-26T21:25:53.854 INFO:tasks.workunit.client.0.smithi084.stdout:8/301: symlink d4/d6/db/d1e/d22/l59 0 2024-04-26T21:25:53.854 INFO:tasks.workunit.client.0.smithi084.stdout:1/276: rename d2/d1b/c3d to d2/d9/d17/d3a/c5d 0 2024-04-26T21:25:53.854 INFO:tasks.workunit.client.1.smithi120.stdout:3/452: fsync dd/de/d18/d24/f3c 0 2024-04-26T21:25:53.859 INFO:tasks.workunit.client.0.smithi084.stdout:3/303: mknod d1/d2c/d2f/c69 0 2024-04-26T21:25:53.860 INFO:tasks.workunit.client.1.smithi120.stdout:6/496: creat d4/db/d25/d6d/d97/d9d/fa5 x:0 0 0 2024-04-26T21:25:53.864 INFO:tasks.workunit.client.1.smithi120.stdout:8/467: getdents d5/d6/d11/d52/d27 0 2024-04-26T21:25:53.875 INFO:tasks.workunit.client.0.smithi084.stdout:3/304: creat d1/d2c/d2f/d31/d55/f6a x:0 0 0 2024-04-26T21:25:53.875 INFO:tasks.workunit.client.1.smithi120.stdout:3/453: dwrite dd/d40/f92 [0,4194304] 0 2024-04-26T21:25:53.876 INFO:tasks.workunit.client.0.smithi084.stdout:2/361: mkdir d6/d7/d3d/d79/d81 0 2024-04-26T21:25:53.880 INFO:tasks.workunit.client.1.smithi120.stdout:3/454: chown dd/de/df/d12/c98 419473 1 2024-04-26T21:25:53.884 INFO:tasks.workunit.client.1.smithi120.stdout:6/497: dwrite d4/db/d10/dd/d4e/d60/f7c [0,4194304] 0 2024-04-26T21:25:53.885 INFO:tasks.workunit.client.1.smithi120.stdout:9/471: dwrite d0/dd/f12 [0,4194304] 0 2024-04-26T21:25:53.888 INFO:tasks.workunit.client.0.smithi084.stdout:6/290: dwrite d3/d18/f2b [0,4194304] 0 2024-04-26T21:25:53.888 INFO:tasks.workunit.client.0.smithi084.stdout:8/302: link d4/d6/db/d1e/d22/l55 d4/d6/db/l5a 0 2024-04-26T21:25:53.891 INFO:tasks.workunit.client.1.smithi120.stdout:8/468: dwrite d5/f15 [0,4194304] 0 2024-04-26T21:25:53.894 INFO:tasks.workunit.client.0.smithi084.stdout:9/214: dwrite da/de/f11 [0,4194304] 0 2024-04-26T21:25:53.898 INFO:tasks.workunit.client.0.smithi084.stdout:8/303: write d4/d7/f14 [8936265,48636] 0 2024-04-26T21:25:53.898 INFO:tasks.workunit.client.1.smithi120.stdout:8/469: stat d5/d6/d11/d52/d27/d4f/d67/d85 0 2024-04-26T21:25:53.900 INFO:tasks.workunit.client.1.smithi120.stdout:3/455: rmdir dd/d40 39 2024-04-26T21:25:53.900 INFO:tasks.workunit.client.0.smithi084.stdout:2/362: mkdir d6/d7/d3d/d79/d81/d82 0 2024-04-26T21:25:53.901 INFO:tasks.workunit.client.0.smithi084.stdout:6/291: creat d3/de/f63 x:0 0 0 2024-04-26T21:25:53.904 INFO:tasks.workunit.client.0.smithi084.stdout:5/250: dwrite d0/f22 [0,4194304] 0 2024-04-26T21:25:53.904 INFO:tasks.workunit.client.1.smithi120.stdout:6/498: chown d4/db/d25/d6d/d97/ca0 10424057 1 2024-04-26T21:25:53.905 INFO:tasks.workunit.client.0.smithi084.stdout:7/255: dread d6/d9/fa [0,4194304] 0 2024-04-26T21:25:53.910 INFO:tasks.workunit.client.0.smithi084.stdout:4/196: dread d5/d7/d17/f27 [0,4194304] 0 2024-04-26T21:25:53.910 INFO:tasks.workunit.client.1.smithi120.stdout:7/475: creat d7/d10/d12/d1a/d33/fa5 x:0 0 0 2024-04-26T21:25:53.911 INFO:tasks.workunit.client.1.smithi120.stdout:7/476: readlink l4 0 2024-04-26T21:25:53.911 INFO:tasks.workunit.client.1.smithi120.stdout:9/472: dwrite d0/dd/d3a/d5c/f67 [0,4194304] 0 2024-04-26T21:25:53.915 INFO:tasks.workunit.client.0.smithi084.stdout:7/256: truncate d6/dc/f55 664301 0 2024-04-26T21:25:53.916 INFO:tasks.workunit.client.1.smithi120.stdout:3/456: symlink dd/de/df/d12/d48/l9a 0 2024-04-26T21:25:53.922 INFO:tasks.workunit.client.0.smithi084.stdout:6/292: read d3/de/d41/f44 [1057717,7558] 0 2024-04-26T21:25:53.922 INFO:tasks.workunit.client.0.smithi084.stdout:2/363: dread - d6/d7/d3d/d15/d1f/d39/d20/d45/f66 zero size 2024-04-26T21:25:53.924 INFO:tasks.workunit.client.0.smithi084.stdout:3/305: dwrite d1/d2c/d2f/f28 [0,4194304] 0 2024-04-26T21:25:53.927 INFO:tasks.workunit.client.1.smithi120.stdout:4/455: rename cf to d10/d6b/c9c 0 2024-04-26T21:25:53.930 INFO:tasks.workunit.client.0.smithi084.stdout:1/277: truncate d2/d19/f32 19577 0 2024-04-26T21:25:53.932 INFO:tasks.workunit.client.0.smithi084.stdout:6/293: write d3/de/d1a/d2f/f42 [480288,115248] 0 2024-04-26T21:25:53.933 INFO:tasks.workunit.client.1.smithi120.stdout:6/499: symlink d4/db/d10/la6 0 2024-04-26T21:25:53.933 INFO:tasks.workunit.client.1.smithi120.stdout:9/473: dread d0/dd/f56 [0,4194304] 0 2024-04-26T21:25:53.935 INFO:tasks.workunit.client.1.smithi120.stdout:6/500: chown d4/db/d10/d1a 41725 1 2024-04-26T21:25:53.935 INFO:tasks.workunit.client.0.smithi084.stdout:5/251: unlink d0/dc/df/d2a/f3e 0 2024-04-26T21:25:53.937 INFO:tasks.workunit.client.1.smithi120.stdout:9/474: truncate d0/d6/f36 1918643 0 2024-04-26T21:25:53.940 INFO:tasks.workunit.client.0.smithi084.stdout:7/257: creat d6/d9/d12/d19/d20/f57 x:0 0 0 2024-04-26T21:25:53.940 INFO:tasks.workunit.client.0.smithi084.stdout:4/197: fdatasync d5/d10/f18 0 2024-04-26T21:25:53.943 INFO:tasks.workunit.client.0.smithi084.stdout:6/294: fdatasync d3/de/d15/d23/f30 0 2024-04-26T21:25:53.945 INFO:tasks.workunit.client.0.smithi084.stdout:9/215: dread da/de/d1e/f31 [0,4194304] 0 2024-04-26T21:25:53.945 INFO:tasks.workunit.client.0.smithi084.stdout:1/278: rmdir d2/d9/d15/d28/d47 39 2024-04-26T21:25:53.948 INFO:tasks.workunit.client.0.smithi084.stdout:4/198: fdatasync d5/d10/d15/d21/d29/f3c 0 2024-04-26T21:25:53.950 INFO:tasks.workunit.client.0.smithi084.stdout:4/199: chown d5/d10 1562 1 2024-04-26T21:25:53.950 INFO:tasks.workunit.client.0.smithi084.stdout:6/295: write d3/fc [1834177,27887] 0 2024-04-26T21:25:53.951 INFO:tasks.workunit.client.0.smithi084.stdout:9/216: chown da/c2c 50157926 1 2024-04-26T21:25:53.953 INFO:tasks.workunit.client.0.smithi084.stdout:5/252: rename d0/dc/df/l47 to d0/dc/l4a 0 2024-04-26T21:25:53.956 INFO:tasks.workunit.client.1.smithi120.stdout:6/501: dwrite d4/d3d/f6e [0,4194304] 0 2024-04-26T21:25:53.957 INFO:tasks.workunit.client.0.smithi084.stdout:1/279: mkdir d2/d54/d5e 0 2024-04-26T21:25:53.958 INFO:tasks.workunit.client.0.smithi084.stdout:4/200: creat d5/d25/f47 x:0 0 0 2024-04-26T21:25:53.960 INFO:tasks.workunit.client.0.smithi084.stdout:6/296: mknod d3/de/d1a/d2f/d4c/c64 0 2024-04-26T21:25:53.964 INFO:tasks.workunit.client.0.smithi084.stdout:2/364: dread d6/d7/d3d/d15/d1f/d22/d2a/f44 [0,4194304] 0 2024-04-26T21:25:53.965 INFO:tasks.workunit.client.0.smithi084.stdout:9/217: mknod da/de/d16/d25/d41/d43/d4a/c4d 0 2024-04-26T21:25:53.973 INFO:tasks.workunit.client.0.smithi084.stdout:4/201: creat d5/d10/d15/d21/d29/d3f/f48 x:0 0 0 2024-04-26T21:25:53.973 INFO:tasks.workunit.client.0.smithi084.stdout:5/253: creat d0/f4b x:0 0 0 2024-04-26T21:25:53.980 INFO:tasks.workunit.client.0.smithi084.stdout:6/297: creat d3/f65 x:0 0 0 2024-04-26T21:25:53.980 INFO:tasks.workunit.client.0.smithi084.stdout:7/258: dwrite d6/f4b [0,4194304] 0 2024-04-26T21:25:53.984 INFO:tasks.workunit.client.0.smithi084.stdout:5/254: dread d0/dc/f1a [0,4194304] 0 2024-04-26T21:25:53.985 INFO:tasks.workunit.client.0.smithi084.stdout:6/298: chown d3/de/d1a/d43/l4e 412865 1 2024-04-26T21:25:53.993 INFO:tasks.workunit.client.0.smithi084.stdout:4/202: symlink d5/d10/d15/d21/l49 0 2024-04-26T21:25:53.996 INFO:tasks.workunit.client.1.smithi120.stdout:6/502: dread - d4/db/d10/d1a/d2b/d57/d67/f59 zero size 2024-04-26T21:25:53.999 INFO:tasks.workunit.client.1.smithi120.stdout:6/503: truncate d4/db/d25/d6d/f77 569041 0 2024-04-26T21:25:53.999 INFO:tasks.workunit.client.0.smithi084.stdout:8/304: dwrite d4/f1c [0,4194304] 0 2024-04-26T21:25:54.003 INFO:tasks.workunit.client.1.smithi120.stdout:4/456: truncate d10/d28/f3e 406392 0 2024-04-26T21:25:54.004 INFO:tasks.workunit.client.0.smithi084.stdout:5/255: truncate d0/dc/f43 784261 0 2024-04-26T21:25:54.004 INFO:tasks.workunit.client.0.smithi084.stdout:1/280: dwrite d2/d9/d17/f18 [4194304,4194304] 0 2024-04-26T21:25:54.004 INFO:tasks.workunit.client.1.smithi120.stdout:6/504: creat d4/d3d/fa7 x:0 0 0 2024-04-26T21:25:54.006 INFO:tasks.workunit.client.1.smithi120.stdout:4/457: write d10/d28/f4b [325135,72215] 0 2024-04-26T21:25:54.008 INFO:tasks.workunit.client.0.smithi084.stdout:4/203: chown l1 24577 1 2024-04-26T21:25:54.009 INFO:tasks.workunit.client.1.smithi120.stdout:6/505: stat d4/db/d10/d22/d56/d94 0 2024-04-26T21:25:54.009 INFO:tasks.workunit.client.1.smithi120.stdout:4/458: write d10/d65/d72/f80 [843797,107511] 0 2024-04-26T21:25:54.011 INFO:tasks.workunit.client.0.smithi084.stdout:4/204: dread - d5/d25/f3e zero size 2024-04-26T21:25:54.011 INFO:tasks.workunit.client.1.smithi120.stdout:5/538: rmdir d2/dc 39 2024-04-26T21:25:54.018 INFO:tasks.workunit.client.0.smithi084.stdout:9/218: dwrite f3 [4194304,4194304] 0 2024-04-26T21:25:54.019 INFO:tasks.workunit.client.1.smithi120.stdout:2/505: dwrite d4/d1b/d25/d2c/f49 [4194304,4194304] 0 2024-04-26T21:25:54.019 INFO:tasks.workunit.client.0.smithi084.stdout:6/299: creat d3/de/d1a/d2f/d4c/d58/f66 x:0 0 0 2024-04-26T21:25:54.023 INFO:tasks.workunit.client.0.smithi084.stdout:4/205: symlink d5/d7/d17/d32/l4a 0 2024-04-26T21:25:54.024 INFO:tasks.workunit.client.0.smithi084.stdout:5/256: write d0/dc/df/d31/f3c [977545,68677] 0 2024-04-26T21:25:54.025 INFO:tasks.workunit.client.1.smithi120.stdout:6/506: symlink d4/db/d25/la8 0 2024-04-26T21:25:54.026 INFO:tasks.workunit.client.1.smithi120.stdout:6/507: write d4/db/d10/dd/d4e/d60/f7c [324236,100773] 0 2024-04-26T21:25:54.028 INFO:tasks.workunit.client.1.smithi120.stdout:9/475: dread d0/dd/d45/f4a [0,4194304] 0 2024-04-26T21:25:54.031 INFO:tasks.workunit.client.0.smithi084.stdout:9/219: creat da/de/d16/d25/f4e x:0 0 0 2024-04-26T21:25:54.032 INFO:tasks.workunit.client.1.smithi120.stdout:9/476: readlink d0/d14/l1e 0 2024-04-26T21:25:54.033 INFO:tasks.workunit.client.1.smithi120.stdout:5/539: unlink d2/d1b/f35 0 2024-04-26T21:25:54.033 INFO:tasks.workunit.client.1.smithi120.stdout:9/477: chown d0/d6/d3d 0 1 2024-04-26T21:25:54.039 INFO:tasks.workunit.client.0.smithi084.stdout:1/281: mknod d2/d9/d15/d28/d5a/c5f 0 2024-04-26T21:25:54.040 INFO:tasks.workunit.client.1.smithi120.stdout:2/506: mknod d4/d1b/d56/d65/ca8 0 2024-04-26T21:25:54.041 INFO:tasks.workunit.client.1.smithi120.stdout:4/459: fdatasync d10/d12/f1d 0 2024-04-26T21:25:54.046 INFO:tasks.workunit.client.1.smithi120.stdout:4/460: write d10/d28/f4b [3648742,94068] 0 2024-04-26T21:25:54.046 INFO:tasks.workunit.client.1.smithi120.stdout:1/439: write d6/d7/d1b/f3d [682353,56892] 0 2024-04-26T21:25:54.046 INFO:tasks.workunit.client.1.smithi120.stdout:5/540: readlink d2/dc/d1d/d1f/lae 0 2024-04-26T21:25:54.046 INFO:tasks.workunit.client.0.smithi084.stdout:4/206: dread d5/d10/f18 [0,4194304] 0 2024-04-26T21:25:54.046 INFO:tasks.workunit.client.0.smithi084.stdout:6/300: rename d3/de/d1a/d43/l4e to d3/d18/d37/l67 0 2024-04-26T21:25:54.049 INFO:tasks.workunit.client.0.smithi084.stdout:9/220: mkdir da/de/d16/d25/d4f 0 2024-04-26T21:25:54.049 INFO:tasks.workunit.client.1.smithi120.stdout:5/541: write d2/d1b/f26 [1424648,72992] 0 2024-04-26T21:25:54.051 INFO:tasks.workunit.client.0.smithi084.stdout:7/259: dwrite d6/d9/fa [0,4194304] 0 2024-04-26T21:25:54.052 INFO:tasks.workunit.client.1.smithi120.stdout:9/478: mkdir d0/dd/d34/d8a/d9c 0 2024-04-26T21:25:54.053 INFO:tasks.workunit.client.1.smithi120.stdout:5/542: write d2/dc/d1d/d21/d66/fa2 [391976,109395] 0 2024-04-26T21:25:54.055 INFO:tasks.workunit.client.1.smithi120.stdout:6/508: symlink d4/la9 0 2024-04-26T21:25:54.058 INFO:tasks.workunit.client.1.smithi120.stdout:6/509: chown d4/db/d10/d22/d6c 95914481 1 2024-04-26T21:25:54.058 INFO:tasks.workunit.client.0.smithi084.stdout:4/207: stat d5/d25 0 2024-04-26T21:25:54.058 INFO:tasks.workunit.client.0.smithi084.stdout:7/260: chown c0 258555266 1 2024-04-26T21:25:54.060 INFO:tasks.workunit.client.1.smithi120.stdout:0/557: dwrite d0/d3/dc/dd/f45 [4194304,4194304] 0 2024-04-26T21:25:54.062 INFO:tasks.workunit.client.0.smithi084.stdout:4/208: dread d5/f2b [0,4194304] 0 2024-04-26T21:25:54.063 INFO:tasks.workunit.client.0.smithi084.stdout:7/261: write d6/dc/f55 [1697794,41612] 0 2024-04-26T21:25:54.064 INFO:tasks.workunit.client.1.smithi120.stdout:4/461: dread d10/d12/f3c [0,4194304] 0 2024-04-26T21:25:54.065 INFO:tasks.workunit.client.1.smithi120.stdout:7/477: rename d7/d10/d12 to d7/d64/da6 0 2024-04-26T21:25:54.066 INFO:tasks.workunit.client.0.smithi084.stdout:6/301: rmdir d3/de/d15/d23/d55 0 2024-04-26T21:25:54.067 INFO:tasks.workunit.client.1.smithi120.stdout:4/462: write d10/d65/f7e [1003574,1148] 0 2024-04-26T21:25:54.070 INFO:tasks.workunit.client.1.smithi120.stdout:6/510: fdatasync d4/db/f5a 0 2024-04-26T21:25:54.079 INFO:tasks.workunit.client.0.smithi084.stdout:1/282: rename d2/d9/d15/f2f to d2/d9/d17/f60 0 2024-04-26T21:25:54.079 INFO:tasks.workunit.client.0.smithi084.stdout:9/221: symlink da/de/d16/d25/d4f/l50 0 2024-04-26T21:25:54.079 INFO:tasks.workunit.client.0.smithi084.stdout:6/302: dread - d3/de/d1a/d43/f4f zero size 2024-04-26T21:25:54.083 INFO:tasks.workunit.client.0.smithi084.stdout:7/262: rename d6/dc/f31 to d6/dc/d47/f58 0 2024-04-26T21:25:54.084 INFO:tasks.workunit.client.1.smithi120.stdout:1/440: truncate d6/d7/d1d/d2c/f93 145730 0 2024-04-26T21:25:54.084 INFO:tasks.workunit.client.1.smithi120.stdout:7/478: mknod d7/d64/da6/d1f/d7d/ca7 0 2024-04-26T21:25:54.085 INFO:tasks.workunit.client.0.smithi084.stdout:6/303: chown d3/de/d1a/l1e 120 1 2024-04-26T21:25:54.086 INFO:tasks.workunit.client.0.smithi084.stdout:1/283: fdatasync d2/d9/f16 0 2024-04-26T21:25:54.087 INFO:tasks.workunit.client.0.smithi084.stdout:6/304: read - d3/de/f63 zero size 2024-04-26T21:25:54.090 INFO:tasks.workunit.client.1.smithi120.stdout:4/463: mkdir d10/d6b/d71/d9d 0 2024-04-26T21:25:54.092 INFO:tasks.workunit.client.0.smithi084.stdout:1/284: chown d2/f56 13127509 1 2024-04-26T21:25:54.093 INFO:tasks.workunit.client.1.smithi120.stdout:4/464: truncate d10/d28/f77 4544881 0 2024-04-26T21:25:54.093 INFO:tasks.workunit.client.0.smithi084.stdout:7/263: write d6/dc/f55 [1934462,68505] 0 2024-04-26T21:25:54.097 INFO:tasks.workunit.client.1.smithi120.stdout:7/479: dwrite d7/ff [0,4194304] 0 2024-04-26T21:25:54.106 INFO:tasks.workunit.client.1.smithi120.stdout:6/511: symlink d4/db/d10/dd/d43/laa 0 2024-04-26T21:25:54.107 INFO:tasks.workunit.client.0.smithi084.stdout:1/285: creat d2/d9/d17/d2a/d2c/f61 x:0 0 0 2024-04-26T21:25:54.110 INFO:tasks.workunit.client.1.smithi120.stdout:0/558: truncate d0/d3/d13/f76 3327828 0 2024-04-26T21:25:54.112 INFO:tasks.workunit.client.0.smithi084.stdout:9/222: dwrite da/de/d1e/f29 [0,4194304] 0 2024-04-26T21:25:54.113 INFO:tasks.workunit.client.0.smithi084.stdout:4/209: truncate d5/d7/f16 3885904 0 2024-04-26T21:25:54.114 INFO:tasks.workunit.client.0.smithi084.stdout:2/365: dread d6/d7/d68/f69 [4194304,4194304] 0 2024-04-26T21:25:54.115 INFO:tasks.workunit.client.1.smithi120.stdout:5/543: rename d2/dc/d1d/f58 to d2/dc/d1d/d21/d66/fc2 0 2024-04-26T21:25:54.117 INFO:tasks.workunit.client.1.smithi120.stdout:5/544: write d2/d48/f6f [1117986,62392] 0 2024-04-26T21:25:54.118 INFO:tasks.workunit.client.0.smithi084.stdout:1/286: write d2/d1b/f55 [273416,19035] 0 2024-04-26T21:25:54.118 INFO:tasks.workunit.client.1.smithi120.stdout:2/507: link d4/l5 d4/d1b/d25/d29/la9 0 2024-04-26T21:25:54.119 INFO:tasks.workunit.client.0.smithi084.stdout:2/366: creat d6/d7/d3d/d79/f83 x:0 0 0 2024-04-26T21:25:54.121 INFO:tasks.workunit.client.0.smithi084.stdout:9/223: rename da/f35 to da/de/d16/d25/d4f/f51 0 2024-04-26T21:25:54.122 INFO:tasks.workunit.client.1.smithi120.stdout:0/559: creat d0/d3/d13/d81/dba/fc2 x:0 0 0 2024-04-26T21:25:54.124 INFO:tasks.workunit.client.0.smithi084.stdout:7/264: write d6/d9/f11 [6892533,51673] 0 2024-04-26T21:25:54.124 INFO:tasks.workunit.client.1.smithi120.stdout:0/560: chown d0/d3/dc/dd/d9b 385 1 2024-04-26T21:25:54.127 INFO:tasks.workunit.client.0.smithi084.stdout:7/265: chown d6/d26/c2b 201346849 1 2024-04-26T21:25:54.127 INFO:tasks.workunit.client.0.smithi084.stdout:6/305: truncate d3/d18/f2b 362275 0 2024-04-26T21:25:54.127 INFO:tasks.workunit.client.1.smithi120.stdout:4/465: link d10/d65/f6d d10/d65/f9e 0 2024-04-26T21:25:54.128 INFO:tasks.workunit.client.1.smithi120.stdout:2/508: rmdir d4/d1b/d25/d2c/d3e 39 2024-04-26T21:25:54.130 INFO:tasks.workunit.client.1.smithi120.stdout:4/466: fsync d10/d28/d73/f8f 0 2024-04-26T21:25:54.131 INFO:tasks.workunit.client.0.smithi084.stdout:2/367: dread d6/d7/d3d/d15/d1f/d39/d20/d45/f60 [0,4194304] 0 2024-04-26T21:25:54.131 INFO:tasks.workunit.client.1.smithi120.stdout:2/509: stat d4/d1b/d2e/d50/d14/la3 0 2024-04-26T21:25:54.132 INFO:tasks.workunit.client.0.smithi084.stdout:9/224: unlink da/de/f38 0 2024-04-26T21:25:54.132 INFO:tasks.workunit.client.0.smithi084.stdout:7/266: truncate d6/dc/d47/f58 1117345 0 2024-04-26T21:25:54.136 INFO:tasks.workunit.client.1.smithi120.stdout:2/510: write f1 [672091,86537] 0 2024-04-26T21:25:54.136 INFO:tasks.workunit.client.1.smithi120.stdout:6/512: symlink d4/db/lab 0 2024-04-26T21:25:54.136 INFO:tasks.workunit.client.0.smithi084.stdout:6/306: creat d3/de/d15/d23/f68 x:0 0 0 2024-04-26T21:25:54.137 INFO:tasks.workunit.client.1.smithi120.stdout:9/479: truncate d0/f90 1220729 0 2024-04-26T21:25:54.138 INFO:tasks.workunit.client.0.smithi084.stdout:6/307: fdatasync d3/de/f3e 0 2024-04-26T21:25:54.139 INFO:tasks.workunit.client.1.smithi120.stdout:9/480: readlink d0/d14/l1e 0 2024-04-26T21:25:54.140 INFO:tasks.workunit.client.0.smithi084.stdout:1/287: creat d2/d9/d15/d28/f62 x:0 0 0 2024-04-26T21:25:54.141 INFO:tasks.workunit.client.1.smithi120.stdout:9/481: readlink d0/dd/le 0 2024-04-26T21:25:54.142 INFO:tasks.workunit.client.0.smithi084.stdout:2/368: write d6/d7/d3d/f1e [4549321,13681] 0 2024-04-26T21:25:54.143 INFO:tasks.workunit.client.1.smithi120.stdout:9/482: chown d0/dd/d34/d8a/d9c 262074569 1 2024-04-26T21:25:54.145 INFO:tasks.workunit.client.0.smithi084.stdout:7/267: mknod d6/d9/d12/d19/d20/d32/c59 0 2024-04-26T21:25:54.145 INFO:tasks.workunit.client.1.smithi120.stdout:6/513: read d4/db/d10/d1a/d2b/d57/d67/f32 [1535375,48739] 0 2024-04-26T21:25:54.145 INFO:tasks.workunit.client.1.smithi120.stdout:9/483: readlink d0/dd/l2c 0 2024-04-26T21:25:54.146 INFO:tasks.workunit.client.1.smithi120.stdout:0/561: unlink d0/d3/dc/dd/d4b/c5c 0 2024-04-26T21:25:54.148 INFO:tasks.workunit.client.1.smithi120.stdout:5/545: dwrite d2/d1b/d89/d47/f53 [4194304,4194304] 0 2024-04-26T21:25:54.148 INFO:tasks.workunit.client.0.smithi084.stdout:1/288: read d2/d9/d17/f29 [3369500,80981] 0 2024-04-26T21:25:54.149 INFO:tasks.workunit.client.0.smithi084.stdout:7/268: fdatasync d6/dc/d47/f48 0 2024-04-26T21:25:54.149 INFO:tasks.workunit.client.0.smithi084.stdout:1/289: readlink d2/d1b/l31 0 2024-04-26T21:25:54.151 INFO:tasks.workunit.client.0.smithi084.stdout:2/369: link d6/d7/d3d/d15/f7f d6/f84 0 2024-04-26T21:25:54.151 INFO:tasks.workunit.client.0.smithi084.stdout:6/308: creat d3/de/d15/f69 x:0 0 0 2024-04-26T21:25:54.153 INFO:tasks.workunit.client.0.smithi084.stdout:7/269: rmdir d6/d9/d12/d19/d20/d38 39 2024-04-26T21:25:54.156 INFO:tasks.workunit.client.0.smithi084.stdout:7/270: chown d6/d26/d40/d41/l52 381 1 2024-04-26T21:25:54.159 INFO:tasks.workunit.client.0.smithi084.stdout:6/309: write d3/de/d15/f69 [583336,93873] 0 2024-04-26T21:25:54.159 INFO:tasks.workunit.client.0.smithi084.stdout:2/370: rename d6/d7/d3d/d15/d1f/d39/d20/d45/d74 to d6/d7/d3d/d79/d85 0 2024-04-26T21:25:54.160 INFO:tasks.workunit.client.0.smithi084.stdout:1/290: write d2/d9/d15/d28/d47/f4b [954103,89600] 0 2024-04-26T21:25:54.161 INFO:tasks.workunit.client.1.smithi120.stdout:1/441: rename d6/d7/d1b/c43 to d6/d7/d1d/d5d/d67/dd/c97 0 2024-04-26T21:25:54.166 INFO:tasks.workunit.client.0.smithi084.stdout:1/291: mkdir d2/d19/d63 0 2024-04-26T21:25:54.167 INFO:tasks.workunit.client.0.smithi084.stdout:6/310: mknod d3/de/d15/d23/c6a 0 2024-04-26T21:25:54.169 INFO:tasks.workunit.client.0.smithi084.stdout:2/371: creat d6/d7/d3d/d15/d1f/d22/f86 x:0 0 0 2024-04-26T21:25:54.171 INFO:tasks.workunit.client.1.smithi120.stdout:0/562: creat d0/df/d59/fc3 x:0 0 0 2024-04-26T21:25:54.171 INFO:tasks.workunit.client.1.smithi120.stdout:5/546: mknod d2/d1b/d89/d47/d8a/cc3 0 2024-04-26T21:25:54.171 INFO:tasks.workunit.client.0.smithi084.stdout:6/311: dread d3/d18/f2b [0,4194304] 0 2024-04-26T21:25:54.172 INFO:tasks.workunit.client.1.smithi120.stdout:4/467: creat d10/d6b/d71/d9d/f9f x:0 0 0 2024-04-26T21:25:54.172 INFO:tasks.workunit.client.0.smithi084.stdout:1/292: mkdir d2/d19/d63/d64 0 2024-04-26T21:25:54.173 INFO:tasks.workunit.client.1.smithi120.stdout:4/468: read - d10/d12/f54 zero size 2024-04-26T21:25:54.176 INFO:tasks.workunit.client.0.smithi084.stdout:7/271: dread d6/dc/f27 [0,4194304] 0 2024-04-26T21:25:54.178 INFO:tasks.workunit.client.1.smithi120.stdout:7/480: rename d7/d10/c62 to d7/d64/ca8 0 2024-04-26T21:25:54.184 INFO:tasks.workunit.client.0.smithi084.stdout:1/293: getdents d2/d9 0 2024-04-26T21:25:54.185 INFO:tasks.workunit.client.0.smithi084.stdout:6/312: link d3/d18/c31 d3/de/d15/d23/c6b 0 2024-04-26T21:25:54.187 INFO:tasks.workunit.client.0.smithi084.stdout:7/272: link d6/d9/d12/l3f d6/d9/l5a 0 2024-04-26T21:25:54.188 INFO:tasks.workunit.client.0.smithi084.stdout:1/294: chown d2/d9/d15/d28/d47/f4f 230 1 2024-04-26T21:25:54.189 INFO:tasks.workunit.client.0.smithi084.stdout:2/372: dwrite d6/d7/d3d/d15/d1f/d39/f48 [0,4194304] 0 2024-04-26T21:25:54.189 INFO:tasks.workunit.client.1.smithi120.stdout:0/563: mknod d0/d3/d51/cc4 0 2024-04-26T21:25:54.193 INFO:tasks.workunit.client.0.smithi084.stdout:6/313: mkdir d3/d6c 0 2024-04-26T21:25:54.193 INFO:tasks.workunit.client.0.smithi084.stdout:7/273: fdatasync d6/d9/fa 0 2024-04-26T21:25:54.194 INFO:tasks.workunit.client.0.smithi084.stdout:2/373: stat d6/d7/d3d/d15/d1f/d39/d20/d36 0 2024-04-26T21:25:54.196 INFO:tasks.workunit.client.0.smithi084.stdout:6/314: rename d3/de/f3e to d3/de/f6d 0 2024-04-26T21:25:54.198 INFO:tasks.workunit.client.0.smithi084.stdout:7/274: creat d6/d26/d40/f5b x:0 0 0 2024-04-26T21:25:54.202 INFO:tasks.workunit.client.0.smithi084.stdout:2/374: creat d6/d7/d3d/d15/d1f/d39/d20/d45/f87 x:0 0 0 2024-04-26T21:25:54.204 INFO:tasks.workunit.client.0.smithi084.stdout:7/275: unlink d6/f4d 0 2024-04-26T21:25:54.205 INFO:tasks.workunit.client.0.smithi084.stdout:2/375: truncate d6/d7/d68/f6f 11050 0 2024-04-26T21:25:54.207 INFO:tasks.workunit.client.0.smithi084.stdout:7/276: fdatasync d6/d9/d12/d19/d20/f57 0 2024-04-26T21:25:54.208 INFO:tasks.workunit.client.1.smithi120.stdout:2/511: rename f1 to d4/d1b/d25/d2c/faa 0 2024-04-26T21:25:54.209 INFO:tasks.workunit.client.0.smithi084.stdout:2/376: mknod d6/d7/d3d/d15/d1f/d22/d2a/c88 0 2024-04-26T21:25:54.210 INFO:tasks.workunit.client.1.smithi120.stdout:2/512: write d4/d1b/d25/f86 [929401,94252] 0 2024-04-26T21:25:54.212 INFO:tasks.workunit.client.0.smithi084.stdout:7/277: mknod d6/d1c/d51/c5c 0 2024-04-26T21:25:54.213 INFO:tasks.workunit.client.0.smithi084.stdout:2/377: write d6/d7/f3f [4419271,129019] 0 2024-04-26T21:25:54.214 INFO:tasks.workunit.client.1.smithi120.stdout:4/469: getdents d10/d6b/d71 0 2024-04-26T21:25:54.215 INFO:tasks.workunit.client.0.smithi084.stdout:1/295: write d2/d9/d17/f36 [2915,55840] 0 2024-04-26T21:25:54.217 INFO:tasks.workunit.client.0.smithi084.stdout:7/278: mknod d6/d26/c5d 0 2024-04-26T21:25:54.218 INFO:tasks.workunit.client.0.smithi084.stdout:1/296: write d2/d9/f14 [844906,47160] 0 2024-04-26T21:25:54.220 INFO:tasks.workunit.client.0.smithi084.stdout:6/315: dread d3/de/d15/d23/f30 [0,4194304] 0 2024-04-26T21:25:54.220 INFO:tasks.workunit.client.1.smithi120.stdout:5/547: dread d2/f13 [0,4194304] 0 2024-04-26T21:25:54.225 INFO:tasks.workunit.client.1.smithi120.stdout:5/548: truncate d2/dc/d1d/d21/d77/d79/db7/fab 783427 0 2024-04-26T21:25:54.226 INFO:tasks.workunit.client.1.smithi120.stdout:2/513: mknod d4/d1b/d25/d29/cab 0 2024-04-26T21:25:54.227 INFO:tasks.workunit.client.1.smithi120.stdout:2/514: fsync d4/d1b/f38 0 2024-04-26T21:25:54.228 INFO:tasks.workunit.client.0.smithi084.stdout:1/297: truncate d2/d9/f14 1608022 0 2024-04-26T21:25:54.228 INFO:tasks.workunit.client.1.smithi120.stdout:4/470: symlink d10/d6b/la0 0 2024-04-26T21:25:54.228 INFO:tasks.workunit.client.0.smithi084.stdout:1/298: fsync d2/d19/f1e 0 2024-04-26T21:25:54.231 INFO:tasks.workunit.client.0.smithi084.stdout:6/316: getdents d3/de 0 2024-04-26T21:25:54.236 INFO:tasks.workunit.client.1.smithi120.stdout:5/549: creat d2/dc/d1d/d1f/d36/fc4 x:0 0 0 2024-04-26T21:25:54.237 INFO:tasks.workunit.client.0.smithi084.stdout:1/299: rename d2/d9/d17/d2a/d2c/f61 to d2/d1b/f65 0 2024-04-26T21:25:54.239 INFO:tasks.workunit.client.0.smithi084.stdout:6/317: creat d3/de/d15/d40/f6e x:0 0 0 2024-04-26T21:25:54.242 INFO:tasks.workunit.client.1.smithi120.stdout:6/514: rename d4/db/d10/dd/d43/f63 to d4/db/d10/d1a/d2b/d57/fac 0 2024-04-26T21:25:54.243 INFO:tasks.workunit.client.1.smithi120.stdout:6/515: fsync d4/db/d10/d1a/d2b/f93 0 2024-04-26T21:25:54.245 INFO:tasks.workunit.client.0.smithi084.stdout:7/279: dwrite d6/dc/d47/f4a [0,4194304] 0 2024-04-26T21:25:54.245 INFO:tasks.workunit.client.0.smithi084.stdout:6/318: write d3/d18/f38 [4711710,128019] 0 2024-04-26T21:25:54.248 INFO:tasks.workunit.client.1.smithi120.stdout:4/471: mkdir d10/d12/da1 0 2024-04-26T21:25:54.250 INFO:tasks.workunit.client.1.smithi120.stdout:9/484: write d0/f7c [2477142,38699] 0 2024-04-26T21:25:54.252 INFO:tasks.workunit.client.1.smithi120.stdout:5/550: dwrite d2/d1b/d89/d47/f5b [0,4194304] 0 2024-04-26T21:25:54.253 INFO:tasks.workunit.client.0.smithi084.stdout:2/378: dwrite d6/d7/d3d/d15/d1f/d22/f24 [0,4194304] 0 2024-04-26T21:25:54.255 INFO:tasks.workunit.client.0.smithi084.stdout:2/379: readlink d6/d7/d3d/d15/d1f/d39/l16 0 2024-04-26T21:25:54.257 INFO:tasks.workunit.client.0.smithi084.stdout:6/319: link d3/de/d15/d23/c25 d3/de/d1a/d43/c6f 0 2024-04-26T21:25:54.260 INFO:tasks.workunit.client.0.smithi084.stdout:6/320: stat d3/de/d1a/l4a 0 2024-04-26T21:25:54.261 INFO:tasks.workunit.client.0.smithi084.stdout:0/229: sync 2024-04-26T21:25:54.264 INFO:tasks.workunit.client.1.smithi120.stdout:1/442: rename d6/d7/d1d/d5d/d67/dd to d6/d7/d2d/d98 0 2024-04-26T21:25:54.267 INFO:tasks.workunit.client.1.smithi120.stdout:4/472: mkdir d10/d28/d73/da2 0 2024-04-26T21:25:54.267 INFO:tasks.workunit.client.0.smithi084.stdout:0/230: fdatasync de/d1c/d32/f44 0 2024-04-26T21:25:54.268 INFO:tasks.workunit.client.1.smithi120.stdout:4/473: readlink d10/d28/l63 0 2024-04-26T21:25:54.268 INFO:tasks.workunit.client.0.smithi084.stdout:6/321: getdents d3/de/d41/d5c 0 2024-04-26T21:25:54.269 INFO:tasks.workunit.client.0.smithi084.stdout:7/280: dwrite d6/d9/f2d [0,4194304] 0 2024-04-26T21:25:54.270 INFO:tasks.workunit.client.1.smithi120.stdout:4/474: truncate d10/d65/d72/f80 1315683 0 2024-04-26T21:25:54.276 INFO:tasks.workunit.client.0.smithi084.stdout:0/231: mkdir de/d20/d4c 0 2024-04-26T21:25:54.277 INFO:tasks.workunit.client.0.smithi084.stdout:1/300: dwrite d2/d9/d17/d2a/d2c/f34 [0,4194304] 0 2024-04-26T21:25:54.277 INFO:tasks.workunit.client.1.smithi120.stdout:6/516: dread d4/db/d10/dd/f26 [0,4194304] 0 2024-04-26T21:25:54.279 INFO:tasks.workunit.client.1.smithi120.stdout:9/485: mknod d0/d66/c9d 0 2024-04-26T21:25:54.279 INFO:tasks.workunit.client.0.smithi084.stdout:6/322: symlink d3/de/d1a/d2f/l70 0 2024-04-26T21:25:54.280 INFO:tasks.workunit.client.1.smithi120.stdout:5/551: creat d2/dc/d1d/d21/d66/d85/fc5 x:0 0 0 2024-04-26T21:25:54.280 INFO:tasks.workunit.client.0.smithi084.stdout:1/301: chown d2/d9/d17/d2a/d2c/d45/f4a 8078 1 2024-04-26T21:25:54.289 INFO:tasks.workunit.client.0.smithi084.stdout:0/232: read de/ff [488884,93707] 0 2024-04-26T21:25:54.289 INFO:tasks.workunit.client.0.smithi084.stdout:2/380: truncate d6/d7/d3d/d15/f1a 1901792 0 2024-04-26T21:25:54.289 INFO:tasks.workunit.client.0.smithi084.stdout:0/233: chown de/d1c/c3e 70353 1 2024-04-26T21:25:54.290 INFO:tasks.workunit.client.0.smithi084.stdout:6/323: mknod d3/d18/d37/c71 0 2024-04-26T21:25:54.290 INFO:tasks.workunit.client.1.smithi120.stdout:4/475: symlink d10/d12/la3 0 2024-04-26T21:25:54.295 INFO:tasks.workunit.client.1.smithi120.stdout:9/486: dwrite d0/d6/d3d/f4e [4194304,4194304] 0 2024-04-26T21:25:54.297 INFO:tasks.workunit.client.0.smithi084.stdout:6/324: dread d3/de/d15/d40/f60 [0,4194304] 0 2024-04-26T21:25:54.298 INFO:tasks.workunit.client.0.smithi084.stdout:0/234: dread de/d20/f29 [0,4194304] 0 2024-04-26T21:25:54.298 INFO:tasks.workunit.client.1.smithi120.stdout:5/552: mknod d2/d30/d3b/cc6 0 2024-04-26T21:25:54.300 INFO:tasks.workunit.client.1.smithi120.stdout:5/553: chown d2/dc/d1d/d21/d66/d85 14 1 2024-04-26T21:25:54.301 INFO:tasks.workunit.client.1.smithi120.stdout:1/443: unlink d6/d7/d2d/d98/c97 0 2024-04-26T21:25:54.304 INFO:tasks.workunit.client.1.smithi120.stdout:5/554: fsync d2/d1b/d89/d47/f53 0 2024-04-26T21:25:54.306 INFO:tasks.workunit.client.1.smithi120.stdout:1/444: truncate d6/d7/d1d/d2c/f76 363671 0 2024-04-26T21:25:54.309 INFO:tasks.workunit.client.0.smithi084.stdout:6/325: mkdir d3/de/d1a/d43/d72 0 2024-04-26T21:25:54.310 INFO:tasks.workunit.client.1.smithi120.stdout:6/517: dwrite d4/db/d10/dd/f18 [0,4194304] 0 2024-04-26T21:25:54.314 INFO:tasks.workunit.client.1.smithi120.stdout:7/481: rename d7/d64/da6/d1f/d28/l5d to d7/d19/la9 0 2024-04-26T21:25:54.315 INFO:tasks.workunit.client.0.smithi084.stdout:1/302: dwrite d2/f56 [0,4194304] 0 2024-04-26T21:25:54.317 INFO:tasks.workunit.client.0.smithi084.stdout:0/235: getdents de/d2b 0 2024-04-26T21:25:54.318 INFO:tasks.workunit.client.1.smithi120.stdout:9/487: link d0/dd/d3a/f6b d0/dd/d3a/d5c/f9e 0 2024-04-26T21:25:54.320 INFO:tasks.workunit.client.0.smithi084.stdout:1/303: chown d2/d9/c53 40172323 1 2024-04-26T21:25:54.321 INFO:tasks.workunit.client.1.smithi120.stdout:7/482: mkdir d7/d19/d60/daa 0 2024-04-26T21:25:54.321 INFO:tasks.workunit.client.0.smithi084.stdout:2/381: dwrite d6/d7/d3d/f57 [0,4194304] 0 2024-04-26T21:25:54.323 INFO:tasks.workunit.client.1.smithi120.stdout:7/483: stat d7/d64/da6/d1f/d7d/d8b/fa3 0 2024-04-26T21:25:54.329 INFO:tasks.workunit.client.1.smithi120.stdout:9/488: rename d0/d5e to d0/dd/d3a/d5c/d9f 0 2024-04-26T21:25:54.330 INFO:tasks.workunit.client.1.smithi120.stdout:6/518: dwrite d4/db/d10/d1a/d2b/d57/d67/f32 [0,4194304] 0 2024-04-26T21:25:54.331 INFO:tasks.workunit.client.0.smithi084.stdout:0/236: symlink de/d1c/d41/l4d 0 2024-04-26T21:25:54.331 INFO:tasks.workunit.client.1.smithi120.stdout:1/445: dread d6/d7/d1d/f20 [0,4194304] 0 2024-04-26T21:25:54.332 INFO:tasks.workunit.client.0.smithi084.stdout:0/237: readlink de/d2b/l2d 0 2024-04-26T21:25:54.332 INFO:tasks.workunit.client.1.smithi120.stdout:9/489: write d0/dd/d3a/d5c/f8e [266969,6814] 0 2024-04-26T21:25:54.333 INFO:tasks.workunit.client.0.smithi084.stdout:2/382: mknod d6/d7/d3d/d79/d81/d82/c89 0 2024-04-26T21:25:54.335 INFO:tasks.workunit.client.1.smithi120.stdout:1/446: write d6/d7/d1b/d3b/f7f [4287426,5261] 0 2024-04-26T21:25:54.337 INFO:tasks.workunit.client.1.smithi120.stdout:7/484: mkdir d7/d64/da6/d1a/d33/d34/dab 0 2024-04-26T21:25:54.337 INFO:tasks.workunit.client.1.smithi120.stdout:5/555: link d2/dc/d1d/d21/d66/fc2 d2/dc/d1d/d21/db2/fc7 0 2024-04-26T21:25:54.338 INFO:tasks.workunit.client.1.smithi120.stdout:6/519: creat d4/db/d10/d22/d6c/fad x:0 0 0 2024-04-26T21:25:54.341 INFO:tasks.workunit.client.1.smithi120.stdout:5/556: chown d2/dc/d1d/d1f/f4c 63246 1 2024-04-26T21:25:54.341 INFO:tasks.workunit.client.1.smithi120.stdout:1/447: read - d6/d7/d1b/f8a zero size 2024-04-26T21:25:54.343 INFO:tasks.workunit.client.1.smithi120.stdout:7/485: chown d7/d64/da6/d1a/d33/fa5 5 1 2024-04-26T21:25:54.347 INFO:tasks.workunit.client.1.smithi120.stdout:6/520: creat d4/db/d10/d1a/d2b/d57/d67/fae x:0 0 0 2024-04-26T21:25:54.348 INFO:tasks.workunit.client.1.smithi120.stdout:5/557: creat d2/dc/fc8 x:0 0 0 2024-04-26T21:25:54.348 INFO:tasks.workunit.client.0.smithi084.stdout:2/383: getdents d6/d7/d3d 0 2024-04-26T21:25:54.352 INFO:tasks.workunit.client.1.smithi120.stdout:9/490: dwrite d0/d14/d2d/f97 [0,4194304] 0 2024-04-26T21:25:54.353 INFO:tasks.workunit.client.0.smithi084.stdout:2/384: symlink d6/d1b/l8a 0 2024-04-26T21:25:54.355 INFO:tasks.workunit.client.1.smithi120.stdout:9/491: write d0/dd/f12 [1363024,116566] 0 2024-04-26T21:25:54.356 INFO:tasks.workunit.client.1.smithi120.stdout:6/521: rmdir d4/db/d25/d6d/d97 39 2024-04-26T21:25:54.358 INFO:tasks.workunit.client.0.smithi084.stdout:2/385: unlink d6/d7/d3d/f25 0 2024-04-26T21:25:54.362 INFO:tasks.workunit.client.1.smithi120.stdout:5/558: link d2/d1b/d89/d47/ca5 d2/d1b/d89/d6b/cc9 0 2024-04-26T21:25:54.367 INFO:tasks.workunit.client.1.smithi120.stdout:7/486: dwrite d7/d64/da6/d1f/d28/d4c/f89 [4194304,4194304] 0 2024-04-26T21:25:54.369 INFO:tasks.workunit.client.1.smithi120.stdout:7/487: fdatasync d7/d64/da6/d1f/d28/d4c/d6c/f71 0 2024-04-26T21:25:54.376 INFO:tasks.workunit.client.1.smithi120.stdout:6/522: mkdir d4/db/d10/dd/d28/d9e/daf 0 2024-04-26T21:25:54.378 INFO:tasks.workunit.client.0.smithi084.stdout:0/238: rename de/d1c/d41 to de/d20/d4e 0 2024-04-26T21:25:54.383 INFO:tasks.workunit.client.1.smithi120.stdout:7/488: rmdir d7/d64/da6/d2f 39 2024-04-26T21:25:54.386 INFO:tasks.workunit.client.0.smithi084.stdout:1/304: dread d2/d9/d15/f58 [0,4194304] 0 2024-04-26T21:25:54.389 INFO:tasks.workunit.client.1.smithi120.stdout:2/515: write d4/d1b/d2e/d50/d14/d15/f2d [3887898,11506] 0 2024-04-26T21:25:54.389 INFO:tasks.workunit.client.0.smithi084.stdout:0/239: rename de/d1c/f2a to de/d1c/d32/f4f 0 2024-04-26T21:25:54.390 INFO:tasks.workunit.client.0.smithi084.stdout:1/305: fsync d2/d54/f5c 0 2024-04-26T21:25:54.391 INFO:tasks.workunit.client.1.smithi120.stdout:7/489: creat d7/fac x:0 0 0 2024-04-26T21:25:54.395 INFO:tasks.workunit.client.0.smithi084.stdout:0/240: symlink de/d2b/d45/l50 0 2024-04-26T21:25:54.399 INFO:tasks.workunit.client.0.smithi084.stdout:0/241: creat de/d1c/d32/f51 x:0 0 0 2024-04-26T21:25:54.399 INFO:tasks.workunit.client.1.smithi120.stdout:7/490: truncate d7/d64/da6/d2f/f52 69756 0 2024-04-26T21:25:54.400 INFO:tasks.workunit.client.1.smithi120.stdout:9/492: write d0/d6/d3d/f4e [9092677,38878] 0 2024-04-26T21:25:54.405 INFO:tasks.workunit.client.1.smithi120.stdout:7/491: symlink d7/d19/d60/lad 0 2024-04-26T21:25:54.406 INFO:tasks.workunit.client.1.smithi120.stdout:9/493: readlink d0/l22 0 2024-04-26T21:25:54.406 INFO:tasks.workunit.client.0.smithi084.stdout:2/386: dwrite d6/d7/d3d/d15/d1f/d39/f48 [0,4194304] 0 2024-04-26T21:25:54.407 INFO:tasks.workunit.client.1.smithi120.stdout:7/492: fsync d7/d64/da6/f7a 0 2024-04-26T21:25:54.409 INFO:tasks.workunit.client.0.smithi084.stdout:2/387: readlink d6/d7/d3d/d15/d1f/d39/d20/d36/l62 0 2024-04-26T21:25:54.411 INFO:tasks.workunit.client.1.smithi120.stdout:7/493: fdatasync d7/d64/da6/d1f/d28/d4c/d6b/f8f 0 2024-04-26T21:25:54.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:54 smithi084 ceph-mon[25539]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:25:54.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:54 smithi084 ceph-mon[25539]: from='client.24441 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:25:54.413 INFO:tasks.workunit.client.1.smithi120.stdout:7/494: chown d7/d10/d97/d99 130561 1 2024-04-26T21:25:54.413 INFO:tasks.workunit.client.1.smithi120.stdout:4/476: dwrite d10/f2d [0,4194304] 0 2024-04-26T21:25:54.414 INFO:tasks.workunit.client.0.smithi084.stdout:0/242: truncate de/d1c/f1d 1209496 0 2024-04-26T21:25:54.416 INFO:tasks.workunit.client.0.smithi084.stdout:0/243: truncate de/d20/f36 944506 0 2024-04-26T21:25:54.417 INFO:tasks.workunit.client.0.smithi084.stdout:2/388: creat d6/d7/d3d/d15/d1f/d22/d2a/f8b x:0 0 0 2024-04-26T21:25:54.419 INFO:tasks.workunit.client.0.smithi084.stdout:0/244: readlink de/d2b/l2c 0 2024-04-26T21:25:54.424 INFO:tasks.workunit.client.0.smithi084.stdout:0/245: symlink de/d20/l52 0 2024-04-26T21:25:54.424 INFO:tasks.workunit.client.1.smithi120.stdout:9/494: dwrite d0/d14/d2d/d4b/f6f [0,4194304] 0 2024-04-26T21:25:54.430 INFO:tasks.workunit.client.1.smithi120.stdout:8/470: sync 2024-04-26T21:25:54.431 INFO:tasks.workunit.client.1.smithi120.stdout:0/564: sync 2024-04-26T21:25:54.431 INFO:tasks.workunit.client.1.smithi120.stdout:3/457: sync 2024-04-26T21:25:54.437 INFO:tasks.workunit.client.1.smithi120.stdout:1/448: truncate d6/d7/d2d/d98/d54/f7a 826620 0 2024-04-26T21:25:54.438 INFO:tasks.workunit.client.1.smithi120.stdout:1/449: stat d6/f15 0 2024-04-26T21:25:54.440 INFO:tasks.workunit.client.1.smithi120.stdout:1/450: readlink d6/d14/l4d 0 2024-04-26T21:25:54.440 INFO:tasks.workunit.client.1.smithi120.stdout:5/559: dread d2/dc/d1d/d21/f45 [0,4194304] 0 2024-04-26T21:25:54.444 INFO:tasks.workunit.client.1.smithi120.stdout:9/495: dwrite d0/d14/f8c [0,4194304] 0 2024-04-26T21:25:54.444 INFO:tasks.workunit.client.1.smithi120.stdout:2/516: write d4/f10 [2582100,31853] 0 2024-04-26T21:25:54.445 INFO:tasks.workunit.client.0.smithi084.stdout:3/306: sync 2024-04-26T21:25:54.451 INFO:tasks.workunit.client.1.smithi120.stdout:0/565: symlink d0/d3/dc/d12/d4a/dbc/lc5 0 2024-04-26T21:25:54.455 INFO:tasks.workunit.client.0.smithi084.stdout:3/307: symlink d1/d2c/d2f/d31/d3b/l6b 0 2024-04-26T21:25:54.455 INFO:tasks.workunit.client.1.smithi120.stdout:1/451: unlink d6/d7/d2d/c4f 0 2024-04-26T21:25:54.456 INFO:tasks.workunit.client.1.smithi120.stdout:6/523: dwrite d4/db/d10/dd/f30 [0,4194304] 0 2024-04-26T21:25:54.457 INFO:tasks.workunit.client.0.smithi084.stdout:2/389: dwrite d6/f84 [0,4194304] 0 2024-04-26T21:25:54.458 INFO:tasks.workunit.client.1.smithi120.stdout:5/560: read d2/d82/d96/fbc [1058978,88088] 0 2024-04-26T21:25:54.459 INFO:tasks.workunit.client.1.smithi120.stdout:9/496: creat d0/d14/fa0 x:0 0 0 2024-04-26T21:25:54.460 INFO:tasks.workunit.client.1.smithi120.stdout:0/566: fdatasync d0/d3/d51/d97/fa5 0 2024-04-26T21:25:54.461 INFO:tasks.workunit.client.0.smithi084.stdout:0/246: dread f0 [0,4194304] 0 2024-04-26T21:25:54.461 INFO:tasks.workunit.client.0.smithi084.stdout:3/308: creat d1/d2c/d2f/d31/d3b/f6c x:0 0 0 2024-04-26T21:25:54.463 INFO:tasks.workunit.client.1.smithi120.stdout:1/452: symlink d6/d14/d6f/l99 0 2024-04-26T21:25:54.464 INFO:tasks.workunit.client.1.smithi120.stdout:0/567: read d0/d3/dc/d12/f6a [28475,66625] 0 2024-04-26T21:25:54.464 INFO:tasks.workunit.client.0.smithi084.stdout:0/247: dread - de/d20/f24 zero size 2024-04-26T21:25:54.468 INFO:tasks.workunit.client.1.smithi120.stdout:2/517: rename d4/l6 to d4/d1b/d2e/d50/d14/d15/d6c/lac 0 2024-04-26T21:25:54.470 INFO:tasks.workunit.client.0.smithi084.stdout:0/248: mkdir de/d1c/d53 0 2024-04-26T21:25:54.473 INFO:tasks.workunit.client.0.smithi084.stdout:3/309: getdents d1/d24/d27 0 2024-04-26T21:25:54.474 INFO:tasks.workunit.client.1.smithi120.stdout:5/561: creat d2/dc/d1d/d21/d66/d6a/d8c/fca x:0 0 0 2024-04-26T21:25:54.474 INFO:tasks.workunit.client.0.smithi084.stdout:0/249: mknod de/d1c/d53/c54 0 2024-04-26T21:25:54.477 INFO:tasks.workunit.client.0.smithi084.stdout:3/310: fsync d1/d2c/d2f/d31/f63 0 2024-04-26T21:25:54.479 INFO:tasks.workunit.client.0.smithi084.stdout:0/250: symlink de/d1c/l55 0 2024-04-26T21:25:54.480 INFO:tasks.workunit.client.0.smithi084.stdout:0/251: chown de/d20 150304360 1 2024-04-26T21:25:54.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.478+0000 7f84ff400700 1 -- 172.21.15.84:0/3465644079 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f84d8005860 con 0x7f84f8071ef0 2024-04-26T21:25:54.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.482+0000 7f84f4c00700 1 -- 172.21.15.84:0/3465644079 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f84e4013e60 con 0x7f84f8071ef0 2024-04-26T21:25:54.484 INFO:tasks.workunit.client.0.smithi084.stdout:0/252: readlink de/d2b/l2c 0 2024-04-26T21:25:54.487 INFO:tasks.workunit.client.1.smithi120.stdout:1/453: dwrite d6/d7/d1b/d55/f5b [0,4194304] 0 2024-04-26T21:25:54.488 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:25:54.488 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:25:54.488 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-26T21:25:54.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:25:54.488 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:25:54.488 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 1, 2024-04-26T21:25:54.488 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 1 2024-04-26T21:25:54.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:25:54.488 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:25:54.488 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-26T21:25:54.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:25:54.488 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:25:54.489 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-26T21:25:54.489 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:25:54.489 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:25:54.489 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 13, 2024-04-26T21:25:54.489 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 1 2024-04-26T21:25:54.489 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:25:54.489 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:25:54.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.486+0000 7f84ff400700 1 -- 172.21.15.84:0/3465644079 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f84e006be80 msgr2=0x7f84e006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:54.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.486+0000 7f84ff400700 1 --2- 172.21.15.84:0/3465644079 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f84e006be80 0x7f84e006e330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f84f8108ea0 tx=0x7f84ec0091a0 comp rx=0 tx=0).stop 2024-04-26T21:25:54.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.486+0000 7f84ff400700 1 -- 172.21.15.84:0/3465644079 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84f8071ef0 msgr2=0x7f84f8107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:54.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.486+0000 7f84ff400700 1 --2- 172.21.15.84:0/3465644079 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84f8071ef0 0x7f84f8107b20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f84e4009150 tx=0x7f84e4009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:54.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.486+0000 7f84ff400700 1 -- 172.21.15.84:0/3465644079 shutdown_connections 2024-04-26T21:25:54.490 INFO:tasks.workunit.client.0.smithi084.stdout:0/253: symlink de/d2b/d45/l56 0 2024-04-26T21:25:54.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.486+0000 7f84ff400700 1 --2- 172.21.15.84:0/3465644079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84f8070940 0x7f84f81075e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:54.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.486+0000 7f84ff400700 1 --2- 172.21.15.84:0/3465644079 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f84e006be80 0x7f84e006e330 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:54.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.486+0000 7f84ff400700 1 --2- 172.21.15.84:0/3465644079 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84f8071ef0 0x7f84f8107b20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:54.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.486+0000 7f84ff400700 1 -- 172.21.15.84:0/3465644079 >> 172.21.15.84:0/3465644079 conn(0x7f84f80f8560 msgr2=0x7f84f80f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:54.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.487+0000 7f84ff400700 1 -- 172.21.15.84:0/3465644079 shutdown_connections 2024-04-26T21:25:54.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.487+0000 7f84ff400700 1 -- 172.21.15.84:0/3465644079 wait complete. 2024-04-26T21:25:54.491 INFO:tasks.workunit.client.1.smithi120.stdout:4/477: dwrite d10/d65/f9e [0,4194304] 0 2024-04-26T21:25:54.491 INFO:tasks.workunit.client.1.smithi120.stdout:4/478: fdatasync d10/f6f 0 2024-04-26T21:25:54.493 INFO:tasks.workunit.client.0.smithi084.stdout:0/254: creat de/d1c/d53/f57 x:0 0 0 2024-04-26T21:25:54.494 INFO:tasks.workunit.client.1.smithi120.stdout:4/479: chown d10/d28/f3d 5 1 2024-04-26T21:25:54.494 INFO:tasks.workunit.client.1.smithi120.stdout:5/562: fdatasync d2/dc/f6d 0 2024-04-26T21:25:54.497 INFO:tasks.workunit.client.1.smithi120.stdout:4/480: write d10/d65/d72/f91 [414065,12912] 0 2024-04-26T21:25:54.498 INFO:tasks.workunit.client.1.smithi120.stdout:5/563: dread - d2/dc/d1d/d21/f7d zero size 2024-04-26T21:25:54.498 INFO:tasks.workunit.client.0.smithi084.stdout:0/255: mknod de/d20/c58 0 2024-04-26T21:25:54.499 INFO:tasks.workunit.client.1.smithi120.stdout:1/454: rename d6/d7/d1b/d89/d8c/f6e to d6/d7/d1b/d89/d8c/d62/f9a 0 2024-04-26T21:25:54.502 INFO:tasks.workunit.client.1.smithi120.stdout:2/518: fdatasync d4/d1b/d2e/d50/f5b 0 2024-04-26T21:25:54.502 INFO:tasks.workunit.client.0.smithi084.stdout:2/390: dread d6/d7/fb [0,4194304] 0 2024-04-26T21:25:54.503 INFO:tasks.workunit.client.0.smithi084.stdout:0/256: creat de/d2b/d45/f59 x:0 0 0 2024-04-26T21:25:54.508 INFO:tasks.workunit.client.0.smithi084.stdout:0/257: truncate de/d1c/f33 2243418 0 2024-04-26T21:25:54.510 INFO:tasks.workunit.client.0.smithi084.stdout:2/391: fsync d6/d7/d3d/d15/d1f/d39/d20/d45/f87 0 2024-04-26T21:25:54.512 INFO:tasks.workunit.client.1.smithi120.stdout:5/564: dwrite d2/dc/d1d/d1f/d36/fc4 [0,4194304] 0 2024-04-26T21:25:54.512 INFO:tasks.workunit.client.1.smithi120.stdout:4/481: mkdir d10/d6b/da4 0 2024-04-26T21:25:54.513 INFO:tasks.workunit.client.1.smithi120.stdout:9/497: getdents d0/d6/d3d 0 2024-04-26T21:25:54.514 INFO:tasks.workunit.client.1.smithi120.stdout:6/524: truncate d4/d3d/f6e 3063917 0 2024-04-26T21:25:54.515 INFO:tasks.workunit.client.0.smithi084.stdout:0/258: link de/d20/f36 de/d20/d4e/f5a 0 2024-04-26T21:25:54.517 INFO:tasks.workunit.client.1.smithi120.stdout:5/565: write d2/d1b/d89/f87 [355016,84212] 0 2024-04-26T21:25:54.518 INFO:tasks.workunit.client.0.smithi084.stdout:2/392: truncate d6/d7/d3d/f54 200251 0 2024-04-26T21:25:54.520 INFO:tasks.workunit.client.1.smithi120.stdout:4/482: dread d10/d65/f7e [0,4194304] 0 2024-04-26T21:25:54.521 INFO:tasks.workunit.client.0.smithi084.stdout:3/311: dread d1/fe [0,4194304] 0 2024-04-26T21:25:54.522 INFO:tasks.workunit.client.1.smithi120.stdout:9/498: getdents d0/d14/d2d/d4b/d85 0 2024-04-26T21:25:54.524 INFO:tasks.workunit.client.1.smithi120.stdout:6/525: unlink d4/db/d25/d6d/d97/d9d/fa5 0 2024-04-26T21:25:54.526 INFO:tasks.workunit.client.0.smithi084.stdout:0/259: rename de/c42 to de/c5b 0 2024-04-26T21:25:54.528 INFO:tasks.workunit.client.1.smithi120.stdout:5/566: creat d2/d48/d63/fcb x:0 0 0 2024-04-26T21:25:54.529 INFO:tasks.workunit.client.1.smithi120.stdout:3/458: dread dd/d40/f50 [0,4194304] 0 2024-04-26T21:25:54.532 INFO:tasks.workunit.client.1.smithi120.stdout:3/459: read - dd/de/d18/d2c/d76/d3b/d56/d75/f7b zero size 2024-04-26T21:25:54.533 INFO:tasks.workunit.client.1.smithi120.stdout:9/499: mknod d0/dd/d45/ca1 0 2024-04-26T21:25:54.536 INFO:tasks.workunit.client.1.smithi120.stdout:6/526: symlink d4/db/d10/dd/d28/lb0 0 2024-04-26T21:25:54.539 INFO:tasks.workunit.client.1.smithi120.stdout:4/483: dwrite d10/f5b [0,4194304] 0 2024-04-26T21:25:54.540 INFO:tasks.workunit.client.1.smithi120.stdout:6/527: write d4/d3d/f83 [3529849,14758] 0 2024-04-26T21:25:54.540 INFO:tasks.workunit.client.1.smithi120.stdout:0/568: truncate d0/d3/d13/f1f 5156550 0 2024-04-26T21:25:54.542 INFO:tasks.workunit.client.0.smithi084.stdout:3/312: creat d1/d2c/d2f/f6d x:0 0 0 2024-04-26T21:25:54.547 INFO:tasks.workunit.client.1.smithi120.stdout:9/500: unlink d0/d6/l20 0 2024-04-26T21:25:54.549 INFO:tasks.workunit.client.0.smithi084.stdout:2/393: rename d6/d7/d3d/d15/d1f/l6e to d6/d7/d3d/d15/d1f/d39/l8c 0 2024-04-26T21:25:54.550 INFO:tasks.workunit.client.0.smithi084.stdout:0/260: stat de/d1c/d32/f3d 0 2024-04-26T21:25:54.551 INFO:tasks.workunit.client.0.smithi084.stdout:0/261: read f6 [1241982,42252] 0 2024-04-26T21:25:54.552 INFO:tasks.workunit.client.1.smithi120.stdout:6/528: creat d4/db/d10/dd/d4e/d60/fb1 x:0 0 0 2024-04-26T21:25:54.552 INFO:tasks.workunit.client.0.smithi084.stdout:3/313: symlink d1/d2c/d2f/d31/d55/d4e/l6e 0 2024-04-26T21:25:54.554 INFO:tasks.workunit.client.0.smithi084.stdout:3/314: stat d1/f22 0 2024-04-26T21:25:54.555 INFO:tasks.workunit.client.1.smithi120.stdout:5/567: dwrite d2/dc/d1d/d21/d66/f14 [0,4194304] 0 2024-04-26T21:25:54.557 INFO:tasks.workunit.client.0.smithi084.stdout:3/315: write d1/d2c/d2f/f2e [1473465,32110] 0 2024-04-26T21:25:54.557 INFO:tasks.workunit.client.0.smithi084.stdout:2/394: symlink d6/d7/d3d/d15/d1f/d6c/l8d 0 2024-04-26T21:25:54.559 INFO:tasks.workunit.client.1.smithi120.stdout:3/460: getdents dd/de 0 2024-04-26T21:25:54.561 INFO:tasks.workunit.client.0.smithi084.stdout:0/262: unlink de/d20/l37 0 2024-04-26T21:25:54.562 INFO:tasks.workunit.client.0.smithi084.stdout:2/395: symlink d6/l8e 0 2024-04-26T21:25:54.563 INFO:tasks.workunit.client.1.smithi120.stdout:6/529: rename d4/db/d10/dd/f26 to d4/db/d10/d22/d56/d94/fb2 0 2024-04-26T21:25:54.564 INFO:tasks.workunit.client.0.smithi084.stdout:3/316: write d1/d24/d27/f53 [1339393,9587] 0 2024-04-26T21:25:54.564 INFO:tasks.workunit.client.1.smithi120.stdout:4/484: link d10/d28/l30 d10/d65/d72/d86/la5 0 2024-04-26T21:25:54.564 INFO:tasks.workunit.client.0.smithi084.stdout:2/396: dread - d6/d7/d68/f78 zero size 2024-04-26T21:25:54.565 INFO:tasks.workunit.client.1.smithi120.stdout:3/461: write dd/de/df/d12/d6c/f39 [1008688,69169] 0 2024-04-26T21:25:54.566 INFO:tasks.workunit.client.0.smithi084.stdout:3/317: fdatasync d1/f23 0 2024-04-26T21:25:54.569 INFO:tasks.workunit.client.0.smithi084.stdout:0/263: dread de/f12 [0,4194304] 0 2024-04-26T21:25:54.569 INFO:tasks.workunit.client.1.smithi120.stdout:6/530: readlink d4/db/d10/la6 0 2024-04-26T21:25:54.570 INFO:tasks.workunit.client.0.smithi084.stdout:2/397: creat d6/d3e/d67/f8f x:0 0 0 2024-04-26T21:25:54.571 INFO:tasks.workunit.client.1.smithi120.stdout:5/568: symlink d2/dc/d1d/d21/d77/d9c/lcc 0 2024-04-26T21:25:54.573 INFO:tasks.workunit.client.1.smithi120.stdout:2/519: dwrite d4/d1b/f41 [0,4194304] 0 2024-04-26T21:25:54.574 INFO:tasks.workunit.client.0.smithi084.stdout:2/398: readlink d6/d7/d3d/d15/d1f/d39/d20/d36/l62 0 2024-04-26T21:25:54.575 INFO:tasks.workunit.client.0.smithi084.stdout:3/318: unlink d1/l2d 0 2024-04-26T21:25:54.577 INFO:tasks.workunit.client.1.smithi120.stdout:5/569: chown d2/f5a 2395247 1 2024-04-26T21:25:54.579 INFO:tasks.workunit.client.1.smithi120.stdout:4/485: mkdir d10/da6 0 2024-04-26T21:25:54.582 INFO:tasks.workunit.client.1.smithi120.stdout:5/570: rmdir d2/dc/d1d/d21/d66/d6a 39 2024-04-26T21:25:54.582 INFO:tasks.workunit.client.1.smithi120.stdout:0/569: dwrite d0/d3/dc/dd/d1b/daa/fbe [0,4194304] 0 2024-04-26T21:25:54.585 INFO:tasks.workunit.client.1.smithi120.stdout:5/571: write d2/d30/f8b [698442,66798] 0 2024-04-26T21:25:54.590 INFO:tasks.workunit.client.0.smithi084.stdout:0/264: link de/d2b/d45/l50 de/d2b/d45/l5c 0 2024-04-26T21:25:54.591 INFO:tasks.workunit.client.1.smithi120.stdout:9/501: rmdir d0/d6 39 2024-04-26T21:25:54.591 INFO:tasks.workunit.client.1.smithi120.stdout:2/520: mknod d4/d1b/cad 0 2024-04-26T21:25:54.592 INFO:tasks.workunit.client.1.smithi120.stdout:5/572: chown d2/d82/f91 13184 1 2024-04-26T21:25:54.596 INFO:tasks.workunit.client.1.smithi120.stdout:5/573: write d2/dc/f38 [4029871,75925] 0 2024-04-26T21:25:54.599 INFO:tasks.workunit.client.0.smithi084.stdout:0/265: chown de/c16 1 1 2024-04-26T21:25:54.600 INFO:tasks.workunit.client.1.smithi120.stdout:3/462: dwrite dd/de/d83/d64/f84 [0,4194304] 0 2024-04-26T21:25:54.600 INFO:tasks.workunit.client.1.smithi120.stdout:6/531: getdents d4/db/d10/dd/d28/d9e 0 2024-04-26T21:25:54.602 INFO:tasks.workunit.client.1.smithi120.stdout:3/463: fsync dd/de/d18/d2c/f8a 0 2024-04-26T21:25:54.603 INFO:tasks.workunit.client.0.smithi084.stdout:3/319: dwrite d1/d24/f25 [0,4194304] 0 2024-04-26T21:25:54.604 INFO:tasks.workunit.client.1.smithi120.stdout:3/464: write dd/d2a/f8b [762490,74144] 0 2024-04-26T21:25:54.605 INFO:tasks.workunit.client.1.smithi120.stdout:9/502: creat d0/dd/d3a/d5c/d9f/fa2 x:0 0 0 2024-04-26T21:25:54.605 INFO:tasks.workunit.client.0.smithi084.stdout:3/320: truncate d1/d24/f36 858230 0 2024-04-26T21:25:54.607 INFO:tasks.workunit.client.1.smithi120.stdout:9/503: dread d0/dd/f62 [0,4194304] 0 2024-04-26T21:25:54.608 INFO:tasks.workunit.client.1.smithi120.stdout:2/521: rmdir d4/d1b/d2e/d50/d14/d15/d6c 39 2024-04-26T21:25:54.608 INFO:tasks.workunit.client.1.smithi120.stdout:5/574: symlink d2/d1b/d89/d6b/lcd 0 2024-04-26T21:25:54.612 INFO:tasks.workunit.client.0.smithi084.stdout:8/305: sync 2024-04-26T21:25:54.612 INFO:tasks.workunit.client.0.smithi084.stdout:5/257: sync 2024-04-26T21:25:54.612 INFO:tasks.workunit.client.0.smithi084.stdout:3/321: symlink d1/d24/d27/l6f 0 2024-04-26T21:25:54.619 INFO:tasks.workunit.client.1.smithi120.stdout:5/575: truncate d2/dc/d1d/f33 3546612 0 2024-04-26T21:25:54.620 INFO:tasks.workunit.client.1.smithi120.stdout:6/532: mkdir d4/db/d10/dd/db3 0 2024-04-26T21:25:54.627 INFO:tasks.workunit.client.1.smithi120.stdout:3/465: dwrite dd/de/d18/f85 [0,4194304] 0 2024-04-26T21:25:54.627 INFO:tasks.workunit.client.0.smithi084.stdout:5/258: link d0/dc/df/d2a/f46 d0/dc/df/d31/f4c 0 2024-04-26T21:25:54.627 INFO:tasks.workunit.client.0.smithi084.stdout:0/266: dwrite de/d1c/f3c [0,4194304] 0 2024-04-26T21:25:54.630 INFO:tasks.workunit.client.0.smithi084.stdout:5/259: mkdir d0/d49/d4d 0 2024-04-26T21:25:54.631 INFO:tasks.workunit.client.0.smithi084.stdout:5/260: chown d0/d49 5890531 1 2024-04-26T21:25:54.632 INFO:tasks.workunit.client.0.smithi084.stdout:0/267: chown de/d20/f24 51 1 2024-04-26T21:25:54.636 INFO:tasks.workunit.client.1.smithi120.stdout:2/522: unlink d4/d1b/d2e/d50/d14/d15/d6c/f97 0 2024-04-26T21:25:54.638 INFO:tasks.workunit.client.0.smithi084.stdout:5/261: chown d0/dc/df/d2a/f40 31 1 2024-04-26T21:25:54.638 INFO:tasks.workunit.client.0.smithi084.stdout:5/262: fsync d0/dc/f2f 0 2024-04-26T21:25:54.638 INFO:tasks.workunit.client.1.smithi120.stdout:9/504: dwrite d0/dd/f62 [0,4194304] 0 2024-04-26T21:25:54.642 INFO:tasks.workunit.client.0.smithi084.stdout:8/306: dread d4/f1c [0,4194304] 0 2024-04-26T21:25:54.643 INFO:tasks.workunit.client.0.smithi084.stdout:5/263: symlink d0/d49/l4e 0 2024-04-26T21:25:54.655 INFO:tasks.workunit.client.1.smithi120.stdout:5/576: dread d2/dc/d1d/d21/d66/fc2 [0,4194304] 0 2024-04-26T21:25:54.657 INFO:tasks.workunit.client.1.smithi120.stdout:5/577: dread - d2/d1b/d89/d6b/f95 zero size 2024-04-26T21:25:54.668 INFO:tasks.workunit.client.0.smithi084.stdout:5/264: dwrite d0/dc/df/f44 [4194304,4194304] 0 2024-04-26T21:25:54.670 INFO:tasks.workunit.client.0.smithi084.stdout:0/268: dwrite de/d1c/d32/f51 [0,4194304] 0 2024-04-26T21:25:54.678 INFO:tasks.workunit.client.0.smithi084.stdout:3/322: dread d1/d24/d27/f30 [0,4194304] 0 2024-04-26T21:25:54.681 INFO:tasks.workunit.client.0.smithi084.stdout:5/265: fdatasync d0/d17/f20 0 2024-04-26T21:25:54.681 INFO:tasks.workunit.client.0.smithi084.stdout:0/269: rename de/c16 to de/d1c/c5d 0 2024-04-26T21:25:54.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:54 smithi120 ceph-mon[32741]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:25:54.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:54 smithi120 ceph-mon[32741]: from='client.24441 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:25:54.683 INFO:tasks.workunit.client.0.smithi084.stdout:3/323: unlink d1/c50 0 2024-04-26T21:25:54.684 INFO:tasks.workunit.client.0.smithi084.stdout:5/266: truncate d0/dc/f1c 1097119 0 2024-04-26T21:25:54.691 INFO:tasks.workunit.client.0.smithi084.stdout:3/324: creat d1/d2c/d2f/d31/d3b/f70 x:0 0 0 2024-04-26T21:25:54.703 INFO:tasks.workunit.client.0.smithi084.stdout:0/270: dread de/f12 [0,4194304] 0 2024-04-26T21:25:54.705 INFO:tasks.workunit.client.0.smithi084.stdout:5/267: dwrite d0/dc/df/f44 [4194304,4194304] 0 2024-04-26T21:25:54.711 INFO:tasks.workunit.client.0.smithi084.stdout:3/325: write d1/d2c/d2f/d31/d52/f60 [527303,104486] 0 2024-04-26T21:25:54.713 INFO:tasks.workunit.client.1.smithi120.stdout:3/466: dread dd/de/d18/d24/f23 [0,4194304] 0 2024-04-26T21:25:54.716 INFO:tasks.workunit.client.0.smithi084.stdout:5/268: readlink d0/dc/df/l13 0 2024-04-26T21:25:54.721 INFO:tasks.workunit.client.0.smithi084.stdout:5/269: symlink d0/dc/l4f 0 2024-04-26T21:25:54.723 INFO:tasks.workunit.client.0.smithi084.stdout:3/326: getdents d1/d2c/d2f/d31/d3b 0 2024-04-26T21:25:54.723 INFO:tasks.workunit.client.1.smithi120.stdout:5/578: unlink d2/d48/d63/la0 0 2024-04-26T21:25:54.727 INFO:tasks.workunit.client.0.smithi084.stdout:3/327: write d1/d24/d27/f2b [1878703,17702] 0 2024-04-26T21:25:54.727 INFO:tasks.workunit.client.0.smithi084.stdout:0/271: link de/d1c/f1d de/d20/f5e 0 2024-04-26T21:25:54.728 INFO:tasks.workunit.client.1.smithi120.stdout:6/533: creat d4/db/d25/d6d/fb4 x:0 0 0 2024-04-26T21:25:54.729 INFO:tasks.workunit.client.0.smithi084.stdout:5/270: fsync d0/dc/df/f24 0 2024-04-26T21:25:54.731 INFO:tasks.workunit.client.0.smithi084.stdout:3/328: readlink d1/d2c/d2f/d31/d3b/l6b 0 2024-04-26T21:25:54.731 INFO:tasks.workunit.client.0.smithi084.stdout:3/329: stat d1/f1a 0 2024-04-26T21:25:54.732 INFO:tasks.workunit.client.1.smithi120.stdout:3/467: mkdir dd/de/df/d12/d48/d9b 0 2024-04-26T21:25:54.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.733+0000 7f9849000700 1 -- 172.21.15.84:0/1786735416 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98440fe080 msgr2=0x7f98440fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:54.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.733+0000 7f9849000700 1 --2- 172.21.15.84:0/1786735416 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98440fe080 0x7f98440fe4f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9830004940 tx=0x7f9830009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:54.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.733+0000 7f9849000700 1 -- 172.21.15.84:0/1786735416 shutdown_connections 2024-04-26T21:25:54.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.733+0000 7f9849000700 1 --2- 172.21.15.84:0/1786735416 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98440fe080 0x7f98440fe4f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:54.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.733+0000 7f9849000700 1 --2- 172.21.15.84:0/1786735416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98440fcf10 0x7f98440fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:54.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.733+0000 7f9849000700 1 -- 172.21.15.84:0/1786735416 >> 172.21.15.84:0/1786735416 conn(0x7f98440f8560 msgr2=0x7f98440fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:54.737 INFO:tasks.workunit.client.1.smithi120.stdout:9/505: rename d0/d6/d3d/l68 to d0/d6/d4d/la3 0 2024-04-26T21:25:54.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.737+0000 7f9849000700 1 -- 172.21.15.84:0/1786735416 shutdown_connections 2024-04-26T21:25:54.738 INFO:tasks.workunit.client.0.smithi084.stdout:0/272: mknod de/d1c/c5f 0 2024-04-26T21:25:54.738 INFO:tasks.workunit.client.0.smithi084.stdout:1/306: sync 2024-04-26T21:25:54.738 INFO:tasks.workunit.client.0.smithi084.stdout:7/281: sync 2024-04-26T21:25:54.738 INFO:tasks.workunit.client.0.smithi084.stdout:9/225: sync 2024-04-26T21:25:54.738 INFO:tasks.workunit.client.0.smithi084.stdout:6/326: sync 2024-04-26T21:25:54.738 INFO:tasks.workunit.client.0.smithi084.stdout:4/210: sync 2024-04-26T21:25:54.740 INFO:tasks.workunit.client.1.smithi120.stdout:5/579: dwrite d2/dc/d1d/d1f/fb0 [0,4194304] 0 2024-04-26T21:25:54.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.737+0000 7f9849000700 1 -- 172.21.15.84:0/1786735416 wait complete. 2024-04-26T21:25:54.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.739+0000 7f9849000700 1 Processor -- start 2024-04-26T21:25:54.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.741+0000 7f9849000700 1 -- start start 2024-04-26T21:25:54.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.742+0000 7f9849000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98440fcf10 0x7f984410b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:54.742 INFO:tasks.workunit.client.0.smithi084.stdout:0/273: write de/d20/f24 [390856,44026] 0 2024-04-26T21:25:54.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.742+0000 7f9849000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98440fe080 0x7f984410bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:54.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.743+0000 7f9849000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984410c390 con 0x7f98440fcf10 2024-04-26T21:25:54.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.743+0000 7f9849000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984410cbe0 con 0x7f98440fe080 2024-04-26T21:25:54.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.743+0000 7f9841400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98440fe080 0x7f984410bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:54.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.743+0000 7f9841400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98440fe080 0x7f984410bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:54964/0 (socket says 172.21.15.84:54964) 2024-04-26T21:25:54.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.743+0000 7f9841400700 1 -- 172.21.15.84:0/2665307601 learned_addr learned my addr 172.21.15.84:0/2665307601 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:25:54.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.743+0000 7f9841e00700 1 --2- 172.21.15.84:0/2665307601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98440fcf10 0x7f984410b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:54.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.744+0000 7f9841e00700 1 -- 172.21.15.84:0/2665307601 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98440fe080 msgr2=0x7f984410bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:54.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.744+0000 7f9841e00700 1 --2- 172.21.15.84:0/2665307601 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98440fe080 0x7f984410bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:54.746 INFO:tasks.workunit.client.0.smithi084.stdout:7/282: creat d6/d26/d40/f5e x:0 0 0 2024-04-26T21:25:54.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.744+0000 7f9841e00700 1 -- 172.21.15.84:0/2665307601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9830005040 con 0x7f98440fcf10 2024-04-26T21:25:54.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.745+0000 7f9841e00700 1 --2- 172.21.15.84:0/2665307601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98440fcf10 0x7f984410b800 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f983400c800 tx=0x7f9834004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:54.747 INFO:tasks.workunit.client.0.smithi084.stdout:1/307: read - d2/d9/d17/d2a/d2c/d45/f4a zero size 2024-04-26T21:25:54.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.745+0000 7f983a000700 1 -- 172.21.15.84:0/2665307601 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f983400a760 con 0x7f98440fcf10 2024-04-26T21:25:54.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.745+0000 7f9849000700 1 -- 172.21.15.84:0/2665307601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984410cec0 con 0x7f98440fcf10 2024-04-26T21:25:54.748 INFO:tasks.workunit.client.0.smithi084.stdout:5/271: getdents d0/dc/df 0 2024-04-26T21:25:54.749 INFO:tasks.workunit.client.0.smithi084.stdout:6/327: fdatasync d3/d18/f2b 0 2024-04-26T21:25:54.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.746+0000 7f983a000700 1 -- 172.21.15.84:0/2665307601 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f983400ad90 con 0x7f98440fcf10 2024-04-26T21:25:54.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.746+0000 7f983a000700 1 -- 172.21.15.84:0/2665307601 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98340113a0 con 0x7f98440fcf10 2024-04-26T21:25:54.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.747+0000 7f9849000700 1 -- 172.21.15.84:0/2665307601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984410d480 con 0x7f98440fcf10 2024-04-26T21:25:54.750 INFO:tasks.workunit.client.0.smithi084.stdout:8/307: dread d4/f13 [0,4194304] 0 2024-04-26T21:25:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.749+0000 7f9849000700 1 -- 172.21.15.84:0/2665307601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9844101a10 con 0x7f98440fcf10 2024-04-26T21:25:54.752 INFO:tasks.workunit.client.0.smithi084.stdout:9/226: link da/f14 da/de/d16/d25/f52 0 2024-04-26T21:25:54.754 INFO:tasks.workunit.client.0.smithi084.stdout:4/211: creat d5/d7/d17/f4b x:0 0 0 2024-04-26T21:25:54.754 INFO:tasks.workunit.client.0.smithi084.stdout:6/328: write d3/de/d41/f52 [4331787,21881] 0 2024-04-26T21:25:54.754 INFO:tasks.workunit.client.0.smithi084.stdout:0/274: read de/d1c/f33 [538670,100595] 0 2024-04-26T21:25:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.753+0000 7f983a000700 1 -- 172.21.15.84:0/2665307601 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f9834012400 con 0x7f98440fcf10 2024-04-26T21:25:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.754+0000 7f983a000700 1 --2- 172.21.15.84:0/2665307601 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f982806bcf0 0x7f982806e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.754+0000 7f983a000700 1 -- 172.21.15.84:0/2665307601 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f983408aa90 con 0x7f98440fcf10 2024-04-26T21:25:54.756 INFO:tasks.workunit.client.0.smithi084.stdout:6/329: chown d3/de/c47 1722763 1 2024-04-26T21:25:54.757 INFO:tasks.workunit.client.0.smithi084.stdout:5/272: rename d0/dc/df/l42 to d0/dc/df/d2a/l50 0 2024-04-26T21:25:54.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.757+0000 7f9841400700 1 --2- 172.21.15.84:0/2665307601 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f982806bcf0 0x7f982806e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:54.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.758+0000 7f9841400700 1 --2- 172.21.15.84:0/2665307601 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f982806bcf0 0x7f982806e1a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9830004f90 tx=0x7f9830009e30 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:54.761 INFO:tasks.workunit.client.0.smithi084.stdout:6/330: unlink d3/de/d15/d23/c27 0 2024-04-26T21:25:54.763 INFO:tasks.workunit.client.1.smithi120.stdout:9/506: mknod d0/d6/d3d/ca4 0 2024-04-26T21:25:54.764 INFO:tasks.workunit.client.1.smithi120.stdout:2/523: write d4/d1b/d2e/d50/d14/d15/f2b [2833184,95698] 0 2024-04-26T21:25:54.767 INFO:tasks.workunit.client.0.smithi084.stdout:7/283: link d6/dc/l50 d6/d26/d40/d41/l5f 0 2024-04-26T21:25:54.768 INFO:tasks.workunit.client.0.smithi084.stdout:0/275: write de/d1c/f33 [2765175,83228] 0 2024-04-26T21:25:54.768 INFO:tasks.workunit.client.0.smithi084.stdout:4/212: creat d5/f4c x:0 0 0 2024-04-26T21:25:54.770 INFO:tasks.workunit.client.1.smithi120.stdout:0/570: truncate d0/d3/d13/f1f 1506748 0 2024-04-26T21:25:54.772 INFO:tasks.workunit.client.0.smithi084.stdout:1/308: dwrite d2/d9/f14 [0,4194304] 0 2024-04-26T21:25:54.772 INFO:tasks.workunit.client.0.smithi084.stdout:9/227: getdents da/de/d1e 0 2024-04-26T21:25:54.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:54.773+0000 7f983a000700 1 -- 172.21.15.84:0/2665307601 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f9834054110 con 0x7f98440fcf10 2024-04-26T21:25:54.774 INFO:tasks.workunit.client.0.smithi084.stdout:6/331: rename d3/d18/d37/c50 to d3/de/c73 0 2024-04-26T21:25:54.778 INFO:tasks.workunit.client.1.smithi120.stdout:2/524: dread d4/d1b/f41 [0,4194304] 0 2024-04-26T21:25:54.778 INFO:tasks.workunit.client.0.smithi084.stdout:7/284: unlink d6/dc/f3b 0 2024-04-26T21:25:54.778 INFO:tasks.workunit.client.1.smithi120.stdout:3/468: creat dd/de/d18/d37/d80/f9c x:0 0 0 2024-04-26T21:25:54.781 INFO:tasks.workunit.client.0.smithi084.stdout:7/285: write d6/d26/d40/f5b [69048,117130] 0 2024-04-26T21:25:54.783 INFO:tasks.workunit.client.0.smithi084.stdout:1/309: rename d2/d9/d17 to d2/d54/d5e/d66 0 2024-04-26T21:25:54.786 INFO:tasks.workunit.client.0.smithi084.stdout:9/228: unlink da/de/d16/l44 0 2024-04-26T21:25:54.787 INFO:tasks.workunit.client.0.smithi084.stdout:6/332: creat d3/de/d15/d5f/f74 x:0 0 0 2024-04-26T21:25:54.790 INFO:tasks.workunit.client.0.smithi084.stdout:8/308: dwrite d4/d6/db/d1e/d22/d2f/f2c [0,4194304] 0 2024-04-26T21:25:54.795 INFO:tasks.workunit.client.1.smithi120.stdout:2/525: fsync d4/d1b/d25/d2c/d3e/f9a 0 2024-04-26T21:25:54.796 INFO:tasks.workunit.client.0.smithi084.stdout:6/333: mkdir d3/de/d1a/d43/d75 0 2024-04-26T21:25:54.796 INFO:tasks.workunit.client.0.smithi084.stdout:4/213: dread d5/d7/d17/f27 [0,4194304] 0 2024-04-26T21:25:54.797 INFO:tasks.workunit.client.1.smithi120.stdout:2/526: fdatasync d4/d1b/d25/f31 0 2024-04-26T21:25:54.798 INFO:tasks.workunit.client.1.smithi120.stdout:3/469: rename dd/de/d18/d37/d7c to dd/de/d18/d24/d9d 0 2024-04-26T21:25:54.802 INFO:tasks.workunit.client.0.smithi084.stdout:8/309: mkdir d4/d7/d15/d37/d52/d5b 0 2024-04-26T21:25:54.804 INFO:tasks.workunit.client.0.smithi084.stdout:4/214: creat d5/d2e/f4d x:0 0 0 2024-04-26T21:25:54.808 INFO:tasks.workunit.client.1.smithi120.stdout:4/486: sync 2024-04-26T21:25:54.808 INFO:tasks.workunit.client.1.smithi120.stdout:8/471: sync 2024-04-26T21:25:54.808 INFO:tasks.workunit.client.1.smithi120.stdout:1/455: sync 2024-04-26T21:25:54.808 INFO:tasks.workunit.client.1.smithi120.stdout:7/495: sync 2024-04-26T21:25:54.809 INFO:tasks.workunit.client.0.smithi084.stdout:8/310: write d4/f12 [4464570,118644] 0 2024-04-26T21:25:54.810 INFO:tasks.workunit.client.0.smithi084.stdout:6/334: creat d3/de/d15/f76 x:0 0 0 2024-04-26T21:25:54.811 INFO:tasks.workunit.client.0.smithi084.stdout:4/215: dread d5/d10/d15/d21/d29/f3c [0,4194304] 0 2024-04-26T21:25:54.811 INFO:tasks.workunit.client.1.smithi120.stdout:3/470: mknod dd/de/df/d12/d48/d6d/c9e 0 2024-04-26T21:25:54.815 INFO:tasks.workunit.client.1.smithi120.stdout:7/496: dread - d7/d64/da6/d1a/d50/f93 zero size 2024-04-26T21:25:54.816 INFO:tasks.workunit.client.1.smithi120.stdout:1/456: readlink d6/d7/d1d/d5d/d67/l29 0 2024-04-26T21:25:54.817 INFO:tasks.workunit.client.1.smithi120.stdout:9/507: write d0/dd/d3a/f46 [1258996,70944] 0 2024-04-26T21:25:54.819 INFO:tasks.workunit.client.0.smithi084.stdout:7/286: getdents d6/d26/d40/d41 0 2024-04-26T21:25:54.821 INFO:tasks.workunit.client.1.smithi120.stdout:7/497: chown d7/d64/da6/d1f/d28/d4c/d6c 944 1 2024-04-26T21:25:54.821 INFO:tasks.workunit.client.1.smithi120.stdout:4/487: creat d10/d12/fa7 x:0 0 0 2024-04-26T21:25:54.822 INFO:tasks.workunit.client.1.smithi120.stdout:5/580: dread d2/d30/f2f [0,4194304] 0 2024-04-26T21:25:54.824 INFO:tasks.workunit.client.1.smithi120.stdout:7/498: chown d7/d19/f44 330035686 1 2024-04-26T21:25:54.825 INFO:tasks.workunit.client.0.smithi084.stdout:8/311: symlink d4/d3a/l5c 0 2024-04-26T21:25:54.827 INFO:tasks.workunit.client.1.smithi120.stdout:3/471: unlink dd/de/d18/l7e 0 2024-04-26T21:25:54.829 INFO:tasks.workunit.client.1.smithi120.stdout:6/534: dwrite d4/db/f23 [0,4194304] 0 2024-04-26T21:25:54.829 INFO:tasks.workunit.client.1.smithi120.stdout:5/581: chown d2/dc/d1d/d1f/d36/d44/d6c/c5d 1018 1 2024-04-26T21:25:54.829 INFO:tasks.workunit.client.0.smithi084.stdout:7/287: mkdir d6/d9/d12/d19/d60 0 2024-04-26T21:25:54.832 INFO:tasks.workunit.client.1.smithi120.stdout:7/499: creat d7/d64/fae x:0 0 0 2024-04-26T21:25:54.832 INFO:tasks.workunit.client.0.smithi084.stdout:7/288: fsync d6/d9/d12/f33 0 2024-04-26T21:25:54.833 INFO:tasks.workunit.client.0.smithi084.stdout:5/273: getdents d0/dc/df/d31/d45 0 2024-04-26T21:25:54.836 INFO:tasks.workunit.client.0.smithi084.stdout:1/310: mkdir d2/d9/d67 0 2024-04-26T21:25:54.839 INFO:tasks.workunit.client.1.smithi120.stdout:1/457: link d6/d9/f84 d6/d7/d1d/f9b 0 2024-04-26T21:25:54.839 INFO:tasks.workunit.client.0.smithi084.stdout:0/276: dwrite de/d20/d4e/f5a [0,4194304] 0 2024-04-26T21:25:54.841 INFO:tasks.workunit.client.1.smithi120.stdout:2/527: write d4/d1b/d2e/d50/f3f [2071546,109784] 0 2024-04-26T21:25:54.842 INFO:tasks.workunit.client.0.smithi084.stdout:4/216: dread d5/d10/f1b [0,4194304] 0 2024-04-26T21:25:54.842 INFO:tasks.workunit.client.0.smithi084.stdout:1/311: fsync d2/d19/f4d 0 2024-04-26T21:25:54.842 INFO:tasks.workunit.client.0.smithi084.stdout:5/274: mkdir d0/dc/df/d51 0 2024-04-26T21:25:54.842 INFO:tasks.workunit.client.1.smithi120.stdout:4/488: mknod d10/d6b/da4/ca8 0 2024-04-26T21:25:54.844 INFO:tasks.workunit.client.0.smithi084.stdout:7/289: write d6/d9/f35 [736734,9545] 0 2024-04-26T21:25:54.844 INFO:tasks.workunit.client.1.smithi120.stdout:5/582: truncate d2/f70 287408 0 2024-04-26T21:25:54.845 INFO:tasks.workunit.client.1.smithi120.stdout:2/528: chown d4/d1b/d56 13 1 2024-04-26T21:25:54.845 INFO:tasks.workunit.client.1.smithi120.stdout:3/472: write dd/d2a/d4a/f59 [1188228,51654] 0 2024-04-26T21:25:54.846 INFO:tasks.workunit.client.0.smithi084.stdout:4/217: fdatasync d5/d10/f1b 0 2024-04-26T21:25:54.846 INFO:tasks.workunit.client.0.smithi084.stdout:0/277: readlink de/d1c/l55 0 2024-04-26T21:25:54.848 INFO:tasks.workunit.client.0.smithi084.stdout:8/312: creat d4/d6/db/d1e/d22/f5d x:0 0 0 2024-04-26T21:25:54.848 INFO:tasks.workunit.client.0.smithi084.stdout:9/229: dread da/de/d16/d25/f52 [0,4194304] 0 2024-04-26T21:25:54.848 INFO:tasks.workunit.client.0.smithi084.stdout:5/275: chown d0/d49/l4e 111927 1 2024-04-26T21:25:54.850 INFO:tasks.workunit.client.1.smithi120.stdout:9/508: creat d0/d14/d2d/fa5 x:0 0 0 2024-04-26T21:25:54.852 INFO:tasks.workunit.client.1.smithi120.stdout:0/571: dwrite d0/d3/dc/dd/f54 [4194304,4194304] 0 2024-04-26T21:25:54.853 INFO:tasks.workunit.client.0.smithi084.stdout:0/278: creat de/d20/d4e/f60 x:0 0 0 2024-04-26T21:25:54.854 INFO:tasks.workunit.client.0.smithi084.stdout:7/290: write d6/d9/ff [1091154,98331] 0 2024-04-26T21:25:54.855 INFO:tasks.workunit.client.1.smithi120.stdout:2/529: chown d4/d1b/d2e/d50/d14/d15/d6c/c7f 88 1 2024-04-26T21:25:54.855 INFO:tasks.workunit.client.1.smithi120.stdout:8/472: getdents d5/d6 0 2024-04-26T21:25:54.855 INFO:tasks.workunit.client.0.smithi084.stdout:4/218: fdatasync d5/f2b 0 2024-04-26T21:25:54.857 INFO:tasks.workunit.client.1.smithi120.stdout:7/500: symlink d7/d64/da6/d1f/d7d/d8b/d94/laf 0 2024-04-26T21:25:54.859 INFO:tasks.workunit.client.0.smithi084.stdout:8/313: truncate d4/d6/f40 340029 0 2024-04-26T21:25:54.859 INFO:tasks.workunit.client.0.smithi084.stdout:5/276: write d0/dc/df/f44 [1161877,15036] 0 2024-04-26T21:25:54.860 INFO:tasks.workunit.client.1.smithi120.stdout:6/535: rename d4/db/d10/f15 to d4/db/d10/dd/db3/fb5 0 2024-04-26T21:25:54.860 INFO:tasks.workunit.client.1.smithi120.stdout:0/572: chown d0/d3/dc/d12/f3b 0 1 2024-04-26T21:25:54.861 INFO:tasks.workunit.client.0.smithi084.stdout:1/312: getdents d2/d9/d15 0 2024-04-26T21:25:54.862 INFO:tasks.workunit.client.1.smithi120.stdout:7/501: readlink d7/d64/da6/l5e 0 2024-04-26T21:25:54.864 INFO:tasks.workunit.client.0.smithi084.stdout:5/277: chown d0/dc/f1c 39 1 2024-04-26T21:25:54.865 INFO:tasks.workunit.client.0.smithi084.stdout:4/219: readlink d5/d7/l38 0 2024-04-26T21:25:54.866 INFO:tasks.workunit.client.1.smithi120.stdout:9/509: creat d0/dd/d34/fa6 x:0 0 0 2024-04-26T21:25:54.866 INFO:tasks.workunit.client.0.smithi084.stdout:6/335: dwrite d3/f26 [4194304,4194304] 0 2024-04-26T21:25:54.867 INFO:tasks.workunit.client.0.smithi084.stdout:7/291: mknod d6/dc/d47/c61 0 2024-04-26T21:25:54.867 INFO:tasks.workunit.client.0.smithi084.stdout:1/313: read d2/d9/d15/f58 [534405,119539] 0 2024-04-26T21:25:54.867 INFO:tasks.workunit.client.1.smithi120.stdout:2/530: symlink d4/d1b/d56/d65/lae 0 2024-04-26T21:25:54.870 INFO:tasks.workunit.client.1.smithi120.stdout:9/510: read d0/d14/d2d/f6c [530913,100493] 0 2024-04-26T21:25:54.872 INFO:tasks.workunit.client.0.smithi084.stdout:1/314: chown d2/d19/d63/d64 1262048247 1 2024-04-26T21:25:54.872 INFO:tasks.workunit.client.0.smithi084.stdout:8/314: creat d4/d6/db/d1e/d22/d39/d4a/f5e x:0 0 0 2024-04-26T21:25:54.874 INFO:tasks.workunit.client.0.smithi084.stdout:7/292: stat d6/dc/l16 0 2024-04-26T21:25:54.874 INFO:tasks.workunit.client.0.smithi084.stdout:5/278: mknod d0/c52 0 2024-04-26T21:25:54.875 INFO:tasks.workunit.client.1.smithi120.stdout:1/458: chown d6/d7/d2d/d48/f66 60121955 1 2024-04-26T21:25:54.875 INFO:tasks.workunit.client.0.smithi084.stdout:4/220: rename d5/d7/lf to d5/d7/l4e 0 2024-04-26T21:25:54.880 INFO:tasks.workunit.client.1.smithi120.stdout:5/583: rename d2/d30/l61 to d2/dc/d1d/d21/lce 0 2024-04-26T21:25:54.880 INFO:tasks.workunit.client.1.smithi120.stdout:1/459: chown d6/d7/f59 3637959 1 2024-04-26T21:25:54.880 INFO:tasks.workunit.client.0.smithi084.stdout:0/279: getdents de/d20 0 2024-04-26T21:25:54.880 INFO:tasks.workunit.client.0.smithi084.stdout:0/280: read de/d1c/f3c [1363878,84390] 0 2024-04-26T21:25:54.881 INFO:tasks.workunit.client.0.smithi084.stdout:4/221: dread - d5/d2e/f4d zero size 2024-04-26T21:25:54.882 INFO:tasks.workunit.client.1.smithi120.stdout:6/536: mknod d4/db/d10/d1a/d2b/d57/d67/cb6 0 2024-04-26T21:25:54.883 INFO:tasks.workunit.client.0.smithi084.stdout:9/230: dread da/f23 [0,4194304] 0 2024-04-26T21:25:54.884 INFO:tasks.workunit.client.1.smithi120.stdout:1/460: dread - d6/d7/d1b/d89/d8c/d62/f9a zero size 2024-04-26T21:25:54.885 INFO:tasks.workunit.client.0.smithi084.stdout:0/281: stat de/d20/l52 0 2024-04-26T21:25:54.885 INFO:tasks.workunit.client.1.smithi120.stdout:7/502: creat d7/d64/da6/d1f/d28/d4c/fb0 x:0 0 0 2024-04-26T21:25:54.887 INFO:tasks.workunit.client.0.smithi084.stdout:0/282: readlink de/d20/d4e/l4d 0 2024-04-26T21:25:54.893 INFO:tasks.workunit.client.0.smithi084.stdout:1/315: rename d2/d54/d5e/d66/f60 to d2/d54/d5e/d66/d2a/d2c/d45/f68 0 2024-04-26T21:25:54.894 INFO:tasks.workunit.client.0.smithi084.stdout:4/222: truncate d5/d10/f18 2056549 0 2024-04-26T21:25:54.896 INFO:tasks.workunit.client.1.smithi120.stdout:1/461: mknod d6/d7/d1b/d89/d8c/c9c 0 2024-04-26T21:25:54.897 INFO:tasks.workunit.client.1.smithi120.stdout:7/503: creat d7/d64/da6/d2f/fb1 x:0 0 0 2024-04-26T21:25:54.898 INFO:tasks.workunit.client.0.smithi084.stdout:5/279: mkdir d0/dc/df/d31/d53 0 2024-04-26T21:25:54.899 INFO:tasks.workunit.client.1.smithi120.stdout:6/537: symlink d4/db/d10/dd/d4e/d76/lb7 0 2024-04-26T21:25:54.899 INFO:tasks.workunit.client.1.smithi120.stdout:4/489: dread d10/d28/f8b [0,4194304] 0 2024-04-26T21:25:54.900 INFO:tasks.workunit.client.0.smithi084.stdout:9/231: mknod da/de/c53 0 2024-04-26T21:25:54.901 INFO:tasks.workunit.client.1.smithi120.stdout:2/531: mknod d4/d1b/d2e/d50/d14/d15/caf 0 2024-04-26T21:25:54.901 INFO:tasks.workunit.client.1.smithi120.stdout:9/511: link d0/d14/f24 d0/dd/d34/fa7 0 2024-04-26T21:25:54.903 INFO:tasks.workunit.client.1.smithi120.stdout:0/573: rename d0/d3/d51/d70/d71/c89 to d0/d3/dc/dd/d9b/cc6 0 2024-04-26T21:25:54.905 INFO:tasks.workunit.client.1.smithi120.stdout:4/490: chown d10/d65/d72/d86/c8d 144 1 2024-04-26T21:25:54.905 INFO:tasks.workunit.client.1.smithi120.stdout:6/538: fdatasync d4/db/d10/d22/d6c/fad 0 2024-04-26T21:25:54.906 INFO:tasks.workunit.client.1.smithi120.stdout:0/574: chown d0/d3/dc/d12/d31 84 1 2024-04-26T21:25:54.907 INFO:tasks.workunit.client.1.smithi120.stdout:3/473: dread f5 [0,4194304] 0 2024-04-26T21:25:54.907 INFO:tasks.workunit.client.0.smithi084.stdout:9/232: write da/f34 [33613,1394] 0 2024-04-26T21:25:54.909 INFO:tasks.workunit.client.1.smithi120.stdout:7/504: mknod d7/d64/da6/d2f/cb2 0 2024-04-26T21:25:54.912 INFO:tasks.workunit.client.0.smithi084.stdout:4/223: rename d5/d2e/f4d to d5/d10/d15/d21/d29/d3f/f4f 0 2024-04-26T21:25:54.914 INFO:tasks.workunit.client.0.smithi084.stdout:2/399: sync 2024-04-26T21:25:54.914 INFO:tasks.workunit.client.1.smithi120.stdout:4/491: symlink d10/d12/la9 0 2024-04-26T21:25:54.917 INFO:tasks.workunit.client.1.smithi120.stdout:0/575: fsync d0/d3/dc/d12/f6a 0 2024-04-26T21:25:54.918 INFO:tasks.workunit.client.0.smithi084.stdout:8/315: dwrite d4/d7/d53/f57 [0,4194304] 0 2024-04-26T21:25:54.919 INFO:tasks.workunit.client.0.smithi084.stdout:9/233: symlink da/de/d16/d40/l54 0 2024-04-26T21:25:54.919 INFO:tasks.workunit.client.1.smithi120.stdout:9/512: symlink d0/dd/la8 0 2024-04-26T21:25:54.919 INFO:tasks.workunit.client.1.smithi120.stdout:7/505: truncate d7/d64/da6/d1f/d28/d4c/fb0 694834 0 2024-04-26T21:25:54.920 INFO:tasks.workunit.client.1.smithi120.stdout:1/462: dwrite d6/d14/d6f/f8e [0,4194304] 0 2024-04-26T21:25:54.920 INFO:tasks.workunit.client.0.smithi084.stdout:7/293: truncate d6/f17 4700270 0 2024-04-26T21:25:54.920 INFO:tasks.workunit.client.0.smithi084.stdout:6/336: dwrite d3/de/d15/d40/f60 [0,4194304] 0 2024-04-26T21:25:54.921 INFO:tasks.workunit.client.1.smithi120.stdout:3/474: creat dd/d2a/d74/f9f x:0 0 0 2024-04-26T21:25:54.922 INFO:tasks.workunit.client.1.smithi120.stdout:5/584: getdents d2/dc/d1d/d21/d66/d85 0 2024-04-26T21:25:54.927 INFO:tasks.workunit.client.1.smithi120.stdout:3/475: chown dd/de/df/d12/d48/f93 701 1 2024-04-26T21:25:54.934 INFO:tasks.workunit.client.0.smithi084.stdout:0/283: dwrite de/d2b/f39 [0,4194304] 0 2024-04-26T21:25:54.935 INFO:tasks.workunit.client.0.smithi084.stdout:8/316: fdatasync d4/d6/db/d1e/d22/d2f/f2c 0 2024-04-26T21:25:54.935 INFO:tasks.workunit.client.1.smithi120.stdout:4/492: dwrite d10/d12/f40 [4194304,4194304] 0 2024-04-26T21:25:54.935 INFO:tasks.workunit.client.1.smithi120.stdout:0/576: fdatasync d0/d3/dc/dd/d80/f8c 0 2024-04-26T21:25:54.937 INFO:tasks.workunit.client.0.smithi084.stdout:7/294: chown d6/d9/d12/d19/d20/f44 946827 1 2024-04-26T21:25:54.937 INFO:tasks.workunit.client.1.smithi120.stdout:8/473: dwrite d5/f30 [0,4194304] 0 2024-04-26T21:25:54.938 INFO:tasks.workunit.client.1.smithi120.stdout:6/539: creat d4/db/d10/fb8 x:0 0 0 2024-04-26T21:25:54.939 INFO:tasks.workunit.client.1.smithi120.stdout:9/513: readlink d0/d6/d4d/la3 0 2024-04-26T21:25:54.941 INFO:tasks.workunit.client.1.smithi120.stdout:1/463: fdatasync d6/d9/f1c 0 2024-04-26T21:25:54.943 INFO:tasks.workunit.client.1.smithi120.stdout:5/585: creat d2/d1b/d89/d47/d8a/fcf x:0 0 0 2024-04-26T21:25:54.944 INFO:tasks.workunit.client.0.smithi084.stdout:1/316: truncate d2/d54/d5e/d66/d2a/d2c/d45/f68 379670 0 2024-04-26T21:25:54.948 INFO:tasks.workunit.client.1.smithi120.stdout:5/586: readlink d2/dc/d1d/d21/d77/d9c/lcc 0 2024-04-26T21:25:54.950 INFO:tasks.workunit.client.1.smithi120.stdout:1/464: rmdir d6/d7/d2d/d98 39 2024-04-26T21:25:54.954 INFO:tasks.workunit.client.0.smithi084.stdout:5/280: dwrite d0/dc/df/f24 [4194304,4194304] 0 2024-04-26T21:25:54.955 INFO:tasks.workunit.client.1.smithi120.stdout:0/577: creat d0/d3/dc/dd/d1b/d24/d73/db7/fc7 x:0 0 0 2024-04-26T21:25:54.955 INFO:tasks.workunit.client.1.smithi120.stdout:5/587: stat d2/dc/d1d/d21/d77/d79/db7/f4e 0 2024-04-26T21:25:54.958 INFO:tasks.workunit.client.1.smithi120.stdout:0/578: chown d0/d3/dc/d12/f1a 12 1 2024-04-26T21:25:54.959 INFO:tasks.workunit.client.1.smithi120.stdout:7/506: dwrite d7/d64/da6/f95 [0,4194304] 0 2024-04-26T21:25:54.960 INFO:tasks.workunit.client.0.smithi084.stdout:4/224: getdents d5/d7/d17 0 2024-04-26T21:25:54.961 INFO:tasks.workunit.client.0.smithi084.stdout:3/330: sync 2024-04-26T21:25:54.961 INFO:tasks.workunit.client.1.smithi120.stdout:8/474: read d5/d6/d11/f2a [3036290,123007] 0 2024-04-26T21:25:54.963 INFO:tasks.workunit.client.0.smithi084.stdout:0/284: creat de/d20/d4c/f61 x:0 0 0 2024-04-26T21:25:54.964 INFO:tasks.workunit.client.1.smithi120.stdout:6/540: dread d4/db/d10/dd/d4e/f75 [0,4194304] 0 2024-04-26T21:25:54.968 INFO:tasks.workunit.client.1.smithi120.stdout:1/465: symlink d6/d7/d2d/d98/d35/l9d 0 2024-04-26T21:25:54.971 INFO:tasks.workunit.client.1.smithi120.stdout:5/588: creat d2/dc/d1d/d21/d66/d85/fd0 x:0 0 0 2024-04-26T21:25:54.971 INFO:tasks.workunit.client.0.smithi084.stdout:3/331: creat d1/d2c/f71 x:0 0 0 2024-04-26T21:25:54.975 INFO:tasks.workunit.client.1.smithi120.stdout:0/579: write d0/d3/d13/f20 [2163923,19139] 0 2024-04-26T21:25:54.976 INFO:tasks.workunit.client.0.smithi084.stdout:2/400: dread d6/d7/d3d/d15/d1f/d39/f48 [0,4194304] 0 2024-04-26T21:25:54.978 INFO:tasks.workunit.client.1.smithi120.stdout:5/589: write d2/d48/d63/fcb [13709,121265] 0 2024-04-26T21:25:54.983 INFO:tasks.workunit.client.0.smithi084.stdout:0/285: chown de/d20/f5e 855049287 1 2024-04-26T21:25:54.983 INFO:tasks.workunit.client.0.smithi084.stdout:1/317: mkdir d2/d9/d15/d28/d69 0 2024-04-26T21:25:54.984 INFO:tasks.workunit.client.0.smithi084.stdout:5/281: write d0/dc/f2f [3276701,26284] 0 2024-04-26T21:25:54.986 INFO:tasks.workunit.client.0.smithi084.stdout:8/317: dwrite d4/d7/d15/f30 [0,4194304] 0 2024-04-26T21:25:54.987 INFO:tasks.workunit.client.0.smithi084.stdout:0/286: chown de/d2b/l2c 1 1 2024-04-26T21:25:54.991 INFO:tasks.workunit.client.0.smithi084.stdout:2/401: chown d6/d7/d3d/d15/d1f/d41/f65 105 1 2024-04-26T21:25:54.991 INFO:tasks.workunit.client.1.smithi120.stdout:8/475: symlink d5/l9f 0 2024-04-26T21:25:54.992 INFO:tasks.workunit.client.0.smithi084.stdout:4/225: unlink d5/d7/f16 0 2024-04-26T21:25:54.993 INFO:tasks.workunit.client.1.smithi120.stdout:8/476: fdatasync d5/d6/d11/d52/d27/f38 0 2024-04-26T21:25:54.994 INFO:tasks.workunit.client.0.smithi084.stdout:3/332: symlink d1/d24/d27/d3a/l72 0 2024-04-26T21:25:54.995 INFO:tasks.workunit.client.0.smithi084.stdout:6/337: dread d3/de/d41/f52 [0,4194304] 0 2024-04-26T21:25:54.996 INFO:tasks.workunit.client.1.smithi120.stdout:1/466: mknod d6/d7/d1b/c9e 0 2024-04-26T21:25:54.997 INFO:tasks.workunit.client.0.smithi084.stdout:0/287: read - de/d2b/f3a zero size 2024-04-26T21:25:54.998 INFO:tasks.workunit.client.0.smithi084.stdout:5/282: creat d0/dc/df/d31/f54 x:0 0 0 2024-04-26T21:25:54.999 INFO:tasks.workunit.client.1.smithi120.stdout:6/541: dwrite d4/db/d10/dd/f90 [0,4194304] 0 2024-04-26T21:25:55.001 INFO:tasks.workunit.client.1.smithi120.stdout:0/580: truncate d0/d3/dc/d12/f6a 1951083 0 2024-04-26T21:25:55.003 INFO:tasks.workunit.client.0.smithi084.stdout:7/295: dread d6/d9/f2d [0,4194304] 0 2024-04-26T21:25:55.004 INFO:tasks.workunit.client.1.smithi120.stdout:6/542: truncate d4/db/d10/d22/d6c/f8b 1012036 0 2024-04-26T21:25:55.007 INFO:tasks.workunit.client.1.smithi120.stdout:5/590: rename d2/dc/d1d/d21/d66/d85/fd0 to d2/dc/d1d/d1f/d36/d44/fd1 0 2024-04-26T21:25:55.008 INFO:tasks.workunit.client.0.smithi084.stdout:5/283: chown d0/dc/l1e 104465623 1 2024-04-26T21:25:55.008 INFO:tasks.workunit.client.0.smithi084.stdout:2/402: dread d6/d7/d3d/d15/d1f/d39/d20/d45/f60 [0,4194304] 0 2024-04-26T21:25:55.009 INFO:tasks.workunit.client.0.smithi084.stdout:9/234: dwrite da/de/d16/d40/f4b [0,4194304] 0 2024-04-26T21:25:55.009 INFO:tasks.workunit.client.0.smithi084.stdout:4/226: write d5/d25/f47 [516377,89230] 0 2024-04-26T21:25:55.013 INFO:tasks.workunit.client.0.smithi084.stdout:6/338: creat d3/de/d15/d40/f77 x:0 0 0 2024-04-26T21:25:55.013 INFO:tasks.workunit.client.0.smithi084.stdout:0/288: symlink de/d20/l62 0 2024-04-26T21:25:55.015 INFO:tasks.workunit.client.1.smithi120.stdout:8/477: mknod d5/d6/ca0 0 2024-04-26T21:25:55.017 INFO:tasks.workunit.client.0.smithi084.stdout:4/227: fdatasync d5/d10/f13 0 2024-04-26T21:25:55.019 INFO:tasks.workunit.client.1.smithi120.stdout:1/467: rmdir d6/d14/d3c 39 2024-04-26T21:25:55.021 INFO:tasks.workunit.client.1.smithi120.stdout:4/493: write d10/d28/f56 [573078,122681] 0 2024-04-26T21:25:55.021 INFO:tasks.workunit.client.0.smithi084.stdout:7/296: mknod d6/dc/d47/c62 0 2024-04-26T21:25:55.023 INFO:tasks.workunit.client.0.smithi084.stdout:5/284: chown d0/dc/df/f44 1323352 1 2024-04-26T21:25:55.026 INFO:tasks.workunit.client.1.smithi120.stdout:3/476: dwrite dd/f31 [0,4194304] 0 2024-04-26T21:25:55.031 INFO:tasks.workunit.client.0.smithi084.stdout:9/235: write da/de/d16/d25/f3c [101818,75869] 0 2024-04-26T21:25:55.031 INFO:tasks.workunit.client.0.smithi084.stdout:1/318: dwrite d2/d54/d5e/d66/f36 [0,4194304] 0 2024-04-26T21:25:55.031 INFO:tasks.workunit.client.0.smithi084.stdout:6/339: symlink d3/de/d1a/d43/l78 0 2024-04-26T21:25:55.033 INFO:tasks.workunit.client.0.smithi084.stdout:7/297: mkdir d6/d9/d63 0 2024-04-26T21:25:55.034 INFO:tasks.workunit.client.1.smithi120.stdout:9/514: truncate d0/dd/d3a/f92 224080 0 2024-04-26T21:25:55.036 INFO:tasks.workunit.client.1.smithi120.stdout:5/591: rmdir d2/dc/d1d/d21/d77/d9c 39 2024-04-26T21:25:55.042 INFO:tasks.workunit.client.0.smithi084.stdout:2/403: mkdir d6/d7/d3d/d4f/d90 0 2024-04-26T21:25:55.043 INFO:tasks.workunit.client.0.smithi084.stdout:9/236: dread da/f37 [0,4194304] 0 2024-04-26T21:25:55.049 INFO:tasks.workunit.client.0.smithi084.stdout:4/228: read d5/f1a [1312021,122147] 0 2024-04-26T21:25:55.049 INFO:tasks.workunit.client.0.smithi084.stdout:1/319: creat d2/d9/d67/f6a x:0 0 0 2024-04-26T21:25:55.049 INFO:tasks.workunit.client.1.smithi120.stdout:7/507: dwrite d7/fe [0,4194304] 0 2024-04-26T21:25:55.051 INFO:tasks.workunit.client.1.smithi120.stdout:5/592: mkdir d2/d1b/dd2 0 2024-04-26T21:25:55.052 INFO:tasks.workunit.client.1.smithi120.stdout:7/508: fdatasync d7/d64/da6/d1a/d50/f93 0 2024-04-26T21:25:55.053 INFO:tasks.workunit.client.0.smithi084.stdout:5/285: creat d0/dc/df/d2a/d41/f55 x:0 0 0 2024-04-26T21:25:55.053 INFO:tasks.workunit.client.0.smithi084.stdout:6/340: rename d3/de/c47 to d3/de/d1a/d2f/d4c/d58/c79 0 2024-04-26T21:25:55.053 INFO:tasks.workunit.client.0.smithi084.stdout:8/318: dwrite d4/d6/db/d1e/d22/d2f/f41 [0,4194304] 0 2024-04-26T21:25:55.055 INFO:tasks.workunit.client.1.smithi120.stdout:0/581: creat d0/d3/dc/fc8 x:0 0 0 2024-04-26T21:25:55.056 INFO:tasks.workunit.client.1.smithi120.stdout:5/593: truncate d2/d30/d3b/f94 1746216 0 2024-04-26T21:25:55.056 INFO:tasks.workunit.client.1.smithi120.stdout:7/509: stat d7/d64/da6/d1f/d28/d4c/d6c/d74 0 2024-04-26T21:25:55.058 INFO:tasks.workunit.client.0.smithi084.stdout:9/237: read da/de/d16/f1b [526086,115967] 0 2024-04-26T21:25:55.059 INFO:tasks.workunit.client.0.smithi084.stdout:1/320: write d2/d54/d5e/d66/f2b [6562508,77689] 0 2024-04-26T21:25:55.060 INFO:tasks.workunit.client.1.smithi120.stdout:5/594: write d2/d1b/f26 [2243486,18289] 0 2024-04-26T21:25:55.062 INFO:tasks.workunit.client.1.smithi120.stdout:0/582: truncate d0/f2c 1568948 0 2024-04-26T21:25:55.063 INFO:tasks.workunit.client.1.smithi120.stdout:4/494: link d10/d28/f2b d10/d12/faa 0 2024-04-26T21:25:55.064 INFO:tasks.workunit.client.1.smithi120.stdout:6/543: link d4/db/c9b d4/db/d10/d1a/d2b/d57/d67/cb9 0 2024-04-26T21:25:55.066 INFO:tasks.workunit.client.1.smithi120.stdout:4/495: chown d10/d28/f4b 41684 1 2024-04-26T21:25:55.067 INFO:tasks.workunit.client.0.smithi084.stdout:2/404: creat d6/d7/d3d/d15/d1f/d39/d43/f91 x:0 0 0 2024-04-26T21:25:55.068 INFO:tasks.workunit.client.1.smithi120.stdout:6/544: write d4/db/d10/d1a/d2b/f82 [631062,102826] 0 2024-04-26T21:25:55.070 INFO:tasks.workunit.client.1.smithi120.stdout:4/496: chown d10/d28/f2b 14281324 1 2024-04-26T21:25:55.070 INFO:tasks.workunit.client.1.smithi120.stdout:9/515: fdatasync d0/d6/f76 0 2024-04-26T21:25:55.071 INFO:tasks.workunit.client.0.smithi084.stdout:4/229: symlink d5/d7/d17/l50 0 2024-04-26T21:25:55.074 INFO:tasks.workunit.client.1.smithi120.stdout:5/595: symlink d2/dc/ld3 0 2024-04-26T21:25:55.074 INFO:tasks.workunit.client.0.smithi084.stdout:8/319: symlink d4/d6/db/d1e/d22/d39/l5f 0 2024-04-26T21:25:55.077 INFO:tasks.workunit.client.0.smithi084.stdout:9/238: mkdir da/de/d16/d55 0 2024-04-26T21:25:55.079 INFO:tasks.workunit.client.1.smithi120.stdout:3/477: rename dd/de/d18/f3e to dd/de/df/d12/fa0 0 2024-04-26T21:25:55.079 INFO:tasks.workunit.client.0.smithi084.stdout:4/230: fsync d5/f4c 0 2024-04-26T21:25:55.080 INFO:tasks.workunit.client.1.smithi120.stdout:3/478: chown dd/de/d18/d24/d9d/d86 5 1 2024-04-26T21:25:55.081 INFO:tasks.workunit.client.1.smithi120.stdout:1/468: dread d6/f15 [0,4194304] 0 2024-04-26T21:25:55.084 INFO:tasks.workunit.client.0.smithi084.stdout:4/231: chown d5/d25/d35 25 1 2024-04-26T21:25:55.085 INFO:tasks.workunit.client.0.smithi084.stdout:2/405: dread - d6/d7/d3d/d15/d1f/d39/d20/d45/f87 zero size 2024-04-26T21:25:55.088 INFO:tasks.workunit.client.0.smithi084.stdout:2/406: chown d6 14 1 2024-04-26T21:25:55.089 INFO:tasks.workunit.client.1.smithi120.stdout:4/497: creat d10/d65/fab x:0 0 0 2024-04-26T21:25:55.090 INFO:tasks.workunit.client.1.smithi120.stdout:9/516: symlink d0/d6/d4d/la9 0 2024-04-26T21:25:55.091 INFO:tasks.workunit.client.1.smithi120.stdout:9/517: fsync d0/d14/f35 0 2024-04-26T21:25:55.093 INFO:tasks.workunit.client.0.smithi084.stdout:6/341: getdents d3/de 0 2024-04-26T21:25:55.094 INFO:tasks.workunit.client.1.smithi120.stdout:7/510: symlink d7/d64/da6/d1a/d33/d34/dab/lb3 0 2024-04-26T21:25:55.096 INFO:tasks.workunit.client.0.smithi084.stdout:5/286: dwrite d0/dc/f14 [0,4194304] 0 2024-04-26T21:25:55.097 INFO:tasks.workunit.client.1.smithi120.stdout:8/478: readlink d5/d6/d11/d52/d70/l90 0 2024-04-26T21:25:55.100 INFO:tasks.workunit.client.0.smithi084.stdout:7/298: dwrite d6/d9/d12/f2c [0,4194304] 0 2024-04-26T21:25:55.100 INFO:tasks.workunit.client.0.smithi084.stdout:2/407: fsync d6/d7/f27 0 2024-04-26T21:25:55.101 INFO:tasks.workunit.client.0.smithi084.stdout:6/342: write d3/de/d15/df/f62 [841927,89303] 0 2024-04-26T21:25:55.103 INFO:tasks.workunit.client.0.smithi084.stdout:0/289: dread f9 [0,4194304] 0 2024-04-26T21:25:55.103 INFO:tasks.workunit.client.1.smithi120.stdout:4/498: creat d10/d6b/fac x:0 0 0 2024-04-26T21:25:55.107 INFO:tasks.workunit.client.1.smithi120.stdout:9/518: dwrite d0/d14/d2d/f97 [0,4194304] 0 2024-04-26T21:25:55.107 INFO:tasks.workunit.client.1.smithi120.stdout:0/583: creat d0/d3/dc/dd/d1b/fc9 x:0 0 0 2024-04-26T21:25:55.115 INFO:tasks.workunit.client.0.smithi084.stdout:1/321: write d2/d9/d15/f5b [96007,101830] 0 2024-04-26T21:25:55.115 INFO:tasks.workunit.client.0.smithi084.stdout:7/299: chown d6/d9/d12/f3e 44508004 1 2024-04-26T21:25:55.119 INFO:tasks.workunit.client.1.smithi120.stdout:6/545: creat d4/db/fba x:0 0 0 2024-04-26T21:25:55.121 INFO:tasks.workunit.client.0.smithi084.stdout:6/343: mknod d3/d6c/c7a 0 2024-04-26T21:25:55.123 INFO:tasks.workunit.client.1.smithi120.stdout:4/499: symlink d10/d65/d8c/lad 0 2024-04-26T21:25:55.124 INFO:tasks.workunit.client.0.smithi084.stdout:1/322: read d2/d54/d5e/d66/d2a/d2c/f34 [4140594,99270] 0 2024-04-26T21:25:55.124 INFO:tasks.workunit.client.0.smithi084.stdout:2/408: symlink d6/d7/l92 0 2024-04-26T21:25:55.125 INFO:tasks.workunit.client.1.smithi120.stdout:8/479: chown d5/d6/f25 13 1 2024-04-26T21:25:55.128 INFO:tasks.workunit.client.0.smithi084.stdout:7/300: write d6/d9/f2e [5339722,3961] 0 2024-04-26T21:25:55.131 INFO:tasks.workunit.client.1.smithi120.stdout:7/511: getdents d7/d10/d97/d99 0 2024-04-26T21:25:55.131 INFO:tasks.workunit.client.1.smithi120.stdout:6/546: creat d4/db/d25/d6d/d97/fbb x:0 0 0 2024-04-26T21:25:55.132 INFO:tasks.workunit.client.1.smithi120.stdout:0/584: write d0/d3/dc/dd/d1b/d24/d73/fab [339083,126946] 0 2024-04-26T21:25:55.134 INFO:tasks.workunit.client.1.smithi120.stdout:4/500: mknod d10/d6b/d71/d9d/cae 0 2024-04-26T21:25:55.135 INFO:tasks.workunit.client.0.smithi084.stdout:4/232: link d5/d7/d17/f4b d5/d7/d17/f51 0 2024-04-26T21:25:55.135 INFO:tasks.workunit.client.1.smithi120.stdout:6/547: chown d4/db/d25/d6d/d97/fbb 26052 1 2024-04-26T21:25:55.138 INFO:tasks.workunit.client.0.smithi084.stdout:6/344: symlink d3/de/d15/l7b 0 2024-04-26T21:25:55.141 INFO:tasks.workunit.client.1.smithi120.stdout:3/479: getdents dd/de/df/d12/d6c 0 2024-04-26T21:25:55.142 INFO:tasks.workunit.client.0.smithi084.stdout:7/301: symlink d6/d9/d12/d19/l64 0 2024-04-26T21:25:55.144 INFO:tasks.workunit.client.1.smithi120.stdout:7/512: dread - d7/d64/da6/d2f/f63 zero size 2024-04-26T21:25:55.145 INFO:tasks.workunit.client.0.smithi084.stdout:4/233: truncate d5/d25/f47 769805 0 2024-04-26T21:25:55.145 INFO:tasks.workunit.client.0.smithi084.stdout:2/409: read d6/d7/d3d/d15/d1f/d39/d20/d36/f5d [326815,108249] 0 2024-04-26T21:25:55.146 INFO:tasks.workunit.client.0.smithi084.stdout:0/290: dwrite f0 [0,4194304] 0 2024-04-26T21:25:55.148 INFO:tasks.workunit.client.1.smithi120.stdout:5/596: dwrite d2/f70 [0,4194304] 0 2024-04-26T21:25:55.149 INFO:tasks.workunit.client.1.smithi120.stdout:9/519: rmdir d0/dd/d34/d8a/d9c 0 2024-04-26T21:25:55.150 INFO:tasks.workunit.client.1.smithi120.stdout:7/513: write d7/d64/da6/d1f/d28/d4c/d6b/f9c [975168,125980] 0 2024-04-26T21:25:55.151 INFO:tasks.workunit.client.1.smithi120.stdout:7/514: readlink d7/l55 0 2024-04-26T21:25:55.152 INFO:tasks.workunit.client.1.smithi120.stdout:8/480: symlink d5/d6/d34/d42/d9d/la1 0 2024-04-26T21:25:55.155 INFO:tasks.workunit.client.1.smithi120.stdout:7/515: chown d7/d64/da6/d1f/d28/c8c 782 1 2024-04-26T21:25:55.155 INFO:tasks.workunit.client.0.smithi084.stdout:0/291: fsync de/d1c/d32/f51 0 2024-04-26T21:25:55.155 INFO:tasks.workunit.client.0.smithi084.stdout:2/410: readlink d6/d7/d3d/d15/d1f/l37 0 2024-04-26T21:25:55.156 INFO:tasks.workunit.client.1.smithi120.stdout:3/480: unlink dd/de/df/f57 0 2024-04-26T21:25:55.158 INFO:tasks.workunit.client.0.smithi084.stdout:7/302: creat d6/f65 x:0 0 0 2024-04-26T21:25:55.161 INFO:tasks.workunit.client.1.smithi120.stdout:4/501: mkdir d10/d12/da1/daf 0 2024-04-26T21:25:55.164 INFO:tasks.workunit.client.0.smithi084.stdout:9/239: dread da/de/d16/d25/d4f/f51 [0,4194304] 0 2024-04-26T21:25:55.165 INFO:tasks.workunit.client.0.smithi084.stdout:5/287: dwrite d0/dc/f2f [0,4194304] 0 2024-04-26T21:25:55.165 INFO:tasks.workunit.client.0.smithi084.stdout:7/303: readlink d6/l1f 0 2024-04-26T21:25:55.166 INFO:tasks.workunit.client.1.smithi120.stdout:5/597: creat d2/dc/d1d/d1f/d36/d44/fd4 x:0 0 0 2024-04-26T21:25:55.173 INFO:tasks.workunit.client.0.smithi084.stdout:9/240: dread - da/de/f2d zero size 2024-04-26T21:25:55.173 INFO:tasks.workunit.client.1.smithi120.stdout:7/516: symlink d7/d64/da6/d2f/d43/lb4 0 2024-04-26T21:25:55.173 INFO:tasks.workunit.client.1.smithi120.stdout:3/481: symlink dd/de/d18/d2c/d76/d3b/d56/la1 0 2024-04-26T21:25:55.174 INFO:tasks.workunit.client.0.smithi084.stdout:7/304: fsync d6/d9/d12/d19/f49 0 2024-04-26T21:25:55.175 INFO:tasks.workunit.client.0.smithi084.stdout:0/292: mkdir de/d2b/d45/d63 0 2024-04-26T21:25:55.177 INFO:tasks.workunit.client.0.smithi084.stdout:8/320: dread d4/d6/db/d1e/d22/d2f/f21 [0,4194304] 0 2024-04-26T21:25:55.177 INFO:tasks.workunit.client.0.smithi084.stdout:1/323: dwrite d2/d54/d5e/d66/f18 [8388608,4194304] 0 2024-04-26T21:25:55.181 INFO:tasks.workunit.client.0.smithi084.stdout:2/411: symlink d6/d7/d3d/d15/d1f/d39/l93 0 2024-04-26T21:25:55.181 INFO:tasks.workunit.client.0.smithi084.stdout:5/288: mkdir d0/d49/d56 0 2024-04-26T21:25:55.182 INFO:tasks.workunit.client.0.smithi084.stdout:9/241: unlink da/ld 0 2024-04-26T21:25:55.183 INFO:tasks.workunit.client.0.smithi084.stdout:2/412: readlink d6/l8e 0 2024-04-26T21:25:55.184 INFO:tasks.workunit.client.1.smithi120.stdout:5/598: mknod d2/d48/d63/cd5 0 2024-04-26T21:25:55.186 INFO:tasks.workunit.client.0.smithi084.stdout:0/293: mkdir de/d2b/d64 0 2024-04-26T21:25:55.186 INFO:tasks.workunit.client.0.smithi084.stdout:4/234: getdents d5/d10/d15/d21/d29/d3f 0 2024-04-26T21:25:55.187 INFO:tasks.workunit.client.0.smithi084.stdout:1/324: rmdir d2/d9/d15 39 2024-04-26T21:25:55.189 INFO:tasks.workunit.client.1.smithi120.stdout:8/481: getdents d5/d6/d34/d37 0 2024-04-26T21:25:55.190 INFO:tasks.workunit.client.0.smithi084.stdout:7/305: rename d6/f2a to d6/d26/d40/f66 0 2024-04-26T21:25:55.192 INFO:tasks.workunit.client.0.smithi084.stdout:9/242: mkdir da/de/d1e/d56 0 2024-04-26T21:25:55.192 INFO:tasks.workunit.client.1.smithi120.stdout:0/585: write d0/d3/dc/d12/f3b [529517,123624] 0 2024-04-26T21:25:55.194 INFO:tasks.workunit.client.1.smithi120.stdout:5/599: symlink d2/d30/ld6 0 2024-04-26T21:25:55.195 INFO:tasks.workunit.client.0.smithi084.stdout:7/306: stat d6/d9/f2d 0 2024-04-26T21:25:55.195 INFO:tasks.workunit.client.1.smithi120.stdout:0/586: stat d0/d3/d51/f88 0 2024-04-26T21:25:55.198 INFO:tasks.workunit.client.0.smithi084.stdout:7/307: chown d6/d26/c2b 10777 1 2024-04-26T21:25:55.203 INFO:tasks.workunit.client.0.smithi084.stdout:3/333: sync 2024-04-26T21:25:55.208 INFO:tasks.workunit.client.0.smithi084.stdout:5/289: creat d0/d49/d56/f57 x:0 0 0 2024-04-26T21:25:55.209 INFO:tasks.workunit.client.1.smithi120.stdout:6/548: dwrite d4/db/d10/dd/d4e/f5f [0,4194304] 0 2024-04-26T21:25:55.210 INFO:tasks.workunit.client.0.smithi084.stdout:1/325: mknod d2/d54/d5e/d66/c6b 0 2024-04-26T21:25:55.213 INFO:tasks.workunit.client.0.smithi084.stdout:8/321: dwrite d4/d6/f40 [0,4194304] 0 2024-04-26T21:25:55.213 INFO:tasks.workunit.client.0.smithi084.stdout:4/235: rename d5/d7/d17/l20 to d5/d10/d15/l52 0 2024-04-26T21:25:55.216 INFO:tasks.workunit.client.1.smithi120.stdout:6/549: dread - d4/db/d10/dd/d4e/d60/fb1 zero size 2024-04-26T21:25:55.216 INFO:tasks.workunit.client.1.smithi120.stdout:5/600: creat d2/dc/d1d/d1f/d36/d44/d6c/fd7 x:0 0 0 2024-04-26T21:25:55.218 INFO:tasks.workunit.client.0.smithi084.stdout:5/290: mknod d0/d49/c58 0 2024-04-26T21:25:55.218 INFO:tasks.workunit.client.0.smithi084.stdout:7/308: readlink d6/d9/d12/d19/d20/l34 0 2024-04-26T21:25:55.218 INFO:tasks.workunit.client.0.smithi084.stdout:8/322: chown d4/d6/db/d1e/d22/d39/d4a 2312 1 2024-04-26T21:25:55.222 INFO:tasks.workunit.client.0.smithi084.stdout:3/334: creat d1/d2c/d2f/d31/d55/d4e/f73 x:0 0 0 2024-04-26T21:25:55.223 INFO:tasks.workunit.client.1.smithi120.stdout:0/587: symlink d0/d3/dc/dd/d1b/lca 0 2024-04-26T21:25:55.223 INFO:tasks.workunit.client.0.smithi084.stdout:8/323: write d4/d6/f24 [8588461,93132] 0 2024-04-26T21:25:55.223 INFO:tasks.workunit.client.0.smithi084.stdout:0/294: rename de/d2b/c48 to de/d20/d4c/c65 0 2024-04-26T21:25:55.225 INFO:tasks.workunit.client.0.smithi084.stdout:5/291: mknod d0/d17/c59 0 2024-04-26T21:25:55.227 INFO:tasks.workunit.client.1.smithi120.stdout:9/520: write d0/dd/d34/f6e [923525,47258] 0 2024-04-26T21:25:55.228 INFO:tasks.workunit.client.1.smithi120.stdout:6/550: mkdir d4/db/d10/d1a/d2b/d57/d67/dbc 0 2024-04-26T21:25:55.231 INFO:tasks.workunit.client.0.smithi084.stdout:6/345: dread d3/de/d41/f51 [0,4194304] 0 2024-04-26T21:25:55.232 INFO:tasks.workunit.client.0.smithi084.stdout:4/236: truncate d5/d10/f13 398317 0 2024-04-26T21:25:55.233 INFO:tasks.workunit.client.0.smithi084.stdout:5/292: stat d0/d17/l1b 0 2024-04-26T21:25:55.234 INFO:tasks.workunit.client.1.smithi120.stdout:5/601: rename d2/dc/d1d/d1f/d36/d44/d6c/fd7 to d2/dc/d1d/d21/fd8 0 2024-04-26T21:25:55.236 INFO:tasks.workunit.client.0.smithi084.stdout:6/346: chown d3/de/c73 1777 1 2024-04-26T21:25:55.240 INFO:tasks.workunit.client.0.smithi084.stdout:7/309: rename d6/d9/cd to d6/dc/c67 0 2024-04-26T21:25:55.241 INFO:tasks.workunit.client.1.smithi120.stdout:8/482: write d5/d6/f25 [1194537,102184] 0 2024-04-26T21:25:55.243 INFO:tasks.workunit.client.0.smithi084.stdout:2/413: dread d6/d7/f3f [0,4194304] 0 2024-04-26T21:25:55.245 INFO:tasks.workunit.client.1.smithi120.stdout:3/482: getdents dd/de/d18/d2c/d76/d3b/d56 0 2024-04-26T21:25:55.247 INFO:tasks.workunit.client.1.smithi120.stdout:9/521: creat d0/dd/d3a/d5c/d98/faa x:0 0 0 2024-04-26T21:25:55.248 INFO:tasks.workunit.client.0.smithi084.stdout:9/243: write da/f14 [3775786,119010] 0 2024-04-26T21:25:55.252 INFO:tasks.workunit.client.1.smithi120.stdout:9/522: fsync d0/d6/d4d/d65/f71 0 2024-04-26T21:25:55.256 INFO:tasks.workunit.client.1.smithi120.stdout:9/523: fsync d0/d14/f8c 0 2024-04-26T21:25:55.257 INFO:tasks.workunit.client.1.smithi120.stdout:0/588: write d0/d3/dc/d12/d31/f43 [280824,48762] 0 2024-04-26T21:25:55.258 INFO:tasks.workunit.client.0.smithi084.stdout:6/347: dread d3/de/d1a/f36 [0,4194304] 0 2024-04-26T21:25:55.260 INFO:tasks.workunit.client.1.smithi120.stdout:3/483: truncate dd/de/d18/d37/d80/f9c 259722 0 2024-04-26T21:25:55.264 INFO:tasks.workunit.client.0.smithi084.stdout:7/310: mkdir d6/d68 0 2024-04-26T21:25:55.264 INFO:tasks.workunit.client.1.smithi120.stdout:6/551: truncate d4/d3d/f83 3822562 0 2024-04-26T21:25:55.264 INFO:tasks.workunit.client.0.smithi084.stdout:2/414: symlink d6/d7/d68/l94 0 2024-04-26T21:25:55.266 INFO:tasks.workunit.client.0.smithi084.stdout:6/348: truncate d3/de/f6d 591432 0 2024-04-26T21:25:55.268 INFO:tasks.workunit.client.1.smithi120.stdout:4/502: dwrite d10/d12/f58 [0,4194304] 0 2024-04-26T21:25:55.268 INFO:tasks.workunit.client.1.smithi120.stdout:9/524: write d0/dd/d3a/d5c/f67 [138935,128408] 0 2024-04-26T21:25:55.269 INFO:tasks.workunit.client.0.smithi084.stdout:1/326: dwrite d2/d9/d15/f25 [0,4194304] 0 2024-04-26T21:25:55.269 INFO:tasks.workunit.client.1.smithi120.stdout:0/589: creat d0/d3/dc/dd/d1b/d24/fcb x:0 0 0 2024-04-26T21:25:55.274 INFO:tasks.workunit.client.0.smithi084.stdout:0/295: dwrite f0 [0,4194304] 0 2024-04-26T21:25:55.274 INFO:tasks.workunit.client.1.smithi120.stdout:6/552: readlink d4/db/d10/dd/d4e/d76/l8e 0 2024-04-26T21:25:55.275 INFO:tasks.workunit.client.1.smithi120.stdout:9/525: write d0/f54 [17215,74630] 0 2024-04-26T21:25:55.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.272+0000 7f983a000700 1 -- 172.21.15.84:0/2665307601 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 26) v1 ==== 92571+0+0 (secure 0 0 0) 0x7f98340544e0 con 0x7f98440fcf10 2024-04-26T21:25:55.277 INFO:tasks.workunit.client.1.smithi120.stdout:2/532: sync 2024-04-26T21:25:55.277 INFO:tasks.workunit.client.0.smithi084.stdout:1/327: read d2/f56 [2533896,77648] 0 2024-04-26T21:25:55.278 INFO:tasks.workunit.client.0.smithi084.stdout:8/324: truncate d4/d6/f40 292915 0 2024-04-26T21:25:55.279 INFO:tasks.workunit.client.1.smithi120.stdout:4/503: mknod d10/d65/d72/d86/cb0 0 2024-04-26T21:25:55.280 INFO:tasks.workunit.client.1.smithi120.stdout:9/526: chown d0/f54 46312 1 2024-04-26T21:25:55.281 INFO:tasks.workunit.client.0.smithi084.stdout:2/415: rmdir d6/d3e/d67 39 2024-04-26T21:25:55.283 INFO:tasks.workunit.client.1.smithi120.stdout:9/527: stat d0/d6/d3d/c72 0 2024-04-26T21:25:55.286 INFO:tasks.workunit.client.0.smithi084.stdout:8/325: write d4/f5 [2724366,32202] 0 2024-04-26T21:25:55.286 INFO:tasks.workunit.client.1.smithi120.stdout:5/602: dread d2/dc/d1d/d21/d66/f41 [0,4194304] 0 2024-04-26T21:25:55.286 INFO:tasks.workunit.client.1.smithi120.stdout:2/533: mknod d4/cb0 0 2024-04-26T21:25:55.289 INFO:tasks.workunit.client.0.smithi084.stdout:3/335: truncate d1/d24/d27/f53 63208 0 2024-04-26T21:25:55.292 INFO:tasks.workunit.client.1.smithi120.stdout:8/483: dwrite d5/d6/d11/d52/d27/f53 [0,4194304] 0 2024-04-26T21:25:55.292 INFO:tasks.workunit.client.1.smithi120.stdout:4/504: unlink d10/d12/l85 0 2024-04-26T21:25:55.293 INFO:tasks.workunit.client.0.smithi084.stdout:0/296: mknod de/d2b/d45/d63/c66 0 2024-04-26T21:25:55.296 INFO:tasks.workunit.client.0.smithi084.stdout:2/416: chown d6/d7/d3d/d15/d1f/d41/c7b 4 1 2024-04-26T21:25:55.298 INFO:tasks.workunit.client.0.smithi084.stdout:3/336: chown d1/d2c/d2f/d31/d3b/f44 978 1 2024-04-26T21:25:55.299 INFO:tasks.workunit.client.0.smithi084.stdout:0/297: read - de/d2b/f43 zero size 2024-04-26T21:25:55.300 INFO:tasks.workunit.client.0.smithi084.stdout:0/298: read - de/d20/d4e/f60 zero size 2024-04-26T21:25:55.302 INFO:tasks.workunit.client.0.smithi084.stdout:9/244: getdents da/de/d1e 0 2024-04-26T21:25:55.302 INFO:tasks.workunit.client.0.smithi084.stdout:2/417: chown d6/d7/d3d/d15/f55 106569 1 2024-04-26T21:25:55.303 INFO:tasks.workunit.client.1.smithi120.stdout:4/505: write d10/d12/f8e [442888,56522] 0 2024-04-26T21:25:55.303 INFO:tasks.workunit.client.1.smithi120.stdout:2/534: creat d4/d1b/d56/d65/fb1 x:0 0 0 2024-04-26T21:25:55.303 INFO:tasks.workunit.client.0.smithi084.stdout:7/311: dwrite d6/d9/d12/d19/f49 [0,4194304] 0 2024-04-26T21:25:55.309 INFO:tasks.workunit.client.1.smithi120.stdout:8/484: truncate d5/d6/d34/d42/d9d/f86 800457 0 2024-04-26T21:25:55.310 INFO:tasks.workunit.client.1.smithi120.stdout:6/553: getdents d4/db/d10/d1a/d2b/d57/d67 0 2024-04-26T21:25:55.311 INFO:tasks.workunit.client.0.smithi084.stdout:8/326: symlink d4/d6/db/l60 0 2024-04-26T21:25:55.315 INFO:tasks.workunit.client.0.smithi084.stdout:8/327: chown d4/d6/db/d1e/d22/l59 17868036 1 2024-04-26T21:25:55.316 INFO:tasks.workunit.client.0.smithi084.stdout:9/245: creat da/de/d16/f57 x:0 0 0 2024-04-26T21:25:55.317 INFO:tasks.workunit.client.1.smithi120.stdout:4/506: rename d10/d65/d72/c84 to d10/d6b/da4/cb1 0 2024-04-26T21:25:55.318 INFO:tasks.workunit.client.0.smithi084.stdout:1/328: link d2/d9/c53 d2/d54/c6c 0 2024-04-26T21:25:55.322 INFO:tasks.workunit.client.1.smithi120.stdout:8/485: dread d5/d6/d34/d42/f5b [0,4194304] 0 2024-04-26T21:25:55.324 INFO:tasks.workunit.client.0.smithi084.stdout:3/337: getdents d1/d2c/d2f/d31/d52 0 2024-04-26T21:25:55.325 INFO:tasks.workunit.client.0.smithi084.stdout:9/246: truncate da/de/d16/f57 335743 0 2024-04-26T21:25:55.326 INFO:tasks.workunit.client.0.smithi084.stdout:7/312: getdents d6/d1c 0 2024-04-26T21:25:55.326 INFO:tasks.workunit.client.0.smithi084.stdout:9/247: fdatasync da/f14 0 2024-04-26T21:25:55.327 INFO:tasks.workunit.client.1.smithi120.stdout:4/507: creat d10/d28/fb2 x:0 0 0 2024-04-26T21:25:55.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.327+0000 7f9849000700 1 -- 172.21.15.84:0/2665307601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f984404bed0 con 0x7f98440fcf10 2024-04-26T21:25:55.328 INFO:tasks.workunit.client.0.smithi084.stdout:3/338: fdatasync d1/d2c/d2f/f28 0 2024-04-26T21:25:55.328 INFO:tasks.workunit.client.0.smithi084.stdout:8/328: truncate d4/d6/db/d1e/d22/d2f/f41 4743170 0 2024-04-26T21:25:55.328 INFO:tasks.workunit.client.1.smithi120.stdout:8/486: chown d5/d6/d34/d42/f71 26839194 1 2024-04-26T21:25:55.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.328+0000 7f983a000700 1 -- 172.21.15.84:0/2665307601 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1835 (secure 0 0 0) 0x7f9834075e60 con 0x7f98440fcf10 2024-04-26T21:25:55.329 INFO:teuthology.orchestra.run.smithi084.stdout:e12 2024-04-26T21:25:55.329 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:25:55.329 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:25:55.330 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:25:55.330 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:25:55.330 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:25:55.330 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:25:55.330 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 12 2024-04-26T21:25:55.330 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:25:55.330 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:25:55.330 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:23:53.700069+0000 2024-04-26T21:25:55.330 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:25:55.330 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:25:55.330 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:25:55.330 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:25:55.330 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:25:55.330 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:25:55.331 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:25:55.331 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:25:55.331 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:25:55.331 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:25:55.331 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:25:55.331 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456,1=24231} 2024-04-26T21:25:55.331 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:25:55.331 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:25:55.331 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:25:55.331 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:25:55.331 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:25:55.331 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:25:55.331 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:25:55.331 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:25:55.332 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:25:55.332 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:25:55.332 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:25:55.332 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:25:55.332 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:25:55.332 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:25:55.332 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:25:55.332 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:25:55.333 INFO:tasks.workunit.client.0.smithi084.stdout:8/329: stat d4/d7/d15/d3c/c49 0 2024-04-26T21:25:55.333 INFO:tasks.workunit.client.1.smithi120.stdout:9/528: dwrite d0/d14/d2d/f6c [4194304,4194304] 0 2024-04-26T21:25:55.333 INFO:tasks.workunit.client.1.smithi120.stdout:4/508: readlink d10/d28/l63 0 2024-04-26T21:25:55.334 INFO:tasks.workunit.client.1.smithi120.stdout:4/509: fdatasync d10/f6a 0 2024-04-26T21:25:55.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.332+0000 7f9849000700 1 -- 172.21.15.84:0/2665307601 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f982806bcf0 msgr2=0x7f982806e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:55.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.332+0000 7f9849000700 1 --2- 172.21.15.84:0/2665307601 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f982806bcf0 0x7f982806e1a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9830004f90 tx=0x7f9830009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:55.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.332+0000 7f9849000700 1 -- 172.21.15.84:0/2665307601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98440fcf10 msgr2=0x7f984410b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:55.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.332+0000 7f9849000700 1 --2- 172.21.15.84:0/2665307601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98440fcf10 0x7f984410b800 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f983400c800 tx=0x7f9834004430 comp rx=0 tx=0).stop 2024-04-26T21:25:55.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.332+0000 7f9849000700 1 -- 172.21.15.84:0/2665307601 shutdown_connections 2024-04-26T21:25:55.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.332+0000 7f9849000700 1 --2- 172.21.15.84:0/2665307601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98440fcf10 0x7f984410b800 secure :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f983400c800 tx=0x7f9834004430 comp rx=0 tx=0).stop 2024-04-26T21:25:55.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.332+0000 7f9849000700 1 --2- 172.21.15.84:0/2665307601 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f982806bcf0 0x7f982806e1a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:55.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.332+0000 7f9849000700 1 --2- 172.21.15.84:0/2665307601 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98440fe080 0x7f984410bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:55.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.332+0000 7f9849000700 1 -- 172.21.15.84:0/2665307601 >> 172.21.15.84:0/2665307601 conn(0x7f98440f8560 msgr2=0x7f98440f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:55.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.333+0000 7f9849000700 1 -- 172.21.15.84:0/2665307601 shutdown_connections 2024-04-26T21:25:55.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.333+0000 7f9849000700 1 -- 172.21.15.84:0/2665307601 wait complete. 2024-04-26T21:25:55.336 INFO:tasks.workunit.client.1.smithi120.stdout:6/554: rename d4/db/d10/dd/d4e/d76 to d4/db/d25/d6d/dbd 0 2024-04-26T21:25:55.336 INFO:tasks.workunit.client.1.smithi120.stdout:4/510: write d10/d65/d72/d86/f9a [822392,76345] 0 2024-04-26T21:25:55.336 INFO:tasks.workunit.client.1.smithi120.stdout:0/590: dread d0/d3/d13/d64/f69 [0,4194304] 0 2024-04-26T21:25:55.337 INFO:tasks.workunit.client.1.smithi120.stdout:6/555: dread - d4/db/d10/d22/d6c/fad zero size 2024-04-26T21:25:55.337 INFO:tasks.workunit.client.0.smithi084.stdout:9/248: creat da/de/d16/d25/d41/d43/d48/f58 x:0 0 0 2024-04-26T21:25:55.337 INFO:tasks.workunit.client.0.smithi084.stdout:2/418: dread d6/f84 [0,4194304] 0 2024-04-26T21:25:55.338 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 12 2024-04-26T21:25:55.338 INFO:tasks.workunit.client.0.smithi084.stdout:3/339: write d1/d2c/d2f/d31/d3b/f6c [232646,127177] 0 2024-04-26T21:25:55.339 INFO:tasks.workunit.client.0.smithi084.stdout:7/313: symlink d6/d26/l69 0 2024-04-26T21:25:55.339 INFO:tasks.workunit.client.0.smithi084.stdout:9/249: dread - da/f45 zero size 2024-04-26T21:25:55.340 INFO:tasks.workunit.client.0.smithi084.stdout:5/293: write d0/dc/df/d2a/f46 [2737655,49180] 0 2024-04-26T21:25:55.341 INFO:tasks.workunit.client.1.smithi120.stdout:8/487: rmdir d5/d6/d75 39 2024-04-26T21:25:55.341 INFO:tasks.workunit.client.0.smithi084.stdout:3/340: chown d1/d24 7839 1 2024-04-26T21:25:55.346 INFO:tasks.workunit.client.0.smithi084.stdout:5/294: symlink d0/dc/l5a 0 2024-04-26T21:25:55.346 INFO:tasks.workunit.client.1.smithi120.stdout:0/591: mknod d0/d3/dc/dd/d1b/d24/ccc 0 2024-04-26T21:25:55.348 INFO:tasks.workunit.client.1.smithi120.stdout:4/511: getdents d10/d6b/d71/d9d 0 2024-04-26T21:25:55.349 INFO:tasks.workunit.client.0.smithi084.stdout:3/341: creat d1/d2c/d2f/d31/d3b/f74 x:0 0 0 2024-04-26T21:25:55.352 INFO:tasks.workunit.client.0.smithi084.stdout:7/314: getdents d6/d9/d12 0 2024-04-26T21:25:55.352 INFO:tasks.workunit.client.1.smithi120.stdout:4/512: write d10/d12/f5c [1832361,124360] 0 2024-04-26T21:25:55.355 INFO:tasks.workunit.client.1.smithi120.stdout:0/592: symlink d0/d3/dc/dd/d1b/d24/d73/db7/lcd 0 2024-04-26T21:25:55.356 INFO:tasks.workunit.client.1.smithi120.stdout:2/535: write d4/d1b/d2e/d50/f5b [1490884,71178] 0 2024-04-26T21:25:55.357 INFO:tasks.workunit.client.1.smithi120.stdout:4/513: dread d10/d12/f2c [0,4194304] 0 2024-04-26T21:25:55.359 INFO:tasks.workunit.client.1.smithi120.stdout:3/484: dread dd/de/d18/d24/f3c [0,4194304] 0 2024-04-26T21:25:55.360 INFO:tasks.workunit.client.1.smithi120.stdout:0/593: fdatasync d0/d3/dc/d12/d31/f33 0 2024-04-26T21:25:55.360 INFO:tasks.workunit.client.1.smithi120.stdout:8/488: unlink d5/d6/d34/d37/d60/f9c 0 2024-04-26T21:25:55.361 INFO:tasks.workunit.client.0.smithi084.stdout:5/295: truncate d0/dc/df/d31/f54 1028647 0 2024-04-26T21:25:55.361 INFO:tasks.workunit.client.0.smithi084.stdout:4/237: dwrite d5/d10/d15/f40 [0,4194304] 0 2024-04-26T21:25:55.361 INFO:tasks.workunit.client.0.smithi084.stdout:6/349: truncate d3/de/f61 3019783 0 2024-04-26T21:25:55.362 INFO:tasks.workunit.client.1.smithi120.stdout:8/489: readlink d5/l9f 0 2024-04-26T21:25:55.363 INFO:tasks.workunit.client.0.smithi084.stdout:0/299: rmdir de/d2b/d45 39 2024-04-26T21:25:55.368 INFO:tasks.workunit.client.0.smithi084.stdout:5/296: stat d0/dc/df/d31/d53 0 2024-04-26T21:25:55.368 INFO:tasks.workunit.client.0.smithi084.stdout:7/315: creat d6/d26/d40/d4f/f6a x:0 0 0 2024-04-26T21:25:55.368 INFO:tasks.workunit.client.0.smithi084.stdout:7/316: fdatasync d6/d9/ff 0 2024-04-26T21:25:55.373 INFO:tasks.workunit.client.1.smithi120.stdout:0/594: creat d0/d3/dc/dd/d1b/d24/d7d/fce x:0 0 0 2024-04-26T21:25:55.374 INFO:tasks.workunit.client.0.smithi084.stdout:4/238: write d5/d7/d17/d32/f34 [1766114,11865] 0 2024-04-26T21:25:55.382 INFO:tasks.workunit.client.0.smithi084.stdout:7/317: symlink d6/d26/d40/d4f/l6b 0 2024-04-26T21:25:55.384 INFO:tasks.workunit.client.0.smithi084.stdout:0/300: dread de/d20/f36 [0,4194304] 0 2024-04-26T21:25:55.385 INFO:tasks.workunit.client.0.smithi084.stdout:6/350: rename d3/de/d15/d5f/f74 to d3/de/f7c 0 2024-04-26T21:25:55.385 INFO:tasks.workunit.client.1.smithi120.stdout:3/485: rename dd/de/d18/d37/f5c to dd/fa2 0 2024-04-26T21:25:55.391 INFO:tasks.workunit.client.0.smithi084.stdout:5/297: getdents d0/d17 0 2024-04-26T21:25:55.392 INFO:tasks.workunit.client.0.smithi084.stdout:8/330: dread d4/d7/f14 [4194304,4194304] 0 2024-04-26T21:25:55.392 INFO:tasks.workunit.client.1.smithi120.stdout:3/486: dread dd/de/d18/d37/d80/f9c [0,4194304] 0 2024-04-26T21:25:55.392 INFO:tasks.workunit.client.1.smithi120.stdout:0/595: getdents d0/d3/dc/d12/d4a/dbc 0 2024-04-26T21:25:55.398 INFO:tasks.workunit.client.1.smithi120.stdout:8/490: rename d5/d6/l3d to d5/la2 0 2024-04-26T21:25:55.400 INFO:tasks.workunit.client.1.smithi120.stdout:8/491: dread - d5/d6/d34/d42/d9d/d83/f97 zero size 2024-04-26T21:25:55.401 INFO:tasks.workunit.client.0.smithi084.stdout:5/298: creat d0/d17/f5b x:0 0 0 2024-04-26T21:25:55.405 INFO:tasks.workunit.client.0.smithi084.stdout:8/331: mknod d4/d7/d15/d3c/c61 0 2024-04-26T21:25:55.407 INFO:tasks.workunit.client.1.smithi120.stdout:4/514: dread d10/d12/f51 [0,4194304] 0 2024-04-26T21:25:55.407 INFO:tasks.workunit.client.1.smithi120.stdout:2/536: truncate d4/d1b/d2e/d50/d14/d15/f2d 4323537 0 2024-04-26T21:25:55.407 INFO:tasks.workunit.client.1.smithi120.stdout:0/596: truncate d0/d3/dc/d12/f6a 762169 0 2024-04-26T21:25:55.410 INFO:tasks.workunit.client.1.smithi120.stdout:3/487: link dd/de/d18/d24/d43/f4c dd/fa3 0 2024-04-26T21:25:55.410 INFO:tasks.workunit.client.1.smithi120.stdout:4/515: chown d10/d12/f45 308253245 1 2024-04-26T21:25:55.414 INFO:tasks.workunit.client.1.smithi120.stdout:0/597: symlink d0/d3/dc/d12/d4a/lcf 0 2024-04-26T21:25:55.415 INFO:tasks.workunit.client.1.smithi120.stdout:3/488: truncate dd/de/d18/f4b 4967003 0 2024-04-26T21:25:55.415 INFO:tasks.workunit.client.0.smithi084.stdout:2/419: truncate d6/d7/f3f 2778275 0 2024-04-26T21:25:55.420 INFO:tasks.workunit.client.0.smithi084.stdout:4/239: truncate d5/d25/d35/f3a 2887899 0 2024-04-26T21:25:55.421 INFO:tasks.workunit.client.1.smithi120.stdout:0/598: mkdir d0/d3/d51/d95/dd0 0 2024-04-26T21:25:55.425 INFO:tasks.workunit.client.1.smithi120.stdout:3/489: creat dd/de/d83/d64/fa4 x:0 0 0 2024-04-26T21:25:55.431 INFO:tasks.workunit.client.1.smithi120.stdout:4/516: dread d10/d65/f6d [0,4194304] 0 2024-04-26T21:25:55.434 INFO:tasks.workunit.client.0.smithi084.stdout:7/318: dread d6/d9/f2e [0,4194304] 0 2024-04-26T21:25:55.435 INFO:tasks.workunit.client.0.smithi084.stdout:1/329: dread d2/d54/d5e/d66/f2b [0,4194304] 0 2024-04-26T21:25:55.439 INFO:tasks.workunit.client.0.smithi084.stdout:0/301: dwrite de/d20/f29 [0,4194304] 0 2024-04-26T21:25:55.439 INFO:tasks.workunit.client.0.smithi084.stdout:9/250: dread da/f1a [0,4194304] 0 2024-04-26T21:25:55.440 INFO:tasks.workunit.client.1.smithi120.stdout:4/517: mknod d10/d6b/da4/cb3 0 2024-04-26T21:25:55.441 INFO:tasks.workunit.client.1.smithi120.stdout:2/537: dwrite d4/d1b/d25/d29/f37 [0,4194304] 0 2024-04-26T21:25:55.441 INFO:tasks.workunit.client.1.smithi120.stdout:1/469: sync 2024-04-26T21:25:55.442 INFO:tasks.workunit.client.0.smithi084.stdout:1/330: chown d2/d19/f4d 1632565 1 2024-04-26T21:25:55.443 INFO:tasks.workunit.client.0.smithi084.stdout:0/302: chown de/d20/d4c 0 1 2024-04-26T21:25:55.444 INFO:tasks.workunit.client.1.smithi120.stdout:2/538: chown d4/d1b/d4f/l5d 1 1 2024-04-26T21:25:55.446 INFO:tasks.workunit.client.0.smithi084.stdout:0/303: write f6 [3334653,125424] 0 2024-04-26T21:25:55.446 INFO:tasks.workunit.client.1.smithi120.stdout:1/470: write d6/d7/d1d/f50 [8560796,2387] 0 2024-04-26T21:25:55.447 INFO:tasks.workunit.client.0.smithi084.stdout:9/251: read da/de/d16/d25/f52 [2636647,36286] 0 2024-04-26T21:25:55.450 INFO:tasks.workunit.client.1.smithi120.stdout:4/518: symlink d10/lb4 0 2024-04-26T21:25:55.451 INFO:tasks.workunit.client.1.smithi120.stdout:3/490: dwrite dd/f31 [4194304,4194304] 0 2024-04-26T21:25:55.453 INFO:tasks.workunit.client.1.smithi120.stdout:3/491: readlink dd/d2a/l65 0 2024-04-26T21:25:55.454 INFO:tasks.workunit.client.0.smithi084.stdout:5/299: link d0/dc/df/d2a/l2b d0/dc/l5c 0 2024-04-26T21:25:55.456 INFO:tasks.workunit.client.1.smithi120.stdout:0/599: dread d0/d3/d13/f20 [0,4194304] 0 2024-04-26T21:25:55.456 INFO:tasks.workunit.client.1.smithi120.stdout:4/519: write d10/d12/f22 [363632,123764] 0 2024-04-26T21:25:55.456 INFO:tasks.workunit.client.0.smithi084.stdout:2/420: rename d6/d7/d3d/d15/d1f/d39/d20/d45/f66 to d6/d7/d3d/d15/d1f/d39/d20/d45/d6d/f95 0 2024-04-26T21:25:55.456 INFO:tasks.workunit.client.0.smithi084.stdout:9/252: readlink da/de/d1e/l20 0 2024-04-26T21:25:55.458 INFO:tasks.workunit.client.1.smithi120.stdout:0/600: fdatasync d0/d3/dc/dd/fbb 0 2024-04-26T21:25:55.459 INFO:tasks.workunit.client.1.smithi120.stdout:1/471: fdatasync d6/d7/d2d/d98/d35/f87 0 2024-04-26T21:25:55.460 INFO:tasks.workunit.client.1.smithi120.stdout:2/539: rmdir d4/d1b/d2e/d50 39 2024-04-26T21:25:55.460 INFO:tasks.workunit.client.0.smithi084.stdout:9/253: write da/de/d16/d40/f4b [7193875,84542] 0 2024-04-26T21:25:55.464 INFO:tasks.workunit.client.0.smithi084.stdout:5/300: write d0/dc/df/d2a/f46 [751685,126223] 0 2024-04-26T21:25:55.464 INFO:tasks.workunit.client.0.smithi084.stdout:9/254: chown da/de/d16/d25/d41/d43/d4a 17274 1 2024-04-26T21:25:55.465 INFO:tasks.workunit.client.0.smithi084.stdout:7/319: creat d6/d1c/d51/f6c x:0 0 0 2024-04-26T21:25:55.467 INFO:tasks.workunit.client.0.smithi084.stdout:5/301: write d0/dc/df/d31/f3c [1573125,1131] 0 2024-04-26T21:25:55.468 INFO:tasks.workunit.client.0.smithi084.stdout:4/240: fdatasync d5/d7/d17/f4b 0 2024-04-26T21:25:55.469 INFO:tasks.workunit.client.1.smithi120.stdout:3/492: unlink dd/d2a/f71 0 2024-04-26T21:25:55.472 INFO:tasks.workunit.client.1.smithi120.stdout:1/472: fdatasync d6/d7/d2d/d98/d56/f57 0 2024-04-26T21:25:55.473 INFO:tasks.workunit.client.0.smithi084.stdout:8/332: getdents d4/d7/d53 0 2024-04-26T21:25:55.473 INFO:tasks.workunit.client.1.smithi120.stdout:3/493: truncate dd/de/df/d12/d48/f93 650272 0 2024-04-26T21:25:55.474 INFO:tasks.workunit.client.0.smithi084.stdout:1/331: fdatasync d2/d54/d5e/d66/d2a/d2c/d45/f68 0 2024-04-26T21:25:55.475 INFO:tasks.workunit.client.1.smithi120.stdout:1/473: chown d6/d7/d2d/d98/c2b 5629 1 2024-04-26T21:25:55.476 INFO:tasks.workunit.client.0.smithi084.stdout:4/241: truncate d5/d10/f1b 1505656 0 2024-04-26T21:25:55.477 INFO:tasks.workunit.client.1.smithi120.stdout:3/494: stat dd/de/df/d12/f21 0 2024-04-26T21:25:55.482 INFO:tasks.workunit.client.0.smithi084.stdout:2/421: mknod d6/d7/d3d/d79/c96 0 2024-04-26T21:25:55.487 INFO:tasks.workunit.client.0.smithi084.stdout:8/333: mknod d4/d7/d15/d37/c62 0 2024-04-26T21:25:55.489 INFO:tasks.workunit.client.1.smithi120.stdout:2/540: dwrite d4/d1b/d25/d2c/f49 [4194304,4194304] 0 2024-04-26T21:25:55.489 INFO:tasks.workunit.client.0.smithi084.stdout:8/334: write d4/f12 [2366268,47274] 0 2024-04-26T21:25:55.492 INFO:tasks.workunit.client.0.smithi084.stdout:5/302: mkdir d0/dc/df/d31/d53/d5d 0 2024-04-26T21:25:55.492 INFO:tasks.workunit.client.0.smithi084.stdout:7/320: mknod d6/d9/d12/d19/d60/c6d 0 2024-04-26T21:25:55.493 INFO:tasks.workunit.client.0.smithi084.stdout:4/242: mknod d5/d10/d15/d21/d29/d3f/c53 0 2024-04-26T21:25:55.494 INFO:tasks.workunit.client.0.smithi084.stdout:7/321: readlink d6/d26/d40/d41/l52 0 2024-04-26T21:25:55.497 INFO:tasks.workunit.client.1.smithi120.stdout:2/541: read d4/f34 [585530,53588] 0 2024-04-26T21:25:55.498 INFO:tasks.workunit.client.1.smithi120.stdout:4/520: write d10/d12/f35 [1105374,72827] 0 2024-04-26T21:25:55.499 INFO:tasks.workunit.client.0.smithi084.stdout:9/255: link da/de/d16/d25/f3c da/de/d16/d25/d4f/f59 0 2024-04-26T21:25:55.499 INFO:tasks.workunit.client.1.smithi120.stdout:0/601: write d0/d3/d13/f1f [1932065,49613] 0 2024-04-26T21:25:55.501 INFO:tasks.workunit.client.0.smithi084.stdout:1/332: mknod d2/d54/d5e/d66/d2a/d2c/d45/c6d 0 2024-04-26T21:25:55.502 INFO:tasks.workunit.client.0.smithi084.stdout:9/256: fdatasync da/de/d1e/f49 0 2024-04-26T21:25:55.503 INFO:tasks.workunit.client.0.smithi084.stdout:0/304: getdents de/d20/d4c 0 2024-04-26T21:25:55.505 INFO:tasks.workunit.client.1.smithi120.stdout:1/474: dwrite d6/d7/f59 [4194304,4194304] 0 2024-04-26T21:25:55.505 INFO:tasks.workunit.client.1.smithi120.stdout:3/495: dwrite dd/d40/f92 [0,4194304] 0 2024-04-26T21:25:55.507 INFO:tasks.workunit.client.0.smithi084.stdout:9/257: readlink da/de/d16/d25/d4f/l50 0 2024-04-26T21:25:55.507 INFO:tasks.workunit.client.1.smithi120.stdout:4/521: write d10/d6b/fac [862072,50082] 0 2024-04-26T21:25:55.513 INFO:tasks.workunit.client.1.smithi120.stdout:4/522: write d10/d12/f19 [1913035,87897] 0 2024-04-26T21:25:55.513 INFO:tasks.workunit.client.0.smithi084.stdout:9/258: rename da/de to da/de/d16/d25/d41/d43/d5a 22 2024-04-26T21:25:55.521 INFO:tasks.workunit.client.1.smithi120.stdout:4/523: rename d10/d28/l33 to d10/d65/d7c/lb5 0 2024-04-26T21:25:55.522 INFO:tasks.workunit.client.1.smithi120.stdout:1/475: creat d6/d7/d1d/d2c/d58/f9f x:0 0 0 2024-04-26T21:25:55.522 INFO:tasks.workunit.client.0.smithi084.stdout:2/422: link d6/d7/d3d/d15/d1f/d22/f86 d6/d7/d3d/d15/d1f/d39/d20/d45/f97 0 2024-04-26T21:25:55.522 INFO:tasks.workunit.client.0.smithi084.stdout:7/322: creat d6/d68/f6e x:0 0 0 2024-04-26T21:25:55.523 INFO:tasks.workunit.client.1.smithi120.stdout:0/602: truncate d0/d3/dc/d12/d31/fbf 429308 0 2024-04-26T21:25:55.525 INFO:tasks.workunit.client.1.smithi120.stdout:4/524: mknod d10/d28/d73/cb6 0 2024-04-26T21:25:55.528 INFO:tasks.workunit.client.1.smithi120.stdout:1/476: mknod d6/d14/d6f/ca0 0 2024-04-26T21:25:55.530 INFO:tasks.workunit.client.0.smithi084.stdout:4/243: symlink d5/d7/d17/d42/l54 0 2024-04-26T21:25:55.530 INFO:tasks.workunit.client.0.smithi084.stdout:7/323: dread - d6/d26/d40/d4f/f56 zero size 2024-04-26T21:25:55.530 INFO:tasks.workunit.client.0.smithi084.stdout:0/305: stat de/d2b/d45/l5c 0 2024-04-26T21:25:55.531 INFO:tasks.workunit.client.1.smithi120.stdout:1/477: read d6/f15 [2664000,28877] 0 2024-04-26T21:25:55.531 INFO:tasks.workunit.client.0.smithi084.stdout:8/335: link d4/d6/db/d1e/d22/c36 d4/d7/d53/c63 0 2024-04-26T21:25:55.531 INFO:tasks.workunit.client.0.smithi084.stdout:1/333: link d2/d54/d5e/d66/d3a/d48/f50 d2/d54/d5e/d66/d3a/d48/f6e 0 2024-04-26T21:25:55.533 INFO:tasks.workunit.client.1.smithi120.stdout:0/603: getdents d0/d3/d51/d70/d71 0 2024-04-26T21:25:55.535 INFO:tasks.workunit.client.0.smithi084.stdout:2/423: link d6/d7/d68/f71 d6/d1b/f98 0 2024-04-26T21:25:55.535 INFO:tasks.workunit.client.1.smithi120.stdout:0/604: chown d0/d3/d51/d70/d99 8781787 1 2024-04-26T21:25:55.536 INFO:tasks.workunit.client.0.smithi084.stdout:5/303: dwrite d0/f22 [0,4194304] 0 2024-04-26T21:25:55.537 INFO:tasks.workunit.client.0.smithi084.stdout:4/244: write d5/d10/f13 [5057030,36155] 0 2024-04-26T21:25:55.538 INFO:tasks.workunit.client.0.smithi084.stdout:5/304: fdatasync d0/f32 0 2024-04-26T21:25:55.538 INFO:tasks.workunit.client.0.smithi084.stdout:1/334: stat d2/d19/f40 0 2024-04-26T21:25:55.539 INFO:tasks.workunit.client.0.smithi084.stdout:7/324: write d6/d9/fa [2841615,73720] 0 2024-04-26T21:25:55.542 INFO:tasks.workunit.client.0.smithi084.stdout:1/335: readlink d2/d19/l41 0 2024-04-26T21:25:55.547 INFO:tasks.workunit.client.1.smithi120.stdout:0/605: getdents d0/d3/dc/d12 0 2024-04-26T21:25:55.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.554+0000 7fc3db600700 1 -- 172.21.15.84:0/2287801746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3d4070890 msgr2=0x7fc3d4070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:55.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.554+0000 7fc3db600700 1 --2- 172.21.15.84:0/2287801746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3d4070890 0x7fc3d4070d00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0004940 tx=0x7fc3c0009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:55.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.555+0000 7fc3db600700 1 -- 172.21.15.84:0/2287801746 shutdown_connections 2024-04-26T21:25:55.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.555+0000 7fc3db600700 1 --2- 172.21.15.84:0/2287801746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3d4070890 0x7fc3d4070d00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:55.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.555+0000 7fc3db600700 1 --2- 172.21.15.84:0/2287801746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3d4071e40 0x7fc3d4070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:55.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.555+0000 7fc3db600700 1 -- 172.21.15.84:0/2287801746 >> 172.21.15.84:0/2287801746 conn(0x7fc3d40f8560 msgr2=0x7fc3d40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:55.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:55 smithi084 ceph-mon[25539]: pgmap v42: 65 pgs: 65 active+clean; 1.5 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 40 MiB/s rd, 188 MiB/s wr, 310 op/s 2024-04-26T21:25:55.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:55 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3465644079' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:25:55.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:55 smithi084 ceph-mon[25539]: Standby manager daemon smithi084.gyasul restarted 2024-04-26T21:25:55.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:55 smithi084 ceph-mon[25539]: Standby manager daemon smithi084.gyasul started 2024-04-26T21:25:55.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:55 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi084.gyasul/crt"}]: dispatch 2024-04-26T21:25:55.556 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:55 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:25:55.557 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:55 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi084.gyasul/key"}]: dispatch 2024-04-26T21:25:55.557 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:55 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:25:55.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.555+0000 7fc3db600700 1 -- 172.21.15.84:0/2287801746 shutdown_connections 2024-04-26T21:25:55.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.555+0000 7fc3db600700 1 -- 172.21.15.84:0/2287801746 wait complete. 2024-04-26T21:25:55.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.556+0000 7fc3db600700 1 Processor -- start 2024-04-26T21:25:55.557 INFO:tasks.workunit.client.0.smithi084.stdout:0/306: dread f9 [0,4194304] 0 2024-04-26T21:25:55.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.556+0000 7fc3db600700 1 -- start start 2024-04-26T21:25:55.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.557+0000 7fc3db600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3d4070890 0x7fc3d411cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:55.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.557+0000 7fc3db600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3d4071e40 0x7fc3d411d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:55.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.557+0000 7fc3db600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d411d870 con 0x7fc3d4070890 2024-04-26T21:25:55.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.557+0000 7fc3db600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d411dbe0 con 0x7fc3d4071e40 2024-04-26T21:25:55.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.558+0000 7fc3d8c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3d4070890 0x7fc3d411cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:55.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.558+0000 7fc3d8c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3d4070890 0x7fc3d411cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55522/0 (socket says 172.21.15.84:55522) 2024-04-26T21:25:55.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.558+0000 7fc3d8c00700 1 -- 172.21.15.84:0/2347266260 learned_addr learned my addr 172.21.15.84:0/2347266260 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:25:55.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.558+0000 7fc3d3e00700 1 --2- 172.21.15.84:0/2347266260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3d4071e40 0x7fc3d411d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:55.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.559+0000 7fc3d8c00700 1 -- 172.21.15.84:0/2347266260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3d4071e40 msgr2=0x7fc3d411d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:55.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.559+0000 7fc3d8c00700 1 --2- 172.21.15.84:0/2347266260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3d4071e40 0x7fc3d411d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:55.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.559+0000 7fc3d8c00700 1 -- 172.21.15.84:0/2347266260 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c0005040 con 0x7fc3d4070890 2024-04-26T21:25:55.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.559+0000 7fc3d8c00700 1 --2- 172.21.15.84:0/2347266260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3d4070890 0x7fc3d411cca0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800b790 tx=0x7fc3c8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:55.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.560+0000 7fc3d0c00700 1 -- 172.21.15.84:0/2347266260 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3c800f6f0 con 0x7fc3d4070890 2024-04-26T21:25:55.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.560+0000 7fc3d0c00700 1 -- 172.21.15.84:0/2347266260 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc3c800fd20 con 0x7fc3d4070890 2024-04-26T21:25:55.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.560+0000 7fc3d0c00700 1 -- 172.21.15.84:0/2347266260 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3c80103a0 con 0x7fc3d4070890 2024-04-26T21:25:55.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.560+0000 7fc3db600700 1 -- 172.21.15.84:0/2347266260 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d411dec0 con 0x7fc3d4070890 2024-04-26T21:25:55.561 INFO:tasks.workunit.client.0.smithi084.stdout:5/305: dread d0/f22 [0,4194304] 0 2024-04-26T21:25:55.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.560+0000 7fc3db600700 1 -- 172.21.15.84:0/2347266260 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d411e400 con 0x7fc3d4070890 2024-04-26T21:25:55.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.561+0000 7fc3db600700 1 -- 172.21.15.84:0/2347266260 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d405f5c0 con 0x7fc3d4070890 2024-04-26T21:25:55.563 INFO:tasks.workunit.client.0.smithi084.stdout:9/259: write da/f23 [728079,19535] 0 2024-04-26T21:25:55.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.563+0000 7fc3d0c00700 1 -- 172.21.15.84:0/2347266260 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) v1 ==== 92571+0+0 (secure 0 0 0) 0x7fc3c800f850 con 0x7fc3d4070890 2024-04-26T21:25:55.564 INFO:tasks.workunit.client.1.smithi120.stdout:1/478: dwrite d6/d7/d1d/f9b [0,4194304] 0 2024-04-26T21:25:55.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.564+0000 7fc3d0c00700 1 --2- 172.21.15.84:0/2347266260 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fc3bc06e620 0x7fc3bc070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:55.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.564+0000 7fc3d0c00700 1 -- 172.21.15.84:0/2347266260 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fc3c808dc50 con 0x7fc3d4070890 2024-04-26T21:25:55.565 INFO:tasks.workunit.client.0.smithi084.stdout:2/424: getdents d6/d7 0 2024-04-26T21:25:55.565 INFO:tasks.workunit.client.0.smithi084.stdout:1/336: chown d2/d54/d5e/d66/d3a/d48/f50 189529 1 2024-04-26T21:25:55.566 INFO:tasks.workunit.client.0.smithi084.stdout:0/307: symlink de/d20/d4c/l67 0 2024-04-26T21:25:55.566 INFO:tasks.workunit.client.0.smithi084.stdout:2/425: chown d6/d1b 4517 1 2024-04-26T21:25:55.567 INFO:tasks.workunit.client.1.smithi120.stdout:1/479: fdatasync d6/d7/f59 0 2024-04-26T21:25:55.568 INFO:tasks.workunit.client.1.smithi120.stdout:3/496: dread dd/d2a/d4a/f6b [0,4194304] 0 2024-04-26T21:25:55.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.568+0000 7fc3d3e00700 1 --2- 172.21.15.84:0/2347266260 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fc3bc06e620 0x7fc3bc070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:55.569 INFO:tasks.workunit.client.0.smithi084.stdout:0/308: write f6 [2933813,33769] 0 2024-04-26T21:25:55.570 INFO:tasks.workunit.client.1.smithi120.stdout:1/480: stat d6/fc 0 2024-04-26T21:25:55.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.571+0000 7fc3d3e00700 1 --2- 172.21.15.84:0/2347266260 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fc3bc06e620 0x7fc3bc070ad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000b3b0 tx=0x7fc3c0009e30 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:55.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.571+0000 7fc3d0c00700 1 -- 172.21.15.84:0/2347266260 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fc3c805aea0 con 0x7fc3d4070890 2024-04-26T21:25:55.573 INFO:tasks.workunit.client.1.smithi120.stdout:1/481: chown d6/d7/d1b/d89/d8c/d62 181468279 1 2024-04-26T21:25:55.573 INFO:tasks.workunit.client.1.smithi120.stdout:3/497: write dd/d2a/f5f [741561,103148] 0 2024-04-26T21:25:55.579 INFO:tasks.workunit.client.0.smithi084.stdout:9/260: rename l4 to da/de/d16/d40/l5b 0 2024-04-26T21:25:55.581 INFO:tasks.workunit.client.0.smithi084.stdout:0/309: mkdir de/d1c/d68 0 2024-04-26T21:25:55.582 INFO:tasks.workunit.client.1.smithi120.stdout:1/482: creat d6/d7/d1b/d55/fa1 x:0 0 0 2024-04-26T21:25:55.583 INFO:tasks.workunit.client.0.smithi084.stdout:0/310: chown de/d2b 4 1 2024-04-26T21:25:55.583 INFO:tasks.workunit.client.0.smithi084.stdout:4/245: write d5/f1a [1375699,95277] 0 2024-04-26T21:25:55.584 INFO:tasks.workunit.client.0.smithi084.stdout:2/426: dread d6/d7/f3f [0,4194304] 0 2024-04-26T21:25:55.587 INFO:tasks.workunit.client.0.smithi084.stdout:4/246: stat d5/d10/d15/d21/l3b 0 2024-04-26T21:25:55.589 INFO:tasks.workunit.client.1.smithi120.stdout:2/542: dread d4/d1b/d2e/d50/f3f [0,4194304] 0 2024-04-26T21:25:55.589 INFO:tasks.workunit.client.1.smithi120.stdout:1/483: truncate d6/fc 4368257 0 2024-04-26T21:25:55.589 INFO:tasks.workunit.client.0.smithi084.stdout:5/306: rename d0/l5 to d0/l5e 0 2024-04-26T21:25:55.593 INFO:tasks.workunit.client.0.smithi084.stdout:4/247: mknod d5/d25/c55 0 2024-04-26T21:25:55.593 INFO:tasks.workunit.client.0.smithi084.stdout:1/337: dwrite d2/d19/f4c [0,4194304] 0 2024-04-26T21:25:55.593 INFO:tasks.workunit.client.1.smithi120.stdout:1/484: stat d6/d7/d2d/d98/fe 0 2024-04-26T21:25:55.594 INFO:tasks.workunit.client.0.smithi084.stdout:2/427: mkdir d6/d7/d3d/d15/d1f/d22/d99 0 2024-04-26T21:25:55.596 INFO:tasks.workunit.client.1.smithi120.stdout:2/543: readlink d4/d1b/d2e/d50/d14/d15/d6c/l83 0 2024-04-26T21:25:55.597 INFO:tasks.workunit.client.1.smithi120.stdout:1/485: chown d6/l3f 5099485 1 2024-04-26T21:25:55.598 INFO:tasks.workunit.client.0.smithi084.stdout:5/307: write d0/f2c [86171,128779] 0 2024-04-26T21:25:55.600 INFO:tasks.workunit.client.0.smithi084.stdout:7/325: dread d6/d9/d12/d19/f3c [0,4194304] 0 2024-04-26T21:25:55.603 INFO:tasks.workunit.client.0.smithi084.stdout:1/338: read d2/d9/d15/f58 [307128,124135] 0 2024-04-26T21:25:55.603 INFO:tasks.workunit.client.1.smithi120.stdout:2/544: symlink d4/d1b/d2e/d5f/lb2 0 2024-04-26T21:25:55.604 INFO:tasks.workunit.client.1.smithi120.stdout:3/498: dwrite dd/de/d18/d24/f3a [0,4194304] 0 2024-04-26T21:25:55.606 INFO:tasks.workunit.client.0.smithi084.stdout:5/308: chown d0/d49/c58 24686395 1 2024-04-26T21:25:55.607 INFO:tasks.workunit.client.0.smithi084.stdout:7/326: chown d6/d9/d12/d19/d20 0 1 2024-04-26T21:25:55.609 INFO:tasks.workunit.client.0.smithi084.stdout:9/261: truncate da/f23 4104892 0 2024-04-26T21:25:55.610 INFO:tasks.workunit.client.0.smithi084.stdout:1/339: mknod d2/d54/d5e/d66/d2a/c6f 0 2024-04-26T21:25:55.611 INFO:tasks.workunit.client.0.smithi084.stdout:0/311: dwrite de/f12 [4194304,4194304] 0 2024-04-26T21:25:55.620 INFO:tasks.workunit.client.0.smithi084.stdout:1/340: symlink d2/d9/d15/d28/d5a/l70 0 2024-04-26T21:25:55.622 INFO:tasks.workunit.client.1.smithi120.stdout:0/606: dread d0/d3/dc/dd/f45 [4194304,4194304] 0 2024-04-26T21:25:55.626 INFO:tasks.workunit.client.0.smithi084.stdout:1/341: fdatasync d2/d9/d15/d28/f62 0 2024-04-26T21:25:55.627 INFO:tasks.workunit.client.1.smithi120.stdout:3/499: write dd/d2a/f33 [1392473,118321] 0 2024-04-26T21:25:55.628 INFO:tasks.workunit.client.1.smithi120.stdout:0/607: write d0/d3/dc/dd/fbb [1653068,83452] 0 2024-04-26T21:25:55.628 INFO:tasks.workunit.client.0.smithi084.stdout:5/309: dread d0/dc/df/d31/f3c [0,4194304] 0 2024-04-26T21:25:55.628 INFO:tasks.workunit.client.0.smithi084.stdout:9/262: dread da/de/d1e/f2f [0,4194304] 0 2024-04-26T21:25:55.628 INFO:tasks.workunit.client.1.smithi120.stdout:2/545: truncate d4/f10 1956343 0 2024-04-26T21:25:55.631 INFO:tasks.workunit.client.0.smithi084.stdout:1/342: fdatasync d2/d9/d15/d28/f62 0 2024-04-26T21:25:55.633 INFO:tasks.workunit.client.0.smithi084.stdout:1/343: chown d2/d1b/f65 854214 1 2024-04-26T21:25:55.636 INFO:tasks.workunit.client.0.smithi084.stdout:5/310: symlink d0/dc/df/d51/l5f 0 2024-04-26T21:25:55.637 INFO:tasks.workunit.client.0.smithi084.stdout:2/428: dwrite d6/d7/d3d/d15/d1f/d22/d2a/f8b [0,4194304] 0 2024-04-26T21:25:55.645 INFO:tasks.workunit.client.0.smithi084.stdout:2/429: readlink d6/d7/d3d/l70 0 2024-04-26T21:25:55.645 INFO:tasks.workunit.client.0.smithi084.stdout:5/311: creat d0/dc/df/d31/d53/f60 x:0 0 0 2024-04-26T21:25:55.651 INFO:tasks.workunit.client.0.smithi084.stdout:0/312: truncate de/d2b/f39 2049051 0 2024-04-26T21:25:55.653 INFO:tasks.workunit.client.0.smithi084.stdout:5/312: write d0/dc/df/d2a/d41/f55 [248254,5553] 0 2024-04-26T21:25:55.655 INFO:tasks.workunit.client.0.smithi084.stdout:9/263: read da/de/d16/f1b [727059,101794] 0 2024-04-26T21:25:55.656 INFO:tasks.workunit.client.0.smithi084.stdout:0/313: rmdir de/d2b 39 2024-04-26T21:25:55.656 INFO:tasks.workunit.client.0.smithi084.stdout:4/248: dread d5/f23 [0,4194304] 0 2024-04-26T21:25:55.656 INFO:tasks.workunit.client.0.smithi084.stdout:2/430: write d6/d7/d3d/f26 [4189069,18141] 0 2024-04-26T21:25:55.659 INFO:tasks.workunit.client.0.smithi084.stdout:2/431: fsync d6/f14 0 2024-04-26T21:25:55.663 INFO:tasks.workunit.client.0.smithi084.stdout:2/432: chown d6/d7/d3d/l70 11 1 2024-04-26T21:25:55.664 INFO:tasks.workunit.client.0.smithi084.stdout:5/313: rename d0/dc/df/d31/f4c to d0/d49/d56/f61 0 2024-04-26T21:25:55.665 INFO:tasks.workunit.client.0.smithi084.stdout:7/327: dread d6/d26/f30 [0,4194304] 0 2024-04-26T21:25:55.666 INFO:tasks.workunit.client.0.smithi084.stdout:1/344: dwrite d2/d1b/f55 [0,4194304] 0 2024-04-26T21:25:55.668 INFO:tasks.workunit.client.0.smithi084.stdout:4/249: creat d5/d25/f56 x:0 0 0 2024-04-26T21:25:55.670 INFO:tasks.workunit.client.0.smithi084.stdout:2/433: symlink d6/d7/d68/l9a 0 2024-04-26T21:25:55.671 INFO:tasks.workunit.client.0.smithi084.stdout:9/264: creat da/de/d1e/d56/f5c x:0 0 0 2024-04-26T21:25:55.671 INFO:tasks.workunit.client.0.smithi084.stdout:7/328: truncate d6/f65 42448 0 2024-04-26T21:25:55.677 INFO:tasks.workunit.client.1.smithi120.stdout:0/608: fdatasync d0/d3/dc/dd/d1b/fa1 0 2024-04-26T21:25:55.678 INFO:tasks.workunit.client.1.smithi120.stdout:3/500: fdatasync dd/de/df/d12/fa0 0 2024-04-26T21:25:55.678 INFO:tasks.workunit.client.0.smithi084.stdout:1/345: dread - d2/d54/d5e/d66/f44 zero size 2024-04-26T21:25:55.679 INFO:tasks.workunit.client.1.smithi120.stdout:2/546: rename d4/d1b/d2e/d50/d14/d15/f45 to d4/d1b/d2e/d50/d14/d15/d6c/fb3 0 2024-04-26T21:25:55.680 INFO:tasks.workunit.client.0.smithi084.stdout:9/265: rmdir da/de/d16/d25/d41/d43/d48 39 2024-04-26T21:25:55.680 INFO:tasks.workunit.client.0.smithi084.stdout:1/346: dread - d2/d54/f5c zero size 2024-04-26T21:25:55.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:55 smithi120 ceph-mon[32741]: pgmap v42: 65 pgs: 65 active+clean; 1.5 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 40 MiB/s rd, 188 MiB/s wr, 310 op/s 2024-04-26T21:25:55.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:55 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/3465644079' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:25:55.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:55 smithi120 ceph-mon[32741]: Standby manager daemon smithi084.gyasul restarted 2024-04-26T21:25:55.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:55 smithi120 ceph-mon[32741]: Standby manager daemon smithi084.gyasul started 2024-04-26T21:25:55.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:55 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi084.gyasul/crt"}]: dispatch 2024-04-26T21:25:55.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:55 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:25:55.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:55 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi084.gyasul/key"}]: dispatch 2024-04-26T21:25:55.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:55 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:25:55.683 INFO:tasks.workunit.client.0.smithi084.stdout:0/314: link de/f14 de/d1c/d32/f69 0 2024-04-26T21:25:55.684 INFO:tasks.workunit.client.1.smithi120.stdout:0/609: mkdir d0/dd1 0 2024-04-26T21:25:55.684 INFO:tasks.workunit.client.0.smithi084.stdout:9/266: write da/de/d1e/f49 [834807,34949] 0 2024-04-26T21:25:55.687 INFO:tasks.workunit.client.0.smithi084.stdout:2/434: write d6/d7/d3d/d15/f7f [2510014,44240] 0 2024-04-26T21:25:55.690 INFO:tasks.workunit.client.0.smithi084.stdout:7/329: link d6/d26/c2b d6/d26/d40/d41/c6f 0 2024-04-26T21:25:55.691 INFO:tasks.workunit.client.1.smithi120.stdout:2/547: mknod d4/d1b/d2e/d50/d14/d15/cb4 0 2024-04-26T21:25:55.692 INFO:tasks.workunit.client.1.smithi120.stdout:2/548: read - d4/d1b/d2e/fa7 zero size 2024-04-26T21:25:55.694 INFO:tasks.workunit.client.0.smithi084.stdout:1/347: rmdir d2/d19/d63/d64 0 2024-04-26T21:25:55.696 INFO:tasks.workunit.client.1.smithi120.stdout:0/610: mkdir d0/dd1/dd2 0 2024-04-26T21:25:55.698 INFO:tasks.workunit.client.1.smithi120.stdout:0/611: chown d0/df/c62 216312 1 2024-04-26T21:25:55.699 INFO:tasks.workunit.client.0.smithi084.stdout:9/267: mknod da/de/d16/d55/c5d 0 2024-04-26T21:25:55.701 INFO:tasks.workunit.client.1.smithi120.stdout:2/549: creat d4/d1b/d56/fb5 x:0 0 0 2024-04-26T21:25:55.701 INFO:tasks.workunit.client.0.smithi084.stdout:4/250: dwrite d5/d10/d15/d21/d29/f3c [0,4194304] 0 2024-04-26T21:25:55.701 INFO:tasks.workunit.client.0.smithi084.stdout:1/348: stat d2/d9/f16 0 2024-04-26T21:25:55.702 INFO:tasks.workunit.client.1.smithi120.stdout:3/501: dwrite dd/de/df/d12/f89 [0,4194304] 0 2024-04-26T21:25:55.704 INFO:tasks.workunit.client.0.smithi084.stdout:2/435: rename c1 to d6/d7/d3d/d79/d85/c9b 0 2024-04-26T21:25:55.707 INFO:tasks.workunit.client.1.smithi120.stdout:3/502: stat dd/de/d18/d8d 0 2024-04-26T21:25:55.714 INFO:tasks.workunit.client.1.smithi120.stdout:3/503: creat dd/de/d18/d2c/d76/d3b/d56/fa5 x:0 0 0 2024-04-26T21:25:55.720 INFO:tasks.workunit.client.0.smithi084.stdout:1/349: creat d2/d19/d63/f71 x:0 0 0 2024-04-26T21:25:55.724 INFO:tasks.workunit.client.0.smithi084.stdout:0/315: dread de/f12 [4194304,4194304] 0 2024-04-26T21:25:55.724 INFO:tasks.workunit.client.0.smithi084.stdout:4/251: mknod d5/d7/d17/d32/d46/c57 0 2024-04-26T21:25:55.725 INFO:tasks.workunit.client.0.smithi084.stdout:4/252: truncate d5/f4c 344550 0 2024-04-26T21:25:55.729 INFO:tasks.workunit.client.0.smithi084.stdout:0/316: dread - de/d20/d4e/f60 zero size 2024-04-26T21:25:55.730 INFO:tasks.workunit.client.0.smithi084.stdout:4/253: unlink d5/c19 0 2024-04-26T21:25:55.733 INFO:tasks.workunit.client.0.smithi084.stdout:4/254: chown d5/d7/d17/d32/f34 33820920 1 2024-04-26T21:25:55.734 INFO:tasks.workunit.client.0.smithi084.stdout:2/436: truncate d6/d7/d3d/f54 171685 0 2024-04-26T21:25:55.736 INFO:tasks.workunit.client.0.smithi084.stdout:9/268: dread da/f34 [0,4194304] 0 2024-04-26T21:25:55.737 INFO:tasks.workunit.client.0.smithi084.stdout:7/330: dread d6/dc/f55 [0,4194304] 0 2024-04-26T21:25:55.738 INFO:tasks.workunit.client.1.smithi120.stdout:0/612: truncate d0/d3/f9 3745402 0 2024-04-26T21:25:55.738 INFO:tasks.workunit.client.0.smithi084.stdout:2/437: chown d6/d7/d68/c72 295804 1 2024-04-26T21:25:55.739 INFO:tasks.workunit.client.0.smithi084.stdout:0/317: write de/d1c/f4a [2849261,82621] 0 2024-04-26T21:25:55.739 INFO:tasks.workunit.client.0.smithi084.stdout:4/255: rename d5/d7/d17/d32/l4a to d5/d2e/l58 0 2024-04-26T21:25:55.740 INFO:tasks.workunit.client.1.smithi120.stdout:3/504: write dd/de/d18/d37/f78 [1066008,94624] 0 2024-04-26T21:25:55.743 INFO:tasks.workunit.client.0.smithi084.stdout:9/269: mknod da/de/d16/c5e 0 2024-04-26T21:25:55.744 INFO:tasks.workunit.client.1.smithi120.stdout:0/613: truncate d0/f72 771516 0 2024-04-26T21:25:55.746 INFO:tasks.workunit.client.0.smithi084.stdout:7/331: truncate d6/dc/d47/f48 800654 0 2024-04-26T21:25:55.746 INFO:tasks.workunit.client.0.smithi084.stdout:4/256: fdatasync d5/d25/f2f 0 2024-04-26T21:25:55.747 INFO:tasks.workunit.client.0.smithi084.stdout:0/318: rename f6 to de/d20/d4e/f6a 0 2024-04-26T21:25:55.747 INFO:tasks.workunit.client.1.smithi120.stdout:3/505: getdents dd/d40 0 2024-04-26T21:25:55.749 INFO:tasks.workunit.client.0.smithi084.stdout:7/332: fdatasync d6/f65 0 2024-04-26T21:25:55.750 INFO:tasks.workunit.client.1.smithi120.stdout:0/614: write d0/d3/dc/dd/d1b/d24/d73/fab [3140703,16348] 0 2024-04-26T21:25:55.757 INFO:tasks.workunit.client.1.smithi120.stdout:0/615: symlink d0/d3/dc/dd/ld3 0 2024-04-26T21:25:55.760 INFO:tasks.workunit.client.1.smithi120.stdout:0/616: stat d0/d3/c6 0 2024-04-26T21:25:55.765 INFO:tasks.workunit.client.1.smithi120.stdout:3/506: dwrite dd/d40/f50 [0,4194304] 0 2024-04-26T21:25:55.771 INFO:tasks.workunit.client.1.smithi120.stdout:3/507: unlink dd/de/d18/d2c/d76/l6f 0 2024-04-26T21:25:55.773 INFO:tasks.workunit.client.1.smithi120.stdout:3/508: chown dd/de/df/d12/d48/d9b 186927 1 2024-04-26T21:25:55.779 INFO:tasks.workunit.client.1.smithi120.stdout:0/617: dread d0/f90 [0,4194304] 0 2024-04-26T21:25:55.783 INFO:tasks.workunit.client.1.smithi120.stdout:0/618: symlink d0/d3/dc/d12/d31/ld4 0 2024-04-26T21:25:55.787 INFO:tasks.workunit.client.1.smithi120.stdout:0/619: mknod d0/d3/dc/dd/d1b/d39/cd5 0 2024-04-26T21:25:55.791 INFO:tasks.workunit.client.1.smithi120.stdout:0/620: creat d0/d3/dc/dd/d1b/daa/fd6 x:0 0 0 2024-04-26T21:25:55.793 INFO:tasks.workunit.client.1.smithi120.stdout:3/509: dwrite dd/de/d83/f81 [0,4194304] 0 2024-04-26T21:25:55.794 INFO:tasks.workunit.client.1.smithi120.stdout:3/510: read dd/de/d83/d64/f84 [3597356,30251] 0 2024-04-26T21:25:55.796 INFO:tasks.workunit.client.1.smithi120.stdout:0/621: truncate d0/d3/dc/d12/dae/faf 2977951 0 2024-04-26T21:25:55.797 INFO:tasks.workunit.client.1.smithi120.stdout:0/622: chown d0/df/d79 138957 1 2024-04-26T21:25:55.801 INFO:tasks.workunit.client.1.smithi120.stdout:3/511: chown dd/de/d18/d2c/d76/c30 5708 1 2024-04-26T21:25:55.803 INFO:tasks.workunit.client.1.smithi120.stdout:3/512: fsync dd/de/d18/d37/f78 0 2024-04-26T21:25:55.804 INFO:tasks.workunit.client.1.smithi120.stdout:0/623: write d0/d3/dc/dd/d1b/d24/d7d/fce [721826,48436] 0 2024-04-26T21:25:55.814 INFO:tasks.workunit.client.1.smithi120.stdout:3/513: truncate dd/de/d18/d37/f78 2664185 0 2024-04-26T21:25:55.818 INFO:tasks.workunit.client.1.smithi120.stdout:3/514: truncate dd/de/d18/d2c/f8a 683682 0 2024-04-26T21:25:55.819 INFO:tasks.workunit.client.0.smithi084.stdout:3/342: sync 2024-04-26T21:25:55.819 INFO:tasks.workunit.client.0.smithi084.stdout:6/351: sync 2024-04-26T21:25:55.820 INFO:tasks.workunit.client.1.smithi120.stdout:3/515: mknod dd/de/df/d12/d48/d6d/ca6 0 2024-04-26T21:25:55.823 INFO:tasks.workunit.client.1.smithi120.stdout:3/516: read - dd/de/d18/d2c/d76/d3b/d56/d75/f7b zero size 2024-04-26T21:25:55.823 INFO:tasks.workunit.client.0.smithi084.stdout:1/350: dwrite d2/fb [0,4194304] 0 2024-04-26T21:25:55.824 INFO:tasks.workunit.client.0.smithi084.stdout:4/257: mknod d5/d25/d35/c59 0 2024-04-26T21:25:55.825 INFO:tasks.workunit.client.0.smithi084.stdout:7/333: chown d6/d9/d12/f3e 7275387 1 2024-04-26T21:25:55.825 INFO:tasks.workunit.client.0.smithi084.stdout:6/352: write d3/de/d1a/d2f/f3c [49290,58295] 0 2024-04-26T21:25:55.828 INFO:tasks.workunit.client.0.smithi084.stdout:6/353: chown d3/d6c 497 1 2024-04-26T21:25:55.829 INFO:tasks.workunit.client.1.smithi120.stdout:3/517: unlink dd/de/df/d12/d6c/f39 0 2024-04-26T21:25:55.829 INFO:tasks.workunit.client.0.smithi084.stdout:7/334: write d6/d26/f45 [374580,95441] 0 2024-04-26T21:25:55.831 INFO:tasks.workunit.client.0.smithi084.stdout:9/270: truncate da/de/d16/d25/d41/d43/d48/f58 156097 0 2024-04-26T21:25:55.831 INFO:tasks.workunit.client.0.smithi084.stdout:3/343: symlink d1/d2c/d2f/d31/d52/l75 0 2024-04-26T21:25:55.832 INFO:tasks.workunit.client.0.smithi084.stdout:0/319: truncate de/f14 1873009 0 2024-04-26T21:25:55.833 INFO:tasks.workunit.client.1.smithi120.stdout:3/518: read dd/de/d18/d24/d43/f4c [169674,91707] 0 2024-04-26T21:25:55.836 INFO:tasks.workunit.client.0.smithi084.stdout:7/335: write d6/d9/d12/d19/d20/f44 [1560828,71849] 0 2024-04-26T21:25:55.837 INFO:tasks.workunit.client.1.smithi120.stdout:0/624: dread d0/df/d59/f98 [0,4194304] 0 2024-04-26T21:25:55.837 INFO:tasks.workunit.client.1.smithi120.stdout:3/519: truncate dd/de/d83/d64/fa4 222469 0 2024-04-26T21:25:55.838 INFO:tasks.workunit.client.0.smithi084.stdout:6/354: symlink d3/d6c/l7d 0 2024-04-26T21:25:55.839 INFO:tasks.workunit.client.0.smithi084.stdout:7/336: truncate d6/d1c/f4e 497902 0 2024-04-26T21:25:55.840 INFO:tasks.workunit.client.1.smithi120.stdout:3/520: fsync dd/de/d18/d2c/d76/d3b/f67 0 2024-04-26T21:25:55.842 INFO:tasks.workunit.client.1.smithi120.stdout:0/625: symlink d0/d3/dc/d12/d31/ld7 0 2024-04-26T21:25:55.844 INFO:tasks.workunit.client.0.smithi084.stdout:0/320: rmdir de/d20 39 2024-04-26T21:25:55.846 INFO:tasks.workunit.client.1.smithi120.stdout:0/626: chown d0/d3/dc/dd/d1b/daa/fd6 0 1 2024-04-26T21:25:55.847 INFO:tasks.workunit.client.0.smithi084.stdout:9/271: mkdir da/de/d16/d25/d4f/d5f 0 2024-04-26T21:25:55.849 INFO:tasks.workunit.client.1.smithi120.stdout:0/627: write d0/d3/f3c [3380539,39355] 0 2024-04-26T21:25:55.853 INFO:tasks.workunit.client.1.smithi120.stdout:0/628: dread - d0/d3/dc/dd/d1b/d24/d73/db7/fc7 zero size 2024-04-26T21:25:55.855 INFO:tasks.workunit.client.0.smithi084.stdout:3/344: rmdir d1 39 2024-04-26T21:25:55.858 INFO:tasks.workunit.client.0.smithi084.stdout:4/258: creat d5/d7/d17/d45/f5a x:0 0 0 2024-04-26T21:25:55.862 INFO:tasks.workunit.client.1.smithi120.stdout:3/521: write dd/de/df/d12/d48/f55 [1674234,31778] 0 2024-04-26T21:25:55.862 INFO:tasks.workunit.client.0.smithi084.stdout:9/272: mknod da/de/d16/d40/c60 0 2024-04-26T21:25:55.865 INFO:tasks.workunit.client.0.smithi084.stdout:6/355: creat d3/de/d1a/d43/d75/f7e x:0 0 0 2024-04-26T21:25:55.866 INFO:tasks.workunit.client.1.smithi120.stdout:7/517: sync 2024-04-26T21:25:55.866 INFO:tasks.workunit.client.1.smithi120.stdout:6/556: sync 2024-04-26T21:25:55.866 INFO:tasks.workunit.client.1.smithi120.stdout:8/492: sync 2024-04-26T21:25:55.866 INFO:tasks.workunit.client.1.smithi120.stdout:4/525: sync 2024-04-26T21:25:55.867 INFO:tasks.workunit.client.1.smithi120.stdout:9/529: sync 2024-04-26T21:25:55.867 INFO:tasks.workunit.client.1.smithi120.stdout:5/603: sync 2024-04-26T21:25:55.870 INFO:tasks.workunit.client.1.smithi120.stdout:7/518: mknod d7/cb5 0 2024-04-26T21:25:55.871 INFO:tasks.workunit.client.1.smithi120.stdout:8/493: chown d5/d6/d75 701051 1 2024-04-26T21:25:55.873 INFO:tasks.workunit.client.1.smithi120.stdout:4/526: symlink d10/d28/d73/lb7 0 2024-04-26T21:25:55.874 INFO:tasks.workunit.client.0.smithi084.stdout:1/351: truncate d2/d9/f14 492401 0 2024-04-26T21:25:55.876 INFO:tasks.workunit.client.0.smithi084.stdout:9/273: mkdir da/de/d16/d25/d41/d43/d48/d61 0 2024-04-26T21:25:55.877 INFO:tasks.workunit.client.0.smithi084.stdout:6/356: symlink d3/de/d1a/d43/l7f 0 2024-04-26T21:25:55.878 INFO:tasks.workunit.client.1.smithi120.stdout:4/527: chown d10/d12/l69 5165861 1 2024-04-26T21:25:55.881 INFO:tasks.workunit.client.0.smithi084.stdout:1/352: mkdir d2/d54/d5e/d66/d2a/d72 0 2024-04-26T21:25:55.886 INFO:tasks.workunit.client.1.smithi120.stdout:0/629: dwrite d0/d3/dc/dd/f21 [0,4194304] 0 2024-04-26T21:25:55.886 INFO:tasks.workunit.client.1.smithi120.stdout:4/528: readlink d10/l70 0 2024-04-26T21:25:55.886 INFO:tasks.workunit.client.1.smithi120.stdout:8/494: write d5/d6/d11/d52/d27/f6d [1098985,120060] 0 2024-04-26T21:25:55.887 INFO:tasks.workunit.client.1.smithi120.stdout:9/530: link d0/dd/d3a/d5c/d9f/fa2 d0/dd/d34/d8a/d9b/fab 0 2024-04-26T21:25:55.887 INFO:tasks.workunit.client.0.smithi084.stdout:6/357: write d3/de/d1a/d2f/f56 [307177,36464] 0 2024-04-26T21:25:55.887 INFO:tasks.workunit.client.0.smithi084.stdout:6/358: chown d3/de/d15/d40 897194025 1 2024-04-26T21:25:55.887 INFO:tasks.workunit.client.0.smithi084.stdout:9/274: read da/de/d16/d25/f36 [211969,31001] 0 2024-04-26T21:25:55.888 INFO:tasks.workunit.client.0.smithi084.stdout:0/321: creat de/d2b/f6b x:0 0 0 2024-04-26T21:25:55.889 INFO:tasks.workunit.client.0.smithi084.stdout:1/353: unlink d2/d9/d15/d28/c33 0 2024-04-26T21:25:55.889 INFO:tasks.workunit.client.1.smithi120.stdout:5/604: rmdir d2/dc/d1d/d21/d66/d6a/d8c/daa 39 2024-04-26T21:25:55.890 INFO:tasks.workunit.client.1.smithi120.stdout:8/495: write d5/f30 [1690202,48230] 0 2024-04-26T21:25:55.891 INFO:tasks.workunit.client.0.smithi084.stdout:0/322: mknod de/d2b/d64/c6c 0 2024-04-26T21:25:55.894 INFO:tasks.workunit.client.0.smithi084.stdout:9/275: rename da/de/d1e/c3f to da/de/d16/d55/c62 0 2024-04-26T21:25:55.895 INFO:tasks.workunit.client.1.smithi120.stdout:9/531: chown d0/dd/d34/fa7 104 1 2024-04-26T21:25:55.895 INFO:tasks.workunit.client.1.smithi120.stdout:3/522: dwrite fa [0,4194304] 0 2024-04-26T21:25:55.895 INFO:tasks.workunit.client.1.smithi120.stdout:7/519: rename d7/d64/da6/d1f/d28/d4c/fb0 to d7/d64/da6/d2f/fb6 0 2024-04-26T21:25:55.895 INFO:tasks.workunit.client.0.smithi084.stdout:1/354: mknod d2/d1b/c73 0 2024-04-26T21:25:55.895 INFO:tasks.workunit.client.0.smithi084.stdout:0/323: mknod de/d2b/d64/c6d 0 2024-04-26T21:25:55.897 INFO:tasks.workunit.client.1.smithi120.stdout:1/486: sync 2024-04-26T21:25:55.900 INFO:tasks.workunit.client.1.smithi120.stdout:0/630: creat d0/dd1/fd8 x:0 0 0 2024-04-26T21:25:55.900 INFO:tasks.workunit.client.1.smithi120.stdout:7/520: chown d7/f8 261444639 1 2024-04-26T21:25:55.901 INFO:tasks.workunit.client.1.smithi120.stdout:5/605: mkdir d2/dc/d1d/d21/d77/d79/dd9 0 2024-04-26T21:25:55.905 INFO:tasks.workunit.client.1.smithi120.stdout:4/529: rename l7 to d10/d12/da1/lb8 0 2024-04-26T21:25:55.905 INFO:tasks.workunit.client.1.smithi120.stdout:8/496: write d5/d6/d11/d32/d3b/f6f [83967,124410] 0 2024-04-26T21:25:55.907 INFO:tasks.workunit.client.1.smithi120.stdout:9/532: chown d0/d6/d4d/c6d 11519548 1 2024-04-26T21:25:55.909 INFO:tasks.workunit.client.0.smithi084.stdout:3/345: dwrite d1/d2c/d2f/d31/f43 [4194304,4194304] 0 2024-04-26T21:25:55.909 INFO:tasks.workunit.client.0.smithi084.stdout:9/276: mknod da/de/d16/d25/d41/d43/d48/d61/c63 0 2024-04-26T21:25:55.913 INFO:tasks.workunit.client.1.smithi120.stdout:6/557: dwrite d4/db/d10/dd/d28/f89 [0,4194304] 0 2024-04-26T21:25:55.915 INFO:tasks.workunit.client.0.smithi084.stdout:3/346: dread - d1/d2c/d2f/d31/f63 zero size 2024-04-26T21:25:55.915 INFO:tasks.workunit.client.1.smithi120.stdout:3/523: rename dd/de/d18/d2c/d76/d3b/d56/d75/f7b to dd/de/d83/fa7 0 2024-04-26T21:25:55.919 INFO:tasks.workunit.client.1.smithi120.stdout:1/487: unlink d6/d7/d1d/d5d/d67/c5f 0 2024-04-26T21:25:55.920 INFO:tasks.workunit.client.0.smithi084.stdout:9/277: creat da/de/d16/d40/f64 x:0 0 0 2024-04-26T21:25:55.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.921+0000 7fc3db600700 1 -- 172.21.15.84:0/2347266260 --> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3d411e840 con 0x7fc3bc06e620 2024-04-26T21:25:55.923 INFO:tasks.workunit.client.0.smithi084.stdout:4/259: dread d5/d7/d17/d32/f34 [0,4194304] 0 2024-04-26T21:25:55.923 INFO:tasks.workunit.client.0.smithi084.stdout:3/347: chown d1/d2c/c39 86179 1 2024-04-26T21:25:55.924 INFO:tasks.workunit.client.0.smithi084.stdout:6/359: dwrite d3/de/d15/d23/f4d [0,4194304] 0 2024-04-26T21:25:55.926 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:25:55.926 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:25:55.926 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:25:55.926 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:25:55.926 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [], 2024-04-26T21:25:55.926 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "", 2024-04-26T21:25:55.926 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading mgr daemons", 2024-04-26T21:25:55.926 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:25:55.926 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:25:55.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.925+0000 7fc3d0c00700 1 -- 172.21.15.84:0/2347266260 <== mgr.14662 v2:172.21.15.120:6828/3773295163 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fc3d411e840 con 0x7fc3bc06e620 2024-04-26T21:25:55.927 INFO:tasks.workunit.client.1.smithi120.stdout:1/488: readlink d6/d7/d2d/d98/l33 0 2024-04-26T21:25:55.929 INFO:tasks.workunit.client.1.smithi120.stdout:1/489: chown d6/d7/d1d/d5d/d67/fb 160 1 2024-04-26T21:25:55.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.930+0000 7fc3db600700 1 -- 172.21.15.84:0/2347266260 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fc3bc06e620 msgr2=0x7fc3bc070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:55.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.930+0000 7fc3db600700 1 --2- 172.21.15.84:0/2347266260 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fc3bc06e620 0x7fc3bc070ad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000b3b0 tx=0x7fc3c0009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:55.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.930+0000 7fc3db600700 1 -- 172.21.15.84:0/2347266260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3d4070890 msgr2=0x7fc3d411cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:55.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.930+0000 7fc3db600700 1 --2- 172.21.15.84:0/2347266260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3d4070890 0x7fc3d411cca0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800b790 tx=0x7fc3c8009220 comp rx=0 tx=0).stop 2024-04-26T21:25:55.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.930+0000 7fc3db600700 1 -- 172.21.15.84:0/2347266260 shutdown_connections 2024-04-26T21:25:55.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.930+0000 7fc3db600700 1 --2- 172.21.15.84:0/2347266260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3d4070890 0x7fc3d411cca0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:55.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.930+0000 7fc3db600700 1 --2- 172.21.15.84:0/2347266260 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7fc3bc06e620 0x7fc3bc070ad0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:55.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.930+0000 7fc3db600700 1 --2- 172.21.15.84:0/2347266260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3d4071e40 0x7fc3d411d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:55.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.930+0000 7fc3db600700 1 -- 172.21.15.84:0/2347266260 >> 172.21.15.84:0/2347266260 conn(0x7fc3d40f8560 msgr2=0x7fc3d40f9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:55.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.931+0000 7fc3db600700 1 -- 172.21.15.84:0/2347266260 shutdown_connections 2024-04-26T21:25:55.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:55.931+0000 7fc3db600700 1 -- 172.21.15.84:0/2347266260 wait complete. 2024-04-26T21:25:55.933 INFO:tasks.workunit.client.0.smithi084.stdout:3/348: rmdir d1/d24/d27 39 2024-04-26T21:25:55.939 INFO:tasks.workunit.client.0.smithi084.stdout:4/260: write d5/d25/f2f [74304,91637] 0 2024-04-26T21:25:55.939 INFO:tasks.workunit.client.0.smithi084.stdout:1/355: dwrite d2/d9/d15/f25 [0,4194304] 0 2024-04-26T21:25:55.939 INFO:tasks.workunit.client.0.smithi084.stdout:9/278: symlink da/de/d16/d25/d41/d43/d48/l65 0 2024-04-26T21:25:55.943 INFO:tasks.workunit.client.1.smithi120.stdout:5/606: mknod d2/dc/d1d/d1f/d36/d67/cda 0 2024-04-26T21:25:55.943 INFO:tasks.workunit.client.0.smithi084.stdout:3/349: write d1/d24/d27/f2b [1619372,104627] 0 2024-04-26T21:25:55.943 INFO:tasks.workunit.client.1.smithi120.stdout:1/490: unlink d6/d7/d1d/d2c/f31 0 2024-04-26T21:25:55.944 INFO:tasks.workunit.client.0.smithi084.stdout:9/279: dread - da/f45 zero size 2024-04-26T21:25:55.949 INFO:tasks.workunit.client.1.smithi120.stdout:0/631: getdents d0/d3/dc/dd/d1b 0 2024-04-26T21:25:55.952 INFO:tasks.workunit.client.0.smithi084.stdout:4/261: write d5/f4c [489337,17529] 0 2024-04-26T21:25:55.953 INFO:tasks.workunit.client.1.smithi120.stdout:4/530: getdents d10/d12/da1 0 2024-04-26T21:25:55.955 INFO:tasks.workunit.client.0.smithi084.stdout:1/356: unlink d2/d54/d5e/d66/d2a/c6f 0 2024-04-26T21:25:55.957 INFO:tasks.workunit.client.1.smithi120.stdout:5/607: write d2/dc/d1d/d21/d66/f41 [4085209,38683] 0 2024-04-26T21:25:55.959 INFO:tasks.workunit.client.1.smithi120.stdout:1/491: truncate d6/d7/d2d/d98/d56/f57 4341227 0 2024-04-26T21:25:55.961 INFO:tasks.workunit.client.0.smithi084.stdout:6/360: getdents d3/de/d1a 0 2024-04-26T21:25:55.965 INFO:tasks.workunit.client.1.smithi120.stdout:3/524: truncate dd/d2a/d4a/f6b 1458849 0 2024-04-26T21:25:55.966 INFO:tasks.workunit.client.0.smithi084.stdout:6/361: write d3/de/d1a/d43/f48 [559183,33140] 0 2024-04-26T21:25:55.967 INFO:tasks.workunit.client.0.smithi084.stdout:9/280: creat da/de/f66 x:0 0 0 2024-04-26T21:25:55.968 INFO:tasks.workunit.client.0.smithi084.stdout:6/362: stat d3/de/d1a/d43/l78 0 2024-04-26T21:25:55.969 INFO:tasks.workunit.client.0.smithi084.stdout:9/281: stat da/de/d16/d25/d41 0 2024-04-26T21:25:55.969 INFO:tasks.workunit.client.1.smithi120.stdout:7/521: dwrite d7/d64/da6/d1f/d28/d4c/d6b/d7b/f80 [4194304,4194304] 0 2024-04-26T21:25:55.971 INFO:tasks.workunit.client.0.smithi084.stdout:6/363: fdatasync d3/d18/f5b 0 2024-04-26T21:25:55.975 INFO:tasks.workunit.client.1.smithi120.stdout:8/497: dread d5/d6/d11/d52/d70/f22 [0,4194304] 0 2024-04-26T21:25:55.975 INFO:tasks.workunit.client.0.smithi084.stdout:1/357: dwrite d2/d9/d15/d28/d47/f4b [0,4194304] 0 2024-04-26T21:25:55.976 INFO:tasks.workunit.client.0.smithi084.stdout:5/314: sync 2024-04-26T21:25:55.976 INFO:tasks.workunit.client.0.smithi084.stdout:8/336: sync 2024-04-26T21:25:55.976 INFO:tasks.workunit.client.0.smithi084.stdout:6/364: truncate d3/d18/d37/f49 163663 0 2024-04-26T21:25:55.978 INFO:tasks.workunit.client.0.smithi084.stdout:6/365: dread - d3/de/f63 zero size 2024-04-26T21:25:55.979 INFO:tasks.workunit.client.0.smithi084.stdout:8/337: truncate d4/d6/f47 985070 0 2024-04-26T21:25:55.979 INFO:tasks.workunit.client.1.smithi120.stdout:6/558: dwrite d4/db/f5a [0,4194304] 0 2024-04-26T21:25:55.981 INFO:tasks.workunit.client.0.smithi084.stdout:8/338: fsync d4/d6/db/d1e/d22/d2f/f2c 0 2024-04-26T21:25:55.984 INFO:tasks.workunit.client.1.smithi120.stdout:3/525: mknod dd/de/df/d12/d48/ca8 0 2024-04-26T21:25:55.985 INFO:tasks.workunit.client.1.smithi120.stdout:7/522: truncate d7/d64/da6/d1f/d28/d4c/f89 8550292 0 2024-04-26T21:25:55.985 INFO:tasks.workunit.client.0.smithi084.stdout:5/315: rename d0/d17/c3a to d0/d49/d4d/c62 0 2024-04-26T21:25:55.989 INFO:tasks.workunit.client.1.smithi120.stdout:5/608: mknod d2/dc/d1d/d21/d77/d79/db7/cdb 0 2024-04-26T21:25:55.989 INFO:tasks.workunit.client.1.smithi120.stdout:1/492: link d6/d9/l21 d6/d7/d1b/d55/la2 0 2024-04-26T21:25:55.989 INFO:tasks.workunit.client.1.smithi120.stdout:4/531: dread d10/d65/d72/d86/f9a [0,4194304] 0 2024-04-26T21:25:55.990 INFO:tasks.workunit.client.0.smithi084.stdout:9/282: getdents da 0 2024-04-26T21:25:55.990 INFO:tasks.workunit.client.0.smithi084.stdout:5/316: stat d0/dc/df/f44 0 2024-04-26T21:25:55.992 INFO:tasks.workunit.client.0.smithi084.stdout:6/366: dread d3/fc [0,4194304] 0 2024-04-26T21:25:55.994 INFO:tasks.workunit.client.1.smithi120.stdout:5/609: chown d2/dc/d1d/d21/d77/f86 116020822 1 2024-04-26T21:25:55.994 INFO:tasks.workunit.client.1.smithi120.stdout:0/632: dread d0/d3/d13/d64/f69 [0,4194304] 0 2024-04-26T21:25:55.996 INFO:tasks.workunit.client.1.smithi120.stdout:8/498: rename d5/d6/d11/d52/d70/c4e to d5/d6/d11/d32/d3b/ca3 0 2024-04-26T21:25:55.996 INFO:tasks.workunit.client.0.smithi084.stdout:9/283: read da/de/f11 [1664688,122486] 0 2024-04-26T21:25:55.998 INFO:tasks.workunit.client.1.smithi120.stdout:1/493: readlink d6/d7/d2d/d98/d35/l96 0 2024-04-26T21:25:55.998 INFO:tasks.workunit.client.1.smithi120.stdout:5/610: fdatasync d2/dc/d1d/d21/d66/d85/fc5 0 2024-04-26T21:25:55.999 INFO:tasks.workunit.client.0.smithi084.stdout:9/284: fdatasync da/de/d16/f57 0 2024-04-26T21:25:56.001 INFO:tasks.workunit.client.0.smithi084.stdout:0/324: dwrite de/f14 [0,4194304] 0 2024-04-26T21:25:56.003 INFO:tasks.workunit.client.0.smithi084.stdout:5/317: mkdir d0/dc/df/d31/d63 0 2024-04-26T21:25:56.004 INFO:tasks.workunit.client.1.smithi120.stdout:4/532: unlink d10/d65/d72/d86/f87 0 2024-04-26T21:25:56.005 INFO:tasks.workunit.client.1.smithi120.stdout:4/533: chown d10/d65/d72/c88 396 1 2024-04-26T21:25:56.010 INFO:tasks.workunit.client.1.smithi120.stdout:7/523: truncate d7/d64/da6/d1f/d28/f3d 1042361 0 2024-04-26T21:25:56.011 INFO:tasks.workunit.client.0.smithi084.stdout:8/339: dwrite d4/f13 [4194304,4194304] 0 2024-04-26T21:25:56.011 INFO:tasks.workunit.client.1.smithi120.stdout:8/499: unlink d5/f15 0 2024-04-26T21:25:56.011 INFO:tasks.workunit.client.0.smithi084.stdout:6/367: mknod d3/de/d1a/d43/c80 0 2024-04-26T21:25:56.012 INFO:tasks.workunit.client.1.smithi120.stdout:3/526: dwrite dd/de/d18/d2c/f8a [0,4194304] 0 2024-04-26T21:25:56.012 INFO:tasks.workunit.client.0.smithi084.stdout:8/340: write d4/d6/f24 [8363916,44959] 0 2024-04-26T21:25:56.014 INFO:tasks.workunit.client.1.smithi120.stdout:4/534: mknod d10/d28/cb9 0 2024-04-26T21:25:56.019 INFO:tasks.workunit.client.1.smithi120.stdout:0/633: rename d0/d3/dc/dd/d1b/d24/d7d/fb8 to d0/d3/d13/d81/fd9 0 2024-04-26T21:25:56.023 INFO:tasks.workunit.client.0.smithi084.stdout:9/285: mkdir da/de/d16/d25/d41/d67 0 2024-04-26T21:25:56.023 INFO:tasks.workunit.client.1.smithi120.stdout:3/527: write dd/de/df/d12/f89 [1592170,130633] 0 2024-04-26T21:25:56.025 INFO:tasks.workunit.client.0.smithi084.stdout:6/368: mkdir d3/d18/d81 0 2024-04-26T21:25:56.027 INFO:tasks.workunit.client.0.smithi084.stdout:0/325: chown de/c1b 54408 1 2024-04-26T21:25:56.027 INFO:tasks.workunit.client.1.smithi120.stdout:5/611: rename d2/dc/c15 to d2/d30/d93/dbf/cdc 0 2024-04-26T21:25:56.031 INFO:tasks.workunit.client.1.smithi120.stdout:3/528: dread - dd/de/df/d12/d48/f99 zero size 2024-04-26T21:25:56.031 INFO:tasks.workunit.client.0.smithi084.stdout:8/341: write d4/f1c [531804,78030] 0 2024-04-26T21:25:56.034 INFO:tasks.workunit.client.1.smithi120.stdout:7/524: rename d7/d64/da6/d1a/d50/f93 to d7/d64/fb7 0 2024-04-26T21:25:56.036 INFO:tasks.workunit.client.0.smithi084.stdout:5/318: dwrite d0/dc/f19 [4194304,4194304] 0 2024-04-26T21:25:56.037 INFO:tasks.workunit.client.0.smithi084.stdout:1/358: unlink d2/d9/f14 0 2024-04-26T21:25:56.039 INFO:tasks.workunit.client.0.smithi084.stdout:9/286: symlink da/de/d16/d25/l68 0 2024-04-26T21:25:56.041 INFO:tasks.workunit.client.0.smithi084.stdout:9/287: stat da/de/d16/d40/c60 0 2024-04-26T21:25:56.043 INFO:tasks.workunit.client.1.smithi120.stdout:0/634: fdatasync d0/d3/f41 0 2024-04-26T21:25:56.043 INFO:tasks.workunit.client.1.smithi120.stdout:1/494: dread d6/d7/d1d/f47 [0,4194304] 0 2024-04-26T21:25:56.044 INFO:tasks.workunit.client.0.smithi084.stdout:1/359: symlink d2/d19/d63/l74 0 2024-04-26T21:25:56.049 INFO:tasks.workunit.client.1.smithi120.stdout:7/525: rename d7/d64/da6/d1a/f27 to d7/d64/fb8 0 2024-04-26T21:25:56.051 INFO:tasks.workunit.client.0.smithi084.stdout:0/326: getdents de/d2b/d45/d63 0 2024-04-26T21:25:56.053 INFO:tasks.workunit.client.1.smithi120.stdout:4/535: dread d10/f26 [0,4194304] 0 2024-04-26T21:25:56.054 INFO:tasks.workunit.client.1.smithi120.stdout:2/550: sync 2024-04-26T21:25:56.055 INFO:tasks.workunit.client.0.smithi084.stdout:9/288: symlink da/de/d16/d25/d41/d43/l69 0 2024-04-26T21:25:56.056 INFO:tasks.workunit.client.0.smithi084.stdout:1/360: mkdir d2/d54/d5e/d66/d2a/d2c/d75 0 2024-04-26T21:25:56.056 INFO:tasks.workunit.client.0.smithi084.stdout:9/289: chown da 14243929 1 2024-04-26T21:25:56.058 INFO:tasks.workunit.client.1.smithi120.stdout:2/551: chown d4/f34 642650892 1 2024-04-26T21:25:56.058 INFO:tasks.workunit.client.0.smithi084.stdout:0/327: chown de/d1c/d53/c54 0 1 2024-04-26T21:25:56.059 INFO:tasks.workunit.client.1.smithi120.stdout:1/495: mknod d6/d7/d1b/d89/d8c/d62/ca3 0 2024-04-26T21:25:56.060 INFO:tasks.workunit.client.1.smithi120.stdout:7/526: truncate d7/d64/da6/d2f/f7c 1035757 0 2024-04-26T21:25:56.062 INFO:tasks.workunit.client.0.smithi084.stdout:6/369: dwrite d3/de/d15/d40/f60 [0,4194304] 0 2024-04-26T21:25:56.063 INFO:tasks.workunit.client.0.smithi084.stdout:1/361: chown d2/d54/c6c 110590 1 2024-04-26T21:25:56.064 INFO:tasks.workunit.client.1.smithi120.stdout:4/536: creat d10/d6b/d71/fba x:0 0 0 2024-04-26T21:25:56.065 INFO:tasks.workunit.client.1.smithi120.stdout:7/527: chown d7/d64/da6/d1f/l4f 247148540 1 2024-04-26T21:25:56.065 INFO:tasks.workunit.client.1.smithi120.stdout:4/537: stat d10/d65/d72 0 2024-04-26T21:25:56.065 INFO:tasks.workunit.client.1.smithi120.stdout:0/635: getdents d0/d3/d13/d81/dba 0 2024-04-26T21:25:56.067 INFO:tasks.workunit.client.0.smithi084.stdout:0/328: write de/d20/f24 [365048,127661] 0 2024-04-26T21:25:56.067 INFO:tasks.workunit.client.0.smithi084.stdout:5/319: dread d0/fd [4194304,4194304] 0 2024-04-26T21:25:56.067 INFO:tasks.workunit.client.0.smithi084.stdout:9/290: readlink da/de/d16/d40/l5b 0 2024-04-26T21:25:56.068 INFO:tasks.workunit.client.1.smithi120.stdout:5/612: dread d2/d1b/d89/f87 [0,4194304] 0 2024-04-26T21:25:56.068 INFO:tasks.workunit.client.0.smithi084.stdout:6/370: chown c2 7668 1 2024-04-26T21:25:56.070 INFO:tasks.workunit.client.0.smithi084.stdout:1/362: fsync d2/d1b/f65 0 2024-04-26T21:25:56.071 INFO:tasks.workunit.client.0.smithi084.stdout:6/371: chown d3/de/d15 412082307 1 2024-04-26T21:25:56.072 INFO:tasks.workunit.client.1.smithi120.stdout:2/552: getdents d4/d1b/d25/d93 0 2024-04-26T21:25:56.072 INFO:tasks.workunit.client.0.smithi084.stdout:9/291: chown da/de/c32 3 1 2024-04-26T21:25:56.073 INFO:tasks.workunit.client.0.smithi084.stdout:8/342: dwrite d4/f1c [0,4194304] 0 2024-04-26T21:25:56.076 INFO:tasks.workunit.client.1.smithi120.stdout:6/559: dread d4/db/d10/dd/f30 [0,4194304] 0 2024-04-26T21:25:56.076 INFO:tasks.workunit.client.1.smithi120.stdout:2/553: write d4/d1b/d25/d2c/f49 [3825331,91279] 0 2024-04-26T21:25:56.080 INFO:tasks.workunit.client.1.smithi120.stdout:0/636: creat d0/dd1/fda x:0 0 0 2024-04-26T21:25:56.080 INFO:tasks.workunit.client.1.smithi120.stdout:3/529: dwrite dd/de/f2f [0,4194304] 0 2024-04-26T21:25:56.080 INFO:tasks.workunit.client.1.smithi120.stdout:2/554: chown d4/d1b/d5c/d99 30357007 1 2024-04-26T21:25:56.080 INFO:tasks.workunit.client.0.smithi084.stdout:0/329: creat de/d1c/d32/f6e x:0 0 0 2024-04-26T21:25:56.080 INFO:tasks.workunit.client.1.smithi120.stdout:1/496: mknod d6/d7/d2d/d48/ca4 0 2024-04-26T21:25:56.084 INFO:tasks.workunit.client.0.smithi084.stdout:9/292: mknod da/de/d1e/d56/c6a 0 2024-04-26T21:25:56.086 INFO:tasks.workunit.client.0.smithi084.stdout:8/343: rmdir d4/d7/d15/d3c 39 2024-04-26T21:25:56.086 INFO:tasks.workunit.client.0.smithi084.stdout:9/293: chown da/de/l2b 4241 1 2024-04-26T21:25:56.089 INFO:tasks.workunit.client.0.smithi084.stdout:8/344: rename d4 to d4/d7/d15/d37/d64 22 2024-04-26T21:25:56.089 INFO:tasks.workunit.client.0.smithi084.stdout:5/320: creat d0/f64 x:0 0 0 2024-04-26T21:25:56.090 INFO:tasks.workunit.client.1.smithi120.stdout:4/538: link d10/d12/f19 d10/d6b/fbb 0 2024-04-26T21:25:56.090 INFO:tasks.workunit.client.1.smithi120.stdout:6/560: chown d4/f1f 0 1 2024-04-26T21:25:56.090 INFO:tasks.workunit.client.1.smithi120.stdout:7/528: mknod d7/d64/da6/d1a/d33/cb9 0 2024-04-26T21:25:56.090 INFO:tasks.workunit.client.1.smithi120.stdout:0/637: unlink d0/l6e 0 2024-04-26T21:25:56.093 INFO:tasks.workunit.client.0.smithi084.stdout:1/363: mknod d2/d9/d15/d28/c76 0 2024-04-26T21:25:56.094 INFO:tasks.workunit.client.0.smithi084.stdout:0/330: write de/d20/f29 [3424156,76899] 0 2024-04-26T21:25:56.096 INFO:tasks.workunit.client.1.smithi120.stdout:8/500: dread d5/d6/d11/d52/d27/f51 [0,4194304] 0 2024-04-26T21:25:56.096 INFO:tasks.workunit.client.0.smithi084.stdout:8/345: mkdir d4/d6/db/d1e/d22/d2f/d65 0 2024-04-26T21:25:56.099 INFO:tasks.workunit.client.0.smithi084.stdout:6/372: getdents d3/de/d41 0 2024-04-26T21:25:56.102 INFO:tasks.workunit.client.1.smithi120.stdout:7/529: fdatasync d7/d64/da6/d2f/d43/f9f 0 2024-04-26T21:25:56.103 INFO:tasks.workunit.client.0.smithi084.stdout:6/373: write d3/de/d1a/d2f/f56 [148170,18495] 0 2024-04-26T21:25:56.103 INFO:tasks.workunit.client.0.smithi084.stdout:9/294: rename c7 to da/de/d16/c6b 0 2024-04-26T21:25:56.106 INFO:tasks.workunit.client.0.smithi084.stdout:0/331: rmdir de/d2b/d64 39 2024-04-26T21:25:56.108 INFO:tasks.workunit.client.0.smithi084.stdout:6/374: write d3/de/d15/d23/f68 [983126,59047] 0 2024-04-26T21:25:56.109 INFO:tasks.workunit.client.1.smithi120.stdout:0/638: dread d0/f72 [0,4194304] 0 2024-04-26T21:25:56.109 INFO:tasks.workunit.client.1.smithi120.stdout:2/555: dread d4/f34 [0,4194304] 0 2024-04-26T21:25:56.115 INFO:tasks.workunit.client.1.smithi120.stdout:2/556: truncate d4/d1b/d56/d65/fb1 321362 0 2024-04-26T21:25:56.116 INFO:tasks.workunit.client.0.smithi084.stdout:5/321: rename d0/dc/l4f to d0/d49/l65 0 2024-04-26T21:25:56.116 INFO:tasks.workunit.client.1.smithi120.stdout:6/561: dread d4/db/d10/dd/f30 [0,4194304] 0 2024-04-26T21:25:56.117 INFO:tasks.workunit.client.1.smithi120.stdout:7/530: symlink d7/d64/da6/d1f/d28/d4c/d6c/d74/lba 0 2024-04-26T21:25:56.119 INFO:tasks.workunit.client.1.smithi120.stdout:1/497: dwrite d6/d7/d1d/f20 [0,4194304] 0 2024-04-26T21:25:56.119 INFO:tasks.workunit.client.1.smithi120.stdout:0/639: creat d0/d3/dc/dd/d1b/daa/fdb x:0 0 0 2024-04-26T21:25:56.119 INFO:tasks.workunit.client.0.smithi084.stdout:5/322: write d0/dc/f2f [2451130,47175] 0 2024-04-26T21:25:56.119 INFO:tasks.workunit.client.1.smithi120.stdout:3/530: truncate dd/de/d83/f81 527748 0 2024-04-26T21:25:56.120 INFO:tasks.workunit.client.0.smithi084.stdout:2/438: sync 2024-04-26T21:25:56.121 INFO:tasks.workunit.client.0.smithi084.stdout:9/295: symlink da/de/d16/d25/l6c 0 2024-04-26T21:25:56.125 INFO:tasks.workunit.client.1.smithi120.stdout:0/640: dread - d0/d3/d51/f88 zero size 2024-04-26T21:25:56.129 INFO:tasks.workunit.client.1.smithi120.stdout:3/531: mkdir dd/de/d18/d37/d80/da9 0 2024-04-26T21:25:56.129 INFO:tasks.workunit.client.0.smithi084.stdout:0/332: dwrite de/d1c/f33 [0,4194304] 0 2024-04-26T21:25:56.134 INFO:tasks.workunit.client.1.smithi120.stdout:0/641: stat d0/d3/dc/dd/d1b/d24/d7d/cb3 0 2024-04-26T21:25:56.136 INFO:tasks.workunit.client.1.smithi120.stdout:5/613: dwrite d2/dc/d1d/d21/d66/f28 [0,4194304] 0 2024-04-26T21:25:56.136 INFO:tasks.workunit.client.0.smithi084.stdout:8/346: rename d4/d6/db/d1e/d22/d2f/la to d4/d6/db/d1e/d22/d39/l66 0 2024-04-26T21:25:56.137 INFO:tasks.workunit.client.1.smithi120.stdout:3/532: rename dd/de/d18/f85 to dd/d40/faa 0 2024-04-26T21:25:56.139 INFO:tasks.workunit.client.1.smithi120.stdout:6/562: dread d4/db/d10/d1a/d2b/f82 [0,4194304] 0 2024-04-26T21:25:56.140 INFO:tasks.workunit.client.0.smithi084.stdout:1/364: write d2/d54/d5e/d66/d2a/d2c/d45/f68 [304600,65274] 0 2024-04-26T21:25:56.142 INFO:tasks.workunit.client.0.smithi084.stdout:2/439: unlink d6/d7/d3d/f26 0 2024-04-26T21:25:56.142 INFO:tasks.workunit.client.1.smithi120.stdout:5/614: symlink d2/d1b/d89/d47/d8a/ldd 0 2024-04-26T21:25:56.144 INFO:tasks.workunit.client.1.smithi120.stdout:3/533: write dd/de/d18/d24/f3c [1740857,108644] 0 2024-04-26T21:25:56.148 INFO:tasks.workunit.client.1.smithi120.stdout:6/563: creat d4/db/d10/dd/d28/fbe x:0 0 0 2024-04-26T21:25:56.148 INFO:tasks.workunit.client.1.smithi120.stdout:1/498: write d6/d7/d2d/d98/d35/f87 [60525,7832] 0 2024-04-26T21:25:56.156 INFO:tasks.workunit.client.1.smithi120.stdout:1/499: write d6/d7/d2d/d98/f42 [1413280,66616] 0 2024-04-26T21:25:56.156 INFO:tasks.workunit.client.0.smithi084.stdout:5/323: unlink d0/dc/df/l25 0 2024-04-26T21:25:56.161 INFO:tasks.workunit.client.1.smithi120.stdout:2/557: dwrite d4/f64 [0,4194304] 0 2024-04-26T21:25:56.161 INFO:tasks.workunit.client.1.smithi120.stdout:7/531: write d7/d64/fb8 [748824,66046] 0 2024-04-26T21:25:56.162 INFO:tasks.workunit.client.0.smithi084.stdout:9/296: symlink da/de/l6d 0 2024-04-26T21:25:56.165 INFO:tasks.workunit.client.0.smithi084.stdout:6/375: link d3/de/d1a/l19 d3/de/d1a/l82 0 2024-04-26T21:25:56.167 INFO:tasks.workunit.client.0.smithi084.stdout:9/297: unlink da/de/d1e/f2f 0 2024-04-26T21:25:56.170 INFO:tasks.workunit.client.0.smithi084.stdout:5/324: symlink d0/dc/df/d31/d63/l66 0 2024-04-26T21:25:56.170 INFO:tasks.workunit.client.1.smithi120.stdout:1/500: chown d6/d7/d1d/d5d/d67/l29 14 1 2024-04-26T21:25:56.174 INFO:tasks.workunit.client.1.smithi120.stdout:6/564: link d4/db/d10/d1a/d2b/l49 d4/db/d10/dd/db3/lbf 0 2024-04-26T21:25:56.174 INFO:tasks.workunit.client.0.smithi084.stdout:2/440: mknod d6/d7/d3d/d15/d1f/d22/c9c 0 2024-04-26T21:25:56.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.174+0000 7f59d0400700 1 -- 172.21.15.84:0/3463510050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59c80fefd0 msgr2=0x7f59c80ff3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:56.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.174+0000 7f59d0400700 1 --2- 172.21.15.84:0/3463510050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59c80fefd0 0x7f59c80ff3e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f59bc004940 tx=0x7f59bc009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:56.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.174+0000 7f59d0400700 1 -- 172.21.15.84:0/3463510050 shutdown_connections 2024-04-26T21:25:56.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.174+0000 7f59d0400700 1 --2- 172.21.15.84:0/3463510050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59c8100280 0x7f59c81006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:56.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.174+0000 7f59d0400700 1 --2- 172.21.15.84:0/3463510050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59c80fefd0 0x7f59c80ff3e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:56.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.174+0000 7f59d0400700 1 -- 172.21.15.84:0/3463510050 >> 172.21.15.84:0/3463510050 conn(0x7f59c80fa8f0 msgr2=0x7f59c80fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:56.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.174+0000 7f59d0400700 1 -- 172.21.15.84:0/3463510050 shutdown_connections 2024-04-26T21:25:56.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.174+0000 7f59d0400700 1 -- 172.21.15.84:0/3463510050 wait complete. 2024-04-26T21:25:56.176 INFO:tasks.workunit.client.0.smithi084.stdout:0/333: link de/d2b/f39 de/d20/d4e/f6f 0 2024-04-26T21:25:56.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.175+0000 7f59d0400700 1 Processor -- start 2024-04-26T21:25:56.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.176+0000 7f59d0400700 1 -- start start 2024-04-26T21:25:56.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.176+0000 7f59d0400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59c80fefd0 0x7f59c810fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:56.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.176+0000 7f59d0400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59c8100280 0x7f59c8110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:56.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.176+0000 7f59d0400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c8110740 con 0x7f59c8100280 2024-04-26T21:25:56.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.176+0000 7f59d0400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c8110f90 con 0x7f59c80fefd0 2024-04-26T21:25:56.177 INFO:tasks.workunit.client.0.smithi084.stdout:0/334: stat de/d20/f29 0 2024-04-26T21:25:56.177 INFO:tasks.workunit.client.0.smithi084.stdout:5/325: dread d0/dc/f43 [0,4194304] 0 2024-04-26T21:25:56.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.177+0000 7f59cd000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59c8100280 0x7f59c8110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:56.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.177+0000 7f59cd000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59c8100280 0x7f59c8110140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55542/0 (socket says 172.21.15.84:55542) 2024-04-26T21:25:56.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.177+0000 7f59cd000700 1 -- 172.21.15.84:0/2076076362 learned_addr learned my addr 172.21.15.84:0/2076076362 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:25:56.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.177+0000 7f59cda00700 1 --2- 172.21.15.84:0/2076076362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59c80fefd0 0x7f59c810fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:56.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.177+0000 7f59cd000700 1 -- 172.21.15.84:0/2076076362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59c80fefd0 msgr2=0x7f59c810fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:56.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.177+0000 7f59cd000700 1 --2- 172.21.15.84:0/2076076362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59c80fefd0 0x7f59c810fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:56.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.177+0000 7f59cd000700 1 -- 172.21.15.84:0/2076076362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc005040 con 0x7f59c8100280 2024-04-26T21:25:56.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.178+0000 7f59cd000700 1 --2- 172.21.15.84:0/2076076362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59c8100280 0x7f59c8110140 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f59b400c8c0 tx=0x7f59b40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:56.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.178+0000 7f59c5600700 1 -- 172.21.15.84:0/2076076362 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59b400a980 con 0x7f59c8100280 2024-04-26T21:25:56.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.178+0000 7f59c5600700 1 -- 172.21.15.84:0/2076076362 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f59b400ce60 con 0x7f59c8100280 2024-04-26T21:25:56.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.178+0000 7f59c5600700 1 -- 172.21.15.84:0/2076076362 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59b40115e0 con 0x7f59c8100280 2024-04-26T21:25:56.180 INFO:tasks.workunit.client.0.smithi084.stdout:0/335: readlink de/d2b/l2c 0 2024-04-26T21:25:56.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.180+0000 7f59d0400700 1 -- 172.21.15.84:0/2076076362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c8111270 con 0x7f59c8100280 2024-04-26T21:25:56.180 INFO:tasks.workunit.client.1.smithi120.stdout:3/534: dwrite dd/de/d18/f4b [0,4194304] 0 2024-04-26T21:25:56.180 INFO:tasks.workunit.client.1.smithi120.stdout:2/558: rename d4/d1b/d2e/d5f/lb2 to d4/d1b/d2e/d5f/lb6 0 2024-04-26T21:25:56.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.180+0000 7f59d0400700 1 -- 172.21.15.84:0/2076076362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c8111780 con 0x7f59c8100280 2024-04-26T21:25:56.181 INFO:tasks.workunit.client.0.smithi084.stdout:9/298: symlink da/de/d16/d25/d41/d43/d4a/l6e 0 2024-04-26T21:25:56.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.182+0000 7f59d0400700 1 -- 172.21.15.84:0/2076076362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c805f5c0 con 0x7f59c8100280 2024-04-26T21:25:56.183 INFO:tasks.workunit.client.0.smithi084.stdout:9/299: write da/f19 [3434714,125726] 0 2024-04-26T21:25:56.184 INFO:tasks.workunit.client.1.smithi120.stdout:5/615: dwrite d2/f13 [0,4194304] 0 2024-04-26T21:25:56.184 INFO:tasks.workunit.client.1.smithi120.stdout:3/535: write dd/f5e [3112855,116242] 0 2024-04-26T21:25:56.184 INFO:tasks.workunit.client.0.smithi084.stdout:9/300: fsync da/fb 0 2024-04-26T21:25:56.188 INFO:tasks.workunit.client.0.smithi084.stdout:6/376: link d3/de/d15/df/f62 d3/de/d1a/d2f/f83 0 2024-04-26T21:25:56.188 INFO:tasks.workunit.client.1.smithi120.stdout:3/536: stat dd/d40/f92 0 2024-04-26T21:25:56.189 INFO:tasks.workunit.client.0.smithi084.stdout:2/441: unlink d6/d7/d3d/d15/d1f/d22/d2a/c2f 0 2024-04-26T21:25:56.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.184+0000 7f59c5600700 1 -- 172.21.15.84:0/2076076362 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) v1 ==== 92571+0+0 (secure 0 0 0) 0x7f59b4012400 con 0x7f59c8100280 2024-04-26T21:25:56.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.186+0000 7f59c5600700 1 --2- 172.21.15.84:0/2076076362 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f59b006e6e0 0x7f59b0070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:25:56.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.186+0000 7f59c5600700 1 -- 172.21.15.84:0/2076076362 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f59b408da80 con 0x7f59c8100280 2024-04-26T21:25:56.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.190+0000 7f59cda00700 1 --2- 172.21.15.84:0/2076076362 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f59b006e6e0 0x7f59b0070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:25:56.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.191+0000 7f59cda00700 1 --2- 172.21.15.84:0/2076076362 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f59b006e6e0 0x7f59b0070b90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00b970 tx=0x7f59bc009e30 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:25:56.191 INFO:tasks.workunit.client.0.smithi084.stdout:0/336: creat de/d20/d4c/f70 x:0 0 0 2024-04-26T21:25:56.192 INFO:tasks.workunit.client.1.smithi120.stdout:3/537: chown dd/d2a/d4a/f59 7415408 1 2024-04-26T21:25:56.192 INFO:tasks.workunit.client.1.smithi120.stdout:6/565: mknod d4/db/d25/cc0 0 2024-04-26T21:25:56.194 INFO:tasks.workunit.client.0.smithi084.stdout:8/347: rmdir d4 39 2024-04-26T21:25:56.194 INFO:tasks.workunit.client.1.smithi120.stdout:2/559: symlink d4/d1b/d56/d65/d8d/lb7 0 2024-04-26T21:25:56.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.194+0000 7f59c5600700 1 -- 172.21.15.84:0/2076076362 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f59b405acf0 con 0x7f59c8100280 2024-04-26T21:25:56.197 INFO:tasks.workunit.client.1.smithi120.stdout:7/532: write d7/d64/da6/d1a/d33/d34/d37/f72 [381113,111745] 0 2024-04-26T21:25:56.197 INFO:tasks.workunit.client.0.smithi084.stdout:4/262: sync 2024-04-26T21:25:56.197 INFO:tasks.workunit.client.0.smithi084.stdout:3/350: sync 2024-04-26T21:25:56.197 INFO:tasks.workunit.client.0.smithi084.stdout:7/337: sync 2024-04-26T21:25:56.198 INFO:tasks.workunit.client.1.smithi120.stdout:9/533: sync 2024-04-26T21:25:56.200 INFO:tasks.workunit.client.1.smithi120.stdout:1/501: link d6/d7/ff d6/d7/d1d/d2c/fa5 0 2024-04-26T21:25:56.201 INFO:tasks.workunit.client.1.smithi120.stdout:9/534: fdatasync d0/dd/f62 0 2024-04-26T21:25:56.201 INFO:tasks.workunit.client.0.smithi084.stdout:7/338: dread - d6/d9/d12/d19/d20/f57 zero size 2024-04-26T21:25:56.202 INFO:tasks.workunit.client.1.smithi120.stdout:3/538: read dd/de/d83/f3f [450432,38383] 0 2024-04-26T21:25:56.202 INFO:tasks.workunit.client.1.smithi120.stdout:5/616: mkdir d2/dc/d1d/d21/db2/dde 0 2024-04-26T21:25:56.203 INFO:tasks.workunit.client.0.smithi084.stdout:7/339: dread - d6/d9/d12/f3e zero size 2024-04-26T21:25:56.204 INFO:tasks.workunit.client.1.smithi120.stdout:6/566: creat d4/d99/fc1 x:0 0 0 2024-04-26T21:25:56.207 INFO:tasks.workunit.client.0.smithi084.stdout:1/365: write d2/d54/d5e/d66/d2a/d2c/f34 [769971,55777] 0 2024-04-26T21:25:56.210 INFO:tasks.workunit.client.0.smithi084.stdout:9/301: creat da/de/d16/d25/d41/d67/f6f x:0 0 0 2024-04-26T21:25:56.212 INFO:tasks.workunit.client.0.smithi084.stdout:1/366: readlink d2/d1b/l1c 0 2024-04-26T21:25:56.213 INFO:tasks.workunit.client.1.smithi120.stdout:3/539: creat dd/d2a/d74/fab x:0 0 0 2024-04-26T21:25:56.215 INFO:tasks.workunit.client.1.smithi120.stdout:6/567: rmdir d4/db/d10/dd/d4e 39 2024-04-26T21:25:56.218 INFO:tasks.workunit.client.1.smithi120.stdout:0/642: dread d0/d3/d51/d97/fa5 [0,4194304] 0 2024-04-26T21:25:56.219 INFO:tasks.workunit.client.0.smithi084.stdout:6/377: mkdir d3/d84 0 2024-04-26T21:25:56.220 INFO:tasks.workunit.client.1.smithi120.stdout:5/617: creat d2/dc/d1d/d1f/d36/d44/d6c/fdf x:0 0 0 2024-04-26T21:25:56.223 INFO:tasks.workunit.client.0.smithi084.stdout:0/337: rename de/d1c/d53 to de/d71 0 2024-04-26T21:25:56.223 INFO:tasks.workunit.client.0.smithi084.stdout:3/351: dwrite d1/d2c/f71 [0,4194304] 0 2024-04-26T21:25:56.224 INFO:tasks.workunit.client.1.smithi120.stdout:6/568: dread - d4/db/d10/f52 zero size 2024-04-26T21:25:56.225 INFO:tasks.workunit.client.1.smithi120.stdout:3/540: unlink dd/d40/f50 0 2024-04-26T21:25:56.225 INFO:tasks.workunit.client.0.smithi084.stdout:8/348: write d4/d7/d15/d3c/f4b [975937,47319] 0 2024-04-26T21:25:56.226 INFO:tasks.workunit.client.1.smithi120.stdout:7/533: rename d7/d64/da6/d2f/d43 to d7/d64/da6/d1f/d28/dbb 0 2024-04-26T21:25:56.227 INFO:tasks.workunit.client.1.smithi120.stdout:6/569: dread - d4/db/d10/dd/d28/d9e/f9f zero size 2024-04-26T21:25:56.229 INFO:tasks.workunit.client.0.smithi084.stdout:5/326: link d0/dc/df/l13 d0/dc/df/d31/d53/d5d/l67 0 2024-04-26T21:25:56.229 INFO:tasks.workunit.client.0.smithi084.stdout:4/263: creat d5/d10/d15/f5b x:0 0 0 2024-04-26T21:25:56.230 INFO:tasks.workunit.client.1.smithi120.stdout:5/618: mknod d2/dc/d1d/d21/d66/d85/ce0 0 2024-04-26T21:25:56.231 INFO:tasks.workunit.client.0.smithi084.stdout:8/349: stat d4/d7/d53/f57 0 2024-04-26T21:25:56.231 INFO:tasks.workunit.client.1.smithi120.stdout:3/541: write dd/de/d18/d2c/d76/d3b/d56/fa5 [79331,55040] 0 2024-04-26T21:25:56.232 INFO:tasks.workunit.client.1.smithi120.stdout:6/570: chown d4/db/d10/dd/d28 345886 1 2024-04-26T21:25:56.233 INFO:tasks.workunit.client.0.smithi084.stdout:5/327: write d0/f32 [3358552,4083] 0 2024-04-26T21:25:56.234 INFO:tasks.workunit.client.0.smithi084.stdout:7/340: dwrite d6/d26/d40/f5b [0,4194304] 0 2024-04-26T21:25:56.238 INFO:tasks.workunit.client.1.smithi120.stdout:7/534: creat d7/d19/fbc x:0 0 0 2024-04-26T21:25:56.241 INFO:tasks.workunit.client.1.smithi120.stdout:7/535: write d7/d64/da6/d1f/f88 [186668,107885] 0 2024-04-26T21:25:56.244 INFO:tasks.workunit.client.1.smithi120.stdout:2/560: dread d4/d1b/d2e/d50/d14/d15/f84 [0,4194304] 0 2024-04-26T21:25:56.244 INFO:tasks.workunit.client.0.smithi084.stdout:2/442: dread d6/d7/d68/f69 [4194304,4194304] 0 2024-04-26T21:25:56.245 INFO:tasks.workunit.client.1.smithi120.stdout:3/542: creat dd/de/d18/d2c/fac x:0 0 0 2024-04-26T21:25:56.249 INFO:tasks.workunit.client.0.smithi084.stdout:8/350: rmdir d4/d7/d15/d37/d52/d5b 0 2024-04-26T21:25:56.251 INFO:tasks.workunit.client.0.smithi084.stdout:7/341: chown d6/d9/d12/d19/c54 255678000 1 2024-04-26T21:25:56.254 INFO:tasks.workunit.client.1.smithi120.stdout:7/536: unlink d7/d64/da6/d1a/d33/d34/d37/l6e 0 2024-04-26T21:25:56.257 INFO:tasks.workunit.client.1.smithi120.stdout:7/537: dread - d7/d64/da6/d1a/d33/fa5 zero size 2024-04-26T21:25:56.257 INFO:tasks.workunit.client.0.smithi084.stdout:7/342: creat d6/d9/d12/d19/f70 x:0 0 0 2024-04-26T21:25:56.258 INFO:tasks.workunit.client.1.smithi120.stdout:3/543: mknod dd/de/df/cad 0 2024-04-26T21:25:56.259 INFO:tasks.workunit.client.1.smithi120.stdout:7/538: stat d7/d10/c4a 0 2024-04-26T21:25:56.259 INFO:tasks.workunit.client.1.smithi120.stdout:2/561: mknod d4/d1b/d25/d93/cb8 0 2024-04-26T21:25:56.260 INFO:tasks.workunit.client.1.smithi120.stdout:6/571: link d4/db/fe d4/db/d10/d1a/d2b/d57/d67/fc2 0 2024-04-26T21:25:56.260 INFO:tasks.workunit.client.1.smithi120.stdout:3/544: read dd/de/f2f [3379291,70501] 0 2024-04-26T21:25:56.261 INFO:tasks.workunit.client.1.smithi120.stdout:6/572: chown d4/c3a 352254801 1 2024-04-26T21:25:56.262 INFO:tasks.workunit.client.1.smithi120.stdout:5/619: getdents d2/dc/d1d/d1f/d36/d67 0 2024-04-26T21:25:56.271 INFO:tasks.workunit.client.1.smithi120.stdout:2/562: unlink d4/d1b/d25/d2c/d3e/d5e/f61 0 2024-04-26T21:25:56.271 INFO:tasks.workunit.client.0.smithi084.stdout:9/302: dwrite da/de/d16/d25/d4f/f51 [0,4194304] 0 2024-04-26T21:25:56.275 INFO:tasks.workunit.client.0.smithi084.stdout:5/328: dwrite d0/fd [4194304,4194304] 0 2024-04-26T21:25:56.275 INFO:tasks.workunit.client.1.smithi120.stdout:7/539: dwrite d7/f8 [8388608,4194304] 0 2024-04-26T21:25:56.277 INFO:tasks.workunit.client.1.smithi120.stdout:7/540: stat d7/d10/c31 0 2024-04-26T21:25:56.280 INFO:tasks.workunit.client.1.smithi120.stdout:6/573: mkdir d4/db/d10/dd/db3/dc3 0 2024-04-26T21:25:56.284 INFO:tasks.workunit.client.0.smithi084.stdout:1/367: truncate d2/d9/d15/d28/d47/f4b 1993829 0 2024-04-26T21:25:56.285 INFO:tasks.workunit.client.1.smithi120.stdout:3/545: mknod dd/de/d18/d24/d9d/d86/cae 0 2024-04-26T21:25:56.287 INFO:tasks.workunit.client.0.smithi084.stdout:9/303: mknod da/de/d16/d25/d41/d43/d4a/c70 0 2024-04-26T21:25:56.288 INFO:tasks.workunit.client.0.smithi084.stdout:8/351: dwrite d4/d6/db/d1e/d22/d2f/f21 [0,4194304] 0 2024-04-26T21:25:56.289 INFO:tasks.workunit.client.0.smithi084.stdout:2/443: truncate d6/d7/d3d/d15/f7f 3947952 0 2024-04-26T21:25:56.290 INFO:tasks.workunit.client.1.smithi120.stdout:3/546: chown dd/de/d18/d2c/d76/d3b/l69 79252 1 2024-04-26T21:25:56.291 INFO:tasks.workunit.client.1.smithi120.stdout:2/563: mknod d4/d1b/d25/d2c/cb9 0 2024-04-26T21:25:56.291 INFO:tasks.workunit.client.1.smithi120.stdout:0/643: write d0/d3/dc/d12/f6a [1769215,51045] 0 2024-04-26T21:25:56.293 INFO:tasks.workunit.client.1.smithi120.stdout:6/574: stat d4/db/d10/dd/db3/lbf 0 2024-04-26T21:25:56.293 INFO:tasks.workunit.client.1.smithi120.stdout:3/547: fdatasync dd/d2a/d74/f9f 0 2024-04-26T21:25:56.297 INFO:tasks.workunit.client.0.smithi084.stdout:5/329: symlink d0/dc/df/d51/l68 0 2024-04-26T21:25:56.297 INFO:tasks.workunit.client.0.smithi084.stdout:3/352: dread d1/d2c/d2f/f1f [0,4194304] 0 2024-04-26T21:25:56.297 INFO:tasks.workunit.client.1.smithi120.stdout:6/575: stat d4/db/d25/d6d/d97/ca0 0 2024-04-26T21:25:56.297 INFO:tasks.workunit.client.0.smithi084.stdout:0/338: dwrite de/d1c/f1d [0,4194304] 0 2024-04-26T21:25:56.299 INFO:tasks.workunit.client.1.smithi120.stdout:1/502: dwrite d6/d7/d1d/d2c/f93 [0,4194304] 0 2024-04-26T21:25:56.300 INFO:tasks.workunit.client.0.smithi084.stdout:9/304: read da/de/d16/d25/f3c [199784,37240] 0 2024-04-26T21:25:56.302 INFO:tasks.workunit.client.1.smithi120.stdout:2/564: creat d4/d1b/d56/d65/d8d/fba x:0 0 0 2024-04-26T21:25:56.308 INFO:tasks.workunit.client.0.smithi084.stdout:5/330: rmdir d0/d49/d4d 39 2024-04-26T21:25:56.313 INFO:tasks.workunit.client.0.smithi084.stdout:2/444: rename d6/d7/fb to d6/d7/d3d/d15/d1f/d22/d99/f9d 0 2024-04-26T21:25:56.313 INFO:tasks.workunit.client.1.smithi120.stdout:2/565: creat d4/d1b/d56/d65/d8d/fbb x:0 0 0 2024-04-26T21:25:56.315 INFO:tasks.workunit.client.1.smithi120.stdout:7/541: dwrite d7/d64/da6/d1f/d28/d4c/d6c/f71 [0,4194304] 0 2024-04-26T21:25:56.316 INFO:tasks.workunit.client.0.smithi084.stdout:3/353: creat d1/d2c/d2f/f76 x:0 0 0 2024-04-26T21:25:56.318 INFO:tasks.workunit.client.1.smithi120.stdout:7/542: dread - d7/d64/da6/d1a/d33/fa5 zero size 2024-04-26T21:25:56.319 INFO:tasks.workunit.client.0.smithi084.stdout:9/305: mknod da/de/d16/d25/d4f/c71 0 2024-04-26T21:25:56.319 INFO:tasks.workunit.client.1.smithi120.stdout:1/503: rename d6/d7/d2d/d48/c6a to d6/d14/d6f/ca6 0 2024-04-26T21:25:56.320 INFO:tasks.workunit.client.1.smithi120.stdout:0/644: dwrite d0/f66 [0,4194304] 0 2024-04-26T21:25:56.324 INFO:tasks.workunit.client.0.smithi084.stdout:7/343: truncate d6/d9/f2d 1834815 0 2024-04-26T21:25:56.327 INFO:tasks.workunit.client.0.smithi084.stdout:8/352: dwrite d4/d6/db/d1e/f45 [0,4194304] 0 2024-04-26T21:25:56.327 INFO:tasks.workunit.client.0.smithi084.stdout:0/339: getdents de/d20 0 2024-04-26T21:25:56.328 INFO:tasks.workunit.client.1.smithi120.stdout:0/645: write d0/d3/dc/fc8 [435657,96410] 0 2024-04-26T21:25:56.329 INFO:tasks.workunit.client.1.smithi120.stdout:3/548: dwrite dd/f31 [4194304,4194304] 0 2024-04-26T21:25:56.338 INFO:tasks.workunit.client.0.smithi084.stdout:3/354: creat d1/f77 x:0 0 0 2024-04-26T21:25:56.339 INFO:tasks.workunit.client.0.smithi084.stdout:1/368: dwrite d2/d54/d5e/d66/f2b [8388608,4194304] 0 2024-04-26T21:25:56.341 INFO:tasks.workunit.client.0.smithi084.stdout:0/340: write f0 [4661809,127580] 0 2024-04-26T21:25:56.348 INFO:tasks.workunit.client.0.smithi084.stdout:7/344: creat d6/d9/d12/d19/d20/d32/f71 x:0 0 0 2024-04-26T21:25:56.348 INFO:tasks.workunit.client.0.smithi084.stdout:8/353: creat d4/d7/d15/d37/d52/f67 x:0 0 0 2024-04-26T21:25:56.348 INFO:tasks.workunit.client.1.smithi120.stdout:2/566: dwrite d4/d1b/d2e/fa7 [0,4194304] 0 2024-04-26T21:25:56.355 INFO:tasks.workunit.client.1.smithi120.stdout:2/567: dread - d4/d1b/d2e/d50/d14/d15/d6c/fa4 zero size 2024-04-26T21:25:56.356 INFO:tasks.workunit.client.0.smithi084.stdout:1/369: mkdir d2/d54/d5e/d66/d3a/d77 0 2024-04-26T21:25:56.356 INFO:tasks.workunit.client.0.smithi084.stdout:0/341: truncate de/d1c/d32/f3d 1145057 0 2024-04-26T21:25:56.357 INFO:tasks.workunit.client.0.smithi084.stdout:1/370: chown d2 116936 1 2024-04-26T21:25:56.359 INFO:tasks.workunit.client.0.smithi084.stdout:3/355: rename d1/d2c/d2f/c48 to d1/d24/c78 0 2024-04-26T21:25:56.362 INFO:tasks.workunit.client.0.smithi084.stdout:9/306: fsync da/de/d16/d25/d4f/f51 0 2024-04-26T21:25:56.362 INFO:tasks.workunit.client.0.smithi084.stdout:8/354: chown d4/d6/db/c1b 1366161 1 2024-04-26T21:25:56.363 INFO:tasks.workunit.client.0.smithi084.stdout:0/342: stat de/d2b/l2d 0 2024-04-26T21:25:56.364 INFO:tasks.workunit.client.1.smithi120.stdout:2/568: write d4/d1b/d2e/d50/d14/d15/d6c/fa4 [969917,48371] 0 2024-04-26T21:25:56.365 INFO:tasks.workunit.client.1.smithi120.stdout:3/549: write f5 [3390478,103716] 0 2024-04-26T21:25:56.369 INFO:tasks.workunit.client.1.smithi120.stdout:2/569: creat d4/d1b/d56/d65/fbc x:0 0 0 2024-04-26T21:25:56.373 INFO:tasks.workunit.client.1.smithi120.stdout:3/550: mknod dd/de/d18/d37/d80/da9/caf 0 2024-04-26T21:25:56.374 INFO:tasks.workunit.client.0.smithi084.stdout:7/345: dwrite d6/d1c/d51/f6c [0,4194304] 0 2024-04-26T21:25:56.376 INFO:tasks.workunit.client.0.smithi084.stdout:7/346: stat d6/d9/d12/d19/d20/l34 0 2024-04-26T21:25:56.380 INFO:tasks.workunit.client.0.smithi084.stdout:1/371: getdents d2/d9/d15/d28/d69 0 2024-04-26T21:25:56.383 INFO:tasks.workunit.client.0.smithi084.stdout:0/343: symlink de/d20/l72 0 2024-04-26T21:25:56.383 INFO:tasks.workunit.client.0.smithi084.stdout:7/347: truncate d6/d9/d12/d19/f70 12699 0 2024-04-26T21:25:56.383 INFO:tasks.workunit.client.0.smithi084.stdout:9/307: rename da/de/l6d to da/de/d16/d25/d41/l72 0 2024-04-26T21:25:56.385 INFO:tasks.workunit.client.1.smithi120.stdout:3/551: rename dd/de/df/d12/d6c to dd/de/d83/d64/db0 0 2024-04-26T21:25:56.387 INFO:tasks.workunit.client.1.smithi120.stdout:2/570: creat d4/d1b/d2e/d50/fbd x:0 0 0 2024-04-26T21:25:56.390 INFO:tasks.workunit.client.0.smithi084.stdout:8/355: creat d4/d7/d15/d37/f68 x:0 0 0 2024-04-26T21:25:56.392 INFO:tasks.workunit.client.0.smithi084.stdout:2/445: chown d6/d7/d3d/d15/d1f/d6c/l8d 869801 1 2024-04-26T21:25:56.397 INFO:tasks.workunit.client.1.smithi120.stdout:2/571: chown d4/d1b/d2e/d50/c19 0 1 2024-04-26T21:25:56.398 INFO:tasks.workunit.client.0.smithi084.stdout:8/356: chown d4/d7/d15/f30 732 1 2024-04-26T21:25:56.399 INFO:tasks.workunit.client.0.smithi084.stdout:1/372: chown d2/d9/c52 6 1 2024-04-26T21:25:56.401 INFO:tasks.workunit.client.0.smithi084.stdout:9/308: link da/de/d16/f57 da/de/d16/d25/f73 0 2024-04-26T21:25:56.402 INFO:tasks.workunit.client.0.smithi084.stdout:8/357: chown d4/lc 13728 1 2024-04-26T21:25:56.403 INFO:tasks.workunit.client.1.smithi120.stdout:0/646: write d0/d3/dc/d12/dae/faf [1759508,35833] 0 2024-04-26T21:25:56.408 INFO:tasks.workunit.client.1.smithi120.stdout:5/620: dwrite d2/dc/d1d/d21/db2/fc7 [0,4194304] 0 2024-04-26T21:25:56.409 INFO:tasks.workunit.client.0.smithi084.stdout:1/373: dread - d2/d19/f4d zero size 2024-04-26T21:25:56.410 INFO:tasks.workunit.client.0.smithi084.stdout:2/446: symlink d6/d7/d3d/d15/d1f/d39/d20/d45/d6d/l9e 0 2024-04-26T21:25:56.410 INFO:tasks.workunit.client.1.smithi120.stdout:2/572: fsync d4/d1b/d56/f5a 0 2024-04-26T21:25:56.414 INFO:tasks.workunit.client.0.smithi084.stdout:9/309: creat da/de/d1e/f74 x:0 0 0 2024-04-26T21:25:56.414 INFO:tasks.workunit.client.1.smithi120.stdout:7/543: dread d7/d19/f24 [0,4194304] 0 2024-04-26T21:25:56.416 INFO:tasks.workunit.client.1.smithi120.stdout:0/647: unlink d0/df/d59/f98 0 2024-04-26T21:25:56.417 INFO:tasks.workunit.client.0.smithi084.stdout:8/358: mkdir d4/d7/d15/d37/d52/d69 0 2024-04-26T21:25:56.421 INFO:tasks.workunit.client.1.smithi120.stdout:5/621: fdatasync d2/dc/f7f 0 2024-04-26T21:25:56.421 INFO:tasks.workunit.client.1.smithi120.stdout:0/648: read d0/f90 [7877051,30889] 0 2024-04-26T21:25:56.421 INFO:tasks.workunit.client.1.smithi120.stdout:2/573: unlink d4/d1b/d25/d2c/f75 0 2024-04-26T21:25:56.421 INFO:tasks.workunit.client.0.smithi084.stdout:0/344: dwrite de/d71/f57 [0,4194304] 0 2024-04-26T21:25:56.422 INFO:tasks.workunit.client.1.smithi120.stdout:1/504: dwrite d6/fc [0,4194304] 0 2024-04-26T21:25:56.425 INFO:tasks.workunit.client.0.smithi084.stdout:8/359: write d4/f5 [2881834,65326] 0 2024-04-26T21:25:56.427 INFO:tasks.workunit.client.1.smithi120.stdout:0/649: fsync d0/d3/dc/d12/f6a 0 2024-04-26T21:25:56.431 INFO:tasks.workunit.client.1.smithi120.stdout:5/622: creat d2/dc/d1d/d1f/d36/fe1 x:0 0 0 2024-04-26T21:25:56.432 INFO:tasks.workunit.client.0.smithi084.stdout:7/348: dwrite d6/d9/d12/d19/d20/d32/f71 [0,4194304] 0 2024-04-26T21:25:56.433 INFO:tasks.workunit.client.1.smithi120.stdout:2/574: chown d4/d1b/d2e/d50/d14/d15/l30 24 1 2024-04-26T21:25:56.433 INFO:tasks.workunit.client.0.smithi084.stdout:8/360: dread d4/d6/f40 [0,4194304] 0 2024-04-26T21:25:56.435 INFO:tasks.workunit.client.1.smithi120.stdout:2/575: fsync d4/f66 0 2024-04-26T21:25:56.436 INFO:tasks.workunit.client.0.smithi084.stdout:2/447: mkdir d6/d7/d9f 0 2024-04-26T21:25:56.437 INFO:tasks.workunit.client.1.smithi120.stdout:3/552: dwrite dd/de/df/d12/f21 [4194304,4194304] 0 2024-04-26T21:25:56.438 INFO:tasks.workunit.client.0.smithi084.stdout:7/349: fdatasync d6/d26/d40/f5e 0 2024-04-26T21:25:56.445 INFO:tasks.workunit.client.1.smithi120.stdout:5/623: fdatasync d2/d48/f56 0 2024-04-26T21:25:56.446 INFO:tasks.workunit.client.1.smithi120.stdout:2/576: symlink d4/lbe 0 2024-04-26T21:25:56.447 INFO:tasks.workunit.client.1.smithi120.stdout:2/577: readlink d4/l1f 0 2024-04-26T21:25:56.449 INFO:tasks.workunit.client.0.smithi084.stdout:9/310: truncate da/de/d16/d25/d4f/f59 180879 0 2024-04-26T21:25:56.449 INFO:tasks.workunit.client.0.smithi084.stdout:3/356: dread d1/d2c/d2f/f54 [0,4194304] 0 2024-04-26T21:25:56.450 INFO:tasks.workunit.client.0.smithi084.stdout:2/448: chown d6/d7/d3d/d15/d1f/d39/d20/l73 63 1 2024-04-26T21:25:56.451 INFO:tasks.workunit.client.1.smithi120.stdout:2/578: fdatasync d4/d1b/d2e/d50/f21 0 2024-04-26T21:25:56.453 INFO:tasks.workunit.client.1.smithi120.stdout:2/579: chown d4/d1b/d56/d65/lae 4 1 2024-04-26T21:25:56.453 INFO:tasks.workunit.client.1.smithi120.stdout:3/553: rename dd/de/d18/d2c to dd/de/d18/d24/db1 0 2024-04-26T21:25:56.456 INFO:tasks.workunit.client.0.smithi084.stdout:2/449: symlink d6/la0 0 2024-04-26T21:25:56.460 INFO:tasks.workunit.client.0.smithi084.stdout:1/374: dwrite d2/d54/d5e/d66/f18 [4194304,4194304] 0 2024-04-26T21:25:56.461 INFO:tasks.workunit.client.0.smithi084.stdout:8/361: creat d4/d6/db/f6a x:0 0 0 2024-04-26T21:25:56.462 INFO:tasks.workunit.client.1.smithi120.stdout:5/624: creat d2/dc/d1d/d21/d77/d79/db7/d5f/fe2 x:0 0 0 2024-04-26T21:25:56.463 INFO:tasks.workunit.client.1.smithi120.stdout:3/554: dread dd/fa3 [0,4194304] 0 2024-04-26T21:25:56.467 INFO:tasks.workunit.client.1.smithi120.stdout:3/555: dread - dd/d2a/d74/fab zero size 2024-04-26T21:25:56.469 INFO:tasks.workunit.client.0.smithi084.stdout:2/450: rmdir d6/d7/d3d/d15/d1f/d6c 39 2024-04-26T21:25:56.471 INFO:tasks.workunit.client.1.smithi120.stdout:3/556: mkdir dd/de/d83/db2 0 2024-04-26T21:25:56.475 INFO:tasks.workunit.client.0.smithi084.stdout:5/331: dread d0/dc/df/f24 [0,4194304] 0 2024-04-26T21:25:56.478 INFO:tasks.workunit.client.0.smithi084.stdout:0/345: dread de/d1c/f1d [0,4194304] 0 2024-04-26T21:25:56.478 INFO:tasks.workunit.client.0.smithi084.stdout:9/311: dwrite da/de/d16/f1c [0,4194304] 0 2024-04-26T21:25:56.481 INFO:tasks.workunit.client.1.smithi120.stdout:2/580: dwrite d4/d1b/d2e/d50/f21 [8388608,4194304] 0 2024-04-26T21:25:56.482 INFO:tasks.workunit.client.0.smithi084.stdout:6/378: sync 2024-04-26T21:25:56.482 INFO:tasks.workunit.client.0.smithi084.stdout:4/264: sync 2024-04-26T21:25:56.489 INFO:tasks.workunit.client.0.smithi084.stdout:6/379: readlink d3/de/d1a/d2f/l70 0 2024-04-26T21:25:56.492 INFO:tasks.workunit.client.0.smithi084.stdout:3/357: dwrite d1/fe [0,4194304] 0 2024-04-26T21:25:56.492 INFO:tasks.workunit.client.1.smithi120.stdout:5/625: dwrite d2/dc/d1d/d21/d66/fa2 [0,4194304] 0 2024-04-26T21:25:56.493 INFO:tasks.workunit.client.0.smithi084.stdout:2/451: creat d6/d7/fa1 x:0 0 0 2024-04-26T21:25:56.495 INFO:tasks.workunit.client.0.smithi084.stdout:4/265: read - d5/d10/d15/f5b zero size 2024-04-26T21:25:56.496 INFO:tasks.workunit.client.1.smithi120.stdout:2/581: mkdir d4/d1b/d56/d65/dbf 0 2024-04-26T21:25:56.498 INFO:tasks.workunit.client.1.smithi120.stdout:0/650: dread d0/d3/dc/dd/f54 [4194304,4194304] 0 2024-04-26T21:25:56.499 INFO:tasks.workunit.client.0.smithi084.stdout:9/312: creat da/de/d16/d25/d41/d67/f75 x:0 0 0 2024-04-26T21:25:56.505 INFO:tasks.workunit.client.0.smithi084.stdout:7/350: dwrite d6/dc/d47/f4a [0,4194304] 0 2024-04-26T21:25:56.507 INFO:tasks.workunit.client.1.smithi120.stdout:2/582: chown d4/d1b/d25/d29/la9 9589 1 2024-04-26T21:25:56.509 INFO:tasks.workunit.client.0.smithi084.stdout:6/380: creat d3/de/d15/f85 x:0 0 0 2024-04-26T21:25:56.512 INFO:tasks.workunit.client.1.smithi120.stdout:5/626: truncate d2/dc/d1d/d1f/d36/f40 144234 0 2024-04-26T21:25:56.513 INFO:tasks.workunit.client.0.smithi084.stdout:2/452: read - d6/d7/d3d/d15/d1f/d39/d43/f91 zero size 2024-04-26T21:25:56.515 INFO:tasks.workunit.client.0.smithi084.stdout:4/266: truncate d5/d7/d17/f51 863251 0 2024-04-26T21:25:56.517 INFO:tasks.workunit.client.0.smithi084.stdout:9/313: creat da/de/d16/d25/d41/f76 x:0 0 0 2024-04-26T21:25:56.523 INFO:tasks.workunit.client.1.smithi120.stdout:0/651: dwrite d0/d3/f4f [0,4194304] 0 2024-04-26T21:25:56.526 INFO:tasks.workunit.client.1.smithi120.stdout:1/505: dread d6/d7/d1d/f50 [4194304,4194304] 0 2024-04-26T21:25:56.526 INFO:tasks.workunit.client.0.smithi084.stdout:2/453: rmdir d6/d7/d3d/d79/d81/d82 39 2024-04-26T21:25:56.530 INFO:tasks.workunit.client.1.smithi120.stdout:3/557: dwrite dd/de/d18/d37/d80/f9c [0,4194304] 0 2024-04-26T21:25:56.531 INFO:tasks.workunit.client.1.smithi120.stdout:1/506: truncate d6/f79 539218 0 2024-04-26T21:25:56.531 INFO:tasks.workunit.client.1.smithi120.stdout:0/652: unlink d0/d3/dc/l65 0 2024-04-26T21:25:56.534 INFO:tasks.workunit.client.0.smithi084.stdout:3/358: dwrite d1/d2c/d2f/d31/d3b/f70 [0,4194304] 0 2024-04-26T21:25:56.534 INFO:tasks.workunit.client.0.smithi084.stdout:9/314: chown da/de/d16/d25/d4f/f51 5 1 2024-04-26T21:25:56.534 INFO:tasks.workunit.client.1.smithi120.stdout:5/627: getdents d2/dc/d1d/d1f/d36/d44 0 2024-04-26T21:25:56.540 INFO:tasks.workunit.client.0.smithi084.stdout:3/359: fsync d1/f58 0 2024-04-26T21:25:56.549 INFO:tasks.workunit.client.0.smithi084.stdout:1/375: dread d2/d9/d15/f5b [0,4194304] 0 2024-04-26T21:25:56.558 INFO:tasks.workunit.client.1.smithi120.stdout:3/558: dread dd/de/f2f [0,4194304] 0 2024-04-26T21:25:56.559 INFO:tasks.workunit.client.1.smithi120.stdout:5/628: dwrite d2/d1b/f26 [0,4194304] 0 2024-04-26T21:25:56.563 INFO:tasks.workunit.client.1.smithi120.stdout:3/559: write dd/d2a/d74/f9f [996207,40928] 0 2024-04-26T21:25:56.564 INFO:tasks.workunit.client.0.smithi084.stdout:9/315: truncate da/de/d1e/f31 2332925 0 2024-04-26T21:25:56.566 INFO:tasks.workunit.client.1.smithi120.stdout:5/629: creat d2/dc/d1d/d21/d77/d79/fe3 x:0 0 0 2024-04-26T21:25:56.575 INFO:tasks.workunit.client.1.smithi120.stdout:9/535: sync 2024-04-26T21:25:56.575 INFO:tasks.workunit.client.1.smithi120.stdout:8/501: sync 2024-04-26T21:25:56.575 INFO:tasks.workunit.client.1.smithi120.stdout:4/539: sync 2024-04-26T21:25:56.575 INFO:tasks.workunit.client.0.smithi084.stdout:6/381: dwrite d3/de/d1a/f36 [0,4194304] 0 2024-04-26T21:25:56.577 INFO:tasks.workunit.client.1.smithi120.stdout:9/536: readlink d0/l28 0 2024-04-26T21:25:56.578 INFO:tasks.workunit.client.1.smithi120.stdout:3/560: creat dd/de/d83/db2/fb3 x:0 0 0 2024-04-26T21:25:56.579 INFO:tasks.workunit.client.1.smithi120.stdout:2/583: truncate d4/d1b/d2e/d50/f2a 1696784 0 2024-04-26T21:25:56.580 INFO:tasks.workunit.client.1.smithi120.stdout:4/540: readlink d10/d12/da1/lb8 0 2024-04-26T21:25:56.581 INFO:tasks.workunit.client.0.smithi084.stdout:5/332: dread d0/dc/f14 [0,4194304] 0 2024-04-26T21:25:56.582 INFO:tasks.workunit.client.1.smithi120.stdout:1/507: write d6/d7/d1d/d2c/fa5 [730628,39206] 0 2024-04-26T21:25:56.584 INFO:tasks.workunit.client.1.smithi120.stdout:2/584: chown d4/d1b 21 1 2024-04-26T21:25:56.584 INFO:tasks.workunit.client.0.smithi084.stdout:9/316: rename da/de/f2d to da/de/d16/d25/d41/d43/d48/d61/f77 0 2024-04-26T21:25:56.587 INFO:tasks.workunit.client.1.smithi120.stdout:0/653: dread d0/d3/dc/d12/f3b [0,4194304] 0 2024-04-26T21:25:56.587 INFO:tasks.workunit.client.0.smithi084.stdout:1/376: truncate d2/d54/d5e/d66/d3a/d48/f50 697239 0 2024-04-26T21:25:56.588 INFO:tasks.workunit.client.0.smithi084.stdout:2/454: write d6/d7/d68/f71 [504137,36755] 0 2024-04-26T21:25:56.589 INFO:tasks.workunit.client.0.smithi084.stdout:8/362: dread d4/d7/f16 [0,4194304] 0 2024-04-26T21:25:56.592 INFO:tasks.workunit.client.0.smithi084.stdout:1/377: write d2/d19/f4c [4752247,83847] 0 2024-04-26T21:25:56.596 INFO:tasks.workunit.client.0.smithi084.stdout:9/317: rename f3 to da/de/d16/d40/f78 0 2024-04-26T21:25:56.599 INFO:tasks.workunit.client.0.smithi084.stdout:9/318: chown da/f34 253 1 2024-04-26T21:25:56.599 INFO:tasks.workunit.client.0.smithi084.stdout:3/360: dread d1/d24/d27/d3a/f62 [0,4194304] 0 2024-04-26T21:25:56.599 INFO:tasks.workunit.client.1.smithi120.stdout:9/537: creat d0/d14/d77/d9a/fac x:0 0 0 2024-04-26T21:25:56.600 INFO:tasks.workunit.client.1.smithi120.stdout:8/502: mkdir d5/d6/d34/d42/d9d/d7a/da4 0 2024-04-26T21:25:56.600 INFO:tasks.workunit.client.0.smithi084.stdout:0/346: dread de/d1c/d32/f51 [0,4194304] 0 2024-04-26T21:25:56.603 INFO:tasks.workunit.client.0.smithi084.stdout:5/333: unlink d0/dc/df/l13 0 2024-04-26T21:25:56.603 INFO:tasks.workunit.client.0.smithi084.stdout:0/347: fdatasync f4 0 2024-04-26T21:25:56.604 INFO:tasks.workunit.client.1.smithi120.stdout:9/538: dread - d0/dd/d3a/d5c/d98/faa zero size 2024-04-26T21:25:56.605 INFO:tasks.workunit.client.1.smithi120.stdout:3/561: dwrite dd/de/d83/f45 [0,4194304] 0 2024-04-26T21:25:56.606 INFO:tasks.workunit.client.1.smithi120.stdout:1/508: dread d6/d7/d1d/d2c/f93 [0,4194304] 0 2024-04-26T21:25:56.606 INFO:tasks.workunit.client.0.smithi084.stdout:0/348: fdatasync de/d1c/d32/f44 0 2024-04-26T21:25:56.608 INFO:tasks.workunit.client.0.smithi084.stdout:0/349: fsync de/f12 0 2024-04-26T21:25:56.609 INFO:tasks.workunit.client.0.smithi084.stdout:0/350: chown de/d20/l52 0 1 2024-04-26T21:25:56.610 INFO:tasks.workunit.client.1.smithi120.stdout:4/541: rename d10/d6b/d71/fba to d10/d6b/da4/fbc 0 2024-04-26T21:25:56.610 INFO:tasks.workunit.client.0.smithi084.stdout:8/363: mknod d4/d6/db/d1e/d22/d2f/c6b 0 2024-04-26T21:25:56.611 INFO:tasks.workunit.client.0.smithi084.stdout:4/267: dread d5/d7/d17/f27 [0,4194304] 0 2024-04-26T21:25:56.611 INFO:tasks.workunit.client.1.smithi120.stdout:0/654: read d0/d3/dc/d12/f6a [302438,43617] 0 2024-04-26T21:25:56.613 INFO:tasks.workunit.client.0.smithi084.stdout:6/382: write d3/fc [238405,14781] 0 2024-04-26T21:25:56.614 INFO:tasks.workunit.client.0.smithi084.stdout:8/364: chown d4/f5 114962517 1 2024-04-26T21:25:56.616 INFO:tasks.workunit.client.0.smithi084.stdout:0/351: dread - de/d20/d4c/f61 zero size 2024-04-26T21:25:56.619 INFO:tasks.workunit.client.1.smithi120.stdout:2/585: creat d4/d1b/d25/d93/fc0 x:0 0 0 2024-04-26T21:25:56.620 INFO:tasks.workunit.client.1.smithi120.stdout:8/503: chown d5/d6/l93 4000486 1 2024-04-26T21:25:56.620 INFO:tasks.workunit.client.0.smithi084.stdout:8/365: write d4/d6/db/d1e/d22/d2f/f41 [869375,116642] 0 2024-04-26T21:25:56.623 INFO:tasks.workunit.client.1.smithi120.stdout:8/504: write d5/d6/d34/d42/d4a/f99 [981392,75294] 0 2024-04-26T21:25:56.624 INFO:tasks.workunit.client.0.smithi084.stdout:6/383: rename d3/de/d1a/d2f/f83 to d3/d18/d81/f86 0 2024-04-26T21:25:56.625 INFO:tasks.workunit.client.0.smithi084.stdout:2/455: dwrite d6/d7/d3d/d15/d1f/d22/f24 [0,4194304] 0 2024-04-26T21:25:56.625 INFO:tasks.workunit.client.1.smithi120.stdout:6/576: sync 2024-04-26T21:25:56.625 INFO:tasks.workunit.client.0.smithi084.stdout:1/378: dread d2/d9/d15/f25 [0,4194304] 0 2024-04-26T21:25:56.626 INFO:tasks.workunit.client.0.smithi084.stdout:9/319: getdents da/de/d16/d25/d41/d67 0 2024-04-26T21:25:56.629 INFO:tasks.workunit.client.1.smithi120.stdout:9/539: creat d0/dd/d3a/d5c/d98/fad x:0 0 0 2024-04-26T21:25:56.633 INFO:tasks.workunit.client.0.smithi084.stdout:1/379: dread - d2/d19/f4d zero size 2024-04-26T21:25:56.633 INFO:tasks.workunit.client.0.smithi084.stdout:2/456: chown d6/d3e/d67 4309298 1 2024-04-26T21:25:56.633 INFO:tasks.workunit.client.0.smithi084.stdout:9/320: write da/de/d1e/f29 [4940875,46147] 0 2024-04-26T21:25:56.641 INFO:tasks.workunit.client.0.smithi084.stdout:9/321: dread - da/de/f66 zero size 2024-04-26T21:25:56.642 INFO:tasks.workunit.client.0.smithi084.stdout:6/384: symlink d3/de/d1a/d43/d75/l87 0 2024-04-26T21:25:56.646 INFO:tasks.workunit.client.0.smithi084.stdout:3/361: dwrite d1/d2c/d2f/d31/d55/f6a [0,4194304] 0 2024-04-26T21:25:56.646 INFO:tasks.workunit.client.0.smithi084.stdout:2/457: chown d6/d1b/c58 1432650 1 2024-04-26T21:25:56.646 INFO:tasks.workunit.client.0.smithi084.stdout:8/366: link d4/lc d4/d6/db/d1e/d22/d39/l6c 0 2024-04-26T21:25:56.650 INFO:tasks.workunit.client.0.smithi084.stdout:1/380: link d2/d54/d5e/d66/f36 d2/d9/d15/d28/d47/f78 0 2024-04-26T21:25:56.651 INFO:tasks.workunit.client.0.smithi084.stdout:6/385: readlink d3/de/d1a/d43/l7f 0 2024-04-26T21:25:56.654 INFO:tasks.workunit.client.0.smithi084.stdout:4/268: dwrite d5/f2b [0,4194304] 0 2024-04-26T21:25:56.655 INFO:tasks.workunit.client.0.smithi084.stdout:1/381: fsync d2/d9/f16 0 2024-04-26T21:25:56.656 INFO:tasks.workunit.client.0.smithi084.stdout:9/322: mknod da/de/d16/c79 0 2024-04-26T21:25:56.658 INFO:tasks.workunit.client.1.smithi120.stdout:0/655: rmdir d0/d3/dc/dd/d1b/daa 39 2024-04-26T21:25:56.659 INFO:tasks.workunit.client.0.smithi084.stdout:1/382: chown d2/d9/d15/d28/c76 27186 1 2024-04-26T21:25:56.659 INFO:tasks.workunit.client.1.smithi120.stdout:0/656: dread - d0/d3/d13/d81/dba/fbd zero size 2024-04-26T21:25:56.663 INFO:tasks.workunit.client.0.smithi084.stdout:7/351: dread d6/d9/fa [0,4194304] 0 2024-04-26T21:25:56.666 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:56 smithi084 ceph-mon[25539]: mgrmap e26: smithi120.zjaduj(active, since 79s), standbys: smithi084.gyasul 2024-04-26T21:25:56.666 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:56 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2665307601' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:25:56.666 INFO:tasks.workunit.client.0.smithi084.stdout:9/323: chown da/f14 1 1 2024-04-26T21:25:56.666 INFO:tasks.workunit.client.0.smithi084.stdout:7/352: write d6/dc/d47/f48 [1263569,6273] 0 2024-04-26T21:25:56.668 INFO:tasks.workunit.client.0.smithi084.stdout:4/269: dread - d5/d7/d17/d45/f5a zero size 2024-04-26T21:25:56.671 INFO:tasks.workunit.client.0.smithi084.stdout:7/353: dread - d6/d26/d40/d4f/f6a zero size 2024-04-26T21:25:56.676 INFO:tasks.workunit.client.1.smithi120.stdout:5/630: truncate d2/d1b/d89/f87 228176 0 2024-04-26T21:25:56.678 INFO:tasks.workunit.client.0.smithi084.stdout:9/324: truncate da/de/d16/d25/d41/d43/d48/f58 302348 0 2024-04-26T21:25:56.679 INFO:tasks.workunit.client.1.smithi120.stdout:8/505: mkdir d5/d6/d11/d52/d27/d4f/d67/da5 0 2024-04-26T21:25:56.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:56 smithi120 ceph-mon[32741]: mgrmap e26: smithi120.zjaduj(active, since 79s), standbys: smithi084.gyasul 2024-04-26T21:25:56.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:56 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2665307601' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:25:56.683 INFO:tasks.workunit.client.0.smithi084.stdout:4/270: creat d5/d7/d17/d32/d46/f5c x:0 0 0 2024-04-26T21:25:56.683 INFO:tasks.workunit.client.1.smithi120.stdout:6/577: mkdir d4/db/d25/d6d/dbd/dc4 0 2024-04-26T21:25:56.685 INFO:tasks.workunit.client.0.smithi084.stdout:9/325: mknod da/de/d16/d25/d4f/c7a 0 2024-04-26T21:25:56.686 INFO:tasks.workunit.client.0.smithi084.stdout:4/271: fdatasync d5/d10/d15/f40 0 2024-04-26T21:25:56.692 INFO:tasks.workunit.client.0.smithi084.stdout:9/326: stat da/de/d16/d25/f52 0 2024-04-26T21:25:56.699 INFO:tasks.workunit.client.1.smithi120.stdout:7/544: sync 2024-04-26T21:25:56.701 INFO:tasks.workunit.client.0.smithi084.stdout:1/383: write d2/d54/d5e/d66/d3a/d48/f6e [1493896,125823] 0 2024-04-26T21:25:56.702 INFO:tasks.workunit.client.0.smithi084.stdout:3/362: dwrite d1/d2c/d2f/d31/d3b/f70 [0,4194304] 0 2024-04-26T21:25:56.705 INFO:tasks.workunit.client.1.smithi120.stdout:7/545: read d7/fd [1209559,57610] 0 2024-04-26T21:25:56.709 INFO:tasks.workunit.client.1.smithi120.stdout:3/562: dwrite dd/de/d18/d24/d43/f4c [0,4194304] 0 2024-04-26T21:25:56.711 INFO:tasks.workunit.client.1.smithi120.stdout:2/586: dwrite d4/f66 [0,4194304] 0 2024-04-26T21:25:56.715 INFO:tasks.workunit.client.0.smithi084.stdout:3/363: symlink d1/d2c/l79 0 2024-04-26T21:25:56.716 INFO:tasks.workunit.client.1.smithi120.stdout:9/540: write d0/d6/f76 [1491901,76121] 0 2024-04-26T21:25:56.719 INFO:tasks.workunit.client.1.smithi120.stdout:9/541: chown d0/dd/c10 6127 1 2024-04-26T21:25:56.723 INFO:tasks.workunit.client.0.smithi084.stdout:1/384: creat d2/d54/d5e/d66/d2a/f79 x:0 0 0 2024-04-26T21:25:56.728 INFO:tasks.workunit.client.0.smithi084.stdout:6/386: dwrite d3/de/d1a/d2f/f56 [0,4194304] 0 2024-04-26T21:25:56.728 INFO:tasks.workunit.client.0.smithi084.stdout:2/458: dwrite d6/d7/d3d/d15/d1f/d39/d20/d45/f97 [0,4194304] 0 2024-04-26T21:25:56.739 INFO:tasks.workunit.client.0.smithi084.stdout:0/352: dread de/d1c/f3c [0,4194304] 0 2024-04-26T21:25:56.744 INFO:tasks.workunit.client.0.smithi084.stdout:2/459: creat d6/d7/d68/fa2 x:0 0 0 2024-04-26T21:25:56.746 INFO:tasks.workunit.client.0.smithi084.stdout:7/354: dwrite d6/d26/d40/f66 [4194304,4194304] 0 2024-04-26T21:25:56.747 INFO:tasks.workunit.client.0.smithi084.stdout:4/272: dwrite d5/d7/d17/d45/f5a [0,4194304] 0 2024-04-26T21:25:56.747 INFO:tasks.workunit.client.0.smithi084.stdout:2/460: stat d6/d7/f27 0 2024-04-26T21:25:56.752 INFO:tasks.workunit.client.0.smithi084.stdout:2/461: dread - d6/d7/d68/f77 zero size 2024-04-26T21:25:56.752 INFO:tasks.workunit.client.0.smithi084.stdout:9/327: dread da/de/d1e/f49 [0,4194304] 0 2024-04-26T21:25:56.758 INFO:tasks.workunit.client.0.smithi084.stdout:1/385: mknod d2/d54/d5e/d66/d3a/d48/c7a 0 2024-04-26T21:25:56.763 INFO:tasks.workunit.client.1.smithi120.stdout:1/509: rename d6/f15 to d6/d7/d2d/d48/d86/fa7 0 2024-04-26T21:25:56.764 INFO:tasks.workunit.client.1.smithi120.stdout:0/657: symlink d0/d3/d51/d70/ldc 0 2024-04-26T21:25:56.765 INFO:tasks.workunit.client.1.smithi120.stdout:5/631: read d2/f3f [355082,114291] 0 2024-04-26T21:25:56.769 INFO:tasks.workunit.client.1.smithi120.stdout:8/506: creat d5/d6/d75/fa6 x:0 0 0 2024-04-26T21:25:56.769 INFO:tasks.workunit.client.1.smithi120.stdout:6/578: mkdir d4/db/d10/d22/d56/dc5 0 2024-04-26T21:25:56.769 INFO:tasks.workunit.client.1.smithi120.stdout:7/546: symlink d7/d64/da6/d1f/d28/d4c/d6c/lbd 0 2024-04-26T21:25:56.771 INFO:tasks.workunit.client.1.smithi120.stdout:7/547: dread - d7/d64/fae zero size 2024-04-26T21:25:56.771 INFO:tasks.workunit.client.0.smithi084.stdout:2/462: creat d6/d7/d3d/d15/d1f/d39/fa3 x:0 0 0 2024-04-26T21:25:56.772 INFO:tasks.workunit.client.0.smithi084.stdout:1/386: symlink d2/d54/d5e/l7b 0 2024-04-26T21:25:56.772 INFO:tasks.workunit.client.1.smithi120.stdout:8/507: dread - d5/d6/d11/d32/d3b/f98 zero size 2024-04-26T21:25:56.772 INFO:tasks.workunit.client.1.smithi120.stdout:2/587: fsync d4/d1b/f41 0 2024-04-26T21:25:56.775 INFO:tasks.workunit.client.0.smithi084.stdout:8/367: dread d4/f4f [4194304,4194304] 0 2024-04-26T21:25:56.776 INFO:tasks.workunit.client.1.smithi120.stdout:8/508: chown d5/d6/d11/d32/d3b/l43 216539 1 2024-04-26T21:25:56.777 INFO:tasks.workunit.client.1.smithi120.stdout:9/542: rename d0/d14/d2d/d4b/d85/d86 to d0/dd/d3a/dae 0 2024-04-26T21:25:56.777 INFO:tasks.workunit.client.1.smithi120.stdout:5/632: rmdir d2/dc/d1d/d21/d77 39 2024-04-26T21:25:56.778 INFO:tasks.workunit.client.1.smithi120.stdout:8/509: write d5/d6/d11/f6b [11887012,2790] 0 2024-04-26T21:25:56.781 INFO:tasks.workunit.client.1.smithi120.stdout:8/510: write f4 [1135684,114322] 0 2024-04-26T21:25:56.787 INFO:tasks.workunit.client.1.smithi120.stdout:6/579: fdatasync d4/db/d10/dd/d4e/f75 0 2024-04-26T21:25:56.791 INFO:tasks.workunit.client.0.smithi084.stdout:1/387: write d2/d19/f1e [1408466,54429] 0 2024-04-26T21:25:56.791 INFO:tasks.workunit.client.0.smithi084.stdout:8/368: mknod d4/d7/d53/c6d 0 2024-04-26T21:25:56.792 INFO:tasks.workunit.client.1.smithi120.stdout:1/510: link d6/d14/d6f/l99 d6/d7/d2d/d48/d86/la8 0 2024-04-26T21:25:56.793 INFO:tasks.workunit.client.1.smithi120.stdout:8/511: chown d5/d6/l77 6605415 1 2024-04-26T21:25:56.797 INFO:tasks.workunit.client.1.smithi120.stdout:9/543: creat d0/d66/d93/faf x:0 0 0 2024-04-26T21:25:56.801 INFO:tasks.workunit.client.1.smithi120.stdout:6/580: rmdir d4/db/d10/d1a/d2b/d57/d67 39 2024-04-26T21:25:56.805 INFO:tasks.workunit.client.0.smithi084.stdout:7/355: dwrite d6/d9/fa [4194304,4194304] 0 2024-04-26T21:25:56.805 INFO:tasks.workunit.client.0.smithi084.stdout:9/328: getdents da/de/d16/d25/d4f 0 2024-04-26T21:25:56.806 INFO:tasks.workunit.client.1.smithi120.stdout:6/581: write d4/db/d25/d6d/f77 [969662,128815] 0 2024-04-26T21:25:56.808 INFO:tasks.workunit.client.1.smithi120.stdout:5/633: dwrite d2/dc/d1d/d1f/d34/fa9 [0,4194304] 0 2024-04-26T21:25:56.809 INFO:tasks.workunit.client.0.smithi084.stdout:0/353: dwrite de/d20/f24 [0,4194304] 0 2024-04-26T21:25:56.812 INFO:tasks.workunit.client.1.smithi120.stdout:6/582: write d4/db/d10/d22/d6c/f70 [1824481,35521] 0 2024-04-26T21:25:56.815 INFO:tasks.workunit.client.1.smithi120.stdout:7/548: link d7/d64/da6/d1f/f48 d7/d64/da6/d1a/d33/fbe 0 2024-04-26T21:25:56.816 INFO:tasks.workunit.client.0.smithi084.stdout:1/388: fdatasync d2/f56 0 2024-04-26T21:25:56.821 INFO:tasks.workunit.client.0.smithi084.stdout:3/364: dwrite d1/f22 [0,4194304] 0 2024-04-26T21:25:56.821 INFO:tasks.workunit.client.0.smithi084.stdout:7/356: read - d6/d26/d40/d4f/f6a zero size 2024-04-26T21:25:56.822 INFO:tasks.workunit.client.1.smithi120.stdout:1/511: mknod d6/d7/d1b/d89/d8c/d62/ca9 0 2024-04-26T21:25:56.822 INFO:tasks.workunit.client.0.smithi084.stdout:8/369: creat d4/d6/f6e x:0 0 0 2024-04-26T21:25:56.823 INFO:tasks.workunit.client.1.smithi120.stdout:9/544: creat d0/d14/fb0 x:0 0 0 2024-04-26T21:25:56.824 INFO:tasks.workunit.client.0.smithi084.stdout:4/273: dwrite d5/d10/d15/f40 [0,4194304] 0 2024-04-26T21:25:56.824 INFO:tasks.workunit.client.0.smithi084.stdout:9/329: dread - da/de/d16/f30 zero size 2024-04-26T21:25:56.824 INFO:tasks.workunit.client.1.smithi120.stdout:8/512: mkdir d5/d6/d34/da7 0 2024-04-26T21:25:56.825 INFO:tasks.workunit.client.0.smithi084.stdout:5/334: sync 2024-04-26T21:25:56.828 INFO:tasks.workunit.client.1.smithi120.stdout:8/513: fdatasync d5/d6/d11/d32/d3b/f6f 0 2024-04-26T21:25:56.832 INFO:tasks.workunit.client.0.smithi084.stdout:3/365: fsync d1/d2c/d2f/f2e 0 2024-04-26T21:25:56.837 INFO:tasks.workunit.client.0.smithi084.stdout:0/354: chown de/d20/d4e/f6a 73090 1 2024-04-26T21:25:56.840 INFO:tasks.workunit.client.0.smithi084.stdout:6/387: dwrite d3/de/d15/d40/f77 [0,4194304] 0 2024-04-26T21:25:56.842 INFO:tasks.workunit.client.1.smithi120.stdout:7/549: mkdir d7/d64/da6/d1a/d33/d34/dab/dbf 0 2024-04-26T21:25:56.844 INFO:tasks.workunit.client.1.smithi120.stdout:4/542: truncate d10/d12/f5c 747421 0 2024-04-26T21:25:56.845 INFO:tasks.workunit.client.0.smithi084.stdout:2/463: rmdir d6/d7/d3d 39 2024-04-26T21:25:56.845 INFO:tasks.workunit.client.1.smithi120.stdout:7/550: chown d7/d19/f44 12200146 1 2024-04-26T21:25:56.847 INFO:tasks.workunit.client.0.smithi084.stdout:4/274: symlink d5/d10/d15/d21/d29/d3f/l5d 0 2024-04-26T21:25:56.851 INFO:tasks.workunit.client.1.smithi120.stdout:8/514: dread d5/d6/d11/d52/d27/f51 [0,4194304] 0 2024-04-26T21:25:56.851 INFO:tasks.workunit.client.1.smithi120.stdout:7/551: chown d7/d64/da6/d1a/d33/cb9 14 1 2024-04-26T21:25:56.851 INFO:tasks.workunit.client.0.smithi084.stdout:0/355: creat de/d71/f73 x:0 0 0 2024-04-26T21:25:56.851 INFO:tasks.workunit.client.0.smithi084.stdout:6/388: read d3/fc [162571,113604] 0 2024-04-26T21:25:56.857 INFO:tasks.workunit.client.0.smithi084.stdout:6/389: dread - d3/de/d1a/d43/f57 zero size 2024-04-26T21:25:56.859 INFO:tasks.workunit.client.0.smithi084.stdout:8/370: creat d4/d7/d15/f6f x:0 0 0 2024-04-26T21:25:56.859 INFO:tasks.workunit.client.0.smithi084.stdout:5/335: symlink d0/dc/df/d31/d45/l69 0 2024-04-26T21:25:56.861 INFO:tasks.workunit.client.1.smithi120.stdout:6/583: chown d4/db/d10/d1a/d2b/d57/d67/cb9 2 1 2024-04-26T21:25:56.862 INFO:tasks.workunit.client.1.smithi120.stdout:1/512: mkdir d6/daa 0 2024-04-26T21:25:56.862 INFO:tasks.workunit.client.0.smithi084.stdout:2/464: chown d6/d7/d3d/d4f/d90 0 1 2024-04-26T21:25:56.864 INFO:tasks.workunit.client.1.smithi120.stdout:6/584: chown d4/db/d10/d1a/d2b/d57 3682 1 2024-04-26T21:25:56.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.864+0000 7f59d0400700 1 -- 172.21.15.84:0/2076076362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f59c8107c50 con 0x7f59c8100280 2024-04-26T21:25:56.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.864+0000 7f59c5600700 1 -- 172.21.15.84:0/2076076362 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f59c8107c50 con 0x7f59c8100280 2024-04-26T21:25:56.865 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:25:56.865 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:25:56.865 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:25:56.866 INFO:tasks.workunit.client.0.smithi084.stdout:8/371: write d4/d6/f47 [429418,36621] 0 2024-04-26T21:25:56.866 INFO:tasks.workunit.client.0.smithi084.stdout:3/366: getdents d1/d2c 0 2024-04-26T21:25:56.866 INFO:tasks.workunit.client.0.smithi084.stdout:2/465: readlink d6/l8e 0 2024-04-26T21:25:56.867 INFO:tasks.workunit.client.1.smithi120.stdout:6/585: write d4/db/d10/dd/d28/f61 [276888,69257] 0 2024-04-26T21:25:56.868 INFO:tasks.workunit.client.0.smithi084.stdout:0/356: mknod de/d1c/d68/c74 0 2024-04-26T21:25:56.868 INFO:tasks.workunit.client.1.smithi120.stdout:9/545: link d0/dd/d3a/d5c/d9f/f89 d0/d14/d77/fb1 0 2024-04-26T21:25:56.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.869+0000 7f59d0400700 1 -- 172.21.15.84:0/2076076362 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f59b006e6e0 msgr2=0x7f59b0070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:56.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.869+0000 7f59d0400700 1 --2- 172.21.15.84:0/2076076362 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f59b006e6e0 0x7f59b0070b90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00b970 tx=0x7f59bc009e30 comp rx=0 tx=0).stop 2024-04-26T21:25:56.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.869+0000 7f59d0400700 1 -- 172.21.15.84:0/2076076362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59c8100280 msgr2=0x7f59c8110140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:25:56.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.869+0000 7f59d0400700 1 --2- 172.21.15.84:0/2076076362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59c8100280 0x7f59c8110140 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f59b400c8c0 tx=0x7f59b40044c0 comp rx=0 tx=0).stop 2024-04-26T21:25:56.871 INFO:tasks.workunit.client.0.smithi084.stdout:1/389: dwrite d2/f2e [0,4194304] 0 2024-04-26T21:25:56.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.870+0000 7f59d0400700 1 -- 172.21.15.84:0/2076076362 shutdown_connections 2024-04-26T21:25:56.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.870+0000 7f59d0400700 1 --2- 172.21.15.84:0/2076076362 >> [v2:172.21.15.120:6828/3773295163,v1:172.21.15.120:6829/3773295163] conn(0x7f59b006e6e0 0x7f59b0070b90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:56.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.870+0000 7f59d0400700 1 --2- 172.21.15.84:0/2076076362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59c80fefd0 0x7f59c810fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:56.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.870+0000 7f59d0400700 1 --2- 172.21.15.84:0/2076076362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59c8100280 0x7f59c8110140 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:25:56.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.870+0000 7f59d0400700 1 -- 172.21.15.84:0/2076076362 >> 172.21.15.84:0/2076076362 conn(0x7f59c80fa8f0 msgr2=0x7f59c80fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:25:56.872 INFO:tasks.workunit.client.0.smithi084.stdout:3/367: rmdir d1/d2c 39 2024-04-26T21:25:56.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.871+0000 7f59d0400700 1 -- 172.21.15.84:0/2076076362 shutdown_connections 2024-04-26T21:25:56.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:25:56.871+0000 7f59d0400700 1 -- 172.21.15.84:0/2076076362 wait complete. 2024-04-26T21:25:56.873 INFO:tasks.workunit.client.0.smithi084.stdout:8/372: stat d4/d7/d15/c28 0 2024-04-26T21:25:56.875 INFO:tasks.workunit.client.0.smithi084.stdout:6/390: symlink d3/de/d1a/d43/d75/l88 0 2024-04-26T21:25:56.881 INFO:tasks.workunit.client.0.smithi084.stdout:2/466: chown d6/d7/d3d/d15/d1f/d39/d20 770253 1 2024-04-26T21:25:56.884 INFO:tasks.workunit.client.0.smithi084.stdout:6/391: fdatasync d3/de/f63 0 2024-04-26T21:25:56.884 INFO:tasks.workunit.client.0.smithi084.stdout:1/390: read d2/d54/d5e/d66/d2a/d2c/f2d [3945336,39846] 0 2024-04-26T21:25:56.885 INFO:tasks.workunit.client.1.smithi120.stdout:2/588: truncate d4/d1b/d25/f86 966970 0 2024-04-26T21:25:56.886 INFO:tasks.workunit.client.0.smithi084.stdout:3/368: creat d1/d2c/d2f/d31/d3b/f7a x:0 0 0 2024-04-26T21:25:56.891 INFO:tasks.workunit.client.1.smithi120.stdout:9/546: unlink d0/d66/d93/faf 0 2024-04-26T21:25:56.893 INFO:tasks.workunit.client.1.smithi120.stdout:6/586: creat d4/db/d10/dd/d28/d9e/fc6 x:0 0 0 2024-04-26T21:25:56.894 INFO:tasks.workunit.client.0.smithi084.stdout:4/275: dwrite d5/d10/f13 [0,4194304] 0 2024-04-26T21:25:56.897 INFO:tasks.workunit.client.0.smithi084.stdout:6/392: write d3/de/f6d [440912,961] 0 2024-04-26T21:25:56.897 INFO:tasks.workunit.client.1.smithi120.stdout:5/634: getdents d2/d82/d96 0 2024-04-26T21:25:56.898 INFO:tasks.workunit.client.1.smithi120.stdout:0/658: dread d0/d3/dc/dd/d1b/f91 [0,4194304] 0 2024-04-26T21:25:56.899 INFO:tasks.workunit.client.1.smithi120.stdout:1/513: mkdir d6/d14/d3c/dab 0 2024-04-26T21:25:56.907 INFO:tasks.workunit.client.0.smithi084.stdout:2/467: dread - d6/d7/d3d/d15/d1f/d39/d20/d45/f87 zero size 2024-04-26T21:25:56.907 INFO:tasks.workunit.client.0.smithi084.stdout:5/336: dwrite d0/f32 [0,4194304] 0 2024-04-26T21:25:56.907 INFO:tasks.workunit.client.0.smithi084.stdout:4/276: chown d5/d25/c55 0 1 2024-04-26T21:25:56.908 INFO:tasks.workunit.client.0.smithi084.stdout:1/391: write d2/d9/d15/f5b [507028,83819] 0 2024-04-26T21:25:56.908 INFO:tasks.workunit.client.1.smithi120.stdout:9/547: creat d0/d66/fb2 x:0 0 0 2024-04-26T21:25:56.909 INFO:tasks.workunit.client.0.smithi084.stdout:7/357: dread d6/d9/d12/f3d [0,4194304] 0 2024-04-26T21:25:56.915 INFO:tasks.workunit.client.1.smithi120.stdout:5/635: mkdir d2/d1b/d89/d47/de4 0 2024-04-26T21:25:56.916 INFO:tasks.workunit.client.1.smithi120.stdout:8/515: write d5/d6/d11/f2a [2736926,73008] 0 2024-04-26T21:25:56.916 INFO:tasks.workunit.client.0.smithi084.stdout:7/358: mkdir d6/d26/d40/d4f/d72 0 2024-04-26T21:25:56.919 INFO:tasks.workunit.client.1.smithi120.stdout:5/636: chown d2/d82/d96/db3/cc1 69 1 2024-04-26T21:25:56.921 INFO:tasks.workunit.client.1.smithi120.stdout:4/543: getdents d10/d65/d72 0 2024-04-26T21:25:56.922 INFO:tasks.workunit.client.0.smithi084.stdout:0/357: dread de/d71/f57 [0,4194304] 0 2024-04-26T21:25:56.924 INFO:tasks.workunit.client.1.smithi120.stdout:1/514: symlink d6/d7/d1d/d2c/lac 0 2024-04-26T21:25:56.926 INFO:tasks.workunit.client.1.smithi120.stdout:4/544: truncate d10/d6b/fbb 2461457 0 2024-04-26T21:25:56.926 INFO:tasks.workunit.client.1.smithi120.stdout:2/589: creat d4/d1b/d56/d65/d8d/d96/fc1 x:0 0 0 2024-04-26T21:25:56.927 INFO:tasks.workunit.client.0.smithi084.stdout:5/337: truncate d0/d17/f20 4427318 0 2024-04-26T21:25:56.928 INFO:tasks.workunit.client.1.smithi120.stdout:2/590: chown d4/f34 7329 1 2024-04-26T21:25:56.928 INFO:tasks.workunit.client.0.smithi084.stdout:0/358: dread - de/d1c/d32/f44 zero size 2024-04-26T21:25:56.928 INFO:tasks.workunit.client.0.smithi084.stdout:8/373: dwrite d4/d7/d15/d37/d52/f67 [0,4194304] 0 2024-04-26T21:25:56.929 INFO:tasks.workunit.client.1.smithi120.stdout:7/552: getdents d7/d64/da6/d1f/d28/d4c 0 2024-04-26T21:25:56.933 INFO:tasks.workunit.client.1.smithi120.stdout:6/587: truncate d4/d3d/f83 3974603 0 2024-04-26T21:25:56.934 INFO:tasks.workunit.client.0.smithi084.stdout:0/359: chown de/d1c/c5f 1283997 1 2024-04-26T21:25:56.936 INFO:tasks.workunit.client.0.smithi084.stdout:7/359: rename d6/dc/c67 to d6/dc/c73 0 2024-04-26T21:25:56.936 INFO:tasks.workunit.client.1.smithi120.stdout:7/553: read d7/fe [859021,12003] 0 2024-04-26T21:25:56.939 INFO:tasks.workunit.client.0.smithi084.stdout:4/277: write d5/d10/f18 [904460,61464] 0 2024-04-26T21:25:56.939 INFO:tasks.workunit.client.0.smithi084.stdout:3/369: dwrite d1/d2c/d2f/d31/d3b/f7a [0,4194304] 0 2024-04-26T21:25:56.940 INFO:tasks.workunit.client.1.smithi120.stdout:5/637: fdatasync d2/dc/d1d/d1f/d36/d44/d6c/f2a 0 2024-04-26T21:25:56.941 INFO:tasks.workunit.client.0.smithi084.stdout:0/360: creat de/d20/d4e/f75 x:0 0 0 2024-04-26T21:25:56.941 INFO:tasks.workunit.client.1.smithi120.stdout:1/515: mkdir d6/d7/d2d/d98/d56/dad 0 2024-04-26T21:25:56.942 INFO:tasks.workunit.client.0.smithi084.stdout:8/374: chown d4/d6/db/c34 0 1 2024-04-26T21:25:56.942 INFO:tasks.workunit.client.0.smithi084.stdout:7/360: mknod d6/d26/c74 0 2024-04-26T21:25:56.944 INFO:tasks.workunit.client.0.smithi084.stdout:5/338: mknod d0/c6a 0 2024-04-26T21:25:56.945 INFO:tasks.workunit.client.1.smithi120.stdout:5/638: chown d2/f3d 26705 1 2024-04-26T21:25:56.945 INFO:tasks.workunit.client.0.smithi084.stdout:6/393: dwrite d3/d18/f2b [0,4194304] 0 2024-04-26T21:25:56.948 INFO:tasks.workunit.client.0.smithi084.stdout:5/339: dread - d0/f4b zero size 2024-04-26T21:25:56.948 INFO:tasks.workunit.client.0.smithi084.stdout:3/370: read d1/d2c/d2f/f18 [499206,48040] 0 2024-04-26T21:25:56.952 INFO:tasks.workunit.client.1.smithi120.stdout:8/516: creat d5/d6/d75/d95/fa8 x:0 0 0 2024-04-26T21:25:56.953 INFO:tasks.workunit.client.0.smithi084.stdout:6/394: readlink d3/de/d15/l7b 0 2024-04-26T21:25:56.953 INFO:tasks.workunit.client.0.smithi084.stdout:7/361: creat d6/d68/f75 x:0 0 0 2024-04-26T21:25:56.953 INFO:tasks.workunit.client.0.smithi084.stdout:8/375: rmdir d4/d6/db/d1e/d22/d39 39 2024-04-26T21:25:56.953 INFO:tasks.workunit.client.0.smithi084.stdout:0/361: write de/d2b/f3a [682158,106827] 0 2024-04-26T21:25:56.955 INFO:tasks.workunit.client.0.smithi084.stdout:1/392: dwrite d2/d54/d5e/d66/d2a/d2c/f34 [4194304,4194304] 0 2024-04-26T21:25:56.955 INFO:tasks.workunit.client.1.smithi120.stdout:1/516: dread d6/d7/d1b/f8a [0,4194304] 0 2024-04-26T21:25:56.956 INFO:tasks.workunit.client.0.smithi084.stdout:3/371: stat d1/d2c/d2f/d31/d3b 0 2024-04-26T21:25:56.956 INFO:tasks.workunit.client.1.smithi120.stdout:4/545: dwrite d10/f2d [0,4194304] 0 2024-04-26T21:25:56.957 INFO:tasks.workunit.client.1.smithi120.stdout:8/517: chown d5/d6/d11/c2b 12398409 1 2024-04-26T21:25:56.957 INFO:tasks.workunit.client.1.smithi120.stdout:2/591: dwrite d4/d1b/d56/d65/d8d/f9d [0,4194304] 0 2024-04-26T21:25:56.958 INFO:tasks.workunit.client.0.smithi084.stdout:3/372: stat d1/fd 0 2024-04-26T21:25:56.958 INFO:tasks.workunit.client.0.smithi084.stdout:8/376: write d4/d7/d53/f57 [4396325,105521] 0 2024-04-26T21:25:56.959 INFO:tasks.workunit.client.1.smithi120.stdout:3/563: sync 2024-04-26T21:25:56.961 INFO:tasks.workunit.client.0.smithi084.stdout:3/373: read d1/d2c/d2f/f18 [6436416,99802] 0 2024-04-26T21:25:56.961 INFO:tasks.workunit.client.0.smithi084.stdout:1/393: fsync d2/d54/d5e/d66/f2b 0 2024-04-26T21:25:56.964 INFO:tasks.workunit.client.0.smithi084.stdout:2/468: dread d6/d7/d3d/d15/d1f/d22/d99/f9d [0,4194304] 0 2024-04-26T21:25:56.964 INFO:tasks.workunit.client.0.smithi084.stdout:8/377: dread d4/d6/f40 [0,4194304] 0 2024-04-26T21:25:56.965 INFO:tasks.workunit.client.0.smithi084.stdout:1/394: write d2/d19/f40 [642867,123226] 0 2024-04-26T21:25:56.966 INFO:tasks.workunit.client.1.smithi120.stdout:4/546: readlink d10/d6b/l81 0 2024-04-26T21:25:56.968 INFO:tasks.workunit.client.0.smithi084.stdout:5/340: unlink d0/dc/df/d2a/c2e 0 2024-04-26T21:25:56.968 INFO:tasks.workunit.client.0.smithi084.stdout:8/378: dread - d4/d7/d15/d37/f68 zero size 2024-04-26T21:25:56.970 INFO:tasks.workunit.client.1.smithi120.stdout:0/659: link d0/d3/f41 d0/d3/dc/dd/d1b/d24/fdd 0 2024-04-26T21:25:56.971 INFO:tasks.workunit.client.0.smithi084.stdout:7/362: rename d6/d9/d12/f3e to d6/dc/f76 0 2024-04-26T21:25:56.972 INFO:tasks.workunit.client.1.smithi120.stdout:5/639: mkdir d2/dc/d1d/d21/d66/de5 0 2024-04-26T21:25:56.973 INFO:tasks.workunit.client.0.smithi084.stdout:7/363: truncate d6/d9/d12/f33 5195934 0 2024-04-26T21:25:56.975 INFO:tasks.workunit.client.0.smithi084.stdout:1/395: creat d2/d54/d5e/d66/d2a/f7c x:0 0 0 2024-04-26T21:25:56.976 INFO:tasks.workunit.client.1.smithi120.stdout:0/660: write d0/d3/dc/d12/d4a/f74 [1706882,95089] 0 2024-04-26T21:25:56.978 INFO:tasks.workunit.client.1.smithi120.stdout:1/517: rename d6/d7/d1b/d89/d8c/d62 to d6/daa/dae 0 2024-04-26T21:25:56.980 INFO:tasks.workunit.client.1.smithi120.stdout:0/661: readlink d0/df/la0 0 2024-04-26T21:25:56.982 INFO:tasks.workunit.client.1.smithi120.stdout:4/547: creat d10/d28/d73/fbd x:0 0 0 2024-04-26T21:25:56.983 INFO:tasks.workunit.client.0.smithi084.stdout:5/341: symlink d0/dc/df/d51/l6b 0 2024-04-26T21:25:56.984 INFO:tasks.workunit.client.0.smithi084.stdout:4/278: dread d5/f4c [0,4194304] 0 2024-04-26T21:25:56.985 INFO:tasks.workunit.client.1.smithi120.stdout:8/518: link d5/d6/d11/d52/d27/f6d d5/d6/d34/d42/d9d/d7a/fa9 0 2024-04-26T21:25:56.989 INFO:tasks.workunit.client.0.smithi084.stdout:3/374: link d1/d2c/d2f/d31/d55/f4b d1/d2c/d2f/d31/d55/f7b 0 2024-04-26T21:25:56.990 INFO:tasks.workunit.client.0.smithi084.stdout:3/375: fdatasync d1/d24/d27/f2b 0 2024-04-26T21:25:56.993 INFO:tasks.workunit.client.1.smithi120.stdout:1/518: write d6/d7/d1b/f8a [896248,99341] 0 2024-04-26T21:25:56.996 INFO:tasks.workunit.client.1.smithi120.stdout:9/548: truncate d0/d6/d4d/d65/f94 806870 0 2024-04-26T21:25:56.996 INFO:tasks.workunit.client.1.smithi120.stdout:4/548: mknod d10/d65/d72/cbe 0 2024-04-26T21:25:56.997 INFO:tasks.workunit.client.1.smithi120.stdout:0/662: creat d0/d3/d13/d64/fde x:0 0 0 2024-04-26T21:25:56.999 INFO:tasks.workunit.client.1.smithi120.stdout:9/549: readlink d0/l11 0 2024-04-26T21:25:57.001 INFO:tasks.workunit.client.0.smithi084.stdout:0/362: getdents de/d71 0 2024-04-26T21:25:57.004 INFO:tasks.workunit.client.1.smithi120.stdout:4/549: mkdir d10/d6b/dbf 0 2024-04-26T21:25:57.006 INFO:tasks.workunit.client.1.smithi120.stdout:0/663: rmdir d0/d3/d13 39 2024-04-26T21:25:57.006 INFO:tasks.workunit.client.0.smithi084.stdout:7/364: rename d6/d26/d40/d41/c6f to d6/d9/d63/c77 0 2024-04-26T21:25:57.007 INFO:tasks.workunit.client.1.smithi120.stdout:9/550: creat d0/dd/d3a/d5c/d9f/fb3 x:0 0 0 2024-04-26T21:25:57.008 INFO:tasks.workunit.client.0.smithi084.stdout:3/376: mkdir d1/d2c/d2f/d31/d55/d4e/d7c 0 2024-04-26T21:25:57.012 INFO:tasks.workunit.client.0.smithi084.stdout:1/396: creat d2/d54/d5e/d66/d2a/d2c/d75/f7d x:0 0 0 2024-04-26T21:25:57.013 INFO:tasks.workunit.client.1.smithi120.stdout:4/550: rmdir d10/d28/d73 39 2024-04-26T21:25:57.013 INFO:tasks.workunit.client.1.smithi120.stdout:3/564: write dd/de/d83/f3f [592281,16470] 0 2024-04-26T21:25:57.017 INFO:tasks.workunit.client.0.smithi084.stdout:0/363: dread de/d1c/f1d [0,4194304] 0 2024-04-26T21:25:57.017 INFO:tasks.workunit.client.1.smithi120.stdout:9/551: rmdir d0/dd/d34/d8a/d9b 39 2024-04-26T21:25:57.018 INFO:tasks.workunit.client.0.smithi084.stdout:4/279: dwrite d5/d10/d15/d21/d29/d3f/f4f [0,4194304] 0 2024-04-26T21:25:57.021 INFO:tasks.workunit.client.1.smithi120.stdout:8/519: dread d5/d6/d34/d42/f84 [0,4194304] 0 2024-04-26T21:25:57.022 INFO:tasks.workunit.client.1.smithi120.stdout:6/588: dread d4/db/d10/dd/d4e/f75 [0,4194304] 0 2024-04-26T21:25:57.024 INFO:tasks.workunit.client.0.smithi084.stdout:4/280: read d5/d25/f47 [330705,123614] 0 2024-04-26T21:25:57.025 INFO:tasks.workunit.client.1.smithi120.stdout:9/552: write d0/d6/f76 [1130954,120837] 0 2024-04-26T21:25:57.028 INFO:tasks.workunit.client.0.smithi084.stdout:7/365: rename d6/d9/d12/f33 to d6/d68/f78 0 2024-04-26T21:25:57.030 INFO:tasks.workunit.client.1.smithi120.stdout:3/565: creat dd/de/d18/d24/db1/d76/fb4 x:0 0 0 2024-04-26T21:25:57.031 INFO:tasks.workunit.client.0.smithi084.stdout:7/366: fdatasync d6/d9/d12/d19/f70 0 2024-04-26T21:25:57.034 INFO:tasks.workunit.client.0.smithi084.stdout:7/367: read d6/f4b [1969999,16746] 0 2024-04-26T21:25:57.036 INFO:tasks.workunit.client.0.smithi084.stdout:3/377: write d1/d2c/f67 [1312010,129310] 0 2024-04-26T21:25:57.037 INFO:tasks.workunit.client.1.smithi120.stdout:6/589: write d4/db/d10/f44 [679943,9077] 0 2024-04-26T21:25:57.038 INFO:tasks.workunit.client.0.smithi084.stdout:1/397: chown d2/d9/l59 14113 1 2024-04-26T21:25:57.038 INFO:tasks.workunit.client.1.smithi120.stdout:2/592: dwrite d4/d1b/d2e/d50/d14/d15/f2d [0,4194304] 0 2024-04-26T21:25:57.039 INFO:tasks.workunit.client.1.smithi120.stdout:8/520: write d5/d6/d11/d52/d70/f40 [1556322,82391] 0 2024-04-26T21:25:57.041 INFO:tasks.workunit.client.1.smithi120.stdout:3/566: write dd/d40/f92 [5081794,19618] 0 2024-04-26T21:25:57.042 INFO:tasks.workunit.client.0.smithi084.stdout:8/379: getdents d4/d7/d15/d37/d52 0 2024-04-26T21:25:57.042 INFO:tasks.workunit.client.0.smithi084.stdout:4/281: dwrite d5/d10/d15/d21/d29/d3f/f4f [0,4194304] 0 2024-04-26T21:25:57.043 INFO:tasks.workunit.client.1.smithi120.stdout:7/554: dread d7/d64/da6/d1f/f36 [0,4194304] 0 2024-04-26T21:25:57.044 INFO:tasks.workunit.client.0.smithi084.stdout:0/364: mknod de/d20/c76 0 2024-04-26T21:25:57.047 INFO:tasks.workunit.client.1.smithi120.stdout:5/640: dread d2/dc/d1d/d21/d66/f41 [0,4194304] 0 2024-04-26T21:25:57.050 INFO:tasks.workunit.client.0.smithi084.stdout:5/342: link d0/dc/df/d51/l5f d0/dc/l6c 0 2024-04-26T21:25:57.052 INFO:tasks.workunit.client.1.smithi120.stdout:2/593: dread - d4/d1b/d2e/d50/d14/d15/f9b zero size 2024-04-26T21:25:57.053 INFO:tasks.workunit.client.0.smithi084.stdout:5/343: chown d0/dc/df/d31/l3f 1 1 2024-04-26T21:25:57.057 INFO:tasks.workunit.client.1.smithi120.stdout:1/519: dwrite d6/d7/d2d/d98/d54/f7a [0,4194304] 0 2024-04-26T21:25:57.058 INFO:tasks.workunit.client.0.smithi084.stdout:3/378: dread d1/d2c/d2f/f18 [0,4194304] 0 2024-04-26T21:25:57.060 INFO:tasks.workunit.client.0.smithi084.stdout:2/469: dwrite d6/d7/d3d/d15/d1f/d39/d20/f35 [0,4194304] 0 2024-04-26T21:25:57.060 INFO:tasks.workunit.client.1.smithi120.stdout:0/664: dread d0/d3/d13/f60 [0,4194304] 0 2024-04-26T21:25:57.062 INFO:tasks.workunit.client.0.smithi084.stdout:7/368: write d6/d9/d12/d19/f3c [1759342,106937] 0 2024-04-26T21:25:57.064 INFO:tasks.workunit.client.1.smithi120.stdout:4/551: dwrite d10/f4f [0,4194304] 0 2024-04-26T21:25:57.065 INFO:tasks.workunit.client.1.smithi120.stdout:3/567: unlink dd/de/df/d12/c2b 0 2024-04-26T21:25:57.068 INFO:tasks.workunit.client.1.smithi120.stdout:3/568: read - dd/de/d18/d24/db1/fac zero size 2024-04-26T21:25:57.070 INFO:tasks.workunit.client.1.smithi120.stdout:2/594: mkdir d4/d1b/d2e/d50/d14/dc2 0 2024-04-26T21:25:57.077 INFO:tasks.workunit.client.1.smithi120.stdout:4/552: symlink d10/d65/lc0 0 2024-04-26T21:25:57.077 INFO:tasks.workunit.client.1.smithi120.stdout:5/641: symlink d2/dc/d1d/d21/d77/d79/db7/le6 0 2024-04-26T21:25:57.077 INFO:tasks.workunit.client.1.smithi120.stdout:0/665: stat d0/d3/dc/dd/d1b/fa1 0 2024-04-26T21:25:57.078 INFO:tasks.workunit.client.1.smithi120.stdout:1/520: readlink d6/d7/d2d/d48/l7d 0 2024-04-26T21:25:57.080 INFO:tasks.workunit.client.1.smithi120.stdout:8/521: write d5/d6/d34/d42/f49 [2228130,124343] 0 2024-04-26T21:25:57.082 INFO:tasks.workunit.client.0.smithi084.stdout:2/470: mkdir d6/d7/d3d/d15/d1f/d39/d20/d36/da4 0 2024-04-26T21:25:57.091 INFO:tasks.workunit.client.0.smithi084.stdout:5/344: dwrite d0/f22 [4194304,4194304] 0 2024-04-26T21:25:57.092 INFO:tasks.workunit.client.1.smithi120.stdout:7/555: dwrite d7/d64/da6/f7a [4194304,4194304] 0 2024-04-26T21:25:57.094 INFO:tasks.workunit.client.1.smithi120.stdout:3/569: rename dd/d2a/d4a/f79 to dd/de/d18/d24/db1/d76/d3b/d56/fb5 0 2024-04-26T21:25:57.095 INFO:tasks.workunit.client.0.smithi084.stdout:0/365: rename de/d1c to de/d2b/d77 0 2024-04-26T21:25:57.096 INFO:tasks.workunit.client.0.smithi084.stdout:8/380: getdents d4/d6/db/d1e/d22 0 2024-04-26T21:25:57.098 INFO:tasks.workunit.client.0.smithi084.stdout:2/471: mkdir d6/d7/d3d/d15/d1f/d39/da5 0 2024-04-26T21:25:57.099 INFO:tasks.workunit.client.1.smithi120.stdout:0/666: mknod d0/d3/dc/d12/dae/cdf 0 2024-04-26T21:25:57.100 INFO:tasks.workunit.client.1.smithi120.stdout:8/522: symlink d5/d6/d11/d52/d27/laa 0 2024-04-26T21:25:57.101 INFO:tasks.workunit.client.0.smithi084.stdout:7/369: dwrite d6/dc/f76 [0,4194304] 0 2024-04-26T21:25:57.105 INFO:tasks.workunit.client.1.smithi120.stdout:5/642: getdents d2/d1b/d89/d47 0 2024-04-26T21:25:57.109 INFO:tasks.workunit.client.0.smithi084.stdout:2/472: fdatasync d6/d7/d3d/d15/d1f/d22/d99/f9d 0 2024-04-26T21:25:57.113 INFO:tasks.workunit.client.1.smithi120.stdout:5/643: readlink d2/l11 0 2024-04-26T21:25:57.117 INFO:tasks.workunit.client.1.smithi120.stdout:9/553: dread d0/dd/d3a/f58 [0,4194304] 0 2024-04-26T21:25:57.117 INFO:tasks.workunit.client.0.smithi084.stdout:2/473: write d6/d1b/f98 [687025,110511] 0 2024-04-26T21:25:57.119 INFO:tasks.workunit.client.0.smithi084.stdout:3/379: dread d1/fd [0,4194304] 0 2024-04-26T21:25:57.119 INFO:tasks.workunit.client.0.smithi084.stdout:7/370: dread d6/dc/f76 [0,4194304] 0 2024-04-26T21:25:57.122 INFO:tasks.workunit.client.1.smithi120.stdout:9/554: dread - d0/d14/d2d/f91 zero size 2024-04-26T21:25:57.123 INFO:tasks.workunit.client.1.smithi120.stdout:2/595: dwrite d4/d1b/d25/d2c/d3e/f9a [0,4194304] 0 2024-04-26T21:25:57.125 INFO:tasks.workunit.client.1.smithi120.stdout:6/590: dwrite d4/db/d10/d1a/d2b/d57/d67/f2e [0,4194304] 0 2024-04-26T21:25:57.125 INFO:tasks.workunit.client.1.smithi120.stdout:1/521: dwrite d6/d14/f16 [0,4194304] 0 2024-04-26T21:25:57.126 INFO:tasks.workunit.client.0.smithi084.stdout:7/371: creat d6/d9/d12/d19/f79 x:0 0 0 2024-04-26T21:25:57.129 INFO:tasks.workunit.client.0.smithi084.stdout:1/398: truncate d2/d19/f4c 994581 0 2024-04-26T21:25:57.133 INFO:tasks.workunit.client.0.smithi084.stdout:7/372: mkdir d6/d9/d12/d19/d7a 0 2024-04-26T21:25:57.137 INFO:tasks.workunit.client.0.smithi084.stdout:7/373: readlink d6/l1f 0 2024-04-26T21:25:57.138 INFO:tasks.workunit.client.1.smithi120.stdout:4/553: dwrite d10/d12/f35 [0,4194304] 0 2024-04-26T21:25:57.138 INFO:tasks.workunit.client.1.smithi120.stdout:3/570: rename dd/d2a/d4a to dd/de/df/db6 0 2024-04-26T21:25:57.143 INFO:tasks.workunit.client.0.smithi084.stdout:2/474: dwrite d6/d7/d3d/d15/d1f/d39/d20/d45/d6d/f95 [0,4194304] 0 2024-04-26T21:25:57.148 INFO:tasks.workunit.client.0.smithi084.stdout:3/380: dwrite d1/d2c/d2f/f6d [0,4194304] 0 2024-04-26T21:25:57.151 INFO:tasks.workunit.client.0.smithi084.stdout:7/374: creat d6/d9/d63/f7b x:0 0 0 2024-04-26T21:25:57.153 INFO:tasks.workunit.client.1.smithi120.stdout:2/596: rename d4/d1b/d56/f5a to d4/d1b/d4f/d95/fc3 0 2024-04-26T21:25:57.155 INFO:tasks.workunit.client.1.smithi120.stdout:6/591: symlink d4/db/d10/d22/d56/d94/lc7 0 2024-04-26T21:25:57.157 INFO:tasks.workunit.client.0.smithi084.stdout:4/282: write d5/f23 [1150396,92049] 0 2024-04-26T21:25:57.159 INFO:tasks.workunit.client.0.smithi084.stdout:2/475: creat d6/d7/d3d/d15/d1f/d39/fa6 x:0 0 0 2024-04-26T21:25:57.160 INFO:tasks.workunit.client.1.smithi120.stdout:1/522: rename d6/d7/d1d/d2c/f7c to d6/d7/d1d/d2c/d58/faf 0 2024-04-26T21:25:57.161 INFO:tasks.workunit.client.0.smithi084.stdout:2/476: write d6/f14 [5048427,23388] 0 2024-04-26T21:25:57.163 INFO:tasks.workunit.client.0.smithi084.stdout:5/345: fsync d0/f22 0 2024-04-26T21:25:57.165 INFO:tasks.workunit.client.1.smithi120.stdout:3/571: truncate dd/de/d83/f81 1171189 0 2024-04-26T21:25:57.165 INFO:tasks.workunit.client.1.smithi120.stdout:9/555: read d0/d6/f36 [162596,67654] 0 2024-04-26T21:25:57.166 INFO:tasks.workunit.client.0.smithi084.stdout:4/283: creat d5/d25/d35/f5e x:0 0 0 2024-04-26T21:25:57.169 INFO:tasks.workunit.client.0.smithi084.stdout:1/399: dwrite d2/d54/d5e/d66/d3a/d48/f50 [0,4194304] 0 2024-04-26T21:25:57.171 INFO:tasks.workunit.client.0.smithi084.stdout:4/284: write d5/f2b [406635,92801] 0 2024-04-26T21:25:57.172 INFO:tasks.workunit.client.1.smithi120.stdout:4/554: dwrite d10/f6a [0,4194304] 0 2024-04-26T21:25:57.173 INFO:tasks.workunit.client.1.smithi120.stdout:6/592: chown d4/db/d10/d1a/d2b/l49 714221361 1 2024-04-26T21:25:57.174 INFO:tasks.workunit.client.0.smithi084.stdout:9/330: sync 2024-04-26T21:25:57.174 INFO:tasks.workunit.client.1.smithi120.stdout:1/523: chown d6/d7/f59 180 1 2024-04-26T21:25:57.175 INFO:tasks.workunit.client.1.smithi120.stdout:7/556: dwrite d7/d19/d60/f76 [0,4194304] 0 2024-04-26T21:25:57.175 INFO:tasks.workunit.client.1.smithi120.stdout:8/523: write d5/d6/d11/d52/d27/f38 [5191666,79108] 0 2024-04-26T21:25:57.175 INFO:tasks.workunit.client.0.smithi084.stdout:6/395: sync 2024-04-26T21:25:57.178 INFO:tasks.workunit.client.0.smithi084.stdout:1/400: rmdir d2/d9/d15/d28 39 2024-04-26T21:25:57.179 INFO:tasks.workunit.client.1.smithi120.stdout:5/644: dwrite d2/d30/d3b/f94 [0,4194304] 0 2024-04-26T21:25:57.182 INFO:tasks.workunit.client.0.smithi084.stdout:4/285: fdatasync d5/d7/d17/f27 0 2024-04-26T21:25:57.183 INFO:tasks.workunit.client.0.smithi084.stdout:9/331: chown da/de/c32 1603587 1 2024-04-26T21:25:57.183 INFO:tasks.workunit.client.0.smithi084.stdout:5/346: getdents d0/dc/df/d31 0 2024-04-26T21:25:57.184 INFO:tasks.workunit.client.0.smithi084.stdout:3/381: dwrite d1/d2c/d2f/d31/d3b/f6c [0,4194304] 0 2024-04-26T21:25:57.185 INFO:tasks.workunit.client.0.smithi084.stdout:1/401: unlink d2/d54/d5e/d66/c3f 0 2024-04-26T21:25:57.185 INFO:tasks.workunit.client.1.smithi120.stdout:8/524: rmdir d5/d6/d11 39 2024-04-26T21:25:57.185 INFO:tasks.workunit.client.1.smithi120.stdout:3/572: fdatasync dd/de/d83/d64/fa4 0 2024-04-26T21:25:57.186 INFO:tasks.workunit.client.1.smithi120.stdout:4/555: dread - d10/d12/fa7 zero size 2024-04-26T21:25:57.193 INFO:tasks.workunit.client.1.smithi120.stdout:8/525: chown d5/d6/d34/d37 556 1 2024-04-26T21:25:57.193 INFO:tasks.workunit.client.1.smithi120.stdout:1/524: chown d6/d7/d1d/d5d/d67/l29 30 1 2024-04-26T21:25:57.194 INFO:tasks.workunit.client.1.smithi120.stdout:0/667: dwrite d0/d3/dc/dd/d1b/d39/f3e [0,4194304] 0 2024-04-26T21:25:57.195 INFO:tasks.workunit.client.1.smithi120.stdout:7/557: mknod d7/d19/d60/cc0 0 2024-04-26T21:25:57.199 INFO:tasks.workunit.client.0.smithi084.stdout:9/332: mknod da/de/d16/d40/c7b 0 2024-04-26T21:25:57.199 INFO:tasks.workunit.client.0.smithi084.stdout:2/477: link d6/d7/d3d/f54 d6/d7/d3d/d79/d81/d82/fa7 0 2024-04-26T21:25:57.201 INFO:tasks.workunit.client.1.smithi120.stdout:5/645: creat d2/d82/d96/db3/fe7 x:0 0 0 2024-04-26T21:25:57.204 INFO:tasks.workunit.client.0.smithi084.stdout:3/382: creat d1/d2c/d2f/f7d x:0 0 0 2024-04-26T21:25:57.205 INFO:tasks.workunit.client.0.smithi084.stdout:9/333: fdatasync da/de/d16/d25/d41/f76 0 2024-04-26T21:25:57.206 INFO:tasks.workunit.client.1.smithi120.stdout:8/526: creat d5/d6/d34/d37/fab x:0 0 0 2024-04-26T21:25:57.207 INFO:tasks.workunit.client.0.smithi084.stdout:5/347: mkdir d0/dc/df/d6d 0 2024-04-26T21:25:57.210 INFO:tasks.workunit.client.0.smithi084.stdout:4/286: rename d5/d7/d17 to d5/d2e/d5f 0 2024-04-26T21:25:57.211 INFO:tasks.workunit.client.1.smithi120.stdout:3/573: rename dd/fa2 to dd/de/d18/d24/db1/fb7 0 2024-04-26T21:25:57.212 INFO:tasks.workunit.client.1.smithi120.stdout:0/668: creat d0/d3/dc/dd/d80/fe0 x:0 0 0 2024-04-26T21:25:57.212 INFO:tasks.workunit.client.0.smithi084.stdout:2/478: mkdir d6/d7/d3d/d79/d81/d82/da8 0 2024-04-26T21:25:57.213 INFO:tasks.workunit.client.0.smithi084.stdout:4/287: write d5/d2e/d5f/f27 [1288580,129569] 0 2024-04-26T21:25:57.215 INFO:tasks.workunit.client.0.smithi084.stdout:9/334: mkdir da/de/d16/d25/d7c 0 2024-04-26T21:25:57.218 INFO:tasks.workunit.client.0.smithi084.stdout:3/383: mkdir d1/d2c/d2f/d31/d55/d4e/d7c/d7e 0 2024-04-26T21:25:57.219 INFO:tasks.workunit.client.0.smithi084.stdout:1/402: dread d2/d54/d5e/d66/d2a/d2c/d45/f68 [0,4194304] 0 2024-04-26T21:25:57.220 INFO:tasks.workunit.client.1.smithi120.stdout:9/556: dwrite d0/d6/d3d/f4e [4194304,4194304] 0 2024-04-26T21:25:57.220 INFO:tasks.workunit.client.1.smithi120.stdout:5/646: creat d2/d82/d96/fe8 x:0 0 0 2024-04-26T21:25:57.222 INFO:tasks.workunit.client.0.smithi084.stdout:1/403: fdatasync d2/d19/f1e 0 2024-04-26T21:25:57.223 INFO:tasks.workunit.client.0.smithi084.stdout:4/288: unlink d5/d10/d15/d21/d29/d3f/f48 0 2024-04-26T21:25:57.226 INFO:tasks.workunit.client.0.smithi084.stdout:3/384: mknod d1/d2c/c7f 0 2024-04-26T21:25:57.227 INFO:tasks.workunit.client.0.smithi084.stdout:9/335: symlink da/de/d16/d25/d41/d43/d48/l7d 0 2024-04-26T21:25:57.228 INFO:tasks.workunit.client.1.smithi120.stdout:8/527: symlink d5/lac 0 2024-04-26T21:25:57.229 INFO:tasks.workunit.client.0.smithi084.stdout:9/336: write da/de/d16/d25/f4e [575893,13233] 0 2024-04-26T21:25:57.229 INFO:tasks.workunit.client.1.smithi120.stdout:6/593: dwrite d4/db/f5a [0,4194304] 0 2024-04-26T21:25:57.233 INFO:tasks.workunit.client.0.smithi084.stdout:0/366: getdents de 0 2024-04-26T21:25:57.236 INFO:tasks.workunit.client.1.smithi120.stdout:3/574: mknod dd/de/d83/db2/cb8 0 2024-04-26T21:25:57.236 INFO:tasks.workunit.client.0.smithi084.stdout:2/479: rename d6/d7/d3d/d15/d1f/d22/c28 to d6/d7/d3d/d79/d81/d82/da8/ca9 0 2024-04-26T21:25:57.246 INFO:tasks.workunit.client.0.smithi084.stdout:6/396: dread d3/de/d1a/d43/f2d [0,4194304] 0 2024-04-26T21:25:57.246 INFO:tasks.workunit.client.1.smithi120.stdout:3/575: write dd/d2a/d74/f9f [231519,109534] 0 2024-04-26T21:25:57.249 INFO:tasks.workunit.client.0.smithi084.stdout:0/367: mkdir de/d78 0 2024-04-26T21:25:57.250 INFO:tasks.workunit.client.1.smithi120.stdout:3/576: readlink dd/de/d18/d24/db1/d76/d3b/l8e 0 2024-04-26T21:25:57.250 INFO:tasks.workunit.client.1.smithi120.stdout:7/558: write f3 [497098,109332] 0 2024-04-26T21:25:57.253 INFO:tasks.workunit.client.0.smithi084.stdout:9/337: rename da/de/f12 to da/de/d16/d25/d41/f7e 0 2024-04-26T21:25:57.254 INFO:tasks.workunit.client.1.smithi120.stdout:5/647: creat d2/dc/d1d/d21/d77/d9c/fe9 x:0 0 0 2024-04-26T21:25:57.258 INFO:tasks.workunit.client.0.smithi084.stdout:8/381: dwrite d4/d7/d15/d37/d3b/f3e [0,4194304] 0 2024-04-26T21:25:57.262 INFO:tasks.workunit.client.0.smithi084.stdout:4/289: dwrite d5/f1a [0,4194304] 0 2024-04-26T21:25:57.262 INFO:tasks.workunit.client.0.smithi084.stdout:2/480: dread d6/d7/d3d/d15/f55 [0,4194304] 0 2024-04-26T21:25:57.263 INFO:tasks.workunit.client.1.smithi120.stdout:7/559: symlink d7/d64/da6/d1a/d50/lc1 0 2024-04-26T21:25:57.267 INFO:tasks.workunit.client.0.smithi084.stdout:3/385: symlink d1/d2c/d2f/d31/l80 0 2024-04-26T21:25:57.269 INFO:tasks.workunit.client.0.smithi084.stdout:3/386: readlink d1/d2c/d2f/d31/d52/l75 0 2024-04-26T21:25:57.269 INFO:tasks.workunit.client.1.smithi120.stdout:4/556: dwrite d10/d12/f5c [0,4194304] 0 2024-04-26T21:25:57.270 INFO:tasks.workunit.client.0.smithi084.stdout:6/397: dwrite d3/de/d15/d23/f4d [4194304,4194304] 0 2024-04-26T21:25:57.270 INFO:tasks.workunit.client.0.smithi084.stdout:9/338: symlink da/de/d16/l7f 0 2024-04-26T21:25:57.270 INFO:tasks.workunit.client.1.smithi120.stdout:3/577: symlink dd/de/d18/lb9 0 2024-04-26T21:25:57.273 INFO:tasks.workunit.client.0.smithi084.stdout:6/398: chown d3/de/d1a/d43/c80 130482360 1 2024-04-26T21:25:57.273 INFO:tasks.workunit.client.0.smithi084.stdout:4/290: mkdir d5/d25/d35/d60 0 2024-04-26T21:25:57.273 INFO:tasks.workunit.client.0.smithi084.stdout:9/339: write da/de/d16/d25/f52 [3767601,49473] 0 2024-04-26T21:25:57.278 INFO:tasks.workunit.client.0.smithi084.stdout:2/481: symlink d6/d7/d3d/d15/d1f/d39/d20/laa 0 2024-04-26T21:25:57.281 INFO:tasks.workunit.client.0.smithi084.stdout:3/387: write d1/d24/d27/f30 [2761179,7602] 0 2024-04-26T21:25:57.281 INFO:tasks.workunit.client.0.smithi084.stdout:2/482: chown d6/d7/d3d/d15/d1f/d39/d20/f50 1789 1 2024-04-26T21:25:57.282 INFO:tasks.workunit.client.1.smithi120.stdout:5/648: mkdir d2/dc/d1d/d1f/d36/d44/dea 0 2024-04-26T21:25:57.283 INFO:tasks.workunit.client.1.smithi120.stdout:6/594: dwrite d4/db/d10/dd/d4e/f5f [0,4194304] 0 2024-04-26T21:25:57.284 INFO:tasks.workunit.client.0.smithi084.stdout:5/348: dread d0/d17/f20 [0,4194304] 0 2024-04-26T21:25:57.285 INFO:tasks.workunit.client.0.smithi084.stdout:8/382: creat d4/d7/d15/f70 x:0 0 0 2024-04-26T21:25:57.289 INFO:tasks.workunit.client.0.smithi084.stdout:0/368: link f4 de/d2b/d77/d32/f79 0 2024-04-26T21:25:57.290 INFO:tasks.workunit.client.0.smithi084.stdout:3/388: mkdir d1/d24/d27/d3a/d81 0 2024-04-26T21:25:57.292 INFO:tasks.workunit.client.1.smithi120.stdout:7/560: chown d7/d64/da6/d1a/d33/c58 1765 1 2024-04-26T21:25:57.292 INFO:tasks.workunit.client.1.smithi120.stdout:6/595: fsync d4/db/f35 0 2024-04-26T21:25:57.292 INFO:tasks.workunit.client.1.smithi120.stdout:7/561: read - d7/d64/fae zero size 2024-04-26T21:25:57.296 INFO:tasks.workunit.client.1.smithi120.stdout:0/669: dwrite d0/d3/dc/dd/f7b [4194304,4194304] 0 2024-04-26T21:25:57.297 INFO:tasks.workunit.client.0.smithi084.stdout:9/340: mkdir da/de/d16/d25/d41/d43/d80 0 2024-04-26T21:25:57.298 INFO:tasks.workunit.client.0.smithi084.stdout:8/383: rename d4/d6/db/d1e/d22/d2f/fd to d4/d3a/f71 0 2024-04-26T21:25:57.300 INFO:tasks.workunit.client.1.smithi120.stdout:5/649: mkdir d2/d1b/dd2/deb 0 2024-04-26T21:25:57.302 INFO:tasks.workunit.client.0.smithi084.stdout:3/389: creat d1/d2c/d2f/d31/d55/f82 x:0 0 0 2024-04-26T21:25:57.304 INFO:tasks.workunit.client.1.smithi120.stdout:8/528: link d5/d6/d11/d32/d3b/f98 d5/d6/d11/d52/d27/d4f/d67/fad 0 2024-04-26T21:25:57.306 INFO:tasks.workunit.client.1.smithi120.stdout:9/557: dwrite d0/dd/d34/fa7 [0,4194304] 0 2024-04-26T21:25:57.311 INFO:tasks.workunit.client.1.smithi120.stdout:0/670: readlink d0/d3/dc/d12/d4a/lcf 0 2024-04-26T21:25:57.313 INFO:tasks.workunit.client.1.smithi120.stdout:7/562: mkdir d7/d64/da6/d1a/dc2 0 2024-04-26T21:25:57.313 INFO:tasks.workunit.client.0.smithi084.stdout:6/399: dread d3/de/d1a/d2f/f3c [0,4194304] 0 2024-04-26T21:25:57.313 INFO:tasks.workunit.client.0.smithi084.stdout:5/349: unlink d0/dc/l5c 0 2024-04-26T21:25:57.314 INFO:tasks.workunit.client.1.smithi120.stdout:9/558: rmdir d0/d6/d4d 39 2024-04-26T21:25:57.314 INFO:tasks.workunit.client.1.smithi120.stdout:7/563: readlink d7/l55 0 2024-04-26T21:25:57.315 INFO:tasks.workunit.client.1.smithi120.stdout:8/529: fsync d5/d6/d11/d32/d3b/f6f 0 2024-04-26T21:25:57.316 INFO:tasks.workunit.client.0.smithi084.stdout:3/390: mknod d1/d2c/d2f/d31/d52/c83 0 2024-04-26T21:25:57.318 INFO:tasks.workunit.client.0.smithi084.stdout:8/384: dread d4/f4f [4194304,4194304] 0 2024-04-26T21:25:57.323 INFO:tasks.workunit.client.0.smithi084.stdout:5/350: mkdir d0/dc/df/d31/d63/d6e 0 2024-04-26T21:25:57.325 INFO:tasks.workunit.client.1.smithi120.stdout:4/557: dread d10/f2d [0,4194304] 0 2024-04-26T21:25:57.326 INFO:tasks.workunit.client.0.smithi084.stdout:0/369: rename de/d2b/f3a to de/f7a 0 2024-04-26T21:25:57.327 INFO:tasks.workunit.client.1.smithi120.stdout:5/650: creat d2/dc/d1d/d21/db2/dde/fec x:0 0 0 2024-04-26T21:25:57.327 INFO:tasks.workunit.client.1.smithi120.stdout:0/671: write d0/d3/dc/dd/d1b/d24/d73/fab [2052473,97858] 0 2024-04-26T21:25:57.329 INFO:tasks.workunit.client.0.smithi084.stdout:8/385: read d4/d6/f24 [5764044,122240] 0 2024-04-26T21:25:57.331 INFO:tasks.workunit.client.1.smithi120.stdout:8/530: creat d5/d6/d34/d42/d9d/fae x:0 0 0 2024-04-26T21:25:57.334 INFO:tasks.workunit.client.1.smithi120.stdout:4/558: dread - d10/d28/f5f zero size 2024-04-26T21:25:57.335 INFO:tasks.workunit.client.1.smithi120.stdout:3/578: dwrite dd/de/df/d12/d48/f55 [0,4194304] 0 2024-04-26T21:25:57.337 INFO:tasks.workunit.client.1.smithi120.stdout:0/672: symlink d0/d3/d51/d70/le1 0 2024-04-26T21:25:57.339 INFO:tasks.workunit.client.0.smithi084.stdout:5/351: write d0/d17/f20 [3969464,66444] 0 2024-04-26T21:25:57.341 INFO:tasks.workunit.client.0.smithi084.stdout:6/400: dread d3/de/d15/d23/f35 [0,4194304] 0 2024-04-26T21:25:57.345 INFO:tasks.workunit.client.1.smithi120.stdout:4/559: dread - d10/d28/d73/f8f zero size 2024-04-26T21:25:57.346 INFO:tasks.workunit.client.0.smithi084.stdout:4/291: dread d5/d25/f2f [0,4194304] 0 2024-04-26T21:25:57.350 INFO:tasks.workunit.client.0.smithi084.stdout:3/391: dwrite d1/d2c/d2f/f2e [0,4194304] 0 2024-04-26T21:25:57.350 INFO:tasks.workunit.client.0.smithi084.stdout:8/386: unlink d4/d7/d15/d3c/c49 0 2024-04-26T21:25:57.351 INFO:tasks.workunit.client.1.smithi120.stdout:0/673: rename d0/d3/dc/d12/d31/ld4 to d0/d3/dc/dd/d1b/d24/d73/le2 0 2024-04-26T21:25:57.351 INFO:tasks.workunit.client.1.smithi120.stdout:4/560: write d10/d12/f1d [2565630,81233] 0 2024-04-26T21:25:57.351 INFO:tasks.workunit.client.0.smithi084.stdout:7/375: truncate d6/d9/d12/d19/f49 905512 0 2024-04-26T21:25:57.352 INFO:tasks.workunit.client.1.smithi120.stdout:3/579: fdatasync dd/de/d18/d24/d43/f47 0 2024-04-26T21:25:57.354 INFO:tasks.workunit.client.1.smithi120.stdout:5/651: link d2/d82/d96/fbc d2/d1b/fed 0 2024-04-26T21:25:57.356 INFO:tasks.workunit.client.1.smithi120.stdout:7/564: getdents d7/d64/da6/d1a/d33/d34/d37 0 2024-04-26T21:25:57.358 INFO:tasks.workunit.client.0.smithi084.stdout:6/401: rmdir d3 39 2024-04-26T21:25:57.360 INFO:tasks.workunit.client.1.smithi120.stdout:3/580: write dd/de/df/d12/f21 [2223784,122297] 0 2024-04-26T21:25:57.364 INFO:tasks.workunit.client.1.smithi120.stdout:0/674: creat d0/dd1/dd2/fe3 x:0 0 0 2024-04-26T21:25:57.365 INFO:tasks.workunit.client.1.smithi120.stdout:5/652: mknod d2/dc/d1d/d21/db2/cee 0 2024-04-26T21:25:57.369 INFO:tasks.workunit.client.0.smithi084.stdout:5/352: dwrite d0/dc/df/d2a/d41/f55 [0,4194304] 0 2024-04-26T21:25:57.370 INFO:tasks.workunit.client.1.smithi120.stdout:3/581: fdatasync dd/de/d18/d24/f23 0 2024-04-26T21:25:57.372 INFO:tasks.workunit.client.0.smithi084.stdout:4/292: unlink d5/d7/l38 0 2024-04-26T21:25:57.377 INFO:tasks.workunit.client.1.smithi120.stdout:6/596: dread d4/db/d10/dd/d4e/f72 [0,4194304] 0 2024-04-26T21:25:57.380 INFO:tasks.workunit.client.1.smithi120.stdout:5/653: dread d2/d48/d63/fcb [0,4194304] 0 2024-04-26T21:25:57.381 INFO:tasks.workunit.client.0.smithi084.stdout:8/387: unlink d4/d7/d53/f57 0 2024-04-26T21:25:57.382 INFO:tasks.workunit.client.1.smithi120.stdout:6/597: write d4/db/d10/f44 [1734670,63100] 0 2024-04-26T21:25:57.382 INFO:tasks.workunit.client.1.smithi120.stdout:5/654: chown d2/d82/f91 1010065 1 2024-04-26T21:25:57.386 INFO:tasks.workunit.client.0.smithi084.stdout:8/388: write d4/d7/d15/d37/f68 [409959,35859] 0 2024-04-26T21:25:57.390 INFO:tasks.workunit.client.0.smithi084.stdout:0/370: dread de/d2b/d77/f33 [0,4194304] 0 2024-04-26T21:25:57.390 INFO:tasks.workunit.client.0.smithi084.stdout:8/389: fdatasync d4/d7/d15/d37/d3b/f3e 0 2024-04-26T21:25:57.397 INFO:tasks.workunit.client.1.smithi120.stdout:5/655: creat d2/d48/d63/dbe/fef x:0 0 0 2024-04-26T21:25:57.407 INFO:tasks.workunit.client.1.smithi120.stdout:7/565: write d7/d64/da6/d2f/f63 [1014473,55430] 0 2024-04-26T21:25:57.407 INFO:tasks.workunit.client.1.smithi120.stdout:9/559: dread d0/d14/d2d/d4b/f55 [0,4194304] 0 2024-04-26T21:25:57.411 INFO:tasks.workunit.client.1.smithi120.stdout:4/561: truncate d10/d12/f45 6175151 0 2024-04-26T21:25:57.411 INFO:tasks.workunit.client.1.smithi120.stdout:7/566: chown d7/d64/da6/d1a/d33/c58 524620716 1 2024-04-26T21:25:57.411 INFO:tasks.workunit.client.1.smithi120.stdout:5/656: dread d2/dc/d1d/d21/d77/d79/db7/fab [0,4194304] 0 2024-04-26T21:25:57.412 INFO:tasks.workunit.client.0.smithi084.stdout:0/371: write de/d20/d4e/f75 [57486,126708] 0 2024-04-26T21:25:57.412 INFO:tasks.workunit.client.1.smithi120.stdout:3/582: write dd/de/d18/d24/db1/fb7 [532248,60147] 0 2024-04-26T21:25:57.413 INFO:tasks.workunit.client.0.smithi084.stdout:6/402: dwrite d3/f26 [4194304,4194304] 0 2024-04-26T21:25:57.414 INFO:tasks.workunit.client.1.smithi120.stdout:9/560: unlink d0/d14/l19 0 2024-04-26T21:25:57.414 INFO:tasks.workunit.client.0.smithi084.stdout:6/403: chown d3 6844772 1 2024-04-26T21:25:57.415 INFO:tasks.workunit.client.0.smithi084.stdout:6/404: stat d3/c39 0 2024-04-26T21:25:57.415 INFO:tasks.workunit.client.1.smithi120.stdout:4/562: mknod d10/d65/d8c/cc1 0 2024-04-26T21:25:57.416 INFO:tasks.workunit.client.1.smithi120.stdout:5/657: stat d2/d30/d3b/l9b 0 2024-04-26T21:25:57.417 INFO:tasks.workunit.client.0.smithi084.stdout:6/405: write d3/fc [3461631,56693] 0 2024-04-26T21:25:57.417 INFO:tasks.workunit.client.0.smithi084.stdout:7/376: dread d6/d9/f2d [0,4194304] 0 2024-04-26T21:25:57.418 INFO:tasks.workunit.client.1.smithi120.stdout:0/675: dread d0/d3/dc/d12/d31/f5e [0,4194304] 0 2024-04-26T21:25:57.421 INFO:tasks.workunit.client.1.smithi120.stdout:4/563: fdatasync d10/d28/f4e 0 2024-04-26T21:25:57.422 INFO:tasks.workunit.client.1.smithi120.stdout:9/561: mknod d0/dd/d3a/cb4 0 2024-04-26T21:25:57.424 INFO:tasks.workunit.client.1.smithi120.stdout:8/531: dread d5/d6/d11/d52/d27/f53 [0,4194304] 0 2024-04-26T21:25:57.424 INFO:tasks.workunit.client.1.smithi120.stdout:7/567: creat d7/d64/da6/d1f/d28/d4c/fc3 x:0 0 0 2024-04-26T21:25:57.425 INFO:tasks.workunit.client.1.smithi120.stdout:3/583: chown dd/de/df/d12/d48/f93 5111 1 2024-04-26T21:25:57.429 INFO:tasks.workunit.client.1.smithi120.stdout:9/562: mkdir d0/d66/db5 0 2024-04-26T21:25:57.432 INFO:tasks.workunit.client.1.smithi120.stdout:4/564: creat d10/d65/d72/d86/fc2 x:0 0 0 2024-04-26T21:25:57.435 INFO:tasks.workunit.client.1.smithi120.stdout:1/525: sync 2024-04-26T21:25:57.435 INFO:tasks.workunit.client.1.smithi120.stdout:2/597: sync 2024-04-26T21:25:57.444 INFO:tasks.workunit.client.1.smithi120.stdout:8/532: truncate d5/d6/d34/d37/d60/f5c 57502 0 2024-04-26T21:25:57.447 INFO:tasks.workunit.client.1.smithi120.stdout:0/676: getdents d0/d3/dc/dd/d1b/d24/d73 0 2024-04-26T21:25:57.448 INFO:tasks.workunit.client.1.smithi120.stdout:1/526: dread - d6/d7/d1b/d55/fa1 zero size 2024-04-26T21:25:57.453 INFO:tasks.workunit.client.1.smithi120.stdout:2/598: write d4/d1b/d25/d2c/fa2 [581363,46721] 0 2024-04-26T21:25:57.458 INFO:tasks.workunit.client.1.smithi120.stdout:1/527: mknod d6/d7/d2d/d98/d54/cb0 0 2024-04-26T21:25:57.459 INFO:tasks.workunit.client.1.smithi120.stdout:0/677: creat d0/d3/dc/dd/d9b/fe4 x:0 0 0 2024-04-26T21:25:57.461 INFO:tasks.workunit.client.1.smithi120.stdout:7/568: truncate d7/d19/d60/f76 4137120 0 2024-04-26T21:25:57.461 INFO:tasks.workunit.client.1.smithi120.stdout:1/528: rmdir d6/d7 39 2024-04-26T21:25:57.464 INFO:tasks.workunit.client.0.smithi084.stdout:8/390: dread d4/f5 [0,4194304] 0 2024-04-26T21:25:57.467 INFO:tasks.workunit.client.0.smithi084.stdout:8/391: write d4/f1c [984636,116855] 0 2024-04-26T21:25:57.469 INFO:tasks.workunit.client.0.smithi084.stdout:5/353: truncate d0/d17/f1d 1441268 0 2024-04-26T21:25:57.469 INFO:tasks.workunit.client.1.smithi120.stdout:8/533: write d5/d6/d34/f39 [965143,109720] 0 2024-04-26T21:25:57.470 INFO:tasks.workunit.client.1.smithi120.stdout:4/565: truncate d10/d12/f5c 3250726 0 2024-04-26T21:25:57.470 INFO:tasks.workunit.client.1.smithi120.stdout:7/569: creat d7/d64/da6/d1f/d7d/d8b/fc4 x:0 0 0 2024-04-26T21:25:57.473 INFO:tasks.workunit.client.1.smithi120.stdout:0/678: unlink d0/d3/dc/d12/d31/lac 0 2024-04-26T21:25:57.474 INFO:tasks.workunit.client.1.smithi120.stdout:6/598: dread d4/db/d10/dd/d28/f61 [0,4194304] 0 2024-04-26T21:25:57.474 INFO:tasks.workunit.client.1.smithi120.stdout:1/529: mknod d6/d7/d1d/d2c/d58/cb1 0 2024-04-26T21:25:57.477 INFO:tasks.workunit.client.0.smithi084.stdout:8/392: truncate d4/d6/db/d1e/d22/d2f/f41 4923539 0 2024-04-26T21:25:57.478 INFO:tasks.workunit.client.1.smithi120.stdout:0/679: readlink d0/d3/dc/d12/d31/ld7 0 2024-04-26T21:25:57.482 INFO:tasks.workunit.client.1.smithi120.stdout:7/570: mkdir d7/d64/da6/d1a/dc5 0 2024-04-26T21:25:57.484 INFO:tasks.workunit.client.0.smithi084.stdout:1/404: truncate d2/d9/d15/f25 2714781 0 2024-04-26T21:25:57.484 INFO:tasks.workunit.client.1.smithi120.stdout:9/563: dwrite d0/d6/f60 [0,4194304] 0 2024-04-26T21:25:57.487 INFO:tasks.workunit.client.0.smithi084.stdout:5/354: dread d0/d17/f20 [0,4194304] 0 2024-04-26T21:25:57.488 INFO:tasks.workunit.client.1.smithi120.stdout:0/680: dread - d0/d3/dc/dd/d9b/fe4 zero size 2024-04-26T21:25:57.492 INFO:tasks.workunit.client.0.smithi084.stdout:7/377: fdatasync d6/dc/f27 0 2024-04-26T21:25:57.494 INFO:tasks.workunit.client.0.smithi084.stdout:6/406: rename d3/fc to d3/de/d5d/f89 0 2024-04-26T21:25:57.496 INFO:tasks.workunit.client.0.smithi084.stdout:6/407: readlink d3/de/d1a/d43/l78 0 2024-04-26T21:25:57.497 INFO:tasks.workunit.client.1.smithi120.stdout:3/584: dread dd/f5e [0,4194304] 0 2024-04-26T21:25:57.499 INFO:tasks.workunit.client.1.smithi120.stdout:0/681: write d0/d3/dc/dd/d1b/daa/fbe [2242482,69465] 0 2024-04-26T21:25:57.499 INFO:tasks.workunit.client.0.smithi084.stdout:6/408: dread - d3/de/d15/d40/f6e zero size 2024-04-26T21:25:57.500 INFO:tasks.workunit.client.1.smithi120.stdout:7/571: unlink d7/d64/da6/d1f/d28/d4c/c7e 0 2024-04-26T21:25:57.508 INFO:tasks.workunit.client.1.smithi120.stdout:5/658: dread d2/dc/d1d/d1f/d36/f76 [0,4194304] 0 2024-04-26T21:25:57.510 INFO:tasks.workunit.client.1.smithi120.stdout:0/682: dread - d0/d3/dc/dd/d1b/d24/f77 zero size 2024-04-26T21:25:57.510 INFO:tasks.workunit.client.1.smithi120.stdout:7/572: truncate d7/fd 3678421 0 2024-04-26T21:25:57.511 INFO:tasks.workunit.client.0.smithi084.stdout:6/409: write d3/f26 [2258174,62618] 0 2024-04-26T21:25:57.513 INFO:tasks.workunit.client.1.smithi120.stdout:3/585: dread dd/de/d83/d64/db0/d46/f6e [0,4194304] 0 2024-04-26T21:25:57.518 INFO:tasks.workunit.client.0.smithi084.stdout:8/393: chown d4/d6/db/l11 4185503 1 2024-04-26T21:25:57.518 INFO:tasks.workunit.client.1.smithi120.stdout:5/659: fdatasync d2/fa 0 2024-04-26T21:25:57.519 INFO:tasks.workunit.client.0.smithi084.stdout:7/378: dwrite d6/d1c/f4e [0,4194304] 0 2024-04-26T21:25:57.521 INFO:tasks.workunit.client.0.smithi084.stdout:7/379: readlink d6/l23 0 2024-04-26T21:25:57.524 INFO:tasks.workunit.client.0.smithi084.stdout:7/380: chown d6/d9/d12/f3d 62 1 2024-04-26T21:25:57.531 INFO:tasks.workunit.client.0.smithi084.stdout:5/355: creat d0/d49/d56/f6f x:0 0 0 2024-04-26T21:25:57.532 INFO:tasks.workunit.client.1.smithi120.stdout:3/586: symlink dd/d40/lba 0 2024-04-26T21:25:57.534 INFO:tasks.workunit.client.0.smithi084.stdout:8/394: dread d4/f5 [0,4194304] 0 2024-04-26T21:25:57.534 INFO:tasks.workunit.client.1.smithi120.stdout:0/683: creat d0/d3/dc/dd/d1b/d24/d73/db7/fe5 x:0 0 0 2024-04-26T21:25:57.536 INFO:tasks.workunit.client.1.smithi120.stdout:8/534: truncate d5/d6/d34/d42/f49 1624895 0 2024-04-26T21:25:57.540 INFO:tasks.workunit.client.0.smithi084.stdout:1/405: dread d2/f56 [0,4194304] 0 2024-04-26T21:25:57.541 INFO:tasks.workunit.client.1.smithi120.stdout:9/564: truncate d0/dd/d34/f59 27804 0 2024-04-26T21:25:57.542 INFO:tasks.workunit.client.1.smithi120.stdout:8/535: chown d5/d6/d75/fa6 682586413 1 2024-04-26T21:25:57.542 INFO:tasks.workunit.client.0.smithi084.stdout:2/483: truncate d6/d7/d68/f71 189382 0 2024-04-26T21:25:57.543 INFO:tasks.workunit.client.1.smithi120.stdout:6/599: dread d4/db/d25/d6d/f84 [0,4194304] 0 2024-04-26T21:25:57.544 INFO:tasks.workunit.client.1.smithi120.stdout:0/684: chown d0/d3/dc/dd/d9b/ca2 2727592 1 2024-04-26T21:25:57.545 INFO:tasks.workunit.client.0.smithi084.stdout:2/484: read - d6/d7/d3d/d79/f83 zero size 2024-04-26T21:25:57.547 INFO:tasks.workunit.client.1.smithi120.stdout:5/660: dwrite d2/dc/d1d/d21/db2/fc7 [0,4194304] 0 2024-04-26T21:25:57.548 INFO:tasks.workunit.client.0.smithi084.stdout:4/293: getdents d5/d10/d15/d21/d29/d3f 0 2024-04-26T21:25:57.552 INFO:tasks.workunit.client.0.smithi084.stdout:7/381: dread d6/d26/d40/f66 [4194304,4194304] 0 2024-04-26T21:25:57.553 INFO:tasks.workunit.client.1.smithi120.stdout:5/661: dread - d2/d82/d96/fe8 zero size 2024-04-26T21:25:57.553 INFO:tasks.workunit.client.0.smithi084.stdout:6/410: creat d3/d18/d81/f8a x:0 0 0 2024-04-26T21:25:57.556 INFO:tasks.workunit.client.0.smithi084.stdout:6/411: read d3/d18/d37/f49 [45386,50205] 0 2024-04-26T21:25:57.557 INFO:tasks.workunit.client.1.smithi120.stdout:7/573: write d7/d64/da6/d1f/d28/f2e [1430257,81874] 0 2024-04-26T21:25:57.558 INFO:tasks.workunit.client.1.smithi120.stdout:4/566: dread d10/d12/f14 [4194304,4194304] 0 2024-04-26T21:25:57.561 INFO:tasks.workunit.client.0.smithi084.stdout:5/356: dread d0/dc/df/d2a/f40 [0,4194304] 0 2024-04-26T21:25:57.561 INFO:tasks.workunit.client.1.smithi120.stdout:1/530: dread d6/d7/d1b/f81 [0,4194304] 0 2024-04-26T21:25:57.561 INFO:tasks.workunit.client.1.smithi120.stdout:3/587: truncate dd/de/d83/f81 1322938 0 2024-04-26T21:25:57.569 INFO:tasks.workunit.client.1.smithi120.stdout:7/574: write d7/d64/da6/d1f/d28/f2e [1353002,42001] 0 2024-04-26T21:25:57.570 INFO:tasks.workunit.client.1.smithi120.stdout:4/567: truncate d10/d12/faa 5153787 0 2024-04-26T21:25:57.571 INFO:tasks.workunit.client.1.smithi120.stdout:6/600: mkdir d4/db/d25/d6d/d97/dc8 0 2024-04-26T21:25:57.571 INFO:tasks.workunit.client.1.smithi120.stdout:1/531: symlink d6/d9/lb2 0 2024-04-26T21:25:57.574 INFO:tasks.workunit.client.1.smithi120.stdout:0/685: creat d0/d3/dc/fe6 x:0 0 0 2024-04-26T21:25:57.576 INFO:tasks.workunit.client.0.smithi084.stdout:2/485: fdatasync d6/d1b/f2c 0 2024-04-26T21:25:57.578 INFO:tasks.workunit.client.0.smithi084.stdout:2/486: fsync d6/d7/d68/fa2 0 2024-04-26T21:25:57.581 INFO:tasks.workunit.client.1.smithi120.stdout:7/575: write d7/d64/da6/d1f/d28/d4c/d6b/f70 [1781156,89457] 0 2024-04-26T21:25:57.581 INFO:tasks.workunit.client.0.smithi084.stdout:1/406: mkdir d2/d54/d5e/d66/d2a/d2c/d45/d7e 0 2024-04-26T21:25:57.582 INFO:tasks.workunit.client.0.smithi084.stdout:2/487: fsync d6/d7/d68/f78 0 2024-04-26T21:25:57.583 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:57 smithi120 ceph-mon[32741]: pgmap v43: 65 pgs: 65 active+clean; 1.5 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 40 MiB/s rd, 188 MiB/s wr, 310 op/s 2024-04-26T21:25:57.583 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:57 smithi120 ceph-mon[32741]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:25:57.583 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:57 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:57.583 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:57 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:57.583 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:57 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2076076362' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:25:57.584 INFO:tasks.workunit.client.1.smithi120.stdout:9/565: dwrite d0/dd/f12 [0,4194304] 0 2024-04-26T21:25:57.586 INFO:tasks.workunit.client.0.smithi084.stdout:7/382: creat d6/dc/f7c x:0 0 0 2024-04-26T21:25:57.587 INFO:tasks.workunit.client.1.smithi120.stdout:1/532: read d6/d7/ff [1109428,18927] 0 2024-04-26T21:25:57.589 INFO:tasks.workunit.client.1.smithi120.stdout:4/568: link d10/d12/fa7 d10/d12/da1/fc3 0 2024-04-26T21:25:57.590 INFO:tasks.workunit.client.1.smithi120.stdout:6/601: creat d4/db/d10/d1a/d2b/d57/d67/d98/fc9 x:0 0 0 2024-04-26T21:25:57.592 INFO:tasks.workunit.client.1.smithi120.stdout:0/686: readlink d0/d3/dc/dd/d1b/d39/l67 0 2024-04-26T21:25:57.601 INFO:tasks.workunit.client.0.smithi084.stdout:1/407: dread d2/d19/f32 [0,4194304] 0 2024-04-26T21:25:57.601 INFO:tasks.workunit.client.1.smithi120.stdout:9/566: chown d0/d14/f35 106267 1 2024-04-26T21:25:57.601 INFO:tasks.workunit.client.1.smithi120.stdout:3/588: truncate dd/de/d83/f81 1314403 0 2024-04-26T21:25:57.604 INFO:tasks.workunit.client.1.smithi120.stdout:5/662: dwrite d2/dc/d1d/d21/d77/d9c/fe9 [0,4194304] 0 2024-04-26T21:25:57.611 INFO:tasks.workunit.client.1.smithi120.stdout:7/576: creat d7/d64/da6/d1f/d28/d4c/d6b/d7b/fc6 x:0 0 0 2024-04-26T21:25:57.612 INFO:tasks.workunit.client.1.smithi120.stdout:4/569: fdatasync d10/d12/f5c 0 2024-04-26T21:25:57.613 INFO:tasks.workunit.client.1.smithi120.stdout:0/687: unlink d0/d3/dc/dd/d1b/d39/l6c 0 2024-04-26T21:25:57.614 INFO:tasks.workunit.client.0.smithi084.stdout:5/357: creat d0/dc/df/d6d/f70 x:0 0 0 2024-04-26T21:25:57.615 INFO:tasks.workunit.client.1.smithi120.stdout:7/577: dread - d7/d64/da6/d2f/f41 zero size 2024-04-26T21:25:57.618 INFO:tasks.workunit.client.0.smithi084.stdout:1/408: mknod d2/d54/d5e/d66/d2a/d2c/d45/c7f 0 2024-04-26T21:25:57.619 INFO:tasks.workunit.client.1.smithi120.stdout:9/567: rename d0/d14/fb0 to d0/d14/d2d/d4b/d85/fb6 0 2024-04-26T21:25:57.619 INFO:tasks.workunit.client.1.smithi120.stdout:3/589: creat dd/de/d18/d24/db1/d76/d3b/d56/d75/fbb x:0 0 0 2024-04-26T21:25:57.621 INFO:tasks.workunit.client.0.smithi084.stdout:7/383: dread d6/d9/d12/d19/d20/d32/f71 [0,4194304] 0 2024-04-26T21:25:57.622 INFO:tasks.workunit.client.0.smithi084.stdout:4/294: link d5/l1c d5/d10/d15/d21/d29/d3f/l61 0 2024-04-26T21:25:57.623 INFO:tasks.workunit.client.1.smithi120.stdout:4/570: dread d10/d28/f41 [0,4194304] 0 2024-04-26T21:25:57.624 INFO:tasks.workunit.client.1.smithi120.stdout:5/663: mknod d2/dc/d1d/d21/db2/dde/cf0 0 2024-04-26T21:25:57.625 INFO:tasks.workunit.client.0.smithi084.stdout:7/384: chown d6/d26/d40 0 1 2024-04-26T21:25:57.626 INFO:tasks.workunit.client.0.smithi084.stdout:6/412: dread d3/de/d41/f52 [0,4194304] 0 2024-04-26T21:25:57.626 INFO:tasks.workunit.client.0.smithi084.stdout:5/358: creat d0/dc/df/d31/d53/f71 x:0 0 0 2024-04-26T21:25:57.630 INFO:tasks.workunit.client.0.smithi084.stdout:2/488: dread d6/d7/d3d/d15/f1a [0,4194304] 0 2024-04-26T21:25:57.632 INFO:tasks.workunit.client.1.smithi120.stdout:9/568: rename d0/dd/d34/d8a to d0/d66/d93/db7 0 2024-04-26T21:25:57.632 INFO:tasks.workunit.client.0.smithi084.stdout:4/295: mknod d5/d2e/d5f/d45/c62 0 2024-04-26T21:25:57.634 INFO:tasks.workunit.client.1.smithi120.stdout:5/664: mkdir d2/d30/d93/df1 0 2024-04-26T21:25:57.636 INFO:tasks.workunit.client.0.smithi084.stdout:7/385: rmdir d6/d68 39 2024-04-26T21:25:57.637 INFO:tasks.workunit.client.1.smithi120.stdout:5/665: dread - d2/d48/d63/dbe/fef zero size 2024-04-26T21:25:57.638 INFO:tasks.workunit.client.0.smithi084.stdout:2/489: dread - d6/d7/d3d/d15/d1f/d39/d20/d45/f61 zero size 2024-04-26T21:25:57.639 INFO:tasks.workunit.client.0.smithi084.stdout:6/413: rmdir d3/d6c 39 2024-04-26T21:25:57.643 INFO:tasks.workunit.client.1.smithi120.stdout:1/533: link d6/d7/d2d/d98/d56/l82 d6/d9/lb3 0 2024-04-26T21:25:57.645 INFO:tasks.workunit.client.1.smithi120.stdout:3/590: fdatasync dd/de/d18/d24/db1/d76/d3b/d56/fb5 0 2024-04-26T21:25:57.646 INFO:tasks.workunit.client.1.smithi120.stdout:5/666: readlink d2/dc/d1d/d21/l46 0 2024-04-26T21:25:57.646 INFO:tasks.workunit.client.0.smithi084.stdout:6/414: chown d3/de/d15/d40/f6e 120386 1 2024-04-26T21:25:57.647 INFO:tasks.workunit.client.0.smithi084.stdout:0/372: write de/f21 [829830,128182] 0 2024-04-26T21:25:57.648 INFO:tasks.workunit.client.1.smithi120.stdout:6/602: dread d4/db/d10/dd/db3/fb5 [0,4194304] 0 2024-04-26T21:25:57.652 INFO:tasks.workunit.client.0.smithi084.stdout:9/341: write da/de/d16/d25/d41/f7e [1504002,106168] 0 2024-04-26T21:25:57.655 INFO:tasks.workunit.client.1.smithi120.stdout:9/569: rmdir d0/d14/d2d 39 2024-04-26T21:25:57.656 INFO:tasks.workunit.client.0.smithi084.stdout:8/395: creat d4/d6/db/d1e/d22/f72 x:0 0 0 2024-04-26T21:25:57.658 INFO:tasks.workunit.client.1.smithi120.stdout:9/570: read - d0/dd/d34/fa6 zero size 2024-04-26T21:25:57.660 INFO:tasks.workunit.client.0.smithi084.stdout:0/373: symlink de/d2b/l7b 0 2024-04-26T21:25:57.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:57 smithi084 ceph-mon[25539]: pgmap v43: 65 pgs: 65 active+clean; 1.5 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 40 MiB/s rd, 188 MiB/s wr, 310 op/s 2024-04-26T21:25:57.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:57 smithi084 ceph-mon[25539]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:25:57.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:57 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:57.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:57 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:25:57.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:57 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2076076362' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:25:57.663 INFO:tasks.workunit.client.0.smithi084.stdout:2/490: getdents d6/d3e/d67 0 2024-04-26T21:25:57.667 INFO:tasks.workunit.client.1.smithi120.stdout:4/571: dread d10/d12/f45 [0,4194304] 0 2024-04-26T21:25:57.672 INFO:tasks.workunit.client.0.smithi084.stdout:5/359: dwrite d0/d17/f5b [0,4194304] 0 2024-04-26T21:25:57.672 INFO:tasks.workunit.client.0.smithi084.stdout:0/374: creat de/d2b/d77/d68/f7c x:0 0 0 2024-04-26T21:25:57.678 INFO:tasks.workunit.client.0.smithi084.stdout:4/296: creat d5/d7/f63 x:0 0 0 2024-04-26T21:25:57.679 INFO:tasks.workunit.client.1.smithi120.stdout:7/578: write d7/d64/da6/d2f/f7c [1707469,121099] 0 2024-04-26T21:25:57.681 INFO:tasks.workunit.client.1.smithi120.stdout:7/579: chown d7/d64/da6/d2f 333811 1 2024-04-26T21:25:57.681 INFO:tasks.workunit.client.0.smithi084.stdout:0/375: truncate de/d20/d4c/f61 178832 0 2024-04-26T21:25:57.684 INFO:tasks.workunit.client.0.smithi084.stdout:8/396: symlink d4/d6/db/d1e/l73 0 2024-04-26T21:25:57.686 INFO:tasks.workunit.client.0.smithi084.stdout:6/415: link d3/d18/d37/c71 d3/de/d15/c8b 0 2024-04-26T21:25:57.687 INFO:tasks.workunit.client.0.smithi084.stdout:1/409: dread d2/d54/d5e/d66/d2a/d2c/f2d [0,4194304] 0 2024-04-26T21:25:57.688 INFO:tasks.workunit.client.0.smithi084.stdout:0/376: mknod de/d20/d4c/c7d 0 2024-04-26T21:25:57.689 INFO:tasks.workunit.client.0.smithi084.stdout:9/342: dwrite da/f46 [0,4194304] 0 2024-04-26T21:25:57.691 INFO:tasks.workunit.client.0.smithi084.stdout:2/491: link d6/d7/d3d/d15/d1f/f34 d6/d7/d3d/d15/d1f/d39/d43/fab 0 2024-04-26T21:25:57.695 INFO:tasks.workunit.client.0.smithi084.stdout:6/416: symlink d3/de/d15/d5f/l8c 0 2024-04-26T21:25:57.695 INFO:tasks.workunit.client.0.smithi084.stdout:9/343: read - da/f3a zero size 2024-04-26T21:25:57.696 INFO:tasks.workunit.client.1.smithi120.stdout:1/534: fdatasync d6/d7/ff 0 2024-04-26T21:25:57.697 INFO:tasks.workunit.client.0.smithi084.stdout:1/410: mknod d2/d54/d5e/d66/d3a/d77/c80 0 2024-04-26T21:25:57.698 INFO:tasks.workunit.client.0.smithi084.stdout:7/386: unlink d6/d26/c2b 0 2024-04-26T21:25:57.701 INFO:tasks.workunit.client.1.smithi120.stdout:6/603: mknod d4/db/d10/d1a/cca 0 2024-04-26T21:25:57.702 INFO:tasks.workunit.client.1.smithi120.stdout:3/591: creat dd/de/d18/d24/db1/d76/d3b/fbc x:0 0 0 2024-04-26T21:25:57.704 INFO:tasks.workunit.client.1.smithi120.stdout:9/571: mkdir d0/dd/d3a/d5c/d98/db8 0 2024-04-26T21:25:57.705 INFO:tasks.workunit.client.1.smithi120.stdout:7/580: creat d7/d64/da6/d1f/d28/d4c/fc7 x:0 0 0 2024-04-26T21:25:57.707 INFO:tasks.workunit.client.1.smithi120.stdout:1/535: chown d6/d9/lb3 314 1 2024-04-26T21:25:57.710 INFO:tasks.workunit.client.0.smithi084.stdout:6/417: write d3/de/d41/f51 [1410950,3300] 0 2024-04-26T21:25:57.711 INFO:tasks.workunit.client.0.smithi084.stdout:3/392: creat d1/d2c/d2f/d31/f84 x:0 0 0 2024-04-26T21:25:57.711 INFO:tasks.workunit.client.1.smithi120.stdout:6/604: mknod d4/db/d10/dd/d28/d9e/daf/ccb 0 2024-04-26T21:25:57.713 INFO:tasks.workunit.client.0.smithi084.stdout:8/397: rename d4/d6/c26 to d4/d7/d53/c74 0 2024-04-26T21:25:57.715 INFO:tasks.workunit.client.1.smithi120.stdout:3/592: getdents dd/de/d18/d24/db1 0 2024-04-26T21:25:57.717 INFO:tasks.workunit.client.1.smithi120.stdout:3/593: chown dd/de/d18 4048598 1 2024-04-26T21:25:57.719 INFO:tasks.workunit.client.0.smithi084.stdout:1/411: creat d2/d9/d15/d28/d47/f81 x:0 0 0 2024-04-26T21:25:57.723 INFO:tasks.workunit.client.0.smithi084.stdout:3/393: unlink d1/d2c/d2f/f76 0 2024-04-26T21:25:57.725 INFO:tasks.workunit.client.1.smithi120.stdout:1/536: link d6/d7/d2d/d98/d35/f87 d6/d7/d1b/d3b/d6d/fb4 0 2024-04-26T21:25:57.727 INFO:tasks.workunit.client.1.smithi120.stdout:3/594: unlink dd/d40/faa 0 2024-04-26T21:25:57.730 INFO:tasks.workunit.client.1.smithi120.stdout:6/605: rmdir d4/db/d10/d22/d56/dc5 0 2024-04-26T21:25:57.732 INFO:tasks.workunit.client.1.smithi120.stdout:2/599: sync 2024-04-26T21:25:57.732 INFO:tasks.workunit.client.0.smithi084.stdout:1/412: write d2/d19/f1e [2554034,79926] 0 2024-04-26T21:25:57.736 INFO:tasks.workunit.client.0.smithi084.stdout:2/492: dread d6/d7/d3d/f5c [0,4194304] 0 2024-04-26T21:25:57.736 INFO:tasks.workunit.client.0.smithi084.stdout:4/297: dwrite d5/d10/d15/d21/d29/f3c [0,4194304] 0 2024-04-26T21:25:57.737 INFO:tasks.workunit.client.1.smithi120.stdout:7/581: dwrite d7/d64/da6/d1f/d28/d4c/d6b/d7b/f80 [0,4194304] 0 2024-04-26T21:25:57.738 INFO:tasks.workunit.client.1.smithi120.stdout:5/667: dread d2/d1b/d89/d6b/f72 [0,4194304] 0 2024-04-26T21:25:57.739 INFO:tasks.workunit.client.0.smithi084.stdout:0/377: dwrite f0 [4194304,4194304] 0 2024-04-26T21:25:57.740 INFO:tasks.workunit.client.1.smithi120.stdout:1/537: symlink d6/d7/d1b/d3b/lb5 0 2024-04-26T21:25:57.745 INFO:tasks.workunit.client.1.smithi120.stdout:4/572: truncate d10/d65/f6d 615189 0 2024-04-26T21:25:57.749 INFO:tasks.workunit.client.1.smithi120.stdout:2/600: mknod d4/d1b/d2e/d50/d14/d15/cc4 0 2024-04-26T21:25:57.753 INFO:tasks.workunit.client.0.smithi084.stdout:7/387: dwrite d6/d1c/f4e [0,4194304] 0 2024-04-26T21:25:57.754 INFO:tasks.workunit.client.1.smithi120.stdout:2/601: chown d4/d1b/d2e/da0 3718754 1 2024-04-26T21:25:57.754 INFO:tasks.workunit.client.1.smithi120.stdout:1/538: dread d6/d7/d1d/d2c/d73/f88 [0,4194304] 0 2024-04-26T21:25:57.754 INFO:tasks.workunit.client.0.smithi084.stdout:6/418: dread d3/de/d15/d23/f30 [0,4194304] 0 2024-04-26T21:25:57.755 INFO:tasks.workunit.client.1.smithi120.stdout:3/595: write dd/de/d18/f22 [1947687,17336] 0 2024-04-26T21:25:57.755 INFO:tasks.workunit.client.0.smithi084.stdout:4/298: write d5/f1a [2544374,123213] 0 2024-04-26T21:25:57.759 INFO:tasks.workunit.client.0.smithi084.stdout:1/413: truncate d2/d9/d15/d28/d47/f81 296234 0 2024-04-26T21:25:57.762 INFO:tasks.workunit.client.1.smithi120.stdout:2/602: creat d4/d1b/d56/d65/fc5 x:0 0 0 2024-04-26T21:25:57.763 INFO:tasks.workunit.client.0.smithi084.stdout:8/398: readlink d4/d6/db/d1e/d22/d2f/l2d 0 2024-04-26T21:25:57.764 INFO:tasks.workunit.client.1.smithi120.stdout:6/606: dread d4/db/d10/dd/d4e/f75 [0,4194304] 0 2024-04-26T21:25:57.765 INFO:tasks.workunit.client.0.smithi084.stdout:0/378: chown de/l19 16164011 1 2024-04-26T21:25:57.766 INFO:tasks.workunit.client.0.smithi084.stdout:6/419: read d3/de/d15/d23/f30 [811439,76260] 0 2024-04-26T21:25:57.768 INFO:tasks.workunit.client.0.smithi084.stdout:9/344: dwrite da/de/d16/d25/d4f/f51 [4194304,4194304] 0 2024-04-26T21:25:57.770 INFO:tasks.workunit.client.1.smithi120.stdout:1/539: link d6/d7/d1b/d3b/d6d/c94 d6/d14/d3c/cb6 0 2024-04-26T21:25:57.771 INFO:tasks.workunit.client.1.smithi120.stdout:5/668: write d2/d30/d3b/f71 [153625,30324] 0 2024-04-26T21:25:57.772 INFO:tasks.workunit.client.1.smithi120.stdout:6/607: symlink d4/db/d10/d1a/d2b/d57/d67/lcc 0 2024-04-26T21:25:57.773 INFO:tasks.workunit.client.0.smithi084.stdout:6/420: dread - d3/f65 zero size 2024-04-26T21:25:57.775 INFO:tasks.workunit.client.1.smithi120.stdout:2/603: creat d4/d1b/d25/fc6 x:0 0 0 2024-04-26T21:25:57.776 INFO:tasks.workunit.client.0.smithi084.stdout:2/493: chown d6/d7/d68/f71 441 1 2024-04-26T21:25:57.776 INFO:tasks.workunit.client.1.smithi120.stdout:5/669: read - d2/d1b/d89/d47/fbb zero size 2024-04-26T21:25:57.778 INFO:tasks.workunit.client.0.smithi084.stdout:8/399: readlink d4/lc 0 2024-04-26T21:25:57.778 INFO:tasks.workunit.client.0.smithi084.stdout:5/360: dwrite d0/d17/f1d [0,4194304] 0 2024-04-26T21:25:57.780 INFO:tasks.workunit.client.0.smithi084.stdout:0/379: mknod de/d2b/d77/d32/c7e 0 2024-04-26T21:25:57.781 INFO:tasks.workunit.client.0.smithi084.stdout:4/299: chown d5/d10/d15/d21/d29/c37 79444635 1 2024-04-26T21:25:57.782 INFO:tasks.workunit.client.0.smithi084.stdout:7/388: mknod d6/d9/d12/d19/d7a/c7d 0 2024-04-26T21:25:57.782 INFO:tasks.workunit.client.0.smithi084.stdout:9/345: mkdir da/de/d16/d25/d41/d43/d48/d61/d81 0 2024-04-26T21:25:57.783 INFO:tasks.workunit.client.1.smithi120.stdout:5/670: dread - d2/dc/d1d/d21/d66/d6a/d8c/fa6 zero size 2024-04-26T21:25:57.784 INFO:tasks.workunit.client.1.smithi120.stdout:2/604: truncate d4/d1b/d56/d65/d8d/d96/fc1 21272 0 2024-04-26T21:25:57.785 INFO:tasks.workunit.client.0.smithi084.stdout:6/421: creat d3/d18/f8d x:0 0 0 2024-04-26T21:25:57.786 INFO:tasks.workunit.client.0.smithi084.stdout:1/414: creat d2/d54/d5e/d66/d2a/d72/f82 x:0 0 0 2024-04-26T21:25:57.789 INFO:tasks.workunit.client.1.smithi120.stdout:2/605: creat d4/d1b/d56/fc7 x:0 0 0 2024-04-26T21:25:57.791 INFO:tasks.workunit.client.0.smithi084.stdout:6/422: stat d3/de/d1a/d2f/f56 0 2024-04-26T21:25:57.791 INFO:tasks.workunit.client.0.smithi084.stdout:5/361: mkdir d0/dc/df/d31/d72 0 2024-04-26T21:25:57.792 INFO:tasks.workunit.client.0.smithi084.stdout:2/494: chown d6/d7/d3d/d15/d1f/d39/d20/l40 634623 1 2024-04-26T21:25:57.792 INFO:tasks.workunit.client.0.smithi084.stdout:7/389: creat d6/d9/d12/d19/f7e x:0 0 0 2024-04-26T21:25:57.793 INFO:tasks.workunit.client.1.smithi120.stdout:7/582: read d7/d64/da6/d1f/f3a [506517,120658] 0 2024-04-26T21:25:57.795 INFO:tasks.workunit.client.1.smithi120.stdout:5/671: unlink d2/d82/d96/fbc 0 2024-04-26T21:25:57.795 INFO:tasks.workunit.client.1.smithi120.stdout:7/583: chown d7/d64/da6/d1a/l21 0 1 2024-04-26T21:25:57.797 INFO:tasks.workunit.client.0.smithi084.stdout:9/346: truncate da/de/d16/d25/d41/d43/d48/f58 878033 0 2024-04-26T21:25:57.798 INFO:tasks.workunit.client.0.smithi084.stdout:1/415: mknod d2/d54/d5e/d66/d3a/d77/c83 0 2024-04-26T21:25:57.799 INFO:tasks.workunit.client.0.smithi084.stdout:6/423: chown d3/de/d1a/d43/d75/f7e 519621 1 2024-04-26T21:25:57.800 INFO:tasks.workunit.client.1.smithi120.stdout:5/672: write d2/dc/d1d/d21/fd8 [382383,25204] 0 2024-04-26T21:25:57.801 INFO:tasks.workunit.client.0.smithi084.stdout:5/362: creat d0/dc/df/d6d/f73 x:0 0 0 2024-04-26T21:25:57.801 INFO:tasks.workunit.client.0.smithi084.stdout:7/390: mkdir d6/d68/d7f 0 2024-04-26T21:25:57.803 INFO:tasks.workunit.client.0.smithi084.stdout:1/416: write d2/d9/f16 [1735863,90262] 0 2024-04-26T21:25:57.804 INFO:tasks.workunit.client.1.smithi120.stdout:5/673: creat d2/dc/d1d/d21/d77/d79/ff2 x:0 0 0 2024-04-26T21:25:57.811 INFO:tasks.workunit.client.0.smithi084.stdout:1/417: readlink d2/l8 0 2024-04-26T21:25:57.812 INFO:tasks.workunit.client.0.smithi084.stdout:9/347: mkdir da/de/d16/d25/d41/d43/d4a/d82 0 2024-04-26T21:25:57.814 INFO:tasks.workunit.client.0.smithi084.stdout:6/424: creat d3/de/d1a/d43/f8e x:0 0 0 2024-04-26T21:25:57.819 INFO:tasks.workunit.client.0.smithi084.stdout:7/391: rename d6/d26/d40/d41 to d6/dc/d47/d80 0 2024-04-26T21:25:57.821 INFO:tasks.workunit.client.1.smithi120.stdout:5/674: dread d2/d48/f6f [0,4194304] 0 2024-04-26T21:25:57.821 INFO:tasks.workunit.client.0.smithi084.stdout:9/348: chown da/de/d1e/f47 21 1 2024-04-26T21:25:57.823 INFO:tasks.workunit.client.0.smithi084.stdout:1/418: mknod d2/d9/d15/d28/c84 0 2024-04-26T21:25:57.825 INFO:tasks.workunit.client.1.smithi120.stdout:5/675: fdatasync d2/d82/d96/fe8 0 2024-04-26T21:25:57.825 INFO:tasks.workunit.client.1.smithi120.stdout:7/584: dwrite d7/d64/da6/d1f/d7d/d8b/fc4 [0,4194304] 0 2024-04-26T21:25:57.825 INFO:tasks.workunit.client.0.smithi084.stdout:0/380: dwrite de/d20/d4e/f6a [0,4194304] 0 2024-04-26T21:25:57.826 INFO:tasks.workunit.client.1.smithi120.stdout:7/585: fdatasync d7/d19/f24 0 2024-04-26T21:25:57.831 INFO:tasks.workunit.client.1.smithi120.stdout:5/676: symlink d2/dc/d1d/d1f/d36/d67/lf3 0 2024-04-26T21:25:57.834 INFO:tasks.workunit.client.1.smithi120.stdout:5/677: truncate d2/dc/fb6 788040 0 2024-04-26T21:25:57.836 INFO:tasks.workunit.client.1.smithi120.stdout:7/586: getdents d7/d64/da6/d1a/d33/d34/dab/dbf 0 2024-04-26T21:25:57.836 INFO:tasks.workunit.client.1.smithi120.stdout:5/678: chown d2/d48/cb1 48127585 1 2024-04-26T21:25:57.839 INFO:tasks.workunit.client.0.smithi084.stdout:3/394: dwrite d1/d2c/d2f/f20 [0,4194304] 0 2024-04-26T21:25:57.840 INFO:tasks.workunit.client.0.smithi084.stdout:4/300: dread d5/d25/d35/f3a [0,4194304] 0 2024-04-26T21:25:57.842 INFO:tasks.workunit.client.0.smithi084.stdout:2/495: dwrite d6/d7/d3d/d15/d1f/d39/d20/d45/f61 [0,4194304] 0 2024-04-26T21:25:57.845 INFO:tasks.workunit.client.0.smithi084.stdout:5/363: dread d0/dc/df/d2a/d41/f55 [0,4194304] 0 2024-04-26T21:25:57.845 INFO:tasks.workunit.client.1.smithi120.stdout:4/573: truncate d10/d65/f6d 943302 0 2024-04-26T21:25:57.846 INFO:tasks.workunit.client.0.smithi084.stdout:5/364: write d0/f22 [4247010,81753] 0 2024-04-26T21:25:57.850 INFO:tasks.workunit.client.1.smithi120.stdout:6/608: write d4/db/f6b [2826777,54354] 0 2024-04-26T21:25:57.852 INFO:tasks.workunit.client.0.smithi084.stdout:3/395: read d1/d2c/d2f/f54 [2098151,76236] 0 2024-04-26T21:25:57.852 INFO:tasks.workunit.client.1.smithi120.stdout:5/679: creat d2/dc/d1d/d1f/d36/d44/dea/ff4 x:0 0 0 2024-04-26T21:25:57.857 INFO:tasks.workunit.client.1.smithi120.stdout:4/574: rename d10/d28/f3d to d10/d28/d73/da2/fc4 0 2024-04-26T21:25:57.857 INFO:tasks.workunit.client.1.smithi120.stdout:2/606: dread d4/d1b/d2e/d50/f5b [0,4194304] 0 2024-04-26T21:25:57.858 INFO:tasks.workunit.client.1.smithi120.stdout:5/680: rmdir d2/d1b/dd2 39 2024-04-26T21:25:57.858 INFO:tasks.workunit.client.1.smithi120.stdout:6/609: write d4/db/d10/f92 [814281,88615] 0 2024-04-26T21:25:57.859 INFO:tasks.workunit.client.0.smithi084.stdout:5/365: creat d0/d49/d4d/f74 x:0 0 0 2024-04-26T21:25:57.860 INFO:tasks.workunit.client.0.smithi084.stdout:4/301: link d5/d25/d35/f3a d5/d25/d35/d60/f64 0 2024-04-26T21:25:57.864 INFO:tasks.workunit.client.1.smithi120.stdout:1/540: dread d6/d7/d1d/f50 [4194304,4194304] 0 2024-04-26T21:25:57.864 INFO:tasks.workunit.client.1.smithi120.stdout:4/575: write d10/d12/f14 [7057461,55142] 0 2024-04-26T21:25:57.865 INFO:tasks.workunit.client.0.smithi084.stdout:3/396: mknod d1/d24/d27/c85 0 2024-04-26T21:25:57.865 INFO:tasks.workunit.client.0.smithi084.stdout:8/400: dread d4/d3a/f71 [0,4194304] 0 2024-04-26T21:25:57.865 INFO:tasks.workunit.client.0.smithi084.stdout:2/496: creat d6/d7/d3d/fac x:0 0 0 2024-04-26T21:25:57.866 INFO:tasks.workunit.client.1.smithi120.stdout:6/610: write d4/db/d25/d6d/f77 [977497,42340] 0 2024-04-26T21:25:57.868 INFO:tasks.workunit.client.0.smithi084.stdout:7/392: dwrite d6/f4b [4194304,4194304] 0 2024-04-26T21:25:57.868 INFO:tasks.workunit.client.0.smithi084.stdout:4/302: readlink d5/d10/d15/d21/l3b 0 2024-04-26T21:25:57.875 INFO:tasks.workunit.client.0.smithi084.stdout:5/366: unlink d0/f32 0 2024-04-26T21:25:57.876 INFO:tasks.workunit.client.1.smithi120.stdout:7/587: dwrite d7/d64/da6/d1f/d7d/fa2 [0,4194304] 0 2024-04-26T21:25:57.880 INFO:tasks.workunit.client.1.smithi120.stdout:1/541: mkdir d6/d7/db7 0 2024-04-26T21:25:57.883 INFO:tasks.workunit.client.1.smithi120.stdout:2/607: rename d4/d1b/d25/d2c/d3e/f7e to d4/d1b/d25/d2c/d3e/d5e/d63/fc8 0 2024-04-26T21:25:57.886 INFO:tasks.workunit.client.0.smithi084.stdout:6/425: dread d3/de/d1a/d43/f48 [0,4194304] 0 2024-04-26T21:25:57.889 INFO:tasks.workunit.client.0.smithi084.stdout:4/303: rename d5/d2e/d5f/d45 to d5/d7/d65 0 2024-04-26T21:25:57.890 INFO:tasks.workunit.client.1.smithi120.stdout:7/588: mknod d7/d64/da6/d1f/cc8 0 2024-04-26T21:25:57.890 INFO:tasks.workunit.client.0.smithi084.stdout:7/393: symlink d6/d1c/d51/l81 0 2024-04-26T21:25:57.892 INFO:tasks.workunit.client.1.smithi120.stdout:1/542: write d6/d7/d1d/d2c/fa5 [3429298,81189] 0 2024-04-26T21:25:57.893 INFO:tasks.workunit.client.1.smithi120.stdout:5/681: rename d2/d82/d96/db3 to d2/dc/d1d/d1f/d36/d44/d6c/df5 0 2024-04-26T21:25:57.897 INFO:tasks.workunit.client.0.smithi084.stdout:8/401: dwrite d4/d7/d15/d3c/f4b [0,4194304] 0 2024-04-26T21:25:57.897 INFO:tasks.workunit.client.0.smithi084.stdout:6/426: readlink d3/de/d15/d5f/l8c 0 2024-04-26T21:25:57.899 INFO:tasks.workunit.client.0.smithi084.stdout:5/367: chown d0/dc/c29 0 1 2024-04-26T21:25:57.903 INFO:tasks.workunit.client.1.smithi120.stdout:1/543: unlink d6/f51 0 2024-04-26T21:25:57.904 INFO:tasks.workunit.client.1.smithi120.stdout:5/682: write d2/dc/f38 [2823063,110898] 0 2024-04-26T21:25:57.907 INFO:tasks.workunit.client.1.smithi120.stdout:4/576: dwrite d10/d12/f57 [0,4194304] 0 2024-04-26T21:25:57.909 INFO:tasks.workunit.client.1.smithi120.stdout:7/589: creat d7/d64/da6/d1f/d28/d4c/fc9 x:0 0 0 2024-04-26T21:25:57.909 INFO:tasks.workunit.client.0.smithi084.stdout:8/402: read - d4/d6/db/f6a zero size 2024-04-26T21:25:57.913 INFO:tasks.workunit.client.0.smithi084.stdout:5/368: fsync d0/dc/df/d31/d53/f71 0 2024-04-26T21:25:57.914 INFO:tasks.workunit.client.0.smithi084.stdout:4/304: dread d5/d2e/d5f/f4b [0,4194304] 0 2024-04-26T21:25:57.919 INFO:tasks.workunit.client.0.smithi084.stdout:6/427: readlink d3/d18/d37/l67 0 2024-04-26T21:25:57.919 INFO:tasks.workunit.client.1.smithi120.stdout:6/611: dwrite d4/db/d25/d6d/f84 [0,4194304] 0 2024-04-26T21:25:57.920 INFO:tasks.workunit.client.1.smithi120.stdout:7/590: dread - d7/d64/da6/d2f/fb1 zero size 2024-04-26T21:25:57.926 INFO:tasks.workunit.client.1.smithi120.stdout:4/577: fdatasync d10/d12/f19 0 2024-04-26T21:25:57.927 INFO:tasks.workunit.client.1.smithi120.stdout:1/544: creat d6/d7/fb8 x:0 0 0 2024-04-26T21:25:57.927 INFO:tasks.workunit.client.0.smithi084.stdout:6/428: read - d3/d18/f5b zero size 2024-04-26T21:25:57.928 INFO:tasks.workunit.client.1.smithi120.stdout:7/591: chown d7/d64/da6/d1f/d28/d4c/fc7 750 1 2024-04-26T21:25:57.929 INFO:tasks.workunit.client.1.smithi120.stdout:2/608: dwrite d4/d1b/d2e/d50/d14/d15/d6c/fa4 [0,4194304] 0 2024-04-26T21:25:57.929 INFO:tasks.workunit.client.1.smithi120.stdout:4/578: stat f6 0 2024-04-26T21:25:57.931 INFO:tasks.workunit.client.1.smithi120.stdout:6/612: mkdir d4/db/d10/d1a/dcd 0 2024-04-26T21:25:57.931 INFO:tasks.workunit.client.0.smithi084.stdout:3/397: dwrite d1/d2c/d2f/f6d [4194304,4194304] 0 2024-04-26T21:25:57.932 INFO:tasks.workunit.client.1.smithi120.stdout:6/613: stat d4/db 0 2024-04-26T21:25:57.933 INFO:tasks.workunit.client.1.smithi120.stdout:2/609: readlink d4/d1b/d2e/d50/d14/l2f 0 2024-04-26T21:25:57.934 INFO:tasks.workunit.client.1.smithi120.stdout:1/545: truncate d6/d7/d1d/d2c/f76 1049198 0 2024-04-26T21:25:57.934 INFO:tasks.workunit.client.0.smithi084.stdout:2/497: link d6/d7/d3d/d15/d1f/d6c/l8d d6/d3e/lad 0 2024-04-26T21:25:57.937 INFO:tasks.workunit.client.1.smithi120.stdout:6/614: chown d4/db/d10/dd/d43/laa 27 1 2024-04-26T21:25:57.938 INFO:tasks.workunit.client.0.smithi084.stdout:0/381: dread de/d2b/d77/d32/f51 [0,4194304] 0 2024-04-26T21:25:57.938 INFO:tasks.workunit.client.0.smithi084.stdout:1/419: dread d2/d1b/f55 [0,4194304] 0 2024-04-26T21:25:57.939 INFO:tasks.workunit.client.0.smithi084.stdout:4/305: creat d5/d10/d15/d21/d29/f66 x:0 0 0 2024-04-26T21:25:57.943 INFO:tasks.workunit.client.0.smithi084.stdout:2/498: chown d6/d7/d3d 116138795 1 2024-04-26T21:25:57.943 INFO:tasks.workunit.client.1.smithi120.stdout:4/579: unlink d10/d28/c4d 0 2024-04-26T21:25:57.943 INFO:tasks.workunit.client.1.smithi120.stdout:8/536: sync 2024-04-26T21:25:57.943 INFO:tasks.workunit.client.1.smithi120.stdout:2/610: fsync d4/d1b/d56/f4a 0 2024-04-26T21:25:57.944 INFO:tasks.workunit.client.1.smithi120.stdout:1/546: symlink d6/d7/d1d/d5d/lb9 0 2024-04-26T21:25:57.945 INFO:tasks.workunit.client.1.smithi120.stdout:4/580: fsync d10/d12/f22 0 2024-04-26T21:25:57.950 INFO:tasks.workunit.client.0.smithi084.stdout:8/403: dwrite d4/d7/d15/d37/f68 [0,4194304] 0 2024-04-26T21:25:57.950 INFO:tasks.workunit.client.0.smithi084.stdout:0/382: mknod de/d2b/d77/c7f 0 2024-04-26T21:25:57.950 INFO:tasks.workunit.client.1.smithi120.stdout:2/611: fdatasync d4/d1b/d2e/d50/f21 0 2024-04-26T21:25:57.950 INFO:tasks.workunit.client.1.smithi120.stdout:8/537: write d5/d6/d75/fa6 [597101,116362] 0 2024-04-26T21:25:57.950 INFO:tasks.workunit.client.1.smithi120.stdout:6/615: mkdir d4/db/d10/d1a/d2b/d57/d67/dbc/dce 0 2024-04-26T21:25:57.951 INFO:tasks.workunit.client.0.smithi084.stdout:6/429: creat d3/de/d41/d5c/f8f x:0 0 0 2024-04-26T21:25:57.951 INFO:tasks.workunit.client.1.smithi120.stdout:6/616: chown d4/db/d25/d6d/d97 0 1 2024-04-26T21:25:57.952 INFO:tasks.workunit.client.0.smithi084.stdout:5/369: dread d0/d17/f5b [0,4194304] 0 2024-04-26T21:25:57.953 INFO:tasks.workunit.client.1.smithi120.stdout:1/547: rmdir d6/d7/d1d 39 2024-04-26T21:25:57.954 INFO:tasks.workunit.client.0.smithi084.stdout:5/370: chown d0/fd 1456621057 1 2024-04-26T21:25:57.955 INFO:tasks.workunit.client.0.smithi084.stdout:2/499: chown d6/d7/d3d/f54 1 1 2024-04-26T21:25:57.955 INFO:tasks.workunit.client.0.smithi084.stdout:0/383: chown de/d2b/d45/l56 1 1 2024-04-26T21:25:57.956 INFO:tasks.workunit.client.1.smithi120.stdout:2/612: rename d4/lbe to d4/d1b/d2e/d50/d14/dc2/lc9 0 2024-04-26T21:25:57.960 INFO:tasks.workunit.client.0.smithi084.stdout:5/371: write d0/dc/f1c [1072716,39119] 0 2024-04-26T21:25:57.960 INFO:tasks.workunit.client.1.smithi120.stdout:4/581: creat d10/d6b/dbf/fc5 x:0 0 0 2024-04-26T21:25:57.964 INFO:tasks.workunit.client.1.smithi120.stdout:8/538: truncate d5/d6/d11/d52/f17 11841776 0 2024-04-26T21:25:57.970 INFO:tasks.workunit.client.0.smithi084.stdout:7/394: link d6/d26/d40/f5e d6/d9/d12/d19/d20/d38/f82 0 2024-04-26T21:25:57.975 INFO:tasks.workunit.client.1.smithi120.stdout:6/617: getdents d4/db/d10/d22/d6c 0 2024-04-26T21:25:57.976 INFO:tasks.workunit.client.0.smithi084.stdout:4/306: rename d5/d2e/d5f/d42 to d5/d10/d15/d21/d29/d3f/d67 0 2024-04-26T21:25:57.977 INFO:tasks.workunit.client.0.smithi084.stdout:6/430: mkdir d3/de/d15/d23/d90 0 2024-04-26T21:25:57.982 INFO:tasks.workunit.client.0.smithi084.stdout:8/404: chown d4/d6/db/d1e/d22/d39/d4a/l50 142 1 2024-04-26T21:25:57.983 INFO:tasks.workunit.client.1.smithi120.stdout:6/618: rmdir d4/db/d25/d6d/d97 39 2024-04-26T21:25:57.983 INFO:tasks.workunit.client.0.smithi084.stdout:2/500: creat d6/d7/d3d/d15/d1f/d39/d43/fae x:0 0 0 2024-04-26T21:25:57.984 INFO:tasks.workunit.client.1.smithi120.stdout:8/539: creat d5/d6/d34/faf x:0 0 0 2024-04-26T21:25:57.985 INFO:tasks.workunit.client.0.smithi084.stdout:7/395: mknod d6/d68/c83 0 2024-04-26T21:25:57.985 INFO:tasks.workunit.client.0.smithi084.stdout:8/405: readlink d4/d6/l35 0 2024-04-26T21:25:57.986 INFO:tasks.workunit.client.1.smithi120.stdout:5/683: write d2/f3d [2012474,52356] 0 2024-04-26T21:25:57.986 INFO:tasks.workunit.client.1.smithi120.stdout:6/619: stat d4/db/f23 0 2024-04-26T21:25:57.986 INFO:tasks.workunit.client.0.smithi084.stdout:0/384: symlink de/d2b/d64/l80 0 2024-04-26T21:25:57.987 INFO:tasks.workunit.client.1.smithi120.stdout:2/613: dwrite d4/d1b/d2e/d50/d14/d15/f2d [0,4194304] 0 2024-04-26T21:25:57.988 INFO:tasks.workunit.client.0.smithi084.stdout:8/406: fdatasync d4/f13 0 2024-04-26T21:25:57.988 INFO:tasks.workunit.client.1.smithi120.stdout:4/582: dwrite d10/d12/f14 [4194304,4194304] 0 2024-04-26T21:25:57.988 INFO:tasks.workunit.client.0.smithi084.stdout:9/349: dread da/de/d16/d40/f78 [4194304,4194304] 0 2024-04-26T21:25:57.989 INFO:tasks.workunit.client.1.smithi120.stdout:7/592: write d7/fe [4124077,117758] 0 2024-04-26T21:25:57.990 INFO:tasks.workunit.client.0.smithi084.stdout:1/420: rmdir d2/d54/d5e/d66/d2a/d2c/d45/d7e 0 2024-04-26T21:25:57.991 INFO:tasks.workunit.client.0.smithi084.stdout:6/431: chown d3/d18/d37/c71 243495 1 2024-04-26T21:25:57.993 INFO:tasks.workunit.client.0.smithi084.stdout:3/398: truncate d1/fe 7859402 0 2024-04-26T21:25:57.994 INFO:tasks.workunit.client.0.smithi084.stdout:8/407: chown d4/d3a/l5c 466532 1 2024-04-26T21:25:57.994 INFO:tasks.workunit.client.1.smithi120.stdout:5/684: dread - d2/d82/d96/fe8 zero size 2024-04-26T21:25:57.995 INFO:tasks.workunit.client.1.smithi120.stdout:2/614: write d4/d1b/d25/d93/fc0 [977124,31913] 0 2024-04-26T21:25:57.997 INFO:tasks.workunit.client.0.smithi084.stdout:8/408: read - d4/d6/f6e zero size 2024-04-26T21:25:58.001 INFO:tasks.workunit.client.0.smithi084.stdout:5/372: rename d0/dc/df/d2a/d41 to d0/dc/df/d75 0 2024-04-26T21:25:58.005 INFO:tasks.workunit.client.0.smithi084.stdout:1/421: dread - d2/d54/d5e/d66/d2a/f7c zero size 2024-04-26T21:25:58.007 INFO:tasks.workunit.client.0.smithi084.stdout:2/501: symlink d6/d7/d3d/d15/d1f/d39/d20/d45/d5a/laf 0 2024-04-26T21:25:58.012 INFO:tasks.workunit.client.0.smithi084.stdout:7/396: rename d6/dc to d6/d9/d12/d19/d7a/d84 0 2024-04-26T21:25:58.013 INFO:tasks.workunit.client.0.smithi084.stdout:6/432: rename d3/de/d15/l7b to d3/de/d15/l91 0 2024-04-26T21:25:58.015 INFO:tasks.workunit.client.1.smithi120.stdout:6/620: creat d4/db/d25/d6d/dbd/dc4/fcf x:0 0 0 2024-04-26T21:25:58.015 INFO:tasks.workunit.client.0.smithi084.stdout:4/307: dread d5/d10/d15/d21/d29/f3c [0,4194304] 0 2024-04-26T21:25:58.016 INFO:tasks.workunit.client.1.smithi120.stdout:7/593: dread d7/d64/da6/d1f/d28/f2c [0,4194304] 0 2024-04-26T21:25:58.018 INFO:tasks.workunit.client.0.smithi084.stdout:4/308: stat d5/d25/f47 0 2024-04-26T21:25:58.020 INFO:tasks.workunit.client.1.smithi120.stdout:5/685: mkdir d2/df6 0 2024-04-26T21:25:58.020 INFO:tasks.workunit.client.1.smithi120.stdout:8/540: creat d5/d6/d11/d32/fb0 x:0 0 0 2024-04-26T21:25:58.027 INFO:tasks.workunit.client.1.smithi120.stdout:7/594: mkdir d7/d64/da6/d1a/d33/d34/dab/dca 0 2024-04-26T21:25:58.029 INFO:tasks.workunit.client.1.smithi120.stdout:5/686: fdatasync d2/f3f 0 2024-04-26T21:25:58.030 INFO:tasks.workunit.client.0.smithi084.stdout:9/350: dwrite da/de/d16/f1c [0,4194304] 0 2024-04-26T21:25:58.030 INFO:tasks.workunit.client.0.smithi084.stdout:1/422: creat d2/d54/d5e/d66/d3a/d77/f85 x:0 0 0 2024-04-26T21:25:58.030 INFO:tasks.workunit.client.0.smithi084.stdout:5/373: unlink d0/dc/df/f44 0 2024-04-26T21:25:58.030 INFO:tasks.workunit.client.0.smithi084.stdout:2/502: symlink d6/d7/d3d/d15/d1f/d22/d99/lb0 0 2024-04-26T21:25:58.030 INFO:tasks.workunit.client.0.smithi084.stdout:4/309: chown d5/d25/d35/c59 292654542 1 2024-04-26T21:25:58.030 INFO:tasks.workunit.client.0.smithi084.stdout:5/374: dread - d0/d49/d4d/f74 zero size 2024-04-26T21:25:58.036 INFO:tasks.workunit.client.1.smithi120.stdout:1/548: dwrite d6/d7/d1b/d3b/d6d/f8d [0,4194304] 0 2024-04-26T21:25:58.036 INFO:tasks.workunit.client.1.smithi120.stdout:4/583: dread d10/d12/f3a [0,4194304] 0 2024-04-26T21:25:58.036 INFO:tasks.workunit.client.1.smithi120.stdout:6/621: rename d4/db/fe to d4/db/d10/d22/d56/d94/fd0 0 2024-04-26T21:25:58.041 INFO:tasks.workunit.client.0.smithi084.stdout:6/433: rename d3/d18/f2b to d3/d18/d37/f92 0 2024-04-26T21:25:58.043 INFO:tasks.workunit.client.0.smithi084.stdout:2/503: write d6/d7/d3d/d15/d1f/d39/d20/f50 [1198195,27144] 0 2024-04-26T21:25:58.044 INFO:tasks.workunit.client.0.smithi084.stdout:5/375: rmdir d0/dc/df/d31 39 2024-04-26T21:25:58.044 INFO:tasks.workunit.client.0.smithi084.stdout:1/423: symlink d2/d54/d5e/d66/d2a/l86 0 2024-04-26T21:25:58.047 INFO:tasks.workunit.client.1.smithi120.stdout:1/549: stat d6/d7/d1d/d5d/d67/c61 0 2024-04-26T21:25:58.049 INFO:tasks.workunit.client.0.smithi084.stdout:5/376: chown d0/d49/c58 0 1 2024-04-26T21:25:58.051 INFO:tasks.workunit.client.0.smithi084.stdout:6/434: stat d3/d18/d37/c3f 0 2024-04-26T21:25:58.053 INFO:tasks.workunit.client.1.smithi120.stdout:4/584: creat d10/d6b/dbf/fc6 x:0 0 0 2024-04-26T21:25:58.061 INFO:tasks.workunit.client.0.smithi084.stdout:9/351: dwrite da/f14 [0,4194304] 0 2024-04-26T21:25:58.061 INFO:tasks.workunit.client.1.smithi120.stdout:6/622: unlink d4/db/d10/d1a/d2b/d57/fac 0 2024-04-26T21:25:58.066 INFO:tasks.workunit.client.1.smithi120.stdout:7/595: rmdir d7/d64/da6/d1a/d33/d34/dab/dca 0 2024-04-26T21:25:58.066 INFO:tasks.workunit.client.1.smithi120.stdout:1/550: symlink d6/d7/d1b/d3b/d6d/lba 0 2024-04-26T21:25:58.067 INFO:tasks.workunit.client.1.smithi120.stdout:6/623: mkdir d4/d3d/dd1 0 2024-04-26T21:25:58.068 INFO:tasks.workunit.client.1.smithi120.stdout:8/541: rename d5/d6/d34/d42/d9d/d7a/fa9 to d5/fb1 0 2024-04-26T21:25:58.069 INFO:tasks.workunit.client.0.smithi084.stdout:7/397: truncate d6/d9/d12/d19/d7a/d84/f76 3244250 0 2024-04-26T21:25:58.070 INFO:tasks.workunit.client.0.smithi084.stdout:6/435: rename d3/d6c/c7a to d3/de/d1a/d2f/d4c/d58/c93 0 2024-04-26T21:25:58.072 INFO:tasks.workunit.client.0.smithi084.stdout:0/385: dread de/d20/d4e/f5a [0,4194304] 0 2024-04-26T21:25:58.072 INFO:tasks.workunit.client.1.smithi120.stdout:7/596: mknod d7/d64/da6/d1f/d7d/d8b/ccb 0 2024-04-26T21:25:58.073 INFO:tasks.workunit.client.0.smithi084.stdout:6/436: dread - d3/de/f63 zero size 2024-04-26T21:25:58.076 INFO:tasks.workunit.client.1.smithi120.stdout:7/597: truncate d7/d10/d97/f9a 574828 0 2024-04-26T21:25:58.076 INFO:tasks.workunit.client.1.smithi120.stdout:5/687: truncate d2/dc/f38 3509988 0 2024-04-26T21:25:58.078 INFO:tasks.workunit.client.0.smithi084.stdout:7/398: truncate d6/d9/d12/d19/f70 272238 0 2024-04-26T21:25:58.078 INFO:tasks.workunit.client.1.smithi120.stdout:7/598: chown d7/d64/da6/d2f/fb1 46418515 1 2024-04-26T21:25:58.079 INFO:tasks.workunit.client.1.smithi120.stdout:6/624: creat d4/db/d10/d1a/dcd/fd2 x:0 0 0 2024-04-26T21:25:58.080 INFO:tasks.workunit.client.1.smithi120.stdout:5/688: rename d2/dc/d1d to d2/dc/d1d/d21/d66/df7 22 2024-04-26T21:25:58.081 INFO:tasks.workunit.client.0.smithi084.stdout:4/310: truncate d5/f23 984315 0 2024-04-26T21:25:58.081 INFO:tasks.workunit.client.0.smithi084.stdout:7/399: chown d6/d26/c74 2685343 1 2024-04-26T21:25:58.081 INFO:tasks.workunit.client.1.smithi120.stdout:1/551: write d6/d7/d2d/d48/f66 [61134,78849] 0 2024-04-26T21:25:58.083 INFO:tasks.workunit.client.1.smithi120.stdout:6/625: readlink d4/db/d10/dd/d43/laa 0 2024-04-26T21:25:58.083 INFO:tasks.workunit.client.0.smithi084.stdout:5/377: dwrite d0/d17/f1d [0,4194304] 0 2024-04-26T21:25:58.084 INFO:tasks.workunit.client.0.smithi084.stdout:2/504: rename d6/d7/d3d/d79/d81/d82/da8/ca9 to d6/d7/d3d/d15/d1f/d39/d20/d45/cb1 0 2024-04-26T21:25:58.084 INFO:tasks.workunit.client.1.smithi120.stdout:7/599: truncate d7/d64/da6/d2f/f7c 2523760 0 2024-04-26T21:25:58.086 INFO:tasks.workunit.client.0.smithi084.stdout:0/386: fsync de/f7a 0 2024-04-26T21:25:58.087 INFO:tasks.workunit.client.0.smithi084.stdout:9/352: mknod da/de/d16/d25/d41/d43/d4a/d82/c83 0 2024-04-26T21:25:58.087 INFO:tasks.workunit.client.1.smithi120.stdout:5/689: creat d2/dc/d1d/d21/db2/dde/ff8 x:0 0 0 2024-04-26T21:25:58.088 INFO:tasks.workunit.client.0.smithi084.stdout:4/311: chown d5/d10/d15/d21/d29/c31 20940117 1 2024-04-26T21:25:58.089 INFO:tasks.workunit.client.1.smithi120.stdout:5/690: chown d2/dc/d1d/d21/d66/f28 103 1 2024-04-26T21:25:58.092 INFO:tasks.workunit.client.0.smithi084.stdout:0/387: stat de/d2b/d77/c26 0 2024-04-26T21:25:58.094 INFO:tasks.workunit.client.0.smithi084.stdout:7/400: creat d6/d9/d12/d19/d7a/d84/d47/f85 x:0 0 0 2024-04-26T21:25:58.095 INFO:tasks.workunit.client.0.smithi084.stdout:9/353: chown da/de/d16/f57 174 1 2024-04-26T21:25:58.095 INFO:tasks.workunit.client.0.smithi084.stdout:2/505: write d6/d7/d3d/f57 [1372505,128759] 0 2024-04-26T21:25:58.098 INFO:tasks.workunit.client.0.smithi084.stdout:8/409: dread d4/d7/f16 [0,4194304] 0 2024-04-26T21:25:58.099 INFO:tasks.workunit.client.0.smithi084.stdout:4/312: mkdir d5/d25/d68 0 2024-04-26T21:25:58.103 INFO:tasks.workunit.client.0.smithi084.stdout:0/388: mkdir de/d2b/d64/d81 0 2024-04-26T21:25:58.103 INFO:tasks.workunit.client.0.smithi084.stdout:9/354: fdatasync da/de/d1e/f74 0 2024-04-26T21:25:58.104 INFO:tasks.workunit.client.1.smithi120.stdout:1/552: dwrite d6/fc [0,4194304] 0 2024-04-26T21:25:58.105 INFO:tasks.workunit.client.0.smithi084.stdout:2/506: readlink d6/d7/d68/l94 0 2024-04-26T21:25:58.108 INFO:tasks.workunit.client.0.smithi084.stdout:1/424: dwrite d2/d9/d15/f25 [0,4194304] 0 2024-04-26T21:25:58.110 INFO:tasks.workunit.client.1.smithi120.stdout:1/553: chown d6/d7/d2d/d98/d35 97 1 2024-04-26T21:25:58.118 INFO:tasks.workunit.client.1.smithi120.stdout:6/626: dwrite d4/db/d10/dd/d28/f61 [0,4194304] 0 2024-04-26T21:25:58.119 INFO:tasks.workunit.client.1.smithi120.stdout:1/554: symlink d6/d7/d1b/d3b/lbb 0 2024-04-26T21:25:58.119 INFO:tasks.workunit.client.1.smithi120.stdout:8/542: dread d5/d6/d11/d52/d27/f38 [4194304,4194304] 0 2024-04-26T21:25:58.121 INFO:tasks.workunit.client.0.smithi084.stdout:9/355: mknod da/de/d16/d25/d41/d43/d48/c84 0 2024-04-26T21:25:58.123 INFO:tasks.workunit.client.0.smithi084.stdout:7/401: creat d6/f86 x:0 0 0 2024-04-26T21:25:58.125 INFO:tasks.workunit.client.0.smithi084.stdout:1/425: truncate d2/d54/d5e/d66/d2a/d2c/d45/f4a 960152 0 2024-04-26T21:25:58.125 INFO:tasks.workunit.client.0.smithi084.stdout:9/356: fsync da/de/d1e/f74 0 2024-04-26T21:25:58.130 INFO:tasks.workunit.client.1.smithi120.stdout:8/543: truncate d5/d6/d11/d32/d3b/f92 103979 0 2024-04-26T21:25:58.131 INFO:tasks.workunit.client.0.smithi084.stdout:0/389: getdents de/d2b/d77 0 2024-04-26T21:25:58.133 INFO:tasks.workunit.client.0.smithi084.stdout:1/426: write d2/d9/f16 [613801,111696] 0 2024-04-26T21:25:58.135 INFO:tasks.workunit.client.0.smithi084.stdout:4/313: dwrite d5/d2e/d5f/f27 [0,4194304] 0 2024-04-26T21:25:58.137 INFO:tasks.workunit.client.0.smithi084.stdout:5/378: dwrite d0/dc/df/d31/d53/f71 [0,4194304] 0 2024-04-26T21:25:58.141 INFO:tasks.workunit.client.0.smithi084.stdout:9/357: creat da/de/d16/d25/d41/d43/d4a/d82/f85 x:0 0 0 2024-04-26T21:25:58.141 INFO:tasks.workunit.client.0.smithi084.stdout:0/390: unlink de/d20/d4c/f70 0 2024-04-26T21:25:58.141 INFO:tasks.workunit.client.0.smithi084.stdout:7/402: creat d6/d9/d63/f87 x:0 0 0 2024-04-26T21:25:58.141 INFO:tasks.workunit.client.0.smithi084.stdout:0/391: chown de/d20/d4c/f61 89 1 2024-04-26T21:25:58.142 INFO:tasks.workunit.client.1.smithi120.stdout:8/544: unlink d5/d6/d11/d32/d3b/f9a 0 2024-04-26T21:25:58.142 INFO:tasks.workunit.client.0.smithi084.stdout:4/314: readlink d5/d10/d15/d21/d29/d3f/d67/l54 0 2024-04-26T21:25:58.142 INFO:tasks.workunit.client.0.smithi084.stdout:5/379: dread - d0/dc/df/d6d/f73 zero size 2024-04-26T21:25:58.145 INFO:tasks.workunit.client.0.smithi084.stdout:1/427: mknod d2/d54/d5e/c87 0 2024-04-26T21:25:58.146 INFO:tasks.workunit.client.1.smithi120.stdout:8/545: read - d5/d6/d34/d42/d9d/f89 zero size 2024-04-26T21:25:58.146 INFO:tasks.workunit.client.0.smithi084.stdout:9/358: write da/de/d16/d25/d41/d67/f6f [939632,100077] 0 2024-04-26T21:25:58.148 INFO:tasks.workunit.client.0.smithi084.stdout:5/380: readlink d0/d17/l28 0 2024-04-26T21:25:58.150 INFO:tasks.workunit.client.0.smithi084.stdout:9/359: chown da/de/d16/d25/d41/d43/d48/l7d 4112 1 2024-04-26T21:25:58.151 INFO:tasks.workunit.client.1.smithi120.stdout:0/688: sync 2024-04-26T21:25:58.154 INFO:tasks.workunit.client.1.smithi120.stdout:6/627: dread d4/db/d25/d6d/f77 [0,4194304] 0 2024-04-26T21:25:58.154 INFO:tasks.workunit.client.1.smithi120.stdout:5/691: dwrite d2/dc/f38 [0,4194304] 0 2024-04-26T21:25:58.156 INFO:tasks.workunit.client.0.smithi084.stdout:0/392: mknod de/d2b/d45/c82 0 2024-04-26T21:25:58.156 INFO:tasks.workunit.client.0.smithi084.stdout:1/428: rmdir d2/d1b 39 2024-04-26T21:25:58.158 INFO:tasks.workunit.client.0.smithi084.stdout:7/403: rename d6/d26/d40/d4f/l6b to d6/d9/d12/d19/d60/l88 0 2024-04-26T21:25:58.160 INFO:tasks.workunit.client.1.smithi120.stdout:8/546: creat d5/d6/d34/d37/d60/fb2 x:0 0 0 2024-04-26T21:25:58.160 INFO:tasks.workunit.client.0.smithi084.stdout:5/381: unlink d0/fd 0 2024-04-26T21:25:58.161 INFO:tasks.workunit.client.1.smithi120.stdout:0/689: write d0/d3/f3c [662351,108143] 0 2024-04-26T21:25:58.161 INFO:tasks.workunit.client.0.smithi084.stdout:7/404: write d6/d9/f11 [5602153,35732] 0 2024-04-26T21:25:58.162 INFO:tasks.workunit.client.0.smithi084.stdout:5/382: dread - d0/dc/df/d6d/f70 zero size 2024-04-26T21:25:58.164 INFO:tasks.workunit.client.0.smithi084.stdout:4/315: mkdir d5/d25/d35/d60/d69 0 2024-04-26T21:25:58.164 INFO:tasks.workunit.client.0.smithi084.stdout:5/383: chown d0/d49/d56/f6f 854 1 2024-04-26T21:25:58.166 INFO:tasks.workunit.client.0.smithi084.stdout:5/384: write d0/f4b [348465,18058] 0 2024-04-26T21:25:58.167 INFO:tasks.workunit.client.1.smithi120.stdout:8/547: chown d5/d6/d34/d37/c8a 376 1 2024-04-26T21:25:58.167 INFO:tasks.workunit.client.0.smithi084.stdout:1/429: unlink d2/d54/d5e/l7b 0 2024-04-26T21:25:58.168 INFO:tasks.workunit.client.1.smithi120.stdout:8/548: readlink d5/d6/d34/d37/l72 0 2024-04-26T21:25:58.171 INFO:tasks.workunit.client.1.smithi120.stdout:6/628: mkdir d4/db/d10/dd/d28/d9e/daf/dd3 0 2024-04-26T21:25:58.173 INFO:tasks.workunit.client.0.smithi084.stdout:1/430: chown d2/d54/d5e/d66/d3a/d77/c80 703594 1 2024-04-26T21:25:58.174 INFO:tasks.workunit.client.0.smithi084.stdout:7/405: mkdir d6/d9/d89 0 2024-04-26T21:25:58.176 INFO:tasks.workunit.client.1.smithi120.stdout:8/549: truncate d5/d6/d34/d42/d9d/d83/f97 377391 0 2024-04-26T21:25:58.243 INFO:tasks.workunit.client.1.smithi120.stdout:0/690: creat d0/d3/dc/d12/fe7 x:0 0 0 2024-04-26T21:25:58.243 INFO:tasks.workunit.client.1.smithi120.stdout:8/550: creat d5/d6/d75/fb3 x:0 0 0 2024-04-26T21:25:58.243 INFO:tasks.workunit.client.1.smithi120.stdout:0/691: symlink d0/d3/dc/dd/d1b/d24/d73/db7/le8 0 2024-04-26T21:25:58.243 INFO:tasks.workunit.client.1.smithi120.stdout:6/629: dread d4/db/d10/dd/d4e/f72 [0,4194304] 0 2024-04-26T21:25:58.243 INFO:tasks.workunit.client.1.smithi120.stdout:0/692: rename d0/d3/dc/d12/d4a/dbc to d0/dd1/dd2/de9 0 2024-04-26T21:25:58.243 INFO:tasks.workunit.client.1.smithi120.stdout:6/630: write d4/db/d10/dd/d28/f61 [2548603,33175] 0 2024-04-26T21:25:58.243 INFO:tasks.workunit.client.1.smithi120.stdout:5/692: write d2/dc/d1d/d21/d66/d6a/d8c/fa6 [449428,33371] 0 2024-04-26T21:25:58.244 INFO:tasks.workunit.client.1.smithi120.stdout:8/551: rename d5/d6/d11/d52/d70/f74 to d5/d6/d34/d37/d94/fb4 0 2024-04-26T21:25:58.244 INFO:tasks.workunit.client.1.smithi120.stdout:5/693: readlink d2/d30/ld6 0 2024-04-26T21:25:58.244 INFO:tasks.workunit.client.1.smithi120.stdout:6/631: chown d4/db/d10/d1a/l88 67871861 1 2024-04-26T21:25:58.244 INFO:tasks.workunit.client.1.smithi120.stdout:5/694: dread - d2/dc/d1d/d1f/d36/d44/fb4 zero size 2024-04-26T21:25:58.244 INFO:tasks.workunit.client.1.smithi120.stdout:1/555: dread d6/d7/d1d/f20 [0,4194304] 0 2024-04-26T21:25:58.244 INFO:tasks.workunit.client.1.smithi120.stdout:1/556: truncate d6/d7/d1b/d55/fa1 638048 0 2024-04-26T21:25:58.244 INFO:tasks.workunit.client.1.smithi120.stdout:0/693: dread d0/d3/dc/fc8 [0,4194304] 0 2024-04-26T21:25:58.244 INFO:tasks.workunit.client.1.smithi120.stdout:5/695: rename d2/dc/d1d/d21/d77/f86 to d2/d1b/dd2/deb/ff9 0 2024-04-26T21:25:58.244 INFO:tasks.workunit.client.1.smithi120.stdout:8/552: dwrite d5/f30 [0,4194304] 0 2024-04-26T21:25:58.244 INFO:tasks.workunit.client.0.smithi084.stdout:2/507: dread d6/d7/f3f [0,4194304] 0 2024-04-26T21:25:58.244 INFO:tasks.workunit.client.0.smithi084.stdout:9/360: getdents da/de/d16/d25/d4f/d5f 0 2024-04-26T21:25:58.245 INFO:tasks.workunit.client.0.smithi084.stdout:0/393: dwrite de/d2b/f6b [0,4194304] 0 2024-04-26T21:25:58.245 INFO:tasks.workunit.client.0.smithi084.stdout:7/406: mknod d6/d1c/c8a 0 2024-04-26T21:25:58.245 INFO:tasks.workunit.client.0.smithi084.stdout:5/385: mknod d0/dc/df/d31/d72/c76 0 2024-04-26T21:25:58.245 INFO:tasks.workunit.client.0.smithi084.stdout:7/407: dread d6/d9/d12/d19/f70 [0,4194304] 0 2024-04-26T21:25:58.245 INFO:tasks.workunit.client.0.smithi084.stdout:4/316: dwrite d5/fe [0,4194304] 0 2024-04-26T21:25:58.245 INFO:tasks.workunit.client.0.smithi084.stdout:0/394: creat de/f83 x:0 0 0 2024-04-26T21:25:58.245 INFO:tasks.workunit.client.0.smithi084.stdout:5/386: creat d0/dc/d48/f77 x:0 0 0 2024-04-26T21:25:58.245 INFO:tasks.workunit.client.0.smithi084.stdout:4/317: chown d5/d7/d65/f5a 16 1 2024-04-26T21:25:58.245 INFO:tasks.workunit.client.0.smithi084.stdout:4/318: write d5/d25/d35/f5e [137654,50950] 0 2024-04-26T21:25:58.245 INFO:tasks.workunit.client.0.smithi084.stdout:4/319: fsync d5/d2e/d5f/d32/d46/f5c 0 2024-04-26T21:25:58.245 INFO:tasks.workunit.client.0.smithi084.stdout:7/408: rename d6/d26/d40/d4f to d6/d9/d12/d8b 0 2024-04-26T21:25:58.245 INFO:tasks.workunit.client.0.smithi084.stdout:1/431: write d2/d19/f32 [1034778,33809] 0 2024-04-26T21:25:58.245 INFO:tasks.workunit.client.0.smithi084.stdout:0/395: creat de/d2b/f84 x:0 0 0 2024-04-26T21:25:58.245 INFO:tasks.workunit.client.0.smithi084.stdout:4/320: dwrite d5/d10/f18 [0,4194304] 0 2024-04-26T21:25:58.246 INFO:tasks.workunit.client.0.smithi084.stdout:1/432: truncate d2/d9/d67/f6a 774227 0 2024-04-26T21:25:58.246 INFO:tasks.workunit.client.0.smithi084.stdout:0/396: symlink de/l85 0 2024-04-26T21:25:58.246 INFO:tasks.workunit.client.0.smithi084.stdout:7/409: dwrite d6/d26/d40/f5b [0,4194304] 0 2024-04-26T21:25:58.247 INFO:tasks.workunit.client.0.smithi084.stdout:2/508: dwrite d6/d7/d3d/d15/d1f/d39/d20/d36/f5d [0,4194304] 0 2024-04-26T21:25:58.248 INFO:tasks.workunit.client.1.smithi120.stdout:1/557: dwrite d6/d7/d2d/d98/f42 [0,4194304] 0 2024-04-26T21:25:58.251 INFO:tasks.workunit.client.0.smithi084.stdout:9/361: dwrite da/de/d1e/f47 [0,4194304] 0 2024-04-26T21:25:58.255 INFO:tasks.workunit.client.0.smithi084.stdout:0/397: creat de/d2b/d45/d63/f86 x:0 0 0 2024-04-26T21:25:58.256 INFO:tasks.workunit.client.1.smithi120.stdout:8/553: getdents d5/d6/d34/d42 0 2024-04-26T21:25:58.259 INFO:tasks.workunit.client.0.smithi084.stdout:4/321: mkdir d5/d10/d15/d21/d29/d3f/d6a 0 2024-04-26T21:25:58.265 INFO:tasks.workunit.client.1.smithi120.stdout:5/696: dwrite d2/d1b/d89/d47/f5b [0,4194304] 0 2024-04-26T21:25:58.267 INFO:tasks.workunit.client.1.smithi120.stdout:6/632: dwrite d4/db/d10/dd/d4e/f72 [4194304,4194304] 0 2024-04-26T21:25:58.267 INFO:tasks.workunit.client.0.smithi084.stdout:0/398: read de/d20/d4e/f75 [16256,91492] 0 2024-04-26T21:25:58.271 INFO:tasks.workunit.client.0.smithi084.stdout:0/399: write f0 [6030558,122120] 0 2024-04-26T21:25:58.273 INFO:tasks.workunit.client.0.smithi084.stdout:2/509: symlink d6/d7/d3d/d15/d1f/d39/d20/d45/lb2 0 2024-04-26T21:25:58.277 INFO:tasks.workunit.client.1.smithi120.stdout:5/697: mknod d2/dc/d1d/d21/d77/d9c/cfa 0 2024-04-26T21:25:58.280 INFO:tasks.workunit.client.0.smithi084.stdout:0/400: stat de/d2b/d64/c6c 0 2024-04-26T21:25:58.280 INFO:tasks.workunit.client.0.smithi084.stdout:4/322: dread d5/d25/d35/f5e [0,4194304] 0 2024-04-26T21:25:58.285 INFO:tasks.workunit.client.1.smithi120.stdout:0/694: dwrite d0/d3/dc/dd/d1b/f8a [0,4194304] 0 2024-04-26T21:25:58.287 INFO:tasks.workunit.client.1.smithi120.stdout:1/558: getdents d6/d7/d1d/d5d/d67 0 2024-04-26T21:25:58.289 INFO:tasks.workunit.client.1.smithi120.stdout:6/633: creat d4/db/d10/dd/db3/fd4 x:0 0 0 2024-04-26T21:25:58.289 INFO:tasks.workunit.client.1.smithi120.stdout:5/698: truncate d2/f5a 1453743 0 2024-04-26T21:25:58.292 INFO:tasks.workunit.client.0.smithi084.stdout:4/323: mknod d5/d10/d15/d21/c6b 0 2024-04-26T21:25:58.293 INFO:tasks.workunit.client.1.smithi120.stdout:0/695: mkdir d0/d3/dc/dd/d4b/dea 0 2024-04-26T21:25:58.301 INFO:tasks.workunit.client.1.smithi120.stdout:6/634: mknod d4/db/d25/cd5 0 2024-04-26T21:25:58.302 INFO:tasks.workunit.client.1.smithi120.stdout:0/696: chown d0/d3/dc/d12/d4a/c84 475063 1 2024-04-26T21:25:58.302 INFO:tasks.workunit.client.1.smithi120.stdout:5/699: creat d2/df6/ffb x:0 0 0 2024-04-26T21:25:58.302 INFO:tasks.workunit.client.1.smithi120.stdout:8/554: dwrite d5/d6/d75/fa6 [0,4194304] 0 2024-04-26T21:25:58.303 INFO:tasks.workunit.client.0.smithi084.stdout:1/433: dread d2/d9/d15/d28/d47/f4b [0,4194304] 0 2024-04-26T21:25:58.306 INFO:tasks.workunit.client.1.smithi120.stdout:1/559: dread d6/d7/d1d/d2c/f76 [0,4194304] 0 2024-04-26T21:25:58.306 INFO:tasks.workunit.client.1.smithi120.stdout:6/635: stat d4/db/d25/d6d/dbd/dc4 0 2024-04-26T21:25:58.308 INFO:tasks.workunit.client.0.smithi084.stdout:1/434: fsync d2/d9/d15/d28/d47/f4f 0 2024-04-26T21:25:58.311 INFO:tasks.workunit.client.1.smithi120.stdout:9/572: sync 2024-04-26T21:25:58.311 INFO:tasks.workunit.client.1.smithi120.stdout:0/697: truncate d0/d3/d13/d81/dba/fbd 297685 0 2024-04-26T21:25:58.311 INFO:tasks.workunit.client.1.smithi120.stdout:2/615: sync 2024-04-26T21:25:58.311 INFO:tasks.workunit.client.1.smithi120.stdout:3/596: sync 2024-04-26T21:25:58.312 INFO:tasks.workunit.client.0.smithi084.stdout:0/401: dwrite de/d20/f5e [4194304,4194304] 0 2024-04-26T21:25:58.316 INFO:tasks.workunit.client.1.smithi120.stdout:2/616: read - d4/d1b/d56/d65/fc5 zero size 2024-04-26T21:25:58.316 INFO:tasks.workunit.client.1.smithi120.stdout:3/597: write dd/de/d18/d24/d43/f4c [1605728,98055] 0 2024-04-26T21:25:58.317 INFO:tasks.workunit.client.1.smithi120.stdout:0/698: write d0/d3/d13/d81/dba/fc2 [241171,16961] 0 2024-04-26T21:25:58.318 INFO:tasks.workunit.client.1.smithi120.stdout:8/555: creat d5/d6/d11/d52/d27/d4f/d67/d85/fb5 x:0 0 0 2024-04-26T21:25:58.318 INFO:tasks.workunit.client.0.smithi084.stdout:5/387: dread d0/f2 [0,4194304] 0 2024-04-26T21:25:58.318 INFO:tasks.workunit.client.0.smithi084.stdout:1/435: read - d2/d9/d15/d28/d47/f4f zero size 2024-04-26T21:25:58.320 INFO:tasks.workunit.client.0.smithi084.stdout:0/402: rmdir de/d2b/d64 39 2024-04-26T21:25:58.320 INFO:tasks.workunit.client.1.smithi120.stdout:9/573: mknod d0/dd/d3a/dae/cb9 0 2024-04-26T21:25:58.321 INFO:tasks.workunit.client.0.smithi084.stdout:1/436: chown d2/d9/d15/d28 438 1 2024-04-26T21:25:58.321 INFO:tasks.workunit.client.0.smithi084.stdout:0/403: chown de/d20/f5e 422351 1 2024-04-26T21:25:58.324 INFO:tasks.workunit.client.0.smithi084.stdout:0/404: read - de/d2b/f84 zero size 2024-04-26T21:25:58.326 INFO:tasks.workunit.client.1.smithi120.stdout:3/598: truncate dd/fa3 4476498 0 2024-04-26T21:25:58.326 INFO:tasks.workunit.client.1.smithi120.stdout:9/574: fdatasync d0/d14/d77/d9a/fac 0 2024-04-26T21:25:58.327 INFO:tasks.workunit.client.1.smithi120.stdout:8/556: fdatasync d5/d6/d11/d52/f6a 0 2024-04-26T21:25:58.328 INFO:tasks.workunit.client.1.smithi120.stdout:7/600: sync 2024-04-26T21:25:58.329 INFO:tasks.workunit.client.1.smithi120.stdout:4/585: sync 2024-04-26T21:25:58.329 INFO:tasks.workunit.client.0.smithi084.stdout:0/405: dread - de/d2b/d77/f49 zero size 2024-04-26T21:25:58.331 INFO:tasks.workunit.client.1.smithi120.stdout:4/586: fsync d10/d12/f35 0 2024-04-26T21:25:58.336 INFO:tasks.workunit.client.0.smithi084.stdout:5/388: mkdir d0/dc/d78 0 2024-04-26T21:25:58.339 INFO:tasks.workunit.client.1.smithi120.stdout:1/560: creat d6/d7/d2d/fbc x:0 0 0 2024-04-26T21:25:58.343 INFO:tasks.workunit.client.1.smithi120.stdout:7/601: symlink d7/d64/da6/d1f/d28/dbb/lcc 0 2024-04-26T21:25:58.343 INFO:tasks.workunit.client.1.smithi120.stdout:3/599: dread dd/de/d18/d24/f7a [0,4194304] 0 2024-04-26T21:25:58.349 INFO:tasks.workunit.client.1.smithi120.stdout:9/575: creat d0/dd/d3a/d5c/fba x:0 0 0 2024-04-26T21:25:58.350 INFO:tasks.workunit.client.1.smithi120.stdout:8/557: symlink d5/d6/d11/d52/d27/lb6 0 2024-04-26T21:25:58.350 INFO:tasks.workunit.client.0.smithi084.stdout:0/406: dwrite de/f7a [0,4194304] 0 2024-04-26T21:25:58.351 INFO:tasks.workunit.client.1.smithi120.stdout:6/636: getdents d4/db/d25/d6d/dbd 0 2024-04-26T21:25:58.352 INFO:tasks.workunit.client.1.smithi120.stdout:2/617: getdents d4/d1b 0 2024-04-26T21:25:58.353 INFO:tasks.workunit.client.0.smithi084.stdout:0/407: mknod de/d78/c87 0 2024-04-26T21:25:58.357 INFO:tasks.workunit.client.0.smithi084.stdout:2/510: dread d6/d7/d3d/d15/d1f/d39/f48 [0,4194304] 0 2024-04-26T21:25:58.361 INFO:tasks.workunit.client.1.smithi120.stdout:6/637: readlink d4/db/d25/la8 0 2024-04-26T21:25:58.361 INFO:tasks.workunit.client.1.smithi120.stdout:1/561: creat d6/d7/d1d/d2c/d73/fbd x:0 0 0 2024-04-26T21:25:58.361 INFO:tasks.workunit.client.1.smithi120.stdout:0/699: write d0/d3/dc/dd/d1b/d24/fdd [1281870,114350] 0 2024-04-26T21:25:58.362 INFO:tasks.workunit.client.1.smithi120.stdout:2/618: read - d4/d1b/d56/fb5 zero size 2024-04-26T21:25:58.362 INFO:tasks.workunit.client.0.smithi084.stdout:0/408: rename de/d20/f36 to de/d71/f88 0 2024-04-26T21:25:58.363 INFO:tasks.workunit.client.1.smithi120.stdout:7/602: mknod d7/d64/da6/d1a/d33/d34/dab/dbf/ccd 0 2024-04-26T21:25:58.364 INFO:tasks.workunit.client.1.smithi120.stdout:5/700: dwrite d2/dc/d1d/d1f/d36/f76 [4194304,4194304] 0 2024-04-26T21:25:58.366 INFO:tasks.workunit.client.0.smithi084.stdout:5/389: write d0/dc/df/d31/d53/f71 [2824323,33924] 0 2024-04-26T21:25:58.366 INFO:tasks.workunit.client.0.smithi084.stdout:2/511: rmdir d6/d7/d3d/d15/d1f/d22/d2a 39 2024-04-26T21:25:58.366 INFO:tasks.workunit.client.1.smithi120.stdout:8/558: mknod d5/d6/d34/da7/cb7 0 2024-04-26T21:25:58.367 INFO:tasks.workunit.client.0.smithi084.stdout:0/409: rmdir de/d2b/d77 39 2024-04-26T21:25:58.373 INFO:tasks.workunit.client.1.smithi120.stdout:1/562: stat d6/d7/d1d/d5d/d67/c4a 0 2024-04-26T21:25:58.374 INFO:tasks.workunit.client.1.smithi120.stdout:4/587: dwrite d10/f5b [0,4194304] 0 2024-04-26T21:25:58.376 INFO:tasks.workunit.client.0.smithi084.stdout:4/324: dread d5/d10/d15/d21/d29/d3f/f4f [0,4194304] 0 2024-04-26T21:25:58.378 INFO:tasks.workunit.client.0.smithi084.stdout:2/512: symlink d6/d7/d3d/d4f/d90/lb3 0 2024-04-26T21:25:58.381 INFO:tasks.workunit.client.1.smithi120.stdout:8/559: write d5/d6/d11/f6b [3873166,32820] 0 2024-04-26T21:25:58.382 INFO:tasks.workunit.client.1.smithi120.stdout:9/576: mknod d0/dd/d3a/d5c/d98/db8/cbb 0 2024-04-26T21:25:58.383 INFO:tasks.workunit.client.1.smithi120.stdout:1/563: write d6/d7/ff [780509,119280] 0 2024-04-26T21:25:58.384 INFO:tasks.workunit.client.1.smithi120.stdout:3/600: dwrite dd/de/d18/d37/d80/f9c [0,4194304] 0 2024-04-26T21:25:58.384 INFO:tasks.workunit.client.1.smithi120.stdout:0/700: unlink d0/d3/dc/d12/fe7 0 2024-04-26T21:25:58.389 INFO:tasks.workunit.client.0.smithi084.stdout:0/410: creat de/d2b/d64/d81/f89 x:0 0 0 2024-04-26T21:25:58.392 INFO:tasks.workunit.client.1.smithi120.stdout:2/619: write d4/d1b/d2e/d50/d14/d15/f84 [691992,84471] 0 2024-04-26T21:25:58.393 INFO:tasks.workunit.client.1.smithi120.stdout:1/564: chown d6/d7/d1d/d2c/f93 32417201 1 2024-04-26T21:25:58.395 INFO:tasks.workunit.client.1.smithi120.stdout:0/701: readlink d0/d3/dc/d12/d4a/l8e 0 2024-04-26T21:25:58.396 INFO:tasks.workunit.client.1.smithi120.stdout:7/603: unlink d7/d64/da6/c3f 0 2024-04-26T21:25:58.397 INFO:tasks.workunit.client.0.smithi084.stdout:5/390: rename d0/dc/df/l37 to d0/dc/df/d6d/l79 0 2024-04-26T21:25:58.398 INFO:tasks.workunit.client.1.smithi120.stdout:2/620: chown d4/d1b/d56/fc7 1465117 1 2024-04-26T21:25:58.398 INFO:tasks.workunit.client.0.smithi084.stdout:5/391: chown d0/d49/d56 1638779 1 2024-04-26T21:25:58.399 INFO:tasks.workunit.client.1.smithi120.stdout:3/601: mknod dd/de/d83/d64/db0/cbd 0 2024-04-26T21:25:58.400 INFO:tasks.workunit.client.1.smithi120.stdout:4/588: fsync d10/d28/f29 0 2024-04-26T21:25:58.403 INFO:tasks.workunit.client.0.smithi084.stdout:4/325: truncate d5/f23 860335 0 2024-04-26T21:25:58.403 INFO:tasks.workunit.client.1.smithi120.stdout:8/560: fsync d5/d6/d34/d42/f84 0 2024-04-26T21:25:58.407 INFO:tasks.workunit.client.0.smithi084.stdout:4/326: write d5/d2e/d5f/d32/d46/f5c [459920,25957] 0 2024-04-26T21:25:58.409 INFO:tasks.workunit.client.1.smithi120.stdout:5/701: dwrite d2/f3d [0,4194304] 0 2024-04-26T21:25:58.412 INFO:tasks.workunit.client.1.smithi120.stdout:4/589: chown d10/d6b/la0 675009851 1 2024-04-26T21:25:58.412 INFO:tasks.workunit.client.1.smithi120.stdout:2/621: mkdir d4/d1b/d2e/da0/dca 0 2024-04-26T21:25:58.414 INFO:tasks.workunit.client.0.smithi084.stdout:2/513: rename d6/d7/d3d/d15/d1f/d39/d20/l73 to d6/d7/d3d/d15/d1f/d39/d20/d45/d6d/lb4 0 2024-04-26T21:25:58.416 INFO:tasks.workunit.client.1.smithi120.stdout:9/577: dread d0/dd/d45/f63 [0,4194304] 0 2024-04-26T21:25:58.422 INFO:tasks.workunit.client.0.smithi084.stdout:2/514: fdatasync d6/d7/d3d/d15/d1f/d39/d20/f3a 0 2024-04-26T21:25:58.423 INFO:tasks.workunit.client.1.smithi120.stdout:8/561: mkdir d5/d6/d34/d37/db8 0 2024-04-26T21:25:58.424 INFO:tasks.workunit.client.1.smithi120.stdout:4/590: symlink d10/d6b/dbf/lc7 0 2024-04-26T21:25:58.425 INFO:tasks.workunit.client.1.smithi120.stdout:3/602: mknod dd/de/d18/d37/d80/da9/cbe 0 2024-04-26T21:25:58.426 INFO:tasks.workunit.client.0.smithi084.stdout:5/392: creat d0/dc/df/f7a x:0 0 0 2024-04-26T21:25:58.427 INFO:tasks.workunit.client.1.smithi120.stdout:0/702: write d0/d3/dc/dd/d1b/f78 [1041735,18957] 0 2024-04-26T21:25:58.429 INFO:tasks.workunit.client.1.smithi120.stdout:9/578: fsync d0/dd/d45/f4a 0 2024-04-26T21:25:58.432 INFO:tasks.workunit.client.0.smithi084.stdout:5/393: fdatasync d0/dc/f1c 0 2024-04-26T21:25:58.433 INFO:tasks.workunit.client.1.smithi120.stdout:2/622: rename d4/d1b/d2e/da0 to d4/d1b/d25/d2c/d3e/d5e/d63/dcb 0 2024-04-26T21:25:58.437 INFO:tasks.workunit.client.1.smithi120.stdout:6/638: dwrite d4/db/d10/d22/d56/d94/fd0 [0,4194304] 0 2024-04-26T21:25:58.437 INFO:tasks.workunit.client.0.smithi084.stdout:2/515: read f0 [288664,97151] 0 2024-04-26T21:25:58.441 INFO:tasks.workunit.client.1.smithi120.stdout:3/603: creat dd/d2a/d74/fbf x:0 0 0 2024-04-26T21:25:58.442 INFO:tasks.workunit.client.0.smithi084.stdout:0/411: dread de/d2b/f39 [0,4194304] 0 2024-04-26T21:25:58.442 INFO:tasks.workunit.client.1.smithi120.stdout:4/591: symlink d10/da6/lc8 0 2024-04-26T21:25:58.443 INFO:tasks.workunit.client.1.smithi120.stdout:8/562: fsync d5/d6/d34/d37/d60/f65 0 2024-04-26T21:25:58.447 INFO:tasks.workunit.client.1.smithi120.stdout:7/604: dwrite d7/d64/da6/d1a/d33/d34/d37/f79 [0,4194304] 0 2024-04-26T21:25:58.447 INFO:tasks.workunit.client.1.smithi120.stdout:0/703: rename d0/d3/dc/dd/d1b/d24/d73/le2 to d0/d3/dc/d12/d31/leb 0 2024-04-26T21:25:58.449 INFO:tasks.workunit.client.1.smithi120.stdout:8/563: stat d5/d6/ca0 0 2024-04-26T21:25:58.450 INFO:tasks.workunit.client.0.smithi084.stdout:5/394: rename d0/c3d to d0/dc/df/d6d/c7b 0 2024-04-26T21:25:58.451 INFO:tasks.workunit.client.1.smithi120.stdout:4/592: creat d10/d28/d73/da2/fc9 x:0 0 0 2024-04-26T21:25:58.453 INFO:tasks.workunit.client.1.smithi120.stdout:9/579: mkdir d0/d14/d2d/d4b/dbc 0 2024-04-26T21:25:58.455 INFO:tasks.workunit.client.1.smithi120.stdout:6/639: mknod d4/db/d10/d1a/d2b/d57/d67/cd6 0 2024-04-26T21:25:58.456 INFO:tasks.workunit.client.1.smithi120.stdout:4/593: dread - d10/d65/d8c/f94 zero size 2024-04-26T21:25:58.458 INFO:tasks.workunit.client.1.smithi120.stdout:1/565: dread d6/f3a [0,4194304] 0 2024-04-26T21:25:58.458 INFO:tasks.workunit.client.0.smithi084.stdout:0/412: write de/d2b/d77/d32/f6e [996412,60762] 0 2024-04-26T21:25:58.461 INFO:tasks.workunit.client.0.smithi084.stdout:5/395: write d0/d17/f5b [1867729,111919] 0 2024-04-26T21:25:58.463 INFO:tasks.workunit.client.0.smithi084.stdout:2/516: dread d6/d1b/f2c [0,4194304] 0 2024-04-26T21:25:58.464 INFO:tasks.workunit.client.1.smithi120.stdout:1/566: write d6/d7/d1b/f3d [1301256,125458] 0 2024-04-26T21:25:58.467 INFO:tasks.workunit.client.0.smithi084.stdout:4/327: dwrite d5/d25/f47 [0,4194304] 0 2024-04-26T21:25:58.472 INFO:tasks.workunit.client.1.smithi120.stdout:5/702: truncate d2/dc/d1d/d21/d66/fa2 2750889 0 2024-04-26T21:25:58.472 INFO:tasks.workunit.client.1.smithi120.stdout:0/704: creat d0/df/d79/fec x:0 0 0 2024-04-26T21:25:58.473 INFO:tasks.workunit.client.0.smithi084.stdout:2/517: write d6/d1b/f7a [299896,58131] 0 2024-04-26T21:25:58.474 INFO:tasks.workunit.client.0.smithi084.stdout:0/413: write de/d71/f57 [3071339,14378] 0 2024-04-26T21:25:58.477 INFO:tasks.workunit.client.0.smithi084.stdout:5/396: write d0/d49/d56/f6f [560099,50452] 0 2024-04-26T21:25:58.477 INFO:tasks.workunit.client.1.smithi120.stdout:5/703: chown d2/dc/d1d/d21/d77/d79/l83 23724067 1 2024-04-26T21:25:58.480 INFO:tasks.workunit.client.0.smithi084.stdout:0/414: fdatasync de/d2b/d77/d32/f44 0 2024-04-26T21:25:58.483 INFO:tasks.workunit.client.1.smithi120.stdout:2/623: dread d4/d1b/d2e/d50/f2a [0,4194304] 0 2024-04-26T21:25:58.483 INFO:tasks.workunit.client.1.smithi120.stdout:0/705: dread - d0/df/f9d zero size 2024-04-26T21:25:58.491 INFO:tasks.workunit.client.0.smithi084.stdout:2/518: symlink d6/d7/lb5 0 2024-04-26T21:25:58.491 INFO:tasks.workunit.client.0.smithi084.stdout:4/328: dwrite d5/d25/f3e [0,4194304] 0 2024-04-26T21:25:58.491 INFO:tasks.workunit.client.1.smithi120.stdout:9/580: creat d0/d6/fbd x:0 0 0 2024-04-26T21:25:58.497 INFO:tasks.workunit.client.1.smithi120.stdout:1/567: write d6/d7/d1b/f8a [1730216,124566] 0 2024-04-26T21:25:58.500 INFO:tasks.workunit.client.0.smithi084.stdout:5/397: unlink d0/dc/df/d2a/l2b 0 2024-04-26T21:25:58.500 INFO:tasks.workunit.client.0.smithi084.stdout:4/329: symlink d5/d7/l6c 0 2024-04-26T21:25:58.501 INFO:tasks.workunit.client.1.smithi120.stdout:2/624: fdatasync d4/d1b/d25/f32 0 2024-04-26T21:25:58.504 INFO:tasks.workunit.client.0.smithi084.stdout:2/519: fdatasync d6/d7/d3d/d15/d1f/d41/f65 0 2024-04-26T21:25:58.504 INFO:tasks.workunit.client.1.smithi120.stdout:5/704: rename d2/d1b/d89/d47/d8a/cc3 to d2/dc/d1d/d1f/d36/d44/d6c/df5/cfc 0 2024-04-26T21:25:58.507 INFO:tasks.workunit.client.0.smithi084.stdout:2/520: read d6/d7/d3d/d15/d1f/d39/d20/d45/f51 [677296,122540] 0 2024-04-26T21:25:58.508 INFO:tasks.workunit.client.1.smithi120.stdout:1/568: dread - d6/d7/d1d/d2c/d58/f9f zero size 2024-04-26T21:25:58.510 INFO:tasks.workunit.client.0.smithi084.stdout:5/398: dread - d0/dc/d48/f77 zero size 2024-04-26T21:25:58.510 INFO:tasks.workunit.client.1.smithi120.stdout:5/705: creat d2/dc/ffd x:0 0 0 2024-04-26T21:25:58.513 INFO:tasks.workunit.client.0.smithi084.stdout:2/521: dread d6/d7/d68/f71 [0,4194304] 0 2024-04-26T21:25:58.513 INFO:tasks.workunit.client.1.smithi120.stdout:7/605: dwrite d7/d19/f51 [0,4194304] 0 2024-04-26T21:25:58.514 INFO:tasks.workunit.client.0.smithi084.stdout:4/330: mkdir d5/d25/d35/d60/d6d 0 2024-04-26T21:25:58.514 INFO:tasks.workunit.client.1.smithi120.stdout:6/640: dwrite d4/db/d10/dd/db3/fb5 [0,4194304] 0 2024-04-26T21:25:58.515 INFO:tasks.workunit.client.0.smithi084.stdout:4/331: dread d5/d25/d35/f5e [0,4194304] 0 2024-04-26T21:25:58.516 INFO:tasks.workunit.client.0.smithi084.stdout:5/399: write d0/f16 [2402701,129700] 0 2024-04-26T21:25:58.518 INFO:tasks.workunit.client.1.smithi120.stdout:8/564: dread d5/d6/d11/f31 [0,4194304] 0 2024-04-26T21:25:58.518 INFO:tasks.workunit.client.1.smithi120.stdout:1/569: stat d6/d7/d1b/d55/la2 0 2024-04-26T21:25:58.520 INFO:tasks.workunit.client.0.smithi084.stdout:4/332: dread d5/d2e/d5f/f51 [0,4194304] 0 2024-04-26T21:25:58.522 INFO:tasks.workunit.client.0.smithi084.stdout:5/400: symlink d0/dc/df/d51/l7c 0 2024-04-26T21:25:58.526 INFO:tasks.workunit.client.0.smithi084.stdout:2/522: mkdir d6/d7/db6 0 2024-04-26T21:25:58.528 INFO:tasks.workunit.client.1.smithi120.stdout:2/625: truncate d4/d1b/d2e/d50/d14/d15/f43 1676821 0 2024-04-26T21:25:58.531 INFO:tasks.workunit.client.0.smithi084.stdout:2/523: truncate d6/d1b/f7a 979850 0 2024-04-26T21:25:58.532 INFO:tasks.workunit.client.1.smithi120.stdout:7/606: chown d7/d64/da6/d1f/d28/c8c 1415 1 2024-04-26T21:25:58.532 INFO:tasks.workunit.client.0.smithi084.stdout:2/524: fsync d6/d7/d3d/fac 0 2024-04-26T21:25:58.533 INFO:tasks.workunit.client.1.smithi120.stdout:3/604: dread dd/de/d18/d24/db1/f8a [0,4194304] 0 2024-04-26T21:25:58.533 INFO:tasks.workunit.client.0.smithi084.stdout:4/333: rename d5/d25/c33 to d5/d2e/d5f/d32/c6e 0 2024-04-26T21:25:58.536 INFO:tasks.workunit.client.1.smithi120.stdout:1/570: chown d6/d7/d1b/d3b/lb5 504 1 2024-04-26T21:25:58.536 INFO:tasks.workunit.client.1.smithi120.stdout:8/565: dread d5/d6/d11/d32/d3b/f92 [0,4194304] 0 2024-04-26T21:25:58.536 INFO:tasks.workunit.client.1.smithi120.stdout:6/641: link d4/db/f5a d4/db/d10/d22/d56/d94/fd7 0 2024-04-26T21:25:58.536 INFO:tasks.workunit.client.1.smithi120.stdout:4/594: dread d10/d12/f55 [0,4194304] 0 2024-04-26T21:25:58.538 INFO:tasks.workunit.client.1.smithi120.stdout:2/626: chown d4/d1b/d25/d2c/f46 3335484 1 2024-04-26T21:25:58.538 INFO:tasks.workunit.client.1.smithi120.stdout:1/571: readlink d6/l7e 0 2024-04-26T21:25:58.539 INFO:tasks.workunit.client.1.smithi120.stdout:3/605: stat dd/de/d18/d8d/l96 0 2024-04-26T21:25:58.540 INFO:tasks.workunit.client.1.smithi120.stdout:9/581: dwrite d0/d6/d4d/d65/f71 [0,4194304] 0 2024-04-26T21:25:58.540 INFO:tasks.workunit.client.1.smithi120.stdout:4/595: chown d10/d65/d72/c88 9387763 1 2024-04-26T21:25:58.541 INFO:tasks.workunit.client.1.smithi120.stdout:7/607: symlink d7/d64/da6/d1a/d33/d34/d37/lce 0 2024-04-26T21:25:58.543 INFO:tasks.workunit.client.0.smithi084.stdout:4/334: rename d5/d25/c55 to d5/d25/d35/d60/d69/c6f 0 2024-04-26T21:25:58.547 INFO:tasks.workunit.client.1.smithi120.stdout:2/627: mknod d4/d1b/d25/d29/ccc 0 2024-04-26T21:25:58.550 INFO:tasks.workunit.client.0.smithi084.stdout:5/401: dwrite d0/dc/df/d2a/f46 [0,4194304] 0 2024-04-26T21:25:58.554 INFO:tasks.workunit.client.1.smithi120.stdout:6/642: symlink d4/db/d10/d22/ld8 0 2024-04-26T21:25:58.555 INFO:tasks.workunit.client.0.smithi084.stdout:5/402: chown d0/d17/l28 27225 1 2024-04-26T21:25:58.555 INFO:tasks.workunit.client.0.smithi084.stdout:4/335: rename d5/d10/d15/d21/d29/d3f to d5/d10/d15/d21/d29/d70 0 2024-04-26T21:25:58.556 INFO:tasks.workunit.client.1.smithi120.stdout:5/706: dwrite d2/dc/d1d/d21/d77/d79/db7/d5f/fe2 [0,4194304] 0 2024-04-26T21:25:58.561 INFO:tasks.workunit.client.0.smithi084.stdout:4/336: write d5/d25/d35/f5e [269216,67295] 0 2024-04-26T21:25:58.564 INFO:tasks.workunit.client.1.smithi120.stdout:3/606: dwrite dd/de/d18/d37/f4e [0,4194304] 0 2024-04-26T21:25:58.572 INFO:tasks.workunit.client.1.smithi120.stdout:3/607: chown dd/d2a/f5f 78923321 1 2024-04-26T21:25:58.576 INFO:tasks.workunit.client.1.smithi120.stdout:3/608: dread dd/de/d83/d64/fa4 [0,4194304] 0 2024-04-26T21:25:58.577 INFO:tasks.workunit.client.0.smithi084.stdout:5/403: dread d0/dc/df/d31/f3c [0,4194304] 0 2024-04-26T21:25:58.581 INFO:tasks.workunit.client.0.smithi084.stdout:2/525: dread d6/d7/d3d/d15/d1f/d22/f24 [0,4194304] 0 2024-04-26T21:25:58.600 INFO:tasks.workunit.client.0.smithi084.stdout:5/404: dwrite d0/f64 [0,4194304] 0 2024-04-26T21:25:58.615 INFO:tasks.workunit.client.0.smithi084.stdout:5/405: getdents d0/dc/df/d31 0 2024-04-26T21:25:58.617 INFO:tasks.workunit.client.0.smithi084.stdout:2/526: write d6/d1b/f98 [1096705,93691] 0 2024-04-26T21:25:58.621 INFO:tasks.workunit.client.0.smithi084.stdout:2/527: symlink d6/d1b/lb7 0 2024-04-26T21:25:58.621 INFO:tasks.workunit.client.0.smithi084.stdout:4/337: dread d5/f2b [0,4194304] 0 2024-04-26T21:25:58.638 INFO:tasks.workunit.client.0.smithi084.stdout:4/338: dread d5/d10/d15/d21/d29/d70/f4f [0,4194304] 0 2024-04-26T21:25:58.640 INFO:tasks.workunit.client.0.smithi084.stdout:4/339: chown d5/d7/d65/c62 72485102 1 2024-04-26T21:25:58.642 INFO:tasks.workunit.client.1.smithi120.stdout:3/609: unlink dd/d40/l58 0 2024-04-26T21:25:58.643 INFO:tasks.workunit.client.0.smithi084.stdout:5/406: creat d0/dc/df/d31/d45/f7d x:0 0 0 2024-04-26T21:25:58.647 INFO:tasks.workunit.client.0.smithi084.stdout:5/407: creat d0/d17/f7e x:0 0 0 2024-04-26T21:25:58.650 INFO:tasks.workunit.client.1.smithi120.stdout:1/572: creat d6/d7/d2d/d48/fbe x:0 0 0 2024-04-26T21:25:58.652 INFO:tasks.workunit.client.0.smithi084.stdout:2/528: dwrite d6/d7/d3d/d15/d1f/d39/d43/fab [0,4194304] 0 2024-04-26T21:25:58.653 INFO:tasks.workunit.client.1.smithi120.stdout:9/582: creat d0/d14/d2d/fbe x:0 0 0 2024-04-26T21:25:58.654 INFO:tasks.workunit.client.0.smithi084.stdout:5/408: dread d0/d49/d56/f6f [0,4194304] 0 2024-04-26T21:25:58.656 INFO:tasks.workunit.client.1.smithi120.stdout:7/608: dwrite d7/d10/f6a [4194304,4194304] 0 2024-04-26T21:25:58.660 INFO:tasks.workunit.client.0.smithi084.stdout:4/340: dwrite d5/d2e/d5f/d32/d46/f5c [0,4194304] 0 2024-04-26T21:25:58.663 INFO:tasks.workunit.client.0.smithi084.stdout:2/529: mknod d6/d7/d3d/d79/d81/d82/da8/cb8 0 2024-04-26T21:25:58.663 INFO:tasks.workunit.client.0.smithi084.stdout:5/409: symlink d0/l7f 0 2024-04-26T21:25:58.669 INFO:tasks.workunit.client.0.smithi084.stdout:4/341: creat d5/d10/f71 x:0 0 0 2024-04-26T21:25:58.675 INFO:tasks.workunit.client.0.smithi084.stdout:4/342: mkdir d5/d2e/d72 0 2024-04-26T21:25:58.680 INFO:tasks.workunit.client.0.smithi084.stdout:4/343: chown d5/d10/d15/d21/d29/d70/c53 761767 1 2024-04-26T21:25:58.681 INFO:tasks.workunit.client.0.smithi084.stdout:5/410: dread d0/dc/f43 [0,4194304] 0 2024-04-26T21:25:58.684 INFO:tasks.workunit.client.0.smithi084.stdout:4/344: getdents d5/d10/d15/d21/d29/d70/d6a 0 2024-04-26T21:25:58.687 INFO:tasks.workunit.client.0.smithi084.stdout:5/411: creat d0/f80 x:0 0 0 2024-04-26T21:25:58.688 INFO:tasks.workunit.client.0.smithi084.stdout:5/412: readlink d0/l7f 0 2024-04-26T21:25:58.691 INFO:tasks.workunit.client.0.smithi084.stdout:5/413: fdatasync d0/dc/df/d31/f54 0 2024-04-26T21:25:58.692 INFO:tasks.workunit.client.1.smithi120.stdout:3/610: mknod dd/de/d83/d64/cc0 0 2024-04-26T21:25:58.694 INFO:tasks.workunit.client.0.smithi084.stdout:4/345: creat d5/d10/d15/d21/d29/d70/f73 x:0 0 0 2024-04-26T21:25:58.697 INFO:tasks.workunit.client.0.smithi084.stdout:5/414: truncate d0/dc/df/d2a/f46 4284528 0 2024-04-26T21:25:58.697 INFO:tasks.workunit.client.1.smithi120.stdout:6/643: truncate d4/db/d25/d6d/d97/f6f 18968 0 2024-04-26T21:25:58.700 INFO:tasks.workunit.client.1.smithi120.stdout:7/609: mkdir d7/d64/da6/d1f/d28/dbb/dcf 0 2024-04-26T21:25:58.701 INFO:tasks.workunit.client.1.smithi120.stdout:6/644: dread - d4/db/d25/d6d/d97/fbb zero size 2024-04-26T21:25:58.702 INFO:tasks.workunit.client.0.smithi084.stdout:4/346: rmdir d5/d2e/d72 0 2024-04-26T21:25:58.702 INFO:tasks.workunit.client.0.smithi084.stdout:2/530: dread d6/d7/d3d/d15/d1f/f32 [0,4194304] 0 2024-04-26T21:25:58.703 INFO:tasks.workunit.client.1.smithi120.stdout:3/611: readlink dd/de/d18/d24/db1/d76/d3b/d56/l68 0 2024-04-26T21:25:58.704 INFO:tasks.workunit.client.1.smithi120.stdout:7/610: read - d7/d64/da6/d1f/d28/d4c/d6b/d7b/fc6 zero size 2024-04-26T21:25:58.705 INFO:tasks.workunit.client.1.smithi120.stdout:9/583: dread d0/d14/d77/fb1 [0,4194304] 0 2024-04-26T21:25:58.709 INFO:tasks.workunit.client.1.smithi120.stdout:6/645: truncate d4/db/d10/d1a/d2b/f93 29301 0 2024-04-26T21:25:58.713 INFO:tasks.workunit.client.1.smithi120.stdout:9/584: unlink d0/dd/d3a/f46 0 2024-04-26T21:25:58.714 INFO:tasks.workunit.client.1.smithi120.stdout:9/585: dread - d0/dd/d34/fa6 zero size 2024-04-26T21:25:58.717 INFO:tasks.workunit.client.1.smithi120.stdout:6/646: mkdir d4/d3d/dd9 0 2024-04-26T21:25:58.720 INFO:tasks.workunit.client.1.smithi120.stdout:3/612: link dd/de/d83/d64/db0/f77 dd/de/d18/d24/fc1 0 2024-04-26T21:25:58.721 INFO:tasks.workunit.client.0.smithi084.stdout:5/415: dwrite d0/dc/df/d2a/f40 [0,4194304] 0 2024-04-26T21:25:58.722 INFO:tasks.workunit.client.1.smithi120.stdout:6/647: dread - d4/db/d10/dd/d4e/f85 zero size 2024-04-26T21:25:58.725 INFO:tasks.workunit.client.1.smithi120.stdout:4/596: mknod d10/d28/cca 0 2024-04-26T21:25:58.727 INFO:tasks.workunit.client.1.smithi120.stdout:4/597: chown d10/d28/d73/c92 9716 1 2024-04-26T21:25:58.729 INFO:tasks.workunit.client.1.smithi120.stdout:4/598: chown d10/lb4 157 1 2024-04-26T21:25:58.730 INFO:tasks.workunit.client.1.smithi120.stdout:6/648: mknod d4/db/d10/dd/db3/cda 0 2024-04-26T21:25:58.732 INFO:tasks.workunit.client.0.smithi084.stdout:5/416: creat d0/dc/df/d51/f81 x:0 0 0 2024-04-26T21:25:58.734 INFO:tasks.workunit.client.0.smithi084.stdout:2/531: dwrite d6/d7/d3d/d15/d1f/d39/fe [0,4194304] 0 2024-04-26T21:25:58.736 INFO:tasks.workunit.client.1.smithi120.stdout:8/566: write d5/d6/d11/d52/d27/f6d [991175,93478] 0 2024-04-26T21:25:58.738 INFO:tasks.workunit.client.1.smithi120.stdout:0/706: sync 2024-04-26T21:25:58.740 INFO:tasks.workunit.client.1.smithi120.stdout:0/707: stat d0/f10 0 2024-04-26T21:25:58.743 INFO:tasks.workunit.client.0.smithi084.stdout:4/347: dwrite d5/d25/d35/d60/f64 [0,4194304] 0 2024-04-26T21:25:58.745 INFO:tasks.workunit.client.0.smithi084.stdout:4/348: chown d5/d25 1904854176 1 2024-04-26T21:25:58.747 INFO:tasks.workunit.client.1.smithi120.stdout:3/613: rename f6 to dd/de/d18/d37/d80/da9/fc2 0 2024-04-26T21:25:58.748 INFO:tasks.workunit.client.0.smithi084.stdout:4/349: truncate d5/d2e/d5f/f27 5304900 0 2024-04-26T21:25:58.750 INFO:tasks.workunit.client.1.smithi120.stdout:0/708: creat d0/df/d59/fed x:0 0 0 2024-04-26T21:25:58.752 INFO:tasks.workunit.client.1.smithi120.stdout:0/709: write d0/d3/f4f [1937818,107043] 0 2024-04-26T21:25:58.753 INFO:tasks.workunit.client.0.smithi084.stdout:2/532: symlink d6/d7/d3d/d15/d1f/d39/d43/lb9 0 2024-04-26T21:25:58.753 INFO:tasks.workunit.client.1.smithi120.stdout:6/649: dwrite d4/db/d10/f92 [0,4194304] 0 2024-04-26T21:25:58.754 INFO:tasks.workunit.client.0.smithi084.stdout:4/350: readlink d5/l1c 0 2024-04-26T21:25:58.769 INFO:tasks.workunit.client.0.smithi084.stdout:2/533: getdents d6/d7/d3d/d15/d1f/d41 0 2024-04-26T21:25:58.770 INFO:tasks.workunit.client.1.smithi120.stdout:5/707: sync 2024-04-26T21:25:58.776 INFO:tasks.workunit.client.1.smithi120.stdout:5/708: fdatasync d2/dc/d1d/d1f/d36/f65 0 2024-04-26T21:25:58.779 INFO:tasks.workunit.client.0.smithi084.stdout:2/534: creat d6/d7/d3d/d79/d81/d82/da8/fba x:0 0 0 2024-04-26T21:25:58.780 INFO:tasks.workunit.client.0.smithi084.stdout:4/351: dread d5/d25/f2f [0,4194304] 0 2024-04-26T21:25:58.783 INFO:tasks.workunit.client.1.smithi120.stdout:0/710: dwrite d0/d3/dc/dd/d1b/f8a [4194304,4194304] 0 2024-04-26T21:25:58.784 INFO:tasks.workunit.client.1.smithi120.stdout:1/573: dwrite d6/d7/d1d/d5d/d67/fb [0,4194304] 0 2024-04-26T21:25:58.785 INFO:tasks.workunit.client.1.smithi120.stdout:0/711: creat d0/d3/d51/d70/d71/fee x:0 0 0 2024-04-26T21:25:58.787 INFO:tasks.workunit.client.1.smithi120.stdout:1/574: fdatasync d6/d9/f84 0 2024-04-26T21:25:58.789 INFO:tasks.workunit.client.0.smithi084.stdout:5/417: dwrite d0/dc/f43 [0,4194304] 0 2024-04-26T21:25:58.790 INFO:tasks.workunit.client.1.smithi120.stdout:2/628: rmdir d4/d1b/d2e/d5f 39 2024-04-26T21:25:58.791 INFO:tasks.workunit.client.0.smithi084.stdout:5/418: stat d0/f2 0 2024-04-26T21:25:58.791 INFO:tasks.workunit.client.1.smithi120.stdout:0/712: dread - d0/df/f9d zero size 2024-04-26T21:25:58.793 INFO:tasks.workunit.client.1.smithi120.stdout:4/599: rename d10/d65/l89 to d10/d65/d72/d86/lcb 0 2024-04-26T21:25:58.795 INFO:tasks.workunit.client.1.smithi120.stdout:9/586: link d0/d66/d93/db7/d9b/fab d0/d6/fbf 0 2024-04-26T21:25:58.800 INFO:tasks.workunit.client.0.smithi084.stdout:5/419: creat d0/dc/df/d31/d45/f82 x:0 0 0 2024-04-26T21:25:58.804 INFO:tasks.workunit.client.1.smithi120.stdout:4/600: fsync d10/d12/f19 0 2024-04-26T21:25:58.804 INFO:tasks.workunit.client.1.smithi120.stdout:8/567: write d5/d6/d34/d37/d60/f5c [289093,64011] 0 2024-04-26T21:25:58.805 INFO:tasks.workunit.client.0.smithi084.stdout:2/535: getdents d6/d7/d3d/d15/d1f/d6c 0 2024-04-26T21:25:58.807 INFO:tasks.workunit.client.1.smithi120.stdout:9/587: mkdir d0/dd/d45/dc0 0 2024-04-26T21:25:58.807 INFO:tasks.workunit.client.1.smithi120.stdout:6/650: write d4/db/d10/d1a/d2b/d57/d67/f4a [113290,77190] 0 2024-04-26T21:25:58.811 INFO:tasks.workunit.client.1.smithi120.stdout:8/568: dread - d5/d6/d34/d42/d9d/f91 zero size 2024-04-26T21:25:58.811 INFO:tasks.workunit.client.1.smithi120.stdout:7/611: dwrite d7/d64/da6/d1a/d33/d34/d37/f3b [4194304,4194304] 0 2024-04-26T21:25:58.813 INFO:tasks.workunit.client.0.smithi084.stdout:2/536: creat d6/d7/d3d/d15/d1f/d39/d20/fbb x:0 0 0 2024-04-26T21:25:58.816 INFO:tasks.workunit.client.0.smithi084.stdout:5/420: dwrite d0/d17/f1d [0,4194304] 0 2024-04-26T21:25:58.816 INFO:tasks.workunit.client.1.smithi120.stdout:0/713: truncate d0/d3/dc/dd/d1b/d39/f53 3156650 0 2024-04-26T21:25:58.816 INFO:tasks.workunit.client.1.smithi120.stdout:9/588: fsync d0/dd/f56 0 2024-04-26T21:25:58.817 INFO:tasks.workunit.client.1.smithi120.stdout:7/612: chown d7/d64/da6/d1f/d28/f3e 193526 1 2024-04-26T21:25:58.818 INFO:tasks.workunit.client.1.smithi120.stdout:4/601: mknod d10/d28/d73/ccc 0 2024-04-26T21:25:58.820 INFO:tasks.workunit.client.1.smithi120.stdout:6/651: write d4/db/d10/d1a/d2b/d57/d67/fc2 [665063,9195] 0 2024-04-26T21:25:58.821 INFO:tasks.workunit.client.1.smithi120.stdout:9/589: stat d0/d6/l1f 0 2024-04-26T21:25:58.823 INFO:tasks.workunit.client.0.smithi084.stdout:2/537: creat d6/d7/d3d/d15/d1f/d39/fbc x:0 0 0 2024-04-26T21:25:58.823 INFO:tasks.workunit.client.1.smithi120.stdout:8/569: rename d5/d6/d34/d37/c8a to d5/d6/d34/da7/cb9 0 2024-04-26T21:25:58.826 INFO:tasks.workunit.client.1.smithi120.stdout:0/714: creat d0/d3/dc/d12/d31/fef x:0 0 0 2024-04-26T21:25:58.828 INFO:tasks.workunit.client.0.smithi084.stdout:5/421: getdents d0/d49/d4d 0 2024-04-26T21:25:58.828 INFO:tasks.workunit.client.1.smithi120.stdout:0/715: chown d0/d3/dc/f1c 165207 1 2024-04-26T21:25:58.831 INFO:tasks.workunit.client.0.smithi084.stdout:4/352: truncate d5/d25/d35/f3a 2370479 0 2024-04-26T21:25:58.833 INFO:tasks.workunit.client.0.smithi084.stdout:5/422: stat d0/l5e 0 2024-04-26T21:25:58.833 INFO:tasks.workunit.client.1.smithi120.stdout:6/652: write d4/db/d10/d22/d6c/f70 [5187950,66481] 0 2024-04-26T21:25:58.834 INFO:tasks.workunit.client.1.smithi120.stdout:7/613: creat d7/d64/da6/d1f/d7d/fd0 x:0 0 0 2024-04-26T21:25:58.835 INFO:tasks.workunit.client.1.smithi120.stdout:8/570: creat d5/d6/d34/d42/fba x:0 0 0 2024-04-26T21:25:58.837 INFO:tasks.workunit.client.0.smithi084.stdout:2/538: symlink d6/d7/d3d/d15/d1f/d22/lbd 0 2024-04-26T21:25:58.838 INFO:tasks.workunit.client.1.smithi120.stdout:4/602: mknod d10/ccd 0 2024-04-26T21:25:58.838 INFO:tasks.workunit.client.1.smithi120.stdout:8/571: read - d5/d6/d34/d37/fab zero size 2024-04-26T21:25:58.840 INFO:tasks.workunit.client.0.smithi084.stdout:4/353: symlink d5/d25/d35/d60/l74 0 2024-04-26T21:25:58.843 INFO:tasks.workunit.client.1.smithi120.stdout:3/614: dread f5 [0,4194304] 0 2024-04-26T21:25:58.843 INFO:tasks.workunit.client.1.smithi120.stdout:6/653: fdatasync d4/db/d10/d1a/d2b/f82 0 2024-04-26T21:25:58.844 INFO:tasks.workunit.client.1.smithi120.stdout:0/716: creat d0/ff0 x:0 0 0 2024-04-26T21:25:58.845 INFO:tasks.workunit.client.0.smithi084.stdout:2/539: truncate d6/d7/d3d/d15/d1f/d39/d43/f91 375960 0 2024-04-26T21:25:58.848 INFO:tasks.workunit.client.1.smithi120.stdout:8/572: chown d5/d6/d11/d52/d27/f9b 236838405 1 2024-04-26T21:25:58.852 INFO:tasks.workunit.client.0.smithi084.stdout:5/423: link d0/dc/df/f24 d0/dc/df/d31/d53/f83 0 2024-04-26T21:25:58.853 INFO:tasks.workunit.client.0.smithi084.stdout:5/424: dread - d0/dc/df/f7a zero size 2024-04-26T21:25:58.855 INFO:tasks.workunit.client.1.smithi120.stdout:0/717: creat d0/d3/dc/dd/d1b/d24/d7d/ff1 x:0 0 0 2024-04-26T21:25:58.856 INFO:tasks.workunit.client.0.smithi084.stdout:4/354: rename d5/d10/d15/d21/d29/d70 to d5/d10/d75 0 2024-04-26T21:25:58.858 INFO:tasks.workunit.client.1.smithi120.stdout:4/603: rename d10/d12/c23 to d10/d28/cce 0 2024-04-26T21:25:58.859 INFO:tasks.workunit.client.0.smithi084.stdout:2/540: fsync d6/d7/d3d/d15/d1f/d22/d99/f9d 0 2024-04-26T21:25:58.860 INFO:tasks.workunit.client.1.smithi120.stdout:3/615: mknod dd/de/d18/d24/db1/d76/d3b/d56/cc3 0 2024-04-26T21:25:58.860 INFO:tasks.workunit.client.1.smithi120.stdout:6/654: mkdir d4/db/d10/ddb 0 2024-04-26T21:25:58.860 INFO:tasks.workunit.client.1.smithi120.stdout:4/604: readlink d10/d28/l34 0 2024-04-26T21:25:58.862 INFO:tasks.workunit.client.0.smithi084.stdout:5/425: rmdir d0/dc/df/d31/d45 39 2024-04-26T21:25:58.862 INFO:tasks.workunit.client.1.smithi120.stdout:2/629: truncate d4/d1b/d25/d29/f37 3343135 0 2024-04-26T21:25:58.865 INFO:tasks.workunit.client.0.smithi084.stdout:4/355: creat d5/d7/d65/f76 x:0 0 0 2024-04-26T21:25:58.866 INFO:tasks.workunit.client.1.smithi120.stdout:0/718: symlink d0/d3/dc/d12/d31/lf2 0 2024-04-26T21:25:58.867 INFO:tasks.workunit.client.1.smithi120.stdout:6/655: dread - d4/db/d10/dd/d4e/d60/fb1 zero size 2024-04-26T21:25:58.869 INFO:tasks.workunit.client.1.smithi120.stdout:1/575: dread d6/d7/d2d/d98/fe [4194304,4194304] 0 2024-04-26T21:25:58.872 INFO:tasks.workunit.client.1.smithi120.stdout:9/590: dwrite d0/d14/d2d/f97 [4194304,4194304] 0 2024-04-26T21:25:58.872 INFO:tasks.workunit.client.1.smithi120.stdout:2/630: mknod d4/d1b/d25/ccd 0 2024-04-26T21:25:58.875 INFO:tasks.workunit.client.1.smithi120.stdout:6/656: mknod d4/db/d10/dd/d4e/d60/cdc 0 2024-04-26T21:25:58.882 INFO:tasks.workunit.client.0.smithi084.stdout:2/541: dread d6/f14 [0,4194304] 0 2024-04-26T21:25:58.883 INFO:tasks.workunit.client.1.smithi120.stdout:3/616: write dd/de/d18/d24/f23 [638202,10475] 0 2024-04-26T21:25:58.884 INFO:tasks.workunit.client.1.smithi120.stdout:1/576: write d6/d7/d1b/d3b/d6d/f8d [4424144,113641] 0 2024-04-26T21:25:58.885 INFO:tasks.workunit.client.1.smithi120.stdout:2/631: symlink d4/d1b/d4f/d95/lce 0 2024-04-26T21:25:58.886 INFO:tasks.workunit.client.0.smithi084.stdout:5/426: write d0/f16 [9105542,128309] 0 2024-04-26T21:25:58.887 INFO:tasks.workunit.client.0.smithi084.stdout:5/427: stat d0/l5e 0 2024-04-26T21:25:58.889 INFO:tasks.workunit.client.0.smithi084.stdout:2/542: rmdir d6/d7 39 2024-04-26T21:25:58.889 INFO:tasks.workunit.client.1.smithi120.stdout:6/657: mknod d4/db/d10/dd/d28/d9e/daf/cdd 0 2024-04-26T21:25:58.889 INFO:tasks.workunit.client.1.smithi120.stdout:9/591: symlink d0/d14/d2d/d4b/lc1 0 2024-04-26T21:25:58.893 INFO:tasks.workunit.client.1.smithi120.stdout:0/719: getdents d0/d3/dc/d12/d31 0 2024-04-26T21:25:58.894 INFO:tasks.workunit.client.1.smithi120.stdout:3/617: write f5 [1919276,48900] 0 2024-04-26T21:25:58.894 INFO:tasks.workunit.client.1.smithi120.stdout:8/573: dwrite d5/d6/d34/d37/d60/fb2 [0,4194304] 0 2024-04-26T21:25:58.895 INFO:tasks.workunit.client.1.smithi120.stdout:2/632: creat d4/d1b/d25/d2c/d3e/d5e/fcf x:0 0 0 2024-04-26T21:25:58.896 INFO:tasks.workunit.client.0.smithi084.stdout:4/356: dwrite d5/d2e/d5f/f4b [0,4194304] 0 2024-04-26T21:25:58.898 INFO:tasks.workunit.client.0.smithi084.stdout:2/543: mkdir d6/d7/d3d/d79/dbe 0 2024-04-26T21:25:58.899 INFO:tasks.workunit.client.1.smithi120.stdout:1/577: truncate d6/d14/f16 5111753 0 2024-04-26T21:25:58.903 INFO:tasks.workunit.client.0.smithi084.stdout:5/428: dread d0/dc/df/d2a/f40 [0,4194304] 0 2024-04-26T21:25:58.910 INFO:tasks.workunit.client.1.smithi120.stdout:2/633: chown d4/d1b/d25/f31 3910529 1 2024-04-26T21:25:58.910 INFO:tasks.workunit.client.1.smithi120.stdout:1/578: readlink d6/d7/d2d/d98/d35/l96 0 2024-04-26T21:25:58.911 INFO:tasks.workunit.client.1.smithi120.stdout:4/605: dwrite d10/f26 [0,4194304] 0 2024-04-26T21:25:58.911 INFO:tasks.workunit.client.0.smithi084.stdout:5/429: mkdir d0/dc/df/d31/d72/d84 0 2024-04-26T21:25:58.914 INFO:tasks.workunit.client.0.smithi084.stdout:8/410: sync 2024-04-26T21:25:58.915 INFO:tasks.workunit.client.0.smithi084.stdout:7/410: sync 2024-04-26T21:25:58.915 INFO:tasks.workunit.client.1.smithi120.stdout:7/614: dwrite d7/d64/da6/d1f/d28/f6f [0,4194304] 0 2024-04-26T21:25:58.915 INFO:tasks.workunit.client.1.smithi120.stdout:6/658: mkdir d4/db/d10/d1a/d2b/d57/d67/d98/dde 0 2024-04-26T21:25:58.916 INFO:tasks.workunit.client.1.smithi120.stdout:4/606: chown d10/d12/l69 974128 1 2024-04-26T21:25:58.919 INFO:tasks.workunit.client.1.smithi120.stdout:6/659: truncate d4/db/d10/dd/f90 4345688 0 2024-04-26T21:25:58.919 INFO:tasks.workunit.client.1.smithi120.stdout:8/574: creat d5/d6/d11/d52/d70/d88/fbb x:0 0 0 2024-04-26T21:25:58.919 INFO:tasks.workunit.client.1.smithi120.stdout:9/592: fsync d0/d14/d2d/d4b/f55 0 2024-04-26T21:25:58.919 INFO:tasks.workunit.client.0.smithi084.stdout:3/399: sync 2024-04-26T21:25:58.919 INFO:tasks.workunit.client.0.smithi084.stdout:6/437: sync 2024-04-26T21:25:58.925 INFO:tasks.workunit.client.1.smithi120.stdout:3/618: creat dd/de/df/d12/d48/fc4 x:0 0 0 2024-04-26T21:25:58.925 INFO:tasks.workunit.client.1.smithi120.stdout:7/615: rmdir d7/d19/d60 39 2024-04-26T21:25:58.927 INFO:tasks.workunit.client.0.smithi084.stdout:2/544: dwrite d6/d7/d3d/d15/d1f/d39/fa6 [0,4194304] 0 2024-04-26T21:25:58.927 INFO:tasks.workunit.client.0.smithi084.stdout:7/411: creat d6/f8c x:0 0 0 2024-04-26T21:25:58.931 INFO:tasks.workunit.client.1.smithi120.stdout:1/579: mkdir d6/d7/d85/dbf 0 2024-04-26T21:25:58.931 INFO:tasks.workunit.client.1.smithi120.stdout:6/660: creat d4/db/d10/dd/d4e/d60/fdf x:0 0 0 2024-04-26T21:25:58.931 INFO:tasks.workunit.client.1.smithi120.stdout:2/634: mknod d4/d1b/d25/cd0 0 2024-04-26T21:25:58.933 INFO:tasks.workunit.client.0.smithi084.stdout:4/357: write d5/d10/f18 [4527327,112653] 0 2024-04-26T21:25:58.936 INFO:tasks.workunit.client.1.smithi120.stdout:3/619: unlink dd/de/d18/d24/db1/d76/d3b/d56/c5d 0 2024-04-26T21:25:58.939 INFO:tasks.workunit.client.1.smithi120.stdout:9/593: truncate d0/f90 1013284 0 2024-04-26T21:25:58.940 INFO:tasks.workunit.client.0.smithi084.stdout:5/430: dwrite d0/dc/df/d51/f81 [0,4194304] 0 2024-04-26T21:25:58.940 INFO:tasks.workunit.client.1.smithi120.stdout:7/616: symlink d7/d64/da6/d1f/d28/dbb/ld1 0 2024-04-26T21:25:58.941 INFO:tasks.workunit.client.1.smithi120.stdout:6/661: rmdir d4/db/d10/dd/d28/d9e/daf 39 2024-04-26T21:25:58.945 INFO:tasks.workunit.client.0.smithi084.stdout:2/545: rmdir d6/d7/d3d/d15 39 2024-04-26T21:25:58.948 INFO:tasks.workunit.client.1.smithi120.stdout:0/720: dwrite d0/d3/dc/d12/d31/f5e [0,4194304] 0 2024-04-26T21:25:58.951 INFO:tasks.workunit.client.1.smithi120.stdout:8/575: rename d5/d6/d11/d52/d27/d4f/d67/d85/fb5 to d5/d6/d11/d52/d27/d4f/fbc 0 2024-04-26T21:25:58.953 INFO:tasks.workunit.client.1.smithi120.stdout:0/721: stat d0/d3/dc/dd/f45 0 2024-04-26T21:25:58.953 INFO:tasks.workunit.client.0.smithi084.stdout:4/358: mkdir d5/d2e/d5f/d32/d46/d77 0 2024-04-26T21:25:58.955 INFO:tasks.workunit.client.1.smithi120.stdout:9/594: truncate d0/dd/d45/f4a 4911229 0 2024-04-26T21:25:58.958 INFO:tasks.workunit.client.0.smithi084.stdout:5/431: rmdir d0/dc/df/d51 39 2024-04-26T21:25:58.961 INFO:tasks.workunit.client.0.smithi084.stdout:3/400: truncate d1/d2c/d2f/d31/d55/f6a 3645380 0 2024-04-26T21:25:58.964 INFO:tasks.workunit.client.0.smithi084.stdout:2/546: creat d6/d7/d3d/d79/d85/fbf x:0 0 0 2024-04-26T21:25:58.964 INFO:tasks.workunit.client.1.smithi120.stdout:2/635: rmdir d4/d1b/d56/d65/dbf 0 2024-04-26T21:25:58.965 INFO:tasks.workunit.client.1.smithi120.stdout:9/595: write d0/f18 [2012893,55045] 0 2024-04-26T21:25:58.967 INFO:tasks.workunit.client.1.smithi120.stdout:3/620: mkdir dd/de/df/db6/dc5 0 2024-04-26T21:25:58.967 INFO:tasks.workunit.client.1.smithi120.stdout:0/722: write d0/d3/dc/dd/d1b/d24/d73/db7/fc7 [596561,3252] 0 2024-04-26T21:25:58.967 INFO:tasks.workunit.client.0.smithi084.stdout:7/412: dread d6/d1c/f4e [0,4194304] 0 2024-04-26T21:25:58.971 INFO:tasks.workunit.client.0.smithi084.stdout:4/359: dwrite d5/d25/f47 [0,4194304] 0 2024-04-26T21:25:58.971 INFO:tasks.workunit.client.1.smithi120.stdout:4/607: dwrite d10/d12/f60 [4194304,4194304] 0 2024-04-26T21:25:58.972 INFO:tasks.workunit.client.0.smithi084.stdout:6/438: dread d3/de/d15/d40/f77 [0,4194304] 0 2024-04-26T21:25:58.976 INFO:tasks.workunit.client.1.smithi120.stdout:7/617: read d7/d64/da6/d1a/d33/d34/d37/f72 [357163,122179] 0 2024-04-26T21:25:58.976 INFO:tasks.workunit.client.0.smithi084.stdout:4/360: write d5/d2e/d5f/f27 [2809643,116800] 0 2024-04-26T21:25:58.977 INFO:tasks.workunit.client.0.smithi084.stdout:4/361: read d5/d2e/d5f/f51 [696976,11269] 0 2024-04-26T21:25:58.979 INFO:tasks.workunit.client.1.smithi120.stdout:3/621: mkdir dd/de/d18/d8d/dc6 0 2024-04-26T21:25:58.979 INFO:tasks.workunit.client.0.smithi084.stdout:8/411: truncate d4/d6/db/d1e/d22/d2f/f2c 2019667 0 2024-04-26T21:25:58.981 INFO:tasks.workunit.client.1.smithi120.stdout:1/580: dread d6/d7/d1b/d3b/d6d/fb4 [0,4194304] 0 2024-04-26T21:25:58.981 INFO:tasks.workunit.client.1.smithi120.stdout:4/608: readlink d10/d65/d72/d86/lcb 0 2024-04-26T21:25:58.986 INFO:tasks.workunit.client.0.smithi084.stdout:7/413: dwrite d6/d9/d12/d19/d7a/d84/f27 [0,4194304] 0 2024-04-26T21:25:58.993 INFO:tasks.workunit.client.1.smithi120.stdout:1/581: creat d6/d9/fc0 x:0 0 0 2024-04-26T21:25:58.994 INFO:tasks.workunit.client.0.smithi084.stdout:1/437: sync 2024-04-26T21:25:58.994 INFO:tasks.workunit.client.0.smithi084.stdout:0/415: sync 2024-04-26T21:25:58.994 INFO:tasks.workunit.client.0.smithi084.stdout:9/362: sync 2024-04-26T21:25:58.995 INFO:tasks.workunit.client.0.smithi084.stdout:4/362: dwrite d5/d10/d15/f5b [0,4194304] 0 2024-04-26T21:25:58.996 INFO:tasks.workunit.client.1.smithi120.stdout:5/709: sync 2024-04-26T21:25:58.996 INFO:tasks.workunit.client.0.smithi084.stdout:9/363: chown da/de/d16/d55/c5d 1031 1 2024-04-26T21:25:59.001 INFO:tasks.workunit.client.1.smithi120.stdout:2/636: dwrite d4/d1b/d25/d2c/d3e/d5e/fcf [0,4194304] 0 2024-04-26T21:25:59.005 INFO:tasks.workunit.client.0.smithi084.stdout:2/547: write d6/d7/d3d/d15/d1f/d39/d20/d45/f87 [353912,99319] 0 2024-04-26T21:25:59.005 INFO:tasks.workunit.client.0.smithi084.stdout:7/414: dread d6/d9/d12/d19/d7a/d84/d47/f48 [0,4194304] 0 2024-04-26T21:25:59.005 INFO:tasks.workunit.client.1.smithi120.stdout:5/710: truncate d2/dc/d1d/d21/f7d 360742 0 2024-04-26T21:25:59.006 INFO:tasks.workunit.client.0.smithi084.stdout:8/412: write d4/d3a/f71 [2607655,52772] 0 2024-04-26T21:25:59.008 INFO:tasks.workunit.client.0.smithi084.stdout:2/548: stat d6/d7/d3d/d15/d1f/f32 0 2024-04-26T21:25:59.009 INFO:tasks.workunit.client.1.smithi120.stdout:0/723: dread d0/d3/dc/d12/d31/f5e [0,4194304] 0 2024-04-26T21:25:59.009 INFO:tasks.workunit.client.1.smithi120.stdout:4/609: link d10/d12/f57 d10/d6b/dbf/fcf 0 2024-04-26T21:25:59.013 INFO:tasks.workunit.client.0.smithi084.stdout:0/416: write de/d2b/d77/d32/f4f [3207984,24886] 0 2024-04-26T21:25:59.015 INFO:tasks.workunit.client.1.smithi120.stdout:2/637: readlink d4/d1b/d4f/l91 0 2024-04-26T21:25:59.017 INFO:tasks.workunit.client.1.smithi120.stdout:6/662: write d4/db/d10/dd/d4e/f81 [56097,67338] 0 2024-04-26T21:25:59.020 INFO:tasks.workunit.client.1.smithi120.stdout:1/582: rename d6/d7/d1d/d2c/d73 to d6/d7/d2d/d48/d86/dc1 0 2024-04-26T21:25:59.021 INFO:tasks.workunit.client.0.smithi084.stdout:2/549: write d6/d7/d3d/d15/d1f/f34 [5083082,130331] 0 2024-04-26T21:25:59.023 INFO:tasks.workunit.client.1.smithi120.stdout:4/610: dread - d10/d6b/f7d zero size 2024-04-26T21:25:59.024 INFO:tasks.workunit.client.1.smithi120.stdout:0/724: rmdir d0/dd1/dd2 39 2024-04-26T21:25:59.027 INFO:tasks.workunit.client.1.smithi120.stdout:2/638: unlink d4/d1b/d25/f31 0 2024-04-26T21:25:59.027 INFO:tasks.workunit.client.1.smithi120.stdout:1/583: chown d6/d7/d1d/d2c/f93 245293 1 2024-04-26T21:25:59.029 INFO:tasks.workunit.client.0.smithi084.stdout:5/432: symlink d0/dc/l85 0 2024-04-26T21:25:59.030 INFO:tasks.workunit.client.1.smithi120.stdout:3/622: dwrite dd/d2a/d74/fbf [0,4194304] 0 2024-04-26T21:25:59.031 INFO:tasks.workunit.client.1.smithi120.stdout:5/711: rename d2/d30/ld6 to d2/df6/lfe 0 2024-04-26T21:25:59.034 INFO:tasks.workunit.client.0.smithi084.stdout:5/433: dread - d0/dc/df/f7a zero size 2024-04-26T21:25:59.038 INFO:tasks.workunit.client.1.smithi120.stdout:0/725: fdatasync d0/d3/dc/dd/d1b/d39/f3e 0 2024-04-26T21:25:59.039 INFO:tasks.workunit.client.1.smithi120.stdout:4/611: mkdir d10/d65/d8c/dd0 0 2024-04-26T21:25:59.040 INFO:tasks.workunit.client.0.smithi084.stdout:0/417: dwrite de/d2b/f43 [0,4194304] 0 2024-04-26T21:25:59.042 INFO:tasks.workunit.client.0.smithi084.stdout:2/550: dwrite d6/d7/d68/fa2 [0,4194304] 0 2024-04-26T21:25:59.043 INFO:tasks.workunit.client.1.smithi120.stdout:6/663: rename d4/db/d10/d1a/cca to d4/db/d10/d1a/dcd/ce0 0 2024-04-26T21:25:59.043 INFO:tasks.workunit.client.1.smithi120.stdout:8/576: dwrite d5/d6/d11/d32/f8f [0,4194304] 0 2024-04-26T21:25:59.048 INFO:tasks.workunit.client.1.smithi120.stdout:2/639: mkdir d4/d1b/d2e/d50/d14/d15/dd1 0 2024-04-26T21:25:59.049 INFO:tasks.workunit.client.0.smithi084.stdout:2/551: truncate d6/d7/d68/f69 9169068 0 2024-04-26T21:25:59.052 INFO:tasks.workunit.client.1.smithi120.stdout:4/612: write d10/d65/d72/f91 [771213,87415] 0 2024-04-26T21:25:59.054 INFO:tasks.workunit.client.1.smithi120.stdout:0/726: unlink d0/d3/d51/d70/le1 0 2024-04-26T21:25:59.055 INFO:tasks.workunit.client.1.smithi120.stdout:8/577: creat d5/d6/d11/fbd x:0 0 0 2024-04-26T21:25:59.057 INFO:tasks.workunit.client.1.smithi120.stdout:2/640: creat d4/d1b/d25/d29/fd2 x:0 0 0 2024-04-26T21:25:59.059 INFO:tasks.workunit.client.1.smithi120.stdout:6/664: mknod d4/db/d10/d1a/d2b/d57/d67/d98/ce1 0 2024-04-26T21:25:59.061 INFO:tasks.workunit.client.0.smithi084.stdout:5/434: dread d0/d17/f5b [0,4194304] 0 2024-04-26T21:25:59.063 INFO:tasks.workunit.client.1.smithi120.stdout:8/578: chown d5/d6/d34/d37/d60/f3a 2 1 2024-04-26T21:25:59.063 INFO:tasks.workunit.client.1.smithi120.stdout:6/665: stat d4/db/d10/d1a/dcd/fd2 0 2024-04-26T21:25:59.065 INFO:tasks.workunit.client.1.smithi120.stdout:4/613: truncate d10/d6b/f7d 267331 0 2024-04-26T21:25:59.067 INFO:tasks.workunit.client.1.smithi120.stdout:5/712: link d2/dc/d1d/d1f/d36/d44/l98 d2/dc/d1d/d21/d77/d9c/lff 0 2024-04-26T21:25:59.068 INFO:tasks.workunit.client.1.smithi120.stdout:2/641: truncate d4/d1b/f89 545448 0 2024-04-26T21:25:59.070 INFO:tasks.workunit.client.1.smithi120.stdout:1/584: dwrite d6/f79 [0,4194304] 0 2024-04-26T21:25:59.072 INFO:tasks.workunit.client.0.smithi084.stdout:7/415: rename d6/d9/d12/d8b/f56 to d6/d9/d12/d8b/f8d 0 2024-04-26T21:25:59.072 INFO:tasks.workunit.client.0.smithi084.stdout:2/552: dread d6/d7/d3d/d15/d1f/d39/fa6 [0,4194304] 0 2024-04-26T21:25:59.074 INFO:tasks.workunit.client.1.smithi120.stdout:8/579: write d5/d6/d34/d42/d9d/f86 [1085958,103811] 0 2024-04-26T21:25:59.075 INFO:tasks.workunit.client.0.smithi084.stdout:7/416: dread - d6/d9/d12/d19/f7e zero size 2024-04-26T21:25:59.078 INFO:tasks.workunit.client.1.smithi120.stdout:0/727: read d0/d3/dc/dd/d1b/d24/d7d/f9e [230704,101951] 0 2024-04-26T21:25:59.080 INFO:tasks.workunit.client.0.smithi084.stdout:7/417: write d6/d9/d12/d19/f7e [126192,108709] 0 2024-04-26T21:25:59.081 INFO:tasks.workunit.client.1.smithi120.stdout:7/618: truncate d7/d64/da6/d1f/d28/f2e 297016 0 2024-04-26T21:25:59.082 INFO:tasks.workunit.client.0.smithi084.stdout:5/435: dwrite d0/f22 [0,4194304] 0 2024-04-26T21:25:59.084 INFO:tasks.workunit.client.0.smithi084.stdout:7/418: write d6/d9/d12/d19/d7a/d84/d47/f85 [496748,33240] 0 2024-04-26T21:25:59.086 INFO:tasks.workunit.client.0.smithi084.stdout:0/418: write de/d71/f88 [3676081,76726] 0 2024-04-26T21:25:59.086 INFO:tasks.workunit.client.0.smithi084.stdout:0/419: stat c7 0 2024-04-26T21:25:59.088 INFO:tasks.workunit.client.0.smithi084.stdout:3/401: creat d1/d2c/d2f/d31/f86 x:0 0 0 2024-04-26T21:25:59.094 INFO:tasks.workunit.client.1.smithi120.stdout:1/585: mknod d6/d7/d1b/d55/cc2 0 2024-04-26T21:25:59.094 INFO:tasks.workunit.client.1.smithi120.stdout:4/614: creat d10/fd1 x:0 0 0 2024-04-26T21:25:59.095 INFO:tasks.workunit.client.0.smithi084.stdout:4/363: link d5/d2e/d5f/l50 d5/d10/l78 0 2024-04-26T21:25:59.099 INFO:tasks.workunit.client.1.smithi120.stdout:4/615: chown d10/d65/d72/d86/f9a 13632 1 2024-04-26T21:25:59.099 INFO:tasks.workunit.client.1.smithi120.stdout:1/586: read d6/d7/d1b/f3d [858462,73205] 0 2024-04-26T21:25:59.102 INFO:tasks.workunit.client.1.smithi120.stdout:1/587: dread - d6/d7/d1d/d5d/d67/f77 zero size 2024-04-26T21:25:59.103 INFO:tasks.workunit.client.1.smithi120.stdout:8/580: dwrite f4 [0,4194304] 0 2024-04-26T21:25:59.103 INFO:tasks.workunit.client.1.smithi120.stdout:0/728: rename d0/d3/dc/d12/d31/leb to d0/d3/d13/lf3 0 2024-04-26T21:25:59.106 INFO:tasks.workunit.client.0.smithi084.stdout:0/420: dwrite de/d2b/d77/d32/f44 [0,4194304] 0 2024-04-26T21:25:59.106 INFO:tasks.workunit.client.0.smithi084.stdout:7/419: dread d6/d9/f35 [0,4194304] 0 2024-04-26T21:25:59.108 INFO:tasks.workunit.client.0.smithi084.stdout:6/439: truncate d3/de/d41/f51 1978960 0 2024-04-26T21:25:59.117 INFO:tasks.workunit.client.1.smithi120.stdout:7/619: link d7/d64/da6/d1f/d28/c8c d7/d64/da6/d1f/d28/cd2 0 2024-04-26T21:25:59.119 INFO:tasks.workunit.client.0.smithi084.stdout:3/402: creat d1/d2c/d2f/d31/d55/d4e/d7c/f87 x:0 0 0 2024-04-26T21:25:59.123 INFO:tasks.workunit.client.0.smithi084.stdout:4/364: creat d5/d25/f79 x:0 0 0 2024-04-26T21:25:59.125 INFO:tasks.workunit.client.0.smithi084.stdout:4/365: stat d5/f1a 0 2024-04-26T21:25:59.125 INFO:tasks.workunit.client.0.smithi084.stdout:7/420: dwrite d6/f8c [0,4194304] 0 2024-04-26T21:25:59.132 INFO:tasks.workunit.client.1.smithi120.stdout:4/616: dwrite d10/d12/f45 [0,4194304] 0 2024-04-26T21:25:59.132 INFO:tasks.workunit.client.1.smithi120.stdout:0/729: rename d0/d3/dc/d12/d4a to d0/df4 0 2024-04-26T21:25:59.132 INFO:tasks.workunit.client.1.smithi120.stdout:8/581: dwrite d5/d6/d11/d52/d27/f38 [0,4194304] 0 2024-04-26T21:25:59.132 INFO:tasks.workunit.client.1.smithi120.stdout:9/596: sync 2024-04-26T21:25:59.135 INFO:tasks.workunit.client.1.smithi120.stdout:3/623: truncate dd/de/d18/d24/d43/f4c 3650973 0 2024-04-26T21:25:59.136 INFO:tasks.workunit.client.0.smithi084.stdout:5/436: mknod d0/dc/c86 0 2024-04-26T21:25:59.138 INFO:tasks.workunit.client.1.smithi120.stdout:1/588: getdents d6/d7/d1b/d89 0 2024-04-26T21:25:59.145 INFO:tasks.workunit.client.1.smithi120.stdout:0/730: chown d0/d3/dc/d12/d31/f5e 124157428 1 2024-04-26T21:25:59.145 INFO:tasks.workunit.client.1.smithi120.stdout:0/731: stat d0/d3/dc/dd/f21 0 2024-04-26T21:25:59.145 INFO:tasks.workunit.client.1.smithi120.stdout:4/617: unlink d10/d6b/f98 0 2024-04-26T21:25:59.145 INFO:tasks.workunit.client.1.smithi120.stdout:2/642: write d4/d1b/d25/f32 [2805242,19681] 0 2024-04-26T21:25:59.145 INFO:tasks.workunit.client.1.smithi120.stdout:9/597: unlink d0/dd/l44 0 2024-04-26T21:25:59.150 INFO:tasks.workunit.client.1.smithi120.stdout:3/624: mknod dd/de/d83/d64/db0/d46/cc7 0 2024-04-26T21:25:59.152 INFO:tasks.workunit.client.1.smithi120.stdout:5/713: write d2/dc/fd [1622206,52251] 0 2024-04-26T21:25:59.152 INFO:tasks.workunit.client.0.smithi084.stdout:4/366: dread d5/d10/f1b [0,4194304] 0 2024-04-26T21:25:59.152 INFO:tasks.workunit.client.0.smithi084.stdout:0/421: fsync de/ff 0 2024-04-26T21:25:59.154 INFO:tasks.workunit.client.0.smithi084.stdout:9/364: dwrite da/de/d16/d25/d4f/f59 [0,4194304] 0 2024-04-26T21:25:59.155 INFO:tasks.workunit.client.1.smithi120.stdout:1/589: unlink d6/d7/d2d/d98/d54/cb0 0 2024-04-26T21:25:59.158 INFO:tasks.workunit.client.0.smithi084.stdout:0/422: write de/d71/f57 [1404269,9147] 0 2024-04-26T21:25:59.162 INFO:tasks.workunit.client.1.smithi120.stdout:1/590: readlink d6/l41 0 2024-04-26T21:25:59.162 INFO:tasks.workunit.client.1.smithi120.stdout:9/598: truncate d0/dd/d3a/d5c/f8d 119723 0 2024-04-26T21:25:59.166 INFO:tasks.workunit.client.1.smithi120.stdout:3/625: rename dd/de to dd/de/d18/d37/d80/dc8 22 2024-04-26T21:25:59.166 INFO:tasks.workunit.client.1.smithi120.stdout:5/714: mkdir d2/dc/d1d/d1f/d34/d100 0 2024-04-26T21:25:59.166 INFO:tasks.workunit.client.1.smithi120.stdout:6/666: dwrite d4/f14 [4194304,4194304] 0 2024-04-26T21:25:59.167 INFO:tasks.workunit.client.0.smithi084.stdout:7/421: stat d6/d9/d12/d19/d7a/d84/c73 0 2024-04-26T21:25:59.168 INFO:tasks.workunit.client.0.smithi084.stdout:5/437: fsync d0/dc/df/d2a/f40 0 2024-04-26T21:25:59.170 INFO:tasks.workunit.client.1.smithi120.stdout:0/732: getdents d0/d3/d13/d81 0 2024-04-26T21:25:59.172 INFO:tasks.workunit.client.0.smithi084.stdout:7/422: fdatasync d6/d9/d12/d19/f7e 0 2024-04-26T21:25:59.176 INFO:tasks.workunit.client.0.smithi084.stdout:4/367: dwrite d5/d10/f71 [0,4194304] 0 2024-04-26T21:25:59.178 INFO:tasks.workunit.client.1.smithi120.stdout:0/733: rmdir d0/d3/d13/d64 39 2024-04-26T21:25:59.179 INFO:tasks.workunit.client.0.smithi084.stdout:9/365: dwrite da/f1a [0,4194304] 0 2024-04-26T21:25:59.180 INFO:tasks.workunit.client.1.smithi120.stdout:2/643: read d4/d1b/d25/f32 [2200105,93936] 0 2024-04-26T21:25:59.180 INFO:tasks.workunit.client.0.smithi084.stdout:3/403: dread d1/d2c/d2f/d31/d3b/f41 [0,4194304] 0 2024-04-26T21:25:59.181 INFO:tasks.workunit.client.0.smithi084.stdout:3/404: dread - d1/f77 zero size 2024-04-26T21:25:59.183 INFO:tasks.workunit.client.1.smithi120.stdout:0/734: write d0/d3/dc/d12/d31/f33 [96748,111396] 0 2024-04-26T21:25:59.186 INFO:tasks.workunit.client.0.smithi084.stdout:2/553: link d6/d7/d3d/d15/d1f/d39/d20/d45/d6d/lb4 d6/d7/d3d/d15/d1f/d39/d20/d45/d6d/lc0 0 2024-04-26T21:25:59.188 INFO:tasks.workunit.client.0.smithi084.stdout:2/554: dread - d6/d7/d3d/d79/d81/d82/da8/fba zero size 2024-04-26T21:25:59.191 INFO:tasks.workunit.client.1.smithi120.stdout:2/644: rename d4/d1b/d25/d29/fd2 to d4/fd3 0 2024-04-26T21:25:59.191 INFO:tasks.workunit.client.0.smithi084.stdout:4/368: creat d5/d10/d75/f7a x:0 0 0 2024-04-26T21:25:59.192 INFO:tasks.workunit.client.1.smithi120.stdout:0/735: chown d0/d3/dc/dd/d80 271540808 1 2024-04-26T21:25:59.196 INFO:tasks.workunit.client.1.smithi120.stdout:0/736: write d0/d3/dc/dd/d1b/d24/fdd [783811,115337] 0 2024-04-26T21:25:59.199 INFO:tasks.workunit.client.0.smithi084.stdout:5/438: dwrite d0/dc/df/d51/f81 [4194304,4194304] 0 2024-04-26T21:25:59.199 INFO:tasks.workunit.client.1.smithi120.stdout:2/645: read d4/d1b/d56/f4a [766787,96187] 0 2024-04-26T21:25:59.203 INFO:tasks.workunit.client.1.smithi120.stdout:0/737: dread - d0/d3/dc/dd/d80/fe0 zero size 2024-04-26T21:25:59.210 INFO:tasks.workunit.client.1.smithi120.stdout:0/738: fsync d0/d3/d13/f96 0 2024-04-26T21:25:59.210 INFO:tasks.workunit.client.1.smithi120.stdout:2/646: rename d4/d1b/d25/d2c/d3e/d5e/d63/fc8 to d4/d1b/d56/fd4 0 2024-04-26T21:25:59.210 INFO:tasks.workunit.client.0.smithi084.stdout:9/366: link da/f46 da/de/d16/d25/d41/d67/f86 0 2024-04-26T21:25:59.214 INFO:tasks.workunit.client.0.smithi084.stdout:1/438: sync 2024-04-26T21:25:59.214 INFO:tasks.workunit.client.0.smithi084.stdout:8/413: sync 2024-04-26T21:25:59.214 INFO:tasks.workunit.client.1.smithi120.stdout:0/739: stat d0/d3/dc/dd/d1b/d24/d7d/d9f 0 2024-04-26T21:25:59.221 INFO:tasks.workunit.client.1.smithi120.stdout:0/740: creat d0/d3/dc/d12/dae/ff5 x:0 0 0 2024-04-26T21:25:59.224 INFO:tasks.workunit.client.0.smithi084.stdout:4/369: chown d5/d2e/l58 0 1 2024-04-26T21:25:59.225 INFO:tasks.workunit.client.0.smithi084.stdout:6/440: getdents d3/de 0 2024-04-26T21:25:59.227 INFO:tasks.workunit.client.1.smithi120.stdout:6/667: dread d4/db/d10/f44 [0,4194304] 0 2024-04-26T21:25:59.232 INFO:tasks.workunit.client.1.smithi120.stdout:0/741: symlink d0/d3/dc/dd/d4b/lf6 0 2024-04-26T21:25:59.234 INFO:tasks.workunit.client.1.smithi120.stdout:6/668: symlink d4/db/d10/dd/db3/le2 0 2024-04-26T21:25:59.235 INFO:tasks.workunit.client.1.smithi120.stdout:7/620: dread d7/d64/da6/f16 [0,4194304] 0 2024-04-26T21:25:59.236 INFO:tasks.workunit.client.1.smithi120.stdout:8/582: write d5/d6/d11/f31 [947401,28058] 0 2024-04-26T21:25:59.246 INFO:tasks.workunit.client.1.smithi120.stdout:4/618: dread d10/d12/f14 [4194304,4194304] 0 2024-04-26T21:25:59.248 INFO:tasks.workunit.client.0.smithi084.stdout:2/555: unlink d6/d7/d3d/l70 0 2024-04-26T21:25:59.250 INFO:tasks.workunit.client.0.smithi084.stdout:2/556: readlink d6/d7/d3d/d15/d1f/d39/d43/lb9 0 2024-04-26T21:25:59.251 INFO:tasks.workunit.client.1.smithi120.stdout:6/669: creat d4/db/d10/d1a/dcd/fe3 x:0 0 0 2024-04-26T21:25:59.252 INFO:tasks.workunit.client.1.smithi120.stdout:8/583: mknod d5/d6/d34/d42/d9d/d7a/da4/cbe 0 2024-04-26T21:25:59.253 INFO:tasks.workunit.client.0.smithi084.stdout:5/439: mkdir d0/dc/df/d31/d53/d87 0 2024-04-26T21:25:59.253 INFO:tasks.workunit.client.0.smithi084.stdout:5/440: chown d0 1409329 1 2024-04-26T21:25:59.253 INFO:tasks.workunit.client.0.smithi084.stdout:2/557: write d6/d7/d3d/d15/d1f/d39/fbc [800563,77696] 0 2024-04-26T21:25:59.256 INFO:tasks.workunit.client.0.smithi084.stdout:2/558: chown d6/d7/d3d/d79/d81/d82/da8 68234393 1 2024-04-26T21:25:59.257 INFO:tasks.workunit.client.1.smithi120.stdout:4/619: symlink d10/ld2 0 2024-04-26T21:25:59.258 INFO:tasks.workunit.client.0.smithi084.stdout:9/367: chown da/de/d16/d25/d41/l72 149 1 2024-04-26T21:25:59.259 INFO:tasks.workunit.client.1.smithi120.stdout:8/584: dread - d5/d6/d75/d95/fa8 zero size 2024-04-26T21:25:59.259 INFO:tasks.workunit.client.1.smithi120.stdout:3/626: dwrite dd/de/d83/d64/db0/f77 [0,4194304] 0 2024-04-26T21:25:59.259 INFO:tasks.workunit.client.1.smithi120.stdout:2/647: dread d4/d1b/d25/d2c/f46 [0,4194304] 0 2024-04-26T21:25:59.260 INFO:tasks.workunit.client.1.smithi120.stdout:1/591: dread d6/d7/d1b/d3b/d6d/f8d [0,4194304] 0 2024-04-26T21:25:59.265 INFO:tasks.workunit.client.0.smithi084.stdout:1/439: symlink d2/d9/d15/d28/d5a/l88 0 2024-04-26T21:25:59.266 INFO:tasks.workunit.client.1.smithi120.stdout:1/592: write d6/d7/d1d/d2c/d58/f9f [136596,89886] 0 2024-04-26T21:25:59.266 INFO:tasks.workunit.client.1.smithi120.stdout:8/585: write d5/d6/d11/f6b [10329792,112703] 0 2024-04-26T21:25:59.267 INFO:tasks.workunit.client.1.smithi120.stdout:2/648: read - d4/d1b/d56/fb5 zero size 2024-04-26T21:25:59.268 INFO:tasks.workunit.client.1.smithi120.stdout:3/627: symlink dd/de/d18/d24/d9d/lc9 0 2024-04-26T21:25:59.272 INFO:tasks.workunit.client.0.smithi084.stdout:7/423: dread d6/f17 [0,4194304] 0 2024-04-26T21:25:59.274 INFO:tasks.workunit.client.1.smithi120.stdout:7/621: write d7/d64/da6/f1d [867786,35124] 0 2024-04-26T21:25:59.274 INFO:tasks.workunit.client.1.smithi120.stdout:0/742: dread d0/d3/dc/f44 [0,4194304] 0 2024-04-26T21:25:59.282 INFO:tasks.workunit.client.1.smithi120.stdout:8/586: mkdir d5/d6/d34/d42/d4a/dbf 0 2024-04-26T21:25:59.283 INFO:tasks.workunit.client.1.smithi120.stdout:4/620: dwrite d10/d12/f60 [4194304,4194304] 0 2024-04-26T21:25:59.285 INFO:tasks.workunit.client.1.smithi120.stdout:1/593: write d6/d7/d1d/d5d/f90 [22640,26878] 0 2024-04-26T21:25:59.287 INFO:tasks.workunit.client.1.smithi120.stdout:6/670: link d4/db/d10/dd/d28/d9e/daf/cdd d4/db/d10/d1a/d2b/d57/d67/ce4 0 2024-04-26T21:25:59.288 INFO:tasks.workunit.client.1.smithi120.stdout:0/743: creat d0/d3/dc/dd/d9b/ff7 x:0 0 0 2024-04-26T21:25:59.290 INFO:tasks.workunit.client.0.smithi084.stdout:4/370: rename d5/d10/d75/f73 to d5/d10/d15/d21/f7b 0 2024-04-26T21:25:59.290 INFO:tasks.workunit.client.0.smithi084.stdout:3/405: write d1/d24/d27/d3a/f62 [2182748,63993] 0 2024-04-26T21:25:59.292 INFO:tasks.workunit.client.1.smithi120.stdout:2/649: rename d4/d1b/d25/d29/cab to d4/cd5 0 2024-04-26T21:25:59.292 INFO:tasks.workunit.client.1.smithi120.stdout:8/587: creat d5/d6/d34/d37/d60/fc0 x:0 0 0 2024-04-26T21:25:59.292 INFO:tasks.workunit.client.1.smithi120.stdout:1/594: fsync d6/d7/d1d/f20 0 2024-04-26T21:25:59.292 INFO:tasks.workunit.client.1.smithi120.stdout:3/628: link dd/d2a/l65 dd/de/df/lca 0 2024-04-26T21:25:59.292 INFO:tasks.workunit.client.1.smithi120.stdout:2/650: readlink d4/d1b/d4f/l91 0 2024-04-26T21:25:59.292 INFO:tasks.workunit.client.1.smithi120.stdout:0/744: readlink d0/df/d59/l5b 0 2024-04-26T21:25:59.292 INFO:tasks.workunit.client.1.smithi120.stdout:7/622: truncate d7/d64/da6/d1f/d28/f3d 831186 0 2024-04-26T21:25:59.293 INFO:tasks.workunit.client.0.smithi084.stdout:3/406: fdatasync d1/d24/f25 0 2024-04-26T21:25:59.294 INFO:tasks.workunit.client.0.smithi084.stdout:3/407: write d1/d2c/d2f/f28 [4838238,113811] 0 2024-04-26T21:25:59.294 INFO:tasks.workunit.client.0.smithi084.stdout:0/423: getdents de/d2b/d64/d81 0 2024-04-26T21:25:59.297 INFO:tasks.workunit.client.0.smithi084.stdout:9/368: fsync da/fb 0 2024-04-26T21:25:59.299 INFO:tasks.workunit.client.0.smithi084.stdout:8/414: dread d4/d6/db/d1e/d22/f2e [0,4194304] 0 2024-04-26T21:25:59.301 INFO:tasks.workunit.client.0.smithi084.stdout:8/415: chown d4/d7/d15/c29 44942 1 2024-04-26T21:25:59.301 INFO:tasks.workunit.client.0.smithi084.stdout:1/440: symlink d2/d54/d5e/d66/d2a/d2c/d75/l89 0 2024-04-26T21:25:59.303 INFO:tasks.workunit.client.0.smithi084.stdout:7/424: unlink d6/d26/c5d 0 2024-04-26T21:25:59.304 INFO:tasks.workunit.client.0.smithi084.stdout:6/441: getdents d3/de/d1a/d43/d72 0 2024-04-26T21:25:59.305 INFO:tasks.workunit.client.0.smithi084.stdout:4/371: symlink d5/d10/l7c 0 2024-04-26T21:25:59.305 INFO:tasks.workunit.client.0.smithi084.stdout:1/441: write d2/d19/f1e [5223871,20959] 0 2024-04-26T21:25:59.306 INFO:tasks.workunit.client.0.smithi084.stdout:5/441: symlink d0/dc/df/d31/d53/d87/l88 0 2024-04-26T21:25:59.308 INFO:tasks.workunit.client.0.smithi084.stdout:3/408: creat d1/d2c/d2f/d31/d55/f88 x:0 0 0 2024-04-26T21:25:59.310 INFO:tasks.workunit.client.0.smithi084.stdout:2/559: creat d6/d7/d3d/d15/d1f/d22/fc1 x:0 0 0 2024-04-26T21:25:59.311 INFO:tasks.workunit.client.0.smithi084.stdout:8/416: getdents d4/d6/db/d1e/d22/d2f/d65 0 2024-04-26T21:25:59.314 INFO:tasks.workunit.client.0.smithi084.stdout:4/372: write d5/d25/d35/f3a [1858288,17350] 0 2024-04-26T21:25:59.314 INFO:tasks.workunit.client.0.smithi084.stdout:0/424: dwrite de/f7a [0,4194304] 0 2024-04-26T21:25:59.316 INFO:tasks.workunit.client.0.smithi084.stdout:8/417: read d4/d3a/f71 [6062514,16125] 0 2024-04-26T21:25:59.317 INFO:tasks.workunit.client.0.smithi084.stdout:4/373: truncate d5/d10/d75/f7a 749654 0 2024-04-26T21:25:59.317 INFO:tasks.workunit.client.0.smithi084.stdout:8/418: dread - d4/d7/d15/f70 zero size 2024-04-26T21:25:59.319 INFO:tasks.workunit.client.1.smithi120.stdout:1/595: mknod d6/d7/d1d/d2c/cc3 0 2024-04-26T21:25:59.323 INFO:tasks.workunit.client.1.smithi120.stdout:0/745: creat d0/d3/d51/d95/dd0/ff8 x:0 0 0 2024-04-26T21:25:59.327 INFO:tasks.workunit.client.1.smithi120.stdout:7/623: rename d7/d64/da6/d1f/d28/d4c/d6b/d7b/f9e to d7/d10/d97/fd3 0 2024-04-26T21:25:59.329 INFO:tasks.workunit.client.1.smithi120.stdout:8/588: link d5/d6/d34/d42/d9d/la1 d5/d6/d34/d42/lc1 0 2024-04-26T21:25:59.331 INFO:tasks.workunit.client.1.smithi120.stdout:2/651: link d4/d1b/d2e/d5f/c78 d4/d1b/d56/cd6 0 2024-04-26T21:25:59.331 INFO:tasks.workunit.client.1.smithi120.stdout:1/596: write d6/d7/d1d/d5d/f90 [755364,130749] 0 2024-04-26T21:25:59.335 INFO:tasks.workunit.client.1.smithi120.stdout:0/746: creat d0/d3/dc/dd/d1b/d24/d7d/ff9 x:0 0 0 2024-04-26T21:25:59.337 INFO:tasks.workunit.client.1.smithi120.stdout:3/629: dwrite dd/de/d18/d37/d80/f9c [4194304,4194304] 0 2024-04-26T21:25:59.338 INFO:tasks.workunit.client.0.smithi084.stdout:3/409: creat d1/d2c/d2f/d31/d55/d4e/d7c/f89 x:0 0 0 2024-04-26T21:25:59.341 INFO:tasks.workunit.client.0.smithi084.stdout:9/369: getdents da/de/d16/d25/d41/d43/d4a/d82 0 2024-04-26T21:25:59.341 INFO:tasks.workunit.client.1.smithi120.stdout:8/589: symlink d5/d6/d34/lc2 0 2024-04-26T21:25:59.344 INFO:tasks.workunit.client.1.smithi120.stdout:7/624: truncate d7/d64/da6/d1f/d28/f2e 173762 0 2024-04-26T21:25:59.344 INFO:tasks.workunit.client.0.smithi084.stdout:0/425: rmdir de/d20/d4c 39 2024-04-26T21:25:59.346 INFO:tasks.workunit.client.0.smithi084.stdout:0/426: chown de/d2b/d64 6518659 1 2024-04-26T21:25:59.346 INFO:tasks.workunit.client.1.smithi120.stdout:2/652: symlink d4/d1b/d5c/d99/ld7 0 2024-04-26T21:25:59.350 INFO:tasks.workunit.client.0.smithi084.stdout:4/374: mknod d5/d2e/c7d 0 2024-04-26T21:25:59.353 INFO:tasks.workunit.client.1.smithi120.stdout:6/671: dwrite d4/db/d25/d6d/fb4 [0,4194304] 0 2024-04-26T21:25:59.354 INFO:tasks.workunit.client.0.smithi084.stdout:8/419: symlink d4/d7/d15/d37/d3b/l75 0 2024-04-26T21:25:59.356 INFO:tasks.workunit.client.1.smithi120.stdout:7/625: creat d7/d64/da6/d1a/d33/d34/d37/fd4 x:0 0 0 2024-04-26T21:25:59.358 INFO:tasks.workunit.client.1.smithi120.stdout:2/653: write d4/d1b/d56/d65/fbc [544665,64866] 0 2024-04-26T21:25:59.360 INFO:tasks.workunit.client.1.smithi120.stdout:8/590: getdents d5/d6/d34/d42/d9d/d7a/da4 0 2024-04-26T21:25:59.367 INFO:tasks.workunit.client.1.smithi120.stdout:2/654: rmdir d4/d1b/d2e 39 2024-04-26T21:25:59.367 INFO:tasks.workunit.client.1.smithi120.stdout:6/672: dread - d4/db/d10/dd/d4e/d60/fb1 zero size 2024-04-26T21:25:59.367 INFO:tasks.workunit.client.1.smithi120.stdout:7/626: chown d7/d64/da6/d1f/d28/d4c/d6b/f8f 1393283 1 2024-04-26T21:25:59.368 INFO:tasks.workunit.client.1.smithi120.stdout:8/591: creat d5/d6/d34/d42/fc3 x:0 0 0 2024-04-26T21:25:59.368 INFO:tasks.workunit.client.1.smithi120.stdout:0/747: dwrite d0/df/d59/fed [0,4194304] 0 2024-04-26T21:25:59.371 INFO:tasks.workunit.client.1.smithi120.stdout:6/673: chown d4/db/d10/dd/d43/d58 843057683 1 2024-04-26T21:25:59.376 INFO:tasks.workunit.client.1.smithi120.stdout:8/592: rmdir d5/d6/d34/d42/d9d/d7a 39 2024-04-26T21:25:59.377 INFO:tasks.workunit.client.0.smithi084.stdout:7/425: write d6/d9/d12/d19/d20/d38/f82 [8706,111397] 0 2024-04-26T21:25:59.379 INFO:tasks.workunit.client.0.smithi084.stdout:1/442: write d2/d54/d5e/d66/f36 [132698,27542] 0 2024-04-26T21:25:59.382 INFO:tasks.workunit.client.1.smithi120.stdout:6/674: write d4/f14 [8627011,103196] 0 2024-04-26T21:25:59.386 INFO:tasks.workunit.client.1.smithi120.stdout:8/593: unlink d5/d6/d34/d37/d60/fc0 0 2024-04-26T21:25:59.386 INFO:tasks.workunit.client.0.smithi084.stdout:9/370: write da/de/d1e/f49 [352855,112384] 0 2024-04-26T21:25:59.387 INFO:tasks.workunit.client.1.smithi120.stdout:7/627: creat d7/d64/da6/d1a/d33/fd5 x:0 0 0 2024-04-26T21:25:59.390 INFO:tasks.workunit.client.0.smithi084.stdout:5/442: dwrite d0/d17/f20 [0,4194304] 0 2024-04-26T21:25:59.393 INFO:tasks.workunit.client.0.smithi084.stdout:4/375: creat d5/d10/d15/d21/d29/f7e x:0 0 0 2024-04-26T21:25:59.394 INFO:tasks.workunit.client.1.smithi120.stdout:6/675: creat d4/db/d10/ddb/fe5 x:0 0 0 2024-04-26T21:25:59.396 INFO:tasks.workunit.client.0.smithi084.stdout:8/420: mknod d4/d7/d15/d3c/c76 0 2024-04-26T21:25:59.397 INFO:tasks.workunit.client.1.smithi120.stdout:1/597: dwrite d6/f3a [4194304,4194304] 0 2024-04-26T21:25:59.398 INFO:tasks.workunit.client.0.smithi084.stdout:6/442: link d3/de/d15/d23/f2e d3/de/d1a/d43/d72/f94 0 2024-04-26T21:25:59.406 INFO:tasks.workunit.client.0.smithi084.stdout:7/426: dwrite d6/d9/d12/d19/f7e [0,4194304] 0 2024-04-26T21:25:59.406 INFO:tasks.workunit.client.1.smithi120.stdout:8/594: getdents d5/d6/d34/d37 0 2024-04-26T21:25:59.407 INFO:tasks.workunit.client.1.smithi120.stdout:3/630: dread dd/de/d18/d24/f3a [0,4194304] 0 2024-04-26T21:25:59.409 INFO:tasks.workunit.client.0.smithi084.stdout:0/427: dread f0 [0,4194304] 0 2024-04-26T21:25:59.412 INFO:tasks.workunit.client.1.smithi120.stdout:9/599: sync 2024-04-26T21:25:59.412 INFO:tasks.workunit.client.0.smithi084.stdout:1/443: dwrite d2/d54/d5e/d66/d2a/d2c/d75/f7d [0,4194304] 0 2024-04-26T21:25:59.418 INFO:tasks.workunit.client.0.smithi084.stdout:6/443: creat d3/de/d15/d40/f95 x:0 0 0 2024-04-26T21:25:59.418 INFO:tasks.workunit.client.0.smithi084.stdout:7/427: mknod d6/d1c/c8e 0 2024-04-26T21:25:59.420 INFO:tasks.workunit.client.0.smithi084.stdout:0/428: write de/d2b/d77/d32/f69 [288498,85454] 0 2024-04-26T21:25:59.425 INFO:tasks.workunit.client.1.smithi120.stdout:1/598: creat d6/d14/d3c/dab/fc4 x:0 0 0 2024-04-26T21:25:59.426 INFO:tasks.workunit.client.0.smithi084.stdout:3/410: getdents d1/d2c/d2f/d31 0 2024-04-26T21:25:59.427 INFO:tasks.workunit.client.0.smithi084.stdout:7/428: write d6/d9/fa [6244252,72857] 0 2024-04-26T21:25:59.429 INFO:tasks.workunit.client.1.smithi120.stdout:3/631: mkdir dd/de/df/d12/d48/d9b/dcb 0 2024-04-26T21:25:59.432 INFO:tasks.workunit.client.1.smithi120.stdout:3/632: fsync dd/de/df/d12/d48/f93 0 2024-04-26T21:25:59.433 INFO:tasks.workunit.client.1.smithi120.stdout:6/676: creat d4/db/d10/d1a/d2b/d57/fe6 x:0 0 0 2024-04-26T21:25:59.434 INFO:tasks.workunit.client.0.smithi084.stdout:2/560: creat d6/d7/d3d/fc2 x:0 0 0 2024-04-26T21:25:59.436 INFO:tasks.workunit.client.1.smithi120.stdout:1/599: creat d6/d7/d2d/d98/d35/fc5 x:0 0 0 2024-04-26T21:25:59.439 INFO:tasks.workunit.client.0.smithi084.stdout:0/429: stat de/d2b/c47 0 2024-04-26T21:25:59.442 INFO:tasks.workunit.client.1.smithi120.stdout:2/655: dread d4/d1b/d2e/d50/d14/d15/f2b [0,4194304] 0 2024-04-26T21:25:59.442 INFO:tasks.workunit.client.0.smithi084.stdout:3/411: mknod d1/d2c/d2f/d31/c8a 0 2024-04-26T21:25:59.443 INFO:tasks.workunit.client.1.smithi120.stdout:0/748: write d0/d3/dc/d12/f1a [3012015,7968] 0 2024-04-26T21:25:59.446 INFO:tasks.workunit.client.0.smithi084.stdout:7/429: mkdir d6/d9/d12/d19/d8f 0 2024-04-26T21:25:59.446 INFO:tasks.workunit.client.0.smithi084.stdout:9/371: write da/f3a [64008,16146] 0 2024-04-26T21:25:59.449 INFO:tasks.workunit.client.0.smithi084.stdout:4/376: getdents d5/d10/d15 0 2024-04-26T21:25:59.450 INFO:tasks.workunit.client.0.smithi084.stdout:5/443: getdents d0/dc/d48 0 2024-04-26T21:25:59.453 INFO:tasks.workunit.client.0.smithi084.stdout:0/430: mknod de/d20/d4e/c8a 0 2024-04-26T21:25:59.456 INFO:tasks.workunit.client.1.smithi120.stdout:2/656: write d4/d1b/d56/d65/d8d/fbb [156337,2143] 0 2024-04-26T21:25:59.456 INFO:tasks.workunit.client.0.smithi084.stdout:9/372: mknod da/de/d16/d25/d4f/c87 0 2024-04-26T21:25:59.458 INFO:tasks.workunit.client.1.smithi120.stdout:0/749: rename d0/d3/dc/d12/dae/ff5 to d0/d3/dc/d12/ffa 0 2024-04-26T21:25:59.459 INFO:tasks.workunit.client.1.smithi120.stdout:9/600: write d0/d14/d2d/f2f [1694653,51671] 0 2024-04-26T21:25:59.460 INFO:tasks.workunit.client.1.smithi120.stdout:6/677: rmdir d4/db/d10/d1a/d2b/d57/d67/d98/dde 0 2024-04-26T21:25:59.461 INFO:tasks.workunit.client.0.smithi084.stdout:5/444: rename d0/f80 to d0/dc/df/d31/d72/d84/f89 0 2024-04-26T21:25:59.465 INFO:tasks.workunit.client.1.smithi120.stdout:7/628: dread d7/d19/f24 [0,4194304] 0 2024-04-26T21:25:59.467 INFO:tasks.workunit.client.0.smithi084.stdout:6/444: write d3/de/d15/df/f62 [1021673,58548] 0 2024-04-26T21:25:59.467 INFO:tasks.workunit.client.1.smithi120.stdout:2/657: creat d4/fd8 x:0 0 0 2024-04-26T21:25:59.468 INFO:tasks.workunit.client.0.smithi084.stdout:8/421: dread d4/d7/d15/d37/d52/f67 [0,4194304] 0 2024-04-26T21:25:59.469 INFO:tasks.workunit.client.0.smithi084.stdout:6/445: read - d3/d18/f8d zero size 2024-04-26T21:25:59.472 INFO:tasks.workunit.client.1.smithi120.stdout:6/678: rename d4/db/d25/cd5 to d4/db/ce7 0 2024-04-26T21:25:59.473 INFO:tasks.workunit.client.0.smithi084.stdout:7/430: rename d6/d9/d12/d19/d7a/d84/d47 to d6/d9/d89/d90 0 2024-04-26T21:25:59.473 INFO:tasks.workunit.client.1.smithi120.stdout:4/621: sync 2024-04-26T21:25:59.473 INFO:tasks.workunit.client.1.smithi120.stdout:5/715: sync 2024-04-26T21:25:59.475 INFO:tasks.workunit.client.1.smithi120.stdout:0/750: mkdir d0/d3/dc/dd/d1b/dfb 0 2024-04-26T21:25:59.476 INFO:tasks.workunit.client.0.smithi084.stdout:5/445: mkdir d0/dc/df/d31/d63/d8a 0 2024-04-26T21:25:59.476 INFO:tasks.workunit.client.1.smithi120.stdout:8/595: dwrite d5/d6/d11/d52/d27/f9b [0,4194304] 0 2024-04-26T21:25:59.478 INFO:tasks.workunit.client.1.smithi120.stdout:7/629: creat d7/d10/d97/d99/fd6 x:0 0 0 2024-04-26T21:25:59.479 INFO:tasks.workunit.client.1.smithi120.stdout:6/679: write d4/db/f6b [801341,39487] 0 2024-04-26T21:25:59.482 INFO:tasks.workunit.client.0.smithi084.stdout:4/377: write d5/d2e/d5f/f4b [1723116,16022] 0 2024-04-26T21:25:59.483 INFO:tasks.workunit.client.0.smithi084.stdout:6/446: symlink d3/de/d1a/l96 0 2024-04-26T21:25:59.484 INFO:tasks.workunit.client.1.smithi120.stdout:0/751: readlink d0/dd1/dd2/de9/lc5 0 2024-04-26T21:25:59.488 INFO:tasks.workunit.client.1.smithi120.stdout:7/630: mknod d7/d64/da6/d1f/d28/dbb/cd7 0 2024-04-26T21:25:59.488 INFO:tasks.workunit.client.1.smithi120.stdout:8/596: stat d5/d6/d11/d52/d70/c76 0 2024-04-26T21:25:59.491 INFO:tasks.workunit.client.1.smithi120.stdout:5/716: creat d2/dc/d1d/d21/d66/d85/f101 x:0 0 0 2024-04-26T21:25:59.491 INFO:tasks.workunit.client.0.smithi084.stdout:7/431: symlink d6/d9/d89/d90/l91 0 2024-04-26T21:25:59.491 INFO:tasks.workunit.client.0.smithi084.stdout:9/373: write da/f37 [628047,68755] 0 2024-04-26T21:25:59.491 INFO:tasks.workunit.client.0.smithi084.stdout:0/431: link de/d2b/d77/f33 de/f8b 0 2024-04-26T21:25:59.493 INFO:tasks.workunit.client.1.smithi120.stdout:4/622: mknod d10/d65/d8c/cd3 0 2024-04-26T21:25:59.494 INFO:tasks.workunit.client.1.smithi120.stdout:0/752: rmdir d0/d3/dc/dd/d1b/d24 39 2024-04-26T21:25:59.497 INFO:tasks.workunit.client.0.smithi084.stdout:9/374: readlink da/de/d1e/l21 0 2024-04-26T21:25:59.498 INFO:tasks.workunit.client.1.smithi120.stdout:9/601: dwrite d0/d14/f35 [4194304,4194304] 0 2024-04-26T21:25:59.500 INFO:tasks.workunit.client.0.smithi084.stdout:4/378: rename d5/d10/d75 to d5/d7/d65/d7f 0 2024-04-26T21:25:59.502 INFO:tasks.workunit.client.1.smithi120.stdout:2/658: link d4/d1b/c3b d4/d1b/d2e/d50/d14/d15/cd9 0 2024-04-26T21:25:59.502 INFO:tasks.workunit.client.0.smithi084.stdout:3/412: chown d1/d2c/d2f/d31/d3b/f6c 102430370 1 2024-04-26T21:25:59.504 INFO:tasks.workunit.client.1.smithi120.stdout:4/623: read d10/d6b/f7d [47384,62230] 0 2024-04-26T21:25:59.506 INFO:tasks.workunit.client.0.smithi084.stdout:1/444: dread d2/d54/d5e/d66/f2b [4194304,4194304] 0 2024-04-26T21:25:59.506 INFO:tasks.workunit.client.0.smithi084.stdout:0/432: truncate de/d2b/d45/d63/f86 563620 0 2024-04-26T21:25:59.506 INFO:tasks.workunit.client.0.smithi084.stdout:5/446: chown d0/dc/df/d31/d53/d5d/l67 3 1 2024-04-26T21:25:59.507 INFO:tasks.workunit.client.1.smithi120.stdout:1/600: dwrite d6/d7/d1b/f60 [0,4194304] 0 2024-04-26T21:25:59.509 INFO:tasks.workunit.client.1.smithi120.stdout:0/753: mknod d0/d3/dc/d12/d31/cfc 0 2024-04-26T21:25:59.509 INFO:tasks.workunit.client.1.smithi120.stdout:8/597: creat d5/d6/d11/d52/d70/d88/fc4 x:0 0 0 2024-04-26T21:25:59.511 INFO:tasks.workunit.client.1.smithi120.stdout:9/602: symlink d0/d14/d2d/d4b/d85/lc2 0 2024-04-26T21:25:59.512 INFO:tasks.workunit.client.0.smithi084.stdout:7/432: dread d6/f17 [0,4194304] 0 2024-04-26T21:25:59.514 INFO:tasks.workunit.client.0.smithi084.stdout:6/447: dwrite d3/de/d1a/d43/d75/f7e [0,4194304] 0 2024-04-26T21:25:59.514 INFO:tasks.workunit.client.0.smithi084.stdout:9/375: mknod da/de/d16/d55/c88 0 2024-04-26T21:25:59.514 INFO:tasks.workunit.client.1.smithi120.stdout:0/754: read - d0/d3/d51/f88 zero size 2024-04-26T21:25:59.515 INFO:tasks.workunit.client.1.smithi120.stdout:3/633: dread dd/de/d83/d64/f84 [0,4194304] 0 2024-04-26T21:25:59.516 INFO:tasks.workunit.client.1.smithi120.stdout:2/659: rmdir d4/d1b/d4f/d95 39 2024-04-26T21:25:59.521 INFO:tasks.workunit.client.1.smithi120.stdout:5/717: rename d2/d48/f6f to d2/dc/d1d/d21/d66/f102 0 2024-04-26T21:25:59.521 INFO:tasks.workunit.client.1.smithi120.stdout:8/598: fdatasync d5/d6/d11/d52/f44 0 2024-04-26T21:25:59.524 INFO:tasks.workunit.client.0.smithi084.stdout:7/433: truncate d6/d68/f6e 755513 0 2024-04-26T21:25:59.525 INFO:tasks.workunit.client.1.smithi120.stdout:7/631: getdents d7/d64/da6/d1f/d7d 0 2024-04-26T21:25:59.525 INFO:tasks.workunit.client.1.smithi120.stdout:3/634: truncate dd/de/f2f 4468190 0 2024-04-26T21:25:59.527 INFO:tasks.workunit.client.0.smithi084.stdout:0/433: stat de/f14 0 2024-04-26T21:25:59.529 INFO:tasks.workunit.client.0.smithi084.stdout:8/422: truncate d4/d7/d15/d3c/f4b 618055 0 2024-04-26T21:25:59.531 INFO:tasks.workunit.client.1.smithi120.stdout:8/599: write d5/d6/d11/fbd [9402,51050] 0 2024-04-26T21:25:59.533 INFO:tasks.workunit.client.1.smithi120.stdout:2/660: unlink d4/d1b/d56/d65/f67 0 2024-04-26T21:25:59.536 INFO:tasks.workunit.client.0.smithi084.stdout:3/413: dwrite d1/d2c/f71 [4194304,4194304] 0 2024-04-26T21:25:59.537 INFO:tasks.workunit.client.1.smithi120.stdout:5/718: creat d2/d48/f103 x:0 0 0 2024-04-26T21:25:59.537 INFO:tasks.workunit.client.1.smithi120.stdout:3/635: dread - dd/de/d18/d24/db1/d76/d3b/d56/fb5 zero size 2024-04-26T21:25:59.538 INFO:tasks.workunit.client.1.smithi120.stdout:7/632: getdents d7/d64/da6/d1a/dc5 0 2024-04-26T21:25:59.540 INFO:tasks.workunit.client.0.smithi084.stdout:5/447: rename d0/c6a to d0/dc/df/d51/c8b 0 2024-04-26T21:25:59.541 INFO:tasks.workunit.client.0.smithi084.stdout:2/561: dwrite d6/d7/d3d/d15/d1f/d41/f65 [0,4194304] 0 2024-04-26T21:25:59.542 INFO:tasks.workunit.client.1.smithi120.stdout:8/600: creat d5/d6/d34/d42/d4a/dbf/fc5 x:0 0 0 2024-04-26T21:25:59.543 INFO:tasks.workunit.client.1.smithi120.stdout:3/636: chown dd/f31 27 1 2024-04-26T21:25:59.543 INFO:tasks.workunit.client.1.smithi120.stdout:2/661: rmdir d4/d1b/d2e/d50/d14/dc2 39 2024-04-26T21:25:59.543 INFO:tasks.workunit.client.0.smithi084.stdout:4/379: symlink d5/d7/d65/d7f/d6a/l80 0 2024-04-26T21:25:59.544 INFO:tasks.workunit.client.1.smithi120.stdout:5/719: fdatasync d2/f3f 0 2024-04-26T21:25:59.550 INFO:tasks.workunit.client.1.smithi120.stdout:0/755: dread d0/d3/dc/d12/f6a [0,4194304] 0 2024-04-26T21:25:59.555 INFO:tasks.workunit.client.1.smithi120.stdout:3/637: unlink dd/de/d18/d24/f23 0 2024-04-26T21:25:59.555 INFO:tasks.workunit.client.1.smithi120.stdout:8/601: dread - d5/d6/d11/d52/d27/d4f/d67/f7b zero size 2024-04-26T21:25:59.555 INFO:tasks.workunit.client.1.smithi120.stdout:5/720: chown d2/d1b/d89/d47/d8a/ldd 1015689129 1 2024-04-26T21:25:59.557 INFO:tasks.workunit.client.0.smithi084.stdout:9/376: unlink da/de/d16/d25/d41/d67/f75 0 2024-04-26T21:25:59.561 INFO:tasks.workunit.client.0.smithi084.stdout:9/377: truncate da/de/d16/d40/f64 663846 0 2024-04-26T21:25:59.562 INFO:tasks.workunit.client.1.smithi120.stdout:1/601: truncate d6/d7/d1b/d55/f5b 3651722 0 2024-04-26T21:25:59.563 INFO:tasks.workunit.client.1.smithi120.stdout:7/633: truncate d7/d64/da6/d1a/d33/f5b 674627 0 2024-04-26T21:25:59.564 INFO:tasks.workunit.client.1.smithi120.stdout:2/662: rename d4/d1b/f89 to d4/d1b/d5c/fda 0 2024-04-26T21:25:59.564 INFO:tasks.workunit.client.1.smithi120.stdout:4/624: dwrite d10/d28/f31 [0,4194304] 0 2024-04-26T21:25:59.571 INFO:tasks.workunit.client.1.smithi120.stdout:3/638: mknod dd/de/d18/d24/db1/d76/d3b/ccc 0 2024-04-26T21:25:59.571 INFO:tasks.workunit.client.1.smithi120.stdout:4/625: unlink d10/f6f 0 2024-04-26T21:25:59.573 INFO:tasks.workunit.client.0.smithi084.stdout:4/380: write d5/d10/d15/d21/d29/f3c [2418916,109652] 0 2024-04-26T21:25:59.575 INFO:tasks.workunit.client.0.smithi084.stdout:8/423: mkdir d4/d6/db/d77 0 2024-04-26T21:25:59.576 INFO:tasks.workunit.client.1.smithi120.stdout:9/603: truncate d0/d14/f35 1232498 0 2024-04-26T21:25:59.577 INFO:tasks.workunit.client.0.smithi084.stdout:1/445: dread d2/d19/f4c [0,4194304] 0 2024-04-26T21:25:59.577 INFO:tasks.workunit.client.1.smithi120.stdout:7/634: dread - d7/d64/da6/d1f/d7d/d8b/fa3 zero size 2024-04-26T21:25:59.579 INFO:tasks.workunit.client.1.smithi120.stdout:5/721: rename d2/f5a to d2/dc/d1d/f104 0 2024-04-26T21:25:59.579 INFO:tasks.workunit.client.0.smithi084.stdout:5/448: mknod d0/dc/df/d31/d45/c8c 0 2024-04-26T21:25:59.580 INFO:tasks.workunit.client.1.smithi120.stdout:1/602: dread d6/d7/d2d/d98/d35/f87 [0,4194304] 0 2024-04-26T21:25:59.580 INFO:tasks.workunit.client.0.smithi084.stdout:9/378: mknod da/de/d16/c89 0 2024-04-26T21:25:59.581 INFO:tasks.workunit.client.1.smithi120.stdout:9/604: chown d0/d14/d2d/d4b/f55 21 1 2024-04-26T21:25:59.583 INFO:tasks.workunit.client.0.smithi084.stdout:4/381: chown d5/d10/f1b 4519051 1 2024-04-26T21:25:59.584 INFO:tasks.workunit.client.0.smithi084.stdout:3/414: readlink d1/d2c/d2f/d31/d55/l49 0 2024-04-26T21:25:59.586 INFO:tasks.workunit.client.1.smithi120.stdout:9/605: write d0/d14/d2d/f2f [2717237,124442] 0 2024-04-26T21:25:59.590 INFO:tasks.workunit.client.0.smithi084.stdout:7/434: dwrite d6/d9/d89/d90/f85 [0,4194304] 0 2024-04-26T21:25:59.590 INFO:tasks.workunit.client.0.smithi084.stdout:4/382: write d5/d7/f63 [892595,130627] 0 2024-04-26T21:25:59.590 INFO:tasks.workunit.client.0.smithi084.stdout:8/424: rename d4 to d4/d7/d15/d78 22 2024-04-26T21:25:59.590 INFO:tasks.workunit.client.1.smithi120.stdout:3/639: creat dd/de/d83/db2/fcd x:0 0 0 2024-04-26T21:25:59.592 INFO:tasks.workunit.client.1.smithi120.stdout:2/663: rename d4/d1b/d56/d65/d8d/d96 to d4/d1b/d25/d2c/d3e/ddb 0 2024-04-26T21:25:59.596 INFO:tasks.workunit.client.0.smithi084.stdout:1/446: rmdir d2/d1b 39 2024-04-26T21:25:59.597 INFO:tasks.workunit.client.1.smithi120.stdout:8/602: creat d5/d6/d11/d52/d27/fc6 x:0 0 0 2024-04-26T21:25:59.604 INFO:tasks.workunit.client.0.smithi084.stdout:9/379: rename da/f1a to da/de/d16/d25/d41/d43/d48/d61/f8a 0 2024-04-26T21:25:59.604 INFO:tasks.workunit.client.0.smithi084.stdout:1/447: stat d2/d9/d15/d28/f62 0 2024-04-26T21:25:59.612 INFO:tasks.workunit.client.0.smithi084.stdout:1/448: write d2/d19/f32 [1828071,1536] 0 2024-04-26T21:25:59.618 INFO:tasks.workunit.client.0.smithi084.stdout:6/448: dread d3/de/d1a/d2f/f3c [0,4194304] 0 2024-04-26T21:25:59.618 INFO:tasks.workunit.client.0.smithi084.stdout:5/449: creat d0/d49/f8d x:0 0 0 2024-04-26T21:25:59.621 INFO:tasks.workunit.client.0.smithi084.stdout:9/380: mknod da/de/d16/d55/c8b 0 2024-04-26T21:25:59.621 INFO:tasks.workunit.client.0.smithi084.stdout:1/449: unlink c0 0 2024-04-26T21:25:59.629 INFO:tasks.workunit.client.0.smithi084.stdout:0/434: dwrite f4 [4194304,4194304] 0 2024-04-26T21:25:59.629 INFO:tasks.workunit.client.0.smithi084.stdout:4/383: truncate d5/d7/f63 317871 0 2024-04-26T21:25:59.632 INFO:tasks.workunit.client.0.smithi084.stdout:3/415: dwrite d1/f77 [0,4194304] 0 2024-04-26T21:25:59.633 INFO:tasks.workunit.client.0.smithi084.stdout:6/449: write d3/de/d15/f85 [890131,50281] 0 2024-04-26T21:25:59.636 INFO:tasks.workunit.client.0.smithi084.stdout:9/381: rename da/de/d16/d55/c8b to da/c8c 0 2024-04-26T21:25:59.638 INFO:tasks.workunit.client.0.smithi084.stdout:4/384: readlink d5/d10/d15/d21/l49 0 2024-04-26T21:25:59.638 INFO:tasks.workunit.client.0.smithi084.stdout:4/385: stat d5/d7 0 2024-04-26T21:25:59.638 INFO:tasks.workunit.client.0.smithi084.stdout:5/450: symlink d0/dc/df/d31/d53/d5d/l8e 0 2024-04-26T21:25:59.640 INFO:tasks.workunit.client.0.smithi084.stdout:3/416: chown d1/d2c/f3c 54974 1 2024-04-26T21:25:59.642 INFO:tasks.workunit.client.0.smithi084.stdout:7/435: dwrite d6/d9/d63/f87 [0,4194304] 0 2024-04-26T21:25:59.649 INFO:tasks.workunit.client.0.smithi084.stdout:3/417: chown d1/f1d 3 1 2024-04-26T21:25:59.650 INFO:tasks.workunit.client.0.smithi084.stdout:4/386: write d5/d7/f63 [149541,88056] 0 2024-04-26T21:25:59.651 INFO:tasks.workunit.client.1.smithi120.stdout:4/626: rename d10/d65/d72 to d10/d65/d8c/dd0/dd4 0 2024-04-26T21:25:59.657 INFO:tasks.workunit.client.1.smithi120.stdout:2/664: chown d4/d1b/d2e/d50/d14/d15/d6c/c7f 170636 1 2024-04-26T21:25:59.657 INFO:tasks.workunit.client.0.smithi084.stdout:7/436: rename d6/d9 to d6/d9/d12/d8b/d92 22 2024-04-26T21:25:59.657 INFO:tasks.workunit.client.0.smithi084.stdout:9/382: truncate da/fb 7655663 0 2024-04-26T21:25:59.660 INFO:tasks.workunit.client.1.smithi120.stdout:5/722: dwrite d2/d48/f103 [0,4194304] 0 2024-04-26T21:25:59.662 INFO:tasks.workunit.client.1.smithi120.stdout:0/756: dread d0/d3/d13/f76 [0,4194304] 0 2024-04-26T21:25:59.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:25:59 smithi084 ceph-mon[25539]: pgmap v44: 65 pgs: 65 active+clean; 2.0 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 76 MiB/s rd, 280 MiB/s wr, 507 op/s 2024-04-26T21:25:59.665 INFO:tasks.workunit.client.0.smithi084.stdout:4/387: rmdir d5/d2e/d5f 39 2024-04-26T21:25:59.667 INFO:tasks.workunit.client.1.smithi120.stdout:5/723: truncate d2/dc/f38 4332552 0 2024-04-26T21:25:59.669 INFO:tasks.workunit.client.0.smithi084.stdout:4/388: dread - d5/d25/f79 zero size 2024-04-26T21:25:59.669 INFO:tasks.workunit.client.0.smithi084.stdout:7/437: symlink d6/d9/d12/d19/d20/d38/l93 0 2024-04-26T21:25:59.671 INFO:tasks.workunit.client.0.smithi084.stdout:1/450: dwrite d2/d9/d15/f58 [0,4194304] 0 2024-04-26T21:25:59.673 INFO:tasks.workunit.client.1.smithi120.stdout:7/635: dwrite d7/d64/da6/f16 [4194304,4194304] 0 2024-04-26T21:25:59.674 INFO:tasks.workunit.client.0.smithi084.stdout:9/383: mkdir da/de/d16/d25/d41/d8d 0 2024-04-26T21:25:59.678 INFO:tasks.workunit.client.1.smithi120.stdout:8/603: symlink d5/d6/d34/d42/d4a/lc7 0 2024-04-26T21:25:59.679 INFO:tasks.workunit.client.0.smithi084.stdout:4/389: creat d5/d25/d35/f81 x:0 0 0 2024-04-26T21:25:59.681 INFO:tasks.workunit.client.0.smithi084.stdout:9/384: fdatasync da/de/d16/d25/f36 0 2024-04-26T21:25:59.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:25:59 smithi120 ceph-mon[32741]: pgmap v44: 65 pgs: 65 active+clean; 2.0 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 76 MiB/s rd, 280 MiB/s wr, 507 op/s 2024-04-26T21:25:59.683 INFO:tasks.workunit.client.0.smithi084.stdout:7/438: fsync d6/d9/d12/d19/d7a/d84/f7c 0 2024-04-26T21:25:59.685 INFO:tasks.workunit.client.1.smithi120.stdout:3/640: creat dd/de/df/db6/dc5/fce x:0 0 0 2024-04-26T21:25:59.688 INFO:tasks.workunit.client.0.smithi084.stdout:4/390: fsync d5/d7/d65/d7f/f4f 0 2024-04-26T21:25:59.692 INFO:tasks.workunit.client.0.smithi084.stdout:4/391: chown d5 0 1 2024-04-26T21:25:59.695 INFO:tasks.workunit.client.1.smithi120.stdout:0/757: mknod d0/df/d79/cfd 0 2024-04-26T21:25:59.697 INFO:tasks.workunit.client.1.smithi120.stdout:5/724: dwrite d2/dc/d1d/d21/d66/fc2 [4194304,4194304] 0 2024-04-26T21:25:59.699 INFO:tasks.workunit.client.0.smithi084.stdout:4/392: fdatasync d5/d7/d65/d7f/f4f 0 2024-04-26T21:25:59.703 INFO:tasks.workunit.client.0.smithi084.stdout:8/425: dread d4/d6/f24 [0,4194304] 0 2024-04-26T21:25:59.706 INFO:tasks.workunit.client.1.smithi120.stdout:7/636: write d7/d64/da6/d2f/f52 [645681,2287] 0 2024-04-26T21:25:59.706 INFO:tasks.workunit.client.0.smithi084.stdout:9/385: mknod da/de/d16/d25/d41/d43/d4a/c8e 0 2024-04-26T21:25:59.707 INFO:tasks.workunit.client.1.smithi120.stdout:3/641: dwrite dd/de/df/d12/fa0 [0,4194304] 0 2024-04-26T21:25:59.709 INFO:tasks.workunit.client.1.smithi120.stdout:7/637: readlink d7/d64/da6/d1f/l4f 0 2024-04-26T21:25:59.711 INFO:tasks.workunit.client.1.smithi120.stdout:3/642: write dd/d2a/d74/fbf [3851829,54630] 0 2024-04-26T21:25:59.711 INFO:tasks.workunit.client.0.smithi084.stdout:7/439: link d6/d1c/d51/l81 d6/d9/d12/d19/d7a/l94 0 2024-04-26T21:25:59.713 INFO:tasks.workunit.client.1.smithi120.stdout:3/643: stat dd/d40/f92 0 2024-04-26T21:25:59.713 INFO:tasks.workunit.client.1.smithi120.stdout:7/638: chown d7/d64/da6/d1f/d28/d4c/d6c/d74/lba 15 1 2024-04-26T21:25:59.716 INFO:tasks.workunit.client.0.smithi084.stdout:3/418: dwrite d1/d2c/d2f/f1f [0,4194304] 0 2024-04-26T21:25:59.716 INFO:tasks.workunit.client.0.smithi084.stdout:9/386: creat da/de/d16/d25/d41/d43/d48/f8f x:0 0 0 2024-04-26T21:25:59.718 INFO:tasks.workunit.client.1.smithi120.stdout:3/644: write dd/de/df/d12/f21 [6669104,105081] 0 2024-04-26T21:25:59.720 INFO:tasks.workunit.client.1.smithi120.stdout:0/758: creat d0/dd1/dd2/de9/ffe x:0 0 0 2024-04-26T21:25:59.722 INFO:tasks.workunit.client.0.smithi084.stdout:4/393: getdents d5/d25 0 2024-04-26T21:25:59.723 INFO:tasks.workunit.client.1.smithi120.stdout:5/725: creat d2/dc/d1d/d1f/d36/d44/f105 x:0 0 0 2024-04-26T21:25:59.726 INFO:tasks.workunit.client.1.smithi120.stdout:6/680: sync 2024-04-26T21:25:59.729 INFO:tasks.workunit.client.1.smithi120.stdout:7/639: fdatasync d7/d64/da6/d1f/d28/f2c 0 2024-04-26T21:25:59.734 INFO:tasks.workunit.client.1.smithi120.stdout:3/645: readlink dd/de/df/lca 0 2024-04-26T21:25:59.737 INFO:tasks.workunit.client.0.smithi084.stdout:8/426: rename d4/d7/d15/d37/d3b/l3f to d4/d7/d15/d37/l79 0 2024-04-26T21:25:59.739 INFO:tasks.workunit.client.0.smithi084.stdout:7/440: getdents d6/d9/d12/d19/d8f 0 2024-04-26T21:25:59.740 INFO:tasks.workunit.client.0.smithi084.stdout:3/419: write d1/d2c/d2f/d31/d3b/f7a [1416587,80951] 0 2024-04-26T21:25:59.740 INFO:tasks.workunit.client.0.smithi084.stdout:4/394: mkdir d5/d10/d82 0 2024-04-26T21:25:59.742 INFO:tasks.workunit.client.1.smithi120.stdout:5/726: creat d2/dc/d1d/d1f/d36/d44/d6c/f106 x:0 0 0 2024-04-26T21:25:59.743 INFO:tasks.workunit.client.1.smithi120.stdout:5/727: chown d2 321861706 1 2024-04-26T21:25:59.746 INFO:tasks.workunit.client.1.smithi120.stdout:5/728: stat d2/dc/d1d/d1f/d36/d44/d6c/f2a 0 2024-04-26T21:25:59.747 INFO:tasks.workunit.client.1.smithi120.stdout:6/681: mknod d4/db/d10/d1a/ce8 0 2024-04-26T21:25:59.748 INFO:tasks.workunit.client.0.smithi084.stdout:1/451: dwrite d2/d9/d15/f25 [0,4194304] 0 2024-04-26T21:25:59.749 INFO:tasks.workunit.client.1.smithi120.stdout:4/627: write d10/d12/fa7 [743293,114067] 0 2024-04-26T21:25:59.754 INFO:tasks.workunit.client.0.smithi084.stdout:3/420: write d1/d24/d27/f2b [2783110,79388] 0 2024-04-26T21:25:59.754 INFO:tasks.workunit.client.0.smithi084.stdout:1/452: write d2/d54/d5e/d66/f2b [12725507,21815] 0 2024-04-26T21:25:59.754 INFO:tasks.workunit.client.1.smithi120.stdout:3/646: unlink fa 0 2024-04-26T21:25:59.755 INFO:tasks.workunit.client.0.smithi084.stdout:5/451: dread d0/f16 [4194304,4194304] 0 2024-04-26T21:25:59.757 INFO:tasks.workunit.client.0.smithi084.stdout:0/435: dread f9 [0,4194304] 0 2024-04-26T21:25:59.757 INFO:tasks.workunit.client.1.smithi120.stdout:3/647: readlink dd/de/d18/d24/d9d/lc9 0 2024-04-26T21:25:59.760 INFO:tasks.workunit.client.1.smithi120.stdout:0/759: mknod d0/d3/dc/dd/d4b/dea/cff 0 2024-04-26T21:25:59.763 INFO:tasks.workunit.client.1.smithi120.stdout:2/665: link d4/d1b/d2e/d50/d14/d15/d6c/fb3 d4/fdc 0 2024-04-26T21:25:59.764 INFO:tasks.workunit.client.0.smithi084.stdout:7/441: rename d6/d9/d12/d19/c54 to d6/d9/d12/d19/d8f/c95 0 2024-04-26T21:25:59.766 INFO:tasks.workunit.client.0.smithi084.stdout:7/442: readlink d6/lb 0 2024-04-26T21:25:59.768 INFO:tasks.workunit.client.0.smithi084.stdout:8/427: truncate d4/d7/d15/d37/d3b/f3e 1959832 0 2024-04-26T21:25:59.773 INFO:tasks.workunit.client.0.smithi084.stdout:5/452: mknod d0/d17/c8f 0 2024-04-26T21:25:59.774 INFO:tasks.workunit.client.0.smithi084.stdout:4/395: getdents d5/d25/d35/d60/d6d 0 2024-04-26T21:25:59.776 INFO:tasks.workunit.client.1.smithi120.stdout:4/628: creat d10/da6/fd5 x:0 0 0 2024-04-26T21:25:59.779 INFO:tasks.workunit.client.0.smithi084.stdout:5/453: chown d0/dc/df/d31/d63 52365003 1 2024-04-26T21:25:59.779 INFO:tasks.workunit.client.0.smithi084.stdout:3/421: rename d1/d2c/f3c to d1/d2c/d2f/d31/d52/f8b 0 2024-04-26T21:25:59.779 INFO:tasks.workunit.client.0.smithi084.stdout:8/428: fdatasync d4/f5 0 2024-04-26T21:25:59.781 INFO:tasks.workunit.client.1.smithi120.stdout:5/729: rename d2/dc/d1d/d1f to d2/d30/d93/d107 0 2024-04-26T21:25:59.784 INFO:tasks.workunit.client.1.smithi120.stdout:6/682: dwrite d4/db/d10/f44 [0,4194304] 0 2024-04-26T21:25:59.784 INFO:tasks.workunit.client.1.smithi120.stdout:8/604: dread d5/d6/d11/d32/f45 [0,4194304] 0 2024-04-26T21:25:59.785 INFO:tasks.workunit.client.0.smithi084.stdout:3/422: rename d1/d2c to d1/d2c/d2f/d31/d52/d8c 22 2024-04-26T21:25:59.787 INFO:tasks.workunit.client.1.smithi120.stdout:2/666: chown d4/d1b/d25/d2c/d3e/d5e/l69 0 1 2024-04-26T21:25:59.788 INFO:tasks.workunit.client.1.smithi120.stdout:1/603: write d6/d7/d1b/d55/f5b [2510673,104738] 0 2024-04-26T21:25:59.789 INFO:tasks.workunit.client.0.smithi084.stdout:9/387: dread da/de/d16/f30 [0,4194304] 0 2024-04-26T21:25:59.789 INFO:tasks.workunit.client.1.smithi120.stdout:5/730: dread - d2/d1b/d89/d47/d8a/fcf zero size 2024-04-26T21:25:59.790 INFO:tasks.workunit.client.1.smithi120.stdout:7/640: link d7/d64/da6/d1a/d33/d34/d37/l49 d7/d64/da6/d1a/d33/d34/dab/dbf/ld8 0 2024-04-26T21:25:59.790 INFO:tasks.workunit.client.0.smithi084.stdout:4/396: creat d5/f83 x:0 0 0 2024-04-26T21:25:59.791 INFO:tasks.workunit.client.1.smithi120.stdout:3/648: mkdir dd/dcf 0 2024-04-26T21:25:59.792 INFO:tasks.workunit.client.1.smithi120.stdout:9/606: sync 2024-04-26T21:25:59.793 INFO:tasks.workunit.client.0.smithi084.stdout:0/436: dwrite f0 [0,4194304] 0 2024-04-26T21:25:59.794 INFO:tasks.workunit.client.1.smithi120.stdout:7/641: write d7/f8 [2698315,40097] 0 2024-04-26T21:25:59.795 INFO:tasks.workunit.client.1.smithi120.stdout:0/760: creat d0/d3/dc/dd/d1b/dfb/f100 x:0 0 0 2024-04-26T21:25:59.802 INFO:tasks.workunit.client.1.smithi120.stdout:4/629: mknod d10/d12/da1/daf/cd6 0 2024-04-26T21:25:59.802 INFO:tasks.workunit.client.0.smithi084.stdout:5/454: creat d0/dc/df/d31/d63/d8a/f90 x:0 0 0 2024-04-26T21:25:59.804 INFO:tasks.workunit.client.0.smithi084.stdout:8/429: creat d4/f7a x:0 0 0 2024-04-26T21:25:59.804 INFO:tasks.workunit.client.1.smithi120.stdout:0/761: dread - d0/df/d79/fec zero size 2024-04-26T21:25:59.810 INFO:tasks.workunit.client.0.smithi084.stdout:9/388: read da/f23 [115044,42172] 0 2024-04-26T21:25:59.813 INFO:tasks.workunit.client.1.smithi120.stdout:7/642: symlink d7/d64/da6/d2f/ld9 0 2024-04-26T21:25:59.813 INFO:tasks.workunit.client.1.smithi120.stdout:9/607: read d0/d6/d3d/f4e [3783738,13368] 0 2024-04-26T21:25:59.816 INFO:tasks.workunit.client.0.smithi084.stdout:9/389: chown da/de/d16/d25/d41/d8d 63 1 2024-04-26T21:25:59.816 INFO:tasks.workunit.client.0.smithi084.stdout:0/437: dwrite de/d2b/d77/d32/f79 [0,4194304] 0 2024-04-26T21:25:59.818 INFO:tasks.workunit.client.1.smithi120.stdout:5/731: dread d2/dc/d1d/d21/d66/fc2 [4194304,4194304] 0 2024-04-26T21:25:59.818 INFO:tasks.workunit.client.1.smithi120.stdout:6/683: dwrite d4/db/d25/d6d/d97/fbb [0,4194304] 0 2024-04-26T21:25:59.821 INFO:tasks.workunit.client.1.smithi120.stdout:4/630: mkdir d10/d6b/d71/dd7 0 2024-04-26T21:25:59.823 INFO:tasks.workunit.client.0.smithi084.stdout:0/438: write de/d2b/d77/d32/f79 [9047483,45899] 0 2024-04-26T21:25:59.823 INFO:tasks.workunit.client.1.smithi120.stdout:0/762: mknod d0/df/d79/c101 0 2024-04-26T21:25:59.826 INFO:tasks.workunit.client.1.smithi120.stdout:8/605: rename d5/la2 to d5/d6/lc8 0 2024-04-26T21:25:59.828 INFO:tasks.workunit.client.1.smithi120.stdout:0/763: chown d0/d3/dc/dd/d1b/d39/c7e 283930128 1 2024-04-26T21:25:59.834 INFO:tasks.workunit.client.1.smithi120.stdout:1/604: write d6/d7/d1d/d2c/f76 [70177,57192] 0 2024-04-26T21:25:59.834 INFO:tasks.workunit.client.1.smithi120.stdout:7/643: rmdir d7/d64/da6/d1f/d28 39 2024-04-26T21:25:59.836 INFO:tasks.workunit.client.0.smithi084.stdout:5/455: getdents d0/d17 0 2024-04-26T21:25:59.837 INFO:tasks.workunit.client.1.smithi120.stdout:6/684: mknod d4/db/d10/d22/d56/d94/ce9 0 2024-04-26T21:25:59.838 INFO:tasks.workunit.client.0.smithi084.stdout:7/443: dread d6/d9/d12/d19/d20/f44 [0,4194304] 0 2024-04-26T21:25:59.838 INFO:tasks.workunit.client.0.smithi084.stdout:4/397: dwrite d5/d25/f3e [0,4194304] 0 2024-04-26T21:25:59.840 INFO:tasks.workunit.client.1.smithi120.stdout:3/649: rename dd/de/d18/d37/d80/da9/caf to dd/de/df/d12/d48/d6d/cd0 0 2024-04-26T21:25:59.841 INFO:tasks.workunit.client.0.smithi084.stdout:5/456: dread - d0/d49/f8d zero size 2024-04-26T21:25:59.844 INFO:tasks.workunit.client.1.smithi120.stdout:0/764: rmdir d0/d3/dc/dd/d9b 39 2024-04-26T21:25:59.847 INFO:tasks.workunit.client.1.smithi120.stdout:9/608: symlink d0/d14/d2d/d4b/dbc/lc3 0 2024-04-26T21:25:59.849 INFO:tasks.workunit.client.1.smithi120.stdout:2/667: truncate d4/d1b/d56/d65/fb1 1554 0 2024-04-26T21:25:59.850 INFO:tasks.workunit.client.0.smithi084.stdout:0/439: fsync de/d2b/d77/d32/f3d 0 2024-04-26T21:25:59.851 INFO:tasks.workunit.client.0.smithi084.stdout:7/444: mkdir d6/d9/d96 0 2024-04-26T21:25:59.852 INFO:tasks.workunit.client.1.smithi120.stdout:8/606: symlink d5/d6/d11/d32/lc9 0 2024-04-26T21:25:59.852 INFO:tasks.workunit.client.0.smithi084.stdout:9/390: link da/de/d1e/d56/c6a da/de/d16/d25/d4f/d5f/c90 0 2024-04-26T21:25:59.856 INFO:tasks.workunit.client.1.smithi120.stdout:6/685: rename d4/db/d10/d1a/d2b/d57/d67/ce4 to d4/d3d/cea 0 2024-04-26T21:25:59.858 INFO:tasks.workunit.client.1.smithi120.stdout:0/765: truncate d0/d3/dc/dd/d1b/fc9 311395 0 2024-04-26T21:25:59.860 INFO:tasks.workunit.client.1.smithi120.stdout:2/668: symlink d4/d1b/d2e/d50/d14/d15/ldd 0 2024-04-26T21:25:59.864 INFO:tasks.workunit.client.1.smithi120.stdout:6/686: mkdir d4/db/d25/d6d/deb 0 2024-04-26T21:25:59.869 INFO:tasks.workunit.client.0.smithi084.stdout:5/457: truncate d0/dc/df/d31/f54 399952 0 2024-04-26T21:25:59.871 INFO:tasks.workunit.client.0.smithi084.stdout:8/430: truncate d4/d6/db/d1e/d22/d2f/f41 4830932 0 2024-04-26T21:25:59.871 INFO:tasks.workunit.client.0.smithi084.stdout:4/398: symlink d5/d2e/d5f/d32/d46/d77/l84 0 2024-04-26T21:25:59.872 INFO:tasks.workunit.client.1.smithi120.stdout:2/669: symlink d4/d1b/d2e/d5f/lde 0 2024-04-26T21:25:59.876 INFO:tasks.workunit.client.0.smithi084.stdout:7/445: dread - d6/d9/d63/f7b zero size 2024-04-26T21:25:59.877 INFO:tasks.workunit.client.1.smithi120.stdout:1/605: dwrite d6/d7/d1d/d2c/f2f [8388608,4194304] 0 2024-04-26T21:25:59.879 INFO:tasks.workunit.client.1.smithi120.stdout:3/650: truncate dd/de/d18/d24/f3c 3639297 0 2024-04-26T21:25:59.880 INFO:tasks.workunit.client.0.smithi084.stdout:9/391: creat da/de/d16/d25/d41/f91 x:0 0 0 2024-04-26T21:25:59.881 INFO:tasks.workunit.client.0.smithi084.stdout:0/440: mknod de/d20/d4c/c8c 0 2024-04-26T21:25:59.883 INFO:tasks.workunit.client.1.smithi120.stdout:7/644: write d7/d19/d60/f76 [34010,114986] 0 2024-04-26T21:25:59.884 INFO:tasks.workunit.client.1.smithi120.stdout:8/607: dread d5/d6/d34/d42/d9d/f86 [0,4194304] 0 2024-04-26T21:25:59.884 INFO:tasks.workunit.client.1.smithi120.stdout:1/606: dread - d6/d7/d2d/d48/d86/dc1/fbd zero size 2024-04-26T21:25:59.887 INFO:tasks.workunit.client.0.smithi084.stdout:5/458: rename d0/dc/df/d31/f3c to d0/dc/df/d2a/f91 0 2024-04-26T21:25:59.888 INFO:tasks.workunit.client.0.smithi084.stdout:0/441: creat de/d2b/d77/d32/f8d x:0 0 0 2024-04-26T21:25:59.890 INFO:tasks.workunit.client.1.smithi120.stdout:7/645: rmdir d7/d64/da6/d1f/d7d/d8b/d94 39 2024-04-26T21:25:59.893 INFO:tasks.workunit.client.1.smithi120.stdout:0/766: dwrite d0/d3/d13/d81/dba/fbd [0,4194304] 0 2024-04-26T21:25:59.893 INFO:tasks.workunit.client.0.smithi084.stdout:7/446: symlink d6/d68/d7f/l97 0 2024-04-26T21:25:59.893 INFO:tasks.workunit.client.0.smithi084.stdout:9/392: symlink da/de/d16/d25/d7c/l92 0 2024-04-26T21:25:59.895 INFO:tasks.workunit.client.0.smithi084.stdout:7/447: stat d6/d9/d63/f87 0 2024-04-26T21:25:59.895 INFO:tasks.workunit.client.0.smithi084.stdout:0/442: mknod de/d78/c8e 0 2024-04-26T21:25:59.895 INFO:tasks.workunit.client.1.smithi120.stdout:1/607: creat d6/d7/d1d/fc6 x:0 0 0 2024-04-26T21:25:59.895 INFO:tasks.workunit.client.0.smithi084.stdout:8/431: link d4/d6/db/c34 d4/d6/db/d1e/c7b 0 2024-04-26T21:25:59.897 INFO:tasks.workunit.client.1.smithi120.stdout:6/687: write d4/db/d10/dd/f18 [2819145,36294] 0 2024-04-26T21:25:59.902 INFO:tasks.workunit.client.0.smithi084.stdout:9/393: mkdir da/de/d16/d55/d93 0 2024-04-26T21:25:59.902 INFO:tasks.workunit.client.1.smithi120.stdout:0/767: creat d0/d3/d51/d97/f102 x:0 0 0 2024-04-26T21:25:59.902 INFO:tasks.workunit.client.1.smithi120.stdout:3/651: dread dd/d2a/f7f [0,4194304] 0 2024-04-26T21:25:59.904 INFO:tasks.workunit.client.0.smithi084.stdout:0/443: rename de/d2b/l2f to de/d2b/d77/d32/l8f 0 2024-04-26T21:25:59.904 INFO:tasks.workunit.client.1.smithi120.stdout:7/646: creat d7/d64/da6/d1f/fda x:0 0 0 2024-04-26T21:25:59.907 INFO:tasks.workunit.client.0.smithi084.stdout:9/394: rmdir da/de/d16/d25/d4f/d5f 39 2024-04-26T21:25:59.908 INFO:tasks.workunit.client.0.smithi084.stdout:3/423: dread d1/d2c/d2f/d31/d52/f8b [0,4194304] 0 2024-04-26T21:25:59.909 INFO:tasks.workunit.client.0.smithi084.stdout:8/432: stat d4/d6/db/d1e/d22/f5d 0 2024-04-26T21:25:59.910 INFO:tasks.workunit.client.1.smithi120.stdout:7/647: creat d7/d64/fdb x:0 0 0 2024-04-26T21:25:59.912 INFO:tasks.workunit.client.0.smithi084.stdout:9/395: chown da/de/d16/d25/d4f 1093 1 2024-04-26T21:25:59.914 INFO:tasks.workunit.client.1.smithi120.stdout:0/768: creat d0/d3/dc/dd/d1b/d24/d73/db7/f103 x:0 0 0 2024-04-26T21:25:59.915 INFO:tasks.workunit.client.0.smithi084.stdout:3/424: chown d1/d2c/d2f/d31/d55/f7b 27846 1 2024-04-26T21:25:59.915 INFO:tasks.workunit.client.0.smithi084.stdout:5/459: dread d0/d17/f20 [0,4194304] 0 2024-04-26T21:25:59.917 INFO:tasks.workunit.client.0.smithi084.stdout:3/425: chown d1/f1a 196284 1 2024-04-26T21:25:59.917 INFO:tasks.workunit.client.1.smithi120.stdout:3/652: rename dd/de/df/db6/dc5/fce to dd/de/df/db6/fd1 0 2024-04-26T21:25:59.918 INFO:tasks.workunit.client.0.smithi084.stdout:8/433: rename d4/d6/db/d77 to d4/d6/db/d1e/d7c 0 2024-04-26T21:25:59.922 INFO:tasks.workunit.client.1.smithi120.stdout:3/653: write dd/d40/f92 [3607030,55170] 0 2024-04-26T21:25:59.923 INFO:tasks.workunit.client.1.smithi120.stdout:7/648: creat d7/d64/da6/d1a/d33/d34/d37/fdc x:0 0 0 2024-04-26T21:25:59.923 INFO:tasks.workunit.client.0.smithi084.stdout:9/396: unlink da/de/d16/d25/d41/d43/d4a/c8e 0 2024-04-26T21:25:59.923 INFO:tasks.workunit.client.0.smithi084.stdout:5/460: chown d0/dc/df/d51/l7c 1450 1 2024-04-26T21:25:59.925 INFO:tasks.workunit.client.1.smithi120.stdout:2/670: dwrite d4/d1b/d2e/d5f/f9e [0,4194304] 0 2024-04-26T21:25:59.927 INFO:tasks.workunit.client.0.smithi084.stdout:7/448: dwrite d6/d9/d12/d19/d20/d38/f82 [0,4194304] 0 2024-04-26T21:25:59.932 INFO:tasks.workunit.client.1.smithi120.stdout:0/769: mknod d0/d3/d13/d81/dba/c104 0 2024-04-26T21:25:59.932 INFO:tasks.workunit.client.0.smithi084.stdout:8/434: chown d4/d6/db/d1e/d22/f5d 11970 1 2024-04-26T21:25:59.932 INFO:tasks.workunit.client.1.smithi120.stdout:7/649: mkdir d7/ddd 0 2024-04-26T21:25:59.933 INFO:tasks.workunit.client.1.smithi120.stdout:8/608: dread d5/d6/d11/f6b [4194304,4194304] 0 2024-04-26T21:25:59.934 INFO:tasks.workunit.client.1.smithi120.stdout:2/671: stat d4/d1b/d56/cd6 0 2024-04-26T21:25:59.939 INFO:tasks.workunit.client.0.smithi084.stdout:7/449: dread - d6/d9/d12/d8b/f8d zero size 2024-04-26T21:25:59.939 INFO:tasks.workunit.client.1.smithi120.stdout:0/770: creat d0/d3/dc/dd/d1b/d24/d73/f105 x:0 0 0 2024-04-26T21:25:59.940 INFO:tasks.workunit.client.1.smithi120.stdout:7/650: fsync d7/d64/da6/d1f/d28/d4c/d6c/f71 0 2024-04-26T21:25:59.944 INFO:tasks.workunit.client.0.smithi084.stdout:0/444: readlink de/d2b/d77/d32/l8f 0 2024-04-26T21:25:59.945 INFO:tasks.workunit.client.0.smithi084.stdout:3/426: dwrite d1/d2c/d2f/d31/d3b/f70 [0,4194304] 0 2024-04-26T21:25:59.947 INFO:tasks.workunit.client.1.smithi120.stdout:0/771: truncate d0/d3/f9 2093507 0 2024-04-26T21:25:59.948 INFO:tasks.workunit.client.0.smithi084.stdout:8/435: creat d4/d7/d15/d3c/f7d x:0 0 0 2024-04-26T21:25:59.949 INFO:tasks.workunit.client.1.smithi120.stdout:8/609: dread d5/d6/d34/d37/f69 [0,4194304] 0 2024-04-26T21:25:59.949 INFO:tasks.workunit.client.0.smithi084.stdout:8/436: fdatasync d4/d7/d15/f6f 0 2024-04-26T21:25:59.950 INFO:tasks.workunit.client.0.smithi084.stdout:9/397: dwrite da/de/d1e/f29 [0,4194304] 0 2024-04-26T21:25:59.950 INFO:tasks.workunit.client.1.smithi120.stdout:0/772: stat d0/d3/dc/dd/d9b/ff7 0 2024-04-26T21:25:59.952 INFO:tasks.workunit.client.0.smithi084.stdout:8/437: chown d4/d6/db/l11 1 1 2024-04-26T21:25:59.954 INFO:tasks.workunit.client.1.smithi120.stdout:8/610: chown d5/d6/d11/d32/f45 7815 1 2024-04-26T21:25:59.956 INFO:tasks.workunit.client.1.smithi120.stdout:7/651: dread d7/d64/da6/d1f/d28/f3e [0,4194304] 0 2024-04-26T21:25:59.958 INFO:tasks.workunit.client.1.smithi120.stdout:0/773: truncate d0/d3/d51/d97/f102 443151 0 2024-04-26T21:25:59.959 INFO:tasks.workunit.client.1.smithi120.stdout:6/688: dread d4/db/d10/d1a/d2b/d57/d67/fc2 [0,4194304] 0 2024-04-26T21:25:59.959 INFO:tasks.workunit.client.1.smithi120.stdout:8/611: mkdir d5/d6/d34/da7/dca 0 2024-04-26T21:25:59.959 INFO:tasks.workunit.client.1.smithi120.stdout:2/672: dread d4/d1b/d2e/d50/f2a [0,4194304] 0 2024-04-26T21:25:59.960 INFO:tasks.workunit.client.0.smithi084.stdout:5/461: rename d0/dc/df/d51/c8b to d0/d49/d56/c92 0 2024-04-26T21:25:59.961 INFO:tasks.workunit.client.0.smithi084.stdout:5/462: dread - d0/dc/df/d6d/f70 zero size 2024-04-26T21:25:59.962 INFO:tasks.workunit.client.1.smithi120.stdout:7/652: creat d7/d64/da6/d1a/d33/d34/dab/dbf/fde x:0 0 0 2024-04-26T21:25:59.965 INFO:tasks.workunit.client.1.smithi120.stdout:6/689: chown d4/db/d25/d6d/dbd/lb7 1 1 2024-04-26T21:25:59.966 INFO:tasks.workunit.client.1.smithi120.stdout:2/673: creat d4/fdf x:0 0 0 2024-04-26T21:25:59.969 INFO:tasks.workunit.client.1.smithi120.stdout:8/612: read d5/d6/d11/d52/d70/f4b [737149,77450] 0 2024-04-26T21:25:59.972 INFO:tasks.workunit.client.1.smithi120.stdout:3/654: dread dd/de/df/db6/f6b [0,4194304] 0 2024-04-26T21:25:59.973 INFO:tasks.workunit.client.1.smithi120.stdout:8/613: dread - d5/d6/d11/d52/d27/d4f/d67/fad zero size 2024-04-26T21:25:59.977 INFO:tasks.workunit.client.0.smithi084.stdout:7/450: symlink d6/d26/l98 0 2024-04-26T21:25:59.977 INFO:tasks.workunit.client.1.smithi120.stdout:8/614: write d5/d6/d11/d52/d70/f40 [2475150,82163] 0 2024-04-26T21:25:59.979 INFO:tasks.workunit.client.1.smithi120.stdout:3/655: symlink dd/de/df/db6/dc5/ld2 0 2024-04-26T21:25:59.980 INFO:tasks.workunit.client.1.smithi120.stdout:2/674: getdents d4/d1b/d5c/d99 0 2024-04-26T21:25:59.984 INFO:tasks.workunit.client.1.smithi120.stdout:3/656: read dd/de/d18/d24/db1/fb7 [2369886,111656] 0 2024-04-26T21:25:59.984 INFO:tasks.workunit.client.0.smithi084.stdout:3/427: dread - d1/d2c/d2f/d31/f61 zero size 2024-04-26T21:25:59.992 INFO:tasks.workunit.client.1.smithi120.stdout:2/675: mkdir d4/d1b/d25/d2c/d3e/d5e/de0 0 2024-04-26T21:25:59.992 INFO:tasks.workunit.client.1.smithi120.stdout:3/657: mkdir dd/de/d18/d24/d9d/d86/dd3 0 2024-04-26T21:25:59.995 INFO:tasks.workunit.client.0.smithi084.stdout:8/438: readlink d4/d6/db/d1e/d22/l55 0 2024-04-26T21:25:59.995 INFO:tasks.workunit.client.1.smithi120.stdout:2/676: chown d4/d1b/d56/d65 55 1 2024-04-26T21:25:59.997 INFO:tasks.workunit.client.1.smithi120.stdout:6/690: dwrite d4/db/d10/dd/d28/d9e/fc6 [0,4194304] 0 2024-04-26T21:26:00.000 INFO:tasks.workunit.client.1.smithi120.stdout:3/658: mknod dd/de/d83/d64/db0/d46/cd4 0 2024-04-26T21:26:00.001 INFO:tasks.workunit.client.1.smithi120.stdout:6/691: mknod d4/db/d25/d6d/d97/cec 0 2024-04-26T21:26:00.002 INFO:tasks.workunit.client.1.smithi120.stdout:2/677: truncate d4/d1b/d2e/d50/fbd 22316 0 2024-04-26T21:26:00.005 INFO:tasks.workunit.client.1.smithi120.stdout:7/653: dread d7/d64/da6/d1a/d33/d34/d37/f3b [0,4194304] 0 2024-04-26T21:26:00.005 INFO:tasks.workunit.client.1.smithi120.stdout:3/659: rmdir dd/de/df 39 2024-04-26T21:26:00.005 INFO:tasks.workunit.client.0.smithi084.stdout:9/398: symlink da/de/d16/d55/d93/l94 0 2024-04-26T21:26:00.006 INFO:tasks.workunit.client.1.smithi120.stdout:2/678: truncate d4/f64 4987336 0 2024-04-26T21:26:00.007 INFO:tasks.workunit.client.1.smithi120.stdout:6/692: mknod d4/db/ced 0 2024-04-26T21:26:00.010 INFO:tasks.workunit.client.0.smithi084.stdout:5/463: symlink d0/dc/l93 0 2024-04-26T21:26:00.015 INFO:tasks.workunit.client.1.smithi120.stdout:6/693: rename d4/c69 to d4/db/d25/d6d/deb/cee 0 2024-04-26T21:26:00.016 INFO:tasks.workunit.client.1.smithi120.stdout:3/660: symlink dd/de/d83/db2/ld5 0 2024-04-26T21:26:00.017 INFO:tasks.workunit.client.1.smithi120.stdout:7/654: rmdir d7/d64/da6/d1a/d50 39 2024-04-26T21:26:00.018 INFO:tasks.workunit.client.0.smithi084.stdout:6/450: sync 2024-04-26T21:26:00.018 INFO:tasks.workunit.client.0.smithi084.stdout:1/453: sync 2024-04-26T21:26:00.019 INFO:tasks.workunit.client.0.smithi084.stdout:2/562: sync 2024-04-26T21:26:00.020 INFO:tasks.workunit.client.0.smithi084.stdout:9/399: dread da/de/d16/d25/d4f/f59 [0,4194304] 0 2024-04-26T21:26:00.020 INFO:tasks.workunit.client.1.smithi120.stdout:6/694: chown d4/db/d10/d1a/d2b/d57/d67/fc2 309 1 2024-04-26T21:26:00.022 INFO:tasks.workunit.client.0.smithi084.stdout:2/563: read d6/d7/d3d/d15/f55 [254074,122705] 0 2024-04-26T21:26:00.022 INFO:tasks.workunit.client.1.smithi120.stdout:3/661: creat dd/de/d18/d37/d80/fd6 x:0 0 0 2024-04-26T21:26:00.024 INFO:tasks.workunit.client.0.smithi084.stdout:0/445: getdents de/d20/d4e 0 2024-04-26T21:26:00.025 INFO:tasks.workunit.client.0.smithi084.stdout:0/446: chown de/d71/f88 17508747 1 2024-04-26T21:26:00.026 INFO:tasks.workunit.client.0.smithi084.stdout:0/447: stat de/d2b/d77/d32/f4f 0 2024-04-26T21:26:00.026 INFO:tasks.workunit.client.1.smithi120.stdout:7/655: creat d7/d64/da6/d1a/fdf x:0 0 0 2024-04-26T21:26:00.027 INFO:tasks.workunit.client.0.smithi084.stdout:7/451: dread d6/d9/ff [0,4194304] 0 2024-04-26T21:26:00.028 INFO:tasks.workunit.client.0.smithi084.stdout:5/464: rename d0/d49/l4e to d0/dc/df/d2a/l94 0 2024-04-26T21:26:00.029 INFO:tasks.workunit.client.0.smithi084.stdout:7/452: chown d6/d9/d89/d90 87222 1 2024-04-26T21:26:00.030 INFO:tasks.workunit.client.0.smithi084.stdout:3/428: creat d1/d24/f8d x:0 0 0 2024-04-26T21:26:00.032 INFO:tasks.workunit.client.0.smithi084.stdout:3/429: truncate d1/d24/f25 4963366 0 2024-04-26T21:26:00.041 INFO:tasks.workunit.client.0.smithi084.stdout:9/400: mkdir da/de/d16/d55/d93/d95 0 2024-04-26T21:26:00.041 INFO:tasks.workunit.client.0.smithi084.stdout:8/439: read d4/d6/db/d1e/d22/d2f/f41 [1143378,105216] 0 2024-04-26T21:26:00.043 INFO:tasks.workunit.client.0.smithi084.stdout:2/564: fdatasync d6/d7/d3d/d15/d1f/d39/fa6 0 2024-04-26T21:26:00.043 INFO:tasks.workunit.client.0.smithi084.stdout:8/440: write d4/d7/d15/f6f [861751,114718] 0 2024-04-26T21:26:00.044 INFO:tasks.workunit.client.0.smithi084.stdout:0/448: mknod de/d2b/d45/c90 0 2024-04-26T21:26:00.046 INFO:tasks.workunit.client.1.smithi120.stdout:3/662: truncate dd/d40/f92 155938 0 2024-04-26T21:26:00.047 INFO:tasks.workunit.client.0.smithi084.stdout:7/453: creat d6/d9/d89/f99 x:0 0 0 2024-04-26T21:26:00.049 INFO:tasks.workunit.client.0.smithi084.stdout:2/565: readlink d6/d7/d3d/d15/d1f/d39/d20/d45/d6d/l9e 0 2024-04-26T21:26:00.050 INFO:tasks.workunit.client.0.smithi084.stdout:1/454: symlink d2/d9/d15/d28/d69/l8a 0 2024-04-26T21:26:00.051 INFO:tasks.workunit.client.1.smithi120.stdout:2/679: dwrite d4/d1b/d25/d2c/d3e/ddb/fc1 [0,4194304] 0 2024-04-26T21:26:00.051 INFO:tasks.workunit.client.0.smithi084.stdout:9/401: mknod da/de/d1e/d56/c96 0 2024-04-26T21:26:00.053 INFO:tasks.workunit.client.1.smithi120.stdout:3/663: rmdir dd/de/d18/d24/d9d/d86 39 2024-04-26T21:26:00.053 INFO:tasks.workunit.client.1.smithi120.stdout:0/774: dwrite d0/df4/f4d [0,4194304] 0 2024-04-26T21:26:00.053 INFO:tasks.workunit.client.0.smithi084.stdout:6/451: dwrite d3/de/d1a/d2f/f3c [0,4194304] 0 2024-04-26T21:26:00.055 INFO:tasks.workunit.client.1.smithi120.stdout:8/615: dwrite d5/d6/d34/d37/f69 [0,4194304] 0 2024-04-26T21:26:00.062 INFO:tasks.workunit.client.0.smithi084.stdout:1/455: dread d2/d54/d5e/d66/d2a/d2c/d45/f4a [0,4194304] 0 2024-04-26T21:26:00.064 INFO:tasks.workunit.client.0.smithi084.stdout:5/465: creat d0/d49/f95 x:0 0 0 2024-04-26T21:26:00.066 INFO:tasks.workunit.client.1.smithi120.stdout:3/664: write dd/de/d18/d24/db1/d76/d3b/d56/d75/fbb [60485,93946] 0 2024-04-26T21:26:00.067 INFO:tasks.workunit.client.0.smithi084.stdout:5/466: stat d0/d49 0 2024-04-26T21:26:00.067 INFO:tasks.workunit.client.1.smithi120.stdout:2/680: unlink d4/d1b/d25/ccd 0 2024-04-26T21:26:00.068 INFO:tasks.workunit.client.0.smithi084.stdout:9/402: creat da/de/d16/d25/d41/d67/f97 x:0 0 0 2024-04-26T21:26:00.068 INFO:tasks.workunit.client.1.smithi120.stdout:0/775: rmdir d0/d3/d13/d81/dba 39 2024-04-26T21:26:00.072 INFO:tasks.workunit.client.1.smithi120.stdout:8/616: getdents d5/d6/d34/d37/db8 0 2024-04-26T21:26:00.075 INFO:tasks.workunit.client.1.smithi120.stdout:0/776: chown d0/d3/dc/dd/d1b/f91 17 1 2024-04-26T21:26:00.075 INFO:tasks.workunit.client.0.smithi084.stdout:0/449: dwrite de/f14 [0,4194304] 0 2024-04-26T21:26:00.076 INFO:tasks.workunit.client.1.smithi120.stdout:2/681: write d4/d1b/d2e/d5f/f9e [2287165,127134] 0 2024-04-26T21:26:00.080 INFO:tasks.workunit.client.1.smithi120.stdout:3/665: fsync dd/de/df/db6/f6b 0 2024-04-26T21:26:00.082 INFO:tasks.workunit.client.0.smithi084.stdout:4/399: sync 2024-04-26T21:26:00.084 INFO:tasks.workunit.client.0.smithi084.stdout:5/467: readlink d0/dc/l5a 0 2024-04-26T21:26:00.088 INFO:tasks.workunit.client.0.smithi084.stdout:5/468: stat d0/d49/d4d/f74 0 2024-04-26T21:26:00.088 INFO:tasks.workunit.client.0.smithi084.stdout:9/403: truncate da/de/d1e/f49 1257200 0 2024-04-26T21:26:00.089 INFO:tasks.workunit.client.0.smithi084.stdout:3/430: write d1/d2c/d2f/d31/d52/f8b [3575943,23385] 0 2024-04-26T21:26:00.089 INFO:tasks.workunit.client.0.smithi084.stdout:4/400: stat d5/d10/d15/d21/d29 0 2024-04-26T21:26:00.092 INFO:tasks.workunit.client.0.smithi084.stdout:1/456: creat d2/d1b/f8b x:0 0 0 2024-04-26T21:26:00.096 INFO:tasks.workunit.client.0.smithi084.stdout:6/452: getdents d3 0 2024-04-26T21:26:00.096 INFO:tasks.workunit.client.0.smithi084.stdout:0/450: rmdir de/d20/d4e 39 2024-04-26T21:26:00.096 INFO:tasks.workunit.client.0.smithi084.stdout:2/566: dwrite d6/d7/d3d/d15/d1f/d39/d20/f35 [4194304,4194304] 0 2024-04-26T21:26:00.097 INFO:tasks.workunit.client.0.smithi084.stdout:5/469: fsync d0/fe 0 2024-04-26T21:26:00.098 INFO:tasks.workunit.client.0.smithi084.stdout:9/404: truncate da/f3a 899766 0 2024-04-26T21:26:00.098 INFO:tasks.workunit.client.0.smithi084.stdout:6/453: stat d3/f10 0 2024-04-26T21:26:00.101 INFO:tasks.workunit.client.0.smithi084.stdout:8/441: dwrite d4/d6/f40 [0,4194304] 0 2024-04-26T21:26:00.101 INFO:tasks.workunit.client.0.smithi084.stdout:7/454: dread d6/d9/d12/d19/f49 [0,4194304] 0 2024-04-26T21:26:00.101 INFO:tasks.workunit.client.1.smithi120.stdout:8/617: dwrite d5/d6/d75/fb3 [0,4194304] 0 2024-04-26T21:26:00.102 INFO:tasks.workunit.client.0.smithi084.stdout:3/431: truncate d1/d24/f8d 1043087 0 2024-04-26T21:26:00.103 INFO:tasks.workunit.client.1.smithi120.stdout:7/656: dread d7/d64/da6/d1f/d7d/d8b/fc4 [0,4194304] 0 2024-04-26T21:26:00.105 INFO:tasks.workunit.client.0.smithi084.stdout:2/567: chown d6/d7/d3d/d15/d1f/d39/d20/d45/d6d 36948 1 2024-04-26T21:26:00.109 INFO:tasks.workunit.client.0.smithi084.stdout:8/442: chown d4/d7/d15/d37/c62 0 1 2024-04-26T21:26:00.110 INFO:tasks.workunit.client.1.smithi120.stdout:8/618: symlink d5/d6/d75/d95/lcb 0 2024-04-26T21:26:00.112 INFO:tasks.workunit.client.1.smithi120.stdout:7/657: symlink d7/d64/da6/d1f/d7d/d8b/le0 0 2024-04-26T21:26:00.112 INFO:tasks.workunit.client.0.smithi084.stdout:8/443: readlink d4/d6/db/d1e/l1f 0 2024-04-26T21:26:00.114 INFO:tasks.workunit.client.0.smithi084.stdout:0/451: mknod de/d2b/d64/c91 0 2024-04-26T21:26:00.114 INFO:tasks.workunit.client.1.smithi120.stdout:0/777: write d0/d3/dc/dd/d1b/f91 [127536,48651] 0 2024-04-26T21:26:00.115 INFO:tasks.workunit.client.1.smithi120.stdout:2/682: write d4/d1b/d2e/d50/f27 [928335,59408] 0 2024-04-26T21:26:00.117 INFO:tasks.workunit.client.0.smithi084.stdout:1/457: creat d2/d54/d5e/d66/d3a/d77/f8c x:0 0 0 2024-04-26T21:26:00.120 INFO:tasks.workunit.client.0.smithi084.stdout:9/405: write da/de/d1e/f47 [4164862,64457] 0 2024-04-26T21:26:00.121 INFO:tasks.workunit.client.1.smithi120.stdout:8/619: creat d5/d6/fcc x:0 0 0 2024-04-26T21:26:00.125 INFO:tasks.workunit.client.1.smithi120.stdout:0/778: unlink d0/c11 0 2024-04-26T21:26:00.131 INFO:tasks.workunit.client.1.smithi120.stdout:7/658: link d7/d10/c46 d7/d19/ce1 0 2024-04-26T21:26:00.132 INFO:tasks.workunit.client.1.smithi120.stdout:8/620: read d5/d6/d11/d32/d3b/f6f [40647,14601] 0 2024-04-26T21:26:00.132 INFO:tasks.workunit.client.0.smithi084.stdout:1/458: mkdir d2/d54/d5e/d8d 0 2024-04-26T21:26:00.134 INFO:tasks.workunit.client.1.smithi120.stdout:2/683: rename d4/d1b/d25/l4c to d4/d1b/d2e/d50/d14/d15/le1 0 2024-04-26T21:26:00.135 INFO:tasks.workunit.client.1.smithi120.stdout:0/779: dread d0/d3/dc/d12/f6a [0,4194304] 0 2024-04-26T21:26:00.138 INFO:tasks.workunit.client.1.smithi120.stdout:8/621: truncate d5/d6/d11/d32/d3b/f6f 884724 0 2024-04-26T21:26:00.140 INFO:tasks.workunit.client.1.smithi120.stdout:0/780: mkdir d0/d3/dc/dd/d4b/dea/d106 0 2024-04-26T21:26:00.141 INFO:tasks.workunit.client.0.smithi084.stdout:8/444: mknod d4/c7e 0 2024-04-26T21:26:00.143 INFO:tasks.workunit.client.0.smithi084.stdout:9/406: dwrite da/f3a [0,4194304] 0 2024-04-26T21:26:00.147 INFO:tasks.workunit.client.1.smithi120.stdout:0/781: unlink d0/d3/dc/d12/ffa 0 2024-04-26T21:26:00.148 INFO:tasks.workunit.client.0.smithi084.stdout:1/459: mknod d2/d54/d5e/d66/d2a/d2c/c8e 0 2024-04-26T21:26:00.148 INFO:tasks.workunit.client.1.smithi120.stdout:2/684: link d4/d1b/f38 d4/d1b/d25/d2c/d3e/d5e/fe2 0 2024-04-26T21:26:00.149 INFO:tasks.workunit.client.0.smithi084.stdout:1/460: chown d2/d9/d15/d28 184958049 1 2024-04-26T21:26:00.151 INFO:tasks.workunit.client.0.smithi084.stdout:4/401: getdents d5/d25/d35/d60 0 2024-04-26T21:26:00.151 INFO:tasks.workunit.client.0.smithi084.stdout:1/461: chown d2/d1b/f65 3333404 1 2024-04-26T21:26:00.151 INFO:tasks.workunit.client.1.smithi120.stdout:2/685: chown d4/d1b/d56/d65/d8d/fba 513627 1 2024-04-26T21:26:00.152 INFO:tasks.workunit.client.0.smithi084.stdout:7/455: dread d6/f4b [0,4194304] 0 2024-04-26T21:26:00.152 INFO:tasks.workunit.client.1.smithi120.stdout:0/782: unlink d0/d3/d13/d5a/f7a 0 2024-04-26T21:26:00.153 INFO:tasks.workunit.client.0.smithi084.stdout:4/402: fdatasync d5/fe 0 2024-04-26T21:26:00.155 INFO:tasks.workunit.client.1.smithi120.stdout:2/686: write d4/d1b/d2e/fa7 [5033729,63948] 0 2024-04-26T21:26:00.155 INFO:tasks.workunit.client.0.smithi084.stdout:3/432: write d1/d2c/d2f/d31/f61 [306145,90322] 0 2024-04-26T21:26:00.158 INFO:tasks.workunit.client.0.smithi084.stdout:2/568: truncate d6/d7/d3d/d15/d1f/d39/d20/d45/f87 422591 0 2024-04-26T21:26:00.159 INFO:tasks.workunit.client.0.smithi084.stdout:0/452: truncate de/f14 3706133 0 2024-04-26T21:26:00.159 INFO:tasks.workunit.client.0.smithi084.stdout:3/433: fsync d1/d24/d27/d3a/f62 0 2024-04-26T21:26:00.159 INFO:tasks.workunit.client.1.smithi120.stdout:2/687: truncate d4/d1b/d2e/d50/f5b 4715290 0 2024-04-26T21:26:00.161 INFO:tasks.workunit.client.0.smithi084.stdout:4/403: truncate d5/d25/f2f 2529309 0 2024-04-26T21:26:00.162 INFO:tasks.workunit.client.0.smithi084.stdout:3/434: chown d1/d2c/d2f/l19 0 1 2024-04-26T21:26:00.165 INFO:tasks.workunit.client.1.smithi120.stdout:7/659: rmdir d7/d64/da6/d1f 39 2024-04-26T21:26:00.167 INFO:tasks.workunit.client.0.smithi084.stdout:6/454: dread d3/de/d15/d23/f4d [0,4194304] 0 2024-04-26T21:26:00.167 INFO:tasks.workunit.client.0.smithi084.stdout:1/462: mknod d2/d19/c8f 0 2024-04-26T21:26:00.167 INFO:tasks.workunit.client.0.smithi084.stdout:7/456: creat d6/d9/d12/d19/d20/d32/f9a x:0 0 0 2024-04-26T21:26:00.170 INFO:tasks.workunit.client.0.smithi084.stdout:7/457: write d6/f65 [405670,6877] 0 2024-04-26T21:26:00.171 INFO:tasks.workunit.client.0.smithi084.stdout:7/458: fsync d6/d68/f75 0 2024-04-26T21:26:00.173 INFO:tasks.workunit.client.1.smithi120.stdout:2/688: rename d4/d1b/l26 to d4/d1b/d25/d2c/d3e/d5e/d63/dcb/dca/le3 0 2024-04-26T21:26:00.179 INFO:tasks.workunit.client.1.smithi120.stdout:8/622: truncate d5/d6/d11/f31 554035 0 2024-04-26T21:26:00.179 INFO:tasks.workunit.client.0.smithi084.stdout:9/407: mknod da/de/d16/d55/d93/d95/c98 0 2024-04-26T21:26:00.179 INFO:tasks.workunit.client.0.smithi084.stdout:0/453: rmdir de/d2b/d77/d32 39 2024-04-26T21:26:00.181 INFO:tasks.workunit.client.0.smithi084.stdout:4/404: rename d5/d10/l7c to d5/d7/d65/d7f/l85 0 2024-04-26T21:26:00.182 INFO:tasks.workunit.client.1.smithi120.stdout:0/783: write d0/d3/dc/dd/d80/f8c [948020,60867] 0 2024-04-26T21:26:00.182 INFO:tasks.workunit.client.1.smithi120.stdout:2/689: symlink d4/d1b/d2e/d50/d14/d15/d6c/le4 0 2024-04-26T21:26:00.183 INFO:tasks.workunit.client.0.smithi084.stdout:1/463: symlink d2/d54/d5e/d66/d2a/l90 0 2024-04-26T21:26:00.183 INFO:tasks.workunit.client.0.smithi084.stdout:8/445: write d4/d7/d15/d37/d3b/f3e [2334123,117971] 0 2024-04-26T21:26:00.185 INFO:tasks.workunit.client.0.smithi084.stdout:8/446: dread - d4/d6/f6e zero size 2024-04-26T21:26:00.186 INFO:tasks.workunit.client.0.smithi084.stdout:3/435: mkdir d1/d2c/d2f/d31/d8e 0 2024-04-26T21:26:00.189 INFO:tasks.workunit.client.0.smithi084.stdout:0/454: stat de/d20/d4e/f60 0 2024-04-26T21:26:00.189 INFO:tasks.workunit.client.0.smithi084.stdout:4/405: creat d5/d25/d35/f86 x:0 0 0 2024-04-26T21:26:00.192 INFO:tasks.workunit.client.1.smithi120.stdout:2/690: truncate d4/d1b/d4f/f9c 698746 0 2024-04-26T21:26:00.194 INFO:tasks.workunit.client.1.smithi120.stdout:7/660: dwrite d7/d64/da6/d1a/d33/d34/dab/dbf/fde [0,4194304] 0 2024-04-26T21:26:00.194 INFO:tasks.workunit.client.1.smithi120.stdout:0/784: mkdir d0/d3/d13/d64/d107 0 2024-04-26T21:26:00.195 INFO:tasks.workunit.client.0.smithi084.stdout:9/408: creat da/de/d16/d25/d41/d8d/f99 x:0 0 0 2024-04-26T21:26:00.197 INFO:tasks.workunit.client.0.smithi084.stdout:0/455: rmdir de/d2b/d64/d81 39 2024-04-26T21:26:00.198 INFO:tasks.workunit.client.1.smithi120.stdout:2/691: write d4/d1b/d2e/d50/d14/d15/f9b [598488,15338] 0 2024-04-26T21:26:00.198 INFO:tasks.workunit.client.0.smithi084.stdout:3/436: unlink d1/d2c/d2f/d31/f63 0 2024-04-26T21:26:00.202 INFO:tasks.workunit.client.1.smithi120.stdout:7/661: dread - d7/d64/da6/d1f/d28/d4c/fc7 zero size 2024-04-26T21:26:00.202 INFO:tasks.workunit.client.0.smithi084.stdout:2/569: dwrite d6/d7/d3d/d15/f1a [0,4194304] 0 2024-04-26T21:26:00.202 INFO:tasks.workunit.client.0.smithi084.stdout:7/459: getdents d6/d9/d12/d19/d7a/d84 0 2024-04-26T21:26:00.203 INFO:tasks.workunit.client.0.smithi084.stdout:9/409: chown da/de/d16/d25/d41/d8d/f99 76134881 1 2024-04-26T21:26:00.203 INFO:tasks.workunit.client.1.smithi120.stdout:8/623: write d5/d6/d11/d52/d27/f51 [1114747,80256] 0 2024-04-26T21:26:00.206 INFO:tasks.workunit.client.0.smithi084.stdout:3/437: write d1/d2c/d2f/f28 [1009113,20930] 0 2024-04-26T21:26:00.206 INFO:tasks.workunit.client.1.smithi120.stdout:8/624: stat d5/d6/d11/d52/d27/d4f/l8c 0 2024-04-26T21:26:00.208 INFO:tasks.workunit.client.0.smithi084.stdout:0/456: stat ca 0 2024-04-26T21:26:00.210 INFO:tasks.workunit.client.1.smithi120.stdout:7/662: rmdir d7/d64/da6/d1f/d28/d4c/d6c 39 2024-04-26T21:26:00.211 INFO:tasks.workunit.client.1.smithi120.stdout:8/625: stat d5/d6/c8b 0 2024-04-26T21:26:00.213 INFO:tasks.workunit.client.1.smithi120.stdout:2/692: mknod d4/d1b/d2e/d50/d14/ce5 0 2024-04-26T21:26:00.213 INFO:tasks.workunit.client.0.smithi084.stdout:1/464: dwrite d2/d1b/f8b [0,4194304] 0 2024-04-26T21:26:00.218 INFO:tasks.workunit.client.1.smithi120.stdout:0/785: rename d0/d3/d13 to d0/d3/d51/d97/d108 0 2024-04-26T21:26:00.221 INFO:tasks.workunit.client.1.smithi120.stdout:8/626: dread - d5/d6/d11/d52/d27/d4f/f7d zero size 2024-04-26T21:26:00.225 INFO:tasks.workunit.client.0.smithi084.stdout:2/570: fsync d6/d7/d3d/d15/d1f/d41/f4b 0 2024-04-26T21:26:00.225 INFO:tasks.workunit.client.0.smithi084.stdout:1/465: write d2/d54/d5e/d66/d3a/d77/f8c [853998,100767] 0 2024-04-26T21:26:00.225 INFO:tasks.workunit.client.1.smithi120.stdout:8/627: chown d5/d6/d34/d42/fba 2347 1 2024-04-26T21:26:00.228 INFO:tasks.workunit.client.0.smithi084.stdout:4/406: getdents d5 0 2024-04-26T21:26:00.229 INFO:tasks.workunit.client.1.smithi120.stdout:0/786: fsync d0/d3/dc/dd/d1b/d39/f53 0 2024-04-26T21:26:00.229 INFO:tasks.workunit.client.0.smithi084.stdout:0/457: symlink de/d2b/d77/d68/l92 0 2024-04-26T21:26:00.231 INFO:tasks.workunit.client.1.smithi120.stdout:8/628: symlink d5/d6/d75/lcd 0 2024-04-26T21:26:00.232 INFO:tasks.workunit.client.1.smithi120.stdout:2/693: dread d4/d1b/d2e/d50/d14/d15/f2b [0,4194304] 0 2024-04-26T21:26:00.233 INFO:tasks.workunit.client.1.smithi120.stdout:8/629: chown d5/d6/d11/d52 14451 1 2024-04-26T21:26:00.235 INFO:tasks.workunit.client.0.smithi084.stdout:4/407: write d5/d2e/d5f/d32/d46/f5c [1523856,16123] 0 2024-04-26T21:26:00.237 INFO:tasks.workunit.client.0.smithi084.stdout:6/455: dread d3/d18/f38 [0,4194304] 0 2024-04-26T21:26:00.237 INFO:tasks.workunit.client.1.smithi120.stdout:9/609: sync 2024-04-26T21:26:00.237 INFO:tasks.workunit.client.1.smithi120.stdout:5/732: sync 2024-04-26T21:26:00.237 INFO:tasks.workunit.client.1.smithi120.stdout:0/787: symlink d0/d3/d51/d97/d108/d64/l109 0 2024-04-26T21:26:00.237 INFO:tasks.workunit.client.1.smithi120.stdout:4/631: sync 2024-04-26T21:26:00.238 INFO:tasks.workunit.client.1.smithi120.stdout:7/663: dwrite d7/d64/da6/d1a/d33/d34/d37/fdc [0,4194304] 0 2024-04-26T21:26:00.239 INFO:tasks.workunit.client.1.smithi120.stdout:8/630: rmdir d5/d6/d34/d37/d94 39 2024-04-26T21:26:00.240 INFO:tasks.workunit.client.1.smithi120.stdout:4/632: fdatasync d10/d12/fa7 0 2024-04-26T21:26:00.241 INFO:tasks.workunit.client.1.smithi120.stdout:5/733: write d2/d1b/fed [2663581,50354] 0 2024-04-26T21:26:00.242 INFO:tasks.workunit.client.1.smithi120.stdout:8/631: chown d5/l9f 1 1 2024-04-26T21:26:00.243 INFO:tasks.workunit.client.0.smithi084.stdout:9/410: dwrite da/de/d1e/f29 [0,4194304] 0 2024-04-26T21:26:00.245 INFO:tasks.workunit.client.1.smithi120.stdout:2/694: symlink d4/d1b/d5c/da6/le6 0 2024-04-26T21:26:00.246 INFO:tasks.workunit.client.0.smithi084.stdout:4/408: dread d5/d7/d65/d7f/f7a [0,4194304] 0 2024-04-26T21:26:00.247 INFO:tasks.workunit.client.0.smithi084.stdout:7/460: dwrite d6/d9/d12/d19/f49 [0,4194304] 0 2024-04-26T21:26:00.248 INFO:tasks.workunit.client.1.smithi120.stdout:9/610: mknod d0/d66/db5/cc4 0 2024-04-26T21:26:00.249 INFO:tasks.workunit.client.0.smithi084.stdout:5/470: sync 2024-04-26T21:26:00.250 INFO:tasks.workunit.client.0.smithi084.stdout:5/471: read - d0/d17/f7e zero size 2024-04-26T21:26:00.252 INFO:tasks.workunit.client.0.smithi084.stdout:8/447: dread d4/d7/d15/f18 [0,4194304] 0 2024-04-26T21:26:00.252 INFO:tasks.workunit.client.1.smithi120.stdout:7/664: truncate d7/d64/da6/d1f/d28/d4c/fc7 956003 0 2024-04-26T21:26:00.253 INFO:tasks.workunit.client.1.smithi120.stdout:9/611: chown d0/dd/l2c 164 1 2024-04-26T21:26:00.255 INFO:tasks.workunit.client.0.smithi084.stdout:6/456: creat d3/de/d41/d5c/f97 x:0 0 0 2024-04-26T21:26:00.255 INFO:tasks.workunit.client.1.smithi120.stdout:4/633: creat d10/d6b/d71/fd8 x:0 0 0 2024-04-26T21:26:00.259 INFO:tasks.workunit.client.0.smithi084.stdout:6/457: write d3/de/d41/d5c/f8f [124362,6974] 0 2024-04-26T21:26:00.259 INFO:tasks.workunit.client.1.smithi120.stdout:8/632: creat d5/d6/d34/da7/fce x:0 0 0 2024-04-26T21:26:00.262 INFO:tasks.workunit.client.0.smithi084.stdout:5/472: creat d0/dc/df/d31/d53/d87/f96 x:0 0 0 2024-04-26T21:26:00.265 INFO:tasks.workunit.client.0.smithi084.stdout:5/473: chown d0/dc/df/d31/d53/d87 7675006 1 2024-04-26T21:26:00.268 INFO:tasks.workunit.client.1.smithi120.stdout:5/734: dwrite d2/d48/d63/dbe/fef [0,4194304] 0 2024-04-26T21:26:00.269 INFO:tasks.workunit.client.1.smithi120.stdout:8/633: fdatasync d5/d6/d34/d42/d9d/d7a/f96 0 2024-04-26T21:26:00.271 INFO:tasks.workunit.client.0.smithi084.stdout:8/448: rename d4/d7/d15/c54 to d4/d7/d15/d37/d52/d69/c7f 0 2024-04-26T21:26:00.272 INFO:tasks.workunit.client.1.smithi120.stdout:8/634: chown d5/d6/d11/d32/d3b/f6f 7323 1 2024-04-26T21:26:00.272 INFO:tasks.workunit.client.0.smithi084.stdout:8/449: write d4/d6/f47 [1728343,61898] 0 2024-04-26T21:26:00.274 INFO:tasks.workunit.client.1.smithi120.stdout:5/735: mknod d2/d30/c108 0 2024-04-26T21:26:00.275 INFO:tasks.workunit.client.1.smithi120.stdout:8/635: write d5/d6/d34/faf [565711,49911] 0 2024-04-26T21:26:00.278 INFO:tasks.workunit.client.1.smithi120.stdout:8/636: chown d5/d6/d34/d42/d9d/d83 28 1 2024-04-26T21:26:00.278 INFO:tasks.workunit.client.0.smithi084.stdout:8/450: mknod d4/d7/d15/c80 0 2024-04-26T21:26:00.279 INFO:tasks.workunit.client.0.smithi084.stdout:8/451: fsync d4/f13 0 2024-04-26T21:26:00.282 INFO:tasks.workunit.client.1.smithi120.stdout:5/736: read d2/dc/f38 [4079130,14219] 0 2024-04-26T21:26:00.284 INFO:tasks.workunit.client.0.smithi084.stdout:5/474: dwrite d0/dc/df/d6d/f70 [0,4194304] 0 2024-04-26T21:26:00.286 INFO:tasks.workunit.client.0.smithi084.stdout:5/475: stat d0/dc/df/d6d 0 2024-04-26T21:26:00.287 INFO:tasks.workunit.client.1.smithi120.stdout:8/637: creat d5/d6/d11/d52/d70/d88/fcf x:0 0 0 2024-04-26T21:26:00.291 INFO:tasks.workunit.client.0.smithi084.stdout:5/476: truncate d0/d49/d4d/f74 1008146 0 2024-04-26T21:26:00.291 INFO:tasks.workunit.client.1.smithi120.stdout:5/737: mkdir d2/dc/d1d/d21/db2/d109 0 2024-04-26T21:26:00.292 INFO:tasks.workunit.client.1.smithi120.stdout:3/666: sync 2024-04-26T21:26:00.292 INFO:tasks.workunit.client.1.smithi120.stdout:1/608: sync 2024-04-26T21:26:00.293 INFO:tasks.workunit.client.1.smithi120.stdout:6/695: sync 2024-04-26T21:26:00.293 INFO:tasks.workunit.client.0.smithi084.stdout:3/438: dread d1/f22 [0,4194304] 0 2024-04-26T21:26:00.294 INFO:tasks.workunit.client.0.smithi084.stdout:8/452: rename d4/d7/d15/d37/d3b/f3e to d4/d6/db/d1e/d22/f81 0 2024-04-26T21:26:00.294 INFO:tasks.workunit.client.1.smithi120.stdout:5/738: read - d2/d82/d96/fe8 zero size 2024-04-26T21:26:00.299 INFO:tasks.workunit.client.0.smithi084.stdout:6/458: dread d3/de/d15/df/f4b [0,4194304] 0 2024-04-26T21:26:00.303 INFO:tasks.workunit.client.1.smithi120.stdout:7/665: dread d7/d64/da6/d2f/f7c [0,4194304] 0 2024-04-26T21:26:00.303 INFO:tasks.workunit.client.1.smithi120.stdout:3/667: unlink dd/de/d83/d64/db0/d46/c97 0 2024-04-26T21:26:00.304 INFO:tasks.workunit.client.1.smithi120.stdout:6/696: rmdir d4/db/d10/dd/db3 39 2024-04-26T21:26:00.307 INFO:tasks.workunit.client.0.smithi084.stdout:5/477: dread d0/dc/df/d31/d53/f83 [4194304,4194304] 0 2024-04-26T21:26:00.312 INFO:tasks.workunit.client.1.smithi120.stdout:0/788: dwrite d0/d3/dc/f2a [0,4194304] 0 2024-04-26T21:26:00.312 INFO:tasks.workunit.client.0.smithi084.stdout:3/439: dwrite d1/d24/d27/f30 [0,4194304] 0 2024-04-26T21:26:00.313 INFO:tasks.workunit.client.1.smithi120.stdout:3/668: truncate dd/d2a/f7f 251217 0 2024-04-26T21:26:00.316 INFO:tasks.workunit.client.1.smithi120.stdout:7/666: creat d7/d64/da6/d1f/d28/dbb/dcf/fe2 x:0 0 0 2024-04-26T21:26:00.317 INFO:tasks.workunit.client.0.smithi084.stdout:8/453: dwrite d4/d7/d15/d37/f68 [0,4194304] 0 2024-04-26T21:26:00.317 INFO:tasks.workunit.client.1.smithi120.stdout:5/739: link d2/dc/d1d/d21/d66/d85/ce0 d2/d30/d93/d107/d36/d44/d6c/df5/c10a 0 2024-04-26T21:26:00.319 INFO:tasks.workunit.client.1.smithi120.stdout:0/789: mkdir d0/d3/d51/d70/d10a 0 2024-04-26T21:26:00.321 INFO:tasks.workunit.client.1.smithi120.stdout:2/695: dread d4/f66 [0,4194304] 0 2024-04-26T21:26:00.326 INFO:tasks.workunit.client.0.smithi084.stdout:7/461: truncate d6/d26/d40/f5b 935641 0 2024-04-26T21:26:00.327 INFO:tasks.workunit.client.1.smithi120.stdout:6/697: getdents d4/db/d10/dd/db3/dc3 0 2024-04-26T21:26:00.329 INFO:tasks.workunit.client.1.smithi120.stdout:2/696: mkdir d4/d1b/d5c/da6/de7 0 2024-04-26T21:26:00.330 INFO:tasks.workunit.client.1.smithi120.stdout:0/790: rmdir d0/d3/d51/d97/d108/d81 39 2024-04-26T21:26:00.330 INFO:tasks.workunit.client.1.smithi120.stdout:9/612: write d0/dd/f83 [1010917,58222] 0 2024-04-26T21:26:00.334 INFO:tasks.workunit.client.1.smithi120.stdout:6/698: chown d4/db/d25/d6d/d97/f7f 41 1 2024-04-26T21:26:00.334 INFO:tasks.workunit.client.1.smithi120.stdout:5/740: rename d2/dc/d1d/d21/d77/d79/db7/cdb to d2/d30/d93/d107/d36/d67/c10b 0 2024-04-26T21:26:00.338 INFO:tasks.workunit.client.1.smithi120.stdout:6/699: readlink d4/db/d10/la6 0 2024-04-26T21:26:00.338 INFO:tasks.workunit.client.1.smithi120.stdout:5/741: readlink d2/dc/d1d/d21/d66/d6a/l9a 0 2024-04-26T21:26:00.338 INFO:tasks.workunit.client.1.smithi120.stdout:7/667: creat d7/d64/da6/d1a/d50/fe3 x:0 0 0 2024-04-26T21:26:00.338 INFO:tasks.workunit.client.1.smithi120.stdout:9/613: truncate d0/dd/d34/fa7 4965007 0 2024-04-26T21:26:00.341 INFO:tasks.workunit.client.1.smithi120.stdout:2/697: symlink d4/d1b/d25/d2c/d3e/ddb/le8 0 2024-04-26T21:26:00.341 INFO:tasks.workunit.client.1.smithi120.stdout:5/742: write d2/d82/d96/fe8 [333718,37127] 0 2024-04-26T21:26:00.345 INFO:tasks.workunit.client.0.smithi084.stdout:0/458: dread de/d2b/d77/d32/f4f [0,4194304] 0 2024-04-26T21:26:00.346 INFO:tasks.workunit.client.1.smithi120.stdout:0/791: symlink d0/d3/dc/dd/d1b/d24/d73/l10b 0 2024-04-26T21:26:00.349 INFO:tasks.workunit.client.0.smithi084.stdout:3/440: dwrite d1/d2c/d2f/d31/d3b/f74 [0,4194304] 0 2024-04-26T21:26:00.349 INFO:tasks.workunit.client.0.smithi084.stdout:8/454: dwrite d4/f5 [0,4194304] 0 2024-04-26T21:26:00.354 INFO:tasks.workunit.client.0.smithi084.stdout:0/459: write de/d2b/d77/f1d [6241940,91899] 0 2024-04-26T21:26:00.359 INFO:tasks.workunit.client.0.smithi084.stdout:7/462: link d6/d9/d12/d19/d7a/d84/c73 d6/d9/d89/d90/d80/c9b 0 2024-04-26T21:26:00.363 INFO:tasks.workunit.client.1.smithi120.stdout:4/634: dread d10/d6b/d71/f82 [0,4194304] 0 2024-04-26T21:26:00.364 INFO:tasks.workunit.client.1.smithi120.stdout:7/668: symlink d7/d19/d60/daa/le4 0 2024-04-26T21:26:00.364 INFO:tasks.workunit.client.0.smithi084.stdout:7/463: write d6/d9/d63/f7b [137199,3232] 0 2024-04-26T21:26:00.364 INFO:tasks.workunit.client.1.smithi120.stdout:5/743: mkdir d2/dc/d1d/d21/db2/dde/d10c 0 2024-04-26T21:26:00.367 INFO:tasks.workunit.client.0.smithi084.stdout:7/464: readlink d6/d26/l98 0 2024-04-26T21:26:00.371 INFO:tasks.workunit.client.1.smithi120.stdout:2/698: rename d4/d1b/d2e/d50/d14/d15/dd1 to d4/d1b/d4f/d95/de9 0 2024-04-26T21:26:00.371 INFO:tasks.workunit.client.1.smithi120.stdout:8/638: dwrite d5/d6/d11/d52/d70/f4b [0,4194304] 0 2024-04-26T21:26:00.372 INFO:tasks.workunit.client.1.smithi120.stdout:2/699: dread - d4/fdf zero size 2024-04-26T21:26:00.376 INFO:tasks.workunit.client.1.smithi120.stdout:5/744: creat d2/d30/d93/d107/d34/d100/f10d x:0 0 0 2024-04-26T21:26:00.378 INFO:tasks.workunit.client.1.smithi120.stdout:7/669: chown d7/d64/da6/d1a/d50/lc1 599150475 1 2024-04-26T21:26:00.378 INFO:tasks.workunit.client.1.smithi120.stdout:9/614: dread d0/dd/d3a/d5c/f8e [0,4194304] 0 2024-04-26T21:26:00.382 INFO:tasks.workunit.client.1.smithi120.stdout:6/700: dread d4/db/d10/f44 [0,4194304] 0 2024-04-26T21:26:00.383 INFO:tasks.workunit.client.1.smithi120.stdout:8/639: chown d5/d6/d34/d42/d9d 1 1 2024-04-26T21:26:00.385 INFO:tasks.workunit.client.1.smithi120.stdout:2/700: mkdir d4/dea 0 2024-04-26T21:26:00.387 INFO:tasks.workunit.client.0.smithi084.stdout:3/441: dwrite d1/d2c/d2f/d31/d52/f64 [0,4194304] 0 2024-04-26T21:26:00.391 INFO:tasks.workunit.client.1.smithi120.stdout:7/670: unlink d7/d64/da6/d1a/d33/d34/d37/lce 0 2024-04-26T21:26:00.393 INFO:tasks.workunit.client.1.smithi120.stdout:3/669: dwrite dd/fa3 [0,4194304] 0 2024-04-26T21:26:00.395 INFO:tasks.workunit.client.1.smithi120.stdout:5/745: rename d2/d48 to d2/d10e 0 2024-04-26T21:26:00.396 INFO:tasks.workunit.client.1.smithi120.stdout:8/640: chown d5/d6/d34/d37/d60/f65 360548 1 2024-04-26T21:26:00.400 INFO:tasks.workunit.client.1.smithi120.stdout:2/701: fsync d4/d1b/d2e/d50/d14/d15/f2b 0 2024-04-26T21:26:00.405 INFO:tasks.workunit.client.1.smithi120.stdout:2/702: chown d4/d1b/d4f/c74 2096 1 2024-04-26T21:26:00.406 INFO:tasks.workunit.client.1.smithi120.stdout:4/635: dwrite d10/d28/d73/da2/fc9 [0,4194304] 0 2024-04-26T21:26:00.411 INFO:tasks.workunit.client.1.smithi120.stdout:8/641: read d5/d6/f1e [2881211,74340] 0 2024-04-26T21:26:00.416 INFO:tasks.workunit.client.0.smithi084.stdout:8/455: creat d4/d6/db/d1e/d22/d39/f82 x:0 0 0 2024-04-26T21:26:00.420 INFO:tasks.workunit.client.0.smithi084.stdout:5/478: dread d0/dc/df/d31/d53/f71 [0,4194304] 0 2024-04-26T21:26:00.421 INFO:tasks.workunit.client.1.smithi120.stdout:4/636: mkdir d10/d28/dd9 0 2024-04-26T21:26:00.422 INFO:tasks.workunit.client.1.smithi120.stdout:1/609: dread d6/d7/f59 [4194304,4194304] 0 2024-04-26T21:26:00.423 INFO:tasks.workunit.client.1.smithi120.stdout:4/637: stat d10/f47 0 2024-04-26T21:26:00.425 INFO:tasks.workunit.client.0.smithi084.stdout:3/442: creat d1/d2c/d2f/d31/d55/d4e/f8f x:0 0 0 2024-04-26T21:26:00.426 INFO:tasks.workunit.client.1.smithi120.stdout:2/703: creat d4/d1b/d2e/d50/d14/dc2/feb x:0 0 0 2024-04-26T21:26:00.426 INFO:tasks.workunit.client.1.smithi120.stdout:6/701: link d4/db/d25/d6d/deb/cee d4/db/d10/d22/cef 0 2024-04-26T21:26:00.428 INFO:tasks.workunit.client.0.smithi084.stdout:3/443: chown d1/d2c/d2f/d31/d55/f66 154 1 2024-04-26T21:26:00.429 INFO:tasks.workunit.client.0.smithi084.stdout:8/456: fdatasync d4/d7/d15/d3c/f4b 0 2024-04-26T21:26:00.429 INFO:tasks.workunit.client.1.smithi120.stdout:9/615: write d0/dd/d3a/d5c/d9f/fa2 [379148,26673] 0 2024-04-26T21:26:00.429 INFO:tasks.workunit.client.1.smithi120.stdout:7/671: getdents d7/d10/d97 0 2024-04-26T21:26:00.431 INFO:tasks.workunit.client.0.smithi084.stdout:7/465: dwrite d6/d9/d12/d19/d20/d32/f71 [0,4194304] 0 2024-04-26T21:26:00.431 INFO:tasks.workunit.client.1.smithi120.stdout:6/702: chown d4/db/d10/la6 0 1 2024-04-26T21:26:00.431 INFO:tasks.workunit.client.1.smithi120.stdout:8/642: creat d5/d6/d34/d42/d9d/fd0 x:0 0 0 2024-04-26T21:26:00.432 INFO:tasks.workunit.client.0.smithi084.stdout:5/479: creat d0/dc/d48/f97 x:0 0 0 2024-04-26T21:26:00.434 INFO:tasks.workunit.client.0.smithi084.stdout:5/480: write d0/f22 [5727386,121879] 0 2024-04-26T21:26:00.435 INFO:tasks.workunit.client.1.smithi120.stdout:0/792: dwrite d0/f90 [4194304,4194304] 0 2024-04-26T21:26:00.435 INFO:tasks.workunit.client.1.smithi120.stdout:3/670: write dd/de/f2f [1772029,114504] 0 2024-04-26T21:26:00.440 INFO:tasks.workunit.client.1.smithi120.stdout:6/703: write d4/f14 [3529209,63436] 0 2024-04-26T21:26:00.442 INFO:tasks.workunit.client.1.smithi120.stdout:1/610: creat d6/d7/d1b/fc7 x:0 0 0 2024-04-26T21:26:00.443 INFO:tasks.workunit.client.0.smithi084.stdout:8/457: write d4/d6/db/d1e/d22/d2f/f21 [852719,98643] 0 2024-04-26T21:26:00.444 INFO:tasks.workunit.client.1.smithi120.stdout:8/643: unlink d5/d6/d34/lc2 0 2024-04-26T21:26:00.446 INFO:tasks.workunit.client.1.smithi120.stdout:1/611: stat d6/d14/d3c/d72 0 2024-04-26T21:26:00.446 INFO:tasks.workunit.client.0.smithi084.stdout:8/458: stat d4/d7/d15/d37/d52 0 2024-04-26T21:26:00.447 INFO:tasks.workunit.client.1.smithi120.stdout:7/672: readlink d7/d64/da6/d1f/d28/d4c/d6c/lbd 0 2024-04-26T21:26:00.450 INFO:tasks.workunit.client.1.smithi120.stdout:3/671: creat dd/d40/fd7 x:0 0 0 2024-04-26T21:26:00.450 INFO:tasks.workunit.client.1.smithi120.stdout:8/644: fsync d5/d6/d11/d52/d27/f9b 0 2024-04-26T21:26:00.450 INFO:tasks.workunit.client.0.smithi084.stdout:3/444: dread d1/d2c/d2f/d31/d3b/f44 [0,4194304] 0 2024-04-26T21:26:00.451 INFO:tasks.workunit.client.1.smithi120.stdout:4/638: getdents d10/d6b 0 2024-04-26T21:26:00.453 INFO:tasks.workunit.client.0.smithi084.stdout:3/445: dread - d1/d2c/d2f/d31/d55/d4e/d7c/f89 zero size 2024-04-26T21:26:00.455 INFO:tasks.workunit.client.0.smithi084.stdout:5/481: unlink d0/dc/d48/f97 0 2024-04-26T21:26:00.456 INFO:tasks.workunit.client.1.smithi120.stdout:2/704: rename d4/d1b/d2e/d5f/lb6 to d4/d1b/d2e/d5f/lec 0 2024-04-26T21:26:00.457 INFO:tasks.workunit.client.1.smithi120.stdout:4/639: symlink d10/d6b/dbf/lda 0 2024-04-26T21:26:00.457 INFO:tasks.workunit.client.1.smithi120.stdout:7/673: fdatasync d7/d64/da6/d1a/d33/d34/d37/fd4 0 2024-04-26T21:26:00.458 INFO:tasks.workunit.client.0.smithi084.stdout:0/460: dread de/d2b/f39 [0,4194304] 0 2024-04-26T21:26:00.459 INFO:tasks.workunit.client.1.smithi120.stdout:8/645: symlink d5/d6/d34/d42/d9d/d83/ld1 0 2024-04-26T21:26:00.460 INFO:tasks.workunit.client.1.smithi120.stdout:3/672: write dd/de/d18/d37/d80/fd6 [938523,128083] 0 2024-04-26T21:26:00.462 INFO:tasks.workunit.client.1.smithi120.stdout:1/612: link d6/fc d6/d14/d3c/dab/fc8 0 2024-04-26T21:26:00.464 INFO:tasks.workunit.client.1.smithi120.stdout:9/616: getdents d0/dd/d3a/d5c/d98/db8 0 2024-04-26T21:26:00.465 INFO:tasks.workunit.client.1.smithi120.stdout:8/646: chown d5/d6/d11/d32/d3b/f98 752 1 2024-04-26T21:26:00.465 INFO:tasks.workunit.client.1.smithi120.stdout:6/704: read d4/d3d/f83 [1827550,11924] 0 2024-04-26T21:26:00.469 INFO:tasks.workunit.client.1.smithi120.stdout:7/674: chown d7/d10/d97/fd3 62374 1 2024-04-26T21:26:00.470 INFO:tasks.workunit.client.0.smithi084.stdout:5/482: dwrite d0/dc/df/d2a/f40 [0,4194304] 0 2024-04-26T21:26:00.471 INFO:tasks.workunit.client.1.smithi120.stdout:1/613: write d6/d7/fb8 [146683,24650] 0 2024-04-26T21:26:00.472 INFO:tasks.workunit.client.0.smithi084.stdout:8/459: creat d4/d7/d15/d3c/f83 x:0 0 0 2024-04-26T21:26:00.473 INFO:tasks.workunit.client.0.smithi084.stdout:3/446: creat d1/d2c/f90 x:0 0 0 2024-04-26T21:26:00.474 INFO:tasks.workunit.client.1.smithi120.stdout:9/617: mkdir d0/d14/d77/dc5 0 2024-04-26T21:26:00.475 INFO:tasks.workunit.client.1.smithi120.stdout:2/705: link d4/d1b/d2e/d50/d14/ce5 d4/d1b/d4f/ced 0 2024-04-26T21:26:00.476 INFO:tasks.workunit.client.1.smithi120.stdout:0/793: dread d0/df4/f68 [0,4194304] 0 2024-04-26T21:26:00.476 INFO:tasks.workunit.client.0.smithi084.stdout:8/460: write d4/d7/d15/d37/f68 [2490147,49638] 0 2024-04-26T21:26:00.478 INFO:tasks.workunit.client.1.smithi120.stdout:2/706: stat d4/d1b/d56 0 2024-04-26T21:26:00.479 INFO:tasks.workunit.client.1.smithi120.stdout:3/673: mknod dd/de/df/d12/d48/d9b/dcb/cd8 0 2024-04-26T21:26:00.479 INFO:tasks.workunit.client.0.smithi084.stdout:0/461: creat de/d20/d4e/f93 x:0 0 0 2024-04-26T21:26:00.480 INFO:tasks.workunit.client.0.smithi084.stdout:0/462: fdatasync de/d71/f73 0 2024-04-26T21:26:00.483 INFO:tasks.workunit.client.0.smithi084.stdout:3/447: creat d1/d2c/d2f/d31/d55/d4e/d7c/f91 x:0 0 0 2024-04-26T21:26:00.485 INFO:tasks.workunit.client.0.smithi084.stdout:0/463: mkdir de/d2b/d45/d94 0 2024-04-26T21:26:00.490 INFO:tasks.workunit.client.0.smithi084.stdout:3/448: fsync d1/f1a 0 2024-04-26T21:26:00.490 INFO:tasks.workunit.client.1.smithi120.stdout:8/647: mknod d5/d6/d34/da7/dca/cd2 0 2024-04-26T21:26:00.491 INFO:tasks.workunit.client.0.smithi084.stdout:5/483: dwrite d0/dc/df/d31/d53/d87/f96 [0,4194304] 0 2024-04-26T21:26:00.494 INFO:tasks.workunit.client.1.smithi120.stdout:7/675: rmdir d7/d64/da6/d1a/dc5 0 2024-04-26T21:26:00.495 INFO:tasks.workunit.client.0.smithi084.stdout:5/484: chown d0/dc/df/f24 500 1 2024-04-26T21:26:00.497 INFO:tasks.workunit.client.1.smithi120.stdout:0/794: truncate d0/d3/d51/d97/d108/f1f 4363523 0 2024-04-26T21:26:00.498 INFO:tasks.workunit.client.1.smithi120.stdout:4/640: write d10/d12/f55 [4216458,85892] 0 2024-04-26T21:26:00.499 INFO:tasks.workunit.client.1.smithi120.stdout:3/674: creat dd/fd9 x:0 0 0 2024-04-26T21:26:00.500 INFO:tasks.workunit.client.0.smithi084.stdout:5/485: fdatasync d0/f16 0 2024-04-26T21:26:00.500 INFO:tasks.workunit.client.0.smithi084.stdout:0/464: dread f9 [0,4194304] 0 2024-04-26T21:26:00.501 INFO:tasks.workunit.client.1.smithi120.stdout:7/676: mknod d7/d10/d97/ce5 0 2024-04-26T21:26:00.502 INFO:tasks.workunit.client.0.smithi084.stdout:5/486: fsync d0/dc/df/d6d/f73 0 2024-04-26T21:26:00.503 INFO:tasks.workunit.client.1.smithi120.stdout:5/746: dread d2/d1b/f26 [0,4194304] 0 2024-04-26T21:26:00.504 INFO:tasks.workunit.client.1.smithi120.stdout:3/675: dread - dd/d2a/d74/fab zero size 2024-04-26T21:26:00.505 INFO:tasks.workunit.client.0.smithi084.stdout:0/465: chown de/d2b/d77/d68/l92 7 1 2024-04-26T21:26:00.505 INFO:tasks.workunit.client.0.smithi084.stdout:3/449: truncate d1/d2c/d2f/f18 7807823 0 2024-04-26T21:26:00.505 INFO:tasks.workunit.client.1.smithi120.stdout:4/641: creat d10/d28/d73/fdb x:0 0 0 2024-04-26T21:26:00.506 INFO:tasks.workunit.client.1.smithi120.stdout:1/614: dwrite d6/d7/d1d/d2c/d58/f9f [0,4194304] 0 2024-04-26T21:26:00.506 INFO:tasks.workunit.client.0.smithi084.stdout:3/450: chown d1/d2c/d2f/d31/d55/f66 0 1 2024-04-26T21:26:00.508 INFO:tasks.workunit.client.0.smithi084.stdout:3/451: readlink d1/d24/d27/l6f 0 2024-04-26T21:26:00.508 INFO:tasks.workunit.client.1.smithi120.stdout:9/618: dread d0/dd/d3a/dae/f8f [0,4194304] 0 2024-04-26T21:26:00.508 INFO:tasks.workunit.client.1.smithi120.stdout:0/795: rmdir d0/d3/d51/d97 39 2024-04-26T21:26:00.508 INFO:tasks.workunit.client.1.smithi120.stdout:7/677: chown d7/d64/da6/d1f/d28/dbb/f9f 775549 1 2024-04-26T21:26:00.513 INFO:tasks.workunit.client.0.smithi084.stdout:5/487: creat d0/dc/df/f98 x:0 0 0 2024-04-26T21:26:00.514 INFO:tasks.workunit.client.1.smithi120.stdout:9/619: write d0/d14/f8c [1994300,54103] 0 2024-04-26T21:26:00.515 INFO:tasks.workunit.client.1.smithi120.stdout:8/648: rename d5/d6/d11/d52/d27/d4f/d67/da5 to d5/d6/d11/d32/d3b/dd3 0 2024-04-26T21:26:00.519 INFO:tasks.workunit.client.1.smithi120.stdout:6/705: truncate d4/db/d25/d6d/f84 3724783 0 2024-04-26T21:26:00.521 INFO:tasks.workunit.client.1.smithi120.stdout:7/678: truncate d7/d64/fdb 323632 0 2024-04-26T21:26:00.521 INFO:tasks.workunit.client.1.smithi120.stdout:6/706: fdatasync d4/d99/fc1 0 2024-04-26T21:26:00.522 INFO:tasks.workunit.client.1.smithi120.stdout:0/796: mknod d0/dd1/c10c 0 2024-04-26T21:26:00.523 INFO:tasks.workunit.client.0.smithi084.stdout:3/452: creat d1/d24/f92 x:0 0 0 2024-04-26T21:26:00.524 INFO:tasks.workunit.client.0.smithi084.stdout:5/488: unlink d0/dc/c29 0 2024-04-26T21:26:00.525 INFO:tasks.workunit.client.1.smithi120.stdout:5/747: mkdir d2/d1b/d89/d47/de4/d10f 0 2024-04-26T21:26:00.525 INFO:tasks.workunit.client.1.smithi120.stdout:9/620: symlink d0/d14/d77/d9a/lc6 0 2024-04-26T21:26:00.526 INFO:tasks.workunit.client.0.smithi084.stdout:0/466: dwrite de/d20/d4e/f5a [0,4194304] 0 2024-04-26T21:26:00.526 INFO:tasks.workunit.client.0.smithi084.stdout:8/461: dwrite d4/d6/db/d1e/d22/d2f/f2c [0,4194304] 0 2024-04-26T21:26:00.526 INFO:tasks.workunit.client.0.smithi084.stdout:3/453: stat d1/d24/d27/c85 0 2024-04-26T21:26:00.534 INFO:tasks.workunit.client.1.smithi120.stdout:2/707: dwrite d4/d1b/d25/d2c/d3e/d5e/fcf [0,4194304] 0 2024-04-26T21:26:00.534 INFO:tasks.workunit.client.1.smithi120.stdout:3/676: rename dd/de/d18 to dd/de/df/dda 0 2024-04-26T21:26:00.534 INFO:tasks.workunit.client.0.smithi084.stdout:0/467: creat de/d2b/d77/d68/f95 x:0 0 0 2024-04-26T21:26:00.536 INFO:tasks.workunit.client.1.smithi120.stdout:0/797: creat d0/d3/dc/dd/d4b/f10d x:0 0 0 2024-04-26T21:26:00.536 INFO:tasks.workunit.client.1.smithi120.stdout:5/748: mknod d2/d30/d93/d107/d36/d44/dea/c110 0 2024-04-26T21:26:00.537 INFO:tasks.workunit.client.1.smithi120.stdout:6/707: creat d4/db/d10/dd/d43/d58/ff0 x:0 0 0 2024-04-26T21:26:00.539 INFO:tasks.workunit.client.1.smithi120.stdout:8/649: rename d5/d6/d34/d37/d60/f3a to d5/d6/d75/d95/fd4 0 2024-04-26T21:26:00.541 INFO:tasks.workunit.client.1.smithi120.stdout:1/615: getdents d6/d7/d1b/d89/d8c 0 2024-04-26T21:26:00.541 INFO:tasks.workunit.client.1.smithi120.stdout:2/708: truncate d4/d1b/d56/d65/d8d/fba 174535 0 2024-04-26T21:26:00.545 INFO:tasks.workunit.client.0.smithi084.stdout:5/489: rename d0/dc/df/d2a/f46 to d0/dc/df/d31/d53/d87/f99 0 2024-04-26T21:26:00.545 INFO:tasks.workunit.client.0.smithi084.stdout:3/454: mknod d1/d2c/d2f/d31/d55/d4e/d7c/d7e/c93 0 2024-04-26T21:26:00.545 INFO:tasks.workunit.client.1.smithi120.stdout:8/650: stat d5/d6/d11/d52/f17 0 2024-04-26T21:26:00.547 INFO:tasks.workunit.client.1.smithi120.stdout:1/616: chown d6/d7/d2d/d98/d56 1616 1 2024-04-26T21:26:00.548 INFO:tasks.workunit.client.1.smithi120.stdout:6/708: fdatasync d4/db/d10/d22/f62 0 2024-04-26T21:26:00.551 INFO:tasks.workunit.client.0.smithi084.stdout:8/462: creat d4/f84 x:0 0 0 2024-04-26T21:26:00.552 INFO:tasks.workunit.client.1.smithi120.stdout:3/677: rename dd/de/df/dda/d37/d80 to dd/de/df/dda/d24/d9d/d86/dd3/ddb 0 2024-04-26T21:26:00.554 INFO:tasks.workunit.client.1.smithi120.stdout:1/617: mkdir d6/d7/d1b/d3b/d6d/dc9 0 2024-04-26T21:26:00.554 INFO:tasks.workunit.client.1.smithi120.stdout:5/749: truncate d2/dc/d1d/d21/d66/d6a/d8c/fca 252188 0 2024-04-26T21:26:00.556 INFO:tasks.workunit.client.1.smithi120.stdout:3/678: chown dd/de/d83/db2/fb3 841008 1 2024-04-26T21:26:00.557 INFO:tasks.workunit.client.1.smithi120.stdout:6/709: readlink d4/db/d10/d22/d56/d94/lc7 0 2024-04-26T21:26:00.557 INFO:tasks.workunit.client.0.smithi084.stdout:5/490: unlink d0/d17/l28 0 2024-04-26T21:26:00.558 INFO:tasks.workunit.client.0.smithi084.stdout:0/468: dwrite de/d20/d4e/f60 [0,4194304] 0 2024-04-26T21:26:00.566 INFO:tasks.workunit.client.1.smithi120.stdout:0/798: dwrite d0/d3/dc/dd/d1b/d39/f3e [0,4194304] 0 2024-04-26T21:26:00.572 INFO:tasks.workunit.client.0.smithi084.stdout:0/469: unlink f4 0 2024-04-26T21:26:00.574 INFO:tasks.workunit.client.1.smithi120.stdout:7/679: write d7/d64/da6/d1f/d28/f2e [425548,6194] 0 2024-04-26T21:26:00.582 INFO:tasks.workunit.client.1.smithi120.stdout:7/680: dread - d7/d64/fae zero size 2024-04-26T21:26:00.583 INFO:tasks.workunit.client.1.smithi120.stdout:0/799: link d0/d3/dc/dd/d1b/d24/d73/db7/fe5 d0/d3/f10e 0 2024-04-26T21:26:00.586 INFO:tasks.workunit.client.1.smithi120.stdout:3/679: truncate dd/de/f2f 3693327 0 2024-04-26T21:26:00.586 INFO:tasks.workunit.client.1.smithi120.stdout:1/618: write d6/d7/d1d/d2c/d58/faf [433800,23371] 0 2024-04-26T21:26:00.586 INFO:tasks.workunit.client.1.smithi120.stdout:6/710: read d4/db/d10/dd/f18 [4855569,98062] 0 2024-04-26T21:26:00.588 INFO:tasks.workunit.client.1.smithi120.stdout:8/651: dread d5/fb1 [0,4194304] 0 2024-04-26T21:26:00.590 INFO:tasks.workunit.client.1.smithi120.stdout:7/681: chown d7/d64/da6/d1f/f48 47900 1 2024-04-26T21:26:00.594 INFO:tasks.workunit.client.1.smithi120.stdout:3/680: unlink dd/de/df/l60 0 2024-04-26T21:26:00.594 INFO:tasks.workunit.client.1.smithi120.stdout:9/621: dwrite d0/dd/f7e [0,4194304] 0 2024-04-26T21:26:00.599 INFO:tasks.workunit.client.1.smithi120.stdout:0/800: dread - d0/d3/dc/dd/d1b/d24/d73/f105 zero size 2024-04-26T21:26:00.599 INFO:tasks.workunit.client.1.smithi120.stdout:8/652: rmdir d5/d6/d11/d32 39 2024-04-26T21:26:00.599 INFO:tasks.workunit.client.1.smithi120.stdout:1/619: write d6/d7/d1b/fc7 [528811,5032] 0 2024-04-26T21:26:00.599 INFO:tasks.workunit.client.1.smithi120.stdout:4/642: dread d10/d28/f77 [0,4194304] 0 2024-04-26T21:26:00.603 INFO:tasks.workunit.client.0.smithi084.stdout:0/470: mkdir de/d2b/d77/d32/d96 0 2024-04-26T21:26:00.603 INFO:tasks.workunit.client.1.smithi120.stdout:7/682: mkdir d7/d19/d60/de6 0 2024-04-26T21:26:00.605 INFO:tasks.workunit.client.0.smithi084.stdout:0/471: write de/d71/f73 [363645,74591] 0 2024-04-26T21:26:00.608 INFO:tasks.workunit.client.1.smithi120.stdout:6/711: creat d4/db/d25/d6d/ff1 x:0 0 0 2024-04-26T21:26:00.609 INFO:tasks.workunit.client.1.smithi120.stdout:1/620: fsync d6/d7/d2d/d48/d86/dc1/fbd 0 2024-04-26T21:26:00.609 INFO:tasks.workunit.client.1.smithi120.stdout:3/681: creat dd/de/df/d12/d48/d9b/dcb/fdc x:0 0 0 2024-04-26T21:26:00.610 INFO:tasks.workunit.client.1.smithi120.stdout:8/653: mknod d5/d6/d75/d95/cd5 0 2024-04-26T21:26:00.612 INFO:tasks.workunit.client.1.smithi120.stdout:1/621: chown d6/d7/d2d 6 1 2024-04-26T21:26:00.615 INFO:tasks.workunit.client.1.smithi120.stdout:3/682: stat dd/de/df/dda/d24/d9d/d86/dd3 0 2024-04-26T21:26:00.618 INFO:tasks.workunit.client.0.smithi084.stdout:5/491: dread d0/d17/f1d [0,4194304] 0 2024-04-26T21:26:00.619 INFO:tasks.workunit.client.1.smithi120.stdout:5/750: dread d2/d30/d93/d107/d36/f65 [0,4194304] 0 2024-04-26T21:26:00.628 INFO:tasks.workunit.client.1.smithi120.stdout:1/622: symlink d6/d7/d2d/d98/d35/lca 0 2024-04-26T21:26:00.630 INFO:tasks.workunit.client.1.smithi120.stdout:0/801: read d0/d3/d51/d97/d108/d81/dba/fbd [1974617,24753] 0 2024-04-26T21:26:00.634 INFO:tasks.workunit.client.0.smithi084.stdout:8/463: dread d4/d7/d15/f30 [4194304,4194304] 0 2024-04-26T21:26:00.638 INFO:tasks.workunit.client.0.smithi084.stdout:5/492: dwrite d0/dc/df/d31/d72/d84/f89 [0,4194304] 0 2024-04-26T21:26:00.638 INFO:tasks.workunit.client.1.smithi120.stdout:8/654: unlink d5/d6/d34/d42/d9d/l8d 0 2024-04-26T21:26:00.646 INFO:tasks.workunit.client.1.smithi120.stdout:9/622: read d0/d14/d2d/d4b/f8b [59166,64821] 0 2024-04-26T21:26:00.647 INFO:tasks.workunit.client.1.smithi120.stdout:1/623: creat d6/d7/d1d/d2c/d58/fcb x:0 0 0 2024-04-26T21:26:00.649 INFO:tasks.workunit.client.1.smithi120.stdout:0/802: rename d0/d3/dc/dd/d1b/d24/d73/db7/fc7 to d0/df/f10f 0 2024-04-26T21:26:00.649 INFO:tasks.workunit.client.1.smithi120.stdout:5/751: dwrite d2/dc/d1d/d21/db2/dde/ff8 [0,4194304] 0 2024-04-26T21:26:00.651 INFO:tasks.workunit.client.1.smithi120.stdout:8/655: stat d5/d6/d11/d52/l2d 0 2024-04-26T21:26:00.652 INFO:tasks.workunit.client.1.smithi120.stdout:6/712: dwrite d4/db/d10/dd/d28/f89 [4194304,4194304] 0 2024-04-26T21:26:00.654 INFO:tasks.workunit.client.1.smithi120.stdout:2/709: dread d4/d1b/d2e/d50/f21 [0,4194304] 0 2024-04-26T21:26:00.664 INFO:tasks.workunit.client.1.smithi120.stdout:1/624: write d6/d9/fc0 [518531,8585] 0 2024-04-26T21:26:00.664 INFO:tasks.workunit.client.0.smithi084.stdout:8/464: write d4/d6/db/d1e/d22/d2f/f41 [1967501,67707] 0 2024-04-26T21:26:00.667 INFO:tasks.workunit.client.0.smithi084.stdout:8/465: chown d4/d7/d15/d37/d3b 1 1 2024-04-26T21:26:00.673 INFO:tasks.workunit.client.0.smithi084.stdout:8/466: mknod d4/d7/d15/d37/d52/d69/c85 0 2024-04-26T21:26:00.674 INFO:tasks.workunit.client.1.smithi120.stdout:0/803: write d0/d3/dc/dd/d1b/daa/fbe [1330567,92156] 0 2024-04-26T21:26:00.675 INFO:tasks.workunit.client.1.smithi120.stdout:0/804: stat d0/d3/f10e 0 2024-04-26T21:26:00.677 INFO:tasks.workunit.client.1.smithi120.stdout:1/625: dread d6/d7/d1b/d55/fa1 [0,4194304] 0 2024-04-26T21:26:00.677 INFO:tasks.workunit.client.1.smithi120.stdout:4/643: dwrite d10/d12/f27 [0,4194304] 0 2024-04-26T21:26:00.678 INFO:tasks.workunit.client.0.smithi084.stdout:5/493: dwrite d0/dc/df/d31/f54 [0,4194304] 0 2024-04-26T21:26:00.678 INFO:tasks.workunit.client.1.smithi120.stdout:1/626: fdatasync d6/d14/f16 0 2024-04-26T21:26:00.680 INFO:tasks.workunit.client.1.smithi120.stdout:7/683: dread d7/d64/da6/d1a/d33/f83 [0,4194304] 0 2024-04-26T21:26:00.681 INFO:tasks.workunit.client.0.smithi084.stdout:8/467: write d4/d7/d15/f30 [8358383,130055] 0 2024-04-26T21:26:00.683 INFO:tasks.workunit.client.0.smithi084.stdout:5/494: write d0/d49/d56/f57 [594316,59340] 0 2024-04-26T21:26:00.685 INFO:tasks.workunit.client.1.smithi120.stdout:9/623: mkdir d0/d66/d93/db7/dc7 0 2024-04-26T21:26:00.688 INFO:tasks.workunit.client.1.smithi120.stdout:8/656: symlink d5/d6/d34/d42/d4a/dbf/ld6 0 2024-04-26T21:26:00.694 INFO:tasks.workunit.client.1.smithi120.stdout:7/684: rename d7/d64/da6/d1a/d50/fe3 to d7/d10/fe7 0 2024-04-26T21:26:00.697 INFO:tasks.workunit.client.0.smithi084.stdout:2/571: sync 2024-04-26T21:26:00.697 INFO:tasks.workunit.client.1.smithi120.stdout:4/644: write d10/d12/f8e [891209,98056] 0 2024-04-26T21:26:00.697 INFO:tasks.workunit.client.1.smithi120.stdout:2/710: dwrite d4/d1b/d25/fc6 [0,4194304] 0 2024-04-26T21:26:00.701 INFO:tasks.workunit.client.1.smithi120.stdout:5/752: link d2/dc/d1d/d21/d66/d85/fc5 d2/dc/d1d/d21/d77/d79/dd9/f111 0 2024-04-26T21:26:00.703 INFO:tasks.workunit.client.0.smithi084.stdout:5/495: dread d0/dc/f1a [0,4194304] 0 2024-04-26T21:26:00.706 INFO:tasks.workunit.client.0.smithi084.stdout:5/496: write d0/dc/df/d31/d45/f82 [434237,129633] 0 2024-04-26T21:26:00.708 INFO:tasks.workunit.client.0.smithi084.stdout:5/497: stat d0/d17/f7e 0 2024-04-26T21:26:00.713 INFO:tasks.workunit.client.0.smithi084.stdout:2/572: creat d6/d7/d3d/d79/d81/fc3 x:0 0 0 2024-04-26T21:26:00.715 INFO:tasks.workunit.client.1.smithi120.stdout:9/624: dread d0/dd/d34/f6e [0,4194304] 0 2024-04-26T21:26:00.716 INFO:tasks.workunit.client.1.smithi120.stdout:0/805: dwrite d0/d3/dc/fe6 [0,4194304] 0 2024-04-26T21:26:00.718 INFO:tasks.workunit.client.0.smithi084.stdout:5/498: read d0/f2c [184571,33728] 0 2024-04-26T21:26:00.718 INFO:tasks.workunit.client.0.smithi084.stdout:8/468: dread d4/d6/db/d1e/d22/f2e [0,4194304] 0 2024-04-26T21:26:00.719 INFO:tasks.workunit.client.0.smithi084.stdout:8/469: stat d4/d6 0 2024-04-26T21:26:00.721 INFO:tasks.workunit.client.1.smithi120.stdout:6/713: dwrite d4/db/d10/d1a/d2b/d57/d67/f2e [0,4194304] 0 2024-04-26T21:26:00.722 INFO:tasks.workunit.client.1.smithi120.stdout:7/685: dread d7/d64/da6/d1f/d28/f3e [0,4194304] 0 2024-04-26T21:26:00.727 INFO:tasks.workunit.client.0.smithi084.stdout:5/499: write d0/dc/df/d75/f55 [4869938,80721] 0 2024-04-26T21:26:00.730 INFO:tasks.workunit.client.1.smithi120.stdout:4/645: truncate d10/d12/f22 2937087 0 2024-04-26T21:26:00.733 INFO:tasks.workunit.client.1.smithi120.stdout:8/657: dwrite d5/d6/d11/f6b [12582912,4194304] 0 2024-04-26T21:26:00.733 INFO:tasks.workunit.client.1.smithi120.stdout:7/686: rmdir d7/d19 39 2024-04-26T21:26:00.735 INFO:tasks.workunit.client.1.smithi120.stdout:0/806: truncate d0/d3/dc/dd/d9b/ff7 1041948 0 2024-04-26T21:26:00.747 INFO:tasks.workunit.client.1.smithi120.stdout:9/625: link d0/d14/c33 d0/dd/d45/d87/cc8 0 2024-04-26T21:26:00.752 INFO:tasks.workunit.client.1.smithi120.stdout:5/753: dwrite d2/d30/d93/d107/d36/d44/f105 [0,4194304] 0 2024-04-26T21:26:00.752 INFO:tasks.workunit.client.1.smithi120.stdout:8/658: chown d5/d6/d34/d42/d9d/la1 11469095 1 2024-04-26T21:26:00.754 INFO:tasks.workunit.client.0.smithi084.stdout:2/573: dread d6/d7/d3d/d15/d1f/d22/d2a/f8b [0,4194304] 0 2024-04-26T21:26:00.754 INFO:tasks.workunit.client.1.smithi120.stdout:2/711: dwrite d4/d1b/d25/d2c/fa2 [0,4194304] 0 2024-04-26T21:26:00.757 INFO:tasks.workunit.client.1.smithi120.stdout:5/754: stat d2/d30/d93/d107/fb0 0 2024-04-26T21:26:00.758 INFO:tasks.workunit.client.0.smithi084.stdout:2/574: write d6/d7/d3d/d15/d1f/d41/f65 [1403493,33496] 0 2024-04-26T21:26:00.760 INFO:tasks.workunit.client.1.smithi120.stdout:2/712: chown d4/d1b/d25/d2c/d3e/f81 1038872917 1 2024-04-26T21:26:00.765 INFO:tasks.workunit.client.0.smithi084.stdout:2/575: chown d6/d7/d3d/d15/d1f/d39/d20/d45/f97 0 1 2024-04-26T21:26:00.766 INFO:tasks.workunit.client.1.smithi120.stdout:8/659: rmdir d5 39 2024-04-26T21:26:00.766 INFO:tasks.workunit.client.0.smithi084.stdout:2/576: chown d6/d7/d3d/d15/d1f/d39/fbc 148993925 1 2024-04-26T21:26:00.775 INFO:tasks.workunit.client.1.smithi120.stdout:7/687: dwrite d7/d64/da6/d1a/d33/d34/dab/dbf/fde [4194304,4194304] 0 2024-04-26T21:26:00.776 INFO:tasks.workunit.client.1.smithi120.stdout:5/755: mknod d2/dc/d1d/d21/d66/de5/c112 0 2024-04-26T21:26:00.781 INFO:tasks.workunit.client.1.smithi120.stdout:0/807: dwrite d0/d3/dc/dd/d1b/daa/fbe [0,4194304] 0 2024-04-26T21:26:00.785 INFO:tasks.workunit.client.0.smithi084.stdout:2/577: dread d6/d7/d3d/d15/f1a [0,4194304] 0 2024-04-26T21:26:00.788 INFO:tasks.workunit.client.1.smithi120.stdout:7/688: truncate d7/d64/da6/d1f/d28/f2e 1168637 0 2024-04-26T21:26:00.789 INFO:tasks.workunit.client.1.smithi120.stdout:5/756: creat d2/dc/d1d/d21/db2/f113 x:0 0 0 2024-04-26T21:26:00.792 INFO:tasks.workunit.client.1.smithi120.stdout:6/714: truncate d4/db/d10/d1a/d2b/d57/d67/f4a 476280 0 2024-04-26T21:26:00.798 INFO:tasks.workunit.client.1.smithi120.stdout:0/808: fdatasync d0/d3/d51/d97/d108/d64/f69 0 2024-04-26T21:26:00.800 INFO:tasks.workunit.client.1.smithi120.stdout:6/715: creat d4/db/d25/d6d/d97/dc8/ff2 x:0 0 0 2024-04-26T21:26:00.802 INFO:tasks.workunit.client.0.smithi084.stdout:8/470: dread d4/f4f [0,4194304] 0 2024-04-26T21:26:00.805 INFO:tasks.workunit.client.1.smithi120.stdout:4/646: dwrite d10/d28/f56 [0,4194304] 0 2024-04-26T21:26:00.811 INFO:tasks.workunit.client.1.smithi120.stdout:5/757: link d2/d10e/l90 d2/dc/d1d/d21/d66/d6a/d8c/l114 0 2024-04-26T21:26:00.813 INFO:tasks.workunit.client.1.smithi120.stdout:8/660: write d5/d6/f7f [4236142,118750] 0 2024-04-26T21:26:00.814 INFO:tasks.workunit.client.1.smithi120.stdout:0/809: rmdir d0/d3/dc/d12/dae 39 2024-04-26T21:26:00.815 INFO:tasks.workunit.client.0.smithi084.stdout:5/500: dread d0/d17/f5b [0,4194304] 0 2024-04-26T21:26:00.815 INFO:tasks.workunit.client.1.smithi120.stdout:2/713: truncate d4/d1b/d25/d2c/f46 2880763 0 2024-04-26T21:26:00.816 INFO:tasks.workunit.client.0.smithi084.stdout:8/471: dread d4/f12 [4194304,4194304] 0 2024-04-26T21:26:00.817 INFO:tasks.workunit.client.1.smithi120.stdout:9/626: dwrite d0/d14/d2d/d4b/f8b [0,4194304] 0 2024-04-26T21:26:00.818 INFO:tasks.workunit.client.1.smithi120.stdout:8/661: read d5/d6/d34/faf [517771,21722] 0 2024-04-26T21:26:00.819 INFO:tasks.workunit.client.0.smithi084.stdout:2/578: dwrite f0 [0,4194304] 0 2024-04-26T21:26:00.819 INFO:tasks.workunit.client.1.smithi120.stdout:8/662: chown d5 264 1 2024-04-26T21:26:00.820 INFO:tasks.workunit.client.0.smithi084.stdout:5/501: mkdir d0/dc/df/d75/d9a 0 2024-04-26T21:26:00.822 INFO:tasks.workunit.client.1.smithi120.stdout:4/647: truncate d10/d28/f77 848764 0 2024-04-26T21:26:00.822 INFO:tasks.workunit.client.0.smithi084.stdout:8/472: chown d4/d6/db/d1e/d22/d39/f82 30379560 1 2024-04-26T21:26:00.827 INFO:tasks.workunit.client.1.smithi120.stdout:2/714: rmdir d4/d1b/d25/d93 39 2024-04-26T21:26:00.829 INFO:tasks.workunit.client.0.smithi084.stdout:2/579: mknod d6/d7/d3d/d79/cc4 0 2024-04-26T21:26:00.830 INFO:tasks.workunit.client.0.smithi084.stdout:5/502: mknod d0/dc/df/d31/c9b 0 2024-04-26T21:26:00.833 INFO:tasks.workunit.client.1.smithi120.stdout:4/648: creat d10/d12/fdc x:0 0 0 2024-04-26T21:26:00.837 INFO:tasks.workunit.client.0.smithi084.stdout:5/503: write d0/dc/f1c [508296,4926] 0 2024-04-26T21:26:00.839 INFO:tasks.workunit.client.1.smithi120.stdout:6/716: write d4/db/d10/dd/d4e/f85 [395497,65723] 0 2024-04-26T21:26:00.841 INFO:tasks.workunit.client.0.smithi084.stdout:2/580: symlink d6/d7/d3d/d79/d81/lc5 0 2024-04-26T21:26:00.844 INFO:tasks.workunit.client.0.smithi084.stdout:8/473: dwrite d4/d7/d15/d3c/f83 [0,4194304] 0 2024-04-26T21:26:00.845 INFO:tasks.workunit.client.1.smithi120.stdout:0/810: dwrite d0/dd1/fda [0,4194304] 0 2024-04-26T21:26:00.846 INFO:tasks.workunit.client.0.smithi084.stdout:5/504: creat d0/dc/df/d31/f9c x:0 0 0 2024-04-26T21:26:00.847 INFO:tasks.workunit.client.0.smithi084.stdout:8/474: chown d4/f13 0 1 2024-04-26T21:26:00.848 INFO:tasks.workunit.client.0.smithi084.stdout:2/581: creat d6/d7/d3d/d79/d81/d82/da8/fc6 x:0 0 0 2024-04-26T21:26:00.849 INFO:tasks.workunit.client.0.smithi084.stdout:5/505: readlink d0/dc/df/d31/d45/l69 0 2024-04-26T21:26:00.849 INFO:tasks.workunit.client.0.smithi084.stdout:1/466: sync 2024-04-26T21:26:00.849 INFO:tasks.workunit.client.0.smithi084.stdout:8/475: chown d4/d7/d15/d37/d52/d69 1 1 2024-04-26T21:26:00.849 INFO:tasks.workunit.client.0.smithi084.stdout:7/466: sync 2024-04-26T21:26:00.853 INFO:tasks.workunit.client.1.smithi120.stdout:7/689: dread d7/d64/da6/d1f/d28/dbb/f81 [0,4194304] 0 2024-04-26T21:26:00.854 INFO:tasks.workunit.client.1.smithi120.stdout:2/715: fdatasync d4/d1b/d25/d2c/d3e/d5e/fe2 0 2024-04-26T21:26:00.856 INFO:tasks.workunit.client.0.smithi084.stdout:7/467: mknod d6/d68/c9c 0 2024-04-26T21:26:00.857 INFO:tasks.workunit.client.0.smithi084.stdout:1/467: creat d2/d9/d15/d28/d5a/f91 x:0 0 0 2024-04-26T21:26:00.860 INFO:tasks.workunit.client.1.smithi120.stdout:9/627: truncate d0/dd/f7e 920212 0 2024-04-26T21:26:00.862 INFO:tasks.workunit.client.0.smithi084.stdout:2/582: creat d6/d7/d3d/d15/fc7 x:0 0 0 2024-04-26T21:26:00.863 INFO:tasks.workunit.client.1.smithi120.stdout:8/663: write d5/d6/d11/d52/f44 [474110,13433] 0 2024-04-26T21:26:00.863 INFO:tasks.workunit.client.1.smithi120.stdout:4/649: dwrite d10/d12/f45 [4194304,4194304] 0 2024-04-26T21:26:00.863 INFO:tasks.workunit.client.0.smithi084.stdout:7/468: chown d6/d9/d12/d19/d7a/d84/c73 342634294 1 2024-04-26T21:26:00.867 INFO:tasks.workunit.client.0.smithi084.stdout:8/476: rmdir d4/d6/db/d1e/d22/d2f/d65 0 2024-04-26T21:26:00.869 INFO:tasks.workunit.client.0.smithi084.stdout:2/583: mknod d6/d7/d3d/d4f/cc8 0 2024-04-26T21:26:00.870 INFO:tasks.workunit.client.0.smithi084.stdout:1/468: creat d2/f92 x:0 0 0 2024-04-26T21:26:00.872 INFO:tasks.workunit.client.0.smithi084.stdout:8/477: mknod d4/d7/d15/d37/d52/d69/c86 0 2024-04-26T21:26:00.876 INFO:tasks.workunit.client.0.smithi084.stdout:0/472: sync 2024-04-26T21:26:00.876 INFO:tasks.workunit.client.0.smithi084.stdout:6/459: sync 2024-04-26T21:26:00.876 INFO:tasks.workunit.client.0.smithi084.stdout:4/409: sync 2024-04-26T21:26:00.876 INFO:tasks.workunit.client.0.smithi084.stdout:9/411: sync 2024-04-26T21:26:00.877 INFO:tasks.workunit.client.0.smithi084.stdout:3/455: sync 2024-04-26T21:26:00.877 INFO:tasks.workunit.client.1.smithi120.stdout:9/628: getdents d0/dd/d3a/d5c/d98/db8 0 2024-04-26T21:26:00.878 INFO:tasks.workunit.client.0.smithi084.stdout:2/584: fsync d6/d7/d3d/d15/d1f/f32 0 2024-04-26T21:26:00.879 INFO:tasks.workunit.client.1.smithi120.stdout:5/758: dwrite d2/d1b/d89/d47/f53 [0,4194304] 0 2024-04-26T21:26:00.882 INFO:tasks.workunit.client.1.smithi120.stdout:4/650: mkdir d10/d28/dd9/ddd 0 2024-04-26T21:26:00.882 INFO:tasks.workunit.client.0.smithi084.stdout:4/410: truncate d5/d25/d35/f81 598838 0 2024-04-26T21:26:00.882 INFO:tasks.workunit.client.0.smithi084.stdout:9/412: write da/de/d16/d25/d41/d43/d48/f8f [101743,115942] 0 2024-04-26T21:26:00.884 INFO:tasks.workunit.client.0.smithi084.stdout:6/460: rmdir d3/d18 39 2024-04-26T21:26:00.884 INFO:tasks.workunit.client.1.smithi120.stdout:9/629: fsync d0/dd/d34/fa6 0 2024-04-26T21:26:00.884 INFO:tasks.workunit.client.0.smithi084.stdout:9/413: chown da/de/d16/d25/l33 228368 1 2024-04-26T21:26:00.885 INFO:tasks.workunit.client.1.smithi120.stdout:8/664: truncate d5/d6/d34/d42/fba 115749 0 2024-04-26T21:26:00.886 INFO:tasks.workunit.client.1.smithi120.stdout:4/651: rmdir d10/d28/dd9 39 2024-04-26T21:26:00.891 INFO:tasks.workunit.client.1.smithi120.stdout:0/811: dwrite d0/d3/dc/dd/d1b/fa1 [0,4194304] 0 2024-04-26T21:26:00.891 INFO:tasks.workunit.client.1.smithi120.stdout:9/630: fdatasync d0/d6/fbf 0 2024-04-26T21:26:00.893 INFO:tasks.workunit.client.1.smithi120.stdout:6/717: dread d4/d3d/f6e [0,4194304] 0 2024-04-26T21:26:00.894 INFO:tasks.workunit.client.0.smithi084.stdout:0/473: creat de/d2b/d64/d81/f97 x:0 0 0 2024-04-26T21:26:00.898 INFO:tasks.workunit.client.0.smithi084.stdout:2/585: mknod d6/d7/d3d/d15/d1f/d39/d20/d45/cc9 0 2024-04-26T21:26:00.900 INFO:tasks.workunit.client.1.smithi120.stdout:0/812: fsync d0/f72 0 2024-04-26T21:26:00.901 INFO:tasks.workunit.client.1.smithi120.stdout:0/813: chown d0/d3/d51/cc4 7 1 2024-04-26T21:26:00.901 INFO:tasks.workunit.client.0.smithi084.stdout:4/411: symlink d5/d7/d65/l87 0 2024-04-26T21:26:00.903 INFO:tasks.workunit.client.0.smithi084.stdout:8/478: creat d4/f87 x:0 0 0 2024-04-26T21:26:00.903 INFO:tasks.workunit.client.0.smithi084.stdout:9/414: symlink da/de/d16/d40/l9a 0 2024-04-26T21:26:00.903 INFO:tasks.workunit.client.1.smithi120.stdout:9/631: rmdir d0/dd/d3a/d5c/d98/db8 39 2024-04-26T21:26:00.904 INFO:tasks.workunit.client.0.smithi084.stdout:2/586: creat d6/d7/d3d/d4f/fca x:0 0 0 2024-04-26T21:26:00.906 INFO:tasks.workunit.client.1.smithi120.stdout:9/632: readlink d0/dd/l25 0 2024-04-26T21:26:00.908 INFO:tasks.workunit.client.0.smithi084.stdout:6/461: read d3/d18/f38 [1148855,63582] 0 2024-04-26T21:26:00.910 INFO:tasks.workunit.client.0.smithi084.stdout:0/474: creat de/d20/f98 x:0 0 0 2024-04-26T21:26:00.911 INFO:tasks.workunit.client.1.smithi120.stdout:1/627: sync 2024-04-26T21:26:00.911 INFO:tasks.workunit.client.1.smithi120.stdout:3/683: sync 2024-04-26T21:26:00.912 INFO:tasks.workunit.client.1.smithi120.stdout:8/665: rename d5/d6/c8b to d5/d6/d11/cd7 0 2024-04-26T21:26:00.916 INFO:tasks.workunit.client.0.smithi084.stdout:9/415: creat da/de/d16/d25/d41/d67/f9b x:0 0 0 2024-04-26T21:26:00.916 INFO:tasks.workunit.client.0.smithi084.stdout:6/462: write d3/de/d15/d40/f6e [666915,19266] 0 2024-04-26T21:26:00.917 INFO:tasks.workunit.client.1.smithi120.stdout:5/759: dwrite d2/dc/d1d/d21/fd8 [0,4194304] 0 2024-04-26T21:26:00.918 INFO:tasks.workunit.client.1.smithi120.stdout:9/633: creat d0/d66/d93/db7/d9b/fc9 x:0 0 0 2024-04-26T21:26:00.919 INFO:tasks.workunit.client.1.smithi120.stdout:1/628: read d6/d7/d2d/d48/d86/dc1/f88 [295044,124414] 0 2024-04-26T21:26:00.920 INFO:tasks.workunit.client.0.smithi084.stdout:7/469: truncate d6/d9/d12/d19/f7e 2680822 0 2024-04-26T21:26:00.920 INFO:tasks.workunit.client.0.smithi084.stdout:6/463: fdatasync d3/de/d15/f85 0 2024-04-26T21:26:00.921 INFO:tasks.workunit.client.0.smithi084.stdout:0/475: mkdir de/d20/d4e/d99 0 2024-04-26T21:26:00.922 INFO:tasks.workunit.client.0.smithi084.stdout:5/506: dwrite d0/dc/f19 [4194304,4194304] 0 2024-04-26T21:26:00.923 INFO:tasks.workunit.client.0.smithi084.stdout:1/469: truncate d2/d54/d5e/d66/f2b 1452487 0 2024-04-26T21:26:00.924 INFO:tasks.workunit.client.0.smithi084.stdout:3/456: dread d1/d2c/d2f/d31/d52/f60 [0,4194304] 0 2024-04-26T21:26:00.925 INFO:tasks.workunit.client.1.smithi120.stdout:6/718: rename d4/db/d10/dd/d4e/f75 to d4/db/d10/dd/d28/d9e/daf/dd3/ff3 0 2024-04-26T21:26:00.925 INFO:tasks.workunit.client.1.smithi120.stdout:3/684: write dd/f5e [4313064,35643] 0 2024-04-26T21:26:00.928 INFO:tasks.workunit.client.1.smithi120.stdout:8/666: creat d5/d6/d75/d95/fd8 x:0 0 0 2024-04-26T21:26:00.929 INFO:tasks.workunit.client.1.smithi120.stdout:0/814: link d0/d3/dc/dd/d1b/d39/l4c d0/d3/dc/dd/d4b/l110 0 2024-04-26T21:26:00.930 INFO:tasks.workunit.client.0.smithi084.stdout:6/464: unlink d3/de/d1a/d43/f8e 0 2024-04-26T21:26:00.934 INFO:tasks.workunit.client.1.smithi120.stdout:3/685: read - dd/de/d83/fa7 zero size 2024-04-26T21:26:00.934 INFO:tasks.workunit.client.1.smithi120.stdout:5/760: unlink d2/d30/d93/d107/d36/fe1 0 2024-04-26T21:26:00.936 INFO:tasks.workunit.client.1.smithi120.stdout:6/719: mkdir d4/d99/df4 0 2024-04-26T21:26:00.940 INFO:tasks.workunit.client.0.smithi084.stdout:9/416: dread da/f37 [0,4194304] 0 2024-04-26T21:26:00.940 INFO:tasks.workunit.client.0.smithi084.stdout:6/465: chown d3/de/d15/f1c 1859739 1 2024-04-26T21:26:00.941 INFO:tasks.workunit.client.1.smithi120.stdout:3/686: read dd/f5e [2263310,35315] 0 2024-04-26T21:26:00.943 INFO:tasks.workunit.client.1.smithi120.stdout:6/720: readlink d4/db/d10/d1a/d2b/d57/l5e 0 2024-04-26T21:26:00.946 INFO:tasks.workunit.client.0.smithi084.stdout:0/476: chown de/d2b/d77/d32/f6e 137885492 1 2024-04-26T21:26:00.948 INFO:tasks.workunit.client.1.smithi120.stdout:9/634: dwrite d0/d6/fbf [0,4194304] 0 2024-04-26T21:26:00.949 INFO:tasks.workunit.client.0.smithi084.stdout:3/457: rmdir d1/d2c/d2f/d31 39 2024-04-26T21:26:00.950 INFO:tasks.workunit.client.1.smithi120.stdout:7/690: dread d7/d64/da6/d1f/d28/d4c/d6b/d7b/f80 [4194304,4194304] 0 2024-04-26T21:26:00.953 INFO:tasks.workunit.client.1.smithi120.stdout:9/635: fsync d0/dd/d34/fa6 0 2024-04-26T21:26:00.954 INFO:tasks.workunit.client.0.smithi084.stdout:4/412: dwrite d5/d10/d15/d21/f7b [0,4194304] 0 2024-04-26T21:26:00.954 INFO:tasks.workunit.client.1.smithi120.stdout:3/687: creat dd/d2a/fdd x:0 0 0 2024-04-26T21:26:00.955 INFO:tasks.workunit.client.0.smithi084.stdout:6/466: mknod d3/de/d1a/d2f/d4c/c98 0 2024-04-26T21:26:00.955 INFO:tasks.workunit.client.0.smithi084.stdout:1/470: chown d2/d54/d5e/d66/f2b 338 1 2024-04-26T21:26:00.958 INFO:tasks.workunit.client.1.smithi120.stdout:2/716: dread d4/d1b/d25/d2c/faa [0,4194304] 0 2024-04-26T21:26:00.959 INFO:tasks.workunit.client.0.smithi084.stdout:6/467: chown d3/de/c73 44685728 1 2024-04-26T21:26:00.961 INFO:tasks.workunit.client.0.smithi084.stdout:2/587: dwrite d6/d7/d3d/d15/d1f/d22/f24 [0,4194304] 0 2024-04-26T21:26:00.965 INFO:tasks.workunit.client.0.smithi084.stdout:1/471: mkdir d2/d54/d93 0 2024-04-26T21:26:00.965 INFO:tasks.workunit.client.1.smithi120.stdout:6/721: getdents d4/d99/df4 0 2024-04-26T21:26:00.967 INFO:tasks.workunit.client.0.smithi084.stdout:5/507: dread d0/dc/df/d2a/f40 [0,4194304] 0 2024-04-26T21:26:00.969 INFO:tasks.workunit.client.0.smithi084.stdout:9/417: symlink da/de/d16/d55/d93/d95/l9c 0 2024-04-26T21:26:00.970 INFO:tasks.workunit.client.0.smithi084.stdout:5/508: fsync d0/dc/df/d31/d45/f7d 0 2024-04-26T21:26:00.970 INFO:tasks.workunit.client.1.smithi120.stdout:5/761: dwrite d2/d30/d3b/f71 [0,4194304] 0 2024-04-26T21:26:00.973 INFO:tasks.workunit.client.1.smithi120.stdout:1/629: write d6/d9/f1c [8593492,54282] 0 2024-04-26T21:26:00.979 INFO:tasks.workunit.client.0.smithi084.stdout:6/468: mknod d3/de/d15/d5f/c99 0 2024-04-26T21:26:00.979 INFO:tasks.workunit.client.1.smithi120.stdout:6/722: chown d4/db/c9b 0 1 2024-04-26T21:26:00.980 INFO:tasks.workunit.client.1.smithi120.stdout:3/688: mknod dd/de/df/dda/d24/db1/d76/d3b/cde 0 2024-04-26T21:26:00.980 INFO:tasks.workunit.client.1.smithi120.stdout:7/691: mkdir d7/d19/d60/de6/de8 0 2024-04-26T21:26:00.982 INFO:tasks.workunit.client.1.smithi120.stdout:4/652: dwrite d10/d6b/f7d [0,4194304] 0 2024-04-26T21:26:00.985 INFO:tasks.workunit.client.0.smithi084.stdout:6/469: stat d3/de/d1a/d2f/d4c/c64 0 2024-04-26T21:26:00.987 INFO:tasks.workunit.client.0.smithi084.stdout:6/470: chown d3/de/d41/d5c 1306715 1 2024-04-26T21:26:00.988 INFO:tasks.workunit.client.1.smithi120.stdout:0/815: dwrite d0/d3/dc/d12/f6a [0,4194304] 0 2024-04-26T21:26:00.989 INFO:tasks.workunit.client.0.smithi084.stdout:5/509: fdatasync d0/f2 0 2024-04-26T21:26:00.992 INFO:tasks.workunit.client.0.smithi084.stdout:6/471: chown d3/de/d1a/d43/f48 57045 1 2024-04-26T21:26:00.993 INFO:tasks.workunit.client.1.smithi120.stdout:1/630: dread - d6/d7/d2d/f34 zero size 2024-04-26T21:26:00.993 INFO:tasks.workunit.client.1.smithi120.stdout:3/689: write dd/de/df/dda/f22 [3657602,55879] 0 2024-04-26T21:26:00.994 INFO:tasks.workunit.client.1.smithi120.stdout:0/816: chown d0/d3/d51/d70 194 1 2024-04-26T21:26:00.996 INFO:tasks.workunit.client.1.smithi120.stdout:7/692: rename d7/d64/da6/d2f/cb2 to d7/ce9 0 2024-04-26T21:26:00.998 INFO:tasks.workunit.client.1.smithi120.stdout:3/690: read - dd/de/d83/db2/fb3 zero size 2024-04-26T21:26:00.999 INFO:tasks.workunit.client.0.smithi084.stdout:1/472: link d2/d54/d5e/d66/d2a/d2c/f2d d2/d54/d5e/d66/d3a/f94 0 2024-04-26T21:26:01.000 INFO:tasks.workunit.client.0.smithi084.stdout:6/472: chown d3/de/d15/df 60219 1 2024-04-26T21:26:01.001 INFO:tasks.workunit.client.0.smithi084.stdout:9/418: truncate da/fb 485396 0 2024-04-26T21:26:01.001 INFO:tasks.workunit.client.1.smithi120.stdout:5/762: creat d2/dc/d1d/d21/d66/d6a/d8c/f115 x:0 0 0 2024-04-26T21:26:01.004 INFO:tasks.workunit.client.1.smithi120.stdout:1/631: mkdir d6/dcc 0 2024-04-26T21:26:01.005 INFO:tasks.workunit.client.0.smithi084.stdout:3/458: rename d1/d2c/d2f/d31/d8e to d1/d2c/d2f/d94 0 2024-04-26T21:26:01.007 INFO:tasks.workunit.client.1.smithi120.stdout:3/691: rename dd to dd/de/df/dda/d24/d9d/d86/dd3/ddb/ddf 22 2024-04-26T21:26:01.007 INFO:tasks.workunit.client.0.smithi084.stdout:8/479: dread d4/d7/f16 [0,4194304] 0 2024-04-26T21:26:01.008 INFO:tasks.workunit.client.1.smithi120.stdout:7/693: read d7/d64/da6/d1a/d33/fbe [4022122,86033] 0 2024-04-26T21:26:01.013 INFO:tasks.workunit.client.0.smithi084.stdout:5/510: mknod d0/dc/df/d31/d63/d8a/c9d 0 2024-04-26T21:26:01.013 INFO:tasks.workunit.client.0.smithi084.stdout:1/473: creat d2/d54/d5e/d66/d2a/f95 x:0 0 0 2024-04-26T21:26:01.016 INFO:tasks.workunit.client.1.smithi120.stdout:5/763: unlink d2/d30/d93/d107/d34/d100/f10d 0 2024-04-26T21:26:01.018 INFO:tasks.workunit.client.0.smithi084.stdout:9/419: creat da/de/d16/d25/f9d x:0 0 0 2024-04-26T21:26:01.022 INFO:tasks.workunit.client.1.smithi120.stdout:0/817: dwrite d0/df/d79/fec [0,4194304] 0 2024-04-26T21:26:01.023 INFO:tasks.workunit.client.0.smithi084.stdout:8/480: write d4/d6/db/d1e/d22/f72 [470444,103931] 0 2024-04-26T21:26:01.023 INFO:tasks.workunit.client.0.smithi084.stdout:6/473: truncate d3/de/d15/d23/f68 1437452 0 2024-04-26T21:26:01.024 INFO:tasks.workunit.client.0.smithi084.stdout:3/459: symlink d1/d2c/d2f/d31/d52/l95 0 2024-04-26T21:26:01.024 INFO:tasks.workunit.client.0.smithi084.stdout:7/470: dwrite d6/d26/d40/f5b [0,4194304] 0 2024-04-26T21:26:01.024 INFO:tasks.workunit.client.0.smithi084.stdout:8/481: stat d4/f7a 0 2024-04-26T21:26:01.026 INFO:tasks.workunit.client.1.smithi120.stdout:8/667: dread d5/d6/d11/d32/f6e [0,4194304] 0 2024-04-26T21:26:01.027 INFO:tasks.workunit.client.1.smithi120.stdout:2/717: write d4/d1b/f85 [58460,121775] 0 2024-04-26T21:26:01.028 INFO:tasks.workunit.client.0.smithi084.stdout:1/474: creat d2/d19/d63/f96 x:0 0 0 2024-04-26T21:26:01.029 INFO:tasks.workunit.client.0.smithi084.stdout:9/420: fdatasync da/de/d16/f1c 0 2024-04-26T21:26:01.037 INFO:tasks.workunit.client.0.smithi084.stdout:2/588: dwrite d6/d7/d3d/f1e [0,4194304] 0 2024-04-26T21:26:01.038 INFO:tasks.workunit.client.0.smithi084.stdout:9/421: write da/de/d16/f1c [1913528,69021] 0 2024-04-26T21:26:01.039 INFO:tasks.workunit.client.0.smithi084.stdout:7/471: unlink d6/d9/d12/d19/d20/l34 0 2024-04-26T21:26:01.045 INFO:tasks.workunit.client.0.smithi084.stdout:8/482: symlink d4/d7/d15/l88 0 2024-04-26T21:26:01.048 INFO:tasks.workunit.client.1.smithi120.stdout:7/694: link d7/d19/fbc d7/d64/da6/fea 0 2024-04-26T21:26:01.049 INFO:tasks.workunit.client.0.smithi084.stdout:7/472: creat d6/d1c/d51/f9d x:0 0 0 2024-04-26T21:26:01.049 INFO:tasks.workunit.client.0.smithi084.stdout:2/589: creat d6/d7/d3d/d15/d1f/d39/d43/fcb x:0 0 0 2024-04-26T21:26:01.051 INFO:tasks.workunit.client.1.smithi120.stdout:7/695: write d7/d64/da6/d1a/fdf [513115,117963] 0 2024-04-26T21:26:01.053 INFO:tasks.workunit.client.1.smithi120.stdout:8/668: mkdir d5/d6/d34/d37/dd9 0 2024-04-26T21:26:01.057 INFO:tasks.workunit.client.1.smithi120.stdout:7/696: read d7/d64/fb8 [388177,59366] 0 2024-04-26T21:26:01.062 INFO:tasks.workunit.client.1.smithi120.stdout:1/632: write d6/d7/d2d/d98/fe [9101339,32882] 0 2024-04-26T21:26:01.062 INFO:tasks.workunit.client.1.smithi120.stdout:8/669: dread - d5/d6/d34/d42/d9d/d7a/f7c zero size 2024-04-26T21:26:01.064 INFO:tasks.workunit.client.0.smithi084.stdout:7/473: rename d6/d9/c25 to d6/d9/d12/d8b/c9e 0 2024-04-26T21:26:01.065 INFO:tasks.workunit.client.0.smithi084.stdout:9/422: dread da/de/d1e/f29 [0,4194304] 0 2024-04-26T21:26:01.069 INFO:tasks.workunit.client.1.smithi120.stdout:4/653: dread d10/f6a [0,4194304] 0 2024-04-26T21:26:01.069 INFO:tasks.workunit.client.1.smithi120.stdout:1/633: creat d6/d7/d1d/d2c/fcd x:0 0 0 2024-04-26T21:26:01.072 INFO:tasks.workunit.client.1.smithi120.stdout:4/654: dread - d10/d6b/dbf/fc5 zero size 2024-04-26T21:26:01.073 INFO:tasks.workunit.client.1.smithi120.stdout:1/634: chown d6/d7/d2d/d98/d56/l91 25587 1 2024-04-26T21:26:01.075 INFO:tasks.workunit.client.1.smithi120.stdout:1/635: stat d6/d7/d1d/d2c/f2f 0 2024-04-26T21:26:01.076 INFO:tasks.workunit.client.1.smithi120.stdout:7/697: dwrite d7/d64/da6/d2f/fb1 [0,4194304] 0 2024-04-26T21:26:01.076 INFO:tasks.workunit.client.1.smithi120.stdout:5/764: write d2/d30/d3b/f68 [2562307,29560] 0 2024-04-26T21:26:01.076 INFO:tasks.workunit.client.0.smithi084.stdout:9/423: unlink da/fb 0 2024-04-26T21:26:01.078 INFO:tasks.workunit.client.1.smithi120.stdout:0/818: truncate d0/f10 3220970 0 2024-04-26T21:26:01.080 INFO:tasks.workunit.client.1.smithi120.stdout:8/670: mkdir d5/d6/d34/d37/dd9/dda 0 2024-04-26T21:26:01.081 INFO:tasks.workunit.client.1.smithi120.stdout:4/655: rename d10 to d10/dde 22 2024-04-26T21:26:01.083 INFO:tasks.workunit.client.0.smithi084.stdout:9/424: mkdir da/d9e 0 2024-04-26T21:26:01.084 INFO:tasks.workunit.client.0.smithi084.stdout:5/511: dread d0/f64 [0,4194304] 0 2024-04-26T21:26:01.084 INFO:tasks.workunit.client.1.smithi120.stdout:7/698: mkdir d7/d19/d60/deb 0 2024-04-26T21:26:01.085 INFO:tasks.workunit.client.1.smithi120.stdout:5/765: mknod d2/d1b/d89/d47/de4/c116 0 2024-04-26T21:26:01.086 INFO:tasks.workunit.client.1.smithi120.stdout:0/819: fdatasync d0/d3/dc/dd/d1b/d24/d7d/ff9 0 2024-04-26T21:26:01.087 INFO:tasks.workunit.client.1.smithi120.stdout:0/820: chown d0 844891194 1 2024-04-26T21:26:01.087 INFO:tasks.workunit.client.0.smithi084.stdout:7/474: dwrite d6/f4b [4194304,4194304] 0 2024-04-26T21:26:01.090 INFO:tasks.workunit.client.0.smithi084.stdout:6/474: write d3/d18/f38 [1104945,20510] 0 2024-04-26T21:26:01.095 INFO:tasks.workunit.client.1.smithi120.stdout:3/692: dwrite dd/de/df/dda/d24/d9d/d86/dd3/ddb/da9/fc2 [4194304,4194304] 0 2024-04-26T21:26:01.097 INFO:tasks.workunit.client.1.smithi120.stdout:5/766: symlink d2/d82/l117 0 2024-04-26T21:26:01.098 INFO:tasks.workunit.client.1.smithi120.stdout:3/693: fdatasync dd/de/d83/f45 0 2024-04-26T21:26:01.099 INFO:tasks.workunit.client.0.smithi084.stdout:7/475: creat d6/d68/f9f x:0 0 0 2024-04-26T21:26:01.100 INFO:tasks.workunit.client.0.smithi084.stdout:6/475: stat d3/de/d15/f85 0 2024-04-26T21:26:01.102 INFO:tasks.workunit.client.1.smithi120.stdout:0/821: unlink d0/d3/dc/dd/d9b/ca2 0 2024-04-26T21:26:01.102 INFO:tasks.workunit.client.1.smithi120.stdout:7/699: creat d7/d64/da6/d2f/fec x:0 0 0 2024-04-26T21:26:01.103 INFO:tasks.workunit.client.0.smithi084.stdout:9/425: truncate da/de/d16/f1b 989619 0 2024-04-26T21:26:01.104 INFO:tasks.workunit.client.1.smithi120.stdout:5/767: symlink d2/dc/d1d/d21/db2/dde/l118 0 2024-04-26T21:26:01.108 INFO:tasks.workunit.client.1.smithi120.stdout:2/718: write d4/d1b/d5c/fda [3628,22540] 0 2024-04-26T21:26:01.116 INFO:tasks.workunit.client.0.smithi084.stdout:1/475: dwrite d2/d54/d5e/d66/d3a/f94 [0,4194304] 0 2024-04-26T21:26:01.116 INFO:tasks.workunit.client.0.smithi084.stdout:6/476: creat d3/de/d41/f9a x:0 0 0 2024-04-26T21:26:01.119 INFO:tasks.workunit.client.0.smithi084.stdout:3/460: dwrite d1/d24/d27/f53 [0,4194304] 0 2024-04-26T21:26:01.119 INFO:tasks.workunit.client.1.smithi120.stdout:4/656: dread f6 [0,4194304] 0 2024-04-26T21:26:01.120 INFO:tasks.workunit.client.1.smithi120.stdout:5/768: creat d2/d30/d93/d107/d36/d67/f119 x:0 0 0 2024-04-26T21:26:01.123 INFO:tasks.workunit.client.0.smithi084.stdout:6/477: chown d3/de/d1a/d43/f48 712646693 1 2024-04-26T21:26:01.124 INFO:tasks.workunit.client.1.smithi120.stdout:5/769: chown d2/d30/d93/d107/d36/d44/fb4 36053 1 2024-04-26T21:26:01.124 INFO:tasks.workunit.client.1.smithi120.stdout:7/700: mknod d7/d64/da6/d1f/d28/d4c/d6c/ced 0 2024-04-26T21:26:01.125 INFO:tasks.workunit.client.0.smithi084.stdout:7/476: rename d6/d9/d89/d90 to d6/d9/d12/d8b/d72/da0 0 2024-04-26T21:26:01.126 INFO:tasks.workunit.client.1.smithi120.stdout:2/719: dwrite d4/d1b/d2e/d50/f27 [0,4194304] 0 2024-04-26T21:26:01.130 INFO:tasks.workunit.client.0.smithi084.stdout:1/476: chown d2/d9/c46 316 1 2024-04-26T21:26:01.131 INFO:tasks.workunit.client.0.smithi084.stdout:8/483: dwrite d4/d6/db/d1e/d22/f2e [0,4194304] 0 2024-04-26T21:26:01.134 INFO:tasks.workunit.client.1.smithi120.stdout:1/636: truncate d6/d7/d2d/d98/fe 6377142 0 2024-04-26T21:26:01.136 INFO:tasks.workunit.client.0.smithi084.stdout:6/478: mknod d3/de/c9b 0 2024-04-26T21:26:01.137 INFO:tasks.workunit.client.1.smithi120.stdout:8/671: dwrite d5/d6/d11/d52/d27/d4f/d67/f7b [0,4194304] 0 2024-04-26T21:26:01.138 INFO:tasks.workunit.client.0.smithi084.stdout:5/512: dread d0/d17/f1d [0,4194304] 0 2024-04-26T21:26:01.140 INFO:tasks.workunit.client.0.smithi084.stdout:8/484: write d4/d6/db/d1e/d22/d39/f82 [790567,12491] 0 2024-04-26T21:26:01.140 INFO:tasks.workunit.client.0.smithi084.stdout:9/426: dwrite da/f45 [0,4194304] 0 2024-04-26T21:26:01.140 INFO:tasks.workunit.client.0.smithi084.stdout:7/477: unlink d6/d1c/d51/f6c 0 2024-04-26T21:26:01.141 INFO:tasks.workunit.client.1.smithi120.stdout:7/701: creat d7/d64/da6/d1a/d33/d34/fee x:0 0 0 2024-04-26T21:26:01.146 INFO:tasks.workunit.client.1.smithi120.stdout:3/694: write dd/de/df/dda/d24/f54 [1548979,21946] 0 2024-04-26T21:26:01.147 INFO:tasks.workunit.client.0.smithi084.stdout:5/513: write d0/dc/df/d31/d63/d8a/f90 [941537,34321] 0 2024-04-26T21:26:01.147 INFO:tasks.workunit.client.0.smithi084.stdout:1/477: mkdir d2/d97 0 2024-04-26T21:26:01.148 INFO:tasks.workunit.client.1.smithi120.stdout:0/822: write d0/f14 [3319624,34298] 0 2024-04-26T21:26:01.149 INFO:tasks.workunit.client.0.smithi084.stdout:9/427: write da/f37 [63647,69859] 0 2024-04-26T21:26:01.150 INFO:tasks.workunit.client.0.smithi084.stdout:7/478: creat d6/d9/d12/d8b/d72/da0/fa1 x:0 0 0 2024-04-26T21:26:01.151 INFO:tasks.workunit.client.1.smithi120.stdout:1/637: creat d6/d7/d1b/d3b/fce x:0 0 0 2024-04-26T21:26:01.152 INFO:tasks.workunit.client.0.smithi084.stdout:7/479: stat d6/c36 0 2024-04-26T21:26:01.158 INFO:tasks.workunit.client.1.smithi120.stdout:2/720: creat d4/d1b/fee x:0 0 0 2024-04-26T21:26:01.160 INFO:tasks.workunit.client.0.smithi084.stdout:6/479: rename d3/d84 to d3/de/d1a/d43/d75/d9c 0 2024-04-26T21:26:01.162 INFO:tasks.workunit.client.1.smithi120.stdout:4/657: symlink d10/d28/dd9/ddd/ldf 0 2024-04-26T21:26:01.165 INFO:tasks.workunit.client.1.smithi120.stdout:4/658: truncate d10/d6b/da4/fbc 1043514 0 2024-04-26T21:26:01.165 INFO:tasks.workunit.client.0.smithi084.stdout:7/480: readlink d6/d9/d12/d19/d7a/l94 0 2024-04-26T21:26:01.167 INFO:tasks.workunit.client.1.smithi120.stdout:3/695: creat dd/de/df/dda/d24/fe0 x:0 0 0 2024-04-26T21:26:01.167 INFO:tasks.workunit.client.1.smithi120.stdout:4/659: write d10/d28/d73/fdb [758558,92073] 0 2024-04-26T21:26:01.168 INFO:tasks.workunit.client.1.smithi120.stdout:9/636: sync 2024-04-26T21:26:01.168 INFO:tasks.workunit.client.1.smithi120.stdout:1/638: rmdir d6/d7/d1b/d89 39 2024-04-26T21:26:01.168 INFO:tasks.workunit.client.0.smithi084.stdout:3/461: link d1/d2c/d2f/d31/d3b/f41 d1/d2c/d2f/f96 0 2024-04-26T21:26:01.170 INFO:tasks.workunit.client.0.smithi084.stdout:8/485: rename d4/d6/db/d1e/d22/f2e to d4/d7/d15/d37/d3b/f89 0 2024-04-26T21:26:01.172 INFO:tasks.workunit.client.1.smithi120.stdout:9/637: stat d0/d14/d2d/f6c 0 2024-04-26T21:26:01.173 INFO:tasks.workunit.client.0.smithi084.stdout:6/480: write d3/de/d1a/d43/f2d [305605,13375] 0 2024-04-26T21:26:01.173 INFO:tasks.workunit.client.1.smithi120.stdout:4/660: chown d10/d28/f56 13 1 2024-04-26T21:26:01.177 INFO:tasks.workunit.client.1.smithi120.stdout:0/823: rename d0/df/d79/c101 to d0/d3/dc/dd/d80/c111 0 2024-04-26T21:26:01.177 INFO:tasks.workunit.client.1.smithi120.stdout:1/639: write d6/d7/d1d/f50 [7436745,103190] 0 2024-04-26T21:26:01.179 INFO:tasks.workunit.client.1.smithi120.stdout:4/661: truncate d10/d6b/dbf/fc5 981199 0 2024-04-26T21:26:01.180 INFO:tasks.workunit.client.0.smithi084.stdout:9/428: creat da/de/d16/d25/d41/d43/f9f x:0 0 0 2024-04-26T21:26:01.180 INFO:tasks.workunit.client.1.smithi120.stdout:0/824: dread - d0/d3/dc/dd/d80/fe0 zero size 2024-04-26T21:26:01.180 INFO:tasks.workunit.client.0.smithi084.stdout:8/486: mknod d4/d6/db/d1e/d7c/c8a 0 2024-04-26T21:26:01.181 INFO:tasks.workunit.client.0.smithi084.stdout:9/429: chown da/de/d16/l7f 67 1 2024-04-26T21:26:01.182 INFO:tasks.workunit.client.0.smithi084.stdout:8/487: read - d4/d6/db/f6a zero size 2024-04-26T21:26:01.182 INFO:tasks.workunit.client.1.smithi120.stdout:8/672: creat d5/d6/d34/d37/fdb x:0 0 0 2024-04-26T21:26:01.184 INFO:tasks.workunit.client.1.smithi120.stdout:3/696: mknod dd/d40/ce1 0 2024-04-26T21:26:01.184 INFO:tasks.workunit.client.0.smithi084.stdout:1/478: truncate d2/fb 3846098 0 2024-04-26T21:26:01.186 INFO:tasks.workunit.client.0.smithi084.stdout:3/462: creat d1/d24/d27/d3a/d81/f97 x:0 0 0 2024-04-26T21:26:01.187 INFO:tasks.workunit.client.0.smithi084.stdout:1/479: dread - d2/d54/d5e/d66/d2a/f79 zero size 2024-04-26T21:26:01.188 INFO:tasks.workunit.client.0.smithi084.stdout:8/488: unlink d4/d6/db/d1e/d22/d2f/c6b 0 2024-04-26T21:26:01.191 INFO:tasks.workunit.client.0.smithi084.stdout:8/489: write d4/f87 [471510,121030] 0 2024-04-26T21:26:01.192 INFO:tasks.workunit.client.1.smithi120.stdout:9/638: creat d0/d14/d2d/d4b/dbc/fca x:0 0 0 2024-04-26T21:26:01.194 INFO:tasks.workunit.client.0.smithi084.stdout:3/463: mkdir d1/d2c/d2f/d31/d55/d4e/d98 0 2024-04-26T21:26:01.196 INFO:tasks.workunit.client.1.smithi120.stdout:4/662: chown d10/c42 235641 1 2024-04-26T21:26:01.196 INFO:tasks.workunit.client.1.smithi120.stdout:1/640: creat d6/d7/d2d/d48/d86/dc1/fcf x:0 0 0 2024-04-26T21:26:01.200 INFO:tasks.workunit.client.0.smithi084.stdout:1/480: link d2/d1b/c73 d2/c98 0 2024-04-26T21:26:01.202 INFO:tasks.workunit.client.0.smithi084.stdout:8/490: rename d4/d6/db/c38 to d4/d7/d15/d3c/c8b 0 2024-04-26T21:26:01.205 INFO:tasks.workunit.client.0.smithi084.stdout:6/481: write d3/d18/d37/f49 [300700,48674] 0 2024-04-26T21:26:01.209 INFO:tasks.workunit.client.0.smithi084.stdout:8/491: unlink d4/d6/db/d1e/d22/d2f/f21 0 2024-04-26T21:26:01.209 INFO:tasks.workunit.client.1.smithi120.stdout:1/641: readlink d6/d7/d2d/d98/d35/l4c 0 2024-04-26T21:26:01.212 INFO:tasks.workunit.client.0.smithi084.stdout:9/430: truncate da/de/d1e/f47 3434134 0 2024-04-26T21:26:01.212 INFO:tasks.workunit.client.1.smithi120.stdout:4/663: read d10/d28/f3e [281998,22163] 0 2024-04-26T21:26:01.212 INFO:tasks.workunit.client.1.smithi120.stdout:8/673: getdents d5/d6/d75 0 2024-04-26T21:26:01.213 INFO:tasks.workunit.client.0.smithi084.stdout:6/482: creat d3/de/d1a/f9d x:0 0 0 2024-04-26T21:26:01.214 INFO:tasks.workunit.client.0.smithi084.stdout:1/481: dwrite d2/d9/d15/f25 [0,4194304] 0 2024-04-26T21:26:01.215 INFO:tasks.workunit.client.1.smithi120.stdout:9/639: truncate d0/d14/d2d/d4b/d85/fb6 494490 0 2024-04-26T21:26:01.216 INFO:tasks.workunit.client.0.smithi084.stdout:6/483: write d3/de/d1a/f36 [3076525,118244] 0 2024-04-26T21:26:01.216 INFO:tasks.workunit.client.0.smithi084.stdout:1/482: fdatasync d2/d9/d15/d28/d47/f81 0 2024-04-26T21:26:01.217 INFO:tasks.workunit.client.0.smithi084.stdout:8/492: mkdir d4/d3a/d8c 0 2024-04-26T21:26:01.218 INFO:tasks.workunit.client.1.smithi120.stdout:0/825: dwrite d0/d3/dc/d12/f6a [4194304,4194304] 0 2024-04-26T21:26:01.219 INFO:tasks.workunit.client.0.smithi084.stdout:6/484: write d3/de/f63 [886944,37001] 0 2024-04-26T21:26:01.219 INFO:tasks.workunit.client.0.smithi084.stdout:1/483: chown d2/d9/d15/d28/l49 4081467 1 2024-04-26T21:26:01.221 INFO:tasks.workunit.client.0.smithi084.stdout:6/485: fdatasync d3/de/d15/d40/f6e 0 2024-04-26T21:26:01.223 INFO:tasks.workunit.client.1.smithi120.stdout:4/664: creat d10/fe0 x:0 0 0 2024-04-26T21:26:01.224 INFO:tasks.workunit.client.1.smithi120.stdout:7/702: dwrite d7/d64/da6/d1f/d28/f3d [0,4194304] 0 2024-04-26T21:26:01.224 INFO:tasks.workunit.client.0.smithi084.stdout:3/464: write d1/d2c/d2f/f18 [7749261,108127] 0 2024-04-26T21:26:01.225 INFO:tasks.workunit.client.1.smithi120.stdout:5/770: dread d2/dc/d1d/d21/d66/fa2 [0,4194304] 0 2024-04-26T21:26:01.226 INFO:tasks.workunit.client.0.smithi084.stdout:3/465: readlink d1/d2c/l79 0 2024-04-26T21:26:01.228 INFO:tasks.workunit.client.0.smithi084.stdout:8/493: write d4/d7/d15/d37/d3b/f89 [2389954,130702] 0 2024-04-26T21:26:01.229 INFO:tasks.workunit.client.1.smithi120.stdout:3/697: dwrite dd/d2a/d74/fab [0,4194304] 0 2024-04-26T21:26:01.236 INFO:tasks.workunit.client.1.smithi120.stdout:8/674: dread - d5/d6/d11/d32/d3b/f73 zero size 2024-04-26T21:26:01.236 INFO:tasks.workunit.client.1.smithi120.stdout:0/826: stat d0/d3/dc/dd/ld3 0 2024-04-26T21:26:01.236 INFO:tasks.workunit.client.1.smithi120.stdout:1/642: rename d6/d9/c37 to d6/d7/d2d/d98/d35/cd0 0 2024-04-26T21:26:01.236 INFO:tasks.workunit.client.0.smithi084.stdout:1/484: symlink d2/d9/d15/d28/d47/l99 0 2024-04-26T21:26:01.238 INFO:tasks.workunit.client.1.smithi120.stdout:7/703: stat d7/d64/da6/d1f/d28/d4c/d6c/d74 0 2024-04-26T21:26:01.238 INFO:tasks.workunit.client.0.smithi084.stdout:9/431: truncate da/de/d16/d40/f78 83727 0 2024-04-26T21:26:01.239 INFO:tasks.workunit.client.1.smithi120.stdout:9/640: fdatasync d0/dd/f7e 0 2024-04-26T21:26:01.241 INFO:tasks.workunit.client.0.smithi084.stdout:9/432: dread - da/de/d16/d25/d41/f91 zero size 2024-04-26T21:26:01.242 INFO:tasks.workunit.client.1.smithi120.stdout:6/723: sync 2024-04-26T21:26:01.242 INFO:tasks.workunit.client.1.smithi120.stdout:7/704: dread - d7/d10/d97/fd3 zero size 2024-04-26T21:26:01.244 INFO:tasks.workunit.client.0.smithi084.stdout:3/466: creat d1/d24/d27/f99 x:0 0 0 2024-04-26T21:26:01.249 INFO:tasks.workunit.client.1.smithi120.stdout:4/665: dread d10/d65/d8c/dd0/dd4/d86/f9a [0,4194304] 0 2024-04-26T21:26:01.249 INFO:tasks.workunit.client.1.smithi120.stdout:1/643: write d6/d9/fc0 [713445,93247] 0 2024-04-26T21:26:01.249 INFO:tasks.workunit.client.1.smithi120.stdout:3/698: symlink dd/d2a/le2 0 2024-04-26T21:26:01.249 INFO:tasks.workunit.client.1.smithi120.stdout:2/721: dread d4/fdc [0,4194304] 0 2024-04-26T21:26:01.249 INFO:tasks.workunit.client.0.smithi084.stdout:1/485: rmdir d2/d54/d5e/d66/d2a/d2c/d75 39 2024-04-26T21:26:01.252 INFO:tasks.workunit.client.1.smithi120.stdout:1/644: write d6/d7/ff [1132597,87450] 0 2024-04-26T21:26:01.254 INFO:tasks.workunit.client.1.smithi120.stdout:2/722: fdatasync d4/f64 0 2024-04-26T21:26:01.254 INFO:tasks.workunit.client.1.smithi120.stdout:0/827: creat d0/d3/d51/d97/d108/d81/dba/f112 x:0 0 0 2024-04-26T21:26:01.256 INFO:tasks.workunit.client.1.smithi120.stdout:5/771: readlink d2/dc/d1d/d21/d77/d9c/lff 0 2024-04-26T21:26:01.256 INFO:tasks.workunit.client.1.smithi120.stdout:7/705: creat d7/d10/d97/fef x:0 0 0 2024-04-26T21:26:01.260 INFO:tasks.workunit.client.1.smithi120.stdout:9/641: symlink d0/dd/d3a/dae/lcb 0 2024-04-26T21:26:01.261 INFO:tasks.workunit.client.0.smithi084.stdout:1/486: creat d2/d54/d5e/f9a x:0 0 0 2024-04-26T21:26:01.262 INFO:tasks.workunit.client.1.smithi120.stdout:4/666: creat d10/d6b/d71/dd7/fe1 x:0 0 0 2024-04-26T21:26:01.263 INFO:tasks.workunit.client.0.smithi084.stdout:8/494: creat d4/d6/f8d x:0 0 0 2024-04-26T21:26:01.263 INFO:tasks.workunit.client.1.smithi120.stdout:2/723: write d4/d1b/f85 [666174,10303] 0 2024-04-26T21:26:01.263 INFO:tasks.workunit.client.1.smithi120.stdout:6/724: read - d4/db/d10/dd/d43/d58/ff0 zero size 2024-04-26T21:26:01.264 INFO:tasks.workunit.client.0.smithi084.stdout:6/486: dread d3/de/d15/d23/f35 [0,4194304] 0 2024-04-26T21:26:01.265 INFO:tasks.workunit.client.1.smithi120.stdout:7/706: fsync d7/d64/da6/fea 0 2024-04-26T21:26:01.266 INFO:tasks.workunit.client.0.smithi084.stdout:8/495: write d4/d7/d15/f30 [7137474,99708] 0 2024-04-26T21:26:01.267 INFO:tasks.workunit.client.0.smithi084.stdout:9/433: getdents da/de/d16 0 2024-04-26T21:26:01.268 INFO:tasks.workunit.client.0.smithi084.stdout:6/487: write d3/de/d41/f9a [633443,6246] 0 2024-04-26T21:26:01.270 INFO:tasks.workunit.client.0.smithi084.stdout:8/496: dread - d4/d6/db/f6a zero size 2024-04-26T21:26:01.270 INFO:tasks.workunit.client.0.smithi084.stdout:9/434: fdatasync da/de/d16/d40/f64 0 2024-04-26T21:26:01.271 INFO:tasks.workunit.client.1.smithi120.stdout:5/772: rename d2/d1b/fed to d2/d1b/d89/d47/f11a 0 2024-04-26T21:26:01.272 INFO:tasks.workunit.client.0.smithi084.stdout:9/435: fdatasync da/de/d16/f1c 0 2024-04-26T21:26:01.273 INFO:tasks.workunit.client.0.smithi084.stdout:6/488: mkdir d3/de/d9e 0 2024-04-26T21:26:01.274 INFO:tasks.workunit.client.1.smithi120.stdout:9/642: creat d0/d14/d77/fcc x:0 0 0 2024-04-26T21:26:01.275 INFO:tasks.workunit.client.1.smithi120.stdout:7/707: fsync d7/d64/fb8 0 2024-04-26T21:26:01.277 INFO:tasks.workunit.client.1.smithi120.stdout:6/725: truncate d4/db/f5a 604296 0 2024-04-26T21:26:01.279 INFO:tasks.workunit.client.0.smithi084.stdout:1/487: dwrite d2/d54/d5e/d66/f18 [0,4194304] 0 2024-04-26T21:26:01.281 INFO:tasks.workunit.client.1.smithi120.stdout:8/675: dwrite d5/d6/d11/d52/d27/f38 [4194304,4194304] 0 2024-04-26T21:26:01.282 INFO:tasks.workunit.client.1.smithi120.stdout:5/773: mknod d2/dc/d1d/d21/d77/d79/db7/c11b 0 2024-04-26T21:26:01.282 INFO:tasks.workunit.client.0.smithi084.stdout:1/488: read - d2/d54/d5e/d66/d2a/f79 zero size 2024-04-26T21:26:01.286 INFO:tasks.workunit.client.1.smithi120.stdout:7/708: readlink d7/d64/da6/d1f/d28/d4c/d6b/d7b/l8d 0 2024-04-26T21:26:01.287 INFO:tasks.workunit.client.1.smithi120.stdout:6/726: unlink d4/la9 0 2024-04-26T21:26:01.289 INFO:tasks.workunit.client.1.smithi120.stdout:9/643: write d0/d6/f36 [2931569,103966] 0 2024-04-26T21:26:01.291 INFO:tasks.workunit.client.0.smithi084.stdout:9/436: creat da/de/d16/d55/d93/d95/fa0 x:0 0 0 2024-04-26T21:26:01.292 INFO:tasks.workunit.client.1.smithi120.stdout:0/828: getdents d0/d3/d51/d97/d108/d81/dba 0 2024-04-26T21:26:01.294 INFO:tasks.workunit.client.1.smithi120.stdout:7/709: readlink d7/d19/l47 0 2024-04-26T21:26:01.297 INFO:tasks.workunit.client.0.smithi084.stdout:6/489: dread d3/d18/d81/f86 [0,4194304] 0 2024-04-26T21:26:01.298 INFO:tasks.workunit.client.0.smithi084.stdout:1/489: write d2/d54/d5e/d66/d2a/d2c/d45/f68 [109231,84580] 0 2024-04-26T21:26:01.300 INFO:tasks.workunit.client.1.smithi120.stdout:2/724: write d4/d1b/d2e/d50/f3f [4263080,20269] 0 2024-04-26T21:26:01.303 INFO:tasks.workunit.client.1.smithi120.stdout:5/774: creat d2/d82/d96/f11c x:0 0 0 2024-04-26T21:26:01.303 INFO:tasks.workunit.client.1.smithi120.stdout:0/829: dread - d0/d3/d51/d97/d108/d81/dba/f112 zero size 2024-04-26T21:26:01.304 INFO:tasks.workunit.client.1.smithi120.stdout:4/667: dwrite d10/d12/da1/fc3 [0,4194304] 0 2024-04-26T21:26:01.307 INFO:tasks.workunit.client.1.smithi120.stdout:6/727: mknod d4/d3d/dd9/cf5 0 2024-04-26T21:26:01.307 INFO:tasks.workunit.client.0.smithi084.stdout:6/490: symlink d3/de/d41/l9f 0 2024-04-26T21:26:01.307 INFO:tasks.workunit.client.1.smithi120.stdout:8/676: truncate d5/d6/d11/d52/d70/f22 2265947 0 2024-04-26T21:26:01.308 INFO:tasks.workunit.client.0.smithi084.stdout:1/490: creat d2/d9/d15/d28/d47/f9b x:0 0 0 2024-04-26T21:26:01.311 INFO:tasks.workunit.client.1.smithi120.stdout:0/830: chown d0/dd1/dd2/de9 4281564 1 2024-04-26T21:26:01.311 INFO:tasks.workunit.client.1.smithi120.stdout:9/644: rename d0/d6/l1a to d0/d14/d2d/d4b/d85/lcd 0 2024-04-26T21:26:01.312 INFO:tasks.workunit.client.0.smithi084.stdout:9/437: link da/de/d16/d25/d41/d8d/f99 da/de/d16/d55/d93/d95/fa1 0 2024-04-26T21:26:01.312 INFO:tasks.workunit.client.0.smithi084.stdout:8/497: write d4/d7/f16 [1573389,94454] 0 2024-04-26T21:26:01.313 INFO:tasks.workunit.client.0.smithi084.stdout:6/491: mkdir d3/de/d1a/d2f/d4c/da0 0 2024-04-26T21:26:01.315 INFO:tasks.workunit.client.0.smithi084.stdout:1/491: mknod d2/d19/d63/c9c 0 2024-04-26T21:26:01.316 INFO:tasks.workunit.client.0.smithi084.stdout:1/492: fsync d2/d9/d15/f25 0 2024-04-26T21:26:01.318 INFO:tasks.workunit.client.0.smithi084.stdout:8/498: creat d4/d6/db/d1e/f8e x:0 0 0 2024-04-26T21:26:01.319 INFO:tasks.workunit.client.1.smithi120.stdout:4/668: mkdir d10/d28/d73/de2 0 2024-04-26T21:26:01.321 INFO:tasks.workunit.client.1.smithi120.stdout:9/645: mkdir d0/d6/d4d/dce 0 2024-04-26T21:26:01.323 INFO:tasks.workunit.client.1.smithi120.stdout:2/725: rename d4/d1b/d2e/l6b to d4/d1b/d2e/d50/d14/dc2/lef 0 2024-04-26T21:26:01.323 INFO:tasks.workunit.client.0.smithi084.stdout:1/493: mkdir d2/d9/d15/d28/d69/d9d 0 2024-04-26T21:26:01.323 INFO:tasks.workunit.client.1.smithi120.stdout:0/831: fdatasync d0/d3/dc/f27 0 2024-04-26T21:26:01.324 INFO:tasks.workunit.client.0.smithi084.stdout:8/499: creat d4/d6/db/d1e/d22/d39/d4a/f8f x:0 0 0 2024-04-26T21:26:01.327 INFO:tasks.workunit.client.1.smithi120.stdout:8/677: truncate d5/d6/f25 1879947 0 2024-04-26T21:26:01.327 INFO:tasks.workunit.client.1.smithi120.stdout:5/775: link d2/dc/d1d/d21/d66/f102 d2/d1b/d89/d47/d8a/f11d 0 2024-04-26T21:26:01.327 INFO:tasks.workunit.client.1.smithi120.stdout:7/710: getdents d7/d64/da6/d1f/d28/dbb 0 2024-04-26T21:26:01.328 INFO:tasks.workunit.client.0.smithi084.stdout:6/492: creat d3/fa1 x:0 0 0 2024-04-26T21:26:01.330 INFO:tasks.workunit.client.0.smithi084.stdout:2/590: sync 2024-04-26T21:26:01.330 INFO:tasks.workunit.client.0.smithi084.stdout:0/477: sync 2024-04-26T21:26:01.331 INFO:tasks.workunit.client.0.smithi084.stdout:4/413: sync 2024-04-26T21:26:01.331 INFO:tasks.workunit.client.1.smithi120.stdout:1/645: dread d6/d7/d1d/f9b [0,4194304] 0 2024-04-26T21:26:01.331 INFO:tasks.workunit.client.1.smithi120.stdout:0/832: mkdir d0/d3/dc/dd/d1b/dfb/d113 0 2024-04-26T21:26:01.331 INFO:tasks.workunit.client.1.smithi120.stdout:4/669: dread d10/d12/f3c [0,4194304] 0 2024-04-26T21:26:01.333 INFO:tasks.workunit.client.0.smithi084.stdout:8/500: rmdir d4/d6/db/d1e/d22/d2f 39 2024-04-26T21:26:01.334 INFO:tasks.workunit.client.0.smithi084.stdout:4/414: fdatasync d5/d2e/d5f/d32/d46/f5c 0 2024-04-26T21:26:01.335 INFO:tasks.workunit.client.0.smithi084.stdout:0/478: write de/d2b/d77/f4a [4351541,31112] 0 2024-04-26T21:26:01.336 INFO:tasks.workunit.client.1.smithi120.stdout:2/726: dread d4/d1b/f85 [0,4194304] 0 2024-04-26T21:26:01.336 INFO:tasks.workunit.client.1.smithi120.stdout:5/776: stat d2/dc/d1d/d21/d66/d6a/d8c/fa6 0 2024-04-26T21:26:01.336 INFO:tasks.workunit.client.0.smithi084.stdout:1/494: symlink d2/d54/d5e/d8d/l9e 0 2024-04-26T21:26:01.338 INFO:tasks.workunit.client.1.smithi120.stdout:8/678: dread d5/d6/d11/fbd [0,4194304] 0 2024-04-26T21:26:01.340 INFO:tasks.workunit.client.1.smithi120.stdout:0/833: creat d0/d3/d51/d97/d108/d5a/f114 x:0 0 0 2024-04-26T21:26:01.340 INFO:tasks.workunit.client.1.smithi120.stdout:6/728: write d4/db/d10/dd/d28/f78 [610394,26018] 0 2024-04-26T21:26:01.342 INFO:tasks.workunit.client.1.smithi120.stdout:8/679: dread d5/d6/d34/d42/fba [0,4194304] 0 2024-04-26T21:26:01.344 INFO:tasks.workunit.client.1.smithi120.stdout:9/646: dread d0/f54 [0,4194304] 0 2024-04-26T21:26:01.344 INFO:tasks.workunit.client.1.smithi120.stdout:5/777: readlink d2/d10e/l90 0 2024-04-26T21:26:01.345 INFO:tasks.workunit.client.0.smithi084.stdout:9/438: fsync da/de/d16/d25/d41/d8d/f99 0 2024-04-26T21:26:01.345 INFO:tasks.workunit.client.1.smithi120.stdout:7/711: dread f3 [0,4194304] 0 2024-04-26T21:26:01.347 INFO:tasks.workunit.client.0.smithi084.stdout:6/493: dread d3/de/d15/d23/f2a [0,4194304] 0 2024-04-26T21:26:01.347 INFO:tasks.workunit.client.1.smithi120.stdout:3/699: dread dd/de/df/dda/f4b [0,4194304] 0 2024-04-26T21:26:01.348 INFO:tasks.workunit.client.1.smithi120.stdout:6/729: fsync d4/db/d10/d1a/d2b/d57/d67/f2e 0 2024-04-26T21:26:01.348 INFO:tasks.workunit.client.1.smithi120.stdout:0/834: rmdir d0/d3/dc/d12 39 2024-04-26T21:26:01.348 INFO:tasks.workunit.client.1.smithi120.stdout:2/727: symlink d4/d1b/d56/d65/d8d/lf0 0 2024-04-26T21:26:01.350 INFO:tasks.workunit.client.1.smithi120.stdout:2/728: fsync d4/f64 0 2024-04-26T21:26:01.352 INFO:tasks.workunit.client.1.smithi120.stdout:7/712: chown d7/d64/da6/f7a 174 1 2024-04-26T21:26:01.353 INFO:tasks.workunit.client.0.smithi084.stdout:2/591: creat d6/d7/d3d/d15/d1f/d39/da5/fcc x:0 0 0 2024-04-26T21:26:01.354 INFO:tasks.workunit.client.1.smithi120.stdout:2/729: truncate d4/d1b/d56/fb5 167974 0 2024-04-26T21:26:01.354 INFO:tasks.workunit.client.0.smithi084.stdout:1/495: mkdir d2/d9/d15/d9f 0 2024-04-26T21:26:01.355 INFO:tasks.workunit.client.1.smithi120.stdout:9/647: creat d0/d6/d4d/fcf x:0 0 0 2024-04-26T21:26:01.356 INFO:tasks.workunit.client.0.smithi084.stdout:9/439: symlink da/de/d16/d25/d41/d8d/la2 0 2024-04-26T21:26:01.357 INFO:tasks.workunit.client.0.smithi084.stdout:1/496: dread - d2/f92 zero size 2024-04-26T21:26:01.359 INFO:tasks.workunit.client.0.smithi084.stdout:2/592: write d6/d7/d3d/d15/d1f/d39/d43/fab [1547670,75504] 0 2024-04-26T21:26:01.360 INFO:tasks.workunit.client.1.smithi120.stdout:1/646: getdents d6/d7/d1d/d5d 0 2024-04-26T21:26:01.361 INFO:tasks.workunit.client.0.smithi084.stdout:2/593: stat d6/d7/d68/f71 0 2024-04-26T21:26:01.361 INFO:tasks.workunit.client.0.smithi084.stdout:6/494: mkdir d3/de/d15/d23/d90/da2 0 2024-04-26T21:26:01.364 INFO:tasks.workunit.client.1.smithi120.stdout:6/730: read d4/db/d25/d6d/f84 [2429180,43248] 0 2024-04-26T21:26:01.364 INFO:tasks.workunit.client.1.smithi120.stdout:5/778: mkdir d2/dc/d1d/d21/d66/d11e 0 2024-04-26T21:26:01.365 INFO:tasks.workunit.client.0.smithi084.stdout:8/501: dwrite d4/d6/db/f6a [0,4194304] 0 2024-04-26T21:26:01.368 INFO:tasks.workunit.client.1.smithi120.stdout:2/730: dread d4/d1b/d2e/d50/d14/d15/d6c/fb3 [0,4194304] 0 2024-04-26T21:26:01.369 INFO:tasks.workunit.client.0.smithi084.stdout:1/497: fsync d2/d19/f4c 0 2024-04-26T21:26:01.371 INFO:tasks.workunit.client.1.smithi120.stdout:7/713: creat d7/d64/da6/d1f/d7d/d8b/d94/ff0 x:0 0 0 2024-04-26T21:26:01.372 INFO:tasks.workunit.client.1.smithi120.stdout:5/779: mkdir d2/d82/d11f 0 2024-04-26T21:26:01.372 INFO:tasks.workunit.client.1.smithi120.stdout:2/731: write d4/d1b/d25/d2c/d3e/ddb/fc1 [3489075,78236] 0 2024-04-26T21:26:01.373 INFO:tasks.workunit.client.1.smithi120.stdout:6/731: dread - d4/db/d25/d6d/d97/f7f zero size 2024-04-26T21:26:01.375 INFO:tasks.workunit.client.1.smithi120.stdout:1/647: getdents d6/d7/d2d/d98/d56/dad 0 2024-04-26T21:26:01.376 INFO:tasks.workunit.client.1.smithi120.stdout:2/732: readlink d4/l5 0 2024-04-26T21:26:01.376 INFO:tasks.workunit.client.0.smithi084.stdout:1/498: mkdir d2/d9/d15/d28/da0 0 2024-04-26T21:26:01.378 INFO:tasks.workunit.client.1.smithi120.stdout:4/670: dwrite d10/d12/f1d [0,4194304] 0 2024-04-26T21:26:01.378 INFO:tasks.workunit.client.1.smithi120.stdout:3/700: getdents dd/de/df/dda 0 2024-04-26T21:26:01.380 INFO:tasks.workunit.client.0.smithi084.stdout:1/499: chown d2/d54/d5e/d66/c6b 353101055 1 2024-04-26T21:26:01.381 INFO:tasks.workunit.client.1.smithi120.stdout:5/780: dread - d2/d30/d93/d107/d36/d44/fd4 zero size 2024-04-26T21:26:01.381 INFO:tasks.workunit.client.1.smithi120.stdout:4/671: read d10/d28/f56 [449073,108300] 0 2024-04-26T21:26:01.382 INFO:tasks.workunit.client.1.smithi120.stdout:4/672: fsync d10/d6b/d71/dd7/fe1 0 2024-04-26T21:26:01.383 INFO:tasks.workunit.client.1.smithi120.stdout:0/835: getdents d0/d3/dc/d12/dae 0 2024-04-26T21:26:01.384 INFO:tasks.workunit.client.1.smithi120.stdout:5/781: write d2/d82/d96/f11c [880080,21059] 0 2024-04-26T21:26:01.386 INFO:tasks.workunit.client.0.smithi084.stdout:1/500: stat d2/d9/d15/d28/f62 0 2024-04-26T21:26:01.388 INFO:tasks.workunit.client.1.smithi120.stdout:4/673: fsync d10/d65/d8c/dd0/dd4/d86/fc2 0 2024-04-26T21:26:01.388 INFO:tasks.workunit.client.1.smithi120.stdout:4/674: dread - d10/d6b/f79 zero size 2024-04-26T21:26:01.390 INFO:tasks.workunit.client.0.smithi084.stdout:2/594: rename d6/d7/d3d/d15/d1f/d39/d20/d45/f61 to d6/d7/d3d/d15/d1f/d22/d2a/fcd 0 2024-04-26T21:26:01.392 INFO:tasks.workunit.client.0.smithi084.stdout:4/415: dwrite d5/d2e/d5f/d32/f34 [0,4194304] 0 2024-04-26T21:26:01.393 INFO:tasks.workunit.client.1.smithi120.stdout:0/836: mknod d0/d3/d51/d95/c115 0 2024-04-26T21:26:01.393 INFO:tasks.workunit.client.1.smithi120.stdout:7/714: link d7/d64/da6/d1f/l40 d7/d19/d60/lf1 0 2024-04-26T21:26:01.396 INFO:tasks.workunit.client.0.smithi084.stdout:2/595: write d6/d7/fa1 [407600,98598] 0 2024-04-26T21:26:01.397 INFO:tasks.workunit.client.1.smithi120.stdout:4/675: symlink d10/d6b/d71/dd7/le3 0 2024-04-26T21:26:01.399 INFO:tasks.workunit.client.1.smithi120.stdout:9/648: write d0/dd/d3a/d5c/f67 [2938751,48805] 0 2024-04-26T21:26:01.400 INFO:tasks.workunit.client.0.smithi084.stdout:0/479: dread de/d2b/f43 [0,4194304] 0 2024-04-26T21:26:01.400 INFO:tasks.workunit.client.1.smithi120.stdout:2/733: getdents d4/d1b/d2e/d50/d14 0 2024-04-26T21:26:01.400 INFO:tasks.workunit.client.1.smithi120.stdout:8/680: truncate d5/d6/d34/d42/d4a/f99 297042 0 2024-04-26T21:26:01.402 INFO:tasks.workunit.client.0.smithi084.stdout:8/502: dwrite d4/d6/db/d1e/d22/f72 [0,4194304] 0 2024-04-26T21:26:01.402 INFO:tasks.workunit.client.0.smithi084.stdout:2/596: dread - d6/d7/d3d/fac zero size 2024-04-26T21:26:01.403 INFO:tasks.workunit.client.1.smithi120.stdout:9/649: chown d0/dd/d3a/f58 11786474 1 2024-04-26T21:26:01.404 INFO:tasks.workunit.client.1.smithi120.stdout:2/734: readlink d4/d1b/d2e/d50/d14/d15/ldd 0 2024-04-26T21:26:01.405 INFO:tasks.workunit.client.1.smithi120.stdout:1/648: rename d6/d7/d2d/d98/l4b to d6/d7/d1b/ld1 0 2024-04-26T21:26:01.410 INFO:tasks.workunit.client.1.smithi120.stdout:4/676: chown d10/d12/f3a 14068 1 2024-04-26T21:26:01.410 INFO:tasks.workunit.client.1.smithi120.stdout:6/732: dwrite d4/db/d25/d6d/f77 [0,4194304] 0 2024-04-26T21:26:01.410 INFO:tasks.workunit.client.1.smithi120.stdout:8/681: rmdir d5/d6/d34/d37/d94 39 2024-04-26T21:26:01.412 INFO:tasks.workunit.client.1.smithi120.stdout:4/677: dread - d10/d6b/f6e zero size 2024-04-26T21:26:01.414 INFO:tasks.workunit.client.0.smithi084.stdout:0/480: mkdir de/d2b/d64/d81/d9a 0 2024-04-26T21:26:01.415 INFO:tasks.workunit.client.1.smithi120.stdout:2/735: creat d4/d1b/d5c/da6/ff1 x:0 0 0 2024-04-26T21:26:01.416 INFO:tasks.workunit.client.0.smithi084.stdout:1/501: dwrite d2/d54/d5e/d66/d2a/d2c/f34 [0,4194304] 0 2024-04-26T21:26:01.417 INFO:tasks.workunit.client.1.smithi120.stdout:9/650: truncate d0/d6/d3d/f75 4931390 0 2024-04-26T21:26:01.418 INFO:tasks.workunit.client.0.smithi084.stdout:4/416: creat d5/d2e/f88 x:0 0 0 2024-04-26T21:26:01.421 INFO:tasks.workunit.client.1.smithi120.stdout:8/682: mkdir d5/d6/d34/d37/db8/ddc 0 2024-04-26T21:26:01.422 INFO:tasks.workunit.client.0.smithi084.stdout:0/481: symlink de/d2b/l9b 0 2024-04-26T21:26:01.423 INFO:tasks.workunit.client.1.smithi120.stdout:0/837: dwrite d0/d3/dc/f2a [0,4194304] 0 2024-04-26T21:26:01.426 INFO:tasks.workunit.client.1.smithi120.stdout:4/678: mknod d10/d65/ce4 0 2024-04-26T21:26:01.430 INFO:tasks.workunit.client.1.smithi120.stdout:2/736: creat d4/d1b/d2e/d50/d14/ff2 x:0 0 0 2024-04-26T21:26:01.430 INFO:tasks.workunit.client.1.smithi120.stdout:9/651: symlink d0/ld0 0 2024-04-26T21:26:01.435 INFO:tasks.workunit.client.0.smithi084.stdout:2/597: dwrite d6/d7/d68/f71 [0,4194304] 0 2024-04-26T21:26:01.435 INFO:tasks.workunit.client.1.smithi120.stdout:6/733: unlink d4/db/d10/d1a/d2b/d57/d67/f59 0 2024-04-26T21:26:01.435 INFO:tasks.workunit.client.1.smithi120.stdout:3/701: dwrite dd/de/d83/d64/f84 [0,4194304] 0 2024-04-26T21:26:01.436 INFO:tasks.workunit.client.0.smithi084.stdout:8/503: dwrite d4/d7/d15/d37/f68 [0,4194304] 0 2024-04-26T21:26:01.437 INFO:tasks.workunit.client.1.smithi120.stdout:7/715: dwrite d7/d64/da6/d2f/fb1 [0,4194304] 0 2024-04-26T21:26:01.439 INFO:tasks.workunit.client.1.smithi120.stdout:8/683: mknod d5/d6/d75/d95/cdd 0 2024-04-26T21:26:01.440 INFO:tasks.workunit.client.1.smithi120.stdout:0/838: creat d0/d3/dc/dd/d1b/d24/d73/db7/f116 x:0 0 0 2024-04-26T21:26:01.441 INFO:tasks.workunit.client.0.smithi084.stdout:2/598: chown d6/d3e/lad 15619671 1 2024-04-26T21:26:01.442 INFO:tasks.workunit.client.1.smithi120.stdout:6/734: read - d4/db/d10/ddb/fe5 zero size 2024-04-26T21:26:01.443 INFO:tasks.workunit.client.1.smithi120.stdout:9/652: chown d0/d6/d3d/f4e 29 1 2024-04-26T21:26:01.448 INFO:tasks.workunit.client.1.smithi120.stdout:1/649: dread d6/d9/f84 [0,4194304] 0 2024-04-26T21:26:01.451 INFO:tasks.workunit.client.1.smithi120.stdout:8/684: symlink d5/d6/d34/da7/lde 0 2024-04-26T21:26:01.452 INFO:tasks.workunit.client.0.smithi084.stdout:4/417: fsync d5/d2e/f88 0 2024-04-26T21:26:01.453 INFO:tasks.workunit.client.1.smithi120.stdout:8/685: readlink d5/l5d 0 2024-04-26T21:26:01.456 INFO:tasks.workunit.client.0.smithi084.stdout:8/504: link d4/d6/f40 d4/d7/d15/d3c/f90 0 2024-04-26T21:26:01.456 INFO:tasks.workunit.client.0.smithi084.stdout:2/599: chown d6/d7/d3d/d15/d1f/d39/d43/fcb 11510 1 2024-04-26T21:26:01.457 INFO:tasks.workunit.client.0.smithi084.stdout:0/482: dwrite f0 [4194304,4194304] 0 2024-04-26T21:26:01.458 INFO:tasks.workunit.client.1.smithi120.stdout:4/679: dwrite d10/d12/fdc [0,4194304] 0 2024-04-26T21:26:01.459 INFO:tasks.workunit.client.1.smithi120.stdout:2/737: creat d4/d1b/d2e/ff3 x:0 0 0 2024-04-26T21:26:01.461 INFO:tasks.workunit.client.1.smithi120.stdout:4/680: read - d10/d28/d73/fbd zero size 2024-04-26T21:26:01.463 INFO:tasks.workunit.client.1.smithi120.stdout:4/681: write d10/f26 [3396677,24428] 0 2024-04-26T21:26:01.466 INFO:tasks.workunit.client.1.smithi120.stdout:4/682: write d10/d12/da1/fc3 [1197027,78302] 0 2024-04-26T21:26:01.468 INFO:tasks.workunit.client.0.smithi084.stdout:4/418: creat d5/d7/d65/d7f/d6a/f89 x:0 0 0 2024-04-26T21:26:01.470 INFO:tasks.workunit.client.0.smithi084.stdout:8/505: rmdir d4/d3a 39 2024-04-26T21:26:01.471 INFO:tasks.workunit.client.1.smithi120.stdout:0/839: dread d0/dd1/fda [0,4194304] 0 2024-04-26T21:26:01.473 INFO:tasks.workunit.client.1.smithi120.stdout:3/702: symlink dd/de/df/dda/d24/d9d/d86/dd3/ddb/da9/le3 0 2024-04-26T21:26:01.475 INFO:tasks.workunit.client.0.smithi084.stdout:2/600: rename d6/d3e/lad to d6/d7/d3d/d15/d1f/d39/d43/lce 0 2024-04-26T21:26:01.475 INFO:tasks.workunit.client.0.smithi084.stdout:6/495: dwrite d3/de/d1a/d43/d72/f94 [0,4194304] 0 2024-04-26T21:26:01.480 INFO:tasks.workunit.client.0.smithi084.stdout:8/506: write d4/d6/db/d1e/f45 [1061714,121982] 0 2024-04-26T21:26:01.487 INFO:tasks.workunit.client.1.smithi120.stdout:2/738: creat d4/d1b/d4f/d95/de9/ff4 x:0 0 0 2024-04-26T21:26:01.488 INFO:tasks.workunit.client.0.smithi084.stdout:8/507: chown d4/d7/d15/d37/f68 4084267 1 2024-04-26T21:26:01.489 INFO:tasks.workunit.client.1.smithi120.stdout:6/735: link d4/db/ced d4/db/d25/cf6 0 2024-04-26T21:26:01.492 INFO:tasks.workunit.client.0.smithi084.stdout:4/419: creat d5/d2e/d5f/f8a x:0 0 0 2024-04-26T21:26:01.493 INFO:tasks.workunit.client.1.smithi120.stdout:0/840: dwrite d0/d3/dc/dd/f7b [4194304,4194304] 0 2024-04-26T21:26:01.494 INFO:tasks.workunit.client.1.smithi120.stdout:4/683: unlink d10/d28/l34 0 2024-04-26T21:26:01.496 INFO:tasks.workunit.client.1.smithi120.stdout:1/650: creat d6/dcc/fd2 x:0 0 0 2024-04-26T21:26:01.500 INFO:tasks.workunit.client.0.smithi084.stdout:4/420: chown d5/d2e/d5f/d32/c6e 90051257 1 2024-04-26T21:26:01.504 INFO:tasks.workunit.client.1.smithi120.stdout:7/716: getdents d7/d19/d60 0 2024-04-26T21:26:01.507 INFO:tasks.workunit.client.0.smithi084.stdout:0/483: dwrite de/d2b/d77/d32/f6e [0,4194304] 0 2024-04-26T21:26:01.509 INFO:tasks.workunit.client.1.smithi120.stdout:9/653: rename d0/d14/d2d/f5d to d0/d66/d93/db7/fd1 0 2024-04-26T21:26:01.514 INFO:tasks.workunit.client.1.smithi120.stdout:2/739: mknod d4/d1b/d4f/d95/cf5 0 2024-04-26T21:26:01.515 INFO:tasks.workunit.client.0.smithi084.stdout:6/496: dread d3/de/d15/d23/f2e [0,4194304] 0 2024-04-26T21:26:01.529 INFO:tasks.workunit.client.0.smithi084.stdout:0/484: creat de/d2b/d77/d32/d96/f9c x:0 0 0 2024-04-26T21:26:01.529 INFO:tasks.workunit.client.1.smithi120.stdout:2/740: mkdir d4/d1b/d2e/d5f/df6 0 2024-04-26T21:26:01.531 INFO:tasks.workunit.client.1.smithi120.stdout:6/736: creat d4/d3d/dd1/ff7 x:0 0 0 2024-04-26T21:26:01.531 INFO:tasks.workunit.client.1.smithi120.stdout:3/703: creat dd/fe4 x:0 0 0 2024-04-26T21:26:01.533 INFO:tasks.workunit.client.0.smithi084.stdout:0/485: symlink de/d78/l9d 0 2024-04-26T21:26:01.534 INFO:tasks.workunit.client.1.smithi120.stdout:7/717: creat d7/d19/d60/de6/de8/ff2 x:0 0 0 2024-04-26T21:26:01.537 INFO:tasks.workunit.client.1.smithi120.stdout:9/654: dread d0/d14/d2d/d4b/d85/f88 [0,4194304] 0 2024-04-26T21:26:01.538 INFO:tasks.workunit.client.1.smithi120.stdout:9/655: readlink d0/dd/l25 0 2024-04-26T21:26:01.538 INFO:tasks.workunit.client.1.smithi120.stdout:6/737: chown d4/db/d10/ca 80050 1 2024-04-26T21:26:01.538 INFO:tasks.workunit.client.0.smithi084.stdout:4/421: dread d5/f2b [0,4194304] 0 2024-04-26T21:26:01.539 INFO:tasks.workunit.client.1.smithi120.stdout:3/704: mknod dd/de/d83/d64/ce5 0 2024-04-26T21:26:01.540 INFO:tasks.workunit.client.1.smithi120.stdout:0/841: write d0/d3/d51/d97/d108/d64/fb9 [846083,25419] 0 2024-04-26T21:26:01.541 INFO:tasks.workunit.client.1.smithi120.stdout:6/738: write d4/d99/fc1 [716111,35351] 0 2024-04-26T21:26:01.542 INFO:tasks.workunit.client.0.smithi084.stdout:0/486: mkdir de/d78/d9e 0 2024-04-26T21:26:01.542 INFO:tasks.workunit.client.1.smithi120.stdout:9/656: mknod d0/dd/d34/cd2 0 2024-04-26T21:26:01.543 INFO:tasks.workunit.client.0.smithi084.stdout:7/481: sync 2024-04-26T21:26:01.543 INFO:tasks.workunit.client.0.smithi084.stdout:5/514: sync 2024-04-26T21:26:01.544 INFO:tasks.workunit.client.1.smithi120.stdout:0/842: chown d0/d3/d51/d70 1546 1 2024-04-26T21:26:01.544 INFO:tasks.workunit.client.0.smithi084.stdout:4/422: mkdir d5/d10/d15/d21/d29/d8b 0 2024-04-26T21:26:01.546 INFO:tasks.workunit.client.1.smithi120.stdout:7/718: getdents d7/d64/da6/d1a 0 2024-04-26T21:26:01.547 INFO:tasks.workunit.client.1.smithi120.stdout:9/657: dread - d0/d14/fa0 zero size 2024-04-26T21:26:01.547 INFO:tasks.workunit.client.1.smithi120.stdout:3/705: dread - dd/de/df/dda/d24/d43/f53 zero size 2024-04-26T21:26:01.549 INFO:tasks.workunit.client.1.smithi120.stdout:0/843: readlink d0/d3/dc/dd/d1b/d24/d73/l10b 0 2024-04-26T21:26:01.549 INFO:tasks.workunit.client.0.smithi084.stdout:5/515: unlink d0/dc/df/d2a/l35 0 2024-04-26T21:26:01.549 INFO:tasks.workunit.client.0.smithi084.stdout:8/508: write d4/d7/d15/d3c/f4b [1046965,79969] 0 2024-04-26T21:26:01.550 INFO:tasks.workunit.client.0.smithi084.stdout:2/601: dread d6/d7/d3d/d15/d1f/d41/f4b [0,4194304] 0 2024-04-26T21:26:01.550 INFO:tasks.workunit.client.0.smithi084.stdout:0/487: symlink de/d2b/d77/l9f 0 2024-04-26T21:26:01.553 INFO:tasks.workunit.client.0.smithi084.stdout:4/423: creat d5/d25/d35/d60/d6d/f8c x:0 0 0 2024-04-26T21:26:01.553 INFO:tasks.workunit.client.0.smithi084.stdout:5/516: write d0/dc/df/d75/f55 [3838128,36690] 0 2024-04-26T21:26:01.556 INFO:tasks.workunit.client.1.smithi120.stdout:9/658: creat d0/d6/d3d/fd3 x:0 0 0 2024-04-26T21:26:01.556 INFO:tasks.workunit.client.0.smithi084.stdout:0/488: mkdir de/d2b/d77/d32/d96/da0 0 2024-04-26T21:26:01.557 INFO:tasks.workunit.client.0.smithi084.stdout:7/482: getdents d6/d9/d12/d8b 0 2024-04-26T21:26:01.558 INFO:tasks.workunit.client.1.smithi120.stdout:2/741: truncate d4/d1b/d2e/d50/d14/d15/d6c/fb3 4719955 0 2024-04-26T21:26:01.559 INFO:tasks.workunit.client.1.smithi120.stdout:7/719: creat d7/d19/d60/daa/ff3 x:0 0 0 2024-04-26T21:26:01.559 INFO:tasks.workunit.client.0.smithi084.stdout:5/517: readlink d0/dc/l6c 0 2024-04-26T21:26:01.560 INFO:tasks.workunit.client.0.smithi084.stdout:6/497: dread d3/de/d5d/f89 [0,4194304] 0 2024-04-26T21:26:01.561 INFO:tasks.workunit.client.0.smithi084.stdout:7/483: readlink d6/d9/d12/d19/l1e 0 2024-04-26T21:26:01.563 INFO:tasks.workunit.client.1.smithi120.stdout:0/844: creat d0/d3/dc/dd/d1b/d24/d73/db7/f117 x:0 0 0 2024-04-26T21:26:01.564 INFO:tasks.workunit.client.0.smithi084.stdout:7/484: write d6/f86 [712214,28404] 0 2024-04-26T21:26:01.564 INFO:tasks.workunit.client.1.smithi120.stdout:2/742: unlink d4/d1b/d4f/c94 0 2024-04-26T21:26:01.565 INFO:tasks.workunit.client.1.smithi120.stdout:7/720: write d7/d64/da6/d1f/d28/dbb/dcf/fe2 [9911,94526] 0 2024-04-26T21:26:01.567 INFO:tasks.workunit.client.0.smithi084.stdout:0/489: fsync de/d2b/d77/d32/f79 0 2024-04-26T21:26:01.569 INFO:tasks.workunit.client.0.smithi084.stdout:6/498: mknod d3/de/d1a/ca3 0 2024-04-26T21:26:01.570 INFO:tasks.workunit.client.1.smithi120.stdout:7/721: fsync d7/d19/d60/f76 0 2024-04-26T21:26:01.572 INFO:tasks.workunit.client.0.smithi084.stdout:8/509: rename d4/d7/d53/c6d to d4/d6/db/d1e/d22/c91 0 2024-04-26T21:26:01.573 INFO:tasks.workunit.client.1.smithi120.stdout:3/706: getdents dd/de/df/dda 0 2024-04-26T21:26:01.574 INFO:tasks.workunit.client.1.smithi120.stdout:2/743: mkdir d4/d1b/d5c/d99/df7 0 2024-04-26T21:26:01.575 INFO:tasks.workunit.client.1.smithi120.stdout:0/845: write d0/d3/d51/f58 [4998661,79778] 0 2024-04-26T21:26:01.576 INFO:tasks.workunit.client.1.smithi120.stdout:4/684: dread d10/d12/f35 [0,4194304] 0 2024-04-26T21:26:01.577 INFO:tasks.workunit.client.1.smithi120.stdout:6/739: dwrite d4/db/d25/f2d [0,4194304] 0 2024-04-26T21:26:01.578 INFO:tasks.workunit.client.0.smithi084.stdout:7/485: write d6/d9/d12/d8b/d72/da0/f4a [5686018,89239] 0 2024-04-26T21:26:01.578 INFO:tasks.workunit.client.0.smithi084.stdout:2/602: write d6/d7/d3d/d15/d1f/d39/fe [631019,20798] 0 2024-04-26T21:26:01.581 INFO:tasks.workunit.client.0.smithi084.stdout:7/486: write d6/d68/f75 [976882,55723] 0 2024-04-26T21:26:01.582 INFO:tasks.workunit.client.1.smithi120.stdout:7/722: chown d7/d64/da6/d1f/d28/f3e 14518 1 2024-04-26T21:26:01.582 INFO:tasks.workunit.client.1.smithi120.stdout:6/740: readlink d4/db/lc 0 2024-04-26T21:26:01.583 INFO:tasks.workunit.client.1.smithi120.stdout:2/744: mkdir d4/d1b/d4f/df8 0 2024-04-26T21:26:01.583 INFO:tasks.workunit.client.0.smithi084.stdout:4/424: truncate d5/d2e/d5f/f4b 523911 0 2024-04-26T21:26:01.584 INFO:tasks.workunit.client.1.smithi120.stdout:9/659: dwrite d0/d6/fbf [0,4194304] 0 2024-04-26T21:26:01.584 INFO:tasks.workunit.client.1.smithi120.stdout:4/685: chown d10/c1c 30 1 2024-04-26T21:26:01.585 INFO:tasks.workunit.client.1.smithi120.stdout:6/741: stat d4/d3d/cea 0 2024-04-26T21:26:01.586 INFO:tasks.workunit.client.0.smithi084.stdout:0/490: mkdir de/d78/d9e/da1 0 2024-04-26T21:26:01.588 INFO:tasks.workunit.client.0.smithi084.stdout:6/499: mknod d3/d6c/ca4 0 2024-04-26T21:26:01.588 INFO:tasks.workunit.client.0.smithi084.stdout:2/603: mkdir d6/d3e/d67/dcf 0 2024-04-26T21:26:01.591 INFO:tasks.workunit.client.1.smithi120.stdout:2/745: chown d4/d1b/d25/d2c/f22 37264 1 2024-04-26T21:26:01.593 INFO:tasks.workunit.client.1.smithi120.stdout:7/723: mkdir d7/d64/da6/d1a/df4 0 2024-04-26T21:26:01.594 INFO:tasks.workunit.client.1.smithi120.stdout:4/686: symlink d10/d65/d8c/dd0/le5 0 2024-04-26T21:26:01.595 INFO:tasks.workunit.client.0.smithi084.stdout:6/500: symlink d3/de/d41/d5c/la5 0 2024-04-26T21:26:01.600 INFO:tasks.workunit.client.1.smithi120.stdout:6/742: mkdir d4/db/d10/d22/d56/d8f/df8 0 2024-04-26T21:26:01.600 INFO:tasks.workunit.client.0.smithi084.stdout:4/425: mkdir d5/d2e/d8d 0 2024-04-26T21:26:01.601 INFO:tasks.workunit.client.1.smithi120.stdout:4/687: chown d10/d12/f1d 4 1 2024-04-26T21:26:01.602 INFO:tasks.workunit.client.0.smithi084.stdout:8/510: dwrite d4/d6/db/d1e/d22/d2f/f2c [4194304,4194304] 0 2024-04-26T21:26:01.603 INFO:tasks.workunit.client.0.smithi084.stdout:5/518: truncate d0/dc/df/d31/d45/f82 376345 0 2024-04-26T21:26:01.603 INFO:tasks.workunit.client.1.smithi120.stdout:2/746: read d4/f34 [126875,78977] 0 2024-04-26T21:26:01.605 INFO:tasks.workunit.client.0.smithi084.stdout:6/501: mknod d3/d18/d81/ca6 0 2024-04-26T21:26:01.605 INFO:tasks.workunit.client.1.smithi120.stdout:9/660: rename d0/c13 to d0/d14/d77/d9a/cd4 0 2024-04-26T21:26:01.607 INFO:tasks.workunit.client.1.smithi120.stdout:0/846: write d0/d3/dc/d12/f42 [886098,119856] 0 2024-04-26T21:26:01.608 INFO:tasks.workunit.client.0.smithi084.stdout:5/519: stat d0/dc/df/d75/d9a 0 2024-04-26T21:26:01.609 INFO:tasks.workunit.client.1.smithi120.stdout:9/661: fsync d0/d14/d2d/fbe 0 2024-04-26T21:26:01.610 INFO:tasks.workunit.client.0.smithi084.stdout:7/487: link d6/d9/d12/d19/d20/d38/f53 d6/d9/d12/d19/d7a/fa2 0 2024-04-26T21:26:01.610 INFO:tasks.workunit.client.1.smithi120.stdout:4/688: symlink d10/d65/d8c/dd0/le6 0 2024-04-26T21:26:01.614 INFO:tasks.workunit.client.0.smithi084.stdout:3/467: sync 2024-04-26T21:26:01.614 INFO:tasks.workunit.client.0.smithi084.stdout:0/491: write de/d20/d4e/f6f [2228819,125707] 0 2024-04-26T21:26:01.614 INFO:tasks.workunit.client.0.smithi084.stdout:4/426: symlink d5/d10/d15/d21/l8e 0 2024-04-26T21:26:01.614 INFO:tasks.workunit.client.0.smithi084.stdout:7/488: truncate d6/d9/f35 1277403 0 2024-04-26T21:26:01.616 INFO:tasks.workunit.client.1.smithi120.stdout:7/724: link d7/d64/da6/f95 d7/d64/da6/d1f/d28/ff5 0 2024-04-26T21:26:01.617 INFO:tasks.workunit.client.0.smithi084.stdout:8/511: rename d4/d7 to d4/d7/d15/d92 22 2024-04-26T21:26:01.617 INFO:tasks.workunit.client.0.smithi084.stdout:7/489: chown d6/d9/d12/d19/d7a/c7d 341065044 1 2024-04-26T21:26:01.617 INFO:tasks.workunit.client.1.smithi120.stdout:4/689: getdents d10/d12/da1 0 2024-04-26T21:26:01.618 INFO:tasks.workunit.client.0.smithi084.stdout:8/512: stat d4/lc 0 2024-04-26T21:26:01.618 INFO:tasks.workunit.client.1.smithi120.stdout:0/847: truncate d0/d3/f9 9888 0 2024-04-26T21:26:01.619 INFO:tasks.workunit.client.0.smithi084.stdout:6/502: fdatasync d3/de/d1a/d2f/d4c/d58/f66 0 2024-04-26T21:26:01.621 INFO:tasks.workunit.client.1.smithi120.stdout:7/725: truncate d7/d10/f11 1328712 0 2024-04-26T21:26:01.623 INFO:tasks.workunit.client.0.smithi084.stdout:6/503: readlink d3/de/d1a/l1e 0 2024-04-26T21:26:01.623 INFO:tasks.workunit.client.1.smithi120.stdout:6/743: write d4/db/d10/dd/f36 [612348,106098] 0 2024-04-26T21:26:01.624 INFO:tasks.workunit.client.1.smithi120.stdout:4/690: symlink d10/d6b/le7 0 2024-04-26T21:26:01.627 INFO:tasks.workunit.client.1.smithi120.stdout:7/726: rename f3 to d7/d64/da6/d1f/d7d/ff6 0 2024-04-26T21:26:01.631 INFO:tasks.workunit.client.0.smithi084.stdout:8/513: readlink d4/d7/d15/d37/l79 0 2024-04-26T21:26:01.632 INFO:tasks.workunit.client.1.smithi120.stdout:3/707: dread dd/d2a/d74/fbf [0,4194304] 0 2024-04-26T21:26:01.634 INFO:tasks.workunit.client.1.smithi120.stdout:7/727: truncate d7/d64/da6/fea 278306 0 2024-04-26T21:26:01.635 INFO:tasks.workunit.client.0.smithi084.stdout:6/504: dread d3/de/d15/d23/f30 [0,4194304] 0 2024-04-26T21:26:01.635 INFO:tasks.workunit.client.0.smithi084.stdout:7/490: creat d6/d9/d12/d8b/d72/fa3 x:0 0 0 2024-04-26T21:26:01.636 INFO:tasks.workunit.client.1.smithi120.stdout:6/744: creat d4/db/d25/d6d/dbd/dc4/ff9 x:0 0 0 2024-04-26T21:26:01.637 INFO:tasks.workunit.client.1.smithi120.stdout:3/708: write dd/de/df/dda/d24/d9d/d86/dd3/ddb/fd6 [1569355,34410] 0 2024-04-26T21:26:01.639 INFO:tasks.workunit.client.0.smithi084.stdout:4/427: link d5/f2b d5/d25/d35/f8f 0 2024-04-26T21:26:01.639 INFO:tasks.workunit.client.0.smithi084.stdout:2/604: dread d6/d7/d68/f69 [0,4194304] 0 2024-04-26T21:26:01.640 INFO:tasks.workunit.client.0.smithi084.stdout:3/468: symlink d1/d2c/d2f/l9a 0 2024-04-26T21:26:01.641 INFO:tasks.workunit.client.0.smithi084.stdout:5/520: creat d0/dc/df/f9e x:0 0 0 2024-04-26T21:26:01.643 INFO:tasks.workunit.client.0.smithi084.stdout:6/505: creat d3/de/d1a/d2f/d4c/fa7 x:0 0 0 2024-04-26T21:26:01.644 INFO:tasks.workunit.client.0.smithi084.stdout:5/521: write d0/dc/df/f9e [1034235,33985] 0 2024-04-26T21:26:01.645 INFO:tasks.workunit.client.0.smithi084.stdout:7/491: truncate d6/d26/f30 4228426 0 2024-04-26T21:26:01.645 INFO:tasks.workunit.client.1.smithi120.stdout:7/728: symlink d7/lf7 0 2024-04-26T21:26:01.646 INFO:tasks.workunit.client.1.smithi120.stdout:6/745: mknod d4/db/d10/d1a/d2b/cfa 0 2024-04-26T21:26:01.647 INFO:tasks.workunit.client.0.smithi084.stdout:0/492: creat de/d2b/fa2 x:0 0 0 2024-04-26T21:26:01.648 INFO:tasks.workunit.client.0.smithi084.stdout:4/428: readlink d5/d10/d15/l52 0 2024-04-26T21:26:01.648 INFO:tasks.workunit.client.1.smithi120.stdout:4/691: dwrite d10/d12/f60 [8388608,4194304] 0 2024-04-26T21:26:01.649 INFO:tasks.workunit.client.0.smithi084.stdout:4/429: stat d5/d25/d35/f86 0 2024-04-26T21:26:01.649 INFO:tasks.workunit.client.0.smithi084.stdout:3/469: creat d1/d2c/d2f/d31/d55/f9b x:0 0 0 2024-04-26T21:26:01.652 INFO:tasks.workunit.client.0.smithi084.stdout:4/430: dread - d5/d10/d15/d21/d29/f66 zero size 2024-04-26T21:26:01.653 INFO:tasks.workunit.client.0.smithi084.stdout:3/470: chown d1/d2c/d2f/d31/d55/f9b 2 1 2024-04-26T21:26:01.653 INFO:tasks.workunit.client.1.smithi120.stdout:3/709: dread dd/d2a/d74/f9f [0,4194304] 0 2024-04-26T21:26:01.653 INFO:tasks.workunit.client.1.smithi120.stdout:7/729: unlink d7/d64/da6/d2f/fb1 0 2024-04-26T21:26:01.654 INFO:tasks.workunit.client.0.smithi084.stdout:6/506: fdatasync d3/de/d15/df/f62 0 2024-04-26T21:26:01.654 INFO:tasks.workunit.client.1.smithi120.stdout:3/710: stat dd/de/df/dda/d24/db1/f8a 0 2024-04-26T21:26:01.655 INFO:tasks.workunit.client.0.smithi084.stdout:2/605: creat d6/d7/d3d/d79/dbe/fd0 x:0 0 0 2024-04-26T21:26:01.659 INFO:tasks.workunit.client.1.smithi120.stdout:6/746: creat d4/db/ffb x:0 0 0 2024-04-26T21:26:01.660 INFO:tasks.workunit.client.0.smithi084.stdout:4/431: write d5/f4c [772332,52352] 0 2024-04-26T21:26:01.661 INFO:tasks.workunit.client.1.smithi120.stdout:4/692: mknod d10/d28/d73/de2/ce8 0 2024-04-26T21:26:01.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:01 smithi084 ceph-mon[25539]: pgmap v45: 65 pgs: 65 active+clean; 2.0 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 60 MiB/s rd, 203 MiB/s wr, 383 op/s 2024-04-26T21:26:01.662 INFO:tasks.workunit.client.0.smithi084.stdout:0/493: symlink de/d2b/d77/d32/d96/da0/la3 0 2024-04-26T21:26:01.664 INFO:tasks.workunit.client.0.smithi084.stdout:3/471: symlink d1/d24/d27/l9c 0 2024-04-26T21:26:01.665 INFO:tasks.workunit.client.0.smithi084.stdout:6/507: creat d3/d18/d81/fa8 x:0 0 0 2024-04-26T21:26:01.665 INFO:tasks.workunit.client.0.smithi084.stdout:0/494: chown de/d20/d4e/d99 1576470570 1 2024-04-26T21:26:01.668 INFO:tasks.workunit.client.0.smithi084.stdout:1/502: sync 2024-04-26T21:26:01.668 INFO:tasks.workunit.client.0.smithi084.stdout:9/440: sync 2024-04-26T21:26:01.669 INFO:tasks.workunit.client.1.smithi120.stdout:3/711: stat dd/de/d83/f81 0 2024-04-26T21:26:01.671 INFO:tasks.workunit.client.0.smithi084.stdout:0/495: dread - de/d2b/d64/d81/f89 zero size 2024-04-26T21:26:01.672 INFO:tasks.workunit.client.0.smithi084.stdout:4/432: truncate d5/f23 1046526 0 2024-04-26T21:26:01.674 INFO:tasks.workunit.client.1.smithi120.stdout:2/747: dread d4/d1b/d2e/d50/f3f [0,4194304] 0 2024-04-26T21:26:01.674 INFO:tasks.workunit.client.0.smithi084.stdout:3/472: fsync d1/f1a 0 2024-04-26T21:26:01.674 INFO:tasks.workunit.client.0.smithi084.stdout:5/522: dwrite d0/d17/f1d [0,4194304] 0 2024-04-26T21:26:01.676 INFO:tasks.workunit.client.0.smithi084.stdout:8/514: dread d4/d7/d15/f30 [0,4194304] 0 2024-04-26T21:26:01.676 INFO:tasks.workunit.client.0.smithi084.stdout:1/503: stat d2/d54/d5e/d66/d3a 0 2024-04-26T21:26:01.676 INFO:tasks.workunit.client.1.smithi120.stdout:0/848: dwrite d0/d3/dc/f1c [0,4194304] 0 2024-04-26T21:26:01.679 INFO:tasks.workunit.client.0.smithi084.stdout:6/508: symlink d3/de/d1a/d43/d72/la9 0 2024-04-26T21:26:01.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:01 smithi120 ceph-mon[32741]: pgmap v45: 65 pgs: 65 active+clean; 2.0 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 60 MiB/s rd, 203 MiB/s wr, 383 op/s 2024-04-26T21:26:01.683 INFO:tasks.workunit.client.0.smithi084.stdout:5/523: stat d0/dc/df/d31/d53/d87 0 2024-04-26T21:26:01.683 INFO:tasks.workunit.client.0.smithi084.stdout:4/433: rename d5/d7/d65/d7f/d67 to d5/d7/d65/d90 0 2024-04-26T21:26:01.683 INFO:tasks.workunit.client.0.smithi084.stdout:1/504: stat d2/d54/d5e/d66/d3a/d48/f50 0 2024-04-26T21:26:01.683 INFO:tasks.workunit.client.0.smithi084.stdout:3/473: dread d1/f23 [0,4194304] 0 2024-04-26T21:26:01.688 INFO:tasks.workunit.client.1.smithi120.stdout:6/747: write d4/d3d/fa7 [140401,88059] 0 2024-04-26T21:26:01.689 INFO:tasks.workunit.client.0.smithi084.stdout:5/524: creat d0/dc/df/d31/d53/d87/f9f x:0 0 0 2024-04-26T21:26:01.689 INFO:tasks.workunit.client.0.smithi084.stdout:1/505: truncate d2/d9/d15/d28/d47/f81 1175342 0 2024-04-26T21:26:01.690 INFO:tasks.workunit.client.0.smithi084.stdout:9/441: write da/f23 [2507704,9846] 0 2024-04-26T21:26:01.698 INFO:tasks.workunit.client.0.smithi084.stdout:7/492: dread d6/d9/d12/f3d [0,4194304] 0 2024-04-26T21:26:01.704 INFO:tasks.workunit.client.0.smithi084.stdout:6/509: dread d3/de/d15/f85 [0,4194304] 0 2024-04-26T21:26:01.705 INFO:tasks.workunit.client.0.smithi084.stdout:5/525: write d0/dc/df/d31/f54 [1840770,64704] 0 2024-04-26T21:26:01.706 INFO:tasks.workunit.client.0.smithi084.stdout:7/493: chown d6/d1c/d51 6 1 2024-04-26T21:26:01.708 INFO:tasks.workunit.client.0.smithi084.stdout:9/442: chown da/de/d16/d25/d41/d43/d48/d61/d81 154 1 2024-04-26T21:26:01.709 INFO:tasks.workunit.client.1.smithi120.stdout:7/730: creat d7/d19/d60/deb/ff8 x:0 0 0 2024-04-26T21:26:01.712 INFO:tasks.workunit.client.1.smithi120.stdout:4/693: rename d10/f5b to d10/d65/d8c/dd0/fe9 0 2024-04-26T21:26:01.713 INFO:tasks.workunit.client.0.smithi084.stdout:7/494: dread - d6/d9/d12/d8b/d72/fa3 zero size 2024-04-26T21:26:01.716 INFO:tasks.workunit.client.1.smithi120.stdout:3/712: mkdir dd/de/df/dda/de6 0 2024-04-26T21:26:01.717 INFO:tasks.workunit.client.0.smithi084.stdout:5/526: chown d0/dc/df/d31/d72/d84 725 1 2024-04-26T21:26:01.718 INFO:tasks.workunit.client.0.smithi084.stdout:9/443: mknod da/de/d16/d25/d41/ca3 0 2024-04-26T21:26:01.719 INFO:tasks.workunit.client.0.smithi084.stdout:2/606: dwrite d6/d7/d3d/d15/d1f/f32 [0,4194304] 0 2024-04-26T21:26:01.720 INFO:tasks.workunit.client.0.smithi084.stdout:6/510: creat d3/de/d9e/faa x:0 0 0 2024-04-26T21:26:01.721 INFO:tasks.workunit.client.0.smithi084.stdout:3/474: dwrite d1/d2c/f90 [0,4194304] 0 2024-04-26T21:26:01.723 INFO:tasks.workunit.client.1.smithi120.stdout:7/731: symlink d7/d19/d60/deb/lf9 0 2024-04-26T21:26:01.725 INFO:tasks.workunit.client.0.smithi084.stdout:3/475: fsync d1/d2c/d2f/d31/d55/d4e/d7c/f89 0 2024-04-26T21:26:01.726 INFO:tasks.workunit.client.1.smithi120.stdout:7/732: readlink d7/d64/da6/d1f/d28/d4c/d6c/d74/lba 0 2024-04-26T21:26:01.727 INFO:tasks.workunit.client.0.smithi084.stdout:4/434: dwrite d5/d7/d65/f5a [0,4194304] 0 2024-04-26T21:26:01.729 INFO:tasks.workunit.client.1.smithi120.stdout:7/733: write d7/d64/da6/f16 [8294603,59756] 0 2024-04-26T21:26:01.732 INFO:tasks.workunit.client.1.smithi120.stdout:6/748: link d4/db/d10/d1a/d2b/d57/d67/d98/fc9 d4/db/d25/d6d/dbd/dc4/ffc 0 2024-04-26T21:26:01.733 INFO:tasks.workunit.client.0.smithi084.stdout:7/495: creat d6/d9/d12/d19/d20/d38/fa4 x:0 0 0 2024-04-26T21:26:01.733 INFO:tasks.workunit.client.0.smithi084.stdout:9/444: symlink da/de/d16/d25/d41/d8d/la4 0 2024-04-26T21:26:01.733 INFO:tasks.workunit.client.0.smithi084.stdout:4/435: write d5/d25/f47 [33876,63810] 0 2024-04-26T21:26:01.739 INFO:tasks.workunit.client.0.smithi084.stdout:5/527: creat d0/dc/fa0 x:0 0 0 2024-04-26T21:26:01.740 INFO:tasks.workunit.client.0.smithi084.stdout:6/511: truncate d3/de/d15/f69 201468 0 2024-04-26T21:26:01.740 INFO:tasks.workunit.client.0.smithi084.stdout:7/496: creat d6/d1c/fa5 x:0 0 0 2024-04-26T21:26:01.750 INFO:tasks.workunit.client.0.smithi084.stdout:5/528: write d0/f2 [1949757,60011] 0 2024-04-26T21:26:01.751 INFO:tasks.workunit.client.1.smithi120.stdout:6/749: dwrite d4/db/d25/d6d/d97/fbb [0,4194304] 0 2024-04-26T21:26:01.753 INFO:tasks.workunit.client.1.smithi120.stdout:4/694: link d10/d12/f19 d10/d6b/d71/d9d/fea 0 2024-04-26T21:26:01.754 INFO:tasks.workunit.client.1.smithi120.stdout:5/782: sync 2024-04-26T21:26:01.757 INFO:tasks.workunit.client.1.smithi120.stdout:7/734: chown d7/d64/da6/d1a/d50 0 1 2024-04-26T21:26:01.757 INFO:tasks.workunit.client.1.smithi120.stdout:0/849: getdents d0/d3/d51/d97/d108/d5a 0 2024-04-26T21:26:01.762 INFO:tasks.workunit.client.0.smithi084.stdout:6/512: creat d3/de/d1a/d2f/fab x:0 0 0 2024-04-26T21:26:01.762 INFO:tasks.workunit.client.0.smithi084.stdout:1/506: dread d2/d54/d5e/d66/f29 [0,4194304] 0 2024-04-26T21:26:01.763 INFO:tasks.workunit.client.0.smithi084.stdout:5/529: mknod d0/dc/df/d31/d72/d84/ca1 0 2024-04-26T21:26:01.763 INFO:tasks.workunit.client.0.smithi084.stdout:9/445: dread - da/de/d16/d55/d93/d95/fa1 zero size 2024-04-26T21:26:01.765 INFO:tasks.workunit.client.1.smithi120.stdout:0/850: mknod d0/df4/c118 0 2024-04-26T21:26:01.765 INFO:tasks.workunit.client.1.smithi120.stdout:6/750: truncate d4/db/d25/d6d/d97/f6f 436766 0 2024-04-26T21:26:01.766 INFO:tasks.workunit.client.0.smithi084.stdout:4/436: getdents d5/d25/d35 0 2024-04-26T21:26:01.767 INFO:tasks.workunit.client.1.smithi120.stdout:0/851: chown d0/d3/d51/d97/d108 0 1 2024-04-26T21:26:01.768 INFO:tasks.workunit.client.1.smithi120.stdout:0/852: chown d0/d3/d51/l93 0 1 2024-04-26T21:26:01.771 INFO:tasks.workunit.client.1.smithi120.stdout:6/751: truncate d4/db/d10/d1a/dcd/fd2 456527 0 2024-04-26T21:26:01.772 INFO:tasks.workunit.client.1.smithi120.stdout:3/713: write dd/f5e [3285983,24449] 0 2024-04-26T21:26:01.772 INFO:tasks.workunit.client.0.smithi084.stdout:2/607: dwrite d6/f84 [4194304,4194304] 0 2024-04-26T21:26:01.774 INFO:tasks.workunit.client.1.smithi120.stdout:2/748: write d4/d1b/d56/fd4 [553516,98746] 0 2024-04-26T21:26:01.776 INFO:tasks.workunit.client.0.smithi084.stdout:9/446: stat da/de/d16/l1f 0 2024-04-26T21:26:01.777 INFO:tasks.workunit.client.0.smithi084.stdout:7/497: dread d6/d9/d12/d8b/d72/da0/f48 [0,4194304] 0 2024-04-26T21:26:01.777 INFO:tasks.workunit.client.1.smithi120.stdout:6/752: rmdir d4/db/d10/d1a/d2b 39 2024-04-26T21:26:01.777 INFO:tasks.workunit.client.1.smithi120.stdout:3/714: write dd/de/df/d12/f21 [386258,52979] 0 2024-04-26T21:26:01.780 INFO:tasks.workunit.client.1.smithi120.stdout:7/735: dwrite d7/d64/da6/f7a [0,4194304] 0 2024-04-26T21:26:01.782 INFO:tasks.workunit.client.1.smithi120.stdout:6/753: mknod d4/db/d25/cfd 0 2024-04-26T21:26:01.785 INFO:tasks.workunit.client.0.smithi084.stdout:7/498: fsync d6/d9/d12/d19/d20/d38/f82 0 2024-04-26T21:26:01.785 INFO:tasks.workunit.client.1.smithi120.stdout:2/749: dread d4/d1b/d56/d65/fb1 [0,4194304] 0 2024-04-26T21:26:01.788 INFO:tasks.workunit.client.1.smithi120.stdout:3/715: unlink dd/de/df/d12/d48/f99 0 2024-04-26T21:26:01.789 INFO:tasks.workunit.client.1.smithi120.stdout:4/695: truncate d10/d6b/dbf/fc5 736225 0 2024-04-26T21:26:01.790 INFO:tasks.workunit.client.0.smithi084.stdout:4/437: mkdir d5/d7/d65/d90/d91 0 2024-04-26T21:26:01.792 INFO:tasks.workunit.client.0.smithi084.stdout:7/499: dread - d6/d1c/fa5 zero size 2024-04-26T21:26:01.792 INFO:tasks.workunit.client.1.smithi120.stdout:2/750: dread d4/d1b/d56/fb5 [0,4194304] 0 2024-04-26T21:26:01.794 INFO:tasks.workunit.client.0.smithi084.stdout:2/608: unlink d6/d7/d3d/f1e 0 2024-04-26T21:26:01.795 INFO:tasks.workunit.client.1.smithi120.stdout:0/853: write d0/d3/dc/d12/d31/fbf [935291,96524] 0 2024-04-26T21:26:01.796 INFO:tasks.workunit.client.1.smithi120.stdout:7/736: mkdir d7/d64/da6/d1a/d50/dfa 0 2024-04-26T21:26:01.796 INFO:tasks.workunit.client.0.smithi084.stdout:7/500: chown d6/d9/d12/d19/d20/d32/f9a 373 1 2024-04-26T21:26:01.797 INFO:tasks.workunit.client.0.smithi084.stdout:9/447: symlink da/de/d1e/d56/la5 0 2024-04-26T21:26:01.799 INFO:tasks.workunit.client.1.smithi120.stdout:7/737: chown d7/c1e 113 1 2024-04-26T21:26:01.800 INFO:tasks.workunit.client.0.smithi084.stdout:3/476: dread d1/d2c/d2f/d31/f37 [0,4194304] 0 2024-04-26T21:26:01.803 INFO:tasks.workunit.client.0.smithi084.stdout:1/507: getdents d2/d9/d15/d28/d69/d9d 0 2024-04-26T21:26:01.805 INFO:tasks.workunit.client.1.smithi120.stdout:4/696: rename d10/da6/fd5 to d10/feb 0 2024-04-26T21:26:01.805 INFO:tasks.workunit.client.1.smithi120.stdout:0/854: write d0/d3/d51/d97/f102 [496030,89962] 0 2024-04-26T21:26:01.805 INFO:tasks.workunit.client.0.smithi084.stdout:6/513: dwrite d3/de/d41/d5c/f97 [0,4194304] 0 2024-04-26T21:26:01.808 INFO:tasks.workunit.client.1.smithi120.stdout:4/697: chown d10/fd1 114717 1 2024-04-26T21:26:01.809 INFO:tasks.workunit.client.1.smithi120.stdout:5/783: dwrite d2/d30/f8b [0,4194304] 0 2024-04-26T21:26:01.810 INFO:tasks.workunit.client.0.smithi084.stdout:7/501: symlink d6/d9/d89/la6 0 2024-04-26T21:26:01.810 INFO:tasks.workunit.client.1.smithi120.stdout:0/855: mknod d0/dd1/dd2/c119 0 2024-04-26T21:26:01.811 INFO:tasks.workunit.client.1.smithi120.stdout:7/738: write d7/d64/da6/d1f/d28/d4c/fc9 [725767,37650] 0 2024-04-26T21:26:01.812 INFO:tasks.workunit.client.0.smithi084.stdout:5/530: rename d0/dc/d78 to d0/da2 0 2024-04-26T21:26:01.813 INFO:tasks.workunit.client.1.smithi120.stdout:4/698: mkdir d10/d65/d7c/dec 0 2024-04-26T21:26:01.818 INFO:tasks.workunit.client.0.smithi084.stdout:3/477: rmdir d1/d2c/d2f/d31/d55/d4e 39 2024-04-26T21:26:01.818 INFO:tasks.workunit.client.0.smithi084.stdout:2/609: symlink d6/d7/d3d/d15/d1f/d41/ld1 0 2024-04-26T21:26:01.819 INFO:tasks.workunit.client.1.smithi120.stdout:0/856: write d0/d3/d51/d97/d108/d81/dba/f112 [339045,101131] 0 2024-04-26T21:26:01.819 INFO:tasks.workunit.client.1.smithi120.stdout:6/754: dwrite d4/db/d10/dd/d4e/f5f [0,4194304] 0 2024-04-26T21:26:01.819 INFO:tasks.workunit.client.0.smithi084.stdout:6/514: rmdir d3/d18 39 2024-04-26T21:26:01.820 INFO:tasks.workunit.client.1.smithi120.stdout:5/784: chown d2/dc/d1d/d21/d66/d85 17 1 2024-04-26T21:26:01.823 INFO:tasks.workunit.client.0.smithi084.stdout:6/515: write d3/de/d1a/d2f/f3c [2812760,59767] 0 2024-04-26T21:26:01.825 INFO:tasks.workunit.client.0.smithi084.stdout:6/516: chown d3/de/f61 46 1 2024-04-26T21:26:01.827 INFO:tasks.workunit.client.0.smithi084.stdout:5/531: fsync d0/d17/f5b 0 2024-04-26T21:26:01.828 INFO:tasks.workunit.client.0.smithi084.stdout:7/502: rename d6/d9/d12/d19/d20/d32/f71 to d6/d9/d12/d8b/fa7 0 2024-04-26T21:26:01.829 INFO:tasks.workunit.client.0.smithi084.stdout:4/438: getdents d5/d25/d35 0 2024-04-26T21:26:01.831 INFO:tasks.workunit.client.0.smithi084.stdout:2/610: creat d6/d7/d3d/d15/d1f/d39/da5/fd2 x:0 0 0 2024-04-26T21:26:01.836 INFO:tasks.workunit.client.1.smithi120.stdout:6/755: symlink d4/db/d10/d22/d56/d9c/lfe 0 2024-04-26T21:26:01.838 INFO:tasks.workunit.client.1.smithi120.stdout:2/751: dread d4/f10 [0,4194304] 0 2024-04-26T21:26:01.839 INFO:tasks.workunit.client.0.smithi084.stdout:3/478: link d1/d2c/f71 d1/d2c/d2f/f9d 0 2024-04-26T21:26:01.839 INFO:tasks.workunit.client.0.smithi084.stdout:5/532: truncate d0/dc/df/f9e 1935144 0 2024-04-26T21:26:01.841 INFO:tasks.workunit.client.0.smithi084.stdout:4/439: write d5/d10/d15/f5b [2411321,114358] 0 2024-04-26T21:26:01.842 INFO:tasks.workunit.client.1.smithi120.stdout:2/752: truncate d4/d1b/d4f/d95/de9/ff4 348837 0 2024-04-26T21:26:01.842 INFO:tasks.workunit.client.0.smithi084.stdout:7/503: symlink d6/d9/d12/d8b/la8 0 2024-04-26T21:26:01.842 INFO:tasks.workunit.client.1.smithi120.stdout:6/756: mkdir d4/db/d10/dd/d28/d9e/daf/dff 0 2024-04-26T21:26:01.842 INFO:tasks.workunit.client.0.smithi084.stdout:2/611: dread - d6/d7/d3d/d15/d1f/d39/da5/fcc zero size 2024-04-26T21:26:01.843 INFO:tasks.workunit.client.1.smithi120.stdout:5/785: link d2/d1b/c7a d2/d30/d93/dbf/c120 0 2024-04-26T21:26:01.851 INFO:tasks.workunit.client.1.smithi120.stdout:3/716: write dd/d2a/f7f [472929,39268] 0 2024-04-26T21:26:01.851 INFO:tasks.workunit.client.0.smithi084.stdout:5/533: mknod d0/dc/df/d31/d53/d5d/ca3 0 2024-04-26T21:26:01.851 INFO:tasks.workunit.client.0.smithi084.stdout:7/504: symlink d6/d68/d7f/la9 0 2024-04-26T21:26:01.852 INFO:tasks.workunit.client.0.smithi084.stdout:3/479: mkdir d1/d2c/d2f/d31/d55/d4e/d98/d9e 0 2024-04-26T21:26:01.853 INFO:tasks.workunit.client.1.smithi120.stdout:2/753: truncate d4/d1b/d25/d29/f37 3241469 0 2024-04-26T21:26:01.853 INFO:tasks.workunit.client.0.smithi084.stdout:2/612: chown d6/d7/d3d/fc2 40557 1 2024-04-26T21:26:01.854 INFO:tasks.workunit.client.1.smithi120.stdout:3/717: creat dd/de/df/fe7 x:0 0 0 2024-04-26T21:26:01.856 INFO:tasks.workunit.client.0.smithi084.stdout:7/505: write d6/d68/f75 [1041180,123354] 0 2024-04-26T21:26:01.856 INFO:tasks.workunit.client.1.smithi120.stdout:2/754: chown d4/d1b/d2e/d50/d14/d15/cc4 342947440 1 2024-04-26T21:26:01.858 INFO:tasks.workunit.client.0.smithi084.stdout:2/613: fdatasync d6/d7/d68/fa2 0 2024-04-26T21:26:01.861 INFO:tasks.workunit.client.1.smithi120.stdout:3/718: creat dd/de/df/dda/d24/db1/d76/d3b/d56/d75/fe8 x:0 0 0 2024-04-26T21:26:01.862 INFO:tasks.workunit.client.0.smithi084.stdout:3/480: unlink d1/d24/d27/d3a/f51 0 2024-04-26T21:26:01.862 INFO:tasks.workunit.client.1.smithi120.stdout:4/699: write d10/d12/f62 [2136566,71777] 0 2024-04-26T21:26:01.863 INFO:tasks.workunit.client.1.smithi120.stdout:2/755: mknod d4/d1b/d25/cf9 0 2024-04-26T21:26:01.864 INFO:tasks.workunit.client.1.smithi120.stdout:3/719: chown dd/de/df/dda/d8d/l96 143 1 2024-04-26T21:26:01.867 INFO:tasks.workunit.client.1.smithi120.stdout:4/700: creat d10/d6b/d71/d9d/fed x:0 0 0 2024-04-26T21:26:01.868 INFO:tasks.workunit.client.0.smithi084.stdout:5/534: creat d0/dc/df/fa4 x:0 0 0 2024-04-26T21:26:01.868 INFO:tasks.workunit.client.0.smithi084.stdout:9/448: dread da/f23 [0,4194304] 0 2024-04-26T21:26:01.869 INFO:tasks.workunit.client.1.smithi120.stdout:2/756: fsync d4/d1b/d4f/f7c 0 2024-04-26T21:26:01.870 INFO:tasks.workunit.client.0.smithi084.stdout:6/517: dwrite d3/d18/d81/fa8 [0,4194304] 0 2024-04-26T21:26:01.871 INFO:tasks.workunit.client.1.smithi120.stdout:3/720: write dd/de/df/dda/f4b [5858288,3999] 0 2024-04-26T21:26:01.872 INFO:tasks.workunit.client.0.smithi084.stdout:2/614: write d6/d7/d3d/d15/d1f/d39/fc [4575907,69885] 0 2024-04-26T21:26:01.872 INFO:tasks.workunit.client.1.smithi120.stdout:4/701: rmdir d10/d65/d8c 39 2024-04-26T21:26:01.875 INFO:tasks.workunit.client.0.smithi084.stdout:4/440: dwrite d5/d10/d15/d21/d29/f7e [0,4194304] 0 2024-04-26T21:26:01.875 INFO:tasks.workunit.client.0.smithi084.stdout:1/508: dread d2/d54/d5e/d66/f36 [0,4194304] 0 2024-04-26T21:26:01.878 INFO:tasks.workunit.client.0.smithi084.stdout:4/441: chown d5/d7/l1d 188619 1 2024-04-26T21:26:01.887 INFO:tasks.workunit.client.0.smithi084.stdout:8/515: sync 2024-04-26T21:26:01.894 INFO:tasks.workunit.client.0.smithi084.stdout:4/442: dwrite d5/d25/f3e [0,4194304] 0 2024-04-26T21:26:01.896 INFO:tasks.workunit.client.0.smithi084.stdout:4/443: write d5/d2e/d5f/f27 [4086735,77807] 0 2024-04-26T21:26:01.898 INFO:tasks.workunit.client.0.smithi084.stdout:4/444: write d5/d25/f3e [129506,80332] 0 2024-04-26T21:26:01.900 INFO:tasks.workunit.client.0.smithi084.stdout:4/445: write d5/d10/f13 [2235499,124371] 0 2024-04-26T21:26:01.930 INFO:tasks.workunit.client.0.smithi084.stdout:0/496: sync 2024-04-26T21:26:01.979 INFO:tasks.workunit.client.1.smithi120.stdout:8/686: sync 2024-04-26T21:26:01.981 INFO:tasks.workunit.client.1.smithi120.stdout:5/786: truncate d2/d1b/f26 260891 0 2024-04-26T21:26:01.991 INFO:tasks.workunit.client.0.smithi084.stdout:3/481: creat d1/d24/d27/d3a/f9f x:0 0 0 2024-04-26T21:26:01.991 INFO:tasks.workunit.client.0.smithi084.stdout:9/449: fsync da/de/d1e/f31 0 2024-04-26T21:26:01.992 INFO:tasks.workunit.client.1.smithi120.stdout:5/787: mknod d2/d82/d96/c121 0 2024-04-26T21:26:01.994 INFO:tasks.workunit.client.0.smithi084.stdout:7/506: getdents d6 0 2024-04-26T21:26:01.994 INFO:tasks.workunit.client.1.smithi120.stdout:3/721: link dd/de/df/dda/d24/f3a dd/de/d83/db2/fe9 0 2024-04-26T21:26:01.994 INFO:tasks.workunit.client.1.smithi120.stdout:6/757: dwrite d4/f31 [4194304,4194304] 0 2024-04-26T21:26:01.994 INFO:tasks.workunit.client.1.smithi120.stdout:2/757: write d4/d1b/d4f/f9c [874355,128255] 0 2024-04-26T21:26:01.995 INFO:tasks.workunit.client.0.smithi084.stdout:1/509: dread - d2/d19/f4d zero size 2024-04-26T21:26:01.998 INFO:tasks.workunit.client.1.smithi120.stdout:4/702: rename d10/d65/d8c to d10/d28/dd9/ddd/dee 0 2024-04-26T21:26:01.999 INFO:tasks.workunit.client.1.smithi120.stdout:5/788: symlink d2/d30/d93/d107/d36/l122 0 2024-04-26T21:26:01.999 INFO:tasks.workunit.client.0.smithi084.stdout:3/482: dread d1/f23 [0,4194304] 0 2024-04-26T21:26:01.999 INFO:tasks.workunit.client.1.smithi120.stdout:6/758: chown d4/db/d10/dd/d28/l42 651893251 1 2024-04-26T21:26:02.000 INFO:tasks.workunit.client.0.smithi084.stdout:1/510: read - d2/d19/f4d zero size 2024-04-26T21:26:02.002 INFO:tasks.workunit.client.0.smithi084.stdout:4/446: rename d5/d2e/d5f/d32/d46/c57 to d5/c92 0 2024-04-26T21:26:02.002 INFO:tasks.workunit.client.1.smithi120.stdout:3/722: mkdir dd/dcf/dea 0 2024-04-26T21:26:02.006 INFO:tasks.workunit.client.0.smithi084.stdout:0/497: read de/f1f [291623,98451] 0 2024-04-26T21:26:02.007 INFO:tasks.workunit.client.1.smithi120.stdout:2/758: mkdir d4/d1b/d2e/d5f/df6/dfa 0 2024-04-26T21:26:02.007 INFO:tasks.workunit.client.1.smithi120.stdout:6/759: rmdir d4/db/d25 39 2024-04-26T21:26:02.008 INFO:tasks.workunit.client.0.smithi084.stdout:3/483: unlink d1/d2c/d2f/l1c 0 2024-04-26T21:26:02.012 INFO:tasks.workunit.client.0.smithi084.stdout:6/518: link d3/de/d15/d5f/l8c d3/de/d1a/d2f/d4c/da0/lac 0 2024-04-26T21:26:02.014 INFO:tasks.workunit.client.0.smithi084.stdout:2/615: getdents d6/d7/d3d/d15/d1f/d39/d43 0 2024-04-26T21:26:02.014 INFO:tasks.workunit.client.1.smithi120.stdout:2/759: creat d4/d1b/d56/d65/ffb x:0 0 0 2024-04-26T21:26:02.015 INFO:tasks.workunit.client.0.smithi084.stdout:6/519: stat d3/d18/l54 0 2024-04-26T21:26:02.015 INFO:tasks.workunit.client.0.smithi084.stdout:0/498: read de/d2b/f6b [2212478,102247] 0 2024-04-26T21:26:02.017 INFO:tasks.workunit.client.0.smithi084.stdout:9/450: dwrite da/f23 [0,4194304] 0 2024-04-26T21:26:02.019 INFO:tasks.workunit.client.1.smithi120.stdout:5/789: rename d2/dc/d1d/d21/c4b to d2/d1b/d89/d6b/c123 0 2024-04-26T21:26:02.019 INFO:tasks.workunit.client.0.smithi084.stdout:0/499: write de/d2b/fa2 [533910,115411] 0 2024-04-26T21:26:02.020 INFO:tasks.workunit.client.1.smithi120.stdout:8/687: dwrite d5/d6/d75/d95/fd8 [0,4194304] 0 2024-04-26T21:26:02.021 INFO:tasks.workunit.client.0.smithi084.stdout:3/484: dread d1/d24/f36 [0,4194304] 0 2024-04-26T21:26:02.022 INFO:tasks.workunit.client.0.smithi084.stdout:5/535: truncate d0/f2 2144748 0 2024-04-26T21:26:02.023 INFO:tasks.workunit.client.0.smithi084.stdout:9/451: dread - da/de/d16/d55/d93/d95/fa1 zero size 2024-04-26T21:26:02.023 INFO:tasks.workunit.client.0.smithi084.stdout:2/616: write d6/d7/d3d/d79/d81/d82/da8/fba [478980,76022] 0 2024-04-26T21:26:02.025 INFO:tasks.workunit.client.0.smithi084.stdout:5/536: dread - d0/dc/df/d31/f9c zero size 2024-04-26T21:26:02.028 INFO:tasks.workunit.client.0.smithi084.stdout:2/617: read d6/d7/d3d/d15/d1f/d41/f4b [3662838,81618] 0 2024-04-26T21:26:02.029 INFO:tasks.workunit.client.1.smithi120.stdout:8/688: write d5/d6/d75/fa6 [2274266,107532] 0 2024-04-26T21:26:02.029 INFO:tasks.workunit.client.0.smithi084.stdout:6/520: mkdir d3/de/d1a/d43/d72/dad 0 2024-04-26T21:26:02.029 INFO:tasks.workunit.client.0.smithi084.stdout:8/516: dread d4/d7/f14 [4194304,4194304] 0 2024-04-26T21:26:02.030 INFO:tasks.workunit.client.0.smithi084.stdout:1/511: write d2/d19/f4d [423276,58936] 0 2024-04-26T21:26:02.033 INFO:tasks.workunit.client.1.smithi120.stdout:5/790: mknod d2/dc/d1d/d21/d66/d11e/c124 0 2024-04-26T21:26:02.034 INFO:tasks.workunit.client.1.smithi120.stdout:4/703: dwrite d10/d28/f4b [0,4194304] 0 2024-04-26T21:26:02.034 INFO:tasks.workunit.client.0.smithi084.stdout:0/500: unlink de/c23 0 2024-04-26T21:26:02.034 INFO:tasks.workunit.client.0.smithi084.stdout:2/618: chown d6/d7/d3d/d15/d1f/d41/c7b 146157 1 2024-04-26T21:26:02.034 INFO:tasks.workunit.client.0.smithi084.stdout:4/447: symlink d5/d10/d15/d21/l93 0 2024-04-26T21:26:02.036 INFO:tasks.workunit.client.0.smithi084.stdout:9/452: mkdir da/de/d1e/d56/da6 0 2024-04-26T21:26:02.038 INFO:tasks.workunit.client.1.smithi120.stdout:8/689: dread - d5/d6/d11/d52/d70/d88/fcf zero size 2024-04-26T21:26:02.038 INFO:tasks.workunit.client.0.smithi084.stdout:1/512: read d2/d9/d15/d28/d47/f81 [245869,3373] 0 2024-04-26T21:26:02.039 INFO:tasks.workunit.client.0.smithi084.stdout:6/521: mkdir d3/de/d15/df/dae 0 2024-04-26T21:26:02.039 INFO:tasks.workunit.client.1.smithi120.stdout:5/791: dread - d2/d82/f91 zero size 2024-04-26T21:26:02.040 INFO:tasks.workunit.client.1.smithi120.stdout:4/704: mknod d10/d28/dd9/cef 0 2024-04-26T21:26:02.041 INFO:tasks.workunit.client.0.smithi084.stdout:0/501: write de/d2b/f43 [2806095,1903] 0 2024-04-26T21:26:02.043 INFO:tasks.workunit.client.1.smithi120.stdout:4/705: chown d10/d6b 413124 1 2024-04-26T21:26:02.043 INFO:tasks.workunit.client.1.smithi120.stdout:3/723: dwrite dd/de/df/dda/d24/db1/d76/fb4 [0,4194304] 0 2024-04-26T21:26:02.043 INFO:tasks.workunit.client.0.smithi084.stdout:4/448: chown d5/d7/d65/l87 0 1 2024-04-26T21:26:02.044 INFO:tasks.workunit.client.1.smithi120.stdout:5/792: readlink d2/dc/d1d/d21/d66/l39 0 2024-04-26T21:26:02.044 INFO:tasks.workunit.client.1.smithi120.stdout:8/690: read d5/d6/d34/d42/f49 [318080,744] 0 2024-04-26T21:26:02.047 INFO:tasks.workunit.client.1.smithi120.stdout:4/706: truncate d10/feb 1002589 0 2024-04-26T21:26:02.047 INFO:tasks.workunit.client.0.smithi084.stdout:6/522: chown d3/de/d15/d5f/l8c 94911 1 2024-04-26T21:26:02.049 INFO:tasks.workunit.client.0.smithi084.stdout:0/502: mkdir de/d78/d9e/da4 0 2024-04-26T21:26:02.049 INFO:tasks.workunit.client.1.smithi120.stdout:3/724: fsync dd/de/df/dda/d37/f4e 0 2024-04-26T21:26:02.049 INFO:tasks.workunit.client.1.smithi120.stdout:8/691: write d5/f30 [4609867,83989] 0 2024-04-26T21:26:02.050 INFO:tasks.workunit.client.0.smithi084.stdout:9/453: truncate da/de/d16/d25/d41/d8d/f99 959823 0 2024-04-26T21:26:02.052 INFO:tasks.workunit.client.0.smithi084.stdout:8/517: link d4/d7/d15/d3c/f4b d4/d6/db/d1e/d22/d39/f93 0 2024-04-26T21:26:02.053 INFO:tasks.workunit.client.1.smithi120.stdout:5/793: unlink d2/fa3 0 2024-04-26T21:26:02.053 INFO:tasks.workunit.client.0.smithi084.stdout:3/485: link d1/d24/c78 d1/d24/d27/d3a/ca0 0 2024-04-26T21:26:02.056 INFO:tasks.workunit.client.1.smithi120.stdout:8/692: write d5/d6/d11/f6b [982959,130975] 0 2024-04-26T21:26:02.056 INFO:tasks.workunit.client.0.smithi084.stdout:3/486: fdatasync d1/d24/d27/f30 0 2024-04-26T21:26:02.056 INFO:tasks.workunit.client.0.smithi084.stdout:1/513: mknod d2/d9/d15/d28/ca1 0 2024-04-26T21:26:02.056 INFO:tasks.workunit.client.0.smithi084.stdout:4/449: mknod d5/d25/d35/d60/c94 0 2024-04-26T21:26:02.058 INFO:tasks.workunit.client.0.smithi084.stdout:5/537: rename d0/dc/df/d2a/l50 to d0/dc/df/d31/d53/d5d/la5 0 2024-04-26T21:26:02.062 INFO:tasks.workunit.client.0.smithi084.stdout:9/454: symlink da/de/d16/d25/d41/d43/d48/d61/d81/la7 0 2024-04-26T21:26:02.064 INFO:tasks.workunit.client.1.smithi120.stdout:4/707: mknod d10/d28/cf0 0 2024-04-26T21:26:02.065 INFO:tasks.workunit.client.1.smithi120.stdout:8/693: readlink d5/d6/l9 0 2024-04-26T21:26:02.067 INFO:tasks.workunit.client.0.smithi084.stdout:8/518: getdents d4/d6/db/d1e/d7c 0 2024-04-26T21:26:02.070 INFO:tasks.workunit.client.0.smithi084.stdout:3/487: getdents d1/d2c/d2f 0 2024-04-26T21:26:02.071 INFO:tasks.workunit.client.1.smithi120.stdout:4/708: mkdir d10/d28/dd9/ddd/df1 0 2024-04-26T21:26:02.072 INFO:tasks.workunit.client.0.smithi084.stdout:1/514: symlink d2/d54/d5e/d66/d2a/d2c/la2 0 2024-04-26T21:26:02.073 INFO:tasks.workunit.client.1.smithi120.stdout:8/694: creat d5/d8e/fdf x:0 0 0 2024-04-26T21:26:02.075 INFO:tasks.workunit.client.1.smithi120.stdout:2/760: dwrite d4/d1b/d25/d2c/fa2 [4194304,4194304] 0 2024-04-26T21:26:02.077 INFO:tasks.workunit.client.1.smithi120.stdout:4/709: truncate d10/f47 1300073 0 2024-04-26T21:26:02.078 INFO:tasks.workunit.client.0.smithi084.stdout:8/519: read d4/d6/db/d1e/f45 [2815487,73806] 0 2024-04-26T21:26:02.079 INFO:tasks.workunit.client.1.smithi120.stdout:2/761: chown d4/d1b/d25/d2c/d3e/d5e/d63/dcb/dca 27782 1 2024-04-26T21:26:02.079 INFO:tasks.workunit.client.0.smithi084.stdout:4/450: dread d5/d25/d35/f8f [0,4194304] 0 2024-04-26T21:26:02.079 INFO:tasks.workunit.client.1.smithi120.stdout:8/695: dread d5/d6/d34/d42/d9d/d83/f97 [0,4194304] 0 2024-04-26T21:26:02.081 INFO:tasks.workunit.client.0.smithi084.stdout:3/488: rename d1/d2c/d2f/f9d to d1/d2c/d2f/d31/d52/fa1 0 2024-04-26T21:26:02.082 INFO:tasks.workunit.client.0.smithi084.stdout:2/619: truncate f0 289779 0 2024-04-26T21:26:02.085 INFO:tasks.workunit.client.1.smithi120.stdout:2/762: mkdir d4/d1b/d25/d2c/d3e/d5e/d63/dcb/dca/dfc 0 2024-04-26T21:26:02.085 INFO:tasks.workunit.client.0.smithi084.stdout:1/515: rmdir d2/d97 0 2024-04-26T21:26:02.087 INFO:tasks.workunit.client.1.smithi120.stdout:2/763: fdatasync d4/d1b/d2e/d50/d14/ff2 0 2024-04-26T21:26:02.089 INFO:tasks.workunit.client.0.smithi084.stdout:8/520: mknod d4/d7/d15/d3c/c94 0 2024-04-26T21:26:02.093 INFO:tasks.workunit.client.1.smithi120.stdout:5/794: dwrite d2/dc/d1d/d21/d77/d79/db7/fab [0,4194304] 0 2024-04-26T21:26:02.096 INFO:tasks.workunit.client.0.smithi084.stdout:2/620: rename d6/d7/d3d/d15/d1f/d39/d43/fab to d6/d7/d3d/d79/fd3 0 2024-04-26T21:26:02.096 INFO:tasks.workunit.client.0.smithi084.stdout:4/451: chown d5/d2e/d5f/f4b 1267 1 2024-04-26T21:26:02.097 INFO:tasks.workunit.client.0.smithi084.stdout:2/621: write d6/d7/d3d/d79/d81/fc3 [133279,111068] 0 2024-04-26T21:26:02.098 INFO:tasks.workunit.client.1.smithi120.stdout:5/795: unlink d2/d30/d93/d107/lae 0 2024-04-26T21:26:02.099 INFO:tasks.workunit.client.0.smithi084.stdout:4/452: dread - d5/d10/d15/d21/d29/f66 zero size 2024-04-26T21:26:02.101 INFO:tasks.workunit.client.1.smithi120.stdout:4/710: truncate d10/d12/faa 2043787 0 2024-04-26T21:26:02.101 INFO:tasks.workunit.client.0.smithi084.stdout:4/453: write d5/d10/f71 [1767857,60227] 0 2024-04-26T21:26:02.103 INFO:tasks.workunit.client.0.smithi084.stdout:4/454: read - d5/d2e/d5f/f8a zero size 2024-04-26T21:26:02.103 INFO:tasks.workunit.client.0.smithi084.stdout:9/455: dread da/de/d16/d25/f52 [0,4194304] 0 2024-04-26T21:26:02.104 INFO:tasks.workunit.client.1.smithi120.stdout:9/662: sync 2024-04-26T21:26:02.104 INFO:tasks.workunit.client.1.smithi120.stdout:1/651: sync 2024-04-26T21:26:02.105 INFO:tasks.workunit.client.0.smithi084.stdout:8/521: dread - d4/d6/db/d1e/d22/d39/d4a/f5e zero size 2024-04-26T21:26:02.107 INFO:tasks.workunit.client.1.smithi120.stdout:4/711: mknod d10/d28/d73/de2/cf2 0 2024-04-26T21:26:02.107 INFO:tasks.workunit.client.0.smithi084.stdout:1/516: rename d2/d1b/f55 to d2/d54/d5e/d66/d3a/fa3 0 2024-04-26T21:26:02.109 INFO:tasks.workunit.client.0.smithi084.stdout:3/489: creat d1/d24/fa2 x:0 0 0 2024-04-26T21:26:02.111 INFO:tasks.workunit.client.1.smithi120.stdout:9/663: truncate d0/d6/d4d/d65/f71 4266854 0 2024-04-26T21:26:02.112 INFO:tasks.workunit.client.1.smithi120.stdout:4/712: mkdir d10/d28/dd9/ddd/dee/dd0/df3 0 2024-04-26T21:26:02.114 INFO:tasks.workunit.client.0.smithi084.stdout:4/455: dread d5/d7/d65/d7f/f7a [0,4194304] 0 2024-04-26T21:26:02.116 INFO:tasks.workunit.client.1.smithi120.stdout:9/664: mknod d0/d14/d77/dc5/cd5 0 2024-04-26T21:26:02.116 INFO:tasks.workunit.client.1.smithi120.stdout:4/713: mknod d10/d6b/dbf/cf4 0 2024-04-26T21:26:02.123 INFO:tasks.workunit.client.1.smithi120.stdout:9/665: link d0/dd/d3a/d5c/d9f/f89 d0/dd/d45/dc0/fd6 0 2024-04-26T21:26:02.124 INFO:tasks.workunit.client.1.smithi120.stdout:3/725: dread dd/de/df/dda/d24/db1/f8a [0,4194304] 0 2024-04-26T21:26:02.126 INFO:tasks.workunit.client.1.smithi120.stdout:9/666: rmdir d0/d14/d2d 39 2024-04-26T21:26:02.128 INFO:tasks.workunit.client.1.smithi120.stdout:9/667: chown d0/d66/fb2 7496 1 2024-04-26T21:26:02.128 INFO:tasks.workunit.client.1.smithi120.stdout:1/652: dwrite d6/d7/d1d/d2c/f93 [0,4194304] 0 2024-04-26T21:26:02.132 INFO:tasks.workunit.client.1.smithi120.stdout:4/714: truncate d10/d12/f3a 1023777 0 2024-04-26T21:26:02.133 INFO:tasks.workunit.client.1.smithi120.stdout:9/668: chown d0/d14/d2d/d4b/d85/f88 4560276 1 2024-04-26T21:26:02.135 INFO:tasks.workunit.client.1.smithi120.stdout:1/653: symlink d6/ld3 0 2024-04-26T21:26:02.140 INFO:tasks.workunit.client.1.smithi120.stdout:9/669: fsync d0/d14/d77/fb1 0 2024-04-26T21:26:02.143 INFO:tasks.workunit.client.1.smithi120.stdout:1/654: truncate d6/d7/d2d/d98/fe 3385179 0 2024-04-26T21:26:02.145 INFO:tasks.workunit.client.1.smithi120.stdout:9/670: creat d0/d14/d77/d9a/fd7 x:0 0 0 2024-04-26T21:26:02.145 INFO:tasks.workunit.client.1.smithi120.stdout:3/726: dwrite dd/de/d83/db2/fb3 [0,4194304] 0 2024-04-26T21:26:02.145 INFO:tasks.workunit.client.1.smithi120.stdout:1/655: chown d6/daa 44 1 2024-04-26T21:26:02.147 INFO:tasks.workunit.client.1.smithi120.stdout:4/715: truncate d10/d12/fa7 2566560 0 2024-04-26T21:26:02.147 INFO:tasks.workunit.client.1.smithi120.stdout:3/727: fsync dd/de/d83/f3f 0 2024-04-26T21:26:02.148 INFO:tasks.workunit.client.1.smithi120.stdout:1/656: mkdir d6/d9/dd4 0 2024-04-26T21:26:02.155 INFO:tasks.workunit.client.1.smithi120.stdout:1/657: symlink d6/d7/d2d/ld5 0 2024-04-26T21:26:02.156 INFO:tasks.workunit.client.1.smithi120.stdout:1/658: stat d6/d7/d1b/c9e 0 2024-04-26T21:26:02.158 INFO:tasks.workunit.client.1.smithi120.stdout:3/728: rename dd/d2a/f5f to dd/de/df/dda/d8d/feb 0 2024-04-26T21:26:02.160 INFO:tasks.workunit.client.1.smithi120.stdout:3/729: read - dd/de/df/d12/d48/fc4 zero size 2024-04-26T21:26:02.162 INFO:tasks.workunit.client.1.smithi120.stdout:3/730: dread - dd/d40/fd7 zero size 2024-04-26T21:26:02.167 INFO:tasks.workunit.client.1.smithi120.stdout:4/716: dwrite d10/f2d [4194304,4194304] 0 2024-04-26T21:26:02.167 INFO:tasks.workunit.client.0.smithi084.stdout:9/456: rename da/de/d16/d25/d41/f76 to da/de/d16/d25/d41/d43/d48/fa8 0 2024-04-26T21:26:02.168 INFO:tasks.workunit.client.0.smithi084.stdout:2/622: mkdir d6/d7/d3d/d15/d1f/d22/dd4 0 2024-04-26T21:26:02.168 INFO:tasks.workunit.client.0.smithi084.stdout:1/517: creat d2/d54/d5e/d66/d2a/d2c/d45/fa4 x:0 0 0 2024-04-26T21:26:02.169 INFO:tasks.workunit.client.0.smithi084.stdout:4/456: creat d5/d10/f95 x:0 0 0 2024-04-26T21:26:02.170 INFO:tasks.workunit.client.1.smithi120.stdout:3/731: write dd/de/df/dda/d24/db1/d76/d3b/d56/d75/fbb [976147,1398] 0 2024-04-26T21:26:02.175 INFO:tasks.workunit.client.1.smithi120.stdout:3/732: mknod dd/de/df/dda/d37/cec 0 2024-04-26T21:26:02.175 INFO:tasks.workunit.client.0.smithi084.stdout:1/518: creat d2/d54/d5e/d66/d3a/d48/fa5 x:0 0 0 2024-04-26T21:26:02.176 INFO:tasks.workunit.client.1.smithi120.stdout:9/671: dwrite d0/dd/d3a/d5c/f9e [0,4194304] 0 2024-04-26T21:26:02.178 INFO:tasks.workunit.client.0.smithi084.stdout:2/623: rmdir d6/d75 0 2024-04-26T21:26:02.182 INFO:tasks.workunit.client.0.smithi084.stdout:9/457: rename da/de/d16/d25/f36 to da/de/d1e/d56/da6/fa9 0 2024-04-26T21:26:02.182 INFO:tasks.workunit.client.1.smithi120.stdout:9/672: mknod d0/d14/d77/d9a/cd8 0 2024-04-26T21:26:02.183 INFO:tasks.workunit.client.0.smithi084.stdout:8/522: dwrite d4/d6/db/d1e/d22/d39/f93 [0,4194304] 0 2024-04-26T21:26:02.184 INFO:tasks.workunit.client.0.smithi084.stdout:9/458: chown da/de/d16/d25/d41/d43/d48/f58 113973144 1 2024-04-26T21:26:02.185 INFO:tasks.workunit.client.0.smithi084.stdout:8/523: stat d4/d7/d15/d3c/f83 0 2024-04-26T21:26:02.186 INFO:tasks.workunit.client.1.smithi120.stdout:3/733: mkdir dd/de/d83/db2/ded 0 2024-04-26T21:26:02.189 INFO:tasks.workunit.client.0.smithi084.stdout:8/524: chown d4/d7/d15/d3c/f90 5 1 2024-04-26T21:26:02.189 INFO:tasks.workunit.client.1.smithi120.stdout:9/673: symlink d0/dd/d45/dc0/ld9 0 2024-04-26T21:26:02.190 INFO:tasks.workunit.client.1.smithi120.stdout:1/659: dwrite d6/d7/d1b/f81 [0,4194304] 0 2024-04-26T21:26:02.198 INFO:tasks.workunit.client.1.smithi120.stdout:4/717: dwrite d10/d6b/dbf/fc5 [0,4194304] 0 2024-04-26T21:26:02.200 INFO:tasks.workunit.client.1.smithi120.stdout:1/660: mknod d6/d7/d2d/d48/cd6 0 2024-04-26T21:26:02.201 INFO:tasks.workunit.client.0.smithi084.stdout:2/624: mknod d6/d7/d3d/d79/cd5 0 2024-04-26T21:26:02.202 INFO:tasks.workunit.client.0.smithi084.stdout:3/490: dread d1/d2c/d2f/f96 [0,4194304] 0 2024-04-26T21:26:02.202 INFO:tasks.workunit.client.0.smithi084.stdout:9/459: mkdir da/de/d16/d55/d93/d95/daa 0 2024-04-26T21:26:02.204 INFO:tasks.workunit.client.0.smithi084.stdout:4/457: link d5/d25/d35/d60/l74 d5/d7/l96 0 2024-04-26T21:26:02.204 INFO:tasks.workunit.client.1.smithi120.stdout:4/718: creat d10/d65/d7c/ff5 x:0 0 0 2024-04-26T21:26:02.205 INFO:tasks.workunit.client.0.smithi084.stdout:8/525: dread d4/d7/d15/d37/d3b/f89 [0,4194304] 0 2024-04-26T21:26:02.206 INFO:tasks.workunit.client.0.smithi084.stdout:1/519: rename d2/d9/d15/f58 to d2/d9/d67/fa6 0 2024-04-26T21:26:02.209 INFO:tasks.workunit.client.1.smithi120.stdout:9/674: dwrite d0/dd/f56 [0,4194304] 0 2024-04-26T21:26:02.211 INFO:tasks.workunit.client.0.smithi084.stdout:1/520: write d2/d54/d5e/d66/d2a/d72/f82 [624662,1984] 0 2024-04-26T21:26:02.212 INFO:tasks.workunit.client.0.smithi084.stdout:9/460: mkdir da/de/d16/d25/d41/dab 0 2024-04-26T21:26:02.213 INFO:tasks.workunit.client.1.smithi120.stdout:3/734: dwrite dd/de/df/dda/d24/d9d/d86/dd3/ddb/f9c [0,4194304] 0 2024-04-26T21:26:02.217 INFO:tasks.workunit.client.1.smithi120.stdout:9/675: dread - d0/dd/d3a/d5c/d98/fad zero size 2024-04-26T21:26:02.220 INFO:tasks.workunit.client.0.smithi084.stdout:7/507: sync 2024-04-26T21:26:02.221 INFO:tasks.workunit.client.1.smithi120.stdout:9/676: dread - d0/dd/d3a/d5c/d98/fad zero size 2024-04-26T21:26:02.226 INFO:tasks.workunit.client.0.smithi084.stdout:3/491: mknod d1/d2c/d2f/d31/ca3 0 2024-04-26T21:26:02.228 INFO:tasks.workunit.client.0.smithi084.stdout:4/458: getdents d5/d25/d35 0 2024-04-26T21:26:02.228 INFO:tasks.workunit.client.0.smithi084.stdout:3/492: dread - d1/d2c/d2f/d31/d55/d4e/d7c/f87 zero size 2024-04-26T21:26:02.229 INFO:tasks.workunit.client.1.smithi120.stdout:9/677: symlink d0/d6/d4d/lda 0 2024-04-26T21:26:02.231 INFO:tasks.workunit.client.0.smithi084.stdout:3/493: stat d1/d24/fa2 0 2024-04-26T21:26:02.231 INFO:tasks.workunit.client.0.smithi084.stdout:1/521: rename d2/d9/c53 to d2/d19/ca7 0 2024-04-26T21:26:02.231 INFO:tasks.workunit.client.1.smithi120.stdout:1/661: dread d6/d9/f84 [0,4194304] 0 2024-04-26T21:26:02.233 INFO:tasks.workunit.client.0.smithi084.stdout:3/494: fdatasync d1/d2c/d2f/d31/d3b/f74 0 2024-04-26T21:26:02.234 INFO:tasks.workunit.client.0.smithi084.stdout:7/508: mkdir d6/d9/d12/d8b/d72/da0/d80/daa 0 2024-04-26T21:26:02.234 INFO:tasks.workunit.client.1.smithi120.stdout:7/739: sync 2024-04-26T21:26:02.235 INFO:tasks.workunit.client.0.smithi084.stdout:1/522: rename d2/d54/d5e to d2/d54/d5e/d66/d3a/da8 22 2024-04-26T21:26:02.235 INFO:tasks.workunit.client.0.smithi084.stdout:8/526: creat d4/d3a/d8c/f95 x:0 0 0 2024-04-26T21:26:02.236 INFO:tasks.workunit.client.1.smithi120.stdout:1/662: unlink d6/d14/l4d 0 2024-04-26T21:26:02.236 INFO:tasks.workunit.client.0.smithi084.stdout:1/523: fdatasync d2/d19/f32 0 2024-04-26T21:26:02.237 INFO:tasks.workunit.client.1.smithi120.stdout:9/678: creat d0/d6/fdb x:0 0 0 2024-04-26T21:26:02.238 INFO:tasks.workunit.client.0.smithi084.stdout:2/625: getdents d6/d7/d3d/d15/d1f/d22/d2a 0 2024-04-26T21:26:02.240 INFO:tasks.workunit.client.0.smithi084.stdout:4/459: mkdir d5/d25/d35/d97 0 2024-04-26T21:26:02.241 INFO:tasks.workunit.client.1.smithi120.stdout:1/663: mkdir d6/dd7 0 2024-04-26T21:26:02.241 INFO:tasks.workunit.client.0.smithi084.stdout:2/626: stat d6/d7/d3d/d15/d1f/d22/f86 0 2024-04-26T21:26:02.241 INFO:tasks.workunit.client.1.smithi120.stdout:7/740: creat d7/d64/da6/d1a/dc2/ffb x:0 0 0 2024-04-26T21:26:02.242 INFO:tasks.workunit.client.1.smithi120.stdout:7/741: readlink d7/lb 0 2024-04-26T21:26:02.245 INFO:tasks.workunit.client.0.smithi084.stdout:1/524: dread d2/d54/d5e/d66/d2a/d72/f82 [0,4194304] 0 2024-04-26T21:26:02.245 INFO:tasks.workunit.client.1.smithi120.stdout:1/664: mknod d6/d14/cd8 0 2024-04-26T21:26:02.247 INFO:tasks.workunit.client.0.smithi084.stdout:7/509: symlink d6/d9/d12/d19/d7a/lab 0 2024-04-26T21:26:02.248 INFO:tasks.workunit.client.0.smithi084.stdout:8/527: unlink d4/d7/d15/d3c/c76 0 2024-04-26T21:26:02.249 INFO:tasks.workunit.client.1.smithi120.stdout:1/665: write d6/d7/d1b/fc7 [67174,116427] 0 2024-04-26T21:26:02.250 INFO:tasks.workunit.client.0.smithi084.stdout:9/461: write da/de/d1e/d56/f5c [584853,7813] 0 2024-04-26T21:26:02.251 INFO:tasks.workunit.client.0.smithi084.stdout:8/528: write d4/d7/d15/d3c/f7d [212659,111697] 0 2024-04-26T21:26:02.252 INFO:tasks.workunit.client.1.smithi120.stdout:1/666: write d6/d7/ff [4722023,74847] 0 2024-04-26T21:26:02.258 INFO:tasks.workunit.client.0.smithi084.stdout:7/510: creat d6/d9/d12/d19/d7a/d84/fac x:0 0 0 2024-04-26T21:26:02.259 INFO:tasks.workunit.client.1.smithi120.stdout:1/667: unlink d6/d14/d6f/f8e 0 2024-04-26T21:26:02.262 INFO:tasks.workunit.client.1.smithi120.stdout:1/668: chown d6/d14/f16 2 1 2024-04-26T21:26:02.263 INFO:tasks.workunit.client.0.smithi084.stdout:9/462: symlink da/de/d16/d55/d93/lac 0 2024-04-26T21:26:02.264 INFO:tasks.workunit.client.0.smithi084.stdout:6/523: sync 2024-04-26T21:26:02.264 INFO:tasks.workunit.client.0.smithi084.stdout:1/525: dwrite d2/f92 [0,4194304] 0 2024-04-26T21:26:02.267 INFO:tasks.workunit.client.0.smithi084.stdout:7/511: rmdir d6/d1c/d51 39 2024-04-26T21:26:02.267 INFO:tasks.workunit.client.1.smithi120.stdout:7/742: dwrite d7/fe [0,4194304] 0 2024-04-26T21:26:02.268 INFO:tasks.workunit.client.1.smithi120.stdout:1/669: truncate d6/daa/dae/f9a 1007764 0 2024-04-26T21:26:02.269 INFO:tasks.workunit.client.0.smithi084.stdout:3/495: getdents d1/d2c/d2f/d31/d55 0 2024-04-26T21:26:02.272 INFO:tasks.workunit.client.0.smithi084.stdout:4/460: rename d5/d7/c43 to d5/d2e/d5f/c98 0 2024-04-26T21:26:02.273 INFO:tasks.workunit.client.0.smithi084.stdout:1/526: dread d2/d19/f40 [0,4194304] 0 2024-04-26T21:26:02.274 INFO:tasks.workunit.client.0.smithi084.stdout:2/627: dwrite d6/d7/d3d/d15/d1f/d39/f48 [0,4194304] 0 2024-04-26T21:26:02.274 INFO:tasks.workunit.client.1.smithi120.stdout:3/735: dread dd/de/df/dda/d24/f3a [0,4194304] 0 2024-04-26T21:26:02.274 INFO:tasks.workunit.client.0.smithi084.stdout:8/529: mkdir d4/d6/db/d1e/d22/d96 0 2024-04-26T21:26:02.276 INFO:tasks.workunit.client.0.smithi084.stdout:6/524: mknod d3/de/d9e/caf 0 2024-04-26T21:26:02.278 INFO:tasks.workunit.client.0.smithi084.stdout:8/530: chown d4/d7/d15/d37/d52/d69/c85 89026910 1 2024-04-26T21:26:02.280 INFO:tasks.workunit.client.1.smithi120.stdout:1/670: read d6/d7/d2d/d48/d86/fa7 [4488216,10813] 0 2024-04-26T21:26:02.280 INFO:tasks.workunit.client.1.smithi120.stdout:1/671: write d6/d7/d1b/f81 [1977712,123583] 0 2024-04-26T21:26:02.283 INFO:tasks.workunit.client.0.smithi084.stdout:9/463: write da/de/d16/d25/f3c [2108552,71511] 0 2024-04-26T21:26:02.283 INFO:tasks.workunit.client.0.smithi084.stdout:3/496: mkdir d1/d2c/d2f/d31/d55/da4 0 2024-04-26T21:26:02.285 INFO:tasks.workunit.client.0.smithi084.stdout:8/531: chown d4/d6/db/l5a 0 1 2024-04-26T21:26:02.286 INFO:tasks.workunit.client.1.smithi120.stdout:3/736: truncate dd/de/df/dda/d37/f78 1437344 0 2024-04-26T21:26:02.288 INFO:tasks.workunit.client.1.smithi120.stdout:9/679: dread d0/d6/d3d/f75 [0,4194304] 0 2024-04-26T21:26:02.289 INFO:tasks.workunit.client.1.smithi120.stdout:1/672: getdents d6/d7/d1d/d5d 0 2024-04-26T21:26:02.290 INFO:tasks.workunit.client.1.smithi120.stdout:9/680: truncate d0/d66/d93/db7/d9b/fab 4860344 0 2024-04-26T21:26:02.292 INFO:tasks.workunit.client.1.smithi120.stdout:3/737: mkdir dd/de/df/d12/d48/d9b/dcb/dee 0 2024-04-26T21:26:02.295 INFO:tasks.workunit.client.0.smithi084.stdout:6/525: rmdir d3/de/d15/d5f 39 2024-04-26T21:26:02.296 INFO:tasks.workunit.client.0.smithi084.stdout:2/628: dread - d6/d7/d3d/fac zero size 2024-04-26T21:26:02.297 INFO:tasks.workunit.client.0.smithi084.stdout:3/497: creat d1/d2c/d2f/d31/d52/fa5 x:0 0 0 2024-04-26T21:26:02.298 INFO:tasks.workunit.client.1.smithi120.stdout:7/743: dwrite d7/d64/da6/f16 [4194304,4194304] 0 2024-04-26T21:26:02.300 INFO:tasks.workunit.client.0.smithi084.stdout:6/526: dread - d3/de/d1a/d43/f57 zero size 2024-04-26T21:26:02.300 INFO:tasks.workunit.client.0.smithi084.stdout:8/532: rename d4/d7/c10 to d4/d6/db/d1e/d22/d39/d4a/c97 0 2024-04-26T21:26:02.302 INFO:tasks.workunit.client.0.smithi084.stdout:9/464: dwrite da/de/d16/d25/f3c [0,4194304] 0 2024-04-26T21:26:02.303 INFO:tasks.workunit.client.0.smithi084.stdout:2/629: mknod d6/d1b/cd6 0 2024-04-26T21:26:02.305 INFO:tasks.workunit.client.0.smithi084.stdout:4/461: getdents d5/d10/d15/d21 0 2024-04-26T21:26:02.313 INFO:tasks.workunit.client.0.smithi084.stdout:6/527: dread d3/de/d15/df/f1b [0,4194304] 0 2024-04-26T21:26:02.314 INFO:tasks.workunit.client.0.smithi084.stdout:2/630: rename d6/d7/d3d/d15/d1f/c23 to d6/d7/d3d/d79/d81/d82/cd7 0 2024-04-26T21:26:02.316 INFO:tasks.workunit.client.0.smithi084.stdout:9/465: unlink da/f45 0 2024-04-26T21:26:02.316 INFO:tasks.workunit.client.0.smithi084.stdout:8/533: symlink d4/d7/l98 0 2024-04-26T21:26:02.320 INFO:tasks.workunit.client.0.smithi084.stdout:6/528: creat d3/de/d1a/fb0 x:0 0 0 2024-04-26T21:26:02.322 INFO:tasks.workunit.client.0.smithi084.stdout:8/534: chown d4/d7/d15/d37/d52 14 1 2024-04-26T21:26:02.324 INFO:tasks.workunit.client.0.smithi084.stdout:1/527: dread d2/d1b/f8b [0,4194304] 0 2024-04-26T21:26:02.324 INFO:tasks.workunit.client.0.smithi084.stdout:6/529: write d3/de/d1a/d43/f57 [989216,104697] 0 2024-04-26T21:26:02.325 INFO:tasks.workunit.client.0.smithi084.stdout:2/631: write d6/d7/d3d/d15/d1f/d39/d20/fbb [568800,56311] 0 2024-04-26T21:26:02.327 INFO:tasks.workunit.client.0.smithi084.stdout:9/466: creat da/de/d16/d25/d41/d8d/fad x:0 0 0 2024-04-26T21:26:02.330 INFO:tasks.workunit.client.0.smithi084.stdout:4/462: dread d5/d2e/d5f/f51 [0,4194304] 0 2024-04-26T21:26:02.330 INFO:tasks.workunit.client.0.smithi084.stdout:5/538: sync 2024-04-26T21:26:02.330 INFO:tasks.workunit.client.0.smithi084.stdout:0/503: sync 2024-04-26T21:26:02.330 INFO:tasks.workunit.client.0.smithi084.stdout:6/530: dread - d3/de/d15/f76 zero size 2024-04-26T21:26:02.331 INFO:tasks.workunit.client.0.smithi084.stdout:1/528: mknod d2/d9/d15/d28/da0/ca9 0 2024-04-26T21:26:02.332 INFO:tasks.workunit.client.0.smithi084.stdout:2/632: dread - d6/d3e/d67/f8f zero size 2024-04-26T21:26:02.332 INFO:tasks.workunit.client.0.smithi084.stdout:0/504: chown de/d71/f57 57887 1 2024-04-26T21:26:02.333 INFO:tasks.workunit.client.0.smithi084.stdout:0/505: stat de/l19 0 2024-04-26T21:26:02.333 INFO:tasks.workunit.client.0.smithi084.stdout:4/463: write d5/d2e/d5f/d32/f34 [4540182,15874] 0 2024-04-26T21:26:02.334 INFO:tasks.workunit.client.0.smithi084.stdout:7/512: dread d6/d26/f30 [0,4194304] 0 2024-04-26T21:26:02.337 INFO:tasks.workunit.client.0.smithi084.stdout:1/529: creat d2/d54/d93/faa x:0 0 0 2024-04-26T21:26:02.338 INFO:tasks.workunit.client.0.smithi084.stdout:7/513: write d6/d1c/fa5 [723142,15250] 0 2024-04-26T21:26:02.339 INFO:tasks.workunit.client.0.smithi084.stdout:4/464: mkdir d5/d25/d99 0 2024-04-26T21:26:02.339 INFO:tasks.workunit.client.0.smithi084.stdout:5/539: truncate d0/dc/df/d31/d53/d87/f99 4914730 0 2024-04-26T21:26:02.340 INFO:tasks.workunit.client.0.smithi084.stdout:2/633: creat d6/d7/d3d/d79/dbe/fd8 x:0 0 0 2024-04-26T21:26:02.343 INFO:tasks.workunit.client.0.smithi084.stdout:5/540: write d0/d49/f8d [42270,8069] 0 2024-04-26T21:26:02.344 INFO:tasks.workunit.client.0.smithi084.stdout:4/465: read d5/fe [1713123,88102] 0 2024-04-26T21:26:02.346 INFO:tasks.workunit.client.0.smithi084.stdout:0/506: truncate de/d2b/d77/d32/f8d 181130 0 2024-04-26T21:26:02.347 INFO:tasks.workunit.client.0.smithi084.stdout:5/541: fsync d0/d49/f95 0 2024-04-26T21:26:02.347 INFO:tasks.workunit.client.0.smithi084.stdout:4/466: unlink d5/d7/l6c 0 2024-04-26T21:26:02.347 INFO:tasks.workunit.client.0.smithi084.stdout:3/498: dwrite d1/d2c/d2f/d31/f37 [4194304,4194304] 0 2024-04-26T21:26:02.348 INFO:tasks.workunit.client.0.smithi084.stdout:0/507: dread - de/f83 zero size 2024-04-26T21:26:02.350 INFO:tasks.workunit.client.0.smithi084.stdout:5/542: fsync d0/dc/df/d6d/f70 0 2024-04-26T21:26:02.353 INFO:tasks.workunit.client.0.smithi084.stdout:0/508: fsync de/d20/f5e 0 2024-04-26T21:26:02.354 INFO:tasks.workunit.client.0.smithi084.stdout:2/634: write f0 [479067,106744] 0 2024-04-26T21:26:02.355 INFO:tasks.workunit.client.0.smithi084.stdout:0/509: fdatasync de/d2b/d77/d32/f8d 0 2024-04-26T21:26:02.358 INFO:tasks.workunit.client.0.smithi084.stdout:3/499: chown d1/d2c/d2f/d31/d55 364 1 2024-04-26T21:26:02.361 INFO:tasks.workunit.client.0.smithi084.stdout:0/510: rmdir de/d2b/d45/d63 39 2024-04-26T21:26:02.362 INFO:tasks.workunit.client.0.smithi084.stdout:7/514: dwrite d6/d9/d63/f7b [0,4194304] 0 2024-04-26T21:26:02.363 INFO:tasks.workunit.client.0.smithi084.stdout:0/511: chown de/d2b/d45/d94 219110 1 2024-04-26T21:26:02.364 INFO:tasks.workunit.client.0.smithi084.stdout:2/635: write d6/d7/d68/f6f [872729,8924] 0 2024-04-26T21:26:02.367 INFO:tasks.workunit.client.0.smithi084.stdout:3/500: rename d1/d24/fa2 to d1/d24/d27/d3a/d81/fa6 0 2024-04-26T21:26:02.367 INFO:tasks.workunit.client.0.smithi084.stdout:7/515: rename d6/d9 to d6/d9/d12/d19/d8f/dad 22 2024-04-26T21:26:02.367 INFO:tasks.workunit.client.0.smithi084.stdout:2/636: dread - d6/d1b/f7e zero size 2024-04-26T21:26:02.369 INFO:tasks.workunit.client.0.smithi084.stdout:3/501: read - d1/d24/d27/d3a/f9f zero size 2024-04-26T21:26:02.370 INFO:tasks.workunit.client.0.smithi084.stdout:4/467: dwrite d5/d25/f3e [0,4194304] 0 2024-04-26T21:26:02.372 INFO:tasks.workunit.client.0.smithi084.stdout:7/516: creat d6/d68/d7f/fae x:0 0 0 2024-04-26T21:26:02.374 INFO:tasks.workunit.client.0.smithi084.stdout:0/512: fdatasync de/f1f 0 2024-04-26T21:26:02.375 INFO:tasks.workunit.client.0.smithi084.stdout:3/502: fsync d1/f1a 0 2024-04-26T21:26:02.375 INFO:tasks.workunit.client.0.smithi084.stdout:4/468: dread d5/d2e/d5f/f51 [0,4194304] 0 2024-04-26T21:26:02.376 INFO:tasks.workunit.client.0.smithi084.stdout:2/637: mkdir d6/d7/d3d/d4f/d90/dd9 0 2024-04-26T21:26:02.376 INFO:tasks.workunit.client.0.smithi084.stdout:7/517: unlink d6/d26/c74 0 2024-04-26T21:26:02.379 INFO:tasks.workunit.client.0.smithi084.stdout:4/469: chown d5/d25/d35/d60 119 1 2024-04-26T21:26:02.381 INFO:tasks.workunit.client.0.smithi084.stdout:3/503: creat d1/d24/d27/d3a/fa7 x:0 0 0 2024-04-26T21:26:02.381 INFO:tasks.workunit.client.0.smithi084.stdout:2/638: readlink d6/d7/d3d/d15/d1f/d39/d20/d45/d5a/l6a 0 2024-04-26T21:26:02.381 INFO:tasks.workunit.client.0.smithi084.stdout:7/518: stat d6/d9/d12/d19/d20 0 2024-04-26T21:26:02.383 INFO:tasks.workunit.client.0.smithi084.stdout:0/513: link de/d2b/d77/d68/l92 de/d20/d4c/la5 0 2024-04-26T21:26:02.384 INFO:tasks.workunit.client.0.smithi084.stdout:7/519: creat d6/d26/faf x:0 0 0 2024-04-26T21:26:02.386 INFO:tasks.workunit.client.1.smithi120.stdout:3/738: link dd/de/df/db6/fd1 dd/de/df/dda/d24/d9d/d86/dd3/ddb/fef 0 2024-04-26T21:26:02.386 INFO:tasks.workunit.client.1.smithi120.stdout:7/744: mkdir d7/d64/da6/d1f/d28/d4c/d6b/dfc 0 2024-04-26T21:26:02.388 INFO:tasks.workunit.client.0.smithi084.stdout:7/520: read d6/d9/d12/d19/f70 [196723,5395] 0 2024-04-26T21:26:02.389 INFO:tasks.workunit.client.1.smithi120.stdout:1/673: dwrite d6/d7/d1b/d3b/fce [0,4194304] 0 2024-04-26T21:26:02.394 INFO:tasks.workunit.client.0.smithi084.stdout:7/521: mknod d6/d9/cb0 0 2024-04-26T21:26:02.394 INFO:tasks.workunit.client.1.smithi120.stdout:3/739: write dd/de/d83/fa7 [564972,56086] 0 2024-04-26T21:26:02.395 INFO:tasks.workunit.client.1.smithi120.stdout:7/745: fdatasync d7/d10/f11 0 2024-04-26T21:26:02.396 INFO:tasks.workunit.client.1.smithi120.stdout:1/674: mknod d6/dd7/cd9 0 2024-04-26T21:26:02.396 INFO:tasks.workunit.client.0.smithi084.stdout:4/470: dread d5/d10/f1b [0,4194304] 0 2024-04-26T21:26:02.397 INFO:tasks.workunit.client.0.smithi084.stdout:3/504: dread d1/d2c/d2f/d31/d3b/f44 [0,4194304] 0 2024-04-26T21:26:02.397 INFO:tasks.workunit.client.1.smithi120.stdout:3/740: fsync dd/de/d83/d64/fa4 0 2024-04-26T21:26:02.399 INFO:tasks.workunit.client.0.smithi084.stdout:7/522: mknod d6/d9/d12/d8b/cb1 0 2024-04-26T21:26:02.400 INFO:tasks.workunit.client.0.smithi084.stdout:4/471: write d5/d7/d65/f76 [290104,97532] 0 2024-04-26T21:26:02.401 INFO:tasks.workunit.client.0.smithi084.stdout:7/523: readlink d6/l18 0 2024-04-26T21:26:02.402 INFO:tasks.workunit.client.0.smithi084.stdout:4/472: fsync d5/d2e/f88 0 2024-04-26T21:26:02.402 INFO:tasks.workunit.client.0.smithi084.stdout:2/639: dread d6/d7/d3d/d15/d1f/f32 [0,4194304] 0 2024-04-26T21:26:02.403 INFO:tasks.workunit.client.1.smithi120.stdout:3/741: truncate dd/de/df/d12/d48/d9b/dcb/fdc 643951 0 2024-04-26T21:26:02.404 INFO:tasks.workunit.client.0.smithi084.stdout:0/514: rmdir de/d2b/d77/d68 39 2024-04-26T21:26:02.405 INFO:tasks.workunit.client.0.smithi084.stdout:7/524: symlink d6/d26/d40/lb2 0 2024-04-26T21:26:02.406 INFO:tasks.workunit.client.0.smithi084.stdout:4/473: fdatasync d5/d10/d15/f5b 0 2024-04-26T21:26:02.407 INFO:tasks.workunit.client.1.smithi120.stdout:7/746: rename d7/d64/da6/d1f/d28/ff5 to d7/d64/da6/d1a/d33/d34/ffd 0 2024-04-26T21:26:02.408 INFO:tasks.workunit.client.0.smithi084.stdout:2/640: creat d6/d7/d3d/d15/d1f/d39/da5/fda x:0 0 0 2024-04-26T21:26:02.411 INFO:tasks.workunit.client.0.smithi084.stdout:7/525: read d6/f17 [2161501,24982] 0 2024-04-26T21:26:02.411 INFO:tasks.workunit.client.0.smithi084.stdout:4/474: mkdir d5/d7/d65/d90/d91/d9a 0 2024-04-26T21:26:02.412 INFO:tasks.workunit.client.1.smithi120.stdout:3/742: link dd/de/l10 dd/de/lf0 0 2024-04-26T21:26:02.413 INFO:tasks.workunit.client.0.smithi084.stdout:0/515: getdents de/d2b/d77/d32/d96 0 2024-04-26T21:26:02.413 INFO:tasks.workunit.client.0.smithi084.stdout:4/475: read - d5/d2e/d5f/f8a zero size 2024-04-26T21:26:02.414 INFO:tasks.workunit.client.1.smithi120.stdout:1/675: dwrite d6/dcc/fd2 [0,4194304] 0 2024-04-26T21:26:02.415 INFO:tasks.workunit.client.0.smithi084.stdout:7/526: mkdir d6/d9/db3 0 2024-04-26T21:26:02.417 INFO:tasks.workunit.client.0.smithi084.stdout:0/516: chown de/d2b/d45/d63/f86 288875198 1 2024-04-26T21:26:02.419 INFO:tasks.workunit.client.1.smithi120.stdout:3/743: truncate dd/de/df/dda/f22 4914052 0 2024-04-26T21:26:02.420 INFO:tasks.workunit.client.1.smithi120.stdout:1/676: dread - d6/d7/d1d/d2c/fcd zero size 2024-04-26T21:26:02.421 INFO:tasks.workunit.client.0.smithi084.stdout:3/505: dwrite d1/d2c/d2f/d31/f37 [0,4194304] 0 2024-04-26T21:26:02.423 INFO:tasks.workunit.client.0.smithi084.stdout:7/527: mknod d6/d9/d12/d19/d20/d38/cb4 0 2024-04-26T21:26:02.424 INFO:tasks.workunit.client.1.smithi120.stdout:1/677: symlink d6/d7/lda 0 2024-04-26T21:26:02.427 INFO:tasks.workunit.client.1.smithi120.stdout:3/744: truncate dd/de/d83/db2/fcd 782981 0 2024-04-26T21:26:02.432 INFO:tasks.workunit.client.1.smithi120.stdout:3/745: symlink dd/de/d83/lf1 0 2024-04-26T21:26:02.436 INFO:tasks.workunit.client.0.smithi084.stdout:4/476: dread d5/f2b [0,4194304] 0 2024-04-26T21:26:02.436 INFO:tasks.workunit.client.1.smithi120.stdout:3/746: rmdir dd/dcf 39 2024-04-26T21:26:02.437 INFO:tasks.workunit.client.1.smithi120.stdout:7/747: dwrite d7/d64/da6/f95 [4194304,4194304] 0 2024-04-26T21:26:02.439 INFO:tasks.workunit.client.0.smithi084.stdout:4/477: write d5/d7/f63 [1118082,117760] 0 2024-04-26T21:26:02.447 INFO:tasks.workunit.client.1.smithi120.stdout:7/748: mknod d7/d64/da6/d1f/d28/dbb/dcf/cfe 0 2024-04-26T21:26:02.448 INFO:tasks.workunit.client.1.smithi120.stdout:3/747: symlink dd/de/df/dda/de6/lf2 0 2024-04-26T21:26:02.449 INFO:tasks.workunit.client.1.smithi120.stdout:1/678: dread d6/d7/d1b/f81 [0,4194304] 0 2024-04-26T21:26:02.453 INFO:tasks.workunit.client.1.smithi120.stdout:1/679: write d6/d7/d1d/f9b [3308790,41399] 0 2024-04-26T21:26:02.457 INFO:tasks.workunit.client.1.smithi120.stdout:1/680: readlink d6/d7/d2d/d98/l64 0 2024-04-26T21:26:02.458 INFO:tasks.workunit.client.1.smithi120.stdout:3/748: rename dd/de/d83/d64/db0/l7d to dd/dcf/dea/lf3 0 2024-04-26T21:26:02.460 INFO:tasks.workunit.client.1.smithi120.stdout:1/681: write d6/d14/d3c/dab/fc4 [778002,55270] 0 2024-04-26T21:26:02.463 INFO:tasks.workunit.client.1.smithi120.stdout:3/749: mknod dd/de/df/db6/dc5/cf4 0 2024-04-26T21:26:02.466 INFO:tasks.workunit.client.1.smithi120.stdout:3/750: readlink dd/de/df/lca 0 2024-04-26T21:26:02.468 INFO:tasks.workunit.client.0.smithi084.stdout:2/641: truncate d6/d7/d3d/d15/d1f/d39/fc 4141630 0 2024-04-26T21:26:02.469 INFO:tasks.workunit.client.0.smithi084.stdout:7/528: unlink d6/d9/d12/d8b/d72/da0/d80/c9b 0 2024-04-26T21:26:02.470 INFO:tasks.workunit.client.1.smithi120.stdout:7/749: truncate d7/d64/da6/d1f/d28/d4c/d6b/d7b/f80 7222086 0 2024-04-26T21:26:02.472 INFO:tasks.workunit.client.1.smithi120.stdout:3/751: truncate dd/d2a/f8b 1417476 0 2024-04-26T21:26:02.473 INFO:tasks.workunit.client.1.smithi120.stdout:0/857: sync 2024-04-26T21:26:02.474 INFO:tasks.workunit.client.1.smithi120.stdout:7/750: symlink d7/d64/da6/d1a/d33/d34/dab/dbf/lff 0 2024-04-26T21:26:02.474 INFO:tasks.workunit.client.1.smithi120.stdout:1/682: dread d6/d7/d1b/f8a [0,4194304] 0 2024-04-26T21:26:02.475 INFO:tasks.workunit.client.1.smithi120.stdout:0/858: stat d0/df/d59 0 2024-04-26T21:26:02.475 INFO:tasks.workunit.client.1.smithi120.stdout:3/752: mknod dd/de/d83/d64/db0/cf5 0 2024-04-26T21:26:02.476 INFO:tasks.workunit.client.0.smithi084.stdout:0/517: unlink de/d2b/d77/d32/l8f 0 2024-04-26T21:26:02.478 INFO:tasks.workunit.client.1.smithi120.stdout:7/751: symlink d7/d10/d97/d99/l100 0 2024-04-26T21:26:02.478 INFO:tasks.workunit.client.1.smithi120.stdout:0/859: chown d0/d3/dc/dd/d1b/d39/f50 9182 1 2024-04-26T21:26:02.479 INFO:tasks.workunit.client.0.smithi084.stdout:3/506: mkdir d1/d2c/d2f/d31/da8 0 2024-04-26T21:26:02.480 INFO:tasks.workunit.client.1.smithi120.stdout:3/753: mknod dd/de/df/d12/d48/d9b/cf6 0 2024-04-26T21:26:02.485 INFO:tasks.workunit.client.1.smithi120.stdout:3/754: creat dd/de/df/dda/d24/d43/ff7 x:0 0 0 2024-04-26T21:26:02.487 INFO:tasks.workunit.client.0.smithi084.stdout:0/518: creat de/d78/fa6 x:0 0 0 2024-04-26T21:26:02.490 INFO:tasks.workunit.client.1.smithi120.stdout:3/755: fdatasync dd/de/df/dda/d24/d43/f47 0 2024-04-26T21:26:02.490 INFO:tasks.workunit.client.0.smithi084.stdout:2/642: mknod d6/d3e/d67/dcf/cdb 0 2024-04-26T21:26:02.495 INFO:tasks.workunit.client.1.smithi120.stdout:1/683: dwrite d6/d7/d2d/d98/f42 [0,4194304] 0 2024-04-26T21:26:02.495 INFO:tasks.workunit.client.0.smithi084.stdout:0/519: mkdir de/d2b/d45/d63/da7 0 2024-04-26T21:26:02.497 INFO:tasks.workunit.client.1.smithi120.stdout:0/860: write d0/d3/dc/dd/f21 [3765872,107804] 0 2024-04-26T21:26:02.498 INFO:tasks.workunit.client.0.smithi084.stdout:2/643: creat d6/d7/d3d/d79/dbe/fdc x:0 0 0 2024-04-26T21:26:02.499 INFO:tasks.workunit.client.1.smithi120.stdout:7/752: write d7/d19/fbc [423266,83044] 0 2024-04-26T21:26:02.500 INFO:tasks.workunit.client.0.smithi084.stdout:0/520: truncate de/d2b/d64/d81/f89 581058 0 2024-04-26T21:26:02.501 INFO:tasks.workunit.client.1.smithi120.stdout:1/684: read d6/d7/d1d/f50 [4628581,54177] 0 2024-04-26T21:26:02.504 INFO:tasks.workunit.client.1.smithi120.stdout:7/753: chown d7/d19/d60/de6/de8 1810 1 2024-04-26T21:26:02.505 INFO:tasks.workunit.client.1.smithi120.stdout:0/861: rmdir d0/d3/d51/d97/d108/d5a 39 2024-04-26T21:26:02.505 INFO:tasks.workunit.client.0.smithi084.stdout:7/529: getdents d6/d9/d89 0 2024-04-26T21:26:02.505 INFO:tasks.workunit.client.0.smithi084.stdout:3/507: creat d1/d2c/d2f/d31/d55/d4e/d98/d9e/fa9 x:0 0 0 2024-04-26T21:26:02.508 INFO:tasks.workunit.client.1.smithi120.stdout:0/862: write d0/d3/dc/d12/f42 [484937,29512] 0 2024-04-26T21:26:02.508 INFO:tasks.workunit.client.0.smithi084.stdout:2/644: rmdir d6/d7/d3d/d15/d1f/d39/d20/d45 39 2024-04-26T21:26:02.511 INFO:tasks.workunit.client.1.smithi120.stdout:3/756: dread dd/de/df/dda/d24/db1/d76/fb4 [0,4194304] 0 2024-04-26T21:26:02.512 INFO:tasks.workunit.client.1.smithi120.stdout:7/754: dread d7/d64/da6/d1f/f88 [0,4194304] 0 2024-04-26T21:26:02.515 INFO:tasks.workunit.client.1.smithi120.stdout:0/863: creat d0/d3/dc/dd/d1b/d24/d7d/d9f/f11a x:0 0 0 2024-04-26T21:26:02.516 INFO:tasks.workunit.client.0.smithi084.stdout:7/530: mkdir d6/d9/d63/db5 0 2024-04-26T21:26:02.518 INFO:tasks.workunit.client.1.smithi120.stdout:7/755: dread - d7/d10/fe7 zero size 2024-04-26T21:26:02.519 INFO:tasks.workunit.client.0.smithi084.stdout:2/645: symlink d6/d3e/d67/ldd 0 2024-04-26T21:26:02.520 INFO:tasks.workunit.client.0.smithi084.stdout:2/646: stat d6/d7/d3d/d79/c96 0 2024-04-26T21:26:02.523 INFO:tasks.workunit.client.1.smithi120.stdout:0/864: mkdir d0/d3/d51/d70/d10a/d11b 0 2024-04-26T21:26:02.524 INFO:tasks.workunit.client.0.smithi084.stdout:7/531: write d6/d1c/f4e [5035893,39573] 0 2024-04-26T21:26:02.525 INFO:tasks.workunit.client.1.smithi120.stdout:7/756: fdatasync d7/d64/da6/d1a/d33/fbe 0 2024-04-26T21:26:02.526 INFO:tasks.workunit.client.0.smithi084.stdout:7/532: chown d6/d9/d12/d8b/d72/da0/d80 327389877 1 2024-04-26T21:26:02.528 INFO:tasks.workunit.client.1.smithi120.stdout:6/760: sync 2024-04-26T21:26:02.529 INFO:tasks.workunit.client.1.smithi120.stdout:1/685: dwrite d6/d7/d2d/d48/fbe [0,4194304] 0 2024-04-26T21:26:02.530 INFO:tasks.workunit.client.1.smithi120.stdout:0/865: read d0/d3/d51/d97/d108/f60 [2985739,29237] 0 2024-04-26T21:26:02.533 INFO:tasks.workunit.client.0.smithi084.stdout:2/647: unlink d6/d7/d3d/d15/d1f/d39/c29 0 2024-04-26T21:26:02.534 INFO:tasks.workunit.client.0.smithi084.stdout:2/648: fsync d6/d7/d68/fa2 0 2024-04-26T21:26:02.535 INFO:tasks.workunit.client.0.smithi084.stdout:7/533: creat d6/d9/d12/d8b/d72/da0/fb6 x:0 0 0 2024-04-26T21:26:02.536 INFO:tasks.workunit.client.0.smithi084.stdout:2/649: fdatasync d6/d7/d68/fa2 0 2024-04-26T21:26:02.540 INFO:tasks.workunit.client.1.smithi120.stdout:3/757: dwrite dd/de/d83/f45 [0,4194304] 0 2024-04-26T21:26:02.541 INFO:tasks.workunit.client.0.smithi084.stdout:7/534: creat d6/d9/d12/d8b/d72/fb7 x:0 0 0 2024-04-26T21:26:02.544 INFO:tasks.workunit.client.1.smithi120.stdout:7/757: mknod d7/d64/da6/d1f/d7d/d8b/d94/c101 0 2024-04-26T21:26:02.546 INFO:tasks.workunit.client.1.smithi120.stdout:3/758: creat dd/de/df/dda/d8d/ff8 x:0 0 0 2024-04-26T21:26:02.548 INFO:tasks.workunit.client.0.smithi084.stdout:7/535: mknod d6/d9/d12/d19/d20/d32/cb8 0 2024-04-26T21:26:02.549 INFO:tasks.workunit.client.1.smithi120.stdout:7/758: unlink d7/d64/da6/d1f/f88 0 2024-04-26T21:26:02.552 INFO:tasks.workunit.client.1.smithi120.stdout:0/866: creat d0/d3/dc/dd/f11c x:0 0 0 2024-04-26T21:26:02.554 INFO:tasks.workunit.client.1.smithi120.stdout:3/759: getdents dd/de/d83/db2/ded 0 2024-04-26T21:26:02.558 INFO:tasks.workunit.client.0.smithi084.stdout:4/478: truncate d5/d2e/d5f/d32/f34 3600546 0 2024-04-26T21:26:02.559 INFO:tasks.workunit.client.1.smithi120.stdout:0/867: read - d0/d3/dc/dd/d1b/d24/d7d/ff9 zero size 2024-04-26T21:26:02.559 INFO:tasks.workunit.client.1.smithi120.stdout:3/760: read dd/de/d83/db2/fb3 [1620161,35097] 0 2024-04-26T21:26:02.561 INFO:tasks.workunit.client.1.smithi120.stdout:6/761: dwrite d4/db/d25/d6d/d97/fbb [4194304,4194304] 0 2024-04-26T21:26:02.562 INFO:tasks.workunit.client.0.smithi084.stdout:4/479: readlink d5/d7/l4e 0 2024-04-26T21:26:02.563 INFO:tasks.workunit.client.0.smithi084.stdout:4/480: readlink d5/d7/l4e 0 2024-04-26T21:26:02.564 INFO:tasks.workunit.client.1.smithi120.stdout:7/759: creat d7/d64/da6/d1f/d28/d4c/f102 x:0 0 0 2024-04-26T21:26:02.564 INFO:tasks.workunit.client.1.smithi120.stdout:3/761: chown dd/de/df/dda/d24/f5a 14050 1 2024-04-26T21:26:02.568 INFO:tasks.workunit.client.0.smithi084.stdout:4/481: fsync d5/d25/f56 0 2024-04-26T21:26:02.569 INFO:tasks.workunit.client.1.smithi120.stdout:3/762: rmdir dd/de/df/dda/d24 39 2024-04-26T21:26:02.572 INFO:tasks.workunit.client.0.smithi084.stdout:7/536: dwrite d6/d9/d12/d19/f49 [0,4194304] 0 2024-04-26T21:26:02.573 INFO:tasks.workunit.client.1.smithi120.stdout:7/760: creat d7/d64/da6/d1a/df4/f103 x:0 0 0 2024-04-26T21:26:02.574 INFO:tasks.workunit.client.0.smithi084.stdout:3/508: truncate d1/d2c/d2f/d31/d3b/f70 538106 0 2024-04-26T21:26:02.578 INFO:tasks.workunit.client.0.smithi084.stdout:2/650: dread d6/d7/d3d/d15/d1f/d22/d2a/f44 [0,4194304] 0 2024-04-26T21:26:02.579 INFO:tasks.workunit.client.1.smithi120.stdout:7/761: truncate d7/d64/da6/d2f/f63 1324456 0 2024-04-26T21:26:02.580 INFO:tasks.workunit.client.1.smithi120.stdout:2/764: sync 2024-04-26T21:26:02.580 INFO:tasks.workunit.client.1.smithi120.stdout:8/696: sync 2024-04-26T21:26:02.580 INFO:tasks.workunit.client.1.smithi120.stdout:9/681: sync 2024-04-26T21:26:02.580 INFO:tasks.workunit.client.1.smithi120.stdout:5/796: sync 2024-04-26T21:26:02.580 INFO:tasks.workunit.client.1.smithi120.stdout:4/719: sync 2024-04-26T21:26:02.580 INFO:tasks.workunit.client.1.smithi120.stdout:6/762: link d4/db/d10/d1a/d2b/d57/fe6 d4/db/d10/d1a/dcd/f100 0 2024-04-26T21:26:02.580 INFO:tasks.workunit.client.0.smithi084.stdout:7/537: truncate d6/d68/f6e 1648651 0 2024-04-26T21:26:02.584 INFO:tasks.workunit.client.1.smithi120.stdout:0/868: truncate d0/d3/dc/dd/f7b 3643513 0 2024-04-26T21:26:02.584 INFO:tasks.workunit.client.0.smithi084.stdout:4/482: link d5/d25/d35/f8f d5/d7/f9b 0 2024-04-26T21:26:02.585 INFO:tasks.workunit.client.0.smithi084.stdout:2/651: write d6/d7/d3d/d15/d1f/d39/fe [4531979,70243] 0 2024-04-26T21:26:02.585 INFO:tasks.workunit.client.0.smithi084.stdout:0/521: dwrite de/d2b/d77/f33 [0,4194304] 0 2024-04-26T21:26:02.587 INFO:tasks.workunit.client.0.smithi084.stdout:7/538: creat d6/d68/fb9 x:0 0 0 2024-04-26T21:26:02.587 INFO:tasks.workunit.client.1.smithi120.stdout:5/797: truncate d2/f13 1031770 0 2024-04-26T21:26:02.590 INFO:tasks.workunit.client.0.smithi084.stdout:7/539: dread - d6/d9/d12/d8b/d72/da0/fb6 zero size 2024-04-26T21:26:02.592 INFO:tasks.workunit.client.1.smithi120.stdout:4/720: rename d10/d12/f8a to d10/d28/d73/de2/ff6 0 2024-04-26T21:26:02.593 INFO:tasks.workunit.client.0.smithi084.stdout:7/540: readlink d6/d9/d12/d19/d7a/l94 0 2024-04-26T21:26:02.594 INFO:tasks.workunit.client.1.smithi120.stdout:9/682: write d0/dd/d3a/d5c/d9f/fa2 [219774,71091] 0 2024-04-26T21:26:02.594 INFO:tasks.workunit.client.0.smithi084.stdout:3/509: rename d1/d2c/d2f/d31/d55/d4e/l59 to d1/d2c/d2f/d31/d55/d4e/d7c/d7e/laa 0 2024-04-26T21:26:02.597 INFO:tasks.workunit.client.1.smithi120.stdout:2/765: creat d4/d1b/d25/d2c/d3e/d5e/d63/dcb/dca/ffd x:0 0 0 2024-04-26T21:26:02.600 INFO:tasks.workunit.client.0.smithi084.stdout:0/522: write f9 [3169768,115087] 0 2024-04-26T21:26:02.604 INFO:tasks.workunit.client.1.smithi120.stdout:3/763: dwrite dd/de/f2e [0,4194304] 0 2024-04-26T21:26:02.605 INFO:tasks.workunit.client.1.smithi120.stdout:6/763: mkdir d4/db/d10/d1a/d2b/d57/d67/dbc/dce/d101 0 2024-04-26T21:26:02.607 INFO:tasks.workunit.client.1.smithi120.stdout:4/721: write d10/d6b/dbf/fc5 [1248257,80644] 0 2024-04-26T21:26:02.607 INFO:tasks.workunit.client.0.smithi084.stdout:4/483: unlink d5/d25/f2f 0 2024-04-26T21:26:02.609 INFO:tasks.workunit.client.1.smithi120.stdout:9/683: read d0/d14/d2d/f97 [7389280,70371] 0 2024-04-26T21:26:02.611 INFO:tasks.workunit.client.1.smithi120.stdout:6/764: chown d4/db/d25/d6d/deb/cee 67816532 1 2024-04-26T21:26:02.613 INFO:tasks.workunit.client.0.smithi084.stdout:0/523: symlink de/d71/la8 0 2024-04-26T21:26:02.613 INFO:tasks.workunit.client.1.smithi120.stdout:5/798: creat d2/dc/d1d/d21/d66/d6a/d8c/daa/f125 x:0 0 0 2024-04-26T21:26:02.614 INFO:tasks.workunit.client.0.smithi084.stdout:2/652: symlink d6/d7/d3d/d15/d1f/d22/lde 0 2024-04-26T21:26:02.616 INFO:tasks.workunit.client.0.smithi084.stdout:7/541: rmdir d6/d1c/d51 39 2024-04-26T21:26:02.618 INFO:tasks.workunit.client.1.smithi120.stdout:9/684: mkdir d0/d6/d3d/ddc 0 2024-04-26T21:26:02.618 INFO:tasks.workunit.client.1.smithi120.stdout:6/765: chown d4/db/d25/d6d/d97/d9d 16508621 1 2024-04-26T21:26:02.619 INFO:tasks.workunit.client.0.smithi084.stdout:0/524: mkdir de/d20/d4e/da9 0 2024-04-26T21:26:02.621 INFO:tasks.workunit.client.1.smithi120.stdout:2/766: creat d4/d1b/d2e/d50/ffe x:0 0 0 2024-04-26T21:26:02.623 INFO:tasks.workunit.client.1.smithi120.stdout:7/762: dwrite d7/d64/da6/d1a/d33/d34/d37/f79 [0,4194304] 0 2024-04-26T21:26:02.628 INFO:tasks.workunit.client.0.smithi084.stdout:4/484: link d5/d2e/d5f/f8a d5/d25/d35/d97/f9c 0 2024-04-26T21:26:02.629 INFO:tasks.workunit.client.1.smithi120.stdout:3/764: dread - dd/de/df/dda/d24/d43/f53 zero size 2024-04-26T21:26:02.630 INFO:tasks.workunit.client.0.smithi084.stdout:0/525: dread de/d2b/d77/d32/f6e [0,4194304] 0 2024-04-26T21:26:02.633 INFO:tasks.workunit.client.1.smithi120.stdout:3/765: fsync dd/de/d83/db2/fb3 0 2024-04-26T21:26:02.636 INFO:tasks.workunit.client.1.smithi120.stdout:3/766: dread - dd/fe4 zero size 2024-04-26T21:26:02.637 INFO:tasks.workunit.client.0.smithi084.stdout:0/526: mknod de/d20/d4c/caa 0 2024-04-26T21:26:02.638 INFO:tasks.workunit.client.0.smithi084.stdout:7/542: truncate d6/d9/d12/d19/d7a/fa2 860506 0 2024-04-26T21:26:02.638 INFO:tasks.workunit.client.1.smithi120.stdout:2/767: rename d4/d1b/f41 to d4/dea/fff 0 2024-04-26T21:26:02.642 INFO:tasks.workunit.client.1.smithi120.stdout:0/869: dwrite d0/d3/dc/dd/d1b/d24/fcb [0,4194304] 0 2024-04-26T21:26:02.642 INFO:tasks.workunit.client.0.smithi084.stdout:0/527: read de/d71/f57 [315933,44525] 0 2024-04-26T21:26:02.645 INFO:tasks.workunit.client.1.smithi120.stdout:2/768: read - d4/d1b/d5c/da6/ff1 zero size 2024-04-26T21:26:02.647 INFO:tasks.workunit.client.0.smithi084.stdout:4/485: link d5/d25/d35/d60/l74 d5/d10/d82/l9d 0 2024-04-26T21:26:02.648 INFO:tasks.workunit.client.1.smithi120.stdout:8/697: dwrite d5/d6/d11/d52/d27/d4f/d67/fad [0,4194304] 0 2024-04-26T21:26:02.648 INFO:tasks.workunit.client.0.smithi084.stdout:4/486: stat d5/d25/d35 0 2024-04-26T21:26:02.649 INFO:tasks.workunit.client.1.smithi120.stdout:6/766: dread d4/f31 [4194304,4194304] 0 2024-04-26T21:26:02.651 INFO:tasks.workunit.client.1.smithi120.stdout:3/767: dread dd/d2a/d74/f9f [0,4194304] 0 2024-04-26T21:26:02.659 INFO:tasks.workunit.client.0.smithi084.stdout:7/543: link d6/d68/d7f/l97 d6/d9/db3/lba 0 2024-04-26T21:26:02.662 INFO:tasks.workunit.client.0.smithi084.stdout:4/487: mknod d5/d2e/d8d/c9e 0 2024-04-26T21:26:02.663 INFO:tasks.workunit.client.0.smithi084.stdout:7/544: rmdir d6/d9/d12/d8b/d72/da0/d80 39 2024-04-26T21:26:02.665 INFO:tasks.workunit.client.1.smithi120.stdout:4/722: write d10/d6b/d71/d9d/fea [3436297,99084] 0 2024-04-26T21:26:02.667 INFO:tasks.workunit.client.1.smithi120.stdout:9/685: write d0/dd/d34/f59 [686034,119061] 0 2024-04-26T21:26:02.667 INFO:tasks.workunit.client.0.smithi084.stdout:0/528: rename de/d2b/d77/d32/f4f to de/d2b/d64/fab 0 2024-04-26T21:26:02.674 INFO:tasks.workunit.client.0.smithi084.stdout:4/488: mknod d5/d25/c9f 0 2024-04-26T21:26:02.675 INFO:tasks.workunit.client.0.smithi084.stdout:7/545: symlink d6/d9/d12/d19/d7a/lbb 0 2024-04-26T21:26:02.678 INFO:tasks.workunit.client.1.smithi120.stdout:9/686: read - d0/d14/fa0 zero size 2024-04-26T21:26:02.679 INFO:tasks.workunit.client.1.smithi120.stdout:7/763: write d7/fac [178971,4973] 0 2024-04-26T21:26:02.681 INFO:tasks.workunit.client.1.smithi120.stdout:0/870: write d0/f2c [2296374,116067] 0 2024-04-26T21:26:02.681 INFO:tasks.workunit.client.0.smithi084.stdout:3/510: dread d1/d2c/d2f/f1f [0,4194304] 0 2024-04-26T21:26:02.681 INFO:tasks.workunit.client.0.smithi084.stdout:0/529: creat de/fac x:0 0 0 2024-04-26T21:26:02.685 INFO:tasks.workunit.client.1.smithi120.stdout:6/767: dwrite d4/f31 [4194304,4194304] 0 2024-04-26T21:26:02.686 INFO:tasks.workunit.client.1.smithi120.stdout:3/768: dread dd/de/df/dda/f4b [0,4194304] 0 2024-04-26T21:26:02.688 INFO:tasks.workunit.client.1.smithi120.stdout:5/799: dwrite d2/d1b/d89/d6b/f72 [0,4194304] 0 2024-04-26T21:26:02.690 INFO:tasks.workunit.client.0.smithi084.stdout:0/530: truncate de/d20/d4e/f75 1167723 0 2024-04-26T21:26:02.694 INFO:tasks.workunit.client.1.smithi120.stdout:2/769: truncate d4/dea/fff 424006 0 2024-04-26T21:26:02.696 INFO:tasks.workunit.client.0.smithi084.stdout:4/489: dwrite d5/d10/f18 [0,4194304] 0 2024-04-26T21:26:02.700 INFO:tasks.workunit.client.0.smithi084.stdout:4/490: read - d5/d25/f56 zero size 2024-04-26T21:26:02.701 INFO:tasks.workunit.client.0.smithi084.stdout:7/546: dwrite d6/d68/f9f [0,4194304] 0 2024-04-26T21:26:02.702 INFO:tasks.workunit.client.1.smithi120.stdout:2/770: creat d4/d1b/d56/f100 x:0 0 0 2024-04-26T21:26:02.705 INFO:tasks.workunit.client.1.smithi120.stdout:8/698: dread d5/d6/d11/d52/d70/f4b [0,4194304] 0 2024-04-26T21:26:02.707 INFO:tasks.workunit.client.1.smithi120.stdout:7/764: link d7/d64/fb8 d7/d19/d60/de6/f104 0 2024-04-26T21:26:02.707 INFO:tasks.workunit.client.0.smithi084.stdout:7/547: rmdir d6/d68 39 2024-04-26T21:26:02.712 INFO:tasks.workunit.client.1.smithi120.stdout:7/765: chown d7/d64/da6/d1a/d33/c58 2 1 2024-04-26T21:26:02.712 INFO:tasks.workunit.client.1.smithi120.stdout:4/723: dread d10/d28/f56 [0,4194304] 0 2024-04-26T21:26:02.714 INFO:tasks.workunit.client.1.smithi120.stdout:8/699: creat d5/d6/d11/d32/d3b/dd3/fe0 x:0 0 0 2024-04-26T21:26:02.714 INFO:tasks.workunit.client.1.smithi120.stdout:7/766: dread - d7/d64/da6/d1f/d28/d4c/f102 zero size 2024-04-26T21:26:02.716 INFO:tasks.workunit.client.1.smithi120.stdout:8/700: readlink d5/d6/d11/d52/d27/laa 0 2024-04-26T21:26:02.722 INFO:tasks.workunit.client.0.smithi084.stdout:0/531: dwrite de/f83 [0,4194304] 0 2024-04-26T21:26:02.724 INFO:tasks.workunit.client.1.smithi120.stdout:7/767: creat d7/d64/da6/d1f/d7d/f105 x:0 0 0 2024-04-26T21:26:02.724 INFO:tasks.workunit.client.1.smithi120.stdout:8/701: read - d5/d6/d34/d42/d9d/fd0 zero size 2024-04-26T21:26:02.724 INFO:tasks.workunit.client.0.smithi084.stdout:3/511: dread d1/f1d [0,4194304] 0 2024-04-26T21:26:02.729 INFO:tasks.workunit.client.0.smithi084.stdout:0/532: mkdir de/d78/d9e/da1/dad 0 2024-04-26T21:26:02.730 INFO:tasks.workunit.client.1.smithi120.stdout:6/768: write d4/db/d10/d1a/d2b/d57/d67/d98/fc9 [923639,92548] 0 2024-04-26T21:26:02.730 INFO:tasks.workunit.client.1.smithi120.stdout:8/702: mkdir d5/d6/d11/d52/d27/d4f/d67/d85/de1 0 2024-04-26T21:26:02.734 INFO:tasks.workunit.client.1.smithi120.stdout:9/687: truncate d0/d14/d2d/d4b/d85/f88 1164842 0 2024-04-26T21:26:02.737 INFO:tasks.workunit.client.1.smithi120.stdout:1/686: sync 2024-04-26T21:26:02.739 INFO:tasks.workunit.client.1.smithi120.stdout:3/769: write dd/de/df/db6/f59 [2462272,96302] 0 2024-04-26T21:26:02.739 INFO:tasks.workunit.client.1.smithi120.stdout:8/703: write d5/d6/d11/d52/d70/f4b [3381052,117546] 0 2024-04-26T21:26:02.740 INFO:tasks.workunit.client.0.smithi084.stdout:7/548: link d6/d26/f30 d6/d68/d7f/fbc 0 2024-04-26T21:26:02.744 INFO:tasks.workunit.client.1.smithi120.stdout:7/768: rename d7/d64/da6/d1f/d28/d4c/d6b/d7b/f80 to d7/d64/da6/d1f/f106 0 2024-04-26T21:26:02.745 INFO:tasks.workunit.client.0.smithi084.stdout:7/549: write d6/d68/fb9 [642682,29478] 0 2024-04-26T21:26:02.747 INFO:tasks.workunit.client.1.smithi120.stdout:3/770: dread - dd/de/df/dda/d24/fe0 zero size 2024-04-26T21:26:02.748 INFO:tasks.workunit.client.1.smithi120.stdout:0/871: dwrite d0/df/d59/fc3 [0,4194304] 0 2024-04-26T21:26:02.748 INFO:tasks.workunit.client.1.smithi120.stdout:9/688: mkdir d0/d14/d77/d9a/ddd 0 2024-04-26T21:26:02.750 INFO:tasks.workunit.client.1.smithi120.stdout:1/687: creat d6/d7/d1b/d55/fdb x:0 0 0 2024-04-26T21:26:02.755 INFO:tasks.workunit.client.0.smithi084.stdout:3/512: write d1/d2c/d2f/f96 [1302309,59838] 0 2024-04-26T21:26:02.755 INFO:tasks.workunit.client.1.smithi120.stdout:5/800: dwrite d2/d30/d93/d107/d36/fc4 [0,4194304] 0 2024-04-26T21:26:02.756 INFO:tasks.workunit.client.1.smithi120.stdout:1/688: chown d6/l41 5004325 1 2024-04-26T21:26:02.756 INFO:tasks.workunit.client.1.smithi120.stdout:0/872: write d0/f2c [2331279,127047] 0 2024-04-26T21:26:02.759 INFO:tasks.workunit.client.1.smithi120.stdout:4/724: write d10/d12/f95 [945501,22106] 0 2024-04-26T21:26:02.759 INFO:tasks.workunit.client.1.smithi120.stdout:4/725: readlink d10/l5a 0 2024-04-26T21:26:02.761 INFO:tasks.workunit.client.1.smithi120.stdout:7/769: mknod d7/d64/da6/d1a/df4/c107 0 2024-04-26T21:26:02.762 INFO:tasks.workunit.client.1.smithi120.stdout:1/689: fsync d6/d7/d1d/d2c/f93 0 2024-04-26T21:26:02.763 INFO:tasks.workunit.client.0.smithi084.stdout:0/533: dwrite de/d20/f5e [0,4194304] 0 2024-04-26T21:26:02.763 INFO:tasks.workunit.client.0.smithi084.stdout:4/491: dread d5/d10/f13 [0,4194304] 0 2024-04-26T21:26:02.765 INFO:tasks.workunit.client.1.smithi120.stdout:0/873: write d0/d3/dc/dd/d1b/d39/f3e [910410,9728] 0 2024-04-26T21:26:02.766 INFO:tasks.workunit.client.1.smithi120.stdout:3/771: mkdir dd/de/df/dda/d24/d9d/d86/dd3/ddb/df9 0 2024-04-26T21:26:02.771 INFO:tasks.workunit.client.1.smithi120.stdout:5/801: symlink d2/dc/d1d/d21/d66/de5/l126 0 2024-04-26T21:26:02.773 INFO:tasks.workunit.client.1.smithi120.stdout:2/771: dread d4/d1b/d25/d2c/f49 [4194304,4194304] 0 2024-04-26T21:26:02.777 INFO:tasks.workunit.client.1.smithi120.stdout:1/690: creat d6/d7/d1d/d2c/fdc x:0 0 0 2024-04-26T21:26:02.780 INFO:tasks.workunit.client.0.smithi084.stdout:8/535: sync 2024-04-26T21:26:02.781 INFO:tasks.workunit.client.1.smithi120.stdout:0/874: rmdir d0/d3/dc/dd/d1b/d39 39 2024-04-26T21:26:02.781 INFO:tasks.workunit.client.1.smithi120.stdout:9/689: rmdir d0/d6/d3d/ddc 0 2024-04-26T21:26:02.784 INFO:tasks.workunit.client.1.smithi120.stdout:5/802: mkdir d2/d30/d93/dbf/d127 0 2024-04-26T21:26:02.785 INFO:tasks.workunit.client.1.smithi120.stdout:3/772: truncate dd/de/d83/d64/db0/f77 4297642 0 2024-04-26T21:26:02.786 INFO:tasks.workunit.client.1.smithi120.stdout:8/704: getdents d5/d6/d34/d42/d9d/d83 0 2024-04-26T21:26:02.786 INFO:tasks.workunit.client.1.smithi120.stdout:7/770: truncate d7/d19/d60/de6/f104 1816873 0 2024-04-26T21:26:02.791 INFO:tasks.workunit.client.1.smithi120.stdout:4/726: dread d10/d12/f35 [0,4194304] 0 2024-04-26T21:26:02.792 INFO:tasks.workunit.client.1.smithi120.stdout:8/705: write d5/d6/d75/d95/fd8 [2177028,27512] 0 2024-04-26T21:26:02.793 INFO:tasks.workunit.client.0.smithi084.stdout:0/534: mkdir de/d20/d4c/dae 0 2024-04-26T21:26:02.795 INFO:tasks.workunit.client.0.smithi084.stdout:4/492: readlink d5/l1c 0 2024-04-26T21:26:02.796 INFO:tasks.workunit.client.0.smithi084.stdout:8/536: mknod d4/d7/d15/d37/d52/c99 0 2024-04-26T21:26:02.797 INFO:tasks.workunit.client.1.smithi120.stdout:3/773: write dd/de/df/d12/d48/fc4 [913824,15942] 0 2024-04-26T21:26:02.797 INFO:tasks.workunit.client.1.smithi120.stdout:9/690: rename d0/dd/d3a/f58 to d0/d14/d2d/d4b/dbc/fde 0 2024-04-26T21:26:02.797 INFO:tasks.workunit.client.0.smithi084.stdout:8/537: dread - d4/d6/f6e zero size 2024-04-26T21:26:02.799 INFO:tasks.workunit.client.0.smithi084.stdout:7/550: creat d6/d9/db3/fbd x:0 0 0 2024-04-26T21:26:02.801 INFO:tasks.workunit.client.1.smithi120.stdout:7/771: mkdir d7/d64/da6/d1a/d33/d34/dab/dbf/d108 0 2024-04-26T21:26:02.802 INFO:tasks.workunit.client.0.smithi084.stdout:3/513: creat d1/d2c/d2f/fab x:0 0 0 2024-04-26T21:26:02.802 INFO:tasks.workunit.client.1.smithi120.stdout:0/875: dread d0/d3/dc/dd/d1b/f78 [0,4194304] 0 2024-04-26T21:26:02.805 INFO:tasks.workunit.client.0.smithi084.stdout:4/493: mkdir d5/d25/d99/da0 0 2024-04-26T21:26:02.806 INFO:tasks.workunit.client.1.smithi120.stdout:4/727: rename d10/d65/ce4 to d10/d28/dd9/ddd/dee/cf7 0 2024-04-26T21:26:02.806 INFO:tasks.workunit.client.0.smithi084.stdout:4/494: readlink l1 0 2024-04-26T21:26:02.807 INFO:tasks.workunit.client.0.smithi084.stdout:7/551: chown d6/d9/l5a 5 1 2024-04-26T21:26:02.810 INFO:tasks.workunit.client.1.smithi120.stdout:9/691: mknod d0/d66/d93/db7/dc7/cdf 0 2024-04-26T21:26:02.811 INFO:tasks.workunit.client.0.smithi084.stdout:0/535: getdents de/d20 0 2024-04-26T21:26:02.811 INFO:tasks.workunit.client.0.smithi084.stdout:3/514: mknod d1/d24/cac 0 2024-04-26T21:26:02.812 INFO:tasks.workunit.client.1.smithi120.stdout:6/769: dread d4/db/d10/dd/f18 [0,4194304] 0 2024-04-26T21:26:02.813 INFO:tasks.workunit.client.1.smithi120.stdout:3/774: readlink dd/de/df/dda/d24/db1/d76/d3b/l52 0 2024-04-26T21:26:02.813 INFO:tasks.workunit.client.0.smithi084.stdout:8/538: dwrite d4/d7/d15/d37/f68 [0,4194304] 0 2024-04-26T21:26:02.814 INFO:tasks.workunit.client.1.smithi120.stdout:8/706: rename d5/d6/d34/da7/lde to d5/d6/d11/d32/d3b/dd3/le2 0 2024-04-26T21:26:02.814 INFO:tasks.workunit.client.1.smithi120.stdout:0/876: write d0/d3/dc/dd/d1b/d39/f3e [2205665,1540] 0 2024-04-26T21:26:02.815 INFO:tasks.workunit.client.0.smithi084.stdout:4/495: mkdir d5/d10/da1 0 2024-04-26T21:26:02.816 INFO:tasks.workunit.client.0.smithi084.stdout:7/552: mkdir d6/d68/d7f/dbe 0 2024-04-26T21:26:02.817 INFO:tasks.workunit.client.1.smithi120.stdout:9/692: readlink d0/d6/l2a 0 2024-04-26T21:26:02.817 INFO:tasks.workunit.client.1.smithi120.stdout:4/728: read d10/d12/f62 [2246310,85964] 0 2024-04-26T21:26:02.818 INFO:tasks.workunit.client.1.smithi120.stdout:2/772: dwrite d4/d1b/d25/fc6 [0,4194304] 0 2024-04-26T21:26:02.818 INFO:tasks.workunit.client.1.smithi120.stdout:3/775: chown dd/de/d83/lf1 787 1 2024-04-26T21:26:02.819 INFO:tasks.workunit.client.1.smithi120.stdout:7/772: dread d7/d64/da6/d1f/d7d/ff6 [0,4194304] 0 2024-04-26T21:26:02.825 INFO:tasks.workunit.client.0.smithi084.stdout:3/515: creat d1/d2c/d2f/d31/d3b/fad x:0 0 0 2024-04-26T21:26:02.827 INFO:tasks.workunit.client.1.smithi120.stdout:5/803: dread d2/d1b/d89/d47/f11a [0,4194304] 0 2024-04-26T21:26:02.827 INFO:tasks.workunit.client.0.smithi084.stdout:7/553: rename d6/d9/d12/d19/d20/d32/cb8 to d6/d9/d12/d19/d7a/cbf 0 2024-04-26T21:26:02.829 INFO:tasks.workunit.client.1.smithi120.stdout:4/729: symlink d10/d28/dd9/ddd/dee/dd0/df3/lf8 0 2024-04-26T21:26:02.830 INFO:tasks.workunit.client.0.smithi084.stdout:3/516: symlink d1/d24/d27/d3a/lae 0 2024-04-26T21:26:02.831 INFO:tasks.workunit.client.1.smithi120.stdout:6/770: mkdir d4/db/d10/dd/d28/d9e/d102 0 2024-04-26T21:26:02.831 INFO:tasks.workunit.client.1.smithi120.stdout:4/730: chown d10/l70 1 1 2024-04-26T21:26:02.846 INFO:tasks.workunit.client.0.smithi084.stdout:2/653: sync 2024-04-26T21:26:02.846 INFO:tasks.workunit.client.0.smithi084.stdout:1/530: sync 2024-04-26T21:26:02.847 INFO:tasks.workunit.client.0.smithi084.stdout:5/543: sync 2024-04-26T21:26:02.847 INFO:tasks.workunit.client.0.smithi084.stdout:6/531: sync 2024-04-26T21:26:02.847 INFO:tasks.workunit.client.0.smithi084.stdout:9/467: sync 2024-04-26T21:26:02.849 INFO:tasks.workunit.client.0.smithi084.stdout:2/654: fsync d6/d7/d3d/d4f/fca 0 2024-04-26T21:26:02.854 INFO:tasks.workunit.client.0.smithi084.stdout:5/544: write d0/f4b [1098891,9951] 0 2024-04-26T21:26:02.855 INFO:tasks.workunit.client.1.smithi120.stdout:0/877: rename d0/d3/lb4 to d0/l11d 0 2024-04-26T21:26:02.856 INFO:tasks.workunit.client.1.smithi120.stdout:0/878: chown d0/d3/dc/d12 35 1 2024-04-26T21:26:02.858 INFO:tasks.workunit.client.1.smithi120.stdout:5/804: mkdir d2/dc/d1d/d21/d66/d85/d128 0 2024-04-26T21:26:02.859 INFO:tasks.workunit.client.1.smithi120.stdout:0/879: write d0/d3/dc/d12/d31/f33 [1399436,614] 0 2024-04-26T21:26:02.859 INFO:tasks.workunit.client.0.smithi084.stdout:4/496: write d5/f2b [343741,415] 0 2024-04-26T21:26:02.863 INFO:tasks.workunit.client.1.smithi120.stdout:9/693: dread d0/f1 [0,4194304] 0 2024-04-26T21:26:02.864 INFO:tasks.workunit.client.1.smithi120.stdout:6/771: symlink d4/db/d10/dd/d28/d9e/daf/l103 0 2024-04-26T21:26:02.864 INFO:tasks.workunit.client.0.smithi084.stdout:0/536: dread de/d2b/d77/f4a [0,4194304] 0 2024-04-26T21:26:02.864 INFO:tasks.workunit.client.0.smithi084.stdout:6/532: creat d3/de/d1a/d43/d72/dad/fb1 x:0 0 0 2024-04-26T21:26:02.864 INFO:tasks.workunit.client.0.smithi084.stdout:1/531: write d2/f2e [2603083,52579] 0 2024-04-26T21:26:02.866 INFO:tasks.workunit.client.0.smithi084.stdout:4/497: stat d5/d7/d65/d90/d91 0 2024-04-26T21:26:02.867 INFO:tasks.workunit.client.1.smithi120.stdout:5/805: unlink d2/d30/d93/d107/d36/d44/dea/ff4 0 2024-04-26T21:26:02.867 INFO:tasks.workunit.client.0.smithi084.stdout:3/517: rename d1/d2c/d2f/d31/d3b/f7a to d1/d2c/d2f/d31/d55/faf 0 2024-04-26T21:26:02.868 INFO:tasks.workunit.client.0.smithi084.stdout:7/554: dwrite d6/d9/d12/d19/d7a/d84/f7c [0,4194304] 0 2024-04-26T21:26:02.869 INFO:tasks.workunit.client.1.smithi120.stdout:0/880: fdatasync d0/d3/d51/d97/d108/d81/fd9 0 2024-04-26T21:26:02.871 INFO:tasks.workunit.client.1.smithi120.stdout:9/694: symlink d0/dd/d45/le0 0 2024-04-26T21:26:02.874 INFO:tasks.workunit.client.0.smithi084.stdout:5/545: creat d0/dc/df/d31/d63/d6e/fa6 x:0 0 0 2024-04-26T21:26:02.874 INFO:tasks.workunit.client.0.smithi084.stdout:2/655: rename d6/d7/d3d/d15/d1f/d39/d20/f35 to d6/d7/d3d/d79/fdf 0 2024-04-26T21:26:02.875 INFO:tasks.workunit.client.1.smithi120.stdout:9/695: chown d0/ld0 0 1 2024-04-26T21:26:02.875 INFO:tasks.workunit.client.1.smithi120.stdout:8/707: dwrite d5/d6/d11/d52/f17 [0,4194304] 0 2024-04-26T21:26:02.875 INFO:tasks.workunit.client.1.smithi120.stdout:2/773: link d4/d1b/d2e/d50/d14/d15/ldd d4/d1b/d4f/d95/l101 0 2024-04-26T21:26:02.876 INFO:tasks.workunit.client.0.smithi084.stdout:4/498: readlink d5/d10/d15/d21/l49 0 2024-04-26T21:26:02.877 INFO:tasks.workunit.client.1.smithi120.stdout:6/772: symlink d4/db/d10/d1a/d2b/d57/d67/d98/l104 0 2024-04-26T21:26:02.878 INFO:tasks.workunit.client.1.smithi120.stdout:3/776: rename dd/de/df/dda/d37/f78 to dd/de/df/dda/d24/ffa 0 2024-04-26T21:26:02.878 INFO:tasks.workunit.client.1.smithi120.stdout:4/731: write d10/d12/f5c [2508225,69551] 0 2024-04-26T21:26:02.880 INFO:tasks.workunit.client.0.smithi084.stdout:0/537: rename de/d78/l9d to de/d2b/d45/d63/da7/laf 0 2024-04-26T21:26:02.880 INFO:tasks.workunit.client.0.smithi084.stdout:5/546: rmdir d0/dc/df/d31/d45 39 2024-04-26T21:26:02.880 INFO:tasks.workunit.client.0.smithi084.stdout:4/499: dread - d5/d7/d65/d7f/d6a/f89 zero size 2024-04-26T21:26:02.882 INFO:tasks.workunit.client.1.smithi120.stdout:9/696: write d0/dd/d3a/d5c/d9f/fa2 [330313,47411] 0 2024-04-26T21:26:02.889 INFO:tasks.workunit.client.1.smithi120.stdout:6/773: write d4/db/d10/d1a/dcd/fd2 [146335,10912] 0 2024-04-26T21:26:02.892 INFO:tasks.workunit.client.0.smithi084.stdout:4/500: readlink d5/d7/l96 0 2024-04-26T21:26:02.893 INFO:tasks.workunit.client.1.smithi120.stdout:3/777: creat dd/de/d83/db2/ffb x:0 0 0 2024-04-26T21:26:02.895 INFO:tasks.workunit.client.1.smithi120.stdout:9/697: creat d0/d14/d77/dc5/fe1 x:0 0 0 2024-04-26T21:26:02.896 INFO:tasks.workunit.client.1.smithi120.stdout:5/806: creat d2/dc/d1d/d21/f129 x:0 0 0 2024-04-26T21:26:02.896 INFO:tasks.workunit.client.0.smithi084.stdout:2/656: getdents d6/d7/d3d/d15/d1f/d6c 0 2024-04-26T21:26:02.900 INFO:tasks.workunit.client.1.smithi120.stdout:5/807: fsync d2/d30/d93/d107/d36/d44/d6c/f106 0 2024-04-26T21:26:02.900 INFO:tasks.workunit.client.1.smithi120.stdout:2/774: rename d4/d1b/d25/d93 to d4/d1b/d25/d2c/d3e/d102 0 2024-04-26T21:26:02.900 INFO:tasks.workunit.client.0.smithi084.stdout:1/532: link d2/fb d2/d9/d15/d28/fab 0 2024-04-26T21:26:02.901 INFO:tasks.workunit.client.0.smithi084.stdout:9/468: dread da/de/d16/f30 [0,4194304] 0 2024-04-26T21:26:02.902 INFO:tasks.workunit.client.1.smithi120.stdout:8/708: getdents d5/d8e 0 2024-04-26T21:26:02.904 INFO:tasks.workunit.client.0.smithi084.stdout:3/518: dwrite d1/d2c/d2f/d31/f86 [0,4194304] 0 2024-04-26T21:26:02.905 INFO:tasks.workunit.client.1.smithi120.stdout:3/778: write dd/de/df/dda/d24/fc1 [2645931,25066] 0 2024-04-26T21:26:02.907 INFO:tasks.workunit.client.0.smithi084.stdout:4/501: creat d5/d7/d65/d7f/fa2 x:0 0 0 2024-04-26T21:26:02.907 INFO:tasks.workunit.client.0.smithi084.stdout:2/657: creat d6/d7/d3d/d15/d1f/d39/d43/fe0 x:0 0 0 2024-04-26T21:26:02.909 INFO:tasks.workunit.client.1.smithi120.stdout:7/773: dread d7/d64/da6/d1f/f106 [0,4194304] 0 2024-04-26T21:26:02.909 INFO:tasks.workunit.client.0.smithi084.stdout:3/519: read - d1/d24/d27/d3a/d81/f97 zero size 2024-04-26T21:26:02.910 INFO:tasks.workunit.client.1.smithi120.stdout:2/775: symlink d4/d1b/d25/d2c/d3e/d102/l103 0 2024-04-26T21:26:02.911 INFO:tasks.workunit.client.0.smithi084.stdout:3/520: chown d1/d2c/d2f/d31/c8a 5 1 2024-04-26T21:26:02.912 INFO:tasks.workunit.client.1.smithi120.stdout:5/808: mkdir d2/d30/d3b/d12a 0 2024-04-26T21:26:02.912 INFO:tasks.workunit.client.0.smithi084.stdout:9/469: symlink da/de/d16/d25/d7c/lae 0 2024-04-26T21:26:02.915 INFO:tasks.workunit.client.1.smithi120.stdout:8/709: mknod d5/d6/d11/d32/d3b/dd3/ce3 0 2024-04-26T21:26:02.916 INFO:tasks.workunit.client.0.smithi084.stdout:1/533: creat d2/d9/d15/fac x:0 0 0 2024-04-26T21:26:02.916 INFO:tasks.workunit.client.1.smithi120.stdout:9/698: creat d0/d14/d77/d9a/ddd/fe2 x:0 0 0 2024-04-26T21:26:02.917 INFO:tasks.workunit.client.0.smithi084.stdout:1/534: read d2/d19/f32 [677122,9283] 0 2024-04-26T21:26:02.918 INFO:tasks.workunit.client.1.smithi120.stdout:3/779: unlink dd/de/df/dda/c32 0 2024-04-26T21:26:02.918 INFO:tasks.workunit.client.0.smithi084.stdout:4/502: mkdir d5/d2e/da3 0 2024-04-26T21:26:02.919 INFO:tasks.workunit.client.0.smithi084.stdout:9/470: dread - da/de/d16/d25/d41/d43/d48/fa8 zero size 2024-04-26T21:26:02.921 INFO:tasks.workunit.client.1.smithi120.stdout:7/774: unlink d7/d64/da6/d1f/d28/f2e 0 2024-04-26T21:26:02.924 INFO:tasks.workunit.client.0.smithi084.stdout:3/521: dread - d1/d2c/d2f/d31/f84 zero size 2024-04-26T21:26:02.924 INFO:tasks.workunit.client.1.smithi120.stdout:8/710: dread d5/d6/d34/d42/f5b [0,4194304] 0 2024-04-26T21:26:02.924 INFO:tasks.workunit.client.1.smithi120.stdout:3/780: creat dd/de/d83/d64/ffc x:0 0 0 2024-04-26T21:26:02.925 INFO:tasks.workunit.client.0.smithi084.stdout:9/471: chown da/de/d16/d25/d41/f7e 2047466 1 2024-04-26T21:26:02.925 INFO:tasks.workunit.client.1.smithi120.stdout:4/732: dwrite d10/d65/fab [0,4194304] 0 2024-04-26T21:26:02.926 INFO:tasks.workunit.client.0.smithi084.stdout:2/658: dread d6/d7/d3d/d15/d1f/d39/fc [0,4194304] 0 2024-04-26T21:26:02.927 INFO:tasks.workunit.client.0.smithi084.stdout:7/555: truncate d6/d68/fb9 229882 0 2024-04-26T21:26:02.928 INFO:tasks.workunit.client.1.smithi120.stdout:5/809: truncate d2/dc/d1d/d21/d66/d6a/d8c/f115 954464 0 2024-04-26T21:26:02.930 INFO:tasks.workunit.client.0.smithi084.stdout:3/522: unlink d1/d2c/f71 0 2024-04-26T21:26:02.930 INFO:tasks.workunit.client.0.smithi084.stdout:7/556: write d6/d9/d12/d8b/d72/da0/f4a [1261846,91368] 0 2024-04-26T21:26:02.931 INFO:tasks.workunit.client.0.smithi084.stdout:0/538: write de/d20/f29 [2798199,93628] 0 2024-04-26T21:26:02.933 INFO:tasks.workunit.client.0.smithi084.stdout:4/503: symlink d5/d25/d68/la4 0 2024-04-26T21:26:02.933 INFO:tasks.workunit.client.0.smithi084.stdout:7/557: chown d6/d68 525424897 1 2024-04-26T21:26:02.937 INFO:tasks.workunit.client.1.smithi120.stdout:7/775: getdents d7/d64/da6/d1a/d33 0 2024-04-26T21:26:02.937 INFO:tasks.workunit.client.0.smithi084.stdout:2/659: creat d6/d7/d3d/d15/d1f/d39/d20/d36/fe1 x:0 0 0 2024-04-26T21:26:02.939 INFO:tasks.workunit.client.1.smithi120.stdout:4/733: creat d10/d28/dd9/ddd/ff9 x:0 0 0 2024-04-26T21:26:02.939 INFO:tasks.workunit.client.0.smithi084.stdout:3/523: creat d1/d24/d27/d3a/fb0 x:0 0 0 2024-04-26T21:26:02.940 INFO:tasks.workunit.client.1.smithi120.stdout:3/781: dread - dd/de/df/dda/d24/f5a zero size 2024-04-26T21:26:02.941 INFO:tasks.workunit.client.1.smithi120.stdout:0/881: dread d0/d3/dc/dd/d1b/f8a [4194304,4194304] 0 2024-04-26T21:26:02.941 INFO:tasks.workunit.client.1.smithi120.stdout:5/810: dread d2/dc/fb6 [0,4194304] 0 2024-04-26T21:26:02.942 INFO:tasks.workunit.client.0.smithi084.stdout:2/660: chown d6/d7/d3d/d15/d1f/d22/lbd 1546 1 2024-04-26T21:26:02.943 INFO:tasks.workunit.client.0.smithi084.stdout:5/547: dwrite d0/f2 [0,4194304] 0 2024-04-26T21:26:02.944 INFO:tasks.workunit.client.0.smithi084.stdout:9/472: creat da/d9e/faf x:0 0 0 2024-04-26T21:26:02.944 INFO:tasks.workunit.client.0.smithi084.stdout:3/524: truncate d1/d24/d27/d3a/f9f 984173 0 2024-04-26T21:26:02.946 INFO:tasks.workunit.client.0.smithi084.stdout:3/525: readlink d1/d24/d27/l9c 0 2024-04-26T21:26:02.947 INFO:tasks.workunit.client.0.smithi084.stdout:4/504: rmdir d5/d7/d65/d7f 39 2024-04-26T21:26:02.948 INFO:tasks.workunit.client.0.smithi084.stdout:1/535: write d2/d19/f4c [1264835,29242] 0 2024-04-26T21:26:02.949 INFO:tasks.workunit.client.1.smithi120.stdout:4/734: chown d10/d65/c90 31307 1 2024-04-26T21:26:02.950 INFO:tasks.workunit.client.0.smithi084.stdout:9/473: chown da/de/d16/d25/f73 379783 1 2024-04-26T21:26:02.950 INFO:tasks.workunit.client.1.smithi120.stdout:0/882: mknod d0/df/c11e 0 2024-04-26T21:26:02.951 INFO:tasks.workunit.client.0.smithi084.stdout:5/548: rmdir d0/dc/df 39 2024-04-26T21:26:02.952 INFO:tasks.workunit.client.0.smithi084.stdout:5/549: fsync d0/fe 0 2024-04-26T21:26:02.952 INFO:tasks.workunit.client.0.smithi084.stdout:2/661: stat d6/d7/d3d/d15/d1f/d39/d20/d45/d6d 0 2024-04-26T21:26:02.956 INFO:tasks.workunit.client.0.smithi084.stdout:7/558: unlink d6/d9/d12/d19/d7a/cbf 0 2024-04-26T21:26:02.956 INFO:tasks.workunit.client.0.smithi084.stdout:4/505: fsync d5/d25/f56 0 2024-04-26T21:26:02.957 INFO:tasks.workunit.client.1.smithi120.stdout:7/776: rename d7/d64/da6/d1a/d33/d34/dab to d7/d64/da6/d1a/d33/d109 0 2024-04-26T21:26:02.959 INFO:tasks.workunit.client.1.smithi120.stdout:5/811: getdents d2/dc/d1d/d21/d66/d11e 0 2024-04-26T21:26:02.960 INFO:tasks.workunit.client.0.smithi084.stdout:1/536: mknod d2/d54/d5e/d8d/cad 0 2024-04-26T21:26:02.963 INFO:tasks.workunit.client.0.smithi084.stdout:2/662: mknod d6/d3e/d67/dcf/ce2 0 2024-04-26T21:26:02.964 INFO:tasks.workunit.client.1.smithi120.stdout:7/777: fsync d7/d19/f24 0 2024-04-26T21:26:02.965 INFO:tasks.workunit.client.1.smithi120.stdout:9/699: dread d0/dd/d3a/d5c/f9e [0,4194304] 0 2024-04-26T21:26:02.966 INFO:tasks.workunit.client.0.smithi084.stdout:0/539: getdents de/d2b/d64 0 2024-04-26T21:26:02.967 INFO:tasks.workunit.client.0.smithi084.stdout:4/506: symlink d5/d2e/d5f/d32/la5 0 2024-04-26T21:26:02.969 INFO:tasks.workunit.client.0.smithi084.stdout:0/540: chown de/d2b/d77/f4a 333525629 1 2024-04-26T21:26:02.969 INFO:tasks.workunit.client.0.smithi084.stdout:3/526: dwrite d1/d2c/d2f/d31/d55/d4e/d7c/f87 [0,4194304] 0 2024-04-26T21:26:02.970 INFO:tasks.workunit.client.1.smithi120.stdout:8/711: dwrite d5/d6/d11/d52/d70/d88/fc4 [0,4194304] 0 2024-04-26T21:26:02.976 INFO:tasks.workunit.client.1.smithi120.stdout:0/883: unlink d0/d3/d51/d97/d108/d5a/f114 0 2024-04-26T21:26:02.979 INFO:tasks.workunit.client.1.smithi120.stdout:6/774: dread d4/db/f23 [0,4194304] 0 2024-04-26T21:26:02.979 INFO:tasks.workunit.client.1.smithi120.stdout:2/776: dread d4/d1b/f38 [4194304,4194304] 0 2024-04-26T21:26:02.980 INFO:tasks.workunit.client.1.smithi120.stdout:1/691: sync 2024-04-26T21:26:02.981 INFO:tasks.workunit.client.1.smithi120.stdout:9/700: rename d0/dd/d3a/cb4 to d0/d14/d77/dc5/ce3 0 2024-04-26T21:26:02.981 INFO:tasks.workunit.client.0.smithi084.stdout:2/663: rmdir d6/d7/d3d/d15 39 2024-04-26T21:26:02.982 INFO:tasks.workunit.client.0.smithi084.stdout:1/537: dwrite d2/d19/f4c [0,4194304] 0 2024-04-26T21:26:02.989 INFO:tasks.workunit.client.0.smithi084.stdout:4/507: creat d5/d25/d99/da0/fa6 x:0 0 0 2024-04-26T21:26:02.989 INFO:tasks.workunit.client.1.smithi120.stdout:9/701: write d0/dd/f83 [2102315,9838] 0 2024-04-26T21:26:02.991 INFO:tasks.workunit.client.0.smithi084.stdout:1/538: symlink d2/d54/d5e/lae 0 2024-04-26T21:26:02.993 INFO:tasks.workunit.client.0.smithi084.stdout:7/559: mknod d6/d1c/d51/cc0 0 2024-04-26T21:26:02.993 INFO:tasks.workunit.client.1.smithi120.stdout:6/775: chown d4/db/d10/dd/d4e/f72 256229 1 2024-04-26T21:26:02.993 INFO:tasks.workunit.client.1.smithi120.stdout:0/884: unlink d0/d3/dc/dd/f34 0 2024-04-26T21:26:02.994 INFO:tasks.workunit.client.0.smithi084.stdout:3/527: read d1/d2c/d2f/f6d [2330607,126314] 0 2024-04-26T21:26:02.995 INFO:tasks.workunit.client.1.smithi120.stdout:2/777: symlink d4/d1b/d25/d29/l104 0 2024-04-26T21:26:02.995 INFO:tasks.workunit.client.0.smithi084.stdout:3/528: stat d1/f22 0 2024-04-26T21:26:02.996 INFO:tasks.workunit.client.0.smithi084.stdout:5/550: getdents d0/d17 0 2024-04-26T21:26:02.999 INFO:tasks.workunit.client.1.smithi120.stdout:6/776: write d4/d3d/fa7 [1145176,91217] 0 2024-04-26T21:26:02.999 INFO:tasks.workunit.client.1.smithi120.stdout:9/702: creat d0/d14/d77/d9a/fe4 x:0 0 0 2024-04-26T21:26:03.000 INFO:tasks.workunit.client.0.smithi084.stdout:4/508: creat d5/d2e/d5f/d32/d46/fa7 x:0 0 0 2024-04-26T21:26:03.002 INFO:tasks.workunit.client.0.smithi084.stdout:0/541: dwrite de/d2b/d77/d32/f44 [0,4194304] 0 2024-04-26T21:26:03.006 INFO:tasks.workunit.client.1.smithi120.stdout:6/777: chown d4/db/d25/d6d/f84 432 1 2024-04-26T21:26:03.006 INFO:tasks.workunit.client.1.smithi120.stdout:8/712: dwrite d5/d6/d11/d52/f17 [4194304,4194304] 0 2024-04-26T21:26:03.011 INFO:tasks.workunit.client.1.smithi120.stdout:3/782: truncate dd/de/df/d12/d48/fc4 90669 0 2024-04-26T21:26:03.011 INFO:tasks.workunit.client.0.smithi084.stdout:3/529: mkdir d1/d2c/d2f/d31/d55/d4e/d7c/db1 0 2024-04-26T21:26:03.013 INFO:tasks.workunit.client.1.smithi120.stdout:1/692: rmdir d6/d7/d2d/d98/d35/d6c 0 2024-04-26T21:26:03.013 INFO:tasks.workunit.client.1.smithi120.stdout:5/812: write d2/d30/d93/d107/d36/d44/d6c/fdf [999208,68206] 0 2024-04-26T21:26:03.013 INFO:tasks.workunit.client.1.smithi120.stdout:7/778: rename d7/d64/da6/d1f/d28/d4c/f92 to d7/d64/da6/d1a/d50/f10a 0 2024-04-26T21:26:03.013 INFO:tasks.workunit.client.0.smithi084.stdout:2/664: creat d6/d7/d3d/d79/d81/fe3 x:0 0 0 2024-04-26T21:26:03.014 INFO:tasks.workunit.client.1.smithi120.stdout:1/693: readlink d6/d7/d2d/ld5 0 2024-04-26T21:26:03.014 INFO:tasks.workunit.client.0.smithi084.stdout:0/542: unlink de/d20/d4e/f5a 0 2024-04-26T21:26:03.015 INFO:tasks.workunit.client.0.smithi084.stdout:8/539: sync 2024-04-26T21:26:03.015 INFO:tasks.workunit.client.0.smithi084.stdout:6/533: sync 2024-04-26T21:26:03.015 INFO:tasks.workunit.client.1.smithi120.stdout:9/703: mknod d0/d66/ce5 0 2024-04-26T21:26:03.023 INFO:tasks.workunit.client.1.smithi120.stdout:2/778: creat d4/d1b/d25/d2c/d3e/d5e/d63/dcb/dca/dfc/f105 x:0 0 0 2024-04-26T21:26:03.025 INFO:tasks.workunit.client.1.smithi120.stdout:8/713: mkdir d5/d6/d34/d37/db8/ddc/de4 0 2024-04-26T21:26:03.027 INFO:tasks.workunit.client.1.smithi120.stdout:5/813: read - d2/dc/d1d/d21/db2/f113 zero size 2024-04-26T21:26:03.027 INFO:tasks.workunit.client.0.smithi084.stdout:4/509: rename d5/d7/d65/d7f/l61 to d5/d2e/d5f/d32/la8 0 2024-04-26T21:26:03.027 INFO:tasks.workunit.client.0.smithi084.stdout:7/560: link d6/d9/f2e d6/d68/d7f/fc1 0 2024-04-26T21:26:03.028 INFO:tasks.workunit.client.1.smithi120.stdout:2/779: readlink d4/d1b/d2e/la5 0 2024-04-26T21:26:03.030 INFO:tasks.workunit.client.1.smithi120.stdout:9/704: read - d0/d14/d77/d9a/fe4 zero size 2024-04-26T21:26:03.030 INFO:tasks.workunit.client.0.smithi084.stdout:5/551: dwrite d0/dc/df/d31/f9c [0,4194304] 0 2024-04-26T21:26:03.031 INFO:tasks.workunit.client.0.smithi084.stdout:0/543: mknod de/d71/cb0 0 2024-04-26T21:26:03.033 INFO:tasks.workunit.client.1.smithi120.stdout:4/735: dread d10/d28/d73/da2/fc9 [0,4194304] 0 2024-04-26T21:26:03.033 INFO:tasks.workunit.client.1.smithi120.stdout:5/814: stat d2/fa 0 2024-04-26T21:26:03.036 INFO:tasks.workunit.client.0.smithi084.stdout:1/539: write d2/d9/d15/d28/d47/f4b [2987531,89834] 0 2024-04-26T21:26:03.036 INFO:tasks.workunit.client.0.smithi084.stdout:9/474: dwrite da/de/d16/d40/f4b [0,4194304] 0 2024-04-26T21:26:03.037 INFO:tasks.workunit.client.0.smithi084.stdout:4/510: readlink d5/l1c 0 2024-04-26T21:26:03.043 INFO:tasks.workunit.client.1.smithi120.stdout:8/714: write d5/d6/d11/d52/d70/d88/fbb [883368,26299] 0 2024-04-26T21:26:03.043 INFO:tasks.workunit.client.1.smithi120.stdout:0/885: dwrite d0/d3/dc/dd/d1b/d24/d73/db7/f103 [0,4194304] 0 2024-04-26T21:26:03.043 INFO:tasks.workunit.client.0.smithi084.stdout:4/511: readlink d5/d2e/l58 0 2024-04-26T21:26:03.043 INFO:tasks.workunit.client.0.smithi084.stdout:7/561: write d6/f65 [1239836,117854] 0 2024-04-26T21:26:03.044 INFO:tasks.workunit.client.0.smithi084.stdout:2/665: write d6/d7/d3d/d15/d1f/f32 [4147770,100793] 0 2024-04-26T21:26:03.044 INFO:tasks.workunit.client.0.smithi084.stdout:8/540: creat d4/d6/db/d1e/d22/d96/f9a x:0 0 0 2024-04-26T21:26:03.044 INFO:tasks.workunit.client.0.smithi084.stdout:1/540: stat d2/d9/d67/fa6 0 2024-04-26T21:26:03.046 INFO:tasks.workunit.client.0.smithi084.stdout:0/544: truncate de/ff 1159342 0 2024-04-26T21:26:03.048 INFO:tasks.workunit.client.1.smithi120.stdout:7/779: rename d7/d64/da6/d1f/d28/d4c/d6c/la1 to d7/d64/da6/d1f/d28/d4c/l10b 0 2024-04-26T21:26:03.048 INFO:tasks.workunit.client.1.smithi120.stdout:2/780: creat d4/f106 x:0 0 0 2024-04-26T21:26:03.050 INFO:tasks.workunit.client.1.smithi120.stdout:9/705: mknod d0/d14/d2d/d4b/d85/ce6 0 2024-04-26T21:26:03.051 INFO:tasks.workunit.client.0.smithi084.stdout:8/541: dread - d4/d6/db/d1e/d22/d39/d4a/f5e zero size 2024-04-26T21:26:03.053 INFO:tasks.workunit.client.1.smithi120.stdout:4/736: mkdir d10/d28/dd9/ddd/dee/dd0/dd4/d86/dfa 0 2024-04-26T21:26:03.054 INFO:tasks.workunit.client.1.smithi120.stdout:6/778: dwrite d4/db/d10/dd/f36 [0,4194304] 0 2024-04-26T21:26:03.055 INFO:tasks.workunit.client.0.smithi084.stdout:4/512: write d5/d25/d35/f8f [2512760,117232] 0 2024-04-26T21:26:03.057 INFO:tasks.workunit.client.0.smithi084.stdout:1/541: dread - d2/d54/f5c zero size 2024-04-26T21:26:03.057 INFO:tasks.workunit.client.0.smithi084.stdout:7/562: rename d6/d26/d40/lb2 to d6/d68/d7f/lc2 0 2024-04-26T21:26:03.060 INFO:tasks.workunit.client.1.smithi120.stdout:6/779: readlink d4/d3d/l7a 0 2024-04-26T21:26:03.061 INFO:tasks.workunit.client.1.smithi120.stdout:3/783: rename dd/fa3 to dd/de/df/dda/d24/db1/d76/d3b/d56/d75/ffd 0 2024-04-26T21:26:03.061 INFO:tasks.workunit.client.1.smithi120.stdout:2/781: creat d4/d1b/d25/d2c/d3e/d5e/d63/f107 x:0 0 0 2024-04-26T21:26:03.062 INFO:tasks.workunit.client.0.smithi084.stdout:1/542: dread - d2/d54/d5e/d66/d3a/d77/f85 zero size 2024-04-26T21:26:03.064 INFO:tasks.workunit.client.0.smithi084.stdout:2/666: symlink d6/d7/d3d/d15/d1f/d39/d20/d45/d6d/le4 0 2024-04-26T21:26:03.065 INFO:tasks.workunit.client.1.smithi120.stdout:3/784: chown dd/de/d83/d64/cc0 0 1 2024-04-26T21:26:03.065 INFO:tasks.workunit.client.0.smithi084.stdout:0/545: symlink de/lb1 0 2024-04-26T21:26:03.066 INFO:tasks.workunit.client.1.smithi120.stdout:0/886: mknod d0/d3/d51/d97/d108/c11f 0 2024-04-26T21:26:03.067 INFO:tasks.workunit.client.0.smithi084.stdout:9/475: dwrite da/de/d1e/f49 [0,4194304] 0 2024-04-26T21:26:03.068 INFO:tasks.workunit.client.0.smithi084.stdout:0/546: readlink de/d2b/d64/l80 0 2024-04-26T21:26:03.069 INFO:tasks.workunit.client.0.smithi084.stdout:4/513: mknod d5/d10/d15/ca9 0 2024-04-26T21:26:03.069 INFO:tasks.workunit.client.1.smithi120.stdout:9/706: rename d0/dd/l2c to d0/d14/d77/le7 0 2024-04-26T21:26:03.070 INFO:tasks.workunit.client.1.smithi120.stdout:2/782: unlink d4/d1b/d25/d2c/lc 0 2024-04-26T21:26:03.071 INFO:tasks.workunit.client.0.smithi084.stdout:8/542: mkdir d4/d6/db/d9b 0 2024-04-26T21:26:03.073 INFO:tasks.workunit.client.0.smithi084.stdout:7/563: mkdir d6/d9/d63/db5/dc3 0 2024-04-26T21:26:03.074 INFO:tasks.workunit.client.1.smithi120.stdout:3/785: symlink dd/dcf/dea/lfe 0 2024-04-26T21:26:03.076 INFO:tasks.workunit.client.1.smithi120.stdout:0/887: chown d0/d3/dc/dd/d9b/ff7 3509413 1 2024-04-26T21:26:03.078 INFO:tasks.workunit.client.0.smithi084.stdout:8/543: fdatasync d4/d6/f6e 0 2024-04-26T21:26:03.078 INFO:tasks.workunit.client.0.smithi084.stdout:4/514: chown d5/c92 577 1 2024-04-26T21:26:03.079 INFO:tasks.workunit.client.0.smithi084.stdout:3/530: dwrite d1/d2c/d2f/d31/d55/f7b [0,4194304] 0 2024-04-26T21:26:03.079 INFO:tasks.workunit.client.0.smithi084.stdout:2/667: write d6/d7/d3d/d15/d1f/d39/d20/fbb [1488568,128566] 0 2024-04-26T21:26:03.083 INFO:tasks.workunit.client.0.smithi084.stdout:8/544: write d4/d7/d15/f6f [277740,58529] 0 2024-04-26T21:26:03.088 INFO:tasks.workunit.client.0.smithi084.stdout:8/545: write d4/d6/db/d1e/d22/f72 [2399089,40876] 0 2024-04-26T21:26:03.090 INFO:tasks.workunit.client.1.smithi120.stdout:3/786: write dd/de/df/dda/f4b [5250302,74211] 0 2024-04-26T21:26:03.096 INFO:tasks.workunit.client.1.smithi120.stdout:0/888: creat d0/d3/dc/d12/d31/f120 x:0 0 0 2024-04-26T21:26:03.098 INFO:tasks.workunit.client.1.smithi120.stdout:8/715: dwrite d5/d6/d11/d32/d3b/f98 [4194304,4194304] 0 2024-04-26T21:26:03.102 INFO:tasks.workunit.client.1.smithi120.stdout:3/787: mkdir dd/d40/dff 0 2024-04-26T21:26:03.104 INFO:tasks.workunit.client.0.smithi084.stdout:4/515: dread d5/d25/f3e [0,4194304] 0 2024-04-26T21:26:03.107 INFO:tasks.workunit.client.1.smithi120.stdout:9/707: dwrite d0/d14/d77/d9a/fd7 [0,4194304] 0 2024-04-26T21:26:03.107 INFO:tasks.workunit.client.1.smithi120.stdout:1/694: truncate d6/dcc/fd2 417053 0 2024-04-26T21:26:03.109 INFO:tasks.workunit.client.1.smithi120.stdout:5/815: write d2/d30/f2f [323202,90481] 0 2024-04-26T21:26:03.109 INFO:tasks.workunit.client.1.smithi120.stdout:0/889: mknod d0/d3/dc/dd/d4b/dea/c121 0 2024-04-26T21:26:03.114 INFO:tasks.workunit.client.1.smithi120.stdout:9/708: write d0/d14/f8c [478448,22072] 0 2024-04-26T21:26:03.118 INFO:tasks.workunit.client.1.smithi120.stdout:1/695: truncate d6/d7/d1d/d2c/fdc 635215 0 2024-04-26T21:26:03.118 INFO:tasks.workunit.client.1.smithi120.stdout:0/890: unlink d0/d3/dc/dd/d1b/d39/ca4 0 2024-04-26T21:26:03.118 INFO:tasks.workunit.client.1.smithi120.stdout:9/709: truncate d0/dd/f83 3100329 0 2024-04-26T21:26:03.120 INFO:tasks.workunit.client.1.smithi120.stdout:3/788: rename dd/de/df/d12/d48/d6d to dd/de/df/d12/d48/d9b/dcb/d100 0 2024-04-26T21:26:03.128 INFO:tasks.workunit.client.1.smithi120.stdout:7/780: dread d7/d64/da6/d1f/d28/d4c/f89 [0,4194304] 0 2024-04-26T21:26:03.129 INFO:tasks.workunit.client.1.smithi120.stdout:8/716: link d5/d6/d11/d52/d27/f53 d5/d6/d11/d32/fe5 0 2024-04-26T21:26:03.130 INFO:tasks.workunit.client.1.smithi120.stdout:8/717: chown d5/d6/d11/d32/d3b/f73 2 1 2024-04-26T21:26:03.131 INFO:tasks.workunit.client.1.smithi120.stdout:1/696: rename d6/d7/d2d/d98/d35/l4c to d6/ldd 0 2024-04-26T21:26:03.135 INFO:tasks.workunit.client.1.smithi120.stdout:3/789: rename dd/de/df/dda/d8d/l96 to dd/de/d83/l101 0 2024-04-26T21:26:03.137 INFO:tasks.workunit.client.1.smithi120.stdout:1/697: mkdir d6/d7/d1d/d5d/dde 0 2024-04-26T21:26:03.141 INFO:tasks.workunit.client.0.smithi084.stdout:8/546: dread d4/d6/db/d1e/d22/d2f/f2c [0,4194304] 0 2024-04-26T21:26:03.142 INFO:tasks.workunit.client.1.smithi120.stdout:9/710: dwrite d0/d14/d2d/f97 [0,4194304] 0 2024-04-26T21:26:03.144 INFO:tasks.workunit.client.1.smithi120.stdout:3/790: mkdir dd/de/df/d12/d48/d9b/dcb/d102 0 2024-04-26T21:26:03.145 INFO:tasks.workunit.client.1.smithi120.stdout:1/698: write d6/d9/f84 [308998,96455] 0 2024-04-26T21:26:03.151 INFO:tasks.workunit.client.1.smithi120.stdout:1/699: fsync d6/d7/d2d/fbc 0 2024-04-26T21:26:03.151 INFO:tasks.workunit.client.1.smithi120.stdout:9/711: truncate d0/f54 835341 0 2024-04-26T21:26:03.152 INFO:tasks.workunit.client.0.smithi084.stdout:6/534: write d3/de/d41/f51 [1436338,80787] 0 2024-04-26T21:26:03.152 INFO:tasks.workunit.client.1.smithi120.stdout:3/791: mkdir dd/de/df/db6/dc5/d103 0 2024-04-26T21:26:03.153 INFO:tasks.workunit.client.1.smithi120.stdout:7/781: dwrite d7/d64/da6/d1f/d28/d4c/fc7 [0,4194304] 0 2024-04-26T21:26:03.155 INFO:tasks.workunit.client.1.smithi120.stdout:1/700: stat d6/d9/f1c 0 2024-04-26T21:26:03.157 INFO:tasks.workunit.client.0.smithi084.stdout:9/476: unlink da/de/d16/d25/d4f/f51 0 2024-04-26T21:26:03.158 INFO:tasks.workunit.client.1.smithi120.stdout:9/712: chown d0/d14/d77/dc5/fe1 2024 1 2024-04-26T21:26:03.159 INFO:tasks.workunit.client.1.smithi120.stdout:1/701: chown d6/daa/dae 2286991 1 2024-04-26T21:26:03.161 INFO:tasks.workunit.client.1.smithi120.stdout:3/792: chown dd/de/df/d12/d48/d9b/dcb/d100/c94 609 1 2024-04-26T21:26:03.161 INFO:tasks.workunit.client.0.smithi084.stdout:9/477: truncate da/de/d1e/f29 5882676 0 2024-04-26T21:26:03.162 INFO:tasks.workunit.client.1.smithi120.stdout:7/782: mknod d7/ddd/c10c 0 2024-04-26T21:26:03.165 INFO:tasks.workunit.client.0.smithi084.stdout:0/547: dread - de/d2b/d77/d68/f7c zero size 2024-04-26T21:26:03.165 INFO:tasks.workunit.client.0.smithi084.stdout:5/552: write d0/dc/f2f [4199598,26076] 0 2024-04-26T21:26:03.166 INFO:tasks.workunit.client.1.smithi120.stdout:3/793: read dd/de/df/dda/f4b [1918765,89673] 0 2024-04-26T21:26:03.174 INFO:tasks.workunit.client.0.smithi084.stdout:2/668: symlink d6/d7/d3d/d79/d85/le5 0 2024-04-26T21:26:03.176 INFO:tasks.workunit.client.1.smithi120.stdout:8/718: dread d5/d6/d11/d52/d70/f22 [0,4194304] 0 2024-04-26T21:26:03.177 INFO:tasks.workunit.client.0.smithi084.stdout:8/547: symlink d4/d7/d15/d37/d3b/l9c 0 2024-04-26T21:26:03.178 INFO:tasks.workunit.client.0.smithi084.stdout:7/564: symlink d6/d9/d96/lc4 0 2024-04-26T21:26:03.179 INFO:tasks.workunit.client.1.smithi120.stdout:3/794: creat dd/de/d83/d64/f104 x:0 0 0 2024-04-26T21:26:03.179 INFO:tasks.workunit.client.0.smithi084.stdout:4/516: chown d5/d2e/d5f/c1e 434 1 2024-04-26T21:26:03.182 INFO:tasks.workunit.client.0.smithi084.stdout:9/478: mknod da/de/d16/d25/d41/d43/d4a/cb0 0 2024-04-26T21:26:03.185 INFO:tasks.workunit.client.0.smithi084.stdout:3/531: symlink d1/d2c/d2f/d31/d55/da4/lb2 0 2024-04-26T21:26:03.185 INFO:tasks.workunit.client.0.smithi084.stdout:8/548: chown d4/d3a/d8c/f95 20832842 1 2024-04-26T21:26:03.186 INFO:tasks.workunit.client.1.smithi120.stdout:9/713: dwrite d0/dd/d45/f63 [0,4194304] 0 2024-04-26T21:26:03.187 INFO:tasks.workunit.client.0.smithi084.stdout:1/543: dwrite d2/d19/d63/f71 [0,4194304] 0 2024-04-26T21:26:03.188 INFO:tasks.workunit.client.0.smithi084.stdout:8/549: dread - d4/d6/f6e zero size 2024-04-26T21:26:03.190 INFO:tasks.workunit.client.1.smithi120.stdout:2/783: dread d4/d1b/d2e/d50/d14/d15/f2b [0,4194304] 0 2024-04-26T21:26:03.192 INFO:tasks.workunit.client.1.smithi120.stdout:5/816: dwrite d2/d10e/f8f [0,4194304] 0 2024-04-26T21:26:03.192 INFO:tasks.workunit.client.1.smithi120.stdout:8/719: symlink d5/d6/d34/d37/dd9/dda/le6 0 2024-04-26T21:26:03.193 INFO:tasks.workunit.client.1.smithi120.stdout:0/891: write d0/d3/d51/f88 [935276,82156] 0 2024-04-26T21:26:03.193 INFO:tasks.workunit.client.0.smithi084.stdout:8/550: chown d4/d7/c2a 33503 1 2024-04-26T21:26:03.197 INFO:tasks.workunit.client.1.smithi120.stdout:2/784: fsync d4/d1b/d2e/d50/d14/ff2 0 2024-04-26T21:26:03.199 INFO:tasks.workunit.client.1.smithi120.stdout:9/714: rmdir d0/dd 39 2024-04-26T21:26:03.200 INFO:tasks.workunit.client.1.smithi120.stdout:8/720: write d5/d6/d11/d52/d27/d4f/d67/fad [6722170,7822] 0 2024-04-26T21:26:03.201 INFO:tasks.workunit.client.0.smithi084.stdout:4/517: write d5/f4c [695401,35911] 0 2024-04-26T21:26:03.201 INFO:tasks.workunit.client.0.smithi084.stdout:5/553: dread d0/dc/df/d31/d63/d8a/f90 [0,4194304] 0 2024-04-26T21:26:03.202 INFO:tasks.workunit.client.0.smithi084.stdout:0/548: rename de/c46 to de/d78/d9e/da4/cb2 0 2024-04-26T21:26:03.204 INFO:tasks.workunit.client.1.smithi120.stdout:8/721: dread - d5/d6/d34/d42/d9d/d7a/f7c zero size 2024-04-26T21:26:03.204 INFO:tasks.workunit.client.0.smithi084.stdout:7/565: unlink d6/d9/d12/d8b/d72/da0/c61 0 2024-04-26T21:26:03.206 INFO:tasks.workunit.client.0.smithi084.stdout:3/532: stat d1/d2c/d2f/l19 0 2024-04-26T21:26:03.206 INFO:tasks.workunit.client.0.smithi084.stdout:3/533: fdatasync d1/d24/d27/f2b 0 2024-04-26T21:26:03.209 INFO:tasks.workunit.client.1.smithi120.stdout:3/795: dwrite dd/de/df/d12/d48/f93 [0,4194304] 0 2024-04-26T21:26:03.209 INFO:tasks.workunit.client.1.smithi120.stdout:0/892: creat d0/d3/dc/d12/d31/f122 x:0 0 0 2024-04-26T21:26:03.215 INFO:tasks.workunit.client.1.smithi120.stdout:9/715: write d0/dd/d34/f59 [1787335,71583] 0 2024-04-26T21:26:03.215 INFO:tasks.workunit.client.1.smithi120.stdout:0/893: chown d0/d3/dc/dd/d1b/d24/d7d/ff9 38733 1 2024-04-26T21:26:03.216 INFO:tasks.workunit.client.0.smithi084.stdout:3/534: chown d1/d2c/d2f/d31/d55/d4e/d7c/d7e 30 1 2024-04-26T21:26:03.218 INFO:tasks.workunit.client.1.smithi120.stdout:8/722: symlink d5/d8e/le7 0 2024-04-26T21:26:03.220 INFO:tasks.workunit.client.0.smithi084.stdout:3/535: chown d1/d2c/l79 22290911 1 2024-04-26T21:26:03.222 INFO:tasks.workunit.client.1.smithi120.stdout:2/785: fdatasync d4/d1b/d25/d29/f37 0 2024-04-26T21:26:03.224 INFO:tasks.workunit.client.1.smithi120.stdout:8/723: read d5/d6/d11/d52/f44 [51986,111355] 0 2024-04-26T21:26:03.224 INFO:tasks.workunit.client.1.smithi120.stdout:2/786: readlink d4/d1b/d25/d29/l7d 0 2024-04-26T21:26:03.227 INFO:tasks.workunit.client.0.smithi084.stdout:5/554: mknod d0/da2/ca7 0 2024-04-26T21:26:03.229 INFO:tasks.workunit.client.1.smithi120.stdout:9/716: mkdir d0/dd/d3a/de8 0 2024-04-26T21:26:03.231 INFO:tasks.workunit.client.0.smithi084.stdout:7/566: chown d6/d9/d12/d8b/d72/da0/d80 2 1 2024-04-26T21:26:03.231 INFO:tasks.workunit.client.1.smithi120.stdout:0/894: unlink d0/d3/dc/d12/f6a 0 2024-04-26T21:26:03.234 INFO:tasks.workunit.client.1.smithi120.stdout:7/783: dread d7/d64/da6/d1f/f48 [0,4194304] 0 2024-04-26T21:26:03.235 INFO:tasks.workunit.client.0.smithi084.stdout:8/551: mkdir d4/d7/d15/d9d 0 2024-04-26T21:26:03.236 INFO:tasks.workunit.client.0.smithi084.stdout:9/479: link da/de/d16/d55/c5d da/de/d16/d25/d41/d8d/cb1 0 2024-04-26T21:26:03.237 INFO:tasks.workunit.client.0.smithi084.stdout:8/552: stat d4/c7e 0 2024-04-26T21:26:03.237 INFO:tasks.workunit.client.0.smithi084.stdout:0/549: creat de/d20/d4e/da9/fb3 x:0 0 0 2024-04-26T21:26:03.237 INFO:tasks.workunit.client.1.smithi120.stdout:7/784: chown d7/d64/da6/d1f/d7d/d8b/d94/laf 0 1 2024-04-26T21:26:03.238 INFO:tasks.workunit.client.0.smithi084.stdout:5/555: read d0/d49/f8d [35075,64590] 0 2024-04-26T21:26:03.239 INFO:tasks.workunit.client.1.smithi120.stdout:5/817: write d2/dc/d1d/d21/d66/f27 [5135256,55433] 0 2024-04-26T21:26:03.239 INFO:tasks.workunit.client.0.smithi084.stdout:6/535: dwrite d3/de/d15/f69 [0,4194304] 0 2024-04-26T21:26:03.240 INFO:tasks.workunit.client.1.smithi120.stdout:5/818: chown d2/dc/d1d/d21/d66/l39 203 1 2024-04-26T21:26:03.242 INFO:tasks.workunit.client.0.smithi084.stdout:7/567: fsync d6/f8c 0 2024-04-26T21:26:03.246 INFO:tasks.workunit.client.1.smithi120.stdout:2/787: symlink d4/d1b/d25/d2c/d3e/d102/l108 0 2024-04-26T21:26:03.249 INFO:tasks.workunit.client.1.smithi120.stdout:9/717: creat d0/d14/d2d/d4b/fe9 x:0 0 0 2024-04-26T21:26:03.249 INFO:tasks.workunit.client.0.smithi084.stdout:3/536: rename d1/d24/f25 to d1/d2c/d2f/d31/d55/fb3 0 2024-04-26T21:26:03.251 INFO:tasks.workunit.client.1.smithi120.stdout:2/788: write d4/d1b/d25/d2c/d3e/d5e/d63/f107 [617779,119811] 0 2024-04-26T21:26:03.251 INFO:tasks.workunit.client.1.smithi120.stdout:0/895: mknod d0/d3/d51/d95/dd0/c123 0 2024-04-26T21:26:03.252 INFO:tasks.workunit.client.1.smithi120.stdout:7/785: mkdir d7/d64/da6/d1a/d50/d10d 0 2024-04-26T21:26:03.252 INFO:tasks.workunit.client.0.smithi084.stdout:0/550: rmdir de/d20 39 2024-04-26T21:26:03.255 INFO:tasks.workunit.client.1.smithi120.stdout:5/819: mkdir d2/d30/d93/d107/d36/d44/d6c/d12b 0 2024-04-26T21:26:03.257 INFO:tasks.workunit.client.0.smithi084.stdout:5/556: truncate d0/d17/f5b 80086 0 2024-04-26T21:26:03.258 INFO:tasks.workunit.client.1.smithi120.stdout:3/796: creat dd/de/df/dda/f105 x:0 0 0 2024-04-26T21:26:03.259 INFO:tasks.workunit.client.1.smithi120.stdout:8/724: mknod d5/d6/d34/d37/db8/ddc/de4/ce8 0 2024-04-26T21:26:03.260 INFO:tasks.workunit.client.0.smithi084.stdout:8/553: creat d4/d6/db/d1e/d22/d96/f9e x:0 0 0 2024-04-26T21:26:03.261 INFO:tasks.workunit.client.1.smithi120.stdout:8/725: chown d5/d6/l77 7850424 1 2024-04-26T21:26:03.261 INFO:tasks.workunit.client.0.smithi084.stdout:7/568: write d6/d9/d12/d8b/fa7 [3651742,8082] 0 2024-04-26T21:26:03.261 INFO:tasks.workunit.client.1.smithi120.stdout:3/797: write dd/d2a/d74/fab [3604682,45807] 0 2024-04-26T21:26:03.262 INFO:tasks.workunit.client.1.smithi120.stdout:9/718: mknod d0/d14/d2d/d4b/cea 0 2024-04-26T21:26:03.262 INFO:tasks.workunit.client.0.smithi084.stdout:6/536: creat d3/de/d15/df/dae/fb2 x:0 0 0 2024-04-26T21:26:03.263 INFO:tasks.workunit.client.0.smithi084.stdout:1/544: dwrite d2/d54/d5e/d66/f29 [0,4194304] 0 2024-04-26T21:26:03.263 INFO:tasks.workunit.client.1.smithi120.stdout:0/896: rmdir d0/d3/dc/dd/d1b/dfb 39 2024-04-26T21:26:03.265 INFO:tasks.workunit.client.1.smithi120.stdout:0/897: readlink d0/df/la0 0 2024-04-26T21:26:03.265 INFO:tasks.workunit.client.0.smithi084.stdout:0/551: write de/d2b/d77/d32/f8d [16110,82548] 0 2024-04-26T21:26:03.270 INFO:tasks.workunit.client.1.smithi120.stdout:9/719: creat d0/d66/d93/feb x:0 0 0 2024-04-26T21:26:03.272 INFO:tasks.workunit.client.1.smithi120.stdout:8/726: unlink d5/d6/d34/d42/d9d/f86 0 2024-04-26T21:26:03.276 INFO:tasks.workunit.client.1.smithi120.stdout:5/820: rename d2/dc/d1d/d21/d66/d6a/d8c/daa/fb5 to d2/d30/d93/d107/d36/d44/d6c/f12c 0 2024-04-26T21:26:03.277 INFO:tasks.workunit.client.1.smithi120.stdout:3/798: dread dd/de/df/dda/d24/d43/f47 [0,4194304] 0 2024-04-26T21:26:03.279 INFO:tasks.workunit.client.1.smithi120.stdout:5/821: chown d2/d30/d93/d107/d36/fc4 133019995 1 2024-04-26T21:26:03.279 INFO:tasks.workunit.client.1.smithi120.stdout:0/898: chown d0/d3/dc/dd/d9b/la9 5664 1 2024-04-26T21:26:03.279 INFO:tasks.workunit.client.1.smithi120.stdout:3/799: write dd/fd9 [49282,105348] 0 2024-04-26T21:26:03.282 INFO:tasks.workunit.client.0.smithi084.stdout:2/669: dwrite d6/d7/d3d/d15/d1f/d39/d20/d45/f87 [0,4194304] 0 2024-04-26T21:26:03.283 INFO:tasks.workunit.client.0.smithi084.stdout:1/545: chown d2/d9/c3c 1838604 1 2024-04-26T21:26:03.284 INFO:tasks.workunit.client.0.smithi084.stdout:0/552: chown de/c18 0 1 2024-04-26T21:26:03.284 INFO:tasks.workunit.client.0.smithi084.stdout:3/537: creat d1/d2c/d2f/d31/d55/fb4 x:0 0 0 2024-04-26T21:26:03.292 INFO:tasks.workunit.client.1.smithi120.stdout:0/899: symlink d0/d3/d51/d95/l124 0 2024-04-26T21:26:03.295 INFO:tasks.workunit.client.1.smithi120.stdout:0/900: symlink d0/d3/d51/d97/d108/d64/l125 0 2024-04-26T21:26:03.299 INFO:tasks.workunit.client.1.smithi120.stdout:0/901: fdatasync d0/d3/dc/d12/f42 0 2024-04-26T21:26:03.301 INFO:tasks.workunit.client.1.smithi120.stdout:9/720: rename d0/d14 to d0/d6/d4d/d65/dec 0 2024-04-26T21:26:03.301 INFO:tasks.workunit.client.0.smithi084.stdout:0/553: read de/f1f [2048273,96552] 0 2024-04-26T21:26:03.304 INFO:tasks.workunit.client.0.smithi084.stdout:4/518: dwrite d5/d2e/d5f/f51 [0,4194304] 0 2024-04-26T21:26:03.305 INFO:tasks.workunit.client.1.smithi120.stdout:3/800: dwrite dd/de/df/dda/d24/db1/d76/d3b/d56/d75/fbb [0,4194304] 0 2024-04-26T21:26:03.305 INFO:tasks.workunit.client.0.smithi084.stdout:6/537: link d3/d18/d37/l67 d3/de/d5d/lb3 0 2024-04-26T21:26:03.306 INFO:tasks.workunit.client.1.smithi120.stdout:7/786: truncate d7/d64/da6/d1f/d28/f3d 2720484 0 2024-04-26T21:26:03.307 INFO:tasks.workunit.client.1.smithi120.stdout:5/822: write d2/d1b/d89/d6b/f95 [583517,113859] 0 2024-04-26T21:26:03.308 INFO:tasks.workunit.client.1.smithi120.stdout:9/721: mkdir d0/dd/d3a/dae/ded 0 2024-04-26T21:26:03.310 INFO:tasks.workunit.client.1.smithi120.stdout:7/787: stat d7/d64/da6/d1f/d28/d4c/d6b/dfc 0 2024-04-26T21:26:03.310 INFO:tasks.workunit.client.1.smithi120.stdout:0/902: creat d0/d3/d51/d70/d99/f126 x:0 0 0 2024-04-26T21:26:03.310 INFO:tasks.workunit.client.0.smithi084.stdout:7/569: dwrite d6/d9/d12/d8b/d72/da0/f4a [4194304,4194304] 0 2024-04-26T21:26:03.311 INFO:tasks.workunit.client.1.smithi120.stdout:9/722: stat d0/d6/d4d/lda 0 2024-04-26T21:26:03.311 INFO:tasks.workunit.client.1.smithi120.stdout:3/801: read dd/de/df/dda/d24/db1/d76/d3b/d56/d75/fbb [4190738,121468] 0 2024-04-26T21:26:03.313 INFO:tasks.workunit.client.1.smithi120.stdout:8/727: rename d5/d6/d11/d52/d27/f38 to d5/d6/d11/d52/fe9 0 2024-04-26T21:26:03.313 INFO:tasks.workunit.client.1.smithi120.stdout:9/723: fdatasync d0/d6/fbf 0 2024-04-26T21:26:03.314 INFO:tasks.workunit.client.1.smithi120.stdout:7/788: stat d7/d64/da6/d1f/d28/d4c/d6c/d74 0 2024-04-26T21:26:03.316 INFO:tasks.workunit.client.1.smithi120.stdout:9/724: fdatasync d0/d6/d4d/d65/dec/d2d/d4b/fe9 0 2024-04-26T21:26:03.318 INFO:tasks.workunit.client.1.smithi120.stdout:8/728: stat d5/d6/d11/d52/d27/d4f/d67/d85 0 2024-04-26T21:26:03.321 INFO:tasks.workunit.client.1.smithi120.stdout:3/802: rename dd/de/df/d12/d48/f93 to dd/de/d83/f106 0 2024-04-26T21:26:03.324 INFO:tasks.workunit.client.1.smithi120.stdout:9/725: unlink d0/d6/c37 0 2024-04-26T21:26:03.326 INFO:tasks.workunit.client.1.smithi120.stdout:8/729: symlink d5/d6/d34/d37/dd9/lea 0 2024-04-26T21:26:03.327 INFO:tasks.workunit.client.0.smithi084.stdout:6/538: rmdir d3/de/d15/d23/d90 39 2024-04-26T21:26:03.328 INFO:tasks.workunit.client.1.smithi120.stdout:3/803: write dd/de/df/dda/d24/d43/f4c [1620120,69095] 0 2024-04-26T21:26:03.330 INFO:tasks.workunit.client.1.smithi120.stdout:9/726: write d0/d6/d4d/d65/dec/d77/d9a/ddd/fe2 [848294,30016] 0 2024-04-26T21:26:03.333 INFO:tasks.workunit.client.1.smithi120.stdout:8/730: fsync d5/d6/f25 0 2024-04-26T21:26:03.333 INFO:tasks.workunit.client.1.smithi120.stdout:3/804: chown dd/de/df/d12/d48/d9b/dcb/dee 245972 1 2024-04-26T21:26:03.334 INFO:tasks.workunit.client.1.smithi120.stdout:9/727: creat d0/d6/d3d/fee x:0 0 0 2024-04-26T21:26:03.339 INFO:tasks.workunit.client.0.smithi084.stdout:5/557: dwrite d0/dc/df/d2a/f91 [0,4194304] 0 2024-04-26T21:26:03.340 INFO:tasks.workunit.client.0.smithi084.stdout:9/480: dread da/de/d16/d25/d41/d43/d48/d61/f77 [0,4194304] 0 2024-04-26T21:26:03.342 INFO:tasks.workunit.client.1.smithi120.stdout:0/903: dread d0/d3/dc/f22 [0,4194304] 0 2024-04-26T21:26:03.342 INFO:tasks.workunit.client.0.smithi084.stdout:0/554: rmdir de/d20/d4e/d99 0 2024-04-26T21:26:03.343 INFO:tasks.workunit.client.1.smithi120.stdout:3/805: chown dd/l17 1935 1 2024-04-26T21:26:03.344 INFO:tasks.workunit.client.0.smithi084.stdout:2/670: write d6/d7/d3d/d15/d1f/d39/da5/fcc [664992,116379] 0 2024-04-26T21:26:03.344 INFO:tasks.workunit.client.1.smithi120.stdout:8/731: rename d5/d6/d11/d52/d70 to d5/d6/d34/d42/d4a/deb 0 2024-04-26T21:26:03.345 INFO:tasks.workunit.client.0.smithi084.stdout:7/570: chown d6/d9/d12/d19/d8f/c95 66805 1 2024-04-26T21:26:03.346 INFO:tasks.workunit.client.1.smithi120.stdout:9/728: creat d0/d66/d93/db7/dc7/fef x:0 0 0 2024-04-26T21:26:03.348 INFO:tasks.workunit.client.0.smithi084.stdout:4/519: getdents d5/d25/d35 0 2024-04-26T21:26:03.352 INFO:tasks.workunit.client.1.smithi120.stdout:4/737: sync 2024-04-26T21:26:03.355 INFO:tasks.workunit.client.0.smithi084.stdout:1/546: dwrite d2/d19/f32 [0,4194304] 0 2024-04-26T21:26:03.355 INFO:tasks.workunit.client.0.smithi084.stdout:0/555: write de/d2b/f6b [2351303,32911] 0 2024-04-26T21:26:03.356 INFO:tasks.workunit.client.1.smithi120.stdout:8/732: unlink d5/d6/d75/d95/cd5 0 2024-04-26T21:26:03.357 INFO:tasks.workunit.client.0.smithi084.stdout:5/558: symlink d0/dc/df/d31/d53/d87/la8 0 2024-04-26T21:26:03.357 INFO:tasks.workunit.client.0.smithi084.stdout:6/539: write d3/de/d15/d40/f77 [3047166,95263] 0 2024-04-26T21:26:03.357 INFO:tasks.workunit.client.0.smithi084.stdout:9/481: truncate da/de/d1e/f74 650349 0 2024-04-26T21:26:03.361 INFO:tasks.workunit.client.0.smithi084.stdout:3/538: dread d1/d2c/d2f/d31/d55/f7b [0,4194304] 0 2024-04-26T21:26:03.362 INFO:tasks.workunit.client.1.smithi120.stdout:4/738: mknod d10/d28/dd9/ddd/dee/dd0/df3/cfb 0 2024-04-26T21:26:03.364 INFO:tasks.workunit.client.1.smithi120.stdout:4/739: chown d10/d28/dd9/ddd/dee/dd0/dd4/d86/dfa 1555 1 2024-04-26T21:26:03.365 INFO:tasks.workunit.client.1.smithi120.stdout:8/733: mkdir d5/d6/d34/d37/d60/dec 0 2024-04-26T21:26:03.366 INFO:tasks.workunit.client.0.smithi084.stdout:6/540: write d3/de/d15/d40/f77 [383692,82841] 0 2024-04-26T21:26:03.367 INFO:tasks.workunit.client.0.smithi084.stdout:9/482: fsync da/de/d1e/f31 0 2024-04-26T21:26:03.367 INFO:tasks.workunit.client.1.smithi120.stdout:8/734: dread - d5/d6/fcc zero size 2024-04-26T21:26:03.368 INFO:tasks.workunit.client.0.smithi084.stdout:3/539: write d1/d2c/d2f/d31/d55/d4e/d98/d9e/fa9 [869346,69991] 0 2024-04-26T21:26:03.368 INFO:tasks.workunit.client.0.smithi084.stdout:1/547: fsync d2/d9/d15/d28/d47/f4b 0 2024-04-26T21:26:03.370 INFO:tasks.workunit.client.0.smithi084.stdout:5/559: creat d0/dc/df/d75/fa9 x:0 0 0 2024-04-26T21:26:03.372 INFO:tasks.workunit.client.1.smithi120.stdout:5/823: dwrite d2/d30/d93/d107/f2c [0,4194304] 0 2024-04-26T21:26:03.372 INFO:tasks.workunit.client.1.smithi120.stdout:7/789: truncate d7/d64/da6/d1f/d7d/ff6 161189 0 2024-04-26T21:26:03.377 INFO:tasks.workunit.client.1.smithi120.stdout:8/735: chown d5/d6/d11/d32/f8f 5699 1 2024-04-26T21:26:03.379 INFO:tasks.workunit.client.0.smithi084.stdout:4/520: mkdir d5/d7/d65/d90/d91/daa 0 2024-04-26T21:26:03.381 INFO:tasks.workunit.client.0.smithi084.stdout:2/671: mkdir d6/d7/d3d/d15/d1f/d22/de6 0 2024-04-26T21:26:03.382 INFO:tasks.workunit.client.0.smithi084.stdout:6/541: mknod d3/de/d41/d5c/cb4 0 2024-04-26T21:26:03.382 INFO:tasks.workunit.client.0.smithi084.stdout:9/483: truncate da/de/d1e/d56/da6/fa9 1224877 0 2024-04-26T21:26:03.383 INFO:tasks.workunit.client.0.smithi084.stdout:3/540: write d1/d2c/d2f/d31/f37 [4421277,29647] 0 2024-04-26T21:26:03.383 INFO:tasks.workunit.client.0.smithi084.stdout:5/560: fsync d0/d49/d56/f6f 0 2024-04-26T21:26:03.385 INFO:tasks.workunit.client.1.smithi120.stdout:9/729: rename d0/l11 to d0/d6/d4d/d65/dec/lf0 0 2024-04-26T21:26:03.387 INFO:tasks.workunit.client.0.smithi084.stdout:1/548: read d2/d54/d5e/d66/d2a/d2c/d45/f68 [72929,51000] 0 2024-04-26T21:26:03.387 INFO:tasks.workunit.client.0.smithi084.stdout:4/521: fsync d5/d7/d65/d7f/d6a/f89 0 2024-04-26T21:26:03.388 INFO:tasks.workunit.client.1.smithi120.stdout:1/702: sync 2024-04-26T21:26:03.388 INFO:tasks.workunit.client.1.smithi120.stdout:6/780: sync 2024-04-26T21:26:03.388 INFO:tasks.workunit.client.0.smithi084.stdout:0/556: creat de/d20/d4c/dae/fb4 x:0 0 0 2024-04-26T21:26:03.389 INFO:tasks.workunit.client.1.smithi120.stdout:0/904: dwrite d0/d3/dc/dd/f54 [0,4194304] 0 2024-04-26T21:26:03.392 INFO:tasks.workunit.client.0.smithi084.stdout:1/549: chown d2/d1b 192 1 2024-04-26T21:26:03.394 INFO:tasks.workunit.client.0.smithi084.stdout:0/557: chown de/d2b/d45/f59 857237750 1 2024-04-26T21:26:03.396 INFO:tasks.workunit.client.0.smithi084.stdout:0/558: readlink de/l85 0 2024-04-26T21:26:03.396 INFO:tasks.workunit.client.0.smithi084.stdout:3/541: chown d1/l4 62 1 2024-04-26T21:26:03.396 INFO:tasks.workunit.client.1.smithi120.stdout:5/824: creat d2/d30/d93/df1/f12d x:0 0 0 2024-04-26T21:26:03.396 INFO:tasks.workunit.client.1.smithi120.stdout:9/730: mkdir d0/dd/d3a/dae/ded/df1 0 2024-04-26T21:26:03.398 INFO:tasks.workunit.client.0.smithi084.stdout:1/550: unlink d2/d9/c3c 0 2024-04-26T21:26:03.398 INFO:tasks.workunit.client.0.smithi084.stdout:6/542: read d3/de/d15/d40/f60 [1932230,25237] 0 2024-04-26T21:26:03.398 INFO:tasks.workunit.client.1.smithi120.stdout:1/703: symlink d6/d7/d2d/d48/ldf 0 2024-04-26T21:26:03.399 INFO:tasks.workunit.client.1.smithi120.stdout:4/740: dread d10/d12/f19 [0,4194304] 0 2024-04-26T21:26:03.400 INFO:tasks.workunit.client.1.smithi120.stdout:3/806: dwrite dd/de/f2e [0,4194304] 0 2024-04-26T21:26:03.404 INFO:tasks.workunit.client.1.smithi120.stdout:6/781: rename d4/db/d10/f52 to d4/db/d10/d22/d6c/d9a/f105 0 2024-04-26T21:26:03.405 INFO:tasks.workunit.client.0.smithi084.stdout:1/551: fsync d2/d54/d5e/d66/d2a/d2c/f2d 0 2024-04-26T21:26:03.405 INFO:tasks.workunit.client.0.smithi084.stdout:7/571: dwrite d6/f17 [0,4194304] 0 2024-04-26T21:26:03.405 INFO:tasks.workunit.client.0.smithi084.stdout:5/561: creat d0/faa x:0 0 0 2024-04-26T21:26:03.405 INFO:tasks.workunit.client.0.smithi084.stdout:4/522: creat d5/d25/d35/d60/fab x:0 0 0 2024-04-26T21:26:03.406 INFO:tasks.workunit.client.0.smithi084.stdout:7/572: stat d6/d1c 0 2024-04-26T21:26:03.408 INFO:tasks.workunit.client.0.smithi084.stdout:3/542: readlink d1/d2c/l33 0 2024-04-26T21:26:03.408 INFO:tasks.workunit.client.1.smithi120.stdout:8/736: dwrite d5/d6/d11/d32/d3b/f6f [0,4194304] 0 2024-04-26T21:26:03.410 INFO:tasks.workunit.client.1.smithi120.stdout:7/790: write d7/d64/da6/d2f/f7c [1047447,116470] 0 2024-04-26T21:26:03.411 INFO:tasks.workunit.client.0.smithi084.stdout:2/672: creat d6/d7/d3d/d15/d1f/d39/d20/d36/fe7 x:0 0 0 2024-04-26T21:26:03.416 INFO:tasks.workunit.client.1.smithi120.stdout:3/807: write dd/de/df/dda/d24/d43/ff7 [459537,70050] 0 2024-04-26T21:26:03.417 INFO:tasks.workunit.client.0.smithi084.stdout:5/562: symlink d0/dc/df/d31/d72/lab 0 2024-04-26T21:26:03.418 INFO:tasks.workunit.client.0.smithi084.stdout:6/543: creat d3/de/d15/d23/d90/fb5 x:0 0 0 2024-04-26T21:26:03.418 INFO:tasks.workunit.client.1.smithi120.stdout:4/741: symlink d10/d28/dd9/ddd/dee/dd0/dd4/lfc 0 2024-04-26T21:26:03.420 INFO:tasks.workunit.client.0.smithi084.stdout:6/544: readlink d3/d18/l54 0 2024-04-26T21:26:03.422 INFO:tasks.workunit.client.0.smithi084.stdout:7/573: symlink d6/d9/d12/lc5 0 2024-04-26T21:26:03.423 INFO:tasks.workunit.client.0.smithi084.stdout:5/563: write d0/dc/df/d31/d53/d87/f96 [3852885,94194] 0 2024-04-26T21:26:03.425 INFO:tasks.workunit.client.1.smithi120.stdout:7/791: creat d7/d10/f10e x:0 0 0 2024-04-26T21:26:03.426 INFO:tasks.workunit.client.0.smithi084.stdout:0/559: write de/d20/f24 [23684,41879] 0 2024-04-26T21:26:03.426 INFO:tasks.workunit.client.1.smithi120.stdout:9/731: getdents d0/d6 0 2024-04-26T21:26:03.429 INFO:tasks.workunit.client.0.smithi084.stdout:9/484: creat da/de/d16/d25/d41/d43/fb2 x:0 0 0 2024-04-26T21:26:03.429 INFO:tasks.workunit.client.0.smithi084.stdout:2/673: mkdir d6/d7/d3d/d4f/de8 0 2024-04-26T21:26:03.429 INFO:tasks.workunit.client.1.smithi120.stdout:8/737: truncate d5/d6/d11/d52/d27/d4f/f7d 421343 0 2024-04-26T21:26:03.429 INFO:tasks.workunit.client.1.smithi120.stdout:4/742: creat d10/da6/ffd x:0 0 0 2024-04-26T21:26:03.429 INFO:tasks.workunit.client.1.smithi120.stdout:3/808: creat dd/de/df/dda/d24/db1/d76/f107 x:0 0 0 2024-04-26T21:26:03.430 INFO:tasks.workunit.client.0.smithi084.stdout:5/564: write d0/f22 [7074675,106979] 0 2024-04-26T21:26:03.431 INFO:tasks.workunit.client.0.smithi084.stdout:6/545: fsync d3/de/d15/df/f1b 0 2024-04-26T21:26:03.436 INFO:tasks.workunit.client.0.smithi084.stdout:3/543: symlink d1/d2c/d2f/lb5 0 2024-04-26T21:26:03.436 INFO:tasks.workunit.client.0.smithi084.stdout:2/674: chown d6/d7/d3d/d15/d1f/d39/d43/fcb 2351 1 2024-04-26T21:26:03.437 INFO:tasks.workunit.client.1.smithi120.stdout:3/809: rmdir dd/dcf/dea 39 2024-04-26T21:26:03.438 INFO:tasks.workunit.client.0.smithi084.stdout:4/523: dwrite d5/d25/d99/da0/fa6 [0,4194304] 0 2024-04-26T21:26:03.440 INFO:tasks.workunit.client.0.smithi084.stdout:1/552: creat d2/d54/d5e/d66/d2a/d2c/faf x:0 0 0 2024-04-26T21:26:03.441 INFO:tasks.workunit.client.0.smithi084.stdout:7/574: mknod d6/cc6 0 2024-04-26T21:26:03.443 INFO:tasks.workunit.client.1.smithi120.stdout:6/782: dwrite d4/d3d/fa7 [0,4194304] 0 2024-04-26T21:26:03.444 INFO:tasks.workunit.client.1.smithi120.stdout:1/704: dwrite d6/d7/d1d/d5d/d67/fb [0,4194304] 0 2024-04-26T21:26:03.445 INFO:tasks.workunit.client.0.smithi084.stdout:7/575: fdatasync d6/d9/d12/d8b/d72/fb7 0 2024-04-26T21:26:03.446 INFO:tasks.workunit.client.0.smithi084.stdout:9/485: rename da/de/d16/d25/d4f/d5f to da/db3 0 2024-04-26T21:26:03.450 INFO:tasks.workunit.client.0.smithi084.stdout:4/524: rmdir d5/d10/d15/d21/d29 39 2024-04-26T21:26:03.450 INFO:tasks.workunit.client.0.smithi084.stdout:1/553: write d2/d54/d5e/d66/d2a/d2c/faf [969572,66311] 0 2024-04-26T21:26:03.453 INFO:tasks.workunit.client.0.smithi084.stdout:6/546: rename d3/de/d1a/d43/d75/f7e to d3/de/d15/d40/fb6 0 2024-04-26T21:26:03.454 INFO:tasks.workunit.client.1.smithi120.stdout:9/732: creat d0/d6/d4d/dce/ff2 x:0 0 0 2024-04-26T21:26:03.454 INFO:tasks.workunit.client.0.smithi084.stdout:7/576: fsync d6/d68/f6e 0 2024-04-26T21:26:03.455 INFO:tasks.workunit.client.1.smithi120.stdout:8/738: creat d5/d6/d34/d37/d60/dec/fed x:0 0 0 2024-04-26T21:26:03.455 INFO:tasks.workunit.client.1.smithi120.stdout:6/783: rmdir d4/db/d10/dd 39 2024-04-26T21:26:03.458 INFO:tasks.workunit.client.1.smithi120.stdout:6/784: write d4/db/d25/d6d/d97/fbb [590089,84322] 0 2024-04-26T21:26:03.459 INFO:tasks.workunit.client.1.smithi120.stdout:1/705: rename d6/d7 to d6/d9/dd4/de0 0 2024-04-26T21:26:03.463 INFO:tasks.workunit.client.0.smithi084.stdout:1/554: mknod d2/d54/d93/cb0 0 2024-04-26T21:26:03.463 INFO:tasks.workunit.client.1.smithi120.stdout:7/792: creat d7/d64/da6/d1f/d28/f10f x:0 0 0 2024-04-26T21:26:03.465 INFO:tasks.workunit.client.0.smithi084.stdout:3/544: symlink d1/d2c/d2f/d31/d52/lb6 0 2024-04-26T21:26:03.465 INFO:tasks.workunit.client.1.smithi120.stdout:4/743: mkdir d10/d28/dd9/ddd/dee/dd0/dd4/d86/dfa/dfe 0 2024-04-26T21:26:03.466 INFO:tasks.workunit.client.0.smithi084.stdout:5/565: dwrite d0/fe [0,4194304] 0 2024-04-26T21:26:03.467 INFO:tasks.workunit.client.1.smithi120.stdout:3/810: mkdir dd/de/df/d12/d48/d9b/dcb/d102/d108 0 2024-04-26T21:26:03.468 INFO:tasks.workunit.client.1.smithi120.stdout:9/733: chown d0/d66/d93/db7/fd1 5546106 1 2024-04-26T21:26:03.469 INFO:tasks.workunit.client.0.smithi084.stdout:6/547: truncate d3/de/d41/f52 4711987 0 2024-04-26T21:26:03.474 INFO:tasks.workunit.client.0.smithi084.stdout:3/545: mknod d1/d2c/d2f/d31/d3b/cb7 0 2024-04-26T21:26:03.474 INFO:tasks.workunit.client.1.smithi120.stdout:4/744: creat d10/d28/dd9/ddd/dee/dd0/df3/fff x:0 0 0 2024-04-26T21:26:03.475 INFO:tasks.workunit.client.0.smithi084.stdout:6/548: symlink d3/de/d5d/lb7 0 2024-04-26T21:26:03.475 INFO:tasks.workunit.client.1.smithi120.stdout:4/745: chown d10/d65 65095 1 2024-04-26T21:26:03.477 INFO:tasks.workunit.client.0.smithi084.stdout:7/577: truncate d6/d68/d7f/fae 100796 0 2024-04-26T21:26:03.477 INFO:tasks.workunit.client.0.smithi084.stdout:1/555: fsync d2/d9/f16 0 2024-04-26T21:26:03.480 INFO:tasks.workunit.client.0.smithi084.stdout:7/578: write d6/d9/fa [6305812,70774] 0 2024-04-26T21:26:03.532 INFO:tasks.workunit.client.1.smithi120.stdout:2/789: sync 2024-04-26T21:26:03.548 INFO:tasks.workunit.client.0.smithi084.stdout:1/556: mkdir d2/d9/d67/db1 0 2024-04-26T21:26:03.550 INFO:tasks.workunit.client.0.smithi084.stdout:2/675: truncate d6/d7/d3d/d79/d81/d82/da8/fba 271483 0 2024-04-26T21:26:03.550 INFO:tasks.workunit.client.0.smithi084.stdout:3/546: link d1/d2c/c39 d1/d2c/d2f/d31/d55/cb8 0 2024-04-26T21:26:03.551 INFO:tasks.workunit.client.0.smithi084.stdout:6/549: truncate d3/de/d41/f44 5108225 0 2024-04-26T21:26:03.554 INFO:tasks.workunit.client.0.smithi084.stdout:1/557: symlink d2/d54/d5e/d66/d3a/d48/lb2 0 2024-04-26T21:26:03.557 INFO:tasks.workunit.client.0.smithi084.stdout:8/554: sync 2024-04-26T21:26:03.557 INFO:tasks.workunit.client.0.smithi084.stdout:3/547: rename d1/d2c/d2f/f2e to d1/d2c/d2f/d31/d55/da4/fb9 0 2024-04-26T21:26:03.558 INFO:tasks.workunit.client.1.smithi120.stdout:3/811: creat dd/f109 x:0 0 0 2024-04-26T21:26:03.559 INFO:tasks.workunit.client.1.smithi120.stdout:4/746: stat d10/d6b/d71/fd8 0 2024-04-26T21:26:03.568 INFO:tasks.workunit.client.0.smithi084.stdout:8/555: creat d4/d6/db/d1e/d22/d96/f9f x:0 0 0 2024-04-26T21:26:03.569 INFO:tasks.workunit.client.0.smithi084.stdout:2/676: link d6/d7/d3d/d15/d1f/d22/d99/f9d d6/d7/d3d/d15/d1f/d39/d20/d36/fe9 0 2024-04-26T21:26:03.570 INFO:tasks.workunit.client.0.smithi084.stdout:7/579: dread d6/f17 [0,4194304] 0 2024-04-26T21:26:03.571 INFO:tasks.workunit.client.0.smithi084.stdout:8/556: fsync d4/f5 0 2024-04-26T21:26:03.573 INFO:tasks.workunit.client.1.smithi120.stdout:9/734: dread d0/d6/d4d/d65/dec/d2d/d4b/d85/f88 [0,4194304] 0 2024-04-26T21:26:03.574 INFO:tasks.workunit.client.1.smithi120.stdout:1/706: dwrite d6/d9/dd4/de0/d1b/d3b/d6d/fb4 [0,4194304] 0 2024-04-26T21:26:03.577 INFO:tasks.workunit.client.0.smithi084.stdout:3/548: creat d1/d2c/d2f/d94/fba x:0 0 0 2024-04-26T21:26:03.578 INFO:tasks.workunit.client.0.smithi084.stdout:1/558: dread d2/d9/f16 [0,4194304] 0 2024-04-26T21:26:03.580 INFO:tasks.workunit.client.0.smithi084.stdout:7/580: write d6/d9/d12/d8b/fa7 [2400714,70891] 0 2024-04-26T21:26:03.583 INFO:tasks.workunit.client.0.smithi084.stdout:8/557: symlink d4/d7/d15/d37/d52/d69/la0 0 2024-04-26T21:26:03.585 INFO:tasks.workunit.client.1.smithi120.stdout:8/739: dread d5/d6/f1e [0,4194304] 0 2024-04-26T21:26:03.588 INFO:tasks.workunit.client.0.smithi084.stdout:1/559: write d2/d54/d5e/d66/d2a/f7c [756096,104438] 0 2024-04-26T21:26:03.588 INFO:tasks.workunit.client.0.smithi084.stdout:3/549: mkdir d1/d24/dbb 0 2024-04-26T21:26:03.590 INFO:tasks.workunit.client.0.smithi084.stdout:1/560: write d2/d54/d5e/f9a [573454,47361] 0 2024-04-26T21:26:03.590 INFO:tasks.workunit.client.1.smithi120.stdout:8/740: stat d5/d6/d11/d52/f17 0 2024-04-26T21:26:03.596 INFO:tasks.workunit.client.0.smithi084.stdout:9/486: dread da/de/d1e/f31 [0,4194304] 0 2024-04-26T21:26:03.596 INFO:tasks.workunit.client.0.smithi084.stdout:7/581: mknod d6/d9/d12/d19/d60/cc7 0 2024-04-26T21:26:03.597 INFO:tasks.workunit.client.1.smithi120.stdout:9/735: dwrite d0/d66/d93/db7/d9b/fc9 [0,4194304] 0 2024-04-26T21:26:03.600 INFO:tasks.workunit.client.0.smithi084.stdout:4/525: dread d5/d10/d15/f5b [0,4194304] 0 2024-04-26T21:26:03.601 INFO:tasks.workunit.client.0.smithi084.stdout:8/558: readlink d4/d6/db/d1e/d22/d39/l66 0 2024-04-26T21:26:03.604 INFO:tasks.workunit.client.0.smithi084.stdout:1/561: creat d2/d9/d15/d9f/fb3 x:0 0 0 2024-04-26T21:26:03.606 INFO:tasks.workunit.client.0.smithi084.stdout:2/677: rmdir d6/d7/d3d/d79/d81/d82/da8 39 2024-04-26T21:26:03.607 INFO:tasks.workunit.client.0.smithi084.stdout:1/562: fdatasync d2/d54/d93/faa 0 2024-04-26T21:26:03.610 INFO:tasks.workunit.client.0.smithi084.stdout:9/487: creat da/de/d16/d40/fb4 x:0 0 0 2024-04-26T21:26:03.612 INFO:tasks.workunit.client.0.smithi084.stdout:4/526: mkdir d5/d25/d99/dac 0 2024-04-26T21:26:03.614 INFO:tasks.workunit.client.0.smithi084.stdout:2/678: creat d6/d7/d3d/d79/fea x:0 0 0 2024-04-26T21:26:03.617 INFO:tasks.workunit.client.0.smithi084.stdout:3/550: link d1/d2c/d2f/d31/d55/cb8 d1/d24/cbc 0 2024-04-26T21:26:03.620 INFO:tasks.workunit.client.1.smithi120.stdout:4/747: creat d10/d28/dd9/f100 x:0 0 0 2024-04-26T21:26:03.620 INFO:tasks.workunit.client.0.smithi084.stdout:7/582: dread d6/f17 [0,4194304] 0 2024-04-26T21:26:03.620 INFO:tasks.workunit.client.0.smithi084.stdout:8/559: rename d4/d7/d53/l56 to d4/d6/db/d1e/d22/d39/d4a/la1 0 2024-04-26T21:26:03.628 INFO:tasks.workunit.client.0.smithi084.stdout:1/563: creat d2/d54/d5e/d66/d3a/fb4 x:0 0 0 2024-04-26T21:26:03.632 INFO:tasks.workunit.client.0.smithi084.stdout:3/551: creat d1/d2c/d2f/d31/d3b/fbd x:0 0 0 2024-04-26T21:26:03.635 INFO:tasks.workunit.client.0.smithi084.stdout:1/564: mkdir d2/d9/d15/d28/da0/db5 0 2024-04-26T21:26:03.635 INFO:tasks.workunit.client.1.smithi120.stdout:8/741: fsync d5/d6/d11/d52/f44 0 2024-04-26T21:26:03.638 INFO:tasks.workunit.client.1.smithi120.stdout:2/790: dread d4/d1b/d25/f32 [0,4194304] 0 2024-04-26T21:26:03.640 INFO:tasks.workunit.client.0.smithi084.stdout:7/583: creat d6/d9/db3/fc8 x:0 0 0 2024-04-26T21:26:03.640 INFO:tasks.workunit.client.0.smithi084.stdout:7/584: chown d6 816776475 1 2024-04-26T21:26:03.640 INFO:tasks.workunit.client.1.smithi120.stdout:8/742: write d5/d6/fcc [482577,129907] 0 2024-04-26T21:26:03.642 INFO:tasks.workunit.client.1.smithi120.stdout:8/743: fsync d5/d8e/fdf 0 2024-04-26T21:26:03.645 INFO:tasks.workunit.client.1.smithi120.stdout:4/748: dwrite d10/d12/f1d [0,4194304] 0 2024-04-26T21:26:03.645 INFO:tasks.workunit.client.0.smithi084.stdout:1/565: mknod d2/d54/d5e/d8d/cb6 0 2024-04-26T21:26:03.652 INFO:tasks.workunit.client.1.smithi120.stdout:8/744: creat d5/d6/d34/d37/db8/ddc/de4/fee x:0 0 0 2024-04-26T21:26:03.657 INFO:tasks.workunit.client.0.smithi084.stdout:7/585: rename d6/d9/d12/d19/f70 to d6/d9/d89/fc9 0 2024-04-26T21:26:03.658 INFO:tasks.workunit.client.1.smithi120.stdout:4/749: write d10/d28/dd9/ddd/dee/dd0/fe9 [7070430,125779] 0 2024-04-26T21:26:03.661 INFO:tasks.workunit.client.0.smithi084.stdout:1/566: creat d2/d9/d15/d28/da0/fb7 x:0 0 0 2024-04-26T21:26:03.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:03 smithi084 ceph-mon[25539]: pgmap v46: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 86 MiB/s rd, 255 MiB/s wr, 496 op/s 2024-04-26T21:26:03.663 INFO:tasks.workunit.client.0.smithi084.stdout:2/679: dwrite d6/d7/d3d/d15/d1f/d22/f24 [0,4194304] 0 2024-04-26T21:26:03.668 INFO:tasks.workunit.client.0.smithi084.stdout:9/488: dwrite da/de/d1e/d56/da6/fa9 [0,4194304] 0 2024-04-26T21:26:03.670 INFO:tasks.workunit.client.1.smithi120.stdout:4/750: rename d10/d28/f2b to d10/d28/dd9/ddd/dee/dd0/dd4/d86/f101 0 2024-04-26T21:26:03.670 INFO:tasks.workunit.client.1.smithi120.stdout:8/745: dwrite d5/d6/d34/d37/fdb [0,4194304] 0 2024-04-26T21:26:03.675 INFO:tasks.workunit.client.0.smithi084.stdout:1/567: creat d2/d54/d5e/d66/d2a/d2c/d45/fb8 x:0 0 0 2024-04-26T21:26:03.676 INFO:tasks.workunit.client.0.smithi084.stdout:8/560: dread d4/f13 [4194304,4194304] 0 2024-04-26T21:26:03.680 INFO:tasks.workunit.client.0.smithi084.stdout:2/680: truncate d6/d7/d3d/d15/d1f/d39/d20/d36/fe7 1033132 0 2024-04-26T21:26:03.680 INFO:tasks.workunit.client.0.smithi084.stdout:8/561: write d4/d6/f6e [166257,63434] 0 2024-04-26T21:26:03.680 INFO:tasks.workunit.client.0.smithi084.stdout:4/527: dwrite d5/f83 [0,4194304] 0 2024-04-26T21:26:03.682 INFO:tasks.workunit.client.0.smithi084.stdout:9/489: symlink da/de/d1e/d56/da6/lb5 0 2024-04-26T21:26:03.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:03 smithi120 ceph-mon[32741]: pgmap v46: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 86 MiB/s rd, 255 MiB/s wr, 496 op/s 2024-04-26T21:26:03.685 INFO:tasks.workunit.client.1.smithi120.stdout:4/751: symlink d10/d28/dd9/ddd/dee/l102 0 2024-04-26T21:26:03.685 INFO:tasks.workunit.client.0.smithi084.stdout:2/681: rmdir d6/d3e 39 2024-04-26T21:26:03.689 INFO:tasks.workunit.client.0.smithi084.stdout:9/490: mkdir da/de/d16/d55/db6 0 2024-04-26T21:26:03.692 INFO:tasks.workunit.client.0.smithi084.stdout:0/560: sync 2024-04-26T21:26:03.694 INFO:tasks.workunit.client.0.smithi084.stdout:1/568: unlink d2/d9/d15/d28/c39 0 2024-04-26T21:26:03.694 INFO:tasks.workunit.client.1.smithi120.stdout:0/905: sync 2024-04-26T21:26:03.696 INFO:tasks.workunit.client.0.smithi084.stdout:0/561: write de/d2b/d77/f1d [8527844,120385] 0 2024-04-26T21:26:03.699 INFO:tasks.workunit.client.0.smithi084.stdout:0/562: readlink de/d2b/d45/l5c 0 2024-04-26T21:26:03.700 INFO:tasks.workunit.client.0.smithi084.stdout:2/682: write d6/d7/d3d/d15/f1a [3628708,42383] 0 2024-04-26T21:26:03.705 INFO:tasks.workunit.client.0.smithi084.stdout:8/562: mkdir d4/d6/db/d1e/d22/d39/d4a/da2 0 2024-04-26T21:26:03.708 INFO:tasks.workunit.client.0.smithi084.stdout:9/491: mknod da/de/d16/d25/d41/dab/cb7 0 2024-04-26T21:26:03.712 INFO:tasks.workunit.client.0.smithi084.stdout:3/552: truncate d1/d24/d27/f53 2100665 0 2024-04-26T21:26:03.712 INFO:tasks.workunit.client.0.smithi084.stdout:4/528: rmdir d5/d7/d65/d90/d91/d9a 0 2024-04-26T21:26:03.712 INFO:tasks.workunit.client.0.smithi084.stdout:0/563: symlink de/d2b/d45/d94/lb5 0 2024-04-26T21:26:03.717 INFO:tasks.workunit.client.0.smithi084.stdout:0/564: mknod de/d20/d4c/cb6 0 2024-04-26T21:26:03.718 INFO:tasks.workunit.client.0.smithi084.stdout:4/529: creat d5/d10/da1/fad x:0 0 0 2024-04-26T21:26:03.724 INFO:tasks.workunit.client.0.smithi084.stdout:0/565: read de/d20/f5e [3424117,73462] 0 2024-04-26T21:26:03.726 INFO:tasks.workunit.client.0.smithi084.stdout:2/683: dwrite d6/d7/d3d/d79/dbe/fd8 [0,4194304] 0 2024-04-26T21:26:03.731 INFO:tasks.workunit.client.0.smithi084.stdout:7/586: dread d6/d9/d12/d19/d7a/d84/f76 [0,4194304] 0 2024-04-26T21:26:03.731 INFO:tasks.workunit.client.0.smithi084.stdout:8/563: dwrite d4/d7/f16 [4194304,4194304] 0 2024-04-26T21:26:03.734 INFO:tasks.workunit.client.0.smithi084.stdout:2/684: readlink d6/d7/d3d/d15/d1f/d39/d20/d45/d6d/l9e 0 2024-04-26T21:26:03.739 INFO:tasks.workunit.client.1.smithi120.stdout:5/825: sync 2024-04-26T21:26:03.750 INFO:tasks.workunit.client.0.smithi084.stdout:0/566: rename de/d2b/f3f to de/d20/d4c/fb7 0 2024-04-26T21:26:03.756 INFO:tasks.workunit.client.1.smithi120.stdout:3/812: write dd/de/df/dda/d24/d43/f47 [1040010,90859] 0 2024-04-26T21:26:03.758 INFO:tasks.workunit.client.1.smithi120.stdout:3/813: write dd/de/df/d12/f21 [9388879,25793] 0 2024-04-26T21:26:03.767 INFO:tasks.workunit.client.1.smithi120.stdout:9/736: creat d0/dd/ff3 x:0 0 0 2024-04-26T21:26:03.769 INFO:tasks.workunit.client.0.smithi084.stdout:4/530: truncate d5/d7/f63 970567 0 2024-04-26T21:26:03.771 INFO:tasks.workunit.client.1.smithi120.stdout:1/707: dwrite d6/d9/dd4/de0/d1d/f47 [0,4194304] 0 2024-04-26T21:26:03.771 INFO:tasks.workunit.client.0.smithi084.stdout:3/553: dwrite d1/d2c/d2f/d31/d55/f82 [0,4194304] 0 2024-04-26T21:26:03.774 INFO:tasks.workunit.client.0.smithi084.stdout:0/567: creat de/d20/d4e/fb8 x:0 0 0 2024-04-26T21:26:03.775 INFO:tasks.workunit.client.1.smithi120.stdout:4/752: creat d10/d6b/d71/dd7/f103 x:0 0 0 2024-04-26T21:26:03.780 INFO:tasks.workunit.client.0.smithi084.stdout:0/568: chown de/d2b/d45/d63/c66 0 1 2024-04-26T21:26:03.783 INFO:tasks.workunit.client.0.smithi084.stdout:7/587: dread d6/d9/d12/d19/d7a/fa2 [0,4194304] 0 2024-04-26T21:26:03.783 INFO:tasks.workunit.client.1.smithi120.stdout:3/814: symlink dd/de/d83/d64/db0/d46/l10a 0 2024-04-26T21:26:03.786 INFO:tasks.workunit.client.0.smithi084.stdout:0/569: fdatasync de/d2b/d77/d32/f44 0 2024-04-26T21:26:03.787 INFO:tasks.workunit.client.1.smithi120.stdout:6/785: sync 2024-04-26T21:26:03.788 INFO:tasks.workunit.client.1.smithi120.stdout:7/793: sync 2024-04-26T21:26:03.789 INFO:tasks.workunit.client.0.smithi084.stdout:4/531: truncate d5/d7/d65/d7f/f7a 1043185 0 2024-04-26T21:26:03.793 INFO:tasks.workunit.client.0.smithi084.stdout:7/588: chown d6/d9/d12/l3f 10255484 1 2024-04-26T21:26:03.794 INFO:tasks.workunit.client.0.smithi084.stdout:3/554: unlink d1/d2c/d2f/d31/c46 0 2024-04-26T21:26:03.795 INFO:tasks.workunit.client.0.smithi084.stdout:8/564: dwrite d4/d7/d15/f30 [0,4194304] 0 2024-04-26T21:26:03.797 INFO:tasks.workunit.client.0.smithi084.stdout:4/532: stat d5/d25/d35/f86 0 2024-04-26T21:26:03.797 INFO:tasks.workunit.client.1.smithi120.stdout:0/906: rename d0/d3/dc/dd/d1b/dfb to d0/d3/dc/dd/d1b/d24/d7d/d9f/d127 0 2024-04-26T21:26:03.799 INFO:tasks.workunit.client.0.smithi084.stdout:0/570: dread - de/d2b/d45/f59 zero size 2024-04-26T21:26:03.812 INFO:tasks.workunit.client.0.smithi084.stdout:8/565: creat d4/d3a/d8c/fa3 x:0 0 0 2024-04-26T21:26:03.812 INFO:tasks.workunit.client.0.smithi084.stdout:2/685: dwrite d6/d7/d3d/d15/d1f/d22/d2a/f44 [0,4194304] 0 2024-04-26T21:26:03.812 INFO:tasks.workunit.client.0.smithi084.stdout:3/555: write d1/f22 [2911391,104988] 0 2024-04-26T21:26:03.813 INFO:tasks.workunit.client.1.smithi120.stdout:5/826: rename d2/d1b/l23 to d2/dc/d1d/d21/db2/dde/d10c/l12e 0 2024-04-26T21:26:03.815 INFO:tasks.workunit.client.0.smithi084.stdout:8/566: readlink d4/d6/db/l60 0 2024-04-26T21:26:03.815 INFO:tasks.workunit.client.1.smithi120.stdout:0/907: dwrite d0/d3/d51/d70/d71/fee [0,4194304] 0 2024-04-26T21:26:03.820 INFO:tasks.workunit.client.0.smithi084.stdout:3/556: write d1/d2c/d2f/d31/d3b/f41 [2473499,51813] 0 2024-04-26T21:26:03.822 INFO:tasks.workunit.client.0.smithi084.stdout:0/571: mknod de/d2b/d77/d32/cb9 0 2024-04-26T21:26:03.824 INFO:tasks.workunit.client.0.smithi084.stdout:8/567: fsync d4/d6/f40 0 2024-04-26T21:26:03.827 INFO:tasks.workunit.client.0.smithi084.stdout:2/686: unlink d6/d7/d3d/d15/d1f/d22/d2a/f44 0 2024-04-26T21:26:03.828 INFO:tasks.workunit.client.1.smithi120.stdout:9/737: dread d0/dd/d45/dc0/fd6 [0,4194304] 0 2024-04-26T21:26:03.830 INFO:tasks.workunit.client.0.smithi084.stdout:0/572: creat de/d20/d4c/fba x:0 0 0 2024-04-26T21:26:03.830 INFO:tasks.workunit.client.0.smithi084.stdout:6/550: sync 2024-04-26T21:26:03.830 INFO:tasks.workunit.client.0.smithi084.stdout:8/568: write d4/d7/d15/f30 [9111614,101619] 0 2024-04-26T21:26:03.830 INFO:tasks.workunit.client.1.smithi120.stdout:9/738: write d0/d66/d93/db7/d9b/fc9 [1673361,86655] 0 2024-04-26T21:26:03.831 INFO:tasks.workunit.client.0.smithi084.stdout:2/687: chown d6/d7/d3d/f5c 2408 1 2024-04-26T21:26:03.832 INFO:tasks.workunit.client.0.smithi084.stdout:5/566: sync 2024-04-26T21:26:03.834 INFO:tasks.workunit.client.1.smithi120.stdout:8/746: unlink d5/d6/d75/fa6 0 2024-04-26T21:26:03.836 INFO:tasks.workunit.client.1.smithi120.stdout:1/708: rename d6/d14/d6f/l99 to d6/d9/dd4/de0/d1b/d55/le1 0 2024-04-26T21:26:03.838 INFO:tasks.workunit.client.1.smithi120.stdout:2/791: creat d4/d1b/d25/d2c/d3e/f109 x:0 0 0 2024-04-26T21:26:03.838 INFO:tasks.workunit.client.0.smithi084.stdout:0/573: unlink de/d78/d9e/da4/cb2 0 2024-04-26T21:26:03.840 INFO:tasks.workunit.client.1.smithi120.stdout:2/792: chown d4/d1b/d56/fc7 1081 1 2024-04-26T21:26:03.840 INFO:tasks.workunit.client.0.smithi084.stdout:0/574: read de/f83 [958017,17604] 0 2024-04-26T21:26:03.841 INFO:tasks.workunit.client.0.smithi084.stdout:6/551: truncate d3/de/d15/f1c 165854 0 2024-04-26T21:26:03.842 INFO:tasks.workunit.client.0.smithi084.stdout:8/569: mknod d4/d7/d15/d9d/ca4 0 2024-04-26T21:26:03.842 INFO:tasks.workunit.client.0.smithi084.stdout:0/575: chown de/d20/c2e 16507464 1 2024-04-26T21:26:03.843 INFO:tasks.workunit.client.0.smithi084.stdout:5/567: mknod d0/dc/df/d75/cac 0 2024-04-26T21:26:03.845 INFO:tasks.workunit.client.0.smithi084.stdout:0/576: dread - de/d2b/d77/d32/d96/f9c zero size 2024-04-26T21:26:03.846 INFO:tasks.workunit.client.0.smithi084.stdout:6/552: readlink d3/d18/d37/l67 0 2024-04-26T21:26:03.848 INFO:tasks.workunit.client.0.smithi084.stdout:8/570: mknod d4/d3a/ca5 0 2024-04-26T21:26:03.849 INFO:tasks.workunit.client.0.smithi084.stdout:0/577: readlink de/l13 0 2024-04-26T21:26:03.849 INFO:tasks.workunit.client.1.smithi120.stdout:8/747: truncate d5/d6/d11/d52/f44 211493 0 2024-04-26T21:26:03.850 INFO:tasks.workunit.client.1.smithi120.stdout:0/908: rename d0/d3/d51/d70/ca8 to d0/d3/d51/d97/d108/d64/c128 0 2024-04-26T21:26:03.851 INFO:tasks.workunit.client.1.smithi120.stdout:8/748: fsync d5/d6/d34/d37/d60/f5c 0 2024-04-26T21:26:03.852 INFO:tasks.workunit.client.0.smithi084.stdout:5/568: creat d0/dc/df/d31/d53/d5d/fad x:0 0 0 2024-04-26T21:26:03.854 INFO:tasks.workunit.client.1.smithi120.stdout:8/749: chown d5/d6/d11/d32/l5f 2943 1 2024-04-26T21:26:03.854 INFO:tasks.workunit.client.0.smithi084.stdout:6/553: rmdir d3/de/d1a/d43/d75 39 2024-04-26T21:26:03.856 INFO:tasks.workunit.client.1.smithi120.stdout:5/827: link d2/d30/d93/d107/d36/d67/lf3 d2/dc/d1d/d21/d66/d6a/l12f 0 2024-04-26T21:26:03.857 INFO:tasks.workunit.client.0.smithi084.stdout:5/569: creat d0/d17/fae x:0 0 0 2024-04-26T21:26:03.859 INFO:tasks.workunit.client.1.smithi120.stdout:9/739: rename d0/dd/l29 to d0/d66/db5/lf4 0 2024-04-26T21:26:03.862 INFO:tasks.workunit.client.0.smithi084.stdout:4/533: truncate d5/d10/f71 1499095 0 2024-04-26T21:26:03.862 INFO:tasks.workunit.client.0.smithi084.stdout:7/589: write d6/d9/d12/d19/d20/d38/f53 [1073521,86383] 0 2024-04-26T21:26:03.865 INFO:tasks.workunit.client.1.smithi120.stdout:1/709: mkdir d6/d9/dd4/de0/d1b/d89/d8c/de2 0 2024-04-26T21:26:03.866 INFO:tasks.workunit.client.0.smithi084.stdout:8/571: rename d4/d6/db/d1e/d22/d2f/c4d to d4/d6/db/d1e/d22/d39/d4a/ca6 0 2024-04-26T21:26:03.866 INFO:tasks.workunit.client.1.smithi120.stdout:8/750: fsync d5/d6/d34/d42/d9d/d7a/f7c 0 2024-04-26T21:26:03.866 INFO:tasks.workunit.client.1.smithi120.stdout:5/828: creat d2/dc/d1d/d21/db2/f130 x:0 0 0 2024-04-26T21:26:03.868 INFO:tasks.workunit.client.0.smithi084.stdout:7/590: creat d6/d9/d12/d19/fca x:0 0 0 2024-04-26T21:26:03.869 INFO:tasks.workunit.client.0.smithi084.stdout:3/557: truncate d1/d2c/d2f/f28 887141 0 2024-04-26T21:26:03.873 INFO:tasks.workunit.client.1.smithi120.stdout:1/710: rmdir d6/d9/dd4/de0/d1b/d89 39 2024-04-26T21:26:03.873 INFO:tasks.workunit.client.0.smithi084.stdout:5/570: creat d0/dc/df/d31/d53/faf x:0 0 0 2024-04-26T21:26:03.874 INFO:tasks.workunit.client.0.smithi084.stdout:0/578: dread de/d2b/d77/d32/f3d [0,4194304] 0 2024-04-26T21:26:03.878 INFO:tasks.workunit.client.0.smithi084.stdout:6/554: getdents d3/de/d15/df 0 2024-04-26T21:26:03.879 INFO:tasks.workunit.client.1.smithi120.stdout:9/740: mkdir d0/dd/d3a/de8/df5 0 2024-04-26T21:26:03.881 INFO:tasks.workunit.client.0.smithi084.stdout:8/572: truncate d4/d6/db/d1e/d22/d96/f9e 417690 0 2024-04-26T21:26:03.882 INFO:tasks.workunit.client.1.smithi120.stdout:1/711: mkdir d6/d9/dd4/de0/d1d/d5d/d67/de3 0 2024-04-26T21:26:03.883 INFO:tasks.workunit.client.0.smithi084.stdout:5/571: readlink d0/dc/df/d31/d63/l66 0 2024-04-26T21:26:03.883 INFO:tasks.workunit.client.1.smithi120.stdout:7/794: truncate d7/d19/f51 3962716 0 2024-04-26T21:26:03.885 INFO:tasks.workunit.client.0.smithi084.stdout:3/558: symlink d1/d2c/d2f/d31/d55/d4e/d98/lbe 0 2024-04-26T21:26:03.886 INFO:tasks.workunit.client.1.smithi120.stdout:9/741: chown d0/d6/d4d/d65/dec/d2d/d4b/f55 655732 1 2024-04-26T21:26:03.886 INFO:tasks.workunit.client.0.smithi084.stdout:8/573: stat d4/d6/db/d1e/d22/c48 0 2024-04-26T21:26:03.887 INFO:tasks.workunit.client.0.smithi084.stdout:6/555: creat d3/de/d15/d23/d90/fb8 x:0 0 0 2024-04-26T21:26:03.891 INFO:tasks.workunit.client.1.smithi120.stdout:1/712: creat d6/fe4 x:0 0 0 2024-04-26T21:26:03.892 INFO:tasks.workunit.client.0.smithi084.stdout:5/572: creat d0/dc/df/d75/fb0 x:0 0 0 2024-04-26T21:26:03.892 INFO:tasks.workunit.client.0.smithi084.stdout:2/688: dread d6/d7/d3d/d15/d1f/d22/d2a/fcd [0,4194304] 0 2024-04-26T21:26:03.894 INFO:tasks.workunit.client.1.smithi120.stdout:9/742: rename d0/dd/d34/f59 to d0/dd/d3a/ff6 0 2024-04-26T21:26:03.895 INFO:tasks.workunit.client.1.smithi120.stdout:9/743: stat d0/f18 0 2024-04-26T21:26:03.895 INFO:tasks.workunit.client.0.smithi084.stdout:4/534: dwrite d5/d2e/d5f/f51 [0,4194304] 0 2024-04-26T21:26:03.896 INFO:tasks.workunit.client.0.smithi084.stdout:5/573: fsync d0/dc/df/d31/f9c 0 2024-04-26T21:26:03.896 INFO:tasks.workunit.client.0.smithi084.stdout:0/579: getdents de/d20/d4c/dae 0 2024-04-26T21:26:03.899 INFO:tasks.workunit.client.0.smithi084.stdout:0/580: fdatasync de/d20/d4e/f6a 0 2024-04-26T21:26:03.901 INFO:tasks.workunit.client.0.smithi084.stdout:1/569: sync 2024-04-26T21:26:03.902 INFO:tasks.workunit.client.0.smithi084.stdout:3/559: write d1/f1a [314736,71044] 0 2024-04-26T21:26:03.905 INFO:tasks.workunit.client.1.smithi120.stdout:4/753: write d10/d12/f3c [618660,78634] 0 2024-04-26T21:26:03.906 INFO:tasks.workunit.client.1.smithi120.stdout:9/744: dread d0/dd/d3a/d5c/f9e [0,4194304] 0 2024-04-26T21:26:03.908 INFO:tasks.workunit.client.0.smithi084.stdout:0/581: unlink de/d2b/d64/d81/f97 0 2024-04-26T21:26:03.909 INFO:tasks.workunit.client.0.smithi084.stdout:0/582: dread - de/d20/f98 zero size 2024-04-26T21:26:03.911 INFO:tasks.workunit.client.0.smithi084.stdout:0/583: write de/d20/f24 [1463131,44441] 0 2024-04-26T21:26:03.912 INFO:tasks.workunit.client.0.smithi084.stdout:0/584: chown de/d2b/d77/c7f 53278909 1 2024-04-26T21:26:03.913 INFO:tasks.workunit.client.0.smithi084.stdout:3/560: unlink d1/d2c/d2f/d31/f37 0 2024-04-26T21:26:03.913 INFO:tasks.workunit.client.1.smithi120.stdout:1/713: rename d6/d9/dd4/de0/ff to d6/d9/dd4/de0/d2d/fe5 0 2024-04-26T21:26:03.914 INFO:tasks.workunit.client.0.smithi084.stdout:1/570: symlink d2/d54/d5e/d66/d3a/d48/lb9 0 2024-04-26T21:26:03.914 INFO:tasks.workunit.client.0.smithi084.stdout:6/556: write d3/de/d15/f1c [906582,39847] 0 2024-04-26T21:26:03.914 INFO:tasks.workunit.client.0.smithi084.stdout:4/535: getdents d5/d7/d65/d90/d91 0 2024-04-26T21:26:03.917 INFO:tasks.workunit.client.1.smithi120.stdout:6/786: dwrite d4/db/d10/d22/d56/d94/fb2 [0,4194304] 0 2024-04-26T21:26:03.920 INFO:tasks.workunit.client.0.smithi084.stdout:2/689: link d6/d7/d3d/d79/d81/fc3 d6/d7/d3d/d15/d1f/d39/d20/d36/da4/feb 0 2024-04-26T21:26:03.920 INFO:tasks.workunit.client.0.smithi084.stdout:3/561: dread - d1/d24/f92 zero size 2024-04-26T21:26:03.920 INFO:tasks.workunit.client.0.smithi084.stdout:5/574: rmdir d0/dc/df/d75/d9a 0 2024-04-26T21:26:03.923 INFO:tasks.workunit.client.0.smithi084.stdout:1/571: rmdir d2/d9 39 2024-04-26T21:26:03.924 INFO:tasks.workunit.client.0.smithi084.stdout:3/562: readlink d1/d24/d27/l3d 0 2024-04-26T21:26:03.924 INFO:tasks.workunit.client.1.smithi120.stdout:4/754: dwrite d10/f2d [4194304,4194304] 0 2024-04-26T21:26:03.926 INFO:tasks.workunit.client.1.smithi120.stdout:4/755: readlink d10/d6b/dbf/lc7 0 2024-04-26T21:26:03.926 INFO:tasks.workunit.client.1.smithi120.stdout:0/909: getdents d0/d3/d51/d70 0 2024-04-26T21:26:03.927 INFO:tasks.workunit.client.0.smithi084.stdout:2/690: fdatasync d6/f14 0 2024-04-26T21:26:03.927 INFO:tasks.workunit.client.1.smithi120.stdout:6/787: mknod d4/db/c106 0 2024-04-26T21:26:03.929 INFO:tasks.workunit.client.0.smithi084.stdout:0/585: creat de/fbb x:0 0 0 2024-04-26T21:26:03.930 INFO:tasks.workunit.client.0.smithi084.stdout:6/557: rename d3/de/d15/df/c5a to d3/de/d1a/d2f/cb9 0 2024-04-26T21:26:03.931 INFO:tasks.workunit.client.0.smithi084.stdout:0/586: readlink de/d2b/d45/l56 0 2024-04-26T21:26:03.931 INFO:tasks.workunit.client.0.smithi084.stdout:7/591: dread d6/d9/d12/f2c [0,4194304] 0 2024-04-26T21:26:03.933 INFO:tasks.workunit.client.1.smithi120.stdout:0/910: rmdir d0/d3/d51/d95/dd0 39 2024-04-26T21:26:03.934 INFO:tasks.workunit.client.0.smithi084.stdout:5/575: symlink d0/dc/df/d31/d72/d84/lb1 0 2024-04-26T21:26:03.935 INFO:tasks.workunit.client.0.smithi084.stdout:3/563: chown d1/d2c/d2f/d31/d55/d4e/d98/lbe 1082165 1 2024-04-26T21:26:03.937 INFO:tasks.workunit.client.0.smithi084.stdout:5/576: fdatasync d0/d49/d56/f57 0 2024-04-26T21:26:03.939 INFO:tasks.workunit.client.1.smithi120.stdout:2/793: dwrite d4/f3a [0,4194304] 0 2024-04-26T21:26:03.941 INFO:tasks.workunit.client.1.smithi120.stdout:4/756: truncate d10/d28/f8b 2383089 0 2024-04-26T21:26:03.947 INFO:tasks.workunit.client.0.smithi084.stdout:0/587: rename de/d2b/d45/l5c to de/d78/d9e/lbc 0 2024-04-26T21:26:03.947 INFO:tasks.workunit.client.1.smithi120.stdout:6/788: mkdir d4/db/d10/dd/d28/d9e/daf/dd3/d107 0 2024-04-26T21:26:03.947 INFO:tasks.workunit.client.0.smithi084.stdout:8/574: dwrite d4/d6/db/d1e/d22/d2f/f2c [4194304,4194304] 0 2024-04-26T21:26:03.951 INFO:tasks.workunit.client.1.smithi120.stdout:6/789: write d4/db/d10/ddb/fe5 [500941,106471] 0 2024-04-26T21:26:03.951 INFO:tasks.workunit.client.1.smithi120.stdout:2/794: truncate d4/d1b/d56/fb5 795039 0 2024-04-26T21:26:03.953 INFO:tasks.workunit.client.1.smithi120.stdout:0/911: dwrite d0/d3/dc/d12/d31/f122 [0,4194304] 0 2024-04-26T21:26:03.953 INFO:tasks.workunit.client.0.smithi084.stdout:0/588: chown de/d2b/d77/d68 22524 1 2024-04-26T21:26:03.954 INFO:tasks.workunit.client.0.smithi084.stdout:5/577: creat d0/dc/df/d31/d72/fb2 x:0 0 0 2024-04-26T21:26:03.954 INFO:tasks.workunit.client.1.smithi120.stdout:2/795: readlink d4/d1b/d25/d29/l104 0 2024-04-26T21:26:03.954 INFO:tasks.workunit.client.1.smithi120.stdout:4/757: mkdir d10/d12/da1/d104 0 2024-04-26T21:26:03.956 INFO:tasks.workunit.client.1.smithi120.stdout:8/751: write d5/d6/d11/d32/fe5 [2032580,33920] 0 2024-04-26T21:26:03.957 INFO:tasks.workunit.client.0.smithi084.stdout:3/564: link d1/f22 d1/d2c/d2f/fbf 0 2024-04-26T21:26:03.957 INFO:tasks.workunit.client.1.smithi120.stdout:2/796: write d4/d1b/d56/d65/fbc [978665,6957] 0 2024-04-26T21:26:03.963 INFO:tasks.workunit.client.1.smithi120.stdout:0/912: symlink d0/d3/dc/d12/dae/l129 0 2024-04-26T21:26:03.964 INFO:tasks.workunit.client.0.smithi084.stdout:5/578: mkdir d0/d49/d4d/db3 0 2024-04-26T21:26:03.964 INFO:tasks.workunit.client.0.smithi084.stdout:0/589: symlink de/d2b/d45/d94/lbd 0 2024-04-26T21:26:03.968 INFO:tasks.workunit.client.1.smithi120.stdout:2/797: creat d4/d1b/d56/d65/f10a x:0 0 0 2024-04-26T21:26:03.968 INFO:tasks.workunit.client.1.smithi120.stdout:6/790: dread d4/db/d10/d22/d6c/f70 [4194304,4194304] 0 2024-04-26T21:26:03.968 INFO:tasks.workunit.client.0.smithi084.stdout:0/590: write de/d20/f29 [1137509,48736] 0 2024-04-26T21:26:03.970 INFO:tasks.workunit.client.1.smithi120.stdout:0/913: readlink d0/d3/dc/d12/d31/ld7 0 2024-04-26T21:26:03.974 INFO:tasks.workunit.client.1.smithi120.stdout:2/798: fsync d4/d1b/d25/f86 0 2024-04-26T21:26:03.977 INFO:tasks.workunit.client.1.smithi120.stdout:0/914: rmdir d0/d3/dc/dd/d1b/d24/d73 39 2024-04-26T21:26:03.979 INFO:tasks.workunit.client.1.smithi120.stdout:0/915: chown d0/d3/d51/d70/ldc 19174 1 2024-04-26T21:26:03.986 INFO:tasks.workunit.client.0.smithi084.stdout:1/572: dwrite d2/d1b/f8b [0,4194304] 0 2024-04-26T21:26:03.990 INFO:tasks.workunit.client.1.smithi120.stdout:0/916: truncate d0/d3/dc/dd/d1b/d39/f53 3632590 0 2024-04-26T21:26:03.993 INFO:tasks.workunit.client.1.smithi120.stdout:7/795: write d7/d64/da6/d1a/d33/fa0 [687954,44932] 0 2024-04-26T21:26:03.994 INFO:tasks.workunit.client.0.smithi084.stdout:7/592: dwrite d6/d1c/d51/f9d [0,4194304] 0 2024-04-26T21:26:03.995 INFO:tasks.workunit.client.1.smithi120.stdout:2/799: read d4/d1b/d4f/f9c [833734,62315] 0 2024-04-26T21:26:03.995 INFO:tasks.workunit.client.1.smithi120.stdout:0/917: creat d0/d3/dc/dd/d9b/f12a x:0 0 0 2024-04-26T21:26:04.001 INFO:tasks.workunit.client.1.smithi120.stdout:1/714: rename d6/d9/dd4/de0/d2d/fe5 to d6/d9/dd4/de0/d1d/d5d/d67/de3/fe6 0 2024-04-26T21:26:04.002 INFO:tasks.workunit.client.0.smithi084.stdout:1/573: chown d2/d9/d15/d28/c84 45379228 1 2024-04-26T21:26:04.006 INFO:tasks.workunit.client.0.smithi084.stdout:3/565: link d1/d2c/d2f/d31/d55/l49 d1/lc0 0 2024-04-26T21:26:04.008 INFO:tasks.workunit.client.0.smithi084.stdout:7/593: creat d6/d9/d12/d8b/d72/fcb x:0 0 0 2024-04-26T21:26:04.009 INFO:tasks.workunit.client.0.smithi084.stdout:2/691: dread d6/d7/d3d/d15/d1f/d41/f4b [0,4194304] 0 2024-04-26T21:26:04.009 INFO:tasks.workunit.client.0.smithi084.stdout:8/575: dwrite d4/d7/d15/f18 [0,4194304] 0 2024-04-26T21:26:04.010 INFO:tasks.workunit.client.1.smithi120.stdout:4/758: rename d10/da6/ffd to d10/d6b/dbf/f105 0 2024-04-26T21:26:04.010 INFO:tasks.workunit.client.1.smithi120.stdout:2/800: chown d4/d1b/d2e/d50/d14/l2f 6 1 2024-04-26T21:26:04.014 INFO:tasks.workunit.client.0.smithi084.stdout:3/566: stat d1/d2c/d2f 0 2024-04-26T21:26:04.015 INFO:tasks.workunit.client.1.smithi120.stdout:1/715: dread d6/daa/dae/f9a [0,4194304] 0 2024-04-26T21:26:04.015 INFO:tasks.workunit.client.0.smithi084.stdout:5/579: dwrite d0/dc/f19 [4194304,4194304] 0 2024-04-26T21:26:04.019 INFO:tasks.workunit.client.1.smithi120.stdout:4/759: read d10/d12/f5c [2271667,72619] 0 2024-04-26T21:26:04.020 INFO:tasks.workunit.client.1.smithi120.stdout:0/918: truncate d0/d3/f3c 2947482 0 2024-04-26T21:26:04.021 INFO:tasks.workunit.client.0.smithi084.stdout:5/580: stat d0/da2 0 2024-04-26T21:26:04.024 INFO:tasks.workunit.client.1.smithi120.stdout:4/760: readlink d10/d6b/l81 0 2024-04-26T21:26:04.027 INFO:tasks.workunit.client.1.smithi120.stdout:3/815: sync 2024-04-26T21:26:04.029 INFO:tasks.workunit.client.1.smithi120.stdout:4/761: readlink d10/d28/dd9/ddd/dee/l102 0 2024-04-26T21:26:04.030 INFO:tasks.workunit.client.0.smithi084.stdout:7/594: creat d6/d9/d12/d19/d7a/d84/fcc x:0 0 0 2024-04-26T21:26:04.035 INFO:tasks.workunit.client.1.smithi120.stdout:8/752: write d5/d6/d11/f31 [1421383,67556] 0 2024-04-26T21:26:04.036 INFO:tasks.workunit.client.0.smithi084.stdout:3/567: write d1/d2c/d2f/d31/d55/f9b [445516,113305] 0 2024-04-26T21:26:04.036 INFO:tasks.workunit.client.0.smithi084.stdout:2/692: rename d6/d7/d3d/d15/d1f/d39/d20/d45/d5a to d6/d7/db6/dec 0 2024-04-26T21:26:04.039 INFO:tasks.workunit.client.0.smithi084.stdout:8/576: mkdir d4/d7/d15/da7 0 2024-04-26T21:26:04.040 INFO:tasks.workunit.client.0.smithi084.stdout:3/568: chown d1/d2c/c7f 14 1 2024-04-26T21:26:04.040 INFO:tasks.workunit.client.0.smithi084.stdout:7/595: mknod d6/d9/d63/db5/ccd 0 2024-04-26T21:26:04.041 INFO:tasks.workunit.client.0.smithi084.stdout:1/574: dwrite d2/d54/d5e/d66/f44 [0,4194304] 0 2024-04-26T21:26:04.041 INFO:tasks.workunit.client.1.smithi120.stdout:2/801: dwrite d4/fd8 [0,4194304] 0 2024-04-26T21:26:04.045 INFO:tasks.workunit.client.0.smithi084.stdout:3/569: fsync d1/d2c/d2f/d31/d3b/f74 0 2024-04-26T21:26:04.046 INFO:tasks.workunit.client.1.smithi120.stdout:6/791: dread d4/db/d10/d1a/d2b/d57/d67/fc2 [0,4194304] 0 2024-04-26T21:26:04.046 INFO:tasks.workunit.client.0.smithi084.stdout:6/558: dread d3/de/d1a/f36 [0,4194304] 0 2024-04-26T21:26:04.053 INFO:tasks.workunit.client.1.smithi120.stdout:0/919: dwrite d0/df/d79/fec [4194304,4194304] 0 2024-04-26T21:26:04.056 INFO:tasks.workunit.client.1.smithi120.stdout:3/816: rename dd/de/df/dda/d24/f41 to dd/d40/f10b 0 2024-04-26T21:26:04.056 INFO:tasks.workunit.client.1.smithi120.stdout:8/753: symlink d5/d6/d34/d42/d4a/dbf/lef 0 2024-04-26T21:26:04.058 INFO:tasks.workunit.client.0.smithi084.stdout:9/492: sync 2024-04-26T21:26:04.060 INFO:tasks.workunit.client.0.smithi084.stdout:8/577: symlink d4/d7/d15/la8 0 2024-04-26T21:26:04.060 INFO:tasks.workunit.client.0.smithi084.stdout:7/596: symlink d6/d68/d7f/lce 0 2024-04-26T21:26:04.061 INFO:tasks.workunit.client.1.smithi120.stdout:7/796: dread d7/d64/da6/d1f/d28/dbb/f9f [0,4194304] 0 2024-04-26T21:26:04.062 INFO:tasks.workunit.client.0.smithi084.stdout:6/559: fsync d3/de/d5d/f89 0 2024-04-26T21:26:04.063 INFO:tasks.workunit.client.1.smithi120.stdout:7/797: dread - d7/d64/da6/d1f/fda zero size 2024-04-26T21:26:04.064 INFO:tasks.workunit.client.1.smithi120.stdout:1/716: rmdir d6/d9 39 2024-04-26T21:26:04.067 INFO:tasks.workunit.client.0.smithi084.stdout:7/597: chown d6/d68/c9c 3441 1 2024-04-26T21:26:04.068 INFO:tasks.workunit.client.1.smithi120.stdout:2/802: creat d4/d1b/d25/d2c/d3e/d5e/de0/f10b x:0 0 0 2024-04-26T21:26:04.070 INFO:tasks.workunit.client.0.smithi084.stdout:1/575: link d2/d54/d5e/d66/d2a/f79 d2/d9/d67/fba 0 2024-04-26T21:26:04.071 INFO:tasks.workunit.client.1.smithi120.stdout:8/754: creat d5/d6/d11/d32/d3b/dd3/ff0 x:0 0 0 2024-04-26T21:26:04.074 INFO:tasks.workunit.client.0.smithi084.stdout:3/570: mknod d1/d24/cc1 0 2024-04-26T21:26:04.074 INFO:tasks.workunit.client.0.smithi084.stdout:5/581: fsync d0/d49/d56/f61 0 2024-04-26T21:26:04.075 INFO:tasks.workunit.client.0.smithi084.stdout:2/693: dwrite d6/d7/d3d/d79/fea [0,4194304] 0 2024-04-26T21:26:04.076 INFO:tasks.workunit.client.0.smithi084.stdout:5/582: fsync d0/dc/df/d6d/f73 0 2024-04-26T21:26:04.079 INFO:tasks.workunit.client.0.smithi084.stdout:0/591: dread de/d20/f24 [0,4194304] 0 2024-04-26T21:26:04.080 INFO:tasks.workunit.client.1.smithi120.stdout:4/762: write d10/d6b/f79 [505917,19489] 0 2024-04-26T21:26:04.082 INFO:tasks.workunit.client.0.smithi084.stdout:1/576: truncate d2/d54/d5e/f9a 1387677 0 2024-04-26T21:26:04.083 INFO:tasks.workunit.client.0.smithi084.stdout:6/560: creat d3/de/d41/d5c/fba x:0 0 0 2024-04-26T21:26:04.083 INFO:tasks.workunit.client.0.smithi084.stdout:7/598: mkdir d6/d68/d7f/dcf 0 2024-04-26T21:26:04.084 INFO:tasks.workunit.client.0.smithi084.stdout:4/536: sync 2024-04-26T21:26:04.090 INFO:tasks.workunit.client.0.smithi084.stdout:5/583: mknod d0/dc/df/d31/d72/cb4 0 2024-04-26T21:26:04.090 INFO:tasks.workunit.client.0.smithi084.stdout:1/577: write d2/d9/d15/fac [145718,6977] 0 2024-04-26T21:26:04.090 INFO:tasks.workunit.client.1.smithi120.stdout:2/803: symlink d4/d1b/d4f/l10c 0 2024-04-26T21:26:04.091 INFO:tasks.workunit.client.0.smithi084.stdout:3/571: rename d1/d2c/d2f/d31/d55/cb8 to d1/d2c/d2f/d31/d55/da4/cc2 0 2024-04-26T21:26:04.092 INFO:tasks.workunit.client.1.smithi120.stdout:1/717: unlink d6/d9/dd4/de0/d1d/f20 0 2024-04-26T21:26:04.095 INFO:tasks.workunit.client.1.smithi120.stdout:3/817: dwrite dd/de/df/dda/d24/f3a [4194304,4194304] 0 2024-04-26T21:26:04.096 INFO:tasks.workunit.client.1.smithi120.stdout:4/763: dread d10/d12/f95 [0,4194304] 0 2024-04-26T21:26:04.098 INFO:tasks.workunit.client.1.smithi120.stdout:3/818: stat dd/de/d83/f45 0 2024-04-26T21:26:04.099 INFO:tasks.workunit.client.1.smithi120.stdout:8/755: creat d5/d6/d34/d42/d9d/ff1 x:0 0 0 2024-04-26T21:26:04.100 INFO:tasks.workunit.client.0.smithi084.stdout:6/561: symlink d3/de/d15/d5f/lbb 0 2024-04-26T21:26:04.100 INFO:tasks.workunit.client.0.smithi084.stdout:3/572: dread - d1/d24/d27/d3a/fb0 zero size 2024-04-26T21:26:04.101 INFO:tasks.workunit.client.1.smithi120.stdout:1/718: mknod d6/d14/d6f/ce7 0 2024-04-26T21:26:04.101 INFO:tasks.workunit.client.0.smithi084.stdout:5/584: readlink d0/dc/df/d31/d72/d84/lb1 0 2024-04-26T21:26:04.102 INFO:tasks.workunit.client.0.smithi084.stdout:7/599: symlink d6/d9/d12/d19/d60/ld0 0 2024-04-26T21:26:04.102 INFO:tasks.workunit.client.1.smithi120.stdout:7/798: link d7/d64/da6/d1a/d33/l98 d7/d64/da6/d1a/d33/d109/dbf/l110 0 2024-04-26T21:26:04.103 INFO:tasks.workunit.client.0.smithi084.stdout:0/592: rmdir de/d20 39 2024-04-26T21:26:04.106 INFO:tasks.workunit.client.0.smithi084.stdout:4/537: creat d5/fae x:0 0 0 2024-04-26T21:26:04.106 INFO:tasks.workunit.client.1.smithi120.stdout:2/804: readlink d4/d1b/d2e/d50/d14/dc2/lef 0 2024-04-26T21:26:04.107 INFO:tasks.workunit.client.1.smithi120.stdout:0/920: dwrite d0/d3/d51/d97/d108/d81/dba/fc2 [0,4194304] 0 2024-04-26T21:26:04.109 INFO:tasks.workunit.client.0.smithi084.stdout:8/578: dwrite d4/d7/d15/f30 [0,4194304] 0 2024-04-26T21:26:04.111 INFO:tasks.workunit.client.0.smithi084.stdout:5/585: readlink d0/dc/l5a 0 2024-04-26T21:26:04.113 INFO:tasks.workunit.client.0.smithi084.stdout:9/493: dwrite da/de/d1e/f74 [0,4194304] 0 2024-04-26T21:26:04.115 INFO:tasks.workunit.client.0.smithi084.stdout:3/573: chown d1/d2c/l33 8528255 1 2024-04-26T21:26:04.117 INFO:tasks.workunit.client.1.smithi120.stdout:4/764: truncate d10/d65/f9e 696148 0 2024-04-26T21:26:04.118 INFO:tasks.workunit.client.1.smithi120.stdout:3/819: creat dd/de/df/dda/d24/d9d/d86/dd3/ddb/f10c x:0 0 0 2024-04-26T21:26:04.122 INFO:tasks.workunit.client.0.smithi084.stdout:6/562: creat d3/de/d1a/d2f/d4c/d58/fbc x:0 0 0 2024-04-26T21:26:04.124 INFO:tasks.workunit.client.0.smithi084.stdout:1/578: creat d2/d9/d15/d28/d69/d9d/fbb x:0 0 0 2024-04-26T21:26:04.124 INFO:tasks.workunit.client.0.smithi084.stdout:4/538: stat d5/d7/d65/d7f/l5d 0 2024-04-26T21:26:04.126 INFO:tasks.workunit.client.0.smithi084.stdout:2/694: dwrite d6/d7/f3f [0,4194304] 0 2024-04-26T21:26:04.127 INFO:tasks.workunit.client.0.smithi084.stdout:5/586: write d0/dc/f1c [1927360,109263] 0 2024-04-26T21:26:04.127 INFO:tasks.workunit.client.0.smithi084.stdout:8/579: fsync d4/d3a/f71 0 2024-04-26T21:26:04.128 INFO:tasks.workunit.client.1.smithi120.stdout:1/719: mknod d6/d9/dd4/de0/d2d/d48/ce8 0 2024-04-26T21:26:04.129 INFO:tasks.workunit.client.0.smithi084.stdout:6/563: chown d3/de/d15/d23/f30 28422269 1 2024-04-26T21:26:04.132 INFO:tasks.workunit.client.0.smithi084.stdout:3/574: chown d1/d24/d27/d3a/f62 7050 1 2024-04-26T21:26:04.132 INFO:tasks.workunit.client.1.smithi120.stdout:4/765: creat d10/d6b/d71/f106 x:0 0 0 2024-04-26T21:26:04.132 INFO:tasks.workunit.client.1.smithi120.stdout:6/792: dread d4/db/d10/dd/d4e/d60/f7c [0,4194304] 0 2024-04-26T21:26:04.134 INFO:tasks.workunit.client.0.smithi084.stdout:9/494: chown da/de/d16/d55/c5d 1057791 1 2024-04-26T21:26:04.138 INFO:tasks.workunit.client.1.smithi120.stdout:8/756: rename d5/d6/d11/d32/d3b/l43 to d5/d6/d34/d42/d9d/lf2 0 2024-04-26T21:26:04.140 INFO:tasks.workunit.client.0.smithi084.stdout:8/580: unlink d4/d7/d15/d3c/c94 0 2024-04-26T21:26:04.140 INFO:tasks.workunit.client.1.smithi120.stdout:5/829: sync 2024-04-26T21:26:04.141 INFO:tasks.workunit.client.0.smithi084.stdout:7/600: creat d6/d68/d7f/dcf/fd1 x:0 0 0 2024-04-26T21:26:04.142 INFO:tasks.workunit.client.0.smithi084.stdout:5/587: rename d0/d49/f8d to d0/dc/df/d51/fb5 0 2024-04-26T21:26:04.142 INFO:tasks.workunit.client.0.smithi084.stdout:7/601: chown d6/d26 1034290 1 2024-04-26T21:26:04.142 INFO:tasks.workunit.client.1.smithi120.stdout:4/766: creat d10/d65/f107 x:0 0 0 2024-04-26T21:26:04.144 INFO:tasks.workunit.client.0.smithi084.stdout:4/539: fdatasync d5/d2e/d5f/f27 0 2024-04-26T21:26:04.145 INFO:tasks.workunit.client.1.smithi120.stdout:0/921: rename d0/d3/dc/dd/d1b/d24/d73/fab to d0/d3/d51/d97/d108/d64/f12b 0 2024-04-26T21:26:04.145 INFO:tasks.workunit.client.0.smithi084.stdout:9/495: write da/de/d16/d25/d41/f91 [412872,49300] 0 2024-04-26T21:26:04.147 INFO:tasks.workunit.client.1.smithi120.stdout:6/793: creat d4/db/d10/dd/d43/f108 x:0 0 0 2024-04-26T21:26:04.148 INFO:tasks.workunit.client.0.smithi084.stdout:1/579: symlink d2/d54/d5e/d66/d2a/d2c/d75/lbc 0 2024-04-26T21:26:04.149 INFO:tasks.workunit.client.1.smithi120.stdout:8/757: write d5/d6/d34/d42/d4a/deb/d88/fbb [957798,121976] 0 2024-04-26T21:26:04.154 INFO:tasks.workunit.client.0.smithi084.stdout:4/540: chown d5/d2e/d5f/d32/la5 2131020 1 2024-04-26T21:26:04.156 INFO:tasks.workunit.client.1.smithi120.stdout:5/830: mknod d2/d10e/d63/c131 0 2024-04-26T21:26:04.157 INFO:tasks.workunit.client.0.smithi084.stdout:7/602: write d6/d9/d12/d8b/d72/fcb [523174,42645] 0 2024-04-26T21:26:04.161 INFO:tasks.workunit.client.0.smithi084.stdout:2/695: truncate d6/d7/d3d/d15/d1f/d39/d20/d36/fe9 1722051 0 2024-04-26T21:26:04.163 INFO:tasks.workunit.client.1.smithi120.stdout:8/758: mknod d5/d8e/cf3 0 2024-04-26T21:26:04.163 INFO:tasks.workunit.client.0.smithi084.stdout:6/564: dread d3/de/d15/df/f4b [0,4194304] 0 2024-04-26T21:26:04.163 INFO:tasks.workunit.client.0.smithi084.stdout:0/593: truncate de/d2b/f39 16809 0 2024-04-26T21:26:04.164 INFO:tasks.workunit.client.0.smithi084.stdout:5/588: symlink d0/d49/lb6 0 2024-04-26T21:26:04.164 INFO:tasks.workunit.client.0.smithi084.stdout:8/581: symlink d4/d6/la9 0 2024-04-26T21:26:04.170 INFO:tasks.workunit.client.1.smithi120.stdout:5/831: creat d2/df6/f132 x:0 0 0 2024-04-26T21:26:04.176 INFO:tasks.workunit.client.1.smithi120.stdout:4/767: dwrite d10/d12/f45 [8388608,4194304] 0 2024-04-26T21:26:04.181 INFO:tasks.workunit.client.0.smithi084.stdout:0/594: mkdir de/d2b/d77/d32/d96/dbe 0 2024-04-26T21:26:04.183 INFO:tasks.workunit.client.1.smithi120.stdout:3/820: dwrite dd/d40/f92 [0,4194304] 0 2024-04-26T21:26:04.184 INFO:tasks.workunit.client.0.smithi084.stdout:2/696: dwrite d6/d7/d3d/d15/d1f/d39/f48 [0,4194304] 0 2024-04-26T21:26:04.184 INFO:tasks.workunit.client.1.smithi120.stdout:7/799: dread d7/fe [0,4194304] 0 2024-04-26T21:26:04.187 INFO:tasks.workunit.client.1.smithi120.stdout:2/805: dwrite d4/d1b/d56/d65/fb1 [0,4194304] 0 2024-04-26T21:26:04.188 INFO:tasks.workunit.client.0.smithi084.stdout:4/541: truncate d5/d7/d65/d7f/f4f 2832051 0 2024-04-26T21:26:04.189 INFO:tasks.workunit.client.0.smithi084.stdout:2/697: write d6/d7/d3d/d15/d1f/d39/da5/fcc [1741289,98398] 0 2024-04-26T21:26:04.191 INFO:tasks.workunit.client.1.smithi120.stdout:8/759: creat d5/d6/d34/d42/d9d/d7a/ff4 x:0 0 0 2024-04-26T21:26:04.192 INFO:tasks.workunit.client.0.smithi084.stdout:3/575: link d1/d2c/d2f/d31/d55/l49 d1/d2c/d2f/d31/d55/lc3 0 2024-04-26T21:26:04.195 INFO:tasks.workunit.client.1.smithi120.stdout:5/832: creat d2/d1b/d89/d47/f133 x:0 0 0 2024-04-26T21:26:04.195 INFO:tasks.workunit.client.0.smithi084.stdout:8/582: mknod d4/d6/db/caa 0 2024-04-26T21:26:04.203 INFO:tasks.workunit.client.0.smithi084.stdout:0/595: rename de/d2b/d77/c3e to de/d78/d9e/cbf 0 2024-04-26T21:26:04.205 INFO:tasks.workunit.client.0.smithi084.stdout:0/596: chown de/d2b/d77/f1d 14168 1 2024-04-26T21:26:04.206 INFO:tasks.workunit.client.1.smithi120.stdout:8/760: write d5/d6/d34/d37/fdb [3682180,108898] 0 2024-04-26T21:26:04.208 INFO:tasks.workunit.client.0.smithi084.stdout:9/496: truncate da/de/d1e/f49 629800 0 2024-04-26T21:26:04.208 INFO:tasks.workunit.client.0.smithi084.stdout:1/580: truncate d2/d19/d63/f71 2859911 0 2024-04-26T21:26:04.209 INFO:tasks.workunit.client.1.smithi120.stdout:1/720: dread d6/d9/dd4/de0/d1b/d3b/f7f [0,4194304] 0 2024-04-26T21:26:04.210 INFO:tasks.workunit.client.0.smithi084.stdout:9/497: chown da/de/d16/d25/f2a 0 1 2024-04-26T21:26:04.210 INFO:tasks.workunit.client.1.smithi120.stdout:4/768: getdents d10/d28/dd9/ddd/dee/dd0/dd4/d86/dfa/dfe 0 2024-04-26T21:26:04.214 INFO:tasks.workunit.client.0.smithi084.stdout:5/589: creat d0/fb7 x:0 0 0 2024-04-26T21:26:04.215 INFO:tasks.workunit.client.1.smithi120.stdout:8/761: readlink d5/l26 0 2024-04-26T21:26:04.216 INFO:tasks.workunit.client.0.smithi084.stdout:8/583: fsync d4/f12 0 2024-04-26T21:26:04.218 INFO:tasks.workunit.client.1.smithi120.stdout:7/800: getdents d7/d64/da6/d1f/d28 0 2024-04-26T21:26:04.219 INFO:tasks.workunit.client.1.smithi120.stdout:0/922: dwrite d0/dd1/dd2/fe3 [0,4194304] 0 2024-04-26T21:26:04.220 INFO:tasks.workunit.client.0.smithi084.stdout:1/581: unlink d2/l8 0 2024-04-26T21:26:04.220 INFO:tasks.workunit.client.1.smithi120.stdout:4/769: rmdir d10/d6b 39 2024-04-26T21:26:04.221 INFO:tasks.workunit.client.0.smithi084.stdout:7/603: write d6/d9/f11 [45786,28477] 0 2024-04-26T21:26:04.222 INFO:tasks.workunit.client.1.smithi120.stdout:4/770: stat d10/l5a 0 2024-04-26T21:26:04.222 INFO:tasks.workunit.client.1.smithi120.stdout:2/806: rename d4/fdc to d4/d1b/d2e/d50/f10d 0 2024-04-26T21:26:04.226 INFO:tasks.workunit.client.0.smithi084.stdout:6/565: dread d3/de/d15/d23/f4d [4194304,4194304] 0 2024-04-26T21:26:04.227 INFO:tasks.workunit.client.1.smithi120.stdout:1/721: rmdir d6/d9/dd4/de0/d1d/d2c/d58 39 2024-04-26T21:26:04.228 INFO:tasks.workunit.client.0.smithi084.stdout:9/498: dwrite da/de/d1e/d56/da6/fa9 [4194304,4194304] 0 2024-04-26T21:26:04.232 INFO:tasks.workunit.client.1.smithi120.stdout:0/923: stat d0/d3/dc/dd/d1b/d24/f77 0 2024-04-26T21:26:04.236 INFO:tasks.workunit.client.1.smithi120.stdout:5/833: rename d2/d1b/d89/d6b/lcd to d2/d30/d93/l134 0 2024-04-26T21:26:04.236 INFO:tasks.workunit.client.1.smithi120.stdout:8/762: mkdir d5/d6/d11/d52/df5 0 2024-04-26T21:26:04.237 INFO:tasks.workunit.client.1.smithi120.stdout:7/801: truncate d7/d64/da6/d1a/fdf 1608770 0 2024-04-26T21:26:04.238 INFO:tasks.workunit.client.1.smithi120.stdout:1/722: read - d6/d9/dd4/de0/d2d/fbc zero size 2024-04-26T21:26:04.240 INFO:tasks.workunit.client.1.smithi120.stdout:2/807: creat d4/d1b/d25/d2c/d3e/d5e/f10e x:0 0 0 2024-04-26T21:26:04.242 INFO:tasks.workunit.client.1.smithi120.stdout:0/924: creat d0/d3/d51/d97/d108/d5a/f12c x:0 0 0 2024-04-26T21:26:04.244 INFO:tasks.workunit.client.1.smithi120.stdout:3/821: dwrite dd/de/df/dda/d24/f3a [0,4194304] 0 2024-04-26T21:26:04.245 INFO:tasks.workunit.client.1.smithi120.stdout:8/763: rmdir d5/d6/d34/d42 39 2024-04-26T21:26:04.245 INFO:tasks.workunit.client.1.smithi120.stdout:5/834: mkdir d2/df6/d135 0 2024-04-26T21:26:04.249 INFO:tasks.workunit.client.0.smithi084.stdout:5/590: creat d0/da2/fb8 x:0 0 0 2024-04-26T21:26:04.251 INFO:tasks.workunit.client.0.smithi084.stdout:3/576: write d1/f58 [481638,27572] 0 2024-04-26T21:26:04.251 INFO:tasks.workunit.client.1.smithi120.stdout:0/925: readlink d0/d3/dc/dd/ld3 0 2024-04-26T21:26:04.257 INFO:tasks.workunit.client.1.smithi120.stdout:0/926: fdatasync d0/d3/f4f 0 2024-04-26T21:26:04.257 INFO:tasks.workunit.client.0.smithi084.stdout:4/542: dwrite d5/d10/d15/d21/d29/f66 [0,4194304] 0 2024-04-26T21:26:04.257 INFO:tasks.workunit.client.1.smithi120.stdout:8/764: mkdir d5/d6/d34/df6 0 2024-04-26T21:26:04.258 INFO:tasks.workunit.client.0.smithi084.stdout:9/499: truncate da/de/f11 2939156 0 2024-04-26T21:26:04.259 INFO:tasks.workunit.client.1.smithi120.stdout:5/835: fdatasync d2/dc/d1d/d21/d77/d79/db7/f99 0 2024-04-26T21:26:04.259 INFO:tasks.workunit.client.1.smithi120.stdout:3/822: mkdir dd/de/df/dda/d24/d9d/d86/d10d 0 2024-04-26T21:26:04.267 INFO:tasks.workunit.client.1.smithi120.stdout:5/836: write d2/dc/d1d/d21/d66/d6a/d8c/f115 [1413626,42311] 0 2024-04-26T21:26:04.268 INFO:tasks.workunit.client.1.smithi120.stdout:4/771: truncate d10/d12/f45 10994779 0 2024-04-26T21:26:04.270 INFO:tasks.workunit.client.0.smithi084.stdout:8/584: mknod d4/d7/d15/cab 0 2024-04-26T21:26:04.271 INFO:tasks.workunit.client.1.smithi120.stdout:5/837: chown d2/df6 6 1 2024-04-26T21:26:04.274 INFO:tasks.workunit.client.1.smithi120.stdout:8/765: fdatasync d5/d6/d34/d42/f49 0 2024-04-26T21:26:04.275 INFO:tasks.workunit.client.1.smithi120.stdout:2/808: dwrite d4/fdf [0,4194304] 0 2024-04-26T21:26:04.280 INFO:tasks.workunit.client.0.smithi084.stdout:4/543: dwrite d5/d10/d15/d21/f7b [0,4194304] 0 2024-04-26T21:26:04.280 INFO:tasks.workunit.client.0.smithi084.stdout:2/698: truncate d6/d7/d3d/d15/d1f/d39/d20/f50 4144743 0 2024-04-26T21:26:04.283 INFO:tasks.workunit.client.1.smithi120.stdout:4/772: symlink d10/d28/dd9/ddd/dee/dd0/df3/l108 0 2024-04-26T21:26:04.286 INFO:tasks.workunit.client.1.smithi120.stdout:0/927: getdents d0/d3/dc 0 2024-04-26T21:26:04.288 INFO:tasks.workunit.client.1.smithi120.stdout:5/838: creat d2/d30/d93/d107/d36/f136 x:0 0 0 2024-04-26T21:26:04.289 INFO:tasks.workunit.client.1.smithi120.stdout:4/773: chown d10/c1f 0 1 2024-04-26T21:26:04.290 INFO:tasks.workunit.client.1.smithi120.stdout:1/723: dwrite d6/d9/dd4/de0/d1b/d55/fa1 [0,4194304] 0 2024-04-26T21:26:04.293 INFO:tasks.workunit.client.0.smithi084.stdout:2/699: dread d6/d7/d3d/d15/d1f/d39/d20/d36/fe7 [0,4194304] 0 2024-04-26T21:26:04.295 INFO:tasks.workunit.client.1.smithi120.stdout:5/839: write d2/d82/d96/fe8 [219548,55255] 0 2024-04-26T21:26:04.295 INFO:tasks.workunit.client.0.smithi084.stdout:0/597: getdents de/d71 0 2024-04-26T21:26:04.297 INFO:tasks.workunit.client.0.smithi084.stdout:0/598: chown de/d2b/d77 16 1 2024-04-26T21:26:04.299 INFO:tasks.workunit.client.1.smithi120.stdout:4/774: rename d10/l5a to d10/d28/dd9/l109 0 2024-04-26T21:26:04.302 INFO:tasks.workunit.client.1.smithi120.stdout:0/928: read d0/d3/d51/d97/f102 [476543,60459] 0 2024-04-26T21:26:04.302 INFO:tasks.workunit.client.1.smithi120.stdout:5/840: creat d2/d30/d93/d107/d36/d44/d6c/df5/f137 x:0 0 0 2024-04-26T21:26:04.306 INFO:tasks.workunit.client.1.smithi120.stdout:9/745: sync 2024-04-26T21:26:04.306 INFO:tasks.workunit.client.1.smithi120.stdout:4/775: mknod d10/da6/c10a 0 2024-04-26T21:26:04.307 INFO:tasks.workunit.client.0.smithi084.stdout:6/566: dwrite d3/d18/d81/f8a [0,4194304] 0 2024-04-26T21:26:04.309 INFO:tasks.workunit.client.0.smithi084.stdout:1/582: link d2/d9/d15/d9f/fb3 d2/d9/d15/d28/fbd 0 2024-04-26T21:26:04.316 INFO:tasks.workunit.client.1.smithi120.stdout:5/841: mknod d2/d1b/d89/d47/de4/c138 0 2024-04-26T21:26:04.319 INFO:tasks.workunit.client.0.smithi084.stdout:8/585: unlink d4/d7/d15/d9d/ca4 0 2024-04-26T21:26:04.320 INFO:tasks.workunit.client.1.smithi120.stdout:7/802: dwrite d7/d64/da6/d1f/d7d/d8b/fa3 [0,4194304] 0 2024-04-26T21:26:04.321 INFO:tasks.workunit.client.0.smithi084.stdout:8/586: fsync d4/f84 0 2024-04-26T21:26:04.323 INFO:tasks.workunit.client.1.smithi120.stdout:1/724: dread d6/d9/dd4/de0/d1d/d2c/d58/faf [0,4194304] 0 2024-04-26T21:26:04.324 INFO:tasks.workunit.client.0.smithi084.stdout:2/700: dread d6/d7/d3d/d79/d81/fc3 [0,4194304] 0 2024-04-26T21:26:04.325 INFO:tasks.workunit.client.1.smithi120.stdout:9/746: creat d0/dd/d3a/dae/ded/df1/ff7 x:0 0 0 2024-04-26T21:26:04.325 INFO:tasks.workunit.client.1.smithi120.stdout:6/794: sync 2024-04-26T21:26:04.326 INFO:tasks.workunit.client.1.smithi120.stdout:5/842: creat d2/dc/d1d/d21/d66/d6a/d8c/daa/f139 x:0 0 0 2024-04-26T21:26:04.332 INFO:tasks.workunit.client.0.smithi084.stdout:9/500: read da/de/d16/d25/f4e [550147,109252] 0 2024-04-26T21:26:04.333 INFO:tasks.workunit.client.1.smithi120.stdout:0/929: dread d0/d3/dc/d12/d31/f5e [4194304,4194304] 0 2024-04-26T21:26:04.338 INFO:tasks.workunit.client.0.smithi084.stdout:4/544: dwrite d5/d25/d35/d60/f64 [0,4194304] 0 2024-04-26T21:26:04.341 INFO:tasks.workunit.client.0.smithi084.stdout:0/599: creat de/d2b/d45/d63/fc0 x:0 0 0 2024-04-26T21:26:04.344 INFO:tasks.workunit.client.1.smithi120.stdout:3/823: dwrite dd/de/df/db6/f6b [0,4194304] 0 2024-04-26T21:26:04.346 INFO:tasks.workunit.client.0.smithi084.stdout:1/583: mkdir d2/d54/d5e/dbe 0 2024-04-26T21:26:04.348 INFO:tasks.workunit.client.1.smithi120.stdout:1/725: read d6/d9/dd4/de0/d1d/d2c/f76 [530245,27481] 0 2024-04-26T21:26:04.349 INFO:tasks.workunit.client.1.smithi120.stdout:7/803: write d7/d64/da6/d1f/d28/d4c/d6b/d7b/fc6 [318554,25625] 0 2024-04-26T21:26:04.350 INFO:tasks.workunit.client.1.smithi120.stdout:8/766: dwrite d5/d6/d34/d42/f84 [0,4194304] 0 2024-04-26T21:26:04.350 INFO:tasks.workunit.client.1.smithi120.stdout:6/795: fsync d4/db/d25/d6d/dbd/dc4/fcf 0 2024-04-26T21:26:04.351 INFO:tasks.workunit.client.0.smithi084.stdout:1/584: write d2/d54/d5e/d66/d2a/d2c/d45/fb8 [435366,31223] 0 2024-04-26T21:26:04.353 INFO:tasks.workunit.client.1.smithi120.stdout:0/930: readlink d0/d3/dc/dd/d1b/d39/l55 0 2024-04-26T21:26:04.354 INFO:tasks.workunit.client.0.smithi084.stdout:1/585: write d2/d54/d5e/d66/d3a/d77/f85 [326834,83200] 0 2024-04-26T21:26:04.355 INFO:tasks.workunit.client.1.smithi120.stdout:3/824: dread - dd/d2a/fdd zero size 2024-04-26T21:26:04.355 INFO:tasks.workunit.client.0.smithi084.stdout:7/604: link d6/d26/f30 d6/d9/d12/d19/d8f/fd2 0 2024-04-26T21:26:04.360 INFO:tasks.workunit.client.1.smithi120.stdout:6/796: dread - d4/db/d10/dd/d43/f108 zero size 2024-04-26T21:26:04.364 INFO:tasks.workunit.client.0.smithi084.stdout:5/591: write d0/dc/f14 [2824889,110023] 0 2024-04-26T21:26:04.365 INFO:tasks.workunit.client.1.smithi120.stdout:0/931: stat d0/d3/d51/l93 0 2024-04-26T21:26:04.365 INFO:tasks.workunit.client.1.smithi120.stdout:9/747: mknod d0/d6/d4d/d65/dec/cf8 0 2024-04-26T21:26:04.365 INFO:tasks.workunit.client.1.smithi120.stdout:4/776: dwrite d10/d12/f1d [0,4194304] 0 2024-04-26T21:26:04.367 INFO:tasks.workunit.client.0.smithi084.stdout:5/592: write d0/d17/f1d [3256623,69327] 0 2024-04-26T21:26:04.368 INFO:tasks.workunit.client.0.smithi084.stdout:3/577: mknod d1/d2c/d2f/d31/d52/cc4 0 2024-04-26T21:26:04.369 INFO:tasks.workunit.client.1.smithi120.stdout:2/809: dwrite d4/d1b/d25/d2c/f49 [8388608,4194304] 0 2024-04-26T21:26:04.370 INFO:tasks.workunit.client.1.smithi120.stdout:6/797: readlink d4/db/d25/d6d/dbd/lb7 0 2024-04-26T21:26:04.371 INFO:tasks.workunit.client.1.smithi120.stdout:5/843: rename d2/d82/d96/c121 to d2/dc/d1d/d21/d66/d85/d128/c13a 0 2024-04-26T21:26:04.376 INFO:tasks.workunit.client.0.smithi084.stdout:0/600: readlink de/d20/l52 0 2024-04-26T21:26:04.377 INFO:tasks.workunit.client.1.smithi120.stdout:5/844: fsync d2/d1b/d89/d47/f133 0 2024-04-26T21:26:04.379 INFO:tasks.workunit.client.1.smithi120.stdout:0/932: write d0/d3/dc/dd/d1b/daa/fbe [3808436,41029] 0 2024-04-26T21:26:04.380 INFO:tasks.workunit.client.0.smithi084.stdout:0/601: fdatasync de/d78/fa6 0 2024-04-26T21:26:04.388 INFO:tasks.workunit.client.0.smithi084.stdout:9/501: mknod da/de/d16/d25/d4f/cb8 0 2024-04-26T21:26:04.388 INFO:tasks.workunit.client.1.smithi120.stdout:1/726: rename d6/ld3 to d6/d14/d3c/le9 0 2024-04-26T21:26:04.390 INFO:tasks.workunit.client.0.smithi084.stdout:0/602: rmdir de/d2b/d64/d81 39 2024-04-26T21:26:04.391 INFO:tasks.workunit.client.1.smithi120.stdout:7/804: dwrite d7/d10/d97/d99/fd6 [0,4194304] 0 2024-04-26T21:26:04.392 INFO:tasks.workunit.client.0.smithi084.stdout:4/545: dread d5/d25/d35/f5e [0,4194304] 0 2024-04-26T21:26:04.394 INFO:tasks.workunit.client.1.smithi120.stdout:1/727: dread - d6/d9/dd4/de0/d2d/fbc zero size 2024-04-26T21:26:04.396 INFO:tasks.workunit.client.1.smithi120.stdout:6/798: truncate d4/db/d10/d1a/d2b/d57/d67/f4a 14729 0 2024-04-26T21:26:04.400 INFO:tasks.workunit.client.0.smithi084.stdout:1/586: link d2/d54/d5e/d66/d2a/d2c/d45/c6d d2/d54/d5e/d66/d2a/d72/cbf 0 2024-04-26T21:26:04.400 INFO:tasks.workunit.client.1.smithi120.stdout:4/777: link d10/d28/l30 d10/da6/l10b 0 2024-04-26T21:26:04.400 INFO:tasks.workunit.client.1.smithi120.stdout:8/767: link d5/d6/d11/d32/c78 d5/d6/d11/cf7 0 2024-04-26T21:26:04.401 INFO:tasks.workunit.client.0.smithi084.stdout:2/701: getdents d6/d7/d3d/d15/d1f/d22/d99 0 2024-04-26T21:26:04.402 INFO:tasks.workunit.client.1.smithi120.stdout:8/768: stat d5/lac 0 2024-04-26T21:26:04.402 INFO:tasks.workunit.client.1.smithi120.stdout:6/799: write d4/db/d10/dd/d4e/d60/fdf [477523,82734] 0 2024-04-26T21:26:04.403 INFO:tasks.workunit.client.0.smithi084.stdout:6/567: dwrite d3/de/d15/d23/f2a [0,4194304] 0 2024-04-26T21:26:04.408 INFO:tasks.workunit.client.0.smithi084.stdout:1/587: write d2/d19/d63/f96 [41780,79741] 0 2024-04-26T21:26:04.411 INFO:tasks.workunit.client.0.smithi084.stdout:8/587: write d4/d7/d15/d3c/f90 [1246997,49921] 0 2024-04-26T21:26:04.412 INFO:tasks.workunit.client.1.smithi120.stdout:0/933: dwrite d0/d3/d51/d97/d108/d81/dba/f112 [0,4194304] 0 2024-04-26T21:26:04.412 INFO:tasks.workunit.client.1.smithi120.stdout:8/769: read d5/d6/d34/d37/d60/f5c [161182,82939] 0 2024-04-26T21:26:04.412 INFO:tasks.workunit.client.1.smithi120.stdout:2/810: dread d4/d1b/f85 [0,4194304] 0 2024-04-26T21:26:04.412 INFO:tasks.workunit.client.0.smithi084.stdout:9/502: mknod da/de/cb9 0 2024-04-26T21:26:04.414 INFO:tasks.workunit.client.1.smithi120.stdout:0/934: readlink d0/d3/dc/d12/d31/lf2 0 2024-04-26T21:26:04.418 INFO:tasks.workunit.client.1.smithi120.stdout:2/811: rmdir d4/d1b/d56 39 2024-04-26T21:26:04.420 INFO:tasks.workunit.client.0.smithi084.stdout:4/546: symlink d5/d25/d35/d97/laf 0 2024-04-26T21:26:04.420 INFO:tasks.workunit.client.0.smithi084.stdout:2/702: mkdir d6/d7/d3d/d15/d1f/d22/dd4/ded 0 2024-04-26T21:26:04.420 INFO:tasks.workunit.client.1.smithi120.stdout:0/935: write d0/f14 [3375264,18227] 0 2024-04-26T21:26:04.420 INFO:tasks.workunit.client.1.smithi120.stdout:8/770: mkdir d5/d6/d75/df8 0 2024-04-26T21:26:04.428 INFO:tasks.workunit.client.1.smithi120.stdout:9/748: write d0/d6/d4d/d65/dec/fa0 [632513,96933] 0 2024-04-26T21:26:04.429 INFO:tasks.workunit.client.0.smithi084.stdout:3/578: fsync d1/d2c/d2f/d31/d52/f8b 0 2024-04-26T21:26:04.430 INFO:tasks.workunit.client.0.smithi084.stdout:2/703: rmdir d6/d7/d3d/d15/d1f/d39/d20/d45/d6d 39 2024-04-26T21:26:04.430 INFO:tasks.workunit.client.1.smithi120.stdout:2/812: creat d4/d1b/d25/d2c/d3e/d5e/d63/dcb/dca/f10f x:0 0 0 2024-04-26T21:26:04.439 INFO:tasks.workunit.client.1.smithi120.stdout:3/825: dread dd/de/df/dda/d24/d9d/d86/dd3/ddb/f9c [4194304,4194304] 0 2024-04-26T21:26:04.439 INFO:tasks.workunit.client.1.smithi120.stdout:4/778: dread d10/d65/f7e [0,4194304] 0 2024-04-26T21:26:04.439 INFO:tasks.workunit.client.1.smithi120.stdout:6/800: truncate d4/db/d25/d6d/d97/fbb 1424411 0 2024-04-26T21:26:04.440 INFO:tasks.workunit.client.0.smithi084.stdout:0/603: dwrite de/d71/f57 [0,4194304] 0 2024-04-26T21:26:04.442 INFO:tasks.workunit.client.1.smithi120.stdout:9/749: mkdir d0/d6/d4d/d65/dec/d77/d9a/df9 0 2024-04-26T21:26:04.447 INFO:tasks.workunit.client.0.smithi084.stdout:1/588: link d2/d54/d5e/d66/d2a/d2c/d75/lbc d2/d9/d15/d28/lc0 0 2024-04-26T21:26:04.451 INFO:tasks.workunit.client.0.smithi084.stdout:6/568: dwrite d3/de/d1a/d43/d72/dad/fb1 [0,4194304] 0 2024-04-26T21:26:04.452 INFO:tasks.workunit.client.1.smithi120.stdout:4/779: chown d10/d28/dd9/ddd/ldf 30318 1 2024-04-26T21:26:04.453 INFO:tasks.workunit.client.0.smithi084.stdout:9/503: dwrite da/de/d16/d40/f64 [0,4194304] 0 2024-04-26T21:26:04.453 INFO:tasks.workunit.client.0.smithi084.stdout:2/704: creat d6/d7/d3d/d15/d1f/d39/d20/d36/da4/fee x:0 0 0 2024-04-26T21:26:04.457 INFO:tasks.workunit.client.0.smithi084.stdout:6/569: write d3/d18/d37/f92 [1066444,75630] 0 2024-04-26T21:26:04.458 INFO:tasks.workunit.client.1.smithi120.stdout:6/801: symlink d4/db/d10/d22/d6c/l109 0 2024-04-26T21:26:04.462 INFO:tasks.workunit.client.0.smithi084.stdout:7/605: dread d6/d9/d12/d19/d7a/d84/f7c [0,4194304] 0 2024-04-26T21:26:04.463 INFO:tasks.workunit.client.0.smithi084.stdout:0/604: creat de/d2b/d77/d32/d96/da0/fc1 x:0 0 0 2024-04-26T21:26:04.464 INFO:tasks.workunit.client.1.smithi120.stdout:1/728: dwrite d6/d9/dd4/de0/d2d/f34 [0,4194304] 0 2024-04-26T21:26:04.466 INFO:tasks.workunit.client.0.smithi084.stdout:0/605: fdatasync de/d20/d4e/f60 0 2024-04-26T21:26:04.466 INFO:tasks.workunit.client.0.smithi084.stdout:3/579: link d1/d2c/d2f/d31/d55/f66 d1/d2c/d2f/d31/da8/fc5 0 2024-04-26T21:26:04.467 INFO:tasks.workunit.client.0.smithi084.stdout:2/705: write d6/f14 [4181897,12494] 0 2024-04-26T21:26:04.468 INFO:tasks.workunit.client.1.smithi120.stdout:9/750: fsync d0/dd/d45/dc0/fd6 0 2024-04-26T21:26:04.469 INFO:tasks.workunit.client.1.smithi120.stdout:8/771: dwrite d5/fb1 [0,4194304] 0 2024-04-26T21:26:04.473 INFO:tasks.workunit.client.1.smithi120.stdout:6/802: chown d4/db/d10/dd/f18 2 1 2024-04-26T21:26:04.473 INFO:tasks.workunit.client.1.smithi120.stdout:0/936: dwrite d0/d3/d51/d95/dd0/ff8 [0,4194304] 0 2024-04-26T21:26:04.475 INFO:tasks.workunit.client.1.smithi120.stdout:2/813: dread d4/fdf [0,4194304] 0 2024-04-26T21:26:04.477 INFO:tasks.workunit.client.1.smithi120.stdout:1/729: mknod d6/d9/dd4/de0/d2d/d98/d56/dad/cea 0 2024-04-26T21:26:04.478 INFO:tasks.workunit.client.0.smithi084.stdout:0/606: mkdir de/d20/d4c/dae/dc2 0 2024-04-26T21:26:04.478 INFO:tasks.workunit.client.0.smithi084.stdout:7/606: fdatasync d6/d9/d12/d8b/f6a 0 2024-04-26T21:26:04.482 INFO:tasks.workunit.client.1.smithi120.stdout:4/780: symlink d10/d6b/dbf/l10c 0 2024-04-26T21:26:04.484 INFO:tasks.workunit.client.1.smithi120.stdout:3/826: dread dd/de/df/db6/f6b [0,4194304] 0 2024-04-26T21:26:04.485 INFO:tasks.workunit.client.0.smithi084.stdout:9/504: mkdir da/de/d16/d25/d41/d43/dba 0 2024-04-26T21:26:04.486 INFO:tasks.workunit.client.1.smithi120.stdout:6/803: symlink d4/db/d10/dd/d28/d9e/daf/l10a 0 2024-04-26T21:26:04.486 INFO:tasks.workunit.client.0.smithi084.stdout:7/607: write d6/d26/d40/f5b [3231305,87772] 0 2024-04-26T21:26:04.488 INFO:tasks.workunit.client.1.smithi120.stdout:9/751: creat d0/d6/d4d/d65/dec/d2d/d4b/d85/ffa x:0 0 0 2024-04-26T21:26:04.490 INFO:tasks.workunit.client.0.smithi084.stdout:0/607: creat de/d2b/d77/d68/fc3 x:0 0 0 2024-04-26T21:26:04.494 INFO:tasks.workunit.client.1.smithi120.stdout:0/937: creat d0/d3/d51/d97/d108/d64/f12d x:0 0 0 2024-04-26T21:26:04.496 INFO:tasks.workunit.client.0.smithi084.stdout:9/505: mknod da/de/d16/d25/d41/d43/d48/d61/d81/cbb 0 2024-04-26T21:26:04.498 INFO:tasks.workunit.client.1.smithi120.stdout:3/827: creat dd/de/df/f10e x:0 0 0 2024-04-26T21:26:04.498 INFO:tasks.workunit.client.0.smithi084.stdout:7/608: chown d6/d9/d12/d19/d7a/d84/l16 36 1 2024-04-26T21:26:04.499 INFO:tasks.workunit.client.0.smithi084.stdout:1/589: dwrite d2/d54/d5e/d66/d3a/fb4 [0,4194304] 0 2024-04-26T21:26:04.504 INFO:tasks.workunit.client.0.smithi084.stdout:2/706: dwrite d6/d7/d68/f6f [0,4194304] 0 2024-04-26T21:26:04.506 INFO:tasks.workunit.client.1.smithi120.stdout:2/814: creat d4/d1b/d56/d65/d8d/f110 x:0 0 0 2024-04-26T21:26:04.509 INFO:tasks.workunit.client.0.smithi084.stdout:0/608: symlink de/d78/d9e/da1/lc4 0 2024-04-26T21:26:04.511 INFO:tasks.workunit.client.1.smithi120.stdout:1/730: rename d6/d9/dd4/de0/d1b/f8a to d6/d9/dd4/de0/d1d/d5d/feb 0 2024-04-26T21:26:04.511 INFO:tasks.workunit.client.1.smithi120.stdout:6/804: mknod d4/db/d10/dd/d43/c10b 0 2024-04-26T21:26:04.516 INFO:tasks.workunit.client.0.smithi084.stdout:7/609: read d6/d9/d12/d19/d7a/d84/f27 [4109419,40790] 0 2024-04-26T21:26:04.516 INFO:tasks.workunit.client.1.smithi120.stdout:9/752: mknod d0/d66/d93/db7/dc7/cfb 0 2024-04-26T21:26:04.520 INFO:tasks.workunit.client.0.smithi084.stdout:7/610: fsync d6/d26/faf 0 2024-04-26T21:26:04.524 INFO:tasks.workunit.client.0.smithi084.stdout:0/609: mknod de/d2b/d77/cc5 0 2024-04-26T21:26:04.524 INFO:tasks.workunit.client.1.smithi120.stdout:4/781: fsync d10/f47 0 2024-04-26T21:26:04.527 INFO:tasks.workunit.client.0.smithi084.stdout:1/590: rename d2/d9/d67/fa6 to d2/d54/d5e/d66/fc1 0 2024-04-26T21:26:04.531 INFO:tasks.workunit.client.0.smithi084.stdout:1/591: creat d2/d9/d15/d9f/fc2 x:0 0 0 2024-04-26T21:26:04.532 INFO:tasks.workunit.client.0.smithi084.stdout:0/610: dread de/d2b/d77/d32/f3d [0,4194304] 0 2024-04-26T21:26:04.540 INFO:tasks.workunit.client.1.smithi120.stdout:2/815: truncate d4/d1b/d2e/d50/f2a 2087904 0 2024-04-26T21:26:04.540 INFO:tasks.workunit.client.1.smithi120.stdout:1/731: mknod d6/d9/dd4/de0/d2d/d48/d86/dc1/cec 0 2024-04-26T21:26:04.540 INFO:tasks.workunit.client.1.smithi120.stdout:6/805: dread - d4/db/d10/d22/d6c/fad zero size 2024-04-26T21:26:04.541 INFO:tasks.workunit.client.1.smithi120.stdout:9/753: rename d0/d6/d4d/d65/dec/f35 to d0/d6/d4d/d65/dec/d77/d9a/ffc 0 2024-04-26T21:26:04.542 INFO:tasks.workunit.client.0.smithi084.stdout:1/592: creat d2/d54/d5e/fc3 x:0 0 0 2024-04-26T21:26:04.543 INFO:tasks.workunit.client.1.smithi120.stdout:2/816: stat d4/d1b/f38 0 2024-04-26T21:26:04.543 INFO:tasks.workunit.client.1.smithi120.stdout:3/828: symlink dd/de/df/d12/d48/d9b/dcb/dee/l10f 0 2024-04-26T21:26:04.544 INFO:tasks.workunit.client.1.smithi120.stdout:4/782: mkdir d10/d28/dd9/ddd/df1/d10d 0 2024-04-26T21:26:04.546 INFO:tasks.workunit.client.1.smithi120.stdout:9/754: read d0/d6/d4d/d65/dec/fa0 [229760,66978] 0 2024-04-26T21:26:04.548 INFO:tasks.workunit.client.1.smithi120.stdout:8/772: dread d5/d6/d11/d52/d27/f9b [0,4194304] 0 2024-04-26T21:26:04.550 INFO:tasks.workunit.client.1.smithi120.stdout:1/732: creat d6/d9/dd4/de0/d1b/d3b/fed x:0 0 0 2024-04-26T21:26:04.550 INFO:tasks.workunit.client.0.smithi084.stdout:3/580: dread d1/d2c/d2f/f16 [0,4194304] 0 2024-04-26T21:26:04.552 INFO:tasks.workunit.client.1.smithi120.stdout:4/783: mkdir d10/d12/da1/d10e 0 2024-04-26T21:26:04.553 INFO:tasks.workunit.client.1.smithi120.stdout:2/817: truncate d4/d1b/d25/d29/f37 907351 0 2024-04-26T21:26:04.554 INFO:tasks.workunit.client.0.smithi084.stdout:9/506: write da/de/f11 [3724959,74997] 0 2024-04-26T21:26:04.555 INFO:tasks.workunit.client.1.smithi120.stdout:1/733: chown d6/d9/dd4/de0/d1b/d55/la2 7290733 1 2024-04-26T21:26:04.558 INFO:tasks.workunit.client.0.smithi084.stdout:7/611: write d6/d9/d12/d19/f7e [3692449,65296] 0 2024-04-26T21:26:04.558 INFO:tasks.workunit.client.0.smithi084.stdout:6/570: dread d3/de/d15/d40/f60 [0,4194304] 0 2024-04-26T21:26:04.560 INFO:tasks.workunit.client.1.smithi120.stdout:4/784: write d10/d6b/da4/fbc [1266058,8651] 0 2024-04-26T21:26:04.561 INFO:tasks.workunit.client.0.smithi084.stdout:3/581: symlink d1/d2c/d2f/d31/d55/d4e/d7c/lc6 0 2024-04-26T21:26:04.561 INFO:tasks.workunit.client.1.smithi120.stdout:1/734: mkdir d6/daa/dae/dee 0 2024-04-26T21:26:04.563 INFO:tasks.workunit.client.1.smithi120.stdout:0/938: write d0/df/f9d [675725,96195] 0 2024-04-26T21:26:04.564 INFO:tasks.workunit.client.1.smithi120.stdout:6/806: dwrite d4/db/d10/d1a/d2b/f82 [0,4194304] 0 2024-04-26T21:26:04.565 INFO:tasks.workunit.client.0.smithi084.stdout:9/507: write da/de/d16/d25/f9d [713484,41479] 0 2024-04-26T21:26:04.565 INFO:tasks.workunit.client.0.smithi084.stdout:6/571: rmdir d3/de/d15/d23/d90 39 2024-04-26T21:26:04.567 INFO:tasks.workunit.client.1.smithi120.stdout:4/785: mknod d10/d6b/d71/c10f 0 2024-04-26T21:26:04.568 INFO:tasks.workunit.client.0.smithi084.stdout:2/707: dread d6/d7/d68/f69 [0,4194304] 0 2024-04-26T21:26:04.569 INFO:tasks.workunit.client.0.smithi084.stdout:1/593: dwrite d2/d54/d5e/d66/d3a/d48/fa5 [0,4194304] 0 2024-04-26T21:26:04.569 INFO:tasks.workunit.client.1.smithi120.stdout:0/939: mknod d0/df/d79/c12e 0 2024-04-26T21:26:04.570 INFO:tasks.workunit.client.0.smithi084.stdout:3/582: truncate d1/d24/d27/d3a/d81/fa6 733765 0 2024-04-26T21:26:04.571 INFO:tasks.workunit.client.1.smithi120.stdout:3/829: dwrite dd/de/d83/f3f [0,4194304] 0 2024-04-26T21:26:04.573 INFO:tasks.workunit.client.1.smithi120.stdout:6/807: write d4/f1f [2531783,121405] 0 2024-04-26T21:26:04.574 INFO:tasks.workunit.client.1.smithi120.stdout:4/786: write d10/d28/f31 [1941985,66213] 0 2024-04-26T21:26:04.574 INFO:tasks.workunit.client.0.smithi084.stdout:9/508: read da/de/d16/d25/f9d [584827,66756] 0 2024-04-26T21:26:04.575 INFO:tasks.workunit.client.0.smithi084.stdout:2/708: read d6/d7/fa1 [158016,51258] 0 2024-04-26T21:26:04.578 INFO:tasks.workunit.client.1.smithi120.stdout:0/940: chown d0/d3/dc/d12/dae/l129 234721 1 2024-04-26T21:26:04.583 INFO:tasks.workunit.client.0.smithi084.stdout:7/612: link d6/d26/c29 d6/d9/d63/cd3 0 2024-04-26T21:26:04.584 INFO:tasks.workunit.client.1.smithi120.stdout:4/787: write d10/d28/d73/fdb [1817007,78853] 0 2024-04-26T21:26:04.584 INFO:tasks.workunit.client.1.smithi120.stdout:2/818: dwrite d4/d1b/d4f/d95/de9/ff4 [0,4194304] 0 2024-04-26T21:26:04.584 INFO:tasks.workunit.client.0.smithi084.stdout:7/613: stat d6/d9/d12/d19/l1e 0 2024-04-26T21:26:04.585 INFO:tasks.workunit.client.0.smithi084.stdout:9/509: unlink da/de/d16/d55/d93/d95/c98 0 2024-04-26T21:26:04.587 INFO:tasks.workunit.client.0.smithi084.stdout:7/614: dread d6/d68/d7f/fae [0,4194304] 0 2024-04-26T21:26:04.589 INFO:tasks.workunit.client.0.smithi084.stdout:6/572: link d3/de/d1a/f9d d3/de/d1a/d43/d75/fbd 0 2024-04-26T21:26:04.591 INFO:tasks.workunit.client.0.smithi084.stdout:7/615: chown d6/d9/d12/d19/d20/d38/cb4 393958164 1 2024-04-26T21:26:04.593 INFO:tasks.workunit.client.0.smithi084.stdout:9/510: mkdir da/de/d16/dbc 0 2024-04-26T21:26:04.596 INFO:tasks.workunit.client.1.smithi120.stdout:1/735: dwrite d6/d9/dd4/de0/d1b/d55/fa1 [0,4194304] 0 2024-04-26T21:26:04.599 INFO:tasks.workunit.client.1.smithi120.stdout:6/808: link d4/db/c37 d4/d99/c10c 0 2024-04-26T21:26:04.599 INFO:tasks.workunit.client.1.smithi120.stdout:4/788: symlink d10/d28/dd9/ddd/dee/dd0/dd4/l110 0 2024-04-26T21:26:04.599 INFO:tasks.workunit.client.0.smithi084.stdout:1/594: getdents d2/d9/d15 0 2024-04-26T21:26:04.602 INFO:tasks.workunit.client.1.smithi120.stdout:2/819: rmdir d4/d1b/d25/d2c/d3e/d5e/d63/dcb/dca 39 2024-04-26T21:26:04.605 INFO:tasks.workunit.client.0.smithi084.stdout:7/616: rename d6/d9/d12/d8b/d72/da0/l91 to d6/d9/d12/d19/d60/ld4 0 2024-04-26T21:26:04.606 INFO:tasks.workunit.client.0.smithi084.stdout:9/511: creat da/de/d1e/d56/fbd x:0 0 0 2024-04-26T21:26:04.608 INFO:tasks.workunit.client.1.smithi120.stdout:4/789: mknod d10/da6/c111 0 2024-04-26T21:26:04.608 INFO:tasks.workunit.client.0.smithi084.stdout:1/595: creat d2/d54/d5e/d66/fc4 x:0 0 0 2024-04-26T21:26:04.609 INFO:tasks.workunit.client.1.smithi120.stdout:2/820: fsync d4/d1b/d25/d2c/d3e/d5e/d63/f107 0 2024-04-26T21:26:04.614 INFO:tasks.workunit.client.0.smithi084.stdout:1/596: write d2/d9/d15/d28/d5a/f91 [967322,106357] 0 2024-04-26T21:26:04.617 INFO:tasks.workunit.client.1.smithi120.stdout:3/830: dwrite dd/de/df/dda/d24/db1/f8a [4194304,4194304] 0 2024-04-26T21:26:04.617 INFO:tasks.workunit.client.0.smithi084.stdout:9/512: rename da/de/cb9 to da/de/cbe 0 2024-04-26T21:26:04.618 INFO:tasks.workunit.client.1.smithi120.stdout:4/790: mknod d10/d6b/d71/dd7/c112 0 2024-04-26T21:26:04.621 INFO:tasks.workunit.client.0.smithi084.stdout:1/597: symlink d2/d54/d5e/d66/d2a/d2c/d75/lc5 0 2024-04-26T21:26:04.624 INFO:tasks.workunit.client.0.smithi084.stdout:1/598: chown d2/d9/d15/d28/da0 78383 1 2024-04-26T21:26:04.625 INFO:tasks.workunit.client.1.smithi120.stdout:2/821: link d4/fd8 d4/d1b/d5c/da6/f111 0 2024-04-26T21:26:04.627 INFO:tasks.workunit.client.1.smithi120.stdout:3/831: mkdir dd/d40/dff/d110 0 2024-04-26T21:26:04.630 INFO:tasks.workunit.client.1.smithi120.stdout:4/791: getdents d10/d65 0 2024-04-26T21:26:04.633 INFO:tasks.workunit.client.0.smithi084.stdout:2/709: dread d6/d7/d3d/d15/d1f/d22/f86 [0,4194304] 0 2024-04-26T21:26:04.635 INFO:tasks.workunit.client.0.smithi084.stdout:2/710: stat d6/d7/d3d/d79/dbe/fd0 0 2024-04-26T21:26:04.640 INFO:tasks.workunit.client.0.smithi084.stdout:1/599: dread d2/d54/d5e/d66/d2a/d2c/d45/f4a [0,4194304] 0 2024-04-26T21:26:04.640 INFO:tasks.workunit.client.0.smithi084.stdout:2/711: mknod d6/d7/d3d/d15/d1f/d22/d2a/cef 0 2024-04-26T21:26:04.643 INFO:tasks.workunit.client.0.smithi084.stdout:3/583: dread d1/d2c/d2f/d31/d3b/f70 [0,4194304] 0 2024-04-26T21:26:04.643 INFO:tasks.workunit.client.0.smithi084.stdout:7/617: truncate d6/d9/d12/d19/f7e 3074633 0 2024-04-26T21:26:04.644 INFO:tasks.workunit.client.0.smithi084.stdout:1/600: chown d2/d54/d93/cb0 33790 1 2024-04-26T21:26:04.650 INFO:tasks.workunit.client.0.smithi084.stdout:7/618: fsync d6/d9/d12/d19/d20/f57 0 2024-04-26T21:26:04.651 INFO:tasks.workunit.client.0.smithi084.stdout:2/712: getdents d6/d3e 0 2024-04-26T21:26:04.654 INFO:tasks.workunit.client.0.smithi084.stdout:7/619: read d6/f65 [990662,117358] 0 2024-04-26T21:26:04.655 INFO:tasks.workunit.client.0.smithi084.stdout:6/573: dwrite d3/de/d15/df/f4b [0,4194304] 0 2024-04-26T21:26:04.659 INFO:tasks.workunit.client.0.smithi084.stdout:1/601: write d2/d9/d67/fba [1039290,6305] 0 2024-04-26T21:26:04.660 INFO:tasks.workunit.client.0.smithi084.stdout:9/513: dwrite da/de/d16/d25/d41/d67/f86 [0,4194304] 0 2024-04-26T21:26:04.661 INFO:tasks.workunit.client.0.smithi084.stdout:7/620: chown d6/d9/d12/d19/d7a/d84/l16 51580 1 2024-04-26T21:26:04.663 INFO:tasks.workunit.client.0.smithi084.stdout:2/713: write d6/d7/d3d/d79/d81/d82/fa7 [884976,121163] 0 2024-04-26T21:26:04.676 INFO:tasks.workunit.client.0.smithi084.stdout:3/584: dwrite d1/f1a [0,4194304] 0 2024-04-26T21:26:04.678 INFO:tasks.workunit.client.0.smithi084.stdout:6/574: link d3/de/d15/c8b d3/de/d15/df/cbe 0 2024-04-26T21:26:04.685 INFO:tasks.workunit.client.0.smithi084.stdout:4/547: sync 2024-04-26T21:26:04.685 INFO:tasks.workunit.client.0.smithi084.stdout:5/593: sync 2024-04-26T21:26:04.692 INFO:tasks.workunit.client.1.smithi120.stdout:7/805: sync 2024-04-26T21:26:04.692 INFO:tasks.workunit.client.1.smithi120.stdout:5/845: sync 2024-04-26T21:26:04.693 INFO:tasks.workunit.client.1.smithi120.stdout:3/832: unlink dd/de/d83/f81 0 2024-04-26T21:26:04.696 INFO:tasks.workunit.client.0.smithi084.stdout:3/585: mkdir d1/d2c/d2f/d31/dc7 0 2024-04-26T21:26:04.697 INFO:tasks.workunit.client.1.smithi120.stdout:4/792: readlink d10/d6b/dbf/l10c 0 2024-04-26T21:26:04.700 INFO:tasks.workunit.client.1.smithi120.stdout:6/809: dwrite d4/db/d10/d22/d6c/f70 [4194304,4194304] 0 2024-04-26T21:26:04.703 INFO:tasks.workunit.client.1.smithi120.stdout:3/833: fsync dd/d40/f92 0 2024-04-26T21:26:04.704 INFO:tasks.workunit.client.0.smithi084.stdout:5/594: symlink d0/dc/df/d31/d53/lb9 0 2024-04-26T21:26:04.706 INFO:tasks.workunit.client.0.smithi084.stdout:1/602: dwrite d2/d54/d93/faa [0,4194304] 0 2024-04-26T21:26:04.708 INFO:tasks.workunit.client.1.smithi120.stdout:0/941: dread d0/d3/d51/d97/d108/f96 [0,4194304] 0 2024-04-26T21:26:04.709 INFO:tasks.workunit.client.0.smithi084.stdout:9/514: rename da/de/d16/d25/d41/d43/d48/f8f to da/de/d16/d25/d41/d43/d48/d61/d81/fbf 0 2024-04-26T21:26:04.709 INFO:tasks.workunit.client.1.smithi120.stdout:3/834: write dd/de/df/dda/f105 [339002,71998] 0 2024-04-26T21:26:04.713 INFO:tasks.workunit.client.1.smithi120.stdout:2/822: dwrite d4/d1b/f85 [0,4194304] 0 2024-04-26T21:26:04.718 INFO:tasks.workunit.client.0.smithi084.stdout:7/621: dwrite d6/d9/d12/d19/d7a/d84/f7c [0,4194304] 0 2024-04-26T21:26:04.720 INFO:tasks.workunit.client.0.smithi084.stdout:4/548: dread d5/f4c [0,4194304] 0 2024-04-26T21:26:04.721 INFO:tasks.workunit.client.0.smithi084.stdout:3/586: mkdir d1/d2c/d2f/d31/d55/d4e/d7c/db1/dc8 0 2024-04-26T21:26:04.725 INFO:tasks.workunit.client.0.smithi084.stdout:1/603: write d2/d54/d5e/d66/d3a/d48/fa5 [3406419,50789] 0 2024-04-26T21:26:04.725 INFO:tasks.workunit.client.0.smithi084.stdout:9/515: symlink da/de/d16/d25/d4f/lc0 0 2024-04-26T21:26:04.726 INFO:tasks.workunit.client.1.smithi120.stdout:7/806: fdatasync d7/d10/f6a 0 2024-04-26T21:26:04.727 INFO:tasks.workunit.client.0.smithi084.stdout:6/575: getdents d3/de/d1a/d43/d72 0 2024-04-26T21:26:04.727 INFO:tasks.workunit.client.1.smithi120.stdout:4/793: write d10/feb [1420159,29732] 0 2024-04-26T21:26:04.730 INFO:tasks.workunit.client.1.smithi120.stdout:5/846: chown d2/d30/d93/dbf/cdc 53710353 1 2024-04-26T21:26:04.732 INFO:tasks.workunit.client.1.smithi120.stdout:0/942: truncate d0/d3/dc/d12/d31/f43 1052131 0 2024-04-26T21:26:04.733 INFO:tasks.workunit.client.0.smithi084.stdout:5/595: link d0/d49/d56/f57 d0/dc/df/d75/fba 0 2024-04-26T21:26:04.733 INFO:tasks.workunit.client.1.smithi120.stdout:2/823: mkdir d4/d1b/d4f/d95/de9/d112 0 2024-04-26T21:26:04.735 INFO:tasks.workunit.client.1.smithi120.stdout:2/824: chown d4/dea 22662 1 2024-04-26T21:26:04.736 INFO:tasks.workunit.client.0.smithi084.stdout:1/604: write d2/d19/d63/f96 [102835,114939] 0 2024-04-26T21:26:04.737 INFO:tasks.workunit.client.1.smithi120.stdout:3/835: symlink dd/de/df/dda/d24/d9d/l111 0 2024-04-26T21:26:04.739 INFO:tasks.workunit.client.1.smithi120.stdout:3/836: fsync dd/de/df/f10e 0 2024-04-26T21:26:04.740 INFO:tasks.workunit.client.0.smithi084.stdout:6/576: rename d3/de/d15/d5f to d3/de/d15/d5f/dbf 22 2024-04-26T21:26:04.741 INFO:tasks.workunit.client.1.smithi120.stdout:0/943: fsync d0/d3/f41 0 2024-04-26T21:26:04.742 INFO:tasks.workunit.client.1.smithi120.stdout:6/810: creat d4/db/d10/dd/d28/d9e/f10d x:0 0 0 2024-04-26T21:26:04.743 INFO:tasks.workunit.client.0.smithi084.stdout:3/587: creat d1/d2c/d2f/fc9 x:0 0 0 2024-04-26T21:26:04.744 INFO:tasks.workunit.client.0.smithi084.stdout:1/605: fsync d2/d9/d15/d28/d47/f9b 0 2024-04-26T21:26:04.744 INFO:tasks.workunit.client.1.smithi120.stdout:2/825: creat d4/d1b/d2e/d50/d14/dc2/f113 x:0 0 0 2024-04-26T21:26:04.746 INFO:tasks.workunit.client.1.smithi120.stdout:4/794: read d10/d28/dd9/ddd/dee/dd0/dd4/d86/f9a [53884,44670] 0 2024-04-26T21:26:04.747 INFO:tasks.workunit.client.1.smithi120.stdout:3/837: rmdir dd/de/d83/d64/db0 39 2024-04-26T21:26:04.747 INFO:tasks.workunit.client.1.smithi120.stdout:6/811: write d4/db/d10/dd/d4e/f85 [865389,59236] 0 2024-04-26T21:26:04.748 INFO:tasks.workunit.client.1.smithi120.stdout:5/847: mknod d2/dc/d1d/d21/d77/c13b 0 2024-04-26T21:26:04.748 INFO:tasks.workunit.client.0.smithi084.stdout:6/577: mkdir d3/de/d15/d23/d90/da2/dc0 0 2024-04-26T21:26:04.753 INFO:tasks.workunit.client.0.smithi084.stdout:1/606: mkdir d2/d9/d15/d28/d5a/dc6 0 2024-04-26T21:26:04.754 INFO:tasks.workunit.client.1.smithi120.stdout:5/848: truncate d2/d30/d93/d107/d36/d67/f119 752119 0 2024-04-26T21:26:04.754 INFO:tasks.workunit.client.1.smithi120.stdout:2/826: symlink d4/d1b/l114 0 2024-04-26T21:26:04.754 INFO:tasks.workunit.client.1.smithi120.stdout:3/838: mknod dd/de/df/dda/de6/c112 0 2024-04-26T21:26:04.755 INFO:tasks.workunit.client.0.smithi084.stdout:3/588: read d1/d24/d27/d3a/f9f [310874,47926] 0 2024-04-26T21:26:04.755 INFO:tasks.workunit.client.1.smithi120.stdout:5/849: stat d2/dc/d1d/d21/d66 0 2024-04-26T21:26:04.756 INFO:tasks.workunit.client.0.smithi084.stdout:9/516: write da/de/f3d [4258446,125140] 0 2024-04-26T21:26:04.759 INFO:tasks.workunit.client.1.smithi120.stdout:4/795: creat d10/d28/dd9/ddd/dee/dd0/dd4/d86/f113 x:0 0 0 2024-04-26T21:26:04.762 INFO:tasks.workunit.client.1.smithi120.stdout:6/812: dread d4/db/d10/d1a/d2b/d57/d67/f4a [0,4194304] 0 2024-04-26T21:26:04.763 INFO:tasks.workunit.client.1.smithi120.stdout:3/839: write dd/de/d83/f106 [2810890,84902] 0 2024-04-26T21:26:04.764 INFO:tasks.workunit.client.1.smithi120.stdout:2/827: symlink d4/l115 0 2024-04-26T21:26:04.765 INFO:tasks.workunit.client.1.smithi120.stdout:6/813: fsync d4/db/d10/d22/d56/d94/fb2 0 2024-04-26T21:26:04.767 INFO:tasks.workunit.client.1.smithi120.stdout:4/796: rename d10/c96 to d10/d28/dd9/ddd/dee/dd0/dd4/d86/dfa/c114 0 2024-04-26T21:26:04.768 INFO:tasks.workunit.client.1.smithi120.stdout:6/814: chown d4/db/d25/d6d/dbd/l7d 261077997 1 2024-04-26T21:26:04.769 INFO:tasks.workunit.client.1.smithi120.stdout:6/815: chown d4/db/d25/d6d/deb 4718502 1 2024-04-26T21:26:04.770 INFO:tasks.workunit.client.1.smithi120.stdout:2/828: unlink d4/d1b/d5c/d99/ld7 0 2024-04-26T21:26:04.772 INFO:tasks.workunit.client.1.smithi120.stdout:3/840: mknod dd/d2a/d74/c113 0 2024-04-26T21:26:04.773 INFO:tasks.workunit.client.1.smithi120.stdout:4/797: mknod d10/d28/d73/c115 0 2024-04-26T21:26:04.774 INFO:tasks.workunit.client.0.smithi084.stdout:6/578: write d3/de/d1a/d2f/f56 [625698,54427] 0 2024-04-26T21:26:04.775 INFO:tasks.workunit.client.1.smithi120.stdout:3/841: stat dd/de/df/d12/d48/d9b 0 2024-04-26T21:26:04.775 INFO:tasks.workunit.client.0.smithi084.stdout:1/607: write d2/d54/d5e/d66/f29 [4349909,41638] 0 2024-04-26T21:26:04.779 INFO:tasks.workunit.client.0.smithi084.stdout:5/596: dwrite d0/dc/df/d6d/f73 [0,4194304] 0 2024-04-26T21:26:04.784 INFO:tasks.workunit.client.1.smithi120.stdout:5/850: dwrite d2/d30/d93/d107/fac [0,4194304] 0 2024-04-26T21:26:04.785 INFO:tasks.workunit.client.0.smithi084.stdout:4/549: dwrite d5/d2e/d5f/f27 [4194304,4194304] 0 2024-04-26T21:26:04.785 INFO:tasks.workunit.client.1.smithi120.stdout:4/798: truncate d10/d28/dd9/ddd/dee/dd0/dd4/d86/f113 392198 0 2024-04-26T21:26:04.785 INFO:tasks.workunit.client.0.smithi084.stdout:5/597: write d0/f22 [1391954,126990] 0 2024-04-26T21:26:04.787 INFO:tasks.workunit.client.0.smithi084.stdout:7/622: dwrite d6/d9/d89/fc9 [0,4194304] 0 2024-04-26T21:26:04.793 INFO:tasks.workunit.client.0.smithi084.stdout:4/550: fsync d5/d25/f47 0 2024-04-26T21:26:04.794 INFO:tasks.workunit.client.0.smithi084.stdout:7/623: chown d6/d9/d12/d8b/cb1 44151 1 2024-04-26T21:26:04.801 INFO:tasks.workunit.client.0.smithi084.stdout:3/589: truncate d1/d24/d27/d3a/f9f 1582423 0 2024-04-26T21:26:04.802 INFO:tasks.workunit.client.0.smithi084.stdout:8/588: sync 2024-04-26T21:26:04.804 INFO:tasks.workunit.client.1.smithi120.stdout:4/799: mknod d10/d65/c116 0 2024-04-26T21:26:04.806 INFO:tasks.workunit.client.0.smithi084.stdout:1/608: creat d2/d9/d67/fc7 x:0 0 0 2024-04-26T21:26:04.807 INFO:tasks.workunit.client.1.smithi120.stdout:6/816: rename d4/db/f5a to d4/db/f10e 0 2024-04-26T21:26:04.809 INFO:tasks.workunit.client.0.smithi084.stdout:5/598: creat d0/dc/df/d51/fbb x:0 0 0 2024-04-26T21:26:04.811 INFO:tasks.workunit.client.0.smithi084.stdout:7/624: rmdir d6/d9/d12/d19/d8f 39 2024-04-26T21:26:04.812 INFO:tasks.workunit.client.0.smithi084.stdout:7/625: chown d6/d68/d7f 90629887 1 2024-04-26T21:26:04.812 INFO:tasks.workunit.client.0.smithi084.stdout:8/589: chown d4/d6/db/d1e/d22/d39/f82 27 1 2024-04-26T21:26:04.815 INFO:tasks.workunit.client.0.smithi084.stdout:9/517: link da/de/d16/d25/f4e da/de/d16/d25/d41/d43/d48/d61/fc1 0 2024-04-26T21:26:04.816 INFO:tasks.workunit.client.0.smithi084.stdout:1/609: mkdir d2/dc8 0 2024-04-26T21:26:04.816 INFO:tasks.workunit.client.0.smithi084.stdout:5/599: fsync d0/dc/df/d31/d53/f60 0 2024-04-26T21:26:04.817 INFO:tasks.workunit.client.0.smithi084.stdout:8/590: fsync d4/d7/d15/d3c/f7d 0 2024-04-26T21:26:04.818 INFO:tasks.workunit.client.0.smithi084.stdout:1/610: chown d2/d9/d15/d28 0 1 2024-04-26T21:26:04.819 INFO:tasks.workunit.client.1.smithi120.stdout:5/851: mkdir d2/d13c 0 2024-04-26T21:26:04.821 INFO:tasks.workunit.client.1.smithi120.stdout:3/842: getdents dd/de/df 0 2024-04-26T21:26:04.821 INFO:tasks.workunit.client.1.smithi120.stdout:5/852: chown d2/d30/d93/dbf 8 1 2024-04-26T21:26:04.822 INFO:tasks.workunit.client.0.smithi084.stdout:9/518: unlink da/c42 0 2024-04-26T21:26:04.822 INFO:tasks.workunit.client.0.smithi084.stdout:8/591: chown d4/d7/d15/f30 382454 1 2024-04-26T21:26:04.822 INFO:tasks.workunit.client.0.smithi084.stdout:3/590: getdents d1/d2c/d2f/d31/d55/d4e/d98/d9e 0 2024-04-26T21:26:04.824 INFO:tasks.workunit.client.0.smithi084.stdout:7/626: write d6/d9/d12/d8b/d72/da0/f85 [1635197,11780] 0 2024-04-26T21:26:04.825 INFO:tasks.workunit.client.1.smithi120.stdout:3/843: stat dd/de/df/dda/d24/db1/d76/l88 0 2024-04-26T21:26:04.825 INFO:tasks.workunit.client.1.smithi120.stdout:9/755: sync 2024-04-26T21:26:04.825 INFO:tasks.workunit.client.1.smithi120.stdout:9/756: readlink d0/dd/l3e 0 2024-04-26T21:26:04.827 INFO:tasks.workunit.client.0.smithi084.stdout:1/611: mkdir d2/d54/d5e/d66/d2a/d2c/d45/dc9 0 2024-04-26T21:26:04.827 INFO:tasks.workunit.client.1.smithi120.stdout:4/800: unlink d10/d28/dd9/l109 0 2024-04-26T21:26:04.828 INFO:tasks.workunit.client.0.smithi084.stdout:0/611: sync 2024-04-26T21:26:04.828 INFO:tasks.workunit.client.0.smithi084.stdout:2/714: sync 2024-04-26T21:26:04.830 INFO:tasks.workunit.client.0.smithi084.stdout:8/592: symlink d4/d6/lac 0 2024-04-26T21:26:04.832 INFO:tasks.workunit.client.0.smithi084.stdout:7/627: creat d6/d9/d12/d8b/d72/fd5 x:0 0 0 2024-04-26T21:26:04.833 INFO:tasks.workunit.client.1.smithi120.stdout:7/807: write d7/d64/da6/d1f/d28/d4c/f89 [4399939,85356] 0 2024-04-26T21:26:04.836 INFO:tasks.workunit.client.0.smithi084.stdout:3/591: creat d1/d2c/d2f/d31/d55/d4e/d7c/fca x:0 0 0 2024-04-26T21:26:04.837 INFO:tasks.workunit.client.1.smithi120.stdout:0/944: write d0/d3/dc/dd/d1b/daa/fd6 [895016,114038] 0 2024-04-26T21:26:04.838 INFO:tasks.workunit.client.0.smithi084.stdout:7/628: dread - d6/d9/d12/d8b/d72/fb7 zero size 2024-04-26T21:26:04.838 INFO:tasks.workunit.client.1.smithi120.stdout:4/801: rmdir d10/d12/da1/daf 39 2024-04-26T21:26:04.840 INFO:tasks.workunit.client.0.smithi084.stdout:2/715: symlink d6/d7/d3d/d79/d81/lf0 0 2024-04-26T21:26:04.842 INFO:tasks.workunit.client.0.smithi084.stdout:1/612: read d2/d19/f1e [1823771,84232] 0 2024-04-26T21:26:04.846 INFO:tasks.workunit.client.1.smithi120.stdout:3/844: dwrite dd/de/df/db6/f59 [0,4194304] 0 2024-04-26T21:26:04.846 INFO:tasks.workunit.client.1.smithi120.stdout:4/802: rmdir d10/d28/d73 39 2024-04-26T21:26:04.848 INFO:tasks.workunit.client.0.smithi084.stdout:7/629: rmdir d6/d1c/d51 39 2024-04-26T21:26:04.848 INFO:tasks.workunit.client.1.smithi120.stdout:6/817: dread d4/d3d/f83 [0,4194304] 0 2024-04-26T21:26:04.848 INFO:tasks.workunit.client.0.smithi084.stdout:0/612: getdents de/d20/d4c/dae/dc2 0 2024-04-26T21:26:04.849 INFO:tasks.workunit.client.0.smithi084.stdout:3/592: mknod d1/d2c/d2f/d31/d55/da4/ccb 0 2024-04-26T21:26:04.851 INFO:tasks.workunit.client.0.smithi084.stdout:7/630: chown d6/d68/d7f/dcf 1628 1 2024-04-26T21:26:04.853 INFO:tasks.workunit.client.0.smithi084.stdout:3/593: readlink d1/d24/d27/l6f 0 2024-04-26T21:26:04.855 INFO:tasks.workunit.client.0.smithi084.stdout:0/613: dread - de/d20/d4c/dae/fb4 zero size 2024-04-26T21:26:04.859 INFO:tasks.workunit.client.0.smithi084.stdout:4/551: write d5/d2e/d5f/d32/f34 [895000,61004] 0 2024-04-26T21:26:04.861 INFO:tasks.workunit.client.0.smithi084.stdout:5/600: dwrite d0/dc/df/d31/f9c [0,4194304] 0 2024-04-26T21:26:04.862 INFO:tasks.workunit.client.0.smithi084.stdout:2/716: stat d6/d7/d3d/d15/d1f/d39/d20/d36/da4/feb 0 2024-04-26T21:26:04.864 INFO:tasks.workunit.client.0.smithi084.stdout:3/594: creat d1/d2c/d2f/d94/fcc x:0 0 0 2024-04-26T21:26:04.874 INFO:tasks.workunit.client.0.smithi084.stdout:7/631: truncate d6/d68/f6e 957493 0 2024-04-26T21:26:04.876 INFO:tasks.workunit.client.0.smithi084.stdout:5/601: rename d0/dc/df/d31/c9b to d0/dc/df/d31/d53/d87/cbc 0 2024-04-26T21:26:04.878 INFO:tasks.workunit.client.0.smithi084.stdout:7/632: readlink d6/d26/l98 0 2024-04-26T21:26:04.879 INFO:tasks.workunit.client.0.smithi084.stdout:9/519: dwrite da/de/d16/d25/d41/d8d/fad [0,4194304] 0 2024-04-26T21:26:04.879 INFO:tasks.workunit.client.0.smithi084.stdout:2/717: symlink d6/d7/d3d/d15/d1f/d22/de6/lf1 0 2024-04-26T21:26:04.882 INFO:tasks.workunit.client.0.smithi084.stdout:6/579: dwrite d3/de/d1a/d43/f48 [0,4194304] 0 2024-04-26T21:26:04.891 INFO:tasks.workunit.client.0.smithi084.stdout:2/718: creat d6/d7/d3d/d79/dbe/ff2 x:0 0 0 2024-04-26T21:26:04.892 INFO:tasks.workunit.client.0.smithi084.stdout:6/580: mkdir d3/de/d15/d5f/dc1 0 2024-04-26T21:26:04.896 INFO:tasks.workunit.client.0.smithi084.stdout:8/593: dread d4/d6/db/d1e/d22/d2f/f2c [0,4194304] 0 2024-04-26T21:26:04.896 INFO:tasks.workunit.client.0.smithi084.stdout:3/595: write d1/d2c/d2f/d31/d52/f60 [1595518,50041] 0 2024-04-26T21:26:04.897 INFO:tasks.workunit.client.1.smithi120.stdout:0/945: creat d0/d3/dc/dd/d1b/d24/d73/db7/f12f x:0 0 0 2024-04-26T21:26:04.898 INFO:tasks.workunit.client.1.smithi120.stdout:5/853: getdents d2/dc/d1d/d21/d77/d79/dd9 0 2024-04-26T21:26:04.898 INFO:tasks.workunit.client.0.smithi084.stdout:2/719: mkdir d6/d7/d3d/d79/d85/df3 0 2024-04-26T21:26:04.899 INFO:tasks.workunit.client.1.smithi120.stdout:2/829: truncate d4/d1b/d2e/d50/f3f 1837455 0 2024-04-26T21:26:04.903 INFO:tasks.workunit.client.1.smithi120.stdout:6/818: fsync d4/db/d10/d22/d56/d94/fd7 0 2024-04-26T21:26:04.905 INFO:tasks.workunit.client.0.smithi084.stdout:0/614: truncate de/d20/f24 3428754 0 2024-04-26T21:26:04.905 INFO:tasks.workunit.client.1.smithi120.stdout:3/845: dread dd/de/df/d12/d48/fc4 [0,4194304] 0 2024-04-26T21:26:04.906 INFO:tasks.workunit.client.0.smithi084.stdout:3/596: fsync d1/d2c/d2f/d31/d3b/f70 0 2024-04-26T21:26:04.911 INFO:tasks.workunit.client.1.smithi120.stdout:2/830: stat d4/d1b/d4f/d95/fc3 0 2024-04-26T21:26:04.911 INFO:tasks.workunit.client.1.smithi120.stdout:6/819: write d4/db/d10/dd/d28/d9e/f10d [683357,12985] 0 2024-04-26T21:26:04.913 INFO:tasks.workunit.client.0.smithi084.stdout:9/520: write da/de/d16/d25/d41/d43/d48/f58 [716393,86009] 0 2024-04-26T21:26:04.913 INFO:tasks.workunit.client.0.smithi084.stdout:6/581: dwrite d3/de/d1a/d2f/d4c/d58/fbc [0,4194304] 0 2024-04-26T21:26:04.915 INFO:tasks.workunit.client.1.smithi120.stdout:0/946: getdents d0 0 2024-04-26T21:26:04.916 INFO:tasks.workunit.client.1.smithi120.stdout:3/846: getdents dd/de/df/db6/dc5/d103 0 2024-04-26T21:26:04.916 INFO:tasks.workunit.client.1.smithi120.stdout:9/757: dwrite d0/dd/d3a/dae/f8f [0,4194304] 0 2024-04-26T21:26:04.921 INFO:tasks.workunit.client.1.smithi120.stdout:2/831: unlink d4/d1b/c3b 0 2024-04-26T21:26:04.923 INFO:tasks.workunit.client.0.smithi084.stdout:8/594: write d4/d6/f24 [7487340,115520] 0 2024-04-26T21:26:04.928 INFO:tasks.workunit.client.1.smithi120.stdout:9/758: symlink d0/lfd 0 2024-04-26T21:26:04.929 INFO:tasks.workunit.client.0.smithi084.stdout:4/552: dread d5/d25/f3e [0,4194304] 0 2024-04-26T21:26:04.935 INFO:tasks.workunit.client.1.smithi120.stdout:0/947: creat d0/d3/dc/dd/d1b/d39/f130 x:0 0 0 2024-04-26T21:26:04.939 INFO:tasks.workunit.client.0.smithi084.stdout:4/553: creat d5/d25/d35/d60/d6d/fb0 x:0 0 0 2024-04-26T21:26:04.941 INFO:tasks.workunit.client.1.smithi120.stdout:4/803: dwrite d10/d28/f5f [0,4194304] 0 2024-04-26T21:26:04.941 INFO:tasks.workunit.client.1.smithi120.stdout:2/832: write d4/d1b/d2e/d50/d14/dc2/feb [352414,63574] 0 2024-04-26T21:26:04.943 INFO:tasks.workunit.client.1.smithi120.stdout:5/854: dwrite d2/dc/d1d/d21/d77/d79/fbd [0,4194304] 0 2024-04-26T21:26:04.943 INFO:tasks.workunit.client.1.smithi120.stdout:3/847: rename dd/de/df/dda/d24/d9d/d86/dd3/ddb/fef to dd/de/df/db6/dc5/f114 0 2024-04-26T21:26:04.944 INFO:tasks.workunit.client.0.smithi084.stdout:2/720: write d6/d7/d3d/d79/d81/d82/da8/fba [1168412,4260] 0 2024-04-26T21:26:04.947 INFO:tasks.workunit.client.1.smithi120.stdout:6/820: mknod d4/db/d10/d1a/d2b/d57/d67/dbc/dce/d101/c10f 0 2024-04-26T21:26:04.947 INFO:tasks.workunit.client.1.smithi120.stdout:9/759: creat d0/d66/d93/db7/dc7/ffe x:0 0 0 2024-04-26T21:26:04.951 INFO:tasks.workunit.client.1.smithi120.stdout:2/833: rename d4/d1b/d2e/d50/fbd to d4/d1b/d25/d29/f116 0 2024-04-26T21:26:04.953 INFO:tasks.workunit.client.1.smithi120.stdout:4/804: mknod d10/d28/c117 0 2024-04-26T21:26:04.955 INFO:tasks.workunit.client.1.smithi120.stdout:3/848: mknod dd/dcf/c115 0 2024-04-26T21:26:04.955 INFO:tasks.workunit.client.0.smithi084.stdout:9/521: dwrite da/f37 [0,4194304] 0 2024-04-26T21:26:04.955 INFO:tasks.workunit.client.0.smithi084.stdout:2/721: read d6/d7/d3d/d79/d81/d82/fa7 [45266,52479] 0 2024-04-26T21:26:04.956 INFO:tasks.workunit.client.1.smithi120.stdout:2/834: write d4/d1b/d56/d65/d8d/f110 [550282,5793] 0 2024-04-26T21:26:04.957 INFO:tasks.workunit.client.0.smithi084.stdout:4/554: rename d5/d7/d65/d7f/d6a/f89 to d5/d25/d99/fb1 0 2024-04-26T21:26:04.965 INFO:tasks.workunit.client.1.smithi120.stdout:0/948: truncate d0/d3/dc/dd/d1b/d39/f50 2122757 0 2024-04-26T21:26:04.965 INFO:tasks.workunit.client.0.smithi084.stdout:0/615: dread de/d20/f24 [0,4194304] 0 2024-04-26T21:26:04.966 INFO:tasks.workunit.client.0.smithi084.stdout:4/555: rmdir d5/d10/d15/d21/d29 39 2024-04-26T21:26:04.967 INFO:tasks.workunit.client.1.smithi120.stdout:0/949: chown d0/d3/d51/d70/d99/f126 24854 1 2024-04-26T21:26:04.969 INFO:tasks.workunit.client.0.smithi084.stdout:9/522: creat da/de/d16/d25/d41/d43/fc2 x:0 0 0 2024-04-26T21:26:04.971 INFO:tasks.workunit.client.0.smithi084.stdout:0/616: fsync de/d2b/d45/d63/fc0 0 2024-04-26T21:26:04.972 INFO:tasks.workunit.client.0.smithi084.stdout:3/597: dwrite d1/d2c/d2f/f1f [4194304,4194304] 0 2024-04-26T21:26:04.974 INFO:tasks.workunit.client.1.smithi120.stdout:6/821: mknod d4/db/d10/d22/d6c/c110 0 2024-04-26T21:26:04.975 INFO:tasks.workunit.client.1.smithi120.stdout:3/849: symlink dd/de/df/dda/d24/d9d/d86/dd3/l116 0 2024-04-26T21:26:04.977 INFO:tasks.workunit.client.1.smithi120.stdout:6/822: chown d4/db/d10/d1a/l88 59403 1 2024-04-26T21:26:04.979 INFO:tasks.workunit.client.1.smithi120.stdout:0/950: dread d0/df4/f68 [0,4194304] 0 2024-04-26T21:26:04.980 INFO:tasks.workunit.client.1.smithi120.stdout:6/823: chown d4/db/d10/d22/d6c/f8b 192419997 1 2024-04-26T21:26:04.981 INFO:tasks.workunit.client.1.smithi120.stdout:9/760: rename d0/l49 to d0/d6/d4d/d65/dec/d2d/d4b/d85/lff 0 2024-04-26T21:26:04.983 INFO:tasks.workunit.client.1.smithi120.stdout:6/824: write d4/db/ffb [208540,78831] 0 2024-04-26T21:26:04.985 INFO:tasks.workunit.client.0.smithi084.stdout:0/617: creat de/d2b/d45/d94/fc6 x:0 0 0 2024-04-26T21:26:04.985 INFO:tasks.workunit.client.0.smithi084.stdout:3/598: symlink d1/d2c/d2f/d31/d52/lcd 0 2024-04-26T21:26:04.997 INFO:tasks.workunit.client.1.smithi120.stdout:6/825: dwrite d4/f31 [4194304,4194304] 0 2024-04-26T21:26:05.000 INFO:tasks.workunit.client.0.smithi084.stdout:0/618: dread de/d2b/d45/d63/f86 [0,4194304] 0 2024-04-26T21:26:05.001 INFO:tasks.workunit.client.0.smithi084.stdout:4/556: dwrite d5/d2e/d5f/f27 [0,4194304] 0 2024-04-26T21:26:05.004 INFO:tasks.workunit.client.1.smithi120.stdout:1/736: sync 2024-04-26T21:26:05.004 INFO:tasks.workunit.client.1.smithi120.stdout:8/773: sync 2024-04-26T21:26:05.005 INFO:tasks.workunit.client.1.smithi120.stdout:4/805: rmdir d10/d28/dd9/ddd/df1/d10d 0 2024-04-26T21:26:05.015 INFO:tasks.workunit.client.1.smithi120.stdout:0/951: link d0/d3/d51/d70/ldc d0/df/d79/l131 0 2024-04-26T21:26:05.016 INFO:tasks.workunit.client.1.smithi120.stdout:1/737: creat d6/d9/dd4/de0/d2d/d98/d56/dad/fef x:0 0 0 2024-04-26T21:26:05.016 INFO:tasks.workunit.client.0.smithi084.stdout:9/523: dwrite da/de/d1e/f29 [0,4194304] 0 2024-04-26T21:26:05.021 INFO:tasks.workunit.client.0.smithi084.stdout:3/599: dwrite d1/d2c/d2f/d31/f61 [0,4194304] 0 2024-04-26T21:26:05.023 INFO:tasks.workunit.client.0.smithi084.stdout:6/582: dread d3/de/d41/f44 [0,4194304] 0 2024-04-26T21:26:05.023 INFO:tasks.workunit.client.1.smithi120.stdout:1/738: fdatasync d6/d9/dd4/de0/d2d/d48/f66 0 2024-04-26T21:26:05.026 INFO:tasks.workunit.client.0.smithi084.stdout:6/583: readlink d3/de/d15/d5f/lbb 0 2024-04-26T21:26:05.026 INFO:tasks.workunit.client.1.smithi120.stdout:8/774: creat d5/d6/d11/d32/ff9 x:0 0 0 2024-04-26T21:26:05.027 INFO:tasks.workunit.client.0.smithi084.stdout:3/600: stat d1/d24/d27/d3a/fb0 0 2024-04-26T21:26:05.027 INFO:tasks.workunit.client.0.smithi084.stdout:8/595: write d4/d6/db/d1e/d22/f5d [1021643,88103] 0 2024-04-26T21:26:05.031 INFO:tasks.workunit.client.0.smithi084.stdout:6/584: write d3/de/d15/d23/d90/fb8 [848265,57642] 0 2024-04-26T21:26:05.038 INFO:tasks.workunit.client.0.smithi084.stdout:3/601: write d1/d24/d27/d3a/d81/fa6 [1184237,118415] 0 2024-04-26T21:26:05.038 INFO:tasks.workunit.client.0.smithi084.stdout:6/585: creat d3/de/d1a/d43/d72/dad/fc2 x:0 0 0 2024-04-26T21:26:05.039 INFO:tasks.workunit.client.0.smithi084.stdout:0/619: write de/d2b/d77/d32/f79 [4223992,103943] 0 2024-04-26T21:26:05.040 INFO:tasks.workunit.client.1.smithi120.stdout:8/775: mknod d5/d6/d11/d32/d3b/cfa 0 2024-04-26T21:26:05.041 INFO:tasks.workunit.client.1.smithi120.stdout:6/826: write d4/db/d25/d6d/d97/f7f [919432,19841] 0 2024-04-26T21:26:05.042 INFO:tasks.workunit.client.0.smithi084.stdout:5/602: sync 2024-04-26T21:26:05.043 INFO:tasks.workunit.client.0.smithi084.stdout:3/602: chown d1/d2c/d2f/d94/fcc 1635338 1 2024-04-26T21:26:05.043 INFO:tasks.workunit.client.1.smithi120.stdout:8/776: stat d5/d6/d11/d52/d27/d4f/d67/fad 0 2024-04-26T21:26:05.043 INFO:tasks.workunit.client.0.smithi084.stdout:7/633: sync 2024-04-26T21:26:05.044 INFO:tasks.workunit.client.0.smithi084.stdout:1/613: sync 2024-04-26T21:26:05.045 INFO:tasks.workunit.client.1.smithi120.stdout:4/806: getdents d10/d28/d73/de2 0 2024-04-26T21:26:05.046 INFO:tasks.workunit.client.0.smithi084.stdout:6/586: mkdir d3/de/d41/d5c/dc3 0 2024-04-26T21:26:05.047 INFO:tasks.workunit.client.0.smithi084.stdout:0/620: creat de/d78/fc7 x:0 0 0 2024-04-26T21:26:05.047 INFO:tasks.workunit.client.1.smithi120.stdout:3/850: truncate dd/de/df/dda/d24/d43/f4c 3588618 0 2024-04-26T21:26:05.049 INFO:tasks.workunit.client.1.smithi120.stdout:0/952: rename d0/d3/dc/dd/d1b/f8a to d0/d3/d51/f132 0 2024-04-26T21:26:05.053 INFO:tasks.workunit.client.0.smithi084.stdout:1/614: creat d2/d9/d15/d28/d47/fca x:0 0 0 2024-04-26T21:26:05.054 INFO:tasks.workunit.client.0.smithi084.stdout:7/634: unlink d6/d9/d12/d8b/d72/da0/f4a 0 2024-04-26T21:26:05.056 INFO:tasks.workunit.client.0.smithi084.stdout:6/587: fsync d3/f10 0 2024-04-26T21:26:05.056 INFO:tasks.workunit.client.0.smithi084.stdout:4/557: write d5/d10/f71 [1396172,88283] 0 2024-04-26T21:26:05.056 INFO:tasks.workunit.client.0.smithi084.stdout:0/621: chown de/d20/d4c/fb7 707 1 2024-04-26T21:26:05.057 INFO:tasks.workunit.client.0.smithi084.stdout:5/603: rename d0/dc/l93 to d0/dc/df/d6d/lbd 0 2024-04-26T21:26:05.057 INFO:tasks.workunit.client.1.smithi120.stdout:4/807: dread d10/d12/f3c [0,4194304] 0 2024-04-26T21:26:05.058 INFO:tasks.workunit.client.1.smithi120.stdout:1/739: write d6/d9/dd4/de0/d1d/d5d/f90 [1698604,104758] 0 2024-04-26T21:26:05.061 INFO:tasks.workunit.client.0.smithi084.stdout:3/603: creat d1/d2c/d2f/d31/d55/d4e/d98/fce x:0 0 0 2024-04-26T21:26:05.061 INFO:tasks.workunit.client.1.smithi120.stdout:8/777: symlink d5/d6/d11/d52/df5/lfb 0 2024-04-26T21:26:05.062 INFO:tasks.workunit.client.0.smithi084.stdout:2/722: sync 2024-04-26T21:26:05.062 INFO:tasks.workunit.client.0.smithi084.stdout:6/588: rmdir d3 39 2024-04-26T21:26:05.063 INFO:tasks.workunit.client.1.smithi120.stdout:0/953: mknod d0/d3/dc/dd/d9b/c133 0 2024-04-26T21:26:05.064 INFO:tasks.workunit.client.1.smithi120.stdout:6/827: creat d4/db/d10/dd/f111 x:0 0 0 2024-04-26T21:26:05.066 INFO:tasks.workunit.client.1.smithi120.stdout:8/778: dread d5/d6/d11/d52/f6a [0,4194304] 0 2024-04-26T21:26:05.067 INFO:tasks.workunit.client.1.smithi120.stdout:1/740: creat d6/d9/dd4/de0/d2d/d98/d56/ff0 x:0 0 0 2024-04-26T21:26:05.068 INFO:tasks.workunit.client.1.smithi120.stdout:8/779: chown d5/d8e/fdf 1570236 1 2024-04-26T21:26:05.069 INFO:tasks.workunit.client.1.smithi120.stdout:1/741: stat d6/d9/dd4/de0/d2d/d98/c10 0 2024-04-26T21:26:05.069 INFO:tasks.workunit.client.0.smithi084.stdout:0/622: creat de/d2b/d45/d63/fc8 x:0 0 0 2024-04-26T21:26:05.069 INFO:tasks.workunit.client.0.smithi084.stdout:7/635: dread - d6/d9/d12/d19/f79 zero size 2024-04-26T21:26:05.070 INFO:tasks.workunit.client.1.smithi120.stdout:8/780: readlink d5/d6/d34/d42/d9d/d83/ld1 0 2024-04-26T21:26:05.070 INFO:tasks.workunit.client.1.smithi120.stdout:4/808: fdatasync d10/d12/fa7 0 2024-04-26T21:26:05.071 INFO:tasks.workunit.client.0.smithi084.stdout:0/623: stat de/d20 0 2024-04-26T21:26:05.072 INFO:tasks.workunit.client.1.smithi120.stdout:1/742: fdatasync d6/d9/dd4/de0/d1d/d2c/d58/fcb 0 2024-04-26T21:26:05.076 INFO:tasks.workunit.client.0.smithi084.stdout:4/558: mkdir d5/d25/d35/d60/d69/db2 0 2024-04-26T21:26:05.076 INFO:tasks.workunit.client.0.smithi084.stdout:6/589: readlink d3/de/d1a/d43/d75/l88 0 2024-04-26T21:26:05.080 INFO:tasks.workunit.client.0.smithi084.stdout:1/615: truncate d2/d19/f40 704546 0 2024-04-26T21:26:05.080 INFO:tasks.workunit.client.1.smithi120.stdout:6/828: creat d4/db/d10/d1a/d2b/d57/d67/dbc/dce/f112 x:0 0 0 2024-04-26T21:26:05.082 INFO:tasks.workunit.client.0.smithi084.stdout:8/596: dwrite d4/f12 [0,4194304] 0 2024-04-26T21:26:05.082 INFO:tasks.workunit.client.0.smithi084.stdout:6/590: stat d3/d18/l54 0 2024-04-26T21:26:05.082 INFO:tasks.workunit.client.1.smithi120.stdout:8/781: mkdir d5/d6/d34/d37/dd9/dda/dfc 0 2024-04-26T21:26:05.084 INFO:tasks.workunit.client.1.smithi120.stdout:3/851: dwrite dd/de/df/dda/d24/db1/d76/d3b/fbc [0,4194304] 0 2024-04-26T21:26:05.091 INFO:tasks.workunit.client.0.smithi084.stdout:7/636: rename d6/d9/d89/la6 to d6/d68/d7f/dbe/ld6 0 2024-04-26T21:26:05.091 INFO:tasks.workunit.client.0.smithi084.stdout:2/723: creat d6/d7/d3d/ff4 x:0 0 0 2024-04-26T21:26:05.091 INFO:tasks.workunit.client.0.smithi084.stdout:6/591: write d3/de/d15/df/f62 [1733755,82793] 0 2024-04-26T21:26:05.094 INFO:tasks.workunit.client.0.smithi084.stdout:9/524: fsync da/de/d1e/f29 0 2024-04-26T21:26:05.094 INFO:tasks.workunit.client.0.smithi084.stdout:3/604: truncate d1/d24/f8d 551588 0 2024-04-26T21:26:05.094 INFO:tasks.workunit.client.1.smithi120.stdout:0/954: rename d0/f66 to d0/d3/d51/d97/d108/f134 0 2024-04-26T21:26:05.094 INFO:tasks.workunit.client.0.smithi084.stdout:4/559: symlink d5/d25/d35/d60/d69/db2/lb3 0 2024-04-26T21:26:05.095 INFO:tasks.workunit.client.0.smithi084.stdout:2/724: readlink d6/d7/lb5 0 2024-04-26T21:26:05.097 INFO:tasks.workunit.client.0.smithi084.stdout:1/616: creat d2/d54/d5e/d66/d2a/d2c/d75/fcb x:0 0 0 2024-04-26T21:26:05.098 INFO:tasks.workunit.client.1.smithi120.stdout:1/743: mkdir d6/d9/dd4/de0/d1d/d5d/dde/df1 0 2024-04-26T21:26:05.102 INFO:tasks.workunit.client.0.smithi084.stdout:0/624: rename de/fbb to de/d2b/d77/d32/d96/fc9 0 2024-04-26T21:26:05.106 INFO:tasks.workunit.client.1.smithi120.stdout:6/829: rename d4/db/f1b to d4/db/d25/d6d/d97/d9d/f113 0 2024-04-26T21:26:05.107 INFO:tasks.workunit.client.0.smithi084.stdout:6/592: mkdir d3/de/d1a/d43/d75/dc4 0 2024-04-26T21:26:05.107 INFO:tasks.workunit.client.0.smithi084.stdout:5/604: dwrite d0/fb7 [0,4194304] 0 2024-04-26T21:26:05.112 INFO:tasks.workunit.client.0.smithi084.stdout:5/605: stat d0/d49/d56 0 2024-04-26T21:26:05.114 INFO:tasks.workunit.client.1.smithi120.stdout:1/744: mkdir d6/d9/dd4/de0/d1d/d5d/df2 0 2024-04-26T21:26:05.117 INFO:tasks.workunit.client.1.smithi120.stdout:3/852: rename dd/de/df/d12/f89 to dd/de/df/dda/d24/d9d/d86/d10d/f117 0 2024-04-26T21:26:05.119 INFO:tasks.workunit.client.0.smithi084.stdout:6/593: chown d3/de/d1a/d2f/f56 1504890394 1 2024-04-26T21:26:05.122 INFO:tasks.workunit.client.1.smithi120.stdout:1/745: mkdir d6/d9/dd4/de0/d2d/d48/d86/dc1/df3 0 2024-04-26T21:26:05.123 INFO:tasks.workunit.client.0.smithi084.stdout:0/625: fsync de/d2b/d77/d32/f6e 0 2024-04-26T21:26:05.124 INFO:tasks.workunit.client.1.smithi120.stdout:3/853: creat dd/d2a/f118 x:0 0 0 2024-04-26T21:26:05.126 INFO:tasks.workunit.client.0.smithi084.stdout:9/525: rename da/de/d16/d25 to da/de/d16/d55/d93/dc3 0 2024-04-26T21:26:05.126 INFO:tasks.workunit.client.1.smithi120.stdout:8/782: getdents d5/d6/d34/d37 0 2024-04-26T21:26:05.127 INFO:tasks.workunit.client.0.smithi084.stdout:7/637: write d6/d9/d12/d19/f79 [955341,92986] 0 2024-04-26T21:26:05.132 INFO:tasks.workunit.client.1.smithi120.stdout:8/783: symlink d5/d6/d34/d42/d4a/lfd 0 2024-04-26T21:26:05.136 INFO:tasks.workunit.client.0.smithi084.stdout:8/597: dwrite d4/d7/d15/d37/f68 [0,4194304] 0 2024-04-26T21:26:05.137 INFO:tasks.workunit.client.0.smithi084.stdout:9/526: chown da/de/d16/d55/c5d 937 1 2024-04-26T21:26:05.138 INFO:tasks.workunit.client.0.smithi084.stdout:1/617: write d2/d54/d5e/d66/d2a/d2c/d45/f4a [539148,101811] 0 2024-04-26T21:26:05.140 INFO:tasks.workunit.client.1.smithi120.stdout:8/784: creat d5/d6/d11/d52/d27/ffe x:0 0 0 2024-04-26T21:26:05.140 INFO:tasks.workunit.client.1.smithi120.stdout:1/746: dwrite d6/d9/f1c [4194304,4194304] 0 2024-04-26T21:26:05.143 INFO:tasks.workunit.client.1.smithi120.stdout:7/808: sync 2024-04-26T21:26:05.145 INFO:tasks.workunit.client.0.smithi084.stdout:0/626: creat de/d2b/d45/d63/da7/fca x:0 0 0 2024-04-26T21:26:05.145 INFO:tasks.workunit.client.0.smithi084.stdout:6/594: dread - d3/de/d1a/d43/f4f zero size 2024-04-26T21:26:05.147 INFO:tasks.workunit.client.0.smithi084.stdout:9/527: fdatasync da/de/d16/d55/d93/dc3/d41/f91 0 2024-04-26T21:26:05.147 INFO:tasks.workunit.client.1.smithi120.stdout:8/785: creat d5/d6/d34/d37/d60/fff x:0 0 0 2024-04-26T21:26:05.149 INFO:tasks.workunit.client.0.smithi084.stdout:4/560: dread d5/d25/d35/d60/f64 [0,4194304] 0 2024-04-26T21:26:05.149 INFO:tasks.workunit.client.1.smithi120.stdout:7/809: unlink d7/d64/da6/d1f/fda 0 2024-04-26T21:26:05.149 INFO:tasks.workunit.client.0.smithi084.stdout:1/618: chown d2/d19/d63/f96 8 1 2024-04-26T21:26:05.150 INFO:tasks.workunit.client.0.smithi084.stdout:3/605: rename d1/d2c/d2f/d31/da8/fc5 to d1/d2c/d2f/d31/d55/d4e/fcf 0 2024-04-26T21:26:05.151 INFO:tasks.workunit.client.1.smithi120.stdout:8/786: readlink d5/d6/d11/d52/l3c 0 2024-04-26T21:26:05.153 INFO:tasks.workunit.client.1.smithi120.stdout:7/810: write d7/d64/da6/d1f/d7d/d8b/fc4 [95200,19938] 0 2024-04-26T21:26:05.155 INFO:tasks.workunit.client.1.smithi120.stdout:8/787: dread - d5/d6/d11/d52/d27/ffe zero size 2024-04-26T21:26:05.156 INFO:tasks.workunit.client.0.smithi084.stdout:6/595: symlink d3/d18/lc5 0 2024-04-26T21:26:05.160 INFO:tasks.workunit.client.0.smithi084.stdout:3/606: mkdir d1/d24/d27/d3a/dd0 0 2024-04-26T21:26:05.162 INFO:tasks.workunit.client.0.smithi084.stdout:9/528: creat da/de/d16/d55/d93/fc4 x:0 0 0 2024-04-26T21:26:05.163 INFO:tasks.workunit.client.0.smithi084.stdout:0/627: write de/d2b/d64/d81/f89 [172425,7073] 0 2024-04-26T21:26:05.163 INFO:tasks.workunit.client.1.smithi120.stdout:7/811: symlink d7/d19/l111 0 2024-04-26T21:26:05.165 INFO:tasks.workunit.client.1.smithi120.stdout:7/812: stat d7/d64/da6/d1f/d28/l3c 0 2024-04-26T21:26:05.166 INFO:tasks.workunit.client.1.smithi120.stdout:8/788: symlink d5/d6/d34/d42/d4a/deb/d88/l100 0 2024-04-26T21:26:05.168 INFO:tasks.workunit.client.0.smithi084.stdout:4/561: rmdir d5/d10/d15/d21/d29 39 2024-04-26T21:26:05.171 INFO:tasks.workunit.client.1.smithi120.stdout:8/789: fdatasync d5/d6/d11/d32/d3b/f73 0 2024-04-26T21:26:05.180 INFO:tasks.workunit.client.0.smithi084.stdout:4/562: mknod d5/d2e/d5f/d32/d46/cb4 0 2024-04-26T21:26:05.185 INFO:tasks.workunit.client.0.smithi084.stdout:9/529: mknod da/de/d16/d55/d93/dc3/d41/d43/cc5 0 2024-04-26T21:26:05.185 INFO:tasks.workunit.client.0.smithi084.stdout:3/607: link d1/d2c/c5d d1/d2c/d2f/d31/d55/d4e/d7c/cd1 0 2024-04-26T21:26:05.187 INFO:tasks.workunit.client.1.smithi120.stdout:3/854: write dd/d2a/f33 [1016481,44836] 0 2024-04-26T21:26:05.188 INFO:tasks.workunit.client.1.smithi120.stdout:3/855: fdatasync dd/d2a/f118 0 2024-04-26T21:26:05.191 INFO:tasks.workunit.client.0.smithi084.stdout:7/638: dread d6/d9/d12/d19/d7a/fa2 [0,4194304] 0 2024-04-26T21:26:05.192 INFO:tasks.workunit.client.0.smithi084.stdout:2/725: dread d6/d7/d3d/d15/d1f/d39/d20/d45/d6d/f95 [0,4194304] 0 2024-04-26T21:26:05.192 INFO:tasks.workunit.client.0.smithi084.stdout:3/608: chown d1/d2c/d2f/d31/d55/da4/lb2 8112127 1 2024-04-26T21:26:05.193 INFO:tasks.workunit.client.1.smithi120.stdout:8/790: dwrite d5/d6/d34/d42/d9d/ff1 [0,4194304] 0 2024-04-26T21:26:05.195 INFO:tasks.workunit.client.0.smithi084.stdout:5/606: dread d0/dc/df/d31/d53/d87/f99 [0,4194304] 0 2024-04-26T21:26:05.198 INFO:tasks.workunit.client.1.smithi120.stdout:9/761: sync 2024-04-26T21:26:05.198 INFO:tasks.workunit.client.1.smithi120.stdout:5/855: sync 2024-04-26T21:26:05.198 INFO:tasks.workunit.client.1.smithi120.stdout:2/835: sync 2024-04-26T21:26:05.198 INFO:tasks.workunit.client.0.smithi084.stdout:6/596: dwrite d3/de/d1a/d43/f4f [0,4194304] 0 2024-04-26T21:26:05.199 INFO:tasks.workunit.client.1.smithi120.stdout:6/830: dwrite d4/db/d10/d22/d6c/f8b [0,4194304] 0 2024-04-26T21:26:05.199 INFO:tasks.workunit.client.0.smithi084.stdout:4/563: creat d5/d2e/fb5 x:0 0 0 2024-04-26T21:26:05.200 INFO:tasks.workunit.client.0.smithi084.stdout:9/530: symlink da/de/d16/d55/d93/dc3/d41/d43/d4a/lc6 0 2024-04-26T21:26:05.203 INFO:tasks.workunit.client.1.smithi120.stdout:4/809: dread d10/d6b/dbf/fc5 [0,4194304] 0 2024-04-26T21:26:05.205 INFO:tasks.workunit.client.1.smithi120.stdout:8/791: write d5/d6/d34/d42/d4a/deb/d88/fc4 [3086048,112038] 0 2024-04-26T21:26:05.205 INFO:tasks.workunit.client.1.smithi120.stdout:1/747: write d6/fc [3015469,89861] 0 2024-04-26T21:26:05.207 INFO:tasks.workunit.client.1.smithi120.stdout:9/762: read - d0/d6/d3d/fee zero size 2024-04-26T21:26:05.207 INFO:tasks.workunit.client.1.smithi120.stdout:7/813: truncate d7/d64/da6/d2f/f63 583268 0 2024-04-26T21:26:05.210 INFO:tasks.workunit.client.0.smithi084.stdout:7/639: rmdir d6/d68 39 2024-04-26T21:26:05.210 INFO:tasks.workunit.client.1.smithi120.stdout:5/856: dread - d2/dc/d1d/d21/d66/d6a/d8c/daa/f125 zero size 2024-04-26T21:26:05.213 INFO:tasks.workunit.client.1.smithi120.stdout:6/831: fdatasync d4/db/d10/dd/f18 0 2024-04-26T21:26:05.216 INFO:tasks.workunit.client.0.smithi084.stdout:2/726: mknod d6/d7/d3d/d15/d1f/d6c/cf5 0 2024-04-26T21:26:05.216 INFO:tasks.workunit.client.0.smithi084.stdout:8/598: dread d4/f13 [4194304,4194304] 0 2024-04-26T21:26:05.216 INFO:tasks.workunit.client.0.smithi084.stdout:5/607: write d0/d17/f20 [1687745,23903] 0 2024-04-26T21:26:05.217 INFO:tasks.workunit.client.1.smithi120.stdout:4/810: unlink d10/ld2 0 2024-04-26T21:26:05.219 INFO:tasks.workunit.client.1.smithi120.stdout:1/748: unlink d6/d9/f8b 0 2024-04-26T21:26:05.220 INFO:tasks.workunit.client.0.smithi084.stdout:0/628: dwrite de/d2b/d77/d32/d96/f9c [0,4194304] 0 2024-04-26T21:26:05.220 INFO:tasks.workunit.client.0.smithi084.stdout:2/727: dread - d6/d7/d3d/d79/dbe/fd0 zero size 2024-04-26T21:26:05.222 INFO:tasks.workunit.client.1.smithi120.stdout:3/856: link dd/d40/lba dd/l119 0 2024-04-26T21:26:05.223 INFO:tasks.workunit.client.0.smithi084.stdout:5/608: write d0/d17/f7e [610367,53061] 0 2024-04-26T21:26:05.223 INFO:tasks.workunit.client.0.smithi084.stdout:8/599: read - d4/d6/db/d1e/d22/d96/f9f zero size 2024-04-26T21:26:05.225 INFO:tasks.workunit.client.1.smithi120.stdout:3/857: chown dd/de/df/d12/f21 574438 1 2024-04-26T21:26:05.226 INFO:tasks.workunit.client.1.smithi120.stdout:0/955: dwrite d0/d3/dc/dd/fbb [0,4194304] 0 2024-04-26T21:26:05.227 INFO:tasks.workunit.client.1.smithi120.stdout:5/857: symlink d2/d1b/d89/d47/de4/l13d 0 2024-04-26T21:26:05.229 INFO:tasks.workunit.client.0.smithi084.stdout:4/564: link d5/d10/f71 d5/d25/d35/d60/d6d/fb6 0 2024-04-26T21:26:05.229 INFO:tasks.workunit.client.1.smithi120.stdout:2/836: rename d4/d1b/d25/c9f to d4/dea/c117 0 2024-04-26T21:26:05.230 INFO:tasks.workunit.client.0.smithi084.stdout:8/600: write d4/d6/db/d1e/d22/d39/f93 [4124416,28092] 0 2024-04-26T21:26:05.230 INFO:tasks.workunit.client.0.smithi084.stdout:9/531: creat da/de/d16/d55/d93/dc3/d41/d43/d80/fc7 x:0 0 0 2024-04-26T21:26:05.231 INFO:tasks.workunit.client.1.smithi120.stdout:4/811: unlink d10/d6b/f79 0 2024-04-26T21:26:05.233 INFO:tasks.workunit.client.0.smithi084.stdout:7/640: dread d6/d68/d7f/fae [0,4194304] 0 2024-04-26T21:26:05.233 INFO:tasks.workunit.client.1.smithi120.stdout:7/814: truncate d7/d64/da6/d1f/d28/d4c/d6b/f9c 1124000 0 2024-04-26T21:26:05.238 INFO:tasks.workunit.client.1.smithi120.stdout:1/749: dread d6/d9/dd4/de0/d2d/f34 [0,4194304] 0 2024-04-26T21:26:05.243 INFO:tasks.workunit.client.0.smithi084.stdout:0/629: creat de/d2b/d77/fcb x:0 0 0 2024-04-26T21:26:05.245 INFO:tasks.workunit.client.0.smithi084.stdout:2/728: creat d6/d7/d3d/d15/d1f/d39/d20/ff6 x:0 0 0 2024-04-26T21:26:05.247 INFO:tasks.workunit.client.0.smithi084.stdout:4/565: creat d5/d10/d15/d21/fb7 x:0 0 0 2024-04-26T21:26:05.247 INFO:tasks.workunit.client.0.smithi084.stdout:5/609: link d0/dc/df/d31/d72/d84/f89 d0/dc/df/d75/fbe 0 2024-04-26T21:26:05.248 INFO:tasks.workunit.client.1.smithi120.stdout:5/858: dwrite d2/d30/f2f [0,4194304] 0 2024-04-26T21:26:05.248 INFO:tasks.workunit.client.1.smithi120.stdout:2/837: creat d4/d1b/d2e/d50/d14/dc2/f118 x:0 0 0 2024-04-26T21:26:05.248 INFO:tasks.workunit.client.1.smithi120.stdout:4/812: chown d10/f4f 108925 1 2024-04-26T21:26:05.248 INFO:tasks.workunit.client.1.smithi120.stdout:6/832: link d4/d99/fc1 d4/db/d10/d1a/d2b/d57/d67/dbc/f114 0 2024-04-26T21:26:05.250 INFO:tasks.workunit.client.0.smithi084.stdout:7/641: fsync d6/d9/d12/d8b/f8d 0 2024-04-26T21:26:05.252 INFO:tasks.workunit.client.1.smithi120.stdout:1/750: mknod d6/dcc/cf4 0 2024-04-26T21:26:05.254 INFO:tasks.workunit.client.1.smithi120.stdout:3/858: mkdir dd/de/df/dda/d24/d9d/d11a 0 2024-04-26T21:26:05.254 INFO:tasks.workunit.client.1.smithi120.stdout:4/813: stat d10/d28/dd9/ddd/dee/dd0/dd4/d86/lcb 0 2024-04-26T21:26:05.256 INFO:tasks.workunit.client.0.smithi084.stdout:8/601: rename d4/d6/db/d1e/d22/f81 to d4/d7/d15/d9d/fad 0 2024-04-26T21:26:05.259 INFO:tasks.workunit.client.0.smithi084.stdout:0/630: creat de/d2b/d77/d32/d96/da0/fcc x:0 0 0 2024-04-26T21:26:05.261 INFO:tasks.workunit.client.1.smithi120.stdout:9/763: link d0/d6/d4d/d65/dec/c33 d0/d6/d4d/d65/dec/d77/dc5/c100 0 2024-04-26T21:26:05.261 INFO:tasks.workunit.client.1.smithi120.stdout:2/838: dread - d4/d1b/d2e/f92 zero size 2024-04-26T21:26:05.263 INFO:tasks.workunit.client.0.smithi084.stdout:6/597: truncate d3/de/d1a/d43/f48 1289940 0 2024-04-26T21:26:05.265 INFO:tasks.workunit.client.0.smithi084.stdout:5/610: mkdir d0/dc/df/d31/d63/dbf 0 2024-04-26T21:26:05.265 INFO:tasks.workunit.client.0.smithi084.stdout:0/631: readlink de/d2b/d77/d32/d96/da0/la3 0 2024-04-26T21:26:05.265 INFO:tasks.workunit.client.0.smithi084.stdout:7/642: mknod d6/d9/d12/d19/d60/cd7 0 2024-04-26T21:26:05.269 INFO:tasks.workunit.client.1.smithi120.stdout:8/792: truncate d5/fb1 2198713 0 2024-04-26T21:26:05.270 INFO:tasks.workunit.client.1.smithi120.stdout:4/814: fsync d10/d28/dd9/ddd/dee/dd0/dd4/f80 0 2024-04-26T21:26:05.274 INFO:tasks.workunit.client.1.smithi120.stdout:4/815: stat d10/d6b/d71/d9d/fea 0 2024-04-26T21:26:05.275 INFO:tasks.workunit.client.1.smithi120.stdout:6/833: mknod d4/c115 0 2024-04-26T21:26:05.277 INFO:tasks.workunit.client.1.smithi120.stdout:9/764: creat d0/dd/d3a/d5c/f101 x:0 0 0 2024-04-26T21:26:05.281 INFO:tasks.workunit.client.0.smithi084.stdout:6/598: creat d3/d18/fc6 x:0 0 0 2024-04-26T21:26:05.281 INFO:tasks.workunit.client.0.smithi084.stdout:3/609: dread d1/d24/d27/d3a/f57 [0,4194304] 0 2024-04-26T21:26:05.283 INFO:tasks.workunit.client.0.smithi084.stdout:0/632: unlink de/d2b/d77/d32/d96/f9c 0 2024-04-26T21:26:05.284 INFO:tasks.workunit.client.1.smithi120.stdout:0/956: dread d0/d3/d51/f132 [0,4194304] 0 2024-04-26T21:26:05.284 INFO:tasks.workunit.client.0.smithi084.stdout:4/566: dwrite d5/d25/d35/d60/d6d/fb0 [0,4194304] 0 2024-04-26T21:26:05.285 INFO:tasks.workunit.client.1.smithi120.stdout:5/859: creat d2/d1b/f13e x:0 0 0 2024-04-26T21:26:05.286 INFO:tasks.workunit.client.0.smithi084.stdout:8/602: link d4/c7e d4/d6/db/d1e/cae 0 2024-04-26T21:26:05.287 INFO:tasks.workunit.client.0.smithi084.stdout:1/619: sync 2024-04-26T21:26:05.288 INFO:tasks.workunit.client.1.smithi120.stdout:7/815: write d7/d64/da6/d2f/f63 [164981,31196] 0 2024-04-26T21:26:05.288 INFO:tasks.workunit.client.1.smithi120.stdout:1/751: dwrite d6/d9/dd4/de0/d1b/d3b/d6d/f8d [0,4194304] 0 2024-04-26T21:26:05.289 INFO:tasks.workunit.client.1.smithi120.stdout:5/860: truncate d2/d1b/f13e 817736 0 2024-04-26T21:26:05.294 INFO:tasks.workunit.client.1.smithi120.stdout:5/861: truncate d2/dc/d1d/d21/db2/f130 509803 0 2024-04-26T21:26:05.294 INFO:tasks.workunit.client.0.smithi084.stdout:9/532: dwrite da/f34 [0,4194304] 0 2024-04-26T21:26:05.298 INFO:tasks.workunit.client.0.smithi084.stdout:8/603: write d4/d7/d15/f30 [4765339,75927] 0 2024-04-26T21:26:05.298 INFO:tasks.workunit.client.1.smithi120.stdout:8/793: mkdir d5/d6/d11/d52/d27/d4f/d101 0 2024-04-26T21:26:05.298 INFO:tasks.workunit.client.0.smithi084.stdout:1/620: stat d2/d9/d15/d28/d69 0 2024-04-26T21:26:05.300 INFO:tasks.workunit.client.1.smithi120.stdout:2/839: mknod d4/d1b/d4f/d95/de9/d112/c119 0 2024-04-26T21:26:05.300 INFO:tasks.workunit.client.1.smithi120.stdout:4/816: truncate d10/d12/fa7 1915445 0 2024-04-26T21:26:05.300 INFO:tasks.workunit.client.1.smithi120.stdout:9/765: fdatasync d0/d6/f76 0 2024-04-26T21:26:05.302 INFO:tasks.workunit.client.0.smithi084.stdout:3/610: symlink d1/d24/d27/d3a/d81/ld2 0 2024-04-26T21:26:05.307 INFO:tasks.workunit.client.0.smithi084.stdout:3/611: chown d1/d2c/d2f/fab 2553 1 2024-04-26T21:26:05.308 INFO:tasks.workunit.client.1.smithi120.stdout:7/816: creat d7/d64/da6/d1a/df4/f112 x:0 0 0 2024-04-26T21:26:05.312 INFO:tasks.workunit.client.1.smithi120.stdout:8/794: mkdir d5/d6/d34/d42/d102 0 2024-04-26T21:26:05.314 INFO:tasks.workunit.client.0.smithi084.stdout:0/633: mknod de/d2b/d45/d63/ccd 0 2024-04-26T21:26:05.314 INFO:tasks.workunit.client.0.smithi084.stdout:5/611: rename d0/dc/df/d31/l36 to d0/dc/df/d31/lc0 0 2024-04-26T21:26:05.316 INFO:tasks.workunit.client.1.smithi120.stdout:3/859: dwrite dd/de/df/db6/dc5/f114 [0,4194304] 0 2024-04-26T21:26:05.316 INFO:tasks.workunit.client.0.smithi084.stdout:6/599: mkdir d3/de/d15/d23/d90/da2/dc7 0 2024-04-26T21:26:05.320 INFO:tasks.workunit.client.0.smithi084.stdout:1/621: mkdir d2/d19/dcc 0 2024-04-26T21:26:05.320 INFO:tasks.workunit.client.0.smithi084.stdout:7/643: rmdir d6/d9/d12/d8b/d72/da0/d80/daa 0 2024-04-26T21:26:05.321 INFO:tasks.workunit.client.1.smithi120.stdout:2/840: creat d4/d1b/d56/f11a x:0 0 0 2024-04-26T21:26:05.322 INFO:tasks.workunit.client.0.smithi084.stdout:3/612: rename d1/d24/d27/d3a/f57 to d1/d2c/d2f/d94/fd3 0 2024-04-26T21:26:05.323 INFO:tasks.workunit.client.0.smithi084.stdout:0/634: rmdir de/d2b/d77/d32/d96/da0 39 2024-04-26T21:26:05.327 INFO:tasks.workunit.client.1.smithi120.stdout:4/817: rmdir d10/d28/dd9/ddd/dee/dd0/df3 39 2024-04-26T21:26:05.328 INFO:tasks.workunit.client.0.smithi084.stdout:2/729: dread d6/d7/d3d/d15/f7f [4194304,4194304] 0 2024-04-26T21:26:05.330 INFO:tasks.workunit.client.1.smithi120.stdout:8/795: unlink d5/d6/d75/lcd 0 2024-04-26T21:26:05.331 INFO:tasks.workunit.client.1.smithi120.stdout:6/834: link d4/db/d10/d22/d6c/l109 d4/db/d10/dd/d28/d9e/daf/dd3/d107/l116 0 2024-04-26T21:26:05.335 INFO:tasks.workunit.client.1.smithi120.stdout:0/957: dwrite d0/dd1/dd2/de9/ffe [0,4194304] 0 2024-04-26T21:26:05.338 INFO:tasks.workunit.client.0.smithi084.stdout:5/612: unlink d0/dc/df/d31/d45/c8c 0 2024-04-26T21:26:05.338 INFO:tasks.workunit.client.0.smithi084.stdout:6/600: rename d3/d18/d37/f49 to d3/de/d1a/d43/d75/d9c/fc8 0 2024-04-26T21:26:05.338 INFO:tasks.workunit.client.1.smithi120.stdout:2/841: creat d4/d1b/d2e/d5f/df6/f11b x:0 0 0 2024-04-26T21:26:05.339 INFO:tasks.workunit.client.1.smithi120.stdout:8/796: write d5/d6/d34/d37/d60/f5c [683909,73677] 0 2024-04-26T21:26:05.340 INFO:tasks.workunit.client.0.smithi084.stdout:9/533: link da/de/d16/d55/d93/dc3/d41/d43/d4a/lc6 da/de/d16/d55/d93/dc3/d41/d43/d4a/lc8 0 2024-04-26T21:26:05.343 INFO:tasks.workunit.client.0.smithi084.stdout:6/601: write d3/fa1 [159904,130711] 0 2024-04-26T21:26:05.343 INFO:tasks.workunit.client.0.smithi084.stdout:1/622: fsync d2/d19/d63/f71 0 2024-04-26T21:26:05.344 INFO:tasks.workunit.client.1.smithi120.stdout:3/860: creat dd/de/d83/db2/ded/f11b x:0 0 0 2024-04-26T21:26:05.345 INFO:tasks.workunit.client.1.smithi120.stdout:1/752: dwrite d6/d9/dd4/de0/d2d/d98/d35/fc5 [0,4194304] 0 2024-04-26T21:26:05.348 INFO:tasks.workunit.client.0.smithi084.stdout:5/613: creat d0/dc/df/d6d/fc1 x:0 0 0 2024-04-26T21:26:05.349 INFO:tasks.workunit.client.0.smithi084.stdout:6/602: chown d3/de/d9e/faa 7971 1 2024-04-26T21:26:05.353 INFO:tasks.workunit.client.0.smithi084.stdout:9/534: mkdir da/de/d1e/dc9 0 2024-04-26T21:26:05.356 INFO:tasks.workunit.client.0.smithi084.stdout:7/644: dwrite d6/d9/d12/d19/d7a/d84/fac [0,4194304] 0 2024-04-26T21:26:05.358 INFO:tasks.workunit.client.1.smithi120.stdout:2/842: symlink d4/d1b/d56/l11c 0 2024-04-26T21:26:05.360 INFO:tasks.workunit.client.1.smithi120.stdout:8/797: rmdir d5/d6/d34/d42/d9d/d7a 39 2024-04-26T21:26:05.362 INFO:tasks.workunit.client.1.smithi120.stdout:5/862: truncate d2/d82/d96/fe8 246293 0 2024-04-26T21:26:05.363 INFO:tasks.workunit.client.1.smithi120.stdout:9/766: getdents d0/d66/d93 0 2024-04-26T21:26:05.366 INFO:tasks.workunit.client.0.smithi084.stdout:8/604: dread d4/d7/d15/d37/d3b/f89 [0,4194304] 0 2024-04-26T21:26:05.366 INFO:tasks.workunit.client.1.smithi120.stdout:3/861: creat dd/de/df/dda/d24/f11c x:0 0 0 2024-04-26T21:26:05.367 INFO:tasks.workunit.client.0.smithi084.stdout:3/613: link d1/d2c/d2f/d31/d52/f8b d1/d2c/d2f/d31/d55/d4e/d98/fd4 0 2024-04-26T21:26:05.368 INFO:tasks.workunit.client.0.smithi084.stdout:2/730: getdents d6/d7/db6 0 2024-04-26T21:26:05.368 INFO:tasks.workunit.client.1.smithi120.stdout:1/753: creat d6/d9/dd4/de0/d1d/ff5 x:0 0 0 2024-04-26T21:26:05.370 INFO:tasks.workunit.client.0.smithi084.stdout:7/645: fsync d6/d9/d12/d19/d7a/d84/f55 0 2024-04-26T21:26:05.374 INFO:tasks.workunit.client.1.smithi120.stdout:4/818: mknod d10/d65/c118 0 2024-04-26T21:26:05.378 INFO:tasks.workunit.client.1.smithi120.stdout:8/798: dread d5/d6/d34/d37/d60/f5c [0,4194304] 0 2024-04-26T21:26:05.380 INFO:tasks.workunit.client.1.smithi120.stdout:3/862: rename dd/de/df/dda/de6/lf2 to dd/de/df/d12/d48/d9b/dcb/d100/l11d 0 2024-04-26T21:26:05.382 INFO:tasks.workunit.client.0.smithi084.stdout:1/623: creat d2/d9/fcd x:0 0 0 2024-04-26T21:26:05.382 INFO:tasks.workunit.client.0.smithi084.stdout:5/614: link d0/f2c d0/dc/fc2 0 2024-04-26T21:26:05.383 INFO:tasks.workunit.client.1.smithi120.stdout:5/863: unlink d2/d10e/l60 0 2024-04-26T21:26:05.385 INFO:tasks.workunit.client.0.smithi084.stdout:8/605: rmdir d4/d7/d15 39 2024-04-26T21:26:05.385 INFO:tasks.workunit.client.1.smithi120.stdout:7/817: dwrite d7/d19/d60/de6/f104 [0,4194304] 0 2024-04-26T21:26:05.388 INFO:tasks.workunit.client.0.smithi084.stdout:2/731: creat d6/d7/d3d/d15/d1f/d6c/ff7 x:0 0 0 2024-04-26T21:26:05.389 INFO:tasks.workunit.client.0.smithi084.stdout:6/603: dwrite d3/de/d15/d23/f2e [0,4194304] 0 2024-04-26T21:26:05.389 INFO:tasks.workunit.client.1.smithi120.stdout:9/767: mkdir d0/d66/d93/db7/d102 0 2024-04-26T21:26:05.390 INFO:tasks.workunit.client.0.smithi084.stdout:8/606: dread - d4/d3a/d8c/f95 zero size 2024-04-26T21:26:05.394 INFO:tasks.workunit.client.1.smithi120.stdout:2/843: rmdir d4/d1b/d5c/da6/de7 0 2024-04-26T21:26:05.397 INFO:tasks.workunit.client.1.smithi120.stdout:0/958: truncate d0/dd1/dd2/de9/ffe 3483475 0 2024-04-26T21:26:05.398 INFO:tasks.workunit.client.0.smithi084.stdout:0/635: dread de/f83 [0,4194304] 0 2024-04-26T21:26:05.398 INFO:tasks.workunit.client.0.smithi084.stdout:5/615: symlink d0/dc/df/d75/lc3 0 2024-04-26T21:26:05.398 INFO:tasks.workunit.client.1.smithi120.stdout:3/863: creat dd/de/df/dda/d37/f11e x:0 0 0 2024-04-26T21:26:05.398 INFO:tasks.workunit.client.1.smithi120.stdout:6/835: dwrite d4/db/d10/dd/d4e/d60/f7c [0,4194304] 0 2024-04-26T21:26:05.400 INFO:tasks.workunit.client.1.smithi120.stdout:7/818: symlink d7/d64/da6/d1a/d50/l113 0 2024-04-26T21:26:05.400 INFO:tasks.workunit.client.0.smithi084.stdout:8/607: write d4/d7/f16 [8823002,872] 0 2024-04-26T21:26:05.400 INFO:tasks.workunit.client.0.smithi084.stdout:3/614: creat d1/d2c/d2f/d31/d55/d4e/d7c/fd5 x:0 0 0 2024-04-26T21:26:05.401 INFO:tasks.workunit.client.1.smithi120.stdout:9/768: fsync d0/dd/d3a/d5c/d98/faa 0 2024-04-26T21:26:05.402 INFO:tasks.workunit.client.1.smithi120.stdout:3/864: chown dd/d40/dff/d110 38747799 1 2024-04-26T21:26:05.402 INFO:tasks.workunit.client.1.smithi120.stdout:4/819: write d10/d6b/dbf/fcf [395075,115638] 0 2024-04-26T21:26:05.403 INFO:tasks.workunit.client.0.smithi084.stdout:9/535: dwrite da/de/d16/d55/d93/dc3/d41/d8d/fad [4194304,4194304] 0 2024-04-26T21:26:05.405 INFO:tasks.workunit.client.0.smithi084.stdout:0/636: write de/d2b/d77/fcb [802824,100929] 0 2024-04-26T21:26:05.406 INFO:tasks.workunit.client.0.smithi084.stdout:1/624: mknod d2/d9/d15/d9f/cce 0 2024-04-26T21:26:05.408 INFO:tasks.workunit.client.1.smithi120.stdout:6/836: fdatasync d4/db/d10/dd/f18 0 2024-04-26T21:26:05.408 INFO:tasks.workunit.client.1.smithi120.stdout:2/844: stat d4/d1b/d2e/d50/d14/d15/c17 0 2024-04-26T21:26:05.409 INFO:tasks.workunit.client.1.smithi120.stdout:7/819: mknod d7/d64/c114 0 2024-04-26T21:26:05.410 INFO:tasks.workunit.client.0.smithi084.stdout:5/616: rmdir d0/dc/d48 39 2024-04-26T21:26:05.411 INFO:tasks.workunit.client.1.smithi120.stdout:3/865: mknod dd/de/df/d12/d48/d9b/dcb/d102/c11f 0 2024-04-26T21:26:05.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:05 smithi084 ceph-mon[25539]: pgmap v47: 65 pgs: 65 active+clean; 2.7 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 90 MiB/s rd, 209 MiB/s wr, 448 op/s 2024-04-26T21:26:05.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:05 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:26:05.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:05 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:26:05.415 INFO:tasks.workunit.client.0.smithi084.stdout:1/625: chown d2/d54/d5e/d8d/cad 6791 1 2024-04-26T21:26:05.416 INFO:tasks.workunit.client.0.smithi084.stdout:8/608: creat d4/d7/d15/d9d/faf x:0 0 0 2024-04-26T21:26:05.416 INFO:tasks.workunit.client.1.smithi120.stdout:6/837: rmdir d4/d3d 39 2024-04-26T21:26:05.417 INFO:tasks.workunit.client.1.smithi120.stdout:4/820: creat d10/d12/da1/d104/f119 x:0 0 0 2024-04-26T21:26:05.418 INFO:tasks.workunit.client.0.smithi084.stdout:9/536: mkdir da/de/d16/d55/d93/dc3/d41/d8d/dca 0 2024-04-26T21:26:05.426 INFO:tasks.workunit.client.0.smithi084.stdout:2/732: dwrite d6/d1b/f98 [0,4194304] 0 2024-04-26T21:26:05.427 INFO:tasks.workunit.client.1.smithi120.stdout:9/769: read d0/d6/d3d/f7b [66673,51678] 0 2024-04-26T21:26:05.430 INFO:tasks.workunit.client.0.smithi084.stdout:4/567: sync 2024-04-26T21:26:05.430 INFO:tasks.workunit.client.0.smithi084.stdout:0/637: rmdir de/d2b/d77/d32 39 2024-04-26T21:26:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:05 smithi120 ceph-mon[32741]: pgmap v47: 65 pgs: 65 active+clean; 2.7 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 90 MiB/s rd, 209 MiB/s wr, 448 op/s 2024-04-26T21:26:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:05 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:26:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:05 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:26:05.433 INFO:tasks.workunit.client.1.smithi120.stdout:8/799: write d5/d6/d34/d42/f5b [1011171,77703] 0 2024-04-26T21:26:05.436 INFO:tasks.workunit.client.0.smithi084.stdout:8/609: chown d4/d6/db/c34 8094430 1 2024-04-26T21:26:05.436 INFO:tasks.workunit.client.1.smithi120.stdout:5/864: write d2/f3f [30346,48322] 0 2024-04-26T21:26:05.441 INFO:tasks.workunit.client.0.smithi084.stdout:8/610: truncate d4/f84 947155 0 2024-04-26T21:26:05.442 INFO:tasks.workunit.client.0.smithi084.stdout:5/617: symlink d0/dc/d48/lc4 0 2024-04-26T21:26:05.445 INFO:tasks.workunit.client.1.smithi120.stdout:8/800: read d5/d6/d34/d42/d4a/deb/f22 [305934,107817] 0 2024-04-26T21:26:05.446 INFO:tasks.workunit.client.1.smithi120.stdout:6/838: dread d4/db/d10/d1a/d2b/f4c [0,4194304] 0 2024-04-26T21:26:05.446 INFO:tasks.workunit.client.0.smithi084.stdout:5/618: read d0/f4b [541988,71309] 0 2024-04-26T21:26:05.448 INFO:tasks.workunit.client.1.smithi120.stdout:8/801: stat d5/d6/d34/d42/d4a/deb/d88/fcf 0 2024-04-26T21:26:05.449 INFO:tasks.workunit.client.0.smithi084.stdout:8/611: write d4/d3a/d8c/fa3 [49885,69451] 0 2024-04-26T21:26:05.450 INFO:tasks.workunit.client.0.smithi084.stdout:9/537: dread da/de/d16/d55/d93/dc3/d41/d8d/fad [0,4194304] 0 2024-04-26T21:26:05.450 INFO:tasks.workunit.client.0.smithi084.stdout:5/619: write d0/d17/f7e [43027,44352] 0 2024-04-26T21:26:05.455 INFO:tasks.workunit.client.1.smithi120.stdout:6/839: mkdir d4/db/d10/dd/d28/d9e/daf/dff/d117 0 2024-04-26T21:26:05.459 INFO:tasks.workunit.client.0.smithi084.stdout:3/615: link d1/d2c/d2f/f6d d1/d2c/d2f/d31/d55/d4e/d98/fd6 0 2024-04-26T21:26:05.460 INFO:tasks.workunit.client.0.smithi084.stdout:7/646: dwrite d6/d68/d7f/fae [0,4194304] 0 2024-04-26T21:26:05.461 INFO:tasks.workunit.client.0.smithi084.stdout:8/612: write d4/d6/db/d1e/d22/d39/f93 [1836737,92955] 0 2024-04-26T21:26:05.465 INFO:tasks.workunit.client.0.smithi084.stdout:6/604: dread d3/de/d1a/d2f/f56 [0,4194304] 0 2024-04-26T21:26:05.468 INFO:tasks.workunit.client.0.smithi084.stdout:4/568: rename d5/d10/d15/d21/d29 to d5/d7/d65/d7f/db8 0 2024-04-26T21:26:05.470 INFO:tasks.workunit.client.0.smithi084.stdout:6/605: write d3/de/d5d/f89 [213945,34808] 0 2024-04-26T21:26:05.470 INFO:tasks.workunit.client.0.smithi084.stdout:8/613: stat d4/d6/db/d9b 0 2024-04-26T21:26:05.474 INFO:tasks.workunit.client.0.smithi084.stdout:1/626: dwrite d2/d19/d63/f71 [0,4194304] 0 2024-04-26T21:26:05.476 INFO:tasks.workunit.client.1.smithi120.stdout:4/821: write d10/d28/f56 [1417525,60385] 0 2024-04-26T21:26:05.478 INFO:tasks.workunit.client.0.smithi084.stdout:3/616: creat d1/d2c/d2f/d31/d3b/fd7 x:0 0 0 2024-04-26T21:26:05.478 INFO:tasks.workunit.client.0.smithi084.stdout:0/638: rename de/d2b/d77/d32/f79 to de/d78/d9e/fce 0 2024-04-26T21:26:05.478 INFO:tasks.workunit.client.0.smithi084.stdout:9/538: rename da to da/de/d16/d55/d93/dc3/d41/d43/d4a/d82/dcb 22 2024-04-26T21:26:05.480 INFO:tasks.workunit.client.1.smithi120.stdout:7/820: dread d7/d64/da6/d1f/d28/f2c [0,4194304] 0 2024-04-26T21:26:05.481 INFO:tasks.workunit.client.0.smithi084.stdout:6/606: unlink d3/de/d1a/d43/d75/l87 0 2024-04-26T21:26:05.484 INFO:tasks.workunit.client.1.smithi120.stdout:2/845: dwrite d4/d1b/d56/f4a [0,4194304] 0 2024-04-26T21:26:05.484 INFO:tasks.workunit.client.1.smithi120.stdout:5/865: write d2/dc/d1d/d21/db2/dde/fec [587942,109870] 0 2024-04-26T21:26:05.485 INFO:tasks.workunit.client.0.smithi084.stdout:0/639: write de/d20/d4e/f6a [3831581,110379] 0 2024-04-26T21:26:05.485 INFO:tasks.workunit.client.1.smithi120.stdout:4/822: mknod d10/da6/c11a 0 2024-04-26T21:26:05.488 INFO:tasks.workunit.client.1.smithi120.stdout:0/959: dwrite d0/f72 [0,4194304] 0 2024-04-26T21:26:05.490 INFO:tasks.workunit.client.0.smithi084.stdout:2/733: dwrite d6/d3e/d67/f8f [0,4194304] 0 2024-04-26T21:26:05.490 INFO:tasks.workunit.client.0.smithi084.stdout:4/569: truncate d5/d7/d65/d7f/db8/f3c 4651432 0 2024-04-26T21:26:05.491 INFO:tasks.workunit.client.0.smithi084.stdout:0/640: truncate de/d78/fc7 983565 0 2024-04-26T21:26:05.492 INFO:tasks.workunit.client.0.smithi084.stdout:5/620: link d0/dc/l5a d0/dc/df/d31/lc5 0 2024-04-26T21:26:05.493 INFO:tasks.workunit.client.0.smithi084.stdout:0/641: readlink de/d71/la8 0 2024-04-26T21:26:05.494 INFO:tasks.workunit.client.0.smithi084.stdout:0/642: stat de/d2b/d45/c82 0 2024-04-26T21:26:05.495 INFO:tasks.workunit.client.1.smithi120.stdout:7/821: truncate d7/d19/fbc 1088553 0 2024-04-26T21:26:05.496 INFO:tasks.workunit.client.1.smithi120.stdout:4/823: readlink d10/d28/dd9/ddd/dee/lad 0 2024-04-26T21:26:05.499 INFO:tasks.workunit.client.0.smithi084.stdout:1/627: creat d2/d54/d5e/fcf x:0 0 0 2024-04-26T21:26:05.499 INFO:tasks.workunit.client.0.smithi084.stdout:0/643: chown de/d2b/d45/f59 0 1 2024-04-26T21:26:05.499 INFO:tasks.workunit.client.0.smithi084.stdout:1/628: chown d2/d9/d15/d28/f62 848906792 1 2024-04-26T21:26:05.499 INFO:tasks.workunit.client.1.smithi120.stdout:2/846: creat d4/d1b/d25/d2c/d3e/f11d x:0 0 0 2024-04-26T21:26:05.501 INFO:tasks.workunit.client.0.smithi084.stdout:1/629: chown d2/d54/d5e/d66/f18 0 1 2024-04-26T21:26:05.503 INFO:tasks.workunit.client.0.smithi084.stdout:6/607: truncate d3/de/d15/d40/f60 284579 0 2024-04-26T21:26:05.503 INFO:tasks.workunit.client.1.smithi120.stdout:0/960: mkdir d0/d3/d51/d97/d135 0 2024-04-26T21:26:05.503 INFO:tasks.workunit.client.1.smithi120.stdout:9/770: dwrite d0/d6/d4d/d65/dec/d77/fb1 [4194304,4194304] 0 2024-04-26T21:26:05.503 INFO:tasks.workunit.client.1.smithi120.stdout:8/802: dread d5/d6/f1e [0,4194304] 0 2024-04-26T21:26:05.503 INFO:tasks.workunit.client.1.smithi120.stdout:5/866: mkdir d2/d30/d93/d107/d36/d44/d6c/d13f 0 2024-04-26T21:26:05.504 INFO:tasks.workunit.client.0.smithi084.stdout:5/621: creat d0/dc/df/d31/d63/fc6 x:0 0 0 2024-04-26T21:26:05.505 INFO:tasks.workunit.client.1.smithi120.stdout:9/771: stat d0/d6/d4d/dce 0 2024-04-26T21:26:05.508 INFO:tasks.workunit.client.0.smithi084.stdout:6/608: fsync d3/d18/fc6 0 2024-04-26T21:26:05.508 INFO:tasks.workunit.client.0.smithi084.stdout:8/614: getdents d4/d6/db 0 2024-04-26T21:26:05.509 INFO:tasks.workunit.client.1.smithi120.stdout:6/840: write d4/db/f23 [5604259,117740] 0 2024-04-26T21:26:05.511 INFO:tasks.workunit.client.1.smithi120.stdout:4/824: creat d10/d6b/f11b x:0 0 0 2024-04-26T21:26:05.512 INFO:tasks.workunit.client.0.smithi084.stdout:1/630: mknod d2/d54/d5e/d66/d3a/d77/cd0 0 2024-04-26T21:26:05.513 INFO:tasks.workunit.client.1.smithi120.stdout:2/847: truncate d4/d1b/d25/d2c/d3e/f11d 956957 0 2024-04-26T21:26:05.515 INFO:tasks.workunit.client.1.smithi120.stdout:6/841: write d4/db/d10/dd/f111 [896299,26694] 0 2024-04-26T21:26:05.517 INFO:tasks.workunit.client.1.smithi120.stdout:7/822: rename d7/d64/da6/d1f/d28/d4c/d6b to d7/d10/d97/d115 0 2024-04-26T21:26:05.518 INFO:tasks.workunit.client.0.smithi084.stdout:5/622: creat d0/d17/fc7 x:0 0 0 2024-04-26T21:26:05.518 INFO:tasks.workunit.client.0.smithi084.stdout:2/734: truncate d6/d7/d3d/d15/d1f/d39/d43/fae 328759 0 2024-04-26T21:26:05.520 INFO:tasks.workunit.client.1.smithi120.stdout:6/842: readlink d4/db/d10/d22/d56/d94/lc7 0 2024-04-26T21:26:05.521 INFO:tasks.workunit.client.0.smithi084.stdout:7/647: rename d6/d9/d12/d19/d8f to d6/d1c/dd8 0 2024-04-26T21:26:05.523 INFO:tasks.workunit.client.0.smithi084.stdout:8/615: unlink d4/d7/d15/d3c/c61 0 2024-04-26T21:26:05.525 INFO:tasks.workunit.client.0.smithi084.stdout:9/539: getdents da/de/d16/d55/d93 0 2024-04-26T21:26:05.526 INFO:tasks.workunit.client.1.smithi120.stdout:0/961: dwrite d0/d3/dc/dd/d1b/d24/d73/db7/f103 [0,4194304] 0 2024-04-26T21:26:05.526 INFO:tasks.workunit.client.0.smithi084.stdout:0/644: dwrite de/d2b/d77/d32/f44 [4194304,4194304] 0 2024-04-26T21:26:05.526 INFO:tasks.workunit.client.1.smithi120.stdout:5/867: symlink d2/dc/d1d/d21/d77/d9c/l140 0 2024-04-26T21:26:05.530 INFO:tasks.workunit.client.0.smithi084.stdout:8/616: stat d4/d6 0 2024-04-26T21:26:05.530 INFO:tasks.workunit.client.0.smithi084.stdout:5/623: symlink d0/da2/lc8 0 2024-04-26T21:26:05.534 INFO:tasks.workunit.client.1.smithi120.stdout:8/803: truncate d5/d6/d34/d37/d60/fb2 448296 0 2024-04-26T21:26:05.534 INFO:tasks.workunit.client.1.smithi120.stdout:4/825: creat d10/d28/d73/da2/f11c x:0 0 0 2024-04-26T21:26:05.536 INFO:tasks.workunit.client.0.smithi084.stdout:0/645: mkdir de/d2b/d45/d94/dcf 0 2024-04-26T21:26:05.536 INFO:tasks.workunit.client.0.smithi084.stdout:5/624: dread - d0/dc/df/d31/d63/d6e/fa6 zero size 2024-04-26T21:26:05.538 INFO:tasks.workunit.client.0.smithi084.stdout:0/646: chown de/d2b/d45/d94 1 1 2024-04-26T21:26:05.540 INFO:tasks.workunit.client.0.smithi084.stdout:9/540: creat da/db3/fcc x:0 0 0 2024-04-26T21:26:05.540 INFO:tasks.workunit.client.0.smithi084.stdout:0/647: fdatasync de/d78/fc7 0 2024-04-26T21:26:05.543 INFO:tasks.workunit.client.0.smithi084.stdout:0/648: write de/d2b/d77/d68/fc3 [902522,2843] 0 2024-04-26T21:26:05.543 INFO:tasks.workunit.client.0.smithi084.stdout:3/617: dread d1/f1d [0,4194304] 0 2024-04-26T21:26:05.543 INFO:tasks.workunit.client.0.smithi084.stdout:9/541: read da/de/d16/f57 [32894,113257] 0 2024-04-26T21:26:05.544 INFO:tasks.workunit.client.0.smithi084.stdout:1/631: rename d2/d54/d5e/d66/d2a/d72/cbf to d2/d54/d5e/d66/d3a/d48/cd1 0 2024-04-26T21:26:05.544 INFO:tasks.workunit.client.0.smithi084.stdout:0/649: fsync f0 0 2024-04-26T21:26:05.546 INFO:tasks.workunit.client.0.smithi084.stdout:9/542: fsync da/f23 0 2024-04-26T21:26:05.548 INFO:tasks.workunit.client.1.smithi120.stdout:5/868: mknod d2/dc/d1d/d21/d66/d85/d128/c141 0 2024-04-26T21:26:05.549 INFO:tasks.workunit.client.1.smithi120.stdout:4/826: rmdir d10/d28/dd9/ddd 39 2024-04-26T21:26:05.550 INFO:tasks.workunit.client.0.smithi084.stdout:2/735: unlink d6/d7/d3d/d15/d1f/d39/d20/d45/d6d/lb4 0 2024-04-26T21:26:05.550 INFO:tasks.workunit.client.0.smithi084.stdout:1/632: write d2/d54/d5e/d66/fc4 [958943,3627] 0 2024-04-26T21:26:05.551 INFO:tasks.workunit.client.0.smithi084.stdout:4/570: truncate d5/d25/d35/f8f 3153565 0 2024-04-26T21:26:05.553 INFO:tasks.workunit.client.0.smithi084.stdout:2/736: chown d6/d7/d3d/d15/d1f/d39/d43 101 1 2024-04-26T21:26:05.554 INFO:tasks.workunit.client.1.smithi120.stdout:6/843: symlink d4/d3d/l118 0 2024-04-26T21:26:05.554 INFO:tasks.workunit.client.1.smithi120.stdout:5/869: symlink d2/dc/d1d/l142 0 2024-04-26T21:26:05.556 INFO:tasks.workunit.client.1.smithi120.stdout:0/962: creat d0/d3/dc/d12/f136 x:0 0 0 2024-04-26T21:26:05.557 INFO:tasks.workunit.client.0.smithi084.stdout:7/648: rename d6/d9/d12/d19/d20/d32/f9a to d6/d9/fd9 0 2024-04-26T21:26:05.559 INFO:tasks.workunit.client.1.smithi120.stdout:0/963: fdatasync d0/d3/dc/dd/f11c 0 2024-04-26T21:26:05.563 INFO:tasks.workunit.client.0.smithi084.stdout:7/649: fdatasync d6/d1c/fa5 0 2024-04-26T21:26:05.563 INFO:tasks.workunit.client.0.smithi084.stdout:3/618: write d1/d2c/d2f/f96 [1811079,52983] 0 2024-04-26T21:26:05.565 INFO:tasks.workunit.client.0.smithi084.stdout:2/737: dread - d6/d7/d3d/d79/f83 zero size 2024-04-26T21:26:05.566 INFO:tasks.workunit.client.1.smithi120.stdout:5/870: fdatasync d2/dc/d1d/d21/d66/d6a/d8c/fa6 0 2024-04-26T21:26:05.567 INFO:tasks.workunit.client.0.smithi084.stdout:0/650: mknod de/d20/d4c/dae/dc2/cd0 0 2024-04-26T21:26:05.567 INFO:tasks.workunit.client.0.smithi084.stdout:6/609: write d3/de/d1a/d2f/d4c/d58/f66 [25817,40515] 0 2024-04-26T21:26:05.568 INFO:tasks.workunit.client.0.smithi084.stdout:0/651: chown de 3 1 2024-04-26T21:26:05.569 INFO:tasks.workunit.client.1.smithi120.stdout:4/827: mknod d10/d28/dd9/ddd/dee/dd0/dd4/d86/dfa/c11d 0 2024-04-26T21:26:05.570 INFO:tasks.workunit.client.0.smithi084.stdout:5/625: creat d0/dc/df/d31/fc9 x:0 0 0 2024-04-26T21:26:05.572 INFO:tasks.workunit.client.1.smithi120.stdout:0/964: rename d0/d3/d51/d97/d108/d64/l6d to d0/d3/d51/d97/d108/d81/dba/l137 0 2024-04-26T21:26:05.573 INFO:tasks.workunit.client.0.smithi084.stdout:3/619: mknod d1/d24/d27/cd8 0 2024-04-26T21:26:05.575 INFO:tasks.workunit.client.0.smithi084.stdout:6/610: chown d3/de/d1a/d2f/d4c/c64 1908619984 1 2024-04-26T21:26:05.579 INFO:tasks.workunit.client.1.smithi120.stdout:6/844: symlink d4/db/d10/dd/d28/d9e/daf/dff/d117/l119 0 2024-04-26T21:26:05.581 INFO:tasks.workunit.client.0.smithi084.stdout:6/611: fsync d3/de/d15/df/f4b 0 2024-04-26T21:26:05.584 INFO:tasks.workunit.client.1.smithi120.stdout:9/772: dwrite d0/d6/d4d/d65/dec/d2d/d4b/d85/f88 [0,4194304] 0 2024-04-26T21:26:05.587 INFO:tasks.workunit.client.0.smithi084.stdout:7/650: unlink d6/f86 0 2024-04-26T21:26:05.589 INFO:tasks.workunit.client.0.smithi084.stdout:1/633: dwrite d2/d9/fcd [0,4194304] 0 2024-04-26T21:26:05.591 INFO:tasks.workunit.client.1.smithi120.stdout:0/965: mkdir d0/d3/dc/d12/d138 0 2024-04-26T21:26:05.591 INFO:tasks.workunit.client.1.smithi120.stdout:6/845: fdatasync d4/db/f6b 0 2024-04-26T21:26:05.593 INFO:tasks.workunit.client.0.smithi084.stdout:9/543: dwrite da/de/d16/d40/fb4 [0,4194304] 0 2024-04-26T21:26:05.595 INFO:tasks.workunit.client.0.smithi084.stdout:0/652: symlink de/d2b/d45/ld1 0 2024-04-26T21:26:05.599 INFO:tasks.workunit.client.1.smithi120.stdout:7/823: dwrite d7/d64/da6/d1f/f106 [0,4194304] 0 2024-04-26T21:26:05.601 INFO:tasks.workunit.client.0.smithi084.stdout:8/617: dwrite d4/f4f [0,4194304] 0 2024-04-26T21:26:05.608 INFO:tasks.workunit.client.1.smithi120.stdout:3/866: sync 2024-04-26T21:26:05.608 INFO:tasks.workunit.client.1.smithi120.stdout:1/754: sync 2024-04-26T21:26:05.610 INFO:tasks.workunit.client.1.smithi120.stdout:2/848: dwrite d4/d1b/d2e/d50/d14/d15/f2d [4194304,4194304] 0 2024-04-26T21:26:05.617 INFO:tasks.workunit.client.1.smithi120.stdout:8/804: dwrite d5/d6/d34/d42/d9d/d83/f97 [0,4194304] 0 2024-04-26T21:26:05.621 INFO:tasks.workunit.client.1.smithi120.stdout:6/846: mkdir d4/db/d10/dd/d11a 0 2024-04-26T21:26:05.623 INFO:tasks.workunit.client.0.smithi084.stdout:1/634: mkdir d2/d19/dd2 0 2024-04-26T21:26:05.623 INFO:tasks.workunit.client.0.smithi084.stdout:4/571: truncate d5/d2e/d5f/f27 2361251 0 2024-04-26T21:26:05.623 INFO:tasks.workunit.client.0.smithi084.stdout:8/618: dread d4/d7/d15/d37/f68 [0,4194304] 0 2024-04-26T21:26:05.627 INFO:tasks.workunit.client.1.smithi120.stdout:0/966: mkdir d0/d3/dc/d12/d138/d139 0 2024-04-26T21:26:05.627 INFO:tasks.workunit.client.1.smithi120.stdout:4/828: write d10/d12/f3a [30877,9588] 0 2024-04-26T21:26:05.628 INFO:tasks.workunit.client.1.smithi120.stdout:1/755: creat d6/d9/dd4/de0/d1b/d3b/ff6 x:0 0 0 2024-04-26T21:26:05.629 INFO:tasks.workunit.client.1.smithi120.stdout:2/849: creat d4/d1b/d4f/d95/de9/d112/f11e x:0 0 0 2024-04-26T21:26:05.632 INFO:tasks.workunit.client.0.smithi084.stdout:7/651: symlink d6/d9/d63/db5/dc3/lda 0 2024-04-26T21:26:05.633 INFO:tasks.workunit.client.1.smithi120.stdout:8/805: mkdir d5/d6/d34/d37/d103 0 2024-04-26T21:26:05.634 INFO:tasks.workunit.client.0.smithi084.stdout:7/652: write d6/d68/f9f [2855218,56433] 0 2024-04-26T21:26:05.635 INFO:tasks.workunit.client.0.smithi084.stdout:8/619: fdatasync d4/d6/db/d1e/d22/d2f/f2c 0 2024-04-26T21:26:05.635 INFO:tasks.workunit.client.0.smithi084.stdout:6/612: creat d3/de/d15/fc9 x:0 0 0 2024-04-26T21:26:05.636 INFO:tasks.workunit.client.1.smithi120.stdout:0/967: write d0/d3/d51/d95/dd0/ff8 [276913,58762] 0 2024-04-26T21:26:05.639 INFO:tasks.workunit.client.1.smithi120.stdout:3/867: link dd/de/df/db6/dc5/f114 dd/de/df/d12/d48/f120 0 2024-04-26T21:26:05.643 INFO:tasks.workunit.client.1.smithi120.stdout:5/871: dwrite d2/dc/d1d/f33 [0,4194304] 0 2024-04-26T21:26:05.645 INFO:tasks.workunit.client.1.smithi120.stdout:3/868: dread - dd/de/df/dda/d24/fe0 zero size 2024-04-26T21:26:05.647 INFO:tasks.workunit.client.1.smithi120.stdout:4/829: unlink d10/l70 0 2024-04-26T21:26:05.650 INFO:tasks.workunit.client.1.smithi120.stdout:2/850: mkdir d4/d1b/d5c/da6/d11f 0 2024-04-26T21:26:05.650 INFO:tasks.workunit.client.0.smithi084.stdout:4/572: link d5/c92 d5/d10/d82/cb9 0 2024-04-26T21:26:05.657 INFO:tasks.workunit.client.1.smithi120.stdout:0/968: mkdir d0/d3/d51/d97/d108/d64/d13a 0 2024-04-26T21:26:05.658 INFO:tasks.workunit.client.1.smithi120.stdout:6/847: symlink d4/db/d10/dd/d28/d9e/daf/dd3/d107/l11b 0 2024-04-26T21:26:05.661 INFO:tasks.workunit.client.0.smithi084.stdout:2/738: write d6/d7/d3d/d15/d1f/d39/fe [300549,100609] 0 2024-04-26T21:26:05.661 INFO:tasks.workunit.client.0.smithi084.stdout:3/620: dread d1/fe [0,4194304] 0 2024-04-26T21:26:05.663 INFO:tasks.workunit.client.0.smithi084.stdout:7/653: dwrite d6/d68/f75 [0,4194304] 0 2024-04-26T21:26:05.664 INFO:tasks.workunit.client.0.smithi084.stdout:9/544: write da/de/d16/f1b [1289180,107815] 0 2024-04-26T21:26:05.666 INFO:tasks.workunit.client.0.smithi084.stdout:0/653: truncate f9 2963392 0 2024-04-26T21:26:05.671 INFO:tasks.workunit.client.1.smithi120.stdout:7/824: getdents d7/d64/da6/d1a/d33/d34 0 2024-04-26T21:26:05.672 INFO:tasks.workunit.client.1.smithi120.stdout:9/773: dread d0/d6/d4d/d65/dec/d2d/d4b/f8b [0,4194304] 0 2024-04-26T21:26:05.675 INFO:tasks.workunit.client.1.smithi120.stdout:5/872: creat d2/d30/d93/d107/d36/d44/d6c/d13f/f143 x:0 0 0 2024-04-26T21:26:05.678 INFO:tasks.workunit.client.0.smithi084.stdout:4/573: truncate d5/fe 164084 0 2024-04-26T21:26:05.680 INFO:tasks.workunit.client.0.smithi084.stdout:6/613: dwrite d3/fa1 [0,4194304] 0 2024-04-26T21:26:05.682 INFO:tasks.workunit.client.1.smithi120.stdout:0/969: rename d0/d3/d51/d97/d108/d64/fb9 to d0/dd1/dd2/de9/f13b 0 2024-04-26T21:26:05.684 INFO:tasks.workunit.client.1.smithi120.stdout:3/869: dwrite dd/de/df/dda/d24/db1/d76/d3b/fbc [0,4194304] 0 2024-04-26T21:26:05.687 INFO:tasks.workunit.client.1.smithi120.stdout:0/970: stat d0/d3/dc/dd/d1b/d24/d7d/ff1 0 2024-04-26T21:26:05.687 INFO:tasks.workunit.client.0.smithi084.stdout:7/654: mknod d6/d9/d12/d19/d20/d38/cdb 0 2024-04-26T21:26:05.688 INFO:tasks.workunit.client.1.smithi120.stdout:3/870: write dd/de/d83/d64/f104 [408952,112712] 0 2024-04-26T21:26:05.692 INFO:tasks.workunit.client.0.smithi084.stdout:6/614: read - d3/de/d1a/d43/d72/dad/fc2 zero size 2024-04-26T21:26:05.693 INFO:tasks.workunit.client.1.smithi120.stdout:9/774: mkdir d0/dd/d3a/d5c/d98/d103 0 2024-04-26T21:26:05.695 INFO:tasks.workunit.client.0.smithi084.stdout:9/545: creat da/de/d16/d55/d93/d95/daa/fcd x:0 0 0 2024-04-26T21:26:05.695 INFO:tasks.workunit.client.0.smithi084.stdout:7/655: creat d6/d9/d12/d8b/fdc x:0 0 0 2024-04-26T21:26:05.696 INFO:tasks.workunit.client.0.smithi084.stdout:4/574: mkdir d5/d7/d65/d90/d91/dba 0 2024-04-26T21:26:05.701 INFO:tasks.workunit.client.0.smithi084.stdout:4/575: chown d5/d25/d99/fb1 9782057 1 2024-04-26T21:26:05.706 INFO:tasks.workunit.client.1.smithi120.stdout:7/825: creat d7/d64/da6/d1f/d28/d4c/f116 x:0 0 0 2024-04-26T21:26:05.706 INFO:tasks.workunit.client.1.smithi120.stdout:3/871: rmdir dd/d2a 39 2024-04-26T21:26:05.709 INFO:tasks.workunit.client.0.smithi084.stdout:8/620: dread d4/d7/f16 [0,4194304] 0 2024-04-26T21:26:05.713 INFO:tasks.workunit.client.1.smithi120.stdout:4/830: write d10/d6b/dbf/fc6 [355699,106629] 0 2024-04-26T21:26:05.723 INFO:tasks.workunit.client.0.smithi084.stdout:0/654: dwrite de/d2b/d77/f1d [8388608,4194304] 0 2024-04-26T21:26:05.723 INFO:tasks.workunit.client.1.smithi120.stdout:8/806: dwrite d5/d6/d34/f39 [0,4194304] 0 2024-04-26T21:26:05.726 INFO:tasks.workunit.client.0.smithi084.stdout:6/615: dwrite d3/de/d15/d40/f6e [0,4194304] 0 2024-04-26T21:26:05.726 INFO:tasks.workunit.client.0.smithi084.stdout:4/576: rmdir d5/d2e/da3 0 2024-04-26T21:26:05.726 INFO:tasks.workunit.client.0.smithi084.stdout:2/739: write d6/d7/d3d/d15/d1f/d39/d20/d36/fe9 [1048594,68586] 0 2024-04-26T21:26:05.731 INFO:tasks.workunit.client.0.smithi084.stdout:6/616: chown d3/de/d15/d5f/dc1 3508015 1 2024-04-26T21:26:05.733 INFO:tasks.workunit.client.1.smithi120.stdout:2/851: dwrite d4/d1b/d56/fb5 [0,4194304] 0 2024-04-26T21:26:05.735 INFO:tasks.workunit.client.0.smithi084.stdout:7/656: dwrite d6/d9/db3/fbd [0,4194304] 0 2024-04-26T21:26:05.736 INFO:tasks.workunit.client.0.smithi084.stdout:4/577: creat d5/d10/da1/fbb x:0 0 0 2024-04-26T21:26:05.740 INFO:tasks.workunit.client.0.smithi084.stdout:3/621: truncate d1/d2c/d2f/d31/d55/f7b 2421345 0 2024-04-26T21:26:05.743 INFO:tasks.workunit.client.0.smithi084.stdout:2/740: symlink d6/lf8 0 2024-04-26T21:26:05.746 INFO:tasks.workunit.client.0.smithi084.stdout:5/626: sync 2024-04-26T21:26:05.746 INFO:tasks.workunit.client.0.smithi084.stdout:1/635: sync 2024-04-26T21:26:05.752 INFO:tasks.workunit.client.0.smithi084.stdout:6/617: dread d3/de/d1a/d43/f48 [0,4194304] 0 2024-04-26T21:26:05.752 INFO:tasks.workunit.client.0.smithi084.stdout:2/741: creat d6/d7/d3d/d15/ff9 x:0 0 0 2024-04-26T21:26:05.756 INFO:tasks.workunit.client.0.smithi084.stdout:7/657: write d6/d1c/d51/f9d [4763795,119958] 0 2024-04-26T21:26:05.757 INFO:tasks.workunit.client.0.smithi084.stdout:4/578: creat d5/fbc x:0 0 0 2024-04-26T21:26:05.764 INFO:tasks.workunit.client.1.smithi120.stdout:6/848: dread d4/db/d10/dd/d4e/f72 [0,4194304] 0 2024-04-26T21:26:05.764 INFO:tasks.workunit.client.0.smithi084.stdout:1/636: creat d2/d9/d15/d28/d47/fd3 x:0 0 0 2024-04-26T21:26:05.766 INFO:tasks.workunit.client.0.smithi084.stdout:3/622: creat d1/d2c/d2f/d31/d55/d4e/d7c/d7e/fd9 x:0 0 0 2024-04-26T21:26:05.767 INFO:tasks.workunit.client.0.smithi084.stdout:2/742: fsync d6/d7/d3d/d15/d1f/d39/fe 0 2024-04-26T21:26:05.770 INFO:tasks.workunit.client.0.smithi084.stdout:7/658: fsync d6/d26/d40/f66 0 2024-04-26T21:26:05.771 INFO:tasks.workunit.client.0.smithi084.stdout:6/618: unlink d3/de/d1a/d2f/f42 0 2024-04-26T21:26:05.782 INFO:tasks.workunit.client.0.smithi084.stdout:4/579: write d5/d25/d35/f86 [557394,96325] 0 2024-04-26T21:26:05.782 INFO:tasks.workunit.client.0.smithi084.stdout:9/546: dwrite da/de/d16/d55/d93/dc3/d41/f7e [0,4194304] 0 2024-04-26T21:26:05.783 INFO:tasks.workunit.client.1.smithi120.stdout:7/826: mkdir d7/d10/d117 0 2024-04-26T21:26:05.785 INFO:tasks.workunit.client.1.smithi120.stdout:3/872: creat dd/d40/f121 x:0 0 0 2024-04-26T21:26:05.786 INFO:tasks.workunit.client.0.smithi084.stdout:3/623: rmdir d1/d24 39 2024-04-26T21:26:05.786 INFO:tasks.workunit.client.0.smithi084.stdout:1/637: chown d2/d9/d15/fac 7508 1 2024-04-26T21:26:05.788 INFO:tasks.workunit.client.1.smithi120.stdout:9/775: creat d0/d6/d4d/d65/dec/d77/d9a/df9/f104 x:0 0 0 2024-04-26T21:26:05.789 INFO:tasks.workunit.client.1.smithi120.stdout:9/776: readlink d0/dd/d3a/l73 0 2024-04-26T21:26:05.790 INFO:tasks.workunit.client.0.smithi084.stdout:0/655: dwrite de/f14 [0,4194304] 0 2024-04-26T21:26:05.798 INFO:tasks.workunit.client.1.smithi120.stdout:6/849: fsync d4/db/d10/dd/f74 0 2024-04-26T21:26:05.798 INFO:tasks.workunit.client.1.smithi120.stdout:7/827: rmdir d7/d64/da6/d1a/dc2 39 2024-04-26T21:26:05.802 INFO:tasks.workunit.client.1.smithi120.stdout:6/850: stat d4/db/d10/d22/d6c/c110 0 2024-04-26T21:26:05.806 INFO:tasks.workunit.client.1.smithi120.stdout:1/756: sync 2024-04-26T21:26:05.806 INFO:tasks.workunit.client.0.smithi084.stdout:5/627: dwrite d0/dc/df/d31/d53/d87/f9f [0,4194304] 0 2024-04-26T21:26:05.810 INFO:tasks.workunit.client.1.smithi120.stdout:6/851: write d4/db/d10/dd/f111 [1102047,128397] 0 2024-04-26T21:26:05.810 INFO:tasks.workunit.client.1.smithi120.stdout:5/873: dread d2/dc/d1d/d21/d77/d79/db7/fab [0,4194304] 0 2024-04-26T21:26:05.811 INFO:tasks.workunit.client.0.smithi084.stdout:5/628: chown d0/dc/d48 5 1 2024-04-26T21:26:05.812 INFO:tasks.workunit.client.1.smithi120.stdout:0/971: getdents d0/d3/dc/dd/d9b 0 2024-04-26T21:26:05.816 INFO:tasks.workunit.client.0.smithi084.stdout:5/629: write d0/dc/df/d31/fc9 [116942,29605] 0 2024-04-26T21:26:05.818 INFO:tasks.workunit.client.0.smithi084.stdout:6/619: mkdir d3/de/d9e/dca 0 2024-04-26T21:26:05.818 INFO:tasks.workunit.client.1.smithi120.stdout:8/807: rmdir d5/d6/d34/df6 0 2024-04-26T21:26:05.820 INFO:tasks.workunit.client.0.smithi084.stdout:8/621: dread d4/d7/f14 [4194304,4194304] 0 2024-04-26T21:26:05.820 INFO:tasks.workunit.client.1.smithi120.stdout:0/972: write d0/d3/dc/dd/d1b/d24/d73/db7/f117 [234251,104903] 0 2024-04-26T21:26:05.821 INFO:tasks.workunit.client.0.smithi084.stdout:2/743: truncate d6/d1b/f7e 676283 0 2024-04-26T21:26:05.821 INFO:tasks.workunit.client.1.smithi120.stdout:2/852: creat d4/d1b/d2e/d50/d14/f120 x:0 0 0 2024-04-26T21:26:05.825 INFO:tasks.workunit.client.0.smithi084.stdout:6/620: fsync d3/de/d15/f1c 0 2024-04-26T21:26:05.825 INFO:tasks.workunit.client.0.smithi084.stdout:9/547: mkdir da/de/d16/d55/d93/dc3/d41/d43/d48/dce 0 2024-04-26T21:26:05.826 INFO:tasks.workunit.client.0.smithi084.stdout:4/580: mknod d5/d25/d99/dac/cbd 0 2024-04-26T21:26:05.826 INFO:tasks.workunit.client.0.smithi084.stdout:3/624: mknod d1/d24/d27/d3a/cda 0 2024-04-26T21:26:05.828 INFO:tasks.workunit.client.0.smithi084.stdout:8/622: stat d4/d6/la9 0 2024-04-26T21:26:05.829 INFO:tasks.workunit.client.1.smithi120.stdout:7/828: symlink d7/d64/da6/d1a/d33/l118 0 2024-04-26T21:26:05.830 INFO:tasks.workunit.client.0.smithi084.stdout:9/548: readlink da/de/d1e/l21 0 2024-04-26T21:26:05.830 INFO:tasks.workunit.client.0.smithi084.stdout:0/656: creat de/d2b/d64/d81/d9a/fd2 x:0 0 0 2024-04-26T21:26:05.830 INFO:tasks.workunit.client.0.smithi084.stdout:2/744: unlink d6/d7/d3d/f5c 0 2024-04-26T21:26:05.833 INFO:tasks.workunit.client.0.smithi084.stdout:8/623: read - d4/d6/db/d1e/f8e zero size 2024-04-26T21:26:05.835 INFO:tasks.workunit.client.0.smithi084.stdout:3/625: mkdir d1/d24/d27/d3a/ddb 0 2024-04-26T21:26:05.836 INFO:tasks.workunit.client.1.smithi120.stdout:5/874: mkdir d2/dc/d1d/d21/d77/d9c/d144 0 2024-04-26T21:26:05.836 INFO:tasks.workunit.client.1.smithi120.stdout:2/853: dwrite d4/d1b/d2e/d50/d14/ff2 [0,4194304] 0 2024-04-26T21:26:05.837 INFO:tasks.workunit.client.0.smithi084.stdout:1/638: rename d2/d9/d15/d28/fab to d2/d9/fd4 0 2024-04-26T21:26:05.838 INFO:tasks.workunit.client.0.smithi084.stdout:3/626: chown d1/d2c/d2f/d31/dc7 25592957 1 2024-04-26T21:26:05.838 INFO:tasks.workunit.client.0.smithi084.stdout:7/659: link d6/d9/d12/d8b/d72/da0/d80/l52 d6/d9/d12/d8b/d72/da0/ldd 0 2024-04-26T21:26:05.839 INFO:tasks.workunit.client.0.smithi084.stdout:3/627: readlink d1/d24/d27/l3d 0 2024-04-26T21:26:05.839 INFO:tasks.workunit.client.0.smithi084.stdout:0/657: chown de/d2b/d45/c90 7824556 1 2024-04-26T21:26:05.840 INFO:tasks.workunit.client.1.smithi120.stdout:6/852: mkdir d4/db/d10/d22/d56/d9c/d11c 0 2024-04-26T21:26:05.841 INFO:tasks.workunit.client.0.smithi084.stdout:7/660: write d6/d9/d89/fc9 [2999587,59353] 0 2024-04-26T21:26:05.841 INFO:tasks.workunit.client.0.smithi084.stdout:6/621: creat d3/fcb x:0 0 0 2024-04-26T21:26:05.842 INFO:tasks.workunit.client.0.smithi084.stdout:2/745: mknod d6/d7/d3d/d79/d85/cfa 0 2024-04-26T21:26:05.844 INFO:tasks.workunit.client.1.smithi120.stdout:0/973: creat d0/d3/dc/d12/dae/f13c x:0 0 0 2024-04-26T21:26:05.845 INFO:tasks.workunit.client.0.smithi084.stdout:3/628: fsync d1/d24/d27/d3a/d81/f97 0 2024-04-26T21:26:05.846 INFO:tasks.workunit.client.0.smithi084.stdout:8/624: unlink d4/d7/f14 0 2024-04-26T21:26:05.849 INFO:tasks.workunit.client.0.smithi084.stdout:3/629: readlink d1/d2c/d2f/d31/d55/da4/lb2 0 2024-04-26T21:26:05.850 INFO:tasks.workunit.client.1.smithi120.stdout:1/757: truncate d6/d9/dd4/de0/d1d/d2c/f93 1138559 0 2024-04-26T21:26:05.851 INFO:tasks.workunit.client.1.smithi120.stdout:4/831: dread d10/d12/f35 [0,4194304] 0 2024-04-26T21:26:05.852 INFO:tasks.workunit.client.1.smithi120.stdout:5/875: fdatasync d2/d30/d3b/f94 0 2024-04-26T21:26:05.854 INFO:tasks.workunit.client.0.smithi084.stdout:1/639: creat d2/d9/d15/d28/d5a/fd5 x:0 0 0 2024-04-26T21:26:05.854 INFO:tasks.workunit.client.0.smithi084.stdout:4/581: link d5/d2e/d5f/d32/c6e d5/d10/da1/cbe 0 2024-04-26T21:26:05.855 INFO:tasks.workunit.client.1.smithi120.stdout:2/854: unlink d4/d1b/d25/d2c/d3e/d5e/d63/f107 0 2024-04-26T21:26:05.855 INFO:tasks.workunit.client.0.smithi084.stdout:6/622: rename d3/de/d15/d40/f95 to d3/de/d1a/d2f/d4c/fcc 0 2024-04-26T21:26:05.857 INFO:tasks.workunit.client.0.smithi084.stdout:8/625: symlink d4/d7/d15/d3c/lb0 0 2024-04-26T21:26:05.858 INFO:tasks.workunit.client.1.smithi120.stdout:8/808: symlink d5/l104 0 2024-04-26T21:26:05.860 INFO:tasks.workunit.client.1.smithi120.stdout:8/809: chown d5/d6/f7f 14055530 1 2024-04-26T21:26:05.862 INFO:tasks.workunit.client.0.smithi084.stdout:1/640: dread - d2/d1b/f65 zero size 2024-04-26T21:26:05.866 INFO:tasks.workunit.client.1.smithi120.stdout:0/974: dwrite d0/d3/d51/d70/d71/fee [0,4194304] 0 2024-04-26T21:26:05.866 INFO:tasks.workunit.client.0.smithi084.stdout:8/626: chown d4/d6/db/d1e/d7c/c8a 9 1 2024-04-26T21:26:05.868 INFO:tasks.workunit.client.0.smithi084.stdout:0/658: getdents de/d78 0 2024-04-26T21:26:05.871 INFO:tasks.workunit.client.0.smithi084.stdout:1/641: symlink d2/d9/d15/d28/da0/ld6 0 2024-04-26T21:26:05.873 INFO:tasks.workunit.client.0.smithi084.stdout:8/627: chown d4/d6/db/d1e/l73 14 1 2024-04-26T21:26:05.873 INFO:tasks.workunit.client.0.smithi084.stdout:7/661: dwrite d6/d9/d12/d19/d20/d38/fa4 [0,4194304] 0 2024-04-26T21:26:05.877 INFO:tasks.workunit.client.1.smithi120.stdout:0/975: rmdir d0/d3/d51/d97/d108/d81 39 2024-04-26T21:26:05.877 INFO:tasks.workunit.client.1.smithi120.stdout:7/829: dread d7/d64/da6/d1a/d33/f5b [0,4194304] 0 2024-04-26T21:26:05.879 INFO:tasks.workunit.client.0.smithi084.stdout:3/630: dwrite d1/d2c/d2f/d94/fba [0,4194304] 0 2024-04-26T21:26:05.879 INFO:tasks.workunit.client.1.smithi120.stdout:7/830: chown d7/ddd/c10c 5 1 2024-04-26T21:26:05.882 INFO:tasks.workunit.client.1.smithi120.stdout:4/832: rename d10/d28/dd9/ddd/dee/dd0/dd4/d86/f101 to d10/d28/d73/de2/f11e 0 2024-04-26T21:26:05.882 INFO:tasks.workunit.client.0.smithi084.stdout:0/659: creat de/fd3 x:0 0 0 2024-04-26T21:26:05.883 INFO:tasks.workunit.client.0.smithi084.stdout:7/662: creat d6/d26/fde x:0 0 0 2024-04-26T21:26:05.884 INFO:tasks.workunit.client.0.smithi084.stdout:3/631: chown d1/d2c/d2f/d31/d55 53 1 2024-04-26T21:26:05.885 INFO:tasks.workunit.client.1.smithi120.stdout:4/833: fsync d10/f26 0 2024-04-26T21:26:05.885 INFO:tasks.workunit.client.1.smithi120.stdout:2/855: chown d4/d1b/d2e/d50/d14/d15/cc4 1791 1 2024-04-26T21:26:05.886 INFO:tasks.workunit.client.0.smithi084.stdout:4/582: dread d5/d7/f63 [0,4194304] 0 2024-04-26T21:26:05.889 INFO:tasks.workunit.client.0.smithi084.stdout:5/630: dread d0/dc/df/d2a/f91 [0,4194304] 0 2024-04-26T21:26:05.889 INFO:tasks.workunit.client.0.smithi084.stdout:4/583: stat d5/d2e/d5f/d32/d46/fa7 0 2024-04-26T21:26:05.889 INFO:tasks.workunit.client.0.smithi084.stdout:8/628: rmdir d4/d6/db/d1e/d22/d39/d4a 39 2024-04-26T21:26:05.892 INFO:tasks.workunit.client.1.smithi120.stdout:8/810: dwrite d5/d6/d11/d52/fe9 [4194304,4194304] 0 2024-04-26T21:26:05.893 INFO:tasks.workunit.client.0.smithi084.stdout:7/663: creat d6/d9/d63/db5/fdf x:0 0 0 2024-04-26T21:26:05.895 INFO:tasks.workunit.client.1.smithi120.stdout:9/777: write d0/d66/fb2 [698112,28455] 0 2024-04-26T21:26:05.895 INFO:tasks.workunit.client.1.smithi120.stdout:3/873: write dd/de/df/db6/fd1 [2786605,76112] 0 2024-04-26T21:26:05.896 INFO:tasks.workunit.client.0.smithi084.stdout:0/660: mknod de/cd4 0 2024-04-26T21:26:05.897 INFO:tasks.workunit.client.1.smithi120.stdout:7/831: symlink d7/d64/da6/d1f/d7d/d8b/l119 0 2024-04-26T21:26:05.898 INFO:tasks.workunit.client.1.smithi120.stdout:3/874: chown dd/de/d83/l82 22798 1 2024-04-26T21:26:05.899 INFO:tasks.workunit.client.0.smithi084.stdout:0/661: dread - de/d20/d4c/fb7 zero size 2024-04-26T21:26:05.903 INFO:tasks.workunit.client.1.smithi120.stdout:8/811: mkdir d5/d6/d11/d32/d3b/d105 0 2024-04-26T21:26:05.906 INFO:tasks.workunit.client.1.smithi120.stdout:9/778: symlink d0/d66/db5/l105 0 2024-04-26T21:26:05.906 INFO:tasks.workunit.client.1.smithi120.stdout:8/812: stat d5/d6/d34/d42/f5b 0 2024-04-26T21:26:05.912 INFO:tasks.workunit.client.1.smithi120.stdout:9/779: truncate d0/dd/d3a/dae/f8f 4744936 0 2024-04-26T21:26:05.915 INFO:tasks.workunit.client.0.smithi084.stdout:3/632: dwrite d1/d2c/d2f/d31/d55/d4e/d98/d9e/fa9 [0,4194304] 0 2024-04-26T21:26:05.915 INFO:tasks.workunit.client.0.smithi084.stdout:7/664: creat d6/d1c/d51/fe0 x:0 0 0 2024-04-26T21:26:05.915 INFO:tasks.workunit.client.1.smithi120.stdout:3/875: write dd/de/df/dda/d24/d9d/d86/dd3/ddb/f9c [9176607,115352] 0 2024-04-26T21:26:05.916 INFO:tasks.workunit.client.0.smithi084.stdout:0/662: symlink de/d20/ld5 0 2024-04-26T21:26:05.920 INFO:tasks.workunit.client.0.smithi084.stdout:9/549: truncate da/de/d16/d55/d93/dc3/d41/d43/d48/d61/f77 848995 0 2024-04-26T21:26:05.921 INFO:tasks.workunit.client.1.smithi120.stdout:2/856: dread d4/d1b/d56/d65/fbc [0,4194304] 0 2024-04-26T21:26:05.921 INFO:tasks.workunit.client.1.smithi120.stdout:9/780: dread - d0/d6/d4d/d65/dec/d2d/d4b/d85/ffa zero size 2024-04-26T21:26:05.923 INFO:tasks.workunit.client.0.smithi084.stdout:6/623: write d3/de/f61 [3556547,8875] 0 2024-04-26T21:26:05.928 INFO:tasks.workunit.client.0.smithi084.stdout:7/665: chown d6/d26/f45 5 1 2024-04-26T21:26:05.929 INFO:tasks.workunit.client.1.smithi120.stdout:4/834: dwrite d10/d6b/d71/d9d/fea [0,4194304] 0 2024-04-26T21:26:05.931 INFO:tasks.workunit.client.1.smithi120.stdout:8/813: creat d5/d6/d11/d32/d3b/d105/f106 x:0 0 0 2024-04-26T21:26:05.934 INFO:tasks.workunit.client.0.smithi084.stdout:9/550: creat da/de/d16/d55/d93/d95/fcf x:0 0 0 2024-04-26T21:26:05.936 INFO:tasks.workunit.client.1.smithi120.stdout:7/832: getdents d7/d64/da6/d1f/d28/d4c/d6c 0 2024-04-26T21:26:05.936 INFO:tasks.workunit.client.1.smithi120.stdout:5/876: write d2/d30/d3b/f4a [643464,34160] 0 2024-04-26T21:26:05.939 INFO:tasks.workunit.client.0.smithi084.stdout:8/629: dwrite d4/d7/d15/d9d/fad [0,4194304] 0 2024-04-26T21:26:05.941 INFO:tasks.workunit.client.0.smithi084.stdout:5/631: write d0/dc/df/d31/d53/f60 [64649,103233] 0 2024-04-26T21:26:05.943 INFO:tasks.workunit.client.1.smithi120.stdout:6/853: dwrite d4/db/d10/d1a/d2b/d57/d67/dbc/f114 [0,4194304] 0 2024-04-26T21:26:05.943 INFO:tasks.workunit.client.1.smithi120.stdout:4/835: fsync d10/d28/f29 0 2024-04-26T21:26:05.946 INFO:tasks.workunit.client.0.smithi084.stdout:9/551: mknod da/de/d16/d55/d93/cd0 0 2024-04-26T21:26:05.947 INFO:tasks.workunit.client.0.smithi084.stdout:8/630: truncate d4/d7/d15/d3c/f7d 1030598 0 2024-04-26T21:26:05.948 INFO:tasks.workunit.client.0.smithi084.stdout:2/746: dread d6/d7/d3d/d79/fea [0,4194304] 0 2024-04-26T21:26:05.948 INFO:tasks.workunit.client.1.smithi120.stdout:9/781: mknod d0/dd/d45/d87/c106 0 2024-04-26T21:26:05.951 INFO:tasks.workunit.client.0.smithi084.stdout:8/631: stat d4/d6/db/d1e/d22/d39/l66 0 2024-04-26T21:26:05.953 INFO:tasks.workunit.client.0.smithi084.stdout:3/633: creat d1/d24/d27/d3a/ddb/fdc x:0 0 0 2024-04-26T21:26:05.959 INFO:tasks.workunit.client.0.smithi084.stdout:7/666: symlink d6/d1c/le1 0 2024-04-26T21:26:05.960 INFO:tasks.workunit.client.1.smithi120.stdout:5/877: truncate d2/dc/fc8 96978 0 2024-04-26T21:26:05.960 INFO:tasks.workunit.client.1.smithi120.stdout:6/854: mkdir d4/db/d25/d6d/dbd/d11d 0 2024-04-26T21:26:05.963 INFO:tasks.workunit.client.0.smithi084.stdout:5/632: mkdir d0/dc/df/d31/d63/d8a/dca 0 2024-04-26T21:26:05.964 INFO:tasks.workunit.client.1.smithi120.stdout:3/876: dread dd/de/df/dda/d24/db1/d76/d3b/d56/fa5 [0,4194304] 0 2024-04-26T21:26:05.964 INFO:tasks.workunit.client.1.smithi120.stdout:4/836: fdatasync d10/d28/d73/f83 0 2024-04-26T21:26:05.964 INFO:tasks.workunit.client.1.smithi120.stdout:9/782: mknod d0/d66/c107 0 2024-04-26T21:26:05.966 INFO:tasks.workunit.client.0.smithi084.stdout:5/633: fdatasync d0/d17/f7e 0 2024-04-26T21:26:05.969 INFO:tasks.workunit.client.1.smithi120.stdout:6/855: fsync d4/db/f23 0 2024-04-26T21:26:05.969 INFO:tasks.workunit.client.0.smithi084.stdout:6/624: getdents d3/de/d1a/d2f/d4c/d58 0 2024-04-26T21:26:05.971 INFO:tasks.workunit.client.0.smithi084.stdout:0/663: dwrite de/f83 [0,4194304] 0 2024-04-26T21:26:05.974 INFO:tasks.workunit.client.1.smithi120.stdout:2/857: dwrite d4/d1b/d56/d65/d8d/f110 [0,4194304] 0 2024-04-26T21:26:05.976 INFO:tasks.workunit.client.1.smithi120.stdout:1/758: dread d6/d9/dd4/de0/d1b/d3b/d6d/fb4 [0,4194304] 0 2024-04-26T21:26:05.978 INFO:tasks.workunit.client.1.smithi120.stdout:5/878: dread - d2/dc/d1d/d21/db2/f113 zero size 2024-04-26T21:26:05.979 INFO:tasks.workunit.client.0.smithi084.stdout:2/747: symlink d6/d7/d3d/d15/d1f/d22/lfb 0 2024-04-26T21:26:05.981 INFO:tasks.workunit.client.0.smithi084.stdout:4/584: dread d5/d10/f18 [0,4194304] 0 2024-04-26T21:26:05.981 INFO:tasks.workunit.client.1.smithi120.stdout:4/837: stat d10/d28/dd9/ddd/dee/dd0/dd4/d86/fc2 0 2024-04-26T21:26:05.983 INFO:tasks.workunit.client.1.smithi120.stdout:0/976: dwrite d0/df4/f68 [0,4194304] 0 2024-04-26T21:26:05.984 INFO:tasks.workunit.client.0.smithi084.stdout:3/634: dwrite d1/d2c/d2f/f1f [4194304,4194304] 0 2024-04-26T21:26:05.985 INFO:tasks.workunit.client.0.smithi084.stdout:8/632: rename d4/d7/d15/d3c/c8b to d4/d6/db/d1e/d22/d2f/cb1 0 2024-04-26T21:26:05.985 INFO:tasks.workunit.client.1.smithi120.stdout:1/759: readlink d6/d9/dd4/de0/d2d/d98/l7b 0 2024-04-26T21:26:05.993 INFO:tasks.workunit.client.0.smithi084.stdout:0/664: fdatasync de/d2b/d45/d63/f86 0 2024-04-26T21:26:05.995 INFO:tasks.workunit.client.0.smithi084.stdout:7/667: symlink d6/d9/d12/d8b/d72/da0/le2 0 2024-04-26T21:26:05.995 INFO:tasks.workunit.client.0.smithi084.stdout:5/634: symlink d0/dc/d48/lcb 0 2024-04-26T21:26:05.995 INFO:tasks.workunit.client.1.smithi120.stdout:4/838: stat d10/d28/dd9/ddd/dee/dd0/dd4/d86/cb0 0 2024-04-26T21:26:05.995 INFO:tasks.workunit.client.1.smithi120.stdout:7/833: dwrite d7/fe [4194304,4194304] 0 2024-04-26T21:26:05.995 INFO:tasks.workunit.client.1.smithi120.stdout:4/839: readlink d10/d28/l61 0 2024-04-26T21:26:06.001 INFO:tasks.workunit.client.0.smithi084.stdout:0/665: chown de/f8b 0 1 2024-04-26T21:26:06.003 INFO:tasks.workunit.client.0.smithi084.stdout:5/635: creat d0/d17/fcc x:0 0 0 2024-04-26T21:26:06.004 INFO:tasks.workunit.client.1.smithi120.stdout:4/840: read d10/d12/f95 [74873,123830] 0 2024-04-26T21:26:06.005 INFO:tasks.workunit.client.1.smithi120.stdout:3/877: link dd/de/df/f10e dd/de/df/dda/d24/d9d/f122 0 2024-04-26T21:26:06.008 INFO:tasks.workunit.client.1.smithi120.stdout:2/858: read d4/d1b/d25/d29/f37 [790425,114399] 0 2024-04-26T21:26:06.010 INFO:tasks.workunit.client.1.smithi120.stdout:9/783: rename d0/d6/d4d/d65/dec/d2d/c61 to d0/d66/d93/db7/c108 0 2024-04-26T21:26:06.010 INFO:tasks.workunit.client.0.smithi084.stdout:3/635: rename d1/d2c/d2f/d31/d3b/f74 to d1/d2c/d2f/d31/d55/d4e/d7c/db1/dc8/fdd 0 2024-04-26T21:26:06.010 INFO:tasks.workunit.client.0.smithi084.stdout:1/642: dread d2/d54/d5e/d66/fc1 [0,4194304] 0 2024-04-26T21:26:06.012 INFO:tasks.workunit.client.1.smithi120.stdout:9/784: chown d0/dd 1772 1 2024-04-26T21:26:06.012 INFO:tasks.workunit.client.0.smithi084.stdout:9/552: truncate da/de/d16/d40/f4b 2976262 0 2024-04-26T21:26:06.014 INFO:tasks.workunit.client.1.smithi120.stdout:2/859: chown d4/d1b/d25/d2c/d3e/d102 155 1 2024-04-26T21:26:06.016 INFO:tasks.workunit.client.1.smithi120.stdout:5/879: dread d2/dc/d1d/d21/db2/dde/fec [0,4194304] 0 2024-04-26T21:26:06.018 INFO:tasks.workunit.client.0.smithi084.stdout:8/633: dwrite d4/d7/d15/f30 [8388608,4194304] 0 2024-04-26T21:26:06.019 INFO:tasks.workunit.client.1.smithi120.stdout:0/977: dwrite d0/d3/d51/d70/d99/f126 [0,4194304] 0 2024-04-26T21:26:06.020 INFO:tasks.workunit.client.1.smithi120.stdout:5/880: fsync d2/d30/d93/d107/d36/d44/f105 0 2024-04-26T21:26:06.021 INFO:tasks.workunit.client.1.smithi120.stdout:4/841: mkdir d10/d6b/d71/dd7/d11f 0 2024-04-26T21:26:06.022 INFO:tasks.workunit.client.0.smithi084.stdout:1/643: creat d2/d19/fd7 x:0 0 0 2024-04-26T21:26:06.022 INFO:tasks.workunit.client.0.smithi084.stdout:3/636: creat d1/d2c/d2f/d31/d55/d4e/fde x:0 0 0 2024-04-26T21:26:06.023 INFO:tasks.workunit.client.0.smithi084.stdout:0/666: getdents de/d2b/d45/d63 0 2024-04-26T21:26:06.025 INFO:tasks.workunit.client.0.smithi084.stdout:9/553: fsync da/de/d16/d55/d93/dc3/f4e 0 2024-04-26T21:26:06.025 INFO:tasks.workunit.client.0.smithi084.stdout:1/644: chown d2/d9/d15/d28/fbd 3 1 2024-04-26T21:26:06.027 INFO:tasks.workunit.client.0.smithi084.stdout:1/645: dread - d2/d9/d15/d9f/fb3 zero size 2024-04-26T21:26:06.028 INFO:tasks.workunit.client.1.smithi120.stdout:9/785: write d0/dd/d34/f6e [922749,40341] 0 2024-04-26T21:26:06.030 INFO:tasks.workunit.client.0.smithi084.stdout:8/634: write d4/d7/d15/d37/f68 [3915501,128166] 0 2024-04-26T21:26:06.032 INFO:tasks.workunit.client.0.smithi084.stdout:9/554: symlink da/ld1 0 2024-04-26T21:26:06.032 INFO:tasks.workunit.client.1.smithi120.stdout:1/760: rename d6/d9/dd4/de0/d2d/d98/c1f to d6/d9/cf7 0 2024-04-26T21:26:06.032 INFO:tasks.workunit.client.1.smithi120.stdout:9/786: readlink d0/d6/d4d/la3 0 2024-04-26T21:26:06.034 INFO:tasks.workunit.client.1.smithi120.stdout:4/842: mknod d10/d28/dd9/ddd/c120 0 2024-04-26T21:26:06.039 INFO:tasks.workunit.client.1.smithi120.stdout:8/814: dread d5/d6/d11/d32/d3b/f6f [0,4194304] 0 2024-04-26T21:26:06.039 INFO:tasks.workunit.client.0.smithi084.stdout:8/635: symlink d4/d6/db/lb2 0 2024-04-26T21:26:06.044 INFO:tasks.workunit.client.1.smithi120.stdout:1/761: write d6/d9/dd4/de0/d2d/d98/d35/fc5 [1524606,77640] 0 2024-04-26T21:26:06.045 INFO:tasks.workunit.client.1.smithi120.stdout:0/978: getdents d0 0 2024-04-26T21:26:06.048 INFO:tasks.workunit.client.1.smithi120.stdout:9/787: creat d0/d6/f109 x:0 0 0 2024-04-26T21:26:06.048 INFO:tasks.workunit.client.0.smithi084.stdout:1/646: mkdir d2/d54/d5e/d66/d2a/d72/dd8 0 2024-04-26T21:26:06.051 INFO:tasks.workunit.client.0.smithi084.stdout:2/748: write d6/d7/d3d/d15/d1f/d39/d43/fae [13301,38610] 0 2024-04-26T21:26:06.052 INFO:tasks.workunit.client.0.smithi084.stdout:1/647: readlink d2/d9/d15/d28/d47/l99 0 2024-04-26T21:26:06.054 INFO:tasks.workunit.client.0.smithi084.stdout:7/668: write d6/d9/d12/d19/f3c [3324058,117889] 0 2024-04-26T21:26:06.054 INFO:tasks.workunit.client.1.smithi120.stdout:3/878: dwrite dd/de/df/dda/d37/f4e [0,4194304] 0 2024-04-26T21:26:06.055 INFO:tasks.workunit.client.0.smithi084.stdout:8/636: mknod d4/cb3 0 2024-04-26T21:26:06.056 INFO:tasks.workunit.client.0.smithi084.stdout:4/585: dread d5/d25/f47 [0,4194304] 0 2024-04-26T21:26:06.060 INFO:tasks.workunit.client.1.smithi120.stdout:6/856: dread d4/db/f6b [0,4194304] 0 2024-04-26T21:26:06.061 INFO:tasks.workunit.client.0.smithi084.stdout:5/636: truncate d0/dc/df/d31/d53/d87/f9f 801677 0 2024-04-26T21:26:06.062 INFO:tasks.workunit.client.0.smithi084.stdout:7/669: read d6/d9/d12/d19/d20/d38/f82 [1745783,76725] 0 2024-04-26T21:26:06.062 INFO:tasks.workunit.client.1.smithi120.stdout:6/857: stat d4/db/d10/dd/d11a 0 2024-04-26T21:26:06.063 INFO:tasks.workunit.client.0.smithi084.stdout:2/749: rmdir d6/d7/d3d/d79/d81/d82 39 2024-04-26T21:26:06.066 INFO:tasks.workunit.client.0.smithi084.stdout:2/750: chown d6/d1b/lb7 3092302 1 2024-04-26T21:26:06.066 INFO:tasks.workunit.client.0.smithi084.stdout:8/637: mkdir d4/d7/d15/d37/d52/db4 0 2024-04-26T21:26:06.067 INFO:tasks.workunit.client.0.smithi084.stdout:8/638: readlink d4/d6/l35 0 2024-04-26T21:26:06.072 INFO:tasks.workunit.client.0.smithi084.stdout:5/637: mkdir d0/dc/df/d31/d72/dcd 0 2024-04-26T21:26:06.072 INFO:tasks.workunit.client.0.smithi084.stdout:8/639: write d4/f4f [3093676,30755] 0 2024-04-26T21:26:06.073 INFO:tasks.workunit.client.1.smithi120.stdout:0/979: creat d0/d3/dc/dd/d1b/d24/d7d/d9f/d127/d113/f13d x:0 0 0 2024-04-26T21:26:06.076 INFO:tasks.workunit.client.1.smithi120.stdout:8/815: mkdir d5/d6/d11/d52/d27/d4f/d67/d85/de1/d107 0 2024-04-26T21:26:06.079 INFO:tasks.workunit.client.1.smithi120.stdout:0/980: write d0/dd1/fda [3197417,68459] 0 2024-04-26T21:26:06.084 INFO:tasks.workunit.client.1.smithi120.stdout:3/879: link dd/de/d83/d64/fa4 dd/de/df/dda/d24/db1/d76/d3b/d56/f123 0 2024-04-26T21:26:06.085 INFO:tasks.workunit.client.1.smithi120.stdout:0/981: write d0/d3/dc/dd/d1b/daa/fd6 [215700,45079] 0 2024-04-26T21:26:06.085 INFO:tasks.workunit.client.0.smithi084.stdout:5/638: dread - d0/dc/d48/f77 zero size 2024-04-26T21:26:06.087 INFO:tasks.workunit.client.1.smithi120.stdout:7/834: dwrite d7/d64/da6/d2f/f52 [0,4194304] 0 2024-04-26T21:26:06.089 INFO:tasks.workunit.client.0.smithi084.stdout:4/586: getdents d5 0 2024-04-26T21:26:06.090 INFO:tasks.workunit.client.0.smithi084.stdout:9/555: dwrite da/de/d16/d55/d93/dc3/d41/d43/d48/d61/f8a [0,4194304] 0 2024-04-26T21:26:06.090 INFO:tasks.workunit.client.0.smithi084.stdout:7/670: creat d6/d1c/fe3 x:0 0 0 2024-04-26T21:26:06.093 INFO:tasks.workunit.client.0.smithi084.stdout:3/637: dwrite d1/d24/f36 [0,4194304] 0 2024-04-26T21:26:06.095 INFO:tasks.workunit.client.1.smithi120.stdout:0/982: chown d0/d3/dc/dd/d1b/f78 2916467 1 2024-04-26T21:26:06.098 INFO:tasks.workunit.client.1.smithi120.stdout:4/843: write d10/d6b/d71/fd8 [494715,977] 0 2024-04-26T21:26:06.099 INFO:tasks.workunit.client.1.smithi120.stdout:1/762: write d6/d14/f16 [2039045,26772] 0 2024-04-26T21:26:06.106 INFO:tasks.workunit.client.1.smithi120.stdout:9/788: fsync d0/d6/d4d/d65/dec/d2d/fa5 0 2024-04-26T21:26:06.109 INFO:tasks.workunit.client.1.smithi120.stdout:5/881: dwrite d2/dc/d1d/d21/d77/d79/f8e [0,4194304] 0 2024-04-26T21:26:06.110 INFO:tasks.workunit.client.1.smithi120.stdout:2/860: dwrite d4/d1b/d25/d2c/d3e/d5e/fe2 [0,4194304] 0 2024-04-26T21:26:06.114 INFO:tasks.workunit.client.1.smithi120.stdout:3/880: mknod dd/de/df/dda/d24/d9d/c124 0 2024-04-26T21:26:06.115 INFO:tasks.workunit.client.1.smithi120.stdout:0/983: symlink d0/d3/dc/dd/d1b/d24/d7d/d9f/d127/d113/l13e 0 2024-04-26T21:26:06.115 INFO:tasks.workunit.client.1.smithi120.stdout:8/816: write d5/fb1 [828996,107804] 0 2024-04-26T21:26:06.116 INFO:tasks.workunit.client.0.smithi084.stdout:9/556: stat da/de/d16/d55/d93/dc3/f52 0 2024-04-26T21:26:06.118 INFO:tasks.workunit.client.1.smithi120.stdout:2/861: write d4/fdf [3441709,47511] 0 2024-04-26T21:26:06.119 INFO:tasks.workunit.client.1.smithi120.stdout:4/844: symlink d10/d12/da1/l121 0 2024-04-26T21:26:06.119 INFO:tasks.workunit.client.0.smithi084.stdout:0/667: dwrite de/d2b/d77/d32/f51 [0,4194304] 0 2024-04-26T21:26:06.119 INFO:tasks.workunit.client.1.smithi120.stdout:3/881: write dd/de/d83/f3f [208906,89585] 0 2024-04-26T21:26:06.121 INFO:tasks.workunit.client.0.smithi084.stdout:4/587: read d5/d10/f13 [4611278,82966] 0 2024-04-26T21:26:06.122 INFO:tasks.workunit.client.1.smithi120.stdout:4/845: chown d10/d6b/da4/ca8 34728787 1 2024-04-26T21:26:06.125 INFO:tasks.workunit.client.1.smithi120.stdout:1/763: mknod d6/d9/dd4/de0/d1b/d89/d8c/cf8 0 2024-04-26T21:26:06.126 INFO:tasks.workunit.client.0.smithi084.stdout:2/751: dwrite d6/d7/d68/f69 [0,4194304] 0 2024-04-26T21:26:06.126 INFO:tasks.workunit.client.1.smithi120.stdout:9/789: mkdir d0/d66/d93/db7/d10a 0 2024-04-26T21:26:06.127 INFO:tasks.workunit.client.0.smithi084.stdout:0/668: chown de/d2b/d77/fcb 190554 1 2024-04-26T21:26:06.128 INFO:tasks.workunit.client.0.smithi084.stdout:7/671: rename d6/d9/d12/d8b/fdc to d6/d1c/fe4 0 2024-04-26T21:26:06.129 INFO:tasks.workunit.client.1.smithi120.stdout:5/882: creat d2/dc/d1d/d21/db2/d109/f145 x:0 0 0 2024-04-26T21:26:06.131 INFO:tasks.workunit.client.0.smithi084.stdout:8/640: dwrite d4/d7/d15/d9d/fad [0,4194304] 0 2024-04-26T21:26:06.132 INFO:tasks.workunit.client.0.smithi084.stdout:9/557: write da/de/d16/d55/d93/dc3/d41/d67/f86 [1766616,75149] 0 2024-04-26T21:26:06.134 INFO:tasks.workunit.client.0.smithi084.stdout:9/558: fdatasync da/f23 0 2024-04-26T21:26:06.135 INFO:tasks.workunit.client.1.smithi120.stdout:0/984: creat d0/d3/dc/dd/d4b/dea/d106/f13f x:0 0 0 2024-04-26T21:26:06.138 INFO:tasks.workunit.client.0.smithi084.stdout:3/638: read d1/f77 [1100330,71636] 0 2024-04-26T21:26:06.138 INFO:tasks.workunit.client.0.smithi084.stdout:5/639: write d0/dc/f1c [1826962,113874] 0 2024-04-26T21:26:06.139 INFO:tasks.workunit.client.1.smithi120.stdout:3/882: write dd/de/df/d12/d48/d9b/dcb/fdc [796740,73233] 0 2024-04-26T21:26:06.140 INFO:tasks.workunit.client.1.smithi120.stdout:7/835: dwrite d7/d10/d97/fd3 [0,4194304] 0 2024-04-26T21:26:06.140 INFO:tasks.workunit.client.1.smithi120.stdout:4/846: creat d10/d12/da1/daf/f122 x:0 0 0 2024-04-26T21:26:06.142 INFO:tasks.workunit.client.1.smithi120.stdout:1/764: rmdir d6/d9/dd4/de0/d1b/d55 39 2024-04-26T21:26:06.142 INFO:tasks.workunit.client.0.smithi084.stdout:7/672: mkdir d6/d9/d12/d8b/d72/da0/d80/de5 0 2024-04-26T21:26:06.142 INFO:tasks.workunit.client.0.smithi084.stdout:0/669: mknod de/d2b/cd6 0 2024-04-26T21:26:06.144 INFO:tasks.workunit.client.0.smithi084.stdout:5/640: chown d0/dc/df 215 1 2024-04-26T21:26:06.147 INFO:tasks.workunit.client.1.smithi120.stdout:7/836: stat d7/d64/da6/d1a/d33/d34/d37/f3b 0 2024-04-26T21:26:06.147 INFO:tasks.workunit.client.1.smithi120.stdout:9/790: creat d0/d66/d93/f10b x:0 0 0 2024-04-26T21:26:06.148 INFO:tasks.workunit.client.1.smithi120.stdout:8/817: creat d5/d6/d34/d37/f108 x:0 0 0 2024-04-26T21:26:06.152 INFO:tasks.workunit.client.0.smithi084.stdout:3/639: chown d1/d2c/d2f/f18 604004104 1 2024-04-26T21:26:06.152 INFO:tasks.workunit.client.0.smithi084.stdout:6/625: sync 2024-04-26T21:26:06.153 INFO:tasks.workunit.client.0.smithi084.stdout:1/648: dread d2/f92 [0,4194304] 0 2024-04-26T21:26:06.153 INFO:tasks.workunit.client.0.smithi084.stdout:7/673: creat d6/d9/d12/d8b/d72/fe6 x:0 0 0 2024-04-26T21:26:06.155 INFO:tasks.workunit.client.1.smithi120.stdout:5/883: rmdir d2/dc/d1d/d21/d66/d6a/d8c/daa 39 2024-04-26T21:26:06.156 INFO:tasks.workunit.client.1.smithi120.stdout:9/791: write d0/d6/d4d/dce/ff2 [503484,48693] 0 2024-04-26T21:26:06.167 INFO:tasks.workunit.client.1.smithi120.stdout:3/883: unlink dd/de/df/db6/l62 0 2024-04-26T21:26:06.168 INFO:tasks.workunit.client.0.smithi084.stdout:3/640: symlink d1/d24/d27/d3a/d81/ldf 0 2024-04-26T21:26:06.168 INFO:tasks.workunit.client.0.smithi084.stdout:1/649: symlink d2/d9/d15/d9f/ld9 0 2024-04-26T21:26:06.171 INFO:tasks.workunit.client.0.smithi084.stdout:7/674: chown d6/d9/d12/d19/f7e 17604663 1 2024-04-26T21:26:06.174 INFO:tasks.workunit.client.0.smithi084.stdout:5/641: dwrite d0/dc/df/d31/d45/f7d [0,4194304] 0 2024-04-26T21:26:06.177 INFO:tasks.workunit.client.1.smithi120.stdout:5/884: rename d2/dc/d1d/d21/d66/f27 to d2/dc/d1d/d21/d66/d85/f146 0 2024-04-26T21:26:06.178 INFO:tasks.workunit.client.0.smithi084.stdout:6/626: mkdir d3/de/d15/d40/dcd 0 2024-04-26T21:26:06.178 INFO:tasks.workunit.client.1.smithi120.stdout:9/792: creat d0/d6/d4d/d65/dec/d77/f10c x:0 0 0 2024-04-26T21:26:06.179 INFO:tasks.workunit.client.0.smithi084.stdout:6/627: stat d3/d18/f38 0 2024-04-26T21:26:06.181 INFO:tasks.workunit.client.1.smithi120.stdout:6/858: dread d4/db/d10/dd/d28/d9e/daf/dd3/ff3 [0,4194304] 0 2024-04-26T21:26:06.188 INFO:tasks.workunit.client.1.smithi120.stdout:5/885: write d2/dc/d1d/d21/d77/d79/f8e [3051278,93780] 0 2024-04-26T21:26:06.190 INFO:tasks.workunit.client.1.smithi120.stdout:1/765: dwrite d6/d9/dd4/de0/d2d/d98/d56/dad/fef [0,4194304] 0 2024-04-26T21:26:06.191 INFO:tasks.workunit.client.0.smithi084.stdout:5/642: rmdir d0/dc 39 2024-04-26T21:26:06.192 INFO:tasks.workunit.client.1.smithi120.stdout:0/985: dwrite d0/d3/dc/d12/f42 [0,4194304] 0 2024-04-26T21:26:06.192 INFO:tasks.workunit.client.0.smithi084.stdout:5/643: read d0/d49/d56/f6f [562427,18816] 0 2024-04-26T21:26:06.193 INFO:tasks.workunit.client.1.smithi120.stdout:6/859: write d4/db/d25/d6d/dbd/dc4/ff9 [836981,67713] 0 2024-04-26T21:26:06.193 INFO:tasks.workunit.client.1.smithi120.stdout:9/793: rename d0/dd/d3a/d5c/f8d to d0/d66/d93/db7/dc7/f10d 0 2024-04-26T21:26:06.195 INFO:tasks.workunit.client.1.smithi120.stdout:1/766: readlink d6/d9/dd4/de0/d1d/d2c/lac 0 2024-04-26T21:26:06.196 INFO:tasks.workunit.client.1.smithi120.stdout:5/886: creat d2/d30/d93/d107/d36/f147 x:0 0 0 2024-04-26T21:26:06.198 INFO:tasks.workunit.client.0.smithi084.stdout:3/641: mkdir d1/d24/de0 0 2024-04-26T21:26:06.199 INFO:tasks.workunit.client.1.smithi120.stdout:1/767: stat d6/d9/dd4/de0/d85 0 2024-04-26T21:26:06.200 INFO:tasks.workunit.client.1.smithi120.stdout:9/794: symlink d0/d6/d4d/d65/dec/d77/d9a/ddd/l10e 0 2024-04-26T21:26:06.202 INFO:tasks.workunit.client.1.smithi120.stdout:5/887: rename d2/d82/f91 to d2/dc/f148 0 2024-04-26T21:26:06.208 INFO:tasks.workunit.client.0.smithi084.stdout:7/675: mkdir d6/de7 0 2024-04-26T21:26:06.210 INFO:tasks.workunit.client.1.smithi120.stdout:5/888: truncate d2/dc/d1d/d21/d66/d6a/d8c/fa6 200878 0 2024-04-26T21:26:06.211 INFO:tasks.workunit.client.0.smithi084.stdout:6/628: dread - d3/de/d1a/d2f/d4c/fcc zero size 2024-04-26T21:26:06.211 INFO:tasks.workunit.client.1.smithi120.stdout:1/768: link d6/d14/l53 d6/d9/dd4/de0/d1b/lf9 0 2024-04-26T21:26:06.214 INFO:tasks.workunit.client.0.smithi084.stdout:3/642: mknod d1/d24/de0/ce1 0 2024-04-26T21:26:06.215 INFO:tasks.workunit.client.0.smithi084.stdout:7/676: read - d6/d9/d12/d8b/d72/fb7 zero size 2024-04-26T21:26:06.215 INFO:tasks.workunit.client.1.smithi120.stdout:5/889: creat d2/d1b/dd2/deb/f149 x:0 0 0 2024-04-26T21:26:06.215 INFO:tasks.workunit.client.0.smithi084.stdout:9/559: dread da/de/d16/d55/d93/dc3/d41/d43/d48/d61/fc1 [0,4194304] 0 2024-04-26T21:26:06.217 INFO:tasks.workunit.client.1.smithi120.stdout:1/769: creat d6/d14/ffa x:0 0 0 2024-04-26T21:26:06.218 INFO:tasks.workunit.client.0.smithi084.stdout:4/588: dwrite d5/d25/f3e [0,4194304] 0 2024-04-26T21:26:06.220 INFO:tasks.workunit.client.0.smithi084.stdout:3/643: chown d1/d2c/d2f/d31/d52/lcd 0 1 2024-04-26T21:26:06.221 INFO:tasks.workunit.client.1.smithi120.stdout:1/770: truncate d6/d14/ffa 174874 0 2024-04-26T21:26:06.223 INFO:tasks.workunit.client.0.smithi084.stdout:5/644: dwrite d0/fe [0,4194304] 0 2024-04-26T21:26:06.227 INFO:tasks.workunit.client.1.smithi120.stdout:1/771: mkdir d6/d9/dd4/de0/d85/dfb 0 2024-04-26T21:26:06.228 INFO:tasks.workunit.client.0.smithi084.stdout:9/560: write da/de/d16/d55/d93/dc3/d41/d67/f9b [967616,31159] 0 2024-04-26T21:26:06.229 INFO:tasks.workunit.client.0.smithi084.stdout:6/629: mknod d3/de/d1a/d2f/cce 0 2024-04-26T21:26:06.230 INFO:tasks.workunit.client.0.smithi084.stdout:7/677: truncate d6/d9/d12/d8b/d72/da0/fa1 779448 0 2024-04-26T21:26:06.230 INFO:tasks.workunit.client.0.smithi084.stdout:6/630: dread - d3/de/d9e/faa zero size 2024-04-26T21:26:06.233 INFO:tasks.workunit.client.0.smithi084.stdout:7/678: chown d6/d9/d12/d8b/fa7 285230597 1 2024-04-26T21:26:06.233 INFO:tasks.workunit.client.0.smithi084.stdout:4/589: truncate d5/f1a 2119405 0 2024-04-26T21:26:06.241 INFO:tasks.workunit.client.1.smithi120.stdout:1/772: rename d6/d9/dd4/de0/d1d/d2c/d58/faf to d6/d9/dd4/de0/d1b/d3b/d6d/dc9/ffc 0 2024-04-26T21:26:06.243 INFO:tasks.workunit.client.0.smithi084.stdout:5/645: write d0/dc/df/d31/f9c [3870676,63681] 0 2024-04-26T21:26:06.248 INFO:tasks.workunit.client.1.smithi120.stdout:1/773: symlink d6/lfd 0 2024-04-26T21:26:06.253 INFO:tasks.workunit.client.1.smithi120.stdout:7/837: write d7/d19/f44 [1439492,2527] 0 2024-04-26T21:26:06.255 INFO:tasks.workunit.client.0.smithi084.stdout:4/590: fsync d5/d7/d65/d7f/f7a 0 2024-04-26T21:26:06.261 INFO:tasks.workunit.client.1.smithi120.stdout:1/774: rename d6/d9/dd4/de0/d2d/d48/d86/dc1/fcf to d6/d9/dd4/de0/d1d/d5d/d67/de3/ffe 0 2024-04-26T21:26:06.262 INFO:tasks.workunit.client.0.smithi084.stdout:2/752: dwrite d6/d7/d3d/d79/d85/fbf [0,4194304] 0 2024-04-26T21:26:06.262 INFO:tasks.workunit.client.1.smithi120.stdout:4/847: dwrite d10/d28/d73/f83 [0,4194304] 0 2024-04-26T21:26:06.263 INFO:tasks.workunit.client.0.smithi084.stdout:6/631: rmdir d3/de/d15/d23/d90/da2/dc0 0 2024-04-26T21:26:06.267 INFO:tasks.workunit.client.1.smithi120.stdout:3/884: truncate dd/de/df/dda/d24/fc1 378616 0 2024-04-26T21:26:06.269 INFO:tasks.workunit.client.0.smithi084.stdout:9/561: dwrite da/de/d16/d55/d93/dc3/d41/d43/fb2 [0,4194304] 0 2024-04-26T21:26:06.269 INFO:tasks.workunit.client.1.smithi120.stdout:8/818: dwrite d5/d6/d11/d32/f8f [0,4194304] 0 2024-04-26T21:26:06.271 INFO:tasks.workunit.client.0.smithi084.stdout:2/753: creat d6/d1b/ffc x:0 0 0 2024-04-26T21:26:06.271 INFO:tasks.workunit.client.1.smithi120.stdout:4/848: rename d10/d28/f49 to d10/d28/dd9/ddd/dee/f123 0 2024-04-26T21:26:06.272 INFO:tasks.workunit.client.1.smithi120.stdout:6/860: write d4/db/d10/dd/d4e/d60/fb1 [226756,93300] 0 2024-04-26T21:26:06.282 INFO:tasks.workunit.client.0.smithi084.stdout:0/670: sync 2024-04-26T21:26:06.286 INFO:tasks.workunit.client.0.smithi084.stdout:7/679: dwrite d6/d9/d12/d19/f3c [0,4194304] 0 2024-04-26T21:26:06.286 INFO:tasks.workunit.client.0.smithi084.stdout:0/671: readlink de/l85 0 2024-04-26T21:26:06.287 INFO:tasks.workunit.client.1.smithi120.stdout:6/861: mkdir d4/db/d25/d6d/deb/d11e 0 2024-04-26T21:26:06.290 INFO:tasks.workunit.client.1.smithi120.stdout:1/775: dwrite d6/fe4 [0,4194304] 0 2024-04-26T21:26:06.296 INFO:tasks.workunit.client.0.smithi084.stdout:8/641: truncate d4/d6/db/d1e/d22/d39/f93 2355513 0 2024-04-26T21:26:06.301 INFO:tasks.workunit.client.0.smithi084.stdout:4/591: dwrite d5/d2e/d5f/f51 [0,4194304] 0 2024-04-26T21:26:06.301 INFO:tasks.workunit.client.0.smithi084.stdout:2/754: truncate d6/d7/d3d/d15/d1f/d39/d20/d36/fe7 1011529 0 2024-04-26T21:26:06.301 INFO:tasks.workunit.client.1.smithi120.stdout:0/986: dwrite d0/d3/dc/dd/d1b/d24/d7d/d9f/d127/f100 [0,4194304] 0 2024-04-26T21:26:06.301 INFO:tasks.workunit.client.0.smithi084.stdout:1/650: dwrite d2/d9/d67/f6a [0,4194304] 0 2024-04-26T21:26:06.306 INFO:tasks.workunit.client.0.smithi084.stdout:3/644: truncate d1/d2c/d2f/f96 968645 0 2024-04-26T21:26:06.310 INFO:tasks.workunit.client.0.smithi084.stdout:8/642: mknod d4/d7/d15/d37/cb5 0 2024-04-26T21:26:06.311 INFO:tasks.workunit.client.1.smithi120.stdout:5/890: dwrite d2/d30/d93/d107/d36/f40 [0,4194304] 0 2024-04-26T21:26:06.313 INFO:tasks.workunit.client.1.smithi120.stdout:8/819: dwrite d5/d6/d34/d42/f84 [4194304,4194304] 0 2024-04-26T21:26:06.323 INFO:tasks.workunit.client.0.smithi084.stdout:0/672: dwrite de/d2b/d64/d81/d9a/fd2 [0,4194304] 0 2024-04-26T21:26:06.325 INFO:tasks.workunit.client.1.smithi120.stdout:6/862: dwrite d4/db/d10/dd/d28/d9e/f10d [0,4194304] 0 2024-04-26T21:26:06.325 INFO:tasks.workunit.client.1.smithi120.stdout:8/820: write d5/d6/d34/d42/d4a/deb/d88/fc4 [415919,43741] 0 2024-04-26T21:26:06.327 INFO:tasks.workunit.client.0.smithi084.stdout:3/645: mknod d1/ce2 0 2024-04-26T21:26:06.330 INFO:tasks.workunit.client.1.smithi120.stdout:9/795: dread d0/d6/d4d/d65/dec/d77/fb1 [0,4194304] 0 2024-04-26T21:26:06.332 INFO:tasks.workunit.client.0.smithi084.stdout:8/643: creat d4/d6/db/d1e/d22/d39/d4a/fb6 x:0 0 0 2024-04-26T21:26:06.336 INFO:tasks.workunit.client.0.smithi084.stdout:0/673: mknod de/d2b/d45/d63/da7/cd7 0 2024-04-26T21:26:06.337 INFO:tasks.workunit.client.1.smithi120.stdout:6/863: dread - d4/db/d25/d6d/ff1 zero size 2024-04-26T21:26:06.344 INFO:tasks.workunit.client.1.smithi120.stdout:0/987: link d0/d3/dc/dd/d1b/d24/d7d/d9f/d127/d113/l13e d0/d3/d51/d70/d71/l140 0 2024-04-26T21:26:06.344 INFO:tasks.workunit.client.1.smithi120.stdout:7/838: write d7/d64/da6/d1f/d28/f6f [1916184,120495] 0 2024-04-26T21:26:06.344 INFO:tasks.workunit.client.1.smithi120.stdout:9/796: symlink d0/d6/d4d/d65/dec/l10f 0 2024-04-26T21:26:06.345 INFO:tasks.workunit.client.1.smithi120.stdout:8/821: symlink d5/d6/d34/d37/db8/ddc/l109 0 2024-04-26T21:26:06.347 INFO:tasks.workunit.client.0.smithi084.stdout:3/646: creat d1/d2c/d2f/d31/d55/da4/fe3 x:0 0 0 2024-04-26T21:26:06.348 INFO:tasks.workunit.client.1.smithi120.stdout:4/849: write d10/d12/f14 [5807213,88670] 0 2024-04-26T21:26:06.349 INFO:tasks.workunit.client.1.smithi120.stdout:7/839: write d7/d19/d60/f76 [2294962,115796] 0 2024-04-26T21:26:06.351 INFO:tasks.workunit.client.1.smithi120.stdout:9/797: creat d0/dd/d3a/d5c/d9f/f110 x:0 0 0 2024-04-26T21:26:06.351 INFO:tasks.workunit.client.0.smithi084.stdout:3/647: write d1/d2c/d2f/d94/fba [2135772,99169] 0 2024-04-26T21:26:06.356 INFO:tasks.workunit.client.0.smithi084.stdout:1/651: dwrite d2/d54/d5e/d66/f36 [4194304,4194304] 0 2024-04-26T21:26:06.358 INFO:tasks.workunit.client.1.smithi120.stdout:4/850: dread d10/d28/dd9/ddd/dee/dd0/dd4/d86/f113 [0,4194304] 0 2024-04-26T21:26:06.358 INFO:tasks.workunit.client.1.smithi120.stdout:9/798: unlink d0/dd/l25 0 2024-04-26T21:26:06.363 INFO:tasks.workunit.client.0.smithi084.stdout:8/644: unlink d4/d6/db/d1e/d22/l59 0 2024-04-26T21:26:06.367 INFO:tasks.workunit.client.1.smithi120.stdout:9/799: mkdir d0/dd/d3a/dae/ded/d111 0 2024-04-26T21:26:06.367 INFO:tasks.workunit.client.0.smithi084.stdout:9/562: write da/de/d16/d55/d93/dc3/f73 [1130033,11762] 0 2024-04-26T21:26:06.370 INFO:tasks.workunit.client.1.smithi120.stdout:5/891: read d2/d82/d96/fe8 [39489,32416] 0 2024-04-26T21:26:06.370 INFO:tasks.workunit.client.1.smithi120.stdout:6/864: dread d4/db/f23 [4194304,4194304] 0 2024-04-26T21:26:06.371 INFO:tasks.workunit.client.1.smithi120.stdout:4/851: read d10/d12/fdc [782196,13418] 0 2024-04-26T21:26:06.372 INFO:tasks.workunit.client.0.smithi084.stdout:9/563: readlink da/de/d16/d55/d93/dc3/l68 0 2024-04-26T21:26:06.375 INFO:tasks.workunit.client.0.smithi084.stdout:0/674: symlink de/d2b/d77/d68/ld8 0 2024-04-26T21:26:06.375 INFO:tasks.workunit.client.1.smithi120.stdout:8/822: dread d5/d6/d34/d42/f84 [4194304,4194304] 0 2024-04-26T21:26:06.377 INFO:tasks.workunit.client.0.smithi084.stdout:6/632: dwrite d3/de/d15/d40/f60 [0,4194304] 0 2024-04-26T21:26:06.378 INFO:tasks.workunit.client.1.smithi120.stdout:6/865: chown d4/db/d10/d1a/d2b/d57/d67/d98/fc9 2856054 1 2024-04-26T21:26:06.384 INFO:tasks.workunit.client.1.smithi120.stdout:5/892: rename d2/d1b/f26 to d2/d1b/d89/d47/de4/d10f/f14a 0 2024-04-26T21:26:06.386 INFO:tasks.workunit.client.0.smithi084.stdout:3/648: symlink d1/d2c/d2f/d31/d55/d4e/d98/d9e/le4 0 2024-04-26T21:26:06.390 INFO:tasks.workunit.client.1.smithi120.stdout:6/866: rename d4/db/d10/dd to d4/db/d10/dd/d28/d9e/d11f 22 2024-04-26T21:26:06.396 INFO:tasks.workunit.client.0.smithi084.stdout:1/652: read d2/d54/d5e/d66/f2b [676877,59107] 0 2024-04-26T21:26:06.397 INFO:tasks.workunit.client.1.smithi120.stdout:9/800: dwrite d0/d6/d4d/d65/dec/d77/d9a/ddd/fe2 [0,4194304] 0 2024-04-26T21:26:06.402 INFO:tasks.workunit.client.0.smithi084.stdout:9/564: rmdir da 39 2024-04-26T21:26:06.407 INFO:tasks.workunit.client.0.smithi084.stdout:2/755: dread d6/d7/d3d/d15/d1f/d39/d20/d45/f97 [0,4194304] 0 2024-04-26T21:26:06.407 INFO:tasks.workunit.client.1.smithi120.stdout:7/840: write d7/d19/f51 [4144205,52988] 0 2024-04-26T21:26:06.411 INFO:tasks.workunit.client.0.smithi084.stdout:6/633: rename d3/de/c9b to d3/de/d1a/d2f/ccf 0 2024-04-26T21:26:06.411 INFO:tasks.workunit.client.1.smithi120.stdout:8/823: dwrite d5/d6/d11/d52/d27/d4f/d67/f7b [0,4194304] 0 2024-04-26T21:26:06.412 INFO:tasks.workunit.client.0.smithi084.stdout:3/649: mkdir d1/d24/d27/d3a/de5 0 2024-04-26T21:26:06.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:06 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:26:06.416 INFO:tasks.workunit.client.1.smithi120.stdout:3/885: dwrite dd/de/df/dda/d24/fc1 [0,4194304] 0 2024-04-26T21:26:06.417 INFO:tasks.workunit.client.1.smithi120.stdout:6/867: dwrite d4/d3d/dd1/ff7 [0,4194304] 0 2024-04-26T21:26:06.418 INFO:tasks.workunit.client.0.smithi084.stdout:1/653: symlink d2/d9/d15/d9f/lda 0 2024-04-26T21:26:06.422 INFO:tasks.workunit.client.0.smithi084.stdout:9/565: dread - da/de/d16/d55/d93/d95/fcf zero size 2024-04-26T21:26:06.424 INFO:tasks.workunit.client.0.smithi084.stdout:4/592: dread d5/d2e/d5f/d32/d46/f5c [0,4194304] 0 2024-04-26T21:26:06.424 INFO:tasks.workunit.client.0.smithi084.stdout:8/645: rmdir d4/d7/d15/d37/d52/db4 0 2024-04-26T21:26:06.429 INFO:tasks.workunit.client.0.smithi084.stdout:5/646: dread d0/dc/f43 [0,4194304] 0 2024-04-26T21:26:06.429 INFO:tasks.workunit.client.0.smithi084.stdout:2/756: creat d6/d7/d3d/d15/d1f/d22/de6/ffd x:0 0 0 2024-04-26T21:26:06.429 INFO:tasks.workunit.client.1.smithi120.stdout:6/868: fsync d4/db/d10/d1a/d2b/f93 0 2024-04-26T21:26:06.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:06 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:26:06.434 INFO:tasks.workunit.client.0.smithi084.stdout:6/634: symlink d3/de/d15/d5f/ld0 0 2024-04-26T21:26:06.434 INFO:tasks.workunit.client.1.smithi120.stdout:7/841: write d7/d64/da6/d1f/f36 [4004354,39254] 0 2024-04-26T21:26:06.435 INFO:tasks.workunit.client.1.smithi120.stdout:6/869: mkdir d4/d99/df4/d120 0 2024-04-26T21:26:06.435 INFO:tasks.workunit.client.0.smithi084.stdout:4/593: fdatasync d5/d25/d99/fb1 0 2024-04-26T21:26:06.437 INFO:tasks.workunit.client.1.smithi120.stdout:6/870: chown d4/d3d/fa7 516826 1 2024-04-26T21:26:06.437 INFO:tasks.workunit.client.1.smithi120.stdout:7/842: chown d7/d64/da6/d1a/d33 3329 1 2024-04-26T21:26:06.440 INFO:tasks.workunit.client.1.smithi120.stdout:7/843: stat d7/ff 0 2024-04-26T21:26:06.440 INFO:tasks.workunit.client.0.smithi084.stdout:9/566: creat da/de/d16/d55/d93/dc3/d41/d43/d48/d61/fd2 x:0 0 0 2024-04-26T21:26:06.440 INFO:tasks.workunit.client.0.smithi084.stdout:3/650: creat d1/d24/dbb/fe6 x:0 0 0 2024-04-26T21:26:06.442 INFO:tasks.workunit.client.0.smithi084.stdout:2/757: symlink d6/d7/d3d/d15/d1f/d6c/lfe 0 2024-04-26T21:26:06.445 INFO:tasks.workunit.client.1.smithi120.stdout:7/844: rmdir d7/d64/da6/d1f/d28 39 2024-04-26T21:26:06.446 INFO:tasks.workunit.client.1.smithi120.stdout:9/801: dwrite d0/d6/fbd [0,4194304] 0 2024-04-26T21:26:06.447 INFO:tasks.workunit.client.1.smithi120.stdout:6/871: creat d4/db/d10/dd/d28/d9e/daf/dff/d117/f121 x:0 0 0 2024-04-26T21:26:06.448 INFO:tasks.workunit.client.1.smithi120.stdout:3/886: dwrite dd/de/df/dda/d24/fc1 [0,4194304] 0 2024-04-26T21:26:06.449 INFO:tasks.workunit.client.0.smithi084.stdout:4/594: mknod d5/d25/d35/d60/cbf 0 2024-04-26T21:26:06.455 INFO:tasks.workunit.client.1.smithi120.stdout:6/872: write d4/db/d10/dd/f36 [3282060,23253] 0 2024-04-26T21:26:06.460 INFO:tasks.workunit.client.0.smithi084.stdout:8/646: creat d4/d7/d15/fb7 x:0 0 0 2024-04-26T21:26:06.461 INFO:tasks.workunit.client.0.smithi084.stdout:6/635: dwrite d3/de/d15/d40/fb6 [0,4194304] 0 2024-04-26T21:26:06.463 INFO:tasks.workunit.client.0.smithi084.stdout:4/595: creat d5/d25/d99/da0/fc0 x:0 0 0 2024-04-26T21:26:06.464 INFO:tasks.workunit.client.1.smithi120.stdout:3/887: creat dd/de/d83/d64/f125 x:0 0 0 2024-04-26T21:26:06.466 INFO:tasks.workunit.client.1.smithi120.stdout:7/845: link d7/d10/d97/d115/d7b/l8d d7/d64/da6/d1f/d7d/l11a 0 2024-04-26T21:26:06.473 INFO:tasks.workunit.client.0.smithi084.stdout:5/647: rmdir d0/dc/df/d31/d63/d8a/dca 0 2024-04-26T21:26:06.474 INFO:tasks.workunit.client.1.smithi120.stdout:7/846: getdents d7/d64/da6/d1a/d50/d10d 0 2024-04-26T21:26:06.476 INFO:tasks.workunit.client.1.smithi120.stdout:2/862: sync 2024-04-26T21:26:06.477 INFO:tasks.workunit.client.0.smithi084.stdout:9/567: creat da/de/d16/d55/d93/dc3/d41/d43/fd3 x:0 0 0 2024-04-26T21:26:06.478 INFO:tasks.workunit.client.0.smithi084.stdout:7/680: sync 2024-04-26T21:26:06.478 INFO:tasks.workunit.client.1.smithi120.stdout:3/888: unlink dd/de/df/dda/d24/d9d/d86/dd3/ddb/da9/le3 0 2024-04-26T21:26:06.480 INFO:tasks.workunit.client.0.smithi084.stdout:4/596: truncate d5/d25/d35/d60/d6d/fb6 312920 0 2024-04-26T21:26:06.481 INFO:tasks.workunit.client.0.smithi084.stdout:7/681: mkdir d6/d9/de8 0 2024-04-26T21:26:06.482 INFO:tasks.workunit.client.1.smithi120.stdout:7/847: mknod d7/d64/c11b 0 2024-04-26T21:26:06.482 INFO:tasks.workunit.client.1.smithi120.stdout:9/802: dwrite d0/d66/d93/db7/dc7/fef [0,4194304] 0 2024-04-26T21:26:06.484 INFO:tasks.workunit.client.0.smithi084.stdout:4/597: mknod d5/d25/d35/cc1 0 2024-04-26T21:26:06.484 INFO:tasks.workunit.client.1.smithi120.stdout:6/873: dread d4/db/d10/d22/d56/d94/fd7 [0,4194304] 0 2024-04-26T21:26:06.486 INFO:tasks.workunit.client.0.smithi084.stdout:6/636: dwrite d3/de/d15/d40/fb6 [0,4194304] 0 2024-04-26T21:26:06.494 INFO:tasks.workunit.client.1.smithi120.stdout:9/803: unlink d0/d6/d4d/d65/dec/d2d/f6c 0 2024-04-26T21:26:06.495 INFO:tasks.workunit.client.1.smithi120.stdout:9/804: stat d0/fa 0 2024-04-26T21:26:06.495 INFO:tasks.workunit.client.1.smithi120.stdout:6/874: getdents d4/db/d25/d6d/dbd/d11d 0 2024-04-26T21:26:06.496 INFO:tasks.workunit.client.0.smithi084.stdout:6/637: symlink d3/de/d1a/d43/d72/ld1 0 2024-04-26T21:26:06.497 INFO:tasks.workunit.client.0.smithi084.stdout:0/675: sync 2024-04-26T21:26:06.499 INFO:tasks.workunit.client.0.smithi084.stdout:7/682: creat d6/d9/d12/d19/fe9 x:0 0 0 2024-04-26T21:26:06.501 INFO:tasks.workunit.client.0.smithi084.stdout:9/568: link da/de/d16/d55/d93/dc3/f2a da/de/d16/d55/d93/dc3/d41/d43/d48/dce/fd4 0 2024-04-26T21:26:06.504 INFO:tasks.workunit.client.0.smithi084.stdout:6/638: creat d3/de/d1a/d43/d75/d9c/fd2 x:0 0 0 2024-04-26T21:26:06.505 INFO:tasks.workunit.client.1.smithi120.stdout:3/889: dwrite dd/de/df/dda/f4b [4194304,4194304] 0 2024-04-26T21:26:06.507 INFO:tasks.workunit.client.1.smithi120.stdout:3/890: fsync dd/f109 0 2024-04-26T21:26:06.507 INFO:tasks.workunit.client.0.smithi084.stdout:4/598: dwrite d5/fbc [0,4194304] 0 2024-04-26T21:26:06.512 INFO:tasks.workunit.client.1.smithi120.stdout:9/805: getdents d0/dd/d45 0 2024-04-26T21:26:06.513 INFO:tasks.workunit.client.0.smithi084.stdout:1/654: dread d2/d54/d5e/d66/d3a/fa3 [0,4194304] 0 2024-04-26T21:26:06.514 INFO:tasks.workunit.client.0.smithi084.stdout:6/639: unlink d3/de/f61 0 2024-04-26T21:26:06.517 INFO:tasks.workunit.client.0.smithi084.stdout:6/640: chown d3/d18/d81/f8a 0 1 2024-04-26T21:26:06.518 INFO:tasks.workunit.client.0.smithi084.stdout:3/651: write d1/d2c/d2f/d31/d55/da4/fb9 [1855397,2303] 0 2024-04-26T21:26:06.520 INFO:tasks.workunit.client.1.smithi120.stdout:3/891: rmdir dd/de/df/dda/de6 39 2024-04-26T21:26:06.520 INFO:tasks.workunit.client.0.smithi084.stdout:2/758: truncate d6/d7/d3d/d79/d85/fbf 3438912 0 2024-04-26T21:26:06.524 INFO:tasks.workunit.client.0.smithi084.stdout:2/759: fdatasync d6/d7/d3d/ff4 0 2024-04-26T21:26:06.524 INFO:tasks.workunit.client.0.smithi084.stdout:8/647: truncate d4/d7/f16 8637548 0 2024-04-26T21:26:06.528 INFO:tasks.workunit.client.1.smithi120.stdout:7/848: dwrite d7/d64/da6/d1f/d28/d4c/f89 [0,4194304] 0 2024-04-26T21:26:06.532 INFO:tasks.workunit.client.0.smithi084.stdout:4/599: mkdir d5/d7/d65/d90/d91/dba/dc2 0 2024-04-26T21:26:06.535 INFO:tasks.workunit.client.0.smithi084.stdout:2/760: read d6/d7/d3d/d15/d1f/d39/fe [2737092,123234] 0 2024-04-26T21:26:06.536 INFO:tasks.workunit.client.0.smithi084.stdout:3/652: mkdir d1/d2c/d2f/d31/d55/da4/de7 0 2024-04-26T21:26:06.538 INFO:tasks.workunit.client.1.smithi120.stdout:9/806: creat d0/d6/d4d/d65/dec/f112 x:0 0 0 2024-04-26T21:26:06.539 INFO:tasks.workunit.client.0.smithi084.stdout:6/641: mkdir d3/de/d15/d5f/dc1/dd3 0 2024-04-26T21:26:06.539 INFO:tasks.workunit.client.0.smithi084.stdout:8/648: stat d4/c7e 0 2024-04-26T21:26:06.541 INFO:tasks.workunit.client.1.smithi120.stdout:7/849: rename d7/d64/da6/d2f/f41 to d7/d64/da6/d1f/d28/f11c 0 2024-04-26T21:26:06.544 INFO:tasks.workunit.client.0.smithi084.stdout:9/569: rename da/de/d16/d55 to da/dd5 0 2024-04-26T21:26:06.547 INFO:tasks.workunit.client.1.smithi120.stdout:9/807: getdents d0/dd/d3a/d5c/d98/d103 0 2024-04-26T21:26:06.547 INFO:tasks.workunit.client.0.smithi084.stdout:6/642: mknod d3/d18/d37/cd4 0 2024-04-26T21:26:06.548 INFO:tasks.workunit.client.1.smithi120.stdout:2/863: dread d4/fdf [0,4194304] 0 2024-04-26T21:26:06.549 INFO:tasks.workunit.client.0.smithi084.stdout:7/683: write d6/d9/d89/f99 [754991,127039] 0 2024-04-26T21:26:06.549 INFO:tasks.workunit.client.1.smithi120.stdout:9/808: chown d0/f4f 39607 1 2024-04-26T21:26:06.551 INFO:tasks.workunit.client.1.smithi120.stdout:6/875: dwrite d4/db/d10/d1a/d2b/f4c [0,4194304] 0 2024-04-26T21:26:06.554 INFO:tasks.workunit.client.0.smithi084.stdout:2/761: mknod d6/d7/d68/cff 0 2024-04-26T21:26:06.554 INFO:tasks.workunit.client.1.smithi120.stdout:9/809: stat d0/d6/d4d/d65/dec/d77/d9a/ddd/fe2 0 2024-04-26T21:26:06.555 INFO:tasks.workunit.client.0.smithi084.stdout:7/684: dread - d6/d1c/fe4 zero size 2024-04-26T21:26:06.559 INFO:tasks.workunit.client.1.smithi120.stdout:9/810: dread - d0/d6/fdb zero size 2024-04-26T21:26:06.560 INFO:tasks.workunit.client.0.smithi084.stdout:6/643: unlink d3/d18/d37/l67 0 2024-04-26T21:26:06.560 INFO:tasks.workunit.client.0.smithi084.stdout:0/676: dread de/d20/d4e/f6a [4194304,4194304] 0 2024-04-26T21:26:06.562 INFO:tasks.workunit.client.0.smithi084.stdout:4/600: creat d5/d2e/d5f/fc3 x:0 0 0 2024-04-26T21:26:06.562 INFO:tasks.workunit.client.1.smithi120.stdout:6/876: rename d4/db/fba to d4/db/d10/dd/d28/d9e/daf/dff/f122 0 2024-04-26T21:26:06.563 INFO:tasks.workunit.client.1.smithi120.stdout:6/877: chown d4/d3d/l7a 187 1 2024-04-26T21:26:06.563 INFO:tasks.workunit.client.0.smithi084.stdout:1/655: dwrite d2/d19/f4d [0,4194304] 0 2024-04-26T21:26:06.571 INFO:tasks.workunit.client.1.smithi120.stdout:9/811: mknod d0/d6/d4d/d65/dec/d2d/d4b/d85/c113 0 2024-04-26T21:26:06.572 INFO:tasks.workunit.client.1.smithi120.stdout:7/850: mkdir d7/d64/da6/d1f/d28/d11d 0 2024-04-26T21:26:06.574 INFO:tasks.workunit.client.0.smithi084.stdout:5/648: dread d0/f64 [0,4194304] 0 2024-04-26T21:26:06.574 INFO:tasks.workunit.client.0.smithi084.stdout:8/649: dwrite d4/f5 [4194304,4194304] 0 2024-04-26T21:26:06.576 INFO:tasks.workunit.client.0.smithi084.stdout:0/677: write de/d2b/d45/d63/fc0 [118678,121506] 0 2024-04-26T21:26:06.581 INFO:tasks.workunit.client.0.smithi084.stdout:3/653: getdents d1/d2c/d2f/d31/d3b 0 2024-04-26T21:26:06.583 INFO:tasks.workunit.client.1.smithi120.stdout:7/851: mknod d7/d19/d60/de6/c11e 0 2024-04-26T21:26:06.585 INFO:tasks.workunit.client.1.smithi120.stdout:2/864: dread d4/f10 [0,4194304] 0 2024-04-26T21:26:06.588 INFO:tasks.workunit.client.0.smithi084.stdout:0/678: symlink de/d78/ld9 0 2024-04-26T21:26:06.590 INFO:tasks.workunit.client.1.smithi120.stdout:6/878: dread d4/db/d10/dd/d4e/f72 [4194304,4194304] 0 2024-04-26T21:26:06.593 INFO:tasks.workunit.client.1.smithi120.stdout:3/892: dread dd/de/f2f [0,4194304] 0 2024-04-26T21:26:06.593 INFO:tasks.workunit.client.0.smithi084.stdout:0/679: chown de/d2b/d77/d32/f3d 606415441 1 2024-04-26T21:26:06.594 INFO:tasks.workunit.client.0.smithi084.stdout:8/650: mkdir d4/d6/db/d1e/db8 0 2024-04-26T21:26:06.594 INFO:tasks.workunit.client.0.smithi084.stdout:3/654: dread d1/d24/f8d [0,4194304] 0 2024-04-26T21:26:06.595 INFO:tasks.workunit.client.1.smithi120.stdout:2/865: truncate d4/d1b/d2e/d50/f21 9389162 0 2024-04-26T21:26:06.595 INFO:tasks.workunit.client.0.smithi084.stdout:1/656: dread d2/d19/f40 [0,4194304] 0 2024-04-26T21:26:06.598 INFO:tasks.workunit.client.0.smithi084.stdout:9/570: mknod da/dd5/d93/dc3/d41/d43/dba/cd6 0 2024-04-26T21:26:06.599 INFO:tasks.workunit.client.1.smithi120.stdout:3/893: read dd/de/df/dda/d8d/feb [2230908,108785] 0 2024-04-26T21:26:06.599 INFO:tasks.workunit.client.1.smithi120.stdout:9/812: dwrite d0/dd/d3a/f6b [0,4194304] 0 2024-04-26T21:26:06.600 INFO:tasks.workunit.client.0.smithi084.stdout:3/655: symlink d1/d2c/d2f/d31/d3b/le8 0 2024-04-26T21:26:06.603 INFO:tasks.workunit.client.0.smithi084.stdout:4/601: getdents d5/d7 0 2024-04-26T21:26:06.603 INFO:tasks.workunit.client.1.smithi120.stdout:2/866: unlink d4/d1b/d2e/c4e 0 2024-04-26T21:26:06.604 INFO:tasks.workunit.client.0.smithi084.stdout:3/656: read - d1/d2c/d2f/d31/d55/fb4 zero size 2024-04-26T21:26:06.604 INFO:tasks.workunit.client.1.smithi120.stdout:9/813: read d0/dd/d3a/d5c/f9e [1739112,116198] 0 2024-04-26T21:26:06.606 INFO:tasks.workunit.client.0.smithi084.stdout:4/602: readlink l1 0 2024-04-26T21:26:06.606 INFO:tasks.workunit.client.0.smithi084.stdout:5/649: rename d0/d17/c34 to d0/d49/cce 0 2024-04-26T21:26:06.609 INFO:tasks.workunit.client.0.smithi084.stdout:9/571: write da/dd5/d93/dc3/d41/d43/f9f [948242,120949] 0 2024-04-26T21:26:06.616 INFO:tasks.workunit.client.1.smithi120.stdout:6/879: dwrite d4/f31 [0,4194304] 0 2024-04-26T21:26:06.616 INFO:tasks.workunit.client.1.smithi120.stdout:3/894: getdents dd/de/df/dda/d24/d9d 0 2024-04-26T21:26:06.618 INFO:tasks.workunit.client.0.smithi084.stdout:1/657: link d2/d54/d5e/d66/f18 d2/d54/d5e/dbe/fdb 0 2024-04-26T21:26:06.618 INFO:tasks.workunit.client.0.smithi084.stdout:4/603: fsync d5/d7/f63 0 2024-04-26T21:26:06.618 INFO:tasks.workunit.client.0.smithi084.stdout:8/651: link d4/d6/db/d1e/d22/d39/d4a/c58 d4/d6/db/d1e/d22/d96/cb9 0 2024-04-26T21:26:06.619 INFO:tasks.workunit.client.0.smithi084.stdout:9/572: mknod da/db3/cd7 0 2024-04-26T21:26:06.619 INFO:tasks.workunit.client.1.smithi120.stdout:2/867: rename d4/d1b/d2e/d50/ffe to d4/d1b/f121 0 2024-04-26T21:26:06.623 INFO:tasks.workunit.client.1.smithi120.stdout:6/880: stat d4/db/d10/dd/d28/d9e/daf/dd3/d107/l11b 0 2024-04-26T21:26:06.625 INFO:tasks.workunit.client.0.smithi084.stdout:5/650: dread d0/dc/df/d75/fba [0,4194304] 0 2024-04-26T21:26:06.627 INFO:tasks.workunit.client.0.smithi084.stdout:4/604: truncate d5/d25/f56 556074 0 2024-04-26T21:26:06.629 INFO:tasks.workunit.client.0.smithi084.stdout:8/652: creat d4/d7/d15/d37/d52/d69/fba x:0 0 0 2024-04-26T21:26:06.631 INFO:tasks.workunit.client.1.smithi120.stdout:6/881: truncate d4/db/d10/d22/f62 1126740 0 2024-04-26T21:26:06.631 INFO:tasks.workunit.client.0.smithi084.stdout:1/658: symlink d2/dc8/ldc 0 2024-04-26T21:26:06.633 INFO:tasks.workunit.client.0.smithi084.stdout:1/659: chown d2/d54/d5e/d66 6 1 2024-04-26T21:26:06.634 INFO:tasks.workunit.client.1.smithi120.stdout:7/852: dwrite d7/d64/da6/d1f/d28/dbb/f9f [0,4194304] 0 2024-04-26T21:26:06.635 INFO:tasks.workunit.client.0.smithi084.stdout:5/651: dread - d0/dc/df/d75/fb0 zero size 2024-04-26T21:26:06.635 INFO:tasks.workunit.client.0.smithi084.stdout:2/762: dread d6/d7/d3d/d15/d1f/d39/f48 [0,4194304] 0 2024-04-26T21:26:06.637 INFO:tasks.workunit.client.0.smithi084.stdout:8/653: mknod d4/d3a/d8c/cbb 0 2024-04-26T21:26:06.637 INFO:tasks.workunit.client.1.smithi120.stdout:3/895: getdents dd/d2a 0 2024-04-26T21:26:06.637 INFO:tasks.workunit.client.1.smithi120.stdout:2/868: rename d4/d1b/d56/d65/d8d/f9d to d4/d1b/d2e/d50/d14/d15/d6c/f122 0 2024-04-26T21:26:06.639 INFO:tasks.workunit.client.0.smithi084.stdout:2/763: write d6/d7/d3d/d15/ff9 [783739,65342] 0 2024-04-26T21:26:06.639 INFO:tasks.workunit.client.0.smithi084.stdout:4/605: mknod d5/d2e/cc4 0 2024-04-26T21:26:06.641 INFO:tasks.workunit.client.1.smithi120.stdout:3/896: fdatasync dd/de/d83/f45 0 2024-04-26T21:26:06.644 INFO:tasks.workunit.client.0.smithi084.stdout:8/654: read d4/d6/f47 [817403,114557] 0 2024-04-26T21:26:06.644 INFO:tasks.workunit.client.1.smithi120.stdout:9/814: dwrite d0/d6/d4d/d65/dec/d2d/d4b/f6f [0,4194304] 0 2024-04-26T21:26:06.648 INFO:tasks.workunit.client.1.smithi120.stdout:7/853: unlink d7/d10/d97/d99/fd6 0 2024-04-26T21:26:06.651 INFO:tasks.workunit.client.0.smithi084.stdout:4/606: creat d5/d7/d65/d7f/db8/fc5 x:0 0 0 2024-04-26T21:26:06.651 INFO:tasks.workunit.client.0.smithi084.stdout:2/764: creat d6/d7/d3d/d15/d1f/d41/f100 x:0 0 0 2024-04-26T21:26:06.654 INFO:tasks.workunit.client.0.smithi084.stdout:7/685: write d6/d9/d12/d8b/d72/da0/f58 [547799,4744] 0 2024-04-26T21:26:06.657 INFO:tasks.workunit.client.1.smithi120.stdout:7/854: creat d7/d64/da6/d1f/d7d/d8b/d94/f11f x:0 0 0 2024-04-26T21:26:06.660 INFO:tasks.workunit.client.1.smithi120.stdout:7/855: chown d7/d19/d60/de6/c11e 3 1 2024-04-26T21:26:06.664 INFO:tasks.workunit.client.0.smithi084.stdout:2/765: creat d6/d7/d3d/d4f/d90/f101 x:0 0 0 2024-04-26T21:26:06.666 INFO:tasks.workunit.client.0.smithi084.stdout:3/657: write d1/d24/f8d [365091,112371] 0 2024-04-26T21:26:06.666 INFO:tasks.workunit.client.1.smithi120.stdout:7/856: symlink d7/d64/da6/d2f/l120 0 2024-04-26T21:26:06.667 INFO:tasks.workunit.client.0.smithi084.stdout:1/660: write d2/d1b/f65 [731945,58033] 0 2024-04-26T21:26:06.668 INFO:tasks.workunit.client.1.smithi120.stdout:2/869: link d4/d1b/d56/d65/d8d/ca1 d4/d1b/d5c/c123 0 2024-04-26T21:26:06.669 INFO:tasks.workunit.client.1.smithi120.stdout:7/857: chown d7/d64/da6/d1a/d33/l118 699 1 2024-04-26T21:26:06.672 INFO:tasks.workunit.client.1.smithi120.stdout:6/882: dwrite d4/db/d10/dd/f90 [0,4194304] 0 2024-04-26T21:26:06.673 INFO:tasks.workunit.client.0.smithi084.stdout:6/644: dwrite d3/de/d15/f76 [0,4194304] 0 2024-04-26T21:26:06.674 INFO:tasks.workunit.client.1.smithi120.stdout:6/883: chown d4/db/d10/d22/d6c/c110 6210656 1 2024-04-26T21:26:06.681 INFO:tasks.workunit.client.0.smithi084.stdout:3/658: dread d1/f58 [0,4194304] 0 2024-04-26T21:26:06.681 INFO:tasks.workunit.client.1.smithi120.stdout:2/870: creat d4/d1b/d4f/f124 x:0 0 0 2024-04-26T21:26:06.683 INFO:tasks.workunit.client.0.smithi084.stdout:2/766: symlink d6/d7/d3d/d15/d1f/d41/l102 0 2024-04-26T21:26:06.683 INFO:tasks.workunit.client.0.smithi084.stdout:6/645: chown d3/de/d1a/c34 1 1 2024-04-26T21:26:06.684 INFO:tasks.workunit.client.1.smithi120.stdout:7/858: stat d7/d64/da6/d1f/d28/d4c/l10b 0 2024-04-26T21:26:06.687 INFO:tasks.workunit.client.1.smithi120.stdout:2/871: rename d4/d1b/l114 to d4/d1b/d5c/l125 0 2024-04-26T21:26:06.690 INFO:tasks.workunit.client.0.smithi084.stdout:7/686: truncate d6/d9/d12/d19/f49 2677019 0 2024-04-26T21:26:06.691 INFO:tasks.workunit.client.1.smithi120.stdout:6/884: rmdir d4/db/d25/d6d/deb/d11e 0 2024-04-26T21:26:06.691 INFO:tasks.workunit.client.1.smithi120.stdout:9/815: dwrite d0/d66/d93/db7/fd1 [0,4194304] 0 2024-04-26T21:26:06.691 INFO:tasks.workunit.client.1.smithi120.stdout:8/824: sync 2024-04-26T21:26:06.691 INFO:tasks.workunit.client.1.smithi120.stdout:0/988: sync 2024-04-26T21:26:06.691 INFO:tasks.workunit.client.1.smithi120.stdout:4/852: sync 2024-04-26T21:26:06.691 INFO:tasks.workunit.client.1.smithi120.stdout:5/893: sync 2024-04-26T21:26:06.691 INFO:tasks.workunit.client.1.smithi120.stdout:1/776: sync 2024-04-26T21:26:06.693 INFO:tasks.workunit.client.1.smithi120.stdout:2/872: dread - d4/d1b/d25/d2c/f8f zero size 2024-04-26T21:26:06.694 INFO:tasks.workunit.client.1.smithi120.stdout:6/885: stat d4/db/d10/dd/d4e/d60 0 2024-04-26T21:26:06.694 INFO:tasks.workunit.client.0.smithi084.stdout:1/661: creat d2/d54/d5e/d66/d2a/d2c/d45/dc9/fdd x:0 0 0 2024-04-26T21:26:06.697 INFO:tasks.workunit.client.1.smithi120.stdout:1/777: readlink d6/d9/dd4/de0/d2d/d48/ldf 0 2024-04-26T21:26:06.699 INFO:tasks.workunit.client.0.smithi084.stdout:3/659: unlink d1/d2c/d2f/d31/d55/da4/lb2 0 2024-04-26T21:26:06.699 INFO:tasks.workunit.client.0.smithi084.stdout:5/652: dread d0/dc/f1c [0,4194304] 0 2024-04-26T21:26:06.699 INFO:tasks.workunit.client.1.smithi120.stdout:0/989: chown d0/d3/dc/dd/fbb 91866 1 2024-04-26T21:26:06.699 INFO:tasks.workunit.client.0.smithi084.stdout:8/655: dwrite d4/d6/f8d [0,4194304] 0 2024-04-26T21:26:06.700 INFO:tasks.workunit.client.0.smithi084.stdout:2/767: fsync d6/d7/d3d/d79/fd3 0 2024-04-26T21:26:06.701 INFO:tasks.workunit.client.1.smithi120.stdout:6/886: write d4/db/d10/dd/d4e/f5f [3764996,52212] 0 2024-04-26T21:26:06.703 INFO:tasks.workunit.client.1.smithi120.stdout:8/825: write d5/d6/d34/d37/fdb [1198951,75406] 0 2024-04-26T21:26:06.704 INFO:tasks.workunit.client.0.smithi084.stdout:8/656: fsync d4/d6/f24 0 2024-04-26T21:26:06.707 INFO:tasks.workunit.client.0.smithi084.stdout:7/687: chown d6/d9/d12/d19/d7a/d84/l24 32 1 2024-04-26T21:26:06.708 INFO:tasks.workunit.client.0.smithi084.stdout:9/573: dread da/f34 [0,4194304] 0 2024-04-26T21:26:06.709 INFO:tasks.workunit.client.0.smithi084.stdout:6/646: getdents d3/de/d15/d5f 0 2024-04-26T21:26:06.710 INFO:tasks.workunit.client.0.smithi084.stdout:0/680: sync 2024-04-26T21:26:06.710 INFO:tasks.workunit.client.0.smithi084.stdout:1/662: creat d2/d54/d5e/d8d/fde x:0 0 0 2024-04-26T21:26:06.714 INFO:tasks.workunit.client.0.smithi084.stdout:2/768: fsync d6/d7/d3d/d79/fd3 0 2024-04-26T21:26:06.715 INFO:tasks.workunit.client.0.smithi084.stdout:4/607: dwrite d5/d10/f1b [0,4194304] 0 2024-04-26T21:26:06.715 INFO:tasks.workunit.client.0.smithi084.stdout:9/574: fsync da/d9e/faf 0 2024-04-26T21:26:06.717 INFO:tasks.workunit.client.0.smithi084.stdout:8/657: symlink d4/d6/db/d1e/d22/d39/d4a/lbc 0 2024-04-26T21:26:06.717 INFO:tasks.workunit.client.1.smithi120.stdout:4/853: symlink d10/d28/d73/da2/l124 0 2024-04-26T21:26:06.718 INFO:tasks.workunit.client.0.smithi084.stdout:6/647: creat d3/de/d1a/d43/d75/d9c/fd5 x:0 0 0 2024-04-26T21:26:06.719 INFO:tasks.workunit.client.0.smithi084.stdout:0/681: symlink de/d2b/d45/d94/lda 0 2024-04-26T21:26:06.720 INFO:tasks.workunit.client.1.smithi120.stdout:2/873: mknod d4/c126 0 2024-04-26T21:26:06.722 INFO:tasks.workunit.client.1.smithi120.stdout:3/897: dread dd/de/d83/db2/fb3 [0,4194304] 0 2024-04-26T21:26:06.723 INFO:tasks.workunit.client.0.smithi084.stdout:1/663: creat d2/d9/d15/d28/da0/fdf x:0 0 0 2024-04-26T21:26:06.724 INFO:tasks.workunit.client.0.smithi084.stdout:9/575: creat da/db3/fd8 x:0 0 0 2024-04-26T21:26:06.725 INFO:tasks.workunit.client.1.smithi120.stdout:3/898: fdatasync dd/de/df/dda/d24/f3a 0 2024-04-26T21:26:06.727 INFO:tasks.workunit.client.0.smithi084.stdout:4/608: mknod d5/d25/d35/d60/cc6 0 2024-04-26T21:26:06.728 INFO:tasks.workunit.client.0.smithi084.stdout:2/769: write d6/d7/d3d/d15/d1f/d22/f24 [3457593,53339] 0 2024-04-26T21:26:06.730 INFO:tasks.workunit.client.1.smithi120.stdout:0/990: dwrite d0/d3/dc/dd/f21 [4194304,4194304] 0 2024-04-26T21:26:06.735 INFO:tasks.workunit.client.0.smithi084.stdout:1/664: mkdir d2/d9/d15/d28/d69/d9d/de0 0 2024-04-26T21:26:06.736 INFO:tasks.workunit.client.0.smithi084.stdout:9/576: chown da/db3/c90 21 1 2024-04-26T21:26:06.736 INFO:tasks.workunit.client.0.smithi084.stdout:2/770: chown d6/d7/d3d/d79/cd5 963003 1 2024-04-26T21:26:06.736 INFO:tasks.workunit.client.1.smithi120.stdout:3/899: truncate dd/de/df/dda/d24/d9d/d86/dd3/ddb/f10c 235143 0 2024-04-26T21:26:06.737 INFO:tasks.workunit.client.0.smithi084.stdout:3/660: truncate d1/d2c/d2f/d31/d52/fa1 8173823 0 2024-04-26T21:26:06.737 INFO:tasks.workunit.client.1.smithi120.stdout:0/991: dread - d0/d3/dc/dd/d1b/d24/d73/db7/f12f zero size 2024-04-26T21:26:06.739 INFO:tasks.workunit.client.0.smithi084.stdout:6/648: truncate d3/d18/f8d 953816 0 2024-04-26T21:26:06.739 INFO:tasks.workunit.client.0.smithi084.stdout:0/682: dread de/d2b/f39 [0,4194304] 0 2024-04-26T21:26:06.741 INFO:tasks.workunit.client.0.smithi084.stdout:4/609: mkdir d5/d25/d99/dc7 0 2024-04-26T21:26:06.746 INFO:tasks.workunit.client.0.smithi084.stdout:7/688: dread d6/d9/f35 [0,4194304] 0 2024-04-26T21:26:06.746 INFO:tasks.workunit.client.1.smithi120.stdout:5/894: write d2/d1b/d89/d47/d8a/f11d [325597,96831] 0 2024-04-26T21:26:06.747 INFO:tasks.workunit.client.0.smithi084.stdout:6/649: rmdir d3/de/d15 39 2024-04-26T21:26:06.748 INFO:tasks.workunit.client.1.smithi120.stdout:7/859: truncate d7/d10/d97/d115/d7b/fc6 276093 0 2024-04-26T21:26:06.749 INFO:tasks.workunit.client.0.smithi084.stdout:3/661: chown d1/d2c/d2f/d31/d3b/fad 20 1 2024-04-26T21:26:06.750 INFO:tasks.workunit.client.1.smithi120.stdout:7/860: fsync d7/d64/da6/d1f/d7d/d8b/d94/f11f 0 2024-04-26T21:26:06.751 INFO:tasks.workunit.client.0.smithi084.stdout:5/653: dwrite d0/dc/df/d2a/f91 [0,4194304] 0 2024-04-26T21:26:06.755 INFO:tasks.workunit.client.0.smithi084.stdout:2/771: dread d6/d7/d3d/d15/d1f/d39/d43/f91 [0,4194304] 0 2024-04-26T21:26:06.761 INFO:tasks.workunit.client.0.smithi084.stdout:5/654: fsync d0/dc/df/f98 0 2024-04-26T21:26:06.762 INFO:tasks.workunit.client.0.smithi084.stdout:0/683: getdents de/d2b/d45/d63 0 2024-04-26T21:26:06.769 INFO:tasks.workunit.client.0.smithi084.stdout:3/662: rename d1/d2c/d2f/l9a to d1/d24/de0/le9 0 2024-04-26T21:26:06.769 INFO:tasks.workunit.client.0.smithi084.stdout:9/577: getdents da/dd5/d93/dc3/d41/d43/d48/dce 0 2024-04-26T21:26:06.770 INFO:tasks.workunit.client.0.smithi084.stdout:7/689: link d6/d1c/d51/l81 d6/d9/d12/d19/d20/d32/lea 0 2024-04-26T21:26:06.774 INFO:tasks.workunit.client.0.smithi084.stdout:2/772: creat d6/d7/d3d/d79/d85/f103 x:0 0 0 2024-04-26T21:26:06.775 INFO:tasks.workunit.client.0.smithi084.stdout:5/655: dread d0/dc/df/d31/fc9 [0,4194304] 0 2024-04-26T21:26:06.778 INFO:tasks.workunit.client.0.smithi084.stdout:9/578: chown da/de/d16/dbc 13075 1 2024-04-26T21:26:06.790 INFO:tasks.workunit.client.0.smithi084.stdout:2/773: chown d6/d7/fa1 2132 1 2024-04-26T21:26:06.791 INFO:tasks.workunit.client.0.smithi084.stdout:6/650: dwrite d3/de/d1a/d43/d75/d9c/fd2 [0,4194304] 0 2024-04-26T21:26:06.792 INFO:tasks.workunit.client.0.smithi084.stdout:4/610: write d5/d2e/d5f/f27 [1891145,32882] 0 2024-04-26T21:26:06.802 INFO:tasks.workunit.client.0.smithi084.stdout:8/658: dread d4/d7/d15/d37/d52/f67 [0,4194304] 0 2024-04-26T21:26:06.805 INFO:tasks.workunit.client.1.smithi120.stdout:6/887: creat d4/db/d10/ddb/f123 x:0 0 0 2024-04-26T21:26:06.807 INFO:tasks.workunit.client.1.smithi120.stdout:9/816: rename d0/d6/d4d/d65/dec/d77/d9a/ddd/l10e to d0/d6/d4d/d65/dec/d77/d9a/l114 0 2024-04-26T21:26:06.810 INFO:tasks.workunit.client.1.smithi120.stdout:9/817: stat d0/dd/d3a/de8/df5 0 2024-04-26T21:26:06.810 INFO:tasks.workunit.client.0.smithi084.stdout:0/684: symlink de/d2b/d77/d32/ldb 0 2024-04-26T21:26:06.812 INFO:tasks.workunit.client.0.smithi084.stdout:7/690: rename d6/d9/cb0 to d6/d9/d89/ceb 0 2024-04-26T21:26:06.812 INFO:tasks.workunit.client.0.smithi084.stdout:5/656: symlink d0/da2/lcf 0 2024-04-26T21:26:06.814 INFO:tasks.workunit.client.0.smithi084.stdout:2/774: symlink d6/d7/d3d/d79/dbe/l104 0 2024-04-26T21:26:06.816 INFO:tasks.workunit.client.0.smithi084.stdout:4/611: unlink d5/cd 0 2024-04-26T21:26:06.817 INFO:tasks.workunit.client.0.smithi084.stdout:1/665: dread d2/d54/d5e/d66/d2a/d2c/f34 [4194304,4194304] 0 2024-04-26T21:26:06.818 INFO:tasks.workunit.client.1.smithi120.stdout:7/861: write d7/d10/fe7 [681820,72667] 0 2024-04-26T21:26:06.819 INFO:tasks.workunit.client.1.smithi120.stdout:6/888: mknod d4/db/d10/dd/d4e/c124 0 2024-04-26T21:26:06.820 INFO:tasks.workunit.client.0.smithi084.stdout:6/651: mkdir d3/de/d1a/d43/dd6 0 2024-04-26T21:26:06.821 INFO:tasks.workunit.client.1.smithi120.stdout:4/854: rename d10/c53 to d10/d6b/d71/d9d/c125 0 2024-04-26T21:26:06.822 INFO:tasks.workunit.client.0.smithi084.stdout:0/685: read de/d20/f24 [3163965,40814] 0 2024-04-26T21:26:06.823 INFO:tasks.workunit.client.1.smithi120.stdout:6/889: truncate d4/db/d10/d1a/d2b/d57/d67/f32 4200678 0 2024-04-26T21:26:06.828 INFO:tasks.workunit.client.0.smithi084.stdout:3/663: dwrite d1/d2c/d2f/d31/d55/f82 [0,4194304] 0 2024-04-26T21:26:06.828 INFO:tasks.workunit.client.1.smithi120.stdout:2/874: unlink d4/d1b/d4f/d95/l101 0 2024-04-26T21:26:06.830 INFO:tasks.workunit.client.1.smithi120.stdout:2/875: chown d4/d1b/d25/c39 826 1 2024-04-26T21:26:06.831 INFO:tasks.workunit.client.0.smithi084.stdout:6/652: write d3/de/d1a/d2f/d4c/d58/f66 [688615,127320] 0 2024-04-26T21:26:06.832 INFO:tasks.workunit.client.0.smithi084.stdout:9/579: dwrite da/de/d1e/f74 [4194304,4194304] 0 2024-04-26T21:26:06.833 INFO:tasks.workunit.client.1.smithi120.stdout:9/818: rmdir d0/d6/d4d/d65/dec/d2d/d4b/d85 39 2024-04-26T21:26:06.834 INFO:tasks.workunit.client.0.smithi084.stdout:1/666: creat d2/d54/d5e/d66/d2a/d2c/d45/fe1 x:0 0 0 2024-04-26T21:26:06.836 INFO:tasks.workunit.client.1.smithi120.stdout:0/992: unlink d0/d3/dc/d12/d31/f43 0 2024-04-26T21:26:06.839 INFO:tasks.workunit.client.0.smithi084.stdout:9/580: write da/dd5/d93/dc3/f73 [1057080,106842] 0 2024-04-26T21:26:06.840 INFO:tasks.workunit.client.0.smithi084.stdout:5/657: write d0/dc/df/d51/f81 [3103504,68476] 0 2024-04-26T21:26:06.841 INFO:tasks.workunit.client.0.smithi084.stdout:2/775: rename d6/d7/d3d/d79/dbe to d6/d105 0 2024-04-26T21:26:06.842 INFO:tasks.workunit.client.0.smithi084.stdout:4/612: write d5/d25/f79 [506483,36946] 0 2024-04-26T21:26:06.845 INFO:tasks.workunit.client.1.smithi120.stdout:4/855: write d10/d28/dd9/ddd/dee/f123 [4172084,70338] 0 2024-04-26T21:26:06.849 INFO:tasks.workunit.client.1.smithi120.stdout:3/900: rmdir dd/d40/dff/d110 0 2024-04-26T21:26:06.850 INFO:tasks.workunit.client.0.smithi084.stdout:5/658: write d0/d49/f95 [614731,84983] 0 2024-04-26T21:26:06.852 INFO:tasks.workunit.client.1.smithi120.stdout:6/890: dread d4/db/d10/dd/d4e/f5f [0,4194304] 0 2024-04-26T21:26:06.854 INFO:tasks.workunit.client.0.smithi084.stdout:3/664: mkdir d1/dea 0 2024-04-26T21:26:06.854 INFO:tasks.workunit.client.0.smithi084.stdout:6/653: write d3/de/d15/d23/f2e [995389,77956] 0 2024-04-26T21:26:06.859 INFO:tasks.workunit.client.1.smithi120.stdout:5/895: rmdir d2/d9f 0 2024-04-26T21:26:06.860 INFO:tasks.workunit.client.1.smithi120.stdout:0/993: dread d0/d3/dc/dd/d1b/d24/d7d/d9f/d127/f100 [0,4194304] 0 2024-04-26T21:26:06.862 INFO:tasks.workunit.client.0.smithi084.stdout:4/613: getdents d5/d10/d15/d21 0 2024-04-26T21:26:06.863 INFO:tasks.workunit.client.0.smithi084.stdout:7/691: dwrite d6/d9/ff [0,4194304] 0 2024-04-26T21:26:06.863 INFO:tasks.workunit.client.1.smithi120.stdout:5/896: dread - d2/d30/d93/df1/f12d zero size 2024-04-26T21:26:06.864 INFO:tasks.workunit.client.0.smithi084.stdout:2/776: truncate d6/d7/d3d/d15/d1f/d39/d43/fcb 31168 0 2024-04-26T21:26:06.867 INFO:tasks.workunit.client.1.smithi120.stdout:7/862: dwrite d7/d64/da6/d1f/d28/f6f [0,4194304] 0 2024-04-26T21:26:06.867 INFO:tasks.workunit.client.0.smithi084.stdout:1/667: write d2/d19/f1e [2558904,105187] 0 2024-04-26T21:26:06.871 INFO:tasks.workunit.client.1.smithi120.stdout:2/876: creat d4/d1b/d2e/d50/d14/dc2/f127 x:0 0 0 2024-04-26T21:26:06.871 INFO:tasks.workunit.client.1.smithi120.stdout:4/856: chown d10/d28/dd9/ddd/dee/dd0/dd4/d86/la5 1555538 1 2024-04-26T21:26:06.872 INFO:tasks.workunit.client.0.smithi084.stdout:5/659: rename d0/f16 to d0/dc/df/d31/d72/d84/fd0 0 2024-04-26T21:26:06.876 INFO:tasks.workunit.client.0.smithi084.stdout:3/665: dread - d1/d2c/d2f/d31/d55/d4e/f8f zero size 2024-04-26T21:26:06.877 INFO:tasks.workunit.client.0.smithi084.stdout:9/581: write da/dd5/d93/dc3/d41/d67/f97 [160388,82752] 0 2024-04-26T21:26:06.881 INFO:tasks.workunit.client.0.smithi084.stdout:7/692: mkdir d6/d26/d40/dec 0 2024-04-26T21:26:06.884 INFO:tasks.workunit.client.0.smithi084.stdout:5/660: unlink d0/dc/df/d31/d72/fb2 0 2024-04-26T21:26:06.885 INFO:tasks.workunit.client.0.smithi084.stdout:0/686: dwrite de/d78/d9e/fce [8388608,4194304] 0 2024-04-26T21:26:06.886 INFO:tasks.workunit.client.0.smithi084.stdout:4/614: unlink d5/d10/da1/cbe 0 2024-04-26T21:26:06.886 INFO:tasks.workunit.client.1.smithi120.stdout:3/901: mknod dd/de/df/db6/dc5/d103/c126 0 2024-04-26T21:26:06.888 INFO:tasks.workunit.client.1.smithi120.stdout:3/902: write dd/de/df/dda/d24/d9d/d86/dd3/ddb/f9c [1317718,88838] 0 2024-04-26T21:26:06.891 INFO:tasks.workunit.client.1.smithi120.stdout:2/877: fsync d4/d1b/d25/d29/f116 0 2024-04-26T21:26:06.892 INFO:tasks.workunit.client.0.smithi084.stdout:7/693: dread - d6/d9/d12/d8b/d72/fd5 zero size 2024-04-26T21:26:06.892 INFO:tasks.workunit.client.0.smithi084.stdout:3/666: mknod d1/d2c/d2f/d31/d55/d4e/d7c/d7e/ceb 0 2024-04-26T21:26:06.895 INFO:tasks.workunit.client.1.smithi120.stdout:4/857: chown d10/d65/f9e 2045933891 1 2024-04-26T21:26:06.896 INFO:tasks.workunit.client.0.smithi084.stdout:9/582: read da/f19 [707507,69324] 0 2024-04-26T21:26:06.897 INFO:tasks.workunit.client.0.smithi084.stdout:4/615: truncate d5/d2e/f88 567039 0 2024-04-26T21:26:06.898 INFO:tasks.workunit.client.1.smithi120.stdout:3/903: stat dd/de/d83/d64/db0/d46 0 2024-04-26T21:26:06.898 INFO:tasks.workunit.client.0.smithi084.stdout:0/687: mknod de/d2b/d45/d63/da7/cdc 0 2024-04-26T21:26:06.902 INFO:tasks.workunit.client.0.smithi084.stdout:8/659: dread d4/d7/d15/d3c/f4b [0,4194304] 0 2024-04-26T21:26:06.903 INFO:tasks.workunit.client.0.smithi084.stdout:1/668: dwrite d2/d1b/f65 [0,4194304] 0 2024-04-26T21:26:06.905 INFO:tasks.workunit.client.1.smithi120.stdout:7/863: rmdir d7/d64/da6/d1a/d33/d109/dbf/d108 0 2024-04-26T21:26:06.907 INFO:tasks.workunit.client.0.smithi084.stdout:3/667: chown d1/d2c/d2f/d31/d55/f4b 3994 1 2024-04-26T21:26:06.910 INFO:tasks.workunit.client.0.smithi084.stdout:4/616: read - d5/d7/d65/d7f/db8/fc5 zero size 2024-04-26T21:26:06.913 INFO:tasks.workunit.client.1.smithi120.stdout:8/826: write d5/d6/d11/f10 [1022613,115088] 0 2024-04-26T21:26:06.913 INFO:tasks.workunit.client.1.smithi120.stdout:6/891: dread d4/db/d10/dd/d4e/d60/f7c [0,4194304] 0 2024-04-26T21:26:06.913 INFO:tasks.workunit.client.1.smithi120.stdout:3/904: creat dd/de/df/d12/d48/d9b/dcb/dee/f127 x:0 0 0 2024-04-26T21:26:06.914 INFO:tasks.workunit.client.1.smithi120.stdout:0/994: getdents d0/d3/d51/d70/d71 0 2024-04-26T21:26:06.917 INFO:tasks.workunit.client.0.smithi084.stdout:9/583: link da/de/l2b da/dd5/db6/ld9 0 2024-04-26T21:26:06.917 INFO:tasks.workunit.client.0.smithi084.stdout:8/660: chown d4/d7/d15/d37/d3b/l75 77284 1 2024-04-26T21:26:06.918 INFO:tasks.workunit.client.0.smithi084.stdout:3/668: creat d1/d2c/d2f/d31/d55/d4e/d98/fec x:0 0 0 2024-04-26T21:26:06.919 INFO:tasks.workunit.client.1.smithi120.stdout:1/778: truncate d6/d9/dd4/de0/d1d/d5d/f90 372289 0 2024-04-26T21:26:06.919 INFO:tasks.workunit.client.1.smithi120.stdout:3/905: chown dd/de/df/dda/d24/db1/d76/d3b/d56/fb5 29 1 2024-04-26T21:26:06.920 INFO:tasks.workunit.client.1.smithi120.stdout:3/906: chown dd/dcf 193103 1 2024-04-26T21:26:06.921 INFO:tasks.workunit.client.0.smithi084.stdout:0/688: creat de/d2b/d45/d94/dcf/fdd x:0 0 0 2024-04-26T21:26:06.922 INFO:tasks.workunit.client.1.smithi120.stdout:8/827: dread - d5/d6/d34/d42/d9d/d7a/ff4 zero size 2024-04-26T21:26:06.922 INFO:tasks.workunit.client.0.smithi084.stdout:1/669: chown d2/d54/d5e/d66/d2a/c42 6 1 2024-04-26T21:26:06.924 INFO:tasks.workunit.client.1.smithi120.stdout:2/878: rename d4/d1b/d4f/d95 to d4/d1b/d25/d29/d128 0 2024-04-26T21:26:06.924 INFO:tasks.workunit.client.1.smithi120.stdout:3/907: chown dd/de/df/d12/d48/d9b/cf6 11544111 1 2024-04-26T21:26:06.925 INFO:tasks.workunit.client.0.smithi084.stdout:9/584: creat da/de/d16/d40/fda x:0 0 0 2024-04-26T21:26:06.929 INFO:tasks.workunit.client.0.smithi084.stdout:3/669: read d1/d2c/d2f/d31/d55/f4b [652494,103472] 0 2024-04-26T21:26:06.929 INFO:tasks.workunit.client.0.smithi084.stdout:8/661: creat d4/d7/d15/d9d/fbd x:0 0 0 2024-04-26T21:26:06.929 INFO:tasks.workunit.client.0.smithi084.stdout:1/670: fdatasync d2/d54/d5e/d66/d3a/d48/f50 0 2024-04-26T21:26:06.931 INFO:tasks.workunit.client.1.smithi120.stdout:6/892: link d4/db/d10/d22/d56/d94/fd0 d4/db/d10/d1a/d2b/d57/d67/f125 0 2024-04-26T21:26:06.931 INFO:tasks.workunit.client.0.smithi084.stdout:0/689: creat de/d2b/d77/d32/d96/dbe/fde x:0 0 0 2024-04-26T21:26:06.932 INFO:tasks.workunit.client.0.smithi084.stdout:8/662: chown d4/f13 73662875 1 2024-04-26T21:26:06.933 INFO:tasks.workunit.client.1.smithi120.stdout:7/864: dread d7/d64/da6/d1f/d28/f3e [0,4194304] 0 2024-04-26T21:26:06.935 INFO:tasks.workunit.client.0.smithi084.stdout:8/663: chown d4/d3a/l5c 258377 1 2024-04-26T21:26:06.935 INFO:tasks.workunit.client.0.smithi084.stdout:9/585: link da/f46 da/dd5/d93/dc3/d41/d8d/dca/fdb 0 2024-04-26T21:26:06.935 INFO:tasks.workunit.client.0.smithi084.stdout:3/670: write d1/d24/dbb/fe6 [369933,110590] 0 2024-04-26T21:26:06.936 INFO:tasks.workunit.client.1.smithi120.stdout:8/828: creat d5/d6/d34/d42/d4a/deb/d88/f10a x:0 0 0 2024-04-26T21:26:06.936 INFO:tasks.workunit.client.1.smithi120.stdout:9/819: write d0/dd/f62 [612039,25947] 0 2024-04-26T21:26:06.937 INFO:tasks.workunit.client.1.smithi120.stdout:3/908: fdatasync dd/de/d83/d64/fa4 0 2024-04-26T21:26:06.938 INFO:tasks.workunit.client.1.smithi120.stdout:2/879: chown d4/d1b/d25/d2c/d3e/d5e/d63/dcb/dca/dfc/f105 60 1 2024-04-26T21:26:06.940 INFO:tasks.workunit.client.1.smithi120.stdout:1/779: mknod d6/d9/dd4/de0/d2d/d48/cff 0 2024-04-26T21:26:06.942 INFO:tasks.workunit.client.0.smithi084.stdout:6/654: dread d3/f26 [4194304,4194304] 0 2024-04-26T21:26:06.945 INFO:tasks.workunit.client.0.smithi084.stdout:5/661: truncate d0/dc/df/d31/d63/d8a/f90 961709 0 2024-04-26T21:26:06.951 INFO:tasks.workunit.client.1.smithi120.stdout:2/880: creat d4/d1b/d2e/d5f/df6/f129 x:0 0 0 2024-04-26T21:26:06.952 INFO:tasks.workunit.client.0.smithi084.stdout:4/617: dwrite d5/d7/d65/d7f/db8/f66 [4194304,4194304] 0 2024-04-26T21:26:06.953 INFO:tasks.workunit.client.1.smithi120.stdout:2/881: dread - d4/d1b/d25/d29/d128/de9/d112/f11e zero size 2024-04-26T21:26:06.955 INFO:tasks.workunit.client.0.smithi084.stdout:9/586: creat da/de/d1e/dc9/fdc x:0 0 0 2024-04-26T21:26:06.957 INFO:tasks.workunit.client.0.smithi084.stdout:6/655: write d3/de/d41/f51 [1665801,115459] 0 2024-04-26T21:26:06.959 INFO:tasks.workunit.client.1.smithi120.stdout:3/909: mknod dd/de/df/d12/c128 0 2024-04-26T21:26:06.959 INFO:tasks.workunit.client.0.smithi084.stdout:1/671: truncate d2/d9/d15/d9f/fb3 668493 0 2024-04-26T21:26:06.961 INFO:tasks.workunit.client.0.smithi084.stdout:9/587: chown da/dd5/d93/d95/daa 3 1 2024-04-26T21:26:06.961 INFO:tasks.workunit.client.1.smithi120.stdout:1/780: unlink d6/d9/cf7 0 2024-04-26T21:26:06.967 INFO:tasks.workunit.client.1.smithi120.stdout:4/858: dwrite d10/d28/fb2 [0,4194304] 0 2024-04-26T21:26:06.967 INFO:tasks.workunit.client.1.smithi120.stdout:1/781: chown d6/d9/dd4/de0/d2d/d48/cd6 314220299 1 2024-04-26T21:26:06.967 INFO:tasks.workunit.client.1.smithi120.stdout:0/995: write d0/d3/dc/dd/f7b [404119,80027] 0 2024-04-26T21:26:06.968 INFO:tasks.workunit.client.0.smithi084.stdout:4/618: write d5/d2e/d5f/d32/d46/f5c [3760698,109082] 0 2024-04-26T21:26:06.968 INFO:tasks.workunit.client.0.smithi084.stdout:2/777: dread d6/d7/d3d/d15/d1f/d39/d20/f50 [0,4194304] 0 2024-04-26T21:26:06.970 INFO:tasks.workunit.client.0.smithi084.stdout:6/656: write d3/de/d1a/fb0 [730713,85468] 0 2024-04-26T21:26:06.971 INFO:tasks.workunit.client.1.smithi120.stdout:0/996: chown d0/d3/dc/d12/d31/f120 365289 1 2024-04-26T21:26:06.971 INFO:tasks.workunit.client.0.smithi084.stdout:1/672: unlink d2/d54/d5e/d66/fc4 0 2024-04-26T21:26:06.972 INFO:tasks.workunit.client.1.smithi120.stdout:3/910: mkdir dd/de/df/d129 0 2024-04-26T21:26:06.974 INFO:tasks.workunit.client.0.smithi084.stdout:7/694: dwrite d6/d9/d12/d19/f7e [0,4194304] 0 2024-04-26T21:26:06.975 INFO:tasks.workunit.client.0.smithi084.stdout:8/664: link d4/d7/d15/d37/d52/d69/c86 d4/d6/db/d1e/d7c/cbe 0 2024-04-26T21:26:06.975 INFO:tasks.workunit.client.1.smithi120.stdout:2/882: getdents d4/d1b/d4f/df8 0 2024-04-26T21:26:06.976 INFO:tasks.workunit.client.0.smithi084.stdout:9/588: rmdir da/db3 39 2024-04-26T21:26:06.976 INFO:tasks.workunit.client.1.smithi120.stdout:6/893: write d4/db/d10/d1a/d2b/d57/d67/fae [515483,107911] 0 2024-04-26T21:26:06.980 INFO:tasks.workunit.client.1.smithi120.stdout:1/782: creat d6/d9/dd4/f100 x:0 0 0 2024-04-26T21:26:06.981 INFO:tasks.workunit.client.1.smithi120.stdout:3/911: creat dd/de/df/dda/d37/f12a x:0 0 0 2024-04-26T21:26:06.982 INFO:tasks.workunit.client.1.smithi120.stdout:2/883: creat d4/d1b/d25/d2c/d3e/d5e/f12a x:0 0 0 2024-04-26T21:26:06.983 INFO:tasks.workunit.client.1.smithi120.stdout:7/865: write d7/d64/da6/d1a/d33/fa5 [844741,66231] 0 2024-04-26T21:26:06.987 INFO:tasks.workunit.client.1.smithi120.stdout:9/820: write d0/dd/d3a/f92 [716798,103754] 0 2024-04-26T21:26:06.989 INFO:tasks.workunit.client.1.smithi120.stdout:7/866: chown d7/d10/c4a 0 1 2024-04-26T21:26:06.990 INFO:tasks.workunit.client.0.smithi084.stdout:7/695: rmdir d6 39 2024-04-26T21:26:06.991 INFO:tasks.workunit.client.1.smithi120.stdout:9/821: write d0/d6/fbd [3314620,58514] 0 2024-04-26T21:26:06.992 INFO:tasks.workunit.client.0.smithi084.stdout:5/662: dwrite d0/dc/df/fa4 [0,4194304] 0 2024-04-26T21:26:06.993 INFO:tasks.workunit.client.1.smithi120.stdout:0/997: dwrite d0/f2c [0,4194304] 0 2024-04-26T21:26:06.994 INFO:tasks.workunit.client.1.smithi120.stdout:7/867: fsync d7/d64/da6/d2f/f52 0 2024-04-26T21:26:06.995 INFO:tasks.workunit.client.1.smithi120.stdout:4/859: rename d10/d12/da1/fc3 to d10/d65/d7c/dec/f126 0 2024-04-26T21:26:06.997 INFO:tasks.workunit.client.0.smithi084.stdout:0/690: dread de/d2b/d77/f33 [0,4194304] 0 2024-04-26T21:26:07.003 INFO:tasks.workunit.client.1.smithi120.stdout:6/894: rmdir d4/db/d25/d6d/dbd/d11d 0 2024-04-26T21:26:07.004 INFO:tasks.workunit.client.0.smithi084.stdout:1/673: write d2/d54/d5e/d66/d2a/d2c/d45/fb8 [754941,47928] 0 2024-04-26T21:26:07.005 INFO:tasks.workunit.client.1.smithi120.stdout:4/860: mknod d10/d28/dd9/ddd/dee/dd0/dd4/c127 0 2024-04-26T21:26:07.007 INFO:tasks.workunit.client.0.smithi084.stdout:4/619: rename d5/d7/d65/d7f/f4f to d5/d25/d99/dc7/fc8 0 2024-04-26T21:26:07.007 INFO:tasks.workunit.client.1.smithi120.stdout:7/868: mknod d7/d64/da6/d1f/d28/d4c/d6c/c121 0 2024-04-26T21:26:07.010 INFO:tasks.workunit.client.0.smithi084.stdout:4/620: write d5/d2e/fb5 [947533,130015] 0 2024-04-26T21:26:07.012 INFO:tasks.workunit.client.0.smithi084.stdout:2/778: dwrite d6/d7/d68/f69 [0,4194304] 0 2024-04-26T21:26:07.012 INFO:tasks.workunit.client.0.smithi084.stdout:0/691: creat de/d20/d4c/dae/fdf x:0 0 0 2024-04-26T21:26:07.014 INFO:tasks.workunit.client.0.smithi084.stdout:3/671: dwrite d1/d2c/d2f/d31/f84 [0,4194304] 0 2024-04-26T21:26:07.014 INFO:tasks.workunit.client.0.smithi084.stdout:5/663: truncate d0/dc/df/d31/f54 443821 0 2024-04-26T21:26:07.015 INFO:tasks.workunit.client.1.smithi120.stdout:4/861: mkdir d10/d28/d128 0 2024-04-26T21:26:07.018 INFO:tasks.workunit.client.0.smithi084.stdout:6/657: getdents d3/d18 0 2024-04-26T21:26:07.018 INFO:tasks.workunit.client.1.smithi120.stdout:3/912: dwrite dd/de/df/dda/f105 [0,4194304] 0 2024-04-26T21:26:07.020 INFO:tasks.workunit.client.1.smithi120.stdout:0/998: rename d0/d3/d51/d97/d108/lf3 to d0/d3/d51/d95/l141 0 2024-04-26T21:26:07.021 INFO:tasks.workunit.client.1.smithi120.stdout:1/783: dread d6/d9/dd4/de0/d2d/d98/d35/f87 [0,4194304] 0 2024-04-26T21:26:07.023 INFO:tasks.workunit.client.0.smithi084.stdout:5/664: chown d0/dc/df/d75/fb0 548348355 1 2024-04-26T21:26:07.023 INFO:tasks.workunit.client.1.smithi120.stdout:7/869: fdatasync d7/d64/da6/d1f/d7d/fa2 0 2024-04-26T21:26:07.025 INFO:tasks.workunit.client.0.smithi084.stdout:4/621: dread d5/d25/d35/f81 [0,4194304] 0 2024-04-26T21:26:07.025 INFO:tasks.workunit.client.0.smithi084.stdout:6/658: write d3/de/d15/d23/d90/fb5 [101133,13698] 0 2024-04-26T21:26:07.027 INFO:tasks.workunit.client.0.smithi084.stdout:2/779: write d6/d7/d3d/d15/f1a [3982905,130068] 0 2024-04-26T21:26:07.027 INFO:tasks.workunit.client.0.smithi084.stdout:7/696: symlink d6/d26/d40/dec/led 0 2024-04-26T21:26:07.029 INFO:tasks.workunit.client.1.smithi120.stdout:1/784: fdatasync d6/d14/ffa 0 2024-04-26T21:26:07.031 INFO:tasks.workunit.client.1.smithi120.stdout:9/822: dwrite d0/dd/d3a/d5c/f101 [0,4194304] 0 2024-04-26T21:26:07.032 INFO:tasks.workunit.client.1.smithi120.stdout:4/862: write d10/d65/fab [3797257,101847] 0 2024-04-26T21:26:07.032 INFO:tasks.workunit.client.0.smithi084.stdout:8/665: getdents d4/d6/db/d1e/d22 0 2024-04-26T21:26:07.035 INFO:tasks.workunit.client.1.smithi120.stdout:6/895: rename d4/db/d10/dd/db3 to d4/db/d10/d22/d56/d8f/df8/d126 0 2024-04-26T21:26:07.041 INFO:tasks.workunit.client.1.smithi120.stdout:7/870: mkdir d7/d122 0 2024-04-26T21:26:07.042 INFO:tasks.workunit.client.0.smithi084.stdout:8/666: write d4/d6/db/d1e/d22/d96/f9a [751973,11365] 0 2024-04-26T21:26:07.044 INFO:tasks.workunit.client.0.smithi084.stdout:3/672: creat d1/d2c/d2f/d31/d3b/fed x:0 0 0 2024-04-26T21:26:07.046 INFO:tasks.workunit.client.1.smithi120.stdout:9/823: creat d0/dd/d3a/d5c/d9f/f115 x:0 0 0 2024-04-26T21:26:07.047 INFO:tasks.workunit.client.1.smithi120.stdout:9/824: readlink d0/d6/d4d/l84 0 2024-04-26T21:26:07.050 INFO:tasks.workunit.client.1.smithi120.stdout:3/913: rename dd/de/df/dda/d24/d9d/d86/dd3 to dd/d2a/d74/d12b 0 2024-04-26T21:26:07.050 INFO:tasks.workunit.client.0.smithi084.stdout:4/622: unlink d5/d2e/l39 0 2024-04-26T21:26:07.054 INFO:tasks.workunit.client.1.smithi120.stdout:1/785: symlink d6/d9/dd4/de0/d1d/d5d/d67/l101 0 2024-04-26T21:26:07.054 INFO:tasks.workunit.client.1.smithi120.stdout:6/896: mkdir d4/db/d10/d22/d56/d9c/d127 0 2024-04-26T21:26:07.057 INFO:tasks.workunit.client.1.smithi120.stdout:6/897: chown d4/c3a 276704621 1 2024-04-26T21:26:07.059 INFO:tasks.workunit.client.1.smithi120.stdout:4/863: creat d10/d12/da1/f129 x:0 0 0 2024-04-26T21:26:07.060 INFO:tasks.workunit.client.1.smithi120.stdout:1/786: readlink d6/d9/dd4/de0/d2d/d98/d56/l65 0 2024-04-26T21:26:07.060 INFO:tasks.workunit.client.1.smithi120.stdout:7/871: truncate d7/d64/da6/d1a/d33/fa5 1639086 0 2024-04-26T21:26:07.060 INFO:tasks.workunit.client.0.smithi084.stdout:9/589: write da/dd5/d93/dc3/f2a [2143297,74354] 0 2024-04-26T21:26:07.062 INFO:tasks.workunit.client.0.smithi084.stdout:7/697: rename d6/d9/d12/d8b/cb1 to d6/d9/d12/d8b/cee 0 2024-04-26T21:26:07.062 INFO:tasks.workunit.client.0.smithi084.stdout:1/674: link d2/d54/d5e/d66/d2a/d72/f82 d2/d9/d15/d28/d69/fe2 0 2024-04-26T21:26:07.063 INFO:tasks.workunit.client.1.smithi120.stdout:4/864: fdatasync d10/d6b/d71/dd7/f103 0 2024-04-26T21:26:07.067 INFO:tasks.workunit.client.0.smithi084.stdout:1/675: dread - d2/d9/d67/fc7 zero size 2024-04-26T21:26:07.071 INFO:tasks.workunit.client.0.smithi084.stdout:8/667: dwrite d4/d7/d15/d3c/f90 [0,4194304] 0 2024-04-26T21:26:07.073 INFO:tasks.workunit.client.1.smithi120.stdout:3/914: rename dd/de/df/dda/d24/fc1 to dd/de/df/dda/d37/f12c 0 2024-04-26T21:26:07.075 INFO:tasks.workunit.client.1.smithi120.stdout:1/787: write d6/d9/dd4/de0/d1d/d2c/f76 [286005,98315] 0 2024-04-26T21:26:07.076 INFO:tasks.workunit.client.1.smithi120.stdout:6/898: truncate d4/db/d10/dd/f74 4205548 0 2024-04-26T21:26:07.078 INFO:tasks.workunit.client.0.smithi084.stdout:2/780: chown d6/d7/d3d/d79/d81/d82/cd7 194 1 2024-04-26T21:26:07.079 INFO:tasks.workunit.client.1.smithi120.stdout:2/884: dread d4/d1b/d25/d2c/fa2 [0,4194304] 0 2024-04-26T21:26:07.080 INFO:tasks.workunit.client.0.smithi084.stdout:6/659: dwrite d3/de/f7c [0,4194304] 0 2024-04-26T21:26:07.084 INFO:tasks.workunit.client.1.smithi120.stdout:3/915: rmdir dd/de/df/dda/d24/db1 39 2024-04-26T21:26:07.084 INFO:tasks.workunit.client.1.smithi120.stdout:6/899: creat d4/db/d10/dd/d43/f128 x:0 0 0 2024-04-26T21:26:07.086 INFO:tasks.workunit.client.0.smithi084.stdout:3/673: getdents d1/d24/d27/d3a/d81 0 2024-04-26T21:26:07.086 INFO:tasks.workunit.client.1.smithi120.stdout:1/788: fdatasync d6/d9/dd4/de0/d1b/f60 0 2024-04-26T21:26:07.091 INFO:tasks.workunit.client.0.smithi084.stdout:4/623: getdents d5/d25/d35/d60/d6d 0 2024-04-26T21:26:07.095 INFO:tasks.workunit.client.0.smithi084.stdout:8/668: symlink d4/d7/d15/da7/lbf 0 2024-04-26T21:26:07.097 INFO:tasks.workunit.client.0.smithi084.stdout:9/590: dwrite da/dd5/d93/dc3/d41/d67/f97 [0,4194304] 0 2024-04-26T21:26:07.099 INFO:tasks.workunit.client.0.smithi084.stdout:4/624: readlink d5/d25/d35/d60/l74 0 2024-04-26T21:26:07.102 INFO:tasks.workunit.client.0.smithi084.stdout:6/660: stat d3/de/d1a/d43/dd6 0 2024-04-26T21:26:07.104 INFO:tasks.workunit.client.1.smithi120.stdout:6/900: dread d4/db/d10/dd/d4e/d60/f7c [0,4194304] 0 2024-04-26T21:26:07.104 INFO:tasks.workunit.client.1.smithi120.stdout:2/885: mknod d4/d1b/d2e/d5f/df6/dfa/c12b 0 2024-04-26T21:26:07.104 INFO:tasks.workunit.client.0.smithi084.stdout:2/781: mknod d6/d7/d3d/d15/d1f/d39/da5/c106 0 2024-04-26T21:26:07.108 INFO:tasks.workunit.client.0.smithi084.stdout:4/625: rename d5/d2e/d5f/d32/d46/fa7 to d5/d2e/d5f/d32/fc9 0 2024-04-26T21:26:07.111 INFO:tasks.workunit.client.0.smithi084.stdout:1/676: dwrite d2/f2e [0,4194304] 0 2024-04-26T21:26:07.113 INFO:tasks.workunit.client.1.smithi120.stdout:3/916: creat dd/de/df/dda/d24/db1/d76/d3b/d56/d75/f12d x:0 0 0 2024-04-26T21:26:07.114 INFO:tasks.workunit.client.0.smithi084.stdout:2/782: write d6/d7/d3d/d15/d1f/d39/fe [898427,63099] 0 2024-04-26T21:26:07.114 INFO:tasks.workunit.client.0.smithi084.stdout:4/626: chown d5/d10/d82/l9d 14 1 2024-04-26T21:26:07.117 INFO:tasks.workunit.client.1.smithi120.stdout:1/789: link d6/d9/dd4/de0/d1b/d3b/d6d/dc9/ffc d6/d9/dd4/de0/d85/dfb/f102 0 2024-04-26T21:26:07.117 INFO:tasks.workunit.client.1.smithi120.stdout:3/917: truncate dd/de/df/f10e 471973 0 2024-04-26T21:26:07.119 INFO:tasks.workunit.client.0.smithi084.stdout:6/661: rename d3/fa1 to d3/de/d15/d23/d90/da2/fd7 0 2024-04-26T21:26:07.119 INFO:tasks.workunit.client.1.smithi120.stdout:3/918: chown dd/d2a/f118 128408020 1 2024-04-26T21:26:07.121 INFO:tasks.workunit.client.1.smithi120.stdout:6/901: mknod d4/db/d10/dd/d28/d9e/daf/dff/d117/c129 0 2024-04-26T21:26:07.126 INFO:tasks.workunit.client.0.smithi084.stdout:2/783: write d6/d7/d3d/d4f/d90/f101 [12985,36880] 0 2024-04-26T21:26:07.132 INFO:tasks.workunit.client.1.smithi120.stdout:1/790: dread d6/d9/dd4/de0/fb8 [0,4194304] 0 2024-04-26T21:26:07.134 INFO:tasks.workunit.client.0.smithi084.stdout:9/591: fsync da/dd5/d93/dc3/f2a 0 2024-04-26T21:26:07.134 INFO:tasks.workunit.client.1.smithi120.stdout:6/902: truncate d4/db/d10/dd/f30 2358823 0 2024-04-26T21:26:07.138 INFO:tasks.workunit.client.0.smithi084.stdout:0/692: dwrite de/d20/d4c/f61 [0,4194304] 0 2024-04-26T21:26:07.139 INFO:tasks.workunit.client.1.smithi120.stdout:9/825: write d0/d6/f47 [1183857,18699] 0 2024-04-26T21:26:07.143 INFO:tasks.workunit.client.1.smithi120.stdout:4/865: truncate d10/d12/f95 927624 0 2024-04-26T21:26:07.143 INFO:tasks.workunit.client.0.smithi084.stdout:5/665: write d0/dc/df/f98 [558859,95092] 0 2024-04-26T21:26:07.145 INFO:tasks.workunit.client.1.smithi120.stdout:1/791: write d6/d9/dd4/de0/d1d/f50 [2511681,21607] 0 2024-04-26T21:26:07.145 INFO:tasks.workunit.client.1.smithi120.stdout:3/919: creat dd/de/df/dda/d24/f12e x:0 0 0 2024-04-26T21:26:07.147 INFO:tasks.workunit.client.0.smithi084.stdout:6/662: dread d3/de/d1a/fb0 [0,4194304] 0 2024-04-26T21:26:07.147 INFO:tasks.workunit.client.0.smithi084.stdout:8/669: dwrite d4/d6/f40 [0,4194304] 0 2024-04-26T21:26:07.153 INFO:tasks.workunit.client.1.smithi120.stdout:4/866: rename d10/d28/d73 to d10/d28/dd9/ddd/dee/dd0/dd4/d86/dfa/dfe/d12a 0 2024-04-26T21:26:07.156 INFO:tasks.workunit.client.0.smithi084.stdout:2/784: creat d6/d7/d3d/d79/d81/d82/da8/f107 x:0 0 0 2024-04-26T21:26:07.158 INFO:tasks.workunit.client.1.smithi120.stdout:4/867: stat d10/d6b/dbf/fcf 0 2024-04-26T21:26:07.160 INFO:tasks.workunit.client.1.smithi120.stdout:1/792: creat d6/f103 x:0 0 0 2024-04-26T21:26:07.160 INFO:tasks.workunit.client.0.smithi084.stdout:5/666: fdatasync d0/dc/df/f9e 0 2024-04-26T21:26:07.163 INFO:tasks.workunit.client.0.smithi084.stdout:0/693: readlink de/d2b/d77/d68/l92 0 2024-04-26T21:26:07.164 INFO:tasks.workunit.client.0.smithi084.stdout:2/785: chown d6/d1b/f2c 100255 1 2024-04-26T21:26:07.164 INFO:tasks.workunit.client.0.smithi084.stdout:6/663: chown d3/de/d15/d23/f30 1060557577 1 2024-04-26T21:26:07.166 INFO:tasks.workunit.client.0.smithi084.stdout:5/667: chown d0/dc/df/d6d 8 1 2024-04-26T21:26:07.167 INFO:tasks.workunit.client.1.smithi120.stdout:4/868: symlink d10/d28/dd9/ddd/dee/dd0/dd4/d86/dfa/dfe/d12a/de2/l12b 0 2024-04-26T21:26:07.170 INFO:tasks.workunit.client.1.smithi120.stdout:3/920: dwrite dd/de/df/dda/d24/f3a [0,4194304] 0 2024-04-26T21:26:07.170 INFO:tasks.workunit.client.0.smithi084.stdout:4/627: dwrite d5/d25/d35/f3a [0,4194304] 0 2024-04-26T21:26:07.177 INFO:tasks.workunit.client.1.smithi120.stdout:2/886: truncate d4/d1b/d25/fc6 3902877 0 2024-04-26T21:26:07.178 INFO:tasks.workunit.client.1.smithi120.stdout:7/872: dread d7/fd [0,4194304] 0 2024-04-26T21:26:07.178 INFO:tasks.workunit.client.1.smithi120.stdout:6/903: write d4/d3d/f83 [213502,111147] 0 2024-04-26T21:26:07.179 INFO:tasks.workunit.client.1.smithi120.stdout:4/869: mknod d10/d28/dd9/ddd/dee/dd0/dd4/d86/dfa/dfe/d12a/de2/c12c 0 2024-04-26T21:26:07.181 INFO:tasks.workunit.client.0.smithi084.stdout:7/698: dwrite d6/d68/f6e [0,4194304] 0 2024-04-26T21:26:07.183 INFO:tasks.workunit.client.0.smithi084.stdout:3/674: dread d1/d2c/d2f/d31/d3b/f6c [0,4194304] 0 2024-04-26T21:26:07.187 INFO:tasks.workunit.client.1.smithi120.stdout:0/999: sync 2024-04-26T21:26:07.187 INFO:tasks.workunit.client.1.smithi120.stdout:4/870: mkdir d10/d28/dd9/ddd/df1/d12d 0 2024-04-26T21:26:07.187 INFO:tasks.workunit.client.1.smithi120.stdout:5/897: sync 2024-04-26T21:26:07.187 INFO:tasks.workunit.client.1.smithi120.stdout:8/829: sync 2024-04-26T21:26:07.188 INFO:tasks.workunit.client.0.smithi084.stdout:5/668: symlink d0/dc/df/d2a/ld1 0 2024-04-26T21:26:07.190 INFO:tasks.workunit.client.1.smithi120.stdout:7/873: unlink d7/d64/da6/d1a/d33/d109/dbf/ccd 0 2024-04-26T21:26:07.191 INFO:tasks.workunit.client.1.smithi120.stdout:6/904: unlink d4/db/d10/d22/d56/d8f/df8/d126/fd4 0 2024-04-26T21:26:07.191 INFO:tasks.workunit.client.0.smithi084.stdout:7/699: chown d6/d9/d12/d19/d60/c6d 73 1 2024-04-26T21:26:07.192 INFO:tasks.workunit.client.0.smithi084.stdout:0/694: read de/d20/d4e/f75 [363,103745] 0 2024-04-26T21:26:07.195 INFO:tasks.workunit.client.1.smithi120.stdout:2/887: getdents d4/d1b/d4f 0 2024-04-26T21:26:07.195 INFO:tasks.workunit.client.0.smithi084.stdout:3/675: write d1/d2c/d2f/d31/d55/d4e/d98/fec [613187,35122] 0 2024-04-26T21:26:07.198 INFO:tasks.workunit.client.1.smithi120.stdout:7/874: write d7/d64/da6/d1f/d7d/d8b/fa3 [3552677,61351] 0 2024-04-26T21:26:07.201 INFO:tasks.workunit.client.0.smithi084.stdout:6/664: link d3/de/d1a/d2f/d4c/d58/f66 d3/de/d15/d5f/dc1/dd3/fd8 0 2024-04-26T21:26:07.205 INFO:tasks.workunit.client.0.smithi084.stdout:4/628: truncate d5/d10/f71 731435 0 2024-04-26T21:26:07.206 INFO:tasks.workunit.client.1.smithi120.stdout:8/830: creat d5/d6/d34/d42/d9d/d7a/f10b x:0 0 0 2024-04-26T21:26:07.207 INFO:tasks.workunit.client.1.smithi120.stdout:4/871: rename d10/d6b/f11b to d10/d6b/da4/f12e 0 2024-04-26T21:26:07.208 INFO:tasks.workunit.client.1.smithi120.stdout:8/831: readlink d5/d8e/le7 0 2024-04-26T21:26:07.208 INFO:tasks.workunit.client.1.smithi120.stdout:9/826: dwrite d0/d6/d4d/d65/dec/d2d/d4b/d85/fb6 [0,4194304] 0 2024-04-26T21:26:07.209 INFO:tasks.workunit.client.0.smithi084.stdout:6/665: truncate d3/d18/fc6 656672 0 2024-04-26T21:26:07.209 INFO:tasks.workunit.client.0.smithi084.stdout:0/695: dread de/d2b/d45/d63/fc0 [0,4194304] 0 2024-04-26T21:26:07.209 INFO:tasks.workunit.client.0.smithi084.stdout:8/670: rename d4/d6/db/d1e/d22/d39/d4a/c58 to d4/d6/db/d1e/d22/d39/d4a/da2/cc0 0 2024-04-26T21:26:07.216 INFO:tasks.workunit.client.1.smithi120.stdout:6/905: creat d4/db/d10/dd/d28/d9e/daf/dff/d117/f12a x:0 0 0 2024-04-26T21:26:07.217 INFO:tasks.workunit.client.0.smithi084.stdout:5/669: dwrite d0/d49/f95 [0,4194304] 0 2024-04-26T21:26:07.217 INFO:tasks.workunit.client.0.smithi084.stdout:6/666: fsync d3/de/d41/d5c/f97 0 2024-04-26T21:26:07.219 INFO:tasks.workunit.client.1.smithi120.stdout:2/888: write d4/d1b/f121 [5877,127888] 0 2024-04-26T21:26:07.219 INFO:tasks.workunit.client.1.smithi120.stdout:7/875: chown d7/d64/da6/d1f/d28/f3d 385217116 1 2024-04-26T21:26:07.220 INFO:tasks.workunit.client.1.smithi120.stdout:4/872: truncate f5 5139763 0 2024-04-26T21:26:07.220 INFO:tasks.workunit.client.0.smithi084.stdout:9/592: truncate da/f14 189557 0 2024-04-26T21:26:07.222 INFO:tasks.workunit.client.0.smithi084.stdout:2/786: getdents d6/d7/d3d/d79/d81/d82 0 2024-04-26T21:26:07.222 INFO:tasks.workunit.client.0.smithi084.stdout:4/629: truncate d5/d25/d35/d97/f9c 745150 0 2024-04-26T21:26:07.226 INFO:tasks.workunit.client.1.smithi120.stdout:7/876: fsync d7/d19/d60/f76 0 2024-04-26T21:26:07.226 INFO:tasks.workunit.client.1.smithi120.stdout:8/832: creat d5/d6/d34/d37/dd9/f10c x:0 0 0 2024-04-26T21:26:07.227 INFO:tasks.workunit.client.0.smithi084.stdout:1/677: dread d2/d1b/f8b [0,4194304] 0 2024-04-26T21:26:07.227 INFO:tasks.workunit.client.0.smithi084.stdout:0/696: truncate de/d2b/d77/d32/d96/fc9 793766 0 2024-04-26T21:26:07.228 INFO:tasks.workunit.client.1.smithi120.stdout:1/793: dread d6/d9/dd4/de0/d2d/d48/f66 [0,4194304] 0 2024-04-26T21:26:07.230 INFO:tasks.workunit.client.1.smithi120.stdout:3/921: dwrite dd/de/df/dda/d8d/feb [0,4194304] 0 2024-04-26T21:26:07.232 INFO:tasks.workunit.client.0.smithi084.stdout:3/676: truncate d1/d2c/d2f/f6d 4177522 0 2024-04-26T21:26:07.232 INFO:tasks.workunit.client.0.smithi084.stdout:2/787: write d6/d7/d3d/d79/d81/d82/da8/fba [1659965,47102] 0 2024-04-26T21:26:07.232 INFO:tasks.workunit.client.0.smithi084.stdout:6/667: write d3/de/d1a/d2f/d4c/d58/fbc [1736790,119196] 0 2024-04-26T21:26:07.233 INFO:tasks.workunit.client.1.smithi120.stdout:3/922: dread - dd/d2a/fdd zero size 2024-04-26T21:26:07.236 INFO:tasks.workunit.client.0.smithi084.stdout:5/670: truncate d0/dc/f43 618968 0 2024-04-26T21:26:07.237 INFO:tasks.workunit.client.1.smithi120.stdout:4/873: unlink d10/d12/fdc 0 2024-04-26T21:26:07.239 INFO:tasks.workunit.client.0.smithi084.stdout:9/593: creat da/d9e/fdd x:0 0 0 2024-04-26T21:26:07.240 INFO:tasks.workunit.client.0.smithi084.stdout:4/630: mknod d5/d25/d35/d60/d69/cca 0 2024-04-26T21:26:07.242 INFO:tasks.workunit.client.0.smithi084.stdout:8/671: creat d4/fc1 x:0 0 0 2024-04-26T21:26:07.242 INFO:tasks.workunit.client.0.smithi084.stdout:0/697: chown de/d2b/d77/f33 89223 1 2024-04-26T21:26:07.244 INFO:tasks.workunit.client.0.smithi084.stdout:1/678: mknod d2/d54/d5e/d66/d2a/d72/ce3 0 2024-04-26T21:26:07.247 INFO:tasks.workunit.client.0.smithi084.stdout:9/594: fdatasync da/dd5/d93/dc3/f73 0 2024-04-26T21:26:07.249 INFO:tasks.workunit.client.1.smithi120.stdout:1/794: mknod d6/dd7/c104 0 2024-04-26T21:26:07.252 INFO:tasks.workunit.client.0.smithi084.stdout:1/679: stat d2/d54/d5e/d66/d2a/d2c/d75/lc5 0 2024-04-26T21:26:07.254 INFO:tasks.workunit.client.1.smithi120.stdout:7/877: dwrite d7/d64/da6/d1a/df4/f112 [0,4194304] 0 2024-04-26T21:26:07.254 INFO:tasks.workunit.client.0.smithi084.stdout:9/595: chown da/de/d1e/l21 1276766229 1 2024-04-26T21:26:07.254 INFO:tasks.workunit.client.0.smithi084.stdout:4/631: creat d5/d25/d99/dac/fcb x:0 0 0 2024-04-26T21:26:07.255 INFO:tasks.workunit.client.1.smithi120.stdout:4/874: creat d10/d6b/dbf/f12f x:0 0 0 2024-04-26T21:26:07.257 INFO:tasks.workunit.client.1.smithi120.stdout:1/795: write d6/d9/dd4/de0/d1d/f9b [174452,65559] 0 2024-04-26T21:26:07.257 INFO:tasks.workunit.client.0.smithi084.stdout:4/632: chown d5/d7/d65/d7f/db8/c31 6 1 2024-04-26T21:26:07.257 INFO:tasks.workunit.client.0.smithi084.stdout:2/788: getdents d6/d7 0 2024-04-26T21:26:07.258 INFO:tasks.workunit.client.1.smithi120.stdout:3/923: dwrite dd/de/df/d12/d48/d9b/dcb/fdc [0,4194304] 0 2024-04-26T21:26:07.261 INFO:tasks.workunit.client.1.smithi120.stdout:2/889: rename d4/d1b/d2e/d50/d14/d15/cb4 to d4/dea/c12c 0 2024-04-26T21:26:07.261 INFO:tasks.workunit.client.1.smithi120.stdout:5/898: truncate d2/d30/d93/d107/fac 2542799 0 2024-04-26T21:26:07.262 INFO:tasks.workunit.client.1.smithi120.stdout:9/827: dread d0/d6/d4d/d65/dec/d77/d9a/ffc [0,4194304] 0 2024-04-26T21:26:07.262 INFO:tasks.workunit.client.1.smithi120.stdout:8/833: creat d5/d6/d34/d37/dd9/dda/dfc/f10d x:0 0 0 2024-04-26T21:26:07.268 INFO:tasks.workunit.client.1.smithi120.stdout:6/906: getdents d4/db/d10/d22/d56 0 2024-04-26T21:26:07.269 INFO:tasks.workunit.client.0.smithi084.stdout:1/680: getdents d2/d54/d5e 0 2024-04-26T21:26:07.269 INFO:tasks.workunit.client.1.smithi120.stdout:7/878: mknod d7/d64/da6/d1f/d7d/c123 0 2024-04-26T21:26:07.269 INFO:tasks.workunit.client.1.smithi120.stdout:5/899: unlink d2/df6/ffb 0 2024-04-26T21:26:07.269 INFO:tasks.workunit.client.0.smithi084.stdout:2/789: mknod d6/d7/d3d/d15/d1f/d39/d20/c108 0 2024-04-26T21:26:07.274 INFO:tasks.workunit.client.1.smithi120.stdout:5/900: write d2/d1b/d89/d6b/f95 [242097,11463] 0 2024-04-26T21:26:07.275 INFO:tasks.workunit.client.1.smithi120.stdout:1/796: mkdir d6/d9/dd4/de0/d1d/d5d/d67/de3/d105 0 2024-04-26T21:26:07.281 INFO:tasks.workunit.client.1.smithi120.stdout:1/797: write d6/d9/dd4/de0/d2d/d98/d35/fc5 [5206695,57180] 0 2024-04-26T21:26:07.282 INFO:tasks.workunit.client.1.smithi120.stdout:2/890: creat d4/d1b/d2e/d50/d14/d15/f12d x:0 0 0 2024-04-26T21:26:07.283 INFO:tasks.workunit.client.0.smithi084.stdout:6/668: dwrite d3/de/d15/df/f62 [0,4194304] 0 2024-04-26T21:26:07.283 INFO:tasks.workunit.client.1.smithi120.stdout:9/828: creat d0/d6/f116 x:0 0 0 2024-04-26T21:26:07.285 INFO:tasks.workunit.client.0.smithi084.stdout:7/700: dread d6/d68/f78 [0,4194304] 0 2024-04-26T21:26:07.286 INFO:tasks.workunit.client.1.smithi120.stdout:3/924: rmdir dd/d2a/d74/d12b/ddb/df9 0 2024-04-26T21:26:07.287 INFO:tasks.workunit.client.1.smithi120.stdout:4/875: dread d10/d12/f8e [0,4194304] 0 2024-04-26T21:26:07.289 INFO:tasks.workunit.client.1.smithi120.stdout:5/901: mkdir d2/dc/d1d/d21/d66/d85/d128/d14b 0 2024-04-26T21:26:07.291 INFO:tasks.workunit.client.1.smithi120.stdout:3/925: dread - dd/de/df/dda/d8d/ff8 zero size 2024-04-26T21:26:07.291 INFO:tasks.workunit.client.0.smithi084.stdout:8/672: dwrite d4/d6/db/d1e/d22/d96/f9f [0,4194304] 0 2024-04-26T21:26:07.292 INFO:tasks.workunit.client.0.smithi084.stdout:4/633: dwrite d5/d25/d99/da0/fc0 [0,4194304] 0 2024-04-26T21:26:07.294 INFO:tasks.workunit.client.1.smithi120.stdout:1/798: creat d6/d14/d3c/f106 x:0 0 0 2024-04-26T21:26:07.294 INFO:tasks.workunit.client.1.smithi120.stdout:5/902: stat d2/dc/d1d/d21/d77/d9c/fe9 0 2024-04-26T21:26:07.296 INFO:tasks.workunit.client.0.smithi084.stdout:1/681: rename d2/d9/d15/d28/da0/ca9 to d2/d54/d5e/d66/d3a/ce4 0 2024-04-26T21:26:07.301 INFO:tasks.workunit.client.1.smithi120.stdout:8/834: link d5/d6/d34/d42/d4a/dbf/ld6 d5/d6/d11/d52/l10e 0 2024-04-26T21:26:07.302 INFO:tasks.workunit.client.1.smithi120.stdout:5/903: creat d2/dc/d1d/d21/db2/d109/f14c x:0 0 0 2024-04-26T21:26:07.302 INFO:tasks.workunit.client.1.smithi120.stdout:6/907: link d4/db/d10/d1a/dcd/f100 d4/db/d10/d1a/d2b/d57/d67/dbc/dce/f12b 0 2024-04-26T21:26:07.303 INFO:tasks.workunit.client.1.smithi120.stdout:4/876: symlink d10/d12/da1/l130 0 2024-04-26T21:26:07.304 INFO:tasks.workunit.client.0.smithi084.stdout:9/596: dwrite da/dd5/d93/dc3/d41/d67/f9b [0,4194304] 0 2024-04-26T21:26:07.304 INFO:tasks.workunit.client.0.smithi084.stdout:4/634: creat d5/d7/d65/fcc x:0 0 0 2024-04-26T21:26:07.306 INFO:tasks.workunit.client.1.smithi120.stdout:1/799: getdents d6/daa/dae/dee 0 2024-04-26T21:26:07.307 INFO:tasks.workunit.client.1.smithi120.stdout:5/904: chown d2/d1b/l37 0 1 2024-04-26T21:26:07.307 INFO:tasks.workunit.client.0.smithi084.stdout:1/682: mknod d2/d54/ce5 0 2024-04-26T21:26:07.310 INFO:tasks.workunit.client.1.smithi120.stdout:6/908: chown d4/db/d10/dd/d43/f108 863701 1 2024-04-26T21:26:07.311 INFO:tasks.workunit.client.1.smithi120.stdout:1/800: dread - d6/d9/dd4/de0/d1b/d3b/ff6 zero size 2024-04-26T21:26:07.314 INFO:tasks.workunit.client.1.smithi120.stdout:9/829: mknod d0/d6/d4d/d65/dec/d2d/c117 0 2024-04-26T21:26:07.315 INFO:tasks.workunit.client.1.smithi120.stdout:7/879: dwrite d7/d64/da6/d1a/d33/d34/d37/fdc [0,4194304] 0 2024-04-26T21:26:07.315 INFO:tasks.workunit.client.1.smithi120.stdout:8/835: mkdir d5/d6/d34/d42/d4a/dbf/d10f 0 2024-04-26T21:26:07.318 INFO:tasks.workunit.client.1.smithi120.stdout:9/830: write d0/d66/fb2 [953645,33030] 0 2024-04-26T21:26:07.319 INFO:tasks.workunit.client.0.smithi084.stdout:6/669: rename d3/de/d1a/d2f/cce to d3/de/d15/d23/d90/da2/dc7/cd9 0 2024-04-26T21:26:07.320 INFO:tasks.workunit.client.1.smithi120.stdout:1/801: creat d6/d9/dd4/f107 x:0 0 0 2024-04-26T21:26:07.322 INFO:tasks.workunit.client.0.smithi084.stdout:8/673: rmdir d4/d6/db/d1e/d22/d39/d4a/da2 39 2024-04-26T21:26:07.323 INFO:tasks.workunit.client.1.smithi120.stdout:7/880: dread - d7/d19/d60/deb/ff8 zero size 2024-04-26T21:26:07.323 INFO:tasks.workunit.client.1.smithi120.stdout:6/909: mkdir d4/db/d10/dd/d28/d9e/daf/dd3/d12c 0 2024-04-26T21:26:07.324 INFO:tasks.workunit.client.1.smithi120.stdout:1/802: write d6/fc [2264042,82452] 0 2024-04-26T21:26:07.325 INFO:tasks.workunit.client.0.smithi084.stdout:2/790: dread d6/d7/d3d/d15/d1f/d39/da5/fcc [0,4194304] 0 2024-04-26T21:26:07.327 INFO:tasks.workunit.client.1.smithi120.stdout:5/905: mkdir d2/dc/d1d/d21/d66/d6a/d8c/daa/d14d 0 2024-04-26T21:26:07.327 INFO:tasks.workunit.client.1.smithi120.stdout:1/803: chown d6/d9/dd4/de0/d2d/d98/d56/ff0 123 1 2024-04-26T21:26:07.328 INFO:tasks.workunit.client.0.smithi084.stdout:2/791: chown d6/d7/d3d/d15/d1f/d41 19635 1 2024-04-26T21:26:07.329 INFO:tasks.workunit.client.0.smithi084.stdout:7/701: dwrite d6/d9/d12/d8b/d72/da0/f58 [0,4194304] 0 2024-04-26T21:26:07.330 INFO:tasks.workunit.client.1.smithi120.stdout:5/906: readlink d2/dc/d1d/d21/d66/l18 0 2024-04-26T21:26:07.331 INFO:tasks.workunit.client.1.smithi120.stdout:9/831: mkdir d0/dd/d3a/de8/d118 0 2024-04-26T21:26:07.333 INFO:tasks.workunit.client.0.smithi084.stdout:4/635: truncate d5/d7/f9b 662709 0 2024-04-26T21:26:07.333 INFO:tasks.workunit.client.0.smithi084.stdout:8/674: mknod d4/d7/d15/d37/d52/d69/cc2 0 2024-04-26T21:26:07.333 INFO:tasks.workunit.client.0.smithi084.stdout:9/597: getdents da/dd5/d93/dc3/d41/d43/d4a 0 2024-04-26T21:26:07.335 INFO:tasks.workunit.client.0.smithi084.stdout:6/670: rename d3/de/d41/d5c/fba to d3/de/d41/d5c/dc3/fda 0 2024-04-26T21:26:07.337 INFO:tasks.workunit.client.1.smithi120.stdout:8/836: mknod d5/d6/d34/d42/d9d/d83/c110 0 2024-04-26T21:26:07.337 INFO:tasks.workunit.client.1.smithi120.stdout:7/881: mknod d7/d19/d60/deb/c124 0 2024-04-26T21:26:07.337 INFO:tasks.workunit.client.0.smithi084.stdout:7/702: mknod d6/d26/d40/cef 0 2024-04-26T21:26:07.338 INFO:tasks.workunit.client.1.smithi120.stdout:9/832: mkdir d0/d66/d93/d119 0 2024-04-26T21:26:07.341 INFO:tasks.workunit.client.1.smithi120.stdout:4/877: getdents d10/d28/dd9/ddd/dee/dd0/dd4/d86/dfa/dfe/d12a 0 2024-04-26T21:26:07.342 INFO:tasks.workunit.client.0.smithi084.stdout:1/683: dwrite d2/d54/d5e/fc3 [0,4194304] 0 2024-04-26T21:26:07.342 INFO:tasks.workunit.client.1.smithi120.stdout:6/910: creat d4/f12d x:0 0 0 2024-04-26T21:26:07.343 INFO:tasks.workunit.client.1.smithi120.stdout:9/833: stat d0/dd/d3a/dae/ded/df1 0 2024-04-26T21:26:07.344 INFO:tasks.workunit.client.0.smithi084.stdout:9/598: chown da/dd5/d93/dc3/d7c/l92 28933 1 2024-04-26T21:26:07.344 INFO:tasks.workunit.client.0.smithi084.stdout:8/675: creat d4/d7/d15/d37/d52/fc3 x:0 0 0 2024-04-26T21:26:07.345 INFO:tasks.workunit.client.0.smithi084.stdout:4/636: creat d5/d10/d82/fcd x:0 0 0 2024-04-26T21:26:07.346 INFO:tasks.workunit.client.1.smithi120.stdout:8/837: rename d5/fb1 to d5/d6/d34/da7/dca/f111 0 2024-04-26T21:26:07.347 INFO:tasks.workunit.client.0.smithi084.stdout:2/792: getdents d6/d3e/d67/dcf 0 2024-04-26T21:26:07.351 INFO:tasks.workunit.client.0.smithi084.stdout:1/684: dread - d2/d9/d15/d28/d69/d9d/fbb zero size 2024-04-26T21:26:07.351 INFO:tasks.workunit.client.1.smithi120.stdout:4/878: mknod d10/d28/dd9/ddd/dee/dd0/dd4/d86/c131 0 2024-04-26T21:26:07.351 INFO:tasks.workunit.client.1.smithi120.stdout:9/834: write d0/d6/d4d/dce/ff2 [1122404,106253] 0 2024-04-26T21:26:07.352 INFO:tasks.workunit.client.0.smithi084.stdout:6/671: rename d3/de/d1a/c34 to d3/de/d15/df/dae/cdb 0 2024-04-26T21:26:07.352 INFO:tasks.workunit.client.0.smithi084.stdout:8/676: stat d4/d6/db/d1e/d22/d39/f82 0 2024-04-26T21:26:07.353 INFO:tasks.workunit.client.0.smithi084.stdout:1/685: chown c1 293 1 2024-04-26T21:26:07.357 INFO:tasks.workunit.client.1.smithi120.stdout:8/838: creat d5/d6/d11/f112 x:0 0 0 2024-04-26T21:26:07.358 INFO:tasks.workunit.client.0.smithi084.stdout:7/703: link d6/d9/d63/f87 d6/d68/d7f/ff0 0 2024-04-26T21:26:07.360 INFO:tasks.workunit.client.0.smithi084.stdout:6/672: creat d3/de/d1a/d43/dd6/fdc x:0 0 0 2024-04-26T21:26:07.365 INFO:tasks.workunit.client.0.smithi084.stdout:1/686: mknod d2/d19/dcc/ce6 0 2024-04-26T21:26:07.366 INFO:tasks.workunit.client.1.smithi120.stdout:4/879: write d10/d28/dd9/ddd/dee/dd0/df3/fff [694653,127601] 0 2024-04-26T21:26:07.368 INFO:tasks.workunit.client.1.smithi120.stdout:4/880: chown d10/d28/dd9 205977353 1 2024-04-26T21:26:07.370 INFO:tasks.workunit.client.1.smithi120.stdout:2/891: dread d4/d1b/d5c/da6/f111 [0,4194304] 0 2024-04-26T21:26:07.370 INFO:tasks.workunit.client.1.smithi120.stdout:9/835: link d0/d6/d4d/d65/dec/d77/dc5/fe1 d0/dd/d45/f11a 0 2024-04-26T21:26:07.375 INFO:tasks.workunit.client.1.smithi120.stdout:8/839: unlink d5/d6/d34/d42/d4a/f99 0 2024-04-26T21:26:07.376 INFO:tasks.workunit.client.0.smithi084.stdout:1/687: dread d2/d9/d15/d28/d47/f81 [0,4194304] 0 2024-04-26T21:26:07.377 INFO:tasks.workunit.client.1.smithi120.stdout:6/911: dread d4/db/d10/d1a/d2b/d57/d67/f66 [0,4194304] 0 2024-04-26T21:26:07.378 INFO:tasks.workunit.client.1.smithi120.stdout:1/804: dread d6/d9/dd4/de0/d1d/f47 [0,4194304] 0 2024-04-26T21:26:07.385 INFO:tasks.workunit.client.0.smithi084.stdout:7/704: dwrite d6/d9/d12/d8b/d72/fd5 [0,4194304] 0 2024-04-26T21:26:07.385 INFO:tasks.workunit.client.0.smithi084.stdout:1/688: mkdir d2/d19/dd2/de7 0 2024-04-26T21:26:07.386 INFO:tasks.workunit.client.1.smithi120.stdout:8/840: unlink d5/d6/d11/fbd 0 2024-04-26T21:26:07.387 INFO:tasks.workunit.client.1.smithi120.stdout:5/907: dread d2/dc/d1d/d21/d77/d79/db7/f4e [0,4194304] 0 2024-04-26T21:26:07.392 INFO:tasks.workunit.client.0.smithi084.stdout:2/793: dread d6/d7/d3d/d79/d81/d82/da8/fba [0,4194304] 0 2024-04-26T21:26:07.393 INFO:tasks.workunit.client.0.smithi084.stdout:7/705: creat d6/d1c/dd8/ff1 x:0 0 0 2024-04-26T21:26:07.394 INFO:tasks.workunit.client.1.smithi120.stdout:9/836: rename d0/dd/d45/d87/cc8 to d0/dd/d34/c11b 0 2024-04-26T21:26:07.396 INFO:tasks.workunit.client.1.smithi120.stdout:6/912: read - d4/db/d10/dd/d43/d58/ff0 zero size 2024-04-26T21:26:07.398 INFO:tasks.workunit.client.0.smithi084.stdout:7/706: dread - d6/d9/db3/fc8 zero size 2024-04-26T21:26:07.403 INFO:tasks.workunit.client.0.smithi084.stdout:2/794: mknod d6/d7/d3d/d15/d1f/d22/d99/c109 0 2024-04-26T21:26:07.404 INFO:tasks.workunit.client.1.smithi120.stdout:8/841: mkdir d5/d6/d34/d42/d9d/d7a/da4/d113 0 2024-04-26T21:26:07.405 INFO:tasks.workunit.client.0.smithi084.stdout:5/671: dwrite d0/dc/df/d75/fbe [0,4194304] 0 2024-04-26T21:26:07.406 INFO:tasks.workunit.client.1.smithi120.stdout:9/837: write d0/dd/d3a/d5c/d9f/f115 [1070,101134] 0 2024-04-26T21:26:07.409 INFO:tasks.workunit.client.1.smithi120.stdout:1/805: link d6/d9/c52 d6/d9/dd4/de0/d85/dbf/c108 0 2024-04-26T21:26:07.410 INFO:tasks.workunit.client.1.smithi120.stdout:4/881: getdents d10/d28/dd9/ddd/dee/dd0/dd4/d86/dfa/dfe/d12a/de2 0 2024-04-26T21:26:07.412 INFO:tasks.workunit.client.1.smithi120.stdout:7/882: dwrite d7/d64/da6/f1d [0,4194304] 0 2024-04-26T21:26:07.412 INFO:tasks.workunit.client.1.smithi120.stdout:8/842: chown d5/d6/d34/d42/d4a/deb/f22 479 1 2024-04-26T21:26:07.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:07 smithi084 ceph-mon[25539]: pgmap v48: 65 pgs: 65 active+clean; 2.7 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 88 MiB/s rd, 197 MiB/s wr, 435 op/s 2024-04-26T21:26:07.413 INFO:tasks.workunit.client.0.smithi084.stdout:2/795: creat d6/d7/db6/dec/f10a x:0 0 0 2024-04-26T21:26:07.415 INFO:tasks.workunit.client.0.smithi084.stdout:7/707: creat d6/ff2 x:0 0 0 2024-04-26T21:26:07.415 INFO:tasks.workunit.client.1.smithi120.stdout:6/913: getdents d4/db/d25/d6d/d97/dc8 0 2024-04-26T21:26:07.417 INFO:tasks.workunit.client.1.smithi120.stdout:2/892: dread d4/f66 [0,4194304] 0 2024-04-26T21:26:07.419 INFO:tasks.workunit.client.0.smithi084.stdout:5/672: truncate d0/dc/df/d31/d53/d5d/fad 284489 0 2024-04-26T21:26:07.424 INFO:tasks.workunit.client.1.smithi120.stdout:7/883: symlink d7/d10/l125 0 2024-04-26T21:26:07.425 INFO:tasks.workunit.client.1.smithi120.stdout:1/806: unlink d6/d9/dd4/de0/d1d/d2c/fa5 0 2024-04-26T21:26:07.427 INFO:tasks.workunit.client.1.smithi120.stdout:7/884: fsync d7/d64/da6/d1a/d33/fa5 0 2024-04-26T21:26:07.428 INFO:tasks.workunit.client.1.smithi120.stdout:6/914: mknod d4/db/d10/d1a/c12e 0 2024-04-26T21:26:07.430 INFO:tasks.workunit.client.1.smithi120.stdout:8/843: unlink d5/d6/d34/da7/cb7 0 2024-04-26T21:26:07.431 INFO:tasks.workunit.client.1.smithi120.stdout:1/807: chown d6/d9/dd4/de0/d2d/d98/c2b 113606517 1 2024-04-26T21:26:07.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:07 smithi120 ceph-mon[32741]: pgmap v48: 65 pgs: 65 active+clean; 2.7 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 88 MiB/s rd, 197 MiB/s wr, 435 op/s 2024-04-26T21:26:07.436 INFO:tasks.workunit.client.1.smithi120.stdout:1/808: creat d6/dd7/f109 x:0 0 0 2024-04-26T21:26:07.436 INFO:tasks.workunit.client.1.smithi120.stdout:6/915: chown d4/db/d10/dd/d28/d9e/daf/dd3/d12c 5 1 2024-04-26T21:26:07.441 INFO:tasks.workunit.client.1.smithi120.stdout:7/885: creat d7/d64/da6/d1a/d33/f126 x:0 0 0 2024-04-26T21:26:07.442 INFO:tasks.workunit.client.1.smithi120.stdout:1/809: mknod d6/dcc/c10a 0 2024-04-26T21:26:07.445 INFO:tasks.workunit.client.1.smithi120.stdout:1/810: chown d6/d14/d3c/f106 17826 1 2024-04-26T21:26:07.446 INFO:tasks.workunit.client.1.smithi120.stdout:8/844: mkdir d5/d6/d34/d42/d9d/d7a/da4/d113/d114 0 2024-04-26T21:26:07.449 INFO:tasks.workunit.client.1.smithi120.stdout:7/886: write d7/d64/da6/d1a/d33/d34/d37/fdc [246813,123886] 0 2024-04-26T21:26:07.454 INFO:tasks.workunit.client.1.smithi120.stdout:8/845: mknod d5/d6/d34/d42/d102/c115 0 2024-04-26T21:26:07.456 INFO:tasks.workunit.client.1.smithi120.stdout:1/811: mknod d6/d9/dd4/de0/d2d/d48/d86/dc1/c10b 0 2024-04-26T21:26:07.458 INFO:tasks.workunit.client.1.smithi120.stdout:7/887: rmdir d7/d19/d60 39 2024-04-26T21:26:07.463 INFO:tasks.workunit.client.1.smithi120.stdout:8/846: rename d5/d6 to d5/d6/d11/d52/d27/d4f/d67/d116 22 2024-04-26T21:26:07.464 INFO:tasks.workunit.client.0.smithi084.stdout:2/796: getdents d6/d7/d3d/d4f/d90/dd9 0 2024-04-26T21:26:07.466 INFO:tasks.workunit.client.1.smithi120.stdout:6/916: dwrite d4/d99/fc1 [0,4194304] 0 2024-04-26T21:26:07.468 INFO:tasks.workunit.client.1.smithi120.stdout:7/888: truncate d7/d10/f10e 753067 0 2024-04-26T21:26:07.471 INFO:tasks.workunit.client.1.smithi120.stdout:4/882: dread d10/d6b/dbf/fcf [0,4194304] 0 2024-04-26T21:26:07.471 INFO:tasks.workunit.client.1.smithi120.stdout:2/893: dwrite d4/d1b/d25/d2c/d3e/f81 [4194304,4194304] 0 2024-04-26T21:26:07.473 INFO:tasks.workunit.client.1.smithi120.stdout:7/889: chown d7/d64/da6/d1f/d28/dbb 32532962 1 2024-04-26T21:26:07.475 INFO:tasks.workunit.client.1.smithi120.stdout:8/847: creat d5/d6/d75/d95/f117 x:0 0 0 2024-04-26T21:26:07.478 INFO:tasks.workunit.client.1.smithi120.stdout:7/890: write d7/fac [866192,2281] 0 2024-04-26T21:26:07.480 INFO:tasks.workunit.client.1.smithi120.stdout:9/838: dwrite d0/d6/d4d/d65/dec/d2d/fa5 [0,4194304] 0 2024-04-26T21:26:07.483 INFO:tasks.workunit.client.1.smithi120.stdout:2/894: symlink d4/d1b/d4f/df8/l12e 0 2024-04-26T21:26:07.486 INFO:tasks.workunit.client.1.smithi120.stdout:2/895: dread - d4/d1b/d2e/d50/d14/dc2/f113 zero size 2024-04-26T21:26:07.487 INFO:tasks.workunit.client.1.smithi120.stdout:7/891: fsync d7/d64/f8a 0 2024-04-26T21:26:07.489 INFO:tasks.workunit.client.0.smithi084.stdout:6/673: write d3/de/d1a/f9d [499248,82159] 0 2024-04-26T21:26:07.494 INFO:tasks.workunit.client.1.smithi120.stdout:8/848: rename d5/d6/d34/d37 to d5/d6/d34/d42/d102/d118 0 2024-04-26T21:26:07.496 INFO:tasks.workunit.client.1.smithi120.stdout:8/849: dread - d5/d6/d11/f112 zero size 2024-04-26T21:26:07.498 INFO:tasks.workunit.client.1.smithi120.stdout:2/896: creat d4/d1b/d25/d2c/d3e/d5e/d63/dcb/dca/dfc/f12f x:0 0 0 2024-04-26T21:26:07.499 INFO:tasks.workunit.client.1.smithi120.stdout:7/892: symlink d7/d64/da6/d1a/l127 0 2024-04-26T21:26:07.500 INFO:tasks.workunit.client.1.smithi120.stdout:3/926: sync 2024-04-26T21:26:07.500 INFO:tasks.workunit.client.1.smithi120.stdout:1/812: write d6/d9/dd4/de0/d2d/d48/f66 [3892633,87035] 0 2024-04-26T21:26:07.500 INFO:tasks.workunit.client.1.smithi120.stdout:8/850: write d5/d6/d11/d32/d3b/f98 [1718558,9544] 0 2024-04-26T21:26:07.501 INFO:tasks.workunit.client.0.smithi084.stdout:7/708: link d6/d9/d12/d19/d7a/fa2 d6/d9/d12/d8b/d72/da0/d80/de5/ff3 0 2024-04-26T21:26:07.502 INFO:tasks.workunit.client.1.smithi120.stdout:1/813: chown d6/dd7 6 1 2024-04-26T21:26:07.503 INFO:tasks.workunit.client.1.smithi120.stdout:4/883: write f6 [985242,38548] 0 2024-04-26T21:26:07.506 INFO:tasks.workunit.client.1.smithi120.stdout:3/927: write dd/f5e [4215675,83104] 0 2024-04-26T21:26:07.508 INFO:tasks.workunit.client.0.smithi084.stdout:5/673: getdents d0 0 2024-04-26T21:26:07.509 INFO:tasks.workunit.client.1.smithi120.stdout:1/814: chown d6/d9/dd4/de0/d2d/d48/d86 3949225 1 2024-04-26T21:26:07.513 INFO:tasks.workunit.client.1.smithi120.stdout:4/884: truncate d10/fe0 150724 0 2024-04-26T21:26:07.514 INFO:tasks.workunit.client.0.smithi084.stdout:5/674: dread - d0/dc/df/f7a zero size 2024-04-26T21:26:07.514 INFO:tasks.workunit.client.1.smithi120.stdout:3/928: truncate dd/d2a/f7f 1375319 0 2024-04-26T21:26:07.515 INFO:tasks.workunit.client.0.smithi084.stdout:1/689: dwrite d2/fb [0,4194304] 0 2024-04-26T21:26:07.515 INFO:tasks.workunit.client.0.smithi084.stdout:7/709: link d6/d1c/d51/c5c d6/d68/d7f/dcf/cf4 0 2024-04-26T21:26:07.517 INFO:tasks.workunit.client.1.smithi120.stdout:1/815: mkdir d6/d9/dd4/de0/d2d/d10c 0 2024-04-26T21:26:07.520 INFO:tasks.workunit.client.1.smithi120.stdout:4/885: creat d10/d6b/d71/f132 x:0 0 0 2024-04-26T21:26:07.522 INFO:tasks.workunit.client.1.smithi120.stdout:1/816: creat d6/d9/dd4/de0/d1d/f10d x:0 0 0 2024-04-26T21:26:07.523 INFO:tasks.workunit.client.1.smithi120.stdout:9/839: write d0/d6/d4d/d65/dec/d2d/d4b/dbc/fca [920012,118677] 0 2024-04-26T21:26:07.528 INFO:tasks.workunit.client.1.smithi120.stdout:3/929: dread dd/de/d83/fa7 [0,4194304] 0 2024-04-26T21:26:07.529 INFO:tasks.workunit.client.1.smithi120.stdout:1/817: fdatasync d6/d9/dd4/de0/d2d/d48/f66 0 2024-04-26T21:26:07.529 INFO:tasks.workunit.client.1.smithi120.stdout:4/886: symlink d10/d28/dd9/ddd/dee/dd0/dd4/l133 0 2024-04-26T21:26:07.530 INFO:tasks.workunit.client.0.smithi084.stdout:7/710: symlink d6/d26/d40/dec/lf5 0 2024-04-26T21:26:07.533 INFO:tasks.workunit.client.0.smithi084.stdout:5/675: fdatasync d0/dc/df/f24 0 2024-04-26T21:26:07.533 INFO:tasks.workunit.client.1.smithi120.stdout:9/840: mknod d0/c11c 0 2024-04-26T21:26:07.535 INFO:tasks.workunit.client.0.smithi084.stdout:5/676: chown d0/dc/df/f9e 934353 1 2024-04-26T21:26:07.539 INFO:tasks.workunit.client.1.smithi120.stdout:5/908: sync 2024-04-26T21:26:07.539 INFO:tasks.workunit.client.1.smithi120.stdout:1/818: fsync d6/d9/dd4/de0/d1b/d3b/f7f 0 2024-04-26T21:26:07.540 INFO:tasks.workunit.client.1.smithi120.stdout:4/887: write d10/d12/da1/d104/f119 [321104,115016] 0 2024-04-26T21:26:07.541 INFO:tasks.workunit.client.1.smithi120.stdout:3/930: rmdir dd/de/df/dda/d24/db1/d76/d3b/d56 39 2024-04-26T21:26:07.542 INFO:tasks.workunit.client.1.smithi120.stdout:8/851: write d5/d6/d34/faf [886211,71107] 0 2024-04-26T21:26:07.544 INFO:tasks.workunit.client.1.smithi120.stdout:9/841: creat d0/dd/d3a/dae/ded/f11d x:0 0 0 2024-04-26T21:26:07.546 INFO:tasks.workunit.client.1.smithi120.stdout:2/897: write d4/d1b/d25/d29/f37 [1105045,81882] 0 2024-04-26T21:26:07.549 INFO:tasks.workunit.client.1.smithi120.stdout:1/819: symlink d6/d9/dd4/de0/d1d/d2c/d58/l10e 0 2024-04-26T21:26:07.551 INFO:tasks.workunit.client.1.smithi120.stdout:4/888: rmdir d10/d28/dd9/ddd/dee/dd0/dd4/d86 39 2024-04-26T21:26:07.554 INFO:tasks.workunit.client.1.smithi120.stdout:6/917: dread d4/db/d10/dd/f74 [0,4194304] 0 2024-04-26T21:26:07.554 INFO:tasks.workunit.client.1.smithi120.stdout:8/852: write d5/d6/d34/d42/d102/d118/f108 [344951,29329] 0 2024-04-26T21:26:07.554 INFO:tasks.workunit.client.1.smithi120.stdout:5/909: chown d2/d30/d93/d107/d36/l122 3 1 2024-04-26T21:26:07.556 INFO:tasks.workunit.client.1.smithi120.stdout:2/898: mkdir d4/d1b/d130 0 2024-04-26T21:26:07.562 INFO:tasks.workunit.client.1.smithi120.stdout:9/842: creat d0/dd/d3a/d5c/d98/f11e x:0 0 0 2024-04-26T21:26:07.563 INFO:tasks.workunit.client.1.smithi120.stdout:6/918: unlink d4/db/d10/d22/d6c/fad 0 2024-04-26T21:26:07.565 INFO:tasks.workunit.client.1.smithi120.stdout:7/893: dread d7/fe [0,4194304] 0 2024-04-26T21:26:07.566 INFO:tasks.workunit.client.1.smithi120.stdout:2/899: write d4/d1b/d25/d29/f116 [423402,50437] 0 2024-04-26T21:26:07.570 INFO:tasks.workunit.client.1.smithi120.stdout:7/894: write d7/d64/da6/d1f/d7d/d8b/fc4 [2290463,25876] 0 2024-04-26T21:26:07.571 INFO:tasks.workunit.client.1.smithi120.stdout:7/895: chown d7/lb 517 1 2024-04-26T21:26:07.577 INFO:tasks.workunit.client.1.smithi120.stdout:4/889: readlink d10/d28/dd9/ddd/dee/dd0/dd4/d86/lcb 0 2024-04-26T21:26:07.577 INFO:tasks.workunit.client.1.smithi120.stdout:5/910: mknod d2/d30/d93/d107/c14e 0 2024-04-26T21:26:07.579 INFO:tasks.workunit.client.1.smithi120.stdout:8/853: creat d5/d6/d34/d42/d102/d118/db8/ddc/de4/f119 x:0 0 0 2024-04-26T21:26:07.583 INFO:tasks.workunit.client.1.smithi120.stdout:1/820: rename d6/d9/dd4/de0/d1d/d5d/d67/de3/ffe to d6/d14/d3c/f10f 0 2024-04-26T21:26:07.584 INFO:tasks.workunit.client.1.smithi120.stdout:5/911: read - d2/d30/d93/d107/d36/d44/d6c/d13f/f143 zero size 2024-04-26T21:26:07.586 INFO:tasks.workunit.client.1.smithi120.stdout:1/821: rmdir d6/dcc 39 2024-04-26T21:26:07.588 INFO:tasks.workunit.client.1.smithi120.stdout:8/854: mkdir d5/d6/d34/d42/d102/d118/db8/d11a 0 2024-04-26T21:26:07.590 INFO:tasks.workunit.client.1.smithi120.stdout:4/890: dread - d10/d28/dd9/ddd/dee/dd0/dd4/d86/dfa/dfe/d12a/f8f zero size 2024-04-26T21:26:07.590 INFO:tasks.workunit.client.0.smithi084.stdout:2/797: dwrite d6/d1b/f7a [0,4194304] 0 2024-04-26T21:26:07.591 INFO:tasks.workunit.client.1.smithi120.stdout:2/900: rename d4/c7 to d4/d1b/d4f/c131 0 2024-04-26T21:26:07.592 INFO:tasks.workunit.client.1.smithi120.stdout:1/822: fsync d6/d9/dd4/de0/d1d/f9b 0 2024-04-26T21:26:07.592 INFO:tasks.workunit.client.1.smithi120.stdout:9/843: dwrite d0/d6/d4d/d65/dec/d2d/d4b/dbc/fca [0,4194304] 0 2024-04-26T21:26:07.595 INFO:tasks.workunit.client.0.smithi084.stdout:2/798: mkdir d6/d7/d3d/d4f/d10b 0 2024-04-26T21:26:07.596 INFO:tasks.workunit.client.1.smithi120.stdout:1/823: chown d6/daa/dae/ca3 3 1 2024-04-26T21:26:07.596 INFO:tasks.workunit.client.1.smithi120.stdout:8/855: chown d5/d6/d34/d42/d102/d118/db8/ddc/de4/fee 283 1 2024-04-26T21:26:07.597 INFO:tasks.workunit.client.1.smithi120.stdout:1/824: stat d6/d9/dd4/de0/d1d/d5d 0 2024-04-26T21:26:07.598 INFO:tasks.workunit.client.1.smithi120.stdout:5/912: fdatasync d2/dc/fd 0 2024-04-26T21:26:07.602 INFO:tasks.workunit.client.1.smithi120.stdout:2/901: creat d4/d1b/d25/d2c/d3e/d5e/d63/dcb/dca/f132 x:0 0 0 2024-04-26T21:26:07.604 INFO:tasks.workunit.client.1.smithi120.stdout:4/891: mkdir d10/d12/da1/d134 0 2024-04-26T21:26:07.606 INFO:tasks.workunit.client.0.smithi084.stdout:2/799: truncate d6/d7/d3d/d79/d81/d82/fa7 1920386 0 2024-04-26T21:26:07.607 INFO:tasks.workunit.client.1.smithi120.stdout:7/896: truncate d7/d64/da6/f16 881087 0 2024-04-26T21:26:07.607 INFO:tasks.workunit.client.0.smithi084.stdout:5/677: truncate d0/dc/df/d31/d72/d84/f89 484977 0 2024-04-26T21:26:07.613 INFO:tasks.workunit.client.1.smithi120.stdout:8/856: symlink d5/d6/d34/d42/d102/d118/db8/l11b 0 2024-04-26T21:26:07.616 INFO:tasks.workunit.client.0.smithi084.stdout:2/800: rename d6/d7/d68/f69 to d6/d7/d68/f10c 0 2024-04-26T21:26:07.616 INFO:tasks.workunit.client.1.smithi120.stdout:1/825: creat d6/d9/dd4/de0/d85/dbf/f110 x:0 0 0 2024-04-26T21:26:07.617 INFO:tasks.workunit.client.1.smithi120.stdout:9/844: link d0/d6/d4d/d65/dec/d2d/l43 d0/d66/d93/db7/d102/l11f 0 2024-04-26T21:26:07.617 INFO:tasks.workunit.client.1.smithi120.stdout:6/919: dwrite d4/d3d/f6e [0,4194304] 0 2024-04-26T21:26:07.617 INFO:tasks.workunit.client.0.smithi084.stdout:2/801: stat d6/d7/d3d/d4f/d90/dd9 0 2024-04-26T21:26:07.619 INFO:tasks.workunit.client.1.smithi120.stdout:5/913: truncate d2/d30/d93/d107/d36/d44/d6c/f12c 802996 0 2024-04-26T21:26:07.621 INFO:tasks.workunit.client.1.smithi120.stdout:4/892: creat d10/d12/da1/d134/f135 x:0 0 0 2024-04-26T21:26:07.622 INFO:tasks.workunit.client.1.smithi120.stdout:8/857: fdatasync d5/d6/d11/f2a 0 2024-04-26T21:26:07.623 INFO:tasks.workunit.client.0.smithi084.stdout:1/690: rename d2/d9/fd4 to d2/fe8 0 2024-04-26T21:26:07.624 INFO:tasks.workunit.client.0.smithi084.stdout:5/678: truncate d0/dc/df/f9e 837723 0 2024-04-26T21:26:07.627 INFO:tasks.workunit.client.0.smithi084.stdout:1/691: stat d2/d54/d5e/d66/d2a/d2c/f34 0 2024-04-26T21:26:07.627 INFO:tasks.workunit.client.0.smithi084.stdout:5/679: fsync d0/f2c 0 2024-04-26T21:26:07.627 INFO:tasks.workunit.client.1.smithi120.stdout:6/920: mkdir d4/db/d25/d6d/d97/d12f 0 2024-04-26T21:26:07.632 INFO:tasks.workunit.client.0.smithi084.stdout:7/711: rename d6/d9/d63/db5/dc3 to d6/d1c/df6 0 2024-04-26T21:26:07.632 INFO:tasks.workunit.client.0.smithi084.stdout:5/680: chown d0/dc/df/d6d/f73 1 1 2024-04-26T21:26:07.635 INFO:tasks.workunit.client.0.smithi084.stdout:1/692: creat d2/d54/d5e/dbe/fe9 x:0 0 0 2024-04-26T21:26:07.636 INFO:tasks.workunit.client.0.smithi084.stdout:5/681: symlink d0/da2/ld2 0 2024-04-26T21:26:07.638 INFO:tasks.workunit.client.0.smithi084.stdout:1/693: chown d2/d54/d5e/d66/d2a/l90 63517755 1 2024-04-26T21:26:07.646 INFO:tasks.workunit.client.0.smithi084.stdout:1/694: write d2/d9/d15/d28/d5a/f91 [1389596,3396] 0 2024-04-26T21:26:07.646 INFO:tasks.workunit.client.0.smithi084.stdout:7/712: mkdir d6/d9/d12/d8b/df7 0 2024-04-26T21:26:07.647 INFO:tasks.workunit.client.1.smithi120.stdout:2/902: write d4/d1b/d25/f86 [197248,8942] 0 2024-04-26T21:26:07.647 INFO:tasks.workunit.client.1.smithi120.stdout:7/897: write d7/d10/d97/d115/f8f [1351038,89105] 0 2024-04-26T21:26:07.650 INFO:tasks.workunit.client.1.smithi120.stdout:9/845: truncate d0/d6/d4d/d65/dec/d77/fcc 744409 0 2024-04-26T21:26:07.654 INFO:tasks.workunit.client.1.smithi120.stdout:2/903: write d4/d1b/d25/d2c/d3e/d5e/d63/dcb/dca/f10f [973121,16274] 0 2024-04-26T21:26:07.655 INFO:tasks.workunit.client.1.smithi120.stdout:5/914: rename d2/df6 to d2/d1b/d89/d14f 0 2024-04-26T21:26:07.655 INFO:tasks.workunit.client.1.smithi120.stdout:8/858: write d5/d6/d34/d42/d102/d118/d94/fb4 [398908,36280] 0 2024-04-26T21:26:07.656 INFO:tasks.workunit.client.0.smithi084.stdout:3/677: sync 2024-04-26T21:26:07.656 INFO:tasks.workunit.client.0.smithi084.stdout:7/713: mknod d6/d68/d7f/dbe/cf8 0 2024-04-26T21:26:07.658 INFO:tasks.workunit.client.1.smithi120.stdout:7/898: creat d7/d19/d60/daa/f128 x:0 0 0 2024-04-26T21:26:07.659 INFO:tasks.workunit.client.1.smithi120.stdout:2/904: dread - d4/d1b/d25/d2c/d3e/f109 zero size 2024-04-26T21:26:07.661 INFO:tasks.workunit.client.1.smithi120.stdout:8/859: write d5/d6/d34/d42/f84 [2720829,71172] 0 2024-04-26T21:26:07.663 INFO:tasks.workunit.client.0.smithi084.stdout:7/714: creat d6/d9/d96/ff9 x:0 0 0 2024-04-26T21:26:07.665 INFO:tasks.workunit.client.1.smithi120.stdout:9/846: rmdir d0/d66/d93/d119 0 2024-04-26T21:26:07.666 INFO:tasks.workunit.client.1.smithi120.stdout:1/826: dread d6/d9/dd4/de0/d1b/d55/fa1 [0,4194304] 0 2024-04-26T21:26:07.666 INFO:tasks.workunit.client.1.smithi120.stdout:4/893: rename d10/d6b/d71/d9d/cae to d10/d28/dd9/c136 0 2024-04-26T21:26:07.666 INFO:tasks.workunit.client.0.smithi084.stdout:3/678: mknod d1/d2c/d2f/d31/d55/d4e/d7c/d7e/cee 0 2024-04-26T21:26:07.667 INFO:tasks.workunit.client.1.smithi120.stdout:2/905: chown d4/d1b/d2e/d50/d14/d15/c17 461161 1 2024-04-26T21:26:07.669 INFO:tasks.workunit.client.1.smithi120.stdout:7/899: creat d7/d64/da6/d1f/d7d/d8b/d94/f129 x:0 0 0 2024-04-26T21:26:07.669 INFO:tasks.workunit.client.1.smithi120.stdout:9/847: chown d0/c11c 241299 1 2024-04-26T21:26:07.670 INFO:tasks.workunit.client.1.smithi120.stdout:8/860: truncate d5/d6/d34/d42/f71 3552522 0 2024-04-26T21:26:07.671 INFO:tasks.workunit.client.0.smithi084.stdout:5/682: dwrite d0/dc/df/d31/d53/f60 [0,4194304] 0 2024-04-26T21:26:07.674 INFO:tasks.workunit.client.0.smithi084.stdout:7/715: symlink d6/d9/d12/d8b/d72/da0/d80/lfa 0 2024-04-26T21:26:07.674 INFO:tasks.workunit.client.0.smithi084.stdout:2/802: dwrite d6/d7/d3d/d15/fc7 [0,4194304] 0 2024-04-26T21:26:07.675 INFO:tasks.workunit.client.0.smithi084.stdout:5/683: read d0/dc/df/d75/fba [2786,56404] 0 2024-04-26T21:26:07.680 INFO:tasks.workunit.client.0.smithi084.stdout:1/695: dwrite d2/d1b/f8b [4194304,4194304] 0 2024-04-26T21:26:07.680 INFO:tasks.workunit.client.1.smithi120.stdout:6/921: rename d4/db/d10/dd/f74 to d4/db/d10/d1a/d2b/f130 0 2024-04-26T21:26:07.683 INFO:tasks.workunit.client.1.smithi120.stdout:8/861: write d5/d6/d34/d42/d102/d118/d60/fff [407883,116019] 0 2024-04-26T21:26:07.683 INFO:tasks.workunit.client.0.smithi084.stdout:3/679: symlink d1/d2c/d2f/d31/d55/lef 0 2024-04-26T21:26:07.685 INFO:tasks.workunit.client.1.smithi120.stdout:8/862: chown d5/d6/d11/c24 2969691 1 2024-04-26T21:26:07.685 INFO:tasks.workunit.client.0.smithi084.stdout:8/677: sync 2024-04-26T21:26:07.685 INFO:tasks.workunit.client.0.smithi084.stdout:9/599: sync 2024-04-26T21:26:07.686 INFO:tasks.workunit.client.0.smithi084.stdout:0/698: sync 2024-04-26T21:26:07.686 INFO:tasks.workunit.client.0.smithi084.stdout:4/637: sync 2024-04-26T21:26:07.686 INFO:tasks.workunit.client.0.smithi084.stdout:6/674: sync 2024-04-26T21:26:07.686 INFO:tasks.workunit.client.1.smithi120.stdout:8/863: chown d5/d6/d34/da7 2756 1 2024-04-26T21:26:07.687 INFO:tasks.workunit.client.0.smithi084.stdout:7/716: write d6/d9/d12/d8b/f8d [685267,65076] 0 2024-04-26T21:26:07.688 INFO:tasks.workunit.client.1.smithi120.stdout:2/906: dwrite d4/d1b/d5c/da6/ff1 [0,4194304] 0 2024-04-26T21:26:07.690 INFO:tasks.workunit.client.0.smithi084.stdout:5/684: chown d0/dc/df/d31/d53/d5d/l67 36 1 2024-04-26T21:26:07.691 INFO:tasks.workunit.client.1.smithi120.stdout:2/907: write d4/f3a [719311,59876] 0 2024-04-26T21:26:07.694 INFO:tasks.workunit.client.0.smithi084.stdout:0/699: chown de/d2b/d77/d32/d96 637682 1 2024-04-26T21:26:07.695 INFO:tasks.workunit.client.1.smithi120.stdout:5/915: dwrite d2/d30/d93/d107/d36/f65 [0,4194304] 0 2024-04-26T21:26:07.696 INFO:tasks.workunit.client.0.smithi084.stdout:7/717: chown d6/d9/d12/d8b/df7 2060852 1 2024-04-26T21:26:07.699 INFO:tasks.workunit.client.0.smithi084.stdout:3/680: chown d1/d2c/d2f/d31/d55/d4e/d7c/d7e/c93 850751221 1 2024-04-26T21:26:07.701 INFO:tasks.workunit.client.1.smithi120.stdout:5/916: chown d2/d1b/d89/d47/f53 2488449 1 2024-04-26T21:26:07.701 INFO:tasks.workunit.client.1.smithi120.stdout:5/917: write d2/d30/f8b [1263453,117009] 0 2024-04-26T21:26:07.702 INFO:tasks.workunit.client.0.smithi084.stdout:6/675: read - d3/de/d1a/d43/d72/dad/fc2 zero size 2024-04-26T21:26:07.705 INFO:tasks.workunit.client.1.smithi120.stdout:4/894: write d10/d12/f27 [4358027,102738] 0 2024-04-26T21:26:07.705 INFO:tasks.workunit.client.1.smithi120.stdout:7/900: mkdir d7/d10/d97/d115/dfc/d12a 0 2024-04-26T21:26:07.706 INFO:tasks.workunit.client.0.smithi084.stdout:4/638: mknod d5/d7/d65/cce 0 2024-04-26T21:26:07.706 INFO:tasks.workunit.client.1.smithi120.stdout:9/848: mknod d0/dd/d3a/d5c/d98/db8/c120 0 2024-04-26T21:26:07.707 INFO:tasks.workunit.client.1.smithi120.stdout:4/895: dread - d10/d12/f54 zero size 2024-04-26T21:26:07.710 INFO:tasks.workunit.client.0.smithi084.stdout:9/600: creat da/dd5/db6/fde x:0 0 0 2024-04-26T21:26:07.712 INFO:tasks.workunit.client.1.smithi120.stdout:7/901: write d7/d64/da6/d1f/f106 [6798427,115686] 0 2024-04-26T21:26:07.712 INFO:tasks.workunit.client.1.smithi120.stdout:4/896: readlink d10/d28/l61 0 2024-04-26T21:26:07.712 INFO:tasks.workunit.client.1.smithi120.stdout:8/864: unlink d5/d6/d34/d42/d9d/la1 0 2024-04-26T21:26:07.712 INFO:tasks.workunit.client.0.smithi084.stdout:6/676: truncate d3/de/d1a/d2f/f3c 5207974 0 2024-04-26T21:26:07.714 INFO:tasks.workunit.client.1.smithi120.stdout:7/902: chown d7/d19/l47 6441 1 2024-04-26T21:26:07.714 INFO:tasks.workunit.client.1.smithi120.stdout:1/827: rename d6/d9/dd4/de0/d2d/d98/d35/cd0 to d6/d9/dd4/de0/d1d/d5d/d67/de3/d105/c111 0 2024-04-26T21:26:07.715 INFO:tasks.workunit.client.0.smithi084.stdout:7/718: symlink d6/d26/lfb 0 2024-04-26T21:26:07.719 INFO:tasks.workunit.client.0.smithi084.stdout:5/685: unlink d0/dc/df/c12 0 2024-04-26T21:26:07.720 INFO:tasks.workunit.client.0.smithi084.stdout:2/803: rename d6/d7/d3d/d15/d1f/d39/d43/fcb to d6/d7/d3d/d15/d1f/d22/d2a/f10d 0 2024-04-26T21:26:07.720 INFO:tasks.workunit.client.0.smithi084.stdout:1/696: creat d2/d9/d15/d28/fea x:0 0 0 2024-04-26T21:26:07.722 INFO:tasks.workunit.client.0.smithi084.stdout:5/686: chown d0/l26 62740 1 2024-04-26T21:26:07.725 INFO:tasks.workunit.client.0.smithi084.stdout:3/681: creat d1/d2c/d2f/d31/dc7/ff0 x:0 0 0 2024-04-26T21:26:07.727 INFO:tasks.workunit.client.1.smithi120.stdout:2/908: fdatasync d4/dea/fff 0 2024-04-26T21:26:07.728 INFO:tasks.workunit.client.1.smithi120.stdout:8/865: write d5/d6/d34/d42/d9d/d83/f97 [3330745,121058] 0 2024-04-26T21:26:07.728 INFO:tasks.workunit.client.0.smithi084.stdout:7/719: chown d6/d9/d12/d8b/cee 380331214 1 2024-04-26T21:26:07.733 INFO:tasks.workunit.client.0.smithi084.stdout:1/697: rmdir d2/d54/d5e/d66/d3a/d48 39 2024-04-26T21:26:07.735 INFO:tasks.workunit.client.0.smithi084.stdout:2/804: write d6/d7/d3d/d79/fdf [5788330,79734] 0 2024-04-26T21:26:07.737 INFO:tasks.workunit.client.0.smithi084.stdout:0/700: getdents de/d78/d9e/da1 0 2024-04-26T21:26:07.742 INFO:tasks.workunit.client.0.smithi084.stdout:1/698: fdatasync d2/d9/d15/d28/d5a/fd5 0 2024-04-26T21:26:07.742 INFO:tasks.workunit.client.0.smithi084.stdout:3/682: write d1/d2c/d2f/d31/d55/d4e/d98/d9e/fa9 [1512149,101516] 0 2024-04-26T21:26:07.742 INFO:tasks.workunit.client.0.smithi084.stdout:5/687: symlink d0/dc/d48/ld3 0 2024-04-26T21:26:07.743 INFO:tasks.workunit.client.0.smithi084.stdout:7/720: symlink d6/d68/d7f/lfc 0 2024-04-26T21:26:07.746 INFO:tasks.workunit.client.0.smithi084.stdout:4/639: getdents d5/d25/d35/d60/d69/db2 0 2024-04-26T21:26:07.746 INFO:tasks.workunit.client.0.smithi084.stdout:8/678: truncate d4/d6/db/d1e/f45 1717019 0 2024-04-26T21:26:07.747 INFO:tasks.workunit.client.1.smithi120.stdout:3/931: sync 2024-04-26T21:26:07.748 INFO:tasks.workunit.client.1.smithi120.stdout:9/849: dread d0/dd/f83 [0,4194304] 0 2024-04-26T21:26:07.751 INFO:tasks.workunit.client.1.smithi120.stdout:3/932: dread - dd/de/df/dda/d24/f5a zero size 2024-04-26T21:26:07.755 INFO:tasks.workunit.client.1.smithi120.stdout:3/933: write dd/de/d83/db2/ffb [868787,109523] 0 2024-04-26T21:26:07.756 INFO:tasks.workunit.client.1.smithi120.stdout:6/922: dwrite d4/db/d10/d22/d6c/d9a/f105 [0,4194304] 0 2024-04-26T21:26:07.757 INFO:tasks.workunit.client.0.smithi084.stdout:5/688: write d0/dc/df/d31/d53/f60 [2647799,108644] 0 2024-04-26T21:26:07.759 INFO:tasks.workunit.client.0.smithi084.stdout:7/721: fdatasync d6/d68/d7f/ff0 0 2024-04-26T21:26:07.760 INFO:tasks.workunit.client.0.smithi084.stdout:3/683: mknod d1/dea/cf1 0 2024-04-26T21:26:07.761 INFO:tasks.workunit.client.0.smithi084.stdout:2/805: link d6/d1b/ffc d6/d7/d3d/d79/d81/d82/da8/f10e 0 2024-04-26T21:26:07.764 INFO:tasks.workunit.client.0.smithi084.stdout:6/677: dwrite d3/de/d1a/d2f/f56 [0,4194304] 0 2024-04-26T21:26:07.769 INFO:tasks.workunit.client.0.smithi084.stdout:9/601: dwrite da/d9e/fdd [0,4194304] 0 2024-04-26T21:26:07.775 INFO:tasks.workunit.client.1.smithi120.stdout:7/903: creat d7/d10/d97/d115/f12b x:0 0 0 2024-04-26T21:26:07.777 INFO:tasks.workunit.client.1.smithi120.stdout:4/897: creat d10/d28/dd9/ddd/df1/f137 x:0 0 0 2024-04-26T21:26:07.777 INFO:tasks.workunit.client.0.smithi084.stdout:5/689: mknod d0/dc/df/d31/d53/d87/cd4 0 2024-04-26T21:26:07.778 INFO:tasks.workunit.client.0.smithi084.stdout:8/679: mkdir d4/d6/db/d1e/d22/d39/dc4 0 2024-04-26T21:26:07.780 INFO:tasks.workunit.client.1.smithi120.stdout:4/898: dread - d10/d6b/da4/f12e zero size 2024-04-26T21:26:07.781 INFO:tasks.workunit.client.0.smithi084.stdout:7/722: symlink d6/d26/d40/dec/lfd 0 2024-04-26T21:26:07.782 INFO:tasks.workunit.client.1.smithi120.stdout:5/918: dread d2/dc/f38 [0,4194304] 0 2024-04-26T21:26:07.783 INFO:tasks.workunit.client.1.smithi120.stdout:4/899: chown d10/d28/l3f 267888346 1 2024-04-26T21:26:07.789 INFO:tasks.workunit.client.0.smithi084.stdout:3/684: mknod d1/d24/d27/d3a/d81/cf2 0 2024-04-26T21:26:07.792 INFO:tasks.workunit.client.1.smithi120.stdout:6/923: mkdir d4/db/d10/d22/d56/d131 0 2024-04-26T21:26:07.793 INFO:tasks.workunit.client.1.smithi120.stdout:2/909: chown d4/d1b/d4f/df8 23520896 1 2024-04-26T21:26:07.793 INFO:tasks.workunit.client.1.smithi120.stdout:7/904: truncate d7/d10/f11 801199 0 2024-04-26T21:26:07.795 INFO:tasks.workunit.client.0.smithi084.stdout:7/723: chown d6/d9/d12/f2c 231552509 1 2024-04-26T21:26:07.796 INFO:tasks.workunit.client.1.smithi120.stdout:4/900: mkdir d10/d12/d138 0 2024-04-26T21:26:07.799 INFO:tasks.workunit.client.1.smithi120.stdout:6/924: stat d4/db/d10/d22/f62 0 2024-04-26T21:26:07.800 INFO:tasks.workunit.client.1.smithi120.stdout:2/910: read - d4/d1b/d56/d65/fc5 zero size 2024-04-26T21:26:07.800 INFO:tasks.workunit.client.0.smithi084.stdout:4/640: dwrite d5/d7/d65/d7f/db8/f66 [4194304,4194304] 0 2024-04-26T21:26:07.803 INFO:tasks.workunit.client.1.smithi120.stdout:9/850: creat d0/d66/d93/db7/f121 x:0 0 0 2024-04-26T21:26:07.805 INFO:tasks.workunit.client.1.smithi120.stdout:4/901: creat d10/d28/dd9/ddd/dee/dd0/dd4/d86/f139 x:0 0 0 2024-04-26T21:26:07.806 INFO:tasks.workunit.client.0.smithi084.stdout:2/806: dread d6/d1b/f7a [0,4194304] 0 2024-04-26T21:26:07.809 INFO:tasks.workunit.client.1.smithi120.stdout:6/925: truncate d4/db/d10/dd/d43/f108 738607 0 2024-04-26T21:26:07.811 INFO:tasks.workunit.client.1.smithi120.stdout:5/919: dwrite d2/dc/d1d/d21/f129 [0,4194304] 0 2024-04-26T21:26:07.819 INFO:tasks.workunit.client.1.smithi120.stdout:2/911: symlink d4/d1b/d2e/d50/d14/d15/d6c/l133 0 2024-04-26T21:26:07.821 INFO:tasks.workunit.client.0.smithi084.stdout:4/641: dread d5/d25/d35/f86 [0,4194304] 0 2024-04-26T21:26:07.822 INFO:tasks.workunit.client.1.smithi120.stdout:6/926: symlink d4/db/d10/d22/d56/d94/l132 0 2024-04-26T21:26:07.825 INFO:tasks.workunit.client.1.smithi120.stdout:4/902: mkdir d10/d28/dd9/ddd/dee/dd0/dd4/d13a 0 2024-04-26T21:26:07.826 INFO:tasks.workunit.client.0.smithi084.stdout:3/685: unlink d1/f23 0 2024-04-26T21:26:07.827 INFO:tasks.workunit.client.1.smithi120.stdout:7/905: link d7/d64/da6/d1a/d33/f83 d7/d64/da6/d1a/d33/d109/f12c 0 2024-04-26T21:26:07.828 INFO:tasks.workunit.client.0.smithi084.stdout:4/642: write d5/d10/da1/fbb [459040,10953] 0 2024-04-26T21:26:07.829 INFO:tasks.workunit.client.1.smithi120.stdout:4/903: write d10/d12/f58 [1178230,92679] 0 2024-04-26T21:26:07.830 INFO:tasks.workunit.client.0.smithi084.stdout:7/724: truncate d6/d9/d12/d19/d20/f57 1011108 0 2024-04-26T21:26:07.830 INFO:tasks.workunit.client.1.smithi120.stdout:2/912: mknod d4/d1b/d25/d2c/d3e/c134 0 2024-04-26T21:26:07.834 INFO:tasks.workunit.client.0.smithi084.stdout:2/807: mkdir d6/d7/d3d/d15/d1f/d39/d43/d10f 0 2024-04-26T21:26:07.836 INFO:tasks.workunit.client.0.smithi084.stdout:3/686: creat d1/d24/d27/d3a/d81/ff3 x:0 0 0 2024-04-26T21:26:07.836 INFO:tasks.workunit.client.0.smithi084.stdout:6/678: dwrite d3/de/d15/d5f/dc1/dd3/fd8 [0,4194304] 0 2024-04-26T21:26:07.838 INFO:tasks.workunit.client.1.smithi120.stdout:9/851: dwrite d0/dd/d45/f63 [0,4194304] 0 2024-04-26T21:26:07.839 INFO:tasks.workunit.client.1.smithi120.stdout:4/904: rmdir d10/d12/da1/daf 39 2024-04-26T21:26:07.840 INFO:tasks.workunit.client.0.smithi084.stdout:4/643: symlink d5/d25/d35/lcf 0 2024-04-26T21:26:07.841 INFO:tasks.workunit.client.0.smithi084.stdout:8/680: rename d4/d6/f8d to d4/d6/db/fc5 0 2024-04-26T21:26:07.842 INFO:tasks.workunit.client.1.smithi120.stdout:9/852: stat d0/dd/d3a/d5c/d98/faa 0 2024-04-26T21:26:07.843 INFO:tasks.workunit.client.0.smithi084.stdout:7/725: rmdir d6/d9/d63 39 2024-04-26T21:26:07.845 INFO:tasks.workunit.client.1.smithi120.stdout:7/906: rename d7/d64/da6/d1f/d7d/fd0 to d7/d64/da6/d1a/d33/d109/dbf/f12d 0 2024-04-26T21:26:07.847 INFO:tasks.workunit.client.0.smithi084.stdout:5/690: getdents d0/d49/d4d 0 2024-04-26T21:26:07.848 INFO:tasks.workunit.client.0.smithi084.stdout:4/644: mkdir d5/d25/d35/d60/d6d/dd0 0 2024-04-26T21:26:07.848 INFO:tasks.workunit.client.0.smithi084.stdout:9/602: dread da/de/f11 [0,4194304] 0 2024-04-26T21:26:07.850 INFO:tasks.workunit.client.0.smithi084.stdout:7/726: rmdir d6/d9/d12 39 2024-04-26T21:26:07.851 INFO:tasks.workunit.client.1.smithi120.stdout:4/905: creat d10/d12/da1/d104/f13b x:0 0 0 2024-04-26T21:26:07.853 INFO:tasks.workunit.client.0.smithi084.stdout:3/687: unlink d1/d2c/c39 0 2024-04-26T21:26:07.856 INFO:tasks.workunit.client.0.smithi084.stdout:6/679: symlink d3/de/d15/d23/ldd 0 2024-04-26T21:26:07.866 INFO:tasks.workunit.client.0.smithi084.stdout:2/808: rename d6/d7/d3d/d79/cc4 to d6/d7/d3d/c110 0 2024-04-26T21:26:07.868 INFO:tasks.workunit.client.0.smithi084.stdout:3/688: creat d1/d2c/d2f/d31/d55/d4e/d7c/ff4 x:0 0 0 2024-04-26T21:26:07.871 INFO:tasks.workunit.client.1.smithi120.stdout:8/866: dwrite d5/d6/d11/d52/d27/f51 [0,4194304] 0 2024-04-26T21:26:07.871 INFO:tasks.workunit.client.1.smithi120.stdout:2/913: dwrite d4/fd8 [4194304,4194304] 0 2024-04-26T21:26:07.871 INFO:tasks.workunit.client.1.smithi120.stdout:5/920: truncate d2/dc/d1d/d21/f129 1983931 0 2024-04-26T21:26:07.873 INFO:tasks.workunit.client.0.smithi084.stdout:2/809: chown d6/d7/d3d/d15/d1f/d22/d99/f9d 20 1 2024-04-26T21:26:07.876 INFO:tasks.workunit.client.1.smithi120.stdout:2/914: write d4/d1b/d25/f86 [952575,28797] 0 2024-04-26T21:26:07.876 INFO:tasks.workunit.client.1.smithi120.stdout:4/906: dread d10/d65/f7e [0,4194304] 0 2024-04-26T21:26:07.877 INFO:tasks.workunit.client.1.smithi120.stdout:5/921: write d2/d1b/d89/d47/d8a/f11d [823099,11955] 0 2024-04-26T21:26:07.878 INFO:tasks.workunit.client.0.smithi084.stdout:5/691: creat d0/dc/fd5 x:0 0 0 2024-04-26T21:26:07.882 INFO:tasks.workunit.client.0.smithi084.stdout:8/681: creat d4/d7/d15/fc6 x:0 0 0 2024-04-26T21:26:07.882 INFO:tasks.workunit.client.0.smithi084.stdout:9/603: dwrite da/db3/fd8 [0,4194304] 0 2024-04-26T21:26:07.882 INFO:tasks.workunit.client.0.smithi084.stdout:2/810: dread - d6/d7/d3d/d15/d1f/d39/d20/d36/da4/fee zero size 2024-04-26T21:26:07.884 INFO:tasks.workunit.client.1.smithi120.stdout:1/828: dwrite d6/d9/dd4/de0/d1d/d5d/f90 [0,4194304] 0 2024-04-26T21:26:07.884 INFO:tasks.workunit.client.1.smithi120.stdout:2/915: fsync d4/d1b/d2e/d50/d14/d15/f12d 0 2024-04-26T21:26:07.888 INFO:tasks.workunit.client.0.smithi084.stdout:9/604: readlink da/de/d16/d40/l4c 0 2024-04-26T21:26:07.888 INFO:tasks.workunit.client.0.smithi084.stdout:6/680: link d3/d18/d37/f92 d3/de/d41/d5c/dc3/fde 0 2024-04-26T21:26:07.893 INFO:tasks.workunit.client.0.smithi084.stdout:1/699: truncate d2/d54/d5e/d66/d2a/d2c/d45/fb8 676501 0 2024-04-26T21:26:07.899 INFO:tasks.workunit.client.0.smithi084.stdout:0/701: sync 2024-04-26T21:26:07.906 INFO:tasks.workunit.client.1.smithi120.stdout:2/916: rename d4/d1b/c23 to d4/d1b/d2e/d50/d14/dc2/c135 0 2024-04-26T21:26:07.907 INFO:tasks.workunit.client.0.smithi084.stdout:8/682: creat d4/d7/d15/fc7 x:0 0 0 2024-04-26T21:26:07.911 INFO:tasks.workunit.client.1.smithi120.stdout:8/867: dwrite d5/d6/d34/d42/d4a/deb/d88/fbb [0,4194304] 0 2024-04-26T21:26:07.911 INFO:tasks.workunit.client.1.smithi120.stdout:2/917: fdatasync d4/d1b/d4f/f9c 0 2024-04-26T21:26:07.913 INFO:tasks.workunit.client.0.smithi084.stdout:9/605: fdatasync da/dd5/d93/dc3/d41/d43/d48/d61/f77 0 2024-04-26T21:26:07.914 INFO:tasks.workunit.client.1.smithi120.stdout:1/829: read d6/d9/dd4/de0/d1d/f9b [226942,88359] 0 2024-04-26T21:26:07.916 INFO:tasks.workunit.client.0.smithi084.stdout:8/683: symlink d4/d7/d15/d3c/lc8 0 2024-04-26T21:26:07.916 INFO:tasks.workunit.client.0.smithi084.stdout:5/692: link d0/d49/c58 d0/dc/df/d31/d63/dbf/cd6 0 2024-04-26T21:26:07.919 INFO:tasks.workunit.client.0.smithi084.stdout:0/702: creat de/d78/d9e/da1/dad/fe0 x:0 0 0 2024-04-26T21:26:07.922 INFO:tasks.workunit.client.0.smithi084.stdout:8/684: symlink d4/d6/db/d1e/d7c/lc9 0 2024-04-26T21:26:07.923 INFO:tasks.workunit.client.0.smithi084.stdout:3/689: dread d1/d2c/d2f/f16 [0,4194304] 0 2024-04-26T21:26:07.924 INFO:tasks.workunit.client.1.smithi120.stdout:8/868: mknod d5/d6/d34/d42/d102/d118/dd9/dda/dfc/c11c 0 2024-04-26T21:26:07.927 INFO:tasks.workunit.client.1.smithi120.stdout:4/907: write d10/d12/f5c [111740,47966] 0 2024-04-26T21:26:07.932 INFO:tasks.workunit.client.0.smithi084.stdout:3/690: rmdir d1/d24/dbb 39 2024-04-26T21:26:07.932 INFO:tasks.workunit.client.0.smithi084.stdout:9/606: link da/dd5/d93/dc3/d4f/lc0 da/dd5/d93/dc3/ldf 0 2024-04-26T21:26:07.933 INFO:tasks.workunit.client.0.smithi084.stdout:5/693: dread d0/dc/df/d31/d53/d87/f9f [0,4194304] 0 2024-04-26T21:26:07.933 INFO:tasks.workunit.client.1.smithi120.stdout:8/869: creat d5/d6/d34/d42/d4a/dbf/d10f/f11d x:0 0 0 2024-04-26T21:26:07.934 INFO:tasks.workunit.client.0.smithi084.stdout:5/694: fdatasync d0/d17/fae 0 2024-04-26T21:26:07.935 INFO:tasks.workunit.client.1.smithi120.stdout:4/908: symlink d10/d6b/d71/dd7/l13c 0 2024-04-26T21:26:07.937 INFO:tasks.workunit.client.0.smithi084.stdout:2/811: read d6/d7/d3d/d15/d1f/d39/fa6 [3417613,52619] 0 2024-04-26T21:26:07.937 INFO:tasks.workunit.client.0.smithi084.stdout:3/691: mkdir d1/d24/d27/d3a/ddb/df5 0 2024-04-26T21:26:07.938 INFO:tasks.workunit.client.0.smithi084.stdout:0/703: link de/d2b/d45/d63/f86 de/d78/d9e/fe1 0 2024-04-26T21:26:07.938 INFO:tasks.workunit.client.0.smithi084.stdout:3/692: stat d1/d2c/f90 0 2024-04-26T21:26:07.939 INFO:tasks.workunit.client.1.smithi120.stdout:8/870: dread - d5/d6/d11/d52/d27/ffe zero size 2024-04-26T21:26:07.941 INFO:tasks.workunit.client.0.smithi084.stdout:0/704: chown de/d2b/d45/d63/c66 6 1 2024-04-26T21:26:07.941 INFO:tasks.workunit.client.1.smithi120.stdout:5/922: dwrite d2/dc/d1d/d21/fd8 [0,4194304] 0 2024-04-26T21:26:07.941 INFO:tasks.workunit.client.1.smithi120.stdout:7/907: dwrite d7/d64/da6/d1a/d33/d34/d37/f79 [0,4194304] 0 2024-04-26T21:26:07.942 INFO:tasks.workunit.client.0.smithi084.stdout:0/705: chown de/d20/c76 222606879 1 2024-04-26T21:26:07.943 INFO:tasks.workunit.client.0.smithi084.stdout:8/685: mkdir d4/d6/db/d9b/dca 0 2024-04-26T21:26:07.944 INFO:tasks.workunit.client.1.smithi120.stdout:4/909: write d10/d65/f107 [702859,102115] 0 2024-04-26T21:26:07.948 INFO:tasks.workunit.client.1.smithi120.stdout:4/910: chown d10/d65/f107 114451 1 2024-04-26T21:26:07.949 INFO:tasks.workunit.client.1.smithi120.stdout:5/923: symlink d2/d82/l150 0 2024-04-26T21:26:07.950 INFO:tasks.workunit.client.1.smithi120.stdout:1/830: dwrite d6/d9/dd4/de0/d1d/d5d/feb [0,4194304] 0 2024-04-26T21:26:07.951 INFO:tasks.workunit.client.1.smithi120.stdout:4/911: write d10/d6b/da4/fbc [1034417,24114] 0 2024-04-26T21:26:07.951 INFO:tasks.workunit.client.0.smithi084.stdout:3/693: mknod d1/d2c/d2f/d31/d3b/cf6 0 2024-04-26T21:26:07.953 INFO:tasks.workunit.client.0.smithi084.stdout:5/695: dwrite d0/f2c [0,4194304] 0 2024-04-26T21:26:07.957 INFO:tasks.workunit.client.0.smithi084.stdout:3/694: read - d1/d2c/d2f/d31/d3b/fad zero size 2024-04-26T21:26:07.959 INFO:tasks.workunit.client.0.smithi084.stdout:0/706: write de/f8b [3372462,30475] 0 2024-04-26T21:26:07.966 INFO:tasks.workunit.client.1.smithi120.stdout:8/871: rename d5/d6/d34/da7 to d5/d6/d34/d42/d9d/d83/d11e 0 2024-04-26T21:26:07.969 INFO:tasks.workunit.client.0.smithi084.stdout:8/686: chown d4/d6/db/c1b 2936 1 2024-04-26T21:26:07.971 INFO:tasks.workunit.client.1.smithi120.stdout:4/912: symlink d10/d6b/dbf/l13d 0 2024-04-26T21:26:07.972 INFO:tasks.workunit.client.0.smithi084.stdout:3/695: creat d1/d2c/ff7 x:0 0 0 2024-04-26T21:26:07.972 INFO:tasks.workunit.client.0.smithi084.stdout:4/645: dwrite d5/d7/d65/d7f/db8/f3c [0,4194304] 0 2024-04-26T21:26:07.974 INFO:tasks.workunit.client.0.smithi084.stdout:5/696: unlink d0/dc/df/d31/lc0 0 2024-04-26T21:26:07.975 INFO:tasks.workunit.client.1.smithi120.stdout:7/908: getdents d7/d19/d60/daa 0 2024-04-26T21:26:07.976 INFO:tasks.workunit.client.1.smithi120.stdout:7/909: stat d7/d19/d60/f76 0 2024-04-26T21:26:07.979 INFO:tasks.workunit.client.0.smithi084.stdout:4/646: write d5/fae [536970,98547] 0 2024-04-26T21:26:07.979 INFO:tasks.workunit.client.1.smithi120.stdout:1/831: creat d6/d9/dd4/de0/d1d/d5d/dde/f112 x:0 0 0 2024-04-26T21:26:07.980 INFO:tasks.workunit.client.1.smithi120.stdout:4/913: fsync d10/d28/f4e 0 2024-04-26T21:26:07.985 INFO:tasks.workunit.client.0.smithi084.stdout:6/681: dwrite d3/de/f63 [0,4194304] 0 2024-04-26T21:26:07.993 INFO:tasks.workunit.client.1.smithi120.stdout:4/914: unlink d10/d12/f19 0 2024-04-26T21:26:07.995 INFO:tasks.workunit.client.1.smithi120.stdout:8/872: creat d5/d6/f11f x:0 0 0 2024-04-26T21:26:07.995 INFO:tasks.workunit.client.0.smithi084.stdout:8/687: dread d4/d6/db/d1e/d22/d39/f93 [0,4194304] 0 2024-04-26T21:26:08.000 INFO:tasks.workunit.client.0.smithi084.stdout:4/647: creat d5/d25/d99/da0/fd1 x:0 0 0 2024-04-26T21:26:08.000 INFO:tasks.workunit.client.1.smithi120.stdout:4/915: write d10/d28/dd9/ddd/dee/dd0/fe9 [5438720,48724] 0 2024-04-26T21:26:08.002 INFO:tasks.workunit.client.1.smithi120.stdout:7/910: dwrite d7/d19/d60/deb/ff8 [0,4194304] 0 2024-04-26T21:26:08.003 INFO:tasks.workunit.client.1.smithi120.stdout:1/832: rename d6/d9/dd4/de0/d1d/d2c/d58/l10e to d6/d9/dd4/de0/d2d/d98/d56/l113 0 2024-04-26T21:26:08.003 INFO:tasks.workunit.client.1.smithi120.stdout:9/853: dread d0/dd/d3a/d5c/d9f/fa2 [0,4194304] 0 2024-04-26T21:26:08.004 INFO:tasks.workunit.client.0.smithi084.stdout:6/682: chown d3/de/d15/d23/d90/da2/dc7/cd9 137 1 2024-04-26T21:26:08.008 INFO:tasks.workunit.client.0.smithi084.stdout:7/727: dread d6/d9/d12/d8b/d72/da0/f85 [0,4194304] 0 2024-04-26T21:26:08.009 INFO:tasks.workunit.client.0.smithi084.stdout:0/707: dwrite de/d20/f29 [0,4194304] 0 2024-04-26T21:26:08.011 INFO:tasks.workunit.client.1.smithi120.stdout:8/873: creat d5/d6/d34/d42/d9d/d7a/f120 x:0 0 0 2024-04-26T21:26:08.013 INFO:tasks.workunit.client.0.smithi084.stdout:8/688: mknod d4/d7/d15/d37/d52/d69/ccb 0 2024-04-26T21:26:08.014 INFO:tasks.workunit.client.1.smithi120.stdout:1/833: symlink d6/dd7/l114 0 2024-04-26T21:26:08.014 INFO:tasks.workunit.client.0.smithi084.stdout:4/648: creat d5/d10/d82/fd2 x:0 0 0 2024-04-26T21:26:08.017 INFO:tasks.workunit.client.1.smithi120.stdout:4/916: creat d10/d28/dd9/ddd/dee/dd0/df3/f13e x:0 0 0 2024-04-26T21:26:08.020 INFO:tasks.workunit.client.1.smithi120.stdout:4/917: readlink d10/d28/dd9/ddd/dee/dd0/df3/l108 0 2024-04-26T21:26:08.024 INFO:tasks.workunit.client.0.smithi084.stdout:6/683: unlink d3/de/d1a/d43/c6f 0 2024-04-26T21:26:08.028 INFO:tasks.workunit.client.0.smithi084.stdout:4/649: dread - d5/d7/d65/fcc zero size 2024-04-26T21:26:08.028 INFO:tasks.workunit.client.0.smithi084.stdout:0/708: rename de/d20/d4e/f6f to de/d78/d9e/da1/fe2 0 2024-04-26T21:26:08.028 INFO:tasks.workunit.client.1.smithi120.stdout:1/834: rename d6/d9/dd4/de0/d1b/c9e to d6/d14/d3c/d72/c115 0 2024-04-26T21:26:08.030 INFO:tasks.workunit.client.0.smithi084.stdout:7/728: creat d6/d9/d12/d19/d7a/d84/ffe x:0 0 0 2024-04-26T21:26:08.033 INFO:tasks.workunit.client.1.smithi120.stdout:1/835: read - d6/d9/dd4/de0/d2d/d98/d56/ff0 zero size 2024-04-26T21:26:08.034 INFO:tasks.workunit.client.0.smithi084.stdout:8/689: truncate d4/d7/d15/f70 219502 0 2024-04-26T21:26:08.036 INFO:tasks.workunit.client.1.smithi120.stdout:7/911: truncate d7/d64/da6/d1a/d33/d109/dbf/f12d 364752 0 2024-04-26T21:26:08.036 INFO:tasks.workunit.client.1.smithi120.stdout:8/874: dwrite d5/d6/d11/d32/d3b/d105/f106 [0,4194304] 0 2024-04-26T21:26:08.038 INFO:tasks.workunit.client.0.smithi084.stdout:7/729: dread - d6/d9/d12/d19/fca zero size 2024-04-26T21:26:08.040 INFO:tasks.workunit.client.1.smithi120.stdout:1/836: mkdir d6/d14/d116 0 2024-04-26T21:26:08.041 INFO:tasks.workunit.client.1.smithi120.stdout:4/918: read d10/d12/f55 [1257129,69324] 0 2024-04-26T21:26:08.042 INFO:tasks.workunit.client.0.smithi084.stdout:7/730: dread - d6/d26/faf zero size 2024-04-26T21:26:08.045 INFO:tasks.workunit.client.1.smithi120.stdout:7/912: getdents d7/d64/da6/d1f/d28/d4c/d6c/d74 0 2024-04-26T21:26:08.046 INFO:tasks.workunit.client.1.smithi120.stdout:1/837: mknod d6/d9/dd4/de0/d1d/d5d/c117 0 2024-04-26T21:26:08.049 INFO:tasks.workunit.client.0.smithi084.stdout:3/696: write d1/d2c/d2f/d94/fd3 [4314322,88300] 0 2024-04-26T21:26:08.053 INFO:tasks.workunit.client.1.smithi120.stdout:7/913: mkdir d7/d19/d60/de6/de8/d12e 0 2024-04-26T21:26:08.055 INFO:tasks.workunit.client.1.smithi120.stdout:7/914: stat d7/d64/da6/d1a/d33/d34/d37/fd4 0 2024-04-26T21:26:08.058 INFO:tasks.workunit.client.1.smithi120.stdout:1/838: mknod d6/d14/d6f/c118 0 2024-04-26T21:26:08.060 INFO:tasks.workunit.client.0.smithi084.stdout:7/731: truncate d6/d1c/dd8/fd2 1327911 0 2024-04-26T21:26:08.060 INFO:tasks.workunit.client.0.smithi084.stdout:8/690: read d4/d7/d15/f6f [299178,64529] 0 2024-04-26T21:26:08.061 INFO:tasks.workunit.client.0.smithi084.stdout:0/709: dwrite de/d2b/d77/fcb [0,4194304] 0 2024-04-26T21:26:08.062 INFO:tasks.workunit.client.1.smithi120.stdout:8/875: fsync d5/d6/d34/d42/d9d/d7a/f120 0 2024-04-26T21:26:08.063 INFO:tasks.workunit.client.0.smithi084.stdout:2/812: dread d6/d7/f3f [0,4194304] 0 2024-04-26T21:26:08.063 INFO:tasks.workunit.client.1.smithi120.stdout:5/924: dread d2/dc/d1d/d21/db2/dde/ff8 [0,4194304] 0 2024-04-26T21:26:08.063 INFO:tasks.workunit.client.1.smithi120.stdout:9/854: write d0/dd/d3a/d5c/f67 [2221755,75229] 0 2024-04-26T21:26:08.067 INFO:tasks.workunit.client.1.smithi120.stdout:1/839: creat d6/d9/dd4/de0/d1d/d5d/d67/f119 x:0 0 0 2024-04-26T21:26:08.067 INFO:tasks.workunit.client.0.smithi084.stdout:3/697: write d1/d2c/d2f/d31/d55/d4e/d7c/fd5 [266039,117611] 0 2024-04-26T21:26:08.069 INFO:tasks.workunit.client.1.smithi120.stdout:1/840: chown d6/d9/dd4/de0/d1d/d5d/d67/l78 3800371 1 2024-04-26T21:26:08.069 INFO:tasks.workunit.client.0.smithi084.stdout:7/732: mknod d6/d1c/cff 0 2024-04-26T21:26:08.072 INFO:tasks.workunit.client.0.smithi084.stdout:2/813: creat d6/d1b/f111 x:0 0 0 2024-04-26T21:26:08.074 INFO:tasks.workunit.client.0.smithi084.stdout:4/650: dwrite d5/d10/f13 [0,4194304] 0 2024-04-26T21:26:08.075 INFO:tasks.workunit.client.0.smithi084.stdout:3/698: truncate d1/d2c/d2f/fab 143218 0 2024-04-26T21:26:08.078 INFO:tasks.workunit.client.0.smithi084.stdout:8/691: link d4/d7/d15/d37/d52/fc3 d4/d6/db/d1e/d22/fcc 0 2024-04-26T21:26:08.079 INFO:tasks.workunit.client.0.smithi084.stdout:3/699: readlink d1/d2c/d2f/d31/d3b/l6b 0 2024-04-26T21:26:08.079 INFO:tasks.workunit.client.0.smithi084.stdout:1/700: sync 2024-04-26T21:26:08.081 INFO:tasks.workunit.client.0.smithi084.stdout:3/700: fdatasync d1/d24/f92 0 2024-04-26T21:26:08.082 INFO:tasks.workunit.client.0.smithi084.stdout:8/692: write d4/f13 [2908799,106580] 0 2024-04-26T21:26:08.083 INFO:tasks.workunit.client.1.smithi120.stdout:4/919: write d10/d65/f7e [627664,101354] 0 2024-04-26T21:26:08.085 INFO:tasks.workunit.client.0.smithi084.stdout:6/684: dread d3/de/d1a/f36 [0,4194304] 0 2024-04-26T21:26:08.085 INFO:tasks.workunit.client.1.smithi120.stdout:4/920: dread - d10/d12/f54 zero size 2024-04-26T21:26:08.086 INFO:tasks.workunit.client.0.smithi084.stdout:1/701: write d2/d19/f4d [5081266,112832] 0 2024-04-26T21:26:08.086 INFO:tasks.workunit.client.0.smithi084.stdout:7/733: mkdir d6/d9/d12/d8b/d72/d100 0 2024-04-26T21:26:08.089 INFO:tasks.workunit.client.0.smithi084.stdout:8/693: mknod d4/d6/db/d9b/ccd 0 2024-04-26T21:26:08.089 INFO:tasks.workunit.client.1.smithi120.stdout:3/934: sync 2024-04-26T21:26:08.091 INFO:tasks.workunit.client.1.smithi120.stdout:9/855: mknod d0/dd/d3a/d5c/d98/c122 0 2024-04-26T21:26:08.091 INFO:tasks.workunit.client.1.smithi120.stdout:8/876: dread d5/d6/d34/d42/d102/d118/d60/fb2 [0,4194304] 0 2024-04-26T21:26:08.093 INFO:tasks.workunit.client.0.smithi084.stdout:6/685: fdatasync d3/d18/d81/f8a 0 2024-04-26T21:26:08.093 INFO:tasks.workunit.client.1.smithi120.stdout:9/856: chown d0/dd/d45/l95 1766548 1 2024-04-26T21:26:08.095 INFO:tasks.workunit.client.0.smithi084.stdout:8/694: dread - d4/d3a/d8c/f95 zero size 2024-04-26T21:26:08.096 INFO:tasks.workunit.client.0.smithi084.stdout:7/734: mkdir d6/d68/d101 0 2024-04-26T21:26:08.096 INFO:tasks.workunit.client.1.smithi120.stdout:1/841: mkdir d6/d14/d116/d11a 0 2024-04-26T21:26:08.097 INFO:tasks.workunit.client.1.smithi120.stdout:7/915: link d7/d64/da6/d1f/d28/f10f d7/d64/da6/d1f/f12f 0 2024-04-26T21:26:08.102 INFO:tasks.workunit.client.1.smithi120.stdout:8/877: truncate d5/d6/d34/d42/d9d/fae 160767 0 2024-04-26T21:26:08.105 INFO:tasks.workunit.client.1.smithi120.stdout:9/857: truncate d0/d6/d4d/d65/dec/d2d/fbe 890425 0 2024-04-26T21:26:08.106 INFO:tasks.workunit.client.1.smithi120.stdout:9/858: readlink d0/ld0 0 2024-04-26T21:26:08.108 INFO:tasks.workunit.client.1.smithi120.stdout:7/916: unlink d7/d64/da6/d1f/d7d/d8b/ccb 0 2024-04-26T21:26:08.109 INFO:tasks.workunit.client.0.smithi084.stdout:6/686: rename d3/de/d15/d40/f77 to d3/de/d1a/d2f/fdf 0 2024-04-26T21:26:08.109 INFO:tasks.workunit.client.1.smithi120.stdout:5/925: write d2/dc/d1d/d21/d66/fa2 [3719740,106031] 0 2024-04-26T21:26:08.110 INFO:tasks.workunit.client.0.smithi084.stdout:7/735: fdatasync d6/d9/d12/d8b/d72/da0/fb6 0 2024-04-26T21:26:08.112 INFO:tasks.workunit.client.1.smithi120.stdout:9/859: truncate d0/d6/d4d/d65/dec/d2d/d4b/d85/fb6 5115578 0 2024-04-26T21:26:08.113 INFO:tasks.workunit.client.1.smithi120.stdout:5/926: truncate d2/d30/d93/d107/d36/f65 4974789 0 2024-04-26T21:26:08.114 INFO:tasks.workunit.client.1.smithi120.stdout:8/878: creat d5/d6/d34/d42/d102/d118/db8/f121 x:0 0 0 2024-04-26T21:26:08.116 INFO:tasks.workunit.client.0.smithi084.stdout:4/651: dwrite d5/d10/d15/d21/fb7 [0,4194304] 0 2024-04-26T21:26:08.118 INFO:tasks.workunit.client.1.smithi120.stdout:9/860: fdatasync d0/d6/d3d/fee 0 2024-04-26T21:26:08.122 INFO:tasks.workunit.client.1.smithi120.stdout:7/917: dread d7/d10/f11 [0,4194304] 0 2024-04-26T21:26:08.122 INFO:tasks.workunit.client.1.smithi120.stdout:5/927: creat d2/d1b/d89/d14f/f151 x:0 0 0 2024-04-26T21:26:08.123 INFO:tasks.workunit.client.1.smithi120.stdout:1/842: write d6/d9/fc0 [401208,106064] 0 2024-04-26T21:26:08.125 INFO:tasks.workunit.client.1.smithi120.stdout:8/879: mkdir d5/d6/d34/d42/d4a/deb/d122 0 2024-04-26T21:26:08.125 INFO:tasks.workunit.client.1.smithi120.stdout:3/935: link dd/de/df/dda/d24/d9d/d86/d10d/f117 dd/de/df/dda/d24/d43/f12f 0 2024-04-26T21:26:08.125 INFO:tasks.workunit.client.0.smithi084.stdout:8/695: dwrite d4/d7/d15/d37/f68 [4194304,4194304] 0 2024-04-26T21:26:08.128 INFO:tasks.workunit.client.1.smithi120.stdout:5/928: dread - d2/d1b/d89/d14f/f151 zero size 2024-04-26T21:26:08.128 INFO:tasks.workunit.client.1.smithi120.stdout:1/843: readlink d6/d9/dd4/de0/d2d/d48/l7d 0 2024-04-26T21:26:08.128 INFO:tasks.workunit.client.1.smithi120.stdout:4/921: getdents d10/d6b/d71 0 2024-04-26T21:26:08.129 INFO:tasks.workunit.client.0.smithi084.stdout:3/701: write d1/d24/d27/f53 [403537,129396] 0 2024-04-26T21:26:08.131 INFO:tasks.workunit.client.1.smithi120.stdout:7/918: creat d7/d64/da6/d1f/d28/d4c/d6c/d74/f130 x:0 0 0 2024-04-26T21:26:08.132 INFO:tasks.workunit.client.1.smithi120.stdout:8/880: fsync d5/d6/d11/d32/d3b/d105/f106 0 2024-04-26T21:26:08.134 INFO:tasks.workunit.client.0.smithi084.stdout:6/687: rename d3/d18/d37/c3f to d3/de/d5d/ce0 0 2024-04-26T21:26:08.137 INFO:tasks.workunit.client.1.smithi120.stdout:1/844: creat d6/d9/dd4/de0/d2d/d98/d56/f11b x:0 0 0 2024-04-26T21:26:08.137 INFO:tasks.workunit.client.1.smithi120.stdout:5/929: symlink d2/l152 0 2024-04-26T21:26:08.143 INFO:tasks.workunit.client.1.smithi120.stdout:3/936: getdents dd/de/df/dda/d24/d9d/d86 0 2024-04-26T21:26:08.146 INFO:tasks.workunit.client.1.smithi120.stdout:9/861: truncate d0/d66/fb2 637520 0 2024-04-26T21:26:08.147 INFO:tasks.workunit.client.0.smithi084.stdout:2/814: dwrite d6/d7/d3d/d15/d1f/d39/da5/fd2 [0,4194304] 0 2024-04-26T21:26:08.147 INFO:tasks.workunit.client.1.smithi120.stdout:5/930: symlink d2/dc/d1d/d21/d66/d6a/l153 0 2024-04-26T21:26:08.154 INFO:tasks.workunit.client.1.smithi120.stdout:4/922: getdents d10/d28/dd9/ddd/dee/dd0/dd4/d86/dfa 0 2024-04-26T21:26:08.156 INFO:tasks.workunit.client.0.smithi084.stdout:8/696: dread - d4/d6/db/d1e/d22/d39/d4a/f5e zero size 2024-04-26T21:26:08.161 INFO:tasks.workunit.client.1.smithi120.stdout:8/881: dwrite d5/d6/d34/d42/d102/d118/dd9/f10c [0,4194304] 0 2024-04-26T21:26:08.161 INFO:tasks.workunit.client.1.smithi120.stdout:4/923: creat d10/d28/dd9/ddd/dee/dd0/df3/f13f x:0 0 0 2024-04-26T21:26:08.164 INFO:tasks.workunit.client.0.smithi084.stdout:4/652: dwrite d5/d25/d99/da0/fc0 [0,4194304] 0 2024-04-26T21:26:08.165 INFO:tasks.workunit.client.0.smithi084.stdout:2/815: rmdir d6/d7/d3d/d15/d1f/d39/d20/d45/d6d 39 2024-04-26T21:26:08.169 INFO:tasks.workunit.client.0.smithi084.stdout:1/702: dwrite d2/d9/d15/d28/d69/fe2 [0,4194304] 0 2024-04-26T21:26:08.173 INFO:tasks.workunit.client.1.smithi120.stdout:8/882: read d5/d6/d34/d42/d4a/f57 [926876,50958] 0 2024-04-26T21:26:08.175 INFO:tasks.workunit.client.0.smithi084.stdout:8/697: creat d4/d7/d15/d37/d52/d69/fce x:0 0 0 2024-04-26T21:26:08.176 INFO:tasks.workunit.client.1.smithi120.stdout:3/937: truncate dd/de/df/d12/d48/f120 1073620 0 2024-04-26T21:26:08.177 INFO:tasks.workunit.client.0.smithi084.stdout:3/702: dwrite d1/d2c/d2f/d31/d55/d4e/fde [0,4194304] 0 2024-04-26T21:26:08.177 INFO:tasks.workunit.client.1.smithi120.stdout:1/845: dwrite d6/d9/dd4/de0/d1d/d5d/d67/de3/fe6 [0,4194304] 0 2024-04-26T21:26:08.181 INFO:tasks.workunit.client.0.smithi084.stdout:7/736: dread d6/d9/d12/d19/d20/d38/f82 [0,4194304] 0 2024-04-26T21:26:08.185 INFO:tasks.workunit.client.1.smithi120.stdout:5/931: dwrite d2/d1b/dd2/deb/f149 [0,4194304] 0 2024-04-26T21:26:08.185 INFO:tasks.workunit.client.1.smithi120.stdout:8/883: mkdir d5/d6/d34/d42/d9d/d7a/da4/d123 0 2024-04-26T21:26:08.189 INFO:tasks.workunit.client.0.smithi084.stdout:9/607: sync 2024-04-26T21:26:08.196 INFO:tasks.workunit.client.0.smithi084.stdout:9/608: chown da/db3/fcc 57454 1 2024-04-26T21:26:08.201 INFO:tasks.workunit.client.0.smithi084.stdout:4/653: link d5/d7/d65/d7f/d6a/l80 d5/d7/d65/d90/d91/dba/dc2/ld3 0 2024-04-26T21:26:08.201 INFO:tasks.workunit.client.1.smithi120.stdout:9/862: dwrite d0/f54 [0,4194304] 0 2024-04-26T21:26:08.202 INFO:tasks.workunit.client.1.smithi120.stdout:8/884: chown d5/d6/c2c 204828 1 2024-04-26T21:26:08.202 INFO:tasks.workunit.client.1.smithi120.stdout:1/846: chown d6/d9/dd4/de0/d2d/d98/d54 78664739 1 2024-04-26T21:26:08.202 INFO:tasks.workunit.client.0.smithi084.stdout:2/816: dwrite d6/d7/db6/dec/f10a [0,4194304] 0 2024-04-26T21:26:08.204 INFO:tasks.workunit.client.1.smithi120.stdout:5/932: truncate d2/dc/d1d/d21/d77/d9c/fe9 271832 0 2024-04-26T21:26:08.206 INFO:tasks.workunit.client.1.smithi120.stdout:9/863: dread - d0/dd/d45/f11a zero size 2024-04-26T21:26:08.209 INFO:tasks.workunit.client.0.smithi084.stdout:4/654: write d5/d25/d35/d60/d6d/fb0 [4150760,5949] 0 2024-04-26T21:26:08.213 INFO:tasks.workunit.client.1.smithi120.stdout:9/864: write d0/dd/d3a/d5c/d9f/f110 [369121,31032] 0 2024-04-26T21:26:08.214 INFO:tasks.workunit.client.0.smithi084.stdout:7/737: dwrite d6/d9/f11 [4194304,4194304] 0 2024-04-26T21:26:08.214 INFO:tasks.workunit.client.0.smithi084.stdout:8/698: creat d4/d6/db/d9b/dca/fcf x:0 0 0 2024-04-26T21:26:08.214 INFO:tasks.workunit.client.0.smithi084.stdout:3/703: rename d1/d2c/d2f/f54 to d1/d24/d27/d3a/de5/ff8 0 2024-04-26T21:26:08.215 INFO:tasks.workunit.client.1.smithi120.stdout:5/933: read d2/dc/d1d/d21/db2/dde/fec [93909,112081] 0 2024-04-26T21:26:08.218 INFO:tasks.workunit.client.0.smithi084.stdout:4/655: fsync d5/d25/d99/da0/fd1 0 2024-04-26T21:26:08.220 INFO:tasks.workunit.client.0.smithi084.stdout:8/699: readlink d4/d7/l98 0 2024-04-26T21:26:08.222 INFO:tasks.workunit.client.0.smithi084.stdout:6/688: truncate d3/de/f63 3068945 0 2024-04-26T21:26:08.225 INFO:tasks.workunit.client.1.smithi120.stdout:8/885: getdents d5/d6/d11/d52/d27/d4f 0 2024-04-26T21:26:08.225 INFO:tasks.workunit.client.0.smithi084.stdout:7/738: stat d6/d9/d12/d19/d20/f44 0 2024-04-26T21:26:08.230 INFO:tasks.workunit.client.0.smithi084.stdout:8/700: chown d4/d7/d15/d37 2 1 2024-04-26T21:26:08.230 INFO:tasks.workunit.client.1.smithi120.stdout:8/886: mkdir d5/d6/d75/d124 0 2024-04-26T21:26:08.233 INFO:tasks.workunit.client.0.smithi084.stdout:5/697: sync 2024-04-26T21:26:08.233 INFO:tasks.workunit.client.0.smithi084.stdout:0/710: sync 2024-04-26T21:26:08.234 INFO:tasks.workunit.client.0.smithi084.stdout:3/704: mknod d1/d2c/d2f/d31/d55/d4e/d98/d9e/cf9 0 2024-04-26T21:26:08.236 INFO:tasks.workunit.client.0.smithi084.stdout:5/698: dread - d0/dc/df/d75/fb0 zero size 2024-04-26T21:26:08.239 INFO:tasks.workunit.client.0.smithi084.stdout:0/711: dread - de/d20/f98 zero size 2024-04-26T21:26:08.241 INFO:tasks.workunit.client.1.smithi120.stdout:4/924: dwrite d10/fe0 [0,4194304] 0 2024-04-26T21:26:08.243 INFO:tasks.workunit.client.0.smithi084.stdout:7/739: creat d6/d68/d7f/dcf/f102 x:0 0 0 2024-04-26T21:26:08.246 INFO:tasks.workunit.client.1.smithi120.stdout:9/865: dwrite d0/dd/d3a/dae/f8f [0,4194304] 0 2024-04-26T21:26:08.248 INFO:tasks.workunit.client.1.smithi120.stdout:8/887: mkdir d5/d6/d11/d52/d125 0 2024-04-26T21:26:08.249 INFO:tasks.workunit.client.0.smithi084.stdout:8/701: write d4/d6/db/d1e/f8e [156232,121575] 0 2024-04-26T21:26:08.250 INFO:tasks.workunit.client.0.smithi084.stdout:0/712: readlink de/d2b/l2d 0 2024-04-26T21:26:08.251 INFO:tasks.workunit.client.1.smithi120.stdout:4/925: symlink d10/d28/dd9/ddd/df1/d12d/l140 0 2024-04-26T21:26:08.252 INFO:tasks.workunit.client.0.smithi084.stdout:3/705: read d1/d2c/d2f/d31/d55/d4e/d98/fec [373705,4409] 0 2024-04-26T21:26:08.253 INFO:tasks.workunit.client.1.smithi120.stdout:9/866: chown d0/dd/d3a/c42 1808534 1 2024-04-26T21:26:08.255 INFO:tasks.workunit.client.0.smithi084.stdout:5/699: fdatasync d0/dc/d48/f77 0 2024-04-26T21:26:08.260 INFO:tasks.workunit.client.1.smithi120.stdout:3/938: dwrite dd/fe4 [0,4194304] 0 2024-04-26T21:26:08.261 INFO:tasks.workunit.client.0.smithi084.stdout:0/713: creat de/d20/d4c/fe3 x:0 0 0 2024-04-26T21:26:08.263 INFO:tasks.workunit.client.1.smithi120.stdout:4/926: readlink d10/d6b/dbf/lc7 0 2024-04-26T21:26:08.264 INFO:tasks.workunit.client.0.smithi084.stdout:2/817: dwrite d6/d7/d3d/d15/ff9 [0,4194304] 0 2024-04-26T21:26:08.265 INFO:tasks.workunit.client.0.smithi084.stdout:4/656: link d5/d7/d65/d7f/d6a/l80 d5/d7/d65/d90/d91/daa/ld4 0 2024-04-26T21:26:08.266 INFO:tasks.workunit.client.1.smithi120.stdout:4/927: chown d10/d28/cb9 14 1 2024-04-26T21:26:08.266 INFO:tasks.workunit.client.1.smithi120.stdout:3/939: chown dd/d2a/d74/d12b/ddb/f9c 3256 1 2024-04-26T21:26:08.266 INFO:tasks.workunit.client.0.smithi084.stdout:7/740: fdatasync d6/d26/f30 0 2024-04-26T21:26:08.271 INFO:tasks.workunit.client.0.smithi084.stdout:7/741: readlink d6/d9/d12/d8b/d72/da0/d80/lfa 0 2024-04-26T21:26:08.272 INFO:tasks.workunit.client.0.smithi084.stdout:8/702: symlink d4/d6/db/d1e/d22/d39/d4a/ld0 0 2024-04-26T21:26:08.275 INFO:tasks.workunit.client.0.smithi084.stdout:5/700: creat d0/dc/df/d31/d45/fd7 x:0 0 0 2024-04-26T21:26:08.277 INFO:tasks.workunit.client.1.smithi120.stdout:6/927: sync 2024-04-26T21:26:08.279 INFO:tasks.workunit.client.1.smithi120.stdout:3/940: mkdir dd/d130 0 2024-04-26T21:26:08.279 INFO:tasks.workunit.client.1.smithi120.stdout:1/847: dread d6/d14/f16 [0,4194304] 0 2024-04-26T21:26:08.282 INFO:tasks.workunit.client.0.smithi084.stdout:2/818: unlink d6/d7/d3d/d79/d81/lc5 0 2024-04-26T21:26:08.283 INFO:tasks.workunit.client.1.smithi120.stdout:8/888: dwrite d5/d6/d34/faf [0,4194304] 0 2024-04-26T21:26:08.283 INFO:tasks.workunit.client.1.smithi120.stdout:6/928: fsync d4/db/d10/ddb/f123 0 2024-04-26T21:26:08.286 INFO:tasks.workunit.client.1.smithi120.stdout:6/929: read - d4/f12d zero size 2024-04-26T21:26:08.289 INFO:tasks.workunit.client.0.smithi084.stdout:6/689: dread d3/de/d15/d23/f68 [0,4194304] 0 2024-04-26T21:26:08.291 INFO:tasks.workunit.client.0.smithi084.stdout:5/701: readlink d0/dc/df/d6d/l79 0 2024-04-26T21:26:08.292 INFO:tasks.workunit.client.0.smithi084.stdout:5/702: readlink d0/dc/d48/ld3 0 2024-04-26T21:26:08.295 INFO:tasks.workunit.client.1.smithi120.stdout:9/867: dwrite d0/d6/d4d/d65/dec/d77/d9a/ffc [0,4194304] 0 2024-04-26T21:26:08.295 INFO:tasks.workunit.client.1.smithi120.stdout:3/941: creat dd/de/df/db6/dc5/d103/f131 x:0 0 0 2024-04-26T21:26:08.297 INFO:tasks.workunit.client.0.smithi084.stdout:1/703: dread d2/d54/d5e/d66/f36 [0,4194304] 0 2024-04-26T21:26:08.298 INFO:tasks.workunit.client.1.smithi120.stdout:8/889: dread d5/d6/d34/d42/d102/d118/d60/fff [0,4194304] 0 2024-04-26T21:26:08.300 INFO:tasks.workunit.client.0.smithi084.stdout:7/742: rename d6/l23 to d6/d68/d7f/dbe/l103 0 2024-04-26T21:26:08.305 INFO:tasks.workunit.client.0.smithi084.stdout:3/706: getdents d1/d2c/d2f/d31/d55/da4/de7 0 2024-04-26T21:26:08.305 INFO:tasks.workunit.client.0.smithi084.stdout:6/690: read - d3/f65 zero size 2024-04-26T21:26:08.306 INFO:tasks.workunit.client.0.smithi084.stdout:2/819: truncate d6/d7/d3d/d15/d1f/d39/d20/d45/f97 3764597 0 2024-04-26T21:26:08.306 INFO:tasks.workunit.client.0.smithi084.stdout:6/691: chown d3/de/f7c 1420 1 2024-04-26T21:26:08.307 INFO:tasks.workunit.client.0.smithi084.stdout:3/707: stat d1/d24/d27/f53 0 2024-04-26T21:26:08.309 INFO:tasks.workunit.client.1.smithi120.stdout:4/928: write d10/d28/dd9/ddd/dee/f94 [598354,53991] 0 2024-04-26T21:26:08.310 INFO:tasks.workunit.client.0.smithi084.stdout:1/704: creat d2/d19/dd2/feb x:0 0 0 2024-04-26T21:26:08.312 INFO:tasks.workunit.client.0.smithi084.stdout:8/703: link d4/d6/db/d9b/dca/fcf d4/d6/db/d1e/d22/d2f/fd1 0 2024-04-26T21:26:08.312 INFO:tasks.workunit.client.0.smithi084.stdout:6/692: chown d3/de/d1a/d2f/d4c/d58/c93 5954291 1 2024-04-26T21:26:08.315 INFO:tasks.workunit.client.0.smithi084.stdout:9/609: dread da/de/d16/d40/f64 [0,4194304] 0 2024-04-26T21:26:08.315 INFO:tasks.workunit.client.0.smithi084.stdout:7/743: rmdir d6/d9/d96 39 2024-04-26T21:26:08.316 INFO:tasks.workunit.client.1.smithi120.stdout:8/890: rename d5/d6/d34/d42/d102/d118/db8/ddc/de4/ce8 to d5/d6/d34/d42/d4a/dbf/c126 0 2024-04-26T21:26:08.319 INFO:tasks.workunit.client.0.smithi084.stdout:9/610: readlink da/dd5/d93/dc3/l6c 0 2024-04-26T21:26:08.320 INFO:tasks.workunit.client.1.smithi120.stdout:9/868: dwrite d0/d6/d4d/d65/dec/d2d/f97 [4194304,4194304] 0 2024-04-26T21:26:08.321 INFO:tasks.workunit.client.0.smithi084.stdout:5/703: creat d0/dc/df/d31/d53/d5d/fd8 x:0 0 0 2024-04-26T21:26:08.322 INFO:tasks.workunit.client.1.smithi120.stdout:4/929: getdents d10/d65/d7c 0 2024-04-26T21:26:08.323 INFO:tasks.workunit.client.0.smithi084.stdout:7/744: chown d6/d68/d7f/lfc 8132140 1 2024-04-26T21:26:08.325 INFO:tasks.workunit.client.1.smithi120.stdout:6/930: dwrite d4/db/d10/dd/f30 [0,4194304] 0 2024-04-26T21:26:08.326 INFO:tasks.workunit.client.0.smithi084.stdout:7/745: fdatasync d6/d9/f11 0 2024-04-26T21:26:08.331 INFO:tasks.workunit.client.1.smithi120.stdout:6/931: fsync d4/db/d10/dd/d43/f128 0 2024-04-26T21:26:08.332 INFO:tasks.workunit.client.0.smithi084.stdout:1/705: mknod d2/d9/d15/d28/d5a/cec 0 2024-04-26T21:26:08.334 INFO:tasks.workunit.client.0.smithi084.stdout:8/704: fdatasync d4/d6/db/d1e/d22/d39/d4a/f8f 0 2024-04-26T21:26:08.338 INFO:tasks.workunit.client.1.smithi120.stdout:8/891: rename d5/d6/d34/d42/d9d/d7a/da4/d113 to d5/d6/d11/d52/df5/d127 0 2024-04-26T21:26:08.340 INFO:tasks.workunit.client.0.smithi084.stdout:5/704: creat d0/da2/fd9 x:0 0 0 2024-04-26T21:26:08.342 INFO:tasks.workunit.client.1.smithi120.stdout:9/869: dwrite d0/d66/d93/db7/dc7/fef [0,4194304] 0 2024-04-26T21:26:08.344 INFO:tasks.workunit.client.0.smithi084.stdout:3/708: rename d1/d2c/d2f/d31/f43 to d1/d24/d27/d3a/ffa 0 2024-04-26T21:26:08.346 INFO:tasks.workunit.client.1.smithi120.stdout:8/892: mkdir d5/d128 0 2024-04-26T21:26:08.347 INFO:tasks.workunit.client.0.smithi084.stdout:7/746: symlink d6/d68/d7f/dcf/l104 0 2024-04-26T21:26:08.348 INFO:tasks.workunit.client.0.smithi084.stdout:6/693: dwrite d3/d18/fc6 [0,4194304] 0 2024-04-26T21:26:08.352 INFO:tasks.workunit.client.1.smithi120.stdout:4/930: write d10/d12/f95 [946418,24793] 0 2024-04-26T21:26:08.356 INFO:tasks.workunit.client.0.smithi084.stdout:0/714: dwrite de/ff [0,4194304] 0 2024-04-26T21:26:08.361 INFO:tasks.workunit.client.1.smithi120.stdout:8/893: creat d5/d6/d34/d42/f129 x:0 0 0 2024-04-26T21:26:08.363 INFO:tasks.workunit.client.1.smithi120.stdout:8/894: dread - d5/d6/d11/f112 zero size 2024-04-26T21:26:08.363 INFO:tasks.workunit.client.1.smithi120.stdout:4/931: dread - d10/d6b/da4/f12e zero size 2024-04-26T21:26:08.363 INFO:tasks.workunit.client.0.smithi084.stdout:4/657: dwrite d5/d7/f9b [0,4194304] 0 2024-04-26T21:26:08.363 INFO:tasks.workunit.client.0.smithi084.stdout:1/706: mkdir d2/d9/d15/ded 0 2024-04-26T21:26:08.364 INFO:tasks.workunit.client.0.smithi084.stdout:7/747: dread - d6/d9/d12/d19/fe9 zero size 2024-04-26T21:26:08.364 INFO:tasks.workunit.client.0.smithi084.stdout:8/705: symlink d4/d7/d53/ld2 0 2024-04-26T21:26:08.364 INFO:tasks.workunit.client.0.smithi084.stdout:5/705: rmdir d0/d17 39 2024-04-26T21:26:08.367 INFO:tasks.workunit.client.0.smithi084.stdout:4/658: chown d5/d25/d99/da0/fa6 39 1 2024-04-26T21:26:08.369 INFO:tasks.workunit.client.1.smithi120.stdout:8/895: write d5/d6/d34/d42/d102/d118/d60/f5c [1372970,73844] 0 2024-04-26T21:26:08.369 INFO:tasks.workunit.client.0.smithi084.stdout:8/706: truncate d4/d7/d15/d37/d3b/f89 4640362 0 2024-04-26T21:26:08.370 INFO:tasks.workunit.client.1.smithi120.stdout:8/896: chown d5/d6/d11/l28 59 1 2024-04-26T21:26:08.375 INFO:tasks.workunit.client.0.smithi084.stdout:6/694: unlink d3/f10 0 2024-04-26T21:26:08.376 INFO:tasks.workunit.client.1.smithi120.stdout:8/897: dread - d5/d6/d34/d42/d4a/dbf/d10f/f11d zero size 2024-04-26T21:26:08.376 INFO:tasks.workunit.client.1.smithi120.stdout:4/932: creat d10/f141 x:0 0 0 2024-04-26T21:26:08.379 INFO:tasks.workunit.client.1.smithi120.stdout:4/933: mknod d10/d6b/dbf/c142 0 2024-04-26T21:26:08.382 INFO:tasks.workunit.client.1.smithi120.stdout:4/934: truncate d10/d6b/da4/f12e 238626 0 2024-04-26T21:26:08.382 INFO:tasks.workunit.client.1.smithi120.stdout:1/848: dread d6/d9/dd4/de0/d1b/d3b/f7f [0,4194304] 0 2024-04-26T21:26:08.385 INFO:tasks.workunit.client.0.smithi084.stdout:8/707: rmdir d4/d6/db/d1e/d22/d39/d4a/da2 39 2024-04-26T21:26:08.385 INFO:tasks.workunit.client.0.smithi084.stdout:1/707: creat d2/d54/d5e/d66/d2a/d2c/d45/dc9/fee x:0 0 0 2024-04-26T21:26:08.388 INFO:tasks.workunit.client.1.smithi120.stdout:8/898: creat d5/d6/d11/d52/d27/f12a x:0 0 0 2024-04-26T21:26:08.391 INFO:tasks.workunit.client.1.smithi120.stdout:2/918: sync 2024-04-26T21:26:08.391 INFO:tasks.workunit.client.0.smithi084.stdout:5/706: read d0/dc/df/d51/fb5 [7866,56223] 0 2024-04-26T21:26:08.392 INFO:tasks.workunit.client.1.smithi120.stdout:4/935: mknod d10/d12/da1/d104/c143 0 2024-04-26T21:26:08.397 INFO:tasks.workunit.client.0.smithi084.stdout:7/748: dwrite d6/d68/d7f/fae [0,4194304] 0 2024-04-26T21:26:08.398 INFO:tasks.workunit.client.1.smithi120.stdout:6/932: dwrite d4/db/d10/dd/d28/d9e/f9f [0,4194304] 0 2024-04-26T21:26:08.399 INFO:tasks.workunit.client.1.smithi120.stdout:9/870: dwrite d0/d66/d93/db7/dc7/f10d [0,4194304] 0 2024-04-26T21:26:08.403 INFO:tasks.workunit.client.1.smithi120.stdout:9/871: fdatasync d0/dd/ff3 0 2024-04-26T21:26:08.403 INFO:tasks.workunit.client.0.smithi084.stdout:5/707: creat d0/d49/d56/fda x:0 0 0 2024-04-26T21:26:08.404 INFO:tasks.workunit.client.1.smithi120.stdout:4/936: symlink d10/d65/d7c/dec/l144 0 2024-04-26T21:26:08.408 INFO:tasks.workunit.client.1.smithi120.stdout:4/937: truncate d10/d6b/d71/f132 188848 0 2024-04-26T21:26:08.408 INFO:tasks.workunit.client.1.smithi120.stdout:2/919: symlink d4/d1b/d5c/d99/df7/l136 0 2024-04-26T21:26:08.410 INFO:tasks.workunit.client.1.smithi120.stdout:1/849: write d6/d9/dd4/de0/d2d/d98/d54/f7a [2089155,79727] 0 2024-04-26T21:26:08.410 INFO:tasks.workunit.client.0.smithi084.stdout:9/611: write da/de/d16/f30 [1733363,56257] 0 2024-04-26T21:26:08.410 INFO:tasks.workunit.client.0.smithi084.stdout:4/659: dwrite d5/d10/d15/d21/f7b [0,4194304] 0 2024-04-26T21:26:08.411 INFO:tasks.workunit.client.1.smithi120.stdout:4/938: stat d10/d12/c5d 0 2024-04-26T21:26:08.412 INFO:tasks.workunit.client.1.smithi120.stdout:3/942: dread dd/de/df/dda/d24/f3a [4194304,4194304] 0 2024-04-26T21:26:08.412 INFO:tasks.workunit.client.1.smithi120.stdout:6/933: mkdir d4/db/d25/d6d/d97/dc8/d133 0 2024-04-26T21:26:08.419 INFO:tasks.workunit.client.1.smithi120.stdout:2/920: unlink d4/d1b/d25/d2c/f8f 0 2024-04-26T21:26:08.421 INFO:tasks.workunit.client.0.smithi084.stdout:3/709: write d1/d24/d27/d3a/fa7 [762380,48038] 0 2024-04-26T21:26:08.421 INFO:tasks.workunit.client.0.smithi084.stdout:6/695: dwrite d3/de/d1a/d43/d72/dad/fb1 [0,4194304] 0 2024-04-26T21:26:08.422 INFO:tasks.workunit.client.1.smithi120.stdout:8/899: dwrite d5/d6/d11/d52/fe9 [12582912,4194304] 0 2024-04-26T21:26:08.423 INFO:tasks.workunit.client.1.smithi120.stdout:3/943: read - dd/de/df/d12/d48/d9b/dcb/dee/f127 zero size 2024-04-26T21:26:08.424 INFO:tasks.workunit.client.0.smithi084.stdout:2/820: write d6/d7/d3d/d79/d81/d82/fa7 [835435,58960] 0 2024-04-26T21:26:08.427 INFO:tasks.workunit.client.1.smithi120.stdout:6/934: creat d4/db/d10/d1a/d2b/d57/d67/dbc/dce/d101/f134 x:0 0 0 2024-04-26T21:26:08.428 INFO:tasks.workunit.client.1.smithi120.stdout:2/921: chown d4/d1b/d4f/ced 5859404 1 2024-04-26T21:26:08.433 INFO:tasks.workunit.client.1.smithi120.stdout:4/939: creat d10/d28/dd9/ddd/dee/dd0/f145 x:0 0 0 2024-04-26T21:26:08.433 INFO:tasks.workunit.client.1.smithi120.stdout:3/944: creat dd/de/df/dda/d24/d9d/d86/f132 x:0 0 0 2024-04-26T21:26:08.435 INFO:tasks.workunit.client.1.smithi120.stdout:6/935: read d4/db/d10/d1a/d2b/d57/d67/f66 [613712,47203] 0 2024-04-26T21:26:08.438 INFO:tasks.workunit.client.0.smithi084.stdout:8/708: dwrite d4/d7/d15/d9d/fad [0,4194304] 0 2024-04-26T21:26:08.441 INFO:tasks.workunit.client.1.smithi120.stdout:7/919: sync 2024-04-26T21:26:08.441 INFO:tasks.workunit.client.1.smithi120.stdout:5/934: sync 2024-04-26T21:26:08.444 INFO:tasks.workunit.client.1.smithi120.stdout:8/900: symlink d5/d6/d34/d42/l12b 0 2024-04-26T21:26:08.446 INFO:tasks.workunit.client.0.smithi084.stdout:2/821: dread d6/d7/d3d/d4f/d90/f101 [0,4194304] 0 2024-04-26T21:26:08.447 INFO:tasks.workunit.client.0.smithi084.stdout:9/612: dwrite da/de/d16/f30 [0,4194304] 0 2024-04-26T21:26:08.448 INFO:tasks.workunit.client.0.smithi084.stdout:3/710: creat d1/d2c/d2f/d31/d55/d4e/d98/ffb x:0 0 0 2024-04-26T21:26:08.450 INFO:tasks.workunit.client.1.smithi120.stdout:1/850: dwrite d6/d9/dd4/de0/d1d/f10d [0,4194304] 0 2024-04-26T21:26:08.451 INFO:tasks.workunit.client.1.smithi120.stdout:3/945: mkdir dd/de/df/db6/dc5/d103/d133 0 2024-04-26T21:26:08.452 INFO:tasks.workunit.client.0.smithi084.stdout:6/696: creat d3/de/d15/d40/dcd/fe1 x:0 0 0 2024-04-26T21:26:08.456 INFO:tasks.workunit.client.0.smithi084.stdout:0/715: truncate de/d2b/d77/f33 957336 0 2024-04-26T21:26:08.457 INFO:tasks.workunit.client.0.smithi084.stdout:8/709: creat d4/d6/db/d1e/d22/d2f/fd3 x:0 0 0 2024-04-26T21:26:08.458 INFO:tasks.workunit.client.1.smithi120.stdout:5/935: write d2/d30/d93/d107/d36/d44/d6c/f106 [224947,85499] 0 2024-04-26T21:26:08.458 INFO:tasks.workunit.client.1.smithi120.stdout:5/936: chown d2/d10e/d63 1578 1 2024-04-26T21:26:08.459 INFO:tasks.workunit.client.0.smithi084.stdout:9/613: chown da/dd5/db6/fde 29851 1 2024-04-26T21:26:08.459 INFO:tasks.workunit.client.0.smithi084.stdout:0/716: chown de/d2b/d45/d63 77 1 2024-04-26T21:26:08.459 INFO:tasks.workunit.client.1.smithi120.stdout:9/872: link d0/d66/d93/db7/c108 d0/dd/c123 0 2024-04-26T21:26:08.459 INFO:tasks.workunit.client.1.smithi120.stdout:8/901: unlink d5/d6/l9 0 2024-04-26T21:26:08.459 INFO:tasks.workunit.client.1.smithi120.stdout:4/940: read d10/d65/d7c/dec/f126 [1604512,87016] 0 2024-04-26T21:26:08.463 INFO:tasks.workunit.client.1.smithi120.stdout:7/920: rename d7/d64/da6/d1a/d33 to d7/d64/da6/d1a/d50/dfa/d131 0 2024-04-26T21:26:08.466 INFO:tasks.workunit.client.0.smithi084.stdout:9/614: chown da/dd5/d93/dc3/d41/d43/d48/dce/fd4 12063830 1 2024-04-26T21:26:08.470 INFO:tasks.workunit.client.0.smithi084.stdout:3/711: creat d1/d24/d27/d3a/ffc x:0 0 0 2024-04-26T21:26:08.472 INFO:tasks.workunit.client.1.smithi120.stdout:2/922: dwrite d4/d1b/d2e/d50/d14/dc2/feb [0,4194304] 0 2024-04-26T21:26:08.473 INFO:tasks.workunit.client.1.smithi120.stdout:4/941: read d10/d28/fb2 [785789,124195] 0 2024-04-26T21:26:08.474 INFO:tasks.workunit.client.1.smithi120.stdout:3/946: symlink dd/de/l134 0 2024-04-26T21:26:08.474 INFO:tasks.workunit.client.0.smithi084.stdout:5/708: getdents d0/d17 0 2024-04-26T21:26:08.474 INFO:tasks.workunit.client.0.smithi084.stdout:4/660: write d5/d25/d35/f5e [727136,8576] 0 2024-04-26T21:26:08.474 INFO:tasks.workunit.client.0.smithi084.stdout:2/822: dread d6/d7/d3d/d15/fc7 [0,4194304] 0 2024-04-26T21:26:08.475 INFO:tasks.workunit.client.0.smithi084.stdout:1/708: link d2/d9/d15/fac d2/d19/d63/fef 0 2024-04-26T21:26:08.475 INFO:tasks.workunit.client.0.smithi084.stdout:8/710: unlink d4/d7/c2a 0 2024-04-26T21:26:08.477 INFO:tasks.workunit.client.0.smithi084.stdout:6/697: rename d3/de/d1a/d43/dd6 to d3/de/d41/d5c/de2 0 2024-04-26T21:26:08.479 INFO:tasks.workunit.client.0.smithi084.stdout:9/615: readlink da/dd5/d93/dc3/d41/d43/d4a/lc6 0 2024-04-26T21:26:08.483 INFO:tasks.workunit.client.0.smithi084.stdout:7/749: truncate d6/d9/d12/d19/d7a/d84/fac 3796947 0 2024-04-26T21:26:08.487 INFO:tasks.workunit.client.0.smithi084.stdout:7/750: dread - d6/d9/db3/fc8 zero size 2024-04-26T21:26:08.489 INFO:tasks.workunit.client.1.smithi120.stdout:5/937: symlink d2/dc/d1d/d21/d77/d79/db7/l154 0 2024-04-26T21:26:08.491 INFO:tasks.workunit.client.1.smithi120.stdout:9/873: dwrite d0/dd/d3a/d5c/f67 [0,4194304] 0 2024-04-26T21:26:08.493 INFO:tasks.workunit.client.0.smithi084.stdout:7/751: chown d6/d26/d40/f66 474614 1 2024-04-26T21:26:08.495 INFO:tasks.workunit.client.0.smithi084.stdout:2/823: creat d6/d7/d3d/d79/d85/df3/f112 x:0 0 0 2024-04-26T21:26:08.496 INFO:tasks.workunit.client.1.smithi120.stdout:3/947: dwrite dd/de/d83/f3f [0,4194304] 0 2024-04-26T21:26:08.497 INFO:tasks.workunit.client.0.smithi084.stdout:8/711: truncate d4/d6/db/d1e/d22/d39/d4a/f8f 69508 0 2024-04-26T21:26:08.497 INFO:tasks.workunit.client.0.smithi084.stdout:7/752: chown d6/d9/d12/d19/d60 2 1 2024-04-26T21:26:08.501 INFO:tasks.workunit.client.1.smithi120.stdout:9/874: read d0/dd/d3a/d5c/f101 [3616954,130120] 0 2024-04-26T21:26:08.503 INFO:tasks.workunit.client.0.smithi084.stdout:7/753: fdatasync d6/d1c/d51/fe0 0 2024-04-26T21:26:08.506 INFO:tasks.workunit.client.1.smithi120.stdout:8/902: creat d5/d6/f12c x:0 0 0 2024-04-26T21:26:08.506 INFO:tasks.workunit.client.0.smithi084.stdout:3/712: rename d1/d2c/d2f/d31/d55/d4e/d98/d9e/cf9 to d1/cfd 0 2024-04-26T21:26:08.509 INFO:tasks.workunit.client.0.smithi084.stdout:4/661: dread d5/d25/d35/d60/d6d/fb6 [0,4194304] 0 2024-04-26T21:26:08.509 INFO:tasks.workunit.client.1.smithi120.stdout:8/903: fdatasync d5/d6/d11/d52/d27/ffe 0 2024-04-26T21:26:08.510 INFO:tasks.workunit.client.0.smithi084.stdout:0/717: dwrite de/d2b/d45/d94/fc6 [0,4194304] 0 2024-04-26T21:26:08.515 INFO:tasks.workunit.client.0.smithi084.stdout:4/662: truncate d5/d2e/d5f/f8a 1757472 0 2024-04-26T21:26:08.517 INFO:tasks.workunit.client.0.smithi084.stdout:1/709: write d2/d54/d5e/d66/d2a/d2c/d75/f7d [1236675,39211] 0 2024-04-26T21:26:08.521 INFO:tasks.workunit.client.1.smithi120.stdout:9/875: creat d0/d66/d93/db7/dc7/f124 x:0 0 0 2024-04-26T21:26:08.522 INFO:tasks.workunit.client.0.smithi084.stdout:1/710: read - d2/d9/d67/fc7 zero size 2024-04-26T21:26:08.527 INFO:tasks.workunit.client.0.smithi084.stdout:1/711: chown d2/d54/d5e/d8d/fde 1352 1 2024-04-26T21:26:08.530 INFO:tasks.workunit.client.0.smithi084.stdout:0/718: rename de/d2b/d64/fab to de/d78/d9e/da4/fe4 0 2024-04-26T21:26:08.536 INFO:tasks.workunit.client.1.smithi120.stdout:3/948: mknod dd/c135 0 2024-04-26T21:26:08.538 INFO:tasks.workunit.client.0.smithi084.stdout:2/824: write d6/d7/d3d/d15/d1f/d39/d20/d45/f60 [466930,80863] 0 2024-04-26T21:26:08.539 INFO:tasks.workunit.client.1.smithi120.stdout:1/851: write d6/d9/dd4/de0/d1b/d55/f5b [4584325,53869] 0 2024-04-26T21:26:08.540 INFO:tasks.workunit.client.0.smithi084.stdout:9/616: dwrite da/dd5/d93/dc3/f4e [0,4194304] 0 2024-04-26T21:26:08.543 INFO:tasks.workunit.client.1.smithi120.stdout:6/936: dwrite d4/db/d10/d1a/d2b/d57/d67/f4a [0,4194304] 0 2024-04-26T21:26:08.545 INFO:tasks.workunit.client.0.smithi084.stdout:2/825: dread - d6/d7/d3d/d79/d81/d82/da8/f107 zero size 2024-04-26T21:26:08.547 INFO:tasks.workunit.client.1.smithi120.stdout:4/942: getdents d10/d12 0 2024-04-26T21:26:08.547 INFO:tasks.workunit.client.0.smithi084.stdout:3/713: write d1/d24/d27/f30 [240971,58913] 0 2024-04-26T21:26:08.549 INFO:tasks.workunit.client.0.smithi084.stdout:7/754: dwrite d6/d9/d12/d19/d7a/d84/fcc [0,4194304] 0 2024-04-26T21:26:08.552 INFO:tasks.workunit.client.1.smithi120.stdout:7/921: dread d7/d64/da6/d1a/d50/dfa/d131/f83 [0,4194304] 0 2024-04-26T21:26:08.554 INFO:tasks.workunit.client.0.smithi084.stdout:0/719: symlink de/d2b/le5 0 2024-04-26T21:26:08.554 INFO:tasks.workunit.client.0.smithi084.stdout:2/826: mknod d6/d7/c113 0 2024-04-26T21:26:08.557 INFO:tasks.workunit.client.0.smithi084.stdout:0/720: chown de/d2b/d45 2 1 2024-04-26T21:26:08.563 INFO:tasks.workunit.client.0.smithi084.stdout:8/712: dwrite d4/d6/db/d1e/d22/d39/f93 [0,4194304] 0 2024-04-26T21:26:08.563 INFO:tasks.workunit.client.1.smithi120.stdout:2/923: dwrite d4/d1b/d2e/d50/d14/d15/f71 [0,4194304] 0 2024-04-26T21:26:08.569 INFO:tasks.workunit.client.0.smithi084.stdout:0/721: read de/d20/d4e/f60 [1092882,96300] 0 2024-04-26T21:26:08.569 INFO:tasks.workunit.client.0.smithi084.stdout:7/755: symlink d6/d9/d12/d19/d60/l105 0 2024-04-26T21:26:08.571 INFO:tasks.workunit.client.0.smithi084.stdout:8/713: dread - d4/d6/db/d1e/d22/d2f/fd1 zero size 2024-04-26T21:26:08.571 INFO:tasks.workunit.client.0.smithi084.stdout:3/714: symlink d1/d2c/d2f/d31/d55/d4e/d7c/lfe 0 2024-04-26T21:26:08.572 INFO:tasks.workunit.client.1.smithi120.stdout:5/938: dread d2/dc/d1d/d21/d66/f14 [0,4194304] 0 2024-04-26T21:26:08.572 INFO:tasks.workunit.client.1.smithi120.stdout:2/924: truncate d4/d1b/d25/d2c/d3e/f11d 1547315 0 2024-04-26T21:26:08.575 INFO:tasks.workunit.client.0.smithi084.stdout:4/663: truncate d5/d2e/d5f/f27 368648 0 2024-04-26T21:26:08.579 INFO:tasks.workunit.client.0.smithi084.stdout:1/712: write d2/d54/d5e/d66/d3a/d77/f8c [399762,66397] 0 2024-04-26T21:26:08.580 INFO:tasks.workunit.client.1.smithi120.stdout:1/852: dwrite d6/d9/dd4/de0/d1b/d55/fa1 [0,4194304] 0 2024-04-26T21:26:08.580 INFO:tasks.workunit.client.0.smithi084.stdout:8/714: mkdir d4/d6/db/d9b/dd4 0 2024-04-26T21:26:08.590 INFO:tasks.workunit.client.0.smithi084.stdout:4/664: creat d5/d7/d65/d7f/fd5 x:0 0 0 2024-04-26T21:26:08.590 INFO:tasks.workunit.client.0.smithi084.stdout:3/715: truncate d1/d2c/d2f/d31/d55/f7b 2330498 0 2024-04-26T21:26:08.592 INFO:tasks.workunit.client.0.smithi084.stdout:1/713: write d2/f92 [315475,2600] 0 2024-04-26T21:26:08.595 INFO:tasks.workunit.client.0.smithi084.stdout:8/715: creat d4/d6/db/d1e/fd5 x:0 0 0 2024-04-26T21:26:08.600 INFO:tasks.workunit.client.1.smithi120.stdout:1/853: dread d6/d9/fc0 [0,4194304] 0 2024-04-26T21:26:08.601 INFO:tasks.workunit.client.0.smithi084.stdout:1/714: write d2/d54/d5e/d66/d2a/d2c/f2d [3570616,3124] 0 2024-04-26T21:26:08.605 INFO:tasks.workunit.client.0.smithi084.stdout:0/722: dread de/d2b/d45/d94/fc6 [0,4194304] 0 2024-04-26T21:26:08.609 INFO:tasks.workunit.client.0.smithi084.stdout:3/716: read d1/d2c/d2f/d31/d52/fa1 [1440775,97302] 0 2024-04-26T21:26:08.610 INFO:tasks.workunit.client.1.smithi120.stdout:7/922: dread d7/d10/fe7 [0,4194304] 0 2024-04-26T21:26:08.610 INFO:tasks.workunit.client.0.smithi084.stdout:9/617: truncate da/dd5/d93/dc3/d41/d43/f9f 217094 0 2024-04-26T21:26:08.612 INFO:tasks.workunit.client.0.smithi084.stdout:1/715: readlink d2/d54/d5e/d66/d3a/d48/lb2 0 2024-04-26T21:26:08.614 INFO:tasks.workunit.client.0.smithi084.stdout:0/723: chown de/d78/d9e/da1/fe2 349672 1 2024-04-26T21:26:08.619 INFO:tasks.workunit.client.0.smithi084.stdout:9/618: creat da/dd5/d93/dc3/d41/d8d/fe0 x:0 0 0 2024-04-26T21:26:08.621 INFO:tasks.workunit.client.0.smithi084.stdout:8/716: getdents d4/d7/d15/d3c 0 2024-04-26T21:26:08.621 INFO:tasks.workunit.client.0.smithi084.stdout:2/827: dread - d6/d7/d3d/fac zero size 2024-04-26T21:26:08.627 INFO:tasks.workunit.client.0.smithi084.stdout:1/716: creat d2/d54/d5e/d66/d3a/ff0 x:0 0 0 2024-04-26T21:26:08.632 INFO:tasks.workunit.client.0.smithi084.stdout:9/619: mknod da/de/ce1 0 2024-04-26T21:26:08.632 INFO:tasks.workunit.client.0.smithi084.stdout:2/828: dread d6/d1b/f7e [0,4194304] 0 2024-04-26T21:26:08.635 INFO:tasks.workunit.client.0.smithi084.stdout:8/717: getdents d4/d7/d15/d37/d52/d69 0 2024-04-26T21:26:08.635 INFO:tasks.workunit.client.0.smithi084.stdout:7/756: write d6/d9/d63/f87 [1951071,104282] 0 2024-04-26T21:26:08.639 INFO:tasks.workunit.client.0.smithi084.stdout:0/724: write de/d2b/f84 [903323,40546] 0 2024-04-26T21:26:08.641 INFO:tasks.workunit.client.0.smithi084.stdout:3/717: write d1/d24/d27/d3a/f62 [5640127,13467] 0 2024-04-26T21:26:08.644 INFO:tasks.workunit.client.0.smithi084.stdout:8/718: dread - d4/d6/db/d1e/d22/d39/d4a/fb6 zero size 2024-04-26T21:26:08.647 INFO:tasks.workunit.client.0.smithi084.stdout:9/620: truncate da/de/d1e/d56/f5c 1437628 0 2024-04-26T21:26:08.652 INFO:tasks.workunit.client.0.smithi084.stdout:9/621: fsync da/dd5/d93/d95/daa/fcd 0 2024-04-26T21:26:08.656 INFO:tasks.workunit.client.0.smithi084.stdout:2/829: read - d6/d7/d3d/d79/d81/d82/da8/f107 zero size 2024-04-26T21:26:08.656 INFO:tasks.workunit.client.0.smithi084.stdout:7/757: mkdir d6/d9/d96/d106 0 2024-04-26T21:26:08.657 INFO:tasks.workunit.client.0.smithi084.stdout:1/717: dwrite d2/d54/d5e/d66/d2a/f7c [0,4194304] 0 2024-04-26T21:26:08.660 INFO:tasks.workunit.client.0.smithi084.stdout:0/725: fdatasync de/d2b/d45/d63/fc0 0 2024-04-26T21:26:08.662 INFO:tasks.workunit.client.0.smithi084.stdout:9/622: chown da/dd5/d93/lac 0 1 2024-04-26T21:26:08.666 INFO:tasks.workunit.client.0.smithi084.stdout:4/665: dwrite d5/d7/d65/d7f/db8/f7e [0,4194304] 0 2024-04-26T21:26:08.672 INFO:tasks.workunit.client.0.smithi084.stdout:4/666: write d5/d25/f47 [2711633,58274] 0 2024-04-26T21:26:08.674 INFO:tasks.workunit.client.0.smithi084.stdout:2/830: mknod d6/d7/d3d/d15/d1f/d39/d20/d36/c114 0 2024-04-26T21:26:08.675 INFO:tasks.workunit.client.0.smithi084.stdout:3/718: dwrite d1/d24/d27/d3a/ffa [4194304,4194304] 0 2024-04-26T21:26:08.681 INFO:tasks.workunit.client.0.smithi084.stdout:7/758: rename d6/d9/d12/d19/d7a to d6/d68/d7f/d107 0 2024-04-26T21:26:08.684 INFO:tasks.workunit.client.0.smithi084.stdout:1/718: creat d2/d9/d15/d28/d5a/ff1 x:0 0 0 2024-04-26T21:26:08.685 INFO:tasks.workunit.client.0.smithi084.stdout:4/667: rmdir d5/d7/d65/d90/d91/daa 39 2024-04-26T21:26:08.685 INFO:tasks.workunit.client.0.smithi084.stdout:2/831: chown d6/d7/d3d/d15/d1f/d39/d20/d36/fe1 139 1 2024-04-26T21:26:08.689 INFO:tasks.workunit.client.1.smithi120.stdout:4/943: chown d10/d12/da1/daf/f122 13107 1 2024-04-26T21:26:08.690 INFO:tasks.workunit.client.0.smithi084.stdout:9/623: symlink da/dd5/d93/dc3/d41/d43/le2 0 2024-04-26T21:26:08.690 INFO:tasks.workunit.client.0.smithi084.stdout:7/759: mknod d6/d68/c108 0 2024-04-26T21:26:08.691 INFO:tasks.workunit.client.1.smithi120.stdout:4/944: write d10/f26 [1565119,40060] 0 2024-04-26T21:26:08.693 INFO:tasks.workunit.client.0.smithi084.stdout:0/726: rename de/d78/d9e/cbf to de/d2b/d77/d32/d96/dbe/ce6 0 2024-04-26T21:26:08.693 INFO:tasks.workunit.client.1.smithi120.stdout:6/937: mkdir d4/db/d10/d22/d56/d8f/df8/d135 0 2024-04-26T21:26:08.696 INFO:tasks.workunit.client.1.smithi120.stdout:8/904: write d5/d6/d34/d42/d9d/d7a/f96 [417454,3794] 0 2024-04-26T21:26:08.697 INFO:tasks.workunit.client.0.smithi084.stdout:8/719: getdents d4/d6/db/d1e/d22 0 2024-04-26T21:26:08.698 INFO:tasks.workunit.client.0.smithi084.stdout:7/760: write d6/d26/d40/f5b [3649755,71771] 0 2024-04-26T21:26:08.698 INFO:tasks.workunit.client.0.smithi084.stdout:4/668: rename d5/d7/d65/fcc to d5/d7/d65/d90/d91/dba/fd6 0 2024-04-26T21:26:08.704 INFO:tasks.workunit.client.0.smithi084.stdout:2/832: rename d6/d3e/d67 to d6/d7/db6/d115 0 2024-04-26T21:26:08.705 INFO:tasks.workunit.client.0.smithi084.stdout:9/624: mknod da/dd5/d93/dc3/d41/d43/d48/d61/d81/ce3 0 2024-04-26T21:26:08.707 INFO:tasks.workunit.client.0.smithi084.stdout:7/761: creat d6/d68/d7f/d107/f109 x:0 0 0 2024-04-26T21:26:08.708 INFO:tasks.workunit.client.0.smithi084.stdout:4/669: rmdir d5/d2e/d5f/d32/d46/d77 39 2024-04-26T21:26:08.713 INFO:tasks.workunit.client.0.smithi084.stdout:0/727: getdents de/d2b 0 2024-04-26T21:26:08.717 INFO:tasks.workunit.client.0.smithi084.stdout:2/833: mknod d6/d7/d3d/d15/d1f/d39/da5/c116 0 2024-04-26T21:26:08.717 INFO:tasks.workunit.client.0.smithi084.stdout:1/719: dwrite d2/d19/d63/f96 [0,4194304] 0 2024-04-26T21:26:08.718 INFO:tasks.workunit.client.1.smithi120.stdout:7/923: read d7/d64/da6/f95 [5374973,33112] 0 2024-04-26T21:26:08.718 INFO:tasks.workunit.client.1.smithi120.stdout:6/938: fdatasync d4/db/d25/d6d/f77 0 2024-04-26T21:26:08.719 INFO:tasks.workunit.client.0.smithi084.stdout:3/719: dread d1/d2c/d2f/f28 [0,4194304] 0 2024-04-26T21:26:08.720 INFO:tasks.workunit.client.0.smithi084.stdout:0/728: symlink de/d20/d4e/da9/le7 0 2024-04-26T21:26:08.722 INFO:tasks.workunit.client.0.smithi084.stdout:4/670: mkdir d5/d2e/d5f/dd7 0 2024-04-26T21:26:08.725 INFO:tasks.workunit.client.0.smithi084.stdout:5/709: sync 2024-04-26T21:26:08.729 INFO:tasks.workunit.client.0.smithi084.stdout:1/720: fdatasync d2/d9/d15/d28/d47/f4b 0 2024-04-26T21:26:08.729 INFO:tasks.workunit.client.1.smithi120.stdout:3/949: dwrite dd/d2a/d74/fbf [0,4194304] 0 2024-04-26T21:26:08.729 INFO:tasks.workunit.client.0.smithi084.stdout:2/834: rename d6/d7/d3d/d15/fc7 to d6/d7/d3d/d15/d1f/d22/dd4/f117 0 2024-04-26T21:26:08.731 INFO:tasks.workunit.client.0.smithi084.stdout:5/710: write d0/dc/df/fa4 [4684270,5775] 0 2024-04-26T21:26:08.733 INFO:tasks.workunit.client.0.smithi084.stdout:2/835: dread - d6/d7/d3d/fac zero size 2024-04-26T21:26:08.733 INFO:tasks.workunit.client.1.smithi120.stdout:9/876: sync 2024-04-26T21:26:08.737 INFO:tasks.workunit.client.1.smithi120.stdout:8/905: mkdir d5/d6/d34/d42/d102/d118/d60/dec/d12d 0 2024-04-26T21:26:08.738 INFO:tasks.workunit.client.0.smithi084.stdout:2/836: mknod d6/d7/d3d/d15/d1f/d6c/c118 0 2024-04-26T21:26:08.748 INFO:tasks.workunit.client.1.smithi120.stdout:6/939: symlink d4/d3d/dd9/l136 0 2024-04-26T21:26:08.751 INFO:tasks.workunit.client.0.smithi084.stdout:2/837: mknod d6/d7/db6/dec/c119 0 2024-04-26T21:26:08.756 INFO:tasks.workunit.client.0.smithi084.stdout:5/711: link d0/dc/fa0 d0/dc/df/d31/d45/fdb 0 2024-04-26T21:26:08.760 INFO:tasks.workunit.client.0.smithi084.stdout:2/838: symlink d6/d7/d3d/d79/d81/l11a 0 2024-04-26T21:26:08.761 INFO:tasks.workunit.client.0.smithi084.stdout:2/839: readlink d6/d1b/l8a 0 2024-04-26T21:26:08.779 INFO:tasks.workunit.client.0.smithi084.stdout:1/721: write d2/d54/d5e/d66/d2a/d2c/d45/fa4 [37178,100678] 0 2024-04-26T21:26:08.780 INFO:tasks.workunit.client.0.smithi084.stdout:0/729: dread de/f1f [0,4194304] 0 2024-04-26T21:26:08.803 INFO:tasks.workunit.client.0.smithi084.stdout:8/720: dwrite d4/d6/db/d1e/d22/d39/d4a/f8f [0,4194304] 0 2024-04-26T21:26:08.805 INFO:tasks.workunit.client.0.smithi084.stdout:7/762: dwrite d6/d68/d7f/d107/d84/f55 [0,4194304] 0 2024-04-26T21:26:08.811 INFO:tasks.workunit.client.0.smithi084.stdout:3/720: dwrite d1/d2c/d2f/d31/d3b/f41 [0,4194304] 0 2024-04-26T21:26:08.816 INFO:tasks.workunit.client.0.smithi084.stdout:4/671: dwrite d5/d2e/d5f/f8a [0,4194304] 0 2024-04-26T21:26:08.818 INFO:tasks.workunit.client.0.smithi084.stdout:7/763: write d6/d68/d7f/fae [3270135,101462] 0 2024-04-26T21:26:08.819 INFO:tasks.workunit.client.0.smithi084.stdout:0/730: chown de/d2b/d45/d63/da7/laf 4 1 2024-04-26T21:26:08.825 INFO:tasks.workunit.client.0.smithi084.stdout:3/721: creat d1/d24/d27/fff x:0 0 0 2024-04-26T21:26:08.825 INFO:tasks.workunit.client.0.smithi084.stdout:6/698: sync 2024-04-26T21:26:08.838 INFO:tasks.workunit.client.0.smithi084.stdout:8/721: symlink d4/d6/ld6 0 2024-04-26T21:26:08.846 INFO:tasks.workunit.client.0.smithi084.stdout:0/731: truncate de/fd3 942037 0 2024-04-26T21:26:08.846 INFO:tasks.workunit.client.0.smithi084.stdout:6/699: read - d3/de/d9e/faa zero size 2024-04-26T21:26:08.847 INFO:tasks.workunit.client.0.smithi084.stdout:2/840: dread d6/d7/d68/f10c [0,4194304] 0 2024-04-26T21:26:08.847 INFO:tasks.workunit.client.0.smithi084.stdout:1/722: dwrite d2/d54/d5e/d66/f29 [4194304,4194304] 0 2024-04-26T21:26:08.849 INFO:tasks.workunit.client.0.smithi084.stdout:5/712: dread d0/dc/df/d6d/f70 [0,4194304] 0 2024-04-26T21:26:08.853 INFO:tasks.workunit.client.0.smithi084.stdout:7/764: rename d6/d9/d96/ff9 to d6/d9/d12/d8b/d72/d100/f10a 0 2024-04-26T21:26:08.854 INFO:tasks.workunit.client.0.smithi084.stdout:9/625: sync 2024-04-26T21:26:08.861 INFO:tasks.workunit.client.0.smithi084.stdout:1/723: rename d2/d19/c26 to d2/d9/d15/d28/d69/cf2 0 2024-04-26T21:26:08.863 INFO:tasks.workunit.client.0.smithi084.stdout:6/700: write d3/de/d1a/d2f/fdf [4265955,112663] 0 2024-04-26T21:26:08.865 INFO:tasks.workunit.client.0.smithi084.stdout:7/765: creat d6/d9/d12/d8b/f10b x:0 0 0 2024-04-26T21:26:08.865 INFO:tasks.workunit.client.0.smithi084.stdout:9/626: rename da/dd5/d93/dc3/d7c to da/dd5/d93/dc3/d41/de4 0 2024-04-26T21:26:08.868 INFO:tasks.workunit.client.0.smithi084.stdout:5/713: symlink d0/dc/ldc 0 2024-04-26T21:26:08.872 INFO:tasks.workunit.client.0.smithi084.stdout:1/724: write d2/d54/d5e/d66/d2a/d2c/d75/f7d [1865144,66629] 0 2024-04-26T21:26:08.874 INFO:tasks.workunit.client.0.smithi084.stdout:6/701: fdatasync d3/de/d15/df/f1b 0 2024-04-26T21:26:08.876 INFO:tasks.workunit.client.0.smithi084.stdout:5/714: write d0/d49/d56/f6f [1605669,37947] 0 2024-04-26T21:26:08.878 INFO:tasks.workunit.client.0.smithi084.stdout:7/766: mknod d6/d9/d63/c10c 0 2024-04-26T21:26:08.879 INFO:tasks.workunit.client.0.smithi084.stdout:3/722: write d1/d2c/d2f/d31/d52/f8b [2888182,58865] 0 2024-04-26T21:26:08.880 INFO:tasks.workunit.client.0.smithi084.stdout:9/627: mknod da/dd5/d93/dc3/d41/d43/d48/ce5 0 2024-04-26T21:26:08.884 INFO:tasks.workunit.client.0.smithi084.stdout:1/725: dread - d2/d9/d15/d28/d47/fd3 zero size 2024-04-26T21:26:08.887 INFO:tasks.workunit.client.0.smithi084.stdout:5/715: readlink d0/dc/df/d31/d53/d5d/l8e 0 2024-04-26T21:26:08.887 INFO:tasks.workunit.client.0.smithi084.stdout:6/702: unlink d3/de/d41/d5c/dc3/fde 0 2024-04-26T21:26:08.887 INFO:tasks.workunit.client.0.smithi084.stdout:9/628: fdatasync da/f46 0 2024-04-26T21:26:08.890 INFO:tasks.workunit.client.0.smithi084.stdout:7/767: write d6/d68/d7f/fae [4973124,99460] 0 2024-04-26T21:26:08.891 INFO:tasks.workunit.client.1.smithi120.stdout:5/939: truncate d2/d30/d93/d107/d34/fa9 4867794 0 2024-04-26T21:26:08.892 INFO:tasks.workunit.client.1.smithi120.stdout:3/950: fdatasync dd/de/d83/fa7 0 2024-04-26T21:26:08.894 INFO:tasks.workunit.client.1.smithi120.stdout:5/940: write d2/d1b/f13e [518583,11882] 0 2024-04-26T21:26:08.897 INFO:tasks.workunit.client.0.smithi084.stdout:2/841: dwrite d6/d7/d3d/d15/f1a [0,4194304] 0 2024-04-26T21:26:08.898 INFO:tasks.workunit.client.0.smithi084.stdout:8/722: dwrite d4/d7/d15/fb7 [0,4194304] 0 2024-04-26T21:26:08.901 INFO:tasks.workunit.client.0.smithi084.stdout:6/703: stat d3/de/d1a/d2f/d4c/d58/f66 0 2024-04-26T21:26:08.903 INFO:tasks.workunit.client.0.smithi084.stdout:4/672: dwrite d5/d2e/d5f/f27 [0,4194304] 0 2024-04-26T21:26:08.904 INFO:tasks.workunit.client.1.smithi120.stdout:8/906: creat d5/d6/d34/d42/d102/d118/d60/dec/f12e x:0 0 0 2024-04-26T21:26:08.907 INFO:tasks.workunit.client.1.smithi120.stdout:6/940: mkdir d4/db/d10/d22/d56/d94/d137 0 2024-04-26T21:26:08.908 INFO:tasks.workunit.client.0.smithi084.stdout:8/723: chown d4/d6/db/d1e/c4c 65506 1 2024-04-26T21:26:08.914 INFO:tasks.workunit.client.0.smithi084.stdout:9/629: mkdir da/de/d1e/d56/da6/de6 0 2024-04-26T21:26:08.914 INFO:tasks.workunit.client.0.smithi084.stdout:1/726: creat d2/d54/d5e/ff3 x:0 0 0 2024-04-26T21:26:08.914 INFO:tasks.workunit.client.0.smithi084.stdout:4/673: readlink d5/d25/l2d 0 2024-04-26T21:26:08.915 INFO:tasks.workunit.client.0.smithi084.stdout:3/723: write d1/d2c/d2f/d31/f86 [2823232,130633] 0 2024-04-26T21:26:08.916 INFO:tasks.workunit.client.1.smithi120.stdout:7/924: link d7/d19/d60/deb/ff8 d7/d10/d97/d115/dfc/f132 0 2024-04-26T21:26:08.920 INFO:tasks.workunit.client.0.smithi084.stdout:2/842: read - d6/d7/d3d/d15/d1f/d39/da5/fda zero size 2024-04-26T21:26:08.925 INFO:tasks.workunit.client.0.smithi084.stdout:9/630: stat da/dd5/d93/dc3/d41/d43/d80 0 2024-04-26T21:26:08.927 INFO:tasks.workunit.client.0.smithi084.stdout:1/727: chown d2/d54/d5e/d66/f44 0 1 2024-04-26T21:26:08.928 INFO:tasks.workunit.client.0.smithi084.stdout:4/674: mkdir d5/d25/d35/d60/d6d/dd0/dd8 0 2024-04-26T21:26:08.930 INFO:tasks.workunit.client.0.smithi084.stdout:3/724: rmdir d1/d24/d27/d3a/dd0 0 2024-04-26T21:26:08.932 INFO:tasks.workunit.client.0.smithi084.stdout:5/716: write d0/d49/d56/f57 [607888,106958] 0 2024-04-26T21:26:08.932 INFO:tasks.workunit.client.1.smithi120.stdout:9/877: mknod d0/d6/d4d/d65/dec/c125 0 2024-04-26T21:26:08.936 INFO:tasks.workunit.client.0.smithi084.stdout:9/631: write da/dd5/d93/dc3/f73 [2171211,38387] 0 2024-04-26T21:26:08.937 INFO:tasks.workunit.client.1.smithi120.stdout:4/945: getdents d10/d12 0 2024-04-26T21:26:08.938 INFO:tasks.workunit.client.0.smithi084.stdout:4/675: mkdir d5/d10/d82/dd9 0 2024-04-26T21:26:08.939 INFO:tasks.workunit.client.1.smithi120.stdout:4/946: stat d10/d28/f4b 0 2024-04-26T21:26:08.944 INFO:tasks.workunit.client.0.smithi084.stdout:6/704: dwrite d3/fcb [0,4194304] 0 2024-04-26T21:26:08.945 INFO:tasks.workunit.client.0.smithi084.stdout:8/724: link d4/d6/db/l46 d4/d7/d15/d37/d52/d69/ld7 0 2024-04-26T21:26:08.945 INFO:tasks.workunit.client.0.smithi084.stdout:2/843: rename d6/d7/d3d/d4f/d90 to d6/d7/db6/d115/d11b 0 2024-04-26T21:26:08.946 INFO:tasks.workunit.client.0.smithi084.stdout:4/676: mknod d5/d7/d65/d7f/d6a/cda 0 2024-04-26T21:26:08.950 INFO:tasks.workunit.client.0.smithi084.stdout:1/728: getdents d2/d54/d5e/dbe 0 2024-04-26T21:26:08.954 INFO:tasks.workunit.client.1.smithi120.stdout:6/941: mknod d4/db/d25/d6d/d97/dc8/d133/c138 0 2024-04-26T21:26:08.958 INFO:tasks.workunit.client.0.smithi084.stdout:2/844: write d6/d7/d3d/d15/d1f/d39/da5/fd2 [763774,83438] 0 2024-04-26T21:26:08.959 INFO:tasks.workunit.client.0.smithi084.stdout:9/632: truncate da/dd5/d93/dc3/d41/d8d/f99 733214 0 2024-04-26T21:26:08.966 INFO:tasks.workunit.client.1.smithi120.stdout:7/925: link d7/d10/f6a d7/d64/da6/d1f/d28/d4c/d6c/f133 0 2024-04-26T21:26:08.967 INFO:tasks.workunit.client.0.smithi084.stdout:8/725: write d4/d3a/f71 [7518196,109630] 0 2024-04-26T21:26:08.967 INFO:tasks.workunit.client.0.smithi084.stdout:0/732: sync 2024-04-26T21:26:08.968 INFO:tasks.workunit.client.1.smithi120.stdout:6/942: truncate d4/db/d10/d1a/d2b/d57/d67/f66 57489 0 2024-04-26T21:26:08.969 INFO:tasks.workunit.client.0.smithi084.stdout:4/677: write d5/d7/d65/d90/d91/dba/fd6 [223269,127757] 0 2024-04-26T21:26:08.970 INFO:tasks.workunit.client.0.smithi084.stdout:9/633: creat da/dd5/d93/dc3/d41/de4/fe7 x:0 0 0 2024-04-26T21:26:08.974 INFO:tasks.workunit.client.0.smithi084.stdout:3/725: link d1/d2c/d2f/d31/d55/d4e/fcf d1/d2c/f100 0 2024-04-26T21:26:08.975 INFO:tasks.workunit.client.1.smithi120.stdout:7/926: symlink d7/d64/da6/d1f/d28/d4c/d6c/d74/l134 0 2024-04-26T21:26:08.977 INFO:tasks.workunit.client.0.smithi084.stdout:0/733: chown de/d20/d4c/la5 70075 1 2024-04-26T21:26:08.978 INFO:tasks.workunit.client.1.smithi120.stdout:6/943: read d4/db/d25/d6d/fb4 [394464,78251] 0 2024-04-26T21:26:08.979 INFO:tasks.workunit.client.0.smithi084.stdout:7/768: dread d6/d9/d12/d19/d20/d38/fa4 [0,4194304] 0 2024-04-26T21:26:08.983 INFO:tasks.workunit.client.1.smithi120.stdout:7/927: unlink d7/d64/da6/d1a/d50/dfa/d131/d109/f12c 0 2024-04-26T21:26:08.985 INFO:tasks.workunit.client.0.smithi084.stdout:2/845: mknod d6/d7/d3d/d15/d1f/d39/d20/d45/d6d/c11c 0 2024-04-26T21:26:08.988 INFO:tasks.workunit.client.1.smithi120.stdout:6/944: dread d4/db/d10/dd/d4e/f81 [0,4194304] 0 2024-04-26T21:26:08.989 INFO:tasks.workunit.client.1.smithi120.stdout:9/878: dread d0/f4f [0,4194304] 0 2024-04-26T21:26:08.990 INFO:tasks.workunit.client.0.smithi084.stdout:8/726: creat d4/d7/d15/fd8 x:0 0 0 2024-04-26T21:26:08.990 INFO:tasks.workunit.client.0.smithi084.stdout:7/769: mkdir d6/d9/d96/d10d 0 2024-04-26T21:26:08.996 INFO:tasks.workunit.client.0.smithi084.stdout:5/717: dwrite d0/d49/d4d/f74 [0,4194304] 0 2024-04-26T21:26:08.996 INFO:tasks.workunit.client.0.smithi084.stdout:4/678: dread d5/d10/da1/fbb [0,4194304] 0 2024-04-26T21:26:08.997 INFO:tasks.workunit.client.0.smithi084.stdout:1/729: dwrite d2/d54/d5e/d66/d3a/ff0 [0,4194304] 0 2024-04-26T21:26:08.998 INFO:tasks.workunit.client.0.smithi084.stdout:8/727: write d4/d3a/f71 [4338787,60667] 0 2024-04-26T21:26:08.998 INFO:tasks.workunit.client.0.smithi084.stdout:5/718: dread - d0/faa zero size 2024-04-26T21:26:09.004 INFO:tasks.workunit.client.0.smithi084.stdout:6/705: dwrite d3/de/d41/d5c/de2/fdc [0,4194304] 0 2024-04-26T21:26:09.008 INFO:tasks.workunit.client.0.smithi084.stdout:8/728: read - d4/d6/db/d1e/d22/d2f/fd1 zero size 2024-04-26T21:26:09.012 INFO:tasks.workunit.client.0.smithi084.stdout:3/726: getdents d1/d2c/d2f/d31/dc7 0 2024-04-26T21:26:09.013 INFO:tasks.workunit.client.1.smithi120.stdout:6/945: mknod d4/db/d25/c139 0 2024-04-26T21:26:09.015 INFO:tasks.workunit.client.0.smithi084.stdout:2/846: write d6/d7/d3d/fac [638647,122283] 0 2024-04-26T21:26:09.016 INFO:tasks.workunit.client.1.smithi120.stdout:5/941: creat d2/dc/d1d/d21/d66/d6a/f155 x:0 0 0 2024-04-26T21:26:09.019 INFO:tasks.workunit.client.1.smithi120.stdout:6/946: stat d4/db/d10/dd/d28/d9e/f9f 0 2024-04-26T21:26:09.021 INFO:tasks.workunit.client.1.smithi120.stdout:7/928: dread d7/d10/d97/d115/f8f [0,4194304] 0 2024-04-26T21:26:09.022 INFO:tasks.workunit.client.1.smithi120.stdout:6/947: fdatasync d4/db/d10/dd/d4e/d60/fb1 0 2024-04-26T21:26:09.028 INFO:tasks.workunit.client.1.smithi120.stdout:8/907: creat d5/d6/d34/d42/d4a/deb/f12f x:0 0 0 2024-04-26T21:26:09.028 INFO:tasks.workunit.client.0.smithi084.stdout:4/679: rename d5/d2e/d5f/l50 to d5/d25/ldb 0 2024-04-26T21:26:09.030 INFO:tasks.workunit.client.1.smithi120.stdout:6/948: unlink d4/db/d10/d22/f62 0 2024-04-26T21:26:09.032 INFO:tasks.workunit.client.0.smithi084.stdout:5/719: creat d0/dc/df/d31/d53/fdd x:0 0 0 2024-04-26T21:26:09.032 INFO:tasks.workunit.client.0.smithi084.stdout:5/720: chown d0/d49/d56 0 1 2024-04-26T21:26:09.033 INFO:tasks.workunit.client.0.smithi084.stdout:3/727: symlink d1/d2c/d2f/d31/d52/l101 0 2024-04-26T21:26:09.034 INFO:tasks.workunit.client.1.smithi120.stdout:7/929: fdatasync d7/d10/d97/d115/dfc/f132 0 2024-04-26T21:26:09.038 INFO:tasks.workunit.client.0.smithi084.stdout:6/706: creat d3/de/d15/d23/fe3 x:0 0 0 2024-04-26T21:26:09.039 INFO:tasks.workunit.client.0.smithi084.stdout:9/634: dwrite da/dd5/d93/fc4 [0,4194304] 0 2024-04-26T21:26:09.040 INFO:tasks.workunit.client.1.smithi120.stdout:8/908: creat d5/d6/d34/d42/d102/d118/db8/d11a/f130 x:0 0 0 2024-04-26T21:26:09.040 INFO:tasks.workunit.client.1.smithi120.stdout:5/942: dwrite d2/d30/d93/d107/d36/d44/d6c/df5/f137 [0,4194304] 0 2024-04-26T21:26:09.041 INFO:tasks.workunit.client.0.smithi084.stdout:4/680: rmdir d5/d7/d65/d7f/d6a 39 2024-04-26T21:26:09.046 INFO:tasks.workunit.client.0.smithi084.stdout:3/728: symlink d1/d2c/d2f/d31/dc7/l102 0 2024-04-26T21:26:09.050 INFO:tasks.workunit.client.0.smithi084.stdout:1/730: dwrite d2/d19/d63/f71 [0,4194304] 0 2024-04-26T21:26:09.051 INFO:tasks.workunit.client.1.smithi120.stdout:8/909: readlink d5/d6/l1d 0 2024-04-26T21:26:09.052 INFO:tasks.workunit.client.0.smithi084.stdout:0/734: truncate de/d2b/d64/d81/d9a/fd2 1793576 0 2024-04-26T21:26:09.056 INFO:tasks.workunit.client.1.smithi120.stdout:5/943: fsync d2/d30/d93/d107/d36/d44/fd4 0 2024-04-26T21:26:09.057 INFO:tasks.workunit.client.0.smithi084.stdout:4/681: chown d5/d25/d35/d60/fab 19 1 2024-04-26T21:26:09.059 INFO:tasks.workunit.client.1.smithi120.stdout:8/910: symlink d5/d6/d34/d42/d9d/d83/d11e/l131 0 2024-04-26T21:26:09.059 INFO:tasks.workunit.client.0.smithi084.stdout:4/682: stat d5/d25/d99/da0/fa6 0 2024-04-26T21:26:09.063 INFO:tasks.workunit.client.0.smithi084.stdout:6/707: creat d3/de/d15/d23/d90/fe4 x:0 0 0 2024-04-26T21:26:09.065 INFO:tasks.workunit.client.0.smithi084.stdout:4/683: write d5/d25/f79 [446952,69236] 0 2024-04-26T21:26:09.066 INFO:tasks.workunit.client.0.smithi084.stdout:3/729: mkdir d1/d24/d27/d3a/ddb/d103 0 2024-04-26T21:26:09.066 INFO:tasks.workunit.client.1.smithi120.stdout:8/911: chown d5/d6/d34/d42/d9d/d83/d11e/cb9 0 1 2024-04-26T21:26:09.071 INFO:tasks.workunit.client.0.smithi084.stdout:1/731: symlink d2/d54/d5e/d8d/lf4 0 2024-04-26T21:26:09.072 INFO:tasks.workunit.client.0.smithi084.stdout:9/635: symlink da/dd5/d93/dc3/d41/dab/le8 0 2024-04-26T21:26:09.073 INFO:tasks.workunit.client.0.smithi084.stdout:5/721: link d0/dc/df/d51/f81 d0/d49/fde 0 2024-04-26T21:26:09.077 INFO:tasks.workunit.client.0.smithi084.stdout:6/708: creat d3/de/d41/fe5 x:0 0 0 2024-04-26T21:26:09.078 INFO:tasks.workunit.client.0.smithi084.stdout:7/770: dwrite d6/d9/d12/d8b/d72/da0/d80/de5/ff3 [0,4194304] 0 2024-04-26T21:26:09.078 INFO:tasks.workunit.client.0.smithi084.stdout:3/730: mkdir d1/dea/d104 0 2024-04-26T21:26:09.086 INFO:tasks.workunit.client.1.smithi120.stdout:2/925: mkdir d4/d1b/d25/d137 0 2024-04-26T21:26:09.091 INFO:tasks.workunit.client.0.smithi084.stdout:0/735: dread de/d78/d9e/fe1 [0,4194304] 0 2024-04-26T21:26:09.091 INFO:tasks.workunit.client.0.smithi084.stdout:4/684: creat d5/d10/d15/fdc x:0 0 0 2024-04-26T21:26:09.091 INFO:tasks.workunit.client.0.smithi084.stdout:3/731: write d1/d2c/d2f/d31/d55/d4e/d98/d9e/fa9 [1105350,33351] 0 2024-04-26T21:26:09.091 INFO:tasks.workunit.client.0.smithi084.stdout:8/729: dwrite d4/d6/db/d9b/dca/fcf [0,4194304] 0 2024-04-26T21:26:09.091 INFO:tasks.workunit.client.0.smithi084.stdout:2/847: truncate d6/d7/d3d/d79/d81/d82/fa7 798807 0 2024-04-26T21:26:09.092 INFO:tasks.workunit.client.1.smithi120.stdout:3/951: write dd/de/df/d12/d48/fc4 [371168,130552] 0 2024-04-26T21:26:09.093 INFO:tasks.workunit.client.1.smithi120.stdout:3/952: chown dd/d2a/f33 493 1 2024-04-26T21:26:09.099 INFO:tasks.workunit.client.0.smithi084.stdout:3/732: creat d1/d24/d27/f105 x:0 0 0 2024-04-26T21:26:09.101 INFO:tasks.workunit.client.0.smithi084.stdout:8/730: symlink d4/d6/db/d1e/d7c/ld9 0 2024-04-26T21:26:09.102 INFO:tasks.workunit.client.0.smithi084.stdout:1/732: creat d2/d54/d5e/d66/d2a/d72/dd8/ff5 x:0 0 0 2024-04-26T21:26:09.103 INFO:tasks.workunit.client.1.smithi120.stdout:1/854: rename d6/d9/l21 to d6/d9/dd4/de0/d1d/d5d/d67/de3/d105/l11c 0 2024-04-26T21:26:09.109 INFO:tasks.workunit.client.0.smithi084.stdout:3/733: chown d1/d24/d27/l9c 0 1 2024-04-26T21:26:09.117 INFO:tasks.workunit.client.1.smithi120.stdout:8/912: rename d5/d6/d34/d42/fc3 to d5/d6/f132 0 2024-04-26T21:26:09.119 INFO:tasks.workunit.client.1.smithi120.stdout:9/879: write d0/d6/f39 [1814297,119057] 0 2024-04-26T21:26:09.121 INFO:tasks.workunit.client.0.smithi084.stdout:7/771: dwrite d6/d9/d12/d8b/f10b [0,4194304] 0 2024-04-26T21:26:09.122 INFO:tasks.workunit.client.0.smithi084.stdout:3/734: chown d1/d2c/d2f/d31/d55/d4e/d7c/d7e/laa 136 1 2024-04-26T21:26:09.123 INFO:tasks.workunit.client.0.smithi084.stdout:1/733: link d2/d19/l41 d2/d9/d15/d28/d69/d9d/de0/lf6 0 2024-04-26T21:26:09.126 INFO:tasks.workunit.client.0.smithi084.stdout:8/731: link d4/d6/db/d1e/c7b d4/d6/db/d9b/cda 0 2024-04-26T21:26:09.130 INFO:tasks.workunit.client.1.smithi120.stdout:6/949: truncate d4/db/d10/dd/f111 555774 0 2024-04-26T21:26:09.132 INFO:tasks.workunit.client.1.smithi120.stdout:5/944: write d2/dc/d1d/d21/d77/d79/ff2 [192630,27196] 0 2024-04-26T21:26:09.134 INFO:tasks.workunit.client.0.smithi084.stdout:8/732: stat d4/d6/f47 0 2024-04-26T21:26:09.136 INFO:tasks.workunit.client.0.smithi084.stdout:3/735: fsync d1/d24/d27/d3a/fa7 0 2024-04-26T21:26:09.139 INFO:tasks.workunit.client.1.smithi120.stdout:3/953: write dd/de/df/dda/d24/d9d/f122 [735480,29680] 0 2024-04-26T21:26:09.139 INFO:tasks.workunit.client.0.smithi084.stdout:2/848: truncate d6/d7/d3d/d15/d1f/d39/d20/d45/f60 350046 0 2024-04-26T21:26:09.141 INFO:tasks.workunit.client.1.smithi120.stdout:5/945: write d2/dc/d1d/d21/d66/d6a/f155 [97488,107431] 0 2024-04-26T21:26:09.146 INFO:tasks.workunit.client.0.smithi084.stdout:1/734: rename d2/d54/d5e/c87 to d2/d54/d5e/d66/d3a/d48/cf7 0 2024-04-26T21:26:09.147 INFO:tasks.workunit.client.1.smithi120.stdout:7/930: dwrite d7/d64/da6/d1a/df4/f103 [0,4194304] 0 2024-04-26T21:26:09.152 INFO:tasks.workunit.client.0.smithi084.stdout:2/849: chown d6/d7/d3d/d15/d1f/d22/d99/c109 109916400 1 2024-04-26T21:26:09.153 INFO:tasks.workunit.client.1.smithi120.stdout:2/926: dwrite d4/d1b/d25/d2c/d3e/ddb/fc1 [0,4194304] 0 2024-04-26T21:26:09.153 INFO:tasks.workunit.client.0.smithi084.stdout:6/709: dread d3/de/d41/f51 [0,4194304] 0 2024-04-26T21:26:09.155 INFO:tasks.workunit.client.1.smithi120.stdout:6/950: dread d4/db/d10/dd/f30 [0,4194304] 0 2024-04-26T21:26:09.158 INFO:tasks.workunit.client.1.smithi120.stdout:1/855: dwrite d6/d9/dd4/de0/d1b/f81 [0,4194304] 0 2024-04-26T21:26:09.159 INFO:tasks.workunit.client.0.smithi084.stdout:1/735: readlink d2/d19/l41 0 2024-04-26T21:26:09.160 INFO:tasks.workunit.client.0.smithi084.stdout:9/636: dwrite da/f46 [4194304,4194304] 0 2024-04-26T21:26:09.162 INFO:tasks.workunit.client.0.smithi084.stdout:7/772: write d6/d1c/f4e [101265,48566] 0 2024-04-26T21:26:09.163 INFO:tasks.workunit.client.1.smithi120.stdout:9/880: write d0/f7c [847119,115672] 0 2024-04-26T21:26:09.164 INFO:tasks.workunit.client.0.smithi084.stdout:6/710: chown d3/de/d41/f44 796 1 2024-04-26T21:26:09.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:08 smithi084 ceph-mon[25539]: pgmap v49: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 129 MiB/s rd, 302 MiB/s wr, 663 op/s 2024-04-26T21:26:09.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:08 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:26:09.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:08 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:26:09.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:08 smithi084 ceph-mon[25539]: mgrmap e27: smithi120.zjaduj(active, since 92s), standbys: smithi084.gyasul 2024-04-26T21:26:09.165 INFO:tasks.workunit.client.1.smithi120.stdout:9/881: chown d0/dd/d3a 97990821 1 2024-04-26T21:26:09.166 INFO:tasks.workunit.client.1.smithi120.stdout:9/882: stat d0/dd/c16 0 2024-04-26T21:26:09.173 INFO:tasks.workunit.client.0.smithi084.stdout:2/850: chown d6/d7/d3d/d79/d85/c9b 18 1 2024-04-26T21:26:09.175 INFO:tasks.workunit.client.0.smithi084.stdout:0/736: dread de/d2b/f6b [0,4194304] 0 2024-04-26T21:26:09.175 INFO:tasks.workunit.client.0.smithi084.stdout:7/773: mkdir d6/d9/d10e 0 2024-04-26T21:26:09.176 INFO:tasks.workunit.client.0.smithi084.stdout:9/637: mkdir da/dd5/d93/dc3/d41/d67/de9 0 2024-04-26T21:26:09.177 INFO:tasks.workunit.client.0.smithi084.stdout:5/722: dread d0/dc/df/d31/d53/f71 [0,4194304] 0 2024-04-26T21:26:09.180 INFO:tasks.workunit.client.0.smithi084.stdout:1/736: creat d2/ff8 x:0 0 0 2024-04-26T21:26:09.180 INFO:tasks.workunit.client.1.smithi120.stdout:2/927: creat d4/d1b/d56/d65/f138 x:0 0 0 2024-04-26T21:26:09.181 INFO:tasks.workunit.client.0.smithi084.stdout:1/737: chown d2/d9 12768 1 2024-04-26T21:26:09.181 INFO:tasks.workunit.client.0.smithi084.stdout:2/851: write d6/d7/d3d/fac [358010,66394] 0 2024-04-26T21:26:09.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:08 smithi120 ceph-mon[32741]: pgmap v49: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 129 MiB/s rd, 302 MiB/s wr, 663 op/s 2024-04-26T21:26:09.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:08 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:26:09.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:08 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:26:09.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:08 smithi120 ceph-mon[32741]: mgrmap e27: smithi120.zjaduj(active, since 92s), standbys: smithi084.gyasul 2024-04-26T21:26:09.186 INFO:tasks.workunit.client.1.smithi120.stdout:6/951: creat d4/db/d10/dd/d28/d9e/daf/dd3/f13a x:0 0 0 2024-04-26T21:26:09.186 INFO:tasks.workunit.client.1.smithi120.stdout:7/931: mknod d7/d64/da6/d1f/d28/d11d/c135 0 2024-04-26T21:26:09.187 INFO:tasks.workunit.client.0.smithi084.stdout:7/774: getdents d6/d9/d96/d106 0 2024-04-26T21:26:09.188 INFO:tasks.workunit.client.0.smithi084.stdout:0/737: dread - de/d2b/d45/d94/dcf/fdd zero size 2024-04-26T21:26:09.189 INFO:tasks.workunit.client.1.smithi120.stdout:9/883: mknod d0/d6/d4d/d65/c126 0 2024-04-26T21:26:09.190 INFO:tasks.workunit.client.0.smithi084.stdout:3/736: dwrite d1/d24/d27/d3a/fb0 [0,4194304] 0 2024-04-26T21:26:09.195 INFO:tasks.workunit.client.1.smithi120.stdout:6/952: mkdir d4/db/d25/d6d/d97/d13b 0 2024-04-26T21:26:09.197 INFO:tasks.workunit.client.0.smithi084.stdout:0/738: write de/d78/d9e/da1/dad/fe0 [689528,39304] 0 2024-04-26T21:26:09.197 INFO:tasks.workunit.client.1.smithi120.stdout:6/953: write d4/db/d10/dd/d4e/f85 [50848,81239] 0 2024-04-26T21:26:09.199 INFO:tasks.workunit.client.1.smithi120.stdout:4/947: sync 2024-04-26T21:26:09.199 INFO:tasks.workunit.client.0.smithi084.stdout:6/711: dwrite d3/de/d1a/d43/d72/f94 [4194304,4194304] 0 2024-04-26T21:26:09.201 INFO:tasks.workunit.client.1.smithi120.stdout:7/932: chown d7/d64/da6/f16 1016073 1 2024-04-26T21:26:09.201 INFO:tasks.workunit.client.1.smithi120.stdout:4/948: fsync d10/d12/f40 0 2024-04-26T21:26:09.202 INFO:tasks.workunit.client.0.smithi084.stdout:5/723: rename d0/d49/l65 to d0/dc/df/d31/d63/d6e/ldf 0 2024-04-26T21:26:09.202 INFO:tasks.workunit.client.0.smithi084.stdout:2/852: creat d6/d7/f11d x:0 0 0 2024-04-26T21:26:09.203 INFO:tasks.workunit.client.1.smithi120.stdout:3/954: write dd/de/df/dda/d24/f5a [613690,89303] 0 2024-04-26T21:26:09.203 INFO:tasks.workunit.client.0.smithi084.stdout:1/738: mknod d2/d54/d5e/d66/d2a/d2c/cf9 0 2024-04-26T21:26:09.203 INFO:tasks.workunit.client.0.smithi084.stdout:3/737: mkdir d1/d2c/d2f/d31/d55/d4e/d106 0 2024-04-26T21:26:09.211 INFO:tasks.workunit.client.1.smithi120.stdout:6/954: read d4/db/d10/d1a/d2b/d57/d67/f66 [22472,94892] 0 2024-04-26T21:26:09.213 INFO:tasks.workunit.client.0.smithi084.stdout:3/738: creat d1/d2c/f107 x:0 0 0 2024-04-26T21:26:09.214 INFO:tasks.workunit.client.1.smithi120.stdout:8/913: dread d5/d6/d11/d32/d3b/f98 [0,4194304] 0 2024-04-26T21:26:09.214 INFO:tasks.workunit.client.1.smithi120.stdout:5/946: write d2/d30/d93/d107/d36/d44/d6c/f12c [154346,123294] 0 2024-04-26T21:26:09.214 INFO:tasks.workunit.client.0.smithi084.stdout:0/739: creat de/d2b/d45/fe8 x:0 0 0 2024-04-26T21:26:09.216 INFO:tasks.workunit.client.0.smithi084.stdout:9/638: write da/dd5/d93/dc3/f3c [946247,59103] 0 2024-04-26T21:26:09.219 INFO:tasks.workunit.client.1.smithi120.stdout:6/955: read - d4/db/d10/dd/d28/d9e/daf/dd3/f13a zero size 2024-04-26T21:26:09.219 INFO:tasks.workunit.client.1.smithi120.stdout:7/933: dread d7/d10/fe7 [0,4194304] 0 2024-04-26T21:26:09.219 INFO:tasks.workunit.client.1.smithi120.stdout:3/955: rename dd/de/d83/d64/cc0 to dd/d2a/d74/d12b/c136 0 2024-04-26T21:26:09.220 INFO:tasks.workunit.client.0.smithi084.stdout:2/853: rename d6/d7/d3d/d15/d1f/d39/d20/d45/c5f to d6/d7/d3d/d79/d81/d82/c11e 0 2024-04-26T21:26:09.224 INFO:tasks.workunit.client.1.smithi120.stdout:9/884: link d0/d6/d4d/l5a d0/dd/d3a/dae/ded/d111/l127 0 2024-04-26T21:26:09.225 INFO:tasks.workunit.client.0.smithi084.stdout:5/724: dread d0/dc/df/d31/f54 [0,4194304] 0 2024-04-26T21:26:09.226 INFO:tasks.workunit.client.0.smithi084.stdout:8/733: dread d4/d7/d15/d37/d52/f67 [0,4194304] 0 2024-04-26T21:26:09.230 INFO:tasks.workunit.client.0.smithi084.stdout:3/739: mknod d1/d2c/d2f/d31/c108 0 2024-04-26T21:26:09.234 INFO:tasks.workunit.client.0.smithi084.stdout:5/725: stat d0/dc/df/d75/fba 0 2024-04-26T21:26:09.235 INFO:tasks.workunit.client.0.smithi084.stdout:2/854: rename d6/d7/d3d/d15/d1f/d22/d99/lb0 to d6/d7/d3d/d15/d1f/d22/dd4/l11f 0 2024-04-26T21:26:09.235 INFO:tasks.workunit.client.0.smithi084.stdout:3/740: chown d1/d24/d27/d3a/ddb/fdc 245737 1 2024-04-26T21:26:09.236 INFO:tasks.workunit.client.1.smithi120.stdout:1/856: dwrite d6/dcc/fd2 [0,4194304] 0 2024-04-26T21:26:09.236 INFO:tasks.workunit.client.1.smithi120.stdout:4/949: rmdir d10/d12/d138 0 2024-04-26T21:26:09.236 INFO:tasks.workunit.client.1.smithi120.stdout:9/885: creat d0/dd/d3a/de8/f128 x:0 0 0 2024-04-26T21:26:09.237 INFO:tasks.workunit.client.1.smithi120.stdout:8/914: dread d5/d6/d11/d32/d3b/f98 [0,4194304] 0 2024-04-26T21:26:09.241 INFO:tasks.workunit.client.1.smithi120.stdout:4/950: chown d10/d28/f4b 401 1 2024-04-26T21:26:09.242 INFO:tasks.workunit.client.0.smithi084.stdout:5/726: creat d0/dc/df/d31/d53/d87/fe0 x:0 0 0 2024-04-26T21:26:09.243 INFO:tasks.workunit.client.0.smithi084.stdout:3/741: readlink d1/d2c/d2f/d31/d52/l75 0 2024-04-26T21:26:09.244 INFO:tasks.workunit.client.0.smithi084.stdout:8/734: creat d4/d6/db/fdb x:0 0 0 2024-04-26T21:26:09.246 INFO:tasks.workunit.client.1.smithi120.stdout:8/915: write d5/d6/d11/d32/d3b/d105/f106 [4157382,61070] 0 2024-04-26T21:26:09.248 INFO:tasks.workunit.client.0.smithi084.stdout:2/855: truncate d6/d7/d3d/d15/d1f/d39/fa6 2111308 0 2024-04-26T21:26:09.249 INFO:tasks.workunit.client.1.smithi120.stdout:1/857: creat d6/d9/f11d x:0 0 0 2024-04-26T21:26:09.254 INFO:tasks.workunit.client.1.smithi120.stdout:9/886: creat d0/dd/d45/f129 x:0 0 0 2024-04-26T21:26:09.255 INFO:tasks.workunit.client.0.smithi084.stdout:4/685: sync 2024-04-26T21:26:09.255 INFO:tasks.workunit.client.0.smithi084.stdout:1/739: dread d2/d54/d5e/d66/d2a/d72/f82 [0,4194304] 0 2024-04-26T21:26:09.260 INFO:tasks.workunit.client.1.smithi120.stdout:8/916: symlink d5/d6/d34/d42/d4a/dbf/d10f/l133 0 2024-04-26T21:26:09.260 INFO:tasks.workunit.client.0.smithi084.stdout:6/712: dread d3/de/f63 [0,4194304] 0 2024-04-26T21:26:09.261 INFO:tasks.workunit.client.1.smithi120.stdout:4/951: dread d10/fe0 [0,4194304] 0 2024-04-26T21:26:09.262 INFO:tasks.workunit.client.1.smithi120.stdout:4/952: fsync d10/d12/f35 0 2024-04-26T21:26:09.264 INFO:tasks.workunit.client.1.smithi120.stdout:7/934: dread d7/d10/d97/fd3 [0,4194304] 0 2024-04-26T21:26:09.264 INFO:tasks.workunit.client.1.smithi120.stdout:4/953: fdatasync d10/d28/f56 0 2024-04-26T21:26:09.265 INFO:tasks.workunit.client.1.smithi120.stdout:7/935: stat d7/ff 0 2024-04-26T21:26:09.265 INFO:tasks.workunit.client.1.smithi120.stdout:5/947: write d2/dc/ffd [798434,12036] 0 2024-04-26T21:26:09.267 INFO:tasks.workunit.client.1.smithi120.stdout:6/956: getdents d4/db/d25/d6d/dbd 0 2024-04-26T21:26:09.267 INFO:tasks.workunit.client.0.smithi084.stdout:8/735: symlink d4/d6/db/d9b/dd4/ldc 0 2024-04-26T21:26:09.272 INFO:tasks.workunit.client.1.smithi120.stdout:1/858: symlink d6/d9/dd4/de0/d2d/d98/l11e 0 2024-04-26T21:26:09.274 INFO:tasks.workunit.client.1.smithi120.stdout:3/956: dread dd/de/df/db6/f59 [0,4194304] 0 2024-04-26T21:26:09.276 INFO:tasks.workunit.client.0.smithi084.stdout:7/775: dwrite d6/d9/d12/d8b/f6a [0,4194304] 0 2024-04-26T21:26:09.276 INFO:tasks.workunit.client.1.smithi120.stdout:1/859: chown d6/d9/dd4/de0/d1d/d5d 4255468 1 2024-04-26T21:26:09.276 INFO:tasks.workunit.client.1.smithi120.stdout:3/957: stat dd/de/df/dda/d24/f5a 0 2024-04-26T21:26:09.281 INFO:tasks.workunit.client.0.smithi084.stdout:5/727: getdents d0/dc/df/d31/d63/d6e 0 2024-04-26T21:26:09.281 INFO:tasks.workunit.client.0.smithi084.stdout:7/776: chown d6/d9/d96/d106 374 1 2024-04-26T21:26:09.281 INFO:tasks.workunit.client.1.smithi120.stdout:3/958: write dd/de/d83/d64/f104 [1493504,9393] 0 2024-04-26T21:26:09.283 INFO:tasks.workunit.client.1.smithi120.stdout:8/917: getdents d5/d6/d34/d42/d4a/deb/d122 0 2024-04-26T21:26:09.287 INFO:tasks.workunit.client.0.smithi084.stdout:3/742: link d1/d2c/d2f/d31/d55/d4e/f73 d1/d24/d27/d3a/ddb/d103/f109 0 2024-04-26T21:26:09.287 INFO:tasks.workunit.client.0.smithi084.stdout:1/740: write d2/d54/d5e/d66/f2b [1292406,113794] 0 2024-04-26T21:26:09.289 INFO:tasks.workunit.client.0.smithi084.stdout:3/743: dread - d1/d2c/f100 zero size 2024-04-26T21:26:09.289 INFO:tasks.workunit.client.1.smithi120.stdout:5/948: dwrite d2/d30/d93/d107/d36/f40 [0,4194304] 0 2024-04-26T21:26:09.290 INFO:tasks.workunit.client.0.smithi084.stdout:0/740: dread de/d2b/f43 [0,4194304] 0 2024-04-26T21:26:09.290 INFO:tasks.workunit.client.1.smithi120.stdout:6/957: mkdir d4/db/d10/d22/d56/d9c/d13c 0 2024-04-26T21:26:09.291 INFO:tasks.workunit.client.0.smithi084.stdout:9/639: dwrite da/dd5/d93/dc3/f52 [0,4194304] 0 2024-04-26T21:26:09.292 INFO:tasks.workunit.client.0.smithi084.stdout:8/736: rename d4/d7/d15/d3c/f4b to d4/d7/d53/fdd 0 2024-04-26T21:26:09.298 INFO:tasks.workunit.client.1.smithi120.stdout:9/887: getdents d0/d6 0 2024-04-26T21:26:09.298 INFO:tasks.workunit.client.0.smithi084.stdout:8/737: write d4/f13 [821384,51881] 0 2024-04-26T21:26:09.300 INFO:tasks.workunit.client.0.smithi084.stdout:5/728: mkdir d0/dc/df/d31/d53/de1 0 2024-04-26T21:26:09.305 INFO:tasks.workunit.client.0.smithi084.stdout:3/744: truncate d1/d2c/d2f/d31/d55/f9b 1562705 0 2024-04-26T21:26:09.307 INFO:tasks.workunit.client.1.smithi120.stdout:8/918: dwrite d5/d6/d11/f6b [4194304,4194304] 0 2024-04-26T21:26:09.308 INFO:tasks.workunit.client.0.smithi084.stdout:3/745: stat d1/d24/d27/c85 0 2024-04-26T21:26:09.310 INFO:tasks.workunit.client.0.smithi084.stdout:7/777: rename d6/d9/d12/d19/f49 to d6/d9/d89/f10f 0 2024-04-26T21:26:09.310 INFO:tasks.workunit.client.1.smithi120.stdout:1/860: write d6/d9/dd4/de0/d1b/f3d [1846564,15474] 0 2024-04-26T21:26:09.311 INFO:tasks.workunit.client.1.smithi120.stdout:6/958: truncate d4/db/d10/dd/d28/f89 4227314 0 2024-04-26T21:26:09.313 INFO:tasks.workunit.client.0.smithi084.stdout:5/729: unlink d0/dc/df/d2a/f40 0 2024-04-26T21:26:09.315 INFO:tasks.workunit.client.1.smithi120.stdout:3/959: dwrite dd/de/d83/d64/f104 [0,4194304] 0 2024-04-26T21:26:09.315 INFO:tasks.workunit.client.0.smithi084.stdout:2/856: dread d6/d1b/f98 [0,4194304] 0 2024-04-26T21:26:09.316 INFO:tasks.workunit.client.0.smithi084.stdout:8/738: symlink d4/d7/d15/lde 0 2024-04-26T21:26:09.317 INFO:tasks.workunit.client.1.smithi120.stdout:5/949: rename d2/d30/ca8 to d2/dc/d1d/d21/c156 0 2024-04-26T21:26:09.319 INFO:tasks.workunit.client.1.smithi120.stdout:6/959: chown d4/db/d25/d6d/dbd/lb7 293063411 1 2024-04-26T21:26:09.321 INFO:tasks.workunit.client.0.smithi084.stdout:4/686: dread d5/d2e/d5f/f4b [0,4194304] 0 2024-04-26T21:26:09.325 INFO:tasks.workunit.client.0.smithi084.stdout:3/746: write d1/d2c/d2f/d31/d55/d4e/d7c/fca [209013,83657] 0 2024-04-26T21:26:09.325 INFO:tasks.workunit.client.0.smithi084.stdout:5/730: chown d0/dc/df/f9e 20718 1 2024-04-26T21:26:09.325 INFO:tasks.workunit.client.0.smithi084.stdout:7/778: rmdir d6/de7 0 2024-04-26T21:26:09.327 INFO:tasks.workunit.client.0.smithi084.stdout:6/713: dwrite d3/de/d15/d23/f30 [0,4194304] 0 2024-04-26T21:26:09.328 INFO:tasks.workunit.client.1.smithi120.stdout:4/954: dwrite d10/d12/f2c [0,4194304] 0 2024-04-26T21:26:09.328 INFO:tasks.workunit.client.0.smithi084.stdout:8/739: symlink d4/d6/db/d9b/ldf 0 2024-04-26T21:26:09.328 INFO:tasks.workunit.client.0.smithi084.stdout:5/731: chown d0/d17/fae 38933694 1 2024-04-26T21:26:09.331 INFO:tasks.workunit.client.0.smithi084.stdout:9/640: rename da/de/d1e/d56/f5c to da/de/d16/fea 0 2024-04-26T21:26:09.337 INFO:tasks.workunit.client.1.smithi120.stdout:4/955: symlink d10/d6b/d71/dd7/l146 0 2024-04-26T21:26:09.337 INFO:tasks.workunit.client.1.smithi120.stdout:9/888: write d0/d6/d4d/d65/dec/d77/d9a/fe4 [803543,8645] 0 2024-04-26T21:26:09.339 INFO:tasks.workunit.client.0.smithi084.stdout:9/641: chown da/de/c53 2 1 2024-04-26T21:26:09.341 INFO:tasks.workunit.client.0.smithi084.stdout:4/687: creat d5/d25/fdd x:0 0 0 2024-04-26T21:26:09.341 INFO:tasks.workunit.client.0.smithi084.stdout:2/857: chown d6/d7/d3d/d15/d1f/d39/d20/d45/f60 4569 1 2024-04-26T21:26:09.341 INFO:tasks.workunit.client.0.smithi084.stdout:7/779: write d6/d1c/fe4 [921082,55324] 0 2024-04-26T21:26:09.344 INFO:tasks.workunit.client.1.smithi120.stdout:5/950: rename d2/dc/d1d/d21/d77/d79/db7/f99 to d2/d10e/d63/f157 0 2024-04-26T21:26:09.344 INFO:tasks.workunit.client.1.smithi120.stdout:4/956: write d10/d12/f40 [2016943,10056] 0 2024-04-26T21:26:09.345 INFO:tasks.workunit.client.0.smithi084.stdout:1/741: dwrite d2/d54/d5e/d66/d2a/d2c/d75/f7d [0,4194304] 0 2024-04-26T21:26:09.346 INFO:tasks.workunit.client.0.smithi084.stdout:8/740: rename d4/d7/d15/d37/d3b/f89 to d4/d7/d15/d37/d52/fe0 0 2024-04-26T21:26:09.353 INFO:tasks.workunit.client.0.smithi084.stdout:5/732: creat d0/dc/df/d6d/fe2 x:0 0 0 2024-04-26T21:26:09.354 INFO:tasks.workunit.client.0.smithi084.stdout:3/747: mknod d1/d2c/d2f/d31/da8/c10a 0 2024-04-26T21:26:09.356 INFO:tasks.workunit.client.0.smithi084.stdout:4/688: mknod d5/d10/da1/cde 0 2024-04-26T21:26:09.358 INFO:tasks.workunit.client.1.smithi120.stdout:1/861: dwrite d6/d9/dd4/de0/d1b/d3b/fed [0,4194304] 0 2024-04-26T21:26:09.360 INFO:tasks.workunit.client.0.smithi084.stdout:2/858: readlink d6/d7/d3d/d15/d1f/d39/d43/lb9 0 2024-04-26T21:26:09.360 INFO:tasks.workunit.client.0.smithi084.stdout:9/642: creat da/de/d16/d40/feb x:0 0 0 2024-04-26T21:26:09.362 INFO:tasks.workunit.client.1.smithi120.stdout:5/951: mknod d2/dc/d1d/d21/d66/d6a/d8c/daa/d14d/c158 0 2024-04-26T21:26:09.364 INFO:tasks.workunit.client.0.smithi084.stdout:0/741: write de/d2b/d45/d63/f86 [1544468,108813] 0 2024-04-26T21:26:09.364 INFO:tasks.workunit.client.0.smithi084.stdout:9/643: fdatasync da/de/d16/f57 0 2024-04-26T21:26:09.365 INFO:tasks.workunit.client.0.smithi084.stdout:0/742: stat f0 0 2024-04-26T21:26:09.366 INFO:tasks.workunit.client.1.smithi120.stdout:6/960: dread d4/db/d10/dd/d4e/d60/fb1 [0,4194304] 0 2024-04-26T21:26:09.367 INFO:tasks.workunit.client.0.smithi084.stdout:6/714: dwrite d3/de/d15/fc9 [0,4194304] 0 2024-04-26T21:26:09.368 INFO:tasks.workunit.client.1.smithi120.stdout:4/957: getdents d10/d28/dd9/ddd/dee/dd0/dd4/d86/dfa/dfe 0 2024-04-26T21:26:09.369 INFO:tasks.workunit.client.1.smithi120.stdout:3/960: dwrite dd/de/d83/f106 [0,4194304] 0 2024-04-26T21:26:09.371 INFO:tasks.workunit.client.0.smithi084.stdout:5/733: creat d0/dc/df/d6d/fe3 x:0 0 0 2024-04-26T21:26:09.373 INFO:tasks.workunit.client.0.smithi084.stdout:9/644: chown da/dd5/d93/dc3/d41/d43/le2 65188 1 2024-04-26T21:26:09.379 INFO:tasks.workunit.client.1.smithi120.stdout:5/952: chown d2/d1b/d89/d47/d8a/fcf 1 1 2024-04-26T21:26:09.381 INFO:tasks.workunit.client.1.smithi120.stdout:4/958: stat d10/d28/dd9/ddd/dee/cf7 0 2024-04-26T21:26:09.382 INFO:tasks.workunit.client.1.smithi120.stdout:1/862: link d6/d14/c39 d6/d9/dd4/de0/d1d/d5d/df2/c11f 0 2024-04-26T21:26:09.383 INFO:tasks.workunit.client.0.smithi084.stdout:3/748: symlink d1/d2c/d2f/d31/da8/l10b 0 2024-04-26T21:26:09.385 INFO:tasks.workunit.client.0.smithi084.stdout:4/689: truncate d5/fe 399014 0 2024-04-26T21:26:09.386 INFO:tasks.workunit.client.0.smithi084.stdout:6/715: mkdir d3/de/d41/de6 0 2024-04-26T21:26:09.389 INFO:tasks.workunit.client.1.smithi120.stdout:4/959: unlink d10/da6/c111 0 2024-04-26T21:26:09.390 INFO:tasks.workunit.client.0.smithi084.stdout:3/749: readlink d1/d2c/l79 0 2024-04-26T21:26:09.390 INFO:tasks.workunit.client.1.smithi120.stdout:3/961: dread - dd/de/df/dda/d24/db1/d76/d3b/d56/d75/f12d zero size 2024-04-26T21:26:09.390 INFO:tasks.workunit.client.1.smithi120.stdout:3/962: chown dd/d2a/d74/d12b/l116 7151 1 2024-04-26T21:26:09.392 INFO:tasks.workunit.client.1.smithi120.stdout:1/863: mkdir d6/d9/dd4/de0/d1b/d3b/d6d/d120 0 2024-04-26T21:26:09.395 INFO:tasks.workunit.client.1.smithi120.stdout:4/960: creat d10/d28/dd9/ddd/dee/dd0/dd4/d86/dfa/dfe/d12a/f147 x:0 0 0 2024-04-26T21:26:09.399 INFO:tasks.workunit.client.1.smithi120.stdout:6/961: getdents d4/db/d10/dd/d28/d9e/daf/dd3 0 2024-04-26T21:26:09.399 INFO:tasks.workunit.client.1.smithi120.stdout:4/961: chown d10/d28/l63 5811332 1 2024-04-26T21:26:09.400 INFO:tasks.workunit.client.0.smithi084.stdout:2/859: dwrite d6/d7/d3d/d15/ff9 [0,4194304] 0 2024-04-26T21:26:09.400 INFO:tasks.workunit.client.0.smithi084.stdout:0/743: dwrite de/d2b/d45/d63/da7/fca [0,4194304] 0 2024-04-26T21:26:09.401 INFO:tasks.workunit.client.1.smithi120.stdout:1/864: chown d6/d14/c39 76233017 1 2024-04-26T21:26:09.404 INFO:tasks.workunit.client.0.smithi084.stdout:4/690: symlink d5/d7/d65/d7f/db8/ldf 0 2024-04-26T21:26:09.406 INFO:tasks.workunit.client.0.smithi084.stdout:8/741: dread d4/d6/db/d1e/d22/f5d [0,4194304] 0 2024-04-26T21:26:09.407 INFO:tasks.workunit.client.1.smithi120.stdout:9/889: dwrite d0/d6/d4d/d65/dec/f8c [0,4194304] 0 2024-04-26T21:26:09.408 INFO:tasks.workunit.client.0.smithi084.stdout:3/750: mkdir d1/d2c/d2f/d31/d55/d4e/d10c 0 2024-04-26T21:26:09.410 INFO:tasks.workunit.client.1.smithi120.stdout:1/865: dread - d6/d9/dd4/de0/d2d/d48/d86/dc1/fbd zero size 2024-04-26T21:26:09.414 INFO:tasks.workunit.client.0.smithi084.stdout:9/645: dwrite da/dd5/d93/dc3/d41/d43/d48/f58 [0,4194304] 0 2024-04-26T21:26:09.415 INFO:tasks.workunit.client.0.smithi084.stdout:9/646: fdatasync da/db3/fd8 0 2024-04-26T21:26:09.416 INFO:tasks.workunit.client.1.smithi120.stdout:1/866: write d6/d9/dd4/de0/d1b/d55/fa1 [134026,44735] 0 2024-04-26T21:26:09.419 INFO:tasks.workunit.client.0.smithi084.stdout:8/742: stat d4/d6/db/d9b/cda 0 2024-04-26T21:26:09.419 INFO:tasks.workunit.client.1.smithi120.stdout:9/890: symlink d0/dd/d3a/dae/l12a 0 2024-04-26T21:26:09.420 INFO:tasks.workunit.client.1.smithi120.stdout:3/963: write dd/de/df/d12/d48/f55 [2010362,17916] 0 2024-04-26T21:26:09.420 INFO:tasks.workunit.client.0.smithi084.stdout:3/751: symlink d1/d2c/d2f/d31/dc7/l10d 0 2024-04-26T21:26:09.424 INFO:tasks.workunit.client.0.smithi084.stdout:5/734: link d0/f4b d0/dc/df/d75/fe4 0 2024-04-26T21:26:09.425 INFO:tasks.workunit.client.1.smithi120.stdout:1/867: rmdir d6/d9/dd4/de0/d85/dfb 39 2024-04-26T21:26:09.426 INFO:tasks.workunit.client.0.smithi084.stdout:7/780: truncate d6/d9/d12/d8b/f10b 3373521 0 2024-04-26T21:26:09.427 INFO:tasks.workunit.client.0.smithi084.stdout:4/691: mknod d5/d10/d82/dd9/ce0 0 2024-04-26T21:26:09.430 INFO:tasks.workunit.client.0.smithi084.stdout:5/735: write d0/dc/df/d6d/fe2 [908819,21194] 0 2024-04-26T21:26:09.433 INFO:tasks.workunit.client.1.smithi120.stdout:9/891: truncate d0/d6/d4d/d65/dec/d2d/f91 542923 0 2024-04-26T21:26:09.435 INFO:tasks.workunit.client.0.smithi084.stdout:7/781: mkdir d6/d68/d7f/d107/d84/d110 0 2024-04-26T21:26:09.437 INFO:tasks.workunit.client.1.smithi120.stdout:1/868: creat d6/d14/f121 x:0 0 0 2024-04-26T21:26:09.439 INFO:tasks.workunit.client.0.smithi084.stdout:4/692: unlink d5/d10/d15/f40 0 2024-04-26T21:26:09.440 INFO:tasks.workunit.client.0.smithi084.stdout:9/647: link da/dd5/d93/dc3/d41/d43/d48/d61/d81/ce3 da/dd5/db6/cec 0 2024-04-26T21:26:09.444 INFO:tasks.workunit.client.0.smithi084.stdout:3/752: dread d1/d2c/d2f/d31/d55/d4e/d98/fec [0,4194304] 0 2024-04-26T21:26:09.445 INFO:tasks.workunit.client.1.smithi120.stdout:1/869: mknod d6/d9/dd4/de0/d2d/d98/d56/dad/c122 0 2024-04-26T21:26:09.447 INFO:tasks.workunit.client.0.smithi084.stdout:7/782: mkdir d6/d1c/d51/d111 0 2024-04-26T21:26:09.447 INFO:tasks.workunit.client.0.smithi084.stdout:8/743: dread d4/d6/db/d1e/d22/d39/f93 [0,4194304] 0 2024-04-26T21:26:09.447 INFO:tasks.workunit.client.0.smithi084.stdout:2/860: dwrite d6/d7/d3d/d15/d1f/d22/de6/ffd [0,4194304] 0 2024-04-26T21:26:09.448 INFO:tasks.workunit.client.1.smithi120.stdout:1/870: dread - d6/d9/dd4/f100 zero size 2024-04-26T21:26:09.448 INFO:tasks.workunit.client.1.smithi120.stdout:4/962: dwrite d10/d28/dd9/ddd/dee/dd0/dd4/d86/f99 [0,4194304] 0 2024-04-26T21:26:09.450 INFO:tasks.workunit.client.1.smithi120.stdout:6/962: write d4/db/d10/d1a/d2b/d57/fe6 [767170,117172] 0 2024-04-26T21:26:09.451 INFO:tasks.workunit.client.0.smithi084.stdout:4/693: fsync d5/d7/d65/d90/d91/dba/fd6 0 2024-04-26T21:26:09.452 INFO:tasks.workunit.client.0.smithi084.stdout:9/648: mknod da/dd5/d93/dc3/d41/dab/ced 0 2024-04-26T21:26:09.454 INFO:tasks.workunit.client.1.smithi120.stdout:6/963: write d4/d3d/dd1/ff7 [3773546,28885] 0 2024-04-26T21:26:09.456 INFO:tasks.workunit.client.0.smithi084.stdout:2/861: chown d6/d7/d3d/d15/d1f/d22/d99/c109 2239 1 2024-04-26T21:26:09.456 INFO:tasks.workunit.client.0.smithi084.stdout:9/649: fsync da/de/d16/f57 0 2024-04-26T21:26:09.459 INFO:tasks.workunit.client.0.smithi084.stdout:8/744: symlink d4/d6/db/d1e/d7c/le1 0 2024-04-26T21:26:09.460 INFO:tasks.workunit.client.1.smithi120.stdout:9/892: write d0/d6/d3d/f7b [532767,64741] 0 2024-04-26T21:26:09.462 INFO:tasks.workunit.client.1.smithi120.stdout:6/964: mknod d4/db/d25/d6d/d97/dc8/c13d 0 2024-04-26T21:26:09.462 INFO:tasks.workunit.client.1.smithi120.stdout:4/963: read d10/d28/f31 [1311845,10655] 0 2024-04-26T21:26:09.464 INFO:tasks.workunit.client.0.smithi084.stdout:8/745: write d4/d7/d15/fc7 [15647,745] 0 2024-04-26T21:26:09.465 INFO:tasks.workunit.client.0.smithi084.stdout:6/716: dread d3/de/d15/d23/d90/da2/fd7 [0,4194304] 0 2024-04-26T21:26:09.466 INFO:tasks.workunit.client.1.smithi120.stdout:5/953: dread d2/d30/d93/d107/d36/d44/d6c/f2a [0,4194304] 0 2024-04-26T21:26:09.466 INFO:tasks.workunit.client.1.smithi120.stdout:1/871: rename d6/d9/dd4/de0/d2d/d48/d86/fa7 to d6/d9/dd4/de0/d2d/d48/f123 0 2024-04-26T21:26:09.469 INFO:tasks.workunit.client.0.smithi084.stdout:7/783: rename d6/d9/d89 to d6/d9/d12/d19/d20/d38/d112 0 2024-04-26T21:26:09.471 INFO:tasks.workunit.client.1.smithi120.stdout:1/872: unlink d6/daa/dae/ca9 0 2024-04-26T21:26:09.471 INFO:tasks.workunit.client.1.smithi120.stdout:6/965: chown d4/db/d10/d1a/d2b/d57/d67/f4a 20893317 1 2024-04-26T21:26:09.472 INFO:tasks.workunit.client.1.smithi120.stdout:4/964: mkdir d10/d12/da1/d10e/d148 0 2024-04-26T21:26:09.473 INFO:tasks.workunit.client.1.smithi120.stdout:2/928: sync 2024-04-26T21:26:09.478 INFO:tasks.workunit.client.0.smithi084.stdout:2/862: symlink d6/d7/d3d/d15/d1f/d41/l120 0 2024-04-26T21:26:09.479 INFO:tasks.workunit.client.1.smithi120.stdout:4/965: stat d10/d28/dd9 0 2024-04-26T21:26:09.482 INFO:tasks.workunit.client.0.smithi084.stdout:8/746: mkdir d4/d6/db/d9b/dd4/de2 0 2024-04-26T21:26:09.482 INFO:tasks.workunit.client.1.smithi120.stdout:3/964: dwrite dd/de/df/dda/d24/db1/d76/d3b/d56/fb5 [0,4194304] 0 2024-04-26T21:26:09.482 INFO:tasks.workunit.client.1.smithi120.stdout:5/954: write d2/d30/d93/d107/d36/d44/f105 [247577,81334] 0 2024-04-26T21:26:09.486 INFO:tasks.workunit.client.1.smithi120.stdout:6/966: symlink d4/db/d25/d6d/dbd/l13e 0 2024-04-26T21:26:09.488 INFO:tasks.workunit.client.1.smithi120.stdout:1/873: rename d6/d9/lb3 to d6/d9/dd4/de0/d1b/d89/l124 0 2024-04-26T21:26:09.489 INFO:tasks.workunit.client.0.smithi084.stdout:4/694: unlink d5/d10/d82/cb9 0 2024-04-26T21:26:09.490 INFO:tasks.workunit.client.1.smithi120.stdout:4/966: creat d10/d28/dd9/ddd/dee/dd0/dd4/d86/dfa/f149 x:0 0 0 2024-04-26T21:26:09.494 INFO:tasks.workunit.client.0.smithi084.stdout:7/784: truncate d6/d68/d7f/fbc 1588881 0 2024-04-26T21:26:09.495 INFO:tasks.workunit.client.1.smithi120.stdout:1/874: dread - d6/d9/dd4/de0/d2d/d98/d56/ff0 zero size 2024-04-26T21:26:09.495 INFO:tasks.workunit.client.1.smithi120.stdout:6/967: chown d4/db/d10/d1a/d2b/d57/d67/dbc/dce/d101 1 1 2024-04-26T21:26:09.495 INFO:tasks.workunit.client.1.smithi120.stdout:4/967: fsync d10/d28/f3e 0 2024-04-26T21:26:09.497 INFO:tasks.workunit.client.1.smithi120.stdout:6/968: chown d4/db/d25/d6d/dbd/lb7 1701 1 2024-04-26T21:26:09.498 INFO:tasks.workunit.client.0.smithi084.stdout:6/717: unlink d3/de/d41/f52 0 2024-04-26T21:26:09.501 INFO:tasks.workunit.client.0.smithi084.stdout:0/744: dread de/f12 [4194304,4194304] 0 2024-04-26T21:26:09.503 INFO:tasks.workunit.client.0.smithi084.stdout:4/695: read d5/d10/d15/d21/f7b [1061807,46003] 0 2024-04-26T21:26:09.503 INFO:tasks.workunit.client.0.smithi084.stdout:2/863: creat d6/d7/d3d/d4f/de8/f121 x:0 0 0 2024-04-26T21:26:09.505 INFO:tasks.workunit.client.0.smithi084.stdout:2/864: stat d6/d7/d3d/fc2 0 2024-04-26T21:26:09.506 INFO:tasks.workunit.client.1.smithi120.stdout:4/968: truncate d10/d6b/f6e 972939 0 2024-04-26T21:26:09.506 INFO:tasks.workunit.client.0.smithi084.stdout:3/753: truncate d1/d24/d27/f30 13530 0 2024-04-26T21:26:09.508 INFO:tasks.workunit.client.0.smithi084.stdout:9/650: getdents da/d9e 0 2024-04-26T21:26:09.508 INFO:tasks.workunit.client.1.smithi120.stdout:1/875: rmdir d6/d9/dd4/de0/d1d/d5d/dde/df1 0 2024-04-26T21:26:09.511 INFO:tasks.workunit.client.0.smithi084.stdout:8/747: dwrite d4/d6/db/d1e/d22/d96/f9f [0,4194304] 0 2024-04-26T21:26:09.511 INFO:tasks.workunit.client.1.smithi120.stdout:9/893: dwrite d0/d6/d3d/fd3 [0,4194304] 0 2024-04-26T21:26:09.512 INFO:tasks.workunit.client.1.smithi120.stdout:4/969: fsync d10/d28/dd9/f100 0 2024-04-26T21:26:09.512 INFO:tasks.workunit.client.0.smithi084.stdout:0/745: truncate de/d2b/fa2 82128 0 2024-04-26T21:26:09.513 INFO:tasks.workunit.client.0.smithi084.stdout:9/651: write da/de/d16/d40/fda [645913,107515] 0 2024-04-26T21:26:09.516 INFO:tasks.workunit.client.1.smithi120.stdout:9/894: chown d0/d6/f76 62268 1 2024-04-26T21:26:09.517 INFO:tasks.workunit.client.1.smithi120.stdout:1/876: write d6/d9/dd4/de0/d1d/d5d/feb [1631139,91851] 0 2024-04-26T21:26:09.517 INFO:tasks.workunit.client.0.smithi084.stdout:9/652: fdatasync da/de/d1e/dc9/fdc 0 2024-04-26T21:26:09.518 INFO:tasks.workunit.client.0.smithi084.stdout:3/754: creat d1/d2c/d2f/d31/d55/d4e/d7c/db1/f10e x:0 0 0 2024-04-26T21:26:09.519 INFO:tasks.workunit.client.1.smithi120.stdout:2/929: dwrite d4/d1b/d2e/fa7 [4194304,4194304] 0 2024-04-26T21:26:09.523 INFO:tasks.workunit.client.0.smithi084.stdout:0/746: unlink de/d20/d4c/dae/fdf 0 2024-04-26T21:26:09.524 INFO:tasks.workunit.client.1.smithi120.stdout:4/970: chown d10/d28/dd9/ddd/dee/dd0/dd4/l133 356313 1 2024-04-26T21:26:09.527 INFO:tasks.workunit.client.1.smithi120.stdout:2/930: creat d4/d1b/d5c/d99/df7/f139 x:0 0 0 2024-04-26T21:26:09.529 INFO:tasks.workunit.client.0.smithi084.stdout:9/653: mknod da/dd5/d93/dc3/d41/de4/cee 0 2024-04-26T21:26:09.529 INFO:tasks.workunit.client.1.smithi120.stdout:9/895: mkdir d0/d6/d4d/d65/dec/d77/d9a/d12b 0 2024-04-26T21:26:09.529 INFO:tasks.workunit.client.1.smithi120.stdout:5/955: dwrite d2/d30/d3b/f71 [0,4194304] 0 2024-04-26T21:26:09.529 INFO:tasks.workunit.client.0.smithi084.stdout:6/718: getdents d3/d6c 0 2024-04-26T21:26:09.531 INFO:tasks.workunit.client.0.smithi084.stdout:2/865: getdents d6/d7/d9f 0 2024-04-26T21:26:09.532 INFO:tasks.workunit.client.1.smithi120.stdout:5/956: read d2/d1b/dd2/deb/f149 [527207,105581] 0 2024-04-26T21:26:09.534 INFO:tasks.workunit.client.1.smithi120.stdout:5/957: fdatasync d2/d1b/d89/d14f/f132 0 2024-04-26T21:26:09.539 INFO:tasks.workunit.client.0.smithi084.stdout:0/747: mknod de/d71/ce9 0 2024-04-26T21:26:09.539 INFO:tasks.workunit.client.0.smithi084.stdout:8/748: creat d4/d6/db/d1e/d22/d39/d4a/da2/fe3 x:0 0 0 2024-04-26T21:26:09.539 INFO:tasks.workunit.client.0.smithi084.stdout:3/755: dread d1/d2c/d2f/d31/d55/f9b [0,4194304] 0 2024-04-26T21:26:09.540 INFO:tasks.workunit.client.0.smithi084.stdout:7/785: link d6/d9/d12/d19/d60/l88 d6/d9/d96/l113 0 2024-04-26T21:26:09.540 INFO:tasks.workunit.client.0.smithi084.stdout:2/866: dread - d6/d7/d3d/d79/d81/d82/da8/fc6 zero size 2024-04-26T21:26:09.542 INFO:tasks.workunit.client.0.smithi084.stdout:8/749: chown d4/d7/d15/fb7 2 1 2024-04-26T21:26:09.543 INFO:tasks.workunit.client.1.smithi120.stdout:5/958: creat d2/d82/d96/f159 x:0 0 0 2024-04-26T21:26:09.543 INFO:tasks.workunit.client.0.smithi084.stdout:4/696: getdents d5/d7/d65/d7f/db8 0 2024-04-26T21:26:09.544 INFO:tasks.workunit.client.0.smithi084.stdout:8/750: write d4/f4f [2005646,26927] 0 2024-04-26T21:26:09.546 INFO:tasks.workunit.client.0.smithi084.stdout:6/719: dread d3/de/f63 [0,4194304] 0 2024-04-26T21:26:09.547 INFO:tasks.workunit.client.0.smithi084.stdout:0/748: mkdir de/d78/d9e/da4/dea 0 2024-04-26T21:26:09.548 INFO:tasks.workunit.client.0.smithi084.stdout:6/720: stat d3/d18/d81/f8a 0 2024-04-26T21:26:09.549 INFO:tasks.workunit.client.1.smithi120.stdout:5/959: unlink d2/d30/d93/d107/d36/d44/d6c/c32 0 2024-04-26T21:26:09.550 INFO:tasks.workunit.client.0.smithi084.stdout:3/756: creat d1/d2c/d2f/d31/d3b/f10f x:0 0 0 2024-04-26T21:26:09.554 INFO:tasks.workunit.client.1.smithi120.stdout:5/960: mkdir d2/d1b/d89/d6b/d15a 0 2024-04-26T21:26:09.555 INFO:tasks.workunit.client.0.smithi084.stdout:8/751: rename d4/d6/db/d1e/c51 to d4/d3a/ce4 0 2024-04-26T21:26:09.559 INFO:tasks.workunit.client.1.smithi120.stdout:9/896: dwrite d0/d6/d4d/d65/dec/d2d/d4b/f8b [0,4194304] 0 2024-04-26T21:26:09.562 INFO:tasks.workunit.client.1.smithi120.stdout:9/897: write d0/f18 [2871137,91732] 0 2024-04-26T21:26:09.562 INFO:tasks.workunit.client.1.smithi120.stdout:6/969: dread d4/db/d10/dd/f90 [0,4194304] 0 2024-04-26T21:26:09.563 INFO:tasks.workunit.client.0.smithi084.stdout:0/749: rename de/d2b/d77/c3b to de/d78/d9e/da4/ceb 0 2024-04-26T21:26:09.563 INFO:tasks.workunit.client.0.smithi084.stdout:9/654: link da/dd5/d93/dc3/d41/dab/le8 da/dd5/d93/dc3/d41/d43/d48/dce/lef 0 2024-04-26T21:26:09.565 INFO:tasks.workunit.client.1.smithi120.stdout:9/898: symlink d0/dd/d3a/dae/l12c 0 2024-04-26T21:26:09.568 INFO:tasks.workunit.client.0.smithi084.stdout:3/757: mknod d1/d2c/d2f/d31/d55/c110 0 2024-04-26T21:26:09.570 INFO:tasks.workunit.client.0.smithi084.stdout:9/655: mkdir da/dd5/d93/dc3/d41/d43/d48/d61/df0 0 2024-04-26T21:26:09.573 INFO:tasks.workunit.client.1.smithi120.stdout:6/970: getdents d4/db/d25/d6d 0 2024-04-26T21:26:09.575 INFO:tasks.workunit.client.1.smithi120.stdout:2/931: write d4/d1b/d4f/f7c [834025,98896] 0 2024-04-26T21:26:09.575 INFO:tasks.workunit.client.1.smithi120.stdout:1/877: write d6/d9/dd4/de0/d2d/d48/d86/dc1/fbd [268507,68263] 0 2024-04-26T21:26:09.576 INFO:tasks.workunit.client.0.smithi084.stdout:9/656: dread - da/dd5/d93/dc3/d41/d43/d48/d61/fd2 zero size 2024-04-26T21:26:09.579 INFO:tasks.workunit.client.0.smithi084.stdout:9/657: mknod da/dd5/d93/dc3/d41/d43/d80/cf1 0 2024-04-26T21:26:09.580 INFO:tasks.workunit.client.1.smithi120.stdout:2/932: write d4/fd3 [543336,78997] 0 2024-04-26T21:26:09.582 INFO:tasks.workunit.client.1.smithi120.stdout:1/878: write d6/d14/d3c/f106 [585199,40558] 0 2024-04-26T21:26:09.582 INFO:tasks.workunit.client.0.smithi084.stdout:9/658: symlink da/db3/lf2 0 2024-04-26T21:26:09.583 INFO:tasks.workunit.client.0.smithi084.stdout:7/786: write d6/d26/d40/f66 [5026027,18612] 0 2024-04-26T21:26:09.587 INFO:tasks.workunit.client.0.smithi084.stdout:7/787: creat d6/d68/f114 x:0 0 0 2024-04-26T21:26:09.587 INFO:tasks.workunit.client.1.smithi120.stdout:1/879: chown d6/d9/dd4/de0/d1d/d5d/d67 7867275 1 2024-04-26T21:26:09.587 INFO:tasks.workunit.client.1.smithi120.stdout:4/971: dwrite d10/f6c [0,4194304] 0 2024-04-26T21:26:09.588 INFO:tasks.workunit.client.1.smithi120.stdout:2/933: unlink d4/d1b/d2e/d50/d14/ce5 0 2024-04-26T21:26:09.588 INFO:tasks.workunit.client.1.smithi120.stdout:6/971: dread d4/db/d10/d1a/d2b/d57/d67/dbc/dce/f12b [0,4194304] 0 2024-04-26T21:26:09.589 INFO:tasks.workunit.client.0.smithi084.stdout:9/659: rename da/de/f66 to da/dd5/d93/dc3/d41/d67/de9/ff3 0 2024-04-26T21:26:09.589 INFO:tasks.workunit.client.0.smithi084.stdout:7/788: readlink d6/d9/d12/d8b/d72/da0/le2 0 2024-04-26T21:26:09.592 INFO:tasks.workunit.client.1.smithi120.stdout:4/972: dread d10/d6b/da4/f12e [0,4194304] 0 2024-04-26T21:26:09.597 INFO:tasks.workunit.client.0.smithi084.stdout:9/660: rename da/dd5/d93/dc3/d41/d43/d48/l7d to da/dd5/d93/dc3/d41/d8d/dca/lf4 0 2024-04-26T21:26:09.597 INFO:tasks.workunit.client.1.smithi120.stdout:1/880: creat d6/d14/f125 x:0 0 0 2024-04-26T21:26:09.598 INFO:tasks.workunit.client.0.smithi084.stdout:9/661: chown da/de/ce1 52 1 2024-04-26T21:26:09.602 INFO:tasks.workunit.client.1.smithi120.stdout:5/961: dread d2/dc/d1d/d21/db2/fc7 [0,4194304] 0 2024-04-26T21:26:09.602 INFO:tasks.workunit.client.1.smithi120.stdout:1/881: mkdir d6/d9/dd4/de0/d2d/d126 0 2024-04-26T21:26:09.608 INFO:tasks.workunit.client.1.smithi120.stdout:5/962: link d2/d1b/d89/d47/d8a/fcf d2/dc/d1d/d21/d66/de5/f15b 0 2024-04-26T21:26:09.612 INFO:tasks.workunit.client.1.smithi120.stdout:5/963: fdatasync d2/dc/d1d/d21/d66/d85/fc5 0 2024-04-26T21:26:09.612 INFO:tasks.workunit.client.0.smithi084.stdout:9/662: dwrite da/de/d16/f30 [0,4194304] 0 2024-04-26T21:26:09.613 INFO:tasks.workunit.client.1.smithi120.stdout:6/972: write d4/db/d25/d6d/fb4 [975398,66782] 0 2024-04-26T21:26:09.614 INFO:tasks.workunit.client.1.smithi120.stdout:2/934: write d4/d1b/d2e/d50/d14/d15/f2b [1997176,59646] 0 2024-04-26T21:26:09.615 INFO:tasks.workunit.client.0.smithi084.stdout:9/663: readlink l8 0 2024-04-26T21:26:09.617 INFO:tasks.workunit.client.1.smithi120.stdout:4/973: write d10/d6b/fbb [4894680,126891] 0 2024-04-26T21:26:09.619 INFO:tasks.workunit.client.0.smithi084.stdout:9/664: readlink da/ld1 0 2024-04-26T21:26:09.619 INFO:tasks.workunit.client.1.smithi120.stdout:1/882: truncate d6/fc 3031754 0 2024-04-26T21:26:09.620 INFO:tasks.workunit.client.0.smithi084.stdout:1/742: sync 2024-04-26T21:26:09.622 INFO:tasks.workunit.client.1.smithi120.stdout:4/974: fdatasync d10/d28/f31 0 2024-04-26T21:26:09.622 INFO:tasks.workunit.client.0.smithi084.stdout:1/743: fdatasync d2/d9/fcd 0 2024-04-26T21:26:09.624 INFO:tasks.workunit.client.1.smithi120.stdout:7/936: sync 2024-04-26T21:26:09.625 INFO:tasks.workunit.client.0.smithi084.stdout:1/744: write d2/d54/d5e/fc3 [4725773,12427] 0 2024-04-26T21:26:09.627 INFO:tasks.workunit.client.1.smithi120.stdout:6/973: link d4/f31 d4/db/d10/dd/d28/d9e/daf/dd3/f13f 0 2024-04-26T21:26:09.627 INFO:tasks.workunit.client.1.smithi120.stdout:8/919: sync 2024-04-26T21:26:09.629 INFO:tasks.workunit.client.0.smithi084.stdout:9/665: rename da/dd5/d93/dc3/d41/d43/d48/d61/d81/fbf to da/de/d1e/d56/da6/de6/ff5 0 2024-04-26T21:26:09.629 INFO:tasks.workunit.client.1.smithi120.stdout:2/935: mknod d4/d1b/d25/d2c/d3e/d5e/d63/dcb/c13a 0 2024-04-26T21:26:09.629 INFO:tasks.workunit.client.1.smithi120.stdout:1/883: creat d6/d9/dd4/de0/d1b/d3b/d6d/d120/f127 x:0 0 0 2024-04-26T21:26:09.630 INFO:tasks.workunit.client.1.smithi120.stdout:8/920: chown d5/d6 4 1 2024-04-26T21:26:09.633 INFO:tasks.workunit.client.0.smithi084.stdout:1/745: mkdir d2/d9/d15/d28/da0/db5/dfa 0 2024-04-26T21:26:09.635 INFO:tasks.workunit.client.1.smithi120.stdout:6/974: dread - d4/db/d10/dd/d28/d9e/daf/dd3/f13a zero size 2024-04-26T21:26:09.635 INFO:tasks.workunit.client.1.smithi120.stdout:1/884: stat d6/d14/d3c/f106 0 2024-04-26T21:26:09.635 INFO:tasks.workunit.client.0.smithi084.stdout:9/666: unlink da/dd5/d93/dc3/d41/d43/d4a/c4d 0 2024-04-26T21:26:09.635 INFO:tasks.workunit.client.1.smithi120.stdout:4/975: getdents d10/d28 0 2024-04-26T21:26:09.640 INFO:tasks.workunit.client.0.smithi084.stdout:2/867: truncate d6/d7/d3d/d15/d1f/d22/d2a/fcd 3648272 0 2024-04-26T21:26:09.642 INFO:tasks.workunit.client.0.smithi084.stdout:1/746: rmdir d2/d9/d15/ded 0 2024-04-26T21:26:09.642 INFO:tasks.workunit.client.0.smithi084.stdout:6/721: truncate d3/de/d1a/d2f/d4c/d58/fbc 2536746 0 2024-04-26T21:26:09.643 INFO:tasks.workunit.client.1.smithi120.stdout:6/975: mknod d4/db/d10/dd/d43/c140 0 2024-04-26T21:26:09.644 INFO:tasks.workunit.client.0.smithi084.stdout:8/752: truncate d4/d6/db/d1e/d22/d96/f9f 1569689 0 2024-04-26T21:26:09.646 INFO:tasks.workunit.client.1.smithi120.stdout:1/885: unlink d6/d9/dd4/de0/d2d/d98/d56/f11b 0 2024-04-26T21:26:09.647 INFO:tasks.workunit.client.1.smithi120.stdout:8/921: getdents d5/d6/d34/d42/d102/d118/db8 0 2024-04-26T21:26:09.648 INFO:tasks.workunit.client.0.smithi084.stdout:0/750: truncate de/d2b/d77/d32/d96/fc9 390073 0 2024-04-26T21:26:09.650 INFO:tasks.workunit.client.1.smithi120.stdout:6/976: mknod d4/db/d10/d1a/d2b/d57/d67/c141 0 2024-04-26T21:26:09.651 INFO:tasks.workunit.client.0.smithi084.stdout:2/868: rename d6/d7/d3d/d15/d1f/d39/da5/c106 to d6/d7/d3d/d15/d1f/d22/dd4/ded/c122 0 2024-04-26T21:26:09.651 INFO:tasks.workunit.client.1.smithi120.stdout:1/886: mkdir d6/daa/dae/d128 0 2024-04-26T21:26:09.653 INFO:tasks.workunit.client.0.smithi084.stdout:7/789: dread d6/d26/d40/f66 [4194304,4194304] 0 2024-04-26T21:26:09.653 INFO:tasks.workunit.client.0.smithi084.stdout:2/869: fdatasync d6/d7/d3d/d15/d1f/d39/fe 0 2024-04-26T21:26:09.661 INFO:tasks.workunit.client.1.smithi120.stdout:4/976: dread d10/d28/f77 [0,4194304] 0 2024-04-26T21:26:09.664 INFO:tasks.workunit.client.1.smithi120.stdout:8/922: dread d5/d6/d34/d42/d102/d118/d60/f5c [0,4194304] 0 2024-04-26T21:26:09.666 INFO:tasks.workunit.client.1.smithi120.stdout:4/977: chown d10/d28/dd9/ddd/dee/dd0/dd4/d86/dfa/dfe/d12a/de2/ff6 1 1 2024-04-26T21:26:09.668 INFO:tasks.workunit.client.1.smithi120.stdout:4/978: dread - d10/d12/da1/f129 zero size 2024-04-26T21:26:09.670 INFO:tasks.workunit.client.1.smithi120.stdout:4/979: creat d10/d28/dd9/ddd/dee/dd0/dd4/d86/dfa/f14a x:0 0 0 2024-04-26T21:26:09.672 INFO:tasks.workunit.client.1.smithi120.stdout:4/980: dread - d10/d6b/d71/dd7/fe1 zero size 2024-04-26T21:26:09.680 INFO:tasks.workunit.client.1.smithi120.stdout:8/923: dwrite d5/d6/d11/d32/d3b/f6f [4194304,4194304] 0 2024-04-26T21:26:09.684 INFO:tasks.workunit.client.1.smithi120.stdout:8/924: creat d5/d6/d34/d42/d9d/d7a/da4/f134 x:0 0 0 2024-04-26T21:26:09.686 INFO:tasks.workunit.client.1.smithi120.stdout:8/925: chown d5/d6/d34/d42/lc1 786 1 2024-04-26T21:26:09.689 INFO:tasks.workunit.client.1.smithi120.stdout:8/926: creat d5/d6/d11/d52/d27/d4f/d101/f135 x:0 0 0 2024-04-26T21:26:09.697 INFO:tasks.workunit.client.0.smithi084.stdout:7/790: creat d6/d68/d7f/dcf/f115 x:0 0 0 2024-04-26T21:26:09.700 INFO:tasks.workunit.client.0.smithi084.stdout:3/758: write d1/d24/d27/f30 [348864,39952] 0 2024-04-26T21:26:09.701 INFO:tasks.workunit.client.0.smithi084.stdout:9/667: dread da/de/d16/d40/f64 [0,4194304] 0 2024-04-26T21:26:09.702 INFO:tasks.workunit.client.1.smithi120.stdout:8/927: dwrite d5/d6/d34/d42/d102/d118/db8/ddc/de4/f119 [0,4194304] 0 2024-04-26T21:26:09.702 INFO:tasks.workunit.client.0.smithi084.stdout:4/697: dread d5/d7/d65/f5a [0,4194304] 0 2024-04-26T21:26:09.703 INFO:tasks.workunit.client.0.smithi084.stdout:1/747: rename d2/d54/d5e/d66/d2a/d2c/d75/l89 to d2/d54/d5e/d66/d2a/d2c/lfb 0 2024-04-26T21:26:09.704 INFO:tasks.workunit.client.0.smithi084.stdout:9/668: write da/dd5/d93/dc3/d41/de4/fe7 [858188,31005] 0 2024-04-26T21:26:09.705 INFO:tasks.workunit.client.0.smithi084.stdout:2/870: creat d6/d7/f123 x:0 0 0 2024-04-26T21:26:09.708 INFO:tasks.workunit.client.0.smithi084.stdout:7/791: creat d6/d9/d63/f116 x:0 0 0 2024-04-26T21:26:09.712 INFO:tasks.workunit.client.0.smithi084.stdout:1/748: mknod d2/d54/d5e/d66/d3a/d48/cfc 0 2024-04-26T21:26:09.716 INFO:tasks.workunit.client.0.smithi084.stdout:7/792: creat d6/d9/d12/d8b/d72/f117 x:0 0 0 2024-04-26T21:26:09.718 INFO:tasks.workunit.client.0.smithi084.stdout:3/759: getdents d1/d2c/d2f/d31/da8 0 2024-04-26T21:26:09.720 INFO:tasks.workunit.client.0.smithi084.stdout:3/760: chown d1/c40 350 1 2024-04-26T21:26:09.726 INFO:tasks.workunit.client.0.smithi084.stdout:7/793: rmdir d6/d9/d12/d19/d20/d38/d112 39 2024-04-26T21:26:09.729 INFO:tasks.workunit.client.0.smithi084.stdout:1/749: link d2/d9/d15/d28/d5a/f91 d2/d54/ffd 0 2024-04-26T21:26:09.730 INFO:tasks.workunit.client.0.smithi084.stdout:3/761: creat d1/d2c/d2f/d31/da8/f111 x:0 0 0 2024-04-26T21:26:09.732 INFO:tasks.workunit.client.0.smithi084.stdout:8/753: dread d4/f87 [0,4194304] 0 2024-04-26T21:26:09.735 INFO:tasks.workunit.client.0.smithi084.stdout:1/750: creat d2/d19/ffe x:0 0 0 2024-04-26T21:26:09.738 INFO:tasks.workunit.client.0.smithi084.stdout:8/754: stat d4/d7/d15/d9d/faf 0 2024-04-26T21:26:09.739 INFO:tasks.workunit.client.1.smithi120.stdout:2/936: truncate d4/d1b/d25/d2c/d3e/d5e/fe2 3003146 0 2024-04-26T21:26:09.743 INFO:tasks.workunit.client.1.smithi120.stdout:5/964: dwrite d2/dc/d1d/d21/d77/d79/db7/d5f/fe2 [0,4194304] 0 2024-04-26T21:26:09.743 INFO:tasks.workunit.client.0.smithi084.stdout:1/751: write d2/d19/f4d [5175840,36471] 0 2024-04-26T21:26:09.744 INFO:tasks.workunit.client.0.smithi084.stdout:4/698: dread d5/d25/f3e [0,4194304] 0 2024-04-26T21:26:09.747 INFO:tasks.workunit.client.0.smithi084.stdout:3/762: truncate d1/d2c/d2f/d31/d52/fa5 881212 0 2024-04-26T21:26:09.747 INFO:tasks.workunit.client.0.smithi084.stdout:1/752: fsync d2/d54/d5e/d66/f29 0 2024-04-26T21:26:09.751 INFO:tasks.workunit.client.0.smithi084.stdout:1/753: fdatasync d2/d54/d5e/ff3 0 2024-04-26T21:26:09.752 INFO:tasks.workunit.client.0.smithi084.stdout:4/699: write d5/d10/f18 [4031588,27945] 0 2024-04-26T21:26:09.757 INFO:tasks.workunit.client.1.smithi120.stdout:6/977: fsync d4/db/d10/d1a/d2b/d57/d67/f32 0 2024-04-26T21:26:09.757 INFO:tasks.workunit.client.0.smithi084.stdout:7/794: dwrite d6/d68/d7f/fae [0,4194304] 0 2024-04-26T21:26:09.758 INFO:tasks.workunit.client.1.smithi120.stdout:4/981: truncate d10/d28/f5f 3017378 0 2024-04-26T21:26:09.758 INFO:tasks.workunit.client.1.smithi120.stdout:4/982: chown d10/lb4 5435 1 2024-04-26T21:26:09.762 INFO:tasks.workunit.client.1.smithi120.stdout:3/965: sync 2024-04-26T21:26:09.762 INFO:tasks.workunit.client.1.smithi120.stdout:1/887: dread d6/d9/dd4/de0/d1d/f9b [0,4194304] 0 2024-04-26T21:26:09.763 INFO:tasks.workunit.client.0.smithi084.stdout:7/795: stat d6/c36 0 2024-04-26T21:26:09.763 INFO:tasks.workunit.client.0.smithi084.stdout:4/700: rename d5/d2e/d5f to d5/d25/d35/d60/d6d/de1 0 2024-04-26T21:26:09.766 INFO:tasks.workunit.client.1.smithi120.stdout:1/888: stat d6/d9/dd4/de0/d1d/d5d/d67/de3/fe6 0 2024-04-26T21:26:09.768 INFO:tasks.workunit.client.0.smithi084.stdout:8/755: dwrite d4/d7/d15/d9d/faf [0,4194304] 0 2024-04-26T21:26:09.771 INFO:tasks.workunit.client.1.smithi120.stdout:1/889: chown d6/d9/dd4/de0/d2d/d98/d56/dad/c122 7273692 1 2024-04-26T21:26:09.772 INFO:tasks.workunit.client.0.smithi084.stdout:8/756: mknod d4/d3a/d8c/ce5 0 2024-04-26T21:26:09.775 INFO:tasks.workunit.client.1.smithi120.stdout:1/890: chown d6/d9/dd4/de0/d1d/f50 194 1 2024-04-26T21:26:09.783 INFO:tasks.workunit.client.1.smithi120.stdout:8/928: dwrite d5/d6/d11/d52/f44 [0,4194304] 0 2024-04-26T21:26:09.784 INFO:tasks.workunit.client.0.smithi084.stdout:3/763: truncate d1/d2c/d2f/d31/d55/d4e/d7c/db1/dc8/fdd 119155 0 2024-04-26T21:26:09.786 INFO:tasks.workunit.client.0.smithi084.stdout:7/796: write d6/d9/fa [5618823,19421] 0 2024-04-26T21:26:09.788 INFO:tasks.workunit.client.0.smithi084.stdout:3/764: fdatasync d1/d2c/d2f/d31/d3b/fd7 0 2024-04-26T21:26:09.788 INFO:tasks.workunit.client.0.smithi084.stdout:9/669: dread da/dd5/d93/dc3/d41/d67/f86 [0,4194304] 0 2024-04-26T21:26:09.800 INFO:tasks.workunit.client.0.smithi084.stdout:3/765: mknod d1/d2c/d2f/c112 0 2024-04-26T21:26:09.803 INFO:tasks.workunit.client.0.smithi084.stdout:1/754: dread d2/d9/d67/fba [0,4194304] 0 2024-04-26T21:26:09.803 INFO:tasks.workunit.client.1.smithi120.stdout:5/965: mkdir d2/d30/d93/d107/d36/d44/d15c 0 2024-04-26T21:26:09.804 INFO:tasks.workunit.client.1.smithi120.stdout:4/983: symlink d10/d6b/d71/dd7/l14b 0 2024-04-26T21:26:09.806 INFO:tasks.workunit.client.0.smithi084.stdout:8/757: dwrite d4/d6/db/d1e/fd5 [0,4194304] 0 2024-04-26T21:26:09.806 INFO:tasks.workunit.client.0.smithi084.stdout:9/670: truncate da/de/d16/d40/fda 1611705 0 2024-04-26T21:26:09.806 INFO:tasks.workunit.client.0.smithi084.stdout:3/766: write d1/d24/f8d [257175,69682] 0 2024-04-26T21:26:09.808 INFO:tasks.workunit.client.1.smithi120.stdout:8/929: truncate d5/d6/d11/f2a 4182338 0 2024-04-26T21:26:09.811 INFO:tasks.workunit.client.1.smithi120.stdout:2/937: unlink d4/d1b/d2e/d50/l62 0 2024-04-26T21:26:09.812 INFO:tasks.workunit.client.1.smithi120.stdout:3/966: getdents dd/d130 0 2024-04-26T21:26:09.815 INFO:tasks.workunit.client.1.smithi120.stdout:5/966: unlink d2/d1b/d89/d47/d8a/f11d 0 2024-04-26T21:26:09.819 INFO:tasks.workunit.client.0.smithi084.stdout:5/736: sync 2024-04-26T21:26:09.823 INFO:tasks.workunit.client.1.smithi120.stdout:3/967: mkdir dd/de/df/d12/d48/d137 0 2024-04-26T21:26:09.826 INFO:tasks.workunit.client.1.smithi120.stdout:2/938: rename d4/d1b/d2e/d50/d14/la3 to d4/d1b/d25/d29/l13b 0 2024-04-26T21:26:09.829 INFO:tasks.workunit.client.0.smithi084.stdout:8/758: unlink d4/d3a/d8c/cbb 0 2024-04-26T21:26:09.831 INFO:tasks.workunit.client.0.smithi084.stdout:1/755: write d2/d54/d93/faa [1301737,1062] 0 2024-04-26T21:26:09.832 INFO:tasks.workunit.client.0.smithi084.stdout:5/737: mkdir d0/d49/d56/de5 0 2024-04-26T21:26:09.832 INFO:tasks.workunit.client.1.smithi120.stdout:3/968: mkdir dd/de/df/dda/d8d/d138 0 2024-04-26T21:26:09.832 INFO:tasks.workunit.client.0.smithi084.stdout:3/767: symlink d1/d24/dbb/l113 0 2024-04-26T21:26:09.835 INFO:tasks.workunit.client.0.smithi084.stdout:9/671: dwrite da/de/d1e/f31 [0,4194304] 0 2024-04-26T21:26:09.846 INFO:tasks.workunit.client.0.smithi084.stdout:8/759: read d4/d7/d15/f70 [61994,8804] 0 2024-04-26T21:26:09.849 INFO:tasks.workunit.client.1.smithi120.stdout:2/939: fdatasync d4/d1b/d2e/d50/f3f 0 2024-04-26T21:26:09.852 INFO:tasks.workunit.client.0.smithi084.stdout:1/756: mkdir d2/d54/d5e/d66/d2a/dff 0 2024-04-26T21:26:09.854 INFO:tasks.workunit.client.0.smithi084.stdout:8/760: write d4/d6/db/d1e/f8e [248987,19135] 0 2024-04-26T21:26:09.854 INFO:tasks.workunit.client.0.smithi084.stdout:7/797: dread d6/d68/f6e [0,4194304] 0 2024-04-26T21:26:09.856 INFO:tasks.workunit.client.0.smithi084.stdout:4/701: dread d5/d25/d35/d60/d6d/de1/d32/f34 [0,4194304] 0 2024-04-26T21:26:09.861 INFO:tasks.workunit.client.0.smithi084.stdout:5/738: write d0/f4b [1886813,108578] 0 2024-04-26T21:26:09.863 INFO:tasks.workunit.client.1.smithi120.stdout:3/969: dread dd/de/df/d12/d48/d9b/dcb/fdc [0,4194304] 0 2024-04-26T21:26:09.864 INFO:tasks.workunit.client.0.smithi084.stdout:7/798: dread - d6/d9/d12/d8b/d72/da0/fb6 zero size 2024-04-26T21:26:09.866 INFO:tasks.workunit.client.1.smithi120.stdout:3/970: dread - dd/de/df/dda/d24/d43/f53 zero size 2024-04-26T21:26:09.867 INFO:tasks.workunit.client.0.smithi084.stdout:8/761: creat d4/d6/db/d1e/d22/d39/d4a/fe6 x:0 0 0 2024-04-26T21:26:09.867 INFO:tasks.workunit.client.0.smithi084.stdout:9/672: write da/dd5/d93/dc3/d41/d67/f6f [335109,56264] 0 2024-04-26T21:26:09.876 INFO:tasks.workunit.client.0.smithi084.stdout:4/702: link d5/d25/d35/d60/d6d/de1/c1e d5/d25/d99/dac/ce2 0 2024-04-26T21:26:09.877 INFO:tasks.workunit.client.0.smithi084.stdout:4/703: fdatasync d5/d7/f63 0 2024-04-26T21:26:09.880 INFO:tasks.workunit.client.1.smithi120.stdout:3/971: truncate dd/de/df/dda/d24/db1/d76/d3b/d56/f123 20764 0 2024-04-26T21:26:09.880 INFO:tasks.workunit.client.0.smithi084.stdout:5/739: write d0/dc/df/d75/f55 [916749,60352] 0 2024-04-26T21:26:09.881 INFO:tasks.workunit.client.0.smithi084.stdout:8/762: write d4/d6/db/d1e/d22/d39/f93 [3334702,20023] 0 2024-04-26T21:26:09.881 INFO:tasks.workunit.client.0.smithi084.stdout:7/799: write d6/d9/d63/f7b [975477,58996] 0 2024-04-26T21:26:09.886 INFO:tasks.workunit.client.1.smithi120.stdout:3/972: creat dd/de/df/dda/f139 x:0 0 0 2024-04-26T21:26:09.889 INFO:tasks.workunit.client.0.smithi084.stdout:5/740: rmdir d0/dc/df/d31/d53/d5d 39 2024-04-26T21:26:09.890 INFO:tasks.workunit.client.0.smithi084.stdout:8/763: write d4/d7/d15/d37/d52/d69/fba [747458,81606] 0 2024-04-26T21:26:09.891 INFO:tasks.workunit.client.0.smithi084.stdout:7/800: write d6/d9/d12/f2c [2305712,94916] 0 2024-04-26T21:26:09.891 INFO:tasks.workunit.client.0.smithi084.stdout:5/741: fsync d0/dc/f1c 0 2024-04-26T21:26:09.897 INFO:tasks.workunit.client.0.smithi084.stdout:7/801: write d6/d68/f9f [4830590,98347] 0 2024-04-26T21:26:09.901 INFO:tasks.workunit.client.1.smithi120.stdout:8/930: write d5/f30 [498235,48229] 0 2024-04-26T21:26:09.902 INFO:tasks.workunit.client.0.smithi084.stdout:1/757: dread d2/d1b/f65 [0,4194304] 0 2024-04-26T21:26:09.905 INFO:tasks.workunit.client.0.smithi084.stdout:5/742: creat d0/dc/df/d31/d72/dcd/fe6 x:0 0 0 2024-04-26T21:26:09.905 INFO:tasks.workunit.client.0.smithi084.stdout:9/673: dwrite da/de/d16/d40/f4b [0,4194304] 0 2024-04-26T21:26:09.907 INFO:tasks.workunit.client.0.smithi084.stdout:3/768: dread d1/f1a [0,4194304] 0 2024-04-26T21:26:09.913 INFO:tasks.workunit.client.0.smithi084.stdout:1/758: mknod d2/d54/d5e/d66/d2a/dff/c100 0 2024-04-26T21:26:09.914 INFO:tasks.workunit.client.1.smithi120.stdout:2/940: truncate d4/d1b/d2e/d50/d14/d15/f71 471714 0 2024-04-26T21:26:09.916 INFO:tasks.workunit.client.1.smithi120.stdout:4/984: dwrite d10/d6b/f6e [0,4194304] 0 2024-04-26T21:26:09.917 INFO:tasks.workunit.client.0.smithi084.stdout:7/802: rename d6/d9/d12/d8b/d72/da0/d80/l5f to d6/d9/d12/l118 0 2024-04-26T21:26:09.918 INFO:tasks.workunit.client.0.smithi084.stdout:4/704: dwrite d5/d7/d65/f5a [0,4194304] 0 2024-04-26T21:26:09.918 INFO:tasks.workunit.client.0.smithi084.stdout:8/764: truncate d4/d6/db/fc5 2261480 0 2024-04-26T21:26:09.920 INFO:tasks.workunit.client.1.smithi120.stdout:4/985: chown d10/c1c 2211934 1 2024-04-26T21:26:09.921 INFO:tasks.workunit.client.1.smithi120.stdout:5/967: dwrite d2/dc/d1d/d21/d66/de5/f15b [0,4194304] 0 2024-04-26T21:26:09.925 INFO:tasks.workunit.client.0.smithi084.stdout:9/674: link da/dd5/d93/dc3/f73 da/dd5/ff6 0 2024-04-26T21:26:09.925 INFO:tasks.workunit.client.0.smithi084.stdout:5/743: truncate d0/dc/df/d31/d53/d87/f9f 1288596 0 2024-04-26T21:26:09.925 INFO:tasks.workunit.client.0.smithi084.stdout:1/759: truncate d2/d9/d15/d28/d47/fd3 833346 0 2024-04-26T21:26:09.926 INFO:tasks.workunit.client.1.smithi120.stdout:4/986: write d10/d12/da1/d134/f135 [329111,102137] 0 2024-04-26T21:26:09.927 INFO:tasks.workunit.client.0.smithi084.stdout:5/744: readlink d0/d17/l3b 0 2024-04-26T21:26:09.927 INFO:tasks.workunit.client.0.smithi084.stdout:4/705: mknod d5/d25/d99/da0/ce3 0 2024-04-26T21:26:09.927 INFO:tasks.workunit.client.0.smithi084.stdout:8/765: write d4/d7/d15/fd8 [486411,74684] 0 2024-04-26T21:26:09.930 INFO:tasks.workunit.client.1.smithi120.stdout:2/941: mkdir d4/d1b/d25/d29/d13c 0 2024-04-26T21:26:09.933 INFO:tasks.workunit.client.1.smithi120.stdout:5/968: creat d2/d30/d93/d107/d36/d44/dea/f15d x:0 0 0 2024-04-26T21:26:09.933 INFO:tasks.workunit.client.1.smithi120.stdout:8/931: dwrite d5/d6/d11/d52/d27/f6d [0,4194304] 0 2024-04-26T21:26:09.934 INFO:tasks.workunit.client.1.smithi120.stdout:4/987: rmdir d10/d6b/dbf 39 2024-04-26T21:26:09.934 INFO:tasks.workunit.client.1.smithi120.stdout:1/891: write d6/fc [3272553,125120] 0 2024-04-26T21:26:09.936 INFO:tasks.workunit.client.0.smithi084.stdout:1/760: write d2/d19/fd7 [872485,62640] 0 2024-04-26T21:26:09.939 INFO:tasks.workunit.client.0.smithi084.stdout:8/766: stat d4/d6/db/d1e/d22/d39/dc4 0 2024-04-26T21:26:09.941 INFO:tasks.workunit.client.1.smithi120.stdout:4/988: chown d10/d28/dd9/ddd/dee/dd0/dd4/d86/c131 3768 1 2024-04-26T21:26:09.943 INFO:tasks.workunit.client.0.smithi084.stdout:7/803: creat d6/d9/d12/d19/d20/f119 x:0 0 0 2024-04-26T21:26:09.943 INFO:tasks.workunit.client.0.smithi084.stdout:8/767: stat d4/d6/db/d9b/dd4 0 2024-04-26T21:26:09.943 INFO:tasks.workunit.client.0.smithi084.stdout:5/745: write d0/dc/df/d31/d53/d87/f99 [4788176,50168] 0 2024-04-26T21:26:09.944 INFO:tasks.workunit.client.1.smithi120.stdout:1/892: creat d6/d9/dd4/de0/d1d/f129 x:0 0 0 2024-04-26T21:26:09.944 INFO:tasks.workunit.client.1.smithi120.stdout:1/893: readlink d6/l41 0 2024-04-26T21:26:09.947 INFO:tasks.workunit.client.1.smithi120.stdout:2/942: truncate d4/d1b/d25/d29/d128/fc3 2265182 0 2024-04-26T21:26:09.948 INFO:tasks.workunit.client.0.smithi084.stdout:1/761: symlink d2/d54/d5e/d66/d3a/d77/l101 0 2024-04-26T21:26:09.949 INFO:tasks.workunit.client.1.smithi120.stdout:5/969: creat d2/d1b/d89/d47/de4/f15e x:0 0 0 2024-04-26T21:26:09.954 INFO:tasks.workunit.client.1.smithi120.stdout:8/932: mkdir d5/d6/d11/d52/d136 0 2024-04-26T21:26:09.956 INFO:tasks.workunit.client.0.smithi084.stdout:1/762: write d2/d54/d5e/d66/d3a/d48/f6e [1149192,110326] 0 2024-04-26T21:26:09.958 INFO:tasks.workunit.client.1.smithi120.stdout:8/933: dread - d5/d6/d34/d42/d102/d118/d60/f65 zero size 2024-04-26T21:26:09.959 INFO:tasks.workunit.client.0.smithi084.stdout:1/763: chown d2/d54/d5e/d66/f29 2702790 1 2024-04-26T21:26:09.961 INFO:tasks.workunit.client.1.smithi120.stdout:4/989: link d10/d6b/dbf/lda d10/d12/da1/d134/l14c 0 2024-04-26T21:26:09.961 INFO:tasks.workunit.client.0.smithi084.stdout:7/804: creat d6/d9/d12/d8b/d72/da0/d80/f11a x:0 0 0 2024-04-26T21:26:09.961 INFO:tasks.workunit.client.0.smithi084.stdout:8/768: rmdir d4/d6/db/d9b 39 2024-04-26T21:26:09.963 INFO:tasks.workunit.client.1.smithi120.stdout:1/894: dwrite d6/f103 [0,4194304] 0 2024-04-26T21:26:09.964 INFO:tasks.workunit.client.0.smithi084.stdout:5/746: fdatasync d0/dc/df/d6d/f73 0 2024-04-26T21:26:09.966 INFO:tasks.workunit.client.1.smithi120.stdout:4/990: fsync d10/d6b/dbf/fcf 0 2024-04-26T21:26:09.969 INFO:tasks.workunit.client.0.smithi084.stdout:8/769: dread - d4/d6/db/d1e/d22/d39/d4a/da2/fe3 zero size 2024-04-26T21:26:09.969 INFO:tasks.workunit.client.1.smithi120.stdout:4/991: write d10/f26 [3022436,80278] 0 2024-04-26T21:26:09.974 INFO:tasks.workunit.client.1.smithi120.stdout:1/895: rename d6/d9/dd4/de0/d2d/d10c to d6/d9/dd4/de0/d1d/d5d/d67/d12a 0 2024-04-26T21:26:09.975 INFO:tasks.workunit.client.0.smithi084.stdout:3/769: dread d1/d2c/d2f/d31/d55/fb3 [0,4194304] 0 2024-04-26T21:26:09.976 INFO:tasks.workunit.client.0.smithi084.stdout:9/675: truncate da/de/d16/f57 2029545 0 2024-04-26T21:26:09.982 INFO:tasks.workunit.client.0.smithi084.stdout:8/770: rename d4/d6/db/d1e/d22/d2f/fd1 to d4/d7/d53/fe7 0 2024-04-26T21:26:09.982 INFO:tasks.workunit.client.1.smithi120.stdout:8/934: dwrite d5/d6/d34/d42/d102/d118/db8/d11a/f130 [0,4194304] 0 2024-04-26T21:26:09.983 INFO:tasks.workunit.client.1.smithi120.stdout:1/896: truncate d6/d9/dd4/de0/d1b/d3b/d6d/d120/f127 972875 0 2024-04-26T21:26:09.983 INFO:tasks.workunit.client.0.smithi084.stdout:8/771: write d4/f5 [327946,122859] 0 2024-04-26T21:26:09.986 INFO:tasks.workunit.client.0.smithi084.stdout:7/805: dwrite d6/d9/d12/d8b/f8d [0,4194304] 0 2024-04-26T21:26:09.986 INFO:tasks.workunit.client.0.smithi084.stdout:9/676: symlink da/de/d16/dbc/lf7 0 2024-04-26T21:26:09.986 INFO:tasks.workunit.client.1.smithi120.stdout:4/992: write d10/d28/dd9/ddd/dee/dd0/dd4/f91 [1312916,19888] 0 2024-04-26T21:26:09.988 INFO:tasks.workunit.client.1.smithi120.stdout:8/935: mkdir d5/d6/d11/d52/d27/d4f/d137 0 2024-04-26T21:26:09.989 INFO:tasks.workunit.client.0.smithi084.stdout:8/772: mkdir d4/d6/de8 0 2024-04-26T21:26:09.992 INFO:tasks.workunit.client.1.smithi120.stdout:4/993: mkdir d10/d6b/dbf/d14d 0 2024-04-26T21:26:09.992 INFO:tasks.workunit.client.0.smithi084.stdout:7/806: unlink d6/d1c/d51/cc0 0 2024-04-26T21:26:09.992 INFO:tasks.workunit.client.0.smithi084.stdout:9/677: symlink da/de/lf8 0 2024-04-26T21:26:09.993 INFO:tasks.workunit.client.1.smithi120.stdout:1/897: truncate d6/d9/dd4/de0/d1b/d3b/fce 2151361 0 2024-04-26T21:26:09.993 INFO:tasks.workunit.client.0.smithi084.stdout:8/773: truncate d4/d3a/f71 8752472 0 2024-04-26T21:26:09.994 INFO:tasks.workunit.client.1.smithi120.stdout:8/936: read d5/d6/d11/d52/d27/d4f/f7d [212546,29481] 0 2024-04-26T21:26:09.994 INFO:tasks.workunit.client.1.smithi120.stdout:9/899: sync 2024-04-26T21:26:10.001 INFO:tasks.workunit.client.0.smithi084.stdout:9/678: mknod da/dd5/db6/cf9 0 2024-04-26T21:26:10.001 INFO:tasks.workunit.client.1.smithi120.stdout:9/900: stat d0/d66/d93/db7/f121 0 2024-04-26T21:26:10.004 INFO:tasks.workunit.client.0.smithi084.stdout:7/807: creat d6/d1c/f11b x:0 0 0 2024-04-26T21:26:10.005 INFO:tasks.workunit.client.1.smithi120.stdout:1/898: truncate d6/d9/dd4/de0/d1d/f9b 4217425 0 2024-04-26T21:26:10.005 INFO:tasks.workunit.client.1.smithi120.stdout:4/994: rmdir d10/d12/da1/d10e/d148 0 2024-04-26T21:26:10.006 INFO:tasks.workunit.client.1.smithi120.stdout:9/901: read - d0/d6/d4d/d65/dec/d77/dc5/fe1 zero size 2024-04-26T21:26:10.010 INFO:tasks.workunit.client.1.smithi120.stdout:4/995: rmdir d10/da6 39 2024-04-26T21:26:10.011 INFO:tasks.workunit.client.0.smithi084.stdout:8/774: rename d4/d6/db/d1e/d22/d39/d4a/da2 to d4/d6/db/d1e/d22/d39/de9 0 2024-04-26T21:26:10.011 INFO:tasks.workunit.client.0.smithi084.stdout:4/706: dread d5/d10/d15/d21/f7b [0,4194304] 0 2024-04-26T21:26:10.012 INFO:tasks.workunit.client.0.smithi084.stdout:4/707: stat d5/d7/d65/d90 0 2024-04-26T21:26:10.012 INFO:tasks.workunit.client.1.smithi120.stdout:5/970: dread d2/d30/d93/d107/d34/fa9 [0,4194304] 0 2024-04-26T21:26:10.013 INFO:tasks.workunit.client.0.smithi084.stdout:8/775: truncate d4/d3a/d8c/fa3 1072610 0 2024-04-26T21:26:10.015 INFO:tasks.workunit.client.1.smithi120.stdout:1/899: mkdir d6/d9/dd4/de0/d1d/d5d/d12b 0 2024-04-26T21:26:10.016 INFO:tasks.workunit.client.0.smithi084.stdout:9/679: getdents da/de/d1e/d56/da6/de6 0 2024-04-26T21:26:10.016 INFO:tasks.workunit.client.0.smithi084.stdout:8/776: chown d4/d7/d15/d37/d52/d69/fba 125 1 2024-04-26T21:26:10.018 INFO:tasks.workunit.client.0.smithi084.stdout:8/777: write d4/f13 [4577456,48465] 0 2024-04-26T21:26:10.018 INFO:tasks.workunit.client.0.smithi084.stdout:7/808: link d6/d9/d12/d19/d20/d38/d112/fc9 d6/d26/f11c 0 2024-04-26T21:26:10.019 INFO:tasks.workunit.client.1.smithi120.stdout:9/902: mkdir d0/dd/d3a/d5c/d98/d12d 0 2024-04-26T21:26:10.021 INFO:tasks.workunit.client.0.smithi084.stdout:7/809: chown d6/d9/d12/d8b/d72/da0 55581081 1 2024-04-26T21:26:10.023 INFO:tasks.workunit.client.0.smithi084.stdout:9/680: creat da/dd5/d93/dc3/d41/d43/dba/ffa x:0 0 0 2024-04-26T21:26:10.024 INFO:tasks.workunit.client.1.smithi120.stdout:9/903: fdatasync d0/d6/f36 0 2024-04-26T21:26:10.031 INFO:tasks.workunit.client.1.smithi120.stdout:8/937: write d5/d6/d11/d52/d27/d4f/f7d [310293,117808] 0 2024-04-26T21:26:10.031 INFO:tasks.workunit.client.0.smithi084.stdout:8/778: mkdir d4/d7/d15/da7/dea 0 2024-04-26T21:26:10.031 INFO:tasks.workunit.client.1.smithi120.stdout:9/904: chown d0/d6/d4d/d65/dec/d77/fcc 5125 1 2024-04-26T21:26:10.033 INFO:tasks.workunit.client.0.smithi084.stdout:9/681: write da/de/d16/d40/f64 [830892,112491] 0 2024-04-26T21:26:10.034 INFO:tasks.workunit.client.1.smithi120.stdout:4/996: write d10/d12/f1d [978304,14594] 0 2024-04-26T21:26:10.035 INFO:tasks.workunit.client.0.smithi084.stdout:9/682: chown da/de/d16/dbc 99 1 2024-04-26T21:26:10.037 INFO:tasks.workunit.client.0.smithi084.stdout:1/764: dread d2/d54/d5e/d66/d2a/d2c/f34 [4194304,4194304] 0 2024-04-26T21:26:10.040 INFO:tasks.workunit.client.1.smithi120.stdout:8/938: fsync d5/d6/d34/d42/d102/d118/dd9/dda/dfc/f10d 0 2024-04-26T21:26:10.044 INFO:tasks.workunit.client.1.smithi120.stdout:4/997: readlink d10/d28/dd9/ddd/dee/dd0/dd4/d86/dfa/dfe/d12a/de2/l12b 0 2024-04-26T21:26:10.044 INFO:tasks.workunit.client.1.smithi120.stdout:9/905: getdents d0/dd/d3a/d5c/d98 0 2024-04-26T21:26:10.044 INFO:tasks.workunit.client.0.smithi084.stdout:8/779: chown d4/d6/db/d9b/cda 38 1 2024-04-26T21:26:10.046 INFO:tasks.workunit.client.0.smithi084.stdout:1/765: mkdir d2/d54/d5e/d102 0 2024-04-26T21:26:10.047 INFO:tasks.workunit.client.1.smithi120.stdout:1/900: dwrite d6/d9/dd4/de0/d1d/d2c/d58/fcb [0,4194304] 0 2024-04-26T21:26:10.050 INFO:tasks.workunit.client.1.smithi120.stdout:5/971: dwrite d2/d10e/d63/fcb [0,4194304] 0 2024-04-26T21:26:10.050 INFO:tasks.workunit.client.1.smithi120.stdout:4/998: mknod d10/d6b/d71/dd7/c14e 0 2024-04-26T21:26:10.053 INFO:tasks.workunit.client.0.smithi084.stdout:4/708: dwrite d5/f1a [0,4194304] 0 2024-04-26T21:26:10.054 INFO:tasks.workunit.client.1.smithi120.stdout:8/939: symlink d5/d6/d34/d42/d4a/deb/d88/l138 0 2024-04-26T21:26:10.060 INFO:tasks.workunit.client.1.smithi120.stdout:9/906: symlink d0/dd/d3a/de8/d118/l12e 0 2024-04-26T21:26:10.060 INFO:tasks.workunit.client.1.smithi120.stdout:4/999: creat d10/d6b/dbf/f14f x:0 0 0 2024-04-26T21:26:10.064 INFO:tasks.workunit.client.0.smithi084.stdout:9/683: dwrite da/de/d16/d40/fda [0,4194304] 0 2024-04-26T21:26:10.066 INFO:tasks.workunit.client.1.smithi120.stdout:8/940: creat d5/d6/d34/d42/d102/d118/dd9/dda/dfc/f139 x:0 0 0 2024-04-26T21:26:10.071 INFO:tasks.workunit.client.0.smithi084.stdout:8/780: write d4/d7/d15/d37/d52/f67 [1825927,85929] 0 2024-04-26T21:26:10.073 INFO:tasks.workunit.client.1.smithi120.stdout:9/907: dread d0/d6/f76 [0,4194304] 0 2024-04-26T21:26:10.076 INFO:tasks.workunit.client.0.smithi084.stdout:7/810: dread d6/d9/d12/f2c [0,4194304] 0 2024-04-26T21:26:10.077 INFO:tasks.workunit.client.1.smithi120.stdout:5/972: dwrite d2/dc/d1d/d21/d66/fa2 [0,4194304] 0 2024-04-26T21:26:10.083 INFO:tasks.workunit.client.0.smithi084.stdout:1/766: dwrite d2/d9/d15/d28/d47/f9b [0,4194304] 0 2024-04-26T21:26:10.086 INFO:tasks.workunit.client.0.smithi084.stdout:8/781: mknod d4/d6/de8/ceb 0 2024-04-26T21:26:10.086 INFO:tasks.workunit.client.0.smithi084.stdout:9/684: link da/c3b da/dd5/d93/dc3/d41/d43/d4a/d82/cfb 0 2024-04-26T21:26:10.087 INFO:tasks.workunit.client.1.smithi120.stdout:3/973: sync 2024-04-26T21:26:10.087 INFO:tasks.workunit.client.1.smithi120.stdout:6/978: sync 2024-04-26T21:26:10.087 INFO:tasks.workunit.client.1.smithi120.stdout:7/937: sync 2024-04-26T21:26:10.091 INFO:tasks.workunit.client.0.smithi084.stdout:1/767: creat d2/d54/d5e/d66/d2a/d2c/d45/dc9/f103 x:0 0 0 2024-04-26T21:26:10.091 INFO:tasks.workunit.client.0.smithi084.stdout:8/782: write d4/d6/db/d1e/d22/d39/d4a/fb6 [307161,32633] 0 2024-04-26T21:26:10.092 INFO:tasks.workunit.client.1.smithi120.stdout:7/938: fsync d7/d19/fbc 0 2024-04-26T21:26:10.093 INFO:tasks.workunit.client.1.smithi120.stdout:5/973: creat d2/d30/d93/d107/d36/d44/d6c/df5/f15f x:0 0 0 2024-04-26T21:26:10.094 INFO:tasks.workunit.client.0.smithi084.stdout:8/783: write d4/f12 [4307788,123869] 0 2024-04-26T21:26:10.095 INFO:tasks.workunit.client.1.smithi120.stdout:6/979: mkdir d4/db/d10/dd/d11a/d142 0 2024-04-26T21:26:10.098 INFO:tasks.workunit.client.1.smithi120.stdout:6/980: chown d4/db/d10/d22 444480 1 2024-04-26T21:26:10.098 INFO:tasks.workunit.client.0.smithi084.stdout:8/784: write d4/d6/db/d1e/f8e [497586,9465] 0 2024-04-26T21:26:10.099 INFO:tasks.workunit.client.1.smithi120.stdout:8/941: dread d5/d6/d11/d52/d27/d4f/d67/fad [4194304,4194304] 0 2024-04-26T21:26:10.100 INFO:tasks.workunit.client.1.smithi120.stdout:1/901: dread d6/d9/dd4/de0/d1b/d3b/f7f [0,4194304] 0 2024-04-26T21:26:10.102 INFO:tasks.workunit.client.0.smithi084.stdout:9/685: creat da/dd5/d93/dc3/d41/d43/d48/d61/df0/ffc x:0 0 0 2024-04-26T21:26:10.104 INFO:tasks.workunit.client.1.smithi120.stdout:7/939: read - d7/d10/d97/fef zero size 2024-04-26T21:26:10.106 INFO:tasks.workunit.client.1.smithi120.stdout:6/981: chown d4/db/d10/dd/d43/c10b 3091 1 2024-04-26T21:26:10.107 INFO:tasks.workunit.client.1.smithi120.stdout:5/974: write d2/d30/d93/d107/d36/d44/d6c/df5/f15f [566863,41895] 0 2024-04-26T21:26:10.109 INFO:tasks.workunit.client.0.smithi084.stdout:4/709: truncate d5/d25/d35/f3a 2005023 0 2024-04-26T21:26:10.110 INFO:tasks.workunit.client.0.smithi084.stdout:1/768: creat d2/d9/d15/d9f/f104 x:0 0 0 2024-04-26T21:26:10.112 INFO:tasks.workunit.client.1.smithi120.stdout:1/902: mknod d6/d9/c12c 0 2024-04-26T21:26:10.113 INFO:tasks.workunit.client.0.smithi084.stdout:8/785: fsync d4/d6/db/d1e/d22/d39/d4a/f5e 0 2024-04-26T21:26:10.115 INFO:tasks.workunit.client.1.smithi120.stdout:3/974: rename dd/de/df/db6/dc5/d103 to dd/de/df/d12/d13a 0 2024-04-26T21:26:10.116 INFO:tasks.workunit.client.1.smithi120.stdout:7/940: write d7/d19/d60/f76 [889845,19874] 0 2024-04-26T21:26:10.118 INFO:tasks.workunit.client.0.smithi084.stdout:7/811: link d6/d68/d7f/dcf/cf4 d6/d68/d7f/c11d 0 2024-04-26T21:26:10.120 INFO:tasks.workunit.client.0.smithi084.stdout:8/786: fsync d4/d6/db/d1e/d22/fcc 0 2024-04-26T21:26:10.122 INFO:tasks.workunit.client.0.smithi084.stdout:4/710: creat d5/d25/d35/d60/d6d/dd0/dd8/fe4 x:0 0 0 2024-04-26T21:26:10.123 INFO:tasks.workunit.client.1.smithi120.stdout:3/975: stat dd/de/df/d12/d48/ca8 0 2024-04-26T21:26:10.123 INFO:tasks.workunit.client.0.smithi084.stdout:7/812: creat d6/d9/db3/f11e x:0 0 0 2024-04-26T21:26:10.125 INFO:tasks.workunit.client.1.smithi120.stdout:7/941: mkdir d7/d64/da6/d1f/d7d/d8b/d94/d136 0 2024-04-26T21:26:10.127 INFO:tasks.workunit.client.1.smithi120.stdout:1/903: truncate d6/d9/dd4/de0/d2d/d98/d35/fc5 5394495 0 2024-04-26T21:26:10.127 INFO:tasks.workunit.client.0.smithi084.stdout:7/813: mknod d6/d26/d40/dec/c11f 0 2024-04-26T21:26:10.127 INFO:tasks.workunit.client.0.smithi084.stdout:1/769: link d2/d9/c52 d2/c105 0 2024-04-26T21:26:10.128 INFO:tasks.workunit.client.1.smithi120.stdout:3/976: symlink dd/de/d83/db2/l13b 0 2024-04-26T21:26:10.129 INFO:tasks.workunit.client.0.smithi084.stdout:1/770: write d2/d19/f1e [53867,107009] 0 2024-04-26T21:26:10.131 INFO:tasks.workunit.client.0.smithi084.stdout:6/722: sync 2024-04-26T21:26:10.131 INFO:tasks.workunit.client.0.smithi084.stdout:0/751: sync 2024-04-26T21:26:10.131 INFO:tasks.workunit.client.0.smithi084.stdout:2/871: sync 2024-04-26T21:26:10.132 INFO:tasks.workunit.client.1.smithi120.stdout:8/942: dwrite d5/d6/d11/d52/fe9 [4194304,4194304] 0 2024-04-26T21:26:10.133 INFO:tasks.workunit.client.0.smithi084.stdout:2/872: chown d6/d7/c113 3249733 1 2024-04-26T21:26:10.134 INFO:tasks.workunit.client.1.smithi120.stdout:6/982: dwrite d4/db/d10/dd/f36 [0,4194304] 0 2024-04-26T21:26:10.134 INFO:tasks.workunit.client.0.smithi084.stdout:7/814: write d6/d9/d12/d19/d20/d38/d112/f99 [896298,72225] 0 2024-04-26T21:26:10.135 INFO:tasks.workunit.client.1.smithi120.stdout:2/943: sync 2024-04-26T21:26:10.138 INFO:tasks.workunit.client.0.smithi084.stdout:1/771: chown d2/d19/c8f 0 1 2024-04-26T21:26:10.140 INFO:tasks.workunit.client.1.smithi120.stdout:6/983: readlink d4/db/d10/d22/d56/d94/lc7 0 2024-04-26T21:26:10.140 INFO:tasks.workunit.client.1.smithi120.stdout:2/944: chown d4/d1b/d25/d2c/d3e/d5e/f10e 429157 1 2024-04-26T21:26:10.140 INFO:tasks.workunit.client.1.smithi120.stdout:1/904: rename d6/d14/cd8 to d6/d9/dd4/c12d 0 2024-04-26T21:26:10.143 INFO:tasks.workunit.client.1.smithi120.stdout:3/977: mknod dd/de/df/dda/d24/d9d/d86/d10d/c13c 0 2024-04-26T21:26:10.143 INFO:tasks.workunit.client.1.smithi120.stdout:7/942: unlink d7/d64/da6/d1a/d50/dfa/d131/l98 0 2024-04-26T21:26:10.143 INFO:tasks.workunit.client.0.smithi084.stdout:7/815: chown d6/d68/d7f/fc1 286396998 1 2024-04-26T21:26:10.144 INFO:tasks.workunit.client.0.smithi084.stdout:8/787: dwrite d4/d6/db/d1e/d22/d39/d4a/fe6 [0,4194304] 0 2024-04-26T21:26:10.147 INFO:tasks.workunit.client.0.smithi084.stdout:6/723: truncate d3/de/d15/d23/f35 712892 0 2024-04-26T21:26:10.150 INFO:tasks.workunit.client.1.smithi120.stdout:6/984: read d4/db/ffb [149840,121904] 0 2024-04-26T21:26:10.150 INFO:tasks.workunit.client.1.smithi120.stdout:5/975: truncate d2/dc/d1d/d21/f129 1101730 0 2024-04-26T21:26:10.153 INFO:tasks.workunit.client.0.smithi084.stdout:1/772: fsync d2/d54/d5e/d66/d2a/d2c/d45/fe1 0 2024-04-26T21:26:10.154 INFO:tasks.workunit.client.1.smithi120.stdout:8/943: mkdir d5/d6/d34/d42/d9d/d7a/da4/d123/d13a 0 2024-04-26T21:26:10.154 INFO:tasks.workunit.client.1.smithi120.stdout:6/985: chown d4/db/d10/d22/d56/d94/ce9 31 1 2024-04-26T21:26:10.155 INFO:tasks.workunit.client.0.smithi084.stdout:8/788: symlink d4/d7/d15/da7/lec 0 2024-04-26T21:26:10.156 INFO:tasks.workunit.client.0.smithi084.stdout:0/752: write de/d2b/d77/f49 [386200,8108] 0 2024-04-26T21:26:10.159 INFO:tasks.workunit.client.1.smithi120.stdout:5/976: chown d2/d30/d93/d107/d34/d100 1180264155 1 2024-04-26T21:26:10.159 INFO:tasks.workunit.client.1.smithi120.stdout:7/943: symlink d7/d64/da6/d1a/dc2/l137 0 2024-04-26T21:26:10.160 INFO:tasks.workunit.client.1.smithi120.stdout:3/978: creat dd/de/df/d12/d48/d9b/dcb/d102/d108/f13d x:0 0 0 2024-04-26T21:26:10.160 INFO:tasks.workunit.client.1.smithi120.stdout:1/905: getdents d6/d9/dd4/de0/d1d/d5d/d12b 0 2024-04-26T21:26:10.163 INFO:tasks.workunit.client.1.smithi120.stdout:2/945: getdents d4/d1b/d2e/d5f 0 2024-04-26T21:26:10.164 INFO:tasks.workunit.client.0.smithi084.stdout:6/724: truncate d3/de/d1a/d2f/fab 640412 0 2024-04-26T21:26:10.165 INFO:tasks.workunit.client.1.smithi120.stdout:8/944: creat d5/d6/d11/d52/d136/f13b x:0 0 0 2024-04-26T21:26:10.166 INFO:tasks.workunit.client.0.smithi084.stdout:1/773: write d2/d54/d5e/d66/d2a/d72/dd8/ff5 [176677,46379] 0 2024-04-26T21:26:10.167 INFO:tasks.workunit.client.1.smithi120.stdout:7/944: dread - d7/d64/da6/d1f/d28/d4c/f102 zero size 2024-04-26T21:26:10.169 INFO:tasks.workunit.client.0.smithi084.stdout:9/686: dwrite da/dd5/d93/dc3/d41/d67/de9/ff3 [0,4194304] 0 2024-04-26T21:26:10.169 INFO:tasks.workunit.client.1.smithi120.stdout:3/979: truncate dd/d2a/d74/d12b/ddb/f9c 10281422 0 2024-04-26T21:26:10.169 INFO:tasks.workunit.client.1.smithi120.stdout:5/977: creat d2/dc/d1d/d21/d66/d6a/f160 x:0 0 0 2024-04-26T21:26:10.171 INFO:tasks.workunit.client.1.smithi120.stdout:9/908: dread d0/d6/d4d/d65/dec/d77/d9a/ddd/fe2 [0,4194304] 0 2024-04-26T21:26:10.173 INFO:tasks.workunit.client.1.smithi120.stdout:1/906: mkdir d6/d9/dd4/de0/d2d/d98/d56/d12e 0 2024-04-26T21:26:10.173 INFO:tasks.workunit.client.1.smithi120.stdout:2/946: mknod d4/d1b/d2e/d5f/df6/c13d 0 2024-04-26T21:26:10.173 INFO:tasks.workunit.client.0.smithi084.stdout:6/725: mkdir d3/de/d1a/d2f/d4c/d58/de7 0 2024-04-26T21:26:10.176 INFO:tasks.workunit.client.0.smithi084.stdout:9/687: write da/dd5/db6/fde [261714,67543] 0 2024-04-26T21:26:10.176 INFO:tasks.workunit.client.1.smithi120.stdout:3/980: mknod dd/d2a/d74/d12b/c13e 0 2024-04-26T21:26:10.177 INFO:tasks.workunit.client.0.smithi084.stdout:7/816: dwrite d6/d9/d63/f87 [4194304,4194304] 0 2024-04-26T21:26:10.178 INFO:tasks.workunit.client.1.smithi120.stdout:6/986: read d4/db/d10/dd/d28/f61 [1667661,14441] 0 2024-04-26T21:26:10.179 INFO:tasks.workunit.client.0.smithi084.stdout:8/789: rmdir d4/d7/d15 39 2024-04-26T21:26:10.180 INFO:tasks.workunit.client.1.smithi120.stdout:3/981: stat dd/de/df/dda/d24/db1/d76/c30 0 2024-04-26T21:26:10.180 INFO:tasks.workunit.client.1.smithi120.stdout:2/947: fsync d4/d1b/d2e/f92 0 2024-04-26T21:26:10.185 INFO:tasks.workunit.client.1.smithi120.stdout:5/978: mknod d2/dc/d1d/d21/d77/d79/dd9/c161 0 2024-04-26T21:26:10.185 INFO:tasks.workunit.client.1.smithi120.stdout:2/948: readlink d4/d1b/d25/d29/d128/lce 0 2024-04-26T21:26:10.187 INFO:tasks.workunit.client.1.smithi120.stdout:1/907: symlink d6/d9/dd4/de0/d1d/d5d/df2/l12f 0 2024-04-26T21:26:10.188 INFO:tasks.workunit.client.0.smithi084.stdout:6/726: chown d3/de/d15/l91 17681698 1 2024-04-26T21:26:10.189 INFO:tasks.workunit.client.1.smithi120.stdout:6/987: creat d4/db/d10/d22/d6c/f143 x:0 0 0 2024-04-26T21:26:10.191 INFO:tasks.workunit.client.0.smithi084.stdout:2/873: dwrite d6/d7/d3d/d79/d81/fc3 [0,4194304] 0 2024-04-26T21:26:10.191 INFO:tasks.workunit.client.0.smithi084.stdout:9/688: creat da/dd5/d93/dc3/d41/d43/d48/d61/d81/ffd x:0 0 0 2024-04-26T21:26:10.195 INFO:tasks.workunit.client.1.smithi120.stdout:5/979: mknod d2/d30/d93/d107/d36/d44/d6c/c162 0 2024-04-26T21:26:10.196 INFO:tasks.workunit.client.1.smithi120.stdout:1/908: creat d6/d9/dd4/de0/d2d/d48/d86/f130 x:0 0 0 2024-04-26T21:26:10.198 INFO:tasks.workunit.client.1.smithi120.stdout:2/949: symlink d4/d1b/d5c/d99/l13e 0 2024-04-26T21:26:10.199 INFO:tasks.workunit.client.0.smithi084.stdout:8/790: truncate d4/d6/db/d1e/f8e 1071172 0 2024-04-26T21:26:10.200 INFO:tasks.workunit.client.1.smithi120.stdout:1/909: dread - d6/d9/dd4/f100 zero size 2024-04-26T21:26:10.202 INFO:tasks.workunit.client.0.smithi084.stdout:1/774: dwrite d2/d1b/f65 [0,4194304] 0 2024-04-26T21:26:10.202 INFO:tasks.workunit.client.0.smithi084.stdout:0/753: dwrite de/d20/d4e/f60 [0,4194304] 0 2024-04-26T21:26:10.202 INFO:tasks.workunit.client.1.smithi120.stdout:5/980: creat d2/d82/d11f/f163 x:0 0 0 2024-04-26T21:26:10.203 INFO:tasks.workunit.client.0.smithi084.stdout:9/689: rename da/dd5/d93/dc3/d41/ca3 to da/d9e/cfe 0 2024-04-26T21:26:10.207 INFO:tasks.workunit.client.1.smithi120.stdout:6/988: dread d4/db/d10/d1a/dcd/fd2 [0,4194304] 0 2024-04-26T21:26:10.208 INFO:tasks.workunit.client.1.smithi120.stdout:1/910: read d6/d9/dd4/de0/d1d/f50 [8862349,2803] 0 2024-04-26T21:26:10.213 INFO:tasks.workunit.client.1.smithi120.stdout:2/950: dread - d4/d1b/d4f/f124 zero size 2024-04-26T21:26:10.213 INFO:tasks.workunit.client.0.smithi084.stdout:8/791: mknod d4/ced 0 2024-04-26T21:26:10.215 INFO:tasks.workunit.client.1.smithi120.stdout:6/989: truncate d4/db/d10/d1a/d2b/d57/fe6 1736187 0 2024-04-26T21:26:10.217 INFO:tasks.workunit.client.0.smithi084.stdout:1/775: rmdir d2/d54/d5e/d66/d2a/dff 39 2024-04-26T21:26:10.218 INFO:tasks.workunit.client.0.smithi084.stdout:9/690: mknod da/d9e/cff 0 2024-04-26T21:26:10.220 INFO:tasks.workunit.client.0.smithi084.stdout:2/874: rename d6/d1b/c52 to d6/d7/d3d/d15/c124 0 2024-04-26T21:26:10.226 INFO:tasks.workunit.client.0.smithi084.stdout:9/691: dread - da/dd5/d93/d95/daa/fcd zero size 2024-04-26T21:26:10.226 INFO:tasks.workunit.client.0.smithi084.stdout:8/792: symlink d4/d6/db/d9b/lee 0 2024-04-26T21:26:10.226 INFO:tasks.workunit.client.0.smithi084.stdout:1/776: mkdir d2/d54/d93/d106 0 2024-04-26T21:26:10.227 INFO:tasks.workunit.client.1.smithi120.stdout:1/911: mkdir d6/d9/dd4/de0/d2d/d98/d56/dad/d131 0 2024-04-26T21:26:10.230 INFO:tasks.workunit.client.0.smithi084.stdout:1/777: dread - d2/d9/d15/d28/d5a/fd5 zero size 2024-04-26T21:26:10.231 INFO:tasks.workunit.client.1.smithi120.stdout:8/945: dread d5/d6/d11/d52/fe9 [12582912,4194304] 0 2024-04-26T21:26:10.232 INFO:tasks.workunit.client.0.smithi084.stdout:9/692: write da/dd5/d93/dc3/d41/d43/d48/d61/df0/ffc [921842,4262] 0 2024-04-26T21:26:10.232 INFO:tasks.workunit.client.1.smithi120.stdout:7/945: truncate d7/d19/f51 2398571 0 2024-04-26T21:26:10.233 INFO:tasks.workunit.client.0.smithi084.stdout:2/875: fdatasync d6/d105/fdc 0 2024-04-26T21:26:10.234 INFO:tasks.workunit.client.1.smithi120.stdout:9/909: write d0/d6/d4d/d65/dec/d77/dc5/fe1 [506403,40790] 0 2024-04-26T21:26:10.241 INFO:tasks.workunit.client.1.smithi120.stdout:2/951: mknod d4/d1b/d25/d2c/d3e/d5e/d63/dcb/c13f 0 2024-04-26T21:26:10.241 INFO:tasks.workunit.client.1.smithi120.stdout:1/912: chown d6/d9/dd4/de0/d2d/d48/f123 1207393 1 2024-04-26T21:26:10.245 INFO:tasks.workunit.client.1.smithi120.stdout:1/913: dread - d6/d14/f121 zero size 2024-04-26T21:26:10.245 INFO:tasks.workunit.client.0.smithi084.stdout:2/876: read d6/d7/d3d/d15/d1f/d39/d20/d45/f60 [302849,94544] 0 2024-04-26T21:26:10.250 INFO:tasks.workunit.client.1.smithi120.stdout:2/952: chown d4/d1b/d4f/df8/l12e 0 1 2024-04-26T21:26:10.251 INFO:tasks.workunit.client.1.smithi120.stdout:3/982: write dd/de/df/dda/d24/ffa [2053334,76310] 0 2024-04-26T21:26:10.251 INFO:tasks.workunit.client.0.smithi084.stdout:0/754: dwrite de/d20/d4c/fba [0,4194304] 0 2024-04-26T21:26:10.253 INFO:tasks.workunit.client.0.smithi084.stdout:3/770: sync 2024-04-26T21:26:10.253 INFO:tasks.workunit.client.0.smithi084.stdout:5/747: sync 2024-04-26T21:26:10.255 INFO:tasks.workunit.client.0.smithi084.stdout:9/693: link da/dd5/d93/dc3/d41/d43/d48/d61/f8a da/f100 0 2024-04-26T21:26:10.256 INFO:tasks.workunit.client.0.smithi084.stdout:6/727: dread d3/d18/f20 [0,4194304] 0 2024-04-26T21:26:10.258 INFO:tasks.workunit.client.1.smithi120.stdout:3/983: truncate dd/de/df/dda/d8d/ff8 584753 0 2024-04-26T21:26:10.258 INFO:tasks.workunit.client.0.smithi084.stdout:8/793: dwrite d4/d6/f40 [0,4194304] 0 2024-04-26T21:26:10.263 INFO:tasks.workunit.client.1.smithi120.stdout:7/946: rename d7/d19/d60/daa/le4 to d7/d64/da6/d1f/d28/l138 0 2024-04-26T21:26:10.265 INFO:tasks.workunit.client.1.smithi120.stdout:5/981: dread d2/dc/d1d/d21/d66/f14 [0,4194304] 0 2024-04-26T21:26:10.267 INFO:tasks.workunit.client.0.smithi084.stdout:5/748: symlink d0/dc/df/d75/le7 0 2024-04-26T21:26:10.268 INFO:tasks.workunit.client.1.smithi120.stdout:2/953: unlink d4/d1b/d25/d2c/d3e/f81 0 2024-04-26T21:26:10.271 INFO:tasks.workunit.client.0.smithi084.stdout:4/711: sync 2024-04-26T21:26:10.272 INFO:tasks.workunit.client.0.smithi084.stdout:1/778: dwrite d2/d9/d15/d9f/fb3 [0,4194304] 0 2024-04-26T21:26:10.272 INFO:tasks.workunit.client.0.smithi084.stdout:9/694: mknod da/d9e/c101 0 2024-04-26T21:26:10.286 INFO:tasks.workunit.client.0.smithi084.stdout:7/817: dread d6/d68/d7f/d107/d84/f27 [0,4194304] 0 2024-04-26T21:26:10.288 INFO:tasks.workunit.client.0.smithi084.stdout:2/877: mkdir d6/d7/d3d/d15/d1f/d39/d20/d45/d6d/d125 0 2024-04-26T21:26:10.288 INFO:tasks.workunit.client.0.smithi084.stdout:0/755: dwrite de/d20/d4e/f6a [4194304,4194304] 0 2024-04-26T21:26:10.290 INFO:tasks.workunit.client.1.smithi120.stdout:7/947: creat d7/d64/da6/d1f/d7d/f139 x:0 0 0 2024-04-26T21:26:10.291 INFO:tasks.workunit.client.1.smithi120.stdout:6/990: dwrite d4/f1f [0,4194304] 0 2024-04-26T21:26:10.294 INFO:tasks.workunit.client.1.smithi120.stdout:5/982: creat d2/d1b/d89/d47/de4/d10f/f164 x:0 0 0 2024-04-26T21:26:10.295 INFO:tasks.workunit.client.0.smithi084.stdout:5/749: rename d0/dc/l85 to d0/d49/d56/de5/le8 0 2024-04-26T21:26:10.298 INFO:tasks.workunit.client.0.smithi084.stdout:4/712: mkdir d5/d2e/de5 0 2024-04-26T21:26:10.301 INFO:tasks.workunit.client.1.smithi120.stdout:8/946: truncate d5/d6/d34/d42/d102/d118/fdb 1488291 0 2024-04-26T21:26:10.303 INFO:tasks.workunit.client.0.smithi084.stdout:8/794: write d4/d6/f47 [1417757,64226] 0 2024-04-26T21:26:10.303 INFO:tasks.workunit.client.0.smithi084.stdout:7/818: write d6/d1c/f4e [2652522,36223] 0 2024-04-26T21:26:10.307 INFO:tasks.workunit.client.0.smithi084.stdout:0/756: fsync de/d2b/d77/f49 0 2024-04-26T21:26:10.308 INFO:tasks.workunit.client.0.smithi084.stdout:5/750: dread - d0/dc/df/d31/d63/d6e/fa6 zero size 2024-04-26T21:26:10.310 INFO:tasks.workunit.client.1.smithi120.stdout:7/948: mknod d7/d10/c13a 0 2024-04-26T21:26:10.312 INFO:tasks.workunit.client.0.smithi084.stdout:7/819: fsync d6/d68/f9f 0 2024-04-26T21:26:10.312 INFO:tasks.workunit.client.0.smithi084.stdout:4/713: rename d5/d25/d35/d60/d6d/de1/f4b to d5/d25/d99/da0/fe6 0 2024-04-26T21:26:10.315 INFO:tasks.workunit.client.0.smithi084.stdout:2/878: mknod d6/d7/d3d/d15/d1f/d39/c126 0 2024-04-26T21:26:10.315 INFO:tasks.workunit.client.0.smithi084.stdout:6/728: dwrite d3/de/d15/d23/f30 [0,4194304] 0 2024-04-26T21:26:10.317 INFO:tasks.workunit.client.1.smithi120.stdout:6/991: symlink d4/db/d10/dd/d28/d9e/daf/l144 0 2024-04-26T21:26:10.318 INFO:tasks.workunit.client.1.smithi120.stdout:3/984: link dd/de/df/dda/d24/db1/d76/d3b/d56/cc3 dd/de/df/d12/d48/d9b/dcb/dee/c13f 0 2024-04-26T21:26:10.318 INFO:tasks.workunit.client.1.smithi120.stdout:8/947: readlink d5/d6/d34/d42/d9d/lf2 0 2024-04-26T21:26:10.320 INFO:tasks.workunit.client.0.smithi084.stdout:7/820: chown d6/d9/d10e 23432 1 2024-04-26T21:26:10.321 INFO:tasks.workunit.client.0.smithi084.stdout:7/821: dread - d6/d1c/fe3 zero size 2024-04-26T21:26:10.321 INFO:tasks.workunit.client.1.smithi120.stdout:8/948: read d5/d6/d11/d52/d27/d4f/d67/fad [985769,7765] 0 2024-04-26T21:26:10.323 INFO:tasks.workunit.client.1.smithi120.stdout:8/949: chown d5/d6/d11/d52/d27/ffe 1535154 1 2024-04-26T21:26:10.325 INFO:tasks.workunit.client.1.smithi120.stdout:8/950: fdatasync d5/d6/d34/d42/d4a/deb/f12f 0 2024-04-26T21:26:10.326 INFO:tasks.workunit.client.0.smithi084.stdout:1/779: truncate d2/d54/d5e/d66/d2a/d72/f82 3036561 0 2024-04-26T21:26:10.326 INFO:tasks.workunit.client.1.smithi120.stdout:7/949: unlink d7/d19/l47 0 2024-04-26T21:26:10.328 INFO:tasks.workunit.client.0.smithi084.stdout:8/795: chown d4/d6/db/d1e/d22/d39/d4a/la1 41273290 1 2024-04-26T21:26:10.331 INFO:tasks.workunit.client.0.smithi084.stdout:9/695: dwrite da/de/d16/f1c [4194304,4194304] 0 2024-04-26T21:26:10.331 INFO:tasks.workunit.client.0.smithi084.stdout:7/822: fsync d6/d9/d12/f3d 0 2024-04-26T21:26:10.336 INFO:tasks.workunit.client.0.smithi084.stdout:2/879: mkdir d6/d7/db6/d115/d127 0 2024-04-26T21:26:10.339 INFO:tasks.workunit.client.0.smithi084.stdout:5/751: getdents d0/dc/df/d6d 0 2024-04-26T21:26:10.341 INFO:tasks.workunit.client.1.smithi120.stdout:3/985: write dd/de/df/dda/d24/db1/fb7 [2310847,12709] 0 2024-04-26T21:26:10.342 INFO:tasks.workunit.client.0.smithi084.stdout:1/780: write d2/d19/d63/f96 [3211675,95744] 0 2024-04-26T21:26:10.343 INFO:tasks.workunit.client.1.smithi120.stdout:3/986: chown dd/d2a/f118 3488 1 2024-04-26T21:26:10.345 INFO:tasks.workunit.client.1.smithi120.stdout:6/992: symlink d4/db/d10/d1a/d2b/d57/d67/d98/l145 0 2024-04-26T21:26:10.346 INFO:tasks.workunit.client.0.smithi084.stdout:1/781: dread - d2/d9/d15/d28/d5a/fd5 zero size 2024-04-26T21:26:10.346 INFO:tasks.workunit.client.1.smithi120.stdout:7/950: dread - d7/d64/fae zero size 2024-04-26T21:26:10.347 INFO:tasks.workunit.client.0.smithi084.stdout:4/714: dread d5/d25/d99/da0/fe6 [0,4194304] 0 2024-04-26T21:26:10.348 INFO:tasks.workunit.client.1.smithi120.stdout:5/983: link d2/d30/d3b/l9b d2/dc/d1d/d21/d77/d9c/d144/l165 0 2024-04-26T21:26:10.349 INFO:tasks.workunit.client.0.smithi084.stdout:5/752: rename d0/dc/df/d31/d63/d8a to d0/dc/d48/de9 0 2024-04-26T21:26:10.351 INFO:tasks.workunit.client.0.smithi084.stdout:3/771: dread d1/d24/d27/d3a/f62 [0,4194304] 0 2024-04-26T21:26:10.352 INFO:tasks.workunit.client.0.smithi084.stdout:8/796: mknod d4/d7/d15/d37/d52/d69/cef 0 2024-04-26T21:26:10.354 INFO:tasks.workunit.client.0.smithi084.stdout:9/696: link da/f100 da/dd5/d93/dc3/d41/d43/d48/d61/f102 0 2024-04-26T21:26:10.355 INFO:tasks.workunit.client.0.smithi084.stdout:4/715: mknod d5/d7/d65/d90/ce7 0 2024-04-26T21:26:10.356 INFO:tasks.workunit.client.0.smithi084.stdout:7/823: mknod d6/d9/d12/d19/d20/d38/c120 0 2024-04-26T21:26:10.358 INFO:tasks.workunit.client.1.smithi120.stdout:3/987: mkdir dd/d2a/d74/d12b/d140 0 2024-04-26T21:26:10.358 INFO:tasks.workunit.client.1.smithi120.stdout:7/951: creat d7/d10/d97/f13b x:0 0 0 2024-04-26T21:26:10.359 INFO:tasks.workunit.client.0.smithi084.stdout:8/797: stat d4/d6/db/d1e/d22/d39/d4a/f8f 0 2024-04-26T21:26:10.359 INFO:tasks.workunit.client.1.smithi120.stdout:2/954: link d4/d1b/d2e/d50/d14/dc2/lc9 d4/d1b/d2e/d50/d14/d15/l140 0 2024-04-26T21:26:10.360 INFO:tasks.workunit.client.0.smithi084.stdout:3/772: chown d1/d24/d27/c4f 1 1 2024-04-26T21:26:10.361 INFO:tasks.workunit.client.0.smithi084.stdout:7/824: readlink d6/d68/d7f/l97 0 2024-04-26T21:26:10.362 INFO:tasks.workunit.client.0.smithi084.stdout:1/782: dread d2/d19/f40 [0,4194304] 0 2024-04-26T21:26:10.363 INFO:tasks.workunit.client.1.smithi120.stdout:2/955: stat d4/d1b/d25/d29/d128/de9 0 2024-04-26T21:26:10.363 INFO:tasks.workunit.client.1.smithi120.stdout:7/952: truncate d7/d64/da6/d1f/f12f 1041451 0 2024-04-26T21:26:10.365 INFO:tasks.workunit.client.0.smithi084.stdout:1/783: stat d2/d54/d5e/d8d/cb6 0 2024-04-26T21:26:10.365 INFO:tasks.workunit.client.1.smithi120.stdout:5/984: getdents d2 0 2024-04-26T21:26:10.366 INFO:tasks.workunit.client.0.smithi084.stdout:7/825: chown d6/d9/d12/d19/d20/d32/l37 241987826 1 2024-04-26T21:26:10.366 INFO:tasks.workunit.client.0.smithi084.stdout:4/716: creat d5/d10/d82/fe8 x:0 0 0 2024-04-26T21:26:10.367 INFO:tasks.workunit.client.0.smithi084.stdout:0/757: truncate de/d20/f5e 12578257 0 2024-04-26T21:26:10.369 INFO:tasks.workunit.client.0.smithi084.stdout:4/717: chown d5/d10/f18 878815997 1 2024-04-26T21:26:10.370 INFO:tasks.workunit.client.1.smithi120.stdout:7/953: creat d7/d10/d97/f13c x:0 0 0 2024-04-26T21:26:10.371 INFO:tasks.workunit.client.0.smithi084.stdout:9/697: mknod da/dd5/d93/dc3/d41/de4/c103 0 2024-04-26T21:26:10.372 INFO:tasks.workunit.client.1.smithi120.stdout:5/985: fsync d2/dc/d1d/d21/d77/d79/dd9/f111 0 2024-04-26T21:26:10.373 INFO:tasks.workunit.client.0.smithi084.stdout:4/718: chown d5/d7/d65/d7f/db8/f7e 774442 1 2024-04-26T21:26:10.375 INFO:tasks.workunit.client.1.smithi120.stdout:7/954: mknod d7/d64/da6/d1f/d28/d11d/c13d 0 2024-04-26T21:26:10.377 INFO:tasks.workunit.client.0.smithi084.stdout:5/753: rename d0/dc/df/d31/d53/d87/f9f to d0/dc/df/d31/d72/fea 0 2024-04-26T21:26:10.378 INFO:tasks.workunit.client.0.smithi084.stdout:3/773: fdatasync d1/d2c/d2f/d31/d55/d4e/d7c/f87 0 2024-04-26T21:26:10.381 INFO:tasks.workunit.client.0.smithi084.stdout:5/754: dread - d0/dc/d48/f77 zero size 2024-04-26T21:26:10.381 INFO:tasks.workunit.client.0.smithi084.stdout:3/774: stat d1/d24/d27/d3a/d81/cf2 0 2024-04-26T21:26:10.382 INFO:tasks.workunit.client.1.smithi120.stdout:7/955: creat d7/d122/f13e x:0 0 0 2024-04-26T21:26:10.383 INFO:tasks.workunit.client.1.smithi120.stdout:3/988: dread dd/de/df/db6/fd1 [0,4194304] 0 2024-04-26T21:26:10.385 INFO:tasks.workunit.client.1.smithi120.stdout:3/989: fsync dd/de/df/dda/d24/f11c 0 2024-04-26T21:26:10.386 INFO:tasks.workunit.client.1.smithi120.stdout:2/956: dwrite d4/d1b/d25/d2c/d3e/f11d [0,4194304] 0 2024-04-26T21:26:10.386 INFO:tasks.workunit.client.0.smithi084.stdout:2/880: write d6/d7/d3d/d15/d1f/d39/d20/d36/f5d [4118885,109795] 0 2024-04-26T21:26:10.387 INFO:tasks.workunit.client.0.smithi084.stdout:8/798: creat d4/d6/db/d9b/dd4/de2/ff0 x:0 0 0 2024-04-26T21:26:10.390 INFO:tasks.workunit.client.0.smithi084.stdout:3/775: write d1/d24/d27/d3a/d81/ff3 [265461,112255] 0 2024-04-26T21:26:10.391 INFO:tasks.workunit.client.1.smithi120.stdout:7/956: rename d7/d10/f30 to d7/d64/f13f 0 2024-04-26T21:26:10.394 INFO:tasks.workunit.client.0.smithi084.stdout:1/784: rename d2/d1b/l31 to d2/d54/d5e/dbe/l107 0 2024-04-26T21:26:10.395 INFO:tasks.workunit.client.0.smithi084.stdout:7/826: dwrite d6/d9/d12/d8b/d72/f117 [0,4194304] 0 2024-04-26T21:26:10.400 INFO:tasks.workunit.client.0.smithi084.stdout:4/719: truncate d5/d25/d35/f3a 1220981 0 2024-04-26T21:26:10.401 INFO:tasks.workunit.client.0.smithi084.stdout:7/827: readlink d6/d26/l69 0 2024-04-26T21:26:10.401 INFO:tasks.workunit.client.0.smithi084.stdout:8/799: stat d4/d6/db/d1e/d22/d2f/cb1 0 2024-04-26T21:26:10.402 INFO:tasks.workunit.client.0.smithi084.stdout:0/758: creat de/fec x:0 0 0 2024-04-26T21:26:10.403 INFO:tasks.workunit.client.1.smithi120.stdout:7/957: fdatasync d7/d19/d60/daa/ff3 0 2024-04-26T21:26:10.404 INFO:tasks.workunit.client.1.smithi120.stdout:8/951: dread d5/d6/f1e [0,4194304] 0 2024-04-26T21:26:10.405 INFO:tasks.workunit.client.1.smithi120.stdout:3/990: rename dd/de/df/dda/d24/ffa to dd/de/d83/db2/ded/f141 0 2024-04-26T21:26:10.409 INFO:tasks.workunit.client.0.smithi084.stdout:8/800: read d4/d6/db/d1e/fd5 [2549978,120705] 0 2024-04-26T21:26:10.410 INFO:tasks.workunit.client.0.smithi084.stdout:4/720: creat d5/d10/fe9 x:0 0 0 2024-04-26T21:26:10.411 INFO:tasks.workunit.client.1.smithi120.stdout:5/986: write d2/d82/d96/f11c [1025474,112617] 0 2024-04-26T21:26:10.412 INFO:tasks.workunit.client.1.smithi120.stdout:2/957: rename d4/d1b/d2e/la5 to d4/d1b/d2e/d5f/df6/dfa/l141 0 2024-04-26T21:26:10.412 INFO:tasks.workunit.client.0.smithi084.stdout:6/729: dread d3/d18/d81/fa8 [0,4194304] 0 2024-04-26T21:26:10.414 INFO:tasks.workunit.client.0.smithi084.stdout:8/801: chown d4/d6/db/d1e/d22/d2f 1631 1 2024-04-26T21:26:10.417 INFO:tasks.workunit.client.0.smithi084.stdout:4/721: dread d5/d2e/f88 [0,4194304] 0 2024-04-26T21:26:10.419 INFO:tasks.workunit.client.1.smithi120.stdout:8/952: rename d5/d6/d34/d42/d102/d118/db8/ddc/l109 to d5/d6/d34/d42/d102/l13c 0 2024-04-26T21:26:10.419 INFO:tasks.workunit.client.0.smithi084.stdout:7/828: rmdir d6/d9/d10e 0 2024-04-26T21:26:10.421 INFO:tasks.workunit.client.0.smithi084.stdout:4/722: chown d5/d7/d65/d7f/c53 9788 1 2024-04-26T21:26:10.422 INFO:tasks.workunit.client.1.smithi120.stdout:5/987: symlink d2/dc/d1d/d21/db2/dde/d10c/l166 0 2024-04-26T21:26:10.428 INFO:tasks.workunit.client.0.smithi084.stdout:8/802: creat d4/d7/d15/d37/d3b/ff1 x:0 0 0 2024-04-26T21:26:10.430 INFO:tasks.workunit.client.0.smithi084.stdout:5/755: link d0/dc/df/d31/lc5 d0/dc/df/d31/leb 0 2024-04-26T21:26:10.430 INFO:tasks.workunit.client.0.smithi084.stdout:2/881: write d6/d7/d3d/d15/d1f/d39/d20/f3a [5731533,80488] 0 2024-04-26T21:26:10.431 INFO:tasks.workunit.client.1.smithi120.stdout:3/991: rename dd/de/d83/f45 to dd/de/df/dda/d24/db1/d76/d3b/d56/d75/f142 0 2024-04-26T21:26:10.434 INFO:tasks.workunit.client.0.smithi084.stdout:6/730: symlink d3/de/d1a/d2f/d4c/da0/le8 0 2024-04-26T21:26:10.436 INFO:tasks.workunit.client.0.smithi084.stdout:3/776: write d1/d2c/d2f/d31/d55/f6a [2860612,128951] 0 2024-04-26T21:26:10.436 INFO:tasks.workunit.client.0.smithi084.stdout:8/803: unlink d4/d7/d15/d37/d52/d69/fba 0 2024-04-26T21:26:10.437 INFO:tasks.workunit.client.0.smithi084.stdout:5/756: creat d0/dc/df/d31/d45/fec x:0 0 0 2024-04-26T21:26:10.438 INFO:tasks.workunit.client.0.smithi084.stdout:6/731: dread - d3/d18/f5b zero size 2024-04-26T21:26:10.439 INFO:tasks.workunit.client.0.smithi084.stdout:2/882: mkdir d6/d7/d3d/d15/d1f/d39/da5/d128 0 2024-04-26T21:26:10.440 INFO:tasks.workunit.client.1.smithi120.stdout:2/958: link d4/d1b/d25/cd0 d4/d1b/d56/d65/d8d/c142 0 2024-04-26T21:26:10.443 INFO:tasks.workunit.client.0.smithi084.stdout:0/759: write de/d2b/d77/d32/d96/da0/fc1 [965143,79295] 0 2024-04-26T21:26:10.445 INFO:tasks.workunit.client.1.smithi120.stdout:2/959: creat d4/d1b/d56/f143 x:0 0 0 2024-04-26T21:26:10.447 INFO:tasks.workunit.client.0.smithi084.stdout:6/732: chown d3/de/d15/d23/d90/fe4 151013984 1 2024-04-26T21:26:10.447 INFO:tasks.workunit.client.0.smithi084.stdout:4/723: dread d5/d25/d99/da0/fe6 [0,4194304] 0 2024-04-26T21:26:10.447 INFO:tasks.workunit.client.1.smithi120.stdout:2/960: fdatasync d4/d1b/d2e/d50/d14/f120 0 2024-04-26T21:26:10.447 INFO:tasks.workunit.client.1.smithi120.stdout:7/958: dwrite d7/d64/da6/d1a/d50/dfa/d131/f83 [0,4194304] 0 2024-04-26T21:26:10.451 INFO:tasks.workunit.client.1.smithi120.stdout:1/914: sync 2024-04-26T21:26:10.451 INFO:tasks.workunit.client.1.smithi120.stdout:9/910: sync 2024-04-26T21:26:10.452 INFO:tasks.workunit.client.0.smithi084.stdout:0/760: symlink de/d2b/d45/d63/led 0 2024-04-26T21:26:10.454 INFO:tasks.workunit.client.0.smithi084.stdout:3/777: symlink d1/d2c/d2f/d31/d55/da4/l114 0 2024-04-26T21:26:10.455 INFO:tasks.workunit.client.0.smithi084.stdout:9/698: dread da/f100 [0,4194304] 0 2024-04-26T21:26:10.456 INFO:tasks.workunit.client.1.smithi120.stdout:5/988: write d2/dc/d1d/d21/d66/d6a/d8c/fca [312487,30082] 0 2024-04-26T21:26:10.458 INFO:tasks.workunit.client.1.smithi120.stdout:2/961: creat d4/d1b/d25/d29/d128/de9/f144 x:0 0 0 2024-04-26T21:26:10.459 INFO:tasks.workunit.client.0.smithi084.stdout:1/785: dread d2/d54/d5e/d66/d3a/fb4 [0,4194304] 0 2024-04-26T21:26:10.459 INFO:tasks.workunit.client.0.smithi084.stdout:3/778: chown d1/d2c/d2f/d31/da8/l10b 0 1 2024-04-26T21:26:10.459 INFO:tasks.workunit.client.0.smithi084.stdout:4/724: creat d5/d7/fea x:0 0 0 2024-04-26T21:26:10.460 INFO:tasks.workunit.client.0.smithi084.stdout:6/733: unlink d3/de/d1a/d2f/d4c/d58/l5e 0 2024-04-26T21:26:10.467 INFO:tasks.workunit.client.1.smithi120.stdout:7/959: dread d7/d64/da6/d2f/f63 [0,4194304] 0 2024-04-26T21:26:10.469 INFO:tasks.workunit.client.0.smithi084.stdout:3/779: dread - d1/d2c/d2f/d31/d55/d4e/f8f zero size 2024-04-26T21:26:10.469 INFO:tasks.workunit.client.0.smithi084.stdout:0/761: symlink de/d2b/d45/d63/da7/lee 0 2024-04-26T21:26:10.469 INFO:tasks.workunit.client.1.smithi120.stdout:8/953: dread d5/d6/d11/d52/d27/f9b [0,4194304] 0 2024-04-26T21:26:10.470 INFO:tasks.workunit.client.0.smithi084.stdout:1/786: creat d2/d19/d63/f108 x:0 0 0 2024-04-26T21:26:10.470 INFO:tasks.workunit.client.1.smithi120.stdout:1/915: mkdir d6/d9/dd4/de0/d2d/d98/d35/d132 0 2024-04-26T21:26:10.471 INFO:tasks.workunit.client.0.smithi084.stdout:2/883: rename d6/d7/d3d/d15/d1f/d39/d20/d45/d6d/l9e to d6/d7/d3d/d79/l129 0 2024-04-26T21:26:10.472 INFO:tasks.workunit.client.0.smithi084.stdout:7/829: dread d6/d9/d12/d8b/d72/da0/f85 [0,4194304] 0 2024-04-26T21:26:10.472 INFO:tasks.workunit.client.0.smithi084.stdout:8/804: dread d4/d7/d15/d3c/f90 [0,4194304] 0 2024-04-26T21:26:10.473 INFO:tasks.workunit.client.1.smithi120.stdout:5/989: creat d2/dc/d1d/d21/db2/dde/f167 x:0 0 0 2024-04-26T21:26:10.473 INFO:tasks.workunit.client.0.smithi084.stdout:9/699: mkdir da/dd5/d93/dc3/d4f/d104 0 2024-04-26T21:26:10.473 INFO:tasks.workunit.client.0.smithi084.stdout:1/787: stat d2/d54/d5e/d66/f36 0 2024-04-26T21:26:10.477 INFO:tasks.workunit.client.1.smithi120.stdout:3/992: dread dd/de/df/dda/f105 [0,4194304] 0 2024-04-26T21:26:10.477 INFO:tasks.workunit.client.1.smithi120.stdout:6/993: sync 2024-04-26T21:26:10.479 INFO:tasks.workunit.client.1.smithi120.stdout:3/993: chown dd/de/df/dda/d24/db1/d76/d3b 615637013 1 2024-04-26T21:26:10.479 INFO:tasks.workunit.client.0.smithi084.stdout:8/805: symlink d4/lf2 0 2024-04-26T21:26:10.480 INFO:tasks.workunit.client.0.smithi084.stdout:2/884: chown d6/d7/d3d/d79/fd3 55 1 2024-04-26T21:26:10.484 INFO:tasks.workunit.client.0.smithi084.stdout:7/830: write d6/d9/d12/d8b/d72/da0/fa1 [34796,94405] 0 2024-04-26T21:26:10.485 INFO:tasks.workunit.client.1.smithi120.stdout:1/916: read - d6/d9/dd4/de0/d2d/fbc zero size 2024-04-26T21:26:10.486 INFO:tasks.workunit.client.0.smithi084.stdout:9/700: mkdir da/dd5/d93/dc3/d41/d67/de9/d105 0 2024-04-26T21:26:10.487 INFO:tasks.workunit.client.1.smithi120.stdout:1/917: write d6/d14/ffa [91527,51684] 0 2024-04-26T21:26:10.488 INFO:tasks.workunit.client.0.smithi084.stdout:1/788: symlink d2/d54/d93/d106/l109 0 2024-04-26T21:26:10.489 INFO:tasks.workunit.client.1.smithi120.stdout:5/990: dwrite d2/d30/d3b/f4a [0,4194304] 0 2024-04-26T21:26:10.492 INFO:tasks.workunit.client.0.smithi084.stdout:5/757: dread d0/dc/df/d31/d45/f7d [0,4194304] 0 2024-04-26T21:26:10.492 INFO:tasks.workunit.client.1.smithi120.stdout:5/991: fsync d2/d1b/d89/d14f/f151 0 2024-04-26T21:26:10.496 INFO:tasks.workunit.client.1.smithi120.stdout:5/992: write d2/d1b/d89/d47/f11a [1292753,1333] 0 2024-04-26T21:26:10.496 INFO:tasks.workunit.client.0.smithi084.stdout:9/701: chown da/dd5/d93/dc3/d4f/f59 636781395 1 2024-04-26T21:26:10.496 INFO:tasks.workunit.client.0.smithi084.stdout:2/885: mkdir d6/d7/db6/d115/d127/d12a 0 2024-04-26T21:26:10.497 INFO:tasks.workunit.client.1.smithi120.stdout:3/994: rmdir dd/de/df/d12/d13a 39 2024-04-26T21:26:10.498 INFO:tasks.workunit.client.1.smithi120.stdout:7/960: mkdir d7/d64/da6/d1a/d50/d10d/d140 0 2024-04-26T21:26:10.498 INFO:tasks.workunit.client.1.smithi120.stdout:3/995: chown dd/d2a/le2 2 1 2024-04-26T21:26:10.498 INFO:tasks.workunit.client.0.smithi084.stdout:9/702: fdatasync da/f14 0 2024-04-26T21:26:10.501 INFO:tasks.workunit.client.0.smithi084.stdout:1/789: rmdir d2/d54/d5e/d66/d2a/d2c/d45 39 2024-04-26T21:26:10.502 INFO:tasks.workunit.client.1.smithi120.stdout:1/918: rename d6/d9/dd4/de0/d2d/d48/l7d to d6/d9/dd4/de0/d1d/d2c/d58/l133 0 2024-04-26T21:26:10.503 INFO:tasks.workunit.client.0.smithi084.stdout:3/780: write d1/d2c/d2f/d31/d55/d4e/d7c/f89 [348102,94923] 0 2024-04-26T21:26:10.504 INFO:tasks.workunit.client.1.smithi120.stdout:1/919: stat d6/d9/dd4/de0/d2d/d98/f42 0 2024-04-26T21:26:10.504 INFO:tasks.workunit.client.0.smithi084.stdout:0/762: link de/d2b/d64/d81/d9a/fd2 de/d2b/d77/fef 0 2024-04-26T21:26:10.505 INFO:tasks.workunit.client.1.smithi120.stdout:1/920: chown d6/d9/dd4/de0/d2d/d48/d86/dc1/fbd 3984615 1 2024-04-26T21:26:10.507 INFO:tasks.workunit.client.0.smithi084.stdout:6/734: dwrite d3/de/d15/f24 [4194304,4194304] 0 2024-04-26T21:26:10.510 INFO:tasks.workunit.client.0.smithi084.stdout:5/758: truncate d0/dc/df/d31/fc9 998390 0 2024-04-26T21:26:10.510 INFO:tasks.workunit.client.0.smithi084.stdout:8/806: write d4/d6/db/d1e/d22/d39/f82 [1807563,117292] 0 2024-04-26T21:26:10.513 INFO:tasks.workunit.client.0.smithi084.stdout:9/703: symlink da/de/d1e/d56/da6/l106 0 2024-04-26T21:26:10.514 INFO:tasks.workunit.client.1.smithi120.stdout:6/994: unlink d4/db/d25/cf6 0 2024-04-26T21:26:10.517 INFO:tasks.workunit.client.0.smithi084.stdout:3/781: write d1/d2c/d2f/f1f [5428004,107404] 0 2024-04-26T21:26:10.519 INFO:tasks.workunit.client.1.smithi120.stdout:8/954: write d5/d6/d11/d32/d3b/dd3/ff0 [7524,59244] 0 2024-04-26T21:26:10.519 INFO:tasks.workunit.client.1.smithi120.stdout:9/911: link d0/dd/d45/c69 d0/d6/d4d/d65/dec/d2d/d4b/dbc/c12f 0 2024-04-26T21:26:10.520 INFO:tasks.workunit.client.0.smithi084.stdout:9/704: readlink da/de/d1e/d56/da6/lb5 0 2024-04-26T21:26:10.521 INFO:tasks.workunit.client.0.smithi084.stdout:2/886: mknod d6/d7/d3d/d79/d81/c12b 0 2024-04-26T21:26:10.524 INFO:tasks.workunit.client.1.smithi120.stdout:8/955: truncate d5/d6/d34/d42/d102/d118/d94/fb4 1241350 0 2024-04-26T21:26:10.526 INFO:tasks.workunit.client.0.smithi084.stdout:6/735: unlink d3/de/d15/f1c 0 2024-04-26T21:26:10.526 INFO:tasks.workunit.client.1.smithi120.stdout:5/993: fdatasync d2/f3d 0 2024-04-26T21:26:10.526 INFO:tasks.workunit.client.1.smithi120.stdout:3/996: symlink dd/de/df/dda/d24/d9d/l143 0 2024-04-26T21:26:10.527 INFO:tasks.workunit.client.0.smithi084.stdout:4/725: dwrite d5/d10/f13 [4194304,4194304] 0 2024-04-26T21:26:10.530 INFO:tasks.workunit.client.1.smithi120.stdout:2/962: link d4/d1b/d5c/c123 d4/d1b/d5c/c145 0 2024-04-26T21:26:10.530 INFO:tasks.workunit.client.0.smithi084.stdout:5/759: symlink d0/dc/df/d31/d72/led 0 2024-04-26T21:26:10.531 INFO:tasks.workunit.client.1.smithi120.stdout:3/997: write dd/de/df/dda/d24/db1/d76/d3b/d56/fb5 [4137563,10909] 0 2024-04-26T21:26:10.534 INFO:tasks.workunit.client.0.smithi084.stdout:3/782: symlink d1/d24/dbb/l115 0 2024-04-26T21:26:10.534 INFO:tasks.workunit.client.0.smithi084.stdout:9/705: chown da/dd5/d93/dc3/d4f/c7a 9166879 1 2024-04-26T21:26:10.536 INFO:tasks.workunit.client.0.smithi084.stdout:8/807: symlink d4/d7/d15/d37/d3b/lf3 0 2024-04-26T21:26:10.541 INFO:tasks.workunit.client.1.smithi120.stdout:6/995: dread d4/db/d10/d22/d56/d94/fb2 [0,4194304] 0 2024-04-26T21:26:10.543 INFO:tasks.workunit.client.1.smithi120.stdout:3/998: chown dd/de/df/db6/c4d 902 1 2024-04-26T21:26:10.544 INFO:tasks.workunit.client.0.smithi084.stdout:1/790: rename d2/d1b/l1c to d2/d9/l10a 0 2024-04-26T21:26:10.545 INFO:tasks.workunit.client.0.smithi084.stdout:8/808: dread - d4/d3a/d8c/f95 zero size 2024-04-26T21:26:10.546 INFO:tasks.workunit.client.1.smithi120.stdout:3/999: write dd/d2a/d74/fbf [1696878,13807] 0 2024-04-26T21:26:10.550 INFO:tasks.workunit.client.0.smithi084.stdout:1/791: chown d2/d54/d5e 20 1 2024-04-26T21:26:10.550 INFO:tasks.workunit.client.0.smithi084.stdout:3/783: creat d1/d2c/d2f/d31/da8/f116 x:0 0 0 2024-04-26T21:26:10.551 INFO:tasks.workunit.client.0.smithi084.stdout:7/831: dwrite d6/d9/d12/d19/d20/f119 [0,4194304] 0 2024-04-26T21:26:10.551 INFO:tasks.workunit.client.0.smithi084.stdout:4/726: creat d5/d7/d65/d90/d91/dba/dc2/feb x:0 0 0 2024-04-26T21:26:10.553 INFO:tasks.workunit.client.0.smithi084.stdout:9/706: creat da/dd5/d93/dc3/d41/d43/dba/f107 x:0 0 0 2024-04-26T21:26:10.555 INFO:tasks.workunit.client.0.smithi084.stdout:8/809: symlink d4/d6/db/d1e/d22/d96/lf4 0 2024-04-26T21:26:10.560 INFO:tasks.workunit.client.0.smithi084.stdout:2/887: write d6/d105/fd8 [1451814,78657] 0 2024-04-26T21:26:10.562 INFO:tasks.workunit.client.0.smithi084.stdout:5/760: write d0/f22 [8619025,79707] 0 2024-04-26T21:26:10.568 INFO:tasks.workunit.client.1.smithi120.stdout:1/921: rename d6/d9/dd4/de0/d1d/d5d/df2/c11f to d6/d9/dd4/de0/d1d/d5d/dde/c134 0 2024-04-26T21:26:10.569 INFO:tasks.workunit.client.0.smithi084.stdout:6/736: dread d3/de/d1a/d43/f2d [0,4194304] 0 2024-04-26T21:26:10.570 INFO:tasks.workunit.client.0.smithi084.stdout:2/888: creat d6/d7/db6/d115/dcf/f12c x:0 0 0 2024-04-26T21:26:10.573 INFO:tasks.workunit.client.0.smithi084.stdout:9/707: creat da/dd5/d93/dc3/d4f/d104/f108 x:0 0 0 2024-04-26T21:26:10.575 INFO:tasks.workunit.client.0.smithi084.stdout:8/810: creat d4/d6/db/d1e/d22/d39/dc4/ff5 x:0 0 0 2024-04-26T21:26:10.577 INFO:tasks.workunit.client.0.smithi084.stdout:6/737: write d3/de/d1a/d2f/d4c/d58/f66 [1542721,12667] 0 2024-04-26T21:26:10.579 INFO:tasks.workunit.client.0.smithi084.stdout:3/784: getdents d1/d2c 0 2024-04-26T21:26:10.583 INFO:tasks.workunit.client.1.smithi120.stdout:5/994: getdents d2/d30/d93/d107/d36/d44/d6c/d12b 0 2024-04-26T21:26:10.584 INFO:tasks.workunit.client.0.smithi084.stdout:4/727: creat d5/d7/d65/d90/d91/fec x:0 0 0 2024-04-26T21:26:10.589 INFO:tasks.workunit.client.0.smithi084.stdout:0/763: dread de/ff [0,4194304] 0 2024-04-26T21:26:10.589 INFO:tasks.workunit.client.0.smithi084.stdout:9/708: creat da/dd5/d93/dc3/d41/d43/d48/f109 x:0 0 0 2024-04-26T21:26:10.593 INFO:tasks.workunit.client.0.smithi084.stdout:3/785: creat d1/d24/d27/d3a/de5/f117 x:0 0 0 2024-04-26T21:26:10.595 INFO:tasks.workunit.client.0.smithi084.stdout:8/811: getdents d4/d7 0 2024-04-26T21:26:10.597 INFO:tasks.workunit.client.1.smithi120.stdout:2/963: mknod d4/d1b/d5c/da6/d11f/c146 0 2024-04-26T21:26:10.601 INFO:tasks.workunit.client.0.smithi084.stdout:1/792: dwrite d2/f2e [0,4194304] 0 2024-04-26T21:26:10.601 INFO:tasks.workunit.client.0.smithi084.stdout:8/812: fsync d4/d3a/f71 0 2024-04-26T21:26:10.602 INFO:tasks.workunit.client.1.smithi120.stdout:8/956: dread f4 [0,4194304] 0 2024-04-26T21:26:10.604 INFO:tasks.workunit.client.0.smithi084.stdout:2/889: dwrite d6/d105/fd8 [4194304,4194304] 0 2024-04-26T21:26:10.605 INFO:tasks.workunit.client.0.smithi084.stdout:4/728: creat d5/d25/d35/d60/d6d/de1/d32/d46/d77/fed x:0 0 0 2024-04-26T21:26:10.606 INFO:tasks.workunit.client.1.smithi120.stdout:9/912: truncate d0/dd/f83 2790109 0 2024-04-26T21:26:10.607 INFO:tasks.workunit.client.1.smithi120.stdout:2/964: mkdir d4/d1b/d2e/d50/d14/dc2/d147 0 2024-04-26T21:26:10.619 INFO:tasks.workunit.client.1.smithi120.stdout:8/957: dwrite d5/d6/d34/d42/d9d/d7a/f96 [0,4194304] 0 2024-04-26T21:26:10.622 INFO:tasks.workunit.client.1.smithi120.stdout:6/996: rename d4/db/d10/d22/d6c/l109 to d4/db/d10/dd/d43/d58/l146 0 2024-04-26T21:26:10.623 INFO:tasks.workunit.client.1.smithi120.stdout:7/961: getdents d7/d19/d60 0 2024-04-26T21:26:10.624 INFO:tasks.workunit.client.0.smithi084.stdout:3/786: rename d1/d2c/d2f/d31/d3b to d1/d2c/d2f/d31/dc7/d118 0 2024-04-26T21:26:10.624 INFO:tasks.workunit.client.0.smithi084.stdout:0/764: dread de/d71/f73 [0,4194304] 0 2024-04-26T21:26:10.626 INFO:tasks.workunit.client.1.smithi120.stdout:9/913: fsync d0/dd/d3a/d5c/d98/faa 0 2024-04-26T21:26:10.628 INFO:tasks.workunit.client.0.smithi084.stdout:7/832: dread d6/d9/ff [0,4194304] 0 2024-04-26T21:26:10.632 INFO:tasks.workunit.client.1.smithi120.stdout:1/922: creat d6/f135 x:0 0 0 2024-04-26T21:26:10.634 INFO:tasks.workunit.client.0.smithi084.stdout:5/761: dwrite d0/dc/df/d51/fb5 [0,4194304] 0 2024-04-26T21:26:10.635 INFO:tasks.workunit.client.1.smithi120.stdout:9/914: mknod d0/dd/d3a/d5c/d98/db8/c130 0 2024-04-26T21:26:10.638 INFO:tasks.workunit.client.1.smithi120.stdout:9/915: dread - d0/d66/d93/db7/dc7/f124 zero size 2024-04-26T21:26:10.638 INFO:tasks.workunit.client.0.smithi084.stdout:1/793: mknod d2/d9/d15/d28/d5a/dc6/c10b 0 2024-04-26T21:26:10.640 INFO:tasks.workunit.client.1.smithi120.stdout:1/923: unlink d6/d9/dd4/de0/d2d/f34 0 2024-04-26T21:26:10.641 INFO:tasks.workunit.client.0.smithi084.stdout:9/709: dwrite da/dd5/d93/d95/daa/fcd [0,4194304] 0 2024-04-26T21:26:10.644 INFO:tasks.workunit.client.1.smithi120.stdout:7/962: dwrite d7/d64/da6/d1f/d7d/d8b/d94/f11f [0,4194304] 0 2024-04-26T21:26:10.645 INFO:tasks.workunit.client.0.smithi084.stdout:2/890: rename d6/d7/db6/d115/dcf/ce2 to d6/d7/d3d/d15/d1f/d22/de6/c12d 0 2024-04-26T21:26:10.645 INFO:tasks.workunit.client.0.smithi084.stdout:3/787: creat d1/dea/d104/f119 x:0 0 0 2024-04-26T21:26:10.652 INFO:tasks.workunit.client.0.smithi084.stdout:6/738: dwrite d3/de/d15/df/f4b [4194304,4194304] 0 2024-04-26T21:26:10.652 INFO:tasks.workunit.client.0.smithi084.stdout:9/710: write da/dd5/d93/d95/daa/fcd [1777536,9887] 0 2024-04-26T21:26:10.655 INFO:tasks.workunit.client.0.smithi084.stdout:3/788: dread d1/d2c/d2f/fab [0,4194304] 0 2024-04-26T21:26:10.658 INFO:tasks.workunit.client.1.smithi120.stdout:8/958: dread d5/d6/d34/d42/d102/d118/fdb [0,4194304] 0 2024-04-26T21:26:10.658 INFO:tasks.workunit.client.0.smithi084.stdout:0/765: creat de/ff0 x:0 0 0 2024-04-26T21:26:10.661 INFO:tasks.workunit.client.0.smithi084.stdout:1/794: rename d2/d9/d15/fac to d2/d54/d5e/f10c 0 2024-04-26T21:26:10.661 INFO:tasks.workunit.client.0.smithi084.stdout:0/766: chown de/d20/c2e 1649 1 2024-04-26T21:26:10.662 INFO:tasks.workunit.client.0.smithi084.stdout:6/739: rmdir d3/de/d1a/d2f/d4c 39 2024-04-26T21:26:10.667 INFO:tasks.workunit.client.1.smithi120.stdout:1/924: rmdir d6/d9/dd4/de0/d1d/d5d/d67 39 2024-04-26T21:26:10.669 INFO:tasks.workunit.client.0.smithi084.stdout:1/795: mknod d2/d9/d15/d9f/c10d 0 2024-04-26T21:26:10.674 INFO:tasks.workunit.client.0.smithi084.stdout:9/711: truncate da/dd5/d93/dc3/d41/d43/d4a/d82/f85 699203 0 2024-04-26T21:26:10.676 INFO:tasks.workunit.client.0.smithi084.stdout:6/740: symlink d3/de/d1a/d2f/le9 0 2024-04-26T21:26:10.678 INFO:tasks.workunit.client.1.smithi120.stdout:6/997: getdents d4/db/d25/d6d 0 2024-04-26T21:26:10.678 INFO:tasks.workunit.client.0.smithi084.stdout:0/767: link de/d2b/d45/f59 de/d71/ff1 0 2024-04-26T21:26:10.679 INFO:tasks.workunit.client.1.smithi120.stdout:2/965: write d4/d1b/d2e/d50/f27 [5058786,16360] 0 2024-04-26T21:26:10.680 INFO:tasks.workunit.client.1.smithi120.stdout:5/995: dwrite d2/dc/fc8 [0,4194304] 0 2024-04-26T21:26:10.681 INFO:tasks.workunit.client.1.smithi120.stdout:6/998: readlink d4/db/d10/d1a/d2b/d57/d67/lcc 0 2024-04-26T21:26:10.682 INFO:tasks.workunit.client.0.smithi084.stdout:7/833: dread d6/d9/d12/d8b/f8d [0,4194304] 0 2024-04-26T21:26:10.682 INFO:tasks.workunit.client.1.smithi120.stdout:1/925: truncate d6/d9/fc0 497809 0 2024-04-26T21:26:10.692 INFO:tasks.workunit.client.0.smithi084.stdout:6/741: truncate d3/de/f7c 4902624 0 2024-04-26T21:26:10.695 INFO:tasks.workunit.client.1.smithi120.stdout:5/996: truncate d2/d10e/f103 2716132 0 2024-04-26T21:26:10.700 INFO:tasks.workunit.client.1.smithi120.stdout:1/926: rmdir d6/d9/dd4/de0/d1b/d3b 39 2024-04-26T21:26:10.700 INFO:tasks.workunit.client.1.smithi120.stdout:2/966: truncate d4/d1b/d25/d29/d128/de9/ff4 5050095 0 2024-04-26T21:26:10.702 INFO:tasks.workunit.client.1.smithi120.stdout:5/997: truncate d2/dc/d1d/d21/d66/f59 7242395 0 2024-04-26T21:26:10.703 INFO:tasks.workunit.client.0.smithi084.stdout:3/789: dwrite d1/d24/d27/d3a/d81/fa6 [0,4194304] 0 2024-04-26T21:26:10.703 INFO:tasks.workunit.client.1.smithi120.stdout:7/963: write d7/d64/da6/d1f/d28/f3e [711510,112334] 0 2024-04-26T21:26:10.707 INFO:tasks.workunit.client.0.smithi084.stdout:1/796: dread d2/f2e [0,4194304] 0 2024-04-26T21:26:10.707 INFO:tasks.workunit.client.0.smithi084.stdout:4/729: dread d5/d25/d99/da0/fa6 [0,4194304] 0 2024-04-26T21:26:10.709 INFO:tasks.workunit.client.1.smithi120.stdout:9/916: truncate d0/d66/d93/db7/dc7/f10d 2037110 0 2024-04-26T21:26:10.709 INFO:tasks.workunit.client.1.smithi120.stdout:2/967: mknod d4/d1b/d5c/d99/df7/c148 0 2024-04-26T21:26:10.714 INFO:tasks.workunit.client.0.smithi084.stdout:9/712: dwrite da/dd5/d93/fc4 [0,4194304] 0 2024-04-26T21:26:10.716 INFO:tasks.workunit.client.1.smithi120.stdout:9/917: rmdir d0/dd/d3a 39 2024-04-26T21:26:10.716 INFO:tasks.workunit.client.1.smithi120.stdout:2/968: creat d4/d1b/d56/d65/f149 x:0 0 0 2024-04-26T21:26:10.717 INFO:tasks.workunit.client.0.smithi084.stdout:4/730: dread d5/d25/d35/f81 [0,4194304] 0 2024-04-26T21:26:10.719 INFO:tasks.workunit.client.0.smithi084.stdout:3/790: creat d1/d2c/d2f/d31/d55/d4e/d7c/d7e/f11a x:0 0 0 2024-04-26T21:26:10.721 INFO:tasks.workunit.client.1.smithi120.stdout:7/964: getdents d7/d64/da6/d1a/d50/dfa 0 2024-04-26T21:26:10.722 INFO:tasks.workunit.client.1.smithi120.stdout:7/965: fsync d7/d64/fb8 0 2024-04-26T21:26:10.723 INFO:tasks.workunit.client.1.smithi120.stdout:2/969: mknod d4/d1b/d2e/d5f/df6/c14a 0 2024-04-26T21:26:10.724 INFO:tasks.workunit.client.0.smithi084.stdout:0/768: dwrite de/d2b/d77/d32/f44 [0,4194304] 0 2024-04-26T21:26:10.728 INFO:tasks.workunit.client.1.smithi120.stdout:9/918: rename d0/d66/d93/db7/dc7/cdf to d0/d66/d93/c131 0 2024-04-26T21:26:10.729 INFO:tasks.workunit.client.0.smithi084.stdout:1/797: creat d2/f10e x:0 0 0 2024-04-26T21:26:10.729 INFO:tasks.workunit.client.0.smithi084.stdout:9/713: getdents da 0 2024-04-26T21:26:10.729 INFO:tasks.workunit.client.1.smithi120.stdout:6/999: write d4/db/d10/d1a/d2b/f8d [5575892,24622] 0 2024-04-26T21:26:10.732 INFO:tasks.workunit.client.0.smithi084.stdout:5/762: dwrite d0/f2 [0,4194304] 0 2024-04-26T21:26:10.734 INFO:tasks.workunit.client.0.smithi084.stdout:1/798: unlink d2/d54/d5e/f9a 0 2024-04-26T21:26:10.742 INFO:tasks.workunit.client.0.smithi084.stdout:9/714: mknod da/dd5/d93/dc3/d41/d43/d4a/c10a 0 2024-04-26T21:26:10.745 INFO:tasks.workunit.client.1.smithi120.stdout:2/970: rmdir d4/d1b/d25/d29/d128/de9/d112 39 2024-04-26T21:26:10.747 INFO:tasks.workunit.client.1.smithi120.stdout:2/971: stat d4/d1b/d5c/fda 0 2024-04-26T21:26:10.748 INFO:tasks.workunit.client.0.smithi084.stdout:1/799: write d2/d9/d15/d28/da0/fdf [499751,117541] 0 2024-04-26T21:26:10.749 INFO:tasks.workunit.client.0.smithi084.stdout:4/731: dwrite d5/f2b [0,4194304] 0 2024-04-26T21:26:10.751 INFO:tasks.workunit.client.0.smithi084.stdout:2/891: truncate d6/d7/d3d/d15/d1f/d22/f24 3120358 0 2024-04-26T21:26:10.758 INFO:tasks.workunit.client.0.smithi084.stdout:9/715: symlink da/dd5/d93/dc3/d4f/d104/l10b 0 2024-04-26T21:26:10.761 INFO:tasks.workunit.client.1.smithi120.stdout:5/998: truncate d2/f3f 19588 0 2024-04-26T21:26:10.762 INFO:tasks.workunit.client.0.smithi084.stdout:5/763: rename d0/dc/df/d75/fa9 to d0/dc/fee 0 2024-04-26T21:26:10.764 INFO:tasks.workunit.client.1.smithi120.stdout:8/959: dread d5/d6/d34/d42/f71 [0,4194304] 0 2024-04-26T21:26:10.767 INFO:tasks.workunit.client.0.smithi084.stdout:0/769: link de/d2b/d45/d63/da7/cdc de/d2b/d45/d94/cf2 0 2024-04-26T21:26:10.771 INFO:tasks.workunit.client.1.smithi120.stdout:1/927: dwrite d6/d9/dd4/de0/f59 [0,4194304] 0 2024-04-26T21:26:10.771 INFO:tasks.workunit.client.1.smithi120.stdout:8/960: chown d5/d6/d34/d42/d9d/d83/ld1 106 1 2024-04-26T21:26:10.774 INFO:tasks.workunit.client.0.smithi084.stdout:4/732: creat d5/d25/d35/d60/d6d/dd0/fee x:0 0 0 2024-04-26T21:26:10.775 INFO:tasks.workunit.client.0.smithi084.stdout:1/800: creat d2/d19/dd2/de7/f10f x:0 0 0 2024-04-26T21:26:10.776 INFO:tasks.workunit.client.0.smithi084.stdout:9/716: rmdir da/de/d16/dbc 39 2024-04-26T21:26:10.778 INFO:tasks.workunit.client.0.smithi084.stdout:2/892: fsync d6/d7/d68/fa2 0 2024-04-26T21:26:10.785 INFO:tasks.workunit.client.0.smithi084.stdout:2/893: chown d6/d7/d3d/d79/d81/c12b 890732401 1 2024-04-26T21:26:10.788 INFO:tasks.workunit.client.0.smithi084.stdout:9/717: mkdir da/dd5/d93/dc3/d41/d43/d48/d10c 0 2024-04-26T21:26:10.800 INFO:tasks.workunit.client.0.smithi084.stdout:5/764: dwrite d0/d17/fc7 [0,4194304] 0 2024-04-26T21:26:10.815 INFO:tasks.workunit.client.0.smithi084.stdout:3/791: dwrite d1/d2c/d2f/d31/dc7/d118/f44 [0,4194304] 0 2024-04-26T21:26:10.821 INFO:tasks.workunit.client.0.smithi084.stdout:0/770: rename de/d2b/d45 to de/d2b/df3 0 2024-04-26T21:26:10.826 INFO:tasks.workunit.client.0.smithi084.stdout:4/733: dwrite d5/d10/d15/d21/f7b [0,4194304] 0 2024-04-26T21:26:10.828 INFO:tasks.workunit.client.0.smithi084.stdout:9/718: dwrite da/f34 [0,4194304] 0 2024-04-26T21:26:10.833 INFO:tasks.workunit.client.0.smithi084.stdout:1/801: truncate d2/d19/d63/f71 2188068 0 2024-04-26T21:26:10.836 INFO:tasks.workunit.client.0.smithi084.stdout:1/802: stat d2/d9/d15/d28/d47/f81 0 2024-04-26T21:26:10.838 INFO:tasks.workunit.client.0.smithi084.stdout:1/803: chown d2/d9/d15/d28/d47/f81 104 1 2024-04-26T21:26:10.846 INFO:tasks.workunit.client.0.smithi084.stdout:3/792: mknod d1/d2c/d2f/d31/dc7/d118/c11b 0 2024-04-26T21:26:10.850 INFO:tasks.workunit.client.0.smithi084.stdout:5/765: mknod d0/dc/cef 0 2024-04-26T21:26:10.854 INFO:tasks.workunit.client.0.smithi084.stdout:3/793: fsync d1/d2c/d2f/d31/da8/f116 0 2024-04-26T21:26:10.854 INFO:tasks.workunit.client.0.smithi084.stdout:2/894: dread d6/d7/d68/f6f [0,4194304] 0 2024-04-26T21:26:10.855 INFO:tasks.workunit.client.0.smithi084.stdout:9/719: getdents da/de/d16 0 2024-04-26T21:26:10.856 INFO:tasks.workunit.client.0.smithi084.stdout:4/734: link d5/d25/d35/d60/d6d/de1/d32/la8 d5/lef 0 2024-04-26T21:26:10.861 INFO:tasks.workunit.client.0.smithi084.stdout:1/804: getdents d2/d54/d5e/d66/d2a/d2c/d45/dc9 0 2024-04-26T21:26:10.862 INFO:tasks.workunit.client.0.smithi084.stdout:9/720: mknod da/dd5/d93/dc3/d41/d43/d4a/c10d 0 2024-04-26T21:26:10.863 INFO:tasks.workunit.client.1.smithi120.stdout:8/961: mknod d5/d6/d34/d42/d102/d118/db8/ddc/c13d 0 2024-04-26T21:26:10.865 INFO:tasks.workunit.client.0.smithi084.stdout:2/895: symlink d6/d7/db6/d115/d11b/l12e 0 2024-04-26T21:26:10.868 INFO:tasks.workunit.client.0.smithi084.stdout:3/794: getdents d1/d2c/d2f/d31/d55/d4e/d7c/db1/dc8 0 2024-04-26T21:26:10.868 INFO:tasks.workunit.client.1.smithi120.stdout:9/919: rename d0/d66/d93/c131 to d0/dd/d34/c132 0 2024-04-26T21:26:10.871 INFO:tasks.workunit.client.0.smithi084.stdout:2/896: chown d6/d7/d3d/d15/d1f/d39/d20/fbb 8844 1 2024-04-26T21:26:10.875 INFO:tasks.workunit.client.1.smithi120.stdout:2/972: mkdir d4/d1b/d2e/d50/d14b 0 2024-04-26T21:26:10.877 INFO:tasks.workunit.client.0.smithi084.stdout:5/766: dwrite d0/dc/df/d31/d53/d5d/fad [0,4194304] 0 2024-04-26T21:26:10.878 INFO:tasks.workunit.client.0.smithi084.stdout:0/771: truncate de/d2b/d77/d32/f44 5499917 0 2024-04-26T21:26:10.880 INFO:tasks.workunit.client.0.smithi084.stdout:3/795: truncate d1/d2c/d2f/fc9 65136 0 2024-04-26T21:26:10.881 INFO:tasks.workunit.client.1.smithi120.stdout:5/999: mknod d2/d30/d93/d107/d36/d44/d15c/c168 0 2024-04-26T21:26:10.884 INFO:tasks.workunit.client.1.smithi120.stdout:1/928: mknod d6/d9/dd4/de0/d1b/d3b/d6d/d120/c136 0 2024-04-26T21:26:10.885 INFO:tasks.workunit.client.1.smithi120.stdout:8/962: rename d5/d6/d34/d42/d4a/deb/f22 to d5/d6/d11/d52/df5/d127/f13e 0 2024-04-26T21:26:10.886 INFO:tasks.workunit.client.1.smithi120.stdout:9/920: symlink d0/d66/d93/db7/dc7/l133 0 2024-04-26T21:26:10.886 INFO:tasks.workunit.client.0.smithi084.stdout:0/772: mknod de/cf4 0 2024-04-26T21:26:10.887 INFO:tasks.workunit.client.0.smithi084.stdout:4/735: dwrite d5/d25/d35/d60/d6d/fb0 [4194304,4194304] 0 2024-04-26T21:26:10.888 INFO:tasks.workunit.client.1.smithi120.stdout:7/966: getdents d7/d64/da6/d1f/d7d/d8b 0 2024-04-26T21:26:10.888 INFO:tasks.workunit.client.0.smithi084.stdout:3/796: mkdir d1/d24/d11c 0 2024-04-26T21:26:10.888 INFO:tasks.workunit.client.0.smithi084.stdout:0/773: truncate de/ff0 872819 0 2024-04-26T21:26:10.897 INFO:tasks.workunit.client.0.smithi084.stdout:4/736: mknod d5/d7/d65/d90/cf0 0 2024-04-26T21:26:10.899 INFO:tasks.workunit.client.0.smithi084.stdout:5/767: truncate d0/dc/f1c 4112042 0 2024-04-26T21:26:10.900 INFO:tasks.workunit.client.0.smithi084.stdout:4/737: chown d5/d25/d99/dac/fcb 1080547517 1 2024-04-26T21:26:10.902 INFO:tasks.workunit.client.1.smithi120.stdout:2/973: symlink d4/d1b/d25/d29/d128/de9/l14c 0 2024-04-26T21:26:10.908 INFO:tasks.workunit.client.0.smithi084.stdout:4/738: symlink d5/d25/lf1 0 2024-04-26T21:26:10.909 INFO:tasks.workunit.client.0.smithi084.stdout:0/774: dwrite de/d2b/d77/d32/f51 [0,4194304] 0 2024-04-26T21:26:10.910 INFO:tasks.workunit.client.1.smithi120.stdout:7/967: dread d7/d10/d97/d115/f9c [0,4194304] 0 2024-04-26T21:26:10.914 INFO:tasks.workunit.client.1.smithi120.stdout:1/929: dwrite d6/d14/d3c/f10f [0,4194304] 0 2024-04-26T21:26:10.926 INFO:tasks.workunit.client.0.smithi084.stdout:5/768: write d0/dc/df/d31/d72/d84/f89 [817898,23144] 0 2024-04-26T21:26:10.926 INFO:tasks.workunit.client.0.smithi084.stdout:4/739: read d5/d25/d35/d60/d6d/de1/f8a [1176859,63090] 0 2024-04-26T21:26:10.932 INFO:tasks.workunit.client.0.smithi084.stdout:4/740: chown d5/d2e/fb5 1793 1 2024-04-26T21:26:10.933 INFO:tasks.workunit.client.1.smithi120.stdout:9/921: dread d0/d6/d4d/d65/dec/d2d/fa5 [0,4194304] 0 2024-04-26T21:26:10.934 INFO:tasks.workunit.client.0.smithi084.stdout:3/797: dwrite d1/d2c/d2f/d31/d55/fb3 [0,4194304] 0 2024-04-26T21:26:10.939 INFO:tasks.workunit.client.0.smithi084.stdout:9/721: dread da/f37 [0,4194304] 0 2024-04-26T21:26:10.944 INFO:tasks.workunit.client.0.smithi084.stdout:2/897: dwrite d6/d7/d3d/d79/d81/d82/da8/f10e [0,4194304] 0 2024-04-26T21:26:10.945 INFO:tasks.workunit.client.1.smithi120.stdout:2/974: dread d4/d1b/d56/fb5 [0,4194304] 0 2024-04-26T21:26:10.946 INFO:tasks.workunit.client.1.smithi120.stdout:2/975: fsync d4/d1b/d25/d29/f37 0 2024-04-26T21:26:10.949 INFO:tasks.workunit.client.1.smithi120.stdout:2/976: readlink d4/d1b/d2e/d50/d14/d15/d6c/le4 0 2024-04-26T21:26:10.955 INFO:tasks.workunit.client.0.smithi084.stdout:9/722: creat da/de/d1e/d56/da6/f10e x:0 0 0 2024-04-26T21:26:10.956 INFO:tasks.workunit.client.0.smithi084.stdout:4/741: read - d5/d25/d35/d60/d6d/de1/d32/fc9 zero size 2024-04-26T21:26:10.957 INFO:tasks.workunit.client.0.smithi084.stdout:4/742: chown d5/d2e/d8d 19721 1 2024-04-26T21:26:10.960 INFO:tasks.workunit.client.1.smithi120.stdout:2/977: mkdir d4/dea/d14d 0 2024-04-26T21:26:10.962 INFO:tasks.workunit.client.0.smithi084.stdout:4/743: readlink d5/d25/d68/la4 0 2024-04-26T21:26:10.962 INFO:tasks.workunit.client.1.smithi120.stdout:7/968: dread d7/d19/f24 [0,4194304] 0 2024-04-26T21:26:10.963 INFO:tasks.workunit.client.0.smithi084.stdout:9/723: write da/de/d1e/f74 [5190170,75667] 0 2024-04-26T21:26:10.965 INFO:tasks.workunit.client.1.smithi120.stdout:1/930: dread d6/d9/dd4/de0/d1b/f81 [0,4194304] 0 2024-04-26T21:26:10.967 INFO:tasks.workunit.client.1.smithi120.stdout:9/922: link d0/d6/d4d/d65/dec/c125 d0/dd/c134 0 2024-04-26T21:26:10.969 INFO:tasks.workunit.client.1.smithi120.stdout:1/931: read d6/d9/dd4/de0/d2d/d48/f123 [152086,26266] 0 2024-04-26T21:26:10.971 INFO:tasks.workunit.client.1.smithi120.stdout:9/923: fdatasync d0/d6/d4d/d65/dec/d77/dc5/fe1 0 2024-04-26T21:26:10.974 INFO:tasks.workunit.client.0.smithi084.stdout:4/744: mkdir d5/d25/d35/d60/d6d/de1/dd7/df2 0 2024-04-26T21:26:10.974 INFO:tasks.workunit.client.1.smithi120.stdout:8/963: dwrite d5/d6/d11/d52/df5/d127/f13e [0,4194304] 0 2024-04-26T21:26:10.976 INFO:tasks.workunit.client.0.smithi084.stdout:0/775: dwrite de/d2b/d77/fcb [0,4194304] 0 2024-04-26T21:26:10.977 INFO:tasks.workunit.client.0.smithi084.stdout:3/798: dread d1/d2c/d2f/d31/d55/fb3 [0,4194304] 0 2024-04-26T21:26:10.979 INFO:tasks.workunit.client.0.smithi084.stdout:4/745: chown d5/d25/d35/d60/d69/db2 1 1 2024-04-26T21:26:10.984 INFO:tasks.workunit.client.0.smithi084.stdout:5/769: dwrite d0/dc/df/d51/f81 [0,4194304] 0 2024-04-26T21:26:10.984 INFO:tasks.workunit.client.0.smithi084.stdout:9/724: rename da/de/d16/d40/c60 to da/dd5/d93/dc3/d41/d43/d4a/d82/c10f 0 2024-04-26T21:26:10.987 INFO:tasks.workunit.client.0.smithi084.stdout:2/898: dread d6/d7/d3d/d15/d1f/d39/d20/f76 [0,4194304] 0 2024-04-26T21:26:10.989 INFO:tasks.workunit.client.0.smithi084.stdout:3/799: mkdir d1/d24/d27/d3a/ddb/df5/d11d 0 2024-04-26T21:26:10.990 INFO:tasks.workunit.client.0.smithi084.stdout:9/725: creat da/dd5/db6/f110 x:0 0 0 2024-04-26T21:26:10.990 INFO:tasks.workunit.client.0.smithi084.stdout:4/746: dread d5/d25/f56 [0,4194304] 0 2024-04-26T21:26:10.991 INFO:tasks.workunit.client.1.smithi120.stdout:9/924: creat d0/d6/d4d/d65/dec/d2d/d4b/dbc/f135 x:0 0 0 2024-04-26T21:26:10.994 INFO:tasks.workunit.client.1.smithi120.stdout:2/978: link d4/d1b/d25/d29/l51 d4/d1b/d25/d29/d13c/l14e 0 2024-04-26T21:26:10.995 INFO:tasks.workunit.client.1.smithi120.stdout:7/969: write d7/d64/da6/d1f/d7d/d8b/d94/ff0 [503679,1016] 0 2024-04-26T21:26:10.995 INFO:tasks.workunit.client.1.smithi120.stdout:9/925: write d0/dd/d45/f63 [2132275,117765] 0 2024-04-26T21:26:10.996 INFO:tasks.workunit.client.1.smithi120.stdout:1/932: rename d6/d9/dd4/de0/d1d/d5d/d67/f77 to d6/d14/d6f/f137 0 2024-04-26T21:26:10.996 INFO:tasks.workunit.client.0.smithi084.stdout:2/899: mknod d6/d7/d3d/d15/d1f/d39/da5/d128/c12f 0 2024-04-26T21:26:11.000 INFO:tasks.workunit.client.1.smithi120.stdout:8/964: unlink d5/d6/d34/c9e 0 2024-04-26T21:26:11.004 INFO:tasks.workunit.client.1.smithi120.stdout:9/926: write d0/d6/d4d/d65/dec/d2d/d4b/dbc/f135 [444492,50145] 0 2024-04-26T21:26:11.004 INFO:tasks.workunit.client.1.smithi120.stdout:7/970: rmdir d7/d64/da6/d1f/d28/d11d 39 2024-04-26T21:26:11.004 INFO:tasks.workunit.client.1.smithi120.stdout:1/933: mkdir d6/daa/dae/d128/d138 0 2024-04-26T21:26:11.005 INFO:tasks.workunit.client.1.smithi120.stdout:8/965: write d5/d6/d11/d32/f8f [1216235,60877] 0 2024-04-26T21:26:11.009 INFO:tasks.workunit.client.1.smithi120.stdout:1/934: fsync d6/d9/dd4/de0/d1d/d2c/f93 0 2024-04-26T21:26:11.010 INFO:tasks.workunit.client.1.smithi120.stdout:8/966: unlink d5/d6/d11/d32/l5f 0 2024-04-26T21:26:11.015 INFO:tasks.workunit.client.1.smithi120.stdout:7/971: rename d7/d64/da6/d1a/d50/dfa/d131/d109/dbf/l110 to d7/d10/d117/l141 0 2024-04-26T21:26:11.018 INFO:tasks.workunit.client.1.smithi120.stdout:8/967: write d5/d6/d11/d52/d27/d4f/d67/fad [4963142,44961] 0 2024-04-26T21:26:11.018 INFO:tasks.workunit.client.1.smithi120.stdout:9/927: dread d0/dd/d3a/f92 [0,4194304] 0 2024-04-26T21:26:11.018 INFO:tasks.workunit.client.1.smithi120.stdout:1/935: rename d6/l7e to d6/d9/dd4/de0/d1d/d5d/df2/l139 0 2024-04-26T21:26:11.018 INFO:tasks.workunit.client.1.smithi120.stdout:2/979: dwrite d4/d1b/d25/d2c/fa2 [4194304,4194304] 0 2024-04-26T21:26:11.020 INFO:tasks.workunit.client.1.smithi120.stdout:9/928: chown d0/dd/d3a/d5c/d98 679834 1 2024-04-26T21:26:11.026 INFO:tasks.workunit.client.1.smithi120.stdout:8/968: unlink d5/d6/d11/l61 0 2024-04-26T21:26:11.026 INFO:tasks.workunit.client.1.smithi120.stdout:7/972: rename d7/d10/d97/d99/l100 to d7/d10/d97/d115/dfc/d12a/l142 0 2024-04-26T21:26:11.033 INFO:tasks.workunit.client.1.smithi120.stdout:7/973: unlink d7/d10/c18 0 2024-04-26T21:26:11.036 INFO:tasks.workunit.client.1.smithi120.stdout:8/969: link d5/d6/d34/d42/d102/d118/db8/l11b d5/l13f 0 2024-04-26T21:26:11.036 INFO:tasks.workunit.client.1.smithi120.stdout:7/974: write d7/d64/fb8 [4800024,2461] 0 2024-04-26T21:26:11.041 INFO:tasks.workunit.client.1.smithi120.stdout:9/929: dwrite d0/d6/d4d/d65/dec/d77/d9a/fe4 [0,4194304] 0 2024-04-26T21:26:11.044 INFO:tasks.workunit.client.1.smithi120.stdout:8/970: symlink d5/d6/d34/l140 0 2024-04-26T21:26:11.046 INFO:tasks.workunit.client.1.smithi120.stdout:8/971: dread - d5/d6/f11f zero size 2024-04-26T21:26:11.051 INFO:tasks.workunit.client.1.smithi120.stdout:9/930: truncate d0/d6/d4d/d65/dec/d2d/d4b/d85/ffa 801220 0 2024-04-26T21:26:11.059 INFO:tasks.workunit.client.1.smithi120.stdout:9/931: dread d0/d6/d4d/d65/dec/d2d/fbe [0,4194304] 0 2024-04-26T21:26:11.060 INFO:tasks.workunit.client.1.smithi120.stdout:1/936: dread d6/d9/dd4/de0/d1b/d3b/d6d/f8d [0,4194304] 0 2024-04-26T21:26:11.063 INFO:tasks.workunit.client.1.smithi120.stdout:7/975: write d7/d10/d97/d115/d7b/fc6 [963189,89742] 0 2024-04-26T21:26:11.065 INFO:tasks.workunit.client.1.smithi120.stdout:2/980: dwrite d4/d1b/d25/d2c/d3e/d5e/d63/dcb/dca/dfc/f105 [0,4194304] 0 2024-04-26T21:26:11.068 INFO:tasks.workunit.client.1.smithi120.stdout:2/981: dread - d4/d1b/d56/d65/f149 zero size 2024-04-26T21:26:11.069 INFO:tasks.workunit.client.1.smithi120.stdout:9/932: truncate d0/dd/f12 9374663 0 2024-04-26T21:26:11.069 INFO:tasks.workunit.client.1.smithi120.stdout:1/937: creat d6/daa/dae/d128/f13a x:0 0 0 2024-04-26T21:26:11.071 INFO:tasks.workunit.client.1.smithi120.stdout:9/933: rmdir d0/dd/d34 39 2024-04-26T21:26:11.074 INFO:tasks.workunit.client.1.smithi120.stdout:2/982: rename d4/d1b/d25/d2c/d3e/f109 to d4/d1b/d2e/d5f/f14f 0 2024-04-26T21:26:11.077 INFO:tasks.workunit.client.1.smithi120.stdout:2/983: write d4/d1b/d25/d29/d128/de9/f144 [774454,103181] 0 2024-04-26T21:26:11.079 INFO:tasks.workunit.client.1.smithi120.stdout:9/934: creat d0/dd/d34/f136 x:0 0 0 2024-04-26T21:26:11.080 INFO:tasks.workunit.client.1.smithi120.stdout:1/938: rename d6/dd7 to d6/d9/dd4/de0/d2d/d48/d86/dc1/df3/d13b 0 2024-04-26T21:26:11.084 INFO:tasks.workunit.client.1.smithi120.stdout:9/935: dread d0/dd/d45/f11a [0,4194304] 0 2024-04-26T21:26:11.088 INFO:tasks.workunit.client.1.smithi120.stdout:9/936: mknod d0/d6/d4d/dce/c137 0 2024-04-26T21:26:11.091 INFO:tasks.workunit.client.1.smithi120.stdout:9/937: creat d0/d6/f138 x:0 0 0 2024-04-26T21:26:11.091 INFO:tasks.workunit.client.1.smithi120.stdout:7/976: write d7/d64/da6/d1a/d50/dfa/d131/d34/ffd [5865101,71559] 0 2024-04-26T21:26:11.092 INFO:tasks.workunit.client.1.smithi120.stdout:1/939: truncate d6/d9/f84 3940032 0 2024-04-26T21:26:11.095 INFO:tasks.workunit.client.1.smithi120.stdout:7/977: creat d7/d19/d60/de6/de8/f143 x:0 0 0 2024-04-26T21:26:11.099 INFO:tasks.workunit.client.1.smithi120.stdout:7/978: chown d7/d64/da6/d1a/d50/dfa/d131/d34/d37/f79 478 1 2024-04-26T21:26:11.106 INFO:tasks.workunit.client.1.smithi120.stdout:9/938: fdatasync d0/d6/d4d/d65/dec/d2d/d4b/d85/ffa 0 2024-04-26T21:26:11.107 INFO:tasks.workunit.client.1.smithi120.stdout:2/984: dread d4/d1b/d25/fc6 [0,4194304] 0 2024-04-26T21:26:11.107 INFO:tasks.workunit.client.1.smithi120.stdout:7/979: dread d7/d64/da6/d1a/d50/dfa/d131/d34/d37/f72 [0,4194304] 0 2024-04-26T21:26:11.109 INFO:tasks.workunit.client.0.smithi084.stdout:9/726: rename da/dd5/d93/d95/daa/fcd to da/dd5/d93/d95/f111 0 2024-04-26T21:26:11.109 INFO:tasks.workunit.client.1.smithi120.stdout:9/939: mkdir d0/dd/d3a/de8/d118/d139 0 2024-04-26T21:26:11.110 INFO:tasks.workunit.client.1.smithi120.stdout:1/940: dwrite d6/d14/d3c/f106 [0,4194304] 0 2024-04-26T21:26:11.111 INFO:tasks.workunit.client.0.smithi084.stdout:2/900: mkdir d6/d7/db6/d115/d130 0 2024-04-26T21:26:11.111 INFO:tasks.workunit.client.0.smithi084.stdout:4/747: write d5/d25/d35/d60/d6d/f8c [509124,81373] 0 2024-04-26T21:26:11.113 INFO:tasks.workunit.client.1.smithi120.stdout:2/985: fdatasync d4/d1b/d25/d29/f4d 0 2024-04-26T21:26:11.113 INFO:tasks.workunit.client.1.smithi120.stdout:7/980: dread d7/d64/da6/d1a/d50/dfa/d131/d34/d37/f72 [0,4194304] 0 2024-04-26T21:26:11.113 INFO:tasks.workunit.client.0.smithi084.stdout:9/727: creat da/de/d16/f112 x:0 0 0 2024-04-26T21:26:11.114 INFO:tasks.workunit.client.1.smithi120.stdout:9/940: mknod d0/dd/d3a/dae/ded/df1/c13a 0 2024-04-26T21:26:11.115 INFO:tasks.workunit.client.1.smithi120.stdout:7/981: readlink d7/d64/da6/d2f/ld9 0 2024-04-26T21:26:11.117 INFO:tasks.workunit.client.1.smithi120.stdout:9/941: stat d0/dd/d3a/d5c/d98/db8/c130 0 2024-04-26T21:26:11.117 INFO:tasks.workunit.client.0.smithi084.stdout:9/728: read da/f100 [2196380,72311] 0 2024-04-26T21:26:11.117 INFO:tasks.workunit.client.0.smithi084.stdout:4/748: write d5/d7/d65/d7f/db8/f3c [1917875,78970] 0 2024-04-26T21:26:11.118 INFO:tasks.workunit.client.1.smithi120.stdout:7/982: stat d7/d10/d97/d115/f8f 0 2024-04-26T21:26:11.118 INFO:tasks.workunit.client.1.smithi120.stdout:2/986: creat d4/dea/f150 x:0 0 0 2024-04-26T21:26:11.118 INFO:tasks.workunit.client.0.smithi084.stdout:2/901: write d6/d1b/f7a [955637,72997] 0 2024-04-26T21:26:11.121 INFO:tasks.workunit.client.1.smithi120.stdout:9/942: mknod d0/dd/d3a/dae/ded/c13b 0 2024-04-26T21:26:11.124 INFO:tasks.workunit.client.0.smithi084.stdout:9/729: rmdir da/dd5/d93/dc3 39 2024-04-26T21:26:11.128 INFO:tasks.workunit.client.1.smithi120.stdout:7/983: mkdir d7/d64/da6/d1f/d7d/d8b/d94/d144 0 2024-04-26T21:26:11.129 INFO:tasks.workunit.client.1.smithi120.stdout:1/941: write d6/d9/dd4/de0/d2d/d48/d86/dc1/f88 [262784,52519] 0 2024-04-26T21:26:11.130 INFO:tasks.workunit.client.1.smithi120.stdout:9/943: unlink d0/d6/l2a 0 2024-04-26T21:26:11.131 INFO:tasks.workunit.client.1.smithi120.stdout:1/942: chown d6/d9/dd4/de0/d2d 6 1 2024-04-26T21:26:11.131 INFO:tasks.workunit.client.0.smithi084.stdout:4/749: getdents d5/d25/d99/dc7 0 2024-04-26T21:26:11.132 INFO:tasks.workunit.client.1.smithi120.stdout:7/984: write d7/d64/da6/d1f/d7d/d8b/fc4 [4416588,110222] 0 2024-04-26T21:26:11.133 INFO:tasks.workunit.client.1.smithi120.stdout:1/943: fsync d6/d9/dd4/de0/d1b/d3b/d6d/fb4 0 2024-04-26T21:26:11.134 INFO:tasks.workunit.client.0.smithi084.stdout:2/902: link d6/d7/d3d/d15/d1f/f34 d6/d7/d3d/d15/d1f/d39/d20/d45/d6d/f131 0 2024-04-26T21:26:11.137 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:10 smithi084 ceph-mon[25539]: pgmap v50: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 93 MiB/s rd, 211 MiB/s wr, 466 op/s 2024-04-26T21:26:11.138 INFO:tasks.workunit.client.0.smithi084.stdout:9/730: link da/dd5/db6/ld9 da/l113 0 2024-04-26T21:26:11.138 INFO:tasks.workunit.client.0.smithi084.stdout:3/800: dread d1/d2c/d2f/d94/fd3 [0,4194304] 0 2024-04-26T21:26:11.139 INFO:tasks.workunit.client.1.smithi120.stdout:9/944: creat d0/d6/d4d/d65/dec/d2d/d4b/d85/f13c x:0 0 0 2024-04-26T21:26:11.139 INFO:tasks.workunit.client.1.smithi120.stdout:2/987: write d4/d1b/d2e/d50/d14/d15/d6c/fa4 [3740076,59605] 0 2024-04-26T21:26:11.140 INFO:tasks.workunit.client.0.smithi084.stdout:5/770: dread d0/d17/f1d [0,4194304] 0 2024-04-26T21:26:11.141 INFO:tasks.workunit.client.0.smithi084.stdout:4/750: link d5/d7/d65/d90/d91/dba/dc2/feb d5/d7/d65/d90/d91/daa/ff3 0 2024-04-26T21:26:11.144 INFO:tasks.workunit.client.1.smithi120.stdout:2/988: readlink d4/d1b/d4f/l5d 0 2024-04-26T21:26:11.146 INFO:tasks.workunit.client.0.smithi084.stdout:4/751: creat d5/d25/d35/d60/d6d/dd0/ff4 x:0 0 0 2024-04-26T21:26:11.148 INFO:tasks.workunit.client.0.smithi084.stdout:5/771: creat d0/dc/df/d31/d53/de1/ff0 x:0 0 0 2024-04-26T21:26:11.148 INFO:tasks.workunit.client.0.smithi084.stdout:3/801: link d1/d2c/d2f/d94/fba d1/d2c/d2f/d31/f11e 0 2024-04-26T21:26:11.149 INFO:tasks.workunit.client.0.smithi084.stdout:4/752: write d5/d25/d35/d60/d6d/dd0/fee [772364,73014] 0 2024-04-26T21:26:11.150 INFO:tasks.workunit.client.1.smithi120.stdout:2/989: fdatasync d4/d1b/d2e/d5f/df6/f11b 0 2024-04-26T21:26:11.151 INFO:tasks.workunit.client.0.smithi084.stdout:4/753: chown d5/d7/d65/f76 21379 1 2024-04-26T21:26:11.152 INFO:tasks.workunit.client.1.smithi120.stdout:7/985: getdents d7/d64/da6/d1a/d50/dfa/d131 0 2024-04-26T21:26:11.154 INFO:tasks.workunit.client.1.smithi120.stdout:7/986: write d7/d10/d97/f13c [253817,67555] 0 2024-04-26T21:26:11.160 INFO:tasks.workunit.client.1.smithi120.stdout:7/987: rename d7/d19/fbc to d7/d10/d97/d115/d7b/f145 0 2024-04-26T21:26:11.161 INFO:tasks.workunit.client.1.smithi120.stdout:2/990: write d4/dea/fff [389777,14328] 0 2024-04-26T21:26:11.165 INFO:tasks.workunit.client.1.smithi120.stdout:7/988: truncate d7/d19/d60/f76 4466833 0 2024-04-26T21:26:11.165 INFO:tasks.workunit.client.0.smithi084.stdout:3/802: getdents d1/d2c/d2f/d31 0 2024-04-26T21:26:11.166 INFO:tasks.workunit.client.1.smithi120.stdout:1/944: dwrite d6/d9/dd4/de0/d2d/d48/fbe [0,4194304] 0 2024-04-26T21:26:11.168 INFO:tasks.workunit.client.0.smithi084.stdout:2/903: dwrite d6/d7/d3d/d15/d1f/d39/d43/fe0 [0,4194304] 0 2024-04-26T21:26:11.168 INFO:tasks.workunit.client.1.smithi120.stdout:7/989: fdatasync d7/d64/da6/d1a/df4/f103 0 2024-04-26T21:26:11.172 INFO:tasks.workunit.client.1.smithi120.stdout:2/991: creat d4/d1b/d2e/d5f/df6/dfa/f151 x:0 0 0 2024-04-26T21:26:11.172 INFO:tasks.workunit.client.0.smithi084.stdout:2/904: stat d6/d7/d3d/d15/d1f/d39/l93 0 2024-04-26T21:26:11.173 INFO:tasks.workunit.client.1.smithi120.stdout:9/945: dread d0/d6/fbf [0,4194304] 0 2024-04-26T21:26:11.177 INFO:tasks.workunit.client.1.smithi120.stdout:7/990: read d7/d64/da6/d1f/f3a [1183102,61461] 0 2024-04-26T21:26:11.181 INFO:tasks.workunit.client.0.smithi084.stdout:9/731: write da/dd5/d93/dc3/d41/d43/d48/d61/f77 [337666,127333] 0 2024-04-26T21:26:11.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:10 smithi120 ceph-mon[32741]: pgmap v50: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 93 MiB/s rd, 211 MiB/s wr, 466 op/s 2024-04-26T21:26:11.182 INFO:tasks.workunit.client.1.smithi120.stdout:2/992: mknod d4/d1b/d2e/d50/d14/dc2/c152 0 2024-04-26T21:26:11.184 INFO:tasks.workunit.client.1.smithi120.stdout:9/946: creat d0/dd/d3a/dae/f13d x:0 0 0 2024-04-26T21:26:11.188 INFO:tasks.workunit.client.0.smithi084.stdout:4/754: dread d5/d25/d35/d97/f9c [0,4194304] 0 2024-04-26T21:26:11.189 INFO:tasks.workunit.client.0.smithi084.stdout:9/732: unlink da/dd5/d93/dc3/d41/d43/fc2 0 2024-04-26T21:26:11.190 INFO:tasks.workunit.client.1.smithi120.stdout:9/947: write d0/dd/d3a/dae/ded/f11d [1027592,73963] 0 2024-04-26T21:26:11.191 INFO:tasks.workunit.client.1.smithi120.stdout:1/945: dwrite d6/d14/ffa [0,4194304] 0 2024-04-26T21:26:11.193 INFO:tasks.workunit.client.0.smithi084.stdout:3/803: write d1/d24/d27/d3a/de5/ff8 [1390217,130802] 0 2024-04-26T21:26:11.197 INFO:tasks.workunit.client.1.smithi120.stdout:1/946: mknod d6/d9/dd4/de0/d1d/c13c 0 2024-04-26T21:26:11.199 INFO:tasks.workunit.client.0.smithi084.stdout:9/733: truncate da/dd5/d93/dc3/d41/d67/f9b 4704142 0 2024-04-26T21:26:11.200 INFO:tasks.workunit.client.0.smithi084.stdout:3/804: truncate d1/d2c/d2f/fab 1088291 0 2024-04-26T21:26:11.201 INFO:tasks.workunit.client.1.smithi120.stdout:9/948: write d0/d6/d3d/fee [452409,118119] 0 2024-04-26T21:26:11.207 INFO:tasks.workunit.client.0.smithi084.stdout:2/905: dwrite d6/d7/d3d/d15/d1f/d22/f24 [0,4194304] 0 2024-04-26T21:26:11.207 INFO:tasks.workunit.client.0.smithi084.stdout:9/734: mkdir da/dd5/d93/dc3/d4f/d114 0 2024-04-26T21:26:11.207 INFO:tasks.workunit.client.1.smithi120.stdout:1/947: dread - d6/d9/dd4/de0/d1d/d5d/d67/f119 zero size 2024-04-26T21:26:11.208 INFO:tasks.workunit.client.1.smithi120.stdout:9/949: fsync d0/d6/d4d/d65/dec/d77/d9a/fd7 0 2024-04-26T21:26:11.212 INFO:tasks.workunit.client.0.smithi084.stdout:2/906: creat d6/d7/d3d/d4f/d10b/f132 x:0 0 0 2024-04-26T21:26:11.213 INFO:tasks.workunit.client.1.smithi120.stdout:7/991: dwrite d7/d64/da6/d1a/d50/dfa/d131/f126 [0,4194304] 0 2024-04-26T21:26:11.216 INFO:tasks.workunit.client.0.smithi084.stdout:9/735: link da/dd5/d93/dc3/d4f/d104/f108 da/dd5/d93/dc3/d41/d8d/f115 0 2024-04-26T21:26:11.218 INFO:tasks.workunit.client.0.smithi084.stdout:4/755: truncate d5/f2b 1932370 0 2024-04-26T21:26:11.222 INFO:tasks.workunit.client.0.smithi084.stdout:9/736: creat da/db3/f116 x:0 0 0 2024-04-26T21:26:11.224 INFO:tasks.workunit.client.1.smithi120.stdout:1/948: mkdir d6/d9/dd4/de0/d2d/d98/d13d 0 2024-04-26T21:26:11.230 INFO:tasks.workunit.client.1.smithi120.stdout:1/949: chown d6/d9/dd4/de0/d2d/d48/d86/la8 20272 1 2024-04-26T21:26:11.230 INFO:tasks.workunit.client.0.smithi084.stdout:3/805: dwrite d1/d2c/f67 [0,4194304] 0 2024-04-26T21:26:11.232 INFO:tasks.workunit.client.0.smithi084.stdout:3/806: readlink d1/d2c/d2f/d31/da8/l10b 0 2024-04-26T21:26:11.234 INFO:tasks.workunit.client.1.smithi120.stdout:2/993: dread d4/d1b/d2e/d5f/f9e [0,4194304] 0 2024-04-26T21:26:11.235 INFO:tasks.workunit.client.1.smithi120.stdout:7/992: write d7/fd [4620874,118405] 0 2024-04-26T21:26:11.238 INFO:tasks.workunit.client.0.smithi084.stdout:3/807: symlink d1/d2c/d2f/d31/d55/d4e/l11f 0 2024-04-26T21:26:11.239 INFO:tasks.workunit.client.1.smithi120.stdout:1/950: mkdir d6/d9/dd4/de0/d2d/d48/d86/dc1/df3/d13b/d13e 0 2024-04-26T21:26:11.239 INFO:tasks.workunit.client.1.smithi120.stdout:2/994: truncate d4/d1b/d4f/f124 1017330 0 2024-04-26T21:26:11.244 INFO:tasks.workunit.client.0.smithi084.stdout:3/808: dread d1/d2c/d2f/fc9 [0,4194304] 0 2024-04-26T21:26:11.246 INFO:tasks.workunit.client.1.smithi120.stdout:9/950: dwrite d0/d6/d3d/f75 [0,4194304] 0 2024-04-26T21:26:11.249 INFO:tasks.workunit.client.0.smithi084.stdout:9/737: dread da/de/d16/fea [0,4194304] 0 2024-04-26T21:26:11.253 INFO:tasks.workunit.client.0.smithi084.stdout:3/809: mknod d1/d24/c120 0 2024-04-26T21:26:11.255 INFO:tasks.workunit.client.0.smithi084.stdout:3/810: fdatasync d1/d24/f36 0 2024-04-26T21:26:11.260 INFO:tasks.workunit.client.1.smithi120.stdout:9/951: mknod d0/dd/d3a/d5c/d98/c13e 0 2024-04-26T21:26:11.261 INFO:tasks.workunit.client.1.smithi120.stdout:9/952: stat d0/l22 0 2024-04-26T21:26:11.262 INFO:tasks.workunit.client.0.smithi084.stdout:3/811: mknod d1/c121 0 2024-04-26T21:26:11.263 INFO:tasks.workunit.client.1.smithi120.stdout:2/995: unlink d4/d1b/d2e/d50/d14/d15/f43 0 2024-04-26T21:26:11.263 INFO:tasks.workunit.client.0.smithi084.stdout:4/756: dwrite d5/d25/d99/da0/fa6 [4194304,4194304] 0 2024-04-26T21:26:11.265 INFO:tasks.workunit.client.1.smithi120.stdout:9/953: chown d0/dd/d3a/d5c/d9f/fb3 5823 1 2024-04-26T21:26:11.265 INFO:tasks.workunit.client.1.smithi120.stdout:1/951: rename d6/d9/dd4/de0/d1d/d2c/d58/l133 to d6/d14/d116/d11a/l13f 0 2024-04-26T21:26:11.268 INFO:tasks.workunit.client.1.smithi120.stdout:7/993: truncate d7/d10/f10e 180207 0 2024-04-26T21:26:11.269 INFO:tasks.workunit.client.0.smithi084.stdout:4/757: stat d5/d10/da1/fbb 0 2024-04-26T21:26:11.270 INFO:tasks.workunit.client.0.smithi084.stdout:3/812: chown d1/d2c/d2f/d31/dc7/d118/f10f 145705 1 2024-04-26T21:26:11.271 INFO:tasks.workunit.client.1.smithi120.stdout:2/996: rmdir d4/d1b/d25/d2c/d3e/d5e/d63 39 2024-04-26T21:26:11.273 INFO:tasks.workunit.client.1.smithi120.stdout:7/994: mknod d7/d19/d60/c146 0 2024-04-26T21:26:11.273 INFO:tasks.workunit.client.0.smithi084.stdout:2/907: dread d6/d7/f27 [0,4194304] 0 2024-04-26T21:26:11.276 INFO:tasks.workunit.client.0.smithi084.stdout:9/738: dread da/dd5/d93/dc3/d41/d67/f6f [0,4194304] 0 2024-04-26T21:26:11.276 INFO:tasks.workunit.client.1.smithi120.stdout:1/952: rename d6/d9/dd4/de0/d2d/d98/d54/f7a to d6/f140 0 2024-04-26T21:26:11.277 INFO:tasks.workunit.client.0.smithi084.stdout:3/813: symlink d1/d2c/d2f/d31/d55/d4e/d7c/l122 0 2024-04-26T21:26:11.278 INFO:tasks.workunit.client.1.smithi120.stdout:2/997: truncate d4/d1b/d25/f32 4161175 0 2024-04-26T21:26:11.281 INFO:tasks.workunit.client.0.smithi084.stdout:2/908: truncate d6/d7/d68/f77 591702 0 2024-04-26T21:26:11.282 INFO:tasks.workunit.client.1.smithi120.stdout:1/953: readlink d6/d9/dd4/de0/d2d/d98/d56/l113 0 2024-04-26T21:26:11.284 INFO:tasks.workunit.client.0.smithi084.stdout:3/814: symlink d1/l123 0 2024-04-26T21:26:11.286 INFO:tasks.workunit.client.0.smithi084.stdout:2/909: mknod d6/c133 0 2024-04-26T21:26:11.287 INFO:tasks.workunit.client.1.smithi120.stdout:2/998: stat d4/d1b/d2e/d50/d14/d15/l30 0 2024-04-26T21:26:11.290 INFO:tasks.workunit.client.0.smithi084.stdout:2/910: mknod d6/d7/d3d/d15/d1f/d22/dd4/c134 0 2024-04-26T21:26:11.291 INFO:tasks.workunit.client.1.smithi120.stdout:2/999: mkdir d4/d1b/d2e/d5f/df6/d153 0 2024-04-26T21:26:11.295 INFO:tasks.workunit.client.1.smithi120.stdout:1/954: dread d6/d9/dd4/de0/d1d/d2c/f76 [0,4194304] 0 2024-04-26T21:26:11.300 INFO:tasks.workunit.client.1.smithi120.stdout:9/954: dwrite d0/dd/d3a/d5c/d98/f11e [0,4194304] 0 2024-04-26T21:26:11.301 INFO:tasks.workunit.client.1.smithi120.stdout:9/955: fdatasync d0/dd/ff3 0 2024-04-26T21:26:11.309 INFO:tasks.workunit.client.1.smithi120.stdout:7/995: dread d7/d64/da6/d1f/d7d/fa2 [0,4194304] 0 2024-04-26T21:26:11.310 INFO:tasks.workunit.client.0.smithi084.stdout:2/911: dwrite d6/d1b/f111 [0,4194304] 0 2024-04-26T21:26:11.311 INFO:tasks.workunit.client.0.smithi084.stdout:9/739: dread da/dd5/d93/dc3/d41/d67/f97 [0,4194304] 0 2024-04-26T21:26:11.312 INFO:tasks.workunit.client.1.smithi120.stdout:7/996: fdatasync d7/d64/da6/d1f/d7d/d8b/d94/f11f 0 2024-04-26T21:26:11.313 INFO:tasks.workunit.client.1.smithi120.stdout:7/997: chown d7/d10/d97/d115/dfc/f132 75584658 1 2024-04-26T21:26:11.322 INFO:tasks.workunit.client.0.smithi084.stdout:4/758: dread d5/f1a [0,4194304] 0 2024-04-26T21:26:11.327 INFO:tasks.workunit.client.0.smithi084.stdout:4/759: getdents d5/d2e/d8d 0 2024-04-26T21:26:11.329 INFO:tasks.workunit.client.0.smithi084.stdout:2/912: write d6/d7/db6/d115/d11b/f101 [550140,65375] 0 2024-04-26T21:26:11.330 INFO:tasks.workunit.client.0.smithi084.stdout:9/740: dread da/dd5/d93/dc3/d41/d43/d48/dce/fd4 [0,4194304] 0 2024-04-26T21:26:11.331 INFO:tasks.workunit.client.1.smithi120.stdout:8/972: sync 2024-04-26T21:26:11.335 INFO:tasks.workunit.client.0.smithi084.stdout:9/741: mkdir da/db3/d117 0 2024-04-26T21:26:11.341 INFO:tasks.workunit.client.0.smithi084.stdout:9/742: rmdir da/dd5/d93/dc3/d41/d43/d48 39 2024-04-26T21:26:11.345 INFO:tasks.workunit.client.1.smithi120.stdout:1/955: readlink d6/d14/l53 0 2024-04-26T21:26:11.345 INFO:tasks.workunit.client.1.smithi120.stdout:8/973: dwrite d5/d6/d34/d42/d9d/d7a/ff4 [0,4194304] 0 2024-04-26T21:26:11.347 INFO:tasks.workunit.client.1.smithi120.stdout:1/956: fsync d6/d14/d3c/f106 0 2024-04-26T21:26:11.351 INFO:tasks.workunit.client.1.smithi120.stdout:7/998: truncate d7/d64/da6/d1a/d50/dfa/d131/fbe 3046599 0 2024-04-26T21:26:11.352 INFO:tasks.workunit.client.0.smithi084.stdout:9/743: mkdir da/dd5/d93/dc3/d41/d43/d48/d118 0 2024-04-26T21:26:11.352 INFO:tasks.workunit.client.0.smithi084.stdout:2/913: dwrite d6/d7/d68/fa2 [0,4194304] 0 2024-04-26T21:26:11.352 INFO:tasks.workunit.client.1.smithi120.stdout:1/957: chown d6/d9/dd4/de0/d2d/d98/d56/l65 3 1 2024-04-26T21:26:11.357 INFO:tasks.workunit.client.0.smithi084.stdout:9/744: write da/dd5/d93/dc3/d41/d43/d48/f58 [3028540,23690] 0 2024-04-26T21:26:11.357 INFO:tasks.workunit.client.1.smithi120.stdout:8/974: mkdir d5/d6/d34/d42/d4a/deb/d122/d141 0 2024-04-26T21:26:11.363 INFO:tasks.workunit.client.0.smithi084.stdout:2/914: symlink d6/d7/d3d/d15/d1f/d22/d2a/l135 0 2024-04-26T21:26:11.366 INFO:tasks.workunit.client.1.smithi120.stdout:8/975: creat d5/d6/d34/d42/d9d/d83/d11e/f142 x:0 0 0 2024-04-26T21:26:11.369 INFO:tasks.workunit.client.0.smithi084.stdout:2/915: symlink d6/d7/db6/dec/l136 0 2024-04-26T21:26:11.375 INFO:tasks.workunit.client.1.smithi120.stdout:8/976: unlink d5/d6/d34/l140 0 2024-04-26T21:26:11.377 INFO:tasks.workunit.client.0.smithi084.stdout:4/760: dread d5/d7/d65/d7f/db8/f7e [0,4194304] 0 2024-04-26T21:26:11.377 INFO:tasks.workunit.client.0.smithi084.stdout:2/916: stat d6/d7/db6/d115/dcf/f12c 0 2024-04-26T21:26:11.380 INFO:tasks.workunit.client.1.smithi120.stdout:9/956: dwrite d0/d6/d4d/d65/dec/fa0 [0,4194304] 0 2024-04-26T21:26:11.380 INFO:tasks.workunit.client.0.smithi084.stdout:9/745: write da/dd5/d93/dc3/d41/d43/f9f [1137449,58551] 0 2024-04-26T21:26:11.383 INFO:tasks.workunit.client.0.smithi084.stdout:4/761: symlink d5/d7/d65/d90/d91/dba/dc2/lf5 0 2024-04-26T21:26:11.389 INFO:tasks.workunit.client.0.smithi084.stdout:9/746: rename da/de/d1e/d56/da6/f10e to da/db3/f119 0 2024-04-26T21:26:11.389 INFO:tasks.workunit.client.1.smithi120.stdout:9/957: creat d0/d6/d4d/f13f x:0 0 0 2024-04-26T21:26:11.390 INFO:tasks.workunit.client.1.smithi120.stdout:8/977: link d5/d6/d11/d32/d3b/f73 d5/d6/d75/df8/f143 0 2024-04-26T21:26:11.393 INFO:tasks.workunit.client.0.smithi084.stdout:9/747: read da/dd5/d93/d95/fa1 [632836,67256] 0 2024-04-26T21:26:11.402 INFO:tasks.workunit.client.1.smithi120.stdout:8/978: creat d5/d6/d11/d32/d3b/f144 x:0 0 0 2024-04-26T21:26:11.403 INFO:tasks.workunit.client.1.smithi120.stdout:7/999: dwrite d7/d64/da6/d1f/d28/dbb/dcf/fe2 [0,4194304] 0 2024-04-26T21:26:11.409 INFO:tasks.workunit.client.0.smithi084.stdout:4/762: write d5/f23 [1304426,65386] 0 2024-04-26T21:26:11.413 INFO:tasks.workunit.client.1.smithi120.stdout:1/958: dwrite d6/d14/d6f/f137 [0,4194304] 0 2024-04-26T21:26:11.425 INFO:tasks.workunit.client.0.smithi084.stdout:2/917: dread d6/d7/d3d/d15/d1f/d22/d2a/f8b [0,4194304] 0 2024-04-26T21:26:11.428 INFO:tasks.workunit.client.1.smithi120.stdout:9/958: write d0/dd/d34/fa6 [256707,45219] 0 2024-04-26T21:26:11.430 INFO:tasks.workunit.client.0.smithi084.stdout:2/918: fsync d6/d7/d68/f78 0 2024-04-26T21:26:11.431 INFO:tasks.workunit.client.0.smithi084.stdout:9/748: dread da/dd5/d93/dc3/f4e [0,4194304] 0 2024-04-26T21:26:11.431 INFO:tasks.workunit.client.0.smithi084.stdout:4/763: dwrite d5/d10/da1/fbb [0,4194304] 0 2024-04-26T21:26:11.433 INFO:tasks.workunit.client.1.smithi120.stdout:9/959: mkdir d0/dd/d3a/de8/d118/d140 0 2024-04-26T21:26:11.437 INFO:tasks.workunit.client.0.smithi084.stdout:4/764: chown d5/d7/d65/c62 597 1 2024-04-26T21:26:11.439 INFO:tasks.workunit.client.0.smithi084.stdout:2/919: mkdir d6/d7/d3d/d15/d1f/d39/d43/d137 0 2024-04-26T21:26:11.442 INFO:tasks.workunit.client.1.smithi120.stdout:9/960: symlink d0/dd/d3a/de8/d118/d139/l141 0 2024-04-26T21:26:11.443 INFO:tasks.workunit.client.0.smithi084.stdout:9/749: creat da/dd5/d93/dc3/d41/d43/d48/f11a x:0 0 0 2024-04-26T21:26:11.446 INFO:tasks.workunit.client.0.smithi084.stdout:2/920: symlink d6/d7/l138 0 2024-04-26T21:26:11.446 INFO:tasks.workunit.client.1.smithi120.stdout:9/961: mkdir d0/d66/d142 0 2024-04-26T21:26:11.446 INFO:tasks.workunit.client.1.smithi120.stdout:1/959: dwrite d6/d9/fc0 [0,4194304] 0 2024-04-26T21:26:11.448 INFO:tasks.workunit.client.0.smithi084.stdout:9/750: fdatasync da/f23 0 2024-04-26T21:26:11.449 INFO:tasks.workunit.client.1.smithi120.stdout:8/979: dread d5/d6/d11/f2a [0,4194304] 0 2024-04-26T21:26:11.453 INFO:tasks.workunit.client.0.smithi084.stdout:9/751: dread - da/dd5/d93/dc3/d41/d43/dba/ffa zero size 2024-04-26T21:26:11.453 INFO:tasks.workunit.client.0.smithi084.stdout:2/921: creat d6/d7/d68/f139 x:0 0 0 2024-04-26T21:26:11.453 INFO:tasks.workunit.client.0.smithi084.stdout:8/813: sync 2024-04-26T21:26:11.453 INFO:tasks.workunit.client.0.smithi084.stdout:7/834: sync 2024-04-26T21:26:11.456 INFO:tasks.workunit.client.0.smithi084.stdout:9/752: read - da/dd5/d93/dc3/d41/d8d/f115 zero size 2024-04-26T21:26:11.456 INFO:tasks.workunit.client.0.smithi084.stdout:2/922: unlink d6/d1b/cd6 0 2024-04-26T21:26:11.457 INFO:tasks.workunit.client.0.smithi084.stdout:8/814: rmdir d4/d7/d15/d9d 39 2024-04-26T21:26:11.457 INFO:tasks.workunit.client.0.smithi084.stdout:4/765: dwrite d5/d25/d35/d60/d6d/de1/d32/d46/f5c [0,4194304] 0 2024-04-26T21:26:11.464 INFO:tasks.workunit.client.0.smithi084.stdout:8/815: fsync d4/d7/d15/d9d/fbd 0 2024-04-26T21:26:11.468 INFO:tasks.workunit.client.0.smithi084.stdout:8/816: write d4/d7/d15/fc6 [188125,11019] 0 2024-04-26T21:26:11.470 INFO:tasks.workunit.client.1.smithi120.stdout:1/960: truncate d6/d9/dd4/de0/d1b/f81 2720339 0 2024-04-26T21:26:11.471 INFO:tasks.workunit.client.1.smithi120.stdout:9/962: dwrite d0/dd/d34/fa6 [0,4194304] 0 2024-04-26T21:26:11.472 INFO:tasks.workunit.client.1.smithi120.stdout:8/980: dwrite d5/d6/d34/d42/d9d/d7a/f10b [0,4194304] 0 2024-04-26T21:26:11.475 INFO:tasks.workunit.client.0.smithi084.stdout:8/817: mknod d4/d6/db/d1e/d22/d2f/cf6 0 2024-04-26T21:26:11.475 INFO:tasks.workunit.client.1.smithi120.stdout:8/981: write d5/d6/d11/d32/d3b/d105/f106 [527943,28739] 0 2024-04-26T21:26:11.476 INFO:tasks.workunit.client.0.smithi084.stdout:7/835: dwrite d6/d9/d63/db5/fdf [0,4194304] 0 2024-04-26T21:26:11.481 INFO:tasks.workunit.client.1.smithi120.stdout:1/961: read d6/d9/dd4/de0/d1d/d2c/f93 [155498,99845] 0 2024-04-26T21:26:11.483 INFO:tasks.workunit.client.1.smithi120.stdout:9/963: rename d0/d6/d4d/d65/f94 to d0/d66/d93/db7/d102/f143 0 2024-04-26T21:26:11.484 INFO:tasks.workunit.client.0.smithi084.stdout:7/836: unlink d6/d9/d12/d8b/d72/fb7 0 2024-04-26T21:26:11.484 INFO:tasks.workunit.client.0.smithi084.stdout:4/766: dwrite d5/d25/d35/d60/d6d/de1/fc3 [0,4194304] 0 2024-04-26T21:26:11.487 INFO:tasks.workunit.client.0.smithi084.stdout:8/818: mkdir d4/d7/d15/da7/df7 0 2024-04-26T21:26:11.492 INFO:tasks.workunit.client.0.smithi084.stdout:7/837: mkdir d6/d9/d63/db5/d121 0 2024-04-26T21:26:11.492 INFO:tasks.workunit.client.0.smithi084.stdout:8/819: chown d4/d7/d15/c80 32956056 1 2024-04-26T21:26:11.495 INFO:tasks.workunit.client.1.smithi120.stdout:8/982: link d5/d6/d34/d42/d9d/ff1 d5/d6/d34/d42/d4a/deb/d122/f145 0 2024-04-26T21:26:11.495 INFO:tasks.workunit.client.1.smithi120.stdout:8/983: chown d5/d6/d34/d42/d102/d118/dd9 4 1 2024-04-26T21:26:11.498 INFO:tasks.workunit.client.0.smithi084.stdout:4/767: rename d5/d25/d99/dac/cbd to d5/d10/d15/cf6 0 2024-04-26T21:26:11.501 INFO:tasks.workunit.client.0.smithi084.stdout:7/838: write d6/d9/d63/db5/fdf [5240107,15959] 0 2024-04-26T21:26:11.501 INFO:tasks.workunit.client.1.smithi120.stdout:1/962: symlink d6/d9/dd4/de0/d2d/d98/d56/d12e/l141 0 2024-04-26T21:26:11.502 INFO:tasks.workunit.client.1.smithi120.stdout:8/984: creat d5/d6/d34/d42/d4a/deb/d88/f146 x:0 0 0 2024-04-26T21:26:11.504 INFO:tasks.workunit.client.0.smithi084.stdout:4/768: unlink d5/d25/d35/d60/cc6 0 2024-04-26T21:26:11.504 INFO:tasks.workunit.client.1.smithi120.stdout:1/963: dread - d6/d9/dd4/de0/d2d/fbc zero size 2024-04-26T21:26:11.505 INFO:tasks.workunit.client.1.smithi120.stdout:9/964: getdents d0/d6/d4d/d65/dec 0 2024-04-26T21:26:11.506 INFO:tasks.workunit.client.0.smithi084.stdout:8/820: truncate d4/d6/db/d1e/d22/f72 3018704 0 2024-04-26T21:26:11.509 INFO:tasks.workunit.client.1.smithi120.stdout:8/985: truncate d5/d6/d34/d42/d102/d118/d94/fb4 1635186 0 2024-04-26T21:26:11.513 INFO:tasks.workunit.client.0.smithi084.stdout:8/821: creat d4/d6/db/d1e/d22/d39/dc4/ff8 x:0 0 0 2024-04-26T21:26:11.515 INFO:tasks.workunit.client.0.smithi084.stdout:8/822: fsync d4/d7/d15/d37/d52/f67 0 2024-04-26T21:26:11.520 INFO:tasks.workunit.client.1.smithi120.stdout:8/986: fsync d5/d6/d34/d42/d102/d118/f69 0 2024-04-26T21:26:11.523 INFO:tasks.workunit.client.0.smithi084.stdout:2/923: dread d6/d7/d3d/d15/d1f/d22/de6/ffd [0,4194304] 0 2024-04-26T21:26:11.528 INFO:tasks.workunit.client.1.smithi120.stdout:8/987: mknod d5/d6/d34/d42/d102/c147 0 2024-04-26T21:26:11.529 INFO:tasks.workunit.client.1.smithi120.stdout:8/988: chown d5/d6/d75 6 1 2024-04-26T21:26:11.531 INFO:tasks.workunit.client.1.smithi120.stdout:1/964: dread d6/f140 [0,4194304] 0 2024-04-26T21:26:11.532 INFO:tasks.workunit.client.0.smithi084.stdout:4/769: getdents d5/d25/d35/d60 0 2024-04-26T21:26:11.533 INFO:tasks.workunit.client.0.smithi084.stdout:4/770: fsync d5/d25/d99/dac/fcb 0 2024-04-26T21:26:11.535 INFO:tasks.workunit.client.0.smithi084.stdout:8/823: truncate d4/d6/db/d1e/d22/d96/f9f 1224422 0 2024-04-26T21:26:11.536 INFO:tasks.workunit.client.0.smithi084.stdout:4/771: creat d5/d25/d68/ff7 x:0 0 0 2024-04-26T21:26:11.537 INFO:tasks.workunit.client.0.smithi084.stdout:2/924: write d6/d7/d68/f78 [256216,112858] 0 2024-04-26T21:26:11.540 INFO:tasks.workunit.client.1.smithi120.stdout:1/965: symlink d6/daa/dae/l142 0 2024-04-26T21:26:11.540 INFO:tasks.workunit.client.0.smithi084.stdout:4/772: creat d5/d10/d15/d21/ff8 x:0 0 0 2024-04-26T21:26:11.541 INFO:tasks.workunit.client.0.smithi084.stdout:2/925: fdatasync d6/d7/f27 0 2024-04-26T21:26:11.543 INFO:tasks.workunit.client.1.smithi120.stdout:8/989: rename d5/d6/d34/d42/d4a/dbf/d10f/l133 to d5/d6/d34/d42/l148 0 2024-04-26T21:26:11.543 INFO:tasks.workunit.client.0.smithi084.stdout:4/773: chown d5/d25/d35/d60/d6d/de1/dd7/df2 44408 1 2024-04-26T21:26:11.543 INFO:tasks.workunit.client.1.smithi120.stdout:9/965: dread d0/d6/d4d/d65/dec/f8c [0,4194304] 0 2024-04-26T21:26:11.544 INFO:tasks.workunit.client.0.smithi084.stdout:2/926: creat d6/d7/d3d/d4f/de8/f13a x:0 0 0 2024-04-26T21:26:11.547 INFO:tasks.workunit.client.0.smithi084.stdout:4/774: fdatasync d5/d25/d35/d60/d6d/de1/f51 0 2024-04-26T21:26:11.549 INFO:tasks.workunit.client.1.smithi120.stdout:8/990: creat d5/d6/d75/d124/f149 x:0 0 0 2024-04-26T21:26:11.550 INFO:tasks.workunit.client.0.smithi084.stdout:8/824: write d4/d6/db/d1e/d22/d39/d4a/f5e [544324,113158] 0 2024-04-26T21:26:11.550 INFO:tasks.workunit.client.0.smithi084.stdout:2/927: fsync d6/d7/f3f 0 2024-04-26T21:26:11.552 INFO:tasks.workunit.client.0.smithi084.stdout:4/775: unlink d5/d10/d15/fdc 0 2024-04-26T21:26:11.552 INFO:tasks.workunit.client.1.smithi120.stdout:8/991: write d5/d6/d34/d42/d4a/deb/d88/f10a [648640,28678] 0 2024-04-26T21:26:11.553 INFO:tasks.workunit.client.0.smithi084.stdout:8/825: chown d4/d7/d15/d37/d52/fc3 39287 1 2024-04-26T21:26:11.555 INFO:tasks.workunit.client.0.smithi084.stdout:4/776: mknod d5/d7/cf9 0 2024-04-26T21:26:11.557 INFO:tasks.workunit.client.0.smithi084.stdout:4/777: readlink d5/d25/d35/d60/d69/db2/lb3 0 2024-04-26T21:26:11.558 INFO:tasks.workunit.client.0.smithi084.stdout:8/826: unlink d4/d6/db/d1e/d22/c91 0 2024-04-26T21:26:11.560 INFO:tasks.workunit.client.0.smithi084.stdout:8/827: chown d4/d6/db/d1e/fd5 34202721 1 2024-04-26T21:26:11.562 INFO:tasks.workunit.client.1.smithi120.stdout:1/966: dwrite d6/d14/d3c/dab/fc4 [0,4194304] 0 2024-04-26T21:26:11.562 INFO:tasks.workunit.client.0.smithi084.stdout:2/928: getdents d6/d7/d68 0 2024-04-26T21:26:11.565 INFO:tasks.workunit.client.1.smithi120.stdout:9/966: dwrite d0/dd/d3a/d5c/f9e [0,4194304] 0 2024-04-26T21:26:11.566 INFO:tasks.workunit.client.0.smithi084.stdout:2/929: mkdir d6/d7/d3d/d15/d1f/d39/da5/d13b 0 2024-04-26T21:26:11.568 INFO:tasks.workunit.client.1.smithi120.stdout:9/967: chown d0/d6/d4d/d65/dec/d77/dc5/cd5 97896036 1 2024-04-26T21:26:11.571 INFO:tasks.workunit.client.1.smithi120.stdout:1/967: unlink d6/d9/dd4/de0/c12 0 2024-04-26T21:26:11.573 INFO:tasks.workunit.client.0.smithi084.stdout:4/778: dwrite d5/d25/d35/d60/d6d/de1/f8a [0,4194304] 0 2024-04-26T21:26:11.576 INFO:tasks.workunit.client.0.smithi084.stdout:2/930: fsync d6/d7/d3d/d15/d1f/d39/d20/d45/f51 0 2024-04-26T21:26:11.586 INFO:tasks.workunit.client.0.smithi084.stdout:8/828: rename d4/d6/db/d1e/d22/fcc to d4/d6/db/d1e/d22/d96/ff9 0 2024-04-26T21:26:11.588 INFO:tasks.workunit.client.0.smithi084.stdout:4/779: rmdir d5/d2e/de5 0 2024-04-26T21:26:11.590 INFO:tasks.workunit.client.0.smithi084.stdout:4/780: dread - d5/d25/d35/d60/fab zero size 2024-04-26T21:26:11.593 INFO:tasks.workunit.client.1.smithi120.stdout:9/968: dwrite d0/d6/f109 [0,4194304] 0 2024-04-26T21:26:11.594 INFO:tasks.workunit.client.1.smithi120.stdout:8/992: dread d5/d6/d11/d32/d3b/f56 [0,4194304] 0 2024-04-26T21:26:11.596 INFO:tasks.workunit.client.0.smithi084.stdout:4/781: mkdir d5/d10/dfa 0 2024-04-26T21:26:11.596 INFO:tasks.workunit.client.1.smithi120.stdout:9/969: chown d0/d6/d4d/d65/dec/d2d/f97 1 1 2024-04-26T21:26:11.600 INFO:tasks.workunit.client.0.smithi084.stdout:2/931: dwrite d6/d7/d68/f77 [0,4194304] 0 2024-04-26T21:26:11.601 INFO:tasks.workunit.client.0.smithi084.stdout:4/782: mknod d5/d7/d65/d7f/d6a/cfb 0 2024-04-26T21:26:11.601 INFO:tasks.workunit.client.1.smithi120.stdout:1/968: dwrite d6/d9/dd4/de0/d1d/d5d/d67/fb [0,4194304] 0 2024-04-26T21:26:11.602 INFO:tasks.workunit.client.1.smithi120.stdout:8/993: getdents d5/d6/d34 0 2024-04-26T21:26:11.603 INFO:tasks.workunit.client.0.smithi084.stdout:3/815: sync 2024-04-26T21:26:11.603 INFO:tasks.workunit.client.0.smithi084.stdout:6/742: sync 2024-04-26T21:26:11.603 INFO:tasks.workunit.client.0.smithi084.stdout:5/772: sync 2024-04-26T21:26:11.603 INFO:tasks.workunit.client.0.smithi084.stdout:1/805: sync 2024-04-26T21:26:11.603 INFO:tasks.workunit.client.0.smithi084.stdout:0/776: sync 2024-04-26T21:26:11.609 INFO:tasks.workunit.client.0.smithi084.stdout:2/932: creat d6/d7/d3d/d4f/d10b/f13c x:0 0 0 2024-04-26T21:26:11.610 INFO:tasks.workunit.client.0.smithi084.stdout:8/829: write d4/f7a [775637,104339] 0 2024-04-26T21:26:11.611 INFO:tasks.workunit.client.0.smithi084.stdout:4/783: mknod d5/d7/d65/d7f/db8/cfc 0 2024-04-26T21:26:11.611 INFO:tasks.workunit.client.0.smithi084.stdout:2/933: chown d6/d7/db6/d115/d11b 31311 1 2024-04-26T21:26:11.612 INFO:tasks.workunit.client.0.smithi084.stdout:0/777: rmdir de/d2b/d77/d32/d96/dbe 39 2024-04-26T21:26:11.615 INFO:tasks.workunit.client.0.smithi084.stdout:3/816: creat d1/f124 x:0 0 0 2024-04-26T21:26:11.617 INFO:tasks.workunit.client.1.smithi120.stdout:9/970: link d0/d6/d4d/d65/dec/d2d/d4b/d85/f88 d0/dd/d45/dc0/f144 0 2024-04-26T21:26:11.619 INFO:tasks.workunit.client.0.smithi084.stdout:6/743: mkdir d3/de/d1a/d43/d75/dc4/dea 0 2024-04-26T21:26:11.620 INFO:tasks.workunit.client.0.smithi084.stdout:4/784: mknod d5/d10/d82/cfd 0 2024-04-26T21:26:11.624 INFO:tasks.workunit.client.0.smithi084.stdout:5/773: rename d0/d49/lb6 to d0/dc/df/d31/lf1 0 2024-04-26T21:26:11.625 INFO:tasks.workunit.client.0.smithi084.stdout:2/934: chown d6/d7/d3d/d15/d1f/d22/dd4/ded/c122 7 1 2024-04-26T21:26:11.625 INFO:tasks.workunit.client.1.smithi120.stdout:1/969: dwrite d6/f135 [0,4194304] 0 2024-04-26T21:26:11.627 INFO:tasks.workunit.client.0.smithi084.stdout:5/774: write d0/f4b [133701,23823] 0 2024-04-26T21:26:11.628 INFO:tasks.workunit.client.0.smithi084.stdout:4/785: creat d5/d10/ffe x:0 0 0 2024-04-26T21:26:11.631 INFO:tasks.workunit.client.1.smithi120.stdout:9/971: truncate d0/d6/d4d/d65/dec/d2d/d4b/f55 301985 0 2024-04-26T21:26:11.634 INFO:tasks.workunit.client.0.smithi084.stdout:1/806: rename d2/d9/d15/d28 to d2/d54/d93/d110 0 2024-04-26T21:26:11.634 INFO:tasks.workunit.client.1.smithi120.stdout:1/970: creat d6/d9/dd4/de0/d2d/d48/d86/dc1/df3/d13b/f143 x:0 0 0 2024-04-26T21:26:11.635 INFO:tasks.workunit.client.0.smithi084.stdout:3/817: truncate d1/d24/d27/d3a/f9f 2457399 0 2024-04-26T21:26:11.635 INFO:tasks.workunit.client.1.smithi120.stdout:9/972: write d0/dd/d34/f136 [912560,109410] 0 2024-04-26T21:26:11.642 INFO:tasks.workunit.client.0.smithi084.stdout:5/775: read d0/d49/fde [5982042,128908] 0 2024-04-26T21:26:11.642 INFO:tasks.workunit.client.0.smithi084.stdout:6/744: dread d3/de/d1a/d43/d75/d9c/fc8 [0,4194304] 0 2024-04-26T21:26:11.642 INFO:tasks.workunit.client.0.smithi084.stdout:4/786: fsync d5/d25/d35/d60/fab 0 2024-04-26T21:26:11.642 INFO:tasks.workunit.client.1.smithi120.stdout:9/973: chown d0/d6/d4d/d65/dec/d2d/d4b/l96 18477545 1 2024-04-26T21:26:11.643 INFO:tasks.workunit.client.0.smithi084.stdout:3/818: mkdir d1/dea/d125 0 2024-04-26T21:26:11.646 INFO:tasks.workunit.client.1.smithi120.stdout:1/971: creat d6/d9/dd4/de0/d1d/d5d/d12b/f144 x:0 0 0 2024-04-26T21:26:11.647 INFO:tasks.workunit.client.1.smithi120.stdout:8/994: truncate d5/d6/d34/d42/d102/d118/d94/fb4 1616492 0 2024-04-26T21:26:11.647 INFO:tasks.workunit.client.0.smithi084.stdout:8/830: rename d4/d6/db/l60 to d4/d7/d15/da7/lfa 0 2024-04-26T21:26:11.649 INFO:tasks.workunit.client.1.smithi120.stdout:8/995: chown d5/d6/d11/d32/d3b/f6f 1 1 2024-04-26T21:26:11.650 INFO:tasks.workunit.client.0.smithi084.stdout:5/776: rmdir d0/dc/df/d2a 39 2024-04-26T21:26:11.652 INFO:tasks.workunit.client.0.smithi084.stdout:1/807: creat d2/d54/d5e/d66/d2a/d2c/f111 x:0 0 0 2024-04-26T21:26:11.656 INFO:tasks.workunit.client.0.smithi084.stdout:3/819: mknod d1/d24/d27/d3a/de5/c126 0 2024-04-26T21:26:11.657 INFO:tasks.workunit.client.0.smithi084.stdout:2/935: dwrite d6/d7/d3d/d15/d1f/d39/d43/fe0 [0,4194304] 0 2024-04-26T21:26:11.657 INFO:tasks.workunit.client.1.smithi120.stdout:1/972: rename d6/d9/dd4/de0/d2d/d98/d56/l65 to d6/d9/dd4/de0/d2d/d48/l145 0 2024-04-26T21:26:11.658 INFO:tasks.workunit.client.1.smithi120.stdout:1/973: chown d6/d9/dd4 110119 1 2024-04-26T21:26:11.663 INFO:tasks.workunit.client.0.smithi084.stdout:4/787: dread d5/d25/d35/f86 [0,4194304] 0 2024-04-26T21:26:11.665 INFO:tasks.workunit.client.1.smithi120.stdout:9/974: dwrite d0/d6/d4d/d65/dec/f8c [0,4194304] 0 2024-04-26T21:26:11.669 INFO:tasks.workunit.client.0.smithi084.stdout:0/778: dwrite de/f14 [0,4194304] 0 2024-04-26T21:26:11.669 INFO:tasks.workunit.client.1.smithi120.stdout:1/974: fdatasync d6/d9/dd4/de0/d1b/f60 0 2024-04-26T21:26:11.673 INFO:tasks.workunit.client.0.smithi084.stdout:3/820: symlink d1/d24/d27/l127 0 2024-04-26T21:26:11.673 INFO:tasks.workunit.client.0.smithi084.stdout:4/788: truncate d5/d10/f1b 4737688 0 2024-04-26T21:26:11.676 INFO:tasks.workunit.client.1.smithi120.stdout:9/975: rename d0/f1 to d0/d66/d93/f145 0 2024-04-26T21:26:11.677 INFO:tasks.workunit.client.0.smithi084.stdout:6/745: rename d3/de/d15/d23/c25 to d3/de/d9e/dca/ceb 0 2024-04-26T21:26:11.677 INFO:tasks.workunit.client.0.smithi084.stdout:1/808: mkdir d2/d54/d5e/d66/d2a/d2c/d45/d112 0 2024-04-26T21:26:11.687 INFO:tasks.workunit.client.1.smithi120.stdout:8/996: dwrite d5/d6/d34/d42/d9d/fd0 [0,4194304] 0 2024-04-26T21:26:11.692 INFO:tasks.workunit.client.0.smithi084.stdout:8/831: dwrite d4/d7/d15/d9d/fad [4194304,4194304] 0 2024-04-26T21:26:11.692 INFO:tasks.workunit.client.0.smithi084.stdout:0/779: mknod de/d78/d9e/da1/dad/cf5 0 2024-04-26T21:26:11.692 INFO:tasks.workunit.client.0.smithi084.stdout:4/789: creat d5/d7/d65/d90/d91/daa/fff x:0 0 0 2024-04-26T21:26:11.693 INFO:tasks.workunit.client.1.smithi120.stdout:1/975: getdents d6/d9/dd4/de0/d2d/d48/d86/dc1 0 2024-04-26T21:26:11.694 INFO:tasks.workunit.client.1.smithi120.stdout:8/997: read d5/d6/d34/d42/d4a/deb/d88/fbb [3119231,75922] 0 2024-04-26T21:26:11.694 INFO:tasks.workunit.client.0.smithi084.stdout:1/809: chown d2/d54/d5e/d66/d3a/d48/cd1 9707596 1 2024-04-26T21:26:11.702 INFO:tasks.workunit.client.1.smithi120.stdout:1/976: creat d6/d14/d3c/dab/f146 x:0 0 0 2024-04-26T21:26:11.704 INFO:tasks.workunit.client.1.smithi120.stdout:1/977: readlink d6/d9/dd4/de0/d2d/d98/l11e 0 2024-04-26T21:26:11.705 INFO:tasks.workunit.client.1.smithi120.stdout:8/998: mkdir d5/d6/d34/d42/d102/d118/db8/d11a/d14a 0 2024-04-26T21:26:11.706 INFO:tasks.workunit.client.0.smithi084.stdout:4/790: chown d5/d7/d65/d90/d91/fec 48 1 2024-04-26T21:26:11.712 INFO:tasks.workunit.client.0.smithi084.stdout:6/746: rename d3/de/d1a/d2f/fdf to d3/de/d1a/d43/d75/dc4/dea/fec 0 2024-04-26T21:26:11.712 INFO:tasks.workunit.client.0.smithi084.stdout:2/936: dwrite d6/d7/d3d/d79/d85/df3/f112 [0,4194304] 0 2024-04-26T21:26:11.715 INFO:tasks.workunit.client.1.smithi120.stdout:1/978: creat d6/d9/dd4/de0/d2d/d98/d13d/f147 x:0 0 0 2024-04-26T21:26:11.718 INFO:tasks.workunit.client.0.smithi084.stdout:1/810: write d2/d54/d93/d110/d47/f78 [9272966,100238] 0 2024-04-26T21:26:11.720 INFO:tasks.workunit.client.1.smithi120.stdout:8/999: link d5/d6/d34/d42/d9d/d83/d11e/fce d5/d6/d34/d42/d102/d118/dd9/dda/dfc/f14b 0 2024-04-26T21:26:11.720 INFO:tasks.workunit.client.1.smithi120.stdout:9/976: dread d0/d6/d4d/d65/dec/d2d/f97 [4194304,4194304] 0 2024-04-26T21:26:11.721 INFO:tasks.workunit.client.1.smithi120.stdout:9/977: chown d0/d66/c9d 122452 1 2024-04-26T21:26:11.722 INFO:tasks.workunit.client.0.smithi084.stdout:2/937: mknod d6/d7/d3d/d79/c13d 0 2024-04-26T21:26:11.722 INFO:tasks.workunit.client.0.smithi084.stdout:4/791: mknod d5/d7/d65/c100 0 2024-04-26T21:26:11.722 INFO:tasks.workunit.client.0.smithi084.stdout:8/832: getdents d4/d3a 0 2024-04-26T21:26:11.723 INFO:tasks.workunit.client.0.smithi084.stdout:1/811: dread - d2/d9/d15/d9f/f104 zero size 2024-04-26T21:26:11.724 INFO:tasks.workunit.client.0.smithi084.stdout:6/747: mkdir d3/de/d15/df/dae/ded 0 2024-04-26T21:26:11.724 INFO:tasks.workunit.client.1.smithi120.stdout:9/978: read d0/dd/d3a/d5c/d9f/fa2 [3378150,114761] 0 2024-04-26T21:26:11.726 INFO:tasks.workunit.client.0.smithi084.stdout:3/821: dwrite d1/d2c/d2f/d31/d52/f8b [0,4194304] 0 2024-04-26T21:26:11.727 INFO:tasks.workunit.client.1.smithi120.stdout:9/979: fsync d0/d6/d4d/d65/dec/d2d/d4b/d85/f13c 0 2024-04-26T21:26:11.728 INFO:tasks.workunit.client.0.smithi084.stdout:6/748: chown d3/f26 373 1 2024-04-26T21:26:11.729 INFO:tasks.workunit.client.0.smithi084.stdout:1/812: write d2/ff8 [916971,78875] 0 2024-04-26T21:26:11.729 INFO:tasks.workunit.client.1.smithi120.stdout:9/980: dread - d0/dd/d3a/dae/f13d zero size 2024-04-26T21:26:11.731 INFO:tasks.workunit.client.1.smithi120.stdout:1/979: dread d6/d9/dd4/de0/d1d/d2c/f93 [0,4194304] 0 2024-04-26T21:26:11.732 INFO:tasks.workunit.client.0.smithi084.stdout:8/833: unlink d4/d7/d15/c28 0 2024-04-26T21:26:11.732 INFO:tasks.workunit.client.0.smithi084.stdout:4/792: mkdir d5/d10/d15/d101 0 2024-04-26T21:26:11.733 INFO:tasks.workunit.client.0.smithi084.stdout:3/822: write d1/d24/d27/f30 [1380833,100182] 0 2024-04-26T21:26:11.734 INFO:tasks.workunit.client.1.smithi120.stdout:1/980: truncate d6/d14/d3c/dab/f146 628932 0 2024-04-26T21:26:11.735 INFO:tasks.workunit.client.1.smithi120.stdout:9/981: readlink d0/d6/d4d/d65/dec/d2d/l43 0 2024-04-26T21:26:11.737 INFO:tasks.workunit.client.0.smithi084.stdout:6/749: mkdir d3/de/d15/df/dae/ded/dee 0 2024-04-26T21:26:11.738 INFO:tasks.workunit.client.0.smithi084.stdout:1/813: chown d2/d54/d93/d110/d47/f81 2 1 2024-04-26T21:26:11.738 INFO:tasks.workunit.client.0.smithi084.stdout:4/793: chown d5/d7/c28 7 1 2024-04-26T21:26:11.744 INFO:tasks.workunit.client.0.smithi084.stdout:7/839: sync 2024-04-26T21:26:11.744 INFO:tasks.workunit.client.0.smithi084.stdout:9/753: sync 2024-04-26T21:26:11.745 INFO:tasks.workunit.client.0.smithi084.stdout:1/814: readlink d2/d54/d93/d110/d5a/l88 0 2024-04-26T21:26:11.746 INFO:tasks.workunit.client.0.smithi084.stdout:2/938: dwrite d6/d1b/f111 [0,4194304] 0 2024-04-26T21:26:11.746 INFO:tasks.workunit.client.0.smithi084.stdout:7/840: chown d6/d9/d96 0 1 2024-04-26T21:26:11.747 INFO:tasks.workunit.client.1.smithi120.stdout:9/982: symlink d0/l146 0 2024-04-26T21:26:11.756 INFO:tasks.workunit.client.0.smithi084.stdout:4/794: unlink d5/d25/f47 0 2024-04-26T21:26:11.756 INFO:tasks.workunit.client.0.smithi084.stdout:3/823: symlink d1/l128 0 2024-04-26T21:26:11.756 INFO:tasks.workunit.client.0.smithi084.stdout:4/795: stat d5 0 2024-04-26T21:26:11.757 INFO:tasks.workunit.client.0.smithi084.stdout:5/777: dread d0/d49/f95 [0,4194304] 0 2024-04-26T21:26:11.760 INFO:tasks.workunit.client.0.smithi084.stdout:8/834: rename d4/d6/la9 to d4/d6/db/d1e/d22/d39/de9/lfb 0 2024-04-26T21:26:11.762 INFO:tasks.workunit.client.0.smithi084.stdout:7/841: fsync d6/d68/d7f/d107/d84/f55 0 2024-04-26T21:26:11.765 INFO:tasks.workunit.client.0.smithi084.stdout:6/750: mknod d3/de/d1a/d2f/d4c/d58/de7/cef 0 2024-04-26T21:26:11.766 INFO:tasks.workunit.client.0.smithi084.stdout:9/754: truncate da/dd5/d93/dc3/d41/d43/dba/f107 42375 0 2024-04-26T21:26:11.767 INFO:tasks.workunit.client.0.smithi084.stdout:3/824: mkdir d1/d2c/d2f/d31/d55/d4e/d7c/db1/d129 0 2024-04-26T21:26:11.768 INFO:tasks.workunit.client.0.smithi084.stdout:0/780: dwrite de/d2b/df3/f59 [0,4194304] 0 2024-04-26T21:26:11.769 INFO:tasks.workunit.client.0.smithi084.stdout:7/842: chown d6/f65 145683806 1 2024-04-26T21:26:11.774 INFO:tasks.workunit.client.0.smithi084.stdout:3/825: readlink d1/d24/dbb/l113 0 2024-04-26T21:26:11.776 INFO:tasks.workunit.client.0.smithi084.stdout:4/796: rename d5/d7/d65/d90/d91/dba/dc2/feb to d5/d25/d35/f102 0 2024-04-26T21:26:11.783 INFO:tasks.workunit.client.0.smithi084.stdout:9/755: creat da/dd5/d93/d95/f11b x:0 0 0 2024-04-26T21:26:11.783 INFO:tasks.workunit.client.0.smithi084.stdout:0/781: creat de/d20/ff6 x:0 0 0 2024-04-26T21:26:11.783 INFO:tasks.workunit.client.0.smithi084.stdout:3/826: read d1/f22 [1953208,103735] 0 2024-04-26T21:26:11.786 INFO:tasks.workunit.client.0.smithi084.stdout:8/835: rename d4/ced to d4/d7/d15/da7/cfc 0 2024-04-26T21:26:11.787 INFO:tasks.workunit.client.1.smithi120.stdout:1/981: write d6/d9/dd4/de0/d1d/d2c/fdc [91248,78352] 0 2024-04-26T21:26:11.792 INFO:tasks.workunit.client.0.smithi084.stdout:4/797: truncate d5/d10/d82/fe8 145517 0 2024-04-26T21:26:11.795 INFO:tasks.workunit.client.0.smithi084.stdout:3/827: mkdir d1/d24/de0/d12a 0 2024-04-26T21:26:11.799 INFO:tasks.workunit.client.0.smithi084.stdout:4/798: stat d5/d25/d35/d60/d6d/de1/dd7 0 2024-04-26T21:26:11.800 INFO:tasks.workunit.client.0.smithi084.stdout:9/756: write da/dd5/d93/d95/f111 [1380441,2122] 0 2024-04-26T21:26:11.803 INFO:tasks.workunit.client.0.smithi084.stdout:6/751: dwrite d3/fcb [0,4194304] 0 2024-04-26T21:26:11.803 INFO:tasks.workunit.client.0.smithi084.stdout:2/939: dread d6/d7/f3f [0,4194304] 0 2024-04-26T21:26:11.803 INFO:tasks.workunit.client.0.smithi084.stdout:9/757: fsync da/de/d1e/f31 0 2024-04-26T21:26:11.810 INFO:tasks.workunit.client.0.smithi084.stdout:8/836: getdents d4/d6/db/d1e/d22/d39/d4a 0 2024-04-26T21:26:11.814 INFO:tasks.workunit.client.0.smithi084.stdout:4/799: rmdir d5/d25/d35/d60/d69/db2 39 2024-04-26T21:26:11.818 INFO:tasks.workunit.client.0.smithi084.stdout:4/800: write d5/d7/d65/d7f/db8/f66 [827573,46263] 0 2024-04-26T21:26:11.825 INFO:tasks.workunit.client.0.smithi084.stdout:1/815: dread d2/d1b/f65 [0,4194304] 0 2024-04-26T21:26:11.832 INFO:tasks.workunit.client.0.smithi084.stdout:7/843: dwrite d6/d9/d12/f3d [0,4194304] 0 2024-04-26T21:26:11.835 INFO:tasks.workunit.client.0.smithi084.stdout:2/940: dwrite d6/d7/d68/f10c [0,4194304] 0 2024-04-26T21:26:11.836 INFO:tasks.workunit.client.0.smithi084.stdout:5/778: truncate d0/dc/df/d51/fb5 3611057 0 2024-04-26T21:26:11.839 INFO:tasks.workunit.client.0.smithi084.stdout:0/782: write de/d2b/d77/d32/f8d [830059,112816] 0 2024-04-26T21:26:11.848 INFO:tasks.workunit.client.0.smithi084.stdout:9/758: unlink da/dd5/d93/dc3/d41/d43/d48/d61/fc1 0 2024-04-26T21:26:11.853 INFO:tasks.workunit.client.0.smithi084.stdout:9/759: read da/dd5/d93/d95/fa1 [339788,42380] 0 2024-04-26T21:26:11.853 INFO:tasks.workunit.client.0.smithi084.stdout:8/837: write d4/d7/d15/f6f [344004,52983] 0 2024-04-26T21:26:11.853 INFO:tasks.workunit.client.0.smithi084.stdout:4/801: creat d5/d25/d99/da0/f103 x:0 0 0 2024-04-26T21:26:11.853 INFO:tasks.workunit.client.0.smithi084.stdout:7/844: fdatasync d6/d68/d7f/fc1 0 2024-04-26T21:26:11.856 INFO:tasks.workunit.client.0.smithi084.stdout:7/845: stat d6/f8c 0 2024-04-26T21:26:11.857 INFO:tasks.workunit.client.0.smithi084.stdout:2/941: creat d6/d7/d3d/d4f/d10b/f13e x:0 0 0 2024-04-26T21:26:11.858 INFO:tasks.workunit.client.0.smithi084.stdout:3/828: link d1/d24/d27/d3a/ca0 d1/d24/d27/d3a/ddb/df5/d11d/c12b 0 2024-04-26T21:26:11.861 INFO:tasks.workunit.client.0.smithi084.stdout:0/783: read de/d2b/f39 [3308,44328] 0 2024-04-26T21:26:11.861 INFO:tasks.workunit.client.0.smithi084.stdout:5/779: link d0/dc/df/d31/d45/fd7 d0/dc/df/d31/d53/d87/ff2 0 2024-04-26T21:26:11.865 INFO:tasks.workunit.client.0.smithi084.stdout:6/752: rename d3/de/f6d to d3/de/d1a/d43/ff0 0 2024-04-26T21:26:11.867 INFO:tasks.workunit.client.0.smithi084.stdout:8/838: symlink d4/d6/db/d1e/d22/d39/lfd 0 2024-04-26T21:26:11.867 INFO:tasks.workunit.client.1.smithi120.stdout:9/983: symlink d0/dd/d3a/d5c/d98/db8/l147 0 2024-04-26T21:26:11.869 INFO:tasks.workunit.client.1.smithi120.stdout:9/984: readlink d0/d66/d93/db7/dc7/l133 0 2024-04-26T21:26:11.870 INFO:tasks.workunit.client.0.smithi084.stdout:2/942: symlink d6/d7/d3d/d4f/de8/l13f 0 2024-04-26T21:26:11.871 INFO:tasks.workunit.client.0.smithi084.stdout:2/943: readlink d6/d7/d68/l9a 0 2024-04-26T21:26:11.878 INFO:tasks.workunit.client.0.smithi084.stdout:7/846: dread d6/d9/f35 [0,4194304] 0 2024-04-26T21:26:11.879 INFO:tasks.workunit.client.0.smithi084.stdout:6/753: creat d3/de/d1a/d43/d75/dc4/dea/ff1 x:0 0 0 2024-04-26T21:26:11.887 INFO:tasks.workunit.client.0.smithi084.stdout:3/829: truncate d1/d2c/d2f/d31/d55/f88 273434 0 2024-04-26T21:26:11.888 INFO:tasks.workunit.client.1.smithi120.stdout:9/985: dwrite d0/dd/d3a/ff6 [0,4194304] 0 2024-04-26T21:26:11.888 INFO:tasks.workunit.client.0.smithi084.stdout:0/784: dread de/d2b/d77/f33 [0,4194304] 0 2024-04-26T21:26:11.888 INFO:tasks.workunit.client.0.smithi084.stdout:9/760: link da/dd5/d93/dc3/d41/d8d/dca/lf4 da/dd5/d93/l11c 0 2024-04-26T21:26:11.893 INFO:tasks.workunit.client.0.smithi084.stdout:6/754: creat d3/de/d15/d23/d90/da2/ff2 x:0 0 0 2024-04-26T21:26:11.895 INFO:tasks.workunit.client.0.smithi084.stdout:3/830: mknod d1/d2c/d2f/d31/dc7/c12c 0 2024-04-26T21:26:11.895 INFO:tasks.workunit.client.0.smithi084.stdout:7/847: fdatasync d6/f4b 0 2024-04-26T21:26:11.896 INFO:tasks.workunit.client.0.smithi084.stdout:8/839: dwrite d4/d6/db/fdb [0,4194304] 0 2024-04-26T21:26:11.897 INFO:tasks.workunit.client.0.smithi084.stdout:9/761: unlink da/dd5/d93/dc3/d41/d43/d48/d61/f8a 0 2024-04-26T21:26:11.905 INFO:tasks.workunit.client.0.smithi084.stdout:0/785: rename de/d20/d4e/f60 to de/d2b/d77/d32/d96/da0/ff7 0 2024-04-26T21:26:11.914 INFO:tasks.workunit.client.0.smithi084.stdout:7/848: symlink d6/d9/d12/d19/d60/l122 0 2024-04-26T21:26:11.917 INFO:tasks.workunit.client.0.smithi084.stdout:4/802: dread d5/d10/d15/d21/fb7 [0,4194304] 0 2024-04-26T21:26:11.917 INFO:tasks.workunit.client.0.smithi084.stdout:1/816: dwrite d2/d54/d5e/d66/d2a/f95 [0,4194304] 0 2024-04-26T21:26:11.927 INFO:tasks.workunit.client.0.smithi084.stdout:1/817: read d2/d54/d5e/d66/d2a/d2c/d45/f68 [99046,77729] 0 2024-04-26T21:26:11.928 INFO:tasks.workunit.client.0.smithi084.stdout:8/840: mknod d4/d6/cfe 0 2024-04-26T21:26:11.929 INFO:tasks.workunit.client.0.smithi084.stdout:2/944: dread d6/d7/d3d/d15/d1f/d39/d20/d45/d6d/f95 [0,4194304] 0 2024-04-26T21:26:11.930 INFO:tasks.workunit.client.0.smithi084.stdout:5/780: dwrite d0/dc/df/d31/d53/f83 [0,4194304] 0 2024-04-26T21:26:11.936 INFO:tasks.workunit.client.0.smithi084.stdout:0/786: mkdir de/df8 0 2024-04-26T21:26:11.937 INFO:tasks.workunit.client.0.smithi084.stdout:6/755: dwrite d3/de/d41/d5c/f97 [0,4194304] 0 2024-04-26T21:26:11.937 INFO:tasks.workunit.client.0.smithi084.stdout:9/762: write da/f100 [5054254,81752] 0 2024-04-26T21:26:11.937 INFO:tasks.workunit.client.0.smithi084.stdout:3/831: mkdir d1/d2c/d2f/d31/d55/d4e/d7c/db1/d129/d12d 0 2024-04-26T21:26:11.939 INFO:tasks.workunit.client.0.smithi084.stdout:1/818: truncate d2/d19/dd2/feb 819030 0 2024-04-26T21:26:11.946 INFO:tasks.workunit.client.0.smithi084.stdout:0/787: dread - de/d20/d4e/f93 zero size 2024-04-26T21:26:11.949 INFO:tasks.workunit.client.0.smithi084.stdout:1/819: chown d2/d19/f1e 115 1 2024-04-26T21:26:11.952 INFO:tasks.workunit.client.0.smithi084.stdout:2/945: creat d6/d7/d3d/d4f/d10b/f140 x:0 0 0 2024-04-26T21:26:11.952 INFO:tasks.workunit.client.0.smithi084.stdout:0/788: stat de/d20/d4c/dae/fb4 0 2024-04-26T21:26:11.954 INFO:tasks.workunit.client.0.smithi084.stdout:3/832: rename d1/d2c/d2f/d31/d55/d4e/d10c to d1/d2c/d2f/d31/d55/d4e/d10c/d12e 22 2024-04-26T21:26:11.956 INFO:tasks.workunit.client.0.smithi084.stdout:1/820: rmdir d2/d9/d15 39 2024-04-26T21:26:11.958 INFO:tasks.workunit.client.0.smithi084.stdout:8/841: write d4/d7/d15/d3c/f83 [591207,28589] 0 2024-04-26T21:26:11.962 INFO:tasks.workunit.client.0.smithi084.stdout:7/849: dwrite d6/d9/d12/d19/f7e [0,4194304] 0 2024-04-26T21:26:11.962 INFO:tasks.workunit.client.0.smithi084.stdout:9/763: dread da/dd5/d93/dc3/d41/d43/d4a/d82/f85 [0,4194304] 0 2024-04-26T21:26:11.965 INFO:tasks.workunit.client.0.smithi084.stdout:0/789: creat de/d2b/df3/ff9 x:0 0 0 2024-04-26T21:26:11.971 INFO:tasks.workunit.client.0.smithi084.stdout:3/833: rename d1/d24/de0 to d1/dea/d12f 0 2024-04-26T21:26:11.971 INFO:tasks.workunit.client.0.smithi084.stdout:4/803: dwrite d5/d25/d35/d97/f9c [0,4194304] 0 2024-04-26T21:26:11.978 INFO:tasks.workunit.client.0.smithi084.stdout:9/764: fdatasync da/dd5/d93/d95/fa1 0 2024-04-26T21:26:11.980 INFO:tasks.workunit.client.0.smithi084.stdout:1/821: truncate d2/d19/d63/f96 716169 0 2024-04-26T21:26:11.980 INFO:tasks.workunit.client.0.smithi084.stdout:2/946: read d6/d7/d3d/d15/d1f/d39/d20/d45/f97 [2274650,122568] 0 2024-04-26T21:26:11.981 INFO:tasks.workunit.client.0.smithi084.stdout:7/850: creat d6/d68/d7f/f123 x:0 0 0 2024-04-26T21:26:11.985 INFO:tasks.workunit.client.0.smithi084.stdout:3/834: creat d1/d2c/d2f/d31/d55/d4e/d98/d9e/f130 x:0 0 0 2024-04-26T21:26:11.988 INFO:tasks.workunit.client.0.smithi084.stdout:9/765: read da/dd5/d93/dc3/d4f/f59 [27729,55510] 0 2024-04-26T21:26:11.990 INFO:tasks.workunit.client.0.smithi084.stdout:1/822: mkdir d2/d9/d15/d9f/d113 0 2024-04-26T21:26:11.992 INFO:tasks.workunit.client.0.smithi084.stdout:4/804: link d5/d7/lc d5/d10/d15/d21/l104 0 2024-04-26T21:26:11.995 INFO:tasks.workunit.client.0.smithi084.stdout:8/842: dwrite d4/d7/d15/d9d/faf [4194304,4194304] 0 2024-04-26T21:26:11.998 INFO:tasks.workunit.client.0.smithi084.stdout:9/766: mkdir da/de/d1e/d56/da6/de6/d11d 0 2024-04-26T21:26:11.998 INFO:tasks.workunit.client.0.smithi084.stdout:0/790: dread de/d2b/d77/d32/f69 [0,4194304] 0 2024-04-26T21:26:12.000 INFO:tasks.workunit.client.0.smithi084.stdout:1/823: mkdir d2/d54/d93/d110/da0/d114 0 2024-04-26T21:26:12.001 INFO:tasks.workunit.client.0.smithi084.stdout:4/805: unlink d5/c92 0 2024-04-26T21:26:12.004 INFO:tasks.workunit.client.0.smithi084.stdout:3/835: rename d1/d2c/d2f/d31/d55/d4e/l11f to d1/d2c/d2f/d31/d55/da4/de7/l131 0 2024-04-26T21:26:12.006 INFO:tasks.workunit.client.0.smithi084.stdout:0/791: fsync de/fac 0 2024-04-26T21:26:12.008 INFO:tasks.workunit.client.0.smithi084.stdout:3/836: chown d1/d2c/c7f 351154 1 2024-04-26T21:26:12.008 INFO:tasks.workunit.client.0.smithi084.stdout:4/806: fdatasync d5/d7/d65/d7f/f7a 0 2024-04-26T21:26:12.014 INFO:tasks.workunit.client.0.smithi084.stdout:0/792: rmdir de/d2b/df3 39 2024-04-26T21:26:12.014 INFO:tasks.workunit.client.0.smithi084.stdout:7/851: write d6/d9/d12/d8b/d72/da0/f48 [1573965,74454] 0 2024-04-26T21:26:12.019 INFO:tasks.workunit.client.0.smithi084.stdout:0/793: write de/d78/d9e/da1/dad/fe0 [276876,95072] 0 2024-04-26T21:26:12.020 INFO:tasks.workunit.client.0.smithi084.stdout:8/843: creat d4/d6/db/d1e/d22/d39/fff x:0 0 0 2024-04-26T21:26:12.021 INFO:tasks.workunit.client.0.smithi084.stdout:4/807: symlink d5/d25/d35/d60/d6d/de1/l105 0 2024-04-26T21:26:12.023 INFO:tasks.workunit.client.0.smithi084.stdout:7/852: write d6/d9/d12/f2c [3809605,37978] 0 2024-04-26T21:26:12.025 INFO:tasks.workunit.client.0.smithi084.stdout:3/837: creat d1/d2c/d2f/d31/d55/da4/f132 x:0 0 0 2024-04-26T21:26:12.027 INFO:tasks.workunit.client.0.smithi084.stdout:1/824: rename d2/d54/d5e/d66/d3a/c5d to d2/c115 0 2024-04-26T21:26:12.050 INFO:tasks.workunit.client.0.smithi084.stdout:0/794: rename de/d78/fc7 to de/d20/d4c/dae/ffa 0 2024-04-26T21:26:12.050 INFO:tasks.workunit.client.0.smithi084.stdout:9/767: dwrite da/de/d16/f57 [0,4194304] 0 2024-04-26T21:26:12.050 INFO:tasks.workunit.client.0.smithi084.stdout:8/844: getdents d4 0 2024-04-26T21:26:12.052 INFO:tasks.workunit.client.0.smithi084.stdout:7/853: write d6/d68/d7f/dcf/fd1 [916545,113931] 0 2024-04-26T21:26:12.057 INFO:tasks.workunit.client.0.smithi084.stdout:7/854: readlink d6/d26/d40/dec/led 0 2024-04-26T21:26:12.060 INFO:tasks.workunit.client.0.smithi084.stdout:3/838: getdents d1/d24/d27/d3a/ddb 0 2024-04-26T21:26:12.063 INFO:tasks.workunit.client.0.smithi084.stdout:9/768: write da/dd5/d93/dc3/d4f/f59 [1392950,22103] 0 2024-04-26T21:26:12.063 INFO:tasks.workunit.client.0.smithi084.stdout:4/808: dread d5/d10/d15/d21/fb7 [0,4194304] 0 2024-04-26T21:26:12.064 INFO:tasks.workunit.client.0.smithi084.stdout:7/855: mkdir d6/d9/db3/d124 0 2024-04-26T21:26:12.066 INFO:tasks.workunit.client.0.smithi084.stdout:1/825: rename d2/d54/d5e/d66/d2a/d2c/d45/d112 to d2/d54/d5e/d66/d2a/dff/d116 0 2024-04-26T21:26:12.067 INFO:tasks.workunit.client.0.smithi084.stdout:8/845: read d4/d6/db/d1e/d22/d96/f9e [11680,17062] 0 2024-04-26T21:26:12.069 INFO:tasks.workunit.client.0.smithi084.stdout:8/846: fdatasync d4/f12 0 2024-04-26T21:26:12.070 INFO:tasks.workunit.client.0.smithi084.stdout:3/839: creat d1/d2c/d2f/d31/d55/d4e/d7c/db1/d129/f133 x:0 0 0 2024-04-26T21:26:12.071 INFO:tasks.workunit.client.0.smithi084.stdout:4/809: creat d5/d7/d65/d90/d91/dba/dc2/f106 x:0 0 0 2024-04-26T21:26:12.076 INFO:tasks.workunit.client.0.smithi084.stdout:4/810: stat d5/d25/d35/d60/d6d/de1/d32/d46/f5c 0 2024-04-26T21:26:12.076 INFO:tasks.workunit.client.0.smithi084.stdout:0/795: dwrite de/d78/d9e/da1/fe2 [0,4194304] 0 2024-04-26T21:26:12.076 INFO:tasks.workunit.client.0.smithi084.stdout:7/856: creat d6/d9/d12/d8b/d72/da0/d80/de5/f125 x:0 0 0 2024-04-26T21:26:12.079 INFO:tasks.workunit.client.0.smithi084.stdout:0/796: write de/d2b/d77/f49 [80292,71257] 0 2024-04-26T21:26:12.083 INFO:tasks.workunit.client.0.smithi084.stdout:3/840: creat d1/d2c/d2f/d31/f134 x:0 0 0 2024-04-26T21:26:12.088 INFO:tasks.workunit.client.0.smithi084.stdout:1/826: rename d2/c105 to d2/d54/d5e/d66/d2a/d2c/d45/dc9/c117 0 2024-04-26T21:26:12.093 INFO:tasks.workunit.client.0.smithi084.stdout:7/857: creat d6/d9/d12/d19/d20/d38/d112/f126 x:0 0 0 2024-04-26T21:26:12.094 INFO:tasks.workunit.client.0.smithi084.stdout:0/797: creat de/d78/d9e/da1/dad/ffb x:0 0 0 2024-04-26T21:26:12.095 INFO:tasks.workunit.client.0.smithi084.stdout:3/841: symlink d1/d2c/d2f/d94/l135 0 2024-04-26T21:26:12.101 INFO:tasks.workunit.client.0.smithi084.stdout:8/847: write d4/d6/db/d1e/fd5 [23659,66268] 0 2024-04-26T21:26:12.101 INFO:tasks.workunit.client.0.smithi084.stdout:1/827: creat d2/d54/d93/d110/d69/d9d/de0/f118 x:0 0 0 2024-04-26T21:26:12.102 INFO:tasks.workunit.client.0.smithi084.stdout:0/798: creat de/d2b/d64/d81/ffc x:0 0 0 2024-04-26T21:26:12.104 INFO:tasks.workunit.client.0.smithi084.stdout:3/842: read - d1/d2c/d2f/d31/dc7/d118/fbd zero size 2024-04-26T21:26:12.104 INFO:tasks.workunit.client.0.smithi084.stdout:7/858: truncate d6/d1c/dd8/fd2 1606977 0 2024-04-26T21:26:12.105 INFO:tasks.workunit.client.0.smithi084.stdout:4/811: dread d5/d25/d35/d60/d6d/de1/f51 [0,4194304] 0 2024-04-26T21:26:12.109 INFO:tasks.workunit.client.0.smithi084.stdout:1/828: rmdir d2/d54/d5e/d66/d2a/d2c 39 2024-04-26T21:26:12.109 INFO:tasks.workunit.client.0.smithi084.stdout:9/769: dread da/f14 [0,4194304] 0 2024-04-26T21:26:12.109 INFO:tasks.workunit.client.0.smithi084.stdout:3/843: dread - d1/d2c/d2f/d31/dc7/d118/fd7 zero size 2024-04-26T21:26:12.110 INFO:tasks.workunit.client.0.smithi084.stdout:7/859: truncate d6/d9/d63/f116 764990 0 2024-04-26T21:26:12.111 INFO:tasks.workunit.client.0.smithi084.stdout:4/812: creat d5/d7/d65/d90/d91/daa/f107 x:0 0 0 2024-04-26T21:26:12.114 INFO:tasks.workunit.client.0.smithi084.stdout:4/813: fsync d5/d25/d99/da0/fc0 0 2024-04-26T21:26:12.115 INFO:tasks.workunit.client.0.smithi084.stdout:7/860: rmdir d6/d9/d12/d8b/d72 39 2024-04-26T21:26:12.119 INFO:tasks.workunit.client.0.smithi084.stdout:0/799: link de/d2b/d77/d32/d96/fc9 de/d20/d4c/dae/dc2/ffd 0 2024-04-26T21:26:12.119 INFO:tasks.workunit.client.0.smithi084.stdout:9/770: rename da/dd5/d93/dc3/d41/de4/l92 to da/dd5/d93/dc3/d41/d8d/dca/l11e 0 2024-04-26T21:26:12.120 INFO:tasks.workunit.client.0.smithi084.stdout:1/829: truncate d2/d54/d5e/d66/d3a/d48/fa5 4408983 0 2024-04-26T21:26:12.123 INFO:tasks.workunit.client.0.smithi084.stdout:8/848: dwrite d4/f4f [0,4194304] 0 2024-04-26T21:26:12.124 INFO:tasks.workunit.client.0.smithi084.stdout:9/771: creat da/de/d1e/d56/f11f x:0 0 0 2024-04-26T21:26:12.127 INFO:tasks.workunit.client.0.smithi084.stdout:4/814: rename d5/d7/d65/f5a to d5/d7/d65/d90/d91/f108 0 2024-04-26T21:26:12.129 INFO:tasks.workunit.client.0.smithi084.stdout:9/772: chown da/db3/fcc 2 1 2024-04-26T21:26:12.133 INFO:tasks.workunit.client.0.smithi084.stdout:4/815: truncate d5/f1a 4810937 0 2024-04-26T21:26:12.135 INFO:tasks.workunit.client.0.smithi084.stdout:8/849: getdents d4/d6/db/d1e/d22/d39 0 2024-04-26T21:26:12.136 INFO:tasks.workunit.client.0.smithi084.stdout:3/844: dwrite d1/d24/d27/d3a/d81/ff3 [0,4194304] 0 2024-04-26T21:26:12.136 INFO:tasks.workunit.client.0.smithi084.stdout:0/800: dread de/d2b/d77/d32/f3d [0,4194304] 0 2024-04-26T21:26:12.139 INFO:tasks.workunit.client.0.smithi084.stdout:7/861: dwrite d6/d9/d12/f3d [0,4194304] 0 2024-04-26T21:26:12.144 INFO:tasks.workunit.client.0.smithi084.stdout:4/816: creat d5/f109 x:0 0 0 2024-04-26T21:26:12.150 INFO:tasks.workunit.client.0.smithi084.stdout:3/845: dread - d1/d2c/d2f/d31/d55/d4e/f8f zero size 2024-04-26T21:26:12.151 INFO:tasks.workunit.client.1.smithi120.stdout:9/986: sync 2024-04-26T21:26:12.151 INFO:tasks.workunit.client.1.smithi120.stdout:1/982: sync 2024-04-26T21:26:12.151 INFO:tasks.workunit.client.0.smithi084.stdout:7/862: mknod d6/d9/d12/d19/d20/d38/d112/c127 0 2024-04-26T21:26:12.153 INFO:tasks.workunit.client.0.smithi084.stdout:9/773: dwrite da/dd5/d93/dc3/d41/d43/dba/f107 [0,4194304] 0 2024-04-26T21:26:12.153 INFO:tasks.workunit.client.0.smithi084.stdout:4/817: creat d5/d25/f10a x:0 0 0 2024-04-26T21:26:12.154 INFO:tasks.workunit.client.1.smithi120.stdout:1/983: fsync d6/d9/dd4/f100 0 2024-04-26T21:26:12.159 INFO:tasks.workunit.client.1.smithi120.stdout:9/987: creat d0/d6/d4d/d65/dec/d2d/f148 x:0 0 0 2024-04-26T21:26:12.164 INFO:tasks.workunit.client.0.smithi084.stdout:3/846: creat d1/d24/d27/d3a/d81/f136 x:0 0 0 2024-04-26T21:26:12.165 INFO:tasks.workunit.client.0.smithi084.stdout:1/830: write d2/d54/d5e/d66/d2a/d72/f82 [474399,69084] 0 2024-04-26T21:26:12.168 INFO:tasks.workunit.client.0.smithi084.stdout:9/774: fdatasync da/de/d1e/d56/da6/fa9 0 2024-04-26T21:26:12.169 INFO:tasks.workunit.client.0.smithi084.stdout:0/801: creat de/d2b/d77/d32/ffe x:0 0 0 2024-04-26T21:26:12.172 INFO:tasks.workunit.client.0.smithi084.stdout:7/863: unlink d6/d9/d12/d8b/d72/da0/f48 0 2024-04-26T21:26:12.172 INFO:tasks.workunit.client.1.smithi120.stdout:1/984: truncate d6/d9/dd4/de0/d1b/d3b/d6d/dc9/ffc 14677 0 2024-04-26T21:26:12.173 INFO:tasks.workunit.client.0.smithi084.stdout:0/802: write de/d20/d4e/f6a [4784455,33492] 0 2024-04-26T21:26:12.175 INFO:tasks.workunit.client.0.smithi084.stdout:1/831: mkdir d2/d54/d5e/d66/d2a/d119 0 2024-04-26T21:26:12.176 INFO:tasks.workunit.client.0.smithi084.stdout:4/818: creat d5/d7/d65/f10b x:0 0 0 2024-04-26T21:26:12.177 INFO:tasks.workunit.client.0.smithi084.stdout:9/775: mkdir da/dd5/d93/dc3/d41/d8d/d120 0 2024-04-26T21:26:12.180 INFO:tasks.workunit.client.1.smithi120.stdout:1/985: unlink d6/d9/dd4/de0/d2d/d98/d35/l96 0 2024-04-26T21:26:12.180 INFO:tasks.workunit.client.0.smithi084.stdout:1/832: read - d2/d54/d93/d110/da0/fb7 zero size 2024-04-26T21:26:12.182 INFO:tasks.workunit.client.0.smithi084.stdout:3/847: getdents d1/d2c/d2f/d31/d55/d4e/d7c/db1 0 2024-04-26T21:26:12.183 INFO:tasks.workunit.client.0.smithi084.stdout:4/819: symlink d5/d10/dfa/l10c 0 2024-04-26T21:26:12.186 INFO:tasks.workunit.client.1.smithi120.stdout:1/986: getdents d6/d14/d6f 0 2024-04-26T21:26:12.189 INFO:tasks.workunit.client.1.smithi120.stdout:1/987: read d6/d9/dd4/de0/d1b/d3b/d6d/f8d [1257053,3228] 0 2024-04-26T21:26:12.189 INFO:tasks.workunit.client.0.smithi084.stdout:4/820: chown d5/d10/da1 0 1 2024-04-26T21:26:12.193 INFO:tasks.workunit.client.0.smithi084.stdout:3/848: symlink d1/d2c/d2f/d31/da8/l137 0 2024-04-26T21:26:12.195 INFO:tasks.workunit.client.1.smithi120.stdout:9/988: dwrite d0/d6/d4d/d65/dec/d77/d9a/fd7 [4194304,4194304] 0 2024-04-26T21:26:12.196 INFO:tasks.workunit.client.1.smithi120.stdout:1/988: symlink d6/d9/dd4/de0/d2d/d98/d56/d12e/l148 0 2024-04-26T21:26:12.196 INFO:tasks.workunit.client.0.smithi084.stdout:7/864: dread d6/d9/f2d [0,4194304] 0 2024-04-26T21:26:12.201 INFO:tasks.workunit.client.1.smithi120.stdout:1/989: mkdir d6/d9/dd4/de0/d1b/d55/d149 0 2024-04-26T21:26:12.203 INFO:tasks.workunit.client.0.smithi084.stdout:8/850: dread d4/d6/db/d1e/d22/d2f/f2c [0,4194304] 0 2024-04-26T21:26:12.205 INFO:tasks.workunit.client.0.smithi084.stdout:3/849: creat d1/dea/d12f/d12a/f138 x:0 0 0 2024-04-26T21:26:12.205 INFO:tasks.workunit.client.0.smithi084.stdout:1/833: truncate d2/d54/d5e/d66/d3a/d48/f6e 2170177 0 2024-04-26T21:26:12.205 INFO:tasks.workunit.client.0.smithi084.stdout:9/776: dwrite da/de/d1e/f31 [0,4194304] 0 2024-04-26T21:26:12.206 INFO:tasks.workunit.client.0.smithi084.stdout:1/834: stat d2/d1b/f8b 0 2024-04-26T21:26:12.208 INFO:tasks.workunit.client.1.smithi120.stdout:1/990: symlink d6/d9/dd4/de0/d2d/d98/d56/d12e/l14a 0 2024-04-26T21:26:12.211 INFO:tasks.workunit.client.1.smithi120.stdout:9/989: write d0/dd/f7e [137024,48854] 0 2024-04-26T21:26:12.211 INFO:tasks.workunit.client.0.smithi084.stdout:1/835: read - d2/d54/d5e/dbe/fe9 zero size 2024-04-26T21:26:12.212 INFO:tasks.workunit.client.1.smithi120.stdout:1/991: mkdir d6/d9/dd4/de0/d1d/d5d/d67/de3/d14b 0 2024-04-26T21:26:12.214 INFO:tasks.workunit.client.1.smithi120.stdout:9/990: fsync d0/d6/d4d/d65/dec/d77/d9a/fe4 0 2024-04-26T21:26:12.215 INFO:tasks.workunit.client.0.smithi084.stdout:3/850: symlink d1/d24/dbb/l139 0 2024-04-26T21:26:12.217 INFO:tasks.workunit.client.0.smithi084.stdout:1/836: symlink d2/d19/d63/l11a 0 2024-04-26T21:26:12.219 INFO:tasks.workunit.client.0.smithi084.stdout:2/947: sync 2024-04-26T21:26:12.219 INFO:tasks.workunit.client.0.smithi084.stdout:5/781: sync 2024-04-26T21:26:12.220 INFO:tasks.workunit.client.0.smithi084.stdout:6/756: sync 2024-04-26T21:26:12.220 INFO:tasks.workunit.client.0.smithi084.stdout:4/821: dwrite d5/d10/da1/fbb [0,4194304] 0 2024-04-26T21:26:12.226 INFO:tasks.workunit.client.1.smithi120.stdout:9/991: rename d0/d6/d4d/d65/dec/d77/d9a/fd7 to d0/d66/d142/f149 0 2024-04-26T21:26:12.227 INFO:tasks.workunit.client.0.smithi084.stdout:9/777: link da/dd5/d93/dc3/f73 da/dd5/d93/dc3/d41/d8d/dca/f121 0 2024-04-26T21:26:12.227 INFO:tasks.workunit.client.0.smithi084.stdout:1/837: creat d2/d54/d5e/f11b x:0 0 0 2024-04-26T21:26:12.227 INFO:tasks.workunit.client.0.smithi084.stdout:6/757: stat d3/de/d9e/dca 0 2024-04-26T21:26:12.230 INFO:tasks.workunit.client.0.smithi084.stdout:2/948: fdatasync d6/d7/d68/f71 0 2024-04-26T21:26:12.231 INFO:tasks.workunit.client.1.smithi120.stdout:9/992: rmdir d0/d66/d93/db7/d9b 39 2024-04-26T21:26:12.232 INFO:tasks.workunit.client.0.smithi084.stdout:5/782: symlink d0/dc/df/d31/d72/lf3 0 2024-04-26T21:26:12.234 INFO:tasks.workunit.client.0.smithi084.stdout:3/851: creat d1/d2c/d2f/d31/d55/d4e/d98/d9e/f13a x:0 0 0 2024-04-26T21:26:12.236 INFO:tasks.workunit.client.0.smithi084.stdout:7/865: dwrite d6/d68/d7f/ff0 [8388608,4194304] 0 2024-04-26T21:26:12.245 INFO:tasks.workunit.client.1.smithi120.stdout:9/993: rename d0/d66/d93/db7/d9b/fc9 to d0/dd/d3a/de8/f14a 0 2024-04-26T21:26:12.245 INFO:tasks.workunit.client.1.smithi120.stdout:1/992: write d6/d9/dd4/de0/d2d/d98/f42 [314767,119823] 0 2024-04-26T21:26:12.249 INFO:tasks.workunit.client.1.smithi120.stdout:1/993: fdatasync d6/d9/dd4/de0/d2d/d98/d56/dad/fef 0 2024-04-26T21:26:12.252 INFO:tasks.workunit.client.1.smithi120.stdout:1/994: stat d6/d9/dd4/de0/d2d/d98/f42 0 2024-04-26T21:26:12.255 INFO:tasks.workunit.client.1.smithi120.stdout:1/995: mknod d6/d9/dd4/de0/d2d/d98/d56/c14c 0 2024-04-26T21:26:12.256 INFO:tasks.workunit.client.1.smithi120.stdout:9/994: write d0/f4f [1919907,102850] 0 2024-04-26T21:26:12.261 INFO:tasks.workunit.client.1.smithi120.stdout:1/996: write d6/d9/dd4/de0/d1b/fc7 [268317,34729] 0 2024-04-26T21:26:12.269 INFO:tasks.workunit.client.1.smithi120.stdout:1/997: link d6/d9/dd4/de0/d1d/d5d/d67/de3/d105/l11c d6/d9/dd4/de0/d1d/d5d/dde/l14d 0 2024-04-26T21:26:12.272 INFO:tasks.workunit.client.1.smithi120.stdout:9/995: dwrite d0/d66/d93/db7/d102/f143 [0,4194304] 0 2024-04-26T21:26:12.274 INFO:tasks.workunit.client.1.smithi120.stdout:9/996: chown d0/d66/d93/db7/d9b/fab 3459834 1 2024-04-26T21:26:12.275 INFO:tasks.workunit.client.1.smithi120.stdout:1/998: dread d6/d9/dd4/de0/d1b/d3b/d6d/dc9/ffc [0,4194304] 0 2024-04-26T21:26:12.278 INFO:tasks.workunit.client.1.smithi120.stdout:1/999: readlink d6/d9/dd4/de0/d1d/d5d/d67/l71 0 2024-04-26T21:26:12.288 INFO:tasks.workunit.client.1.smithi120.stdout:9/997: dwrite d0/dd/f7e [0,4194304] 0 2024-04-26T21:26:12.292 INFO:tasks.workunit.client.1.smithi120.stdout:9/998: creat d0/d6/d4d/d65/dec/d77/f14b x:0 0 0 2024-04-26T21:26:12.307 INFO:tasks.workunit.client.1.smithi120.stdout:9/999: dwrite d0/d6/d4d/d65/dec/d2d/d4b/f6f [0,4194304] 0 2024-04-26T21:26:12.308 INFO:tasks.workunit.client.0.smithi084.stdout:3/852: chown d1/d24/dbb/l113 1771 1 2024-04-26T21:26:12.309 INFO:tasks.workunit.client.0.smithi084.stdout:9/778: rename da/de/d1e/d56/fbd to da/dd5/d93/d95/f122 0 2024-04-26T21:26:12.311 INFO:tasks.workunit.client.0.smithi084.stdout:7/866: dread - d6/ff2 zero size 2024-04-26T21:26:12.318 INFO:tasks.workunit.client.0.smithi084.stdout:0/803: dread de/d2b/d77/f1d [4194304,4194304] 0 2024-04-26T21:26:12.318 INFO:tasks.workunit.client.1.smithi120.stderr:+ rm -rf -- ./tmp.4gxmboSRzN 2024-04-26T21:26:12.321 INFO:tasks.workunit.client.0.smithi084.stdout:9/779: creat da/de/d1e/d56/da6/de6/f123 x:0 0 0 2024-04-26T21:26:12.326 INFO:tasks.workunit.client.0.smithi084.stdout:8/851: dwrite d4/d6/db/d1e/d22/d39/f93 [4194304,4194304] 0 2024-04-26T21:26:12.326 INFO:tasks.workunit.client.0.smithi084.stdout:7/867: symlink d6/d68/d7f/d107/d84/d110/l128 0 2024-04-26T21:26:12.328 INFO:tasks.workunit.client.0.smithi084.stdout:0/804: readlink de/d2b/df3/d94/lb5 0 2024-04-26T21:26:12.333 INFO:tasks.workunit.client.0.smithi084.stdout:6/758: dwrite d3/de/d15/d40/f6e [0,4194304] 0 2024-04-26T21:26:12.333 INFO:tasks.workunit.client.0.smithi084.stdout:2/949: truncate d6/d7/d3d/d15/d1f/d22/d2a/fcd 3603336 0 2024-04-26T21:26:12.339 INFO:tasks.workunit.client.0.smithi084.stdout:8/852: creat d4/d7/d15/d3c/f100 x:0 0 0 2024-04-26T21:26:12.339 INFO:tasks.workunit.client.0.smithi084.stdout:0/805: creat de/d78/d9e/fff x:0 0 0 2024-04-26T21:26:12.341 INFO:tasks.workunit.client.0.smithi084.stdout:9/780: symlink da/db3/d117/l124 0 2024-04-26T21:26:12.343 INFO:tasks.workunit.client.0.smithi084.stdout:0/806: chown de/f12 4 1 2024-04-26T21:26:12.352 INFO:tasks.workunit.client.0.smithi084.stdout:9/781: readlink da/de/d16/d40/l54 0 2024-04-26T21:26:12.354 INFO:tasks.workunit.client.0.smithi084.stdout:8/853: unlink d4/d6/db/d1e/d22/d2f/l2d 0 2024-04-26T21:26:12.356 INFO:tasks.workunit.client.0.smithi084.stdout:7/868: dwrite d6/d9/fd9 [0,4194304] 0 2024-04-26T21:26:12.357 INFO:tasks.workunit.client.0.smithi084.stdout:2/950: unlink d6/d7/db6/d115/d11b/lb3 0 2024-04-26T21:26:12.362 INFO:tasks.workunit.client.0.smithi084.stdout:9/782: mknod da/dd5/d93/dc3/d41/de4/c125 0 2024-04-26T21:26:12.366 INFO:tasks.workunit.client.0.smithi084.stdout:8/854: creat d4/d6/db/d1e/d22/d2f/f101 x:0 0 0 2024-04-26T21:26:12.370 INFO:tasks.workunit.client.0.smithi084.stdout:1/838: dwrite d2/d54/d5e/d66/d3a/d77/f85 [0,4194304] 0 2024-04-26T21:26:12.373 INFO:tasks.workunit.client.0.smithi084.stdout:9/783: mkdir da/dd5/d93/dc3/d126 0 2024-04-26T21:26:12.373 INFO:tasks.workunit.client.0.smithi084.stdout:3/853: dwrite d1/d2c/d2f/fc9 [0,4194304] 0 2024-04-26T21:26:12.379 INFO:tasks.workunit.client.0.smithi084.stdout:1/839: chown d2/d9/d15/d9f/cce 496418213 1 2024-04-26T21:26:12.393 INFO:tasks.workunit.client.0.smithi084.stdout:9/784: symlink da/dd5/d93/dc3/d41/d43/d48/d61/df0/l127 0 2024-04-26T21:26:12.398 INFO:tasks.workunit.client.0.smithi084.stdout:6/759: dwrite d3/de/d15/d23/f4d [4194304,4194304] 0 2024-04-26T21:26:12.400 INFO:tasks.workunit.client.0.smithi084.stdout:3/854: rename d1/d24/d27/d3a/de5/f117 to d1/d2c/d2f/f13b 0 2024-04-26T21:26:12.402 INFO:tasks.workunit.client.0.smithi084.stdout:1/840: stat d2/d54/d5e/d66/d2a/d2c/la2 0 2024-04-26T21:26:12.403 INFO:tasks.workunit.client.0.smithi084.stdout:7/869: dwrite d6/d9/d12/d8b/f6a [0,4194304] 0 2024-04-26T21:26:12.405 INFO:tasks.workunit.client.0.smithi084.stdout:5/783: dread d0/dc/f14 [0,4194304] 0 2024-04-26T21:26:12.406 INFO:tasks.workunit.client.0.smithi084.stdout:3/855: read - d1/d24/d27/d3a/d81/f136 zero size 2024-04-26T21:26:12.406 INFO:tasks.workunit.client.0.smithi084.stdout:1/841: readlink d2/d54/d5e/d66/d3a/d48/lb9 0 2024-04-26T21:26:12.408 INFO:tasks.workunit.client.0.smithi084.stdout:7/870: read d6/d9/d12/d19/f7e [2407344,8250] 0 2024-04-26T21:26:12.412 INFO:tasks.workunit.client.0.smithi084.stdout:9/785: creat da/dd5/d93/dc3/d41/de4/f128 x:0 0 0 2024-04-26T21:26:12.415 INFO:tasks.workunit.client.0.smithi084.stdout:8/855: rename d4/d6/db/d1e/d22/d39/d4a/l50 to d4/d6/db/d9b/dca/l102 0 2024-04-26T21:26:12.416 INFO:tasks.workunit.client.0.smithi084.stdout:6/760: chown d3/d18/c31 82884 1 2024-04-26T21:26:12.417 INFO:tasks.workunit.client.0.smithi084.stdout:3/856: creat d1/d2c/d2f/d31/dc7/f13c x:0 0 0 2024-04-26T21:26:12.418 INFO:tasks.workunit.client.0.smithi084.stdout:5/784: creat d0/dc/df/d31/d53/de1/ff4 x:0 0 0 2024-04-26T21:26:12.420 INFO:tasks.workunit.client.0.smithi084.stdout:2/951: dread d6/d7/d3d/d15/d1f/d22/d99/f9d [0,4194304] 0 2024-04-26T21:26:12.422 INFO:tasks.workunit.client.0.smithi084.stdout:3/857: rmdir d1/dea/d12f/d12a 39 2024-04-26T21:26:12.428 INFO:tasks.workunit.client.0.smithi084.stdout:0/807: dread de/d78/d9e/fce [0,4194304] 0 2024-04-26T21:26:12.428 INFO:tasks.workunit.client.0.smithi084.stdout:9/786: truncate da/dd5/d93/dc3/d41/d43/d48/d61/fd2 190118 0 2024-04-26T21:26:12.430 INFO:tasks.workunit.client.0.smithi084.stdout:8/856: read d4/d6/db/d1e/d22/d96/f9f [262127,117494] 0 2024-04-26T21:26:12.432 INFO:tasks.workunit.client.0.smithi084.stdout:8/857: fsync d4/d6/db/d1e/f8e 0 2024-04-26T21:26:12.435 INFO:tasks.workunit.client.0.smithi084.stdout:8/858: chown d4/d6/db/d9b/ccd 30 1 2024-04-26T21:26:12.440 INFO:tasks.workunit.client.0.smithi084.stdout:6/761: dwrite d3/de/d15/d23/fe3 [0,4194304] 0 2024-04-26T21:26:12.469 INFO:tasks.workunit.client.0.smithi084.stdout:4/822: sync 2024-04-26T21:26:12.473 INFO:tasks.workunit.client.0.smithi084.stdout:4/823: write d5/d7/d65/d90/d91/dba/fd6 [879239,101213] 0 2024-04-26T21:26:12.474 INFO:tasks.workunit.client.0.smithi084.stdout:5/785: mkdir d0/df5 0 2024-04-26T21:26:12.476 INFO:tasks.workunit.client.0.smithi084.stdout:7/871: getdents d6/d9/d12/d19 0 2024-04-26T21:26:12.477 INFO:tasks.workunit.client.0.smithi084.stdout:4/824: chown d5/d25/d35/c59 694131428 1 2024-04-26T21:26:12.481 INFO:tasks.workunit.client.0.smithi084.stdout:3/858: unlink d1/d2c/d2f/d31/dc7/d118/fd7 0 2024-04-26T21:26:12.486 INFO:tasks.workunit.client.0.smithi084.stdout:9/787: mknod da/dd5/d93/dc3/d4f/d104/c129 0 2024-04-26T21:26:12.491 INFO:tasks.workunit.client.0.smithi084.stdout:6/762: symlink d3/d6c/lf3 0 2024-04-26T21:26:12.493 INFO:tasks.workunit.client.0.smithi084.stdout:1/842: truncate d2/d54/d5e/d66/d2a/d2c/f2d 3829535 0 2024-04-26T21:26:12.497 INFO:tasks.workunit.client.0.smithi084.stdout:6/763: truncate d3/de/d9e/faa 196289 0 2024-04-26T21:26:12.498 INFO:tasks.workunit.client.0.smithi084.stdout:2/952: symlink d6/d7/db6/d115/l141 0 2024-04-26T21:26:12.500 INFO:tasks.workunit.client.0.smithi084.stdout:2/953: chown d6/l8e 26443 1 2024-04-26T21:26:12.502 INFO:tasks.workunit.client.0.smithi084.stdout:3/859: getdents d1/d2c/d2f/d31/d55/d4e/d7c/db1/d129/d12d 0 2024-04-26T21:26:12.503 INFO:tasks.workunit.client.0.smithi084.stdout:1/843: unlink d2/d54/d93/d110/d47/fd3 0 2024-04-26T21:26:12.504 INFO:tasks.workunit.client.0.smithi084.stdout:0/808: dwrite de/ff [0,4194304] 0 2024-04-26T21:26:12.510 INFO:tasks.workunit.client.0.smithi084.stdout:8/859: getdents d4/d6/db/d1e/d22/d39/dc4 0 2024-04-26T21:26:12.512 INFO:tasks.workunit.client.0.smithi084.stdout:4/825: dread d5/d25/d35/f3a [0,4194304] 0 2024-04-26T21:26:12.522 INFO:tasks.workunit.client.0.smithi084.stdout:8/860: fsync d4/d7/d53/fe7 0 2024-04-26T21:26:12.524 INFO:tasks.workunit.client.0.smithi084.stdout:3/860: dwrite d1/d2c/d2f/d31/d55/d4e/fde [0,4194304] 0 2024-04-26T21:26:12.528 INFO:tasks.workunit.client.0.smithi084.stdout:1/844: dread d2/d54/d5e/d66/f2b [0,4194304] 0 2024-04-26T21:26:12.532 INFO:tasks.workunit.client.0.smithi084.stdout:3/861: rmdir d1/d2c/d2f 39 2024-04-26T21:26:12.538 INFO:tasks.workunit.client.0.smithi084.stdout:4/826: dwrite d5/d7/d65/d7f/fd5 [0,4194304] 0 2024-04-26T21:26:12.540 INFO:tasks.workunit.client.0.smithi084.stdout:1/845: mknod d2/d54/d93/d110/d69/d9d/c11c 0 2024-04-26T21:26:12.541 INFO:tasks.workunit.client.0.smithi084.stdout:4/827: dread - d5/d25/d99/da0/f103 zero size 2024-04-26T21:26:12.542 INFO:tasks.workunit.client.0.smithi084.stdout:4/828: readlink d5/d2e/l58 0 2024-04-26T21:26:12.544 INFO:tasks.workunit.client.0.smithi084.stdout:1/846: read d2/d19/d63/fef [6056,32273] 0 2024-04-26T21:26:12.546 INFO:tasks.workunit.client.0.smithi084.stdout:4/829: write d5/d25/d35/d60/d6d/fb0 [3321065,119140] 0 2024-04-26T21:26:12.547 INFO:tasks.workunit.client.0.smithi084.stdout:0/809: mkdir de/d20/d4e/d100 0 2024-04-26T21:26:12.548 INFO:tasks.workunit.client.0.smithi084.stdout:4/830: dread - d5/d25/d99/da0/f103 zero size 2024-04-26T21:26:12.552 INFO:tasks.workunit.client.0.smithi084.stdout:0/810: read de/d2b/d77/f3c [1476561,20620] 0 2024-04-26T21:26:12.556 INFO:tasks.workunit.client.0.smithi084.stdout:4/831: chown d5/d10/d15/d21/l93 630536161 1 2024-04-26T21:26:12.559 INFO:tasks.workunit.client.0.smithi084.stdout:4/832: truncate d5/d10/fe9 324381 0 2024-04-26T21:26:12.560 INFO:tasks.workunit.client.0.smithi084.stdout:3/862: rename d1/d2c/d2f/d31/d52/l75 to d1/d2c/d2f/d31/d52/l13d 0 2024-04-26T21:26:12.562 INFO:tasks.workunit.client.0.smithi084.stdout:3/863: read - d1/f124 zero size 2024-04-26T21:26:12.563 INFO:tasks.workunit.client.0.smithi084.stdout:7/872: creat d6/d68/d7f/f129 x:0 0 0 2024-04-26T21:26:12.565 INFO:tasks.workunit.client.0.smithi084.stdout:6/764: rmdir d3/de/d1a/d43/d75/dc4 39 2024-04-26T21:26:12.567 INFO:tasks.workunit.client.0.smithi084.stdout:0/811: rename de/d2b/d64/l80 to de/d2b/df3/d94/dcf/l101 0 2024-04-26T21:26:12.568 INFO:tasks.workunit.client.0.smithi084.stdout:4/833: creat d5/d7/d65/f10d x:0 0 0 2024-04-26T21:26:12.569 INFO:tasks.workunit.client.0.smithi084.stdout:3/864: fsync d1/d2c/d2f/d31/d55/d4e/d98/d9e/f130 0 2024-04-26T21:26:12.569 INFO:tasks.workunit.client.0.smithi084.stdout:1/847: dwrite d2/d54/d5e/d66/d2a/d72/f82 [0,4194304] 0 2024-04-26T21:26:12.578 INFO:tasks.workunit.client.0.smithi084.stdout:1/848: symlink d2/d54/d5e/d66/d2a/dff/d116/l11d 0 2024-04-26T21:26:12.586 INFO:tasks.workunit.client.0.smithi084.stdout:4/834: creat d5/d25/d35/d60/d69/f10e x:0 0 0 2024-04-26T21:26:12.588 INFO:tasks.workunit.client.0.smithi084.stdout:0/812: dwrite de/d78/d9e/fe1 [0,4194304] 0 2024-04-26T21:26:12.589 INFO:tasks.workunit.client.0.smithi084.stdout:9/788: write da/dd5/d93/dc3/d41/d43/fd3 [192392,105419] 0 2024-04-26T21:26:12.595 INFO:tasks.workunit.client.0.smithi084.stdout:4/835: rename d5/d7/d65/c100 to d5/d2e/c10f 0 2024-04-26T21:26:12.598 INFO:tasks.workunit.client.0.smithi084.stdout:4/836: write d5/d7/d65/f10d [913004,114037] 0 2024-04-26T21:26:12.599 INFO:tasks.workunit.client.0.smithi084.stdout:2/954: write d6/d7/d3d/d15/d1f/d39/d20/d36/fe7 [1451309,16761] 0 2024-04-26T21:26:12.603 INFO:tasks.workunit.client.0.smithi084.stdout:8/861: fsync d4/d7/d15/d37/d52/fe0 0 2024-04-26T21:26:12.604 INFO:tasks.workunit.client.0.smithi084.stdout:4/837: truncate d5/d7/d65/d90/d91/dba/dc2/f106 948876 0 2024-04-26T21:26:12.611 INFO:tasks.workunit.client.0.smithi084.stdout:7/873: write d6/d1c/d51/f9d [4347434,37769] 0 2024-04-26T21:26:12.613 INFO:tasks.workunit.client.0.smithi084.stdout:9/789: creat da/dd5/d93/dc3/f12a x:0 0 0 2024-04-26T21:26:12.615 INFO:tasks.workunit.client.0.smithi084.stdout:3/865: write d1/d2c/d2f/d31/d55/d4e/d98/fd6 [4261887,113308] 0 2024-04-26T21:26:12.616 INFO:tasks.workunit.client.0.smithi084.stdout:0/813: write de/f1f [914749,120240] 0 2024-04-26T21:26:12.620 INFO:tasks.workunit.client.0.smithi084.stdout:8/862: dread d4/f87 [0,4194304] 0 2024-04-26T21:26:12.620 INFO:tasks.workunit.client.0.smithi084.stdout:9/790: dread - da/de/d16/d40/feb zero size 2024-04-26T21:26:12.675 INFO:tasks.workunit.client.0.smithi084.stdout:6/765: dwrite d3/de/d1a/d43/f4f [0,4194304] 0 2024-04-26T21:26:12.676 INFO:tasks.workunit.client.0.smithi084.stdout:3/866: fdatasync d1/d2c/d2f/d31/d55/da4/fe3 0 2024-04-26T21:26:12.683 INFO:tasks.workunit.client.0.smithi084.stdout:0/814: fsync de/d2b/d77/d32/d96/fc9 0 2024-04-26T21:26:12.683 INFO:tasks.workunit.client.0.smithi084.stdout:9/791: truncate da/dd5/db6/fde 444324 0 2024-04-26T21:26:12.686 INFO:tasks.workunit.client.0.smithi084.stdout:1/849: dread d2/d54/d5e/d66/d3a/fa3 [0,4194304] 0 2024-04-26T21:26:12.689 INFO:tasks.workunit.client.0.smithi084.stdout:3/867: dread - d1/d2c/d2f/d31/dc7/d118/fed zero size 2024-04-26T21:26:12.689 INFO:tasks.workunit.client.0.smithi084.stdout:4/838: dwrite d5/d10/d15/d21/ff8 [0,4194304] 0 2024-04-26T21:26:12.689 INFO:tasks.workunit.client.0.smithi084.stdout:9/792: chown da/de/d16/d40/feb 204747668 1 2024-04-26T21:26:12.689 INFO:tasks.workunit.client.0.smithi084.stdout:2/955: dwrite d6/d7/d3d/ff4 [0,4194304] 0 2024-04-26T21:26:12.692 INFO:tasks.workunit.client.0.smithi084.stdout:8/863: rename d4/d6/db/d1e/d22/d96/f9e to d4/d6/db/d9b/dd4/f103 0 2024-04-26T21:26:12.695 INFO:tasks.workunit.client.0.smithi084.stdout:4/839: write d5/d25/d35/d60/d6d/fb0 [1728052,101198] 0 2024-04-26T21:26:12.699 INFO:tasks.workunit.client.0.smithi084.stdout:2/956: fsync d6/d7/d3d/d15/d1f/d39/d20/d36/da4/feb 0 2024-04-26T21:26:12.700 INFO:tasks.workunit.client.0.smithi084.stdout:6/766: rename d3/de/d15/d5f/dc1 to d3/de/d15/df/dae/df4 0 2024-04-26T21:26:12.703 INFO:tasks.workunit.client.0.smithi084.stdout:3/868: fdatasync d1/d2c/d2f/d31/d52/fa5 0 2024-04-26T21:26:12.704 INFO:tasks.workunit.client.0.smithi084.stdout:4/840: fsync d5/d25/d35/f81 0 2024-04-26T21:26:12.704 INFO:tasks.workunit.client.0.smithi084.stdout:6/767: chown d3/de/d15/d5f/lbb 29 1 2024-04-26T21:26:12.706 INFO:tasks.workunit.client.0.smithi084.stdout:2/957: write d6/d7/d3d/d15/d1f/d39/da5/fcc [746830,113059] 0 2024-04-26T21:26:12.707 INFO:tasks.workunit.client.0.smithi084.stdout:0/815: rename de/f14 to de/d20/d4e/d100/f102 0 2024-04-26T21:26:12.710 INFO:tasks.workunit.client.0.smithi084.stdout:4/841: mkdir d5/d2e/d8d/d110 0 2024-04-26T21:26:12.713 INFO:tasks.workunit.client.0.smithi084.stdout:1/850: write d2/d54/d93/d110/d47/f4f [930480,117908] 0 2024-04-26T21:26:12.713 INFO:tasks.workunit.client.0.smithi084.stdout:9/793: dread da/dd5/d93/dc3/d41/d8d/dca/f121 [0,4194304] 0 2024-04-26T21:26:12.714 INFO:tasks.workunit.client.0.smithi084.stdout:8/864: truncate d4/d6/db/d1e/f45 2563317 0 2024-04-26T21:26:12.718 INFO:tasks.workunit.client.0.smithi084.stdout:3/869: creat d1/d24/d27/d3a/d81/f13e x:0 0 0 2024-04-26T21:26:12.718 INFO:tasks.workunit.client.0.smithi084.stdout:9/794: chown da/de/d1e/d56/da6/fa9 38 1 2024-04-26T21:26:12.719 INFO:tasks.workunit.client.0.smithi084.stdout:0/816: rmdir de/d20/d4e 39 2024-04-26T21:26:12.722 INFO:tasks.workunit.client.0.smithi084.stdout:1/851: creat d2/d54/d5e/d8d/f11e x:0 0 0 2024-04-26T21:26:12.723 INFO:tasks.workunit.client.0.smithi084.stdout:9/795: chown da/dd5/d93/dc3/d41/d67/de9 205 1 2024-04-26T21:26:12.723 INFO:tasks.workunit.client.0.smithi084.stdout:4/842: rename d5/d7/f9b to d5/d25/d35/d60/f111 0 2024-04-26T21:26:12.724 INFO:tasks.workunit.client.0.smithi084.stdout:8/865: creat d4/d6/db/d1e/d22/d39/de9/f104 x:0 0 0 2024-04-26T21:26:12.724 INFO:tasks.workunit.client.0.smithi084.stdout:4/843: stat c2 0 2024-04-26T21:26:12.725 INFO:tasks.workunit.client.0.smithi084.stdout:0/817: mkdir de/d2b/df3/d63/da7/d103 0 2024-04-26T21:26:12.727 INFO:tasks.workunit.client.0.smithi084.stdout:9/796: dread - da/dd5/d93/dc3/f12a zero size 2024-04-26T21:26:12.730 INFO:tasks.workunit.client.0.smithi084.stdout:2/958: write d6/d105/fd0 [518729,59210] 0 2024-04-26T21:26:12.730 INFO:tasks.workunit.client.0.smithi084.stdout:1/852: write d2/d54/d5e/d66/d2a/d2c/d45/fa4 [787908,65768] 0 2024-04-26T21:26:12.732 INFO:tasks.workunit.client.0.smithi084.stdout:6/768: dwrite d3/de/f7c [0,4194304] 0 2024-04-26T21:26:12.738 INFO:tasks.workunit.client.0.smithi084.stdout:9/797: readlink da/dd5/d93/dc3/d41/d43/l69 0 2024-04-26T21:26:12.745 INFO:tasks.workunit.client.0.smithi084.stdout:3/870: dwrite d1/d24/d27/d3a/fa7 [0,4194304] 0 2024-04-26T21:26:12.748 INFO:tasks.workunit.client.0.smithi084.stdout:6/769: unlink d3/de/d15/f69 0 2024-04-26T21:26:12.748 INFO:tasks.workunit.client.0.smithi084.stdout:0/818: link de/d78/ld9 de/d2b/d77/l104 0 2024-04-26T21:26:12.749 INFO:tasks.workunit.client.0.smithi084.stdout:4/844: rename d5/d7/d65/d7f/db8/c31 to d5/d25/d35/d60/d69/db2/c112 0 2024-04-26T21:26:12.752 INFO:tasks.workunit.client.0.smithi084.stdout:9/798: readlink da/dd5/d93/dc3/d4f/lc0 0 2024-04-26T21:26:12.753 INFO:tasks.workunit.client.0.smithi084.stdout:2/959: truncate d6/d7/d3d/d15/d1f/d39/d43/f91 1061465 0 2024-04-26T21:26:12.758 INFO:tasks.workunit.client.0.smithi084.stdout:8/866: truncate d4/d7/d15/d9d/fad 4765184 0 2024-04-26T21:26:12.759 INFO:tasks.workunit.client.0.smithi084.stdout:6/770: mknod d3/de/d15/df/cf5 0 2024-04-26T21:26:12.764 INFO:tasks.workunit.client.0.smithi084.stdout:5/786: sync 2024-04-26T21:26:12.766 INFO:tasks.workunit.client.0.smithi084.stdout:9/799: unlink da/db3/cd7 0 2024-04-26T21:26:12.769 INFO:tasks.workunit.client.0.smithi084.stdout:1/853: getdents d2/d54/d93/d110/da0/db5/dfa 0 2024-04-26T21:26:12.769 INFO:tasks.workunit.client.0.smithi084.stdout:6/771: read d3/d18/d81/f8a [2457647,19983] 0 2024-04-26T21:26:12.770 INFO:tasks.workunit.client.0.smithi084.stdout:8/867: rmdir d4 39 2024-04-26T21:26:12.770 INFO:tasks.workunit.client.0.smithi084.stdout:3/871: mknod d1/d24/d27/d3a/ddb/df5/d11d/c13f 0 2024-04-26T21:26:12.771 INFO:tasks.workunit.client.0.smithi084.stdout:5/787: fdatasync d0/dc/df/d31/d72/d84/f89 0 2024-04-26T21:26:12.776 INFO:tasks.workunit.client.0.smithi084.stdout:1/854: fsync d2/d54/d93/d110/da0/fdf 0 2024-04-26T21:26:12.778 INFO:tasks.workunit.client.0.smithi084.stdout:6/772: mkdir d3/de/d15/d5f/df6 0 2024-04-26T21:26:12.780 INFO:tasks.workunit.client.0.smithi084.stdout:3/872: chown d1/d2c/f107 688519739 1 2024-04-26T21:26:12.780 INFO:tasks.workunit.client.0.smithi084.stdout:5/788: fsync d0/dc/df/d6d/fe3 0 2024-04-26T21:26:12.781 INFO:tasks.workunit.client.0.smithi084.stdout:0/819: rename de/d2b/d77/d32/l40 to de/d2b/d77/d32/d96/l105 0 2024-04-26T21:26:12.787 INFO:tasks.workunit.client.0.smithi084.stdout:6/773: creat d3/de/d41/d5c/ff7 x:0 0 0 2024-04-26T21:26:12.792 INFO:tasks.workunit.client.0.smithi084.stdout:0/820: symlink de/d78/d9e/da4/l106 0 2024-04-26T21:26:12.793 INFO:tasks.workunit.client.0.smithi084.stdout:2/960: dwrite d6/d7/d68/f71 [0,4194304] 0 2024-04-26T21:26:12.794 INFO:tasks.workunit.client.0.smithi084.stdout:9/800: link da/dd5/d93/d95/l9c da/dd5/d93/dc3/d41/d8d/d120/l12b 0 2024-04-26T21:26:12.796 INFO:tasks.workunit.client.0.smithi084.stdout:6/774: creat d3/de/d1a/d2f/d4c/ff8 x:0 0 0 2024-04-26T21:26:12.800 INFO:tasks.workunit.client.0.smithi084.stdout:4/845: dwrite d5/d25/d35/f86 [0,4194304] 0 2024-04-26T21:26:12.804 INFO:tasks.workunit.client.0.smithi084.stdout:5/789: creat d0/dc/df/ff6 x:0 0 0 2024-04-26T21:26:12.806 INFO:tasks.workunit.client.0.smithi084.stdout:9/801: symlink da/l12c 0 2024-04-26T21:26:12.807 INFO:tasks.workunit.client.0.smithi084.stdout:4/846: dread - d5/d7/d65/d90/d91/daa/ff3 zero size 2024-04-26T21:26:12.811 INFO:tasks.workunit.client.0.smithi084.stdout:8/868: write d4/d6/db/d9b/dd4/f103 [174641,112618] 0 2024-04-26T21:26:12.841 INFO:tasks.workunit.client.0.smithi084.stdout:0/821: creat de/d2b/df3/d63/da7/d103/f107 x:0 0 0 2024-04-26T21:26:12.841 INFO:tasks.workunit.client.0.smithi084.stdout:6/775: creat d3/de/d1a/d2f/d4c/ff9 x:0 0 0 2024-04-26T21:26:12.842 INFO:tasks.workunit.client.0.smithi084.stdout:4/847: write d5/d25/d35/d60/d6d/fb0 [5004613,60754] 0 2024-04-26T21:26:12.843 INFO:tasks.workunit.client.0.smithi084.stdout:5/790: truncate d0/d17/fcc 460546 0 2024-04-26T21:26:12.845 INFO:tasks.workunit.client.0.smithi084.stdout:3/873: link d1/d24/d27/cd8 d1/d24/d27/d3a/ddb/d103/c140 0 2024-04-26T21:26:12.848 INFO:tasks.workunit.client.0.smithi084.stdout:5/791: readlink d0/dc/df/d31/d63/d6e/ldf 0 2024-04-26T21:26:12.851 INFO:tasks.workunit.client.0.smithi084.stdout:8/869: creat d4/d7/f105 x:0 0 0 2024-04-26T21:26:12.851 INFO:tasks.workunit.client.0.smithi084.stdout:6/776: unlink d3/de/d1a/d43/d75/d9c/fc8 0 2024-04-26T21:26:12.855 INFO:tasks.workunit.client.0.smithi084.stdout:1/855: dwrite d2/d54/d5e/d66/d3a/fa3 [0,4194304] 0 2024-04-26T21:26:12.859 INFO:tasks.workunit.client.0.smithi084.stdout:3/874: symlink d1/d2c/d2f/d31/d55/d4e/d10c/l141 0 2024-04-26T21:26:12.868 INFO:tasks.workunit.client.0.smithi084.stdout:6/777: rename d3/de/d15/d5f to d3/de/d1a/d43/d75/dfa 0 2024-04-26T21:26:12.870 INFO:tasks.workunit.client.0.smithi084.stdout:3/875: creat d1/d24/d27/d3a/ddb/df5/d11d/f142 x:0 0 0 2024-04-26T21:26:12.870 INFO:tasks.workunit.client.0.smithi084.stdout:2/961: dread d6/d7/d3d/d79/d85/df3/f112 [0,4194304] 0 2024-04-26T21:26:12.871 INFO:tasks.workunit.client.0.smithi084.stdout:0/822: dread de/d78/d9e/fe1 [0,4194304] 0 2024-04-26T21:26:12.877 INFO:tasks.workunit.client.0.smithi084.stdout:0/823: stat de/c5b 0 2024-04-26T21:26:12.878 INFO:tasks.workunit.client.0.smithi084.stdout:5/792: write d0/dc/f1c [138934,75425] 0 2024-04-26T21:26:12.879 INFO:tasks.workunit.client.0.smithi084.stdout:3/876: fdatasync d1/d2c/d2f/d31/d55/d4e/d7c/db1/d129/f133 0 2024-04-26T21:26:12.879 INFO:tasks.workunit.client.0.smithi084.stdout:8/870: dwrite d4/d7/d15/d9d/faf [0,4194304] 0 2024-04-26T21:26:12.882 INFO:tasks.workunit.client.0.smithi084.stdout:1/856: dread d2/d54/d5e/d66/d2a/d72/f82 [0,4194304] 0 2024-04-26T21:26:12.884 INFO:tasks.workunit.client.0.smithi084.stdout:6/778: rename d3/de/d1a/d43/d75/d9c to d3/de/d15/df/dae/df4/dfb 0 2024-04-26T21:26:12.886 INFO:tasks.workunit.client.0.smithi084.stdout:3/877: chown d1/d2c/d2f/d31/dc7/d118/fbd 34091339 1 2024-04-26T21:26:12.888 INFO:tasks.workunit.client.0.smithi084.stdout:6/779: chown d3/de/d1a/f36 7340 1 2024-04-26T21:26:12.888 INFO:tasks.workunit.client.0.smithi084.stdout:0/824: read - de/d20/d4e/da9/fb3 zero size 2024-04-26T21:26:12.889 INFO:tasks.workunit.client.0.smithi084.stdout:1/857: write d2/d19/d63/f108 [722427,93626] 0 2024-04-26T21:26:12.890 INFO:tasks.workunit.client.0.smithi084.stdout:8/871: write d4/d7/d15/d37/d3b/ff1 [62546,4281] 0 2024-04-26T21:26:12.891 INFO:tasks.workunit.client.0.smithi084.stdout:2/962: dread d6/d7/d68/f78 [0,4194304] 0 2024-04-26T21:26:12.893 INFO:tasks.workunit.client.0.smithi084.stdout:5/793: symlink d0/dc/df/d2a/lf7 0 2024-04-26T21:26:12.893 INFO:tasks.workunit.client.0.smithi084.stdout:0/825: readlink de/d2b/d77/l55 0 2024-04-26T21:26:12.895 INFO:tasks.workunit.client.0.smithi084.stdout:4/848: dwrite d5/d2e/f88 [0,4194304] 0 2024-04-26T21:26:12.897 INFO:tasks.workunit.client.0.smithi084.stdout:1/858: write d2/d19/d63/f108 [137140,123606] 0 2024-04-26T21:26:12.897 INFO:tasks.workunit.client.0.smithi084.stdout:2/963: mkdir d6/d105/d142 0 2024-04-26T21:26:12.901 INFO:tasks.workunit.client.0.smithi084.stdout:0/826: fdatasync de/d2b/d77/d32/f6e 0 2024-04-26T21:26:12.904 INFO:tasks.workunit.client.0.smithi084.stdout:6/780: creat d3/de/d1a/d43/d72/dad/ffc x:0 0 0 2024-04-26T21:26:12.904 INFO:tasks.workunit.client.0.smithi084.stdout:5/794: rmdir d0/dc/df/d31/d53/de1 39 2024-04-26T21:26:12.904 INFO:tasks.workunit.client.0.smithi084.stdout:8/872: creat d4/d6/db/d1e/d22/d39/d4a/f106 x:0 0 0 2024-04-26T21:26:12.904 INFO:tasks.workunit.client.0.smithi084.stdout:4/849: chown d5/f2b 34353 1 2024-04-26T21:26:12.905 INFO:tasks.workunit.client.0.smithi084.stdout:2/964: unlink d6/d7/d3d/d4f/cc8 0 2024-04-26T21:26:12.911 INFO:tasks.workunit.client.0.smithi084.stdout:6/781: mkdir d3/de/d41/dfd 0 2024-04-26T21:26:12.914 INFO:tasks.workunit.client.0.smithi084.stdout:4/850: symlink d5/d10/d15/l113 0 2024-04-26T21:26:12.914 INFO:tasks.workunit.client.0.smithi084.stdout:5/795: mknod d0/d49/cf8 0 2024-04-26T21:26:12.915 INFO:tasks.workunit.client.0.smithi084.stdout:8/873: creat d4/d7/d15/d37/d52/f107 x:0 0 0 2024-04-26T21:26:12.916 INFO:tasks.workunit.client.0.smithi084.stdout:1/859: creat d2/d54/d5e/d66/d2a/d2c/f11f x:0 0 0 2024-04-26T21:26:12.920 INFO:tasks.workunit.client.0.smithi084.stdout:2/965: truncate d6/d7/d3d/d15/d1f/f34 440642 0 2024-04-26T21:26:12.924 INFO:tasks.workunit.client.0.smithi084.stdout:8/874: readlink d4/d6/db/d1e/l1f 0 2024-04-26T21:26:12.928 INFO:tasks.workunit.client.0.smithi084.stdout:5/796: rename d0/dc/l4a to d0/dc/df/d31/d45/lf9 0 2024-04-26T21:26:12.930 INFO:tasks.workunit.client.0.smithi084.stdout:0/827: dwrite de/d2b/d77/d32/f51 [0,4194304] 0 2024-04-26T21:26:12.932 INFO:tasks.workunit.client.0.smithi084.stdout:8/875: write d4/d7/d15/d37/d3b/ff1 [528075,99378] 0 2024-04-26T21:26:12.933 INFO:tasks.workunit.client.0.smithi084.stdout:4/851: creat d5/d25/d35/d60/d69/f114 x:0 0 0 2024-04-26T21:26:12.936 INFO:tasks.workunit.client.0.smithi084.stdout:0/828: mkdir de/d108 0 2024-04-26T21:26:12.939 INFO:tasks.workunit.client.0.smithi084.stdout:5/797: creat d0/dc/df/d31/d63/d6e/ffa x:0 0 0 2024-04-26T21:26:12.945 INFO:tasks.workunit.client.0.smithi084.stdout:3/878: dread d1/d2c/d2f/d31/d52/f64 [0,4194304] 0 2024-04-26T21:26:12.946 INFO:tasks.workunit.client.0.smithi084.stdout:5/798: creat d0/dc/df/d31/d63/d6e/ffb x:0 0 0 2024-04-26T21:26:12.947 INFO:tasks.workunit.client.0.smithi084.stdout:0/829: creat de/f109 x:0 0 0 2024-04-26T21:26:12.950 INFO:tasks.workunit.client.0.smithi084.stdout:6/782: dwrite d3/d18/f5b [0,4194304] 0 2024-04-26T21:26:12.952 INFO:tasks.workunit.client.0.smithi084.stdout:5/799: fdatasync d0/dc/df/f7a 0 2024-04-26T21:26:12.954 INFO:tasks.workunit.client.0.smithi084.stdout:6/783: readlink d3/de/d1a/l96 0 2024-04-26T21:26:12.954 INFO:tasks.workunit.client.0.smithi084.stdout:0/830: creat de/d78/d9e/da1/dad/f10a x:0 0 0 2024-04-26T21:26:12.956 INFO:tasks.workunit.client.0.smithi084.stdout:8/876: dwrite d4/d7/d15/d37/d52/fe0 [4194304,4194304] 0 2024-04-26T21:26:12.956 INFO:tasks.workunit.client.0.smithi084.stdout:6/784: chown d3/de/d1a/d2f/f3c 26022376 1 2024-04-26T21:26:12.968 INFO:tasks.workunit.client.0.smithi084.stdout:8/877: truncate d4/d3a/d8c/f95 248699 0 2024-04-26T21:26:12.968 INFO:tasks.workunit.client.0.smithi084.stdout:7/874: sync 2024-04-26T21:26:12.968 INFO:tasks.workunit.client.0.smithi084.stdout:0/831: truncate de/d20/d4c/dae/dc2/ffd 817958 0 2024-04-26T21:26:12.970 INFO:tasks.workunit.client.0.smithi084.stdout:0/832: chown de/d2b/df3/d94/lb5 1406129 1 2024-04-26T21:26:12.971 INFO:tasks.workunit.client.0.smithi084.stdout:7/875: symlink d6/d9/d12/l12a 0 2024-04-26T21:26:12.972 INFO:tasks.workunit.client.0.smithi084.stdout:1/860: dread d2/f2e [0,4194304] 0 2024-04-26T21:26:12.972 INFO:tasks.workunit.client.0.smithi084.stdout:8/878: write d4/d6/db/d1e/d22/d39/d4a/f8f [1775076,13633] 0 2024-04-26T21:26:12.973 INFO:tasks.workunit.client.0.smithi084.stdout:6/785: dread d3/de/d1a/f9d [0,4194304] 0 2024-04-26T21:26:12.974 INFO:tasks.workunit.client.0.smithi084.stdout:0/833: mkdir de/d2b/df3/d94/d10b 0 2024-04-26T21:26:12.976 INFO:tasks.workunit.client.0.smithi084.stdout:6/786: fsync d3/de/d15/f24 0 2024-04-26T21:26:12.978 INFO:tasks.workunit.client.0.smithi084.stdout:1/861: mknod d2/d19/dd2/de7/c120 0 2024-04-26T21:26:12.978 INFO:tasks.workunit.client.0.smithi084.stdout:7/876: truncate d6/d68/d7f/d107/d84/ffe 854075 0 2024-04-26T21:26:12.981 INFO:tasks.workunit.client.0.smithi084.stdout:0/834: write de/d78/d9e/da1/dad/ffb [626367,76976] 0 2024-04-26T21:26:12.982 INFO:tasks.workunit.client.0.smithi084.stdout:7/877: write d6/d9/fa [7873902,130451] 0 2024-04-26T21:26:12.985 INFO:tasks.workunit.client.0.smithi084.stdout:4/852: truncate d5/d7/d65/d7f/db8/f7e 4148473 0 2024-04-26T21:26:12.989 INFO:tasks.workunit.client.0.smithi084.stdout:7/878: unlink d6/d9/d12/d8b/d72/da0/d80/f11a 0 2024-04-26T21:26:12.990 INFO:tasks.workunit.client.0.smithi084.stdout:0/835: truncate de/d2b/fa2 450348 0 2024-04-26T21:26:12.991 INFO:tasks.workunit.client.0.smithi084.stdout:4/853: creat d5/d10/d82/f115 x:0 0 0 2024-04-26T21:26:13.000 INFO:tasks.workunit.client.0.smithi084.stdout:4/854: readlink d5/d7/d65/d90/d91/dba/dc2/lf5 0 2024-04-26T21:26:13.000 INFO:tasks.workunit.client.0.smithi084.stdout:8/879: dwrite d4/d7/f105 [0,4194304] 0 2024-04-26T21:26:13.002 INFO:tasks.workunit.client.0.smithi084.stdout:5/800: dwrite d0/f64 [0,4194304] 0 2024-04-26T21:26:13.008 INFO:tasks.workunit.client.0.smithi084.stdout:8/880: fsync d4/d7/d15/d9d/fbd 0 2024-04-26T21:26:13.008 INFO:tasks.workunit.client.0.smithi084.stdout:0/836: dread de/d2b/fa2 [0,4194304] 0 2024-04-26T21:26:13.010 INFO:tasks.workunit.client.0.smithi084.stdout:4/855: creat d5/d25/d99/dc7/f116 x:0 0 0 2024-04-26T21:26:13.010 INFO:tasks.workunit.client.0.smithi084.stdout:5/801: rmdir d0/dc/d48 39 2024-04-26T21:26:13.014 INFO:tasks.workunit.client.0.smithi084.stdout:8/881: write d4/d6/db/d1e/d22/d2f/fd3 [117589,100845] 0 2024-04-26T21:26:13.017 INFO:tasks.workunit.client.0.smithi084.stdout:7/879: dwrite d6/d9/d12/d19/d20/d38/fa4 [0,4194304] 0 2024-04-26T21:26:13.023 INFO:tasks.workunit.client.0.smithi084.stdout:5/802: rename d0/dc/df/d31/d72/lab to d0/dc/df/d31/d72/lfc 0 2024-04-26T21:26:13.025 INFO:tasks.workunit.client.0.smithi084.stdout:6/787: dread d3/de/d15/fc9 [0,4194304] 0 2024-04-26T21:26:13.028 INFO:tasks.workunit.client.0.smithi084.stdout:6/788: dread - d3/de/d15/d23/d90/fe4 zero size 2024-04-26T21:26:13.029 INFO:tasks.workunit.client.0.smithi084.stdout:0/837: creat de/f10c x:0 0 0 2024-04-26T21:26:13.030 INFO:tasks.workunit.client.0.smithi084.stdout:8/882: unlink d4/d7/d15/d37/d52/d69/cef 0 2024-04-26T21:26:13.031 INFO:tasks.workunit.client.0.smithi084.stdout:7/880: creat d6/d9/de8/f12b x:0 0 0 2024-04-26T21:26:13.034 INFO:tasks.workunit.client.0.smithi084.stdout:8/883: write d4/d6/db/d9b/dca/fcf [4296691,39586] 0 2024-04-26T21:26:13.037 INFO:tasks.workunit.client.0.smithi084.stdout:4/856: getdents d5/d25/d35/d60 0 2024-04-26T21:26:13.038 INFO:tasks.workunit.client.0.smithi084.stdout:6/789: truncate d3/de/d41/f9a 44475 0 2024-04-26T21:26:13.039 INFO:tasks.workunit.client.0.smithi084.stdout:8/884: creat d4/d7/f108 x:0 0 0 2024-04-26T21:26:13.043 INFO:tasks.workunit.client.0.smithi084.stdout:8/885: write d4/d3a/d8c/f95 [765132,4842] 0 2024-04-26T21:26:13.047 INFO:tasks.workunit.client.0.smithi084.stdout:4/857: creat d5/d25/d35/d60/d6d/de1/dd7/f117 x:0 0 0 2024-04-26T21:26:13.049 INFO:tasks.workunit.client.0.smithi084.stdout:8/886: write d4/d7/d15/d37/d52/f107 [475671,46862] 0 2024-04-26T21:26:13.049 INFO:tasks.workunit.client.0.smithi084.stdout:7/881: write d6/d26/f11c [4787331,78592] 0 2024-04-26T21:26:13.056 INFO:tasks.workunit.client.0.smithi084.stdout:7/882: chown d6/d68/d7f/f129 4966024 1 2024-04-26T21:26:13.060 INFO:tasks.workunit.client.0.smithi084.stdout:4/858: creat d5/d7/d65/d7f/f118 x:0 0 0 2024-04-26T21:26:13.062 INFO:tasks.workunit.client.0.smithi084.stdout:7/883: readlink d6/d68/d7f/lc2 0 2024-04-26T21:26:13.065 INFO:tasks.workunit.client.0.smithi084.stdout:0/838: dwrite de/d2b/d64/d81/f89 [0,4194304] 0 2024-04-26T21:26:13.066 INFO:tasks.workunit.client.0.smithi084.stdout:6/790: dwrite d3/de/d1a/d43/f57 [0,4194304] 0 2024-04-26T21:26:13.067 INFO:tasks.workunit.client.0.smithi084.stdout:8/887: rename d4/d7/d53/fdd to d4/d6/f109 0 2024-04-26T21:26:13.067 INFO:tasks.workunit.client.0.smithi084.stdout:5/803: dwrite d0/dc/fee [0,4194304] 0 2024-04-26T21:26:13.069 INFO:tasks.workunit.client.0.smithi084.stdout:7/884: chown d6/d9/d12/d8b/d72/da0/d80/lfa 20 1 2024-04-26T21:26:13.072 INFO:tasks.workunit.client.0.smithi084.stdout:4/859: rename d5/d25/lf1 to d5/d7/d65/d7f/db8/d8b/l119 0 2024-04-26T21:26:13.073 INFO:tasks.workunit.client.0.smithi084.stdout:7/885: read d6/d68/f78 [8014480,69224] 0 2024-04-26T21:26:13.078 INFO:tasks.workunit.client.0.smithi084.stdout:0/839: mknod de/c10d 0 2024-04-26T21:26:13.078 INFO:tasks.workunit.client.0.smithi084.stdout:8/888: chown d4/d6/db/d1e/d22/c36 529430062 1 2024-04-26T21:26:13.085 INFO:tasks.workunit.client.0.smithi084.stdout:4/860: symlink d5/d10/d15/l11a 0 2024-04-26T21:26:13.087 INFO:tasks.workunit.client.0.smithi084.stdout:6/791: rename d3/de/d15/c8b to d3/de/d1a/d43/d75/cfe 0 2024-04-26T21:26:13.089 INFO:tasks.workunit.client.0.smithi084.stdout:7/886: dread d6/d68/d7f/dcf/fd1 [0,4194304] 0 2024-04-26T21:26:13.091 INFO:tasks.workunit.client.0.smithi084.stdout:4/861: symlink d5/d25/d99/da0/l11b 0 2024-04-26T21:26:13.092 INFO:tasks.workunit.client.0.smithi084.stdout:7/887: chown d6/d68/d7f/d107/f109 0 1 2024-04-26T21:26:13.102 INFO:tasks.workunit.client.0.smithi084.stdout:6/792: dwrite d3/de/d15/df/f4b [0,4194304] 0 2024-04-26T21:26:13.110 INFO:tasks.workunit.client.0.smithi084.stdout:7/888: truncate d6/d9/d12/d8b/d72/da0/fa1 381777 0 2024-04-26T21:26:13.111 INFO:tasks.workunit.client.0.smithi084.stdout:6/793: truncate d3/de/d15/f76 3766399 0 2024-04-26T21:26:13.113 INFO:tasks.workunit.client.0.smithi084.stdout:5/804: dread d0/dc/df/d2a/f91 [0,4194304] 0 2024-04-26T21:26:13.116 INFO:tasks.workunit.client.0.smithi084.stdout:7/889: mknod d6/d9/c12c 0 2024-04-26T21:26:13.117 INFO:tasks.workunit.client.0.smithi084.stdout:6/794: mknod d3/de/d15/d40/dcd/cff 0 2024-04-26T21:26:13.117 INFO:tasks.workunit.client.0.smithi084.stdout:0/840: dwrite de/f21 [0,4194304] 0 2024-04-26T21:26:13.118 INFO:tasks.workunit.client.0.smithi084.stdout:5/805: stat d0/dc/df/d31/d72/fea 0 2024-04-26T21:26:13.121 INFO:tasks.workunit.client.0.smithi084.stdout:7/890: rmdir d6/d68/d7f/dbe 39 2024-04-26T21:26:13.123 INFO:tasks.workunit.client.0.smithi084.stdout:6/795: mknod d3/de/d41/c100 0 2024-04-26T21:26:13.125 INFO:tasks.workunit.client.0.smithi084.stdout:7/891: mknod d6/d9/d12/d19/d60/c12d 0 2024-04-26T21:26:13.129 INFO:tasks.workunit.client.0.smithi084.stdout:7/892: mknod d6/d26/d40/dec/c12e 0 2024-04-26T21:26:13.132 INFO:tasks.workunit.client.0.smithi084.stdout:4/862: dread d5/f83 [0,4194304] 0 2024-04-26T21:26:13.134 INFO:tasks.workunit.client.0.smithi084.stdout:4/863: chown d5/d25/d35/d60/d6d/de1/fc3 1514498838 1 2024-04-26T21:26:13.136 INFO:tasks.workunit.client.0.smithi084.stdout:7/893: getdents d6/d9/d12/d19/d20/d38 0 2024-04-26T21:26:13.136 INFO:tasks.workunit.client.0.smithi084.stdout:4/864: stat d5/d10/d15/d101 0 2024-04-26T21:26:13.137 INFO:tasks.workunit.client.0.smithi084.stdout:4/865: fsync d5/d25/d99/da0/fa6 0 2024-04-26T21:26:13.142 INFO:tasks.workunit.client.0.smithi084.stdout:5/806: dread d0/f4b [0,4194304] 0 2024-04-26T21:26:13.144 INFO:tasks.workunit.client.0.smithi084.stdout:4/866: truncate d5/d25/d35/f8f 1030995 0 2024-04-26T21:26:13.144 INFO:tasks.workunit.client.0.smithi084.stdout:0/841: dread de/d2b/d77/d68/fc3 [0,4194304] 0 2024-04-26T21:26:13.152 INFO:tasks.workunit.client.0.smithi084.stdout:4/867: link d5/d25/d35/d60/d6d/dd0/dd8/fe4 d5/d7/d65/f11c 0 2024-04-26T21:26:13.152 INFO:tasks.workunit.client.0.smithi084.stdout:7/894: write d6/d68/d7f/d107/d84/fac [3641660,93645] 0 2024-04-26T21:26:13.156 INFO:tasks.workunit.client.0.smithi084.stdout:5/807: write d0/d17/f5b [590977,116242] 0 2024-04-26T21:26:13.159 INFO:tasks.workunit.client.0.smithi084.stdout:7/895: fsync d6/d68/d7f/d107/d84/f27 0 2024-04-26T21:26:13.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:12 smithi084 ceph-mon[25539]: pgmap v51: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 116 MiB/s rd, 256 MiB/s wr, 561 op/s 2024-04-26T21:26:13.162 INFO:tasks.workunit.client.0.smithi084.stdout:5/808: unlink d0/dc/f1a 0 2024-04-26T21:26:13.163 INFO:tasks.workunit.client.0.smithi084.stdout:7/896: write d6/d9/d12/d19/d20/d38/f82 [2032134,269] 0 2024-04-26T21:26:13.168 INFO:tasks.workunit.client.0.smithi084.stdout:5/809: rename d0/c52 to d0/dc/d48/cfd 0 2024-04-26T21:26:13.169 INFO:tasks.workunit.client.0.smithi084.stdout:7/897: symlink d6/d1c/d51/d111/l12f 0 2024-04-26T21:26:13.172 INFO:tasks.workunit.client.0.smithi084.stdout:4/868: dwrite d5/d7/d65/d90/d91/dba/fd6 [0,4194304] 0 2024-04-26T21:26:13.173 INFO:tasks.workunit.client.0.smithi084.stdout:5/810: truncate d0/dc/df/d31/d53/fdd 62928 0 2024-04-26T21:26:13.180 INFO:tasks.workunit.client.0.smithi084.stdout:5/811: symlink d0/lfe 0 2024-04-26T21:26:13.181 INFO:tasks.workunit.client.0.smithi084.stdout:4/869: write d5/fe [182580,9026] 0 2024-04-26T21:26:13.181 INFO:tasks.workunit.client.0.smithi084.stdout:7/898: write d6/d9/d12/d19/d20/f57 [1097393,71136] 0 2024-04-26T21:26:13.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:12 smithi120 ceph-mon[32741]: pgmap v51: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 116 MiB/s rd, 256 MiB/s wr, 561 op/s 2024-04-26T21:26:13.189 INFO:tasks.workunit.client.0.smithi084.stdout:7/899: creat d6/d9/d63/db5/d121/f130 x:0 0 0 2024-04-26T21:26:13.191 INFO:tasks.workunit.client.0.smithi084.stdout:5/812: link d0/dc/df/d31/d53/de1/ff4 d0/d49/d4d/fff 0 2024-04-26T21:26:13.192 INFO:tasks.workunit.client.0.smithi084.stdout:5/813: dread - d0/dc/df/d31/d45/fd7 zero size 2024-04-26T21:26:13.193 INFO:tasks.workunit.client.0.smithi084.stdout:4/870: rename d5/d25/d35/d60/d6d/de1/f51 to d5/d25/d35/d60/d69/db2/f11d 0 2024-04-26T21:26:13.194 INFO:tasks.workunit.client.0.smithi084.stdout:7/900: creat d6/d9/d63/db5/f131 x:0 0 0 2024-04-26T21:26:13.196 INFO:tasks.workunit.client.0.smithi084.stdout:7/901: chown d6/d68/d7f/l97 58818496 1 2024-04-26T21:26:13.199 INFO:tasks.workunit.client.0.smithi084.stdout:5/814: creat d0/dc/df/d31/d53/f100 x:0 0 0 2024-04-26T21:26:13.215 INFO:tasks.workunit.client.0.smithi084.stdout:4/871: dwrite d5/d7/d65/f11c [0,4194304] 0 2024-04-26T21:26:13.216 INFO:tasks.workunit.client.0.smithi084.stdout:4/872: stat d5/d25/d35 0 2024-04-26T21:26:13.217 INFO:tasks.workunit.client.0.smithi084.stdout:7/902: dwrite d6/d9/d12/d8b/d72/da0/f85 [4194304,4194304] 0 2024-04-26T21:26:13.221 INFO:tasks.workunit.client.0.smithi084.stdout:4/873: write d5/d25/d99/da0/fc0 [2276800,52295] 0 2024-04-26T21:26:13.223 INFO:tasks.workunit.client.0.smithi084.stdout:4/874: read d5/d25/d35/f86 [2669116,129259] 0 2024-04-26T21:26:13.229 INFO:tasks.workunit.client.0.smithi084.stdout:5/815: dread d0/dc/f19 [4194304,4194304] 0 2024-04-26T21:26:13.283 INFO:tasks.workunit.client.0.smithi084.stdout:7/903: dwrite d6/d9/d12/d8b/d72/da0/fb6 [0,4194304] 0 2024-04-26T21:26:13.286 INFO:tasks.workunit.client.0.smithi084.stdout:4/875: dread d5/d25/d99/da0/fa6 [0,4194304] 0 2024-04-26T21:26:13.293 INFO:tasks.workunit.client.0.smithi084.stdout:4/876: mknod d5/d25/d35/d60/d6d/c11e 0 2024-04-26T21:26:13.293 INFO:tasks.workunit.client.0.smithi084.stdout:7/904: truncate d6/d9/d12/d19/d20/d38/d112/f10f 645803 0 2024-04-26T21:26:13.300 INFO:tasks.workunit.client.0.smithi084.stdout:4/877: rmdir d5/d10/d82 39 2024-04-26T21:26:13.300 INFO:tasks.workunit.client.0.smithi084.stdout:7/905: symlink d6/d9/d63/db5/l132 0 2024-04-26T21:26:13.302 INFO:tasks.workunit.client.0.smithi084.stdout:7/906: dread - d6/d9/d12/d19/fca zero size 2024-04-26T21:26:13.306 INFO:tasks.workunit.client.0.smithi084.stdout:4/878: symlink d5/d7/d65/d7f/db8/d8b/l11f 0 2024-04-26T21:26:13.310 INFO:tasks.workunit.client.0.smithi084.stdout:4/879: creat d5/d10/d82/f120 x:0 0 0 2024-04-26T21:26:13.311 INFO:tasks.workunit.client.0.smithi084.stdout:7/907: link d6/d9/d12/d19/d20/d38/l93 d6/d68/d7f/d107/d84/d110/l133 0 2024-04-26T21:26:13.311 INFO:tasks.workunit.client.0.smithi084.stdout:4/880: dread - d5/d7/d65/d90/d91/fec zero size 2024-04-26T21:26:13.314 INFO:tasks.workunit.client.0.smithi084.stdout:7/908: stat d6/d1c/d51/l81 0 2024-04-26T21:26:13.315 INFO:tasks.workunit.client.0.smithi084.stdout:4/881: mkdir d5/d25/d121 0 2024-04-26T21:26:13.318 INFO:tasks.workunit.client.0.smithi084.stdout:7/909: rename d6/f8c to d6/d68/d7f/d107/f134 0 2024-04-26T21:26:13.320 INFO:tasks.workunit.client.0.smithi084.stdout:4/882: mknod d5/d7/d65/d90/d91/daa/c122 0 2024-04-26T21:26:13.325 INFO:tasks.workunit.client.0.smithi084.stdout:7/910: rename d6/d9/db3/fbd to d6/d68/d7f/d107/d84/d110/f135 0 2024-04-26T21:26:13.326 INFO:tasks.workunit.client.0.smithi084.stdout:4/883: mknod d5/d7/d65/d90/d91/dba/dc2/c123 0 2024-04-26T21:26:13.329 INFO:tasks.workunit.client.0.smithi084.stdout:7/911: dread - d6/d9/d12/d8b/d72/fa3 zero size 2024-04-26T21:26:13.329 INFO:tasks.workunit.client.0.smithi084.stdout:4/884: chown d5/d7/d65/d7f/db8/l30 21 1 2024-04-26T21:26:13.333 INFO:tasks.workunit.client.0.smithi084.stdout:7/912: mkdir d6/d1c/d136 0 2024-04-26T21:26:13.337 INFO:tasks.workunit.client.0.smithi084.stdout:7/913: mknod d6/d9/d12/d8b/d72/c137 0 2024-04-26T21:26:13.357 INFO:tasks.workunit.client.0.smithi084.stdout:4/885: dread d5/d25/d35/d60/d6d/de1/f8a [0,4194304] 0 2024-04-26T21:26:13.367 INFO:tasks.workunit.client.0.smithi084.stdout:7/914: dread d6/d68/d7f/d107/d84/fac [0,4194304] 0 2024-04-26T21:26:13.387 INFO:tasks.workunit.client.0.smithi084.stdout:4/886: dwrite d5/d25/d35/f3a [0,4194304] 0 2024-04-26T21:26:13.389 INFO:tasks.workunit.client.0.smithi084.stdout:7/915: dwrite d6/d68/d7f/dcf/f102 [0,4194304] 0 2024-04-26T21:26:13.399 INFO:tasks.workunit.client.0.smithi084.stdout:9/802: sync 2024-04-26T21:26:13.401 INFO:tasks.workunit.client.0.smithi084.stdout:4/887: dread d5/f83 [0,4194304] 0 2024-04-26T21:26:13.405 INFO:tasks.workunit.client.0.smithi084.stdout:4/888: symlink d5/d25/d35/d60/l124 0 2024-04-26T21:26:13.407 INFO:tasks.workunit.client.0.smithi084.stdout:9/803: creat da/d9e/f12d x:0 0 0 2024-04-26T21:26:13.407 INFO:tasks.workunit.client.0.smithi084.stdout:7/916: dwrite d6/d68/d7f/d107/d84/fcc [0,4194304] 0 2024-04-26T21:26:13.409 INFO:tasks.workunit.client.0.smithi084.stdout:7/917: read d6/d68/d7f/dcf/f102 [2438048,46021] 0 2024-04-26T21:26:13.417 INFO:tasks.workunit.client.0.smithi084.stdout:4/889: truncate d5/d7/d65/d7f/f7a 156823 0 2024-04-26T21:26:13.419 INFO:tasks.workunit.client.0.smithi084.stdout:7/918: rmdir d6/d9/d12/d8b 39 2024-04-26T21:26:13.429 INFO:tasks.workunit.client.0.smithi084.stdout:9/804: write da/dd5/d93/dc3/d41/f91 [19724,28464] 0 2024-04-26T21:26:13.433 INFO:tasks.workunit.client.0.smithi084.stdout:4/890: getdents d5/d25/d35/d60/d6d/de1/d32 0 2024-04-26T21:26:13.437 INFO:tasks.workunit.client.0.smithi084.stdout:7/919: dwrite d6/d9/d12/f3d [0,4194304] 0 2024-04-26T21:26:13.457 INFO:tasks.workunit.client.0.smithi084.stdout:7/920: dwrite d6/d68/d7f/f129 [0,4194304] 0 2024-04-26T21:26:13.459 INFO:tasks.workunit.client.0.smithi084.stdout:9/805: dread da/dd5/d93/dc3/d41/d43/d48/d61/f102 [0,4194304] 0 2024-04-26T21:26:13.460 INFO:tasks.workunit.client.0.smithi084.stdout:7/921: readlink d6/d9/d12/d19/d60/l122 0 2024-04-26T21:26:13.465 INFO:tasks.workunit.client.0.smithi084.stdout:9/806: creat da/dd5/db6/f12e x:0 0 0 2024-04-26T21:26:13.468 INFO:tasks.workunit.client.0.smithi084.stdout:7/922: rmdir d6/d1c/d136 0 2024-04-26T21:26:13.468 INFO:tasks.workunit.client.0.smithi084.stdout:4/891: dread d5/d10/f1b [0,4194304] 0 2024-04-26T21:26:13.470 INFO:tasks.workunit.client.0.smithi084.stdout:4/892: readlink d5/d7/d65/d7f/db8/l30 0 2024-04-26T21:26:13.471 INFO:tasks.workunit.client.0.smithi084.stdout:9/807: truncate da/dd5/d93/dc3/d4f/d104/f108 298642 0 2024-04-26T21:26:13.473 INFO:tasks.workunit.client.0.smithi084.stdout:9/808: creat da/d9e/f12f x:0 0 0 2024-04-26T21:26:13.475 INFO:tasks.workunit.client.0.smithi084.stdout:4/893: unlink d5/d25/d35/d60/d6d/f8c 0 2024-04-26T21:26:13.478 INFO:tasks.workunit.client.0.smithi084.stdout:2/966: sync 2024-04-26T21:26:13.479 INFO:tasks.workunit.client.0.smithi084.stdout:1/862: sync 2024-04-26T21:26:13.479 INFO:tasks.workunit.client.0.smithi084.stdout:7/923: write d6/f17 [1477469,99443] 0 2024-04-26T21:26:13.483 INFO:tasks.workunit.client.0.smithi084.stdout:4/894: getdents d5 0 2024-04-26T21:26:13.484 INFO:tasks.workunit.client.0.smithi084.stdout:7/924: creat d6/d26/d40/dec/f138 x:0 0 0 2024-04-26T21:26:13.485 INFO:tasks.workunit.client.0.smithi084.stdout:4/895: dread - d5/d7/d65/f10b zero size 2024-04-26T21:26:13.489 INFO:tasks.workunit.client.0.smithi084.stdout:2/967: truncate d6/d7/d3d/d15/d1f/d39/da5/fd2 5078016 0 2024-04-26T21:26:13.489 INFO:tasks.workunit.client.0.smithi084.stdout:9/809: getdents da/de/d16/d40 0 2024-04-26T21:26:13.495 INFO:tasks.workunit.client.0.smithi084.stdout:2/968: symlink d6/d7/d3d/d15/d1f/d41/l143 0 2024-04-26T21:26:13.497 INFO:tasks.workunit.client.0.smithi084.stdout:9/810: creat da/dd5/d93/dc3/d41/f130 x:0 0 0 2024-04-26T21:26:13.498 INFO:tasks.workunit.client.0.smithi084.stdout:1/863: write d2/d54/d5e/d66/d3a/d48/f50 [760710,64950] 0 2024-04-26T21:26:13.499 INFO:tasks.workunit.client.0.smithi084.stdout:7/925: mkdir d6/d9/db3/d124/d139 0 2024-04-26T21:26:13.501 INFO:tasks.workunit.client.0.smithi084.stdout:9/811: write da/dd5/d93/dc3/d41/d43/d48/f109 [749001,94833] 0 2024-04-26T21:26:13.502 INFO:tasks.workunit.client.0.smithi084.stdout:1/864: fdatasync d2/d54/d5e/d66/d3a/d77/f85 0 2024-04-26T21:26:13.510 INFO:tasks.workunit.client.0.smithi084.stdout:9/812: unlink da/db3/fcc 0 2024-04-26T21:26:13.520 INFO:tasks.workunit.client.0.smithi084.stdout:1/865: dwrite d2/d9/d15/d9f/fb3 [0,4194304] 0 2024-04-26T21:26:13.522 INFO:tasks.workunit.client.0.smithi084.stdout:7/926: dwrite d6/d68/d7f/d107/d84/f55 [0,4194304] 0 2024-04-26T21:26:13.526 INFO:tasks.workunit.client.0.smithi084.stdout:7/927: truncate d6/d9/db3/fc8 593623 0 2024-04-26T21:26:13.529 INFO:tasks.workunit.client.0.smithi084.stdout:2/969: dread d6/d105/fd8 [4194304,4194304] 0 2024-04-26T21:26:13.530 INFO:tasks.workunit.client.0.smithi084.stdout:1/866: rename d2/d54/d93/d110/d47/fca to d2/d19/dd2/f121 0 2024-04-26T21:26:13.531 INFO:tasks.workunit.client.0.smithi084.stdout:2/970: chown d6/d7/d3d/d15/d1f/d22/de6/lf1 0 1 2024-04-26T21:26:13.540 INFO:tasks.workunit.client.0.smithi084.stdout:9/813: dread da/de/f3d [0,4194304] 0 2024-04-26T21:26:13.540 INFO:tasks.workunit.client.0.smithi084.stdout:2/971: truncate d6/d7/d3d/d15/d1f/d39/fe 2542212 0 2024-04-26T21:26:13.543 INFO:tasks.workunit.client.0.smithi084.stdout:2/972: fdatasync d6/d7/d3d/d15/d1f/d39/da5/fd2 0 2024-04-26T21:26:13.547 INFO:tasks.workunit.client.0.smithi084.stdout:2/973: chown d6/d7/d3d/d15/d1f/d39/d20/d45/f60 22631 1 2024-04-26T21:26:13.552 INFO:tasks.workunit.client.0.smithi084.stdout:9/814: link da/dd5/d93/dc3/d41/d43/d4a/lc6 da/de/d1e/l131 0 2024-04-26T21:26:13.555 INFO:tasks.workunit.client.0.smithi084.stdout:9/815: mknod da/db3/c132 0 2024-04-26T21:26:13.557 INFO:tasks.workunit.client.0.smithi084.stdout:9/816: chown da/db3/f119 78468 1 2024-04-26T21:26:13.559 INFO:tasks.workunit.client.0.smithi084.stdout:9/817: write da/de/d1e/d56/f11f [665048,103746] 0 2024-04-26T21:26:13.560 INFO:tasks.workunit.client.0.smithi084.stdout:1/867: dread d2/d54/d5e/d66/f29 [4194304,4194304] 0 2024-04-26T21:26:13.563 INFO:tasks.workunit.client.0.smithi084.stdout:1/868: fsync d2/d1b/f65 0 2024-04-26T21:26:13.565 INFO:tasks.workunit.client.0.smithi084.stdout:9/818: truncate da/de/d1e/dc9/fdc 323992 0 2024-04-26T21:26:13.573 INFO:tasks.workunit.client.0.smithi084.stdout:9/819: write da/dd5/d93/dc3/d41/d43/d48/d61/fd2 [65886,127530] 0 2024-04-26T21:26:13.579 INFO:tasks.workunit.client.0.smithi084.stdout:9/820: creat da/de/d1e/dc9/f133 x:0 0 0 2024-04-26T21:26:13.587 INFO:tasks.workunit.client.0.smithi084.stdout:1/869: dwrite d2/d19/dd2/f121 [0,4194304] 0 2024-04-26T21:26:13.589 INFO:tasks.workunit.client.0.smithi084.stdout:9/821: creat da/dd5/d93/f134 x:0 0 0 2024-04-26T21:26:13.591 INFO:tasks.workunit.client.0.smithi084.stdout:2/974: dread d6/d7/d3d/d15/d1f/d39/d20/d45/f87 [0,4194304] 0 2024-04-26T21:26:13.591 INFO:tasks.workunit.client.0.smithi084.stdout:9/822: readlink da/dd5/d93/dc3/d41/d8d/la2 0 2024-04-26T21:26:13.600 INFO:tasks.workunit.client.0.smithi084.stdout:9/823: rename da/de/d16/f57 to da/de/d1e/dc9/f135 0 2024-04-26T21:26:13.605 INFO:tasks.workunit.client.0.smithi084.stdout:6/796: sync 2024-04-26T21:26:13.605 INFO:tasks.workunit.client.0.smithi084.stdout:8/889: sync 2024-04-26T21:26:13.605 INFO:tasks.workunit.client.0.smithi084.stdout:5/816: sync 2024-04-26T21:26:13.605 INFO:tasks.workunit.client.0.smithi084.stdout:0/842: sync 2024-04-26T21:26:13.606 INFO:tasks.workunit.client.0.smithi084.stdout:3/879: sync 2024-04-26T21:26:13.608 INFO:tasks.workunit.client.0.smithi084.stdout:2/975: write d6/d7/d3d/d15/d1f/d39/d20/d45/f87 [1063892,85906] 0 2024-04-26T21:26:13.615 INFO:tasks.workunit.client.0.smithi084.stdout:3/880: dread - d1/d2c/f35 zero size 2024-04-26T21:26:13.615 INFO:tasks.workunit.client.0.smithi084.stdout:6/797: unlink d3/de/d15/d23/d90/fb8 0 2024-04-26T21:26:13.616 INFO:tasks.workunit.client.0.smithi084.stdout:0/843: fdatasync de/d2b/d64/d81/d9a/fd2 0 2024-04-26T21:26:13.618 INFO:tasks.workunit.client.0.smithi084.stdout:8/890: dread - d4/d6/db/d1e/d22/d39/dc4/ff8 zero size 2024-04-26T21:26:13.619 INFO:tasks.workunit.client.0.smithi084.stdout:2/976: stat d6/d7/d3d/d15/ff9 0 2024-04-26T21:26:13.621 INFO:tasks.workunit.client.0.smithi084.stdout:3/881: creat d1/d2c/d2f/d31/d55/d4e/f143 x:0 0 0 2024-04-26T21:26:13.621 INFO:tasks.workunit.client.0.smithi084.stdout:6/798: chown d3/de/d1a/d43/l78 129 1 2024-04-26T21:26:13.626 INFO:tasks.workunit.client.0.smithi084.stdout:8/891: dread - d4/d6/db/d1e/d22/d39/dc4/ff8 zero size 2024-04-26T21:26:13.628 INFO:tasks.workunit.client.0.smithi084.stdout:2/977: mknod d6/d7/d3d/d15/d1f/d39/d43/c144 0 2024-04-26T21:26:13.628 INFO:tasks.workunit.client.0.smithi084.stdout:6/799: chown d3/de/d1a/d2f/d4c/c98 235644 1 2024-04-26T21:26:13.629 INFO:tasks.workunit.client.0.smithi084.stdout:0/844: link de/d20/l4b de/d20/l10e 0 2024-04-26T21:26:13.637 INFO:tasks.workunit.client.0.smithi084.stdout:8/892: creat d4/d6/db/d9b/dca/f10a x:0 0 0 2024-04-26T21:26:13.641 INFO:tasks.workunit.client.0.smithi084.stdout:9/824: dwrite da/dd5/d93/dc3/d41/d67/f86 [4194304,4194304] 0 2024-04-26T21:26:13.646 INFO:tasks.workunit.client.0.smithi084.stdout:2/978: rename d6/d7/db6 to d6/d7/d3d/d15/d1f/d145 0 2024-04-26T21:26:13.647 INFO:tasks.workunit.client.0.smithi084.stdout:5/817: dwrite d0/dc/df/d31/d53/f100 [0,4194304] 0 2024-04-26T21:26:13.650 INFO:tasks.workunit.client.0.smithi084.stdout:8/893: mkdir d4/d6/db/d1e/d22/d2f/d10b 0 2024-04-26T21:26:13.654 INFO:tasks.workunit.client.0.smithi084.stdout:3/882: dwrite d1/f124 [0,4194304] 0 2024-04-26T21:26:13.655 INFO:tasks.workunit.client.0.smithi084.stdout:2/979: rmdir d6/d7/d3d/d15/d1f/d39/d20/d45 39 2024-04-26T21:26:13.655 INFO:tasks.workunit.client.0.smithi084.stdout:6/800: write d3/de/d1a/f9d [1066884,19899] 0 2024-04-26T21:26:13.658 INFO:tasks.workunit.client.0.smithi084.stdout:8/894: unlink d4/lc 0 2024-04-26T21:26:13.663 INFO:tasks.workunit.client.0.smithi084.stdout:0/845: rename de/d20/d4e/da9/fb3 to de/d2b/d64/f10f 0 2024-04-26T21:26:13.671 INFO:tasks.workunit.client.0.smithi084.stdout:2/980: creat d6/d7/d3d/d15/d1f/d22/d99/f146 x:0 0 0 2024-04-26T21:26:13.671 INFO:tasks.workunit.client.0.smithi084.stdout:0/846: unlink de/d20/d4e/f6a 0 2024-04-26T21:26:13.673 INFO:tasks.workunit.client.0.smithi084.stdout:3/883: mknod d1/d2c/d2f/d31/d55/d4e/d7c/db1/d129/d12d/c144 0 2024-04-26T21:26:13.675 INFO:tasks.workunit.client.0.smithi084.stdout:3/884: dread - d1/d2c/ff7 zero size 2024-04-26T21:26:13.675 INFO:tasks.workunit.client.0.smithi084.stdout:0/847: dread - de/d2b/d77/d68/f7c zero size 2024-04-26T21:26:13.676 INFO:tasks.workunit.client.0.smithi084.stdout:6/801: creat d3/de/d15/df/dae/df4/dd3/f101 x:0 0 0 2024-04-26T21:26:13.677 INFO:tasks.workunit.client.0.smithi084.stdout:5/818: read d0/dc/df/d31/d45/f7d [2976381,46711] 0 2024-04-26T21:26:13.679 INFO:tasks.workunit.client.0.smithi084.stdout:6/802: chown d3/de/d15/l46 526650640 1 2024-04-26T21:26:13.681 INFO:tasks.workunit.client.0.smithi084.stdout:5/819: readlink d0/l30 0 2024-04-26T21:26:13.684 INFO:tasks.workunit.client.0.smithi084.stdout:0/848: chown de/d78/d9e/da1/lc4 27670394 1 2024-04-26T21:26:13.694 INFO:tasks.workunit.client.0.smithi084.stdout:3/885: fsync d1/d2c/d2f/d31/d55/da4/fe3 0 2024-04-26T21:26:13.698 INFO:tasks.workunit.client.0.smithi084.stdout:5/820: rename d0/f22 to d0/dc/df/d51/f101 0 2024-04-26T21:26:13.709 INFO:tasks.workunit.client.0.smithi084.stdout:5/821: link d0/f64 d0/dc/df/d51/f102 0 2024-04-26T21:26:13.717 INFO:tasks.workunit.client.0.smithi084.stdout:6/803: dwrite d3/de/d15/d23/f35 [0,4194304] 0 2024-04-26T21:26:13.718 INFO:tasks.workunit.client.0.smithi084.stdout:5/822: mknod d0/dc/df/d31/d72/c103 0 2024-04-26T21:26:13.725 INFO:tasks.workunit.client.0.smithi084.stdout:6/804: write d3/de/d15/d23/f2a [459745,62529] 0 2024-04-26T21:26:13.726 INFO:tasks.workunit.client.0.smithi084.stdout:2/981: dwrite d6/d7/d3d/d15/d1f/d41/f100 [0,4194304] 0 2024-04-26T21:26:13.729 INFO:tasks.workunit.client.0.smithi084.stdout:5/823: stat d0/dc/df/d75/le7 0 2024-04-26T21:26:13.731 INFO:tasks.workunit.client.0.smithi084.stdout:5/824: dread - d0/dc/df/d31/d63/d6e/fa6 zero size 2024-04-26T21:26:13.733 INFO:tasks.workunit.client.0.smithi084.stdout:2/982: symlink d6/d7/d3d/d15/d1f/d39/d20/d36/da4/l147 0 2024-04-26T21:26:13.738 INFO:tasks.workunit.client.0.smithi084.stdout:6/805: write d3/de/d15/d23/fe3 [3939086,11165] 0 2024-04-26T21:26:13.738 INFO:tasks.workunit.client.0.smithi084.stdout:2/983: symlink d6/d3e/l148 0 2024-04-26T21:26:13.742 INFO:tasks.workunit.client.0.smithi084.stdout:3/886: dread d1/d24/d27/f2b [0,4194304] 0 2024-04-26T21:26:13.749 INFO:tasks.workunit.client.0.smithi084.stdout:3/887: chown d1/d24/d27/f2b 1 1 2024-04-26T21:26:13.752 INFO:tasks.workunit.client.0.smithi084.stdout:6/806: link d3/de/d41/d5c/ff7 d3/de/d15/df/dae/df4/dfb/f102 0 2024-04-26T21:26:13.753 INFO:tasks.workunit.client.0.smithi084.stdout:0/849: dread f0 [4194304,4194304] 0 2024-04-26T21:26:13.753 INFO:tasks.workunit.client.0.smithi084.stdout:8/895: dread d4/d6/db/d1e/d22/d39/d4a/f5e [0,4194304] 0 2024-04-26T21:26:13.753 INFO:tasks.workunit.client.0.smithi084.stdout:2/984: truncate d6/d7/d3d/d15/d1f/d39/d20/d45/d6d/f131 246660 0 2024-04-26T21:26:13.757 INFO:tasks.workunit.client.0.smithi084.stdout:6/807: fsync d3/de/d15/df/f1b 0 2024-04-26T21:26:13.758 INFO:tasks.workunit.client.0.smithi084.stdout:2/985: symlink d6/d7/d3d/d15/d1f/d145/l149 0 2024-04-26T21:26:13.759 INFO:tasks.workunit.client.0.smithi084.stdout:8/896: write d4/d6/db/d1e/d22/d2f/fd3 [421338,80307] 0 2024-04-26T21:26:13.764 INFO:tasks.workunit.client.0.smithi084.stdout:2/986: fdatasync d6/d7/d3d/d79/f83 0 2024-04-26T21:26:13.769 INFO:tasks.workunit.client.0.smithi084.stdout:8/897: creat d4/d6/db/d1e/d22/d39/f10c x:0 0 0 2024-04-26T21:26:13.773 INFO:tasks.workunit.client.0.smithi084.stdout:2/987: truncate d6/d7/f3f 3943786 0 2024-04-26T21:26:13.785 INFO:tasks.workunit.client.0.smithi084.stdout:8/898: write d4/d6/f24 [914006,69031] 0 2024-04-26T21:26:13.786 INFO:tasks.workunit.client.0.smithi084.stdout:6/808: dwrite d3/de/d15/df/dae/fb2 [0,4194304] 0 2024-04-26T21:26:13.787 INFO:tasks.workunit.client.0.smithi084.stdout:2/988: truncate d6/d7/f3f 1534324 0 2024-04-26T21:26:13.788 INFO:tasks.workunit.client.0.smithi084.stdout:6/809: chown d3/d6c/lf3 108998 1 2024-04-26T21:26:13.793 INFO:tasks.workunit.client.0.smithi084.stdout:3/888: dread d1/d2c/d2f/d31/d55/d4e/d98/fd4 [0,4194304] 0 2024-04-26T21:26:13.793 INFO:tasks.workunit.client.0.smithi084.stdout:6/810: write d3/de/d15/fc9 [3193504,99595] 0 2024-04-26T21:26:13.793 INFO:tasks.workunit.client.0.smithi084.stdout:2/989: chown d6/d7/d3d/d15/d1f/d39/d20/d36/fe9 235785 1 2024-04-26T21:26:13.798 INFO:tasks.workunit.client.0.smithi084.stdout:8/899: write d4/d7/d15/f70 [285258,116494] 0 2024-04-26T21:26:13.803 INFO:tasks.workunit.client.0.smithi084.stdout:6/811: unlink d3/de/d1a/d2f/d4c/ff8 0 2024-04-26T21:26:13.806 INFO:tasks.workunit.client.0.smithi084.stdout:6/812: chown d3/de/d1a/d43/f2d 34296 1 2024-04-26T21:26:13.811 INFO:tasks.workunit.client.0.smithi084.stdout:8/900: rename d4/d7/d15/d3c/f7d to d4/d6/db/d1e/d22/d2f/d10b/f10d 0 2024-04-26T21:26:13.813 INFO:tasks.workunit.client.0.smithi084.stdout:6/813: fdatasync d3/de/d1a/d2f/d4c/d58/fbc 0 2024-04-26T21:26:13.815 INFO:tasks.workunit.client.0.smithi084.stdout:8/901: mknod d4/d7/d15/d37/d3b/c10e 0 2024-04-26T21:26:13.817 INFO:tasks.workunit.client.0.smithi084.stdout:6/814: chown d3/de/d1a/d43/d75/cfe 34 1 2024-04-26T21:26:13.819 INFO:tasks.workunit.client.0.smithi084.stdout:8/902: creat d4/d6/db/d9b/f10f x:0 0 0 2024-04-26T21:26:13.819 INFO:tasks.workunit.client.0.smithi084.stdout:6/815: stat d3/de/d1a/d2f/d4c/d58 0 2024-04-26T21:26:13.822 INFO:tasks.workunit.client.0.smithi084.stdout:8/903: stat d4/d7/d53/fe7 0 2024-04-26T21:26:13.825 INFO:tasks.workunit.client.0.smithi084.stdout:6/816: rmdir d3/de/d1a/d43/d75/dfa 39 2024-04-26T21:26:13.829 INFO:tasks.workunit.client.0.smithi084.stdout:8/904: read d4/d7/f16 [4601462,91714] 0 2024-04-26T21:26:13.834 INFO:tasks.workunit.client.0.smithi084.stdout:2/990: write d6/d7/f3f [1213501,70553] 0 2024-04-26T21:26:13.834 INFO:tasks.workunit.client.0.smithi084.stdout:6/817: truncate d3/de/d1a/d43/d72/dad/fc2 505330 0 2024-04-26T21:26:13.837 INFO:tasks.workunit.client.0.smithi084.stdout:8/905: dread d4/d6/db/d1e/d22/d39/d4a/f5e [0,4194304] 0 2024-04-26T21:26:13.838 INFO:tasks.workunit.client.0.smithi084.stdout:2/991: write d6/d7/d3d/d15/f1a [2264174,122106] 0 2024-04-26T21:26:13.847 INFO:tasks.workunit.client.0.smithi084.stdout:3/889: dwrite d1/d2c/d2f/d94/fcc [0,4194304] 0 2024-04-26T21:26:13.849 INFO:tasks.workunit.client.0.smithi084.stdout:8/906: truncate d4/d7/d15/fc6 519332 0 2024-04-26T21:26:13.850 INFO:tasks.workunit.client.0.smithi084.stdout:2/992: readlink d6/d7/d3d/d15/d1f/d41/ld1 0 2024-04-26T21:26:13.857 INFO:tasks.workunit.client.0.smithi084.stdout:6/818: dwrite d3/de/d41/d5c/f8f [0,4194304] 0 2024-04-26T21:26:13.875 INFO:tasks.workunit.client.0.smithi084.stdout:8/907: mkdir d4/d6/db/d1e/d7c/d110 0 2024-04-26T21:26:13.878 INFO:tasks.workunit.client.0.smithi084.stdout:2/993: unlink d6/d7/d3d/d4f/d10b/f140 0 2024-04-26T21:26:13.881 INFO:tasks.workunit.client.0.smithi084.stdout:6/819: rename d3/de/d41/f44 to d3/de/d9e/f103 0 2024-04-26T21:26:13.883 INFO:tasks.workunit.client.0.smithi084.stdout:8/908: mkdir d4/d7/d15/d37/d3b/d111 0 2024-04-26T21:26:13.886 INFO:tasks.workunit.client.0.smithi084.stdout:6/820: mkdir d3/de/d15/d23/d104 0 2024-04-26T21:26:13.889 INFO:tasks.workunit.client.0.smithi084.stdout:8/909: symlink d4/d6/db/d1e/d22/d39/de9/l112 0 2024-04-26T21:26:13.893 INFO:tasks.workunit.client.0.smithi084.stdout:8/910: mkdir d4/d6/db/d9b/dca/d113 0 2024-04-26T21:26:13.902 INFO:tasks.workunit.client.0.smithi084.stdout:2/994: dread d6/d7/d3d/d15/d1f/d39/fe [0,4194304] 0 2024-04-26T21:26:13.904 INFO:tasks.workunit.client.0.smithi084.stdout:2/995: dread - d6/d7/d3d/d4f/d10b/f132 zero size 2024-04-26T21:26:13.907 INFO:tasks.workunit.client.0.smithi084.stdout:8/911: write d4/f1c [4945358,102617] 0 2024-04-26T21:26:13.914 INFO:tasks.workunit.client.0.smithi084.stdout:3/890: dwrite d1/d2c/d2f/d31/d52/fa5 [0,4194304] 0 2024-04-26T21:26:13.917 INFO:tasks.workunit.client.0.smithi084.stdout:8/912: getdents d4/d7/d15/d9d 0 2024-04-26T21:26:13.919 INFO:tasks.workunit.client.0.smithi084.stdout:6/821: dread d3/de/d15/df/dae/df4/dd3/fd8 [0,4194304] 0 2024-04-26T21:26:13.921 INFO:tasks.workunit.client.0.smithi084.stdout:3/891: symlink d1/d2c/d2f/d31/d55/d4e/d7c/db1/d129/d12d/l145 0 2024-04-26T21:26:13.925 INFO:tasks.workunit.client.0.smithi084.stdout:6/822: mknod d3/de/d1a/d43/d72/dad/c105 0 2024-04-26T21:26:13.928 INFO:tasks.workunit.client.0.smithi084.stdout:2/996: dwrite d6/d7/d3d/d15/d1f/d22/d99/f9d [0,4194304] 0 2024-04-26T21:26:13.928 INFO:tasks.workunit.client.0.smithi084.stdout:6/823: chown d3/de/d15/d40/fb6 1840186041 1 2024-04-26T21:26:13.931 INFO:tasks.workunit.client.0.smithi084.stdout:8/913: dread d4/d6/db/d1e/d22/d96/f9a [0,4194304] 0 2024-04-26T21:26:13.932 INFO:tasks.workunit.client.0.smithi084.stdout:3/892: rename d1/d2c/d2f/d31/f61 to d1/d2c/d2f/d31/d55/d4e/d98/f146 0 2024-04-26T21:26:13.938 INFO:tasks.workunit.client.0.smithi084.stdout:2/997: rename d6/d7/d3d/d15/d1f/d145/d115/d11b/f101 to d6/d7/d3d/f14a 0 2024-04-26T21:26:13.940 INFO:tasks.workunit.client.0.smithi084.stdout:3/893: symlink d1/d24/d11c/l147 0 2024-04-26T21:26:13.941 INFO:tasks.workunit.client.0.smithi084.stdout:7/928: sync 2024-04-26T21:26:13.941 INFO:tasks.workunit.client.0.smithi084.stdout:4/896: sync 2024-04-26T21:26:13.941 INFO:tasks.workunit.client.0.smithi084.stdout:9/825: sync 2024-04-26T21:26:13.942 INFO:tasks.workunit.client.0.smithi084.stdout:1/870: sync 2024-04-26T21:26:13.943 INFO:tasks.workunit.client.0.smithi084.stdout:6/824: link d3/de/d1a/d2f/fab d3/de/d15/df/dae/df4/f106 0 2024-04-26T21:26:13.944 INFO:tasks.workunit.client.0.smithi084.stdout:2/998: readlink d6/d7/d3d/d15/d1f/d39/d20/d45/d6d/le4 0 2024-04-26T21:26:13.951 INFO:tasks.workunit.client.0.smithi084.stdout:3/894: symlink d1/d2c/d2f/d31/l148 0 2024-04-26T21:26:13.955 INFO:tasks.workunit.client.0.smithi084.stdout:2/999: dread - d6/d7/d3d/d79/d81/fe3 zero size 2024-04-26T21:26:13.956 INFO:tasks.workunit.client.0.smithi084.stdout:6/825: truncate d3/de/d41/f9a 405307 0 2024-04-26T21:26:13.956 INFO:tasks.workunit.client.0.smithi084.stdout:4/897: truncate d5/d7/d65/d7f/fa2 235749 0 2024-04-26T21:26:13.957 INFO:tasks.workunit.client.0.smithi084.stdout:1/871: write d2/f56 [1850678,115810] 0 2024-04-26T21:26:13.961 INFO:tasks.workunit.client.0.smithi084.stdout:3/895: symlink d1/d2c/d2f/d31/d55/da4/l149 0 2024-04-26T21:26:13.961 INFO:tasks.workunit.client.0.smithi084.stdout:8/914: dwrite d4/f84 [0,4194304] 0 2024-04-26T21:26:13.961 INFO:tasks.workunit.client.0.smithi084.stdout:9/826: link da/dd5/d93/dc3/d41/d43/d48/fa8 da/dd5/d93/dc3/d41/d43/d48/dce/f136 0 2024-04-26T21:26:13.965 INFO:tasks.workunit.client.0.smithi084.stdout:7/929: dread d6/d9/d12/f3d [0,4194304] 0 2024-04-26T21:26:13.965 INFO:tasks.workunit.client.0.smithi084.stdout:6/826: rename d3/d18/f5b to d3/de/d1a/d2f/d4c/f107 0 2024-04-26T21:26:13.966 INFO:tasks.workunit.client.0.smithi084.stdout:1/872: read d2/d54/d5e/d66/d2a/f95 [59717,89821] 0 2024-04-26T21:26:13.969 INFO:tasks.workunit.client.0.smithi084.stdout:7/930: chown d6/d1c/fe3 1936664141 1 2024-04-26T21:26:13.969 INFO:tasks.workunit.client.0.smithi084.stdout:8/915: stat d4/d6/db/d1e/d22/d39/dc4/ff5 0 2024-04-26T21:26:13.969 INFO:tasks.workunit.client.0.smithi084.stdout:6/827: chown d3/d18/d37 3194754 1 2024-04-26T21:26:13.970 INFO:tasks.workunit.client.0.smithi084.stdout:3/896: truncate d1/d2c/d2f/d31/f134 936331 0 2024-04-26T21:26:13.973 INFO:tasks.workunit.client.0.smithi084.stdout:8/916: stat d4/d6/db/fc5 0 2024-04-26T21:26:13.973 INFO:tasks.workunit.client.0.smithi084.stdout:7/931: readlink d6/l18 0 2024-04-26T21:26:13.973 INFO:tasks.workunit.client.0.smithi084.stdout:4/898: getdents d5/d10/d82/dd9 0 2024-04-26T21:26:13.974 INFO:tasks.workunit.client.0.smithi084.stdout:1/873: dread - d2/d54/d93/d110/d5a/ff1 zero size 2024-04-26T21:26:13.976 INFO:tasks.workunit.client.0.smithi084.stdout:5/825: sync 2024-04-26T21:26:13.976 INFO:tasks.workunit.client.0.smithi084.stdout:0/850: sync 2024-04-26T21:26:13.976 INFO:tasks.workunit.client.0.smithi084.stdout:8/917: chown d4/d7/d15/f18 3917 1 2024-04-26T21:26:13.976 INFO:tasks.workunit.client.0.smithi084.stdout:4/899: chown d5/d7/d65/d7f/db8/f3c 3311 1 2024-04-26T21:26:13.977 INFO:tasks.workunit.client.0.smithi084.stdout:6/828: rmdir d3/de/d15/d23/d90/da2/dc7 39 2024-04-26T21:26:13.980 INFO:tasks.workunit.client.0.smithi084.stdout:8/918: stat d4/d7/d53/fe7 0 2024-04-26T21:26:13.982 INFO:tasks.workunit.client.0.smithi084.stdout:1/874: mknod d2/d54/d93/d110/d69/d9d/c122 0 2024-04-26T21:26:13.983 INFO:tasks.workunit.client.0.smithi084.stdout:3/897: write d1/d2c/d2f/d31/d52/fa1 [7621469,9415] 0 2024-04-26T21:26:13.985 INFO:tasks.workunit.client.0.smithi084.stdout:7/932: read d6/f65 [1192792,54030] 0 2024-04-26T21:26:13.985 INFO:tasks.workunit.client.0.smithi084.stdout:4/900: symlink d5/d25/d35/d60/d69/db2/l125 0 2024-04-26T21:26:13.987 INFO:tasks.workunit.client.0.smithi084.stdout:6/829: mknod d3/de/d1a/d43/d72/dad/c108 0 2024-04-26T21:26:13.988 INFO:tasks.workunit.client.0.smithi084.stdout:1/875: write d2/d19/fd7 [1169577,33644] 0 2024-04-26T21:26:13.992 INFO:tasks.workunit.client.0.smithi084.stdout:5/826: write d0/d17/f7e [1305599,49602] 0 2024-04-26T21:26:13.993 INFO:tasks.workunit.client.0.smithi084.stdout:4/901: creat d5/d7/d65/d7f/d6a/f126 x:0 0 0 2024-04-26T21:26:13.994 INFO:tasks.workunit.client.0.smithi084.stdout:7/933: chown d6/d9/d12/l12a 6345 1 2024-04-26T21:26:13.995 INFO:tasks.workunit.client.0.smithi084.stdout:9/827: dwrite da/dd5/d93/dc3/f2a [0,4194304] 0 2024-04-26T21:26:13.996 INFO:tasks.workunit.client.0.smithi084.stdout:3/898: read - d1/d2c/d2f/d31/d55/d4e/d7c/d7e/fd9 zero size 2024-04-26T21:26:14.002 INFO:tasks.workunit.client.0.smithi084.stdout:6/830: creat d3/de/d1a/d43/d75/dfa/f109 x:0 0 0 2024-04-26T21:26:14.002 INFO:tasks.workunit.client.0.smithi084.stdout:4/902: rmdir d5/d25/d99 39 2024-04-26T21:26:14.002 INFO:tasks.workunit.client.0.smithi084.stdout:0/851: dwrite de/ff [0,4194304] 0 2024-04-26T21:26:14.004 INFO:tasks.workunit.client.0.smithi084.stdout:7/934: creat d6/d9/d12/d19/f13a x:0 0 0 2024-04-26T21:26:14.008 INFO:tasks.workunit.client.0.smithi084.stdout:9/828: rmdir da/dd5/d93/dc3/d41 39 2024-04-26T21:26:14.015 INFO:tasks.workunit.client.0.smithi084.stdout:8/919: dwrite d4/d3a/d8c/f95 [0,4194304] 0 2024-04-26T21:26:14.017 INFO:tasks.workunit.client.0.smithi084.stdout:0/852: symlink de/d2b/df3/d94/dcf/l110 0 2024-04-26T21:26:14.022 INFO:tasks.workunit.client.0.smithi084.stdout:3/899: write d1/d2c/d2f/d31/d55/f82 [2885579,45759] 0 2024-04-26T21:26:14.022 INFO:tasks.workunit.client.0.smithi084.stdout:1/876: dwrite d2/d9/d15/f25 [0,4194304] 0 2024-04-26T21:26:14.027 INFO:tasks.workunit.client.0.smithi084.stdout:0/853: creat de/d2b/df3/d94/dcf/f111 x:0 0 0 2024-04-26T21:26:14.027 INFO:tasks.workunit.client.0.smithi084.stdout:7/935: fsync d6/d9/d12/d8b/d72/da0/fa1 0 2024-04-26T21:26:14.031 INFO:tasks.workunit.client.0.smithi084.stdout:4/903: dread d5/d10/f1b [0,4194304] 0 2024-04-26T21:26:14.032 INFO:tasks.workunit.client.0.smithi084.stdout:8/920: mknod d4/d7/d15/da7/df7/c114 0 2024-04-26T21:26:14.034 INFO:tasks.workunit.client.0.smithi084.stdout:0/854: readlink de/d2b/l2d 0 2024-04-26T21:26:14.039 INFO:tasks.workunit.client.0.smithi084.stdout:1/877: creat d2/d9/d15/d9f/d113/f123 x:0 0 0 2024-04-26T21:26:14.040 INFO:tasks.workunit.client.0.smithi084.stdout:7/936: rename d6/d68/d7f/d107/lab to d6/d1c/d51/d111/l13b 0 2024-04-26T21:26:14.042 INFO:tasks.workunit.client.0.smithi084.stdout:4/904: creat d5/d7/d65/d90/d91/dba/f127 x:0 0 0 2024-04-26T21:26:14.042 INFO:tasks.workunit.client.0.smithi084.stdout:0/855: write de/d2b/d64/d81/f89 [410865,127162] 0 2024-04-26T21:26:14.046 INFO:tasks.workunit.client.0.smithi084.stdout:3/900: getdents d1/d2c/d2f/d31/d55/d4e/d98 0 2024-04-26T21:26:14.047 INFO:tasks.workunit.client.0.smithi084.stdout:8/921: write d4/d6/db/d1e/d22/d39/d4a/f5e [48869,1527] 0 2024-04-26T21:26:14.049 INFO:tasks.workunit.client.0.smithi084.stdout:7/937: creat d6/d68/d7f/d107/f13c x:0 0 0 2024-04-26T21:26:14.051 INFO:tasks.workunit.client.0.smithi084.stdout:4/905: dread - d5/d10/d82/f115 zero size 2024-04-26T21:26:14.052 INFO:tasks.workunit.client.0.smithi084.stdout:0/856: write de/f109 [942210,94326] 0 2024-04-26T21:26:14.052 INFO:tasks.workunit.client.0.smithi084.stdout:9/829: dwrite da/de/d16/d40/feb [0,4194304] 0 2024-04-26T21:26:14.059 INFO:tasks.workunit.client.0.smithi084.stdout:1/878: link d2/d54/d93/d110/c84 d2/d19/dd2/c124 0 2024-04-26T21:26:14.059 INFO:tasks.workunit.client.0.smithi084.stdout:8/922: mknod d4/d6/db/d9b/dd4/de2/c115 0 2024-04-26T21:26:14.063 INFO:tasks.workunit.client.0.smithi084.stdout:8/923: stat d4/d7/d15/d37/d52/fe0 0 2024-04-26T21:26:14.064 INFO:tasks.workunit.client.0.smithi084.stdout:4/906: truncate d5/fbc 3186835 0 2024-04-26T21:26:14.069 INFO:tasks.workunit.client.0.smithi084.stdout:7/938: mkdir d6/d9/d12/d19/d13d 0 2024-04-26T21:26:14.070 INFO:tasks.workunit.client.0.smithi084.stdout:4/907: write d5/d10/f13 [8412664,106964] 0 2024-04-26T21:26:14.072 INFO:tasks.workunit.client.0.smithi084.stdout:5/827: dread d0/dc/df/d51/f101 [4194304,4194304] 0 2024-04-26T21:26:14.072 INFO:tasks.workunit.client.0.smithi084.stdout:0/857: dread de/d2b/d77/d32/f8d [0,4194304] 0 2024-04-26T21:26:14.074 INFO:tasks.workunit.client.0.smithi084.stdout:5/828: fsync d0/f2 0 2024-04-26T21:26:14.075 INFO:tasks.workunit.client.0.smithi084.stdout:3/901: rename d1/d2c/d2f/d31/d55/d4e/d7c/db1/dc8 to d1/d24/d14a 0 2024-04-26T21:26:14.077 INFO:tasks.workunit.client.0.smithi084.stdout:4/908: mknod d5/d10/d82/dd9/c128 0 2024-04-26T21:26:14.077 INFO:tasks.workunit.client.0.smithi084.stdout:1/879: dread d2/d19/d63/f108 [0,4194304] 0 2024-04-26T21:26:14.080 INFO:tasks.workunit.client.0.smithi084.stdout:0/858: dread - de/d2b/d77/d32/d96/da0/fcc zero size 2024-04-26T21:26:14.083 INFO:tasks.workunit.client.0.smithi084.stdout:5/829: mkdir d0/dc/df/d31/d53/d104 0 2024-04-26T21:26:14.086 INFO:tasks.workunit.client.0.smithi084.stdout:4/909: readlink d5/d10/d15/l52 0 2024-04-26T21:26:14.086 INFO:tasks.workunit.client.0.smithi084.stdout:3/902: symlink d1/d24/d27/d3a/ddb/df5/d11d/l14b 0 2024-04-26T21:26:14.086 INFO:tasks.workunit.client.0.smithi084.stdout:1/880: creat d2/d19/f125 x:0 0 0 2024-04-26T21:26:14.087 INFO:tasks.workunit.client.0.smithi084.stdout:0/859: mknod de/d2b/df3/d63/da7/c112 0 2024-04-26T21:26:14.088 INFO:tasks.workunit.client.0.smithi084.stdout:5/830: truncate d0/d49/d56/f57 1441957 0 2024-04-26T21:26:14.090 INFO:tasks.workunit.client.0.smithi084.stdout:8/924: dwrite d4/d6/db/fdb [0,4194304] 0 2024-04-26T21:26:14.099 INFO:tasks.workunit.client.0.smithi084.stdout:4/910: read d5/d10/da1/fbb [1354385,1493] 0 2024-04-26T21:26:14.099 INFO:tasks.workunit.client.0.smithi084.stdout:3/903: creat d1/d24/d27/d3a/ddb/f14c x:0 0 0 2024-04-26T21:26:14.100 INFO:tasks.workunit.client.0.smithi084.stdout:8/925: chown d4/d3a/ce4 1569 1 2024-04-26T21:26:14.102 INFO:tasks.workunit.client.0.smithi084.stdout:5/831: symlink d0/d49/l105 0 2024-04-26T21:26:14.104 INFO:tasks.workunit.client.0.smithi084.stdout:0/860: creat de/d2b/df3/f113 x:0 0 0 2024-04-26T21:26:14.104 INFO:tasks.workunit.client.0.smithi084.stdout:1/881: creat d2/d54/d5e/d66/d2a/d119/f126 x:0 0 0 2024-04-26T21:26:14.105 INFO:tasks.workunit.client.0.smithi084.stdout:5/832: readlink d0/d17/l1b 0 2024-04-26T21:26:14.106 INFO:tasks.workunit.client.0.smithi084.stdout:8/926: fsync d4/d7/d15/d3c/f90 0 2024-04-26T21:26:14.107 INFO:tasks.workunit.client.0.smithi084.stdout:3/904: chown d1/d2c/d2f/d31/d55/da4/de7 3 1 2024-04-26T21:26:14.107 INFO:tasks.workunit.client.0.smithi084.stdout:7/939: dwrite d6/d68/d7f/f123 [0,4194304] 0 2024-04-26T21:26:14.111 INFO:tasks.workunit.client.0.smithi084.stdout:0/861: mkdir de/d71/d114 0 2024-04-26T21:26:14.111 INFO:tasks.workunit.client.0.smithi084.stdout:9/830: dwrite da/dd5/d93/dc3/d41/f7e [4194304,4194304] 0 2024-04-26T21:26:14.114 INFO:tasks.workunit.client.0.smithi084.stdout:4/911: creat d5/d25/d35/d60/d6d/de1/dd7/df2/f129 x:0 0 0 2024-04-26T21:26:14.116 INFO:tasks.workunit.client.0.smithi084.stdout:0/862: write de/d2b/df3/ff9 [648158,85584] 0 2024-04-26T21:26:14.117 INFO:tasks.workunit.client.0.smithi084.stdout:8/927: unlink d4/d6/db/c32 0 2024-04-26T21:26:14.117 INFO:tasks.workunit.client.0.smithi084.stdout:3/905: mkdir d1/d24/d27/d3a/de5/d14d 0 2024-04-26T21:26:14.119 INFO:tasks.workunit.client.0.smithi084.stdout:7/940: unlink d6/d9/d12/d8b/d72/da0/f85 0 2024-04-26T21:26:14.120 INFO:tasks.workunit.client.0.smithi084.stdout:0/863: creat de/d71/f115 x:0 0 0 2024-04-26T21:26:14.125 INFO:tasks.workunit.client.0.smithi084.stdout:9/831: creat da/dd5/d93/dc3/d41/d67/de9/d105/f137 x:0 0 0 2024-04-26T21:26:14.126 INFO:tasks.workunit.client.0.smithi084.stdout:4/912: read d5/d7/d65/f76 [276023,447] 0 2024-04-26T21:26:14.127 INFO:tasks.workunit.client.0.smithi084.stdout:8/928: truncate d4/d7/d15/d9d/fad 4394534 0 2024-04-26T21:26:14.131 INFO:tasks.workunit.client.0.smithi084.stdout:3/906: mknod d1/d24/d27/d3a/de5/d14d/c14e 0 2024-04-26T21:26:14.133 INFO:tasks.workunit.client.0.smithi084.stdout:8/929: write d4/d7/d15/fc7 [189789,109043] 0 2024-04-26T21:26:14.137 INFO:tasks.workunit.client.0.smithi084.stdout:7/941: dread d6/d9/f2d [0,4194304] 0 2024-04-26T21:26:14.143 INFO:tasks.workunit.client.0.smithi084.stdout:8/930: mknod d4/d6/db/d9b/dca/d113/c116 0 2024-04-26T21:26:14.146 INFO:tasks.workunit.client.0.smithi084.stdout:3/907: creat d1/dea/d12f/d12a/f14f x:0 0 0 2024-04-26T21:26:14.147 INFO:tasks.workunit.client.0.smithi084.stdout:0/864: write de/d20/d4c/dae/fb4 [195683,59462] 0 2024-04-26T21:26:14.147 INFO:tasks.workunit.client.0.smithi084.stdout:1/882: dwrite d2/d54/d5e/d66/f2b [0,4194304] 0 2024-04-26T21:26:14.148 INFO:tasks.workunit.client.0.smithi084.stdout:9/832: truncate da/dd5/d93/dc3/d4f/d104/f108 70569 0 2024-04-26T21:26:14.151 INFO:tasks.workunit.client.0.smithi084.stdout:5/833: dread d0/d17/f1d [0,4194304] 0 2024-04-26T21:26:14.159 INFO:tasks.workunit.client.0.smithi084.stdout:1/883: mkdir d2/d54/d5e/d66/d2a/d72/d127 0 2024-04-26T21:26:14.161 INFO:tasks.workunit.client.0.smithi084.stdout:5/834: chown d0/dc/df/d31/d53/fdd 16722 1 2024-04-26T21:26:14.161 INFO:tasks.workunit.client.0.smithi084.stdout:3/908: mkdir d1/d24/d27/d3a/ddb/df5/d11d/d150 0 2024-04-26T21:26:14.163 INFO:tasks.workunit.client.0.smithi084.stdout:4/913: dwrite d5/d7/d65/d90/d91/f108 [0,4194304] 0 2024-04-26T21:26:14.168 INFO:tasks.workunit.client.0.smithi084.stdout:8/931: getdents d4/d6/db/d9b/dca 0 2024-04-26T21:26:14.173 INFO:tasks.workunit.client.0.smithi084.stdout:5/835: symlink d0/df5/l106 0 2024-04-26T21:26:14.177 INFO:tasks.workunit.client.0.smithi084.stdout:8/932: creat d4/d7/d53/f117 x:0 0 0 2024-04-26T21:26:14.178 INFO:tasks.workunit.client.0.smithi084.stdout:7/942: dread d6/d68/d7f/dcf/f102 [0,4194304] 0 2024-04-26T21:26:14.178 INFO:tasks.workunit.client.0.smithi084.stdout:9/833: write da/dd5/d93/dc3/d41/d43/d4a/d82/f85 [670558,62264] 0 2024-04-26T21:26:14.182 INFO:tasks.workunit.client.0.smithi084.stdout:5/836: truncate d0/dc/df/d75/fe4 2088140 0 2024-04-26T21:26:14.185 INFO:tasks.workunit.client.0.smithi084.stdout:0/865: dwrite de/d2b/d77/d32/d96/da0/ff7 [0,4194304] 0 2024-04-26T21:26:14.186 INFO:tasks.workunit.client.0.smithi084.stdout:5/837: chown d0/dc/df/d75/f55 11738467 1 2024-04-26T21:26:14.187 INFO:tasks.workunit.client.0.smithi084.stdout:0/866: stat de/d78/d9e/fce 0 2024-04-26T21:26:14.190 INFO:tasks.workunit.client.0.smithi084.stdout:9/834: mknod da/dd5/d93/dc3/d4f/d104/c138 0 2024-04-26T21:26:14.193 INFO:tasks.workunit.client.0.smithi084.stdout:3/909: dwrite d1/d2c/f90 [4194304,4194304] 0 2024-04-26T21:26:14.198 INFO:tasks.workunit.client.0.smithi084.stdout:9/835: creat da/f139 x:0 0 0 2024-04-26T21:26:14.211 INFO:tasks.workunit.client.0.smithi084.stdout:5/838: write d0/dc/f19 [6054944,4059] 0 2024-04-26T21:26:14.213 INFO:tasks.workunit.client.0.smithi084.stdout:1/884: dread d2/d54/d5e/dbe/fdb [0,4194304] 0 2024-04-26T21:26:14.218 INFO:tasks.workunit.client.0.smithi084.stdout:5/839: symlink d0/dc/df/d31/d53/d104/l107 0 2024-04-26T21:26:14.218 INFO:tasks.workunit.client.0.smithi084.stdout:7/943: dwrite d6/d68/d7f/d107/d84/f7c [0,4194304] 0 2024-04-26T21:26:14.219 INFO:tasks.workunit.client.0.smithi084.stdout:1/885: fsync d2/d54/d93/d110/d69/d9d/fbb 0 2024-04-26T21:26:14.227 INFO:tasks.workunit.client.0.smithi084.stdout:5/840: symlink d0/dc/df/d31/d53/d87/l108 0 2024-04-26T21:26:14.227 INFO:tasks.workunit.client.0.smithi084.stdout:3/910: write d1/d2c/d2f/d31/dc7/d118/f6c [736896,41475] 0 2024-04-26T21:26:14.236 INFO:tasks.workunit.client.0.smithi084.stdout:9/836: dwrite da/de/d1e/f49 [0,4194304] 0 2024-04-26T21:26:14.236 INFO:tasks.workunit.client.0.smithi084.stdout:7/944: creat d6/d68/d7f/d107/d84/d110/f13e x:0 0 0 2024-04-26T21:26:14.239 INFO:tasks.workunit.client.0.smithi084.stdout:5/841: chown d0/da2/fd9 2178 1 2024-04-26T21:26:14.241 INFO:tasks.workunit.client.0.smithi084.stdout:5/842: stat d0/dc/df/d31/d53 0 2024-04-26T21:26:14.242 INFO:tasks.workunit.client.0.smithi084.stdout:1/886: truncate d2/d54/d5e/d66/d2a/d2c/f2d 398033 0 2024-04-26T21:26:14.243 INFO:tasks.workunit.client.0.smithi084.stdout:5/843: stat d0/dc/df/d31/f9c 0 2024-04-26T21:26:14.245 INFO:tasks.workunit.client.0.smithi084.stdout:5/844: chown d0/dc/df/d31/d72/c76 62 1 2024-04-26T21:26:14.246 INFO:tasks.workunit.client.0.smithi084.stdout:1/887: symlink d2/d1b/l128 0 2024-04-26T21:26:14.249 INFO:tasks.workunit.client.0.smithi084.stdout:5/845: creat d0/dc/df/d31/d53/f109 x:0 0 0 2024-04-26T21:26:14.253 INFO:tasks.workunit.client.0.smithi084.stdout:5/846: mkdir d0/dc/d48/de9/d10a 0 2024-04-26T21:26:14.257 INFO:tasks.workunit.client.0.smithi084.stdout:5/847: symlink d0/dc/df/d31/d72/l10b 0 2024-04-26T21:26:14.258 INFO:tasks.workunit.client.0.smithi084.stdout:3/911: dread d1/d2c/d2f/d31/dc7/d118/f70 [0,4194304] 0 2024-04-26T21:26:14.259 INFO:tasks.workunit.client.0.smithi084.stdout:9/837: dread da/dd5/d93/dc3/d41/d43/d48/d61/f77 [0,4194304] 0 2024-04-26T21:26:14.260 INFO:tasks.workunit.client.0.smithi084.stdout:5/848: mkdir d0/dc/df/d51/d10c 0 2024-04-26T21:26:14.260 INFO:tasks.workunit.client.0.smithi084.stdout:3/912: chown d1/d24/d27/f30 1 1 2024-04-26T21:26:14.262 INFO:tasks.workunit.client.0.smithi084.stdout:5/849: chown d0/dc/d48/lcb 176789 1 2024-04-26T21:26:14.263 INFO:tasks.workunit.client.0.smithi084.stdout:9/838: write da/dd5/d93/dc3/d41/d8d/fad [9160337,49942] 0 2024-04-26T21:26:14.265 INFO:tasks.workunit.client.0.smithi084.stdout:3/913: write d1/d2c/d2f/d31/d52/fa1 [2598465,23736] 0 2024-04-26T21:26:14.268 INFO:tasks.workunit.client.0.smithi084.stdout:5/850: mknod d0/dc/df/d31/d72/c10d 0 2024-04-26T21:26:14.270 INFO:tasks.workunit.client.0.smithi084.stdout:9/839: unlink da/dd5/d93/dc3/d4f/d104/f108 0 2024-04-26T21:26:14.270 INFO:tasks.workunit.client.0.smithi084.stdout:7/945: dread d6/d68/d7f/d107/d84/f76 [0,4194304] 0 2024-04-26T21:26:14.271 INFO:tasks.workunit.client.0.smithi084.stdout:3/914: creat d1/d24/d27/d3a/ddb/df5/d11d/d150/f151 x:0 0 0 2024-04-26T21:26:14.277 INFO:tasks.workunit.client.0.smithi084.stdout:5/851: link d0/dc/df/d6d/fe2 d0/dc/df/d31/d53/d5d/f10e 0 2024-04-26T21:26:14.279 INFO:tasks.workunit.client.0.smithi084.stdout:3/915: symlink d1/d2c/d2f/d31/d55/d4e/d7c/l152 0 2024-04-26T21:26:14.281 INFO:tasks.workunit.client.0.smithi084.stdout:3/916: dread - d1/d2c/d2f/d31/da8/f111 zero size 2024-04-26T21:26:14.281 INFO:tasks.workunit.client.0.smithi084.stdout:9/840: link da/dd5/d93/dc3/d41/f7e da/db3/d117/f13a 0 2024-04-26T21:26:14.282 INFO:tasks.workunit.client.0.smithi084.stdout:3/917: stat d1/d24/d27/d3a/d81/fa6 0 2024-04-26T21:26:14.282 INFO:tasks.workunit.client.0.smithi084.stdout:5/852: symlink d0/da2/l10f 0 2024-04-26T21:26:14.283 INFO:tasks.workunit.client.0.smithi084.stdout:9/841: chown da/dd5/d93/dc3/d4f/d104 333 1 2024-04-26T21:26:14.289 INFO:tasks.workunit.client.0.smithi084.stdout:5/853: truncate d0/dc/df/d31/f9c 2101049 0 2024-04-26T21:26:14.295 INFO:tasks.workunit.client.0.smithi084.stdout:7/946: dwrite d6/d9/d12/d8b/d72/fcb [0,4194304] 0 2024-04-26T21:26:14.300 INFO:tasks.workunit.client.0.smithi084.stdout:3/918: getdents d1/d2c/d2f/d31/d55/d4e/d7c/db1 0 2024-04-26T21:26:14.301 INFO:tasks.workunit.client.0.smithi084.stdout:9/842: dwrite da/de/d16/d40/f64 [4194304,4194304] 0 2024-04-26T21:26:14.312 INFO:tasks.workunit.client.0.smithi084.stdout:3/919: fdatasync d1/d2c/d2f/d31/d55/da4/fe3 0 2024-04-26T21:26:14.318 INFO:tasks.workunit.client.0.smithi084.stdout:5/854: dwrite d0/dc/f2f [0,4194304] 0 2024-04-26T21:26:14.320 INFO:tasks.workunit.client.0.smithi084.stdout:7/947: link d6/d9/db3/lba d6/d68/l13f 0 2024-04-26T21:26:14.322 INFO:tasks.workunit.client.0.smithi084.stdout:9/843: mkdir da/dd5/d93/dc3/d41/d8d/d13b 0 2024-04-26T21:26:14.328 INFO:tasks.workunit.client.0.smithi084.stdout:5/855: truncate d0/dc/d48/f77 81223 0 2024-04-26T21:26:14.328 INFO:tasks.workunit.client.0.smithi084.stdout:7/948: mknod d6/d9/db3/d124/d139/c140 0 2024-04-26T21:26:14.337 INFO:tasks.workunit.client.0.smithi084.stdout:7/949: getdents d6/d26/d40/dec 0 2024-04-26T21:26:14.337 INFO:tasks.workunit.client.0.smithi084.stdout:3/920: dwrite d1/d2c/d2f/d31/d55/d4e/d7c/db1/d129/f133 [0,4194304] 0 2024-04-26T21:26:14.338 INFO:tasks.workunit.client.0.smithi084.stdout:5/856: truncate d0/dc/df/d31/d53/fdd 667740 0 2024-04-26T21:26:14.350 INFO:tasks.workunit.client.0.smithi084.stdout:3/921: fsync d1/d2c/d2f/fab 0 2024-04-26T21:26:14.360 INFO:tasks.workunit.client.0.smithi084.stdout:7/950: dwrite d6/d9/fa [0,4194304] 0 2024-04-26T21:26:14.361 INFO:tasks.workunit.client.0.smithi084.stdout:7/951: readlink d6/l18 0 2024-04-26T21:26:14.366 INFO:tasks.workunit.client.0.smithi084.stdout:5/857: dwrite d0/dc/df/d31/fc9 [0,4194304] 0 2024-04-26T21:26:14.368 INFO:tasks.workunit.client.0.smithi084.stdout:7/952: symlink d6/d68/d7f/d107/d84/l141 0 2024-04-26T21:26:14.370 INFO:tasks.workunit.client.0.smithi084.stdout:9/844: dread da/dd5/d93/dc3/d41/d67/f86 [0,4194304] 0 2024-04-26T21:26:14.372 INFO:tasks.workunit.client.0.smithi084.stdout:7/953: write d6/d9/d63/db5/fdf [61827,72835] 0 2024-04-26T21:26:14.372 INFO:tasks.workunit.client.0.smithi084.stdout:5/858: chown d0/d49/f95 8326052 1 2024-04-26T21:26:14.375 INFO:tasks.workunit.client.0.smithi084.stdout:3/922: dwrite d1/d2c/d2f/d31/f134 [0,4194304] 0 2024-04-26T21:26:14.377 INFO:tasks.workunit.client.0.smithi084.stdout:3/923: chown d1/f1d 86459 1 2024-04-26T21:26:14.380 INFO:tasks.workunit.client.0.smithi084.stdout:3/924: chown d1/d2c/d2f/d31/dc7/d118/fad 2044 1 2024-04-26T21:26:14.383 INFO:tasks.workunit.client.0.smithi084.stdout:5/859: rename d0/dc/df/d31/f9c to d0/da2/f110 0 2024-04-26T21:26:14.390 INFO:tasks.workunit.client.0.smithi084.stdout:7/954: write d6/d1c/d51/fe0 [928728,27079] 0 2024-04-26T21:26:14.396 INFO:tasks.workunit.client.0.smithi084.stdout:7/955: creat d6/d9/d12/d19/d20/d38/f142 x:0 0 0 2024-04-26T21:26:14.398 INFO:tasks.workunit.client.0.smithi084.stdout:7/956: chown d6/d1c/c8a 3254821 1 2024-04-26T21:26:14.399 INFO:tasks.workunit.client.0.smithi084.stdout:5/860: getdents d0/dc/df/d31 0 2024-04-26T21:26:14.401 INFO:tasks.workunit.client.0.smithi084.stdout:3/925: write d1/d2c/d2f/f96 [4447556,13636] 0 2024-04-26T21:26:14.401 INFO:tasks.workunit.client.0.smithi084.stdout:7/957: readlink d6/d68/d7f/d107/d84/d110/l128 0 2024-04-26T21:26:14.402 INFO:tasks.workunit.client.0.smithi084.stdout:3/926: chown d1/dea/d125 3905 1 2024-04-26T21:26:14.404 INFO:tasks.workunit.client.0.smithi084.stdout:5/861: mknod d0/dc/df/d31/d45/c111 0 2024-04-26T21:26:14.408 INFO:tasks.workunit.client.0.smithi084.stdout:3/927: rmdir d1/d2c/d2f/d31/d55/d4e/d7c/d7e 39 2024-04-26T21:26:14.409 INFO:tasks.workunit.client.0.smithi084.stdout:5/862: unlink d0/dc/df/d31/fc9 0 2024-04-26T21:26:14.411 INFO:tasks.workunit.client.0.smithi084.stdout:9/845: dread da/f23 [0,4194304] 0 2024-04-26T21:26:14.411 INFO:tasks.workunit.client.0.smithi084.stdout:3/928: symlink d1/d2c/l153 0 2024-04-26T21:26:14.414 INFO:tasks.workunit.client.0.smithi084.stdout:5/863: creat d0/dc/df/d31/d45/f112 x:0 0 0 2024-04-26T21:26:14.415 INFO:tasks.workunit.client.0.smithi084.stdout:9/846: write da/db3/f119 [605817,77428] 0 2024-04-26T21:26:14.421 INFO:tasks.workunit.client.0.smithi084.stdout:7/958: dwrite d6/d68/d7f/d107/d84/f76 [0,4194304] 0 2024-04-26T21:26:14.429 INFO:tasks.workunit.client.0.smithi084.stdout:7/959: mknod d6/d9/db3/c143 0 2024-04-26T21:26:14.436 INFO:tasks.workunit.client.0.smithi084.stdout:5/864: truncate d0/dc/df/d31/d53/f83 8664564 0 2024-04-26T21:26:14.438 INFO:tasks.workunit.client.0.smithi084.stdout:9/847: dwrite da/dd5/db6/fde [0,4194304] 0 2024-04-26T21:26:14.442 INFO:tasks.workunit.client.0.smithi084.stdout:3/929: dread d1/d2c/d2f/d31/dc7/d118/f44 [0,4194304] 0 2024-04-26T21:26:14.449 INFO:tasks.workunit.client.0.smithi084.stdout:7/960: dwrite d6/d1c/fe3 [0,4194304] 0 2024-04-26T21:26:14.452 INFO:tasks.workunit.client.0.smithi084.stdout:7/961: fsync d6/d9/d12/d19/f13a 0 2024-04-26T21:26:14.453 INFO:tasks.workunit.client.0.smithi084.stdout:3/930: rename d1/d24/d27/d3a/lae to d1/l154 0 2024-04-26T21:26:14.455 INFO:tasks.workunit.client.0.smithi084.stdout:7/962: write d6/d68/f6e [3227648,26889] 0 2024-04-26T21:26:14.456 INFO:tasks.workunit.client.0.smithi084.stdout:3/931: truncate d1/f124 4572581 0 2024-04-26T21:26:14.458 INFO:tasks.workunit.client.0.smithi084.stdout:7/963: stat d6/d9/d12/d19/d20 0 2024-04-26T21:26:14.464 INFO:tasks.workunit.client.0.smithi084.stdout:7/964: write d6/d68/d7f/d107/d84/f7c [4318391,14487] 0 2024-04-26T21:26:14.465 INFO:tasks.workunit.client.0.smithi084.stdout:9/848: dwrite da/dd5/d93/dc3/d41/d43/d48/d61/f77 [0,4194304] 0 2024-04-26T21:26:14.466 INFO:tasks.workunit.client.0.smithi084.stdout:3/932: rename d1/d2c/d2f/d31/dc7/d118/f10f to d1/f155 0 2024-04-26T21:26:14.471 INFO:tasks.workunit.client.0.smithi084.stdout:7/965: chown d6/d9/d12/d19/d60/cc7 18541 1 2024-04-26T21:26:14.471 INFO:tasks.workunit.client.0.smithi084.stdout:9/849: creat da/dd5/d93/dc3/d41/d43/d48/d61/f13c x:0 0 0 2024-04-26T21:26:14.475 INFO:tasks.workunit.client.0.smithi084.stdout:3/933: creat d1/d2c/d2f/d31/d55/d4e/d7c/f156 x:0 0 0 2024-04-26T21:26:14.476 INFO:tasks.workunit.client.0.smithi084.stdout:9/850: fdatasync da/dd5/d93/dc3/d41/d43/d80/fc7 0 2024-04-26T21:26:14.478 INFO:tasks.workunit.client.0.smithi084.stdout:7/966: rename d6/d9/d63/db5/f131 to d6/d9/d12/d19/d20/d32/f144 0 2024-04-26T21:26:14.481 INFO:tasks.workunit.client.0.smithi084.stdout:9/851: readlink da/de/l2b 0 2024-04-26T21:26:14.483 INFO:tasks.workunit.client.0.smithi084.stdout:7/967: creat d6/d1c/f145 x:0 0 0 2024-04-26T21:26:14.488 INFO:tasks.workunit.client.0.smithi084.stdout:3/934: dread d1/d2c/d2f/d31/d52/fa5 [0,4194304] 0 2024-04-26T21:26:14.491 INFO:tasks.workunit.client.0.smithi084.stdout:3/935: creat d1/dea/d104/f157 x:0 0 0 2024-04-26T21:26:14.491 INFO:tasks.workunit.client.0.smithi084.stdout:7/968: write d6/d68/d7f/fbc [1702524,79697] 0 2024-04-26T21:26:14.494 INFO:tasks.workunit.client.0.smithi084.stdout:3/936: write d1/d2c/d2f/d31/d55/f6a [2543662,74910] 0 2024-04-26T21:26:14.495 INFO:tasks.workunit.client.0.smithi084.stdout:7/969: rmdir d6/d1c/d51 39 2024-04-26T21:26:14.498 INFO:tasks.workunit.client.0.smithi084.stdout:3/937: mkdir d1/dea/d12f/d12a/d158 0 2024-04-26T21:26:14.498 INFO:tasks.workunit.client.0.smithi084.stdout:9/852: dwrite da/dd5/d93/dc3/d41/f91 [0,4194304] 0 2024-04-26T21:26:14.501 INFO:tasks.workunit.client.0.smithi084.stdout:6/831: sync 2024-04-26T21:26:14.506 INFO:tasks.workunit.client.0.smithi084.stdout:9/853: creat da/de/d1e/f13d x:0 0 0 2024-04-26T21:26:14.506 INFO:tasks.workunit.client.0.smithi084.stdout:6/832: chown d3/de/d15/d23/f30 171 1 2024-04-26T21:26:14.509 INFO:tasks.workunit.client.0.smithi084.stdout:6/833: write d3/de/d15/df/dae/df4/dd3/f101 [864287,84361] 0 2024-04-26T21:26:14.509 INFO:tasks.workunit.client.0.smithi084.stdout:9/854: rmdir da/dd5/d93/dc3/d41/d43/d48/d61 39 2024-04-26T21:26:14.515 INFO:tasks.workunit.client.0.smithi084.stdout:7/970: dwrite d6/d68/f114 [0,4194304] 0 2024-04-26T21:26:14.529 INFO:tasks.workunit.client.0.smithi084.stdout:7/971: mknod d6/d26/d40/c146 0 2024-04-26T21:26:14.530 INFO:tasks.workunit.client.0.smithi084.stdout:6/834: rename d3/de/d41/f9a to d3/de/d1a/d43/d75/dfa/df6/f10a 0 2024-04-26T21:26:14.536 INFO:tasks.workunit.client.0.smithi084.stdout:3/938: dwrite d1/d2c/d2f/d31/d55/d4e/d7c/db1/f10e [0,4194304] 0 2024-04-26T21:26:14.540 INFO:tasks.workunit.client.0.smithi084.stdout:7/972: write d6/d68/d7f/d107/d84/f27 [849086,98352] 0 2024-04-26T21:26:14.542 INFO:tasks.workunit.client.0.smithi084.stdout:9/855: dwrite da/dd5/d93/dc3/f73 [0,4194304] 0 2024-04-26T21:26:14.546 INFO:tasks.workunit.client.0.smithi084.stdout:3/939: rename d1/fe to d1/d24/d27/d3a/ddb/df5/d11d/f159 0 2024-04-26T21:26:14.548 INFO:tasks.workunit.client.0.smithi084.stdout:7/973: mknod d6/d9/d63/c147 0 2024-04-26T21:26:14.549 INFO:tasks.workunit.client.0.smithi084.stdout:7/974: dread - d6/ff2 zero size 2024-04-26T21:26:14.554 INFO:tasks.workunit.client.0.smithi084.stdout:7/975: mkdir d6/d68/d7f/d148 0 2024-04-26T21:26:14.557 INFO:tasks.workunit.client.0.smithi084.stdout:7/976: chown d6/d9/d12/d19/d20/d32/lea 673 1 2024-04-26T21:26:14.559 INFO:tasks.workunit.client.0.smithi084.stdout:9/856: truncate da/dd5/d93/dc3/d41/d67/f97 837003 0 2024-04-26T21:26:14.562 INFO:tasks.workunit.client.0.smithi084.stdout:3/940: dread d1/d2c/d2f/d31/d55/d4e/d7c/db1/f10e [0,4194304] 0 2024-04-26T21:26:14.565 INFO:tasks.workunit.client.0.smithi084.stdout:3/941: chown d1/d2c/d2f/d31/l47 1 1 2024-04-26T21:26:14.568 INFO:tasks.workunit.client.0.smithi084.stdout:7/977: write d6/d68/f78 [7416135,36432] 0 2024-04-26T21:26:14.569 INFO:tasks.workunit.client.0.smithi084.stdout:9/857: write da/d9e/fdd [903626,101428] 0 2024-04-26T21:26:14.574 INFO:tasks.workunit.client.0.smithi084.stdout:9/858: chown da/dd5/d93/dc3/d41/d43/d4a/d82 99197 1 2024-04-26T21:26:14.576 INFO:tasks.workunit.client.0.smithi084.stdout:3/942: rename d1/d2c/d2f/d31/dc7/d118/c11b to d1/dea/d12f/c15a 0 2024-04-26T21:26:14.576 INFO:tasks.workunit.client.0.smithi084.stdout:9/859: mknod da/d9e/c13e 0 2024-04-26T21:26:14.577 INFO:tasks.workunit.client.0.smithi084.stdout:6/835: dread d3/de/d15/d40/f60 [0,4194304] 0 2024-04-26T21:26:14.577 INFO:tasks.workunit.client.0.smithi084.stdout:7/978: write d6/d1c/fa5 [1115328,20052] 0 2024-04-26T21:26:14.580 INFO:tasks.workunit.client.0.smithi084.stdout:9/860: symlink da/db3/d117/l13f 0 2024-04-26T21:26:14.580 INFO:tasks.workunit.client.0.smithi084.stdout:3/943: truncate d1/d2c/d2f/f13b 113353 0 2024-04-26T21:26:14.582 INFO:tasks.workunit.client.0.smithi084.stdout:6/836: dread d3/d18/f8d [0,4194304] 0 2024-04-26T21:26:14.584 INFO:tasks.workunit.client.0.smithi084.stdout:7/979: symlink d6/d9/d12/d8b/d72/da0/l149 0 2024-04-26T21:26:14.584 INFO:tasks.workunit.client.0.smithi084.stdout:3/944: creat d1/d24/d27/d3a/ddb/df5/d11d/d150/f15b x:0 0 0 2024-04-26T21:26:14.587 INFO:tasks.workunit.client.0.smithi084.stdout:9/861: creat da/dd5/d93/dc3/d41/d8d/f140 x:0 0 0 2024-04-26T21:26:14.589 INFO:tasks.workunit.client.0.smithi084.stdout:9/862: fdatasync da/dd5/db6/f110 0 2024-04-26T21:26:14.591 INFO:tasks.workunit.client.0.smithi084.stdout:6/837: write d3/de/d15/f85 [1828175,62936] 0 2024-04-26T21:26:14.592 INFO:tasks.workunit.client.0.smithi084.stdout:7/980: write d6/d9/d12/d19/d20/f44 [874491,48750] 0 2024-04-26T21:26:14.598 INFO:tasks.workunit.client.0.smithi084.stdout:9/863: write da/dd5/d93/dc3/d41/d43/fb2 [2615560,87643] 0 2024-04-26T21:26:14.601 INFO:tasks.workunit.client.0.smithi084.stdout:6/838: link d3/d6c/ca4 d3/de/d1a/d2f/c10b 0 2024-04-26T21:26:14.603 INFO:tasks.workunit.client.0.smithi084.stdout:6/839: stat d3/de/d1a/d2f/d4c/f107 0 2024-04-26T21:26:14.603 INFO:tasks.workunit.client.0.smithi084.stdout:9/864: read da/de/d1e/f47 [374595,65304] 0 2024-04-26T21:26:14.606 INFO:tasks.workunit.client.0.smithi084.stdout:6/840: rmdir d3/de/d1a 39 2024-04-26T21:26:14.609 INFO:tasks.workunit.client.0.smithi084.stdout:5/865: sync 2024-04-26T21:26:14.610 INFO:tasks.workunit.client.0.smithi084.stdout:1/888: sync 2024-04-26T21:26:14.610 INFO:tasks.workunit.client.0.smithi084.stdout:4/914: sync 2024-04-26T21:26:14.610 INFO:tasks.workunit.client.0.smithi084.stdout:0/867: sync 2024-04-26T21:26:14.610 INFO:tasks.workunit.client.0.smithi084.stdout:8/933: sync 2024-04-26T21:26:14.614 INFO:tasks.workunit.client.0.smithi084.stdout:6/841: stat d3/de/d41/dfd 0 2024-04-26T21:26:14.614 INFO:tasks.workunit.client.0.smithi084.stdout:7/981: dwrite d6/d9/d63/f87 [0,4194304] 0 2024-04-26T21:26:14.616 INFO:tasks.workunit.client.0.smithi084.stdout:1/889: dread - d2/d54/d93/d110/da0/fb7 zero size 2024-04-26T21:26:14.616 INFO:tasks.workunit.client.0.smithi084.stdout:5/866: fsync d0/d49/f95 0 2024-04-26T21:26:14.618 INFO:tasks.workunit.client.0.smithi084.stdout:0/868: truncate de/d71/f57 2277766 0 2024-04-26T21:26:14.620 INFO:tasks.workunit.client.0.smithi084.stdout:4/915: rename d5/d7/d65/d7f/db8/l30 to d5/d7/d65/d90/l12a 0 2024-04-26T21:26:14.621 INFO:tasks.workunit.client.0.smithi084.stdout:3/945: dread d1/d2c/d2f/d31/d55/d4e/fde [0,4194304] 0 2024-04-26T21:26:14.621 INFO:tasks.workunit.client.0.smithi084.stdout:6/842: readlink d3/de/d1a/d2f/d4c/da0/lac 0 2024-04-26T21:26:14.623 INFO:tasks.workunit.client.0.smithi084.stdout:7/982: readlink d6/d9/db3/lba 0 2024-04-26T21:26:14.624 INFO:tasks.workunit.client.0.smithi084.stdout:5/867: rmdir d0/dc/df/d31/d53/d104 39 2024-04-26T21:26:14.626 INFO:tasks.workunit.client.0.smithi084.stdout:0/869: mknod de/d2b/d77/d32/d96/da0/c116 0 2024-04-26T21:26:14.631 INFO:tasks.workunit.client.0.smithi084.stdout:8/934: write d4/d6/db/d1e/d22/d2f/f2c [5225521,99791] 0 2024-04-26T21:26:14.633 INFO:tasks.workunit.client.0.smithi084.stdout:4/916: readlink d5/d7/d65/d90/d91/dba/dc2/ld3 0 2024-04-26T21:26:14.635 INFO:tasks.workunit.client.0.smithi084.stdout:7/983: fsync d6/d9/d12/d19/d20/d32/f144 0 2024-04-26T21:26:14.636 INFO:tasks.workunit.client.0.smithi084.stdout:0/870: truncate f0 5134642 0 2024-04-26T21:26:14.638 INFO:tasks.workunit.client.0.smithi084.stdout:5/868: unlink d0/dc/df/d31/d53/f83 0 2024-04-26T21:26:14.639 INFO:tasks.workunit.client.0.smithi084.stdout:9/865: dwrite da/f3a [0,4194304] 0 2024-04-26T21:26:14.641 INFO:tasks.workunit.client.0.smithi084.stdout:3/946: creat d1/d24/f15c x:0 0 0 2024-04-26T21:26:14.645 INFO:tasks.workunit.client.0.smithi084.stdout:1/890: dread d2/d54/d5e/d66/f18 [4194304,4194304] 0 2024-04-26T21:26:14.648 INFO:tasks.workunit.client.0.smithi084.stdout:1/891: dread - d2/d54/d5e/f11b zero size 2024-04-26T21:26:14.650 INFO:tasks.workunit.client.0.smithi084.stdout:0/871: mkdir de/d20/d4e/d117 0 2024-04-26T21:26:14.651 INFO:tasks.workunit.client.0.smithi084.stdout:9/866: rename da/l113 to da/dd5/d93/dc3/d41/d67/de9/d105/l141 0 2024-04-26T21:26:14.653 INFO:tasks.workunit.client.0.smithi084.stdout:4/917: mknod d5/d10/c12b 0 2024-04-26T21:26:14.655 INFO:tasks.workunit.client.0.smithi084.stdout:1/892: stat d2/d54/d5e/d66/d2a/dff/c100 0 2024-04-26T21:26:14.655 INFO:tasks.workunit.client.0.smithi084.stdout:3/947: creat d1/d2c/d2f/d31/dc7/d118/f15d x:0 0 0 2024-04-26T21:26:14.657 INFO:tasks.workunit.client.0.smithi084.stdout:8/935: dread d4/d3a/d8c/f95 [0,4194304] 0 2024-04-26T21:26:14.663 INFO:tasks.workunit.client.0.smithi084.stdout:5/869: truncate d0/dc/df/d75/fbe 749090 0 2024-04-26T21:26:14.663 INFO:tasks.workunit.client.0.smithi084.stdout:9/867: fsync da/dd5/d93/d95/f122 0 2024-04-26T21:26:14.663 INFO:tasks.workunit.client.0.smithi084.stdout:1/893: rmdir d2/d54/d5e 39 2024-04-26T21:26:14.666 INFO:tasks.workunit.client.0.smithi084.stdout:9/868: read - da/de/d1e/dc9/f133 zero size 2024-04-26T21:26:14.669 INFO:tasks.workunit.client.0.smithi084.stdout:4/918: creat d5/d10/f12c x:0 0 0 2024-04-26T21:26:14.672 INFO:tasks.workunit.client.0.smithi084.stdout:0/872: rename de/d2b/d77/d32/f3d to de/d2b/d77/f118 0 2024-04-26T21:26:14.674 INFO:tasks.workunit.client.0.smithi084.stdout:3/948: mknod d1/d2c/d2f/d31/d55/d4e/d7c/d7e/c15e 0 2024-04-26T21:26:14.676 INFO:tasks.workunit.client.0.smithi084.stdout:4/919: write d5/d7/d65/d90/d91/daa/f107 [696786,33197] 0 2024-04-26T21:26:14.677 INFO:tasks.workunit.client.0.smithi084.stdout:6/843: dread d3/de/d41/d5c/f97 [0,4194304] 0 2024-04-26T21:26:14.677 INFO:tasks.workunit.client.0.smithi084.stdout:8/936: rmdir d4/d6/db/d1e/db8 0 2024-04-26T21:26:14.679 INFO:tasks.workunit.client.0.smithi084.stdout:7/984: dwrite d6/d9/d12/d19/d20/d38/fa4 [0,4194304] 0 2024-04-26T21:26:14.680 INFO:tasks.workunit.client.0.smithi084.stdout:1/894: link d2/d1b/f65 d2/d54/d5e/d66/d2a/d72/d127/f129 0 2024-04-26T21:26:14.684 INFO:tasks.workunit.client.0.smithi084.stdout:9/869: getdents da/d9e 0 2024-04-26T21:26:14.688 INFO:tasks.workunit.client.0.smithi084.stdout:4/920: readlink d5/d25/d35/d60/d69/db2/lb3 0 2024-04-26T21:26:14.696 INFO:tasks.workunit.client.0.smithi084.stdout:3/949: truncate d1/d24/d27/d3a/ddb/df5/d11d/d150/f15b 409309 0 2024-04-26T21:26:14.698 INFO:tasks.workunit.client.0.smithi084.stdout:5/870: dread d0/dc/f14 [0,4194304] 0 2024-04-26T21:26:14.699 INFO:tasks.workunit.client.0.smithi084.stdout:7/985: rename d6/d68/l13f to d6/d68/d7f/dbe/l14a 0 2024-04-26T21:26:14.700 INFO:tasks.workunit.client.0.smithi084.stdout:4/921: symlink d5/d7/d65/d7f/db8/l12d 0 2024-04-26T21:26:14.702 INFO:tasks.workunit.client.0.smithi084.stdout:0/873: link de/d71/f88 de/d20/d4c/f119 0 2024-04-26T21:26:14.704 INFO:tasks.workunit.client.0.smithi084.stdout:6/844: getdents d3/de/d15/d23/d90 0 2024-04-26T21:26:14.706 INFO:tasks.workunit.client.0.smithi084.stdout:1/895: dread d2/d54/d5e/d66/d2a/d2c/f2d [0,4194304] 0 2024-04-26T21:26:14.707 INFO:tasks.workunit.client.0.smithi084.stdout:7/986: unlink d6/d1c/dd8/ff1 0 2024-04-26T21:26:14.710 INFO:tasks.workunit.client.0.smithi084.stdout:3/950: truncate d1/d2c/d2f/d31/d52/fa1 8312479 0 2024-04-26T21:26:14.711 INFO:tasks.workunit.client.0.smithi084.stdout:8/937: dwrite d4/d7/d15/fc6 [0,4194304] 0 2024-04-26T21:26:14.717 INFO:tasks.workunit.client.0.smithi084.stdout:7/987: chown d6/d9/d63/f7b 791079828 1 2024-04-26T21:26:14.717 INFO:tasks.workunit.client.0.smithi084.stdout:1/896: symlink d2/l12a 0 2024-04-26T21:26:14.718 INFO:tasks.workunit.client.0.smithi084.stdout:8/938: rmdir d4/d6/db/d1e/d22/d2f 39 2024-04-26T21:26:14.719 INFO:tasks.workunit.client.0.smithi084.stdout:5/871: getdents d0/dc/df/d31/d72 0 2024-04-26T21:26:14.721 INFO:tasks.workunit.client.0.smithi084.stdout:3/951: unlink d1/d24/d27/d3a/l72 0 2024-04-26T21:26:14.723 INFO:tasks.workunit.client.0.smithi084.stdout:6/845: write d3/de/d15/df/dae/df4/dfb/fd2 [1332377,19862] 0 2024-04-26T21:26:14.725 INFO:tasks.workunit.client.0.smithi084.stdout:7/988: write d6/d68/d7f/dcf/f102 [5043341,29269] 0 2024-04-26T21:26:14.726 INFO:tasks.workunit.client.0.smithi084.stdout:1/897: symlink d2/d54/d93/d110/d69/l12b 0 2024-04-26T21:26:14.730 INFO:tasks.workunit.client.0.smithi084.stdout:3/952: fsync d1/d2c/f90 0 2024-04-26T21:26:14.735 INFO:tasks.workunit.client.0.smithi084.stdout:7/989: mknod d6/d68/d7f/dcf/c14b 0 2024-04-26T21:26:14.739 INFO:tasks.workunit.client.0.smithi084.stdout:4/922: dwrite d5/fae [0,4194304] 0 2024-04-26T21:26:14.743 INFO:tasks.workunit.client.0.smithi084.stdout:0/874: dwrite de/d20/d4e/f93 [0,4194304] 0 2024-04-26T21:26:14.746 INFO:tasks.workunit.client.0.smithi084.stdout:3/953: symlink d1/dea/d12f/d12a/d158/l15f 0 2024-04-26T21:26:14.746 INFO:tasks.workunit.client.0.smithi084.stdout:1/898: write d2/d54/d5e/d66/d2a/d2c/d45/dc9/fdd [47492,13920] 0 2024-04-26T21:26:14.747 INFO:tasks.workunit.client.0.smithi084.stdout:7/990: chown d6/d68/d7f/d107/fa2 304388417 1 2024-04-26T21:26:14.752 INFO:tasks.workunit.client.0.smithi084.stdout:0/875: rmdir de/d2b/df3/d94/dcf 39 2024-04-26T21:26:14.756 INFO:tasks.workunit.client.0.smithi084.stdout:4/923: unlink d5/d10/d82/dd9/ce0 0 2024-04-26T21:26:14.756 INFO:tasks.workunit.client.0.smithi084.stdout:0/876: write de/d2b/d77/d32/d96/da0/ff7 [2750444,2327] 0 2024-04-26T21:26:14.760 INFO:tasks.workunit.client.0.smithi084.stdout:7/991: mknod d6/d9/d96/d106/c14c 0 2024-04-26T21:26:14.760 INFO:tasks.workunit.client.0.smithi084.stdout:1/899: dread d2/d19/f40 [0,4194304] 0 2024-04-26T21:26:14.766 INFO:tasks.workunit.client.0.smithi084.stdout:6/846: dread d3/de/d1a/d43/f48 [0,4194304] 0 2024-04-26T21:26:14.766 INFO:tasks.workunit.client.0.smithi084.stdout:4/924: creat d5/d25/d99/dc7/f12e x:0 0 0 2024-04-26T21:26:14.772 INFO:tasks.workunit.client.0.smithi084.stdout:0/877: creat de/d2b/d77/f11a x:0 0 0 2024-04-26T21:26:14.772 INFO:tasks.workunit.client.0.smithi084.stdout:4/925: readlink d5/d25/d35/d60/l74 0 2024-04-26T21:26:14.772 INFO:tasks.workunit.client.0.smithi084.stdout:7/992: chown d6/d9/d12/d19/d20/d38/d112/c127 4804078 1 2024-04-26T21:26:14.772 INFO:tasks.workunit.client.0.smithi084.stdout:6/847: creat d3/d18/f10c x:0 0 0 2024-04-26T21:26:14.777 INFO:tasks.workunit.client.0.smithi084.stdout:5/872: dread d0/d17/fc7 [0,4194304] 0 2024-04-26T21:26:14.783 INFO:tasks.workunit.client.0.smithi084.stdout:7/993: creat d6/d9/d96/d10d/f14d x:0 0 0 2024-04-26T21:26:14.786 INFO:tasks.workunit.client.0.smithi084.stdout:0/878: creat de/f11b x:0 0 0 2024-04-26T21:26:14.786 INFO:tasks.workunit.client.0.smithi084.stdout:4/926: link d5/f23 d5/d10/d82/f12f 0 2024-04-26T21:26:14.786 INFO:tasks.workunit.client.0.smithi084.stdout:1/900: dread d2/d54/d5e/d66/f18 [0,4194304] 0 2024-04-26T21:26:14.787 INFO:tasks.workunit.client.0.smithi084.stdout:6/848: symlink d3/de/d15/df/dae/ded/dee/l10d 0 2024-04-26T21:26:14.788 INFO:tasks.workunit.client.0.smithi084.stdout:4/927: readlink l4 0 2024-04-26T21:26:14.789 INFO:tasks.workunit.client.0.smithi084.stdout:3/954: dwrite d1/d2c/d2f/d31/d55/d4e/fcf [0,4194304] 0 2024-04-26T21:26:14.789 INFO:tasks.workunit.client.0.smithi084.stdout:7/994: mkdir d6/d9/d14e 0 2024-04-26T21:26:14.793 INFO:tasks.workunit.client.0.smithi084.stdout:1/901: symlink d2/d54/d93/d110/da0/l12c 0 2024-04-26T21:26:14.795 INFO:tasks.workunit.client.0.smithi084.stdout:0/879: rename de/d2b/l31 to de/d2b/d77/d68/l11c 0 2024-04-26T21:26:14.796 INFO:tasks.workunit.client.0.smithi084.stdout:6/849: write d3/de/d1a/d2f/d4c/ff9 [482236,96989] 0 2024-04-26T21:26:14.796 INFO:tasks.workunit.client.0.smithi084.stdout:4/928: getdents d5/d2e/d8d/d110 0 2024-04-26T21:26:14.796 INFO:tasks.workunit.client.0.smithi084.stdout:7/995: chown d6/d9/d63/f87 15 1 2024-04-26T21:26:14.797 INFO:tasks.workunit.client.0.smithi084.stdout:8/939: dread d4/f84 [0,4194304] 0 2024-04-26T21:26:14.800 INFO:tasks.workunit.client.0.smithi084.stdout:5/873: write d0/dc/df/d31/d72/d84/fd0 [3415050,8154] 0 2024-04-26T21:26:14.802 INFO:tasks.workunit.client.0.smithi084.stdout:3/955: rename d1/d2c/d2f/fbf to d1/d2c/d2f/d31/d55/d4e/d10c/f160 0 2024-04-26T21:26:14.805 INFO:tasks.workunit.client.0.smithi084.stdout:7/996: mkdir d6/d9/db3/d14f 0 2024-04-26T21:26:14.806 INFO:tasks.workunit.client.0.smithi084.stdout:1/902: creat d2/d9/d15/f12d x:0 0 0 2024-04-26T21:26:14.810 INFO:tasks.workunit.client.0.smithi084.stdout:7/997: mkdir d6/d9/d63/db5/d121/d150 0 2024-04-26T21:26:14.811 INFO:tasks.workunit.client.0.smithi084.stdout:1/903: chown d2/d54/d93/d110/d69 2350 1 2024-04-26T21:26:14.811 INFO:tasks.workunit.client.0.smithi084.stdout:4/929: rename d5/d7/c28 to d5/d7/d65/d7f/c130 0 2024-04-26T21:26:14.814 INFO:tasks.workunit.client.0.smithi084.stdout:3/956: creat d1/d2c/f161 x:0 0 0 2024-04-26T21:26:14.815 INFO:tasks.workunit.client.0.smithi084.stdout:4/930: read d5/d25/d35/f81 [264461,102190] 0 2024-04-26T21:26:14.816 INFO:tasks.workunit.client.0.smithi084.stdout:8/940: rename d4/d6/db/d9b/dd4 to d4/d3a/d8c/d118 0 2024-04-26T21:26:14.817 INFO:tasks.workunit.client.0.smithi084.stdout:7/998: write d6/d68/d7f/dcf/f102 [14935,49532] 0 2024-04-26T21:26:14.824 INFO:tasks.workunit.client.0.smithi084.stdout:5/874: rename d0/dc/df/d6d/l79 to d0/dc/df/d31/d72/d84/l113 0 2024-04-26T21:26:14.825 INFO:tasks.workunit.client.0.smithi084.stdout:8/941: mkdir d4/d6/db/d1e/d119 0 2024-04-26T21:26:14.827 INFO:tasks.workunit.client.0.smithi084.stdout:7/999: mknod d6/d9/d63/c151 0 2024-04-26T21:26:14.828 INFO:tasks.workunit.client.0.smithi084.stdout:5/875: dread - d0/dc/df/d31/d53/d87/ff2 zero size 2024-04-26T21:26:14.831 INFO:tasks.workunit.client.0.smithi084.stdout:1/904: rename d2/d54/d93/d110/d69/d9d/de0/lf6 to d2/d54/d93/d110/d69/l12e 0 2024-04-26T21:26:14.835 INFO:tasks.workunit.client.0.smithi084.stdout:3/957: write d1/f58 [595173,85471] 0 2024-04-26T21:26:14.837 INFO:tasks.workunit.client.0.smithi084.stdout:1/905: chown d2/d1b/c73 43 1 2024-04-26T21:26:14.840 INFO:tasks.workunit.client.0.smithi084.stdout:0/880: dread de/d2b/d77/d32/f6e [0,4194304] 0 2024-04-26T21:26:14.842 INFO:tasks.workunit.client.0.smithi084.stdout:6/850: dread d3/de/d9e/f103 [0,4194304] 0 2024-04-26T21:26:14.843 INFO:tasks.workunit.client.0.smithi084.stdout:4/931: rename d5/d25/d35/d60/d6d/dd0/dd8/fe4 to d5/d25/d35/d60/d6d/de1/f131 0 2024-04-26T21:26:14.855 INFO:tasks.workunit.client.0.smithi084.stdout:0/881: creat de/d78/d9e/f11d x:0 0 0 2024-04-26T21:26:14.859 INFO:tasks.workunit.client.0.smithi084.stdout:4/932: chown d5/d25/d35/d60/d69/f10e 229596 1 2024-04-26T21:26:14.862 INFO:tasks.workunit.client.0.smithi084.stdout:6/851: truncate d3/de/d15/df/dae/df4/dfb/f102 793218 0 2024-04-26T21:26:14.863 INFO:tasks.workunit.client.0.smithi084.stdout:4/933: write d5/d10/d82/f120 [161110,110218] 0 2024-04-26T21:26:14.870 INFO:tasks.workunit.client.0.smithi084.stdout:8/942: dwrite d4/d6/db/d9b/dca/fcf [4194304,4194304] 0 2024-04-26T21:26:14.870 INFO:tasks.workunit.client.0.smithi084.stdout:6/852: read d3/de/d15/df/dae/fb2 [3727793,9484] 0 2024-04-26T21:26:14.873 INFO:tasks.workunit.client.0.smithi084.stdout:6/853: readlink d3/de/d1a/d43/d75/dfa/lbb 0 2024-04-26T21:26:14.883 INFO:tasks.workunit.client.0.smithi084.stdout:1/906: truncate d2/d54/d5e/d66/d2a/d2c/d75/fcb 624400 0 2024-04-26T21:26:14.884 INFO:tasks.workunit.client.0.smithi084.stdout:0/882: creat de/d78/d9e/da1/dad/f11e x:0 0 0 2024-04-26T21:26:14.887 INFO:tasks.workunit.client.0.smithi084.stdout:6/854: creat d3/de/d1a/d43/d72/f10e x:0 0 0 2024-04-26T21:26:14.889 INFO:tasks.workunit.client.0.smithi084.stdout:4/934: unlink d5/d25/d35/d60/d6d/de1/c98 0 2024-04-26T21:26:14.891 INFO:tasks.workunit.client.0.smithi084.stdout:6/855: mknod d3/de/d1a/d2f/d4c/d58/c10f 0 2024-04-26T21:26:14.891 INFO:tasks.workunit.client.0.smithi084.stdout:4/935: write d5/d25/d99/da0/fa6 [6746538,49411] 0 2024-04-26T21:26:14.895 INFO:tasks.workunit.client.0.smithi084.stdout:4/936: stat d5/d25/d99/dc7/f12e 0 2024-04-26T21:26:14.898 INFO:tasks.workunit.client.0.smithi084.stdout:6/856: fdatasync d3/de/d15/d40/fb6 0 2024-04-26T21:26:14.905 INFO:tasks.workunit.client.0.smithi084.stdout:6/857: write d3/de/d1a/d2f/d4c/ff9 [102414,103991] 0 2024-04-26T21:26:14.908 INFO:tasks.workunit.client.0.smithi084.stdout:3/958: dread d1/f1d [0,4194304] 0 2024-04-26T21:26:14.910 INFO:tasks.workunit.client.0.smithi084.stdout:1/907: dwrite d2/d9/fcd [0,4194304] 0 2024-04-26T21:26:14.915 INFO:tasks.workunit.client.0.smithi084.stdout:1/908: chown d2/d54/d5e/dbe/fdb 884242 1 2024-04-26T21:26:14.923 INFO:tasks.workunit.client.0.smithi084.stdout:1/909: symlink d2/d19/d63/l12f 0 2024-04-26T21:26:14.926 INFO:tasks.workunit.client.0.smithi084.stdout:3/959: creat d1/d2c/d2f/d31/d55/da4/f162 x:0 0 0 2024-04-26T21:26:14.931 INFO:tasks.workunit.client.0.smithi084.stdout:1/910: rename d2/d54/d5e/d66/d2a/d2c/d75/lc5 to d2/d54/d5e/dbe/l130 0 2024-04-26T21:26:14.932 INFO:tasks.workunit.client.0.smithi084.stdout:3/960: symlink d1/d2c/d2f/d94/l163 0 2024-04-26T21:26:14.935 INFO:tasks.workunit.client.0.smithi084.stdout:3/961: symlink d1/d24/d11c/l164 0 2024-04-26T21:26:14.936 INFO:tasks.workunit.client.0.smithi084.stdout:1/911: dread - d2/d54/d5e/d66/d2a/d2c/d45/dc9/fee zero size 2024-04-26T21:26:14.939 INFO:tasks.workunit.client.0.smithi084.stdout:3/962: mknod d1/dea/d104/c165 0 2024-04-26T21:26:14.940 INFO:tasks.workunit.client.0.smithi084.stdout:1/912: unlink d2/d54/d93/d110/d47/f4b 0 2024-04-26T21:26:14.945 INFO:tasks.workunit.client.0.smithi084.stdout:3/963: chown d1/d2c/d2f/d31/d55/d4e/d7c/l122 99168008 1 2024-04-26T21:26:14.945 INFO:tasks.workunit.client.0.smithi084.stdout:1/913: dread d2/d19/dd2/feb [0,4194304] 0 2024-04-26T21:26:14.947 INFO:tasks.workunit.client.0.smithi084.stdout:8/943: write d4/d7/d15/d37/f68 [2185399,11839] 0 2024-04-26T21:26:14.950 INFO:tasks.workunit.client.0.smithi084.stdout:4/937: write d5/d25/d99/dc7/fc8 [1527361,37288] 0 2024-04-26T21:26:14.950 INFO:tasks.workunit.client.0.smithi084.stdout:0/883: write f9 [1841948,86171] 0 2024-04-26T21:26:14.953 INFO:tasks.workunit.client.0.smithi084.stdout:8/944: write d4/d7/d15/d3c/f83 [1555066,26265] 0 2024-04-26T21:26:14.956 INFO:tasks.workunit.client.0.smithi084.stdout:0/884: stat de/d2b/l2c 0 2024-04-26T21:26:14.957 INFO:tasks.workunit.client.0.smithi084.stdout:3/964: link d1/d2c/d2f/d31/da8/f116 d1/d24/d27/d3a/d81/f166 0 2024-04-26T21:26:14.965 INFO:tasks.workunit.client.0.smithi084.stdout:6/858: dwrite d3/d18/fc6 [0,4194304] 0 2024-04-26T21:26:14.968 INFO:tasks.workunit.client.0.smithi084.stdout:8/945: dread d4/d6/db/d1e/d22/d39/d4a/fb6 [0,4194304] 0 2024-04-26T21:26:14.978 INFO:tasks.workunit.client.0.smithi084.stdout:1/914: dwrite d2/d54/d5e/d66/d2a/f95 [0,4194304] 0 2024-04-26T21:26:14.981 INFO:tasks.workunit.client.0.smithi084.stdout:8/946: rmdir d4/d7/d15/d37/d52/d69 39 2024-04-26T21:26:14.990 INFO:tasks.workunit.client.0.smithi084.stdout:3/965: dwrite d1/d2c/d2f/fc9 [0,4194304] 0 2024-04-26T21:26:14.990 INFO:tasks.workunit.client.0.smithi084.stdout:4/938: dwrite d5/d10/ffe [0,4194304] 0 2024-04-26T21:26:14.992 INFO:tasks.workunit.client.0.smithi084.stdout:3/966: read d1/d2c/d2f/d31/d55/d4e/fcf [3625000,77231] 0 2024-04-26T21:26:15.001 INFO:tasks.workunit.client.0.smithi084.stdout:8/947: creat d4/d6/db/d9b/dca/f11a x:0 0 0 2024-04-26T21:26:15.002 INFO:tasks.workunit.client.0.smithi084.stdout:3/967: mknod d1/d2c/d2f/d31/d55/d4e/d7c/d7e/c167 0 2024-04-26T21:26:15.003 INFO:tasks.workunit.client.0.smithi084.stdout:0/885: dread de/d71/f88 [0,4194304] 0 2024-04-26T21:26:15.009 INFO:tasks.workunit.client.0.smithi084.stdout:4/939: mkdir d5/d25/d35/d60/d6d/dd0/d132 0 2024-04-26T21:26:15.013 INFO:tasks.workunit.client.0.smithi084.stdout:0/886: symlink de/d2b/d64/d81/l11f 0 2024-04-26T21:26:15.015 INFO:tasks.workunit.client.0.smithi084.stdout:3/968: dread - d1/d24/d27/d3a/d81/f97 zero size 2024-04-26T21:26:15.018 INFO:tasks.workunit.client.0.smithi084.stdout:8/948: truncate d4/d6/f6e 367084 0 2024-04-26T21:26:15.019 INFO:tasks.workunit.client.0.smithi084.stdout:0/887: write f9 [596169,126447] 0 2024-04-26T21:26:15.023 INFO:tasks.workunit.client.0.smithi084.stdout:1/915: dwrite d2/d9/f16 [0,4194304] 0 2024-04-26T21:26:15.025 INFO:tasks.workunit.client.0.smithi084.stdout:3/969: mknod d1/d24/d27/d3a/d81/c168 0 2024-04-26T21:26:15.027 INFO:tasks.workunit.client.0.smithi084.stdout:1/916: symlink d2/d54/d5e/dbe/l131 0 2024-04-26T21:26:15.034 INFO:tasks.workunit.client.0.smithi084.stdout:3/970: creat d1/d2c/d2f/d31/d55/d4e/d7c/db1/d129/d12d/f169 x:0 0 0 2024-04-26T21:26:15.034 INFO:tasks.workunit.client.0.smithi084.stdout:1/917: mknod d2/d54/d93/d110/c132 0 2024-04-26T21:26:15.037 INFO:tasks.workunit.client.0.smithi084.stdout:1/918: readlink d2/d19/d63/l11a 0 2024-04-26T21:26:15.039 INFO:tasks.workunit.client.0.smithi084.stdout:8/949: write d4/d6/db/fc5 [54075,15265] 0 2024-04-26T21:26:15.039 INFO:tasks.workunit.client.0.smithi084.stdout:6/859: dread d3/de/d41/d5c/de2/fdc [0,4194304] 0 2024-04-26T21:26:15.041 INFO:tasks.workunit.client.0.smithi084.stdout:8/950: chown d4/d6/db/lb2 316598 1 2024-04-26T21:26:15.041 INFO:tasks.workunit.client.0.smithi084.stdout:0/888: write de/d2b/f84 [1937393,122492] 0 2024-04-26T21:26:15.042 INFO:tasks.workunit.client.0.smithi084.stdout:0/889: stat de/df8 0 2024-04-26T21:26:15.043 INFO:tasks.workunit.client.0.smithi084.stdout:9/870: sync 2024-04-26T21:26:15.043 INFO:tasks.workunit.client.0.smithi084.stdout:3/971: getdents d1/d24/d27/d3a/ddb/df5 0 2024-04-26T21:26:15.046 INFO:tasks.workunit.client.0.smithi084.stdout:8/951: creat d4/d7/f11b x:0 0 0 2024-04-26T21:26:15.049 INFO:tasks.workunit.client.0.smithi084.stdout:3/972: chown d1/d2c/d2f/d31/d55/d4e/d98 7629421 1 2024-04-26T21:26:15.049 INFO:tasks.workunit.client.0.smithi084.stdout:9/871: rename da/de/c32 to da/de/d16/d40/c142 0 2024-04-26T21:26:15.052 INFO:tasks.workunit.client.0.smithi084.stdout:8/952: unlink d4/d6/f47 0 2024-04-26T21:26:15.053 INFO:tasks.workunit.client.0.smithi084.stdout:1/919: write d2/d54/d5e/d66/d3a/ff0 [2300358,96879] 0 2024-04-26T21:26:15.055 INFO:tasks.workunit.client.0.smithi084.stdout:1/920: readlink d2/d54/d5e/dbe/l131 0 2024-04-26T21:26:15.056 INFO:tasks.workunit.client.0.smithi084.stdout:9/872: symlink da/dd5/d93/dc3/l143 0 2024-04-26T21:26:15.057 INFO:tasks.workunit.client.0.smithi084.stdout:4/940: dread d5/fbc [0,4194304] 0 2024-04-26T21:26:15.058 INFO:tasks.workunit.client.0.smithi084.stdout:3/973: fsync d1/d24/d27/d3a/ddb/d103/f109 0 2024-04-26T21:26:15.059 INFO:tasks.workunit.client.0.smithi084.stdout:0/890: getdents de/d2b/d77/d32/d96/dbe 0 2024-04-26T21:26:15.060 INFO:tasks.workunit.client.0.smithi084.stdout:8/953: creat d4/d6/f11c x:0 0 0 2024-04-26T21:26:15.062 INFO:tasks.workunit.client.0.smithi084.stdout:0/891: readlink de/d2b/d77/d68/l92 0 2024-04-26T21:26:15.118 INFO:tasks.workunit.client.0.smithi084.stdout:5/876: sync 2024-04-26T21:26:15.122 INFO:tasks.workunit.client.0.smithi084.stdout:6/860: dwrite d3/de/d1a/fb0 [0,4194304] 0 2024-04-26T21:26:15.123 INFO:tasks.workunit.client.0.smithi084.stdout:8/954: creat d4/d7/f11d x:0 0 0 2024-04-26T21:26:15.123 INFO:tasks.workunit.client.0.smithi084.stdout:0/892: truncate f9 3747194 0 2024-04-26T21:26:15.127 INFO:tasks.workunit.client.0.smithi084.stdout:9/873: rename da/de/d1e/dc9/fdc to da/dd5/d93/f144 0 2024-04-26T21:26:15.128 INFO:tasks.workunit.client.0.smithi084.stdout:4/941: link d5/d10/d15/l11a d5/d10/d15/d101/l133 0 2024-04-26T21:26:15.128 INFO:tasks.workunit.client.0.smithi084.stdout:8/955: chown d4/d6/db/d9b/ldf 209455 1 2024-04-26T21:26:15.135 INFO:tasks.workunit.client.0.smithi084.stdout:0/893: chown de/d2b/df3/d63/da7/cdc 580927 1 2024-04-26T21:26:15.139 INFO:tasks.workunit.client.0.smithi084.stdout:3/974: dwrite d1/d24/d27/f2b [0,4194304] 0 2024-04-26T21:26:15.139 INFO:tasks.workunit.client.0.smithi084.stdout:5/877: creat d0/dc/d48/de9/d10a/f114 x:0 0 0 2024-04-26T21:26:15.141 INFO:tasks.workunit.client.0.smithi084.stdout:5/878: fdatasync d0/d49/f95 0 2024-04-26T21:26:15.141 INFO:tasks.workunit.client.0.smithi084.stdout:3/975: chown d1/d2c/d2f/fc9 469546 1 2024-04-26T21:26:15.145 INFO:tasks.workunit.client.0.smithi084.stdout:6/861: dread d3/de/d1a/d43/ff0 [0,4194304] 0 2024-04-26T21:26:15.147 INFO:tasks.workunit.client.0.smithi084.stdout:0/894: creat de/d20/d4c/dae/dc2/f120 x:0 0 0 2024-04-26T21:26:15.151 INFO:tasks.workunit.client.0.smithi084.stdout:5/879: mknod d0/df5/c115 0 2024-04-26T21:26:15.156 INFO:tasks.workunit.client.0.smithi084.stdout:4/942: dread d5/d7/d65/d7f/fd5 [0,4194304] 0 2024-04-26T21:26:15.161 INFO:tasks.workunit.client.0.smithi084.stdout:4/943: dread d5/d7/d65/d90/d91/dba/dc2/f106 [0,4194304] 0 2024-04-26T21:26:15.161 INFO:tasks.workunit.client.0.smithi084.stdout:0/895: creat de/d20/d4c/dae/dc2/f121 x:0 0 0 2024-04-26T21:26:15.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:14 smithi084 ceph-mon[25539]: pgmap v52: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 114 MiB/s rd, 257 MiB/s wr, 592 op/s 2024-04-26T21:26:15.163 INFO:tasks.workunit.client.0.smithi084.stdout:4/944: write d5/d25/d99/da0/fc0 [3902388,44704] 0 2024-04-26T21:26:15.166 INFO:tasks.workunit.client.0.smithi084.stdout:4/945: write d5/d10/d82/fe8 [1068942,102185] 0 2024-04-26T21:26:15.169 INFO:tasks.workunit.client.0.smithi084.stdout:4/946: write d5/d25/d35/d60/d6d/de1/dd7/f117 [964588,44368] 0 2024-04-26T21:26:15.175 INFO:tasks.workunit.client.0.smithi084.stdout:9/874: truncate da/dd5/d93/dc3/d41/d67/f86 2648364 0 2024-04-26T21:26:15.176 INFO:tasks.workunit.client.0.smithi084.stdout:8/956: write d4/d7/d15/d37/d52/d69/fce [413938,33330] 0 2024-04-26T21:26:15.177 INFO:tasks.workunit.client.0.smithi084.stdout:5/880: creat d0/dc/df/d31/f116 x:0 0 0 2024-04-26T21:26:15.182 INFO:tasks.workunit.client.0.smithi084.stdout:9/875: rmdir da/dd5/d93/dc3/d41/d67 39 2024-04-26T21:26:15.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:14 smithi120 ceph-mon[32741]: pgmap v52: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 114 MiB/s rd, 257 MiB/s wr, 592 op/s 2024-04-26T21:26:15.189 INFO:tasks.workunit.client.0.smithi084.stdout:5/881: fsync d0/da2/f110 0 2024-04-26T21:26:15.189 INFO:tasks.workunit.client.0.smithi084.stdout:4/947: truncate d5/d25/d35/f8f 775759 0 2024-04-26T21:26:15.195 INFO:tasks.workunit.client.0.smithi084.stdout:8/957: rename d4/d7/d15/f30 to d4/d6/db/d1e/d22/f11e 0 2024-04-26T21:26:15.198 INFO:tasks.workunit.client.0.smithi084.stdout:0/896: dwrite de/d2b/df3/d94/dcf/fdd [0,4194304] 0 2024-04-26T21:26:15.199 INFO:tasks.workunit.client.0.smithi084.stdout:9/876: truncate da/dd5/d93/dc3/d41/d43/d80/fc7 24737 0 2024-04-26T21:26:15.199 INFO:tasks.workunit.client.0.smithi084.stdout:9/877: readlink l8 0 2024-04-26T21:26:15.207 INFO:tasks.workunit.client.0.smithi084.stdout:4/948: rename d5/d7/d65/d7f/l85 to d5/d25/d121/l134 0 2024-04-26T21:26:15.211 INFO:tasks.workunit.client.0.smithi084.stdout:8/958: creat d4/d6/db/f11f x:0 0 0 2024-04-26T21:26:15.212 INFO:tasks.workunit.client.0.smithi084.stdout:5/882: write d0/dc/d48/de9/f90 [1257887,39209] 0 2024-04-26T21:26:15.218 INFO:tasks.workunit.client.0.smithi084.stdout:8/959: getdents d4/d7/d15/d37/d3b/d111 0 2024-04-26T21:26:15.219 INFO:tasks.workunit.client.0.smithi084.stdout:0/897: dwrite de/fec [0,4194304] 0 2024-04-26T21:26:15.221 INFO:tasks.workunit.client.0.smithi084.stdout:5/883: getdents d0/d49/d56/de5 0 2024-04-26T21:26:15.222 INFO:tasks.workunit.client.0.smithi084.stdout:0/898: chown de/d20/d4c 20438 1 2024-04-26T21:26:15.226 INFO:tasks.workunit.client.0.smithi084.stdout:8/960: mkdir d4/d6/db/d120 0 2024-04-26T21:26:15.228 INFO:tasks.workunit.client.0.smithi084.stdout:5/884: mknod d0/dc/df/d31/d45/c117 0 2024-04-26T21:26:15.232 INFO:tasks.workunit.client.0.smithi084.stdout:4/949: dwrite d5/d7/d65/d7f/f118 [0,4194304] 0 2024-04-26T21:26:15.235 INFO:tasks.workunit.client.0.smithi084.stdout:0/899: rename de/d20/d4c/caa to de/d2b/d77/d32/c122 0 2024-04-26T21:26:15.237 INFO:tasks.workunit.client.0.smithi084.stdout:4/950: write d5/d10/d15/d21/f7b [2905158,31247] 0 2024-04-26T21:26:15.239 INFO:tasks.workunit.client.0.smithi084.stdout:9/878: dread da/de/d1e/f74 [4194304,4194304] 0 2024-04-26T21:26:15.241 INFO:tasks.workunit.client.0.smithi084.stdout:8/961: dread d4/d7/d15/d37/d52/d69/fce [0,4194304] 0 2024-04-26T21:26:15.246 INFO:tasks.workunit.client.0.smithi084.stdout:9/879: rmdir da/dd5/d93/dc3/d4f/d114 0 2024-04-26T21:26:15.250 INFO:tasks.workunit.client.0.smithi084.stdout:9/880: mknod da/de/d16/d40/c145 0 2024-04-26T21:26:15.257 INFO:tasks.workunit.client.0.smithi084.stdout:9/881: write da/de/d1e/d56/da6/de6/f123 [810182,108141] 0 2024-04-26T21:26:15.260 INFO:tasks.workunit.client.0.smithi084.stdout:4/951: dwrite d5/d25/d99/da0/f103 [0,4194304] 0 2024-04-26T21:26:15.265 INFO:tasks.workunit.client.0.smithi084.stdout:8/962: dwrite d4/d7/d15/d37/f68 [4194304,4194304] 0 2024-04-26T21:26:15.265 INFO:tasks.workunit.client.0.smithi084.stdout:9/882: mkdir da/dd5/d93/dc3/d146 0 2024-04-26T21:26:15.266 INFO:tasks.workunit.client.0.smithi084.stdout:5/885: dread d0/dc/df/d6d/f70 [0,4194304] 0 2024-04-26T21:26:15.270 INFO:tasks.workunit.client.0.smithi084.stdout:0/900: dwrite de/d20/d4c/dae/dc2/ffd [0,4194304] 0 2024-04-26T21:26:15.271 INFO:tasks.workunit.client.0.smithi084.stdout:0/901: chown de/f21 1340 1 2024-04-26T21:26:15.277 INFO:tasks.workunit.client.0.smithi084.stdout:8/963: symlink d4/d6/db/d1e/d22/d39/l121 0 2024-04-26T21:26:15.281 INFO:tasks.workunit.client.0.smithi084.stdout:5/886: unlink d0/d17/fcc 0 2024-04-26T21:26:15.282 INFO:tasks.workunit.client.0.smithi084.stdout:4/952: getdents d5/d25/d35/d60/d6d/de1/d32 0 2024-04-26T21:26:15.283 INFO:tasks.workunit.client.0.smithi084.stdout:9/883: chown da/dd5/d93/dc3/d41/d8d/dca/lf4 641481 1 2024-04-26T21:26:15.284 INFO:tasks.workunit.client.0.smithi084.stdout:0/902: creat de/f123 x:0 0 0 2024-04-26T21:26:15.285 INFO:tasks.workunit.client.0.smithi084.stdout:5/887: truncate d0/dc/fd5 516076 0 2024-04-26T21:26:15.286 INFO:tasks.workunit.client.0.smithi084.stdout:4/953: mknod d5/d25/d35/d60/d6d/de1/d32/c135 0 2024-04-26T21:26:15.287 INFO:tasks.workunit.client.0.smithi084.stdout:0/903: write de/d2b/d77/d32/f69 [380499,11057] 0 2024-04-26T21:26:15.288 INFO:tasks.workunit.client.0.smithi084.stdout:9/884: mknod da/dd5/d93/dc3/d41/d43/dba/c147 0 2024-04-26T21:26:15.289 INFO:tasks.workunit.client.0.smithi084.stdout:9/885: fdatasync da/f3a 0 2024-04-26T21:26:15.290 INFO:tasks.workunit.client.0.smithi084.stdout:5/888: symlink d0/d17/l118 0 2024-04-26T21:26:15.291 INFO:tasks.workunit.client.0.smithi084.stdout:4/954: write d5/d25/d35/d60/d69/db2/f11d [2755464,63719] 0 2024-04-26T21:26:15.294 INFO:tasks.workunit.client.0.smithi084.stdout:0/904: creat de/d2b/d77/d68/f124 x:0 0 0 2024-04-26T21:26:15.295 INFO:tasks.workunit.client.0.smithi084.stdout:4/955: dread - d5/d25/f10a zero size 2024-04-26T21:26:15.296 INFO:tasks.workunit.client.0.smithi084.stdout:9/886: creat da/de/f148 x:0 0 0 2024-04-26T21:26:15.300 INFO:tasks.workunit.client.0.smithi084.stdout:5/889: dread d0/dc/df/d6d/fe2 [0,4194304] 0 2024-04-26T21:26:15.300 INFO:tasks.workunit.client.0.smithi084.stdout:9/887: mknod da/dd5/d93/dc3/d41/dab/c149 0 2024-04-26T21:26:15.310 INFO:tasks.workunit.client.0.smithi084.stdout:5/890: link d0/dc/df/d31/d53/f100 d0/dc/df/d31/d53/d104/f119 0 2024-04-26T21:26:15.312 INFO:tasks.workunit.client.0.smithi084.stdout:5/891: fdatasync d0/dc/df/d31/d53/f109 0 2024-04-26T21:26:15.313 INFO:tasks.workunit.client.0.smithi084.stdout:9/888: link da/ld1 da/de/d1e/d56/da6/de6/d11d/l14a 0 2024-04-26T21:26:15.319 INFO:tasks.workunit.client.0.smithi084.stdout:0/905: dwrite de/d2b/d77/d68/f95 [0,4194304] 0 2024-04-26T21:26:15.319 INFO:tasks.workunit.client.0.smithi084.stdout:5/892: rename d0/dc/df/d75/fb0 to d0/dc/df/d31/d45/f11a 0 2024-04-26T21:26:15.321 INFO:tasks.workunit.client.0.smithi084.stdout:4/956: dwrite d5/d7/d65/d7f/db8/f7e [0,4194304] 0 2024-04-26T21:26:15.324 INFO:tasks.workunit.client.0.smithi084.stdout:5/893: truncate d0/dc/df/ff6 131769 0 2024-04-26T21:26:15.324 INFO:tasks.workunit.client.0.smithi084.stdout:4/957: fsync d5/d25/d35/d60/d69/f114 0 2024-04-26T21:26:15.325 INFO:tasks.workunit.client.0.smithi084.stdout:9/889: rename da/dd5/d93/dc3/d4f/f59 to da/dd5/f14b 0 2024-04-26T21:26:15.329 INFO:tasks.workunit.client.0.smithi084.stdout:0/906: fdatasync de/d20/d4e/f75 0 2024-04-26T21:26:15.329 INFO:tasks.workunit.client.0.smithi084.stdout:4/958: write d5/d25/d99/da0/fe6 [4382383,129419] 0 2024-04-26T21:26:15.330 INFO:tasks.workunit.client.0.smithi084.stdout:5/894: rmdir d0/dc/df/d6d 39 2024-04-26T21:26:15.333 INFO:tasks.workunit.client.0.smithi084.stdout:0/907: fsync de/d2b/d64/d81/f89 0 2024-04-26T21:26:15.336 INFO:tasks.workunit.client.0.smithi084.stdout:9/890: mkdir da/dd5/d93/dc3/d41/d67/de9/d14c 0 2024-04-26T21:26:15.338 INFO:tasks.workunit.client.0.smithi084.stdout:4/959: mkdir d5/d2e/d136 0 2024-04-26T21:26:15.344 INFO:tasks.workunit.client.0.smithi084.stdout:5/895: symlink d0/dc/df/d31/d53/d5d/l11b 0 2024-04-26T21:26:15.344 INFO:tasks.workunit.client.0.smithi084.stdout:4/960: fdatasync d5/d25/d35/d60/d6d/de1/d32/d46/f5c 0 2024-04-26T21:26:15.346 INFO:tasks.workunit.client.0.smithi084.stdout:9/891: mkdir da/dd5/d93/dc3/d41/d43/d14d 0 2024-04-26T21:26:15.348 INFO:tasks.workunit.client.0.smithi084.stdout:4/961: unlink d5/d25/d35/d60/c94 0 2024-04-26T21:26:15.349 INFO:tasks.workunit.client.0.smithi084.stdout:5/896: rename d0/lfe to d0/dc/d48/de9/d10a/l11c 0 2024-04-26T21:26:15.352 INFO:tasks.workunit.client.0.smithi084.stdout:4/962: link d5/f4c d5/d7/d65/d7f/db8/f137 0 2024-04-26T21:26:15.354 INFO:tasks.workunit.client.0.smithi084.stdout:4/963: mkdir d5/d25/d99/dac/d138 0 2024-04-26T21:26:15.356 INFO:tasks.workunit.client.0.smithi084.stdout:4/964: mknod d5/d25/d68/c139 0 2024-04-26T21:26:15.357 INFO:tasks.workunit.client.0.smithi084.stdout:4/965: chown d5/d25/d68/c139 4063 1 2024-04-26T21:26:15.365 INFO:tasks.workunit.client.0.smithi084.stdout:0/908: dwrite de/d20/d4c/fb7 [0,4194304] 0 2024-04-26T21:26:15.369 INFO:tasks.workunit.client.0.smithi084.stdout:0/909: creat de/d2b/d64/d81/f125 x:0 0 0 2024-04-26T21:26:15.377 INFO:tasks.workunit.client.0.smithi084.stdout:0/910: write de/d2b/df3/d94/fc6 [1381320,84888] 0 2024-04-26T21:26:15.379 INFO:tasks.workunit.client.0.smithi084.stdout:0/911: chown f0 171 1 2024-04-26T21:26:15.383 INFO:tasks.workunit.client.0.smithi084.stdout:0/912: rename de/d71 to de/d20/d4e/d100/d126 0 2024-04-26T21:26:15.385 INFO:tasks.workunit.client.0.smithi084.stdout:4/966: dread d5/d7/d65/d90/d91/f108 [0,4194304] 0 2024-04-26T21:26:15.386 INFO:tasks.workunit.client.0.smithi084.stdout:0/913: chown de/d2b/d77/l104 372400894 1 2024-04-26T21:26:15.387 INFO:tasks.workunit.client.0.smithi084.stdout:4/967: mknod d5/d7/c13a 0 2024-04-26T21:26:15.388 INFO:tasks.workunit.client.0.smithi084.stdout:0/914: symlink de/d20/d4c/l127 0 2024-04-26T21:26:15.389 INFO:tasks.workunit.client.0.smithi084.stdout:0/915: chown de/d2b/f39 261080 1 2024-04-26T21:26:15.391 INFO:tasks.workunit.client.0.smithi084.stdout:4/968: rename d5/d2e to d5/d25/d35/d60/d69/db2/d13b 0 2024-04-26T21:26:15.392 INFO:tasks.workunit.client.0.smithi084.stdout:0/916: symlink de/d78/d9e/da4/dea/l128 0 2024-04-26T21:26:15.394 INFO:tasks.workunit.client.0.smithi084.stdout:4/969: symlink d5/d25/d99/dac/d138/l13c 0 2024-04-26T21:26:15.399 INFO:tasks.workunit.client.0.smithi084.stdout:4/970: truncate d5/d7/d65/d7f/fa2 434804 0 2024-04-26T21:26:15.400 INFO:tasks.workunit.client.0.smithi084.stdout:0/917: getdents de/d20/d4c 0 2024-04-26T21:26:15.401 INFO:tasks.workunit.client.0.smithi084.stdout:4/971: fdatasync d5/d25/f79 0 2024-04-26T21:26:15.404 INFO:tasks.workunit.client.0.smithi084.stdout:4/972: symlink d5/d25/d35/l13d 0 2024-04-26T21:26:15.408 INFO:tasks.workunit.client.0.smithi084.stdout:4/973: write d5/d10/da1/fbb [920225,84023] 0 2024-04-26T21:26:15.410 INFO:tasks.workunit.client.0.smithi084.stdout:0/918: truncate de/d2b/df3/f59 4041360 0 2024-04-26T21:26:15.413 INFO:tasks.workunit.client.0.smithi084.stdout:4/974: creat d5/d25/d35/d60/d69/db2/d13b/d8d/d110/f13e x:0 0 0 2024-04-26T21:26:15.417 INFO:tasks.workunit.client.0.smithi084.stdout:4/975: fsync d5/d7/d65/d90/d91/daa/ff3 0 2024-04-26T21:26:15.422 INFO:tasks.workunit.client.0.smithi084.stdout:4/976: mkdir d5/d25/d99/dac/d13f 0 2024-04-26T21:26:15.426 INFO:tasks.workunit.client.0.smithi084.stdout:4/977: truncate d5/d10/f18 5280362 0 2024-04-26T21:26:15.427 INFO:tasks.workunit.client.0.smithi084.stdout:4/978: stat d5/d25/d35/d60/d69/db2/l125 0 2024-04-26T21:26:15.430 INFO:tasks.workunit.client.0.smithi084.stdout:4/979: truncate d5/d7/f63 295673 0 2024-04-26T21:26:15.430 INFO:tasks.workunit.client.0.smithi084.stdout:0/919: dread de/d20/f24 [0,4194304] 0 2024-04-26T21:26:15.442 INFO:tasks.workunit.client.0.smithi084.stdout:4/980: dwrite d5/d25/d99/dc7/fc8 [0,4194304] 0 2024-04-26T21:26:15.446 INFO:tasks.workunit.client.0.smithi084.stdout:4/981: rmdir d5/d25/d99/da0 39 2024-04-26T21:26:15.451 INFO:tasks.workunit.client.0.smithi084.stdout:4/982: unlink d5/d7/d65/d7f/db8/cfc 0 2024-04-26T21:26:15.456 INFO:tasks.workunit.client.0.smithi084.stdout:4/983: unlink d5/d25/f3e 0 2024-04-26T21:26:15.469 INFO:tasks.workunit.client.0.smithi084.stdout:4/984: dwrite d5/d25/d99/dc7/f116 [0,4194304] 0 2024-04-26T21:26:15.472 INFO:tasks.workunit.client.0.smithi084.stdout:4/985: fsync d5/d7/d65/d90/d91/dba/f127 0 2024-04-26T21:26:15.481 INFO:tasks.workunit.client.0.smithi084.stdout:4/986: rename d5/d7/d65/d90/d91/dba/dc2/ld3 to d5/d25/d99/l140 0 2024-04-26T21:26:15.491 INFO:tasks.workunit.client.0.smithi084.stdout:4/987: dread d5/d7/d65/d7f/f118 [0,4194304] 0 2024-04-26T21:26:15.494 INFO:tasks.workunit.client.0.smithi084.stdout:4/988: mkdir d5/d25/d35/d97/d141 0 2024-04-26T21:26:15.498 INFO:tasks.workunit.client.0.smithi084.stdout:4/989: mkdir d5/d25/d35/d60/d6d/dd0/dd8/d142 0 2024-04-26T21:26:15.500 INFO:tasks.workunit.client.0.smithi084.stdout:4/990: chown d5/f2b 2 1 2024-04-26T21:26:15.505 INFO:tasks.workunit.client.0.smithi084.stdout:4/991: unlink d5/d10/d82/fe8 0 2024-04-26T21:26:15.506 INFO:tasks.workunit.client.0.smithi084.stdout:4/992: chown d5/d10/da1/cde 1624 1 2024-04-26T21:26:15.509 INFO:tasks.workunit.client.0.smithi084.stdout:4/993: creat d5/d25/d35/d60/f143 x:0 0 0 2024-04-26T21:26:15.528 INFO:tasks.workunit.client.0.smithi084.stdout:4/994: dwrite d5/d25/d35/d60/d6d/de1/fc3 [0,4194304] 0 2024-04-26T21:26:15.546 INFO:tasks.workunit.client.0.smithi084.stdout:4/995: dwrite d5/d7/d65/f10b [0,4194304] 0 2024-04-26T21:26:15.555 INFO:tasks.workunit.client.0.smithi084.stdout:4/996: creat d5/d25/f144 x:0 0 0 2024-04-26T21:26:15.558 INFO:tasks.workunit.client.0.smithi084.stdout:4/997: write d5/d7/d65/d7f/db8/f7e [2966578,76440] 0 2024-04-26T21:26:15.562 INFO:tasks.workunit.client.0.smithi084.stdout:4/998: mknod d5/d25/d35/d60/d6d/dd0/c145 0 2024-04-26T21:26:15.563 INFO:tasks.workunit.client.0.smithi084.stdout:1/921: sync 2024-04-26T21:26:15.570 INFO:tasks.workunit.client.0.smithi084.stdout:4/999: rename d5/d25/d35/d60/d6d/de1/d32/f34 to d5/d25/d121/f146 0 2024-04-26T21:26:15.577 INFO:tasks.workunit.client.0.smithi084.stdout:1/922: dread d2/d9/f16 [0,4194304] 0 2024-04-26T21:26:15.585 INFO:tasks.workunit.client.0.smithi084.stdout:1/923: truncate d2/d54/d5e/d66/d2a/d72/d127/f129 1525161 0 2024-04-26T21:26:15.604 INFO:tasks.workunit.client.0.smithi084.stdout:1/924: dwrite d2/d54/d5e/f11b [0,4194304] 0 2024-04-26T21:26:15.619 INFO:tasks.workunit.client.0.smithi084.stdout:1/925: write d2/d19/d63/f96 [313517,72638] 0 2024-04-26T21:26:15.623 INFO:tasks.workunit.client.0.smithi084.stdout:1/926: symlink d2/d9/d15/d9f/d113/l133 0 2024-04-26T21:26:15.626 INFO:tasks.workunit.client.0.smithi084.stdout:1/927: symlink d2/d19/dd2/l134 0 2024-04-26T21:26:15.632 INFO:tasks.workunit.client.0.smithi084.stdout:1/928: creat d2/d54/d5e/d66/d2a/d2c/f135 x:0 0 0 2024-04-26T21:26:15.636 INFO:tasks.workunit.client.0.smithi084.stdout:1/929: fdatasync d2/d54/d5e/d66/d2a/f7c 0 2024-04-26T21:26:15.644 INFO:tasks.workunit.client.0.smithi084.stdout:1/930: link d2/d1b/c73 d2/d54/d5e/d66/d2a/d2c/d45/c136 0 2024-04-26T21:26:15.645 INFO:tasks.workunit.client.0.smithi084.stdout:3/976: sync 2024-04-26T21:26:15.645 INFO:tasks.workunit.client.0.smithi084.stdout:6/862: sync 2024-04-26T21:26:15.648 INFO:tasks.workunit.client.0.smithi084.stdout:6/863: chown d3/de/d41/d5c/f8f 30341 1 2024-04-26T21:26:15.650 INFO:tasks.workunit.client.0.smithi084.stdout:6/864: stat d3/de/d1a/d2f 0 2024-04-26T21:26:15.652 INFO:tasks.workunit.client.0.smithi084.stdout:3/977: getdents d1/dea 0 2024-04-26T21:26:15.660 INFO:tasks.workunit.client.0.smithi084.stdout:6/865: getdents d3/de/d15/df/dae/df4/dd3 0 2024-04-26T21:26:15.662 INFO:tasks.workunit.client.0.smithi084.stdout:3/978: getdents d1/d2c/d2f/d31/dc7 0 2024-04-26T21:26:15.667 INFO:tasks.workunit.client.0.smithi084.stdout:1/931: dread d2/f56 [0,4194304] 0 2024-04-26T21:26:15.669 INFO:tasks.workunit.client.0.smithi084.stdout:6/866: write d3/de/d1a/d43/f48 [679161,64821] 0 2024-04-26T21:26:15.670 INFO:tasks.workunit.client.0.smithi084.stdout:1/932: write d2/d19/dd2/de7/f10f [1036246,115272] 0 2024-04-26T21:26:15.673 INFO:tasks.workunit.client.0.smithi084.stdout:6/867: mkdir d3/d18/d37/d110 0 2024-04-26T21:26:15.675 INFO:tasks.workunit.client.0.smithi084.stdout:3/979: truncate d1/d24/d27/d3a/fa7 2607697 0 2024-04-26T21:26:15.678 INFO:tasks.workunit.client.0.smithi084.stdout:6/868: truncate d3/de/d15/d23/f68 1257236 0 2024-04-26T21:26:15.680 INFO:tasks.workunit.client.0.smithi084.stdout:6/869: chown d3/d18/l54 152465800 1 2024-04-26T21:26:15.690 INFO:tasks.workunit.client.0.smithi084.stdout:1/933: dwrite d2/d54/d5e/dbe/fe9 [0,4194304] 0 2024-04-26T21:26:15.697 INFO:tasks.workunit.client.0.smithi084.stdout:1/934: creat d2/f137 x:0 0 0 2024-04-26T21:26:15.701 INFO:tasks.workunit.client.0.smithi084.stdout:1/935: symlink d2/d54/d93/d110/d5a/l138 0 2024-04-26T21:26:15.705 INFO:tasks.workunit.client.0.smithi084.stdout:3/980: dread d1/d2c/d2f/d31/f11e [0,4194304] 0 2024-04-26T21:26:15.707 INFO:tasks.workunit.client.0.smithi084.stdout:1/936: creat d2/d54/d5e/d66/d2a/d72/d127/f139 x:0 0 0 2024-04-26T21:26:15.710 INFO:tasks.workunit.client.0.smithi084.stdout:1/937: write d2/f10e [571827,9416] 0 2024-04-26T21:26:15.713 INFO:tasks.workunit.client.0.smithi084.stdout:9/892: sync 2024-04-26T21:26:15.713 INFO:tasks.workunit.client.0.smithi084.stdout:0/920: sync 2024-04-26T21:26:15.713 INFO:tasks.workunit.client.0.smithi084.stdout:5/897: sync 2024-04-26T21:26:15.713 INFO:tasks.workunit.client.0.smithi084.stdout:8/964: sync 2024-04-26T21:26:15.715 INFO:tasks.workunit.client.0.smithi084.stdout:6/870: dread d3/de/d15/df/f1b [0,4194304] 0 2024-04-26T21:26:15.718 INFO:tasks.workunit.client.0.smithi084.stdout:8/965: dread - d4/d6/db/d1e/d22/d39/f10c zero size 2024-04-26T21:26:15.719 INFO:tasks.workunit.client.0.smithi084.stdout:9/893: fsync da/de/f3d 0 2024-04-26T21:26:15.725 INFO:tasks.workunit.client.0.smithi084.stdout:0/921: dread de/d78/d9e/da1/dad/ffb [0,4194304] 0 2024-04-26T21:26:15.730 INFO:tasks.workunit.client.0.smithi084.stdout:3/981: dread d1/d2c/d2f/d31/d55/f66 [0,4194304] 0 2024-04-26T21:26:15.730 INFO:tasks.workunit.client.0.smithi084.stdout:9/894: unlink da/f19 0 2024-04-26T21:26:15.731 INFO:tasks.workunit.client.0.smithi084.stdout:5/898: link d0/dc/df/d31/d63/fc6 d0/dc/df/d51/d10c/f11d 0 2024-04-26T21:26:15.731 INFO:tasks.workunit.client.0.smithi084.stdout:8/966: dread d4/f7a [0,4194304] 0 2024-04-26T21:26:15.732 INFO:tasks.workunit.client.0.smithi084.stdout:6/871: dread d3/de/d15/f85 [0,4194304] 0 2024-04-26T21:26:15.732 INFO:tasks.workunit.client.0.smithi084.stdout:3/982: unlink d1/d2c/f107 0 2024-04-26T21:26:15.740 INFO:tasks.workunit.client.0.smithi084.stdout:8/967: truncate d4/d6/db/d1e/d22/d39/dc4/ff8 980616 0 2024-04-26T21:26:15.741 INFO:tasks.workunit.client.0.smithi084.stdout:3/983: dread d1/d24/d14a/fdd [0,4194304] 0 2024-04-26T21:26:15.741 INFO:tasks.workunit.client.0.smithi084.stdout:9/895: truncate da/dd5/d93/dc3/d41/f7e 4104515 0 2024-04-26T21:26:15.746 INFO:tasks.workunit.client.0.smithi084.stdout:5/899: write d0/dc/f43 [767249,128781] 0 2024-04-26T21:26:15.748 INFO:tasks.workunit.client.0.smithi084.stdout:3/984: fsync d1/d2c/d2f/d31/dc7/ff0 0 2024-04-26T21:26:15.751 INFO:tasks.workunit.client.0.smithi084.stdout:8/968: dread d4/d6/db/d1e/d22/d39/dc4/ff8 [0,4194304] 0 2024-04-26T21:26:15.756 INFO:tasks.workunit.client.0.smithi084.stdout:1/938: dread d2/d54/d93/d110/d47/f78 [0,4194304] 0 2024-04-26T21:26:15.759 INFO:tasks.workunit.client.0.smithi084.stdout:3/985: mkdir d1/d24/d27/d3a/ddb/d16a 0 2024-04-26T21:26:15.760 INFO:tasks.workunit.client.0.smithi084.stdout:9/896: link da/de/d16/d40/l5b da/dd5/d93/dc3/d41/d43/l14e 0 2024-04-26T21:26:15.762 INFO:tasks.workunit.client.0.smithi084.stdout:1/939: fsync d2/d54/d5e/d66/d2a/d72/d127/f139 0 2024-04-26T21:26:15.764 INFO:tasks.workunit.client.0.smithi084.stdout:8/969: write d4/d6/db/d1e/d22/d39/d4a/fe6 [39206,24704] 0 2024-04-26T21:26:15.768 INFO:tasks.workunit.client.0.smithi084.stdout:6/872: dwrite d3/de/d15/df/dae/df4/dfb/fd5 [0,4194304] 0 2024-04-26T21:26:15.768 INFO:tasks.workunit.client.0.smithi084.stdout:9/897: stat da/dd5/d93/dc3/f2a 0 2024-04-26T21:26:15.770 INFO:tasks.workunit.client.0.smithi084.stdout:3/986: symlink d1/d24/d27/d3a/ddb/d16a/l16b 0 2024-04-26T21:26:15.773 INFO:tasks.workunit.client.0.smithi084.stdout:3/987: chown d1/d24/d27/l3d 183 1 2024-04-26T21:26:15.778 INFO:tasks.workunit.client.0.smithi084.stdout:1/940: creat d2/d54/d5e/d66/d2a/dff/f13a x:0 0 0 2024-04-26T21:26:15.780 INFO:tasks.workunit.client.0.smithi084.stdout:8/970: mknod d4/d6/c122 0 2024-04-26T21:26:15.781 INFO:tasks.workunit.client.0.smithi084.stdout:0/922: dread de/d78/d9e/fe1 [0,4194304] 0 2024-04-26T21:26:15.781 INFO:tasks.workunit.client.0.smithi084.stdout:6/873: creat d3/de/d1a/d2f/d4c/d58/f111 x:0 0 0 2024-04-26T21:26:15.781 INFO:tasks.workunit.client.0.smithi084.stdout:5/900: dwrite d0/dc/df/ff6 [0,4194304] 0 2024-04-26T21:26:15.785 INFO:tasks.workunit.client.0.smithi084.stdout:9/898: read da/dd5/d93/d95/fa1 [442305,130714] 0 2024-04-26T21:26:15.792 INFO:tasks.workunit.client.0.smithi084.stdout:0/923: creat de/d20/d4e/d117/f129 x:0 0 0 2024-04-26T21:26:15.792 INFO:tasks.workunit.client.0.smithi084.stdout:1/941: read d2/d54/d93/d110/da0/fdf [518328,107818] 0 2024-04-26T21:26:15.796 INFO:tasks.workunit.client.0.smithi084.stdout:8/971: write d4/d6/db/d1e/d22/d2f/fd3 [1486980,107285] 0 2024-04-26T21:26:15.805 INFO:tasks.workunit.client.0.smithi084.stdout:1/942: mknod d2/d9/d15/d9f/c13b 0 2024-04-26T21:26:15.805 INFO:tasks.workunit.client.0.smithi084.stdout:8/972: write d4/f12 [5682995,56410] 0 2024-04-26T21:26:15.823 INFO:tasks.workunit.client.0.smithi084.stdout:9/899: dwrite da/dd5/d93/dc3/d41/d43/d48/f58 [0,4194304] 0 2024-04-26T21:26:15.824 INFO:tasks.workunit.client.0.smithi084.stdout:5/901: dwrite d0/dc/df/d31/d53/d5d/fad [4194304,4194304] 0 2024-04-26T21:26:15.829 INFO:tasks.workunit.client.0.smithi084.stdout:6/874: dwrite d3/de/d15/d23/f2e [4194304,4194304] 0 2024-04-26T21:26:15.834 INFO:tasks.workunit.client.0.smithi084.stdout:3/988: dwrite d1/d2c/f35 [0,4194304] 0 2024-04-26T21:26:15.840 INFO:tasks.workunit.client.0.smithi084.stdout:3/989: fdatasync d1/d2c/d2f/d31/d55/f82 0 2024-04-26T21:26:15.844 INFO:tasks.workunit.client.0.smithi084.stdout:8/973: dwrite d4/d6/db/d1e/d22/d2f/f101 [0,4194304] 0 2024-04-26T21:26:15.847 INFO:tasks.workunit.client.0.smithi084.stdout:8/974: truncate d4/f7a 1609854 0 2024-04-26T21:26:15.847 INFO:tasks.workunit.client.0.smithi084.stdout:3/990: mkdir d1/d24/d11c/d16c 0 2024-04-26T21:26:15.849 INFO:tasks.workunit.client.0.smithi084.stdout:5/902: write d0/d49/d56/f6f [684525,115230] 0 2024-04-26T21:26:15.864 INFO:tasks.workunit.client.0.smithi084.stdout:8/975: dread - d4/d6/db/d1e/d22/d39/fff zero size 2024-04-26T21:26:15.866 INFO:tasks.workunit.client.0.smithi084.stdout:9/900: link da/db3/d117/f13a da/dd5/d93/dc3/d41/d43/d48/d61/d81/f14f 0 2024-04-26T21:26:15.867 INFO:tasks.workunit.client.0.smithi084.stdout:5/903: dread - d0/dc/df/d31/d53/d87/fe0 zero size 2024-04-26T21:26:15.867 INFO:tasks.workunit.client.0.smithi084.stdout:9/901: stat da/d9e/cfe 0 2024-04-26T21:26:15.874 INFO:tasks.workunit.client.0.smithi084.stdout:1/943: dread d2/d54/d5e/dbe/fdb [8388608,4194304] 0 2024-04-26T21:26:15.886 INFO:tasks.workunit.client.0.smithi084.stdout:8/976: dwrite d4/d6/db/d9b/f10f [0,4194304] 0 2024-04-26T21:26:15.903 INFO:tasks.workunit.client.0.smithi084.stdout:3/991: creat d1/d2c/d2f/d31/d55/d4e/d7c/db1/d129/d12d/f16d x:0 0 0 2024-04-26T21:26:15.907 INFO:tasks.workunit.client.0.smithi084.stdout:1/944: creat d2/d54/d93/d110/d47/f13c x:0 0 0 2024-04-26T21:26:15.910 INFO:tasks.workunit.client.0.smithi084.stdout:9/902: symlink da/dd5/d93/dc3/d41/d8d/d13b/l150 0 2024-04-26T21:26:15.911 INFO:tasks.workunit.client.0.smithi084.stdout:8/977: write d4/d3a/d8c/f95 [171096,45383] 0 2024-04-26T21:26:15.912 INFO:tasks.workunit.client.0.smithi084.stdout:1/945: write d2/d9/d15/f12d [313387,21011] 0 2024-04-26T21:26:15.913 INFO:tasks.workunit.client.0.smithi084.stdout:5/904: link d0/dc/df/d31/d53/fdd d0/dc/df/d6d/f11e 0 2024-04-26T21:26:15.916 INFO:tasks.workunit.client.0.smithi084.stdout:3/992: rename d1/d2c/d2f/d31/d52/cc4 to d1/d2c/d2f/d31/d55/d4e/d98/c16e 0 2024-04-26T21:26:15.919 INFO:tasks.workunit.client.0.smithi084.stdout:8/978: creat d4/d6/db/d120/f123 x:0 0 0 2024-04-26T21:26:15.924 INFO:tasks.workunit.client.0.smithi084.stdout:5/905: unlink d0/dc/df/d31/d45/c111 0 2024-04-26T21:26:15.928 INFO:tasks.workunit.client.0.smithi084.stdout:8/979: rmdir d4/d6/db/d9b/dca 39 2024-04-26T21:26:15.935 INFO:tasks.workunit.client.0.smithi084.stdout:8/980: unlink d4/c4e 0 2024-04-26T21:26:15.942 INFO:tasks.workunit.client.0.smithi084.stdout:8/981: readlink d4/d6/l35 0 2024-04-26T21:26:15.946 INFO:tasks.workunit.client.0.smithi084.stdout:1/946: dwrite d2/d54/d5e/d66/f36 [0,4194304] 0 2024-04-26T21:26:15.949 INFO:tasks.workunit.client.0.smithi084.stdout:5/906: dwrite d0/dc/df/ff6 [4194304,4194304] 0 2024-04-26T21:26:15.959 INFO:tasks.workunit.client.0.smithi084.stdout:1/947: creat d2/d9/d15/d9f/d113/f13d x:0 0 0 2024-04-26T21:26:15.960 INFO:tasks.workunit.client.0.smithi084.stdout:5/907: mknod d0/dc/df/d6d/c11f 0 2024-04-26T21:26:15.968 INFO:tasks.workunit.client.0.smithi084.stdout:5/908: unlink d0/d49/d56/c92 0 2024-04-26T21:26:15.969 INFO:tasks.workunit.client.0.smithi084.stdout:9/903: write da/dd5/d93/dc3/d41/d8d/f99 [652444,63468] 0 2024-04-26T21:26:15.974 INFO:tasks.workunit.client.0.smithi084.stdout:5/909: readlink d0/dc/df/d31/d72/lfc 0 2024-04-26T21:26:15.978 INFO:tasks.workunit.client.0.smithi084.stdout:9/904: mkdir da/dd5/d93/dc3/d41/d67/d151 0 2024-04-26T21:26:15.980 INFO:tasks.workunit.client.0.smithi084.stdout:3/993: dread d1/d24/d27/d3a/ffa [0,4194304] 0 2024-04-26T21:26:15.983 INFO:tasks.workunit.client.0.smithi084.stdout:1/948: dread d2/d54/d93/d110/d47/f78 [0,4194304] 0 2024-04-26T21:26:15.983 INFO:tasks.workunit.client.0.smithi084.stdout:8/982: dwrite d4/d7/d15/d9d/fad [0,4194304] 0 2024-04-26T21:26:15.987 INFO:tasks.workunit.client.0.smithi084.stdout:5/910: link d0/dc/df/d31/d63/d6e/ffa d0/dc/df/d31/d53/de1/f120 0 2024-04-26T21:26:15.987 INFO:tasks.workunit.client.0.smithi084.stdout:3/994: truncate d1/d2c/d2f/d31/f11e 4355843 0 2024-04-26T21:26:15.995 INFO:tasks.workunit.client.0.smithi084.stdout:9/905: mkdir da/dd5/d93/dc3/d41/d67/de9/d152 0 2024-04-26T21:26:15.996 INFO:tasks.workunit.client.0.smithi084.stdout:8/983: rename d4/d7/d15/d37/d3b/c10e to d4/d7/d53/c124 0 2024-04-26T21:26:15.997 INFO:tasks.workunit.client.0.smithi084.stdout:5/911: truncate d0/dc/df/d31/d53/d87/fe0 166756 0 2024-04-26T21:26:15.997 INFO:tasks.workunit.client.0.smithi084.stdout:1/949: read d2/d19/f40 [671150,22756] 0 2024-04-26T21:26:16.004 INFO:tasks.workunit.client.0.smithi084.stdout:8/984: rename d4/d7/d15/fc7 to d4/d7/d15/d37/d3b/f125 0 2024-04-26T21:26:16.005 INFO:tasks.workunit.client.0.smithi084.stdout:3/995: dwrite d1/d2c/d2f/d94/fcc [4194304,4194304] 0 2024-04-26T21:26:16.009 INFO:tasks.workunit.client.0.smithi084.stdout:9/906: truncate da/de/d16/d40/f4b 3799103 0 2024-04-26T21:26:16.012 INFO:tasks.workunit.client.0.smithi084.stdout:3/996: write d1/d2c/d2f/d31/d55/fb3 [4397019,81720] 0 2024-04-26T21:26:16.020 INFO:tasks.workunit.client.0.smithi084.stdout:8/985: truncate d4/d6/db/d9b/dca/f11a 573860 0 2024-04-26T21:26:16.021 INFO:tasks.workunit.client.0.smithi084.stdout:1/950: dwrite d2/ff8 [0,4194304] 0 2024-04-26T21:26:16.029 INFO:tasks.workunit.client.0.smithi084.stdout:1/951: creat d2/d54/d93/d110/d69/f13e x:0 0 0 2024-04-26T21:26:16.030 INFO:tasks.workunit.client.0.smithi084.stdout:9/907: dwrite da/dd5/f14b [0,4194304] 0 2024-04-26T21:26:16.033 INFO:tasks.workunit.client.0.smithi084.stdout:3/997: dread d1/d2c/d2f/d31/d55/d4e/d7c/fca [0,4194304] 0 2024-04-26T21:26:16.036 INFO:tasks.workunit.client.0.smithi084.stdout:8/986: truncate d4/d6/db/fc5 1817312 0 2024-04-26T21:26:16.037 INFO:tasks.workunit.client.0.smithi084.stdout:5/912: dread d0/dc/fee [0,4194304] 0 2024-04-26T21:26:16.039 INFO:tasks.workunit.client.0.smithi084.stdout:3/998: symlink d1/d24/d14a/l16f 0 2024-04-26T21:26:16.044 INFO:tasks.workunit.client.0.smithi084.stdout:5/913: read d0/dc/df/d31/f54 [342849,66376] 0 2024-04-26T21:26:16.045 INFO:tasks.workunit.client.0.smithi084.stdout:8/987: rename d4/d6/db/d1e/cae to d4/d6/db/d120/c126 0 2024-04-26T21:26:16.048 INFO:tasks.workunit.client.0.smithi084.stdout:3/999: rmdir d1/dea/d12f/d12a 39 2024-04-26T21:26:16.052 INFO:tasks.workunit.client.0.smithi084.stdout:9/908: write da/f46 [2524901,108766] 0 2024-04-26T21:26:16.054 INFO:tasks.workunit.client.0.smithi084.stdout:1/952: dread d2/d54/d93/d110/d5a/f91 [0,4194304] 0 2024-04-26T21:26:16.055 INFO:tasks.workunit.client.0.smithi084.stdout:5/914: creat d0/f121 x:0 0 0 2024-04-26T21:26:16.059 INFO:tasks.workunit.client.0.smithi084.stdout:1/953: mkdir d2/d54/d5e/d8d/d13f 0 2024-04-26T21:26:16.059 INFO:tasks.workunit.client.0.smithi084.stdout:8/988: link d4/d7/d15/d37/d52/d69/la0 d4/d7/d15/d37/d52/l127 0 2024-04-26T21:26:16.062 INFO:tasks.workunit.client.0.smithi084.stdout:1/954: creat d2/d54/d5e/d66/d2a/d72/dd8/f140 x:0 0 0 2024-04-26T21:26:16.063 INFO:tasks.workunit.client.0.smithi084.stdout:1/955: stat d2/f10e 0 2024-04-26T21:26:16.064 INFO:tasks.workunit.client.0.smithi084.stdout:8/989: creat d4/d6/db/d1e/d119/f128 x:0 0 0 2024-04-26T21:26:16.067 INFO:tasks.workunit.client.0.smithi084.stdout:9/909: write da/de/d16/d40/fda [355990,65113] 0 2024-04-26T21:26:16.067 INFO:tasks.workunit.client.0.smithi084.stdout:5/915: truncate d0/d17/f1d 1568976 0 2024-04-26T21:26:16.069 INFO:tasks.workunit.client.0.smithi084.stdout:5/916: chown d0/d17/c59 2117 1 2024-04-26T21:26:16.073 INFO:tasks.workunit.client.0.smithi084.stdout:1/956: write d2/d19/dd2/feb [974330,93634] 0 2024-04-26T21:26:16.077 INFO:tasks.workunit.client.0.smithi084.stdout:1/957: chown d2/d1b/f8b 55689518 1 2024-04-26T21:26:16.077 INFO:tasks.workunit.client.0.smithi084.stdout:9/910: dread da/dd5/d93/dc3/d41/d43/f9f [0,4194304] 0 2024-04-26T21:26:16.080 INFO:tasks.workunit.client.0.smithi084.stdout:1/958: dread - d2/d54/d5e/d66/d2a/dff/f13a zero size 2024-04-26T21:26:16.080 INFO:tasks.workunit.client.0.smithi084.stdout:9/911: chown da/c8c 1448165380 1 2024-04-26T21:26:16.085 INFO:tasks.workunit.client.0.smithi084.stdout:9/912: chown da/dd5/d93/dc3/d41/dab/le8 1343 1 2024-04-26T21:26:16.085 INFO:tasks.workunit.client.0.smithi084.stdout:1/959: mkdir d2/d54/d5e/d66/d3a/d77/d141 0 2024-04-26T21:26:16.087 INFO:tasks.workunit.client.0.smithi084.stdout:8/990: dwrite d4/d7/d15/d37/d52/fc3 [0,4194304] 0 2024-04-26T21:26:16.087 INFO:tasks.workunit.client.0.smithi084.stdout:5/917: truncate d0/d17/f1d 492637 0 2024-04-26T21:26:16.089 INFO:tasks.workunit.client.0.smithi084.stdout:8/991: dread - d4/d7/d15/d3c/f100 zero size 2024-04-26T21:26:16.094 INFO:tasks.workunit.client.0.smithi084.stdout:5/918: mknod d0/dc/df/d31/d72/c122 0 2024-04-26T21:26:16.096 INFO:tasks.workunit.client.0.smithi084.stdout:1/960: getdents d2/d54/d5e/dbe 0 2024-04-26T21:26:16.101 INFO:tasks.workunit.client.0.smithi084.stdout:1/961: getdents d2/d54 0 2024-04-26T21:26:16.104 INFO:tasks.workunit.client.0.smithi084.stdout:8/992: dwrite d4/d6/db/fdb [0,4194304] 0 2024-04-26T21:26:16.107 INFO:tasks.workunit.client.0.smithi084.stdout:5/919: rmdir d0/dc/df/d31 39 2024-04-26T21:26:16.107 INFO:tasks.workunit.client.0.smithi084.stdout:9/913: write da/dd5/d93/dc3/d41/d43/d48/d61/d81/f14f [4094047,40132] 0 2024-04-26T21:26:16.109 INFO:tasks.workunit.client.0.smithi084.stdout:1/962: rename d2/d19/d63 to d2/d54/d93/d110/da0/db5/d142 0 2024-04-26T21:26:16.114 INFO:tasks.workunit.client.0.smithi084.stdout:6/875: sync 2024-04-26T21:26:16.114 INFO:tasks.workunit.client.0.smithi084.stdout:0/924: sync 2024-04-26T21:26:16.116 INFO:tasks.workunit.client.0.smithi084.stdout:8/993: mknod d4/d7/d15/da7/dea/c129 0 2024-04-26T21:26:16.117 INFO:tasks.workunit.client.0.smithi084.stdout:0/925: write de/d2b/df3/d63/da7/d103/f107 [612781,76587] 0 2024-04-26T21:26:16.120 INFO:tasks.workunit.client.0.smithi084.stdout:1/963: rename d2/d54/d5e/d66/d2a/d72 to d2/d54/d5e/d66/d2a/dff/d143 0 2024-04-26T21:26:16.122 INFO:tasks.workunit.client.0.smithi084.stdout:9/914: getdents da/dd5/d93/dc3/d41/d67/de9/d152 0 2024-04-26T21:26:16.123 INFO:tasks.workunit.client.0.smithi084.stdout:8/994: creat d4/d7/f12a x:0 0 0 2024-04-26T21:26:16.125 INFO:tasks.workunit.client.0.smithi084.stdout:0/926: rename de/d2b/f39 to de/d2b/df3/d94/d10b/f12a 0 2024-04-26T21:26:16.125 INFO:tasks.workunit.client.0.smithi084.stdout:0/927: readlink de/d2b/df3/l56 0 2024-04-26T21:26:16.128 INFO:tasks.workunit.client.0.smithi084.stdout:6/876: unlink d3/c3d 0 2024-04-26T21:26:16.130 INFO:tasks.workunit.client.0.smithi084.stdout:5/920: write d0/dc/df/d75/f55 [4522248,53833] 0 2024-04-26T21:26:16.132 INFO:tasks.workunit.client.0.smithi084.stdout:5/921: chown d0/da2 292 1 2024-04-26T21:26:16.133 INFO:tasks.workunit.client.0.smithi084.stdout:1/964: mknod d2/d9/c144 0 2024-04-26T21:26:16.135 INFO:tasks.workunit.client.0.smithi084.stdout:6/877: mkdir d3/de/d1a/d43/d72/dad/d112 0 2024-04-26T21:26:16.139 INFO:tasks.workunit.client.0.smithi084.stdout:1/965: mkdir d2/d54/d93/d145 0 2024-04-26T21:26:16.141 INFO:tasks.workunit.client.0.smithi084.stdout:9/915: mknod da/dd5/d93/dc3/d41/d8d/d120/c153 0 2024-04-26T21:26:16.142 INFO:tasks.workunit.client.0.smithi084.stdout:0/928: dread de/d2b/f84 [0,4194304] 0 2024-04-26T21:26:16.148 INFO:tasks.workunit.client.0.smithi084.stdout:8/995: link d4/d6/db/c34 d4/d3a/d8c/d118/c12b 0 2024-04-26T21:26:16.149 INFO:tasks.workunit.client.0.smithi084.stdout:9/916: unlink da/dd5/d93/dc3/d41/d67/de9/ff3 0 2024-04-26T21:26:16.150 INFO:tasks.workunit.client.0.smithi084.stdout:8/996: chown d4/d6/c122 877 1 2024-04-26T21:26:16.151 INFO:tasks.workunit.client.0.smithi084.stdout:6/878: write d3/de/d15/df/dae/fb2 [3204232,26264] 0 2024-04-26T21:26:16.151 INFO:tasks.workunit.client.0.smithi084.stdout:5/922: dwrite d0/dc/f1c [4194304,4194304] 0 2024-04-26T21:26:16.152 INFO:tasks.workunit.client.0.smithi084.stdout:1/966: write d2/d54/d5e/d66/d2a/d2c/f2d [1188532,80851] 0 2024-04-26T21:26:16.154 INFO:tasks.workunit.client.0.smithi084.stdout:9/917: fsync da/dd5/d93/dc3/d41/d8d/f99 0 2024-04-26T21:26:16.160 INFO:tasks.workunit.client.0.smithi084.stdout:6/879: unlink d3/de/d1a/d2f/d4c/d58/f111 0 2024-04-26T21:26:16.163 INFO:tasks.workunit.client.0.smithi084.stdout:6/880: readlink d3/de/d1a/d43/d72/la9 0 2024-04-26T21:26:16.164 INFO:tasks.workunit.client.0.smithi084.stdout:8/997: getdents d4/d6/db/d1e/d22/d39/dc4 0 2024-04-26T21:26:16.166 INFO:tasks.workunit.client.0.smithi084.stdout:1/967: mkdir d2/d54/d5e/d66/d2a/d146 0 2024-04-26T21:26:16.171 INFO:tasks.workunit.client.0.smithi084.stdout:0/929: dwrite de/d2b/d77/d68/f95 [0,4194304] 0 2024-04-26T21:26:16.171 INFO:tasks.workunit.client.0.smithi084.stdout:6/881: creat d3/de/d15/df/dae/df4/dfb/f113 x:0 0 0 2024-04-26T21:26:16.172 INFO:tasks.workunit.client.0.smithi084.stdout:9/918: write da/de/d16/fea [802673,51546] 0 2024-04-26T21:26:16.176 INFO:tasks.workunit.client.0.smithi084.stdout:0/930: write de/d2b/d64/d81/ffc [542533,7409] 0 2024-04-26T21:26:16.177 INFO:tasks.workunit.client.0.smithi084.stdout:9/919: chown da/dd5/d93/dc3/d4f/d104 111205 1 2024-04-26T21:26:16.178 INFO:tasks.workunit.client.0.smithi084.stdout:1/968: write d2/d54/d5e/fc3 [3810169,9624] 0 2024-04-26T21:26:16.181 INFO:tasks.workunit.client.0.smithi084.stdout:1/969: chown d2/d9/d67/db1 217021946 1 2024-04-26T21:26:16.181 INFO:tasks.workunit.client.0.smithi084.stdout:9/920: chown da/de/d16/f1b 224 1 2024-04-26T21:26:16.183 INFO:tasks.workunit.client.0.smithi084.stdout:0/931: symlink de/d2b/d64/l12b 0 2024-04-26T21:26:16.185 INFO:tasks.workunit.client.0.smithi084.stdout:1/970: dread - d2/d54/d5e/d8d/fde zero size 2024-04-26T21:26:16.187 INFO:tasks.workunit.client.0.smithi084.stdout:9/921: readlink da/dd5/d93/dc3/d41/d43/l14e 0 2024-04-26T21:26:16.187 INFO:tasks.workunit.client.0.smithi084.stdout:5/923: dwrite d0/dc/df/d31/d53/d87/f96 [0,4194304] 0 2024-04-26T21:26:16.190 INFO:tasks.workunit.client.0.smithi084.stdout:0/932: mkdir de/d2b/df3/d94/d12c 0 2024-04-26T21:26:16.198 INFO:tasks.workunit.client.0.smithi084.stdout:1/971: link d2/d54/d5e/d66/d2a/d119/f126 d2/d54/d5e/dbe/f147 0 2024-04-26T21:26:16.199 INFO:tasks.workunit.client.0.smithi084.stdout:5/924: creat d0/dc/df/d31/d53/d5d/f123 x:0 0 0 2024-04-26T21:26:16.201 INFO:tasks.workunit.client.0.smithi084.stdout:0/933: symlink de/d2b/d77/d32/d96/l12d 0 2024-04-26T21:26:16.203 INFO:tasks.workunit.client.0.smithi084.stdout:0/934: chown de/d78/d9e/da4/fe4 10668 1 2024-04-26T21:26:16.204 INFO:tasks.workunit.client.0.smithi084.stdout:5/925: creat d0/dc/df/d31/d72/f124 x:0 0 0 2024-04-26T21:26:16.205 INFO:tasks.workunit.client.0.smithi084.stdout:1/972: truncate d2/d54/d5e/d66/d2a/d2c/d45/dc9/fee 551564 0 2024-04-26T21:26:16.209 INFO:tasks.workunit.client.0.smithi084.stdout:0/935: symlink de/d2b/d77/d32/l12e 0 2024-04-26T21:26:16.212 INFO:tasks.workunit.client.0.smithi084.stdout:9/922: dwrite da/de/d1e/d56/da6/fa9 [4194304,4194304] 0 2024-04-26T21:26:16.212 INFO:tasks.workunit.client.0.smithi084.stdout:1/973: truncate d2/d9/d15/d9f/fc2 903217 0 2024-04-26T21:26:16.215 INFO:tasks.workunit.client.0.smithi084.stdout:1/974: readlink d2/d54/d5e/lae 0 2024-04-26T21:26:16.217 INFO:tasks.workunit.client.0.smithi084.stdout:9/923: rename da/dd5/d93 to da/dd5/d93/dc3/d41/d43/d48/d61/d154 22 2024-04-26T21:26:16.225 INFO:tasks.workunit.client.0.smithi084.stdout:5/926: dwrite d0/dc/df/d31/d45/fec [0,4194304] 0 2024-04-26T21:26:16.240 INFO:tasks.workunit.client.0.smithi084.stdout:0/936: dread de/d2b/d77/d32/f69 [0,4194304] 0 2024-04-26T21:26:16.245 INFO:tasks.workunit.client.0.smithi084.stdout:0/937: creat de/d20/f12f x:0 0 0 2024-04-26T21:26:16.247 INFO:tasks.workunit.client.0.smithi084.stdout:5/927: dread d0/dc/df/d75/fbe [0,4194304] 0 2024-04-26T21:26:16.249 INFO:tasks.workunit.client.0.smithi084.stdout:1/975: dread d2/d54/d5e/d66/f29 [0,4194304] 0 2024-04-26T21:26:16.255 INFO:tasks.workunit.client.0.smithi084.stdout:0/938: creat de/d2b/d64/f130 x:0 0 0 2024-04-26T21:26:16.258 INFO:tasks.workunit.client.0.smithi084.stdout:1/976: creat d2/d54/d5e/d66/d2a/d2c/f148 x:0 0 0 2024-04-26T21:26:16.258 INFO:tasks.workunit.client.0.smithi084.stdout:0/939: mknod de/d20/d4e/c131 0 2024-04-26T21:26:16.261 INFO:tasks.workunit.client.0.smithi084.stdout:0/940: unlink de/d78/c87 0 2024-04-26T21:26:16.264 INFO:tasks.workunit.client.0.smithi084.stdout:5/928: dwrite d0/dc/df/d75/f55 [4194304,4194304] 0 2024-04-26T21:26:16.269 INFO:tasks.workunit.client.0.smithi084.stdout:0/941: truncate de/d20/d4c/f119 3036696 0 2024-04-26T21:26:16.280 INFO:tasks.workunit.client.0.smithi084.stdout:0/942: rename de/d20/d4e/d117/f129 to de/d2b/d77/f132 0 2024-04-26T21:26:16.280 INFO:tasks.workunit.client.0.smithi084.stdout:1/977: dwrite d2/d54/d93/d110/d5a/ff1 [0,4194304] 0 2024-04-26T21:26:16.283 INFO:tasks.workunit.client.0.smithi084.stdout:5/929: truncate d0/dc/df/d75/f55 2957244 0 2024-04-26T21:26:16.286 INFO:tasks.workunit.client.0.smithi084.stdout:0/943: creat de/d2b/d77/d68/f133 x:0 0 0 2024-04-26T21:26:16.288 INFO:tasks.workunit.client.0.smithi084.stdout:5/930: creat d0/dc/d48/de9/f125 x:0 0 0 2024-04-26T21:26:16.291 INFO:tasks.workunit.client.0.smithi084.stdout:0/944: rmdir de/d78 39 2024-04-26T21:26:16.294 INFO:tasks.workunit.client.0.smithi084.stdout:1/978: write d2/d19/f32 [3663663,26634] 0 2024-04-26T21:26:16.294 INFO:tasks.workunit.client.0.smithi084.stdout:0/945: write de/d2b/d77/d32/d96/fc9 [169052,39418] 0 2024-04-26T21:26:16.300 INFO:tasks.workunit.client.0.smithi084.stdout:1/979: unlink d2/d54/d93/d110/d69/f13e 0 2024-04-26T21:26:16.301 INFO:tasks.workunit.client.0.smithi084.stdout:0/946: mknod de/df8/c134 0 2024-04-26T21:26:16.305 INFO:tasks.workunit.client.0.smithi084.stdout:0/947: unlink de/d2b/d77/d32/d96/dbe/ce6 0 2024-04-26T21:26:16.307 INFO:tasks.workunit.client.0.smithi084.stdout:0/948: stat de/df8 0 2024-04-26T21:26:16.310 INFO:tasks.workunit.client.0.smithi084.stdout:5/931: dwrite d0/dc/df/f7a [0,4194304] 0 2024-04-26T21:26:16.314 INFO:tasks.workunit.client.0.smithi084.stdout:5/932: unlink d0/d49/d56/f57 0 2024-04-26T21:26:16.315 INFO:tasks.workunit.client.0.smithi084.stdout:1/980: truncate d2/d54/d5e/f11b 4193296 0 2024-04-26T21:26:16.317 INFO:tasks.workunit.client.0.smithi084.stdout:5/933: chown d0/dc/df/d31/d72/led 20 1 2024-04-26T21:26:16.321 INFO:tasks.workunit.client.0.smithi084.stdout:5/934: chown d0/dc/d48/f77 375757 1 2024-04-26T21:26:16.326 INFO:tasks.workunit.client.0.smithi084.stdout:1/981: link d2/d54/d5e/d8d/l9e d2/d54/d5e/d102/l149 0 2024-04-26T21:26:16.330 INFO:tasks.workunit.client.0.smithi084.stdout:5/935: creat d0/d49/f126 x:0 0 0 2024-04-26T21:26:16.331 INFO:tasks.workunit.client.0.smithi084.stdout:1/982: mknod d2/d54/d5e/d66/d2a/d2c/d45/c14a 0 2024-04-26T21:26:16.335 INFO:tasks.workunit.client.0.smithi084.stdout:1/983: creat d2/d19/f14b x:0 0 0 2024-04-26T21:26:16.335 INFO:tasks.workunit.client.0.smithi084.stdout:5/936: read d0/dc/df/d31/d45/f82 [215948,81654] 0 2024-04-26T21:26:16.338 INFO:tasks.workunit.client.0.smithi084.stdout:1/984: rename d2/dc8/ldc to d2/d54/d93/d110/d47/l14c 0 2024-04-26T21:26:16.354 INFO:tasks.workunit.client.0.smithi084.stdout:1/985: dwrite d2/d9/d15/f25 [0,4194304] 0 2024-04-26T21:26:16.359 INFO:tasks.workunit.client.0.smithi084.stdout:1/986: creat d2/d54/d5e/d66/f14d x:0 0 0 2024-04-26T21:26:16.363 INFO:tasks.workunit.client.0.smithi084.stdout:1/987: write d2/d54/d5e/d66/d2a/dff/d143/dd8/f140 [535641,61671] 0 2024-04-26T21:26:16.377 INFO:tasks.workunit.client.0.smithi084.stdout:1/988: truncate d2/d9/f16 514219 0 2024-04-26T21:26:16.381 INFO:tasks.workunit.client.0.smithi084.stdout:1/989: dread d2/d54/d93/d110/da0/db5/d142/fef [0,4194304] 0 2024-04-26T21:26:16.383 INFO:tasks.workunit.client.0.smithi084.stdout:1/990: chown d2/d54/d5e/d66/d2a/d2c/d45/fe1 16169632 1 2024-04-26T21:26:16.385 INFO:tasks.workunit.client.0.smithi084.stdout:1/991: readlink d2/d54/d5e/d66/d2a/d2c/d75/lbc 0 2024-04-26T21:26:16.389 INFO:tasks.workunit.client.0.smithi084.stdout:1/992: link d2/f2e d2/d54/d93/d110/da0/f14e 0 2024-04-26T21:26:16.391 INFO:tasks.workunit.client.0.smithi084.stdout:1/993: creat d2/d19/dd2/f14f x:0 0 0 2024-04-26T21:26:16.394 INFO:tasks.workunit.client.0.smithi084.stdout:1/994: mknod d2/d54/d93/d110/c150 0 2024-04-26T21:26:16.398 INFO:tasks.workunit.client.0.smithi084.stdout:1/995: mknod d2/d54/d5e/d66/d2a/d2c/c151 0 2024-04-26T21:26:16.411 INFO:tasks.workunit.client.0.smithi084.stdout:1/996: write d2/d54/d5e/d66/d2a/d2c/d45/f4a [538489,17178] 0 2024-04-26T21:26:16.413 INFO:tasks.workunit.client.0.smithi084.stdout:1/997: fsync d2/d9/d15/d9f/d113/f123 0 2024-04-26T21:26:16.429 INFO:tasks.workunit.client.0.smithi084.stdout:1/998: dwrite d2/d19/f14b [0,4194304] 0 2024-04-26T21:26:16.445 INFO:tasks.workunit.client.0.smithi084.stdout:1/999: write d2/d9/d67/f6a [4799968,25092] 0 2024-04-26T21:26:16.558 INFO:tasks.workunit.client.0.smithi084.stdout:8/998: sync 2024-04-26T21:26:16.560 INFO:tasks.workunit.client.0.smithi084.stdout:8/999: dread - d4/d7/f11d zero size 2024-04-26T21:26:16.668 INFO:tasks.workunit.client.0.smithi084.stdout:6/882: sync 2024-04-26T21:26:16.675 INFO:tasks.workunit.client.0.smithi084.stdout:6/883: fsync d3/de/d15/d23/f30 0 2024-04-26T21:26:16.695 INFO:tasks.workunit.client.0.smithi084.stdout:6/884: truncate d3/de/d1a/d43/f57 3998093 0 2024-04-26T21:26:16.701 INFO:tasks.workunit.client.0.smithi084.stdout:6/885: fsync d3/d18/f8d 0 2024-04-26T21:26:16.713 INFO:tasks.workunit.client.0.smithi084.stdout:6/886: write d3/de/d41/d5c/f97 [4429327,100151] 0 2024-04-26T21:26:16.722 INFO:tasks.workunit.client.0.smithi084.stdout:6/887: unlink d3/de/d1a/l4a 0 2024-04-26T21:26:16.740 INFO:tasks.workunit.client.0.smithi084.stdout:6/888: link d3/de/d41/d5c/de2/fdc d3/de/d15/df/dae/ded/f114 0 2024-04-26T21:26:16.743 INFO:tasks.workunit.client.0.smithi084.stdout:0/949: sync 2024-04-26T21:26:16.743 INFO:tasks.workunit.client.0.smithi084.stdout:5/937: sync 2024-04-26T21:26:16.744 INFO:tasks.workunit.client.0.smithi084.stdout:9/924: sync 2024-04-26T21:26:16.748 INFO:tasks.workunit.client.0.smithi084.stdout:6/889: fsync d3/de/d9e/f103 0 2024-04-26T21:26:16.750 INFO:tasks.workunit.client.0.smithi084.stdout:5/938: symlink d0/df5/l127 0 2024-04-26T21:26:16.757 INFO:tasks.workunit.client.0.smithi084.stdout:5/939: read - d0/dc/df/d31/d63/d6e/ffa zero size 2024-04-26T21:26:16.759 INFO:tasks.workunit.client.0.smithi084.stdout:9/925: creat da/dd5/d93/dc3/d41/d43/d48/d61/df0/f155 x:0 0 0 2024-04-26T21:26:16.767 INFO:tasks.workunit.client.0.smithi084.stdout:0/950: rename de/d2b/d77/fcb to de/d78/d9e/da1/f135 0 2024-04-26T21:26:16.773 INFO:tasks.workunit.client.0.smithi084.stdout:6/890: dread d3/de/d1a/d43/d75/fbd [0,4194304] 0 2024-04-26T21:26:16.784 INFO:tasks.workunit.client.0.smithi084.stdout:9/926: fdatasync da/de/d1e/d56/da6/de6/ff5 0 2024-04-26T21:26:16.787 INFO:tasks.workunit.client.0.smithi084.stdout:0/951: dread - de/d20/f98 zero size 2024-04-26T21:26:16.791 INFO:tasks.workunit.client.0.smithi084.stdout:6/891: creat d3/de/d15/d23/d90/f115 x:0 0 0 2024-04-26T21:26:16.806 INFO:tasks.workunit.client.0.smithi084.stdout:6/892: creat d3/d18/d37/d110/f116 x:0 0 0 2024-04-26T21:26:16.814 INFO:tasks.workunit.client.0.smithi084.stdout:0/952: dwrite de/d78/d9e/da1/dad/f11e [0,4194304] 0 2024-04-26T21:26:16.814 INFO:tasks.workunit.client.0.smithi084.stdout:6/893: creat d3/de/d9e/dca/f117 x:0 0 0 2024-04-26T21:26:16.815 INFO:tasks.workunit.client.0.smithi084.stdout:5/940: link d0/dc/df/d75/le7 d0/dc/df/d31/d63/dbf/l128 0 2024-04-26T21:26:16.819 INFO:tasks.workunit.client.0.smithi084.stdout:6/894: write d3/de/d15/df/f1b [2880627,48836] 0 2024-04-26T21:26:16.824 INFO:tasks.workunit.client.0.smithi084.stdout:5/941: read d0/dc/df/d6d/fe2 [249148,117187] 0 2024-04-26T21:26:16.830 INFO:tasks.workunit.client.0.smithi084.stdout:0/953: link de/d20/d4e/d100/f102 de/d2b/d77/d32/f136 0 2024-04-26T21:26:16.831 INFO:tasks.workunit.client.0.smithi084.stdout:5/942: write d0/dc/fee [3444722,68087] 0 2024-04-26T21:26:16.836 INFO:tasks.workunit.client.0.smithi084.stdout:9/927: dread da/f100 [0,4194304] 0 2024-04-26T21:26:16.838 INFO:tasks.workunit.client.0.smithi084.stdout:5/943: link d0/dc/df/d31/d72/f124 d0/d17/f129 0 2024-04-26T21:26:16.842 INFO:tasks.workunit.client.0.smithi084.stdout:9/928: getdents da/de/d16/d40 0 2024-04-26T21:26:16.846 INFO:tasks.workunit.client.0.smithi084.stdout:5/944: getdents d0/dc/df/d51 0 2024-04-26T21:26:16.847 INFO:tasks.workunit.client.0.smithi084.stdout:6/895: write d3/de/d15/d40/fb6 [409035,64962] 0 2024-04-26T21:26:16.848 INFO:tasks.workunit.client.0.smithi084.stdout:9/929: dread - da/dd5/d93/dc3/d41/d43/d48/d61/df0/f155 zero size 2024-04-26T21:26:16.849 INFO:tasks.workunit.client.0.smithi084.stdout:0/954: dwrite de/d20/d4c/fb7 [0,4194304] 0 2024-04-26T21:26:16.851 INFO:tasks.workunit.client.0.smithi084.stdout:5/945: dread - d0/dc/df/d31/f116 zero size 2024-04-26T21:26:16.853 INFO:tasks.workunit.client.0.smithi084.stdout:6/896: stat d3/de/d1a/d2f/d4c/da0 0 2024-04-26T21:26:16.854 INFO:tasks.workunit.client.0.smithi084.stdout:0/955: chown de/d78/d9e/da1/dad/f11e 437154 1 2024-04-26T21:26:16.855 INFO:tasks.workunit.client.0.smithi084.stdout:9/930: mknod da/de/d1e/d56/c156 0 2024-04-26T21:26:16.859 INFO:tasks.workunit.client.0.smithi084.stdout:5/946: fdatasync d0/d17/f1d 0 2024-04-26T21:26:16.859 INFO:tasks.workunit.client.0.smithi084.stdout:6/897: creat d3/de/d15/df/dae/df4/f118 x:0 0 0 2024-04-26T21:26:16.862 INFO:tasks.workunit.client.0.smithi084.stdout:0/956: rename de/d2b/d77/f11a to de/d78/f137 0 2024-04-26T21:26:16.874 INFO:tasks.workunit.client.0.smithi084.stdout:9/931: mkdir da/dd5/d93/dc3/d41/d8d/d13b/d157 0 2024-04-26T21:26:16.875 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:16 smithi084 ceph-mon[25539]: pgmap v53: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 89 MiB/s rd, 203 MiB/s wr, 466 op/s 2024-04-26T21:26:16.909 INFO:tasks.workunit.client.0.smithi084.stdout:5/947: rename d0/dc/df/d31 to d0/dc/df/d31/d12a 22 2024-04-26T21:26:16.912 INFO:tasks.workunit.client.0.smithi084.stdout:9/932: write da/de/d1e/f31 [4303211,55474] 0 2024-04-26T21:26:16.917 INFO:tasks.workunit.client.0.smithi084.stdout:9/933: unlink da/de/c28 0 2024-04-26T21:26:16.920 INFO:tasks.workunit.client.0.smithi084.stdout:5/948: rename d0/dc/df/ff6 to d0/dc/f12b 0 2024-04-26T21:26:16.920 INFO:tasks.workunit.client.0.smithi084.stdout:9/934: write da/d9e/f12d [499697,15340] 0 2024-04-26T21:26:16.923 INFO:tasks.workunit.client.0.smithi084.stdout:5/949: chown d0/dc/df/d31/d53/d104 352634521 1 2024-04-26T21:26:16.926 INFO:tasks.workunit.client.0.smithi084.stdout:9/935: truncate da/dd5/d93/dc3/d41/d43/d4a/d82/f85 1309828 0 2024-04-26T21:26:16.930 INFO:tasks.workunit.client.0.smithi084.stdout:9/936: symlink da/dd5/d93/dc3/d41/d67/de9/d14c/l158 0 2024-04-26T21:26:16.935 INFO:tasks.workunit.client.0.smithi084.stdout:6/898: write d3/de/d1a/d43/d72/dad/fb1 [4658334,118065] 0 2024-04-26T21:26:16.939 INFO:tasks.workunit.client.0.smithi084.stdout:6/899: chown d3/de/c73 11 1 2024-04-26T21:26:16.942 INFO:tasks.workunit.client.0.smithi084.stdout:6/900: symlink d3/de/d1a/l119 0 2024-04-26T21:26:16.943 INFO:tasks.workunit.client.0.smithi084.stdout:5/950: dwrite d0/d49/f126 [0,4194304] 0 2024-04-26T21:26:16.946 INFO:tasks.workunit.client.0.smithi084.stdout:0/957: dread de/d2b/f43 [0,4194304] 0 2024-04-26T21:26:16.947 INFO:tasks.workunit.client.0.smithi084.stdout:6/901: creat d3/d18/d37/d110/f11a x:0 0 0 2024-04-26T21:26:16.948 INFO:tasks.workunit.client.0.smithi084.stdout:5/951: mknod d0/da2/c12c 0 2024-04-26T21:26:16.948 INFO:tasks.workunit.client.0.smithi084.stdout:9/937: truncate da/dd5/d93/dc3/d41/d43/d48/d61/f102 1634809 0 2024-04-26T21:26:16.952 INFO:tasks.workunit.client.0.smithi084.stdout:0/958: symlink de/d20/d4e/d100/d126/d114/l138 0 2024-04-26T21:26:16.954 INFO:tasks.workunit.client.0.smithi084.stdout:6/902: creat d3/de/d15/df/dae/ded/f11b x:0 0 0 2024-04-26T21:26:16.956 INFO:tasks.workunit.client.0.smithi084.stdout:6/903: dread - d3/de/d15/df/dae/ded/f11b zero size 2024-04-26T21:26:16.972 INFO:tasks.workunit.client.0.smithi084.stdout:0/959: dread de/d2b/d77/d32/f69 [0,4194304] 0 2024-04-26T21:26:16.975 INFO:tasks.workunit.client.0.smithi084.stdout:0/960: read - de/d2b/df3/d63/fc8 zero size 2024-04-26T21:26:16.978 INFO:tasks.workunit.client.0.smithi084.stdout:0/961: rmdir de/d78/d9e/da1 39 2024-04-26T21:26:17.087 INFO:tasks.workunit.client.0.smithi084.stdout:6/904: dwrite d3/de/d41/d5c/ff7 [0,4194304] 0 2024-04-26T21:26:17.088 INFO:tasks.workunit.client.0.smithi084.stdout:0/962: fdatasync de/d2b/df3/d63/da7/d103/f107 0 2024-04-26T21:26:17.088 INFO:tasks.workunit.client.0.smithi084.stdout:5/952: dread d0/f64 [0,4194304] 0 2024-04-26T21:26:17.091 INFO:tasks.workunit.client.0.smithi084.stdout:0/963: chown de/d2b/d77/l55 2620618 1 2024-04-26T21:26:17.099 INFO:tasks.workunit.client.0.smithi084.stdout:6/905: rename d3/de/d1a/d2f/d4c/da0/le8 to d3/de/d15/d23/d104/l11c 0 2024-04-26T21:26:17.103 INFO:tasks.workunit.client.0.smithi084.stdout:0/964: creat de/d20/d4e/d100/d126/f139 x:0 0 0 2024-04-26T21:26:17.108 INFO:tasks.workunit.client.0.smithi084.stdout:0/965: stat de/d78/d9e/da1/dad/f11e 0 2024-04-26T21:26:17.109 INFO:tasks.workunit.client.0.smithi084.stdout:0/966: readlink de/d2b/l2c 0 2024-04-26T21:26:17.110 INFO:tasks.workunit.client.0.smithi084.stdout:5/953: dread d0/d17/f7e [0,4194304] 0 2024-04-26T21:26:17.112 INFO:tasks.workunit.client.0.smithi084.stdout:6/906: creat d3/f11d x:0 0 0 2024-04-26T21:26:17.114 INFO:tasks.workunit.client.0.smithi084.stdout:5/954: write d0/d17/fc7 [945376,118921] 0 2024-04-26T21:26:17.118 INFO:tasks.workunit.client.0.smithi084.stdout:0/967: symlink de/d2b/d77/d32/d96/l13a 0 2024-04-26T21:26:17.124 INFO:tasks.workunit.client.0.smithi084.stdout:5/955: fsync d0/dc/df/d31/d53/d87/fe0 0 2024-04-26T21:26:17.127 INFO:tasks.workunit.client.0.smithi084.stdout:0/968: mkdir de/d2b/d77/d32/d96/dbe/d13b 0 2024-04-26T21:26:17.134 INFO:tasks.workunit.client.0.smithi084.stdout:6/907: dwrite d3/de/d15/df/f4b [4194304,4194304] 0 2024-04-26T21:26:17.142 INFO:tasks.workunit.client.0.smithi084.stdout:6/908: creat d3/de/d41/f11e x:0 0 0 2024-04-26T21:26:17.143 INFO:tasks.workunit.client.0.smithi084.stdout:5/956: getdents d0/d49/d56 0 2024-04-26T21:26:17.148 INFO:tasks.workunit.client.0.smithi084.stdout:5/957: creat d0/d49/d56/de5/f12d x:0 0 0 2024-04-26T21:26:17.151 INFO:tasks.workunit.client.0.smithi084.stdout:0/969: write de/d20/d4e/fb8 [929788,52060] 0 2024-04-26T21:26:17.152 INFO:tasks.workunit.client.0.smithi084.stdout:6/909: creat d3/f11f x:0 0 0 2024-04-26T21:26:17.160 INFO:tasks.workunit.client.0.smithi084.stdout:0/970: mkdir de/d2b/d13c 0 2024-04-26T21:26:17.164 INFO:tasks.workunit.client.0.smithi084.stdout:5/958: write d0/dc/df/d51/f81 [3490652,63027] 0 2024-04-26T21:26:17.165 INFO:tasks.workunit.client.0.smithi084.stdout:0/971: read de/d20/f5e [3889753,1831] 0 2024-04-26T21:26:17.168 INFO:tasks.workunit.client.0.smithi084.stdout:0/972: dread - de/d2b/d77/d32/d96/da0/fcc zero size 2024-04-26T21:26:17.170 INFO:tasks.workunit.client.0.smithi084.stdout:0/973: chown de/d2b/d77/d32/d96/dbe 0 1 2024-04-26T21:26:17.172 INFO:tasks.workunit.client.0.smithi084.stdout:0/974: stat de/d78/d9e/f11d 0 2024-04-26T21:26:17.174 INFO:tasks.workunit.client.0.smithi084.stdout:5/959: write d0/d49/d4d/fff [452431,130498] 0 2024-04-26T21:26:17.175 INFO:tasks.workunit.client.0.smithi084.stdout:0/975: write de/d78/d9e/f11d [777252,92072] 0 2024-04-26T21:26:17.182 INFO:tasks.workunit.client.0.smithi084.stdout:6/910: dwrite d3/de/d15/df/dae/ded/f114 [4194304,4194304] 0 2024-04-26T21:26:17.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:16 smithi120 ceph-mon[32741]: pgmap v53: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 89 MiB/s rd, 203 MiB/s wr, 466 op/s 2024-04-26T21:26:17.182 INFO:tasks.workunit.client.0.smithi084.stdout:5/960: rename d0/dc/df/d31/d53/d104/f119 to d0/d49/d4d/db3/f12e 0 2024-04-26T21:26:17.184 INFO:tasks.workunit.client.0.smithi084.stdout:5/961: write d0/d49/f126 [1186167,65235] 0 2024-04-26T21:26:17.186 INFO:tasks.workunit.client.0.smithi084.stdout:5/962: stat d0/d17/f1d 0 2024-04-26T21:26:17.193 INFO:tasks.workunit.client.0.smithi084.stdout:0/976: dwrite de/d20/d4e/fb8 [0,4194304] 0 2024-04-26T21:26:17.197 INFO:tasks.workunit.client.0.smithi084.stdout:5/963: rename d0/dc/f2f to d0/dc/df/d31/d72/dcd/f12f 0 2024-04-26T21:26:17.200 INFO:tasks.workunit.client.0.smithi084.stdout:6/911: dwrite d3/d18/d37/d110/f11a [0,4194304] 0 2024-04-26T21:26:17.204 INFO:tasks.workunit.client.0.smithi084.stdout:5/964: creat d0/dc/df/d31/d63/d6e/f130 x:0 0 0 2024-04-26T21:26:17.208 INFO:tasks.workunit.client.0.smithi084.stdout:6/912: unlink d3/de/d41/fe5 0 2024-04-26T21:26:17.222 INFO:tasks.workunit.client.0.smithi084.stdout:0/977: dwrite de/d78/f137 [0,4194304] 0 2024-04-26T21:26:17.226 INFO:tasks.workunit.client.0.smithi084.stdout:0/978: symlink de/d2b/d64/d81/d9a/l13d 0 2024-04-26T21:26:17.236 INFO:tasks.workunit.client.0.smithi084.stdout:0/979: creat de/d20/d4e/d100/d126/d114/f13e x:0 0 0 2024-04-26T21:26:17.241 INFO:tasks.workunit.client.0.smithi084.stdout:0/980: mknod de/d2b/d13c/c13f 0 2024-04-26T21:26:17.244 INFO:tasks.workunit.client.0.smithi084.stdout:0/981: mknod de/d78/d9e/c140 0 2024-04-26T21:26:17.246 INFO:tasks.workunit.client.0.smithi084.stdout:0/982: write de/d20/d4c/dae/dc2/ffd [6396,12556] 0 2024-04-26T21:26:17.253 INFO:tasks.workunit.client.0.smithi084.stdout:6/913: dread d3/de/d15/d23/f35 [0,4194304] 0 2024-04-26T21:26:17.254 INFO:tasks.workunit.client.0.smithi084.stdout:5/965: dread d0/dc/df/d31/d53/d5d/fad [0,4194304] 0 2024-04-26T21:26:17.256 INFO:tasks.workunit.client.0.smithi084.stdout:6/914: write d3/de/d1a/fb0 [2177484,85352] 0 2024-04-26T21:26:17.258 INFO:tasks.workunit.client.0.smithi084.stdout:5/966: read d0/dc/df/d6d/f73 [155152,39774] 0 2024-04-26T21:26:17.263 INFO:tasks.workunit.client.0.smithi084.stdout:0/983: dwrite de/d78/d9e/da1/fe2 [0,4194304] 0 2024-04-26T21:26:17.271 INFO:tasks.workunit.client.0.smithi084.stdout:5/967: link d0/dc/df/d31/d53/d87/fe0 d0/dc/df/d51/f131 0 2024-04-26T21:26:17.275 INFO:tasks.workunit.client.0.smithi084.stdout:5/968: write d0/dc/f19 [6659695,98092] 0 2024-04-26T21:26:17.276 INFO:tasks.workunit.client.0.smithi084.stdout:9/938: sync 2024-04-26T21:26:17.281 INFO:tasks.workunit.client.0.smithi084.stdout:9/939: chown da/de/d1e/dc9/f135 10661 1 2024-04-26T21:26:17.288 INFO:tasks.workunit.client.0.smithi084.stdout:6/915: dwrite d3/de/d15/df/dae/df4/f106 [0,4194304] 0 2024-04-26T21:26:17.288 INFO:tasks.workunit.client.0.smithi084.stdout:0/984: dwrite de/d2b/df3/ff9 [0,4194304] 0 2024-04-26T21:26:17.288 INFO:tasks.workunit.client.0.smithi084.stdout:9/940: truncate da/dd5/db6/f12e 192517 0 2024-04-26T21:26:17.289 INFO:tasks.workunit.client.0.smithi084.stdout:5/969: write d0/dc/df/d31/d72/d84/f89 [1425847,9069] 0 2024-04-26T21:26:17.294 INFO:tasks.workunit.client.0.smithi084.stdout:6/916: read d3/de/d41/d5c/de2/fdc [5198957,69065] 0 2024-04-26T21:26:17.294 INFO:tasks.workunit.client.0.smithi084.stdout:5/970: unlink d0/d17/l1b 0 2024-04-26T21:26:17.295 INFO:tasks.workunit.client.0.smithi084.stdout:9/941: write da/dd5/d93/dc3/d41/d8d/f99 [1627020,14589] 0 2024-04-26T21:26:17.297 INFO:tasks.workunit.client.0.smithi084.stdout:6/917: fdatasync d3/de/d15/d23/d90/fe4 0 2024-04-26T21:26:17.298 INFO:tasks.workunit.client.0.smithi084.stdout:0/985: chown de/d2b/df3/ld1 3356 1 2024-04-26T21:26:17.300 INFO:tasks.workunit.client.0.smithi084.stdout:5/971: dread - d0/da2/fd9 zero size 2024-04-26T21:26:17.301 INFO:tasks.workunit.client.0.smithi084.stdout:9/942: mkdir da/dd5/d93/dc3/d4f/d159 0 2024-04-26T21:26:17.302 INFO:tasks.workunit.client.0.smithi084.stdout:0/986: mknod de/d2b/d64/d81/c141 0 2024-04-26T21:26:17.306 INFO:tasks.workunit.client.0.smithi084.stdout:6/918: truncate d3/de/d15/d23/f2a 4420035 0 2024-04-26T21:26:17.308 INFO:tasks.workunit.client.0.smithi084.stdout:9/943: creat da/dd5/d93/dc3/d41/dab/f15a x:0 0 0 2024-04-26T21:26:17.311 INFO:tasks.workunit.client.0.smithi084.stdout:9/944: readlink da/dd5/d93/dc3/d41/d43/d48/l65 0 2024-04-26T21:26:17.313 INFO:tasks.workunit.client.0.smithi084.stdout:0/987: dread de/d2b/fa2 [0,4194304] 0 2024-04-26T21:26:17.313 INFO:tasks.workunit.client.0.smithi084.stdout:6/919: symlink d3/de/d41/d5c/de2/l120 0 2024-04-26T21:26:17.316 INFO:tasks.workunit.client.0.smithi084.stdout:9/945: fsync da/dd5/d93/dc3/d41/d43/d48/d61/d81/f14f 0 2024-04-26T21:26:17.316 INFO:tasks.workunit.client.0.smithi084.stdout:0/988: fdatasync de/ff0 0 2024-04-26T21:26:17.323 INFO:tasks.workunit.client.0.smithi084.stdout:6/920: rename d3/de/d1a/d2f/fab to d3/de/d1a/d43/d75/f121 0 2024-04-26T21:26:17.327 INFO:tasks.workunit.client.0.smithi084.stdout:5/972: truncate d0/dc/df/d31/d53/d87/f96 3551732 0 2024-04-26T21:26:17.333 INFO:tasks.workunit.client.0.smithi084.stdout:5/973: write d0/dc/df/d51/fbb [645119,113565] 0 2024-04-26T21:26:17.337 INFO:tasks.workunit.client.0.smithi084.stdout:9/946: dwrite da/dd5/d93/dc3/d41/d67/f9b [4194304,4194304] 0 2024-04-26T21:26:17.341 INFO:tasks.workunit.client.0.smithi084.stdout:5/974: symlink d0/dc/df/d51/d10c/l132 0 2024-04-26T21:26:17.351 INFO:tasks.workunit.client.0.smithi084.stdout:5/975: link d0/dc/df/d51/l5f d0/dc/df/d31/d72/dcd/l133 0 2024-04-26T21:26:17.354 INFO:tasks.workunit.client.0.smithi084.stdout:5/976: read - d0/dc/df/d31/d63/d6e/f130 zero size 2024-04-26T21:26:17.357 INFO:tasks.workunit.client.0.smithi084.stdout:9/947: dwrite da/db3/f116 [0,4194304] 0 2024-04-26T21:26:17.365 INFO:tasks.workunit.client.0.smithi084.stdout:9/948: creat da/de/d16/f15b x:0 0 0 2024-04-26T21:26:17.371 INFO:tasks.workunit.client.0.smithi084.stdout:5/977: dwrite d0/dc/df/fa4 [0,4194304] 0 2024-04-26T21:26:17.372 INFO:tasks.workunit.client.0.smithi084.stdout:5/978: readlink d0/dc/d48/lcb 0 2024-04-26T21:26:17.376 INFO:tasks.workunit.client.0.smithi084.stdout:5/979: mknod d0/dc/df/d31/d53/d104/c134 0 2024-04-26T21:26:17.377 INFO:tasks.workunit.client.0.smithi084.stdout:9/949: truncate da/dd5/d93/d95/fa1 3685 0 2024-04-26T21:26:17.381 INFO:tasks.workunit.client.0.smithi084.stdout:5/980: mknod d0/dc/df/d75/c135 0 2024-04-26T21:26:17.384 INFO:tasks.workunit.client.0.smithi084.stdout:9/950: mkdir da/de/d1e/dc9/d15c 0 2024-04-26T21:26:17.385 INFO:tasks.workunit.client.0.smithi084.stdout:5/981: mknod d0/dc/df/d31/d72/c136 0 2024-04-26T21:26:17.389 INFO:tasks.workunit.client.0.smithi084.stdout:5/982: creat d0/dc/df/d31/d72/dcd/f137 x:0 0 0 2024-04-26T21:26:17.394 INFO:tasks.workunit.client.0.smithi084.stdout:5/983: getdents d0/dc/df/d31/d63/dbf 0 2024-04-26T21:26:17.397 INFO:tasks.workunit.client.0.smithi084.stdout:5/984: creat d0/dc/df/d31/d53/d87/f138 x:0 0 0 2024-04-26T21:26:17.400 INFO:tasks.workunit.client.0.smithi084.stdout:9/951: dread da/dd5/d93/dc3/f4e [0,4194304] 0 2024-04-26T21:26:17.404 INFO:tasks.workunit.client.0.smithi084.stdout:5/985: dread d0/dc/df/d31/d72/d84/f89 [0,4194304] 0 2024-04-26T21:26:17.411 INFO:tasks.workunit.client.0.smithi084.stdout:5/986: link d0/dc/df/d31/d53/d87/l88 d0/dc/d48/l139 0 2024-04-26T21:26:17.412 INFO:tasks.workunit.client.0.smithi084.stdout:5/987: fsync d0/dc/df/d51/f81 0 2024-04-26T21:26:17.415 INFO:tasks.workunit.client.0.smithi084.stdout:5/988: mknod d0/d49/d4d/db3/c13a 0 2024-04-26T21:26:17.422 INFO:tasks.workunit.client.0.smithi084.stdout:9/952: dread da/de/d16/d40/f78 [0,4194304] 0 2024-04-26T21:26:17.422 INFO:tasks.workunit.client.0.smithi084.stdout:5/989: link d0/dc/df/d31/d63/d6e/ldf d0/dc/df/d51/l13b 0 2024-04-26T21:26:17.459 INFO:tasks.workunit.client.0.smithi084.stdout:9/953: mknod da/de/d1e/d56/da6/de6/c15d 0 2024-04-26T21:26:17.539 INFO:tasks.workunit.client.0.smithi084.stdout:9/954: mkdir da/dd5/d93/dc3/d4f/d15e 0 2024-04-26T21:26:17.543 INFO:tasks.workunit.client.0.smithi084.stdout:9/955: truncate da/dd5/d93/dc3/d41/d43/fd3 806414 0 2024-04-26T21:26:17.550 INFO:tasks.workunit.client.0.smithi084.stdout:9/956: getdents da/de/d1e/d56/da6 0 2024-04-26T21:26:17.551 INFO:tasks.workunit.client.0.smithi084.stdout:9/957: readlink da/dd5/d93/dc3/ldf 0 2024-04-26T21:26:17.556 INFO:tasks.workunit.client.0.smithi084.stdout:9/958: creat da/dd5/d93/dc3/d41/d43/dba/f15f x:0 0 0 2024-04-26T21:26:17.559 INFO:tasks.workunit.client.0.smithi084.stdout:9/959: readlink da/dd5/d93/dc3/d41/d8d/la4 0 2024-04-26T21:26:17.562 INFO:tasks.workunit.client.0.smithi084.stdout:9/960: creat da/dd5/d93/dc3/d4f/d104/f160 x:0 0 0 2024-04-26T21:26:17.564 INFO:tasks.workunit.client.0.smithi084.stdout:9/961: write da/dd5/d93/dc3/f52 [3509299,98786] 0 2024-04-26T21:26:17.569 INFO:tasks.workunit.client.0.smithi084.stdout:9/962: creat da/dd5/d93/dc3/d41/d43/d80/f161 x:0 0 0 2024-04-26T21:26:17.571 INFO:tasks.workunit.client.0.smithi084.stdout:9/963: write da/de/d1e/f49 [5134986,1385] 0 2024-04-26T21:26:17.582 INFO:tasks.workunit.client.0.smithi084.stdout:5/990: dwrite d0/fb7 [0,4194304] 0 2024-04-26T21:26:17.586 INFO:tasks.workunit.client.0.smithi084.stdout:5/991: dread - d0/dc/df/d31/d53/d87/f138 zero size 2024-04-26T21:26:17.602 INFO:tasks.workunit.client.0.smithi084.stdout:5/992: dwrite d0/dc/fc2 [0,4194304] 0 2024-04-26T21:26:17.605 INFO:tasks.workunit.client.0.smithi084.stdout:9/964: dwrite da/dd5/d93/dc3/d41/d43/d80/fc7 [0,4194304] 0 2024-04-26T21:26:17.608 INFO:tasks.workunit.client.0.smithi084.stdout:5/993: fsync d0/dc/fd5 0 2024-04-26T21:26:17.611 INFO:tasks.workunit.client.0.smithi084.stdout:9/965: mknod da/dd5/d93/dc3/d41/d43/c162 0 2024-04-26T21:26:17.612 INFO:tasks.workunit.client.0.smithi084.stdout:5/994: mkdir d0/df5/d13c 0 2024-04-26T21:26:17.613 INFO:tasks.workunit.client.0.smithi084.stdout:5/995: stat d0/da2/c12c 0 2024-04-26T21:26:17.619 INFO:tasks.workunit.client.0.smithi084.stdout:5/996: mknod d0/df5/d13c/c13d 0 2024-04-26T21:26:17.621 INFO:tasks.workunit.client.0.smithi084.stdout:6/921: sync 2024-04-26T21:26:17.621 INFO:tasks.workunit.client.0.smithi084.stdout:0/989: sync 2024-04-26T21:26:17.624 INFO:tasks.workunit.client.0.smithi084.stdout:6/922: chown d3/de/c73 4 1 2024-04-26T21:26:17.625 INFO:tasks.workunit.client.0.smithi084.stdout:0/990: write de/d20/d4e/d100/d126/d114/f13e [306138,21117] 0 2024-04-26T21:26:17.626 INFO:tasks.workunit.client.0.smithi084.stdout:6/923: write d3/de/d1a/d2f/d4c/ff9 [923341,45369] 0 2024-04-26T21:26:17.630 INFO:tasks.workunit.client.0.smithi084.stdout:0/991: truncate de/d2b/d77/d32/f44 1922858 0 2024-04-26T21:26:17.632 INFO:tasks.workunit.client.0.smithi084.stdout:0/992: dread - de/f11b zero size 2024-04-26T21:26:17.633 INFO:tasks.workunit.client.0.smithi084.stdout:9/966: write da/de/d16/d40/f4b [2883220,56258] 0 2024-04-26T21:26:17.636 INFO:tasks.workunit.client.0.smithi084.stdout:9/967: rmdir da/dd5 39 2024-04-26T21:26:17.636 INFO:tasks.workunit.client.0.smithi084.stdout:0/993: mknod de/d20/d4e/d117/c142 0 2024-04-26T21:26:17.640 INFO:tasks.workunit.client.0.smithi084.stdout:0/994: write de/d78/f137 [4031032,111606] 0 2024-04-26T21:26:17.644 INFO:tasks.workunit.client.0.smithi084.stdout:5/997: dwrite d0/dc/df/d6d/fc1 [0,4194304] 0 2024-04-26T21:26:17.644 INFO:tasks.workunit.client.0.smithi084.stdout:0/995: chown de/d2b/d77/l55 57719 1 2024-04-26T21:26:17.645 INFO:tasks.workunit.client.0.smithi084.stdout:6/924: dread d3/de/d41/d5c/de2/fdc [4194304,4194304] 0 2024-04-26T21:26:17.650 INFO:tasks.workunit.client.0.smithi084.stdout:5/998: read d0/dc/df/d31/d53/d5d/fad [1749465,103478] 0 2024-04-26T21:26:17.654 INFO:tasks.workunit.client.0.smithi084.stdout:0/996: write de/d78/d9e/da1/dad/f11e [730166,79038] 0 2024-04-26T21:26:17.656 INFO:tasks.workunit.client.0.smithi084.stdout:6/925: creat d3/de/d1a/d43/d75/dc4/f122 x:0 0 0 2024-04-26T21:26:17.662 INFO:tasks.workunit.client.0.smithi084.stdout:6/926: mknod d3/de/d1a/d43/d75/dfa/df6/c123 0 2024-04-26T21:26:17.665 INFO:tasks.workunit.client.0.smithi084.stdout:6/927: readlink d3/de/d1a/d43/d72/ld1 0 2024-04-26T21:26:17.666 INFO:tasks.workunit.client.0.smithi084.stdout:9/968: dread da/de/d1e/f47 [0,4194304] 0 2024-04-26T21:26:17.666 INFO:tasks.workunit.client.0.smithi084.stdout:0/997: write de/d20/d4c/fe3 [1007576,121486] 0 2024-04-26T21:26:17.668 INFO:tasks.workunit.client.0.smithi084.stdout:6/928: fsync d3/de/d15/d40/f6e 0 2024-04-26T21:26:17.671 INFO:tasks.workunit.client.0.smithi084.stdout:5/999: dwrite d0/d49/d56/f6f [0,4194304] 0 2024-04-26T21:26:17.672 INFO:tasks.workunit.client.0.smithi084.stdout:0/998: rmdir de/d20 39 2024-04-26T21:26:17.673 INFO:tasks.workunit.client.0.smithi084.stdout:9/969: write da/dd5/d93/dc3/f52 [4438251,106867] 0 2024-04-26T21:26:17.677 INFO:tasks.workunit.client.0.smithi084.stdout:6/929: truncate d3/de/d15/df/dae/df4/f118 680536 0 2024-04-26T21:26:17.681 INFO:tasks.workunit.client.0.smithi084.stdout:6/930: truncate d3/de/d1a/d43/d72/f10e 439339 0 2024-04-26T21:26:17.689 INFO:tasks.workunit.client.0.smithi084.stdout:6/931: unlink d3/d6c/lf3 0 2024-04-26T21:26:17.701 INFO:tasks.workunit.client.0.smithi084.stdout:0/999: dwrite de/d2b/d64/d81/f125 [0,4194304] 0 2024-04-26T21:26:17.720 INFO:tasks.workunit.client.0.smithi084.stdout:6/932: dread d3/de/d1a/f36 [0,4194304] 0 2024-04-26T21:26:17.721 INFO:tasks.workunit.client.0.smithi084.stdout:6/933: chown d3/de/d9e/dca/f117 19660 1 2024-04-26T21:26:17.744 INFO:tasks.workunit.client.0.smithi084.stdout:6/934: dread d3/de/d15/df/f62 [0,4194304] 0 2024-04-26T21:26:17.753 INFO:tasks.workunit.client.0.smithi084.stdout:6/935: truncate d3/de/d15/d40/f6e 2924823 0 2024-04-26T21:26:17.758 INFO:tasks.workunit.client.0.smithi084.stdout:6/936: fdatasync d3/de/d15/d23/f68 0 2024-04-26T21:26:17.964 INFO:tasks.workunit.client.0.smithi084.stdout:9/970: sync 2024-04-26T21:26:17.966 INFO:tasks.workunit.client.0.smithi084.stdout:9/971: fsync da/de/d1e/d56/da6/de6/f123 0 2024-04-26T21:26:18.032 INFO:tasks.workunit.client.0.smithi084.stdout:9/972: dwrite da/de/d16/f112 [0,4194304] 0 2024-04-26T21:26:18.038 INFO:tasks.workunit.client.0.smithi084.stdout:9/973: symlink da/dd5/d93/dc3/d41/de4/l163 0 2024-04-26T21:26:18.041 INFO:tasks.workunit.client.0.smithi084.stdout:9/974: chown da/dd5/db6/cf9 156 1 2024-04-26T21:26:18.177 INFO:tasks.workunit.client.0.smithi084.stdout:6/937: sync 2024-04-26T21:26:18.189 INFO:tasks.workunit.client.0.smithi084.stdout:6/938: fsync d3/de/d1a/d43/d72/dad/fc2 0 2024-04-26T21:26:18.192 INFO:tasks.workunit.client.0.smithi084.stdout:6/939: chown d3/de/d41/d5c/cb4 2705 1 2024-04-26T21:26:18.206 INFO:tasks.workunit.client.0.smithi084.stdout:9/975: sync 2024-04-26T21:26:18.219 INFO:tasks.workunit.client.0.smithi084.stdout:9/976: write da/dd5/d93/dc3/d41/d43/dba/f107 [4796292,129142] 0 2024-04-26T21:26:18.220 INFO:tasks.workunit.client.0.smithi084.stdout:6/940: dwrite d3/f26 [4194304,4194304] 0 2024-04-26T21:26:18.235 INFO:tasks.workunit.client.0.smithi084.stdout:9/977: creat da/dd5/d93/dc3/d4f/f164 x:0 0 0 2024-04-26T21:26:18.242 INFO:tasks.workunit.client.0.smithi084.stdout:6/941: dwrite d3/d18/fc6 [0,4194304] 0 2024-04-26T21:26:18.245 INFO:tasks.workunit.client.0.smithi084.stdout:9/978: creat da/dd5/d93/dc3/d4f/d159/f165 x:0 0 0 2024-04-26T21:26:18.249 INFO:tasks.workunit.client.0.smithi084.stdout:9/979: chown da/dd5/d93/dc3/ldf 2608 1 2024-04-26T21:26:18.269 INFO:tasks.workunit.client.0.smithi084.stdout:9/980: rename da/de/d16/dbc to da/dd5/d93/dc3/d41/d67/de9/d166 0 2024-04-26T21:26:18.278 INFO:tasks.workunit.client.0.smithi084.stdout:9/981: dread da/f100 [0,4194304] 0 2024-04-26T21:26:18.280 INFO:tasks.workunit.client.0.smithi084.stdout:9/982: chown da/dd5/d93/dc3/d41/dab 27 1 2024-04-26T21:26:18.283 INFO:tasks.workunit.client.0.smithi084.stdout:9/983: mknod da/de/d1e/dc9/d15c/c167 0 2024-04-26T21:26:18.323 INFO:tasks.workunit.client.0.smithi084.stdout:9/984: dread da/dd5/d93/dc3/d41/d43/fb2 [0,4194304] 0 2024-04-26T21:26:18.347 INFO:tasks.workunit.client.0.smithi084.stdout:9/985: truncate da/f46 69367 0 2024-04-26T21:26:18.350 INFO:tasks.workunit.client.0.smithi084.stdout:9/986: write da/dd5/d93/dc3/d41/d43/d48/f58 [3982850,114443] 0 2024-04-26T21:26:18.357 INFO:tasks.workunit.client.0.smithi084.stdout:9/987: creat da/dd5/d93/dc3/d41/d43/dba/f168 x:0 0 0 2024-04-26T21:26:18.361 INFO:tasks.workunit.client.0.smithi084.stdout:9/988: chown da/dd5/d93/dc3/d41/d43/d48/d61/d81/f14f 82 1 2024-04-26T21:26:18.369 INFO:tasks.workunit.client.0.smithi084.stdout:9/989: symlink da/dd5/d93/dc3/l169 0 2024-04-26T21:26:18.374 INFO:tasks.workunit.client.0.smithi084.stdout:9/990: symlink da/dd5/d93/dc3/d41/d8d/dca/l16a 0 2024-04-26T21:26:18.377 INFO:tasks.workunit.client.0.smithi084.stdout:9/991: dread - da/dd5/d93/dc3/d41/d43/d80/f161 zero size 2024-04-26T21:26:18.379 INFO:tasks.workunit.client.0.smithi084.stdout:9/992: stat da/dd5/d93/dc3/d41/d67/de9/d152 0 2024-04-26T21:26:18.381 INFO:tasks.workunit.client.0.smithi084.stdout:9/993: readlink da/dd5/d93/dc3/d4f/lc0 0 2024-04-26T21:26:18.393 INFO:tasks.workunit.client.0.smithi084.stdout:9/994: dread da/dd5/d93/dc3/d41/d67/f97 [0,4194304] 0 2024-04-26T21:26:18.409 INFO:tasks.workunit.client.0.smithi084.stdout:9/995: dwrite da/dd5/d93/dc3/d41/d8d/dca/f121 [0,4194304] 0 2024-04-26T21:26:18.413 INFO:tasks.workunit.client.0.smithi084.stdout:9/996: write da/dd5/d93/dc3/d41/f91 [1898893,119592] 0 2024-04-26T21:26:18.413 INFO:tasks.workunit.client.0.smithi084.stdout:6/942: sync 2024-04-26T21:26:18.432 INFO:tasks.workunit.client.0.smithi084.stdout:6/943: rename d3/de/d9e/f103 to d3/de/d1a/d43/d75/dfa/f124 0 2024-04-26T21:26:18.438 INFO:tasks.workunit.client.0.smithi084.stdout:9/997: getdents da/dd5/d93/dc3/d41/d43/d48/d61/df0 0 2024-04-26T21:26:18.446 INFO:tasks.workunit.client.0.smithi084.stdout:6/944: rename d3/de/d15/df/dae/df4/dfb/f102 to d3/de/d9e/f125 0 2024-04-26T21:26:18.450 INFO:tasks.workunit.client.0.smithi084.stdout:9/998: creat da/dd5/d93/dc3/d41/d67/de9/d14c/f16b x:0 0 0 2024-04-26T21:26:18.455 INFO:tasks.workunit.client.0.smithi084.stdout:9/999: truncate da/dd5/d93/dc3/d41/f130 738375 0 2024-04-26T21:26:18.458 INFO:tasks.workunit.client.0.smithi084.stdout:6/945: rename d3/de/d15/df/dae/df4/dfb/f113 to d3/de/d1a/d43/d75/dc4/dea/f126 0 2024-04-26T21:26:18.462 INFO:tasks.workunit.client.0.smithi084.stdout:6/946: chown d3/de/d15/d23/d104/l11c 19 1 2024-04-26T21:26:18.470 INFO:tasks.workunit.client.0.smithi084.stdout:6/947: symlink d3/d18/d81/l127 0 2024-04-26T21:26:18.475 INFO:tasks.workunit.client.0.smithi084.stdout:6/948: symlink d3/de/d9e/dca/l128 0 2024-04-26T21:26:18.480 INFO:tasks.workunit.client.0.smithi084.stdout:6/949: symlink d3/de/d15/d40/l129 0 2024-04-26T21:26:18.480 INFO:tasks.workunit.client.0.smithi084.stdout:6/950: chown d3/d6c 194943 1 2024-04-26T21:26:18.521 INFO:tasks.workunit.client.0.smithi084.stdout:6/951: dread d3/d18/d81/f8a [0,4194304] 0 2024-04-26T21:26:18.532 INFO:tasks.workunit.client.0.smithi084.stdout:6/952: dread d3/d18/f20 [4194304,4194304] 0 2024-04-26T21:26:18.558 INFO:tasks.workunit.client.0.smithi084.stdout:6/953: dwrite d3/d18/f38 [4194304,4194304] 0 2024-04-26T21:26:18.565 INFO:tasks.workunit.client.0.smithi084.stdout:6/954: mknod d3/de/d1a/d2f/d4c/d58/c12a 0 2024-04-26T21:26:18.581 INFO:tasks.workunit.client.0.smithi084.stdout:6/955: link d3/de/d41/c100 d3/de/d15/df/dae/df4/dd3/c12b 0 2024-04-26T21:26:18.599 INFO:tasks.workunit.client.0.smithi084.stdout:6/956: write d3/d18/f8d [781578,58461] 0 2024-04-26T21:26:18.603 INFO:tasks.workunit.client.0.smithi084.stdout:6/957: mkdir d3/de/d9e/dca/d12c 0 2024-04-26T21:26:18.631 INFO:tasks.workunit.client.0.smithi084.stdout:6/958: dwrite d3/fcb [0,4194304] 0 2024-04-26T21:26:18.636 INFO:tasks.workunit.client.0.smithi084.stdout:6/959: mkdir d3/de/d1a/d43/d12d 0 2024-04-26T21:26:18.638 INFO:tasks.workunit.client.0.smithi084.stdout:6/960: write d3/de/d1a/d2f/d4c/ff9 [450984,69305] 0 2024-04-26T21:26:18.644 INFO:tasks.workunit.client.0.smithi084.stdout:6/961: creat d3/de/d1a/d43/d72/dad/f12e x:0 0 0 2024-04-26T21:26:18.650 INFO:tasks.workunit.client.0.smithi084.stdout:6/962: mkdir d3/de/d1a/d43/d75/dc4/d12f 0 2024-04-26T21:26:18.655 INFO:tasks.workunit.client.0.smithi084.stdout:6/963: symlink d3/de/d1a/d43/d72/dad/d112/l130 0 2024-04-26T21:26:18.759 INFO:tasks.workunit.client.0.smithi084.stdout:6/964: dwrite d3/de/d15/df/dae/df4/f118 [0,4194304] 0 2024-04-26T21:26:18.760 INFO:tasks.workunit.client.0.smithi084.stdout:6/965: dwrite d3/de/f63 [0,4194304] 0 2024-04-26T21:26:18.760 INFO:tasks.workunit.client.0.smithi084.stdout:6/966: truncate d3/de/d15/d23/f2e 7780242 0 2024-04-26T21:26:18.760 INFO:tasks.workunit.client.0.smithi084.stdout:6/967: unlink d3/fcb 0 2024-04-26T21:26:18.760 INFO:tasks.workunit.client.0.smithi084.stdout:6/968: chown d3/de/d1a/d43/c80 25 1 2024-04-26T21:26:18.760 INFO:tasks.workunit.client.0.smithi084.stdout:6/969: creat d3/de/d41/d5c/f131 x:0 0 0 2024-04-26T21:26:18.760 INFO:tasks.workunit.client.0.smithi084.stdout:6/970: write d3/de/d15/d40/f6e [2637911,57906] 0 2024-04-26T21:26:18.760 INFO:tasks.workunit.client.0.smithi084.stdout:6/971: fdatasync d3/de/d15/df/dae/fb2 0 2024-04-26T21:26:18.760 INFO:tasks.workunit.client.0.smithi084.stdout:6/972: mknod d3/de/d1a/d2f/d4c/c132 0 2024-04-26T21:26:18.760 INFO:tasks.workunit.client.0.smithi084.stdout:6/973: write d3/de/d1a/d43/d75/fbd [590056,87509] 0 2024-04-26T21:26:18.767 INFO:tasks.workunit.client.0.smithi084.stdout:6/974: rename d3/de/d1a/d2f/d4c/c98 to d3/de/d15/d23/d90/da2/c133 0 2024-04-26T21:26:18.786 INFO:tasks.workunit.client.0.smithi084.stdout:6/975: dwrite d3/d18/f38 [4194304,4194304] 0 2024-04-26T21:26:18.790 INFO:tasks.workunit.client.0.smithi084.stdout:6/976: creat d3/de/d15/d40/f134 x:0 0 0 2024-04-26T21:26:18.822 INFO:tasks.workunit.client.0.smithi084.stdout:6/977: dwrite d3/de/d5d/f89 [0,4194304] 0 2024-04-26T21:26:18.826 INFO:tasks.workunit.client.0.smithi084.stdout:6/978: chown d3/d18/d37/d110/f116 448 1 2024-04-26T21:26:18.832 INFO:tasks.workunit.client.0.smithi084.stdout:6/979: creat d3/de/d15/df/dae/ded/dee/f135 x:0 0 0 2024-04-26T21:26:18.835 INFO:tasks.workunit.client.0.smithi084.stdout:6/980: creat d3/d6c/f136 x:0 0 0 2024-04-26T21:26:18.837 INFO:tasks.workunit.client.0.smithi084.stdout:6/981: stat d3/de/d1a/d43/d72/dad/ffc 0 2024-04-26T21:26:18.849 INFO:tasks.workunit.client.0.smithi084.stdout:6/982: dread d3/de/d1a/d43/f2d [0,4194304] 0 2024-04-26T21:26:18.871 INFO:tasks.workunit.client.0.smithi084.stdout:6/983: dwrite d3/de/d15/df/dae/df4/dfb/fd2 [0,4194304] 0 2024-04-26T21:26:18.873 INFO:tasks.workunit.client.0.smithi084.stdout:6/984: readlink d3/de/d15/l46 0 2024-04-26T21:26:18.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:18 smithi084 ceph-mon[25539]: pgmap v54: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 118 MiB/s rd, 265 MiB/s wr, 636 op/s 2024-04-26T21:26:18.935 INFO:tasks.workunit.client.0.smithi084.stdout:6/985: link d3/de/d15/d40/dcd/fe1 d3/de/d15/d23/d90/f137 0 2024-04-26T21:26:18.939 INFO:tasks.workunit.client.0.smithi084.stdout:6/986: dread - d3/de/d15/d23/d90/f137 zero size 2024-04-26T21:26:18.943 INFO:tasks.workunit.client.0.smithi084.stdout:6/987: fsync d3/de/d1a/d43/d72/f94 0 2024-04-26T21:26:18.944 INFO:tasks.workunit.client.0.smithi084.stdout:6/988: chown d3/de/d1a 14753 1 2024-04-26T21:26:18.946 INFO:tasks.workunit.client.0.smithi084.stdout:6/989: chown d3/d18/l54 89 1 2024-04-26T21:26:18.966 INFO:tasks.workunit.client.0.smithi084.stdout:6/990: dread d3/de/d15/d23/f30 [0,4194304] 0 2024-04-26T21:26:18.968 INFO:tasks.workunit.client.0.smithi084.stdout:6/991: stat d3/de/d1a/d43/d75/dc4/f122 0 2024-04-26T21:26:18.972 INFO:tasks.workunit.client.0.smithi084.stdout:6/992: mknod d3/de/d1a/d43/c138 0 2024-04-26T21:26:18.973 INFO:tasks.workunit.client.0.smithi084.stdout:6/993: dread - d3/de/d9e/dca/f117 zero size 2024-04-26T21:26:18.974 INFO:tasks.workunit.client.0.smithi084.stdout:6/994: readlink d3/de/d1a/d43/l78 0 2024-04-26T21:26:18.977 INFO:tasks.workunit.client.0.smithi084.stdout:6/995: mknod d3/de/d1a/d43/d72/dad/d112/c139 0 2024-04-26T21:26:18.978 INFO:tasks.workunit.client.0.smithi084.stdout:6/996: readlink d3/de/d15/d23/ldd 0 2024-04-26T21:26:18.981 INFO:tasks.workunit.client.0.smithi084.stdout:6/997: symlink d3/de/d5d/l13a 0 2024-04-26T21:26:18.990 INFO:tasks.workunit.client.0.smithi084.stdout:6/998: truncate d3/d18/d37/f92 3874711 0 2024-04-26T21:26:18.997 INFO:tasks.workunit.client.0.smithi084.stdout:6/999: write d3/de/d15/d23/d90/da2/fd7 [3933993,91249] 0 2024-04-26T21:26:19.006 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm -rf -- ./tmp.xVAnkYFrMT 2024-04-26T21:26:19.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:18 smithi120 ceph-mon[32741]: pgmap v54: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 118 MiB/s rd, 265 MiB/s wr, 636 op/s 2024-04-26T21:26:21.551 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: pgmap v55: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 76 MiB/s rd, 160 MiB/s wr, 408 op/s 2024-04-26T21:26:21.551 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:26:21.552 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:26:21.552 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:26:21.552 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:26:21.552 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:26:21.552 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:26:21.552 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mgr fail", "who": "smithi120.zjaduj"}]: dispatch 2024-04-26T21:26:21.552 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mgr fail", "who": "smithi120.zjaduj"}]: dispatch 2024-04-26T21:26:21.552 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: Activating manager daemon smithi084.gyasul 2024-04-26T21:26:21.552 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: osdmap e47: 6 total, 6 up, 6 in 2024-04-26T21:26:21.552 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd='[{"prefix": "mgr fail", "who": "smithi120.zjaduj"}]': finished 2024-04-26T21:26:21.552 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: mgrmap e28: smithi084.gyasul(active, starting, since 0.0168675s) 2024-04-26T21:26:21.552 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-04-26T21:26:21.552 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:26:21.552 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.hbjunw"}]: dispatch 2024-04-26T21:26:21.552 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.rtrqtr"}]: dispatch 2024-04-26T21:26:21.553 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.qnkxcn"}]: dispatch 2024-04-26T21:26:21.553 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.ufqfoh"}]: dispatch 2024-04-26T21:26:21.553 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr metadata", "who": "smithi084.gyasul", "id": "smithi084.gyasul"}]: dispatch 2024-04-26T21:26:21.553 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:26:21.553 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:26:21.553 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:26:21.553 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:26:21.553 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:26:21.553 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:26:21.553 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T21:26:21.553 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T21:26:21.553 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T21:26:21.553 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: Manager daemon smithi084.gyasul is now available 2024-04-26T21:26:21.553 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:26:21.553 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.gyasul/mirror_snapshot_schedule"}]: dispatch 2024-04-26T21:26:21.553 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:26:21.554 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.gyasul/trash_purge_schedule"}]: dispatch 2024-04-26T21:26:21.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: pgmap v55: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 76 MiB/s rd, 160 MiB/s wr, 408 op/s 2024-04-26T21:26:21.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:26:21.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:26:21.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:26:21.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:26:21.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' 2024-04-26T21:26:21.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:26:21.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.14662 172.21.15.120:0/1534095546' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mgr fail", "who": "smithi120.zjaduj"}]: dispatch 2024-04-26T21:26:21.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "mgr fail", "who": "smithi120.zjaduj"}]: dispatch 2024-04-26T21:26:21.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: Activating manager daemon smithi084.gyasul 2024-04-26T21:26:21.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: osdmap e47: 6 total, 6 up, 6 in 2024-04-26T21:26:21.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.14662 ' entity='mgr.smithi120.zjaduj' cmd='[{"prefix": "mgr fail", "who": "smithi120.zjaduj"}]': finished 2024-04-26T21:26:21.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: mgrmap e28: smithi084.gyasul(active, starting, since 0.0168675s) 2024-04-26T21:26:21.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-04-26T21:26:21.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:26:21.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.hbjunw"}]: dispatch 2024-04-26T21:26:21.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.rtrqtr"}]: dispatch 2024-04-26T21:26:21.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.qnkxcn"}]: dispatch 2024-04-26T21:26:21.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.ufqfoh"}]: dispatch 2024-04-26T21:26:21.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr metadata", "who": "smithi084.gyasul", "id": "smithi084.gyasul"}]: dispatch 2024-04-26T21:26:21.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:26:21.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:26:21.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:26:21.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:26:21.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:26:21.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:26:21.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T21:26:21.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T21:26:21.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T21:26:21.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: Manager daemon smithi084.gyasul is now available 2024-04-26T21:26:21.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:26:21.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.gyasul/mirror_snapshot_schedule"}]: dispatch 2024-04-26T21:26:21.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:26:21.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.gyasul/trash_purge_schedule"}]: dispatch 2024-04-26T21:26:22.915 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:22 smithi084 ceph-mon[25539]: mgrmap e29: smithi084.gyasul(active, since 1.02221s) 2024-04-26T21:26:22.915 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:22 smithi084 ceph-mon[25539]: pgmap v3: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail 2024-04-26T21:26:22.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:22 smithi120 ceph-mon[32741]: mgrmap e29: smithi084.gyasul(active, since 1.02221s) 2024-04-26T21:26:22.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:22 smithi120 ceph-mon[32741]: pgmap v3: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail 2024-04-26T21:26:23.801 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:23 smithi084 ceph-mon[25539]: mgrmap e30: smithi084.gyasul(active, since 2s) 2024-04-26T21:26:23.801 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:23 smithi084 ceph-mon[25539]: [26/Apr/2024:21:26:22] ENGINE Bus STARTING 2024-04-26T21:26:23.801 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:23 smithi084 ceph-mon[25539]: [26/Apr/2024:21:26:22] ENGINE Serving on http://172.21.15.84:8765 2024-04-26T21:26:23.801 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:23 smithi084 ceph-mon[25539]: [26/Apr/2024:21:26:23] ENGINE Serving on https://172.21.15.84:7150 2024-04-26T21:26:23.801 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:23 smithi084 ceph-mon[25539]: [26/Apr/2024:21:26:23] ENGINE Bus STARTED 2024-04-26T21:26:23.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:23 smithi120 ceph-mon[32741]: mgrmap e30: smithi084.gyasul(active, since 2s) 2024-04-26T21:26:23.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:23 smithi120 ceph-mon[32741]: [26/Apr/2024:21:26:22] ENGINE Bus STARTING 2024-04-26T21:26:23.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:23 smithi120 ceph-mon[32741]: [26/Apr/2024:21:26:22] ENGINE Serving on http://172.21.15.84:8765 2024-04-26T21:26:23.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:23 smithi120 ceph-mon[32741]: [26/Apr/2024:21:26:23] ENGINE Serving on https://172.21.15.84:7150 2024-04-26T21:26:23.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:23 smithi120 ceph-mon[32741]: [26/Apr/2024:21:26:23] ENGINE Bus STARTED 2024-04-26T21:26:25.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:25 smithi084 ceph-mon[25539]: pgmap v5: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail 2024-04-26T21:26:25.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:25 smithi084 ceph-mon[25539]: mgrmap e31: smithi084.gyasul(active, since 4s) 2024-04-26T21:26:25.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:25 smithi120 ceph-mon[32741]: pgmap v5: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail 2024-04-26T21:26:25.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:25 smithi120 ceph-mon[32741]: mgrmap e31: smithi084.gyasul(active, since 4s) 2024-04-26T21:26:27.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.095+0000 7fb86f200700 1 -- 172.21.15.84:0/3660843983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8700ff720 msgr2=0x7fb870100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:27.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.095+0000 7fb86f200700 1 --2- 172.21.15.84:0/3660843983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8700ff720 0x7fb870100080 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb85c004940 tx=0x7fb85c009e30 comp rx=0 tx=0).stop 2024-04-26T21:26:27.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.095+0000 7fb86f200700 1 -- 172.21.15.84:0/3660843983 shutdown_connections 2024-04-26T21:26:27.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.095+0000 7fb86f200700 1 --2- 172.21.15.84:0/3660843983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8700ff720 0x7fb870100080 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:27.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.095+0000 7fb86f200700 1 --2- 172.21.15.84:0/3660843983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8700fedd0 0x7fb8700ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:27.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.095+0000 7fb86f200700 1 -- 172.21.15.84:0/3660843983 >> 172.21.15.84:0/3660843983 conn(0x7fb8700fa570 msgr2=0x7fb8700fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:26:27.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.095+0000 7fb86f200700 1 -- 172.21.15.84:0/3660843983 shutdown_connections 2024-04-26T21:26:27.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.095+0000 7fb86f200700 1 -- 172.21.15.84:0/3660843983 wait complete. 2024-04-26T21:26:27.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.096+0000 7fb86f200700 1 Processor -- start 2024-04-26T21:26:27.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.097+0000 7fb86f200700 1 -- start start 2024-04-26T21:26:27.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.097+0000 7fb86f200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8700fedd0 0x7fb87010f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:27.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.097+0000 7fb86f200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8700ff720 0x7fb87010ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:27.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.097+0000 7fb86f200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb870110530 con 0x7fb8700fedd0 2024-04-26T21:26:27.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.097+0000 7fb86f200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb870110d80 con 0x7fb8700ff720 2024-04-26T21:26:27.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.097+0000 7fb86d400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8700ff720 0x7fb87010ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:27.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.097+0000 7fb86de00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8700fedd0 0x7fb87010f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:27.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.097+0000 7fb86d400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8700ff720 0x7fb87010ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:60380/0 (socket says 172.21.15.84:60380) 2024-04-26T21:26:27.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.097+0000 7fb86d400700 1 -- 172.21.15.84:0/2345481237 learned_addr learned my addr 172.21.15.84:0/2345481237 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:26:27.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.098+0000 7fb86de00700 1 -- 172.21.15.84:0/2345481237 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8700ff720 msgr2=0x7fb87010ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:27.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.098+0000 7fb86de00700 1 --2- 172.21.15.84:0/2345481237 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8700ff720 0x7fb87010ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:27.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.098+0000 7fb86de00700 1 -- 172.21.15.84:0/2345481237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c005040 con 0x7fb8700fedd0 2024-04-26T21:26:27.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.098+0000 7fb86de00700 1 --2- 172.21.15.84:0/2345481237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8700fedd0 0x7fb87010f9f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb8700ffbd0 tx=0x7fb86000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:26:27.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.099+0000 7fb866000700 1 -- 172.21.15.84:0/2345481237 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb860004e90 con 0x7fb8700fedd0 2024-04-26T21:26:27.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.099+0000 7fb866000700 1 -- 172.21.15.84:0/2345481237 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb86000f040 con 0x7fb8700fedd0 2024-04-26T21:26:27.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.099+0000 7fb86f200700 1 -- 172.21.15.84:0/2345481237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb870111000 con 0x7fb8700fedd0 2024-04-26T21:26:27.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.099+0000 7fb866000700 1 -- 172.21.15.84:0/2345481237 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb86000c950 con 0x7fb8700fedd0 2024-04-26T21:26:27.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.099+0000 7fb86f200700 1 -- 172.21.15.84:0/2345481237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb870111540 con 0x7fb8700fedd0 2024-04-26T21:26:27.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.100+0000 7fb866000700 1 -- 172.21.15.84:0/2345481237 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 46566+0+0 (secure 0 0 0) 0x7fb86000cab0 con 0x7fb8700fedd0 2024-04-26T21:26:27.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.101+0000 7fb866000700 1 --2- 172.21.15.84:0/2345481237 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fb8540394c0 0x7fb85403b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:27.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.101+0000 7fb866000700 1 -- 172.21.15.84:0/2345481237 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fb86004cde0 con 0x7fb8700fedd0 2024-04-26T21:26:27.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.101+0000 7fb86f200700 1 -- 172.21.15.84:0/2345481237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87005f5c0 con 0x7fb8700fedd0 2024-04-26T21:26:27.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.101+0000 7fb86d400700 1 --2- 172.21.15.84:0/2345481237 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fb8540394c0 0x7fb85403b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:27.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.103+0000 7fb86d400700 1 --2- 172.21.15.84:0/2345481237 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fb8540394c0 0x7fb85403b970 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009fd0 tx=0x7fb85c009e30 comp rx=0 tx=0).ready entity=mgr.24429 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:26:27.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.110+0000 7fb866000700 1 -- 172.21.15.84:0/2345481237 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fb860019080 con 0x7fb8700fedd0 2024-04-26T21:26:27.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:27 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:27.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:27 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:27.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:27 smithi084 ceph-mon[25539]: pgmap v6: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 12 KiB/s rd, 576 KiB/s wr, 83 op/s 2024-04-26T21:26:27.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.466+0000 7fb86f200700 1 -- 172.21.15.84:0/2345481237 --> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb870111890 con 0x7fb8540394c0 2024-04-26T21:26:27.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.476+0000 7fb866000700 1 -- 172.21.15.84:0/2345481237 <== mgr.24429 v2:172.21.15.84:6800/3665499318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fb870111890 con 0x7fb8540394c0 2024-04-26T21:26:27.479 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:27 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:27.479 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:27 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:27.479 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:27 smithi120 ceph-mon[32741]: pgmap v6: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 12 KiB/s rd, 576 KiB/s wr, 83 op/s 2024-04-26T21:26:27.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.479+0000 7fb86f200700 1 -- 172.21.15.84:0/2345481237 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fb8540394c0 msgr2=0x7fb85403b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:27.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.479+0000 7fb86f200700 1 --2- 172.21.15.84:0/2345481237 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fb8540394c0 0x7fb85403b970 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009fd0 tx=0x7fb85c009e30 comp rx=0 tx=0).stop 2024-04-26T21:26:27.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.479+0000 7fb86f200700 1 -- 172.21.15.84:0/2345481237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8700fedd0 msgr2=0x7fb87010f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:27.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.479+0000 7fb86f200700 1 --2- 172.21.15.84:0/2345481237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8700fedd0 0x7fb87010f9f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb8700ffbd0 tx=0x7fb86000b040 comp rx=0 tx=0).stop 2024-04-26T21:26:27.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.480+0000 7fb86f200700 1 -- 172.21.15.84:0/2345481237 shutdown_connections 2024-04-26T21:26:27.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.480+0000 7fb86f200700 1 --2- 172.21.15.84:0/2345481237 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fb8540394c0 0x7fb85403b970 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:27.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.480+0000 7fb86f200700 1 --2- 172.21.15.84:0/2345481237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8700fedd0 0x7fb87010f9f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:27.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.480+0000 7fb86f200700 1 --2- 172.21.15.84:0/2345481237 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8700ff720 0x7fb87010ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:27.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.480+0000 7fb86f200700 1 -- 172.21.15.84:0/2345481237 >> 172.21.15.84:0/2345481237 conn(0x7fb8700fa570 msgr2=0x7fb8700fbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:26:27.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.483+0000 7fb86f200700 1 -- 172.21.15.84:0/2345481237 shutdown_connections 2024-04-26T21:26:27.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.483+0000 7fb86f200700 1 -- 172.21.15.84:0/2345481237 wait complete. 2024-04-26T21:26:27.503 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:26:27.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.662+0000 7f85dc000700 1 -- 172.21.15.84:0/1995399132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85d40fcf10 msgr2=0x7f85d40fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:27.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.662+0000 7f85dc000700 1 --2- 172.21.15.84:0/1995399132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85d40fcf10 0x7f85d40fd320 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f85c8004940 tx=0x7f85c8009e30 comp rx=0 tx=0).stop 2024-04-26T21:26:27.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.662+0000 7f85dc000700 1 -- 172.21.15.84:0/1995399132 shutdown_connections 2024-04-26T21:26:27.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.662+0000 7f85dc000700 1 --2- 172.21.15.84:0/1995399132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85d40fe080 0x7f85d40fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:27.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.662+0000 7f85dc000700 1 --2- 172.21.15.84:0/1995399132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85d40fcf10 0x7f85d40fd320 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:27.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.662+0000 7f85dc000700 1 -- 172.21.15.84:0/1995399132 >> 172.21.15.84:0/1995399132 conn(0x7f85d40f8560 msgr2=0x7f85d40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:26:27.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.662+0000 7f85dc000700 1 -- 172.21.15.84:0/1995399132 shutdown_connections 2024-04-26T21:26:27.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.662+0000 7f85dc000700 1 -- 172.21.15.84:0/1995399132 wait complete. 2024-04-26T21:26:27.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.663+0000 7f85dc000700 1 Processor -- start 2024-04-26T21:26:27.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.664+0000 7f85dc000700 1 -- start start 2024-04-26T21:26:27.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.664+0000 7f85dc000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85d40fcf10 0x7f85d410fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:27.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.664+0000 7f85dc000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85d40fe080 0x7f85d41100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:27.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.664+0000 7f85dc000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d41106d0 con 0x7f85d40fcf10 2024-04-26T21:26:27.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.664+0000 7f85dc000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d4110f20 con 0x7f85d40fe080 2024-04-26T21:26:27.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.664+0000 7f85d9600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85d40fcf10 0x7f85d410fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:27.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.664+0000 7f85d8c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85d40fe080 0x7f85d41100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:27.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.664+0000 7f85d8c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85d40fe080 0x7f85d41100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:60388/0 (socket says 172.21.15.84:60388) 2024-04-26T21:26:27.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.664+0000 7f85d8c00700 1 -- 172.21.15.84:0/996593752 learned_addr learned my addr 172.21.15.84:0/996593752 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:26:27.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.665+0000 7f85d8c00700 1 -- 172.21.15.84:0/996593752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85d40fcf10 msgr2=0x7f85d410fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:27.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.665+0000 7f85d8c00700 1 --2- 172.21.15.84:0/996593752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85d40fcf10 0x7f85d410fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:27.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.665+0000 7f85d8c00700 1 -- 172.21.15.84:0/996593752 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c8005040 con 0x7f85d40fe080 2024-04-26T21:26:27.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.665+0000 7f85d8c00700 1 --2- 172.21.15.84:0/996593752 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85d40fe080 0x7f85d41100d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f85c000eb40 tx=0x7f85c000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:26:27.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.666+0000 7f85d1600700 1 -- 172.21.15.84:0/996593752 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85c0007cc0 con 0x7f85d40fe080 2024-04-26T21:26:27.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.666+0000 7f85d1600700 1 -- 172.21.15.84:0/996593752 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f85c000f040 con 0x7f85d40fe080 2024-04-26T21:26:27.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.666+0000 7f85d1600700 1 -- 172.21.15.84:0/996593752 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85c000ca10 con 0x7f85d40fe080 2024-04-26T21:26:27.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.666+0000 7f85dc000700 1 -- 172.21.15.84:0/996593752 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d41111a0 con 0x7f85d40fe080 2024-04-26T21:26:27.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.666+0000 7f85dc000700 1 -- 172.21.15.84:0/996593752 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d4111690 con 0x7f85d40fe080 2024-04-26T21:26:27.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.667+0000 7f85d1600700 1 -- 172.21.15.84:0/996593752 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 31) v1 ==== 46566+0+0 (secure 0 0 0) 0x7f85c000cc80 con 0x7f85d40fe080 2024-04-26T21:26:27.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.668+0000 7f85dc000700 1 -- 172.21.15.84:0/996593752 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d4101a10 con 0x7f85d40fe080 2024-04-26T21:26:27.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.668+0000 7f85d1600700 1 --2- 172.21.15.84:0/996593752 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f85bc039480 0x7f85bc03b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:27.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.668+0000 7f85d1600700 1 -- 172.21.15.84:0/996593752 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f85c004cf70 con 0x7f85d40fe080 2024-04-26T21:26:27.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.669+0000 7f85d9600700 1 --2- 172.21.15.84:0/996593752 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f85bc039480 0x7f85bc03b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:27.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.670+0000 7f85d9600700 1 --2- 172.21.15.84:0/996593752 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f85bc039480 0x7f85bc03b930 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f85c8009fd0 tx=0x7f85c8009e30 comp rx=0 tx=0).ready entity=mgr.24429 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:26:27.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:27.675+0000 7f85d1600700 1 -- 172.21.15.84:0/996593752 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f85c0081930 con 0x7f85d40fe080 2024-04-26T21:26:28.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.026+0000 7f85dc000700 1 -- 172.21.15.84:0/996593752 --> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f85d4111900 con 0x7f85bc039480 2024-04-26T21:26:28.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.029+0000 7f85d1600700 1 -- 172.21.15.84:0/996593752 <== mgr.24429 v2:172.21.15.84:6800/3665499318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f85d4111900 con 0x7f85bc039480 2024-04-26T21:26:28.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.034+0000 7f85dc000700 1 -- 172.21.15.84:0/996593752 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f85bc039480 msgr2=0x7f85bc03b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:28.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.034+0000 7f85dc000700 1 --2- 172.21.15.84:0/996593752 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f85bc039480 0x7f85bc03b930 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f85c8009fd0 tx=0x7f85c8009e30 comp rx=0 tx=0).stop 2024-04-26T21:26:28.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.034+0000 7f85dc000700 1 -- 172.21.15.84:0/996593752 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85d40fe080 msgr2=0x7f85d41100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:28.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.034+0000 7f85dc000700 1 --2- 172.21.15.84:0/996593752 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85d40fe080 0x7f85d41100d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f85c000eb40 tx=0x7f85c000b040 comp rx=0 tx=0).stop 2024-04-26T21:26:28.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.035+0000 7f85dc000700 1 -- 172.21.15.84:0/996593752 shutdown_connections 2024-04-26T21:26:28.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.035+0000 7f85dc000700 1 --2- 172.21.15.84:0/996593752 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f85bc039480 0x7f85bc03b930 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:28.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.035+0000 7f85dc000700 1 --2- 172.21.15.84:0/996593752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85d40fcf10 0x7f85d410fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:28.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.035+0000 7f85dc000700 1 --2- 172.21.15.84:0/996593752 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85d40fe080 0x7f85d41100d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:28.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.035+0000 7f85dc000700 1 -- 172.21.15.84:0/996593752 >> 172.21.15.84:0/996593752 conn(0x7f85d40f8560 msgr2=0x7f85d40f9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:26:28.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.035+0000 7f85dc000700 1 -- 172.21.15.84:0/996593752 shutdown_connections 2024-04-26T21:26:28.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.035+0000 7f85dc000700 1 -- 172.21.15.84:0/996593752 wait complete. 2024-04-26T21:26:28.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.212+0000 7f23bd000700 1 -- 172.21.15.84:0/10979949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23b8066af0 msgr2=0x7f23b8101e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:28.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.212+0000 7f23bd000700 1 --2- 172.21.15.84:0/10979949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23b8066af0 0x7f23b8101e10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f23a8004880 tx=0x7f23a8009e30 comp rx=0 tx=0).stop 2024-04-26T21:26:28.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.213+0000 7f23bd000700 1 -- 172.21.15.84:0/10979949 shutdown_connections 2024-04-26T21:26:28.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.213+0000 7f23bd000700 1 --2- 172.21.15.84:0/10979949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23b8102350 0x7f23b8104730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:28.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.213+0000 7f23bd000700 1 --2- 172.21.15.84:0/10979949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23b8066af0 0x7f23b8101e10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:28.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.213+0000 7f23bd000700 1 -- 172.21.15.84:0/10979949 >> 172.21.15.84:0/10979949 conn(0x7f23b80f7420 msgr2=0x7f23b80f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:26:28.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.213+0000 7f23bd000700 1 -- 172.21.15.84:0/10979949 shutdown_connections 2024-04-26T21:26:28.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.213+0000 7f23bd000700 1 -- 172.21.15.84:0/10979949 wait complete. 2024-04-26T21:26:28.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.214+0000 7f23bd000700 1 Processor -- start 2024-04-26T21:26:28.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.214+0000 7f23bd000700 1 -- start start 2024-04-26T21:26:28.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.214+0000 7f23bd000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23b8066af0 0x7f23b810fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:28.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.214+0000 7f23bd000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23b8102350 0x7f23b81101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:28.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.214+0000 7f23bd000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b81107a0 con 0x7f23b8102350 2024-04-26T21:26:28.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.214+0000 7f23bd000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b8110ff0 con 0x7f23b8066af0 2024-04-26T21:26:28.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.215+0000 7f23b5400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23b8102350 0x7f23b81101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:28.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.215+0000 7f23b5400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23b8102350 0x7f23b81101a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45930/0 (socket says 172.21.15.84:45930) 2024-04-26T21:26:28.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.215+0000 7f23b5400700 1 -- 172.21.15.84:0/1930701814 learned_addr learned my addr 172.21.15.84:0/1930701814 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:26:28.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.215+0000 7f23b5e00700 1 --2- 172.21.15.84:0/1930701814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23b8066af0 0x7f23b810fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:28.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.215+0000 7f23b5e00700 1 -- 172.21.15.84:0/1930701814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23b8102350 msgr2=0x7f23b81101a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:28.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.215+0000 7f23b5e00700 1 --2- 172.21.15.84:0/1930701814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23b8102350 0x7f23b81101a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:28.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.215+0000 7f23b5e00700 1 -- 172.21.15.84:0/1930701814 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a8005040 con 0x7f23b8066af0 2024-04-26T21:26:28.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.216+0000 7f23b5e00700 1 --2- 172.21.15.84:0/1930701814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23b8066af0 0x7f23b810fc60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f23a80137c0 tx=0x7f23a8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:26:28.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.216+0000 7f23ae000700 1 -- 172.21.15.84:0/1930701814 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23a800e030 con 0x7f23b8066af0 2024-04-26T21:26:28.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.216+0000 7f23ae000700 1 -- 172.21.15.84:0/1930701814 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f23a8013e60 con 0x7f23b8066af0 2024-04-26T21:26:28.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.216+0000 7f23bd000700 1 -- 172.21.15.84:0/1930701814 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b8111270 con 0x7f23b8066af0 2024-04-26T21:26:28.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.217+0000 7f23bd000700 1 -- 172.21.15.84:0/1930701814 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b81117b0 con 0x7f23b8066af0 2024-04-26T21:26:28.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.217+0000 7f23ae000700 1 -- 172.21.15.84:0/1930701814 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23a801ce20 con 0x7f23b8066af0 2024-04-26T21:26:28.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.218+0000 7f23bd000700 1 -- 172.21.15.84:0/1930701814 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23980052e0 con 0x7f23b8066af0 2024-04-26T21:26:28.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.218+0000 7f23ae000700 1 -- 172.21.15.84:0/1930701814 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 31) v1 ==== 46566+0+0 (secure 0 0 0) 0x7f23a8025400 con 0x7f23b8066af0 2024-04-26T21:26:28.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.219+0000 7f23ae000700 1 --2- 172.21.15.84:0/1930701814 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f239c0394c0 0x7f239c03b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:28.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.219+0000 7f23ae000700 1 -- 172.21.15.84:0/1930701814 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f23a804eb40 con 0x7f23b8066af0 2024-04-26T21:26:28.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.220+0000 7f23b5400700 1 --2- 172.21.15.84:0/1930701814 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f239c0394c0 0x7f239c03b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:28.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.221+0000 7f23b5400700 1 --2- 172.21.15.84:0/1930701814 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f239c0394c0 0x7f239c03b970 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009b80 tx=0x7f23a400b040 comp rx=0 tx=0).ready entity=mgr.24429 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:26:28.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.229+0000 7f23ae000700 1 -- 172.21.15.84:0/1930701814 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f23a8023900 con 0x7f23b8066af0 2024-04-26T21:26:28.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:28 smithi084 ceph-mon[25539]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:26:28.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:28 smithi084 ceph-mon[25539]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:26:28.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.536+0000 7f23bd000700 1 -- 172.21.15.84:0/1930701814 --> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2398000bf0 con 0x7f239c0394c0 2024-04-26T21:26:28.541 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:28 smithi120 ceph-mon[32741]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:26:28.541 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:28 smithi120 ceph-mon[32741]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:26:28.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.555+0000 7f23ae000700 1 -- 172.21.15.84:0/1930701814 <== mgr.24429 v2:172.21.15.84:6800/3665499318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f2398000bf0 con 0x7f239c0394c0 2024-04-26T21:26:28.557 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:26:28.557 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (78s) 24s ago 12m 15.1M - 0.25.0 c8568f914cd2 bcb419cf9108 2024-04-26T21:26:28.557 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (12m) 24s ago 12m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 a111b0ee8187 2024-04-26T21:26:28.557 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (11m) 2s ago 10m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 66f4d21263a1 2024-04-26T21:26:28.557 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (70s) 24s ago 11m 74.2M - 9.4.7 954c08fa6188 1bf95f604e07 2024-04-26T21:26:28.557 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (5m) 24s ago 5m 115M - 17.2.7-907-g2be3efa9 1c5834633715 485d7884e1d5 2024-04-26T21:26:28.557 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (5m) 24s ago 5m 12.3M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:26:28.557 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (5m) 2s ago 5m 152M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:26:28.558 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (4m) 2s ago 4m 12.6M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:26:28.558 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (48s) 24s ago 13m 64.4M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:26:28.558 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283 running (2m) 2s ago 10m 73.4M - 19.0.0-3306-gbc612ffb 55dc54019ad8 1a0fbef33353 2024-04-26T21:26:28.558 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (13m) 24s ago 13m 50.8M 2048M 17.2.7-907-g2be3efa9 1c5834633715 24cc2d798ea7 2024-04-26T21:26:28.558 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (10m) 2s ago 10m 43.0M 2048M 17.2.7-907-g2be3efa9 1c5834633715 72c786fd622b 2024-04-26T21:26:28.558 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (85s) 24s ago 12m 7755k - 1.5.0 0da6a335fe13 81e00b40bfbf 2024-04-26T21:26:28.558 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (59s) 2s ago 10m 7692k - 1.5.0 0da6a335fe13 0506a1d46ec4 2024-04-26T21:26:28.558 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (9m) 24s ago 9m 104M 1557M 17.2.7-907-g2be3efa9 1c5834633715 3a2e74d7e51a 2024-04-26T21:26:28.558 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (9m) 24s ago 9m 119M 1557M 17.2.7-907-g2be3efa9 1c5834633715 d283a0a93213 2024-04-26T21:26:28.558 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (8m) 24s ago 8m 94.8M 1557M 17.2.7-907-g2be3efa9 1c5834633715 5899468fc5c8 2024-04-26T21:26:28.558 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (8m) 2s ago 8m 200M 2581M 17.2.7-907-g2be3efa9 1c5834633715 b8a14c87d730 2024-04-26T21:26:28.558 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (7m) 2s ago 7m 181M 2581M 17.2.7-907-g2be3efa9 1c5834633715 4d294df735a3 2024-04-26T21:26:28.558 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (6m) 2s ago 6m 207M 2581M 17.2.7-907-g2be3efa9 1c5834633715 9b60997971a8 2024-04-26T21:26:28.558 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (63s) 24s ago 11m 41.7M - 2.43.0 a07b618ecd1d ae9d5a32ee69 2024-04-26T21:26:28.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.559+0000 7f23bd000700 1 -- 172.21.15.84:0/1930701814 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f239c0394c0 msgr2=0x7f239c03b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:28.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.559+0000 7f23bd000700 1 --2- 172.21.15.84:0/1930701814 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f239c0394c0 0x7f239c03b970 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009b80 tx=0x7f23a400b040 comp rx=0 tx=0).stop 2024-04-26T21:26:28.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.559+0000 7f23bd000700 1 -- 172.21.15.84:0/1930701814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23b8066af0 msgr2=0x7f23b810fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.559+0000 7f23bd000700 1 --2- 172.21.15.84:0/1930701814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23b8066af0 0x7f23b810fc60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f23a80137c0 tx=0x7f23a8009e30 comp rx=0 tx=0).stop 2024-04-26T21:26:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.560+0000 7f23bd000700 1 -- 172.21.15.84:0/1930701814 shutdown_connections 2024-04-26T21:26:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.560+0000 7f23bd000700 1 --2- 172.21.15.84:0/1930701814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23b8066af0 0x7f23b810fc60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.560+0000 7f23bd000700 1 --2- 172.21.15.84:0/1930701814 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f239c0394c0 0x7f239c03b970 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.560+0000 7f23bd000700 1 --2- 172.21.15.84:0/1930701814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23b8102350 0x7f23b81101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.560+0000 7f23bd000700 1 -- 172.21.15.84:0/1930701814 >> 172.21.15.84:0/1930701814 conn(0x7f23b80f7420 msgr2=0x7f23b80f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:26:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.560+0000 7f23bd000700 1 -- 172.21.15.84:0/1930701814 shutdown_connections 2024-04-26T21:26:28.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.560+0000 7f23bd000700 1 -- 172.21.15.84:0/1930701814 wait complete. 2024-04-26T21:26:28.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.733+0000 7f6183200700 1 -- 172.21.15.84:0/3329120970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c0fce60 msgr2=0x7f617c0fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:28.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.733+0000 7f6183200700 1 --2- 172.21.15.84:0/3329120970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c0fce60 0x7f617c0fd270 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f616c004940 tx=0x7f616c009e30 comp rx=0 tx=0).stop 2024-04-26T21:26:28.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.734+0000 7f6183200700 1 -- 172.21.15.84:0/3329120970 shutdown_connections 2024-04-26T21:26:28.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.734+0000 7f6183200700 1 --2- 172.21.15.84:0/3329120970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f617c0fdfd0 0x7f617c0fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:28.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.734+0000 7f6183200700 1 --2- 172.21.15.84:0/3329120970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c0fce60 0x7f617c0fd270 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:28.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.734+0000 7f6183200700 1 -- 172.21.15.84:0/3329120970 >> 172.21.15.84:0/3329120970 conn(0x7f617c0f8560 msgr2=0x7f617c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:26:28.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.734+0000 7f6183200700 1 -- 172.21.15.84:0/3329120970 shutdown_connections 2024-04-26T21:26:28.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.734+0000 7f6183200700 1 -- 172.21.15.84:0/3329120970 wait complete. 2024-04-26T21:26:28.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.735+0000 7f6183200700 1 Processor -- start 2024-04-26T21:26:28.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.735+0000 7f6183200700 1 -- start start 2024-04-26T21:26:28.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.735+0000 7f6183200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f617c0fce60 0x7f617c10fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:28.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.735+0000 7f6183200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c0fdfd0 0x7f617c110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:28.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.735+0000 7f6183200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c110730 con 0x7f617c0fdfd0 2024-04-26T21:26:28.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.735+0000 7f6183200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c110f80 con 0x7f617c0fce60 2024-04-26T21:26:28.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.736+0000 7f617b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c0fdfd0 0x7f617c110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:28.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.736+0000 7f617be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f617c0fce60 0x7f617c10fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:28.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.736+0000 7f617be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f617c0fce60 0x7f617c10fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:60420/0 (socket says 172.21.15.84:60420) 2024-04-26T21:26:28.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.736+0000 7f617be00700 1 -- 172.21.15.84:0/3927772760 learned_addr learned my addr 172.21.15.84:0/3927772760 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:26:28.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.736+0000 7f617b400700 1 -- 172.21.15.84:0/3927772760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f617c0fce60 msgr2=0x7f617c10fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:28.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.736+0000 7f617b400700 1 --2- 172.21.15.84:0/3927772760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f617c0fce60 0x7f617c10fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:28.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.736+0000 7f617b400700 1 -- 172.21.15.84:0/3927772760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c005040 con 0x7f617c0fdfd0 2024-04-26T21:26:28.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.737+0000 7f617b400700 1 --2- 172.21.15.84:0/3927772760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c0fdfd0 0x7f617c110130 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6168002820 tx=0x7f6168004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:26:28.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.737+0000 7f6173e00700 1 -- 172.21.15.84:0/3927772760 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6168007cc0 con 0x7f617c0fdfd0 2024-04-26T21:26:28.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.737+0000 7f6183200700 1 -- 172.21.15.84:0/3927772760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617c111260 con 0x7f617c0fdfd0 2024-04-26T21:26:28.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.737+0000 7f6173e00700 1 -- 172.21.15.84:0/3927772760 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f616800f040 con 0x7f617c0fdfd0 2024-04-26T21:26:28.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.737+0000 7f6183200700 1 -- 172.21.15.84:0/3927772760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617c1117a0 con 0x7f617c0fdfd0 2024-04-26T21:26:28.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.738+0000 7f6173e00700 1 -- 172.21.15.84:0/3927772760 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61680092b0 con 0x7f617c0fdfd0 2024-04-26T21:26:28.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.739+0000 7f6183200700 1 -- 172.21.15.84:0/3927772760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617c05f5c0 con 0x7f617c0fdfd0 2024-04-26T21:26:28.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.740+0000 7f6173e00700 1 -- 172.21.15.84:0/3927772760 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 46566+0+0 (secure 0 0 0) 0x7f6168009730 con 0x7f617c0fdfd0 2024-04-26T21:26:28.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.740+0000 7f6173e00700 1 --2- 172.21.15.84:0/3927772760 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f6160039480 0x7f616003b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:28.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.740+0000 7f6173e00700 1 -- 172.21.15.84:0/3927772760 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f616804f190 con 0x7f617c0fdfd0 2024-04-26T21:26:28.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.741+0000 7f617be00700 1 --2- 172.21.15.84:0/3927772760 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f6160039480 0x7f616003b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:28.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.742+0000 7f617be00700 1 --2- 172.21.15.84:0/3927772760 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f6160039480 0x7f616003b930 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f616c00b3b0 tx=0x7f616c009e30 comp rx=0 tx=0).ready entity=mgr.24429 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:26:28.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:28.747+0000 7f6173e00700 1 -- 172.21.15.84:0/3927772760 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f61680192b0 con 0x7f617c0fdfd0 2024-04-26T21:26:29.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.223+0000 7f6183200700 1 -- 172.21.15.84:0/3927772760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f617c111a80 con 0x7f617c0fdfd0 2024-04-26T21:26:29.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.224+0000 7f6173e00700 1 -- 172.21.15.84:0/3927772760 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f616801aba0 con 0x7f617c0fdfd0 2024-04-26T21:26:29.226 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:26:29.226 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:26:29.226 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-26T21:26:29.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:26:29.226 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:26:29.226 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 1 2024-04-26T21:26:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:26:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:26:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-26T21:26:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:26:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:26:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-26T21:26:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:26:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:26:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 12, 2024-04-26T21:26:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 1 2024-04-26T21:26:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:26:29.227 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:26:29.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.228+0000 7f6183200700 1 -- 172.21.15.84:0/3927772760 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f6160039480 msgr2=0x7f616003b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:29.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.228+0000 7f6183200700 1 --2- 172.21.15.84:0/3927772760 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f6160039480 0x7f616003b930 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f616c00b3b0 tx=0x7f616c009e30 comp rx=0 tx=0).stop 2024-04-26T21:26:29.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.228+0000 7f6183200700 1 -- 172.21.15.84:0/3927772760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c0fdfd0 msgr2=0x7f617c110130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:29.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.228+0000 7f6183200700 1 --2- 172.21.15.84:0/3927772760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c0fdfd0 0x7f617c110130 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6168002820 tx=0x7f6168004570 comp rx=0 tx=0).stop 2024-04-26T21:26:29.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.228+0000 7f6183200700 1 -- 172.21.15.84:0/3927772760 shutdown_connections 2024-04-26T21:26:29.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.228+0000 7f6183200700 1 --2- 172.21.15.84:0/3927772760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f617c0fce60 0x7f617c10fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:29.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.228+0000 7f6183200700 1 --2- 172.21.15.84:0/3927772760 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f6160039480 0x7f616003b930 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:29.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.228+0000 7f6183200700 1 --2- 172.21.15.84:0/3927772760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c0fdfd0 0x7f617c110130 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:29.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.228+0000 7f6183200700 1 -- 172.21.15.84:0/3927772760 >> 172.21.15.84:0/3927772760 conn(0x7f617c0f8560 msgr2=0x7f617c0f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:26:29.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.228+0000 7f6183200700 1 -- 172.21.15.84:0/3927772760 shutdown_connections 2024-04-26T21:26:29.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.228+0000 7f6183200700 1 -- 172.21.15.84:0/3927772760 wait complete. 2024-04-26T21:26:29.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.406+0000 7f5380400700 1 -- 172.21.15.84:0/296381301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5378100280 msgr2=0x7f53781006f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:29.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.406+0000 7f5380400700 1 --2- 172.21.15.84:0/296381301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5378100280 0x7f53781006f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5364004940 tx=0x7f5364009e30 comp rx=0 tx=0).stop 2024-04-26T21:26:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.406+0000 7f5380400700 1 -- 172.21.15.84:0/296381301 shutdown_connections 2024-04-26T21:26:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.406+0000 7f5380400700 1 --2- 172.21.15.84:0/296381301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5378100280 0x7f53781006f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.406+0000 7f5380400700 1 --2- 172.21.15.84:0/296381301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53780fefd0 0x7f53780ff3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.406+0000 7f5380400700 1 -- 172.21.15.84:0/296381301 >> 172.21.15.84:0/296381301 conn(0x7f53780fa8f0 msgr2=0x7f53780fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:26:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.406+0000 7f5380400700 1 -- 172.21.15.84:0/296381301 shutdown_connections 2024-04-26T21:26:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.407+0000 7f5380400700 1 -- 172.21.15.84:0/296381301 wait complete. 2024-04-26T21:26:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.407+0000 7f5380400700 1 Processor -- start 2024-04-26T21:26:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.408+0000 7f5380400700 1 -- start start 2024-04-26T21:26:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.408+0000 7f5380400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53780fefd0 0x7f5378072750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.408+0000 7f5380400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5378100280 0x7f5378072c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.408+0000 7f5380400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53780732e0 con 0x7f5378100280 2024-04-26T21:26:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.408+0000 7f5380400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5378073b30 con 0x7f53780fefd0 2024-04-26T21:26:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.408+0000 7f537da00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53780fefd0 0x7f5378072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.408+0000 7f537da00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53780fefd0 0x7f5378072750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:60438/0 (socket says 172.21.15.84:60438) 2024-04-26T21:26:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.408+0000 7f537da00700 1 -- 172.21.15.84:0/3605802872 learned_addr learned my addr 172.21.15.84:0/3605802872 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:26:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.409+0000 7f537d000700 1 --2- 172.21.15.84:0/3605802872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5378100280 0x7f5378072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.409+0000 7f537da00700 1 -- 172.21.15.84:0/3605802872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5378100280 msgr2=0x7f5378072c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.409+0000 7f537da00700 1 --2- 172.21.15.84:0/3605802872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5378100280 0x7f5378072c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.409+0000 7f537da00700 1 -- 172.21.15.84:0/3605802872 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5364005040 con 0x7f53780fefd0 2024-04-26T21:26:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.410+0000 7f537da00700 1 --2- 172.21.15.84:0/3605802872 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53780fefd0 0x7f5378072750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f536c002a50 tx=0x7f536c0046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:26:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.410+0000 7f5375600700 1 -- 172.21.15.84:0/3605802872 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f536c007cc0 con 0x7f53780fefd0 2024-04-26T21:26:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.410+0000 7f5375600700 1 -- 172.21.15.84:0/3605802872 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f536c00f040 con 0x7f53780fefd0 2024-04-26T21:26:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.410+0000 7f5375600700 1 -- 172.21.15.84:0/3605802872 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f536c00da30 con 0x7f53780fefd0 2024-04-26T21:26:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.410+0000 7f5380400700 1 -- 172.21.15.84:0/3605802872 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5378073e10 con 0x7f53780fefd0 2024-04-26T21:26:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.411+0000 7f5380400700 1 -- 172.21.15.84:0/3605802872 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53780743d0 con 0x7f53780fefd0 2024-04-26T21:26:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.413+0000 7f5375600700 1 -- 172.21.15.84:0/3605802872 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 31) v1 ==== 46566+0+0 (secure 0 0 0) 0x7f536c00db90 con 0x7f53780fefd0 2024-04-26T21:26:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.413+0000 7f5380400700 1 -- 172.21.15.84:0/3605802872 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537805f5c0 con 0x7f53780fefd0 2024-04-26T21:26:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.413+0000 7f5375600700 1 --2- 172.21.15.84:0/3605802872 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f53600394c0 0x7f536003b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.413+0000 7f5375600700 1 -- 172.21.15.84:0/3605802872 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f536c04cff0 con 0x7f53780fefd0 2024-04-26T21:26:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.414+0000 7f537d000700 1 --2- 172.21.15.84:0/3605802872 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f53600394c0 0x7f536003b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.415+0000 7f537d000700 1 --2- 172.21.15.84:0/3605802872 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f53600394c0 0x7f536003b970 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5364009fd0 tx=0x7f5364009e30 comp rx=0 tx=0).ready entity=mgr.24429 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:26:29.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.423+0000 7f5375600700 1 -- 172.21.15.84:0/3605802872 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f536c081930 con 0x7f53780fefd0 2024-04-26T21:26:29.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:29 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:29.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:29 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:29.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:29 smithi084 ceph-mon[25539]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:26:29.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:29 smithi084 ceph-mon[25539]: pgmap v7: 65 pgs: 65 active+clean; 2.6 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 48 KiB/s rd, 1016 KiB/s wr, 162 op/s 2024-04-26T21:26:29.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:29 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:29.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:29 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:29.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:29 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3927772760' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:26:29.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.760+0000 7f5380400700 1 -- 172.21.15.84:0/3605802872 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5378107ac0 con 0x7f53780fefd0 2024-04-26T21:26:29.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.760+0000 7f5375600700 1 -- 172.21.15.84:0/3605802872 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1835 (secure 0 0 0) 0x7f536c0112f0 con 0x7f53780fefd0 2024-04-26T21:26:29.762 INFO:teuthology.orchestra.run.smithi084.stdout:e12 2024-04-26T21:26:29.762 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:26:29.762 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:26:29.763 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:26:29.763 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:26:29.763 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:26:29.763 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:26:29.763 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 12 2024-04-26T21:26:29.763 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:26:29.763 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:26:29.763 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:23:53.700069+0000 2024-04-26T21:26:29.763 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:26:29.763 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:26:29.763 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:26:29.763 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:26:29.763 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:26:29.763 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:26:29.764 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:26:29.764 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:26:29.764 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:26:29.764 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:26:29.764 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:26:29.764 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456,1=24231} 2024-04-26T21:26:29.764 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:26:29.764 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:26:29.764 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:26:29.764 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:26:29.764 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:26:29.764 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:26:29.764 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:26:29.764 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:26:29.764 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:26:29.765 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:26:29.765 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:26:29.765 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:26:29.765 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:26:29.765 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:26:29.765 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:26:29.765 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:26:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.764+0000 7f5380400700 1 -- 172.21.15.84:0/3605802872 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f53600394c0 msgr2=0x7f536003b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.764+0000 7f5380400700 1 --2- 172.21.15.84:0/3605802872 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f53600394c0 0x7f536003b970 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5364009fd0 tx=0x7f5364009e30 comp rx=0 tx=0).stop 2024-04-26T21:26:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.764+0000 7f5380400700 1 -- 172.21.15.84:0/3605802872 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53780fefd0 msgr2=0x7f5378072750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.764+0000 7f5380400700 1 --2- 172.21.15.84:0/3605802872 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53780fefd0 0x7f5378072750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f536c002a50 tx=0x7f536c0046b0 comp rx=0 tx=0).stop 2024-04-26T21:26:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.764+0000 7f5380400700 1 -- 172.21.15.84:0/3605802872 shutdown_connections 2024-04-26T21:26:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.764+0000 7f5380400700 1 --2- 172.21.15.84:0/3605802872 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53780fefd0 0x7f5378072750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.764+0000 7f5380400700 1 --2- 172.21.15.84:0/3605802872 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f53600394c0 0x7f536003b970 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.764+0000 7f5380400700 1 --2- 172.21.15.84:0/3605802872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5378100280 0x7f5378072c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.764+0000 7f5380400700 1 -- 172.21.15.84:0/3605802872 >> 172.21.15.84:0/3605802872 conn(0x7f53780fa8f0 msgr2=0x7f53780fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:26:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.764+0000 7f5380400700 1 -- 172.21.15.84:0/3605802872 shutdown_connections 2024-04-26T21:26:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.764+0000 7f5380400700 1 -- 172.21.15.84:0/3605802872 wait complete. 2024-04-26T21:26:29.767 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 12 2024-04-26T21:26:29.773 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:29 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:29.773 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:29 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:29.773 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:29 smithi120 ceph-mon[32741]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:26:29.773 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:29 smithi120 ceph-mon[32741]: pgmap v7: 65 pgs: 65 active+clean; 2.6 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 48 KiB/s rd, 1016 KiB/s wr, 162 op/s 2024-04-26T21:26:29.773 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:29 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:29.774 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:29 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:29.774 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:29 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/3927772760' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:26:29.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.975+0000 7fd4e7e00700 1 -- 172.21.15.84:0/3387515066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4e806e7c0 msgr2=0x7fd4e806ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:29.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.975+0000 7fd4e5600700 1 -- 172.21.15.84:0/3387515066 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4d000bcb0 con 0x7fd4e806e7c0 2024-04-26T21:26:29.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.975+0000 7fd4e7e00700 1 --2- 172.21.15.84:0/3387515066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4e806e7c0 0x7fd4e806ec30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0004940 tx=0x7fd4d0009e30 comp rx=0 tx=0).stop 2024-04-26T21:26:29.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.975+0000 7fd4e7e00700 1 -- 172.21.15.84:0/3387515066 shutdown_connections 2024-04-26T21:26:29.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.975+0000 7fd4e7e00700 1 --2- 172.21.15.84:0/3387515066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4e806e7c0 0x7fd4e806ec30 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:29.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.975+0000 7fd4e7e00700 1 --2- 172.21.15.84:0/3387515066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4e806fbe0 0x7fd4e806e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:29.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.975+0000 7fd4e7e00700 1 -- 172.21.15.84:0/3387515066 >> 172.21.15.84:0/3387515066 conn(0x7fd4e8069bf0 msgr2=0x7fd4e806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:26:29.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.976+0000 7fd4e7e00700 1 -- 172.21.15.84:0/3387515066 shutdown_connections 2024-04-26T21:26:29.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.976+0000 7fd4e7e00700 1 -- 172.21.15.84:0/3387515066 wait complete. 2024-04-26T21:26:29.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.977+0000 7fd4e7e00700 1 Processor -- start 2024-04-26T21:26:29.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.978+0000 7fd4e7e00700 1 -- start start 2024-04-26T21:26:29.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.978+0000 7fd4e7e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4e806e7c0 0x7fd4e811c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:29.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.978+0000 7fd4e7e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4e806fbe0 0x7fd4e811c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:29.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.979+0000 7fd4e7e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e811ced0 con 0x7fd4e806e7c0 2024-04-26T21:26:29.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.979+0000 7fd4e7e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e811d720 con 0x7fd4e806fbe0 2024-04-26T21:26:29.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.979+0000 7fd4e6000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4e806fbe0 0x7fd4e811c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:29.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.979+0000 7fd4e6000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4e806fbe0 0x7fd4e811c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:60466/0 (socket says 172.21.15.84:60466) 2024-04-26T21:26:29.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.979+0000 7fd4e6000700 1 -- 172.21.15.84:0/1232227632 learned_addr learned my addr 172.21.15.84:0/1232227632 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:26:29.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.979+0000 7fd4e6a00700 1 --2- 172.21.15.84:0/1232227632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4e806e7c0 0x7fd4e811c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:29.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.980+0000 7fd4e6000700 1 -- 172.21.15.84:0/1232227632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4e806e7c0 msgr2=0x7fd4e811c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:29.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.980+0000 7fd4e6000700 1 --2- 172.21.15.84:0/1232227632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4e806e7c0 0x7fd4e811c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:29.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.980+0000 7fd4e6000700 1 -- 172.21.15.84:0/1232227632 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d0005040 con 0x7fd4e806fbe0 2024-04-26T21:26:29.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.980+0000 7fd4e6a00700 1 --2- 172.21.15.84:0/1232227632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4e806e7c0 0x7fd4e811c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:26:29.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.981+0000 7fd4e6000700 1 --2- 172.21.15.84:0/1232227632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4e806fbe0 0x7fd4e811c8d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0000c00 tx=0x7fd4d0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:26:29.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.981+0000 7fd4dea00700 1 -- 172.21.15.84:0/1232227632 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4d000e040 con 0x7fd4e806fbe0 2024-04-26T21:26:29.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.981+0000 7fd4e7e00700 1 -- 172.21.15.84:0/1232227632 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e811d9a0 con 0x7fd4e806fbe0 2024-04-26T21:26:29.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.981+0000 7fd4e7e00700 1 -- 172.21.15.84:0/1232227632 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e811dee0 con 0x7fd4e806fbe0 2024-04-26T21:26:29.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.982+0000 7fd4dea00700 1 -- 172.21.15.84:0/1232227632 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4d000bd90 con 0x7fd4e806fbe0 2024-04-26T21:26:29.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.982+0000 7fd4dea00700 1 -- 172.21.15.84:0/1232227632 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4d001c610 con 0x7fd4e806fbe0 2024-04-26T21:26:29.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.983+0000 7fd4dea00700 1 -- 172.21.15.84:0/1232227632 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 31) v1 ==== 46566+0+0 (secure 0 0 0) 0x7fd4d001c880 con 0x7fd4e806fbe0 2024-04-26T21:26:29.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.983+0000 7fd4e7e00700 1 -- 172.21.15.84:0/1232227632 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e806d800 con 0x7fd4e806fbe0 2024-04-26T21:26:29.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.984+0000 7fd4dea00700 1 --2- 172.21.15.84:0/1232227632 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fd4cc0394d0 0x7fd4cc03b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:29.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.984+0000 7fd4dea00700 1 -- 172.21.15.84:0/1232227632 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fd4d004f910 con 0x7fd4e806fbe0 2024-04-26T21:26:29.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.986+0000 7fd4e6a00700 1 --2- 172.21.15.84:0/1232227632 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fd4cc0394d0 0x7fd4cc03b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:29.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.995+0000 7fd4e6a00700 1 --2- 172.21.15.84:0/1232227632 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fd4cc0394d0 0x7fd4cc03b980 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd4e806e170 tx=0x7fd4e000b040 comp rx=0 tx=0).ready entity=mgr.24429 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:26:29.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:29.996+0000 7fd4dea00700 1 -- 172.21.15.84:0/1232227632 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fd4d0023300 con 0x7fd4e806fbe0 2024-04-26T21:26:30.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.322+0000 7fd4e7e00700 1 -- 172.21.15.84:0/1232227632 --> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4e811e2b0 con 0x7fd4cc0394d0 2024-04-26T21:26:30.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.324+0000 7fd4dea00700 1 -- 172.21.15.84:0/1232227632 <== mgr.24429 v2:172.21.15.84:6800/3665499318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fd4e811e2b0 con 0x7fd4cc0394d0 2024-04-26T21:26:30.326 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:26:30.326 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:26:30.327 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:26:30.327 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:26:30.327 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-04-26T21:26:30.327 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr" 2024-04-26T21:26:30.327 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-04-26T21:26:30.327 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "2/21 daemons upgraded", 2024-04-26T21:26:30.328 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2024-04-26T21:26:30.328 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:26:30.328 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:26:30.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.327+0000 7fd4e7e00700 1 -- 172.21.15.84:0/1232227632 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fd4cc0394d0 msgr2=0x7fd4cc03b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:30.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.327+0000 7fd4e7e00700 1 --2- 172.21.15.84:0/1232227632 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fd4cc0394d0 0x7fd4cc03b980 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd4e806e170 tx=0x7fd4e000b040 comp rx=0 tx=0).stop 2024-04-26T21:26:30.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.327+0000 7fd4e7e00700 1 -- 172.21.15.84:0/1232227632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4e806fbe0 msgr2=0x7fd4e811c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:30.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.327+0000 7fd4e7e00700 1 --2- 172.21.15.84:0/1232227632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4e806fbe0 0x7fd4e811c8d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0000c00 tx=0x7fd4d0009e30 comp rx=0 tx=0).stop 2024-04-26T21:26:30.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.327+0000 7fd4e7e00700 1 -- 172.21.15.84:0/1232227632 shutdown_connections 2024-04-26T21:26:30.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.327+0000 7fd4e7e00700 1 --2- 172.21.15.84:0/1232227632 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fd4cc0394d0 0x7fd4cc03b980 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd4e806e170 tx=0x7fd4e000b040 comp rx=0 tx=0).stop 2024-04-26T21:26:30.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.327+0000 7fd4e7e00700 1 --2- 172.21.15.84:0/1232227632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4e806e7c0 0x7fd4e811c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:30.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.327+0000 7fd4e7e00700 1 --2- 172.21.15.84:0/1232227632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4e806fbe0 0x7fd4e811c8d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:30.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.327+0000 7fd4e7e00700 1 -- 172.21.15.84:0/1232227632 >> 172.21.15.84:0/1232227632 conn(0x7fd4e8069bf0 msgr2=0x7fd4e806a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:26:30.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.328+0000 7fd4e7e00700 1 -- 172.21.15.84:0/1232227632 shutdown_connections 2024-04-26T21:26:30.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.328+0000 7fd4e7e00700 1 -- 172.21.15.84:0/1232227632 wait complete. 2024-04-26T21:26:30.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.500+0000 7f2edd600700 1 -- 172.21.15.84:0/3154769820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ed80fe080 msgr2=0x7f2ed80fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:30.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.500+0000 7f2edd600700 1 --2- 172.21.15.84:0/3154769820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ed80fe080 0x7f2ed80fe4f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4004940 tx=0x7f2ec4009e30 comp rx=0 tx=0).stop 2024-04-26T21:26:30.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.500+0000 7f2edd600700 1 -- 172.21.15.84:0/3154769820 shutdown_connections 2024-04-26T21:26:30.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.500+0000 7f2edd600700 1 --2- 172.21.15.84:0/3154769820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ed80fe080 0x7f2ed80fe4f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:30.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.500+0000 7f2edd600700 1 --2- 172.21.15.84:0/3154769820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ed80fcf10 0x7f2ed80fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:30.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.500+0000 7f2edd600700 1 -- 172.21.15.84:0/3154769820 >> 172.21.15.84:0/3154769820 conn(0x7f2ed80f8560 msgr2=0x7f2ed80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:26:30.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.500+0000 7f2edd600700 1 -- 172.21.15.84:0/3154769820 shutdown_connections 2024-04-26T21:26:30.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.500+0000 7f2edd600700 1 -- 172.21.15.84:0/3154769820 wait complete. 2024-04-26T21:26:30.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.501+0000 7f2edd600700 1 Processor -- start 2024-04-26T21:26:30.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.501+0000 7f2edd600700 1 -- start start 2024-04-26T21:26:30.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.502+0000 7f2edd600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ed80fcf10 0x7f2ed810fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:30.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.502+0000 7f2edd600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ed80fe080 0x7f2ed8110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:30.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.502+0000 7f2edd600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8110700 con 0x7f2ed80fcf10 2024-04-26T21:26:30.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.502+0000 7f2edd600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8110f50 con 0x7f2ed80fe080 2024-04-26T21:26:30.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.502+0000 7f2ed6000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ed80fe080 0x7f2ed8110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:30.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.502+0000 7f2ed6a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ed80fcf10 0x7f2ed810fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:30.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.502+0000 7f2ed6000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ed80fe080 0x7f2ed8110100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:60496/0 (socket says 172.21.15.84:60496) 2024-04-26T21:26:30.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.502+0000 7f2ed6000700 1 -- 172.21.15.84:0/2630674167 learned_addr learned my addr 172.21.15.84:0/2630674167 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:26:30.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.503+0000 7f2ed6a00700 1 -- 172.21.15.84:0/2630674167 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ed80fe080 msgr2=0x7f2ed8110100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:30.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.503+0000 7f2ed6a00700 1 --2- 172.21.15.84:0/2630674167 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ed80fe080 0x7f2ed8110100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:30.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.503+0000 7f2ed6a00700 1 -- 172.21.15.84:0/2630674167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec4005040 con 0x7f2ed80fcf10 2024-04-26T21:26:30.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.503+0000 7f2ed6000700 1 --2- 172.21.15.84:0/2630674167 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ed80fe080 0x7f2ed8110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:26:30.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.503+0000 7f2ed6a00700 1 --2- 172.21.15.84:0/2630674167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ed80fcf10 0x7f2ed810fbc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8009fd0 tx=0x7f2ec800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:26:30.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.504+0000 7f2ecea00700 1 -- 172.21.15.84:0/2630674167 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ec8007cc0 con 0x7f2ed80fcf10 2024-04-26T21:26:30.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.504+0000 7f2ecea00700 1 -- 172.21.15.84:0/2630674167 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ec800f040 con 0x7f2ed80fcf10 2024-04-26T21:26:30.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.504+0000 7f2edd600700 1 -- 172.21.15.84:0/2630674167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed81111d0 con 0x7f2ed80fcf10 2024-04-26T21:26:30.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.504+0000 7f2ecea00700 1 -- 172.21.15.84:0/2630674167 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ec800cad0 con 0x7f2ed80fcf10 2024-04-26T21:26:30.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.504+0000 7f2edd600700 1 -- 172.21.15.84:0/2630674167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed8111710 con 0x7f2ed80fcf10 2024-04-26T21:26:30.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.505+0000 7f2edd600700 1 -- 172.21.15.84:0/2630674167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed8101a10 con 0x7f2ed80fcf10 2024-04-26T21:26:30.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.505+0000 7f2ecea00700 1 -- 172.21.15.84:0/2630674167 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 46566+0+0 (secure 0 0 0) 0x7f2ec800cc30 con 0x7f2ed80fcf10 2024-04-26T21:26:30.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.506+0000 7f2ecea00700 1 --2- 172.21.15.84:0/2630674167 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f2ebc039470 0x7f2ebc03b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:26:30.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.506+0000 7f2ecea00700 1 -- 172.21.15.84:0/2630674167 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f2ec804ce50 con 0x7f2ed80fcf10 2024-04-26T21:26:30.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.506+0000 7f2ed6000700 1 --2- 172.21.15.84:0/2630674167 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f2ebc039470 0x7f2ebc03b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:26:30.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.507+0000 7f2ed6000700 1 --2- 172.21.15.84:0/2630674167 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f2ebc039470 0x7f2ebc03b920 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4009fd0 tx=0x7f2ec4009e30 comp rx=0 tx=0).ready entity=mgr.24429 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:26:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.514+0000 7f2ecea00700 1 -- 172.21.15.84:0/2630674167 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f2ec8012db0 con 0x7f2ed80fcf10 2024-04-26T21:26:30.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:30 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/3605802872' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:26:30.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:30 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/3605802872' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:26:30.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.903+0000 7f2edd600700 1 -- 172.21.15.84:0/2630674167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2ed804bed0 con 0x7f2ed80fcf10 2024-04-26T21:26:30.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.904+0000 7f2ecea00700 1 -- 172.21.15.84:0/2630674167 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f2ec8012bd0 con 0x7f2ed80fcf10 2024-04-26T21:26:30.906 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:26:30.906 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:26:30.906 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:26:30.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.908+0000 7f2edd600700 1 -- 172.21.15.84:0/2630674167 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f2ebc039470 msgr2=0x7f2ebc03b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:30.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.908+0000 7f2edd600700 1 --2- 172.21.15.84:0/2630674167 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f2ebc039470 0x7f2ebc03b920 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4009fd0 tx=0x7f2ec4009e30 comp rx=0 tx=0).stop 2024-04-26T21:26:30.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.908+0000 7f2edd600700 1 -- 172.21.15.84:0/2630674167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ed80fcf10 msgr2=0x7f2ed810fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:26:30.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.908+0000 7f2edd600700 1 --2- 172.21.15.84:0/2630674167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ed80fcf10 0x7f2ed810fbc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8009fd0 tx=0x7f2ec800b040 comp rx=0 tx=0).stop 2024-04-26T21:26:30.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.909+0000 7f2edd600700 1 -- 172.21.15.84:0/2630674167 shutdown_connections 2024-04-26T21:26:30.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.909+0000 7f2edd600700 1 --2- 172.21.15.84:0/2630674167 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f2ebc039470 0x7f2ebc03b920 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:30.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.909+0000 7f2edd600700 1 --2- 172.21.15.84:0/2630674167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ed80fcf10 0x7f2ed810fbc0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:30.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.909+0000 7f2edd600700 1 --2- 172.21.15.84:0/2630674167 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ed80fe080 0x7f2ed8110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:26:30.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.909+0000 7f2edd600700 1 -- 172.21.15.84:0/2630674167 >> 172.21.15.84:0/2630674167 conn(0x7f2ed80f8560 msgr2=0x7f2ed80f9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:26:30.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.909+0000 7f2edd600700 1 -- 172.21.15.84:0/2630674167 shutdown_connections 2024-04-26T21:26:30.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:26:30.909+0000 7f2edd600700 1 -- 172.21.15.84:0/2630674167 wait complete. 2024-04-26T21:26:31.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:31 smithi084 ceph-mon[25539]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:26:31.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:31 smithi084 ceph-mon[25539]: pgmap v8: 65 pgs: 65 active+clean; 2.6 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 37 KiB/s rd, 790 KiB/s wr, 126 op/s 2024-04-26T21:26:31.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:31 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2630674167' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:26:31.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:31 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:31.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:31 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:31.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:31 smithi120 ceph-mon[32741]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:26:31.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:31 smithi120 ceph-mon[32741]: pgmap v8: 65 pgs: 65 active+clean; 2.6 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 37 KiB/s rd, 790 KiB/s wr, 126 op/s 2024-04-26T21:26:31.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:31 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2630674167' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:26:31.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:31 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:31.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:31 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:33.737 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T21:26:33.737 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-04-26T21:26:33.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:33 smithi084 ceph-mon[25539]: pgmap v9: 65 pgs: 65 active+clean; 1.6 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 43 KiB/s rd, 1.2 MiB/s wr, 182 op/s 2024-04-26T21:26:33.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:33 smithi084 ceph-mon[25539]: Standby manager daemon smithi120.zjaduj started 2024-04-26T21:26:33.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:33 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.120:0/3611839662' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.zjaduj/crt"}]: dispatch 2024-04-26T21:26:33.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:33 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.120:0/3611839662' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:26:33.914 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:33 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.120:0/3611839662' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.zjaduj/key"}]: dispatch 2024-04-26T21:26:33.914 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:33 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.120:0/3611839662' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:26:34.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:33 smithi120 ceph-mon[32741]: pgmap v9: 65 pgs: 65 active+clean; 1.6 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 43 KiB/s rd, 1.2 MiB/s wr, 182 op/s 2024-04-26T21:26:34.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:33 smithi120 ceph-mon[32741]: Standby manager daemon smithi120.zjaduj started 2024-04-26T21:26:34.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:33 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.120:0/3611839662' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.zjaduj/crt"}]: dispatch 2024-04-26T21:26:34.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:33 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.120:0/3611839662' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:26:34.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:33 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.120:0/3611839662' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.zjaduj/key"}]: dispatch 2024-04-26T21:26:34.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:33 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.120:0/3611839662' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:26:34.749 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:34 smithi084 ceph-mon[25539]: mgrmap e32: smithi084.gyasul(active, since 13s), standbys: smithi120.zjaduj 2024-04-26T21:26:34.749 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:34 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr metadata", "who": "smithi120.zjaduj", "id": "smithi120.zjaduj"}]: dispatch 2024-04-26T21:26:35.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:34 smithi120 ceph-mon[32741]: mgrmap e32: smithi084.gyasul(active, since 13s), standbys: smithi120.zjaduj 2024-04-26T21:26:35.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:34 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr metadata", "who": "smithi120.zjaduj", "id": "smithi120.zjaduj"}]: dispatch 2024-04-26T21:26:36.043 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:35 smithi084 ceph-mon[25539]: pgmap v10: 65 pgs: 65 active+clean; 1.6 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 40 KiB/s rd, 1.1 MiB/s wr, 167 op/s 2024-04-26T21:26:36.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:35 smithi120 ceph-mon[32741]: pgmap v10: 65 pgs: 65 active+clean; 1.6 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 40 KiB/s rd, 1.1 MiB/s wr, 167 op/s 2024-04-26T21:26:37.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:36 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:26:37.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:36 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:26:38.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:37 smithi084 ceph-mon[25539]: pgmap v11: 65 pgs: 65 active+clean; 1007 MiB data, 4.9 GiB used, 531 GiB / 536 GiB avail; 50 KiB/s rd, 1.1 MiB/s wr, 192 op/s 2024-04-26T21:26:38.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:37 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:38.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:37 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:38.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:37 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:26:38.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:37 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:26:38.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:37 smithi084 ceph-mon[25539]: Updating smithi084:/etc/ceph/ceph.conf 2024-04-26T21:26:38.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:37 smithi084 ceph-mon[25539]: Updating smithi120:/etc/ceph/ceph.conf 2024-04-26T21:26:38.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:37 smithi120 ceph-mon[32741]: pgmap v11: 65 pgs: 65 active+clean; 1007 MiB data, 4.9 GiB used, 531 GiB / 536 GiB avail; 50 KiB/s rd, 1.1 MiB/s wr, 192 op/s 2024-04-26T21:26:38.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:37 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:38.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:37 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:38.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:37 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:26:38.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:37 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:26:38.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:37 smithi120 ceph-mon[32741]: Updating smithi084:/etc/ceph/ceph.conf 2024-04-26T21:26:38.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:37 smithi120 ceph-mon[32741]: Updating smithi120:/etc/ceph/ceph.conf 2024-04-26T21:26:38.967 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T21:26:38.967 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T21:26:39.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:38 smithi120 ceph-mon[32741]: Updating smithi084:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:26:39.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:38 smithi120 ceph-mon[32741]: Updating smithi120:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:26:39.313 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:38 smithi084 ceph-mon[25539]: Updating smithi084:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:26:39.313 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:38 smithi084 ceph-mon[25539]: Updating smithi120:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:26:40.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:39 smithi084 ceph-mon[25539]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:26:40.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:39 smithi084 ceph-mon[25539]: pgmap v12: 65 pgs: 65 active+clean; 788 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 45 KiB/s rd, 1.3 MiB/s wr, 195 op/s 2024-04-26T21:26:40.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:39 smithi084 ceph-mon[25539]: Updating smithi084:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:26:40.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:39 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:40.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:39 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:40.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:39 smithi120 ceph-mon[32741]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:26:40.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:40 smithi120 ceph-mon[32741]: pgmap v12: 65 pgs: 65 active+clean; 788 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 45 KiB/s rd, 1.3 MiB/s wr, 195 op/s 2024-04-26T21:26:40.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:40 smithi120 ceph-mon[32741]: Updating smithi084:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:26:40.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:40 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:40.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:40 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:42.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:42 smithi084 ceph-mon[25539]: pgmap v13: 65 pgs: 65 active+clean; 788 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 22 KiB/s rd, 987 KiB/s wr, 135 op/s 2024-04-26T21:26:42.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:42 smithi120 ceph-mon[32741]: pgmap v13: 65 pgs: 65 active+clean; 788 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 22 KiB/s rd, 987 KiB/s wr, 135 op/s 2024-04-26T21:26:44.266 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:44 smithi120 ceph-mon[32741]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:26:44.266 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:44 smithi120 ceph-mon[32741]: pgmap v14: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.5 MiB/s wr, 193 op/s 2024-04-26T21:26:44.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:44 smithi084 ceph-mon[25539]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:26:44.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:44 smithi084 ceph-mon[25539]: pgmap v14: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.5 MiB/s wr, 193 op/s 2024-04-26T21:26:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:45 smithi084 ceph-mon[25539]: Updating smithi120:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:26:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:45 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:45 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:45 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:45 smithi120 ceph-mon[32741]: Updating smithi120:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:26:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:45 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:45 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:45 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:46.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:46 smithi084 ceph-mon[25539]: pgmap v15: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1016 KiB/s wr, 120 op/s 2024-04-26T21:26:46.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:46 smithi084 ceph-mon[25539]: Reconfiguring prometheus.smithi084 (dependencies changed)... 2024-04-26T21:26:46.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:46 smithi084 ceph-mon[25539]: Reconfiguring daemon prometheus.smithi084 on smithi084 2024-04-26T21:26:46.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:46 smithi120 ceph-mon[32741]: pgmap v15: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1016 KiB/s wr, 120 op/s 2024-04-26T21:26:46.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:46 smithi120 ceph-mon[32741]: Reconfiguring prometheus.smithi084 (dependencies changed)... 2024-04-26T21:26:46.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:46 smithi120 ceph-mon[32741]: Reconfiguring daemon prometheus.smithi084 on smithi084 2024-04-26T21:26:48.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:48 smithi084 ceph-mon[25539]: pgmap v16: 65 pgs: 65 active+clean; 291 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.5 MiB/s wr, 160 op/s 2024-04-26T21:26:48.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:48 smithi120 ceph-mon[32741]: pgmap v16: 65 pgs: 65 active+clean; 291 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.5 MiB/s wr, 160 op/s 2024-04-26T21:26:50.302 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:50 smithi084 ceph-mon[25539]: pgmap v17: 65 pgs: 65 active+clean; 289 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.5 MiB/s wr, 138 op/s 2024-04-26T21:26:50.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:50 smithi120 ceph-mon[32741]: pgmap v17: 65 pgs: 65 active+clean; 289 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.5 MiB/s wr, 138 op/s 2024-04-26T21:26:51.319 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:51 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:26:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:51 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:26:52.326 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:52 smithi084 ceph-mon[25539]: pgmap v18: 65 pgs: 65 active+clean; 289 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.1 MiB/s wr, 100 op/s 2024-04-26T21:26:52.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:52 smithi120 ceph-mon[32741]: pgmap v18: 65 pgs: 65 active+clean; 289 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.1 MiB/s wr, 100 op/s 2024-04-26T21:26:54.314 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:54 smithi084 ceph-mon[25539]: pgmap v19: 65 pgs: 65 active+clean; 294 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 136 op/s 2024-04-26T21:26:54.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:54 smithi120 ceph-mon[32741]: pgmap v19: 65 pgs: 65 active+clean; 294 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 136 op/s 2024-04-26T21:26:55.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:55 smithi084 ceph-mon[25539]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:26:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:55 smithi120 ceph-mon[32741]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:26:56.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:56 smithi084 ceph-mon[25539]: pgmap v20: 65 pgs: 65 active+clean; 294 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.1 MiB/s wr, 78 op/s 2024-04-26T21:26:56.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:56 smithi120 ceph-mon[32741]: pgmap v20: 65 pgs: 65 active+clean; 294 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.1 MiB/s wr, 78 op/s 2024-04-26T21:26:57.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:57 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:57.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:57 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:57.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:57 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:26:57.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:57 smithi084 ceph-mon[25539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:26:57.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:57 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:26:57.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:57 smithi084 ceph-mon[25539]: pgmap v21: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 1.7 MiB/s wr, 119 op/s 2024-04-26T21:26:57.675 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:57 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:57.676 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:57 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:26:57.676 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:57 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:26:57.676 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:57 smithi120 ceph-mon[32741]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:26:57.676 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:57 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:26:57.676 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:57 smithi120 ceph-mon[32741]: pgmap v21: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 1.7 MiB/s wr, 119 op/s 2024-04-26T21:26:59.900 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:59 smithi120 ceph-mon[32741]: pgmap v22: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 79 op/s 2024-04-26T21:26:59.900 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:59 smithi120 ceph-mon[32741]: Upgrade: Updating mgr.smithi120.zjaduj 2024-04-26T21:26:59.900 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:59 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.zjaduj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:26:59.900 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:59 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:26:59.900 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:59 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:26:59.901 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:26:59 smithi120 ceph-mon[32741]: Deploying daemon mgr.smithi120.zjaduj on smithi120 2024-04-26T21:27:00.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:59 smithi084 ceph-mon[25539]: pgmap v22: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 79 op/s 2024-04-26T21:27:00.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:59 smithi084 ceph-mon[25539]: Upgrade: Updating mgr.smithi120.zjaduj 2024-04-26T21:27:00.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:59 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.zjaduj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:27:00.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:59 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:27:00.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:59 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:27:00.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:26:59 smithi084 ceph-mon[25539]: Deploying daemon mgr.smithi120.zjaduj on smithi120 2024-04-26T21:27:01.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.107+0000 7f7fb2c00700 1 -- 172.21.15.84:0/3315373546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac070830 msgr2=0x7f7fac070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:01.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.107+0000 7f7fb2c00700 1 --2- 172.21.15.84:0/3315373546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac070830 0x7f7fac070ca0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7f98004940 tx=0x7f7f98009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:01.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.107+0000 7f7fb2c00700 1 -- 172.21.15.84:0/3315373546 shutdown_connections 2024-04-26T21:27:01.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.107+0000 7f7fb2c00700 1 --2- 172.21.15.84:0/3315373546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac070830 0x7f7fac070ca0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:01.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.107+0000 7f7fb2c00700 1 --2- 172.21.15.84:0/3315373546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fac071de0 0x7f7fac0702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:01.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.107+0000 7f7fb2c00700 1 -- 172.21.15.84:0/3315373546 >> 172.21.15.84:0/3315373546 conn(0x7f7fac0f8560 msgr2=0x7f7fac0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:01.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.107+0000 7f7fb2c00700 1 -- 172.21.15.84:0/3315373546 shutdown_connections 2024-04-26T21:27:01.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.107+0000 7f7fb2c00700 1 -- 172.21.15.84:0/3315373546 wait complete. 2024-04-26T21:27:01.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.108+0000 7f7fb2c00700 1 Processor -- start 2024-04-26T21:27:01.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.108+0000 7f7fb2c00700 1 -- start start 2024-04-26T21:27:01.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.109+0000 7f7fb2c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac070830 0x7f7fac10fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:01.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.109+0000 7f7fb2c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fac071de0 0x7f7fac1101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:01.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.109+0000 7f7fb2c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac1107a0 con 0x7f7fac070830 2024-04-26T21:27:01.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.109+0000 7f7fb2c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac110fa0 con 0x7f7fac071de0 2024-04-26T21:27:01.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.109+0000 7f7fabe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac070830 0x7f7fac10fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:01.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.109+0000 7f7fabe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac070830 0x7f7fac10fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50962/0 (socket says 172.21.15.84:50962) 2024-04-26T21:27:01.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.109+0000 7f7fabe00700 1 -- 172.21.15.84:0/2336762827 learned_addr learned my addr 172.21.15.84:0/2336762827 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:27:01.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.109+0000 7f7fabe00700 1 -- 172.21.15.84:0/2336762827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fac071de0 msgr2=0x7f7fac1101a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:01.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.109+0000 7f7fabe00700 1 --2- 172.21.15.84:0/2336762827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fac071de0 0x7f7fac1101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:01.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.109+0000 7f7fabe00700 1 -- 172.21.15.84:0/2336762827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f98005040 con 0x7f7fac070830 2024-04-26T21:27:01.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.110+0000 7f7fabe00700 1 --2- 172.21.15.84:0/2336762827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac070830 0x7f7fac10fc60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00c8b0 tx=0x7f7f9c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:01.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.110+0000 7f7fa3e00700 1 -- 172.21.15.84:0/2336762827 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f9c00a760 con 0x7f7fac070830 2024-04-26T21:27:01.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.110+0000 7f7fa3e00700 1 -- 172.21.15.84:0/2336762827 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f9c00ad90 con 0x7f7fac070830 2024-04-26T21:27:01.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.110+0000 7f7fa3e00700 1 -- 172.21.15.84:0/2336762827 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f9c0113a0 con 0x7f7fac070830 2024-04-26T21:27:01.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.110+0000 7f7fb2c00700 1 -- 172.21.15.84:0/2336762827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fac111280 con 0x7f7fac070830 2024-04-26T21:27:01.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.110+0000 7f7fb2c00700 1 -- 172.21.15.84:0/2336762827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac1117c0 con 0x7f7fac070830 2024-04-26T21:27:01.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.111+0000 7f7fb2c00700 1 -- 172.21.15.84:0/2336762827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fac05f5c0 con 0x7f7fac070830 2024-04-26T21:27:01.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.113+0000 7f7fa3e00700 1 -- 172.21.15.84:0/2336762827 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 32) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f7f9c012400 con 0x7f7fac070830 2024-04-26T21:27:01.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.113+0000 7f7fa3e00700 1 --2- 172.21.15.84:0/2336762827 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f7f9006e620 0x7f7f90070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:01.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.114+0000 7f7fa3e00700 1 -- 172.21.15.84:0/2336762827 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f7f9c08dfc0 con 0x7f7fac070830 2024-04-26T21:27:01.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.114+0000 7f7fab400700 1 --2- 172.21.15.84:0/2336762827 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f7f9006e620 0x7f7f90070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:01.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.115+0000 7f7fab400700 1 --2- 172.21.15.84:0/2336762827 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f7f9006e620 0x7f7f90070ad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7f98004f90 tx=0x7f7f98009e30 comp rx=0 tx=0).ready entity=mgr.24429 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:01.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.119+0000 7f7fa3e00700 1 -- 172.21.15.84:0/2336762827 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f7f9c0c2930 con 0x7f7fac070830 2024-04-26T21:27:01.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.415+0000 7f7fb2c00700 1 -- 172.21.15.84:0/2336762827 --> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fac111c50 con 0x7f7f9006e620 2024-04-26T21:27:01.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.416+0000 7f7fa3e00700 1 -- 172.21.15.84:0/2336762827 <== mgr.24429 v2:172.21.15.84:6800/3665499318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f7fac111c50 con 0x7f7f9006e620 2024-04-26T21:27:01.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.419+0000 7f7fb2c00700 1 -- 172.21.15.84:0/2336762827 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f7f9006e620 msgr2=0x7f7f90070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:01.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.419+0000 7f7fb2c00700 1 --2- 172.21.15.84:0/2336762827 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f7f9006e620 0x7f7f90070ad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7f98004f90 tx=0x7f7f98009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:01.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.419+0000 7f7fb2c00700 1 -- 172.21.15.84:0/2336762827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac070830 msgr2=0x7f7fac10fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:01.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.419+0000 7f7fb2c00700 1 --2- 172.21.15.84:0/2336762827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac070830 0x7f7fac10fc60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00c8b0 tx=0x7f7f9c004470 comp rx=0 tx=0).stop 2024-04-26T21:27:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.419+0000 7f7fb2c00700 1 -- 172.21.15.84:0/2336762827 shutdown_connections 2024-04-26T21:27:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.419+0000 7f7fb2c00700 1 --2- 172.21.15.84:0/2336762827 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f7f9006e620 0x7f7f90070ad0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.419+0000 7f7fb2c00700 1 --2- 172.21.15.84:0/2336762827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fac070830 0x7f7fac10fc60 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.419+0000 7f7fb2c00700 1 --2- 172.21.15.84:0/2336762827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fac071de0 0x7f7fac1101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.419+0000 7f7fb2c00700 1 -- 172.21.15.84:0/2336762827 >> 172.21.15.84:0/2336762827 conn(0x7f7fac0f8560 msgr2=0x7f7fac0f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.419+0000 7f7fb2c00700 1 -- 172.21.15.84:0/2336762827 shutdown_connections 2024-04-26T21:27:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.419+0000 7f7fb2c00700 1 -- 172.21.15.84:0/2336762827 wait complete. 2024-04-26T21:27:01.435 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:27:01.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.574+0000 7fa803e00700 1 -- 172.21.15.84:0/1751262584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8040fffe0 msgr2=0x7fa804100450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:01.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.574+0000 7fa803e00700 1 --2- 172.21.15.84:0/1751262584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8040fffe0 0x7fa804100450 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0004940 tx=0x7fa7f0009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:01.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.574+0000 7fa803e00700 1 -- 172.21.15.84:0/1751262584 shutdown_connections 2024-04-26T21:27:01.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.574+0000 7fa803e00700 1 --2- 172.21.15.84:0/1751262584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8040fffe0 0x7fa804100450 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:01.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.574+0000 7fa803e00700 1 --2- 172.21.15.84:0/1751262584 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8040fee70 0x7fa8040ff280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:01.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.574+0000 7fa803e00700 1 -- 172.21.15.84:0/1751262584 >> 172.21.15.84:0/1751262584 conn(0x7fa8040fa570 msgr2=0x7fa8040fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:01.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.574+0000 7fa803e00700 1 -- 172.21.15.84:0/1751262584 shutdown_connections 2024-04-26T21:27:01.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.574+0000 7fa803e00700 1 -- 172.21.15.84:0/1751262584 wait complete. 2024-04-26T21:27:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.575+0000 7fa803e00700 1 Processor -- start 2024-04-26T21:27:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.575+0000 7fa803e00700 1 -- start start 2024-04-26T21:27:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.575+0000 7fa803e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8040fee70 0x7fa80410f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.575+0000 7fa803e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8040fffe0 0x7fa80410fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.575+0000 7fa803e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa804110490 con 0x7fa8040fee70 2024-04-26T21:27:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.575+0000 7fa803e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa804110ce0 con 0x7fa8040fffe0 2024-04-26T21:27:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.576+0000 7fa802a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8040fee70 0x7fa80410f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.576+0000 7fa802a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8040fee70 0x7fa80410f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50984/0 (socket says 172.21.15.84:50984) 2024-04-26T21:27:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.576+0000 7fa802a00700 1 -- 172.21.15.84:0/2289371783 learned_addr learned my addr 172.21.15.84:0/2289371783 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:27:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.576+0000 7fa802000700 1 --2- 172.21.15.84:0/2289371783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8040fffe0 0x7fa80410fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.576+0000 7fa802a00700 1 -- 172.21.15.84:0/2289371783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8040fffe0 msgr2=0x7fa80410fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.576+0000 7fa802a00700 1 --2- 172.21.15.84:0/2289371783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8040fffe0 0x7fa80410fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.576+0000 7fa802a00700 1 -- 172.21.15.84:0/2289371783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f0005040 con 0x7fa8040fee70 2024-04-26T21:27:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.576+0000 7fa802a00700 1 --2- 172.21.15.84:0/2289371783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8040fee70 0x7fa80410f950 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400eb40 tx=0x7fa7f400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.577+0000 7fa7faa00700 1 -- 172.21.15.84:0/2289371783 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7f4007cc0 con 0x7fa8040fee70 2024-04-26T21:27:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.577+0000 7fa7faa00700 1 -- 172.21.15.84:0/2289371783 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa7f400f040 con 0x7fa8040fee70 2024-04-26T21:27:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.577+0000 7fa803e00700 1 -- 172.21.15.84:0/2289371783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa804110f60 con 0x7fa8040fee70 2024-04-26T21:27:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.577+0000 7fa7faa00700 1 -- 172.21.15.84:0/2289371783 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7f400ca10 con 0x7fa8040fee70 2024-04-26T21:27:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.577+0000 7fa803e00700 1 -- 172.21.15.84:0/2289371783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8041114a0 con 0x7fa8040fee70 2024-04-26T21:27:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.578+0000 7fa803e00700 1 -- 172.21.15.84:0/2289371783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80405f5c0 con 0x7fa8040fee70 2024-04-26T21:27:01.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.579+0000 7fa7faa00700 1 -- 172.21.15.84:0/2289371783 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 32) v1 ==== 92569+0+0 (secure 0 0 0) 0x7fa7f400cc80 con 0x7fa8040fee70 2024-04-26T21:27:01.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.581+0000 7fa7faa00700 1 --2- 172.21.15.84:0/2289371783 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fa7e806e630 0x7fa7e8070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:01.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.581+0000 7fa7faa00700 1 -- 172.21.15.84:0/2289371783 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fa7f408dd80 con 0x7fa8040fee70 2024-04-26T21:27:01.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.581+0000 7fa802000700 1 --2- 172.21.15.84:0/2289371783 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fa7e806e630 0x7fa7e8070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:01.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.582+0000 7fa802000700 1 --2- 172.21.15.84:0/2289371783 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fa7e806e630 0x7fa7e8070ae0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000b0d0 tx=0x7fa7f0009e30 comp rx=0 tx=0).ready entity=mgr.24429 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:01.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.586+0000 7fa7faa00700 1 -- 172.21.15.84:0/2289371783 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fa7f405ad50 con 0x7fa8040fee70 2024-04-26T21:27:01.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.851+0000 7fa803e00700 1 -- 172.21.15.84:0/2289371783 --> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa804111730 con 0x7fa7e806e630 2024-04-26T21:27:01.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.853+0000 7fa7faa00700 1 -- 172.21.15.84:0/2289371783 <== mgr.24429 v2:172.21.15.84:6800/3665499318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fa804111730 con 0x7fa7e806e630 2024-04-26T21:27:01.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.856+0000 7fa803e00700 1 -- 172.21.15.84:0/2289371783 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fa7e806e630 msgr2=0x7fa7e8070ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:01.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.856+0000 7fa803e00700 1 --2- 172.21.15.84:0/2289371783 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fa7e806e630 0x7fa7e8070ae0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000b0d0 tx=0x7fa7f0009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:01.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.856+0000 7fa803e00700 1 -- 172.21.15.84:0/2289371783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8040fee70 msgr2=0x7fa80410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:01.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.856+0000 7fa803e00700 1 --2- 172.21.15.84:0/2289371783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8040fee70 0x7fa80410f950 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400eb40 tx=0x7fa7f400b040 comp rx=0 tx=0).stop 2024-04-26T21:27:01.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.856+0000 7fa803e00700 1 -- 172.21.15.84:0/2289371783 shutdown_connections 2024-04-26T21:27:01.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.856+0000 7fa803e00700 1 --2- 172.21.15.84:0/2289371783 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fa7e806e630 0x7fa7e8070ae0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:01.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.856+0000 7fa803e00700 1 --2- 172.21.15.84:0/2289371783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8040fee70 0x7fa80410f950 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:01.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.856+0000 7fa803e00700 1 --2- 172.21.15.84:0/2289371783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8040fffe0 0x7fa80410fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:01.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.856+0000 7fa803e00700 1 -- 172.21.15.84:0/2289371783 >> 172.21.15.84:0/2289371783 conn(0x7fa8040fa570 msgr2=0x7fa8040fbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:01.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.857+0000 7fa803e00700 1 -- 172.21.15.84:0/2289371783 shutdown_connections 2024-04-26T21:27:01.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:01.857+0000 7fa803e00700 1 -- 172.21.15.84:0/2289371783 wait complete. 2024-04-26T21:27:02.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.033+0000 7fa118a00700 1 -- 172.21.15.84:0/1318918272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1140fee80 msgr2=0x7fa1140ff290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:02.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.033+0000 7fa118a00700 1 --2- 172.21.15.84:0/1318918272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1140fee80 0x7fa1140ff290 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa104004940 tx=0x7fa104009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:02.034 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:01 smithi084 ceph-mon[25539]: pgmap v23: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 76 op/s 2024-04-26T21:27:02.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.033+0000 7fa118a00700 1 -- 172.21.15.84:0/1318918272 shutdown_connections 2024-04-26T21:27:02.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.033+0000 7fa118a00700 1 --2- 172.21.15.84:0/1318918272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa114100080 0x7fa1141004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:02.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.033+0000 7fa118a00700 1 --2- 172.21.15.84:0/1318918272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1140fee80 0x7fa1140ff290 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:02.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.033+0000 7fa118a00700 1 -- 172.21.15.84:0/1318918272 >> 172.21.15.84:0/1318918272 conn(0x7fa1140fa730 msgr2=0x7fa1140fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:02.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.033+0000 7fa118a00700 1 -- 172.21.15.84:0/1318918272 shutdown_connections 2024-04-26T21:27:02.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.033+0000 7fa118a00700 1 -- 172.21.15.84:0/1318918272 wait complete. 2024-04-26T21:27:02.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.036+0000 7fa118a00700 1 Processor -- start 2024-04-26T21:27:02.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.036+0000 7fa118a00700 1 -- start start 2024-04-26T21:27:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.037+0000 7fa118a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1140fee80 0x7fa11410fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.037+0000 7fa118a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa114100080 0x7fa11410ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.037+0000 7fa118a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa114110570 con 0x7fa114100080 2024-04-26T21:27:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.037+0000 7fa118a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa114110dc0 con 0x7fa1140fee80 2024-04-26T21:27:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.038+0000 7fa112a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa114100080 0x7fa11410ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.038+0000 7fa112a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa114100080 0x7fa11410ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56256/0 (socket says 172.21.15.84:56256) 2024-04-26T21:27:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.038+0000 7fa112a00700 1 -- 172.21.15.84:0/183502182 learned_addr learned my addr 172.21.15.84:0/183502182 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:27:02.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.038+0000 7fa112a00700 1 -- 172.21.15.84:0/183502182 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1140fee80 msgr2=0x7fa11410fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:02.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.038+0000 7fa112a00700 1 --2- 172.21.15.84:0/183502182 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1140fee80 0x7fa11410fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:02.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.038+0000 7fa112a00700 1 -- 172.21.15.84:0/183502182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa104005040 con 0x7fa114100080 2024-04-26T21:27:02.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.038+0000 7fa112a00700 1 --2- 172.21.15.84:0/183502182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa114100080 0x7fa11410ff70 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa100002a50 tx=0x7fa1000046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:02.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.039+0000 7fa10b400700 1 -- 172.21.15.84:0/183502182 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa100007cc0 con 0x7fa114100080 2024-04-26T21:27:02.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.039+0000 7fa10b400700 1 -- 172.21.15.84:0/183502182 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa10000f040 con 0x7fa114100080 2024-04-26T21:27:02.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.039+0000 7fa118a00700 1 -- 172.21.15.84:0/183502182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1141110a0 con 0x7fa114100080 2024-04-26T21:27:02.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.039+0000 7fa10b400700 1 -- 172.21.15.84:0/183502182 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa100009640 con 0x7fa114100080 2024-04-26T21:27:02.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.039+0000 7fa118a00700 1 -- 172.21.15.84:0/183502182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1141115e0 con 0x7fa114100080 2024-04-26T21:27:02.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.041+0000 7fa118a00700 1 -- 172.21.15.84:0/183502182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1140fe230 con 0x7fa114100080 2024-04-26T21:27:02.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.041+0000 7fa10b400700 1 -- 172.21.15.84:0/183502182 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 32) v1 ==== 92569+0+0 (secure 0 0 0) 0x7fa1000097a0 con 0x7fa114100080 2024-04-26T21:27:02.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.042+0000 7fa10b400700 1 --2- 172.21.15.84:0/183502182 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fa0f806e630 0x7fa0f8070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:02.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.043+0000 7fa10b400700 1 -- 172.21.15.84:0/183502182 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fa10008dec0 con 0x7fa114100080 2024-04-26T21:27:02.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.043+0000 7fa113400700 1 --2- 172.21.15.84:0/183502182 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fa0f806e630 0x7fa0f8070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:02.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.044+0000 7fa113400700 1 --2- 172.21.15.84:0/183502182 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fa0f806e630 0x7fa0f8070ae0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa104004f90 tx=0x7fa104009e30 comp rx=0 tx=0).ready entity=mgr.24429 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:02.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.048+0000 7fa10b400700 1 -- 172.21.15.84:0/183502182 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fa10005ae60 con 0x7fa114100080 2024-04-26T21:27:02.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:01 smithi120 ceph-mon[32741]: pgmap v23: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 76 op/s 2024-04-26T21:27:02.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.339+0000 7fa118a00700 1 -- 172.21.15.84:0/183502182 --> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1141119c0 con 0x7fa0f806e630 2024-04-26T21:27:02.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.362+0000 7fa10b400700 1 -- 172.21.15.84:0/183502182 <== mgr.24429 v2:172.21.15.84:6800/3665499318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fa1141119c0 con 0x7fa0f806e630 2024-04-26T21:27:02.366 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:27:02.366 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (112s) 33s ago 12m 15.2M - 0.25.0 c8568f914cd2 bcb419cf9108 2024-04-26T21:27:02.366 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (12m) 33s ago 12m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 a111b0ee8187 2024-04-26T21:27:02.366 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (11m) 36s ago 11m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 66f4d21263a1 2024-04-26T21:27:02.366 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (104s) 33s ago 12m 77.5M - 9.4.7 954c08fa6188 1bf95f604e07 2024-04-26T21:27:02.366 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (5m) 33s ago 5m 154M - 17.2.7-907-g2be3efa9 1c5834633715 485d7884e1d5 2024-04-26T21:27:02.366 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (5m) 33s ago 5m 12.7M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:27:02.366 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (5m) 36s ago 5m 152M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:27:02.366 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (5m) 36s ago 5m 12.6M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:27:02.366 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (82s) 33s ago 14m 474M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:27:02.366 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283 running (2m) 36s ago 11m 73.4M - 19.0.0-3306-gbc612ffb 55dc54019ad8 1a0fbef33353 2024-04-26T21:27:02.367 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (14m) 33s ago 14m 55.0M 2048M 17.2.7-907-g2be3efa9 1c5834633715 24cc2d798ea7 2024-04-26T21:27:02.367 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (11m) 36s ago 11m 43.0M 2048M 17.2.7-907-g2be3efa9 1c5834633715 72c786fd622b 2024-04-26T21:27:02.367 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (119s) 33s ago 12m 7633k - 1.5.0 0da6a335fe13 81e00b40bfbf 2024-04-26T21:27:02.367 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (93s) 36s ago 11m 7692k - 1.5.0 0da6a335fe13 0506a1d46ec4 2024-04-26T21:27:02.367 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (10m) 33s ago 10m 183M 1557M 17.2.7-907-g2be3efa9 1c5834633715 3a2e74d7e51a 2024-04-26T21:27:02.367 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (9m) 33s ago 9m 186M 1557M 17.2.7-907-g2be3efa9 1c5834633715 d283a0a93213 2024-04-26T21:27:02.367 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (9m) 33s ago 9m 142M 1557M 17.2.7-907-g2be3efa9 1c5834633715 5899468fc5c8 2024-04-26T21:27:02.367 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (8m) 36s ago 8m 200M 2581M 17.2.7-907-g2be3efa9 1c5834633715 b8a14c87d730 2024-04-26T21:27:02.367 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (8m) 36s ago 8m 181M 2581M 17.2.7-907-g2be3efa9 1c5834633715 4d294df735a3 2024-04-26T21:27:02.367 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (7m) 36s ago 7m 207M 2581M 17.2.7-907-g2be3efa9 1c5834633715 9b60997971a8 2024-04-26T21:27:02.367 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 starting - - - - 2024-04-26T21:27:02.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.367+0000 7fa118a00700 1 -- 172.21.15.84:0/183502182 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fa0f806e630 msgr2=0x7fa0f8070ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:02.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.367+0000 7fa118a00700 1 --2- 172.21.15.84:0/183502182 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fa0f806e630 0x7fa0f8070ae0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa104004f90 tx=0x7fa104009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:02.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.367+0000 7fa118a00700 1 -- 172.21.15.84:0/183502182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa114100080 msgr2=0x7fa11410ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:02.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.367+0000 7fa118a00700 1 --2- 172.21.15.84:0/183502182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa114100080 0x7fa11410ff70 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa100002a50 tx=0x7fa1000046b0 comp rx=0 tx=0).stop 2024-04-26T21:27:02.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.367+0000 7fa118a00700 1 -- 172.21.15.84:0/183502182 shutdown_connections 2024-04-26T21:27:02.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.367+0000 7fa118a00700 1 --2- 172.21.15.84:0/183502182 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1140fee80 0x7fa11410fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:02.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.367+0000 7fa118a00700 1 --2- 172.21.15.84:0/183502182 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fa0f806e630 0x7fa0f8070ae0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:02.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.367+0000 7fa118a00700 1 --2- 172.21.15.84:0/183502182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa114100080 0x7fa11410ff70 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:02.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.367+0000 7fa118a00700 1 -- 172.21.15.84:0/183502182 >> 172.21.15.84:0/183502182 conn(0x7fa1140fa730 msgr2=0x7fa1140fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:02.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.368+0000 7fa118a00700 1 -- 172.21.15.84:0/183502182 shutdown_connections 2024-04-26T21:27:02.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.368+0000 7fa118a00700 1 -- 172.21.15.84:0/183502182 wait complete. 2024-04-26T21:27:02.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.550+0000 7f953d800700 1 -- 172.21.15.84:0/3759106492 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95380fefc0 msgr2=0x7f95380ff3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:02.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.550+0000 7f953d800700 1 --2- 172.21.15.84:0/3759106492 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95380fefc0 0x7f95380ff3d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9520004940 tx=0x7f9520009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:02.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.550+0000 7f953d800700 1 -- 172.21.15.84:0/3759106492 shutdown_connections 2024-04-26T21:27:02.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.550+0000 7f953d800700 1 --2- 172.21.15.84:0/3759106492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9538100270 0x7f95381006e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:02.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.550+0000 7f953d800700 1 --2- 172.21.15.84:0/3759106492 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95380fefc0 0x7f95380ff3d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:02.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.550+0000 7f953d800700 1 -- 172.21.15.84:0/3759106492 >> 172.21.15.84:0/3759106492 conn(0x7f95380fa8f0 msgr2=0x7f95380fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:02.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.550+0000 7f953d800700 1 -- 172.21.15.84:0/3759106492 shutdown_connections 2024-04-26T21:27:02.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.550+0000 7f953d800700 1 -- 172.21.15.84:0/3759106492 wait complete. 2024-04-26T21:27:02.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.551+0000 7f953d800700 1 Processor -- start 2024-04-26T21:27:02.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.551+0000 7f953d800700 1 -- start start 2024-04-26T21:27:02.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.551+0000 7f953d800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95380fefc0 0x7f953810fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:02.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.551+0000 7f953d800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9538100270 0x7f953810ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:02.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.551+0000 7f953d800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95381105b0 con 0x7f9538100270 2024-04-26T21:27:02.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.551+0000 7f953d800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9538110720 con 0x7f95380fefc0 2024-04-26T21:27:02.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.552+0000 7f9536a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95380fefc0 0x7f953810fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:02.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.552+0000 7f9536a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95380fefc0 0x7f953810fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:50090/0 (socket says 172.21.15.84:50090) 2024-04-26T21:27:02.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.552+0000 7f9536000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9538100270 0x7f953810ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:02.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.552+0000 7f9536a00700 1 -- 172.21.15.84:0/1592235766 learned_addr learned my addr 172.21.15.84:0/1592235766 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:27:02.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.552+0000 7f9536a00700 1 -- 172.21.15.84:0/1592235766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9538100270 msgr2=0x7f953810ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:02.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.552+0000 7f9536a00700 1 --2- 172.21.15.84:0/1592235766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9538100270 0x7f953810ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:02.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.552+0000 7f9536a00700 1 -- 172.21.15.84:0/1592235766 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9520005040 con 0x7f95380fefc0 2024-04-26T21:27:02.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.553+0000 7f9536a00700 1 --2- 172.21.15.84:0/1592235766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95380fefc0 0x7f953810fa70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f952000b0d0 tx=0x7f9520009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:02.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.553+0000 7f952ea00700 1 -- 172.21.15.84:0/1592235766 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f952000e070 con 0x7f95380fefc0 2024-04-26T21:27:02.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.553+0000 7f952ea00700 1 -- 172.21.15.84:0/1592235766 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f952000b410 con 0x7f95380fefc0 2024-04-26T21:27:02.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.553+0000 7f952ea00700 1 -- 172.21.15.84:0/1592235766 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95200125e0 con 0x7f95380fefc0 2024-04-26T21:27:02.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.553+0000 7f953d800700 1 -- 172.21.15.84:0/1592235766 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9538115120 con 0x7f95380fefc0 2024-04-26T21:27:02.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.553+0000 7f953d800700 1 -- 172.21.15.84:0/1592235766 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95381156e0 con 0x7f95380fefc0 2024-04-26T21:27:02.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.555+0000 7f953d800700 1 -- 172.21.15.84:0/1592235766 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f953804c710 con 0x7f95380fefc0 2024-04-26T21:27:02.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.556+0000 7f952ea00700 1 -- 172.21.15.84:0/1592235766 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 32) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f952000b580 con 0x7f95380fefc0 2024-04-26T21:27:02.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.557+0000 7f952ea00700 1 --2- 172.21.15.84:0/1592235766 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f951c06e630 0x7f951c070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:02.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.557+0000 7f952ea00700 1 -- 172.21.15.84:0/1592235766 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f952008edf0 con 0x7f95380fefc0 2024-04-26T21:27:02.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.557+0000 7f9536000700 1 --2- 172.21.15.84:0/1592235766 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f951c06e630 0x7f951c070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:02.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.558+0000 7f9536000700 1 --2- 172.21.15.84:0/1592235766 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f951c06e630 0x7f951c070ae0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9528009b80 tx=0x7f952800b040 comp rx=0 tx=0).ready entity=mgr.24429 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:02.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.564+0000 7f952ea00700 1 -- 172.21.15.84:0/1592235766 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f952005be10 con 0x7f95380fefc0 2024-04-26T21:27:02.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.932+0000 7f953d800700 1 -- 172.21.15.84:0/1592235766 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9538115b00 con 0x7f95380fefc0 2024-04-26T21:27:02.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.933+0000 7f952ea00700 1 -- 172.21.15.84:0/1592235766 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f9520022300 con 0x7f95380fefc0 2024-04-26T21:27:02.934 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:27:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:27:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-26T21:27:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:27:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:27:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:27:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:27:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:27:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-26T21:27:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:27:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:27:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-26T21:27:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:27:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:27:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 12, 2024-04-26T21:27:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:27:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:27:02.935 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:27:02.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.936+0000 7f953d800700 1 -- 172.21.15.84:0/1592235766 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f951c06e630 msgr2=0x7f951c070ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:02.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.936+0000 7f953d800700 1 --2- 172.21.15.84:0/1592235766 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f951c06e630 0x7f951c070ae0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9528009b80 tx=0x7f952800b040 comp rx=0 tx=0).stop 2024-04-26T21:27:02.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.936+0000 7f953d800700 1 -- 172.21.15.84:0/1592235766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95380fefc0 msgr2=0x7f953810fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:02.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.936+0000 7f953d800700 1 --2- 172.21.15.84:0/1592235766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95380fefc0 0x7f953810fa70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f952000b0d0 tx=0x7f9520009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:02.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.936+0000 7f953d800700 1 -- 172.21.15.84:0/1592235766 shutdown_connections 2024-04-26T21:27:02.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.936+0000 7f953d800700 1 --2- 172.21.15.84:0/1592235766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95380fefc0 0x7f953810fa70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:02.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.936+0000 7f953d800700 1 --2- 172.21.15.84:0/1592235766 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f951c06e630 0x7f951c070ae0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:02.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.936+0000 7f953d800700 1 --2- 172.21.15.84:0/1592235766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9538100270 0x7f953810ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:02.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.936+0000 7f953d800700 1 -- 172.21.15.84:0/1592235766 >> 172.21.15.84:0/1592235766 conn(0x7f95380fa8f0 msgr2=0x7f95380fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:02.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.937+0000 7f953d800700 1 -- 172.21.15.84:0/1592235766 shutdown_connections 2024-04-26T21:27:02.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:02.937+0000 7f953d800700 1 -- 172.21.15.84:0/1592235766 wait complete. 2024-04-26T21:27:02.994 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:02 smithi120 ceph-mon[32741]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:27:02.994 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:02 smithi120 ceph-mon[32741]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:27:03.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.109+0000 7f24c2e00700 1 -- 172.21.15.84:0/2129287663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24bc066ed0 msgr2=0x7f24bc0ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:03.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.109+0000 7f24c2e00700 1 --2- 172.21.15.84:0/2129287663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24bc066ed0 0x7f24bc0ff9a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f24ac004940 tx=0x7f24ac009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:03.109 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:02 smithi084 ceph-mon[25539]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:27:03.109 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:02 smithi084 ceph-mon[25539]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:27:03.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.109+0000 7f24c2e00700 1 -- 172.21.15.84:0/2129287663 shutdown_connections 2024-04-26T21:27:03.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.109+0000 7f24c2e00700 1 --2- 172.21.15.84:0/2129287663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24bc0ffee0 0x7f24bc102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:03.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.109+0000 7f24c2e00700 1 --2- 172.21.15.84:0/2129287663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24bc066ed0 0x7f24bc0ff9a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:03.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.109+0000 7f24c2e00700 1 -- 172.21.15.84:0/2129287663 >> 172.21.15.84:0/2129287663 conn(0x7f24bc0f7430 msgr2=0x7f24bc0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:03.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.109+0000 7f24c2e00700 1 -- 172.21.15.84:0/2129287663 shutdown_connections 2024-04-26T21:27:03.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.109+0000 7f24c2e00700 1 -- 172.21.15.84:0/2129287663 wait complete. 2024-04-26T21:27:03.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.110+0000 7f24c2e00700 1 Processor -- start 2024-04-26T21:27:03.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.110+0000 7f24c2e00700 1 -- start start 2024-04-26T21:27:03.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.110+0000 7f24c2e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24bc066ed0 0x7f24bc10fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:03.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.111+0000 7f24c2e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24bc0ffee0 0x7f24bc1100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:03.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.111+0000 7f24c2e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc110740 con 0x7f24bc0ffee0 2024-04-26T21:27:03.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.111+0000 7f24c2e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc1150e0 con 0x7f24bc066ed0 2024-04-26T21:27:03.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.111+0000 7f24bb400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24bc0ffee0 0x7f24bc1100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:03.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.111+0000 7f24bbe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24bc066ed0 0x7f24bc10fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:03.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.111+0000 7f24bb400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24bc0ffee0 0x7f24bc1100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56302/0 (socket says 172.21.15.84:56302) 2024-04-26T21:27:03.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.111+0000 7f24bb400700 1 -- 172.21.15.84:0/2867676191 learned_addr learned my addr 172.21.15.84:0/2867676191 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:27:03.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.112+0000 7f24bb400700 1 -- 172.21.15.84:0/2867676191 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24bc066ed0 msgr2=0x7f24bc10fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:03.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.112+0000 7f24bb400700 1 --2- 172.21.15.84:0/2867676191 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24bc066ed0 0x7f24bc10fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:03.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.112+0000 7f24bb400700 1 -- 172.21.15.84:0/2867676191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac005040 con 0x7f24bc0ffee0 2024-04-26T21:27:03.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.112+0000 7f24bb400700 1 --2- 172.21.15.84:0/2867676191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24bc0ffee0 0x7f24bc1100b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f24a800b790 tx=0x7f24a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:03.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.113+0000 7f24b3e00700 1 -- 172.21.15.84:0/2867676191 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24a800f6f0 con 0x7f24bc0ffee0 2024-04-26T21:27:03.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.113+0000 7f24c2e00700 1 -- 172.21.15.84:0/2867676191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24bc115340 con 0x7f24bc0ffee0 2024-04-26T21:27:03.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.113+0000 7f24b3e00700 1 -- 172.21.15.84:0/2867676191 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f24a800fd20 con 0x7f24bc0ffee0 2024-04-26T21:27:03.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.113+0000 7f24b3e00700 1 -- 172.21.15.84:0/2867676191 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24a80103a0 con 0x7f24bc0ffee0 2024-04-26T21:27:03.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.113+0000 7f24c2e00700 1 -- 172.21.15.84:0/2867676191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24bc1158b0 con 0x7f24bc0ffee0 2024-04-26T21:27:03.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.115+0000 7f24c2e00700 1 -- 172.21.15.84:0/2867676191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24bc04c710 con 0x7f24bc0ffee0 2024-04-26T21:27:03.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.116+0000 7f24b3e00700 1 -- 172.21.15.84:0/2867676191 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 32) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f24a8011400 con 0x7f24bc0ffee0 2024-04-26T21:27:03.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.117+0000 7f24b3e00700 1 --2- 172.21.15.84:0/2867676191 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f24a006e630 0x7f24a0070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:03.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.117+0000 7f24b3e00700 1 -- 172.21.15.84:0/2867676191 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f24a808deb0 con 0x7f24bc0ffee0 2024-04-26T21:27:03.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.118+0000 7f24bbe00700 1 --2- 172.21.15.84:0/2867676191 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f24a006e630 0x7f24a0070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:03.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.118+0000 7f24bbe00700 1 --2- 172.21.15.84:0/2867676191 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f24a006e630 0x7f24a0070ae0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00b3b0 tx=0x7f24ac009e30 comp rx=0 tx=0).ready entity=mgr.24429 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:03.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.124+0000 7f24b3e00700 1 -- 172.21.15.84:0/2867676191 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f24a805af60 con 0x7f24bc0ffee0 2024-04-26T21:27:03.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.457+0000 7f24c2e00700 1 -- 172.21.15.84:0/2867676191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f24bc105910 con 0x7f24bc0ffee0 2024-04-26T21:27:03.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.458+0000 7f24b3e00700 1 -- 172.21.15.84:0/2867676191 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1835 (secure 0 0 0) 0x7f24a805aaf0 con 0x7f24bc0ffee0 2024-04-26T21:27:03.460 INFO:teuthology.orchestra.run.smithi084.stdout:e14 2024-04-26T21:27:03.461 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:27:03.461 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:27:03.461 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:27:03.461 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:27:03.461 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:27:03.461 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:27:03.461 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 14 2024-04-26T21:27:03.461 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:27:03.461 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:27:03.461 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:27:02.728852+0000 2024-04-26T21:27:03.461 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:27:03.461 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:27:03.461 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:27:03.461 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:27:03.461 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:27:03.462 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:27:03.462 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:27:03.462 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:27:03.462 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:27:03.462 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:27:03.462 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:27:03.462 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456,1=24231} 2024-04-26T21:27:03.462 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:27:03.462 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:27:03.462 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:27:03.462 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:27:03.462 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:27:03.462 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:27:03.462 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:27:03.462 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:27:03.462 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:27:03.463 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:27:03.463 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:27:03.463 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:27:03.463 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:27:03.463 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:27:03.463 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:27:03.463 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:27:03.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.463+0000 7f24c2e00700 1 -- 172.21.15.84:0/2867676191 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f24a006e630 msgr2=0x7f24a0070ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:03.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.463+0000 7f24c2e00700 1 --2- 172.21.15.84:0/2867676191 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f24a006e630 0x7f24a0070ae0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00b3b0 tx=0x7f24ac009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:03.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.463+0000 7f24c2e00700 1 -- 172.21.15.84:0/2867676191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24bc0ffee0 msgr2=0x7f24bc1100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:03.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.463+0000 7f24c2e00700 1 --2- 172.21.15.84:0/2867676191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24bc0ffee0 0x7f24bc1100b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f24a800b790 tx=0x7f24a8009250 comp rx=0 tx=0).stop 2024-04-26T21:27:03.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.463+0000 7f24c2e00700 1 -- 172.21.15.84:0/2867676191 shutdown_connections 2024-04-26T21:27:03.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.463+0000 7f24c2e00700 1 --2- 172.21.15.84:0/2867676191 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24bc066ed0 0x7f24bc10fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:03.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.463+0000 7f24c2e00700 1 --2- 172.21.15.84:0/2867676191 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f24a006e630 0x7f24a0070ae0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:03.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.463+0000 7f24c2e00700 1 --2- 172.21.15.84:0/2867676191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24bc0ffee0 0x7f24bc1100b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:03.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.463+0000 7f24c2e00700 1 -- 172.21.15.84:0/2867676191 >> 172.21.15.84:0/2867676191 conn(0x7f24bc0f7430 msgr2=0x7f24bc0fba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:03.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.463+0000 7f24c2e00700 1 -- 172.21.15.84:0/2867676191 shutdown_connections 2024-04-26T21:27:03.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.463+0000 7f24c2e00700 1 -- 172.21.15.84:0/2867676191 wait complete. 2024-04-26T21:27:03.466 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 14 2024-04-26T21:27:03.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.682+0000 7f7575600700 1 -- 172.21.15.84:0/1578206148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75701002a0 msgr2=0x7f7570100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:03.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.682+0000 7f7575600700 1 --2- 172.21.15.84:0/1578206148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75701002a0 0x7f7570100710 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f755c004940 tx=0x7f755c009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:03.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.682+0000 7f7575600700 1 -- 172.21.15.84:0/1578206148 shutdown_connections 2024-04-26T21:27:03.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.682+0000 7f7575600700 1 --2- 172.21.15.84:0/1578206148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75701002a0 0x7f7570100710 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:03.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.682+0000 7f7575600700 1 --2- 172.21.15.84:0/1578206148 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75700feff0 0x7f75700ff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:03.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.682+0000 7f7575600700 1 -- 172.21.15.84:0/1578206148 >> 172.21.15.84:0/1578206148 conn(0x7f75700fa8f0 msgr2=0x7f75700fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:03.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.683+0000 7f7575600700 1 -- 172.21.15.84:0/1578206148 shutdown_connections 2024-04-26T21:27:03.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.683+0000 7f7575600700 1 -- 172.21.15.84:0/1578206148 wait complete. 2024-04-26T21:27:03.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.684+0000 7f7575600700 1 Processor -- start 2024-04-26T21:27:03.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.684+0000 7f7575600700 1 -- start start 2024-04-26T21:27:03.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.684+0000 7f7575600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75700feff0 0x7f757010fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:03.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.684+0000 7f7575600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75701002a0 0x7f7570110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:03.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.684+0000 7f7575600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7570110650 con 0x7f75700feff0 2024-04-26T21:27:03.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.685+0000 7f7575600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75701107c0 con 0x7f75701002a0 2024-04-26T21:27:03.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.685+0000 7f756ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75700feff0 0x7f757010fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:03.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.685+0000 7f756ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75700feff0 0x7f757010fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56320/0 (socket says 172.21.15.84:56320) 2024-04-26T21:27:03.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.685+0000 7f756ea00700 1 -- 172.21.15.84:0/3041030903 learned_addr learned my addr 172.21.15.84:0/3041030903 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:27:03.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.685+0000 7f756e000700 1 --2- 172.21.15.84:0/3041030903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75701002a0 0x7f7570110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:03.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.686+0000 7f756ea00700 1 -- 172.21.15.84:0/3041030903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75701002a0 msgr2=0x7f7570110050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:03.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.686+0000 7f756ea00700 1 --2- 172.21.15.84:0/3041030903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75701002a0 0x7f7570110050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:03.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.686+0000 7f756ea00700 1 -- 172.21.15.84:0/3041030903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c005040 con 0x7f75700feff0 2024-04-26T21:27:03.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.686+0000 7f756e000700 1 --2- 172.21.15.84:0/3041030903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75701002a0 0x7f7570110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:27:03.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.686+0000 7f756ea00700 1 --2- 172.21.15.84:0/3041030903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75700feff0 0x7f757010fb10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7560002a50 tx=0x7f75600046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:03.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.687+0000 7f7566a00700 1 -- 172.21.15.84:0/3041030903 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7560007cc0 con 0x7f75700feff0 2024-04-26T21:27:03.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.688+0000 7f7566a00700 1 -- 172.21.15.84:0/3041030903 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f756000f040 con 0x7f75700feff0 2024-04-26T21:27:03.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.688+0000 7f7566a00700 1 -- 172.21.15.84:0/3041030903 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f756000db30 con 0x7f75700feff0 2024-04-26T21:27:03.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.688+0000 7f7575600700 1 -- 172.21.15.84:0/3041030903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7570115220 con 0x7f75700feff0 2024-04-26T21:27:03.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.688+0000 7f7575600700 1 -- 172.21.15.84:0/3041030903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75701157e0 con 0x7f75700feff0 2024-04-26T21:27:03.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.690+0000 7f7575600700 1 -- 172.21.15.84:0/3041030903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757004c710 con 0x7f75700feff0 2024-04-26T21:27:03.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.695+0000 7f7566a00700 1 -- 172.21.15.84:0/3041030903 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 32) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f756000dc90 con 0x7f75700feff0 2024-04-26T21:27:03.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.696+0000 7f7566a00700 1 --2- 172.21.15.84:0/3041030903 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f755406e660 0x7f7554070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:03.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.697+0000 7f7566a00700 1 -- 172.21.15.84:0/3041030903 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f756008e560 con 0x7f75700feff0 2024-04-26T21:27:03.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.698+0000 7f756e000700 1 --2- 172.21.15.84:0/3041030903 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f755406e660 0x7f7554070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:03.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.699+0000 7f756e000700 1 --2- 172.21.15.84:0/3041030903 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f755406e660 0x7f7554070b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f755c00b7a0 tx=0x7f755c009e30 comp rx=0 tx=0).ready entity=mgr.24429 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:03.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:03.700+0000 7f7566a00700 1 -- 172.21.15.84:0/3041030903 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f756005b630 con 0x7f75700feff0 2024-04-26T21:27:04.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.059+0000 7f7575600700 1 -- 172.21.15.84:0/3041030903 --> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7570104610 con 0x7f755406e660 2024-04-26T21:27:04.060 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:03 smithi084 ceph-mon[25539]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:27:04.060 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:03 smithi084 ceph-mon[25539]: pgmap v24: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.8 MiB/s wr, 110 op/s 2024-04-26T21:27:04.060 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:03 smithi084 ceph-mon[25539]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:27:04.060 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:03 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/1592235766' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:27:04.060 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:03 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/2867676191' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:27:04.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.061+0000 7f7566a00700 1 -- 172.21.15.84:0/3041030903 <== mgr.24429 v2:172.21.15.84:6800/3665499318 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f7570104610 con 0x7f755406e660 2024-04-26T21:27:04.062 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:27:04.062 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:27:04.062 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:27:04.062 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:27:04.062 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-04-26T21:27:04.062 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr" 2024-04-26T21:27:04.062 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-04-26T21:27:04.062 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "2/21 daemons upgraded", 2024-04-26T21:27:04.062 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading mgr daemons", 2024-04-26T21:27:04.062 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:27:04.062 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:27:04.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.064+0000 7f7575600700 1 -- 172.21.15.84:0/3041030903 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f755406e660 msgr2=0x7f7554070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:04.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.064+0000 7f7575600700 1 --2- 172.21.15.84:0/3041030903 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f755406e660 0x7f7554070b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f755c00b7a0 tx=0x7f755c009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:04.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.064+0000 7f7575600700 1 -- 172.21.15.84:0/3041030903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75700feff0 msgr2=0x7f757010fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:04.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.064+0000 7f7575600700 1 --2- 172.21.15.84:0/3041030903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75700feff0 0x7f757010fb10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7560002a50 tx=0x7f75600046b0 comp rx=0 tx=0).stop 2024-04-26T21:27:04.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.064+0000 7f7575600700 1 -- 172.21.15.84:0/3041030903 shutdown_connections 2024-04-26T21:27:04.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.064+0000 7f7575600700 1 --2- 172.21.15.84:0/3041030903 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7f755406e660 0x7f7554070b10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:04.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.064+0000 7f7575600700 1 --2- 172.21.15.84:0/3041030903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75700feff0 0x7f757010fb10 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:04.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.064+0000 7f7575600700 1 --2- 172.21.15.84:0/3041030903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75701002a0 0x7f7570110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:04.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.064+0000 7f7575600700 1 -- 172.21.15.84:0/3041030903 >> 172.21.15.84:0/3041030903 conn(0x7f75700fa8f0 msgr2=0x7f75700fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:04.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.065+0000 7f7575600700 1 -- 172.21.15.84:0/3041030903 shutdown_connections 2024-04-26T21:27:04.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.065+0000 7f7575600700 1 -- 172.21.15.84:0/3041030903 wait complete. 2024-04-26T21:27:04.142 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:03 smithi120 ceph-mon[32741]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:27:04.143 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:03 smithi120 ceph-mon[32741]: pgmap v24: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.8 MiB/s wr, 110 op/s 2024-04-26T21:27:04.143 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:03 smithi120 ceph-mon[32741]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:27:04.143 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:03 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/1592235766' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:27:04.143 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:03 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2867676191' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:27:04.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.230+0000 7fe6b6000700 1 -- 172.21.15.84:0/3742028001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6b00fe080 msgr2=0x7fe6b00fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:04.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.230+0000 7fe6b6000700 1 --2- 172.21.15.84:0/3742028001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6b00fe080 0x7fe6b00fe4f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe69c004940 tx=0x7fe69c009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:04.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.230+0000 7fe6b6000700 1 -- 172.21.15.84:0/3742028001 shutdown_connections 2024-04-26T21:27:04.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.230+0000 7fe6b6000700 1 --2- 172.21.15.84:0/3742028001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6b00fe080 0x7fe6b00fe4f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:04.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.230+0000 7fe6b6000700 1 --2- 172.21.15.84:0/3742028001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6b00fcf10 0x7fe6b00fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:04.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.230+0000 7fe6b6000700 1 -- 172.21.15.84:0/3742028001 >> 172.21.15.84:0/3742028001 conn(0x7fe6b00f8560 msgr2=0x7fe6b00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:04.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.230+0000 7fe6b6000700 1 -- 172.21.15.84:0/3742028001 shutdown_connections 2024-04-26T21:27:04.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.230+0000 7fe6b6000700 1 -- 172.21.15.84:0/3742028001 wait complete. 2024-04-26T21:27:04.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.231+0000 7fe6b6000700 1 Processor -- start 2024-04-26T21:27:04.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.232+0000 7fe6b6000700 1 -- start start 2024-04-26T21:27:04.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.232+0000 7fe6b6000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6b00fcf10 0x7fe6b010da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:04.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.232+0000 7fe6b6000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6b00fe080 0x7fe6b010df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:04.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.232+0000 7fe6b6000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b010e5d0 con 0x7fe6b00fe080 2024-04-26T21:27:04.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.232+0000 7fe6b6000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b010edc0 con 0x7fe6b00fcf10 2024-04-26T21:27:04.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.232+0000 7fe6aea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6b00fe080 0x7fe6b010df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:04.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.232+0000 7fe6aea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6b00fe080 0x7fe6b010df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56340/0 (socket says 172.21.15.84:56340) 2024-04-26T21:27:04.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.232+0000 7fe6aea00700 1 -- 172.21.15.84:0/148614180 learned_addr learned my addr 172.21.15.84:0/148614180 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:27:04.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.232+0000 7fe6af400700 1 --2- 172.21.15.84:0/148614180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6b00fcf10 0x7fe6b010da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:04.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.233+0000 7fe6aea00700 1 -- 172.21.15.84:0/148614180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6b00fcf10 msgr2=0x7fe6b010da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:04.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.233+0000 7fe6aea00700 1 --2- 172.21.15.84:0/148614180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6b00fcf10 0x7fe6b010da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:04.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.233+0000 7fe6aea00700 1 -- 172.21.15.84:0/148614180 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c005040 con 0x7fe6b00fe080 2024-04-26T21:27:04.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.233+0000 7fe6aea00700 1 --2- 172.21.15.84:0/148614180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6b00fe080 0x7fe6b010df40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00b3b0 tx=0x7fe69c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:04.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.233+0000 7fe6a7400700 1 -- 172.21.15.84:0/148614180 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe69c00e040 con 0x7fe6b00fe080 2024-04-26T21:27:04.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.233+0000 7fe6a7400700 1 -- 172.21.15.84:0/148614180 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe69c004290 con 0x7fe6b00fe080 2024-04-26T21:27:04.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.233+0000 7fe6a7400700 1 -- 172.21.15.84:0/148614180 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe69c01c630 con 0x7fe6b00fe080 2024-04-26T21:27:04.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.233+0000 7fe6b6000700 1 -- 172.21.15.84:0/148614180 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b010f040 con 0x7fe6b00fe080 2024-04-26T21:27:04.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.234+0000 7fe6b6000700 1 -- 172.21.15.84:0/148614180 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b010f600 con 0x7fe6b00fe080 2024-04-26T21:27:04.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.235+0000 7fe6b6000700 1 -- 172.21.15.84:0/148614180 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b005f5c0 con 0x7fe6b00fe080 2024-04-26T21:27:04.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.236+0000 7fe6a7400700 1 -- 172.21.15.84:0/148614180 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 32) v1 ==== 92569+0+0 (secure 0 0 0) 0x7fe69c00bbf0 con 0x7fe6b00fe080 2024-04-26T21:27:04.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.237+0000 7fe6a7400700 1 --2- 172.21.15.84:0/148614180 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fe69406e620 0x7fe694070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:04.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.237+0000 7fe6a7400700 1 -- 172.21.15.84:0/148614180 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fe69c08f430 con 0x7fe6b00fe080 2024-04-26T21:27:04.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.238+0000 7fe6af400700 1 --2- 172.21.15.84:0/148614180 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fe69406e620 0x7fe694070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:04.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.238+0000 7fe6af400700 1 --2- 172.21.15.84:0/148614180 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fe69406e620 0x7fe694070ad0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0006fd0 tx=0x7fe6a0008040 comp rx=0 tx=0).ready entity=mgr.24429 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:04.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.243+0000 7fe6a7400700 1 -- 172.21.15.84:0/148614180 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fe69c05c510 con 0x7fe6b00fe080 2024-04-26T21:27:04.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.663+0000 7fe6b6000700 1 -- 172.21.15.84:0/148614180 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe6b004bed0 con 0x7fe6b00fe080 2024-04-26T21:27:04.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.663+0000 7fe6a7400700 1 -- 172.21.15.84:0/148614180 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fe69c05c0a0 con 0x7fe6b00fe080 2024-04-26T21:27:04.664 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:27:04.664 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:27:04.664 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:27:04.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.666+0000 7fe6b6000700 1 -- 172.21.15.84:0/148614180 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fe69406e620 msgr2=0x7fe694070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:04.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.666+0000 7fe6b6000700 1 --2- 172.21.15.84:0/148614180 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fe69406e620 0x7fe694070ad0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0006fd0 tx=0x7fe6a0008040 comp rx=0 tx=0).stop 2024-04-26T21:27:04.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.666+0000 7fe6b6000700 1 -- 172.21.15.84:0/148614180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6b00fe080 msgr2=0x7fe6b010df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:04.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.666+0000 7fe6b6000700 1 --2- 172.21.15.84:0/148614180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6b00fe080 0x7fe6b010df40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00b3b0 tx=0x7fe69c009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:04.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.666+0000 7fe6b6000700 1 -- 172.21.15.84:0/148614180 shutdown_connections 2024-04-26T21:27:04.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.666+0000 7fe6b6000700 1 --2- 172.21.15.84:0/148614180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6b00fcf10 0x7fe6b010da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:04.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.666+0000 7fe6b6000700 1 --2- 172.21.15.84:0/148614180 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7fe69406e620 0x7fe694070ad0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:04.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.666+0000 7fe6b6000700 1 --2- 172.21.15.84:0/148614180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6b00fe080 0x7fe6b010df40 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:04.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.666+0000 7fe6b6000700 1 -- 172.21.15.84:0/148614180 >> 172.21.15.84:0/148614180 conn(0x7fe6b00f8560 msgr2=0x7fe6b00f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:04.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.667+0000 7fe6b6000700 1 -- 172.21.15.84:0/148614180 shutdown_connections 2024-04-26T21:27:04.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:04.667+0000 7fe6b6000700 1 -- 172.21.15.84:0/148614180 wait complete. 2024-04-26T21:27:05.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:04 smithi084 ceph-mon[25539]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:27:05.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:04 smithi084 ceph-mon[25539]: from='client.? 172.21.15.84:0/148614180' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:27:05.175 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:04 smithi120 ceph-mon[32741]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:27:05.176 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:04 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/148614180' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:27:06.029 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:05 smithi120 ceph-mon[32741]: pgmap v25: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.2 MiB/s wr, 74 op/s 2024-04-26T21:27:06.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:05 smithi084 ceph-mon[25539]: pgmap v25: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.2 MiB/s wr, 74 op/s 2024-04-26T21:27:07.106 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:06 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:27:07.106 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:06 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:07.106 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:06 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:07.106 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:06 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:27:07.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:06 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:27:07.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:06 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:07.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:06 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:07.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:06 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:27:08.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:08 smithi084 ceph-mon[25539]: pgmap v26: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.9 MiB/s wr, 120 op/s 2024-04-26T21:27:08.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:08 smithi120 ceph-mon[32741]: pgmap v26: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.9 MiB/s wr, 120 op/s 2024-04-26T21:27:10.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:10 smithi084 ceph-mon[25539]: pgmap v27: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 80 op/s 2024-04-26T21:27:10.424 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:10 smithi120 ceph-mon[32741]: pgmap v27: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 80 op/s 2024-04-26T21:27:12.290 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:12 smithi084 ceph-mon[25539]: pgmap v28: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 80 op/s 2024-04-26T21:27:12.291 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:12 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:12.291 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:12 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:12.312 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:12 smithi120 ceph-mon[32741]: pgmap v28: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 80 op/s 2024-04-26T21:27:12.312 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:12 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:12.313 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:12 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:14.355 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:14 smithi120 ceph-mon[32741]: pgmap v29: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.9 MiB/s wr, 132 op/s 2024-04-26T21:27:14.355 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:14 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:14.355 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:14 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:14.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:14 smithi084 ceph-mon[25539]: pgmap v29: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.9 MiB/s wr, 132 op/s 2024-04-26T21:27:14.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:14 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:14.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:14 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:15.196 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:15 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:15.196 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:15 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:15.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:15 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:15.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:15 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:16.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:16 smithi120 ceph-mon[32741]: pgmap v30: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 98 op/s 2024-04-26T21:27:16.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:16 smithi084 ceph-mon[25539]: pgmap v30: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 98 op/s 2024-04-26T21:27:17.308 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:17 smithi120 ceph-mon[32741]: Standby manager daemon smithi120.zjaduj restarted 2024-04-26T21:27:17.308 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:17 smithi120 ceph-mon[32741]: Standby manager daemon smithi120.zjaduj started 2024-04-26T21:27:17.308 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:17 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.120:0/192835338' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.zjaduj/crt"}]: dispatch 2024-04-26T21:27:17.308 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:17 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.120:0/192835338' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:27:17.308 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:17 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.120:0/192835338' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.zjaduj/key"}]: dispatch 2024-04-26T21:27:17.308 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:17 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.120:0/192835338' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:27:17.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:17 smithi084 ceph-mon[25539]: Standby manager daemon smithi120.zjaduj restarted 2024-04-26T21:27:17.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:17 smithi084 ceph-mon[25539]: Standby manager daemon smithi120.zjaduj started 2024-04-26T21:27:17.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:17 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.120:0/192835338' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.zjaduj/crt"}]: dispatch 2024-04-26T21:27:17.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:17 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.120:0/192835338' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:27:17.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:17 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.120:0/192835338' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.zjaduj/key"}]: dispatch 2024-04-26T21:27:17.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:17 smithi084 ceph-mon[25539]: from='mgr.? 172.21.15.120:0/192835338' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:27:18.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:18 smithi084 ceph-mon[25539]: pgmap v31: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 2.1 MiB/s wr, 140 op/s 2024-04-26T21:27:18.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:18 smithi084 ceph-mon[25539]: mgrmap e33: smithi084.gyasul(active, since 56s), standbys: smithi120.zjaduj 2024-04-26T21:27:18.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:18 smithi120 ceph-mon[32741]: pgmap v31: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 2.1 MiB/s wr, 140 op/s 2024-04-26T21:27:18.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:18 smithi120 ceph-mon[32741]: mgrmap e33: smithi084.gyasul(active, since 56s), standbys: smithi120.zjaduj 2024-04-26T21:27:19.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:19 smithi084 ceph-mon[25539]: pgmap v32: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 94 op/s 2024-04-26T21:27:19.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:19 smithi120 ceph-mon[32741]: pgmap v32: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 94 op/s 2024-04-26T21:27:21.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:21.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:21.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:27:21.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:27:21.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:21.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:27:21.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:27:21.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:21 smithi084 ceph-mon[25539]: Upgrade: Setting container_image for all mgr 2024-04-26T21:27:21.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:21.612 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi084.gyasul"}]: dispatch 2024-04-26T21:27:21.612 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi084.gyasul"}]': finished 2024-04-26T21:27:21.612 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi120.zjaduj"}]: dispatch 2024-04-26T21:27:21.612 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi120.zjaduj"}]': finished 2024-04-26T21:27:21.612 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-26T21:27:21.612 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:21 smithi084 ceph-mon[25539]: pgmap v33: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 94 op/s 2024-04-26T21:27:21.612 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:21 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:27:21.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:21.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:21.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:27:21.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:27:21.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:21.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:27:21.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:27:21.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:21 smithi120 ceph-mon[32741]: Upgrade: Setting container_image for all mgr 2024-04-26T21:27:21.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:21.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi084.gyasul"}]: dispatch 2024-04-26T21:27:21.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi084.gyasul"}]': finished 2024-04-26T21:27:21.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi120.zjaduj"}]: dispatch 2024-04-26T21:27:21.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi120.zjaduj"}]': finished 2024-04-26T21:27:21.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-26T21:27:21.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:21 smithi120 ceph-mon[32741]: pgmap v33: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 94 op/s 2024-04-26T21:27:21.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:21 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:27:23.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:23 smithi084 ceph-mon[25539]: pgmap v34: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 2.0 MiB/s wr, 130 op/s 2024-04-26T21:27:24.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:23 smithi120 ceph-mon[32741]: pgmap v34: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 2.0 MiB/s wr, 130 op/s 2024-04-26T21:27:25.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:25 smithi084 ceph-mon[25539]: pgmap v35: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.4 MiB/s wr, 78 op/s 2024-04-26T21:27:25.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:25 smithi084 ceph-mon[25539]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:27:26.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:25 smithi120 ceph-mon[32741]: pgmap v35: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.4 MiB/s wr, 78 op/s 2024-04-26T21:27:26.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:25 smithi120 ceph-mon[32741]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:27:27.411 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:27 smithi084 ceph-mon[25539]: Upgrade: Updating mon.smithi084 2024-04-26T21:27:27.411 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:27 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:27.411 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:27 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:27:27.411 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:27 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T21:27:27.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:27 smithi084 ceph-mon[25539]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:27:27.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:27 smithi084 ceph-mon[25539]: Deploying daemon mon.smithi084 on smithi084 2024-04-26T21:27:27.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:27 smithi120 ceph-mon[32741]: Upgrade: Updating mon.smithi084 2024-04-26T21:27:27.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:27 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:27.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:27 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:27:27.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:27 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T21:27:27.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:27 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:27:27.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:27 smithi120 ceph-mon[32741]: Deploying daemon mon.smithi084 on smithi084 2024-04-26T21:27:28.394 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:28 smithi084 ceph-mon[25539]: pgmap v36: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 2.0 MiB/s wr, 114 op/s 2024-04-26T21:27:28.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:28 smithi120 ceph-mon[32741]: pgmap v36: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 2.0 MiB/s wr, 114 op/s 2024-04-26T21:27:29.235 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:28 smithi084 systemd[1]: Stopping Ceph mon.smithi084 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:27:29.582 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:29 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084[25535]: 2024-04-26T21:27:29.436+0000 7f4f27600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi084 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:27:29.582 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:29 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084[25535]: 2024-04-26T21:27:29.436+0000 7f4f27600700 -1 mon.smithi084@0(leader) e2 *** Got Signal Terminated *** 2024-04-26T21:27:29.889 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:29 smithi084 podman[89975]: 2024-04-26 21:27:29.661746489 +0000 UTC m=+0.402427686 container died 24cc2d798ea7af7a727e0a8a1d591c789b9faafcdda0c1ce4354b4e8474cd330 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=quincy-2be3efa, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240424, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:27:30.142 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:30 smithi084 podman[89975]: 2024-04-26 21:27:30.140450516 +0000 UTC m=+0.881131714 container cleanup 24cc2d798ea7af7a727e0a8a1d591c789b9faafcdda0c1ce4354b4e8474cd330 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=quincy-2be3efa, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T21:27:30.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:30 smithi084 bash[89975]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084 2024-04-26T21:27:30.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:30 smithi084 podman[90000]: 2024-04-26 21:27:30.366928518 +0000 UTC m=+0.696985200 container remove 24cc2d798ea7af7a727e0a8a1d591c789b9faafcdda0c1ce4354b4e8474cd330 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=quincy-2be3efa, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424) 2024-04-26T21:27:31.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:30 smithi084 systemd[1]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968@mon.smithi084.service: Deactivated successfully. 2024-04-26T21:27:31.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:30 smithi084 systemd[1]: Stopped Ceph mon.smithi084 for 8bb44d26-0411-11ef-bc93-c7b262605968. 2024-04-26T21:27:31.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:30 smithi084 systemd[1]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968@mon.smithi084.service: Consumed 25.120s CPU time. 2024-04-26T21:27:31.577 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:31 smithi084 systemd[1]: Starting Ceph mon.smithi084 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:27:31.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:31 smithi084 podman[90120]: 2024-04-26 21:27:31.482908376 +0000 UTC m=+0.039553053 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:27:31.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:31 smithi084 podman[90120]: 2024-04-26 21:27:31.743548236 +0000 UTC m=+0.300192924 container create bf610abb6a622564b2de9b6ac8edc4d15b61c65d191f7bc827e39153ca558686 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True) 2024-04-26T21:27:32.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 podman[90120]: 2024-04-26 21:27:32.031251985 +0000 UTC m=+0.587896656 container init bf610abb6a622564b2de9b6ac8edc4d15b61c65d191f7bc827e39153ca558686 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:27:32.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 podman[90120]: 2024-04-26 21:27:32.041262817 +0000 UTC m=+0.597907488 container start bf610abb6a622564b2de9b6ac8edc4d15b61c65d191f7bc827e39153ca558686 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T21:27:32.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: set uid:gid to 167:167 (ceph:ceph) 2024-04-26T21:27:32.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev), process ceph-mon, pid 2 2024-04-26T21:27:32.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: pidfile_write: ignore empty --pid-file 2024-04-26T21:27:32.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: load: jerasure load: lrc 2024-04-26T21:27:32.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: RocksDB version: 7.9.2 2024-04-26T21:27:32.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Git sha 0 2024-04-26T21:27:32.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Compile date 2024-04-26 11:39:23 2024-04-26T21:27:32.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: DB SUMMARY 2024-04-26T21:27:32.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: DB Session ID: IMDIO57ZEXY1JVBJ62WW 2024-04-26T21:27:32.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: CURRENT file: CURRENT 2024-04-26T21:27:32.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: IDENTITY file: IDENTITY 2024-04-26T21:27:32.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1147 Bytes 2024-04-26T21:27:32.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi084/store.db dir, Total Num: 1, files: 000033.sst 2024-04-26T21:27:32.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi084/store.db: 000031.log size: 2692330 ; 2024-04-26T21:27:32.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.error_if_exists: 0 2024-04-26T21:27:32.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.create_if_missing: 0 2024-04-26T21:27:32.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.paranoid_checks: 1 2024-04-26T21:27:32.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-26T21:27:32.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-26T21:27:32.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-26T21:27:32.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.env: 0x55ab392fdcc0 2024-04-26T21:27:32.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.fs: PosixFileSystem 2024-04-26T21:27:32.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.info_log: 0x55ab63f1dca0 2024-04-26T21:27:32.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_file_opening_threads: 16 2024-04-26T21:27:32.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.statistics: (nil) 2024-04-26T21:27:32.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.use_fsync: 0 2024-04-26T21:27:32.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_log_file_size: 0 2024-04-26T21:27:32.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-26T21:27:32.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-26T21:27:32.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.keep_log_file_num: 1000 2024-04-26T21:27:32.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.recycle_log_file_num: 0 2024-04-26T21:27:32.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.allow_fallocate: 1 2024-04-26T21:27:32.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.allow_mmap_reads: 0 2024-04-26T21:27:32.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.allow_mmap_writes: 0 2024-04-26T21:27:32.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.use_direct_reads: 0 2024-04-26T21:27:32.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-26T21:27:32.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.create_missing_column_families: 0 2024-04-26T21:27:32.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.db_log_dir: 2024-04-26T21:27:32.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.wal_dir: 2024-04-26T21:27:32.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-26T21:27:32.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-26T21:27:32.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-26T21:27:32.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-26T21:27:32.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-26T21:27:32.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-26T21:27:32.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.advise_random_on_open: 1 2024-04-26T21:27:32.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.db_write_buffer_size: 0 2024-04-26T21:27:32.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.write_buffer_manager: 0x55ab63eef0e0 2024-04-26T21:27:32.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-26T21:27:32.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-26T21:27:32.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-26T21:27:32.419 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.rate_limiter: (nil) 2024-04-26T21:27:32.419 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-26T21:27:32.419 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.wal_recovery_mode: 2 2024-04-26T21:27:32.419 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.enable_thread_tracking: 0 2024-04-26T21:27:32.419 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.enable_pipelined_write: 0 2024-04-26T21:27:32.419 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.unordered_write: 0 2024-04-26T21:27:32.419 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-26T21:27:32.419 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-26T21:27:32.419 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-26T21:27:32.419 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-26T21:27:32.419 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.row_cache: None 2024-04-26T21:27:32.419 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.wal_filter: None 2024-04-26T21:27:32.420 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-26T21:27:32.420 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.allow_ingest_behind: 0 2024-04-26T21:27:32.420 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.two_write_queues: 0 2024-04-26T21:27:32.420 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.manual_wal_flush: 0 2024-04-26T21:27:32.420 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.wal_compression: 0 2024-04-26T21:27:32.420 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.atomic_flush: 0 2024-04-26T21:27:32.420 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-26T21:27:32.420 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-26T21:27:32.420 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-26T21:27:32.421 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.log_readahead_size: 0 2024-04-26T21:27:32.421 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-26T21:27:32.421 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.best_efforts_recovery: 0 2024-04-26T21:27:32.421 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-26T21:27:32.421 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-26T21:27:32.421 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.allow_data_in_errors: 0 2024-04-26T21:27:32.421 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.db_host_id: __hostname__ 2024-04-26T21:27:32.421 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-26T21:27:32.421 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_background_jobs: 2 2024-04-26T21:27:32.421 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_background_compactions: -1 2024-04-26T21:27:32.421 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_subcompactions: 1 2024-04-26T21:27:32.421 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-26T21:27:32.421 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-26T21:27:32.421 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-26T21:27:32.421 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_total_wal_size: 0 2024-04-26T21:27:32.422 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-26T21:27:32.422 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-26T21:27:32.422 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-26T21:27:32.422 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-26T21:27:32.422 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_open_files: -1 2024-04-26T21:27:32.422 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.bytes_per_sync: 0 2024-04-26T21:27:32.422 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-26T21:27:32.422 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-26T21:27:32.422 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compaction_readahead_size: 0 2024-04-26T21:27:32.422 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_background_flushes: -1 2024-04-26T21:27:32.422 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Compression algorithms supported: 2024-04-26T21:27:32.422 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-26T21:27:32.422 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: kZSTD supported: 0 2024-04-26T21:27:32.422 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: kXpressCompression supported: 0 2024-04-26T21:27:32.423 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: kLZ4HCCompression supported: 1 2024-04-26T21:27:32.423 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: kZlibCompression supported: 1 2024-04-26T21:27:32.423 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: kSnappyCompression supported: 1 2024-04-26T21:27:32.423 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: kLZ4Compression supported: 1 2024-04-26T21:27:32.423 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: kBZip2Compression supported: 0 2024-04-26T21:27:32.423 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-26T21:27:32.423 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-26T21:27:32.423 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi084/store.db/MANIFEST-000015 2024-04-26T21:27:32.423 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-26T21:27:32.423 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-26T21:27:32.424 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.merge_operator: 2024-04-26T21:27:32.424 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compaction_filter: None 2024-04-26T21:27:32.424 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compaction_filter_factory: None 2024-04-26T21:27:32.424 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.sst_partitioner_factory: None 2024-04-26T21:27:32.424 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-26T21:27:32.424 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-26T21:27:32.424 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ab63f1de60) 2024-04-26T21:27:32.424 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: cache_index_and_filter_blocks: 1 2024-04-26T21:27:32.424 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-26T21:27:32.424 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-26T21:27:32.424 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: pin_top_level_index_and_filter: 1 2024-04-26T21:27:32.424 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: index_type: 0 2024-04-26T21:27:32.424 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: data_block_index_type: 0 2024-04-26T21:27:32.424 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: index_shortening: 1 2024-04-26T21:27:32.425 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-26T21:27:32.425 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: checksum: 4 2024-04-26T21:27:32.425 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: no_block_cache: 0 2024-04-26T21:27:32.425 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: block_cache: 0x55ab63f211f0 2024-04-26T21:27:32.425 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: block_cache_name: BinnedLRUCache 2024-04-26T21:27:32.425 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: block_cache_options: 2024-04-26T21:27:32.425 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: capacity : 536870912 2024-04-26T21:27:32.425 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: num_shard_bits : 4 2024-04-26T21:27:32.425 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: strict_capacity_limit : 0 2024-04-26T21:27:32.425 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: high_pri_pool_ratio: 0.000 2024-04-26T21:27:32.425 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: block_cache_compressed: (nil) 2024-04-26T21:27:32.425 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: persistent_cache: (nil) 2024-04-26T21:27:32.426 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: block_size: 4096 2024-04-26T21:27:32.426 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: block_size_deviation: 10 2024-04-26T21:27:32.426 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: block_restart_interval: 16 2024-04-26T21:27:32.426 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: index_block_restart_interval: 1 2024-04-26T21:27:32.426 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: metadata_block_size: 4096 2024-04-26T21:27:32.426 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: partition_filters: 0 2024-04-26T21:27:32.426 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: use_delta_encoding: 1 2024-04-26T21:27:32.426 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: filter_policy: bloomfilter 2024-04-26T21:27:32.426 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: whole_key_filtering: 1 2024-04-26T21:27:32.426 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: verify_compression: 0 2024-04-26T21:27:32.426 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: read_amp_bytes_per_bit: 0 2024-04-26T21:27:32.426 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: format_version: 5 2024-04-26T21:27:32.426 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: enable_index_compression: 1 2024-04-26T21:27:32.427 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: block_align: 0 2024-04-26T21:27:32.427 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: max_auto_readahead_size: 262144 2024-04-26T21:27:32.427 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: prepopulate_block_cache: 0 2024-04-26T21:27:32.427 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: initial_auto_readahead_size: 8192 2024-04-26T21:27:32.428 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: num_file_reads_for_auto_readahead: 2 2024-04-26T21:27:32.428 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.write_buffer_size: 33554432 2024-04-26T21:27:32.428 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_write_buffer_number: 2 2024-04-26T21:27:32.428 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compression: NoCompression 2024-04-26T21:27:32.428 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.bottommost_compression: Disabled 2024-04-26T21:27:32.428 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.prefix_extractor: nullptr 2024-04-26T21:27:32.428 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-26T21:27:32.429 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.num_levels: 7 2024-04-26T21:27:32.429 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-26T21:27:32.429 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-26T21:27:32.429 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-26T21:27:32.429 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-26T21:27:32.429 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-26T21:27:32.429 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-26T21:27:32.429 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-26T21:27:32.429 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-26T21:27:32.429 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-26T21:27:32.429 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-26T21:27:32.429 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-26T21:27:32.429 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-26T21:27:32.429 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-26T21:27:32.429 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compression_opts.level: 32767 2024-04-26T21:27:32.430 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compression_opts.strategy: 0 2024-04-26T21:27:32.430 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-26T21:27:32.430 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-26T21:27:32.430 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-26T21:27:32.430 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-26T21:27:32.430 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compression_opts.enabled: false 2024-04-26T21:27:32.430 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-26T21:27:32.430 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-26T21:27:32.430 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-26T21:27:32.431 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-26T21:27:32.431 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.target_file_size_base: 67108864 2024-04-26T21:27:32.431 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-26T21:27:32.431 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-26T21:27:32.431 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-26T21:27:32.431 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-26T21:27:32.431 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-26T21:27:32.431 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-26T21:27:32.431 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-26T21:27:32.431 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-26T21:27:32.431 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-26T21:27:32.431 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-26T21:27:32.431 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-26T21:27:32.431 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-26T21:27:32.432 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-26T21:27:32.432 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-26T21:27:32.432 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.arena_block_size: 1048576 2024-04-26T21:27:32.432 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-26T21:27:32.432 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-26T21:27:32.432 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.disable_auto_compactions: 0 2024-04-26T21:27:32.432 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-26T21:27:32.432 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-26T21:27:32.432 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-26T21:27:32.432 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-26T21:27:32.432 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-26T21:27:32.432 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-26T21:27:32.432 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-26T21:27:32.432 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-26T21:27:32.433 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-26T21:27:32.433 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-26T21:27:32.433 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-26T21:27:32.433 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.inplace_update_support: 0 2024-04-26T21:27:32.433 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-26T21:27:32.433 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-26T21:27:32.433 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-26T21:27:32.433 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-26T21:27:32.433 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.bloom_locality: 0 2024-04-26T21:27:32.433 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.max_successive_merges: 0 2024-04-26T21:27:32.433 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-26T21:27:32.434 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.paranoid_file_checks: 0 2024-04-26T21:27:32.434 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.force_consistency_checks: 1 2024-04-26T21:27:32.434 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.report_bg_io_stats: 0 2024-04-26T21:27:32.434 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.ttl: 2592000 2024-04-26T21:27:32.434 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-26T21:27:32.434 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-26T21:27:32.434 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-26T21:27:32.434 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.enable_blob_files: false 2024-04-26T21:27:32.434 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.min_blob_size: 0 2024-04-26T21:27:32.434 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.blob_file_size: 268435456 2024-04-26T21:27:32.434 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-26T21:27:32.435 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-26T21:27:32.435 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-26T21:27:32.435 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-26T21:27:32.435 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-26T21:27:32.435 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.blob_file_starting_level: 0 2024-04-26T21:27:32.435 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-26T21:27:32.435 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-04-26T21:27:32.435 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-26T21:27:32.435 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi084/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 11784, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-26T21:27:32.435 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-04-26T21:27:32.435 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fbcffdcd-4b9a-4b9c-bf3c-7cf554df3419 2024-04-26T21:27:32.435 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714166852105927, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-04-26T21:27:32.435 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-04-26T21:27:32.436 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714166852124005, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 2489147, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11785, "largest_seqno": 13054, "table_properties": {"data_size": 2482648, "index_size": 4046, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1413, "raw_key_size": 12358, "raw_average_key_size": 22, "raw_value_size": 2470559, "raw_average_value_size": 4508, "num_data_blocks": 185, "num_entries": 548, "num_filter_entries": 548, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714166852, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fbcffdcd-4b9a-4b9c-bf3c-7cf554df3419", "db_session_id": "IMDIO57ZEXY1JVBJ62WW", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-04-26T21:27:32.436 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714166852124297, "job": 1, "event": "recovery_finished"} 2024-04-26T21:27:32.436 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-04-26T21:27:32.436 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-26T21:27:32.436 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi084/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-26T21:27:32.436 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ab6403e000 2024-04-26T21:27:32.436 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: DB pointer 0x55ab64028000 2024-04-26T21:27:32.436 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-26T21:27:32.436 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-26T21:27:32.436 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: ** DB Stats ** 2024-04-26T21:27:32.436 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T21:27:32.436 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-26T21:27:32.437 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T21:27:32.437 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T21:27:32.437 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-26T21:27:32.437 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T21:27:32.437 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T21:27:32.437 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: 2024-04-26T21:27:32.437 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: ** Compaction Stats [default] ** 2024-04-26T21:27:32.437 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T21:27:32.437 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-26T21:27:32.437 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: L0 1/0 2.37 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 302.1 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-26T21:27:32.437 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: L6 1/0 5.45 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-26T21:27:32.437 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Sum 2/0 7.83 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 302.1 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-26T21:27:32.437 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 302.1 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-26T21:27:32.437 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: 2024-04-26T21:27:32.438 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: ** Compaction Stats [default] ** 2024-04-26T21:27:32.438 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T21:27:32.438 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T21:27:32.438 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 302.1 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-26T21:27:32.438 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: 2024-04-26T21:27:32.438 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-26T21:27:32.438 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: 2024-04-26T21:27:32.438 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T21:27:32.438 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-04-26T21:27:32.439 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-26T21:27:32.439 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-26T21:27:32.439 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-26T21:27:32.439 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-26T21:27:32.439 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Cumulative compaction: 0.00 GB write, 94.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T21:27:32.439 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Interval compaction: 0.00 GB write, 94.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T21:27:32.439 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-26T21:27:32.439 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Block cache BinnedLRUCache@0x55ab63f211f0#2 capacity: 512.00 MB usage: 5.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-04-26T21:27:32.439 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.53 KB,0.000292063%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-04-26T21:27:32.440 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: 2024-04-26T21:27:32.440 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-26T21:27:32.440 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: starting mon.smithi084 rank 0 at public addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] at bind addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi084 fsid 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:27:32.440 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: mon.smithi084@-1(???) e2 preinit fsid 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:27:32.440 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: mon.smithi084@-1(???).mds e15 new map 2024-04-26T21:27:32.440 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: mon.smithi084@-1(???).mds e15 print_map 2024-04-26T21:27:32.440 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: e15 2024-04-26T21:27:32.440 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:27:32.440 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:27:32.441 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: legacy client fscid: 1 2024-04-26T21:27:32.441 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: 2024-04-26T21:27:32.441 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Filesystem 'cephfs' (1) 2024-04-26T21:27:32.441 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: fs_name cephfs 2024-04-26T21:27:32.441 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: epoch 15 2024-04-26T21:27:32.441 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:27:32.441 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:27:32.441 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: modified 2024-04-26T21:27:24.731661+0000 2024-04-26T21:27:32.441 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: tableserver 0 2024-04-26T21:27:32.441 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: root 0 2024-04-26T21:27:32.441 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: session_timeout 60 2024-04-26T21:27:32.441 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: session_autoclose 300 2024-04-26T21:27:32.441 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: max_file_size 1099511627776 2024-04-26T21:27:32.441 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: max_xattr_size 65536 2024-04-26T21:27:32.441 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: required_client_features {} 2024-04-26T21:27:32.441 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: last_failure 0 2024-04-26T21:27:32.442 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: last_failure_osd_epoch 0 2024-04-26T21:27:32.442 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:27:32.442 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: max_mds 2 2024-04-26T21:27:32.442 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: in 0,1 2024-04-26T21:27:32.442 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: up {0=14456,1=24231} 2024-04-26T21:27:32.442 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: failed 2024-04-26T21:27:32.442 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: damaged 2024-04-26T21:27:32.442 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: stopped 2024-04-26T21:27:32.442 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: data_pools [3] 2024-04-26T21:27:32.442 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: metadata_pool 2 2024-04-26T21:27:32.442 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: inline_data enabled 2024-04-26T21:27:32.442 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: balancer 2024-04-26T21:27:32.442 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: bal_rank_mask -1 2024-04-26T21:27:32.442 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: standby_count_wanted 1 2024-04-26T21:27:32.442 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: qdb_cluster leader: 0 members: 2024-04-26T21:27:32.443 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: [mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:27:32.443 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: [mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:27:32.443 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: 2024-04-26T21:27:32.443 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: 2024-04-26T21:27:32.443 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: Standby daemons: 2024-04-26T21:27:32.443 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: 2024-04-26T21:27:32.443 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: [mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:27:32.443 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout: [mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:27:32.443 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: mon.smithi084@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-26T21:27:32.443 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: mon.smithi084@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-04-26T21:27:32.443 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: mon.smithi084@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-04-26T21:27:32.443 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: mon.smithi084@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-04-26T21:27:32.443 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: mon.smithi084@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-04-26T21:27:32.443 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 bash[90120]: bf610abb6a622564b2de9b6ac8edc4d15b61c65d191f7bc827e39153ca558686 2024-04-26T21:27:32.443 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 systemd[1]: Started Ceph mon.smithi084 for 8bb44d26-0411-11ef-bc93-c7b262605968. 2024-04-26T21:27:33.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-04-26T21:27:33.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:27:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: pgmap v38: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 1.2 MiB/s wr, 72 op/s 2024-04-26T21:27:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: mon.smithi084 calling monitor election 2024-04-26T21:27:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: mon.smithi084 is new leader, mons smithi084,smithi120 in quorum (ranks 0,1) 2024-04-26T21:27:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: monmap epoch 2 2024-04-26T21:27:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: fsid 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:27:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: last_changed 2024-04-26T21:15:46.135185+0000 2024-04-26T21:27:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: created 2024-04-26T21:12:25.273724+0000 2024-04-26T21:27:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: min_mon_release 17 (quincy) 2024-04-26T21:27:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: election_strategy: 1 2024-04-26T21:27:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.smithi084 2024-04-26T21:27:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: 1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.smithi120 2024-04-26T21:27:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:27:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: osdmap e47: 6 total, 6 up, 6 in 2024-04-26T21:27:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: mgrmap e33: smithi084.gyasul(active, since 72s), standbys: smithi120.zjaduj 2024-04-26T21:27:33.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:27:33.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:27:33.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:27:33.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: from='mgr.24429 ' entity='' 2024-04-26T21:27:33.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:32 smithi084 ceph-mon[90138]: mgrmap e34: smithi084.gyasul(active, since 72s), standbys: smithi120.zjaduj 2024-04-26T21:27:33.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-04-26T21:27:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: from='mgr.24429 172.21.15.84:0/1824672182' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:27:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: pgmap v38: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 1.2 MiB/s wr, 72 op/s 2024-04-26T21:27:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: mon.smithi084 calling monitor election 2024-04-26T21:27:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: mon.smithi084 is new leader, mons smithi084,smithi120 in quorum (ranks 0,1) 2024-04-26T21:27:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: monmap epoch 2 2024-04-26T21:27:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: fsid 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:27:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: last_changed 2024-04-26T21:15:46.135185+0000 2024-04-26T21:27:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: created 2024-04-26T21:12:25.273724+0000 2024-04-26T21:27:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: min_mon_release 17 (quincy) 2024-04-26T21:27:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: election_strategy: 1 2024-04-26T21:27:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.smithi084 2024-04-26T21:27:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: 1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.smithi120 2024-04-26T21:27:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:27:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: osdmap e47: 6 total, 6 up, 6 in 2024-04-26T21:27:33.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: mgrmap e33: smithi084.gyasul(active, since 72s), standbys: smithi120.zjaduj 2024-04-26T21:27:33.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:27:33.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:27:33.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:27:33.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: from='mgr.24429 ' entity='' 2024-04-26T21:27:33.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:32 smithi120 ceph-mon[32741]: mgrmap e34: smithi084.gyasul(active, since 72s), standbys: smithi120.zjaduj 2024-04-26T21:27:34.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.865+0000 7feb49e00700 1 -- 172.21.15.84:0/722974468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb44070940 msgr2=0x7feb44070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:34.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.865+0000 7feb49e00700 1 --2- 172.21.15.84:0/722974468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb44070940 0x7feb44070db0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feb30004940 tx=0x7feb30009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:34.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.865+0000 7feb49e00700 1 -- 172.21.15.84:0/722974468 shutdown_connections 2024-04-26T21:27:34.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.865+0000 7feb49e00700 1 --2- 172.21.15.84:0/722974468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb44070940 0x7feb44070db0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:34.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.865+0000 7feb49e00700 1 --2- 172.21.15.84:0/722974468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb44071ef0 0x7feb44070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:34.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.865+0000 7feb49e00700 1 -- 172.21.15.84:0/722974468 >> 172.21.15.84:0/722974468 conn(0x7feb440f8560 msgr2=0x7feb440fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:34.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.866+0000 7feb49e00700 1 -- 172.21.15.84:0/722974468 shutdown_connections 2024-04-26T21:27:34.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.866+0000 7feb49e00700 1 -- 172.21.15.84:0/722974468 wait complete. 2024-04-26T21:27:34.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.867+0000 7feb49e00700 1 Processor -- start 2024-04-26T21:27:34.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.867+0000 7feb49e00700 1 -- start start 2024-04-26T21:27:34.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.867+0000 7feb49e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb44070940 0x7feb4410fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:34.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.867+0000 7feb49e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb44071ef0 0x7feb44110110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:34.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.867+0000 7feb49e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb44110710 con 0x7feb44070940 2024-04-26T21:27:34.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.867+0000 7feb49e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb44110f60 con 0x7feb44071ef0 2024-04-26T21:27:34.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.868+0000 7feb42a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb44070940 0x7feb4410fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:34.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.868+0000 7feb42000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb44071ef0 0x7feb44110110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:34.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.868+0000 7feb42a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb44070940 0x7feb4410fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47284/0 (socket says 172.21.15.84:47284) 2024-04-26T21:27:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.868+0000 7feb42000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb44071ef0 0x7feb44110110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:54320/0 (socket says 172.21.15.84:54320) 2024-04-26T21:27:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.868+0000 7feb42a00700 1 -- 172.21.15.84:0/1239423227 learned_addr learned my addr 172.21.15.84:0/1239423227 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:27:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.868+0000 7feb42a00700 1 -- 172.21.15.84:0/1239423227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb44071ef0 msgr2=0x7feb44110110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.868+0000 7feb42a00700 1 --2- 172.21.15.84:0/1239423227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb44071ef0 0x7feb44110110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.868+0000 7feb42a00700 1 -- 172.21.15.84:0/1239423227 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb30005040 con 0x7feb44070940 2024-04-26T21:27:34.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.869+0000 7feb42a00700 1 --2- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb44070940 0x7feb4410fbd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feb3400c8b0 tx=0x7feb34004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:34.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.869+0000 7feb3aa00700 1 -- 172.21.15.84:0/1239423227 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb340106f0 con 0x7feb44070940 2024-04-26T21:27:34.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.869+0000 7feb3aa00700 1 -- 172.21.15.84:0/1239423227 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb34010d20 con 0x7feb44070940 2024-04-26T21:27:34.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.869+0000 7feb3aa00700 1 -- 172.21.15.84:0/1239423227 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb34012e90 con 0x7feb44070940 2024-04-26T21:27:34.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.869+0000 7feb49e00700 1 -- 172.21.15.84:0/1239423227 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb44111240 con 0x7feb44070940 2024-04-26T21:27:34.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.869+0000 7feb49e00700 1 -- 172.21.15.84:0/1239423227 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb44111780 con 0x7feb44070940 2024-04-26T21:27:34.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.871+0000 7feb49e00700 1 -- 172.21.15.84:0/1239423227 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4405f5c0 con 0x7feb44070940 2024-04-26T21:27:34.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.873+0000 7feb3aa00700 1 -- 172.21.15.84:0/1239423227 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 34) v1 ==== 92847+0+0 (secure 0 0 0) 0x7feb34010850 con 0x7feb44070940 2024-04-26T21:27:34.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.874+0000 7feb3aa00700 1 --2- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7feb2806ed20 0x7feb280711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:34.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.874+0000 7feb3aa00700 1 -- 172.21.15.84:0/1239423227 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7feb3408e750 con 0x7feb44070940 2024-04-26T21:27:34.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.874+0000 7feb42000700 1 -- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7feb2806ed20 msgr2=0x7feb280711d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/3665499318 2024-04-26T21:27:34.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.874+0000 7feb42000700 1 --2- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7feb2806ed20 0x7feb280711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T21:27:34.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:34.881+0000 7feb3aa00700 1 -- 172.21.15.84:0/1239423227 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7feb3405b100 con 0x7feb44070940 2024-04-26T21:27:35.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:35.075+0000 7feb42000700 1 -- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7feb2806ed20 msgr2=0x7feb280711d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/3665499318 2024-04-26T21:27:35.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:35.075+0000 7feb42000700 1 --2- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7feb2806ed20 0x7feb280711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T21:27:35.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:35.270+0000 7feb49e00700 1 -- 172.21.15.84:0/1239423227 --> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feb44111bd0 con 0x7feb2806ed20 2024-04-26T21:27:35.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:35.476+0000 7feb42000700 1 -- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7feb2806ed20 msgr2=0x7feb280711d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/3665499318 2024-04-26T21:27:35.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:35.476+0000 7feb42000700 1 --2- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7feb2806ed20 0x7feb280711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T21:27:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:36.277+0000 7feb42000700 1 -- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7feb2806ed20 msgr2=0x7feb280711d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/3665499318 2024-04-26T21:27:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:36.277+0000 7feb42000700 1 --2- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7feb2806ed20 0x7feb280711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T21:27:37.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:37.878+0000 7feb42000700 1 -- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7feb2806ed20 msgr2=0x7feb280711d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/3665499318 2024-04-26T21:27:37.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:37.878+0000 7feb42000700 1 --2- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7feb2806ed20 0x7feb280711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-26T21:27:41.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:41.081+0000 7feb42000700 1 -- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7feb2806ed20 msgr2=0x7feb280711d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/3665499318 2024-04-26T21:27:41.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:41.081+0000 7feb42000700 1 --2- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7feb2806ed20 0x7feb280711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-26T21:27:43.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:43.677+0000 7feb3aa00700 1 -- 172.21.15.84:0/1239423227 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 35) v1 ==== 92370+0+0 (secure 0 0 0) 0x7feb340579a0 con 0x7feb44070940 2024-04-26T21:27:43.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:43.678+0000 7feb3aa00700 1 -- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7feb2806ed20 msgr2=0x7feb280711d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T21:27:43.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:43.678+0000 7feb3aa00700 1 --2- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7feb2806ed20 0x7feb280711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:43.836 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: Active manager daemon smithi084.gyasul restarted 2024-04-26T21:27:43.836 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: Activating manager daemon smithi084.gyasul 2024-04-26T21:27:43.836 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: osdmap e48: 6 total, 6 up, 6 in 2024-04-26T21:27:43.836 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: mgrmap e35: smithi084.gyasul(active, starting, since 0.00794746s), standbys: smithi120.zjaduj 2024-04-26T21:27:43.836 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-04-26T21:27:43.836 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:27:43.836 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.hbjunw"}]: dispatch 2024-04-26T21:27:43.836 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.rtrqtr"}]: dispatch 2024-04-26T21:27:43.836 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.qnkxcn"}]: dispatch 2024-04-26T21:27:43.836 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.ufqfoh"}]: dispatch 2024-04-26T21:27:43.836 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr metadata", "who": "smithi084.gyasul", "id": "smithi084.gyasul"}]: dispatch 2024-04-26T21:27:43.836 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr metadata", "who": "smithi120.zjaduj", "id": "smithi120.zjaduj"}]: dispatch 2024-04-26T21:27:43.836 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:27:43.837 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:27:43.837 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:27:43.837 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:27:43.837 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:27:43.837 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:27:43.837 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T21:27:43.837 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T21:27:43.837 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T21:27:43.837 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:43 smithi084 ceph-mon[90138]: Manager daemon smithi084.gyasul is now available 2024-04-26T21:27:43.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: Active manager daemon smithi084.gyasul restarted 2024-04-26T21:27:43.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: Activating manager daemon smithi084.gyasul 2024-04-26T21:27:43.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: osdmap e48: 6 total, 6 up, 6 in 2024-04-26T21:27:43.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: mgrmap e35: smithi084.gyasul(active, starting, since 0.00794746s), standbys: smithi120.zjaduj 2024-04-26T21:27:43.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-04-26T21:27:43.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:27:43.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.hbjunw"}]: dispatch 2024-04-26T21:27:43.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.rtrqtr"}]: dispatch 2024-04-26T21:27:43.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.qnkxcn"}]: dispatch 2024-04-26T21:27:43.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.ufqfoh"}]: dispatch 2024-04-26T21:27:43.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr metadata", "who": "smithi084.gyasul", "id": "smithi084.gyasul"}]: dispatch 2024-04-26T21:27:43.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr metadata", "who": "smithi120.zjaduj", "id": "smithi120.zjaduj"}]: dispatch 2024-04-26T21:27:43.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:27:43.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:27:43.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:27:43.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:27:43.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:27:43.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:27:43.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T21:27:43.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T21:27:43.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T21:27:43.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:43 smithi120 ceph-mon[32741]: Manager daemon smithi084.gyasul is now available 2024-04-26T21:27:44.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.686+0000 7feb3aa00700 1 -- 172.21.15.84:0/1239423227 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mgrmap(e 36) v1 ==== 92497+0+0 (secure 0 0 0) 0x7feb3408cab0 con 0x7feb44070940 2024-04-26T21:27:44.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.686+0000 7feb3aa00700 1 --2- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7feb2801dbf0 0x7feb280788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:44.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.686+0000 7feb3aa00700 1 -- 172.21.15.84:0/1239423227 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feb44111bd0 con 0x7feb2801dbf0 2024-04-26T21:27:44.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.687+0000 7feb42000700 1 --2- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7feb2801dbf0 0x7feb280788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:44.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.690+0000 7feb42000700 1 --2- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7feb2801dbf0 0x7feb280788e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7feb30004fd0 tx=0x7feb30009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:44.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.694+0000 7feb3aa00700 1 -- 172.21.15.84:0/1239423227 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7feb44111bd0 con 0x7feb2801dbf0 2024-04-26T21:27:44.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.699+0000 7feb49e00700 1 -- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7feb2801dbf0 msgr2=0x7feb280788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:44.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.699+0000 7feb49e00700 1 --2- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7feb2801dbf0 0x7feb280788e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7feb30004fd0 tx=0x7feb30009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:44.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.699+0000 7feb49e00700 1 -- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb44070940 msgr2=0x7feb4410fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:44.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.699+0000 7feb49e00700 1 --2- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb44070940 0x7feb4410fbd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feb3400c8b0 tx=0x7feb34004470 comp rx=0 tx=0).stop 2024-04-26T21:27:44.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.699+0000 7feb49e00700 1 -- 172.21.15.84:0/1239423227 shutdown_connections 2024-04-26T21:27:44.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.699+0000 7feb49e00700 1 --2- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7feb2801dbf0 0x7feb280788e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:44.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.699+0000 7feb49e00700 1 --2- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:6800/3665499318,v1:172.21.15.84:6801/3665499318] conn(0x7feb2806ed20 0x7feb280711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:44.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.699+0000 7feb49e00700 1 --2- 172.21.15.84:0/1239423227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb44070940 0x7feb4410fbd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:44.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.699+0000 7feb49e00700 1 --2- 172.21.15.84:0/1239423227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb44071ef0 0x7feb44110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:44.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.699+0000 7feb49e00700 1 -- 172.21.15.84:0/1239423227 >> 172.21.15.84:0/1239423227 conn(0x7feb440f8560 msgr2=0x7feb440f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:44.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.699+0000 7feb49e00700 1 -- 172.21.15.84:0/1239423227 shutdown_connections 2024-04-26T21:27:44.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.699+0000 7feb49e00700 1 -- 172.21.15.84:0/1239423227 wait complete. 2024-04-26T21:27:44.723 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:27:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.873+0000 7fb9be200700 1 -- 172.21.15.84:0/855878283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9b80fdfd0 msgr2=0x7fb9b80fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.873+0000 7fb9be200700 1 --2- 172.21.15.84:0/855878283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9b80fdfd0 0x7fb9b80fe440 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4004940 tx=0x7fb9a4009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.874+0000 7fb9be200700 1 -- 172.21.15.84:0/855878283 shutdown_connections 2024-04-26T21:27:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.874+0000 7fb9be200700 1 --2- 172.21.15.84:0/855878283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9b80fdfd0 0x7fb9b80fe440 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.874+0000 7fb9be200700 1 --2- 172.21.15.84:0/855878283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b80fce60 0x7fb9b80fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.874+0000 7fb9be200700 1 -- 172.21.15.84:0/855878283 >> 172.21.15.84:0/855878283 conn(0x7fb9b80f8560 msgr2=0x7fb9b80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.874+0000 7fb9be200700 1 -- 172.21.15.84:0/855878283 shutdown_connections 2024-04-26T21:27:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.874+0000 7fb9be200700 1 -- 172.21.15.84:0/855878283 wait complete. 2024-04-26T21:27:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.875+0000 7fb9be200700 1 Processor -- start 2024-04-26T21:27:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.875+0000 7fb9be200700 1 -- start start 2024-04-26T21:27:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.875+0000 7fb9be200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9b80fce60 0x7fb9b8113fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.875+0000 7fb9be200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b80fdfd0 0x7fb9b8114500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.875+0000 7fb9be200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b8114b00 con 0x7fb9b80fce60 2024-04-26T21:27:44.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.875+0000 7fb9be200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b8115350 con 0x7fb9b80fdfd0 2024-04-26T21:27:44.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.876+0000 7fb9b7400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9b80fce60 0x7fb9b8113fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:44.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.876+0000 7fb9b7400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9b80fce60 0x7fb9b8113fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33506/0 (socket says 172.21.15.84:33506) 2024-04-26T21:27:44.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.876+0000 7fb9b7400700 1 -- 172.21.15.84:0/493692769 learned_addr learned my addr 172.21.15.84:0/493692769 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:27:44.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.876+0000 7fb9b6a00700 1 --2- 172.21.15.84:0/493692769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b80fdfd0 0x7fb9b8114500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:44.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.876+0000 7fb9b7400700 1 -- 172.21.15.84:0/493692769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b80fdfd0 msgr2=0x7fb9b8114500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:44.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.876+0000 7fb9b7400700 1 --2- 172.21.15.84:0/493692769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b80fdfd0 0x7fb9b8114500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:44.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.876+0000 7fb9b7400700 1 -- 172.21.15.84:0/493692769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a4005040 con 0x7fb9b80fce60 2024-04-26T21:27:44.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.877+0000 7fb9b7400700 1 --2- 172.21.15.84:0/493692769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9b80fce60 0x7fb9b8113fc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8002a50 tx=0x7fb9a80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:44.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.877+0000 7fb9af400700 1 -- 172.21.15.84:0/493692769 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9a8007cc0 con 0x7fb9b80fce60 2024-04-26T21:27:44.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.877+0000 7fb9af400700 1 -- 172.21.15.84:0/493692769 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9a800f040 con 0x7fb9b80fce60 2024-04-26T21:27:44.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.877+0000 7fb9af400700 1 -- 172.21.15.84:0/493692769 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9a800d9b0 con 0x7fb9b80fce60 2024-04-26T21:27:44.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.877+0000 7fb9be200700 1 -- 172.21.15.84:0/493692769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b8115630 con 0x7fb9b80fce60 2024-04-26T21:27:44.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.878+0000 7fb9be200700 1 -- 172.21.15.84:0/493692769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b8115b70 con 0x7fb9b80fce60 2024-04-26T21:27:44.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.879+0000 7fb9acc00700 1 -- 172.21.15.84:0/493692769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b805f5c0 con 0x7fb9b80fce60 2024-04-26T21:27:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.882+0000 7fb9af400700 1 -- 172.21.15.84:0/493692769 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 36) v1 ==== 92497+0+0 (secure 0 0 0) 0x7fb9a800db10 con 0x7fb9b80fce60 2024-04-26T21:27:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.883+0000 7fb9af400700 1 --2- 172.21.15.84:0/493692769 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb99c06e960 0x7fb99c070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.883+0000 7fb9af400700 1 -- 172.21.15.84:0/493692769 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb9a808dd70 con 0x7fb9b80fce60 2024-04-26T21:27:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.883+0000 7fb9b6a00700 1 --2- 172.21.15.84:0/493692769 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb99c06e960 0x7fb99c070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.884+0000 7fb9b6a00700 1 --2- 172.21.15.84:0/493692769 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb99c06e960 0x7fb99c070e10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400b3b0 tx=0x7fb9a4009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:44.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:44.891+0000 7fb9af400700 1 -- 172.21.15.84:0/493692769 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fb9a8056e20 con 0x7fb9b80fce60 2024-04-26T21:27:45.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:27:45.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:27:45.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.gyasul/mirror_snapshot_schedule"}]: dispatch 2024-04-26T21:27:45.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.gyasul/trash_purge_schedule"}]: dispatch 2024-04-26T21:27:45.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:44 smithi084 ceph-mon[90138]: Standby manager daemon smithi120.zjaduj restarted 2024-04-26T21:27:45.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:44 smithi084 ceph-mon[90138]: Standby manager daemon smithi120.zjaduj started 2024-04-26T21:27:45.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:44 smithi084 ceph-mon[90138]: from='mgr.? 172.21.15.120:0/4114275430' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.zjaduj/crt"}]: dispatch 2024-04-26T21:27:45.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:44 smithi084 ceph-mon[90138]: from='mgr.? 172.21.15.120:0/4114275430' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:27:45.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:44 smithi084 ceph-mon[90138]: from='mgr.? 172.21.15.120:0/4114275430' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.zjaduj/key"}]: dispatch 2024-04-26T21:27:45.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:44 smithi084 ceph-mon[90138]: from='mgr.? 172.21.15.120:0/4114275430' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:27:45.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:44 smithi084 ceph-mon[90138]: mgrmap e36: smithi084.gyasul(active, since 1.02036s), standbys: smithi120.zjaduj 2024-04-26T21:27:45.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:44 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:27:45.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:44 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:27:45.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:44 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.gyasul/mirror_snapshot_schedule"}]: dispatch 2024-04-26T21:27:45.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:44 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.gyasul/trash_purge_schedule"}]: dispatch 2024-04-26T21:27:45.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:44 smithi120 ceph-mon[32741]: Standby manager daemon smithi120.zjaduj restarted 2024-04-26T21:27:45.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:44 smithi120 ceph-mon[32741]: Standby manager daemon smithi120.zjaduj started 2024-04-26T21:27:45.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:44 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.120:0/4114275430' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.zjaduj/crt"}]: dispatch 2024-04-26T21:27:45.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:44 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.120:0/4114275430' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:27:45.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:44 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.120:0/4114275430' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi120.zjaduj/key"}]: dispatch 2024-04-26T21:27:45.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:44 smithi120 ceph-mon[32741]: from='mgr.? 172.21.15.120:0/4114275430' entity='mgr.smithi120.zjaduj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:27:45.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:44 smithi120 ceph-mon[32741]: mgrmap e36: smithi084.gyasul(active, since 1.02036s), standbys: smithi120.zjaduj 2024-04-26T21:27:45.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.241+0000 7fb9acc00700 1 -- 172.21.15.84:0/493692769 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9b804bed0 con 0x7fb99c06e960 2024-04-26T21:27:45.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.243+0000 7fb9af400700 1 -- 172.21.15.84:0/493692769 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fb9b804bed0 con 0x7fb99c06e960 2024-04-26T21:27:45.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.246+0000 7fb9acc00700 1 -- 172.21.15.84:0/493692769 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb99c06e960 msgr2=0x7fb99c070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:45.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.246+0000 7fb9acc00700 1 --2- 172.21.15.84:0/493692769 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb99c06e960 0x7fb99c070e10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400b3b0 tx=0x7fb9a4009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:45.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.246+0000 7fb9acc00700 1 -- 172.21.15.84:0/493692769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9b80fce60 msgr2=0x7fb9b8113fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:45.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.246+0000 7fb9acc00700 1 --2- 172.21.15.84:0/493692769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9b80fce60 0x7fb9b8113fc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8002a50 tx=0x7fb9a80046b0 comp rx=0 tx=0).stop 2024-04-26T21:27:45.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.246+0000 7fb9acc00700 1 -- 172.21.15.84:0/493692769 shutdown_connections 2024-04-26T21:27:45.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.246+0000 7fb9acc00700 1 --2- 172.21.15.84:0/493692769 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb99c06e960 0x7fb99c070e10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:45.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.246+0000 7fb9acc00700 1 --2- 172.21.15.84:0/493692769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9b80fce60 0x7fb9b8113fc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:45.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.246+0000 7fb9acc00700 1 --2- 172.21.15.84:0/493692769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9b80fdfd0 0x7fb9b8114500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:45.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.246+0000 7fb9acc00700 1 -- 172.21.15.84:0/493692769 >> 172.21.15.84:0/493692769 conn(0x7fb9b80f8560 msgr2=0x7fb9b80f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:45.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.247+0000 7fb9acc00700 1 -- 172.21.15.84:0/493692769 shutdown_connections 2024-04-26T21:27:45.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.247+0000 7fb9acc00700 1 -- 172.21.15.84:0/493692769 wait complete. 2024-04-26T21:27:45.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.435+0000 7f5258800700 1 -- 172.21.15.84:0/3837216891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500fe080 msgr2=0x7f52500fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:45.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.435+0000 7f5258800700 1 --2- 172.21.15.84:0/3837216891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500fe080 0x7f52500fe4f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5240004940 tx=0x7f5240009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:45.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.436+0000 7f5258800700 1 -- 172.21.15.84:0/3837216891 shutdown_connections 2024-04-26T21:27:45.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.436+0000 7f5258800700 1 --2- 172.21.15.84:0/3837216891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500fe080 0x7f52500fe4f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:45.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.436+0000 7f5258800700 1 --2- 172.21.15.84:0/3837216891 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52500fcf10 0x7f52500fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:45.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.436+0000 7f5258800700 1 -- 172.21.15.84:0/3837216891 >> 172.21.15.84:0/3837216891 conn(0x7f52500f8560 msgr2=0x7f52500fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:45.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.436+0000 7f5258800700 1 -- 172.21.15.84:0/3837216891 shutdown_connections 2024-04-26T21:27:45.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.436+0000 7f5258800700 1 -- 172.21.15.84:0/3837216891 wait complete. 2024-04-26T21:27:45.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.437+0000 7f5258800700 1 Processor -- start 2024-04-26T21:27:45.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.438+0000 7f5258800700 1 -- start start 2024-04-26T21:27:45.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.438+0000 7f5258800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500fcf10 0x7f525006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:45.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.438+0000 7f5258800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f525006e930 0x7f525006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:45.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.438+0000 7f5258800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525006ff20 con 0x7f52500fcf10 2024-04-26T21:27:45.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.438+0000 7f5258800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525011bde0 con 0x7f525006e930 2024-04-26T21:27:45.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.439+0000 7f5255e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500fcf10 0x7f525006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:45.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.439+0000 7f5255e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500fcf10 0x7f525006e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33518/0 (socket says 172.21.15.84:33518) 2024-04-26T21:27:45.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.439+0000 7f5255e00700 1 -- 172.21.15.84:0/2028556335 learned_addr learned my addr 172.21.15.84:0/2028556335 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:27:45.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.439+0000 7f5255400700 1 --2- 172.21.15.84:0/2028556335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f525006e930 0x7f525006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:45.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.439+0000 7f5255e00700 1 -- 172.21.15.84:0/2028556335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f525006e930 msgr2=0x7f525006eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:45.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.439+0000 7f5255e00700 1 --2- 172.21.15.84:0/2028556335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f525006e930 0x7f525006eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:45.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.439+0000 7f5255e00700 1 -- 172.21.15.84:0/2028556335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5240005040 con 0x7f52500fcf10 2024-04-26T21:27:45.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.439+0000 7f5255400700 1 --2- 172.21.15.84:0/2028556335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f525006e930 0x7f525006eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:27:45.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.440+0000 7f5255e00700 1 --2- 172.21.15.84:0/2028556335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500fcf10 0x7f525006e3f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f524400eb40 tx=0x7f524400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:45.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.441+0000 7f524a000700 1 -- 172.21.15.84:0/2028556335 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5244007cc0 con 0x7f52500fcf10 2024-04-26T21:27:45.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.441+0000 7f5258800700 1 -- 172.21.15.84:0/2028556335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525011bf20 con 0x7f52500fcf10 2024-04-26T21:27:45.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.441+0000 7f5258800700 1 -- 172.21.15.84:0/2028556335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525011c380 con 0x7f52500fcf10 2024-04-26T21:27:45.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.441+0000 7f524a000700 1 -- 172.21.15.84:0/2028556335 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f524400f040 con 0x7f52500fcf10 2024-04-26T21:27:45.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.441+0000 7f524a000700 1 -- 172.21.15.84:0/2028556335 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f524400ca10 con 0x7f52500fcf10 2024-04-26T21:27:45.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.443+0000 7f5258800700 1 -- 172.21.15.84:0/2028556335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52340052e0 con 0x7f52500fcf10 2024-04-26T21:27:45.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.445+0000 7f524a000700 1 -- 172.21.15.84:0/2028556335 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 36) v1 ==== 92497+0+0 (secure 0 0 0) 0x7f524400cb70 con 0x7f52500fcf10 2024-04-26T21:27:45.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.447+0000 7f524a000700 1 --2- 172.21.15.84:0/2028556335 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f523806e900 0x7f5238070db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:45.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.447+0000 7f524a000700 1 -- 172.21.15.84:0/2028556335 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f524408de00 con 0x7f52500fcf10 2024-04-26T21:27:45.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.448+0000 7f5255400700 1 --2- 172.21.15.84:0/2028556335 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f523806e900 0x7f5238070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:45.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.449+0000 7f5255400700 1 --2- 172.21.15.84:0/2028556335 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f523806e900 0x7f5238070db0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5240000c00 tx=0x7f5240009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:45.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.455+0000 7f524a000700 1 -- 172.21.15.84:0/2028556335 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f5244056fe0 con 0x7f52500fcf10 2024-04-26T21:27:45.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.746+0000 7f524a000700 1 -- 172.21.15.84:0/2028556335 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 37) v1 ==== 92791+0+0 (secure 0 0 0) 0x7f52440573b0 con 0x7f52500fcf10 2024-04-26T21:27:45.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.765+0000 7f5258800700 1 -- 172.21.15.84:0/2028556335 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5234000bf0 con 0x7f523806e900 2024-04-26T21:27:45.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.786+0000 7f524a000700 1 -- 172.21.15.84:0/2028556335 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f5234000bf0 con 0x7f523806e900 2024-04-26T21:27:45.788 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:27:45.788 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (2m) 31s ago 13m 16.0M - 0.25.0 c8568f914cd2 bcb419cf9108 2024-04-26T21:27:45.789 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (13m) 31s ago 13m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 a111b0ee8187 2024-04-26T21:27:45.789 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (12m) 34s ago 12m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 66f4d21263a1 2024-04-26T21:27:45.789 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (2m) 31s ago 13m 76.9M - 9.4.7 954c08fa6188 1bf95f604e07 2024-04-26T21:27:45.789 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (6m) 31s ago 6m 150M - 17.2.7-907-g2be3efa9 1c5834633715 485d7884e1d5 2024-04-26T21:27:45.789 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (6m) 31s ago 6m 12.9M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:27:45.789 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (6m) 34s ago 6m 150M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:27:45.789 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (6m) 34s ago 6m 12.8M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:27:45.789 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (2m) 31s ago 15m 495M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:27:45.789 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283,8765 running (40s) 34s ago 12m 64.5M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d6ae0b4628b5 2024-04-26T21:27:45.789 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (15m) 31s ago 15m 54.6M 2048M 17.2.7-907-g2be3efa9 1c5834633715 24cc2d798ea7 2024-04-26T21:27:45.789 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (12m) 34s ago 11m 42.4M 2048M 17.2.7-907-g2be3efa9 1c5834633715 72c786fd622b 2024-04-26T21:27:45.789 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (2m) 31s ago 13m 7314k - 1.5.0 0da6a335fe13 81e00b40bfbf 2024-04-26T21:27:45.789 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (2m) 34s ago 12m 7642k - 1.5.0 0da6a335fe13 0506a1d46ec4 2024-04-26T21:27:45.789 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (11m) 31s ago 11m 184M 1557M 17.2.7-907-g2be3efa9 1c5834633715 3a2e74d7e51a 2024-04-26T21:27:45.789 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (10m) 31s ago 10m 184M 1557M 17.2.7-907-g2be3efa9 1c5834633715 d283a0a93213 2024-04-26T21:27:45.790 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (9m) 31s ago 9m 145M 1557M 17.2.7-907-g2be3efa9 1c5834633715 5899468fc5c8 2024-04-26T21:27:45.790 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (9m) 34s ago 9m 206M 2581M 17.2.7-907-g2be3efa9 1c5834633715 b8a14c87d730 2024-04-26T21:27:45.790 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (8m) 34s ago 8m 188M 2581M 17.2.7-907-g2be3efa9 1c5834633715 4d294df735a3 2024-04-26T21:27:45.790 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (8m) 34s ago 8m 181M 2581M 17.2.7-907-g2be3efa9 1c5834633715 9b60997971a8 2024-04-26T21:27:45.790 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (49s) 31s ago 12m 42.6M - 2.43.0 a07b618ecd1d d3008b765eec 2024-04-26T21:27:45.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.789+0000 7f5258800700 1 -- 172.21.15.84:0/2028556335 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f523806e900 msgr2=0x7f5238070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:45.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.789+0000 7f5258800700 1 --2- 172.21.15.84:0/2028556335 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f523806e900 0x7f5238070db0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5240000c00 tx=0x7f5240009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:45.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.789+0000 7f5258800700 1 -- 172.21.15.84:0/2028556335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500fcf10 msgr2=0x7f525006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:45.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.789+0000 7f5258800700 1 --2- 172.21.15.84:0/2028556335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500fcf10 0x7f525006e3f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f524400eb40 tx=0x7f524400b040 comp rx=0 tx=0).stop 2024-04-26T21:27:45.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.790+0000 7f5258800700 1 -- 172.21.15.84:0/2028556335 shutdown_connections 2024-04-26T21:27:45.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.790+0000 7f5258800700 1 --2- 172.21.15.84:0/2028556335 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f523806e900 0x7f5238070db0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:45.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.790+0000 7f5258800700 1 --2- 172.21.15.84:0/2028556335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500fcf10 0x7f525006e3f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:45.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.790+0000 7f5258800700 1 --2- 172.21.15.84:0/2028556335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f525006e930 0x7f525006eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:45.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.790+0000 7f5258800700 1 -- 172.21.15.84:0/2028556335 >> 172.21.15.84:0/2028556335 conn(0x7f52500f8560 msgr2=0x7f52500f9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:45.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.790+0000 7f5258800700 1 -- 172.21.15.84:0/2028556335 shutdown_connections 2024-04-26T21:27:45.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.791+0000 7f5258800700 1 -- 172.21.15.84:0/2028556335 wait complete. 2024-04-26T21:27:45.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.984+0000 7f85e3e00700 1 -- 172.21.15.84:0/970726166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85dc0662c0 msgr2=0x7f85dc0fd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:45.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.984+0000 7f85e3e00700 1 --2- 172.21.15.84:0/970726166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85dc0662c0 0x7f85dc0fd790 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f85d0004940 tx=0x7f85d0009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:45.986 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:45 smithi084 ceph-mon[90138]: [26/Apr/2024:21:27:44] ENGINE Bus STARTING 2024-04-26T21:27:45.987 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:45 smithi084 ceph-mon[90138]: pgmap v3: 65 pgs: 65 active+clean; 319 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:27:45.987 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:45 smithi084 ceph-mon[90138]: [26/Apr/2024:21:27:44] ENGINE Serving on http://172.21.15.84:8765 2024-04-26T21:27:45.987 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:45 smithi084 ceph-mon[90138]: [26/Apr/2024:21:27:44] ENGINE Serving on https://172.21.15.84:7150 2024-04-26T21:27:45.987 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:45 smithi084 ceph-mon[90138]: [26/Apr/2024:21:27:44] ENGINE Bus STARTED 2024-04-26T21:27:45.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.985+0000 7f85e3e00700 1 -- 172.21.15.84:0/970726166 shutdown_connections 2024-04-26T21:27:45.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.985+0000 7f85e3e00700 1 --2- 172.21.15.84:0/970726166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85dc0fdcd0 0x7f85dc100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:45.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.985+0000 7f85e3e00700 1 --2- 172.21.15.84:0/970726166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85dc0662c0 0x7f85dc0fd790 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:45.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.985+0000 7f85e3e00700 1 -- 172.21.15.84:0/970726166 >> 172.21.15.84:0/970726166 conn(0x7f85dc0f7430 msgr2=0x7f85dc0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:45.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.985+0000 7f85e3e00700 1 -- 172.21.15.84:0/970726166 shutdown_connections 2024-04-26T21:27:45.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.985+0000 7f85e3e00700 1 -- 172.21.15.84:0/970726166 wait complete. 2024-04-26T21:27:45.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.986+0000 7f85e3e00700 1 Processor -- start 2024-04-26T21:27:45.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.987+0000 7f85e3e00700 1 -- start start 2024-04-26T21:27:45.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.987+0000 7f85e3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85dc0662c0 0x7f85dc114020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:45.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.987+0000 7f85e3e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85dc0fdcd0 0x7f85dc114560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:45.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.987+0000 7f85e3e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc114b60 con 0x7f85dc0fdcd0 2024-04-26T21:27:45.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.987+0000 7f85e3e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc1153b0 con 0x7f85dc0662c0 2024-04-26T21:27:45.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.988+0000 7f85e1400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85dc0662c0 0x7f85dc114020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:45.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.988+0000 7f85e1400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85dc0662c0 0x7f85dc114020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:47916/0 (socket says 172.21.15.84:47916) 2024-04-26T21:27:45.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.988+0000 7f85e1400700 1 -- 172.21.15.84:0/2435981024 learned_addr learned my addr 172.21.15.84:0/2435981024 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:27:45.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.988+0000 7f85e0a00700 1 --2- 172.21.15.84:0/2435981024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85dc0fdcd0 0x7f85dc114560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:45.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.989+0000 7f85e1400700 1 -- 172.21.15.84:0/2435981024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85dc0fdcd0 msgr2=0x7f85dc114560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:45.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.989+0000 7f85e1400700 1 --2- 172.21.15.84:0/2435981024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85dc0fdcd0 0x7f85dc114560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:45.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.989+0000 7f85e1400700 1 -- 172.21.15.84:0/2435981024 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d0005040 con 0x7f85dc0662c0 2024-04-26T21:27:45.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.989+0000 7f85e1400700 1 --2- 172.21.15.84:0/2435981024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85dc0662c0 0x7f85dc114020 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f85d000b970 tx=0x7f85d0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:45.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.990+0000 7f85d9600700 1 -- 172.21.15.84:0/2435981024 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85d000e040 con 0x7f85dc0662c0 2024-04-26T21:27:45.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.990+0000 7f85d9600700 1 -- 172.21.15.84:0/2435981024 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f85d0004290 con 0x7f85dc0662c0 2024-04-26T21:27:45.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.990+0000 7f85d9600700 1 -- 172.21.15.84:0/2435981024 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85d001c630 con 0x7f85dc0662c0 2024-04-26T21:27:45.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.990+0000 7f85e3e00700 1 -- 172.21.15.84:0/2435981024 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85dc1155d0 con 0x7f85dc0662c0 2024-04-26T21:27:45.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.990+0000 7f85e3e00700 1 -- 172.21.15.84:0/2435981024 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85dc115b90 con 0x7f85dc0662c0 2024-04-26T21:27:45.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.992+0000 7f85e3e00700 1 -- 172.21.15.84:0/2435981024 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85dc05f5c0 con 0x7f85dc0662c0 2024-04-26T21:27:45.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.993+0000 7f85d9600700 1 -- 172.21.15.84:0/2435981024 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 37) v1 ==== 92791+0+0 (secure 0 0 0) 0x7f85d000bbf0 con 0x7f85dc0662c0 2024-04-26T21:27:45.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.994+0000 7f85d9600700 1 --2- 172.21.15.84:0/2435981024 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f85c406eca0 0x7f85c4071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:45.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.994+0000 7f85d9600700 1 -- 172.21.15.84:0/2435981024 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f85d008fc10 con 0x7f85dc0662c0 2024-04-26T21:27:45.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.995+0000 7f85e0a00700 1 --2- 172.21.15.84:0/2435981024 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f85c406eca0 0x7f85c4071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:45.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:45.996+0000 7f85e0a00700 1 --2- 172.21.15.84:0/2435981024 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f85c406eca0 0x7f85c4071150 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f85c8004d60 tx=0x7f85c800b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:46.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.008+0000 7f85d9600700 1 -- 172.21.15.84:0/2435981024 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f85d005c550 con 0x7f85dc0662c0 2024-04-26T21:27:46.016 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:45 smithi120 ceph-mon[32741]: [26/Apr/2024:21:27:44] ENGINE Bus STARTING 2024-04-26T21:27:46.016 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:45 smithi120 ceph-mon[32741]: pgmap v3: 65 pgs: 65 active+clean; 319 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:27:46.016 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:45 smithi120 ceph-mon[32741]: [26/Apr/2024:21:27:44] ENGINE Serving on http://172.21.15.84:8765 2024-04-26T21:27:46.016 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:45 smithi120 ceph-mon[32741]: [26/Apr/2024:21:27:44] ENGINE Serving on https://172.21.15.84:7150 2024-04-26T21:27:46.016 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:45 smithi120 ceph-mon[32741]: [26/Apr/2024:21:27:44] ENGINE Bus STARTED 2024-04-26T21:27:46.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.455+0000 7f85e3e00700 1 -- 172.21.15.84:0/2435981024 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f85dc10be90 con 0x7f85dc0662c0 2024-04-26T21:27:46.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.456+0000 7f85d9600700 1 -- 172.21.15.84:0/2435981024 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7f85d005c0e0 con 0x7f85dc0662c0 2024-04-26T21:27:46.457 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:27:46.458 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:27:46.458 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 1, 2024-04-26T21:27:46.458 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 1 2024-04-26T21:27:46.458 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:27:46.458 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:27:46.458 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:27:46.458 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:27:46.458 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:27:46.458 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-26T21:27:46.458 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:27:46.458 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:27:46.458 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-26T21:27:46.458 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:27:46.459 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:27:46.459 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 11, 2024-04-26T21:27:46.459 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 3 2024-04-26T21:27:46.459 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:27:46.459 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:27:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.459+0000 7f85e3e00700 1 -- 172.21.15.84:0/2435981024 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f85c406eca0 msgr2=0x7f85c4071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.459+0000 7f85e3e00700 1 --2- 172.21.15.84:0/2435981024 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f85c406eca0 0x7f85c4071150 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f85c8004d60 tx=0x7f85c800b040 comp rx=0 tx=0).stop 2024-04-26T21:27:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.459+0000 7f85e3e00700 1 -- 172.21.15.84:0/2435981024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85dc0662c0 msgr2=0x7f85dc114020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.459+0000 7f85e3e00700 1 --2- 172.21.15.84:0/2435981024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85dc0662c0 0x7f85dc114020 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f85d000b970 tx=0x7f85d0009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.459+0000 7f85e3e00700 1 -- 172.21.15.84:0/2435981024 shutdown_connections 2024-04-26T21:27:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.460+0000 7f85e3e00700 1 --2- 172.21.15.84:0/2435981024 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f85c406eca0 0x7f85c4071150 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.460+0000 7f85e3e00700 1 --2- 172.21.15.84:0/2435981024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85dc0662c0 0x7f85dc114020 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.460+0000 7f85e3e00700 1 --2- 172.21.15.84:0/2435981024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85dc0fdcd0 0x7f85dc114560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.460+0000 7f85e3e00700 1 -- 172.21.15.84:0/2435981024 >> 172.21.15.84:0/2435981024 conn(0x7f85dc0f7430 msgr2=0x7f85dc0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.460+0000 7f85e3e00700 1 -- 172.21.15.84:0/2435981024 shutdown_connections 2024-04-26T21:27:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.460+0000 7f85e3e00700 1 -- 172.21.15.84:0/2435981024 wait complete. 2024-04-26T21:27:46.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.645+0000 7f6660a00700 1 -- 172.21.15.84:0/211246861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f665c0fedd0 msgr2=0x7f665c0ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:46.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.645+0000 7f6660a00700 1 --2- 172.21.15.84:0/211246861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f665c0fedd0 0x7f665c0ff1e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f664c004940 tx=0x7f664c009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:46.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.645+0000 7f6660a00700 1 -- 172.21.15.84:0/211246861 shutdown_connections 2024-04-26T21:27:46.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.645+0000 7f6660a00700 1 --2- 172.21.15.84:0/211246861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c0ff720 0x7f665c100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:46.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.645+0000 7f6660a00700 1 --2- 172.21.15.84:0/211246861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f665c0fedd0 0x7f665c0ff1e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:46.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.645+0000 7f6660a00700 1 -- 172.21.15.84:0/211246861 >> 172.21.15.84:0/211246861 conn(0x7f665c0fa570 msgr2=0x7f665c0fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:46.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.645+0000 7f6660a00700 1 -- 172.21.15.84:0/211246861 shutdown_connections 2024-04-26T21:27:46.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.645+0000 7f6660a00700 1 -- 172.21.15.84:0/211246861 wait complete. 2024-04-26T21:27:46.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.646+0000 7f6660a00700 1 Processor -- start 2024-04-26T21:27:46.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.646+0000 7f6660a00700 1 -- start start 2024-04-26T21:27:46.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.646+0000 7f6660a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c0fedd0 0x7f665c10fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:46.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.646+0000 7f6660a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f665c0ff720 0x7f665c10ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:46.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.646+0000 7f6660a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c110560 con 0x7f665c0fedd0 2024-04-26T21:27:46.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.646+0000 7f6660a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c110db0 con 0x7f665c0ff720 2024-04-26T21:27:46.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.647+0000 7f665b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c0fedd0 0x7f665c10fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:46.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.647+0000 7f665b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c0fedd0 0x7f665c10fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33562/0 (socket says 172.21.15.84:33562) 2024-04-26T21:27:46.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.647+0000 7f665b400700 1 -- 172.21.15.84:0/385166539 learned_addr learned my addr 172.21.15.84:0/385166539 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:27:46.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.647+0000 7f665aa00700 1 --2- 172.21.15.84:0/385166539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f665c0ff720 0x7f665c10ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:46.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.647+0000 7f665b400700 1 -- 172.21.15.84:0/385166539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f665c0ff720 msgr2=0x7f665c10ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:46.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.647+0000 7f665b400700 1 --2- 172.21.15.84:0/385166539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f665c0ff720 0x7f665c10ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:46.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.647+0000 7f665b400700 1 -- 172.21.15.84:0/385166539 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664c005040 con 0x7f665c0fedd0 2024-04-26T21:27:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.648+0000 7f665b400700 1 --2- 172.21.15.84:0/385166539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c0fedd0 0x7f665c10fa20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f664c00b0d0 tx=0x7f664c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.648+0000 7f6653400700 1 -- 172.21.15.84:0/385166539 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f664c00e070 con 0x7f665c0fedd0 2024-04-26T21:27:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.648+0000 7f6653400700 1 -- 172.21.15.84:0/385166539 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f664c013de0 con 0x7f665c0fedd0 2024-04-26T21:27:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.648+0000 7f6660a00700 1 -- 172.21.15.84:0/385166539 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f665c111030 con 0x7f665c0fedd0 2024-04-26T21:27:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.648+0000 7f6653400700 1 -- 172.21.15.84:0/385166539 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f664c00be30 con 0x7f665c0fedd0 2024-04-26T21:27:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.648+0000 7f6660a00700 1 -- 172.21.15.84:0/385166539 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665c111570 con 0x7f665c0fedd0 2024-04-26T21:27:46.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.650+0000 7f6660a00700 1 -- 172.21.15.84:0/385166539 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665c05f5c0 con 0x7f665c0fedd0 2024-04-26T21:27:46.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.651+0000 7f6653400700 1 -- 172.21.15.84:0/385166539 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 37) v1 ==== 92791+0+0 (secure 0 0 0) 0x7f664c027440 con 0x7f665c0fedd0 2024-04-26T21:27:46.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.652+0000 7f6653400700 1 --2- 172.21.15.84:0/385166539 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f664006eca0 0x7f6640071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:46.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.652+0000 7f6653400700 1 -- 172.21.15.84:0/385166539 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f664c08f670 con 0x7f665c0fedd0 2024-04-26T21:27:46.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.653+0000 7f665aa00700 1 --2- 172.21.15.84:0/385166539 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f664006eca0 0x7f6640071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:46.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.654+0000 7f665aa00700 1 --2- 172.21.15.84:0/385166539 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f664006eca0 0x7f6640071150 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6648009b80 tx=0x7f664800b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:46.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:46.660+0000 7f6653400700 1 -- 172.21.15.84:0/385166539 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f664c05cf30 con 0x7f665c0fedd0 2024-04-26T21:27:47.001 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:46 smithi120 ceph-mon[32741]: from='client.34122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:27:47.001 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:46 smithi120 ceph-mon[32741]: pgmap v4: 65 pgs: 65 active+clean; 319 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:27:47.001 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:46 smithi120 ceph-mon[32741]: mgrmap e37: smithi084.gyasul(active, since 2s), standbys: smithi120.zjaduj 2024-04-26T21:27:47.001 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:46 smithi120 ceph-mon[32741]: from='client.34126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:27:47.001 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:46 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/2435981024' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:27:47.045 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:46 smithi084 ceph-mon[90138]: from='client.34122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:27:47.045 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:46 smithi084 ceph-mon[90138]: pgmap v4: 65 pgs: 65 active+clean; 319 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:27:47.045 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:46 smithi084 ceph-mon[90138]: mgrmap e37: smithi084.gyasul(active, since 2s), standbys: smithi120.zjaduj 2024-04-26T21:27:47.045 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:46 smithi084 ceph-mon[90138]: from='client.34126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:27:47.045 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:46 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2435981024' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:27:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.058+0000 7f6660a00700 1 -- 172.21.15.84:0/385166539 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f665c107910 con 0x7f665c0fedd0 2024-04-26T21:27:47.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.059+0000 7f6653400700 1 -- 172.21.15.84:0/385166539 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1922 (secure 0 0 0) 0x7f664c0227a0 con 0x7f665c0fedd0 2024-04-26T21:27:47.063 INFO:teuthology.orchestra.run.smithi084.stdout:e15 2024-04-26T21:27:47.063 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:27:47.063 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:27:47.063 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:27:47.063 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:27:47.063 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:27:47.063 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:27:47.063 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 15 2024-04-26T21:27:47.063 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:27:47.063 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:27:47.063 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:27:24.731661+0000 2024-04-26T21:27:47.063 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:27:47.063 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:27:47.064 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:27:47.064 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:27:47.064 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:27:47.064 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-04-26T21:27:47.064 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:27:47.064 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:27:47.064 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:27:47.064 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:27:47.064 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:27:47.064 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:27:47.064 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456,1=24231} 2024-04-26T21:27:47.064 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:27:47.064 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:27:47.064 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:27:47.065 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:27:47.065 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:27:47.065 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:27:47.065 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:27:47.065 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-04-26T21:27:47.065 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:27:47.065 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 0 members: 2024-04-26T21:27:47.065 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:27:47.065 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:27:47.065 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:27:47.065 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:27:47.065 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:27:47.065 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:27:47.065 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:27:47.066 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:27:47.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.063+0000 7f6660a00700 1 -- 172.21.15.84:0/385166539 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f664006eca0 msgr2=0x7f6640071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:47.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.063+0000 7f6660a00700 1 --2- 172.21.15.84:0/385166539 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f664006eca0 0x7f6640071150 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6648009b80 tx=0x7f664800b040 comp rx=0 tx=0).stop 2024-04-26T21:27:47.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.063+0000 7f6660a00700 1 -- 172.21.15.84:0/385166539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c0fedd0 msgr2=0x7f665c10fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:47.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.063+0000 7f6660a00700 1 --2- 172.21.15.84:0/385166539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c0fedd0 0x7f665c10fa20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f664c00b0d0 tx=0x7f664c009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:47.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.063+0000 7f6660a00700 1 -- 172.21.15.84:0/385166539 shutdown_connections 2024-04-26T21:27:47.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.063+0000 7f6660a00700 1 --2- 172.21.15.84:0/385166539 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f664006eca0 0x7f6640071150 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:47.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.063+0000 7f6660a00700 1 --2- 172.21.15.84:0/385166539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f665c0fedd0 0x7f665c10fa20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:47.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.063+0000 7f6660a00700 1 --2- 172.21.15.84:0/385166539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f665c0ff720 0x7f665c10ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:47.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.063+0000 7f6660a00700 1 -- 172.21.15.84:0/385166539 >> 172.21.15.84:0/385166539 conn(0x7f665c0fa570 msgr2=0x7f665c0fbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:47.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.063+0000 7f6660a00700 1 -- 172.21.15.84:0/385166539 shutdown_connections 2024-04-26T21:27:47.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.063+0000 7f6660a00700 1 -- 172.21.15.84:0/385166539 wait complete. 2024-04-26T21:27:47.069 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 15 2024-04-26T21:27:47.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.252+0000 7fe574c00700 1 -- 172.21.15.84:0/2959022360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe570071ef0 msgr2=0x7fe570070400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:47.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.252+0000 7fe574c00700 1 --2- 172.21.15.84:0/2959022360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe570071ef0 0x7fe570070400 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe560004940 tx=0x7fe560009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:47.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.253+0000 7fe574c00700 1 -- 172.21.15.84:0/2959022360 shutdown_connections 2024-04-26T21:27:47.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.253+0000 7fe574c00700 1 --2- 172.21.15.84:0/2959022360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe570070940 0x7fe570070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:47.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.253+0000 7fe574c00700 1 --2- 172.21.15.84:0/2959022360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe570071ef0 0x7fe570070400 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:47.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.253+0000 7fe574c00700 1 -- 172.21.15.84:0/2959022360 >> 172.21.15.84:0/2959022360 conn(0x7fe5700f8560 msgr2=0x7fe5700fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:47.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.253+0000 7fe574c00700 1 -- 172.21.15.84:0/2959022360 shutdown_connections 2024-04-26T21:27:47.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.253+0000 7fe574c00700 1 -- 172.21.15.84:0/2959022360 wait complete. 2024-04-26T21:27:47.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.254+0000 7fe574c00700 1 Processor -- start 2024-04-26T21:27:47.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.255+0000 7fe574c00700 1 -- start start 2024-04-26T21:27:47.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.255+0000 7fe574c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe570070940 0x7fe570107640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:47.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.255+0000 7fe574c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe570071ef0 0x7fe570107b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:47.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.255+0000 7fe574c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe570109230 con 0x7fe570071ef0 2024-04-26T21:27:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.255+0000 7fe574c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe570109370 con 0x7fe570070940 2024-04-26T21:27:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.255+0000 7fe56d400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe570071ef0 0x7fe570107b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.255+0000 7fe56d400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe570071ef0 0x7fe570107b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33582/0 (socket says 172.21.15.84:33582) 2024-04-26T21:27:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.255+0000 7fe56de00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe570070940 0x7fe570107640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.255+0000 7fe56de00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe570070940 0x7fe570107640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:47952/0 (socket says 172.21.15.84:47952) 2024-04-26T21:27:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.256+0000 7fe56de00700 1 -- 172.21.15.84:0/855662835 learned_addr learned my addr 172.21.15.84:0/855662835 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:27:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.256+0000 7fe56d400700 1 -- 172.21.15.84:0/855662835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe570070940 msgr2=0x7fe570107640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.256+0000 7fe56d400700 1 --2- 172.21.15.84:0/855662835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe570070940 0x7fe570107640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.256+0000 7fe56d400700 1 -- 172.21.15.84:0/855662835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe560005040 con 0x7fe570071ef0 2024-04-26T21:27:47.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.256+0000 7fe56d400700 1 --2- 172.21.15.84:0/855662835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe570071ef0 0x7fe570107b80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe55c009fd0 tx=0x7fe55c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:47.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.257+0000 7fe566000700 1 -- 172.21.15.84:0/855662835 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe55c004e90 con 0x7fe570071ef0 2024-04-26T21:27:47.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.257+0000 7fe566000700 1 -- 172.21.15.84:0/855662835 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe55c00f040 con 0x7fe570071ef0 2024-04-26T21:27:47.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.257+0000 7fe566000700 1 -- 172.21.15.84:0/855662835 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe55c00ca50 con 0x7fe570071ef0 2024-04-26T21:27:47.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.257+0000 7fe574c00700 1 -- 172.21.15.84:0/855662835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe570108200 con 0x7fe570071ef0 2024-04-26T21:27:47.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.257+0000 7fe574c00700 1 -- 172.21.15.84:0/855662835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe570122590 con 0x7fe570071ef0 2024-04-26T21:27:47.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.258+0000 7fe574c00700 1 -- 172.21.15.84:0/855662835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe57005f5c0 con 0x7fe570071ef0 2024-04-26T21:27:47.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.261+0000 7fe566000700 1 -- 172.21.15.84:0/855662835 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 37) v1 ==== 92791+0+0 (secure 0 0 0) 0x7fe55c007cc0 con 0x7fe570071ef0 2024-04-26T21:27:47.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.261+0000 7fe566000700 1 --2- 172.21.15.84:0/855662835 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe55406eca0 0x7fe554071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:47.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.262+0000 7fe566000700 1 -- 172.21.15.84:0/855662835 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe55c08e510 con 0x7fe570071ef0 2024-04-26T21:27:47.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.262+0000 7fe56de00700 1 --2- 172.21.15.84:0/855662835 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe55406eca0 0x7fe554071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:47.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.263+0000 7fe56de00700 1 --2- 172.21.15.84:0/855662835 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe55406eca0 0x7fe554071150 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe56000b0d0 tx=0x7fe560009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:47.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.268+0000 7fe566000700 1 -- 172.21.15.84:0/855662835 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fe55c057310 con 0x7fe570071ef0 2024-04-26T21:27:47.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.560+0000 7fe574c00700 1 -- 172.21.15.84:0/855662835 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5700ff950 con 0x7fe55406eca0 2024-04-26T21:27:47.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.562+0000 7fe566000700 1 -- 172.21.15.84:0/855662835 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fe5700ff950 con 0x7fe55406eca0 2024-04-26T21:27:47.564 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:27:47.564 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:27:47.564 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:27:47.564 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:27:47.564 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-04-26T21:27:47.564 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr" 2024-04-26T21:27:47.564 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-04-26T21:27:47.564 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "2/21 daemons upgraded", 2024-04-26T21:27:47.564 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2024-04-26T21:27:47.565 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:27:47.565 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:27:47.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.565+0000 7fe574c00700 1 -- 172.21.15.84:0/855662835 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe55406eca0 msgr2=0x7fe554071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:47.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.565+0000 7fe574c00700 1 --2- 172.21.15.84:0/855662835 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe55406eca0 0x7fe554071150 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe56000b0d0 tx=0x7fe560009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:47.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.565+0000 7fe574c00700 1 -- 172.21.15.84:0/855662835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe570071ef0 msgr2=0x7fe570107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:47.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.565+0000 7fe574c00700 1 --2- 172.21.15.84:0/855662835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe570071ef0 0x7fe570107b80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe55c009fd0 tx=0x7fe55c00b040 comp rx=0 tx=0).stop 2024-04-26T21:27:47.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.565+0000 7fe574c00700 1 -- 172.21.15.84:0/855662835 shutdown_connections 2024-04-26T21:27:47.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.565+0000 7fe574c00700 1 --2- 172.21.15.84:0/855662835 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe55406eca0 0x7fe554071150 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:47.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.565+0000 7fe574c00700 1 --2- 172.21.15.84:0/855662835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe570070940 0x7fe570107640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:47.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.566+0000 7fe574c00700 1 --2- 172.21.15.84:0/855662835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe570071ef0 0x7fe570107b80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:47.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.566+0000 7fe574c00700 1 -- 172.21.15.84:0/855662835 >> 172.21.15.84:0/855662835 conn(0x7fe5700f8560 msgr2=0x7fe5700f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:47.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.566+0000 7fe574c00700 1 -- 172.21.15.84:0/855662835 shutdown_connections 2024-04-26T21:27:47.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.566+0000 7fe574c00700 1 -- 172.21.15.84:0/855662835 wait complete. 2024-04-26T21:27:47.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.731+0000 7fa60fe00700 1 -- 172.21.15.84:0/3800609685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6100ffd80 msgr2=0x7fa610102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:47.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.731+0000 7fa60fe00700 1 --2- 172.21.15.84:0/3800609685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6100ffd80 0x7fa610102160 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc004940 tx=0x7fa5fc009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:47.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.731+0000 7fa60fe00700 1 -- 172.21.15.84:0/3800609685 shutdown_connections 2024-04-26T21:27:47.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.731+0000 7fa60fe00700 1 --2- 172.21.15.84:0/3800609685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6100ffd80 0x7fa610102160 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:47.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.731+0000 7fa60fe00700 1 --2- 172.21.15.84:0/3800609685 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa610066260 0x7fa6100ff840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:47.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.731+0000 7fa60fe00700 1 -- 172.21.15.84:0/3800609685 >> 172.21.15.84:0/3800609685 conn(0x7fa6100f7250 msgr2=0x7fa6100f9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:47.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.731+0000 7fa60fe00700 1 -- 172.21.15.84:0/3800609685 shutdown_connections 2024-04-26T21:27:47.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.731+0000 7fa60fe00700 1 -- 172.21.15.84:0/3800609685 wait complete. 2024-04-26T21:27:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.732+0000 7fa60fe00700 1 Processor -- start 2024-04-26T21:27:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.732+0000 7fa60fe00700 1 -- start start 2024-04-26T21:27:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.732+0000 7fa60fe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa610066260 0x7fa61010fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.732+0000 7fa60fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6100ffd80 0x7fa61010ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.732+0000 7fa60fe00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6101105b0 con 0x7fa6100ffd80 2024-04-26T21:27:47.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.732+0000 7fa60fe00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa610110e00 con 0x7fa610066260 2024-04-26T21:27:47.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.732+0000 7fa60e000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6100ffd80 0x7fa61010ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:47.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.732+0000 7fa60e000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6100ffd80 0x7fa61010ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33598/0 (socket says 172.21.15.84:33598) 2024-04-26T21:27:47.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.732+0000 7fa60e000700 1 -- 172.21.15.84:0/655353546 learned_addr learned my addr 172.21.15.84:0/655353546 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:27:47.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.733+0000 7fa60ea00700 1 --2- 172.21.15.84:0/655353546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa610066260 0x7fa61010fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:47.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.733+0000 7fa60e000700 1 -- 172.21.15.84:0/655353546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa610066260 msgr2=0x7fa61010fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:47.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.733+0000 7fa60e000700 1 --2- 172.21.15.84:0/655353546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa610066260 0x7fa61010fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:47.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.733+0000 7fa60e000700 1 -- 172.21.15.84:0/655353546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc005040 con 0x7fa6100ffd80 2024-04-26T21:27:47.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.733+0000 7fa60ea00700 1 --2- 172.21.15.84:0/655353546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa610066260 0x7fa61010fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:27:47.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.733+0000 7fa60e000700 1 --2- 172.21.15.84:0/655353546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6100ffd80 0x7fa61010ffb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009150 tx=0x7fa5fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:47.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.733+0000 7fa606a00700 1 -- 172.21.15.84:0/655353546 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5fc00e040 con 0x7fa6100ffd80 2024-04-26T21:27:47.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.734+0000 7fa606a00700 1 -- 172.21.15.84:0/655353546 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa5fc00bbf0 con 0x7fa6100ffd80 2024-04-26T21:27:47.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.734+0000 7fa606a00700 1 -- 172.21.15.84:0/655353546 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5fc01c630 con 0x7fa6100ffd80 2024-04-26T21:27:47.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.734+0000 7fa60fe00700 1 -- 172.21.15.84:0/655353546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa610111080 con 0x7fa6100ffd80 2024-04-26T21:27:47.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.734+0000 7fa60fe00700 1 -- 172.21.15.84:0/655353546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6101115c0 con 0x7fa6100ffd80 2024-04-26T21:27:47.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.735+0000 7fa60fe00700 1 -- 172.21.15.84:0/655353546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61005f5c0 con 0x7fa6100ffd80 2024-04-26T21:27:47.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.737+0000 7fa606a00700 1 -- 172.21.15.84:0/655353546 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 37) v1 ==== 92791+0+0 (secure 0 0 0) 0x7fa5fc00bd60 con 0x7fa6100ffd80 2024-04-26T21:27:47.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.738+0000 7fa606a00700 1 --2- 172.21.15.84:0/655353546 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa5f406eca0 0x7fa5f4071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:27:47.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.738+0000 7fa606a00700 1 -- 172.21.15.84:0/655353546 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa5fc08fac0 con 0x7fa6100ffd80 2024-04-26T21:27:47.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.738+0000 7fa60ea00700 1 --2- 172.21.15.84:0/655353546 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa5f406eca0 0x7fa5f4071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:27:47.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.739+0000 7fa60ea00700 1 --2- 172.21.15.84:0/655353546 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa5f406eca0 0x7fa5f4071150 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa600009fd0 tx=0x7fa600009f00 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:27:47.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.744+0000 7fa606a00700 1 -- 172.21.15.84:0/655353546 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fa5fc05c340 con 0x7fa6100ffd80 2024-04-26T21:27:47.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:47.757+0000 7fa606a00700 1 -- 172.21.15.84:0/655353546 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fa5fc058be0 con 0x7fa6100ffd80 2024-04-26T21:27:47.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:47 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/385166539' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:27:48.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:47 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/385166539' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:27:48.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:48.218+0000 7fa60fe00700 1 -- 172.21.15.84:0/655353546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa61004bed0 con 0x7fa6100ffd80 2024-04-26T21:27:48.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:48.219+0000 7fa606a00700 1 -- 172.21.15.84:0/655353546 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fa5fc045a40 con 0x7fa6100ffd80 2024-04-26T21:27:48.220 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:27:48.220 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:27:48.220 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:27:48.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:48.222+0000 7fa60fe00700 1 -- 172.21.15.84:0/655353546 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa5f406eca0 msgr2=0x7fa5f4071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:48.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:48.222+0000 7fa60fe00700 1 --2- 172.21.15.84:0/655353546 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa5f406eca0 0x7fa5f4071150 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa600009fd0 tx=0x7fa600009f00 comp rx=0 tx=0).stop 2024-04-26T21:27:48.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:48.222+0000 7fa60fe00700 1 -- 172.21.15.84:0/655353546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6100ffd80 msgr2=0x7fa61010ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:27:48.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:48.222+0000 7fa60fe00700 1 --2- 172.21.15.84:0/655353546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6100ffd80 0x7fa61010ffb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009150 tx=0x7fa5fc009e30 comp rx=0 tx=0).stop 2024-04-26T21:27:48.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:48.223+0000 7fa60fe00700 1 -- 172.21.15.84:0/655353546 shutdown_connections 2024-04-26T21:27:48.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:48.223+0000 7fa60fe00700 1 --2- 172.21.15.84:0/655353546 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa5f406eca0 0x7fa5f4071150 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:48.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:48.223+0000 7fa60fe00700 1 --2- 172.21.15.84:0/655353546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa610066260 0x7fa61010fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:48.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:48.223+0000 7fa60fe00700 1 --2- 172.21.15.84:0/655353546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6100ffd80 0x7fa61010ffb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:27:48.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:48.223+0000 7fa60fe00700 1 -- 172.21.15.84:0/655353546 >> 172.21.15.84:0/655353546 conn(0x7fa6100f7250 msgr2=0x7fa6100fb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:27:48.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:48.224+0000 7fa60fe00700 1 -- 172.21.15.84:0/655353546 shutdown_connections 2024-04-26T21:27:48.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:27:48.224+0000 7fa60fe00700 1 -- 172.21.15.84:0/655353546 wait complete. 2024-04-26T21:27:48.841 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:48 smithi084 ceph-mon[90138]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:27:48.841 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:48 smithi084 ceph-mon[90138]: pgmap v5: 65 pgs: 65 active+clean; 319 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:27:48.841 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:48 smithi084 ceph-mon[90138]: mgrmap e38: smithi084.gyasul(active, since 4s), standbys: smithi120.zjaduj 2024-04-26T21:27:48.841 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:48 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/655353546' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:27:49.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:48 smithi120 ceph-mon[32741]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:27:49.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:48 smithi120 ceph-mon[32741]: pgmap v5: 65 pgs: 65 active+clean; 319 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:27:49.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:48 smithi120 ceph-mon[32741]: mgrmap e38: smithi084.gyasul(active, since 4s), standbys: smithi120.zjaduj 2024-04-26T21:27:49.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:48 smithi120 ceph-mon[32741]: from='client.? 172.21.15.84:0/655353546' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:27:50.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:50.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:50.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:50 smithi084 ceph-mon[90138]: pgmap v6: 65 pgs: 65 active+clean; 319 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:27:50.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:50 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:50.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:50 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:50.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:50 smithi120 ceph-mon[32741]: pgmap v6: 65 pgs: 65 active+clean; 319 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:27:52.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:52 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:52.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:52 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:52.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:52 smithi084 ceph-mon[90138]: pgmap v7: 65 pgs: 65 active+clean; 320 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 50 KiB/s rd, 1019 KiB/s wr, 142 op/s 2024-04-26T21:27:52.669 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:52 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:52.669 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:52 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:52.669 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:52 smithi120 ceph-mon[32741]: pgmap v7: 65 pgs: 65 active+clean; 320 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 50 KiB/s rd, 1019 KiB/s wr, 142 op/s 2024-04-26T21:27:54.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:54 smithi084 ceph-mon[90138]: pgmap v8: 65 pgs: 65 active+clean; 320 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 792 KiB/s wr, 111 op/s 2024-04-26T21:27:54.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:54 smithi120 ceph-mon[32741]: pgmap v8: 65 pgs: 65 active+clean; 320 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 792 KiB/s wr, 111 op/s 2024-04-26T21:27:56.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:56.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:56.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:56 smithi084 ceph-mon[90138]: pgmap v9: 65 pgs: 65 active+clean; 320 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.2 MiB/s wr, 174 op/s 2024-04-26T21:27:56.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:56 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:56.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:56 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:56.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:56 smithi120 ceph-mon[32741]: pgmap v9: 65 pgs: 65 active+clean; 320 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.2 MiB/s wr, 174 op/s 2024-04-26T21:27:58.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:58 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:58.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:58 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:58.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:58 smithi084 ceph-mon[90138]: pgmap v10: 65 pgs: 65 active+clean; 320 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.1 MiB/s wr, 160 op/s 2024-04-26T21:27:58.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:58 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:58.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:58 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:58.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:58 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:27:58.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:58 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:27:58.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:58 smithi084 ceph-mon[90138]: Updating smithi084:/etc/ceph/ceph.conf 2024-04-26T21:27:58.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:58 smithi084 ceph-mon[90138]: Updating smithi120:/etc/ceph/ceph.conf 2024-04-26T21:27:58.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:58 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:58.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:58 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:58.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:58 smithi120 ceph-mon[32741]: pgmap v10: 65 pgs: 65 active+clean; 320 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.1 MiB/s wr, 160 op/s 2024-04-26T21:27:58.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:58 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:58.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:58 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:27:58.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:58 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:27:58.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:58 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:27:58.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:58 smithi120 ceph-mon[32741]: Updating smithi084:/etc/ceph/ceph.conf 2024-04-26T21:27:58.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:58 smithi120 ceph-mon[32741]: Updating smithi120:/etc/ceph/ceph.conf 2024-04-26T21:27:59.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:59 smithi084 ceph-mon[90138]: Updating smithi084:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:27:59.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:59 smithi084 ceph-mon[90138]: Updating smithi120:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:27:59.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:27:59 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:27:59.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:59 smithi120 ceph-mon[32741]: Updating smithi084:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:27:59.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:59 smithi120 ceph-mon[32741]: Updating smithi120:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:27:59.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:27:59 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:28:00.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:00 smithi084 ceph-mon[90138]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:28:00.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:00 smithi084 ceph-mon[90138]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:28:00.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:00 smithi084 ceph-mon[90138]: pgmap v11: 65 pgs: 65 active+clean; 319 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.1 MiB/s wr, 170 op/s 2024-04-26T21:28:00.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:00 smithi084 ceph-mon[90138]: Updating smithi084:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:28:00.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:00 smithi120 ceph-mon[32741]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:28:00.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:00 smithi120 ceph-mon[32741]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:28:00.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:00 smithi120 ceph-mon[32741]: pgmap v11: 65 pgs: 65 active+clean; 319 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.1 MiB/s wr, 170 op/s 2024-04-26T21:28:00.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:00 smithi120 ceph-mon[32741]: Updating smithi084:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:28:01.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:01 smithi084 ceph-mon[90138]: Updating smithi120:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:28:01.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:01 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:01.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:01 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:01.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:01 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:01.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:01 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:01.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:01 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:01.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:01 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:28:01.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:01 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:28:01.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:01 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-26T21:28:01.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:01 smithi120 ceph-mon[32741]: Updating smithi120:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:28:01.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:01 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:01.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:01 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:01.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:01 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:01.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:01 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:01.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:01 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:01.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:01 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:28:01.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:01 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:28:01.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:01 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-26T21:28:02.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:02 smithi084 ceph-mon[90138]: pgmap v12: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 54 KiB/s rd, 1.6 MiB/s wr, 260 op/s 2024-04-26T21:28:02.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:02 smithi120 ceph-mon[32741]: pgmap v12: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 54 KiB/s rd, 1.6 MiB/s wr, 260 op/s 2024-04-26T21:28:04.522 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-04-26T21:28:04.522 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-04-26T21:28:04.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:04 smithi120 ceph-mon[32741]: pgmap v13: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1022 KiB/s wr, 177 op/s 2024-04-26T21:28:05.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:04 smithi084 ceph-mon[90138]: pgmap v13: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1022 KiB/s wr, 177 op/s 2024-04-26T21:28:05.774 DEBUG:teuthology.parallel:result is None 2024-04-26T21:28:07.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:06 smithi084 ceph-mon[90138]: pgmap v14: 65 pgs: 65 active+clean; 316 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.5 MiB/s wr, 263 op/s 2024-04-26T21:28:07.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:06 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:07.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:06 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:28:07.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:06 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T21:28:07.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:06 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:07.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:06 smithi120 ceph-mon[32741]: pgmap v14: 65 pgs: 65 active+clean; 316 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.5 MiB/s wr, 263 op/s 2024-04-26T21:28:07.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:06 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:07.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:06 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:28:07.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:06 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T21:28:07.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:06 smithi120 ceph-mon[32741]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:07.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:07 smithi120 ceph-mon[32741]: Upgrade: Updating mon.smithi120 2024-04-26T21:28:07.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:07 smithi120 ceph-mon[32741]: Deploying daemon mon.smithi120 on smithi120 2024-04-26T21:28:08.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:07 smithi084 ceph-mon[90138]: Upgrade: Updating mon.smithi120 2024-04-26T21:28:08.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:07 smithi084 ceph-mon[90138]: Deploying daemon mon.smithi120 on smithi120 2024-04-26T21:28:09.064 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:08 smithi084 ceph-mon[90138]: pgmap v15: 65 pgs: 65 active+clean; 316 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 997 KiB/s wr, 186 op/s 2024-04-26T21:28:09.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:08 smithi120 ceph-mon[32741]: pgmap v15: 65 pgs: 65 active+clean; 316 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 997 KiB/s wr, 186 op/s 2024-04-26T21:28:09.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:09 smithi120 systemd[1]: Stopping Ceph mon.smithi120 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:28:10.110 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:09 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi120[32729]: 2024-04-26T21:28:09.695+0000 7fc697200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi120 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:28:10.110 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:09 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi120[32729]: 2024-04-26T21:28:09.695+0000 7fc697200700 -1 mon.smithi120@1(peon) e2 *** Got Signal Terminated *** 2024-04-26T21:28:10.110 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:09 smithi120 podman[78843]: 2024-04-26 21:28:09.77945578 +0000 UTC m=+0.239512262 container died 72c786fd622b7197634631df96ef1f979ee9930ea832c908f88d2bd9c93d06ba (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi120, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=quincy-2be3efa, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:28:10.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:10 smithi120 podman[78843]: 2024-04-26 21:28:10.306200838 +0000 UTC m=+0.766257291 container cleanup 72c786fd622b7197634631df96ef1f979ee9930ea832c908f88d2bd9c93d06ba (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi120, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=quincy-2be3efa) 2024-04-26T21:28:10.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:10 smithi120 bash[78843]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi120 2024-04-26T21:28:11.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:10 smithi120 podman[78858]: 2024-04-26 21:28:10.723279978 +0000 UTC m=+0.929191395 container remove 72c786fd622b7197634631df96ef1f979ee9930ea832c908f88d2bd9c93d06ba (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi120, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=quincy-2be3efa, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux ) 2024-04-26T21:28:11.619 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:11 smithi120 systemd[1]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968@mon.smithi120.service: Deactivated successfully. 2024-04-26T21:28:11.619 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:11 smithi120 systemd[1]: Stopped Ceph mon.smithi120 for 8bb44d26-0411-11ef-bc93-c7b262605968. 2024-04-26T21:28:11.619 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:11 smithi120 systemd[1]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968@mon.smithi120.service: Consumed 14.999s CPU time. 2024-04-26T21:28:11.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:11 smithi120 systemd[1]: Starting Ceph mon.smithi120 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:28:12.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:11 smithi120 podman[78983]: 2024-04-26 21:28:11.891742532 +0000 UTC m=+0.034420866 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:28:12.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 podman[78983]: 2024-04-26 21:28:12.024268179 +0000 UTC m=+0.166946600 container create 5d530496253b9463e83a1106d7a23f1165df69eed82cdae1b78f6a0762fe785e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi120, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, ceph=True) 2024-04-26T21:28:12.435 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-26T21:28:12.435 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T21:28:12.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 podman[78983]: 2024-04-26 21:28:12.452734552 +0000 UTC m=+0.595412905 container init 5d530496253b9463e83a1106d7a23f1165df69eed82cdae1b78f6a0762fe785e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi120, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-26T21:28:12.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 podman[78983]: 2024-04-26 21:28:12.461420222 +0000 UTC m=+0.604098556 container start 5d530496253b9463e83a1106d7a23f1165df69eed82cdae1b78f6a0762fe785e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi120, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=) 2024-04-26T21:28:12.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: set uid:gid to 167:167 (ceph:ceph) 2024-04-26T21:28:12.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev), process ceph-mon, pid 2 2024-04-26T21:28:12.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: pidfile_write: ignore empty --pid-file 2024-04-26T21:28:12.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: load: jerasure load: lrc 2024-04-26T21:28:12.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: RocksDB version: 7.9.2 2024-04-26T21:28:12.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Git sha 0 2024-04-26T21:28:12.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Compile date 2024-04-26 11:39:23 2024-04-26T21:28:12.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: DB SUMMARY 2024-04-26T21:28:12.525 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: DB Session ID: PQDVMZU5BI6NP4WHKBXV 2024-04-26T21:28:12.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: CURRENT file: CURRENT 2024-04-26T21:28:12.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: IDENTITY file: IDENTITY 2024-04-26T21:28:12.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1072 Bytes 2024-04-26T21:28:12.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi120/store.db dir, Total Num: 1, files: 000027.sst 2024-04-26T21:28:12.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi120/store.db: 000025.log size: 6716351 ; 2024-04-26T21:28:12.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.error_if_exists: 0 2024-04-26T21:28:12.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.create_if_missing: 0 2024-04-26T21:28:12.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.paranoid_checks: 1 2024-04-26T21:28:12.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-26T21:28:12.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-26T21:28:12.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-26T21:28:12.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.env: 0x55b87003ecc0 2024-04-26T21:28:12.526 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.fs: PosixFileSystem 2024-04-26T21:28:12.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.info_log: 0x55b88e59dca0 2024-04-26T21:28:12.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_file_opening_threads: 16 2024-04-26T21:28:12.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.statistics: (nil) 2024-04-26T21:28:12.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.use_fsync: 0 2024-04-26T21:28:12.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_log_file_size: 0 2024-04-26T21:28:12.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-26T21:28:12.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-26T21:28:12.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.keep_log_file_num: 1000 2024-04-26T21:28:12.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.recycle_log_file_num: 0 2024-04-26T21:28:12.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.allow_fallocate: 1 2024-04-26T21:28:12.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.allow_mmap_reads: 0 2024-04-26T21:28:12.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.allow_mmap_writes: 0 2024-04-26T21:28:12.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.use_direct_reads: 0 2024-04-26T21:28:12.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-26T21:28:12.527 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.create_missing_column_families: 0 2024-04-26T21:28:12.528 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.db_log_dir: 2024-04-26T21:28:12.528 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.wal_dir: 2024-04-26T21:28:12.528 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-26T21:28:12.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-26T21:28:12.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-26T21:28:12.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-26T21:28:12.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-26T21:28:12.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-26T21:28:12.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.advise_random_on_open: 1 2024-04-26T21:28:12.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.db_write_buffer_size: 0 2024-04-26T21:28:12.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.write_buffer_manager: 0x55b88e56f0e0 2024-04-26T21:28:12.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-26T21:28:12.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-26T21:28:12.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-26T21:28:12.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.rate_limiter: (nil) 2024-04-26T21:28:12.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-26T21:28:12.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.wal_recovery_mode: 2 2024-04-26T21:28:12.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.enable_thread_tracking: 0 2024-04-26T21:28:12.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.enable_pipelined_write: 0 2024-04-26T21:28:12.935 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.unordered_write: 0 2024-04-26T21:28:12.935 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-26T21:28:12.935 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-26T21:28:12.935 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-26T21:28:12.935 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-26T21:28:12.935 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.row_cache: None 2024-04-26T21:28:12.935 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.wal_filter: None 2024-04-26T21:28:12.935 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-26T21:28:12.935 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.allow_ingest_behind: 0 2024-04-26T21:28:12.935 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.two_write_queues: 0 2024-04-26T21:28:12.935 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.manual_wal_flush: 0 2024-04-26T21:28:12.936 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.wal_compression: 0 2024-04-26T21:28:12.936 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.atomic_flush: 0 2024-04-26T21:28:12.936 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-26T21:28:12.936 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-26T21:28:12.936 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-26T21:28:12.936 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.log_readahead_size: 0 2024-04-26T21:28:12.936 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-26T21:28:12.936 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.best_efforts_recovery: 0 2024-04-26T21:28:12.936 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-26T21:28:12.936 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-26T21:28:12.936 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.allow_data_in_errors: 0 2024-04-26T21:28:12.936 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.db_host_id: __hostname__ 2024-04-26T21:28:12.937 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-26T21:28:12.938 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_background_jobs: 2 2024-04-26T21:28:12.938 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_background_compactions: -1 2024-04-26T21:28:12.938 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_subcompactions: 1 2024-04-26T21:28:12.938 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-26T21:28:12.938 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-26T21:28:12.938 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-26T21:28:12.938 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_total_wal_size: 0 2024-04-26T21:28:12.938 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-26T21:28:12.939 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-26T21:28:12.939 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-26T21:28:12.939 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-26T21:28:12.939 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_open_files: -1 2024-04-26T21:28:12.939 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.bytes_per_sync: 0 2024-04-26T21:28:12.939 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-26T21:28:12.939 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-26T21:28:12.939 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compaction_readahead_size: 0 2024-04-26T21:28:12.939 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_background_flushes: -1 2024-04-26T21:28:12.939 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Compression algorithms supported: 2024-04-26T21:28:12.939 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-26T21:28:12.939 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: kZSTD supported: 0 2024-04-26T21:28:12.939 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: kXpressCompression supported: 0 2024-04-26T21:28:12.939 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: kLZ4HCCompression supported: 1 2024-04-26T21:28:12.940 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: kZlibCompression supported: 1 2024-04-26T21:28:12.940 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: kSnappyCompression supported: 1 2024-04-26T21:28:12.940 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: kLZ4Compression supported: 1 2024-04-26T21:28:12.940 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: kBZip2Compression supported: 0 2024-04-26T21:28:12.940 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-26T21:28:12.940 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-26T21:28:12.940 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi120/store.db/MANIFEST-000009 2024-04-26T21:28:12.940 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-26T21:28:12.940 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-26T21:28:12.940 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.merge_operator: 2024-04-26T21:28:12.940 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compaction_filter: None 2024-04-26T21:28:12.940 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compaction_filter_factory: None 2024-04-26T21:28:12.940 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.sst_partitioner_factory: None 2024-04-26T21:28:12.940 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-26T21:28:12.940 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-26T21:28:12.941 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b88e59de60) 2024-04-26T21:28:12.941 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: cache_index_and_filter_blocks: 1 2024-04-26T21:28:12.941 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-26T21:28:12.941 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-26T21:28:12.941 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: pin_top_level_index_and_filter: 1 2024-04-26T21:28:12.941 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: index_type: 0 2024-04-26T21:28:12.941 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: data_block_index_type: 0 2024-04-26T21:28:12.941 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: index_shortening: 1 2024-04-26T21:28:12.941 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-26T21:28:12.941 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: checksum: 4 2024-04-26T21:28:12.941 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: no_block_cache: 0 2024-04-26T21:28:12.941 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_cache: 0x55b88e5a11f0 2024-04-26T21:28:12.941 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_cache_name: BinnedLRUCache 2024-04-26T21:28:12.942 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_cache_options: 2024-04-26T21:28:12.942 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: capacity : 536870912 2024-04-26T21:28:12.942 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: num_shard_bits : 4 2024-04-26T21:28:12.942 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: strict_capacity_limit : 0 2024-04-26T21:28:12.942 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: high_pri_pool_ratio: 0.000 2024-04-26T21:28:12.942 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_cache_compressed: (nil) 2024-04-26T21:28:12.942 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: persistent_cache: (nil) 2024-04-26T21:28:12.942 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_size: 4096 2024-04-26T21:28:12.942 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_size_deviation: 10 2024-04-26T21:28:12.942 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_restart_interval: 16 2024-04-26T21:28:12.942 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: index_block_restart_interval: 1 2024-04-26T21:28:12.942 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: metadata_block_size: 4096 2024-04-26T21:28:12.942 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: partition_filters: 0 2024-04-26T21:28:12.943 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: use_delta_encoding: 1 2024-04-26T21:28:12.943 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: filter_policy: bloomfilter 2024-04-26T21:28:12.943 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: whole_key_filtering: 1 2024-04-26T21:28:12.943 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: verify_compression: 0 2024-04-26T21:28:12.943 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: read_amp_bytes_per_bit: 0 2024-04-26T21:28:12.943 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: format_version: 5 2024-04-26T21:28:12.943 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: enable_index_compression: 1 2024-04-26T21:28:12.943 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: block_align: 0 2024-04-26T21:28:12.943 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: max_auto_readahead_size: 262144 2024-04-26T21:28:12.943 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: prepopulate_block_cache: 0 2024-04-26T21:28:12.943 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: initial_auto_readahead_size: 8192 2024-04-26T21:28:12.943 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: num_file_reads_for_auto_readahead: 2 2024-04-26T21:28:12.943 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.write_buffer_size: 33554432 2024-04-26T21:28:12.943 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_write_buffer_number: 2 2024-04-26T21:28:12.944 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compression: NoCompression 2024-04-26T21:28:12.944 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.bottommost_compression: Disabled 2024-04-26T21:28:12.944 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.prefix_extractor: nullptr 2024-04-26T21:28:12.944 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-26T21:28:12.944 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.num_levels: 7 2024-04-26T21:28:12.944 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-26T21:28:12.944 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-26T21:28:12.944 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-26T21:28:12.944 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-26T21:28:12.944 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-26T21:28:12.944 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-26T21:28:12.944 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-26T21:28:12.944 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-26T21:28:12.944 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-26T21:28:12.944 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-26T21:28:12.945 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-26T21:28:12.945 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-26T21:28:12.945 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-26T21:28:12.945 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compression_opts.level: 32767 2024-04-26T21:28:12.945 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compression_opts.strategy: 0 2024-04-26T21:28:12.945 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-26T21:28:12.945 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-26T21:28:12.945 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-26T21:28:12.945 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-26T21:28:12.945 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compression_opts.enabled: false 2024-04-26T21:28:12.945 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-26T21:28:12.945 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-26T21:28:12.945 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-26T21:28:12.946 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-26T21:28:12.946 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.target_file_size_base: 67108864 2024-04-26T21:28:12.946 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-26T21:28:12.946 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-26T21:28:12.946 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-26T21:28:12.946 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-26T21:28:12.946 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-26T21:28:12.946 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-26T21:28:12.946 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-26T21:28:12.946 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-26T21:28:12.946 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-26T21:28:12.946 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-26T21:28:12.946 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-26T21:28:12.946 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-26T21:28:12.947 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-26T21:28:12.947 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-26T21:28:12.947 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.arena_block_size: 1048576 2024-04-26T21:28:12.947 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-26T21:28:12.947 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-26T21:28:12.947 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.disable_auto_compactions: 0 2024-04-26T21:28:12.947 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-26T21:28:12.947 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-26T21:28:12.947 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-26T21:28:12.947 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-26T21:28:12.947 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-26T21:28:12.947 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-26T21:28:12.947 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-26T21:28:12.947 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-26T21:28:12.948 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-26T21:28:12.948 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-26T21:28:12.948 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-26T21:28:12.948 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.inplace_update_support: 0 2024-04-26T21:28:12.948 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-26T21:28:12.948 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-26T21:28:12.948 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-26T21:28:12.948 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-26T21:28:12.948 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.bloom_locality: 0 2024-04-26T21:28:12.948 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.max_successive_merges: 0 2024-04-26T21:28:12.948 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-26T21:28:12.948 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.paranoid_file_checks: 0 2024-04-26T21:28:12.948 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.force_consistency_checks: 1 2024-04-26T21:28:12.948 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.report_bg_io_stats: 0 2024-04-26T21:28:12.948 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.ttl: 2592000 2024-04-26T21:28:12.949 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-26T21:28:12.949 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-26T21:28:12.949 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-26T21:28:12.949 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.enable_blob_files: false 2024-04-26T21:28:12.949 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.min_blob_size: 0 2024-04-26T21:28:12.949 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.blob_file_size: 268435456 2024-04-26T21:28:12.949 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-26T21:28:12.949 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-26T21:28:12.949 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-26T21:28:12.949 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-26T21:28:12.949 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-26T21:28:12.949 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.blob_file_starting_level: 0 2024-04-26T21:28:12.949 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-26T21:28:12.949 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-04-26T21:28:12.949 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-26T21:28:12.950 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi120/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 11878, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-26T21:28:12.950 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-04-26T21:28:12.950 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0db40225-7687-4c60-8e91-8c774fd84657 2024-04-26T21:28:12.950 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714166892517193, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-04-26T21:28:12.950 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-04-26T21:28:12.950 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714166892543632, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 4075212, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11883, "largest_seqno": 13867, "table_properties": {"data_size": 4066376, "index_size": 5806, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1989, "raw_key_size": 17881, "raw_average_key_size": 22, "raw_value_size": 4049140, "raw_average_value_size": 5145, "num_data_blocks": 264, "num_entries": 787, "num_filter_entries": 787, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714166892, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0db40225-7687-4c60-8e91-8c774fd84657", "db_session_id": "PQDVMZU5BI6NP4WHKBXV", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-04-26T21:28:12.950 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714166892543764, "job": 1, "event": "recovery_finished"} 2024-04-26T21:28:12.950 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-04-26T21:28:12.950 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-26T21:28:12.950 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi120/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-26T21:28:12.950 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55b88e6be000 2024-04-26T21:28:12.950 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: DB pointer 0x55b88e6a8000 2024-04-26T21:28:12.950 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-26T21:28:12.950 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-26T21:28:12.951 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** DB Stats ** 2024-04-26T21:28:12.951 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T21:28:12.951 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-26T21:28:12.951 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T21:28:12.951 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T21:28:12.951 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-26T21:28:12.951 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T21:28:12.951 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T21:28:12.951 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-04-26T21:28:12.951 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** Compaction Stats [default] ** 2024-04-26T21:28:12.951 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T21:28:12.951 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-26T21:28:12.951 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: L0 1/0 3.89 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 442.5 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-04-26T21:28:12.951 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: L6 1/0 5.46 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-26T21:28:12.951 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Sum 2/0 9.34 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 442.5 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-04-26T21:28:12.951 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 442.5 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-04-26T21:28:12.952 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-04-26T21:28:12.952 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** Compaction Stats [default] ** 2024-04-26T21:28:12.952 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T21:28:12.952 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T21:28:12.952 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 442.5 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-04-26T21:28:12.952 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-04-26T21:28:12.952 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-26T21:28:12.952 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-04-26T21:28:12.952 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T21:28:12.952 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-04-26T21:28:12.952 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-26T21:28:12.952 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-26T21:28:12.952 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-26T21:28:12.952 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-26T21:28:12.952 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Cumulative compaction: 0.00 GB write, 121.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T21:28:12.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Interval compaction: 0.00 GB write, 121.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T21:28:12.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-26T21:28:12.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Block cache BinnedLRUCache@0x55b88e5a11f0#2 capacity: 512.00 MB usage: 8.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.4e-05 secs_since: 0 2024-04-26T21:28:12.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-04-26T21:28:12.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-04-26T21:28:12.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-26T21:28:12.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: starting mon.smithi120 rank 1 at public addrs [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] at bind addrs [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi120 fsid 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:28:12.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: mon.smithi120@-1(???) e2 preinit fsid 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:28:12.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: mon.smithi120@-1(???).mds e15 new map 2024-04-26T21:28:12.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: mon.smithi120@-1(???).mds e15 print_map 2024-04-26T21:28:12.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: e15 2024-04-26T21:28:12.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:28:12.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:28:12.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: legacy client fscid: 1 2024-04-26T21:28:12.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-04-26T21:28:12.954 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Filesystem 'cephfs' (1) 2024-04-26T21:28:12.954 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: fs_name cephfs 2024-04-26T21:28:12.954 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: epoch 15 2024-04-26T21:28:12.954 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:28:12.954 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:28:12.954 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: modified 2024-04-26T21:27:24.731661+0000 2024-04-26T21:28:12.954 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: tableserver 0 2024-04-26T21:28:12.954 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: root 0 2024-04-26T21:28:12.954 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: session_timeout 60 2024-04-26T21:28:12.954 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: session_autoclose 300 2024-04-26T21:28:12.954 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: max_file_size 1099511627776 2024-04-26T21:28:12.954 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: max_xattr_size 65536 2024-04-26T21:28:12.954 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: required_client_features {} 2024-04-26T21:28:12.955 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: last_failure 0 2024-04-26T21:28:12.955 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: last_failure_osd_epoch 0 2024-04-26T21:28:12.955 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:28:12.955 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: max_mds 2 2024-04-26T21:28:12.955 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: in 0,1 2024-04-26T21:28:12.955 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: up {0=14456,1=24231} 2024-04-26T21:28:12.955 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: failed 2024-04-26T21:28:12.955 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: damaged 2024-04-26T21:28:12.955 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: stopped 2024-04-26T21:28:12.955 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: data_pools [3] 2024-04-26T21:28:12.955 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: metadata_pool 2 2024-04-26T21:28:12.955 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: inline_data enabled 2024-04-26T21:28:12.955 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: balancer 2024-04-26T21:28:12.956 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: bal_rank_mask -1 2024-04-26T21:28:12.956 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: standby_count_wanted 1 2024-04-26T21:28:12.956 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: qdb_cluster leader: 0 members: 2024-04-26T21:28:12.956 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: [mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:28:12.956 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: [mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:28:12.956 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-04-26T21:28:12.956 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-04-26T21:28:12.956 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: Standby daemons: 2024-04-26T21:28:12.956 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: 2024-04-26T21:28:12.956 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: [mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:28:12.957 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout: [mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:28:12.957 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: mon.smithi120@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-26T21:28:12.957 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: mon.smithi120@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-26T21:28:12.957 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: mon.smithi120@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-26T21:28:12.957 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: mon.smithi120@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-26T21:28:12.957 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 ceph-mon[79001]: mon.smithi120@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-04-26T21:28:12.957 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 bash[78983]: 5d530496253b9463e83a1106d7a23f1165df69eed82cdae1b78f6a0762fe785e 2024-04-26T21:28:12.957 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:12 smithi120 systemd[1]: Started Ceph mon.smithi120 for 8bb44d26-0411-11ef-bc93-c7b262605968. 2024-04-26T21:28:13.548 DEBUG:teuthology.parallel:result is None 2024-04-26T21:28:13.549 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T21:28:13.624 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T21:28:13.624 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-04-26T21:28:13.708 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-04-26T21:28:13.709 DEBUG:teuthology.parallel:result is None 2024-04-26T21:28:13.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-04-26T21:28:13.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:28:13.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: mon.smithi084 calling monitor election 2024-04-26T21:28:13.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: mon.smithi120 calling monitor election 2024-04-26T21:28:13.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: mon.smithi084 is new leader, mons smithi084,smithi120 in quorum (ranks 0,1) 2024-04-26T21:28:13.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: monmap epoch 3 2024-04-26T21:28:13.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: fsid 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:28:13.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: last_changed 2024-04-26T21:28:12.822436+0000 2024-04-26T21:28:13.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: created 2024-04-26T21:12:25.273724+0000 2024-04-26T21:28:13.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: min_mon_release 19 (squid) 2024-04-26T21:28:13.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: election_strategy: 1 2024-04-26T21:28:13.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.smithi084 2024-04-26T21:28:13.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: 1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.smithi120 2024-04-26T21:28:13.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:28:13.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: osdmap e48: 6 total, 6 up, 6 in 2024-04-26T21:28:13.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: mgrmap e38: smithi084.gyasul(active, since 29s), standbys: smithi120.zjaduj 2024-04-26T21:28:13.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:28:13.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:28:13.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:28:13.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:13.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:13.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:28:13.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:13 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:28:14.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-04-26T21:28:14.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mon metadata", "id": "smithi120"}]: dispatch 2024-04-26T21:28:14.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: mon.smithi084 calling monitor election 2024-04-26T21:28:14.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: mon.smithi120 calling monitor election 2024-04-26T21:28:14.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: mon.smithi084 is new leader, mons smithi084,smithi120 in quorum (ranks 0,1) 2024-04-26T21:28:14.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: monmap epoch 3 2024-04-26T21:28:14.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: fsid 8bb44d26-0411-11ef-bc93-c7b262605968 2024-04-26T21:28:14.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: last_changed 2024-04-26T21:28:12.822436+0000 2024-04-26T21:28:14.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: created 2024-04-26T21:12:25.273724+0000 2024-04-26T21:28:14.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: min_mon_release 19 (squid) 2024-04-26T21:28:14.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: election_strategy: 1 2024-04-26T21:28:14.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.smithi084 2024-04-26T21:28:14.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: 1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.smithi120 2024-04-26T21:28:14.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:28:14.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: osdmap e48: 6 total, 6 up, 6 in 2024-04-26T21:28:14.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: mgrmap e38: smithi084.gyasul(active, since 29s), standbys: smithi120.zjaduj 2024-04-26T21:28:14.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:28:14.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:28:14.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:28:14.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:14.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:14.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:28:14.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:13 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:28:15.160 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:14 smithi120 ceph-mon[79001]: pgmap v18: 65 pgs: 65 active+clean; 313 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 678 KiB/s wr, 134 op/s 2024-04-26T21:28:15.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:14 smithi084 ceph-mon[90138]: pgmap v18: 65 pgs: 65 active+clean; 313 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 678 KiB/s wr, 134 op/s 2024-04-26T21:28:17.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:16 smithi084 ceph-mon[90138]: pgmap v19: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 853 KiB/s wr, 164 op/s 2024-04-26T21:28:17.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:16 smithi120 ceph-mon[79001]: pgmap v19: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 853 KiB/s wr, 164 op/s 2024-04-26T21:28:18.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.396+0000 7f2f86e00700 1 -- 172.21.15.84:0/1546678682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f801046a0 msgr2=0x7f2f80104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:18.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.396+0000 7f2f86e00700 1 --2- 172.21.15.84:0/1546678682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f801046a0 0x7f2f80104b10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c004940 tx=0x7f2f6c009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:18.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.397+0000 7f2f86e00700 1 -- 172.21.15.84:0/1546678682 shutdown_connections 2024-04-26T21:28:18.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.397+0000 7f2f86e00700 1 --2- 172.21.15.84:0/1546678682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f801046a0 0x7f2f80104b10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:18.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.397+0000 7f2f86e00700 1 --2- 172.21.15.84:0/1546678682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f801033f0 0x7f2f80103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:18.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.397+0000 7f2f86e00700 1 -- 172.21.15.84:0/1546678682 >> 172.21.15.84:0/1546678682 conn(0x7f2f800725e0 msgr2=0x7f2f80074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:18.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.397+0000 7f2f86e00700 1 -- 172.21.15.84:0/1546678682 shutdown_connections 2024-04-26T21:28:18.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.397+0000 7f2f86e00700 1 -- 172.21.15.84:0/1546678682 wait complete. 2024-04-26T21:28:18.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.398+0000 7f2f86e00700 1 Processor -- start 2024-04-26T21:28:18.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.398+0000 7f2f86e00700 1 -- start start 2024-04-26T21:28:18.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.398+0000 7f2f86e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f801033f0 0x7f2f80113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:18.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.398+0000 7f2f86e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f801046a0 0x7f2f80114470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:18.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.398+0000 7f2f86e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f80114a70 con 0x7f2f801046a0 2024-04-26T21:28:18.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.398+0000 7f2f86e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f80114be0 con 0x7f2f801033f0 2024-04-26T21:28:18.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.399+0000 7f2f7f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f801046a0 0x7f2f80114470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:18.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.399+0000 7f2f7fe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f801033f0 0x7f2f80113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:18.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.399+0000 7f2f7fe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f801033f0 0x7f2f80113f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.84:42756/0 (socket says 172.21.15.84:42756) 2024-04-26T21:28:18.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.399+0000 7f2f7f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f801046a0 0x7f2f80114470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36874/0 (socket says 172.21.15.84:36874) 2024-04-26T21:28:18.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.399+0000 7f2f7fe00700 1 -- 172.21.15.84:0/47094648 learned_addr learned my addr 172.21.15.84:0/47094648 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:28:18.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.399+0000 7f2f7f400700 1 -- 172.21.15.84:0/47094648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f801033f0 msgr2=0x7f2f80113f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:18.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.399+0000 7f2f7f400700 1 --2- 172.21.15.84:0/47094648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f801033f0 0x7f2f80113f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:18.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.399+0000 7f2f7f400700 1 -- 172.21.15.84:0/47094648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c005040 con 0x7f2f801046a0 2024-04-26T21:28:18.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.399+0000 7f2f7f400700 1 --2- 172.21.15.84:0/47094648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f801046a0 0x7f2f80114470 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c00b970 tx=0x7f2f6c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:18.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.400+0000 7f2f77e00700 1 -- 172.21.15.84:0/47094648 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f6c00e040 con 0x7f2f801046a0 2024-04-26T21:28:18.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.400+0000 7f2f77e00700 1 -- 172.21.15.84:0/47094648 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f6c004290 con 0x7f2f801046a0 2024-04-26T21:28:18.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.400+0000 7f2f86e00700 1 -- 172.21.15.84:0/47094648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f801195e0 con 0x7f2f801046a0 2024-04-26T21:28:18.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.400+0000 7f2f86e00700 1 -- 172.21.15.84:0/47094648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f80119ba0 con 0x7f2f801046a0 2024-04-26T21:28:18.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.400+0000 7f2f77e00700 1 -- 172.21.15.84:0/47094648 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f6c01c3f0 con 0x7f2f801046a0 2024-04-26T21:28:18.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.401+0000 7f2f86e00700 1 -- 172.21.15.84:0/47094648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f600052e0 con 0x7f2f801046a0 2024-04-26T21:28:18.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.402+0000 7f2f77e00700 1 -- 172.21.15.84:0/47094648 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f2f6c00bbf0 con 0x7f2f801046a0 2024-04-26T21:28:18.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.403+0000 7f2f77e00700 1 --2- 172.21.15.84:0/47094648 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2f6406ed30 0x7f2f640711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:18.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.403+0000 7f2f77e00700 1 -- 172.21.15.84:0/47094648 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f2f6c08fcb0 con 0x7f2f801046a0 2024-04-26T21:28:18.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.404+0000 7f2f7fe00700 1 --2- 172.21.15.84:0/47094648 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2f6406ed30 0x7f2f640711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:18.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.404+0000 7f2f7fe00700 1 --2- 172.21.15.84:0/47094648 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2f6406ed30 0x7f2f640711e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2f700041d0 tx=0x7f2f7000b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:18.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.409+0000 7f2f77e00700 1 -- 172.21.15.84:0/47094648 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f2f6c05c3f0 con 0x7f2f801046a0 2024-04-26T21:28:18.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.657+0000 7f2f86e00700 1 -- 172.21.15.84:0/47094648 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f600052e0 con 0x7f2f6406ed30 2024-04-26T21:28:18.659 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:18 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:18.659 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:18 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:18.659 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:18 smithi084 ceph-mon[90138]: pgmap v20: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 14 KiB/s rd, 381 KiB/s wr, 78 op/s 2024-04-26T21:28:18.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.666+0000 7f2f77e00700 1 -- 172.21.15.84:0/47094648 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f2f600052e0 con 0x7f2f6406ed30 2024-04-26T21:28:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.670+0000 7f2f86e00700 1 -- 172.21.15.84:0/47094648 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2f6406ed30 msgr2=0x7f2f640711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.670+0000 7f2f86e00700 1 --2- 172.21.15.84:0/47094648 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2f6406ed30 0x7f2f640711e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2f700041d0 tx=0x7f2f7000b040 comp rx=0 tx=0).stop 2024-04-26T21:28:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.670+0000 7f2f86e00700 1 -- 172.21.15.84:0/47094648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f801046a0 msgr2=0x7f2f80114470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.670+0000 7f2f86e00700 1 --2- 172.21.15.84:0/47094648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f801046a0 0x7f2f80114470 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c00b970 tx=0x7f2f6c009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.670+0000 7f2f86e00700 1 -- 172.21.15.84:0/47094648 shutdown_connections 2024-04-26T21:28:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.670+0000 7f2f86e00700 1 --2- 172.21.15.84:0/47094648 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2f6406ed30 0x7f2f640711e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.670+0000 7f2f86e00700 1 --2- 172.21.15.84:0/47094648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f801033f0 0x7f2f80113f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.671+0000 7f2f86e00700 1 --2- 172.21.15.84:0/47094648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f801046a0 0x7f2f80114470 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.671+0000 7f2f86e00700 1 -- 172.21.15.84:0/47094648 >> 172.21.15.84:0/47094648 conn(0x7f2f800725e0 msgr2=0x7f2f80073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:18.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.671+0000 7f2f86e00700 1 -- 172.21.15.84:0/47094648 shutdown_connections 2024-04-26T21:28:18.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.671+0000 7f2f86e00700 1 -- 172.21.15.84:0/47094648 wait complete. 2024-04-26T21:28:18.687 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:28:18.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.829+0000 7f753d800700 1 -- 172.21.15.84:0/3306399782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75380fe080 msgr2=0x7f75380fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:18.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.829+0000 7f753d800700 1 --2- 172.21.15.84:0/3306399782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75380fe080 0x7f75380fe4f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7520004940 tx=0x7f7520009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:18.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.829+0000 7f753d800700 1 -- 172.21.15.84:0/3306399782 shutdown_connections 2024-04-26T21:28:18.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.829+0000 7f753d800700 1 --2- 172.21.15.84:0/3306399782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75380fe080 0x7f75380fe4f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:18.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.829+0000 7f753d800700 1 --2- 172.21.15.84:0/3306399782 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75380fcf10 0x7f75380fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:18.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.829+0000 7f753d800700 1 -- 172.21.15.84:0/3306399782 >> 172.21.15.84:0/3306399782 conn(0x7f75380f8560 msgr2=0x7f75380fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:18.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.829+0000 7f753d800700 1 -- 172.21.15.84:0/3306399782 shutdown_connections 2024-04-26T21:28:18.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.829+0000 7f753d800700 1 -- 172.21.15.84:0/3306399782 wait complete. 2024-04-26T21:28:18.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.830+0000 7f753d800700 1 Processor -- start 2024-04-26T21:28:18.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.830+0000 7f753d800700 1 -- start start 2024-04-26T21:28:18.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.831+0000 7f753d800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75380fcf10 0x7f753810d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:18.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.831+0000 7f753d800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75380fe080 0x7f753810def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:18.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.831+0000 7f753d800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753810e4f0 con 0x7f75380fe080 2024-04-26T21:28:18.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.831+0000 7f753d800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753810ecf0 con 0x7f75380fcf10 2024-04-26T21:28:18.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.831+0000 7f752e000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75380fe080 0x7f753810def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:18.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.831+0000 7f7536a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75380fcf10 0x7f753810d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:18.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.831+0000 7f752e000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75380fe080 0x7f753810def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36888/0 (socket says 172.21.15.84:36888) 2024-04-26T21:28:18.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.831+0000 7f752e000700 1 -- 172.21.15.84:0/1157182414 learned_addr learned my addr 172.21.15.84:0/1157182414 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:28:18.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.832+0000 7f752e000700 1 -- 172.21.15.84:0/1157182414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75380fcf10 msgr2=0x7f753810d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:18.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.832+0000 7f752e000700 1 --2- 172.21.15.84:0/1157182414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75380fcf10 0x7f753810d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:18.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.832+0000 7f752e000700 1 -- 172.21.15.84:0/1157182414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7520005040 con 0x7f75380fe080 2024-04-26T21:28:18.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.832+0000 7f752e000700 1 --2- 172.21.15.84:0/1157182414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75380fe080 0x7f753810def0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f752000b0d0 tx=0x7f7520009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:18.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.832+0000 7f752f400700 1 -- 172.21.15.84:0/1157182414 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f752000e070 con 0x7f75380fe080 2024-04-26T21:28:18.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.832+0000 7f752f400700 1 -- 172.21.15.84:0/1157182414 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f752000b410 con 0x7f75380fe080 2024-04-26T21:28:18.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.832+0000 7f753d800700 1 -- 172.21.15.84:0/1157182414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753810ef70 con 0x7f75380fe080 2024-04-26T21:28:18.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.832+0000 7f752f400700 1 -- 172.21.15.84:0/1157182414 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75200125e0 con 0x7f75380fe080 2024-04-26T21:28:18.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.833+0000 7f753d800700 1 -- 172.21.15.84:0/1157182414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753810f4b0 con 0x7f75380fe080 2024-04-26T21:28:18.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.834+0000 7f753d800700 1 -- 172.21.15.84:0/1157182414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753805f5c0 con 0x7f75380fe080 2024-04-26T21:28:18.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.835+0000 7f752f400700 1 -- 172.21.15.84:0/1157182414 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f752000b580 con 0x7f75380fe080 2024-04-26T21:28:18.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.835+0000 7f752f400700 1 --2- 172.21.15.84:0/1157182414 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f751c06ed20 0x7f751c0711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:18.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.836+0000 7f752f400700 1 -- 172.21.15.84:0/1157182414 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f752008f730 con 0x7f75380fe080 2024-04-26T21:28:18.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.836+0000 7f7536a00700 1 --2- 172.21.15.84:0/1157182414 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f751c06ed20 0x7f751c0711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:18.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.836+0000 7f7536a00700 1 --2- 172.21.15.84:0/1157182414 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f751c06ed20 0x7f751c0711d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7528009b80 tx=0x7f752800b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:18.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:18.841+0000 7f752f400700 1 -- 172.21.15.84:0/1157182414 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f752005bef0 con 0x7f75380fe080 2024-04-26T21:28:18.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:18 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:18.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:18 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:18.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:18 smithi120 ceph-mon[79001]: pgmap v20: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 14 KiB/s rd, 381 KiB/s wr, 78 op/s 2024-04-26T21:28:19.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.095+0000 7f753d800700 1 -- 172.21.15.84:0/1157182414 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f753810f7e0 con 0x7f751c06ed20 2024-04-26T21:28:19.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.098+0000 7f752f400700 1 -- 172.21.15.84:0/1157182414 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f753810f7e0 con 0x7f751c06ed20 2024-04-26T21:28:19.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.101+0000 7f753d800700 1 -- 172.21.15.84:0/1157182414 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f751c06ed20 msgr2=0x7f751c0711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:19.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.101+0000 7f753d800700 1 --2- 172.21.15.84:0/1157182414 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f751c06ed20 0x7f751c0711d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7528009b80 tx=0x7f752800b040 comp rx=0 tx=0).stop 2024-04-26T21:28:19.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.101+0000 7f753d800700 1 -- 172.21.15.84:0/1157182414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75380fe080 msgr2=0x7f753810def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:19.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.101+0000 7f753d800700 1 --2- 172.21.15.84:0/1157182414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75380fe080 0x7f753810def0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f752000b0d0 tx=0x7f7520009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:19.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.101+0000 7f753d800700 1 -- 172.21.15.84:0/1157182414 shutdown_connections 2024-04-26T21:28:19.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.101+0000 7f753d800700 1 --2- 172.21.15.84:0/1157182414 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f751c06ed20 0x7f751c0711d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:19.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.101+0000 7f753d800700 1 --2- 172.21.15.84:0/1157182414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75380fcf10 0x7f753810d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:19.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.101+0000 7f753d800700 1 --2- 172.21.15.84:0/1157182414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75380fe080 0x7f753810def0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:19.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.101+0000 7f753d800700 1 -- 172.21.15.84:0/1157182414 >> 172.21.15.84:0/1157182414 conn(0x7f75380f8560 msgr2=0x7f75380f9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:19.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.102+0000 7f753d800700 1 -- 172.21.15.84:0/1157182414 shutdown_connections 2024-04-26T21:28:19.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.102+0000 7f753d800700 1 -- 172.21.15.84:0/1157182414 wait complete. 2024-04-26T21:28:19.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.256+0000 7fe02be00700 1 -- 172.21.15.84:0/2916700079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe02c100080 msgr2=0x7fe02c1004f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:19.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.256+0000 7fe02be00700 1 --2- 172.21.15.84:0/2916700079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe02c100080 0x7fe02c1004f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe018004940 tx=0x7fe018009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:19.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.256+0000 7fe02be00700 1 -- 172.21.15.84:0/2916700079 shutdown_connections 2024-04-26T21:28:19.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.256+0000 7fe02be00700 1 --2- 172.21.15.84:0/2916700079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe02c100080 0x7fe02c1004f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:19.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.256+0000 7fe02be00700 1 --2- 172.21.15.84:0/2916700079 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe02c0fee80 0x7fe02c0ff290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:19.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.256+0000 7fe02be00700 1 -- 172.21.15.84:0/2916700079 >> 172.21.15.84:0/2916700079 conn(0x7fe02c0fa730 msgr2=0x7fe02c0fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:19.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.257+0000 7fe02be00700 1 -- 172.21.15.84:0/2916700079 shutdown_connections 2024-04-26T21:28:19.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.257+0000 7fe02be00700 1 -- 172.21.15.84:0/2916700079 wait complete. 2024-04-26T21:28:19.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.257+0000 7fe02be00700 1 Processor -- start 2024-04-26T21:28:19.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.258+0000 7fe02be00700 1 -- start start 2024-04-26T21:28:19.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.258+0000 7fe02be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe02c0fee80 0x7fe02c10f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:19.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.258+0000 7fe02be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe02c100080 0x7fe02c10ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:19.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.258+0000 7fe02be00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c110520 con 0x7fe02c0fee80 2024-04-26T21:28:19.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.258+0000 7fe02be00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c110d70 con 0x7fe02c100080 2024-04-26T21:28:19.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.258+0000 7fe02aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe02c0fee80 0x7fe02c10f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:19.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.258+0000 7fe02aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe02c0fee80 0x7fe02c10f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36898/0 (socket says 172.21.15.84:36898) 2024-04-26T21:28:19.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.258+0000 7fe02aa00700 1 -- 172.21.15.84:0/870679924 learned_addr learned my addr 172.21.15.84:0/870679924 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:28:19.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.259+0000 7fe02a000700 1 --2- 172.21.15.84:0/870679924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe02c100080 0x7fe02c10ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:19.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.259+0000 7fe02aa00700 1 -- 172.21.15.84:0/870679924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe02c100080 msgr2=0x7fe02c10ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:19.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.259+0000 7fe02aa00700 1 --2- 172.21.15.84:0/870679924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe02c100080 0x7fe02c10ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:19.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.259+0000 7fe02aa00700 1 -- 172.21.15.84:0/870679924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe018005040 con 0x7fe02c0fee80 2024-04-26T21:28:19.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.259+0000 7fe02a000700 1 --2- 172.21.15.84:0/870679924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe02c100080 0x7fe02c10ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:28:19.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.259+0000 7fe02aa00700 1 --2- 172.21.15.84:0/870679924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe02c0fee80 0x7fe02c10f9e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00eb70 tx=0x7fe01c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:19.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.259+0000 7fe022a00700 1 -- 172.21.15.84:0/870679924 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe01c007cc0 con 0x7fe02c0fee80 2024-04-26T21:28:19.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.260+0000 7fe022a00700 1 -- 172.21.15.84:0/870679924 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe01c00f040 con 0x7fe02c0fee80 2024-04-26T21:28:19.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.260+0000 7fe022a00700 1 -- 172.21.15.84:0/870679924 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe01c00cbd0 con 0x7fe02c0fee80 2024-04-26T21:28:19.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.260+0000 7fe02be00700 1 -- 172.21.15.84:0/870679924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe02c110ff0 con 0x7fe02c0fee80 2024-04-26T21:28:19.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.260+0000 7fe02be00700 1 -- 172.21.15.84:0/870679924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe02c111530 con 0x7fe02c0fee80 2024-04-26T21:28:19.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.261+0000 7fe02be00700 1 -- 172.21.15.84:0/870679924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02c0fe230 con 0x7fe02c0fee80 2024-04-26T21:28:19.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.262+0000 7fe022a00700 1 -- 172.21.15.84:0/870679924 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fe01c00cd30 con 0x7fe02c0fee80 2024-04-26T21:28:19.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.263+0000 7fe022a00700 1 --2- 172.21.15.84:0/870679924 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe01006ed30 0x7fe0100711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:19.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.263+0000 7fe022a00700 1 -- 172.21.15.84:0/870679924 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe01c08e520 con 0x7fe02c0fee80 2024-04-26T21:28:19.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.263+0000 7fe02a000700 1 --2- 172.21.15.84:0/870679924 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe01006ed30 0x7fe0100711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:19.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.264+0000 7fe02a000700 1 --2- 172.21.15.84:0/870679924 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe01006ed30 0x7fe0100711e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe018000c00 tx=0x7fe018009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:19.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.268+0000 7fe022a00700 1 -- 172.21.15.84:0/870679924 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fe01c05ad10 con 0x7fe02c0fee80 2024-04-26T21:28:19.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.492+0000 7fe02be00700 1 -- 172.21.15.84:0/870679924 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe02c111860 con 0x7fe01006ed30 2024-04-26T21:28:19.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.504+0000 7fe022a00700 1 -- 172.21.15.84:0/870679924 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe02c111860 con 0x7fe01006ed30 2024-04-26T21:28:19.506 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:28:19.506 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (3m) 23s ago 13m 16.1M - 0.25.0 c8568f914cd2 bcb419cf9108 2024-04-26T21:28:19.506 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (14m) 23s ago 14m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 a111b0ee8187 2024-04-26T21:28:19.506 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (12m) 2s ago 12m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 66f4d21263a1 2024-04-26T21:28:19.506 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (3m) 23s ago 13m 76.3M - 9.4.7 954c08fa6188 1bf95f604e07 2024-04-26T21:28:19.506 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (7m) 23s ago 7m 130M - 17.2.7-907-g2be3efa9 1c5834633715 485d7884e1d5 2024-04-26T21:28:19.507 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (6m) 23s ago 6m 13.3M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:28:19.507 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (6m) 2s ago 6m 118M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:28:19.507 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (6m) 2s ago 6m 13.5M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:28:19.507 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (2m) 23s ago 15m 479M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:28:19.507 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283,8765 running (74s) 2s ago 12m 450M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d6ae0b4628b5 2024-04-26T21:28:19.507 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (48s) 23s ago 15m 30.4M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 bf610abb6a62 2024-04-26T21:28:19.507 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (7s) 2s ago 12m 23.6M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 5d530496253b 2024-04-26T21:28:19.507 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (3m) 23s ago 14m 7780k - 1.5.0 0da6a335fe13 81e00b40bfbf 2024-04-26T21:28:19.507 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (2m) 2s ago 12m 7453k - 1.5.0 0da6a335fe13 0506a1d46ec4 2024-04-26T21:28:19.507 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (11m) 23s ago 11m 193M 1557M 17.2.7-907-g2be3efa9 1c5834633715 3a2e74d7e51a 2024-04-26T21:28:19.507 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (11m) 23s ago 11m 198M 1557M 17.2.7-907-g2be3efa9 1c5834633715 d283a0a93213 2024-04-26T21:28:19.507 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (10m) 23s ago 10m 156M 1557M 17.2.7-907-g2be3efa9 1c5834633715 5899468fc5c8 2024-04-26T21:28:19.507 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (9m) 2s ago 9m 229M 2581M 17.2.7-907-g2be3efa9 1c5834633715 b8a14c87d730 2024-04-26T21:28:19.507 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (9m) 2s ago 9m 216M 2581M 17.2.7-907-g2be3efa9 1c5834633715 4d294df735a3 2024-04-26T21:28:19.507 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (8m) 2s ago 8m 200M 2581M 17.2.7-907-g2be3efa9 1c5834633715 9b60997971a8 2024-04-26T21:28:19.508 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (83s) 23s ago 13m 45.5M - 2.43.0 a07b618ecd1d d3008b765eec 2024-04-26T21:28:19.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.507+0000 7fe02be00700 1 -- 172.21.15.84:0/870679924 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe01006ed30 msgr2=0x7fe0100711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:19.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.507+0000 7fe02be00700 1 --2- 172.21.15.84:0/870679924 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe01006ed30 0x7fe0100711e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe018000c00 tx=0x7fe018009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:19.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.507+0000 7fe02be00700 1 -- 172.21.15.84:0/870679924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe02c0fee80 msgr2=0x7fe02c10f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:19.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.507+0000 7fe02be00700 1 --2- 172.21.15.84:0/870679924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe02c0fee80 0x7fe02c10f9e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00eb70 tx=0x7fe01c00b040 comp rx=0 tx=0).stop 2024-04-26T21:28:19.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.507+0000 7fe02be00700 1 -- 172.21.15.84:0/870679924 shutdown_connections 2024-04-26T21:28:19.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.507+0000 7fe02be00700 1 --2- 172.21.15.84:0/870679924 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe01006ed30 0x7fe0100711e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:19.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.507+0000 7fe02be00700 1 --2- 172.21.15.84:0/870679924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe02c0fee80 0x7fe02c10f9e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:19.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.507+0000 7fe02be00700 1 --2- 172.21.15.84:0/870679924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe02c100080 0x7fe02c10ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:19.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.507+0000 7fe02be00700 1 -- 172.21.15.84:0/870679924 >> 172.21.15.84:0/870679924 conn(0x7fe02c0fa730 msgr2=0x7fe02c0fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:19.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.508+0000 7fe02be00700 1 -- 172.21.15.84:0/870679924 shutdown_connections 2024-04-26T21:28:19.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.508+0000 7fe02be00700 1 -- 172.21.15.84:0/870679924 wait complete. 2024-04-26T21:28:19.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.660+0000 7f15eb200700 1 -- 172.21.15.84:0/3295430348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15ec0fdeb0 msgr2=0x7f15ec0fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:19.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.660+0000 7f15eb200700 1 --2- 172.21.15.84:0/3295430348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15ec0fdeb0 0x7f15ec0fe320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f15d4004940 tx=0x7f15d4009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:19.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.660+0000 7f15eb200700 1 -- 172.21.15.84:0/3295430348 shutdown_connections 2024-04-26T21:28:19.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.660+0000 7f15eb200700 1 --2- 172.21.15.84:0/3295430348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15ec0fdeb0 0x7f15ec0fe320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:19.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.660+0000 7f15eb200700 1 --2- 172.21.15.84:0/3295430348 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15ec0fcc00 0x7f15ec0fd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:19.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.660+0000 7f15eb200700 1 -- 172.21.15.84:0/3295430348 >> 172.21.15.84:0/3295430348 conn(0x7f15ec0f8340 msgr2=0x7f15ec0fa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:19.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.660+0000 7f15eb200700 1 -- 172.21.15.84:0/3295430348 shutdown_connections 2024-04-26T21:28:19.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.660+0000 7f15eb200700 1 -- 172.21.15.84:0/3295430348 wait complete. 2024-04-26T21:28:19.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.661+0000 7f15eb200700 1 Processor -- start 2024-04-26T21:28:19.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.661+0000 7f15eb200700 1 -- start start 2024-04-26T21:28:19.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.661+0000 7f15eb200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15ec0fcc00 0x7f15ec10fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:19.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.661+0000 7f15eb200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15ec0fdeb0 0x7f15ec10ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:19.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.661+0000 7f15eb200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec110570 con 0x7f15ec0fcc00 2024-04-26T21:28:19.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.661+0000 7f15eb200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec110dc0 con 0x7f15ec0fdeb0 2024-04-26T21:28:19.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.662+0000 7f15e9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15ec0fcc00 0x7f15ec10fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:19.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.662+0000 7f15e9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15ec0fcc00 0x7f15ec10fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36902/0 (socket says 172.21.15.84:36902) 2024-04-26T21:28:19.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.662+0000 7f15e9e00700 1 -- 172.21.15.84:0/1562817959 learned_addr learned my addr 172.21.15.84:0/1562817959 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:28:19.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.662+0000 7f15e9400700 1 --2- 172.21.15.84:0/1562817959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15ec0fdeb0 0x7f15ec10ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:19.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.662+0000 7f15e9e00700 1 -- 172.21.15.84:0/1562817959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15ec0fdeb0 msgr2=0x7f15ec10ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:19.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.662+0000 7f15e9e00700 1 --2- 172.21.15.84:0/1562817959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15ec0fdeb0 0x7f15ec10ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:19.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.662+0000 7f15e9e00700 1 -- 172.21.15.84:0/1562817959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d4005040 con 0x7f15ec0fcc00 2024-04-26T21:28:19.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.663+0000 7f15e9e00700 1 --2- 172.21.15.84:0/1562817959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15ec0fcc00 0x7f15ec10fa30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f15dc002a50 tx=0x7f15dc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:19.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.663+0000 7f15e2000700 1 -- 172.21.15.84:0/1562817959 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15dc007cc0 con 0x7f15ec0fcc00 2024-04-26T21:28:19.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.663+0000 7f15e2000700 1 -- 172.21.15.84:0/1562817959 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f15dc00f040 con 0x7f15ec0fcc00 2024-04-26T21:28:19.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.663+0000 7f15e2000700 1 -- 172.21.15.84:0/1562817959 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15dc00da30 con 0x7f15ec0fcc00 2024-04-26T21:28:19.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.663+0000 7f15eb200700 1 -- 172.21.15.84:0/1562817959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ec1110a0 con 0x7f15ec0fcc00 2024-04-26T21:28:19.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.663+0000 7f15eb200700 1 -- 172.21.15.84:0/1562817959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ec1115e0 con 0x7f15ec0fcc00 2024-04-26T21:28:19.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.664+0000 7f15eb200700 1 -- 172.21.15.84:0/1562817959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ec101840 con 0x7f15ec0fcc00 2024-04-26T21:28:19.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.665+0000 7f15e2000700 1 -- 172.21.15.84:0/1562817959 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f15dc00db90 con 0x7f15ec0fcc00 2024-04-26T21:28:19.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.666+0000 7f15e2000700 1 --2- 172.21.15.84:0/1562817959 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f15d006ed30 0x7f15d00711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:19.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.666+0000 7f15e2000700 1 -- 172.21.15.84:0/1562817959 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f15dc08ee80 con 0x7f15ec0fcc00 2024-04-26T21:28:19.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.667+0000 7f15e9400700 1 --2- 172.21.15.84:0/1562817959 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f15d006ed30 0x7f15d00711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:19.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.667+0000 7f15e9400700 1 --2- 172.21.15.84:0/1562817959 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f15d006ed30 0x7f15d00711e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009fd0 tx=0x7f15d4009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:19.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.670+0000 7f15e2000700 1 -- 172.21.15.84:0/1562817959 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f15dc05b640 con 0x7f15ec0fcc00 2024-04-26T21:28:19.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:19 smithi084 ceph-mon[90138]: from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:28:19.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:19 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:19.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:19 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:19.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:19 smithi120 ceph-mon[79001]: from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:28:19.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:19 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:19.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:19 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:19.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.979+0000 7f15eb200700 1 -- 172.21.15.84:0/1562817959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f15ec04bed0 con 0x7f15ec0fcc00 2024-04-26T21:28:19.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.980+0000 7f15e2000700 1 -- 172.21.15.84:0/1562817959 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f15dc05b1d0 con 0x7f15ec0fcc00 2024-04-26T21:28:19.981 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:28:19.982 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:28:19.982 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:28:19.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:28:19.982 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:28:19.982 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:28:19.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:28:19.982 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:28:19.982 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-26T21:28:19.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:28:19.982 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:28:19.982 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-26T21:28:19.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:28:19.982 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:28:19.982 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 10, 2024-04-26T21:28:19.983 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 4 2024-04-26T21:28:19.983 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:28:19.983 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:28:19.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.982+0000 7f15eb200700 1 -- 172.21.15.84:0/1562817959 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f15d006ed30 msgr2=0x7f15d00711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:19.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.982+0000 7f15eb200700 1 --2- 172.21.15.84:0/1562817959 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f15d006ed30 0x7f15d00711e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009fd0 tx=0x7f15d4009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:19.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.982+0000 7f15eb200700 1 -- 172.21.15.84:0/1562817959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15ec0fcc00 msgr2=0x7f15ec10fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:19.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.982+0000 7f15eb200700 1 --2- 172.21.15.84:0/1562817959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15ec0fcc00 0x7f15ec10fa30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f15dc002a50 tx=0x7f15dc0046b0 comp rx=0 tx=0).stop 2024-04-26T21:28:19.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.982+0000 7f15eb200700 1 -- 172.21.15.84:0/1562817959 shutdown_connections 2024-04-26T21:28:19.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.982+0000 7f15eb200700 1 --2- 172.21.15.84:0/1562817959 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f15d006ed30 0x7f15d00711e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:19.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.982+0000 7f15eb200700 1 --2- 172.21.15.84:0/1562817959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15ec0fcc00 0x7f15ec10fa30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:19.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.982+0000 7f15eb200700 1 --2- 172.21.15.84:0/1562817959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15ec0fdeb0 0x7f15ec10ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:19.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.983+0000 7f15eb200700 1 -- 172.21.15.84:0/1562817959 >> 172.21.15.84:0/1562817959 conn(0x7f15ec0f8340 msgr2=0x7f15ec0f9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:19.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.983+0000 7f15eb200700 1 -- 172.21.15.84:0/1562817959 shutdown_connections 2024-04-26T21:28:19.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:19.983+0000 7f15eb200700 1 -- 172.21.15.84:0/1562817959 wait complete. 2024-04-26T21:28:20.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.130+0000 7f09a4400700 1 -- 172.21.15.84:0/802113924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c0feff0 msgr2=0x7f099c0ff400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:20.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.130+0000 7f09a4400700 1 --2- 172.21.15.84:0/802113924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c0feff0 0x7f099c0ff400 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0990004940 tx=0x7f0990009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:20.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.130+0000 7f09a4400700 1 -- 172.21.15.84:0/802113924 shutdown_connections 2024-04-26T21:28:20.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.130+0000 7f09a4400700 1 --2- 172.21.15.84:0/802113924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f099c1002a0 0x7f099c100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:20.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.130+0000 7f09a4400700 1 --2- 172.21.15.84:0/802113924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c0feff0 0x7f099c0ff400 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:20.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.130+0000 7f09a4400700 1 -- 172.21.15.84:0/802113924 >> 172.21.15.84:0/802113924 conn(0x7f099c0fa8f0 msgr2=0x7f099c0fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:20.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.131+0000 7f09a4400700 1 -- 172.21.15.84:0/802113924 shutdown_connections 2024-04-26T21:28:20.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.131+0000 7f09a4400700 1 -- 172.21.15.84:0/802113924 wait complete. 2024-04-26T21:28:20.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.131+0000 7f09a4400700 1 Processor -- start 2024-04-26T21:28:20.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.132+0000 7f09a4400700 1 -- start start 2024-04-26T21:28:20.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.132+0000 7f09a4400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c0feff0 0x7f099c10fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:20.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.132+0000 7f09a4400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f099c1002a0 0x7f099c110000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:20.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.132+0000 7f09a4400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c110600 con 0x7f099c0feff0 2024-04-26T21:28:20.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.132+0000 7f09a4400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c110770 con 0x7f099c1002a0 2024-04-26T21:28:20.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.132+0000 7f09a1a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c0feff0 0x7f099c10fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:20.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.132+0000 7f09a1a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c0feff0 0x7f099c10fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36922/0 (socket says 172.21.15.84:36922) 2024-04-26T21:28:20.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.132+0000 7f09a1a00700 1 -- 172.21.15.84:0/2535522131 learned_addr learned my addr 172.21.15.84:0/2535522131 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:28:20.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.132+0000 7f09a1000700 1 --2- 172.21.15.84:0/2535522131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f099c1002a0 0x7f099c110000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:20.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.133+0000 7f09a1a00700 1 -- 172.21.15.84:0/2535522131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f099c1002a0 msgr2=0x7f099c110000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:20.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.133+0000 7f09a1a00700 1 --2- 172.21.15.84:0/2535522131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f099c1002a0 0x7f099c110000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:20.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.133+0000 7f09a1a00700 1 -- 172.21.15.84:0/2535522131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0990005040 con 0x7f099c0feff0 2024-04-26T21:28:20.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.133+0000 7f09a1000700 1 --2- 172.21.15.84:0/2535522131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f099c1002a0 0x7f099c110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:28:20.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.133+0000 7f09a1a00700 1 --2- 172.21.15.84:0/2535522131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c0feff0 0x7f099c10fac0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0990013870 tx=0x7f0990009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:20.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.133+0000 7f0999600700 1 -- 172.21.15.84:0/2535522131 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f099000e070 con 0x7f099c0feff0 2024-04-26T21:28:20.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.133+0000 7f0999600700 1 -- 172.21.15.84:0/2535522131 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f099001c400 con 0x7f099c0feff0 2024-04-26T21:28:20.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.133+0000 7f0999600700 1 -- 172.21.15.84:0/2535522131 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f099000b650 con 0x7f099c0feff0 2024-04-26T21:28:20.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.133+0000 7f09a4400700 1 -- 172.21.15.84:0/2535522131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099c115170 con 0x7f099c0feff0 2024-04-26T21:28:20.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.134+0000 7f09a4400700 1 -- 172.21.15.84:0/2535522131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099c115650 con 0x7f099c0feff0 2024-04-26T21:28:20.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.135+0000 7f09a4400700 1 -- 172.21.15.84:0/2535522131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099c04c710 con 0x7f099c0feff0 2024-04-26T21:28:20.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.136+0000 7f0999600700 1 -- 172.21.15.84:0/2535522131 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f099001c570 con 0x7f099c0feff0 2024-04-26T21:28:20.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.136+0000 7f0999600700 1 --2- 172.21.15.84:0/2535522131 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f098406ed30 0x7f09840711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:20.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.137+0000 7f0999600700 1 -- 172.21.15.84:0/2535522131 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f0990090160 con 0x7f099c0feff0 2024-04-26T21:28:20.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.137+0000 7f09a1000700 1 --2- 172.21.15.84:0/2535522131 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f098406ed30 0x7f09840711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:20.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.138+0000 7f09a1000700 1 --2- 172.21.15.84:0/2535522131 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f098406ed30 0x7f09840711e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f098c004600 tx=0x7f098c00b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:20.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.141+0000 7f0999600700 1 -- 172.21.15.84:0/2535522131 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f099005c920 con 0x7f099c0feff0 2024-04-26T21:28:20.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.416+0000 7f09a4400700 1 -- 172.21.15.84:0/2535522131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f099c115a00 con 0x7f099c0feff0 2024-04-26T21:28:20.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.416+0000 7f0999600700 1 -- 172.21.15.84:0/2535522131 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1922 (secure 0 0 0) 0x7f099005c4b0 con 0x7f099c0feff0 2024-04-26T21:28:20.420 INFO:teuthology.orchestra.run.smithi084.stdout:e15 2024-04-26T21:28:20.420 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:28:20.420 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:28:20.420 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:28:20.420 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:28:20.420 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:28:20.420 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:28:20.421 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 15 2024-04-26T21:28:20.421 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:28:20.421 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:28:20.421 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:27:24.731661+0000 2024-04-26T21:28:20.421 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:28:20.421 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:28:20.421 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:28:20.421 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:28:20.421 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:28:20.421 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-04-26T21:28:20.421 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:28:20.421 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:28:20.422 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:28:20.422 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:28:20.422 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:28:20.422 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:28:20.422 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456,1=24231} 2024-04-26T21:28:20.422 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:28:20.422 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:28:20.422 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:28:20.422 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:28:20.422 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:28:20.422 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:28:20.423 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:28:20.423 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-04-26T21:28:20.423 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:28:20.423 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 0 members: 2024-04-26T21:28:20.423 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:28:20.423 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:28:20.423 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:28:20.423 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:28:20.423 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:28:20.423 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:28:20.423 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:28:20.423 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:28:20.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.421+0000 7f09a4400700 1 -- 172.21.15.84:0/2535522131 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f098406ed30 msgr2=0x7f09840711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:20.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.421+0000 7f09a4400700 1 --2- 172.21.15.84:0/2535522131 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f098406ed30 0x7f09840711e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f098c004600 tx=0x7f098c00b040 comp rx=0 tx=0).stop 2024-04-26T21:28:20.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.421+0000 7f09a4400700 1 -- 172.21.15.84:0/2535522131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c0feff0 msgr2=0x7f099c10fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:20.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.421+0000 7f09a4400700 1 --2- 172.21.15.84:0/2535522131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c0feff0 0x7f099c10fac0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0990013870 tx=0x7f0990009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:20.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.421+0000 7f09a4400700 1 -- 172.21.15.84:0/2535522131 shutdown_connections 2024-04-26T21:28:20.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.421+0000 7f09a4400700 1 --2- 172.21.15.84:0/2535522131 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f098406ed30 0x7f09840711e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:20.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.421+0000 7f09a4400700 1 --2- 172.21.15.84:0/2535522131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c0feff0 0x7f099c10fac0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:20.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.421+0000 7f09a4400700 1 --2- 172.21.15.84:0/2535522131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f099c1002a0 0x7f099c110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:20.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.421+0000 7f09a4400700 1 -- 172.21.15.84:0/2535522131 >> 172.21.15.84:0/2535522131 conn(0x7f099c0fa8f0 msgr2=0x7f099c0fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:20.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.421+0000 7f09a4400700 1 -- 172.21.15.84:0/2535522131 shutdown_connections 2024-04-26T21:28:20.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.421+0000 7f09a4400700 1 -- 172.21.15.84:0/2535522131 wait complete. 2024-04-26T21:28:20.425 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 15 2024-04-26T21:28:20.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.561+0000 7f9a8ae00700 1 -- 172.21.15.84:0/3781901455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a84070830 msgr2=0x7f9a84070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:20.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.561+0000 7f9a8ae00700 1 --2- 172.21.15.84:0/3781901455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a84070830 0x7f9a84070ca0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9a70004940 tx=0x7f9a70009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:20.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.561+0000 7f9a8ae00700 1 -- 172.21.15.84:0/3781901455 shutdown_connections 2024-04-26T21:28:20.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.561+0000 7f9a8ae00700 1 --2- 172.21.15.84:0/3781901455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a84070830 0x7f9a84070ca0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:20.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.561+0000 7f9a8ae00700 1 --2- 172.21.15.84:0/3781901455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a84071de0 0x7f9a840702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:20.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.561+0000 7f9a8ae00700 1 -- 172.21.15.84:0/3781901455 >> 172.21.15.84:0/3781901455 conn(0x7f9a840f8380 msgr2=0x7f9a840fa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:20.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.561+0000 7f9a8ae00700 1 -- 172.21.15.84:0/3781901455 shutdown_connections 2024-04-26T21:28:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.561+0000 7f9a8ae00700 1 -- 172.21.15.84:0/3781901455 wait complete. 2024-04-26T21:28:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.562+0000 7f9a8ae00700 1 Processor -- start 2024-04-26T21:28:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.562+0000 7f9a8ae00700 1 -- start start 2024-04-26T21:28:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.562+0000 7f9a8ae00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a84070830 0x7f9a8410fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.562+0000 7f9a8ae00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a84071de0 0x7f9a8410ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.562+0000 7f9a8ae00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a84110600 con 0x7f9a84070830 2024-04-26T21:28:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.562+0000 7f9a8ae00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a84110df0 con 0x7f9a84071de0 2024-04-26T21:28:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.563+0000 7f9a89a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a84070830 0x7f9a8410fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.563+0000 7f9a89a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a84070830 0x7f9a8410fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36952/0 (socket says 172.21.15.84:36952) 2024-04-26T21:28:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.563+0000 7f9a89a00700 1 -- 172.21.15.84:0/2369708300 learned_addr learned my addr 172.21.15.84:0/2369708300 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:28:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.563+0000 7f9a89000700 1 --2- 172.21.15.84:0/2369708300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a84071de0 0x7f9a8410ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.563+0000 7f9a89a00700 1 -- 172.21.15.84:0/2369708300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a84071de0 msgr2=0x7f9a8410ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.563+0000 7f9a89a00700 1 --2- 172.21.15.84:0/2369708300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a84071de0 0x7f9a8410ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.563+0000 7f9a89a00700 1 -- 172.21.15.84:0/2369708300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a70005040 con 0x7f9a84070830 2024-04-26T21:28:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.564+0000 7f9a89a00700 1 --2- 172.21.15.84:0/2369708300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a84070830 0x7f9a8410fa30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800b790 tx=0x7f9a78009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.564+0000 7f9a81600700 1 -- 172.21.15.84:0/2369708300 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a7800f6f0 con 0x7f9a84070830 2024-04-26T21:28:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.564+0000 7f9a81600700 1 -- 172.21.15.84:0/2369708300 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a7800fd20 con 0x7f9a84070830 2024-04-26T21:28:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.564+0000 7f9a8ae00700 1 -- 172.21.15.84:0/2369708300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a841110d0 con 0x7f9a84070830 2024-04-26T21:28:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.564+0000 7f9a81600700 1 -- 172.21.15.84:0/2369708300 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a780103a0 con 0x7f9a84070830 2024-04-26T21:28:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.564+0000 7f9a8ae00700 1 -- 172.21.15.84:0/2369708300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a84111690 con 0x7f9a84070830 2024-04-26T21:28:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.565+0000 7f9a8ae00700 1 -- 172.21.15.84:0/2369708300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8405f5c0 con 0x7f9a84070830 2024-04-26T21:28:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.566+0000 7f9a81600700 1 -- 172.21.15.84:0/2369708300 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f9a78011400 con 0x7f9a84070830 2024-04-26T21:28:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.567+0000 7f9a81600700 1 --2- 172.21.15.84:0/2369708300 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9a6c06ed20 0x7f9a6c0711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.567+0000 7f9a81600700 1 -- 172.21.15.84:0/2369708300 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f9a7808e7e0 con 0x7f9a84070830 2024-04-26T21:28:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.567+0000 7f9a89000700 1 --2- 172.21.15.84:0/2369708300 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9a6c06ed20 0x7f9a6c0711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.568+0000 7f9a89000700 1 --2- 172.21.15.84:0/2369708300 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9a6c06ed20 0x7f9a6c0711d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9a70004f90 tx=0x7f9a70009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.572+0000 7f9a81600700 1 -- 172.21.15.84:0/2369708300 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f9a7805b030 con 0x7f9a84070830 2024-04-26T21:28:20.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.799+0000 7f9a8ae00700 1 -- 172.21.15.84:0/2369708300 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a841119d0 con 0x7f9a6c06ed20 2024-04-26T21:28:20.801 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:20 smithi084 ceph-mon[90138]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:28:20.801 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:20 smithi084 ceph-mon[90138]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:28:20.801 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:20 smithi084 ceph-mon[90138]: pgmap v21: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 14 KiB/s rd, 381 KiB/s wr, 78 op/s 2024-04-26T21:28:20.801 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:20 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/1562817959' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:28:20.801 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:20 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2535522131' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:28:20.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.802+0000 7f9a81600700 1 -- 172.21.15.84:0/2369708300 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f9a841119d0 con 0x7f9a6c06ed20 2024-04-26T21:28:20.804 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:28:20.804 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:28:20.804 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:28:20.804 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:28:20.804 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-04-26T21:28:20.804 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr", 2024-04-26T21:28:20.804 INFO:teuthology.orchestra.run.smithi084.stdout: "mon" 2024-04-26T21:28:20.804 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-04-26T21:28:20.804 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "4/21 daemons upgraded", 2024-04-26T21:28:20.804 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading mon daemons", 2024-04-26T21:28:20.804 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:28:20.805 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:28:20.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.805+0000 7f9a8ae00700 1 -- 172.21.15.84:0/2369708300 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9a6c06ed20 msgr2=0x7f9a6c0711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:20.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.805+0000 7f9a8ae00700 1 --2- 172.21.15.84:0/2369708300 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9a6c06ed20 0x7f9a6c0711d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9a70004f90 tx=0x7f9a70009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:20.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.805+0000 7f9a8ae00700 1 -- 172.21.15.84:0/2369708300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a84070830 msgr2=0x7f9a8410fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:20.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.805+0000 7f9a8ae00700 1 --2- 172.21.15.84:0/2369708300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a84070830 0x7f9a8410fa30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800b790 tx=0x7f9a78009220 comp rx=0 tx=0).stop 2024-04-26T21:28:20.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.805+0000 7f9a8ae00700 1 -- 172.21.15.84:0/2369708300 shutdown_connections 2024-04-26T21:28:20.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.805+0000 7f9a8ae00700 1 --2- 172.21.15.84:0/2369708300 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9a6c06ed20 0x7f9a6c0711d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:20.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.805+0000 7f9a8ae00700 1 --2- 172.21.15.84:0/2369708300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a84070830 0x7f9a8410fa30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:20.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.805+0000 7f9a8ae00700 1 --2- 172.21.15.84:0/2369708300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a84071de0 0x7f9a8410ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:20.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.805+0000 7f9a8ae00700 1 -- 172.21.15.84:0/2369708300 >> 172.21.15.84:0/2369708300 conn(0x7f9a840f8380 msgr2=0x7f9a840f9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:20.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.805+0000 7f9a8ae00700 1 -- 172.21.15.84:0/2369708300 shutdown_connections 2024-04-26T21:28:20.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.805+0000 7f9a8ae00700 1 -- 172.21.15.84:0/2369708300 wait complete. 2024-04-26T21:28:20.809 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:20 smithi120 ceph-mon[79001]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:28:20.809 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:20 smithi120 ceph-mon[79001]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:28:20.809 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:20 smithi120 ceph-mon[79001]: pgmap v21: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 14 KiB/s rd, 381 KiB/s wr, 78 op/s 2024-04-26T21:28:20.809 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:20 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/1562817959' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:28:20.809 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:20 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2535522131' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:28:20.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.955+0000 7fe6e4400700 1 -- 172.21.15.84:0/1623080194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6dc0fcf60 msgr2=0x7fe6dc0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:20.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.955+0000 7fe6e4400700 1 --2- 172.21.15.84:0/1623080194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6dc0fcf60 0x7fe6dc0fd3d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8004940 tx=0x7fe6c8009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:20.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.955+0000 7fe6e4400700 1 -- 172.21.15.84:0/1623080194 shutdown_connections 2024-04-26T21:28:20.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.955+0000 7fe6e4400700 1 --2- 172.21.15.84:0/1623080194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6dc0fcf60 0x7fe6dc0fd3d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:20.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.955+0000 7fe6e4400700 1 --2- 172.21.15.84:0/1623080194 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6dc0fbcb0 0x7fe6dc0fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:20.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.955+0000 7fe6e4400700 1 -- 172.21.15.84:0/1623080194 >> 172.21.15.84:0/1623080194 conn(0x7fe6dc0f7430 msgr2=0x7fe6dc0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:20.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.955+0000 7fe6e4400700 1 -- 172.21.15.84:0/1623080194 shutdown_connections 2024-04-26T21:28:20.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.956+0000 7fe6e4400700 1 -- 172.21.15.84:0/1623080194 wait complete. 2024-04-26T21:28:20.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.957+0000 7fe6e4400700 1 Processor -- start 2024-04-26T21:28:20.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.957+0000 7fe6e4400700 1 -- start start 2024-04-26T21:28:20.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.957+0000 7fe6e4400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6dc0fbcb0 0x7fe6dc0ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:20.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.957+0000 7fe6e4400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6dc0fcf60 0x7fe6dc0fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:20.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.957+0000 7fe6e4400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc0fe8c0 con 0x7fe6dc0fbcb0 2024-04-26T21:28:20.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.957+0000 7fe6e4400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc0fea00 con 0x7fe6dc0fcf60 2024-04-26T21:28:20.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.958+0000 7fe6e1a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6dc0fbcb0 0x7fe6dc0ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:20.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.958+0000 7fe6e1a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6dc0fbcb0 0x7fe6dc0ffd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36970/0 (socket says 172.21.15.84:36970) 2024-04-26T21:28:20.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.958+0000 7fe6e1a00700 1 -- 172.21.15.84:0/1282147281 learned_addr learned my addr 172.21.15.84:0/1282147281 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:28:20.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.958+0000 7fe6e1000700 1 --2- 172.21.15.84:0/1282147281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6dc0fcf60 0x7fe6dc0fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:20.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.958+0000 7fe6e1a00700 1 -- 172.21.15.84:0/1282147281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6dc0fcf60 msgr2=0x7fe6dc0fe2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:20.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.958+0000 7fe6e1a00700 1 --2- 172.21.15.84:0/1282147281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6dc0fcf60 0x7fe6dc0fe2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:20.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.958+0000 7fe6e1a00700 1 -- 172.21.15.84:0/1282147281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c8005040 con 0x7fe6dc0fbcb0 2024-04-26T21:28:20.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.959+0000 7fe6e1a00700 1 --2- 172.21.15.84:0/1282147281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6dc0fbcb0 0x7fe6dc0ffd80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000b790 tx=0x7fe6d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:20.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.959+0000 7fe6d9600700 1 -- 172.21.15.84:0/1282147281 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6d000f770 con 0x7fe6dc0fbcb0 2024-04-26T21:28:20.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.959+0000 7fe6d9600700 1 -- 172.21.15.84:0/1282147281 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe6d000fda0 con 0x7fe6dc0fbcb0 2024-04-26T21:28:20.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.959+0000 7fe6d9600700 1 -- 172.21.15.84:0/1282147281 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6d000d310 con 0x7fe6dc0fbcb0 2024-04-26T21:28:20.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.959+0000 7fe6e4400700 1 -- 172.21.15.84:0/1282147281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6dc0fece0 con 0x7fe6dc0fbcb0 2024-04-26T21:28:20.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.959+0000 7fe6e4400700 1 -- 172.21.15.84:0/1282147281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6dc115aa0 con 0x7fe6dc0fbcb0 2024-04-26T21:28:20.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.960+0000 7fe6e4400700 1 -- 172.21.15.84:0/1282147281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6dc101af0 con 0x7fe6dc0fbcb0 2024-04-26T21:28:20.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.961+0000 7fe6d9600700 1 -- 172.21.15.84:0/1282147281 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fe6d0010420 con 0x7fe6dc0fbcb0 2024-04-26T21:28:20.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.962+0000 7fe6d9600700 1 --2- 172.21.15.84:0/1282147281 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe6c406ed20 0x7fe6c40711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:20.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.962+0000 7fe6d9600700 1 -- 172.21.15.84:0/1282147281 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe6d008e960 con 0x7fe6dc0fbcb0 2024-04-26T21:28:20.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.962+0000 7fe6e1000700 1 --2- 172.21.15.84:0/1282147281 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe6c406ed20 0x7fe6c40711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:20.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.963+0000 7fe6e1000700 1 --2- 172.21.15.84:0/1282147281 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe6c406ed20 0x7fe6c40711d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc100360 tx=0x7fe6c8009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:20.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:20.967+0000 7fe6d9600700 1 -- 172.21.15.84:0/1282147281 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fe6d0057700 con 0x7fe6dc0fbcb0 2024-04-26T21:28:21.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:21.268+0000 7fe6e4400700 1 -- 172.21.15.84:0/1282147281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe6dc104900 con 0x7fe6dc0fbcb0 2024-04-26T21:28:21.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:21.269+0000 7fe6d9600700 1 -- 172.21.15.84:0/1282147281 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fe6d005adc0 con 0x7fe6dc0fbcb0 2024-04-26T21:28:21.270 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:28:21.270 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:28:21.270 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:28:21.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:21.271+0000 7fe6e4400700 1 -- 172.21.15.84:0/1282147281 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe6c406ed20 msgr2=0x7fe6c40711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:21.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:21.271+0000 7fe6e4400700 1 --2- 172.21.15.84:0/1282147281 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe6c406ed20 0x7fe6c40711d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc100360 tx=0x7fe6c8009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:21.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:21.271+0000 7fe6e4400700 1 -- 172.21.15.84:0/1282147281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6dc0fbcb0 msgr2=0x7fe6dc0ffd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:21.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:21.271+0000 7fe6e4400700 1 --2- 172.21.15.84:0/1282147281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6dc0fbcb0 0x7fe6dc0ffd80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000b790 tx=0x7fe6d0009250 comp rx=0 tx=0).stop 2024-04-26T21:28:21.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:21.271+0000 7fe6e4400700 1 -- 172.21.15.84:0/1282147281 shutdown_connections 2024-04-26T21:28:21.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:21.271+0000 7fe6e4400700 1 --2- 172.21.15.84:0/1282147281 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe6c406ed20 0x7fe6c40711d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:21.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:21.271+0000 7fe6e4400700 1 --2- 172.21.15.84:0/1282147281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6dc0fbcb0 0x7fe6dc0ffd80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:21.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:21.271+0000 7fe6e4400700 1 --2- 172.21.15.84:0/1282147281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6dc0fcf60 0x7fe6dc0fe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:21.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:21.271+0000 7fe6e4400700 1 -- 172.21.15.84:0/1282147281 >> 172.21.15.84:0/1282147281 conn(0x7fe6dc0f7430 msgr2=0x7fe6dc065bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:21.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:21.272+0000 7fe6e4400700 1 -- 172.21.15.84:0/1282147281 shutdown_connections 2024-04-26T21:28:21.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:21.272+0000 7fe6e4400700 1 -- 172.21.15.84:0/1282147281 wait complete. 2024-04-26T21:28:21.870 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:21 smithi120 ceph-mon[79001]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:28:21.870 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:21 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/1282147281' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:28:21.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:21 smithi084 ceph-mon[90138]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:28:21.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:21 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/1282147281' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:28:22.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:22 smithi084 ceph-mon[90138]: pgmap v22: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 14 KiB/s rd, 387 KiB/s wr, 74 op/s 2024-04-26T21:28:22.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:22 smithi120 ceph-mon[79001]: pgmap v22: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 14 KiB/s rd, 387 KiB/s wr, 74 op/s 2024-04-26T21:28:25.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:24 smithi084 ceph-mon[90138]: pgmap v23: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 6.1 KiB/s rd, 181 KiB/s wr, 31 op/s 2024-04-26T21:28:25.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:24 smithi120 ceph-mon[79001]: pgmap v23: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 6.1 KiB/s rd, 181 KiB/s wr, 31 op/s 2024-04-26T21:28:26.159 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:26.159 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:26.159 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:26.159 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:28:26.159 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:26.159 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:28:26.159 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T21:28:26.159 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:26.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:26.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:26.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:26.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:28:26.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:26.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:28:26.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T21:28:26.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:27.169 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:26 smithi084 ceph-mon[90138]: Reconfiguring mon.smithi084 (monmap changed)... 2024-04-26T21:28:27.169 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:26 smithi084 ceph-mon[90138]: Reconfiguring daemon mon.smithi084 on smithi084 2024-04-26T21:28:27.169 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:26 smithi084 ceph-mon[90138]: pgmap v24: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 6.1 KiB/s rd, 181 KiB/s wr, 31 op/s 2024-04-26T21:28:27.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:26 smithi120 ceph-mon[79001]: Reconfiguring mon.smithi084 (monmap changed)... 2024-04-26T21:28:27.318 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:26 smithi120 ceph-mon[79001]: Reconfiguring daemon mon.smithi084 on smithi084 2024-04-26T21:28:27.318 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:26 smithi120 ceph-mon[79001]: pgmap v24: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 6.1 KiB/s rd, 181 KiB/s wr, 31 op/s 2024-04-26T21:28:28.770 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:28 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:28.770 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:28 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:28.771 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:28 smithi084 ceph-mon[90138]: Reconfiguring mgr.smithi084.gyasul (monmap changed)... 2024-04-26T21:28:28.771 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:28 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi084.gyasul", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:28:28.771 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:28 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:28:28.771 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:28 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:28.771 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:28 smithi084 ceph-mon[90138]: Reconfiguring daemon mgr.smithi084.gyasul on smithi084 2024-04-26T21:28:28.771 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:28 smithi084 ceph-mon[90138]: pgmap v25: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 6.2 KiB/s wr, 0 op/s 2024-04-26T21:28:28.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:28 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:28.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:28 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:28.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:28 smithi120 ceph-mon[79001]: Reconfiguring mgr.smithi084.gyasul (monmap changed)... 2024-04-26T21:28:28.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:28 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi084.gyasul", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:28:28.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:28 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:28:28.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:28 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:28.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:28 smithi120 ceph-mon[79001]: Reconfiguring daemon mgr.smithi084.gyasul on smithi084 2024-04-26T21:28:28.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:28 smithi120 ceph-mon[79001]: pgmap v25: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 6.2 KiB/s wr, 0 op/s 2024-04-26T21:28:29.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:29 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:28:29.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:29 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:28:30.845 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:30 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:30.845 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:30 smithi084 ceph-mon[90138]: pgmap v26: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 6.2 KiB/s wr, 0 op/s 2024-04-26T21:28:30.845 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:30 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:30.845 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:30 smithi084 ceph-mon[90138]: Reconfiguring crash.smithi084 (monmap changed)... 2024-04-26T21:28:30.845 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:30 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi084", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:28:30.845 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:30 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:30.845 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:30 smithi084 ceph-mon[90138]: Reconfiguring daemon crash.smithi084 on smithi084 2024-04-26T21:28:31.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:30 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:31.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:30 smithi120 ceph-mon[79001]: pgmap v26: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 6.2 KiB/s wr, 0 op/s 2024-04-26T21:28:31.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:30 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:31.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:30 smithi120 ceph-mon[79001]: Reconfiguring crash.smithi084 (monmap changed)... 2024-04-26T21:28:31.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:30 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi084", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:28:31.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:30 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:31.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:30 smithi120 ceph-mon[79001]: Reconfiguring daemon crash.smithi084 on smithi084 2024-04-26T21:28:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:32 smithi084 ceph-mon[90138]: pgmap v27: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 6.2 KiB/s wr, 0 op/s 2024-04-26T21:28:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:32 smithi084 ceph-mon[90138]: Reconfiguring osd.0 (monmap changed)... 2024-04-26T21:28:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T21:28:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:32 smithi084 ceph-mon[90138]: Reconfiguring daemon osd.0 on smithi084 2024-04-26T21:28:33.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:32 smithi120 ceph-mon[79001]: pgmap v27: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 6.2 KiB/s wr, 0 op/s 2024-04-26T21:28:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:32 smithi120 ceph-mon[79001]: Reconfiguring osd.0 (monmap changed)... 2024-04-26T21:28:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T21:28:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:32 smithi120 ceph-mon[79001]: Reconfiguring daemon osd.0 on smithi084 2024-04-26T21:28:35.153 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:34 smithi084 ceph-mon[90138]: pgmap v28: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-26T21:28:35.154 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:34 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:35.154 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:34 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:35.154 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:34 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T21:28:35.154 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:34 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:35.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:34 smithi120 ceph-mon[79001]: pgmap v28: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-26T21:28:35.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:34 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:35.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:34 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:35.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:34 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T21:28:35.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:34 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:36.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:35 smithi084 ceph-mon[90138]: Reconfiguring osd.1 (monmap changed)... 2024-04-26T21:28:36.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:35 smithi084 ceph-mon[90138]: Reconfiguring daemon osd.1 on smithi084 2024-04-26T21:28:36.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:35 smithi120 ceph-mon[79001]: Reconfiguring osd.1 (monmap changed)... 2024-04-26T21:28:36.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:35 smithi120 ceph-mon[79001]: Reconfiguring daemon osd.1 on smithi084 2024-04-26T21:28:37.237 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:36 smithi120 ceph-mon[79001]: pgmap v29: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-26T21:28:37.237 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:36 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:37.237 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:36 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:37.237 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:36 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T21:28:37.237 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:36 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:37.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:36 smithi084 ceph-mon[90138]: pgmap v29: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-26T21:28:37.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:36 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:37.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:36 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:37.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:36 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T21:28:37.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:36 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:38.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:37 smithi084 ceph-mon[90138]: Reconfiguring osd.2 (monmap changed)... 2024-04-26T21:28:38.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:37 smithi084 ceph-mon[90138]: Reconfiguring daemon osd.2 on smithi084 2024-04-26T21:28:38.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:37 smithi120 ceph-mon[79001]: Reconfiguring osd.2 (monmap changed)... 2024-04-26T21:28:38.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:37 smithi120 ceph-mon[79001]: Reconfiguring daemon osd.2 on smithi084 2024-04-26T21:28:39.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:38 smithi084 ceph-mon[90138]: pgmap v30: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:28:39.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:38 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:39.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:38 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:39.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:38 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.hbjunw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:28:39.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:38 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:39.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:38 smithi120 ceph-mon[79001]: pgmap v30: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:28:39.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:38 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:39.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:38 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:39.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:38 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.hbjunw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:28:39.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:38 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:40.102 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:39 smithi084 ceph-mon[90138]: Reconfiguring mds.cephfs.smithi084.hbjunw (monmap changed)... 2024-04-26T21:28:40.103 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:39 smithi084 ceph-mon[90138]: Reconfiguring daemon mds.cephfs.smithi084.hbjunw on smithi084 2024-04-26T21:28:40.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:39 smithi120 ceph-mon[79001]: Reconfiguring mds.cephfs.smithi084.hbjunw (monmap changed)... 2024-04-26T21:28:40.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:39 smithi120 ceph-mon[79001]: Reconfiguring daemon mds.cephfs.smithi084.hbjunw on smithi084 2024-04-26T21:28:41.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:40 smithi084 ceph-mon[90138]: pgmap v31: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:28:41.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:40 smithi120 ceph-mon[79001]: pgmap v31: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:28:42.317 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:42 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:42.317 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:42 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:42.318 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:42 smithi084 ceph-mon[90138]: Reconfiguring mds.cephfs.smithi084.rtrqtr (monmap changed)... 2024-04-26T21:28:42.318 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:42 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.rtrqtr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:28:42.318 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:42 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:42.318 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:42 smithi084 ceph-mon[90138]: Reconfiguring daemon mds.cephfs.smithi084.rtrqtr on smithi084 2024-04-26T21:28:42.318 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:42 smithi084 ceph-mon[90138]: pgmap v32: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:28:42.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:42 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:42.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:42 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:42.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:42 smithi120 ceph-mon[79001]: Reconfiguring mds.cephfs.smithi084.rtrqtr (monmap changed)... 2024-04-26T21:28:42.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:42 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.rtrqtr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:28:42.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:42 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:42.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:42 smithi120 ceph-mon[79001]: Reconfiguring daemon mds.cephfs.smithi084.rtrqtr on smithi084 2024-04-26T21:28:42.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:42 smithi120 ceph-mon[79001]: pgmap v32: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:28:44.605 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:44.605 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:44.605 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:44 smithi120 ceph-mon[79001]: Reconfiguring crash.smithi120 (monmap changed)... 2024-04-26T21:28:44.605 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi120", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:28:44.606 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:44.606 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:44 smithi120 ceph-mon[79001]: Reconfiguring daemon crash.smithi120 on smithi120 2024-04-26T21:28:44.606 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:44 smithi120 ceph-mon[79001]: pgmap v33: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:28:44.606 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:28:44.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:44.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:44.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:44 smithi084 ceph-mon[90138]: Reconfiguring crash.smithi120 (monmap changed)... 2024-04-26T21:28:44.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi120", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:28:44.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:44.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:44 smithi084 ceph-mon[90138]: Reconfiguring daemon crash.smithi120 on smithi120 2024-04-26T21:28:44.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:44 smithi084 ceph-mon[90138]: pgmap v33: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:28:44.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:28:46.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:46.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:46.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:46 smithi120 ceph-mon[79001]: Reconfiguring mgr.smithi120.zjaduj (monmap changed)... 2024-04-26T21:28:46.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.zjaduj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:28:46.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:28:46.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:46.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:46 smithi120 ceph-mon[79001]: Reconfiguring daemon mgr.smithi120.zjaduj on smithi120 2024-04-26T21:28:46.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:46 smithi120 ceph-mon[79001]: pgmap v34: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:28:46.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:46.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:46.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:46 smithi084 ceph-mon[90138]: Reconfiguring mgr.smithi120.zjaduj (monmap changed)... 2024-04-26T21:28:46.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi120.zjaduj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:28:46.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:28:46.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:46.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:46 smithi084 ceph-mon[90138]: Reconfiguring daemon mgr.smithi120.zjaduj on smithi120 2024-04-26T21:28:46.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:46 smithi084 ceph-mon[90138]: pgmap v34: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:28:48.988 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:48 smithi120 ceph-mon[79001]: pgmap v35: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:28:48.988 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:48 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:48.989 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:48 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:48.989 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:48 smithi120 ceph-mon[79001]: Reconfiguring mon.smithi120 (monmap changed)... 2024-04-26T21:28:48.989 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:48 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:28:48.989 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:48 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T21:28:48.989 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:48 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:48.989 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:48 smithi120 ceph-mon[79001]: Reconfiguring daemon mon.smithi120 on smithi120 2024-04-26T21:28:49.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:48 smithi084 ceph-mon[90138]: pgmap v35: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:28:49.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:48 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:49.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:48 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:49.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:48 smithi084 ceph-mon[90138]: Reconfiguring mon.smithi120 (monmap changed)... 2024-04-26T21:28:49.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:48 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:28:49.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:48 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T21:28:49.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:48 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:49.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:48 smithi084 ceph-mon[90138]: Reconfiguring daemon mon.smithi120 on smithi120 2024-04-26T21:28:51.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:50 smithi084 ceph-mon[90138]: pgmap v36: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-04-26T21:28:51.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:51.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:51.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T21:28:51.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:51.178 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:50 smithi120 ceph-mon[79001]: pgmap v36: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-04-26T21:28:51.178 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:51.178 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:51.178 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T21:28:51.178 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:51.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.439+0000 7f6174c00700 1 -- 172.21.15.84:0/185063651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61700fdeb0 msgr2=0x7f61700fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:51.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.439+0000 7f6174c00700 1 --2- 172.21.15.84:0/185063651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61700fdeb0 0x7f61700fe320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f615c004940 tx=0x7f615c009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:51.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.439+0000 7f6174c00700 1 -- 172.21.15.84:0/185063651 shutdown_connections 2024-04-26T21:28:51.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.439+0000 7f6174c00700 1 --2- 172.21.15.84:0/185063651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61700fdeb0 0x7f61700fe320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:51.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.439+0000 7f6174c00700 1 --2- 172.21.15.84:0/185063651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61700fcc00 0x7f61700fd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:51.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.439+0000 7f6174c00700 1 -- 172.21.15.84:0/185063651 >> 172.21.15.84:0/185063651 conn(0x7f61700f8380 msgr2=0x7f61700fa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:51.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.439+0000 7f6174c00700 1 -- 172.21.15.84:0/185063651 shutdown_connections 2024-04-26T21:28:51.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.439+0000 7f6174c00700 1 -- 172.21.15.84:0/185063651 wait complete. 2024-04-26T21:28:51.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.440+0000 7f6174c00700 1 Processor -- start 2024-04-26T21:28:51.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.440+0000 7f6174c00700 1 -- start start 2024-04-26T21:28:51.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.440+0000 7f6174c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61700fcc00 0x7f617010fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:51.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.440+0000 7f6174c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61700fdeb0 0x7f617010ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:51.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.440+0000 7f6174c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6170110600 con 0x7f61700fcc00 2024-04-26T21:28:51.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.440+0000 7f6174c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6170110df0 con 0x7f61700fdeb0 2024-04-26T21:28:51.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.440+0000 7f616f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61700fcc00 0x7f617010fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:51.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.440+0000 7f616f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61700fcc00 0x7f617010fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41140/0 (socket says 172.21.15.84:41140) 2024-04-26T21:28:51.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.440+0000 7f616f400700 1 -- 172.21.15.84:0/2197187928 learned_addr learned my addr 172.21.15.84:0/2197187928 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:28:51.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.441+0000 7f616ea00700 1 --2- 172.21.15.84:0/2197187928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61700fdeb0 0x7f617010ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:51.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.441+0000 7f616f400700 1 -- 172.21.15.84:0/2197187928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61700fdeb0 msgr2=0x7f617010ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:51.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.441+0000 7f616f400700 1 --2- 172.21.15.84:0/2197187928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61700fdeb0 0x7f617010ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:51.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.441+0000 7f616f400700 1 -- 172.21.15.84:0/2197187928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c005040 con 0x7f61700fcc00 2024-04-26T21:28:51.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.441+0000 7f616f400700 1 --2- 172.21.15.84:0/2197187928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61700fcc00 0x7f617010fa30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f616000b790 tx=0x7f6160009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:51.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.441+0000 7f6167400700 1 -- 172.21.15.84:0/2197187928 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f616000f770 con 0x7f61700fcc00 2024-04-26T21:28:51.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.441+0000 7f6167400700 1 -- 172.21.15.84:0/2197187928 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f616000fda0 con 0x7f61700fcc00 2024-04-26T21:28:51.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.442+0000 7f6174c00700 1 -- 172.21.15.84:0/2197187928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61701110d0 con 0x7f61700fcc00 2024-04-26T21:28:51.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.442+0000 7f6167400700 1 -- 172.21.15.84:0/2197187928 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f616000d310 con 0x7f61700fcc00 2024-04-26T21:28:51.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.442+0000 7f6174c00700 1 -- 172.21.15.84:0/2197187928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6170111690 con 0x7f61700fcc00 2024-04-26T21:28:51.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.443+0000 7f6174c00700 1 -- 172.21.15.84:0/2197187928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6170101840 con 0x7f61700fcc00 2024-04-26T21:28:51.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.444+0000 7f6167400700 1 -- 172.21.15.84:0/2197187928 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f6160010420 con 0x7f61700fcc00 2024-04-26T21:28:51.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.445+0000 7f6167400700 1 --2- 172.21.15.84:0/2197187928 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f615406ed20 0x7f61540711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:51.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.445+0000 7f6167400700 1 -- 172.21.15.84:0/2197187928 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f616008ea40 con 0x7f61700fcc00 2024-04-26T21:28:51.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.445+0000 7f616ea00700 1 --2- 172.21.15.84:0/2197187928 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f615406ed20 0x7f61540711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:51.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.446+0000 7f616ea00700 1 --2- 172.21.15.84:0/2197187928 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f615406ed20 0x7f61540711d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f615c00b970 tx=0x7f615c009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:51.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.451+0000 7f6167400700 1 -- 172.21.15.84:0/2197187928 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f616005b290 con 0x7f61700fcc00 2024-04-26T21:28:51.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.695+0000 7f6174c00700 1 -- 172.21.15.84:0/2197187928 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6170111910 con 0x7f615406ed20 2024-04-26T21:28:51.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.698+0000 7f6167400700 1 -- 172.21.15.84:0/2197187928 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f6170111910 con 0x7f615406ed20 2024-04-26T21:28:51.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.701+0000 7f6174c00700 1 -- 172.21.15.84:0/2197187928 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f615406ed20 msgr2=0x7f61540711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:51.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.701+0000 7f6174c00700 1 --2- 172.21.15.84:0/2197187928 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f615406ed20 0x7f61540711d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f615c00b970 tx=0x7f615c009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:51.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.701+0000 7f6174c00700 1 -- 172.21.15.84:0/2197187928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61700fcc00 msgr2=0x7f617010fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:51.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.701+0000 7f6174c00700 1 --2- 172.21.15.84:0/2197187928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61700fcc00 0x7f617010fa30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f616000b790 tx=0x7f6160009250 comp rx=0 tx=0).stop 2024-04-26T21:28:51.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.701+0000 7f6174c00700 1 -- 172.21.15.84:0/2197187928 shutdown_connections 2024-04-26T21:28:51.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.701+0000 7f6174c00700 1 --2- 172.21.15.84:0/2197187928 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f615406ed20 0x7f61540711d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:51.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.701+0000 7f6174c00700 1 --2- 172.21.15.84:0/2197187928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61700fcc00 0x7f617010fa30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:51.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.701+0000 7f6174c00700 1 --2- 172.21.15.84:0/2197187928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61700fdeb0 0x7f617010ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:51.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.701+0000 7f6174c00700 1 -- 172.21.15.84:0/2197187928 >> 172.21.15.84:0/2197187928 conn(0x7f61700f8380 msgr2=0x7f61700f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:51.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.701+0000 7f6174c00700 1 -- 172.21.15.84:0/2197187928 shutdown_connections 2024-04-26T21:28:51.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.701+0000 7f6174c00700 1 -- 172.21.15.84:0/2197187928 wait complete. 2024-04-26T21:28:51.718 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:28:51.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.853+0000 7fb5f9200700 1 -- 172.21.15.84:0/3871180615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f41033d0 msgr2=0x7fb5f41037e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:51.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.853+0000 7fb5f9200700 1 --2- 172.21.15.84:0/3871180615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f41033d0 0x7fb5f41037e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4004940 tx=0x7fb5e4009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:51.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.853+0000 7fb5f9200700 1 -- 172.21.15.84:0/3871180615 shutdown_connections 2024-04-26T21:28:51.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.853+0000 7fb5f9200700 1 --2- 172.21.15.84:0/3871180615 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5f4104680 0x7fb5f4104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:51.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.853+0000 7fb5f9200700 1 --2- 172.21.15.84:0/3871180615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f41033d0 0x7fb5f41037e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:51.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.853+0000 7fb5f9200700 1 -- 172.21.15.84:0/3871180615 >> 172.21.15.84:0/3871180615 conn(0x7fb5f40725b0 msgr2=0x7fb5f4074a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:51.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.853+0000 7fb5f9200700 1 -- 172.21.15.84:0/3871180615 shutdown_connections 2024-04-26T21:28:51.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.853+0000 7fb5f9200700 1 -- 172.21.15.84:0/3871180615 wait complete. 2024-04-26T21:28:51.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.854+0000 7fb5f9200700 1 Processor -- start 2024-04-26T21:28:51.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.854+0000 7fb5f9200700 1 -- start start 2024-04-26T21:28:51.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.854+0000 7fb5f9200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f41033d0 0x7fb5f4113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:51.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.854+0000 7fb5f9200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5f4104680 0x7fb5f4114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:51.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.854+0000 7fb5f9200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f4114ad0 con 0x7fb5f41033d0 2024-04-26T21:28:51.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.854+0000 7fb5f9200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f4119470 con 0x7fb5f4104680 2024-04-26T21:28:51.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.854+0000 7fb5f1e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f41033d0 0x7fb5f4113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:51.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.855+0000 7fb5f1e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f41033d0 0x7fb5f4113f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50642/0 (socket says 172.21.15.84:50642) 2024-04-26T21:28:51.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.855+0000 7fb5f1e00700 1 -- 172.21.15.84:0/1680527781 learned_addr learned my addr 172.21.15.84:0/1680527781 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:28:51.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.855+0000 7fb5f1400700 1 --2- 172.21.15.84:0/1680527781 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5f4104680 0x7fb5f4114440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:51.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.855+0000 7fb5f1e00700 1 -- 172.21.15.84:0/1680527781 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5f4104680 msgr2=0x7fb5f4114440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:51.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.855+0000 7fb5f1e00700 1 --2- 172.21.15.84:0/1680527781 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5f4104680 0x7fb5f4114440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:51.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.855+0000 7fb5f1e00700 1 -- 172.21.15.84:0/1680527781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e4005040 con 0x7fb5f41033d0 2024-04-26T21:28:51.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.855+0000 7fb5f1400700 1 --2- 172.21.15.84:0/1680527781 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5f4104680 0x7fb5f4114440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:28:51.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.855+0000 7fb5f1e00700 1 --2- 172.21.15.84:0/1680527781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f41033d0 0x7fb5f4113f00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009150 tx=0x7fb5e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:51.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.855+0000 7fb5ea000700 1 -- 172.21.15.84:0/1680527781 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5e400e040 con 0x7fb5f41033d0 2024-04-26T21:28:51.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.856+0000 7fb5ea000700 1 -- 172.21.15.84:0/1680527781 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb5e400bbf0 con 0x7fb5f41033d0 2024-04-26T21:28:51.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.856+0000 7fb5f9200700 1 -- 172.21.15.84:0/1680527781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f4119670 con 0x7fb5f41033d0 2024-04-26T21:28:51.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.856+0000 7fb5ea000700 1 -- 172.21.15.84:0/1680527781 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5e401c630 con 0x7fb5f41033d0 2024-04-26T21:28:51.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.856+0000 7fb5f9200700 1 -- 172.21.15.84:0/1680527781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f4119be0 con 0x7fb5f41033d0 2024-04-26T21:28:51.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.857+0000 7fb5f9200700 1 -- 172.21.15.84:0/1680527781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f404c710 con 0x7fb5f41033d0 2024-04-26T21:28:51.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.858+0000 7fb5ea000700 1 -- 172.21.15.84:0/1680527781 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fb5e400bd60 con 0x7fb5f41033d0 2024-04-26T21:28:51.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.859+0000 7fb5ea000700 1 --2- 172.21.15.84:0/1680527781 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb5d806ed30 0x7fb5d80711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:51.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.859+0000 7fb5ea000700 1 -- 172.21.15.84:0/1680527781 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb5e408feb0 con 0x7fb5f41033d0 2024-04-26T21:28:51.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.859+0000 7fb5f1400700 1 --2- 172.21.15.84:0/1680527781 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb5d806ed30 0x7fb5d80711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:51.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.860+0000 7fb5f1400700 1 --2- 172.21.15.84:0/1680527781 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb5d806ed30 0x7fb5d80711e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0006fd0 tx=0x7fb5e0008040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:51.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:51.864+0000 7fb5ea000700 1 -- 172.21.15.84:0/1680527781 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fb5e405c5f0 con 0x7fb5f41033d0 2024-04-26T21:28:52.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.110+0000 7fb5f9200700 1 -- 172.21.15.84:0/1680527781 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5f4108920 con 0x7fb5d806ed30 2024-04-26T21:28:52.112 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:51 smithi084 ceph-mon[90138]: Reconfiguring osd.3 (monmap changed)... 2024-04-26T21:28:52.112 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:51 smithi084 ceph-mon[90138]: Reconfiguring daemon osd.3 on smithi120 2024-04-26T21:28:52.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.113+0000 7fb5ea000700 1 -- 172.21.15.84:0/1680527781 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fb5f4108920 con 0x7fb5d806ed30 2024-04-26T21:28:52.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.116+0000 7fb5f9200700 1 -- 172.21.15.84:0/1680527781 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb5d806ed30 msgr2=0x7fb5d80711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:52.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.116+0000 7fb5f9200700 1 --2- 172.21.15.84:0/1680527781 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb5d806ed30 0x7fb5d80711e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0006fd0 tx=0x7fb5e0008040 comp rx=0 tx=0).stop 2024-04-26T21:28:52.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.116+0000 7fb5f9200700 1 -- 172.21.15.84:0/1680527781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f41033d0 msgr2=0x7fb5f4113f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:52.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.116+0000 7fb5f9200700 1 --2- 172.21.15.84:0/1680527781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f41033d0 0x7fb5f4113f00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009150 tx=0x7fb5e4009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:52.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.116+0000 7fb5f9200700 1 -- 172.21.15.84:0/1680527781 shutdown_connections 2024-04-26T21:28:52.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.116+0000 7fb5f9200700 1 --2- 172.21.15.84:0/1680527781 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb5d806ed30 0x7fb5d80711e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:52.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.116+0000 7fb5f9200700 1 --2- 172.21.15.84:0/1680527781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f41033d0 0x7fb5f4113f00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:52.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.116+0000 7fb5f9200700 1 --2- 172.21.15.84:0/1680527781 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5f4104680 0x7fb5f4114440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:52.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.116+0000 7fb5f9200700 1 -- 172.21.15.84:0/1680527781 >> 172.21.15.84:0/1680527781 conn(0x7fb5f40725b0 msgr2=0x7fb5f4073b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:52.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.116+0000 7fb5f9200700 1 -- 172.21.15.84:0/1680527781 shutdown_connections 2024-04-26T21:28:52.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.117+0000 7fb5f9200700 1 -- 172.21.15.84:0/1680527781 wait complete. 2024-04-26T21:28:52.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:51 smithi120 ceph-mon[79001]: Reconfiguring osd.3 (monmap changed)... 2024-04-26T21:28:52.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:51 smithi120 ceph-mon[79001]: Reconfiguring daemon osd.3 on smithi120 2024-04-26T21:28:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.266+0000 7f8fad400700 1 -- 172.21.15.84:0/2962400645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa8102180 msgr2=0x7f8fa8104560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.266+0000 7f8fad400700 1 --2- 172.21.15.84:0/2962400645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa8102180 0x7f8fa8104560 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8f94004940 tx=0x7f8f94009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.267+0000 7f8fad400700 1 -- 172.21.15.84:0/2962400645 shutdown_connections 2024-04-26T21:28:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.267+0000 7f8fad400700 1 --2- 172.21.15.84:0/2962400645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa8102180 0x7f8fa8104560 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.267+0000 7f8fad400700 1 --2- 172.21.15.84:0/2962400645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8fa8066cf0 0x7f8fa8101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.267+0000 7f8fad400700 1 -- 172.21.15.84:0/2962400645 >> 172.21.15.84:0/2962400645 conn(0x7f8fa80f7270 msgr2=0x7f8fa80f9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.267+0000 7f8fad400700 1 -- 172.21.15.84:0/2962400645 shutdown_connections 2024-04-26T21:28:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.267+0000 7f8fad400700 1 -- 172.21.15.84:0/2962400645 wait complete. 2024-04-26T21:28:52.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.267+0000 7f8fad400700 1 Processor -- start 2024-04-26T21:28:52.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.268+0000 7f8fad400700 1 -- start start 2024-04-26T21:28:52.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.268+0000 7f8fad400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8fa8066cf0 0x7f8fa810fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.268+0000 7f8fad400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa8102180 0x7f8fa810ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.268+0000 7f8fad400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa8110560 con 0x7f8fa8102180 2024-04-26T21:28:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.268+0000 7f8fad400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa8110db0 con 0x7f8fa8066cf0 2024-04-26T21:28:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.268+0000 7f8fa7400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa8102180 0x7f8fa810ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.268+0000 7f8fa7400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa8102180 0x7f8fa810ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50674/0 (socket says 172.21.15.84:50674) 2024-04-26T21:28:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.268+0000 7f8fa7400700 1 -- 172.21.15.84:0/3225347394 learned_addr learned my addr 172.21.15.84:0/3225347394 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:28:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.268+0000 7f8fa7e00700 1 --2- 172.21.15.84:0/3225347394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8fa8066cf0 0x7f8fa810fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.269+0000 7f8fa7400700 1 -- 172.21.15.84:0/3225347394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8fa8066cf0 msgr2=0x7f8fa810fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.269+0000 7f8fa7400700 1 --2- 172.21.15.84:0/3225347394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8fa8066cf0 0x7f8fa810fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.269+0000 7f8fa7400700 1 -- 172.21.15.84:0/3225347394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f94005040 con 0x7f8fa8102180 2024-04-26T21:28:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.269+0000 7f8fa7400700 1 --2- 172.21.15.84:0/3225347394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa8102180 0x7f8fa810ff60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400b3b0 tx=0x7f8f94009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:52.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.269+0000 7f8f9fe00700 1 -- 172.21.15.84:0/3225347394 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f9400e040 con 0x7f8fa8102180 2024-04-26T21:28:52.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.269+0000 7f8f9fe00700 1 -- 172.21.15.84:0/3225347394 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f94004290 con 0x7f8fa8102180 2024-04-26T21:28:52.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.269+0000 7f8f9fe00700 1 -- 172.21.15.84:0/3225347394 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f9401c3f0 con 0x7f8fa8102180 2024-04-26T21:28:52.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.269+0000 7f8fad400700 1 -- 172.21.15.84:0/3225347394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa8111030 con 0x7f8fa8102180 2024-04-26T21:28:52.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.270+0000 7f8fad400700 1 -- 172.21.15.84:0/3225347394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa8111570 con 0x7f8fa8102180 2024-04-26T21:28:52.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.270+0000 7f8fad400700 1 -- 172.21.15.84:0/3225347394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa80faef0 con 0x7f8fa8102180 2024-04-26T21:28:52.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.272+0000 7f8f9fe00700 1 -- 172.21.15.84:0/3225347394 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f8f9400bbf0 con 0x7f8fa8102180 2024-04-26T21:28:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.272+0000 7f8f9fe00700 1 --2- 172.21.15.84:0/3225347394 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8f8c06ed30 0x7f8f8c0711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.273+0000 7f8f9fe00700 1 -- 172.21.15.84:0/3225347394 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8f9408fc80 con 0x7f8fa8102180 2024-04-26T21:28:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.273+0000 7f8fa7e00700 1 --2- 172.21.15.84:0/3225347394 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8f8c06ed30 0x7f8f8c0711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.273+0000 7f8fa7e00700 1 --2- 172.21.15.84:0/3225347394 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8f8c06ed30 0x7f8f8c0711e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8066a30 tx=0x7f8f9800b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:52.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.278+0000 7f8f9fe00700 1 -- 172.21.15.84:0/3225347394 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f8f9405c500 con 0x7f8fa8102180 2024-04-26T21:28:52.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.515+0000 7f8fad400700 1 -- 172.21.15.84:0/3225347394 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fa81119b0 con 0x7f8f8c06ed30 2024-04-26T21:28:52.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.546+0000 7f8f9fe00700 1 -- 172.21.15.84:0/3225347394 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f8fa81119b0 con 0x7f8f8c06ed30 2024-04-26T21:28:52.549 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:28:52.549 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (3m) 56s ago 14m 16.1M - 0.25.0 c8568f914cd2 bcb419cf9108 2024-04-26T21:28:52.549 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (14m) 56s ago 14m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 a111b0ee8187 2024-04-26T21:28:52.549 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (13m) 35s ago 13m 6669k - 17.2.7-907-g2be3efa9 1c5834633715 66f4d21263a1 2024-04-26T21:28:52.549 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (3m) 56s ago 14m 76.3M - 9.4.7 954c08fa6188 1bf95f604e07 2024-04-26T21:28:52.549 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (7m) 56s ago 7m 130M - 17.2.7-907-g2be3efa9 1c5834633715 485d7884e1d5 2024-04-26T21:28:52.549 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (7m) 56s ago 7m 13.3M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:28:52.549 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (7m) 35s ago 7m 118M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:28:52.549 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (7m) 35s ago 7m 13.5M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:28:52.549 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (3m) 56s ago 16m 479M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:28:52.549 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283,8765 running (107s) 35s ago 13m 450M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d6ae0b4628b5 2024-04-26T21:28:52.550 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (81s) 56s ago 16m 30.4M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 bf610abb6a62 2024-04-26T21:28:52.550 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (40s) 35s ago 13m 23.6M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 5d530496253b 2024-04-26T21:28:52.550 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (3m) 56s ago 14m 7780k - 1.5.0 0da6a335fe13 81e00b40bfbf 2024-04-26T21:28:52.550 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (3m) 35s ago 13m 7453k - 1.5.0 0da6a335fe13 0506a1d46ec4 2024-04-26T21:28:52.550 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (12m) 56s ago 12m 193M 1557M 17.2.7-907-g2be3efa9 1c5834633715 3a2e74d7e51a 2024-04-26T21:28:52.550 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (11m) 56s ago 11m 198M 1557M 17.2.7-907-g2be3efa9 1c5834633715 d283a0a93213 2024-04-26T21:28:52.550 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (11m) 56s ago 11m 156M 1557M 17.2.7-907-g2be3efa9 1c5834633715 5899468fc5c8 2024-04-26T21:28:52.550 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (10m) 35s ago 10m 229M 2581M 17.2.7-907-g2be3efa9 1c5834633715 b8a14c87d730 2024-04-26T21:28:52.550 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (9m) 35s ago 9m 216M 2581M 17.2.7-907-g2be3efa9 1c5834633715 4d294df735a3 2024-04-26T21:28:52.550 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (9m) 35s ago 9m 200M 2581M 17.2.7-907-g2be3efa9 1c5834633715 9b60997971a8 2024-04-26T21:28:52.550 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (116s) 56s ago 13m 45.5M - 2.43.0 a07b618ecd1d d3008b765eec 2024-04-26T21:28:52.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.549+0000 7f8fad400700 1 -- 172.21.15.84:0/3225347394 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8f8c06ed30 msgr2=0x7f8f8c0711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:52.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.549+0000 7f8fad400700 1 --2- 172.21.15.84:0/3225347394 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8f8c06ed30 0x7f8f8c0711e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8066a30 tx=0x7f8f9800b040 comp rx=0 tx=0).stop 2024-04-26T21:28:52.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.549+0000 7f8fad400700 1 -- 172.21.15.84:0/3225347394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa8102180 msgr2=0x7f8fa810ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:52.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.549+0000 7f8fad400700 1 --2- 172.21.15.84:0/3225347394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa8102180 0x7f8fa810ff60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400b3b0 tx=0x7f8f94009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:52.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.550+0000 7f8fad400700 1 -- 172.21.15.84:0/3225347394 shutdown_connections 2024-04-26T21:28:52.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.550+0000 7f8fad400700 1 --2- 172.21.15.84:0/3225347394 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8f8c06ed30 0x7f8f8c0711e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:52.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.550+0000 7f8fad400700 1 --2- 172.21.15.84:0/3225347394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8fa8066cf0 0x7f8fa810fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:52.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.550+0000 7f8fad400700 1 --2- 172.21.15.84:0/3225347394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa8102180 0x7f8fa810ff60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:52.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.550+0000 7f8fad400700 1 -- 172.21.15.84:0/3225347394 >> 172.21.15.84:0/3225347394 conn(0x7f8fa80f7270 msgr2=0x7f8fa80f7640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:52.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.550+0000 7f8fad400700 1 -- 172.21.15.84:0/3225347394 shutdown_connections 2024-04-26T21:28:52.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.550+0000 7f8fad400700 1 -- 172.21.15.84:0/3225347394 wait complete. 2024-04-26T21:28:52.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.693+0000 7f5515800700 1 -- 172.21.15.84:0/2702222729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55100fdfd0 msgr2=0x7f55100fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:52.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.693+0000 7f5515800700 1 --2- 172.21.15.84:0/2702222729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55100fdfd0 0x7f55100fe440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f54fc004940 tx=0x7f54fc009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:52.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.694+0000 7f5515800700 1 -- 172.21.15.84:0/2702222729 shutdown_connections 2024-04-26T21:28:52.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.694+0000 7f5515800700 1 --2- 172.21.15.84:0/2702222729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55100fdfd0 0x7f55100fe440 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:52.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.694+0000 7f5515800700 1 --2- 172.21.15.84:0/2702222729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55100fce60 0x7f55100fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:52.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.694+0000 7f5515800700 1 -- 172.21.15.84:0/2702222729 >> 172.21.15.84:0/2702222729 conn(0x7f55100f8540 msgr2=0x7f55100fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:52.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.694+0000 7f5515800700 1 -- 172.21.15.84:0/2702222729 shutdown_connections 2024-04-26T21:28:52.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.694+0000 7f5515800700 1 -- 172.21.15.84:0/2702222729 wait complete. 2024-04-26T21:28:52.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.694+0000 7f5515800700 1 Processor -- start 2024-04-26T21:28:52.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.695+0000 7f5515800700 1 -- start start 2024-04-26T21:28:52.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.695+0000 7f5515800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55100fce60 0x7f551010fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:52.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.695+0000 7f5515800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55100fdfd0 0x7f5510110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:52.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.695+0000 7f5515800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5510110650 con 0x7f55100fdfd0 2024-04-26T21:28:52.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.695+0000 7f5515800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55101107c0 con 0x7f55100fce60 2024-04-26T21:28:52.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.695+0000 7f550e000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55100fdfd0 0x7f5510110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:52.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.695+0000 7f550e000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55100fdfd0 0x7f5510110050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50690/0 (socket says 172.21.15.84:50690) 2024-04-26T21:28:52.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.695+0000 7f550e000700 1 -- 172.21.15.84:0/2695424899 learned_addr learned my addr 172.21.15.84:0/2695424899 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:28:52.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.696+0000 7f550ea00700 1 --2- 172.21.15.84:0/2695424899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55100fce60 0x7f551010fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:52.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.696+0000 7f550e000700 1 -- 172.21.15.84:0/2695424899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55100fce60 msgr2=0x7f551010fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:52.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.696+0000 7f550e000700 1 --2- 172.21.15.84:0/2695424899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55100fce60 0x7f551010fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:52.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.696+0000 7f550e000700 1 -- 172.21.15.84:0/2695424899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc005040 con 0x7f55100fdfd0 2024-04-26T21:28:52.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.696+0000 7f550e000700 1 --2- 172.21.15.84:0/2695424899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55100fdfd0 0x7f5510110050 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00b3b0 tx=0x7f54fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:52.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.696+0000 7f5506a00700 1 -- 172.21.15.84:0/2695424899 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54fc00e040 con 0x7f55100fdfd0 2024-04-26T21:28:52.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.696+0000 7f5506a00700 1 -- 172.21.15.84:0/2695424899 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f54fc004290 con 0x7f55100fdfd0 2024-04-26T21:28:52.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.696+0000 7f5506a00700 1 -- 172.21.15.84:0/2695424899 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54fc01c630 con 0x7f55100fdfd0 2024-04-26T21:28:52.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.696+0000 7f5515800700 1 -- 172.21.15.84:0/2695424899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55101151c0 con 0x7f55100fdfd0 2024-04-26T21:28:52.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.697+0000 7f5515800700 1 -- 172.21.15.84:0/2695424899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5510115780 con 0x7f55100fdfd0 2024-04-26T21:28:52.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.698+0000 7f5515800700 1 -- 172.21.15.84:0/2695424899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5510101960 con 0x7f55100fdfd0 2024-04-26T21:28:52.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.698+0000 7f5506a00700 1 -- 172.21.15.84:0/2695424899 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f54fc00bbf0 con 0x7f55100fdfd0 2024-04-26T21:28:52.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.699+0000 7f5506a00700 1 --2- 172.21.15.84:0/2695424899 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f54f406ed30 0x7f54f40711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:52.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.700+0000 7f5506a00700 1 -- 172.21.15.84:0/2695424899 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f54fc08ff20 con 0x7f55100fdfd0 2024-04-26T21:28:52.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.700+0000 7f550ea00700 1 --2- 172.21.15.84:0/2695424899 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f54f406ed30 0x7f54f40711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:52.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.700+0000 7f550ea00700 1 --2- 172.21.15.84:0/2695424899 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f54f406ed30 0x7f54f40711e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5500004990 tx=0x7f5500009ee0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:52.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:52.705+0000 7f5506a00700 1 -- 172.21.15.84:0/2695424899 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f54fc05c660 con 0x7f55100fdfd0 2024-04-26T21:28:53.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.006+0000 7f5515800700 1 -- 172.21.15.84:0/2695424899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f55101058c0 con 0x7f55100fdfd0 2024-04-26T21:28:53.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.008+0000 7f5506a00700 1 -- 172.21.15.84:0/2695424899 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f54fc05c1f0 con 0x7f55100fdfd0 2024-04-26T21:28:53.009 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:28:53.009 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:28:53.009 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:28:53.009 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:28:53.010 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:28:53.010 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:28:53.010 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:28:53.010 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:28:53.010 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-26T21:28:53.010 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:28:53.010 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:28:53.010 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-26T21:28:53.010 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:28:53.010 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:28:53.010 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 10, 2024-04-26T21:28:53.010 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 4 2024-04-26T21:28:53.010 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:28:53.010 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:28:53.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.010+0000 7f5515800700 1 -- 172.21.15.84:0/2695424899 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f54f406ed30 msgr2=0x7f54f40711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:53.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.010+0000 7f5515800700 1 --2- 172.21.15.84:0/2695424899 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f54f406ed30 0x7f54f40711e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5500004990 tx=0x7f5500009ee0 comp rx=0 tx=0).stop 2024-04-26T21:28:53.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.010+0000 7f5515800700 1 -- 172.21.15.84:0/2695424899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55100fdfd0 msgr2=0x7f5510110050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:53.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.010+0000 7f5515800700 1 --2- 172.21.15.84:0/2695424899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55100fdfd0 0x7f5510110050 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00b3b0 tx=0x7f54fc009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:53.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.011+0000 7f5515800700 1 -- 172.21.15.84:0/2695424899 shutdown_connections 2024-04-26T21:28:53.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.011+0000 7f5515800700 1 --2- 172.21.15.84:0/2695424899 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f54f406ed30 0x7f54f40711e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.011+0000 7f5515800700 1 --2- 172.21.15.84:0/2695424899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55100fce60 0x7f551010fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.011+0000 7f5515800700 1 --2- 172.21.15.84:0/2695424899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55100fdfd0 0x7f5510110050 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.011+0000 7f5515800700 1 -- 172.21.15.84:0/2695424899 >> 172.21.15.84:0/2695424899 conn(0x7f55100f8540 msgr2=0x7f55100f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.011+0000 7f5515800700 1 -- 172.21.15.84:0/2695424899 shutdown_connections 2024-04-26T21:28:53.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.011+0000 7f5515800700 1 -- 172.21.15.84:0/2695424899 wait complete. 2024-04-26T21:28:53.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.157+0000 7f7269200700 1 -- 172.21.15.84:0/2224050600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72640662c0 msgr2=0x7f72640fd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:53.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.157+0000 7f7269200700 1 --2- 172.21.15.84:0/2224050600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72640662c0 0x7f72640fd790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7254009ce0 tx=0x7f7254004d10 comp rx=0 tx=0).stop 2024-04-26T21:28:53.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.157+0000 7f7269200700 1 -- 172.21.15.84:0/2224050600 shutdown_connections 2024-04-26T21:28:53.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.157+0000 7f7269200700 1 --2- 172.21.15.84:0/2224050600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72640fdcd0 0x7f7264100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:53.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.157+0000 7f7269200700 1 --2- 172.21.15.84:0/2224050600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72640662c0 0x7f72640fd790 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:53.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.157+0000 7f7269200700 1 -- 172.21.15.84:0/2224050600 >> 172.21.15.84:0/2224050600 conn(0x7f72640f7430 msgr2=0x7f72640f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:53.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.157+0000 7f7269200700 1 -- 172.21.15.84:0/2224050600 shutdown_connections 2024-04-26T21:28:53.161 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:52 smithi084 ceph-mon[90138]: from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:28:53.161 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:52 smithi084 ceph-mon[90138]: pgmap v37: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-04-26T21:28:53.161 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:52 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:53.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:52 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:53.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:52 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T21:28:53.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:52 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:53.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.158+0000 7f7269200700 1 -- 172.21.15.84:0/2224050600 wait complete. 2024-04-26T21:28:53.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.158+0000 7f7269200700 1 Processor -- start 2024-04-26T21:28:53.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.158+0000 7f7269200700 1 -- start start 2024-04-26T21:28:53.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.159+0000 7f7269200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72640662c0 0x7f7264114190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:53.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.159+0000 7f7269200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72640fdcd0 0x7f72641146d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:53.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.159+0000 7f7269200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7264114cd0 con 0x7f72640fdcd0 2024-04-26T21:28:53.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.159+0000 7f7269200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7264115520 con 0x7f72640662c0 2024-04-26T21:28:53.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.159+0000 7f725be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72640fdcd0 0x7f72641146d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:53.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.159+0000 7f725be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72640fdcd0 0x7f72641146d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50698/0 (socket says 172.21.15.84:50698) 2024-04-26T21:28:53.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.159+0000 7f725be00700 1 -- 172.21.15.84:0/3987828028 learned_addr learned my addr 172.21.15.84:0/3987828028 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:28:53.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.159+0000 7f7261e00700 1 --2- 172.21.15.84:0/3987828028 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72640662c0 0x7f7264114190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:53.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.160+0000 7f725be00700 1 -- 172.21.15.84:0/3987828028 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72640662c0 msgr2=0x7f7264114190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:53.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.160+0000 7f725be00700 1 --2- 172.21.15.84:0/3987828028 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72640662c0 0x7f7264114190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:53.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.160+0000 7f725be00700 1 -- 172.21.15.84:0/3987828028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7254009940 con 0x7f72640fdcd0 2024-04-26T21:28:53.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.160+0000 7f725be00700 1 --2- 172.21.15.84:0/3987828028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72640fdcd0 0x7f72641146d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f724c00c830 tx=0x7f724c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:53.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.160+0000 7f725a000700 1 -- 172.21.15.84:0/3987828028 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f724c0106f0 con 0x7f72640fdcd0 2024-04-26T21:28:53.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.160+0000 7f725a000700 1 -- 172.21.15.84:0/3987828028 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f724c010d20 con 0x7f72640fdcd0 2024-04-26T21:28:53.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.160+0000 7f725a000700 1 -- 172.21.15.84:0/3987828028 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f724c0113a0 con 0x7f72640fdcd0 2024-04-26T21:28:53.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.160+0000 7f7269200700 1 -- 172.21.15.84:0/3987828028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7264115800 con 0x7f72640fdcd0 2024-04-26T21:28:53.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.160+0000 7f7269200700 1 -- 172.21.15.84:0/3987828028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7264115d40 con 0x7f72640fdcd0 2024-04-26T21:28:53.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.162+0000 7f7269200700 1 -- 172.21.15.84:0/3987828028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726405f5c0 con 0x7f72640fdcd0 2024-04-26T21:28:53.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.164+0000 7f725a000700 1 -- 172.21.15.84:0/3987828028 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f724c012400 con 0x7f72640fdcd0 2024-04-26T21:28:53.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.164+0000 7f725a000700 1 --2- 172.21.15.84:0/3987828028 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f724806ed20 0x7f72480711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:53.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.164+0000 7f725a000700 1 -- 172.21.15.84:0/3987828028 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f724c08e980 con 0x7f72640fdcd0 2024-04-26T21:28:53.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.164+0000 7f7261e00700 1 --2- 172.21.15.84:0/3987828028 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f724806ed20 0x7f72480711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:53.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.164+0000 7f7261e00700 1 --2- 172.21.15.84:0/3987828028 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f724806ed20 0x7f72480711d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7254009470 tx=0x7f7254004d10 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:53.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.170+0000 7f725a000700 1 -- 172.21.15.84:0/3987828028 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f724c05b1d0 con 0x7f72640fdcd0 2024-04-26T21:28:53.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:52 smithi120 ceph-mon[79001]: from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:28:53.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:52 smithi120 ceph-mon[79001]: pgmap v37: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-04-26T21:28:53.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:52 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:53.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:52 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:53.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:52 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T21:28:53.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:52 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:53.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.423+0000 7f7269200700 1 -- 172.21.15.84:0/3987828028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f726404bed0 con 0x7f72640fdcd0 2024-04-26T21:28:53.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.424+0000 7f725a000700 1 -- 172.21.15.84:0/3987828028 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1922 (secure 0 0 0) 0x7f724c05ad60 con 0x7f72640fdcd0 2024-04-26T21:28:53.425 INFO:teuthology.orchestra.run.smithi084.stdout:e15 2024-04-26T21:28:53.425 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:28:53.425 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:28:53.425 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:28:53.425 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:28:53.425 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:28:53.425 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:28:53.425 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 15 2024-04-26T21:28:53.426 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:28:53.426 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:28:53.426 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:27:24.731661+0000 2024-04-26T21:28:53.426 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:28:53.426 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:28:53.426 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:28:53.426 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:28:53.426 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:28:53.426 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-04-26T21:28:53.426 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:28:53.426 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:28:53.426 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:28:53.426 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:28:53.426 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:28:53.426 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:28:53.427 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456,1=24231} 2024-04-26T21:28:53.427 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:28:53.427 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:28:53.427 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:28:53.427 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:28:53.427 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:28:53.427 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:28:53.427 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:28:53.427 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-04-26T21:28:53.427 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:28:53.427 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 0 members: 2024-04-26T21:28:53.427 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:28:53.427 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:28:53.427 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:28:53.427 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:28:53.428 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:28:53.428 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:28:53.428 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:28:53.428 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:28:53.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.427+0000 7f7269200700 1 -- 172.21.15.84:0/3987828028 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f724806ed20 msgr2=0x7f72480711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:53.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.427+0000 7f7269200700 1 --2- 172.21.15.84:0/3987828028 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f724806ed20 0x7f72480711d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7254009470 tx=0x7f7254004d10 comp rx=0 tx=0).stop 2024-04-26T21:28:53.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.427+0000 7f7269200700 1 -- 172.21.15.84:0/3987828028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72640fdcd0 msgr2=0x7f72641146d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:53.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.427+0000 7f7269200700 1 --2- 172.21.15.84:0/3987828028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72640fdcd0 0x7f72641146d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f724c00c830 tx=0x7f724c004470 comp rx=0 tx=0).stop 2024-04-26T21:28:53.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.427+0000 7f7269200700 1 -- 172.21.15.84:0/3987828028 shutdown_connections 2024-04-26T21:28:53.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.427+0000 7f7269200700 1 --2- 172.21.15.84:0/3987828028 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f724806ed20 0x7f72480711d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:53.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.427+0000 7f7269200700 1 --2- 172.21.15.84:0/3987828028 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72640662c0 0x7f7264114190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:53.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.427+0000 7f7269200700 1 --2- 172.21.15.84:0/3987828028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72640fdcd0 0x7f72641146d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:53.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.427+0000 7f7269200700 1 -- 172.21.15.84:0/3987828028 >> 172.21.15.84:0/3987828028 conn(0x7f72640f7430 msgr2=0x7f72640f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:53.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.427+0000 7f7269200700 1 -- 172.21.15.84:0/3987828028 shutdown_connections 2024-04-26T21:28:53.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.427+0000 7f7269200700 1 -- 172.21.15.84:0/3987828028 wait complete. 2024-04-26T21:28:53.430 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 15 2024-04-26T21:28:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.569+0000 7fdbbae00700 1 -- 172.21.15.84:0/2020311596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbb41002a0 msgr2=0x7fdbb4100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.569+0000 7fdbbae00700 1 --2- 172.21.15.84:0/2020311596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbb41002a0 0x7fdbb4100710 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdba0004940 tx=0x7fdba0009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.569+0000 7fdbbae00700 1 -- 172.21.15.84:0/2020311596 shutdown_connections 2024-04-26T21:28:53.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.569+0000 7fdbbae00700 1 --2- 172.21.15.84:0/2020311596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbb41002a0 0x7fdbb4100710 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:53.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.569+0000 7fdbbae00700 1 --2- 172.21.15.84:0/2020311596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdbb40feff0 0x7fdbb40ff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:53.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.569+0000 7fdbbae00700 1 -- 172.21.15.84:0/2020311596 >> 172.21.15.84:0/2020311596 conn(0x7fdbb40fa8f0 msgr2=0x7fdbb40fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:53.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.569+0000 7fdbbae00700 1 -- 172.21.15.84:0/2020311596 shutdown_connections 2024-04-26T21:28:53.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.569+0000 7fdbbae00700 1 -- 172.21.15.84:0/2020311596 wait complete. 2024-04-26T21:28:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.570+0000 7fdbbae00700 1 Processor -- start 2024-04-26T21:28:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.571+0000 7fdbbae00700 1 -- start start 2024-04-26T21:28:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.571+0000 7fdbbae00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbb40feff0 0x7fdbb410fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.571+0000 7fdbbae00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdbb41002a0 0x7fdbb4110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.571+0000 7fdbbae00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb4110680 con 0x7fdbb40feff0 2024-04-26T21:28:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.571+0000 7fdbbae00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb41107f0 con 0x7fdbb41002a0 2024-04-26T21:28:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.571+0000 7fdbb3e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbb40feff0 0x7fdbb410fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.572+0000 7fdbb3400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdbb41002a0 0x7fdbb4110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.572+0000 7fdbb3e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbb40feff0 0x7fdbb410fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50704/0 (socket says 172.21.15.84:50704) 2024-04-26T21:28:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.572+0000 7fdbb3e00700 1 -- 172.21.15.84:0/4072294436 learned_addr learned my addr 172.21.15.84:0/4072294436 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:28:53.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.572+0000 7fdbb3e00700 1 -- 172.21.15.84:0/4072294436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdbb41002a0 msgr2=0x7fdbb4110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:53.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.572+0000 7fdbb3e00700 1 --2- 172.21.15.84:0/4072294436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdbb41002a0 0x7fdbb4110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:53.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.572+0000 7fdbb3e00700 1 -- 172.21.15.84:0/4072294436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba0005040 con 0x7fdbb40feff0 2024-04-26T21:28:53.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.572+0000 7fdbb3e00700 1 --2- 172.21.15.84:0/4072294436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbb40feff0 0x7fdbb410fb40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdba4002a50 tx=0x7fdba40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:53.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.573+0000 7fdbabe00700 1 -- 172.21.15.84:0/4072294436 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdba4007cc0 con 0x7fdbb40feff0 2024-04-26T21:28:53.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.573+0000 7fdbabe00700 1 -- 172.21.15.84:0/4072294436 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdba400f040 con 0x7fdbb40feff0 2024-04-26T21:28:53.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.573+0000 7fdbbae00700 1 -- 172.21.15.84:0/4072294436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb4115250 con 0x7fdbb40feff0 2024-04-26T21:28:53.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.573+0000 7fdbabe00700 1 -- 172.21.15.84:0/4072294436 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdba400da30 con 0x7fdbb40feff0 2024-04-26T21:28:53.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.573+0000 7fdbbae00700 1 -- 172.21.15.84:0/4072294436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb4115810 con 0x7fdbb40feff0 2024-04-26T21:28:53.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.574+0000 7fdbbae00700 1 -- 172.21.15.84:0/4072294436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb404c710 con 0x7fdbb40feff0 2024-04-26T21:28:53.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.575+0000 7fdbabe00700 1 -- 172.21.15.84:0/4072294436 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fdba400db90 con 0x7fdbb40feff0 2024-04-26T21:28:53.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.576+0000 7fdbabe00700 1 --2- 172.21.15.84:0/4072294436 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdb9806ed30 0x7fdb980711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:53.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.576+0000 7fdbabe00700 1 -- 172.21.15.84:0/4072294436 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fdba408e8a0 con 0x7fdbb40feff0 2024-04-26T21:28:53.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.576+0000 7fdbb3400700 1 --2- 172.21.15.84:0/4072294436 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdb9806ed30 0x7fdb980711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:53.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.577+0000 7fdbb3400700 1 --2- 172.21.15.84:0/4072294436 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdb9806ed30 0x7fdb980711e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdba000b3b0 tx=0x7fdba0009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:53.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.581+0000 7fdbabe00700 1 -- 172.21.15.84:0/4072294436 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fdba405af60 con 0x7fdbb40feff0 2024-04-26T21:28:53.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.827+0000 7fdbbae00700 1 -- 172.21.15.84:0/4072294436 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbb41045c0 con 0x7fdb9806ed30 2024-04-26T21:28:53.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.829+0000 7fdbabe00700 1 -- 172.21.15.84:0/4072294436 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fdbb41045c0 con 0x7fdb9806ed30 2024-04-26T21:28:53.830 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:28:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:28:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:28:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:28:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-04-26T21:28:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr", 2024-04-26T21:28:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: "mon" 2024-04-26T21:28:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-04-26T21:28:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "4/21 daemons upgraded", 2024-04-26T21:28:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading mon daemons", 2024-04-26T21:28:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:28:53.830 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:28:53.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.831+0000 7fdbbae00700 1 -- 172.21.15.84:0/4072294436 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdb9806ed30 msgr2=0x7fdb980711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:53.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.831+0000 7fdbbae00700 1 --2- 172.21.15.84:0/4072294436 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdb9806ed30 0x7fdb980711e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdba000b3b0 tx=0x7fdba0009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:53.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.831+0000 7fdbbae00700 1 -- 172.21.15.84:0/4072294436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbb40feff0 msgr2=0x7fdbb410fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:53.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.831+0000 7fdbbae00700 1 --2- 172.21.15.84:0/4072294436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbb40feff0 0x7fdbb410fb40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdba4002a50 tx=0x7fdba40046b0 comp rx=0 tx=0).stop 2024-04-26T21:28:53.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.832+0000 7fdbbae00700 1 -- 172.21.15.84:0/4072294436 shutdown_connections 2024-04-26T21:28:53.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.832+0000 7fdbbae00700 1 --2- 172.21.15.84:0/4072294436 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdb9806ed30 0x7fdb980711e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:53.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.832+0000 7fdbbae00700 1 --2- 172.21.15.84:0/4072294436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbb40feff0 0x7fdbb410fb40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:53.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.832+0000 7fdbbae00700 1 --2- 172.21.15.84:0/4072294436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdbb41002a0 0x7fdbb4110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:53.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.832+0000 7fdbbae00700 1 -- 172.21.15.84:0/4072294436 >> 172.21.15.84:0/4072294436 conn(0x7fdbb40fa8f0 msgr2=0x7fdbb40fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:53.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.832+0000 7fdbbae00700 1 -- 172.21.15.84:0/4072294436 shutdown_connections 2024-04-26T21:28:53.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.832+0000 7fdbbae00700 1 -- 172.21.15.84:0/4072294436 wait complete. 2024-04-26T21:28:53.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.975+0000 7fb78ca00700 1 -- 172.21.15.84:0/358610857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7880fce60 msgr2=0x7fb7880fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:53.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.975+0000 7fb78ca00700 1 --2- 172.21.15.84:0/358610857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7880fce60 0x7fb7880fd270 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb778004940 tx=0x7fb778009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:53.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.975+0000 7fb78ca00700 1 -- 172.21.15.84:0/358610857 shutdown_connections 2024-04-26T21:28:53.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.975+0000 7fb78ca00700 1 --2- 172.21.15.84:0/358610857 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7880fdfd0 0x7fb7880fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:53.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.975+0000 7fb78ca00700 1 --2- 172.21.15.84:0/358610857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7880fce60 0x7fb7880fd270 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:53.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.976+0000 7fb78ca00700 1 -- 172.21.15.84:0/358610857 >> 172.21.15.84:0/358610857 conn(0x7fb7880f8500 msgr2=0x7fb7880fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:53.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.976+0000 7fb78ca00700 1 -- 172.21.15.84:0/358610857 shutdown_connections 2024-04-26T21:28:53.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.976+0000 7fb78ca00700 1 -- 172.21.15.84:0/358610857 wait complete. 2024-04-26T21:28:53.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.977+0000 7fb78ca00700 1 Processor -- start 2024-04-26T21:28:53.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.977+0000 7fb78ca00700 1 -- start start 2024-04-26T21:28:53.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.977+0000 7fb78ca00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7880fce60 0x7fb78810da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:53.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.977+0000 7fb78ca00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7880fdfd0 0x7fb78810df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:53.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.977+0000 7fb78ca00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78810e5f0 con 0x7fb7880fce60 2024-04-26T21:28:53.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.977+0000 7fb78ca00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78810ede0 con 0x7fb7880fdfd0 2024-04-26T21:28:53.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.977+0000 7fb785e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7880fce60 0x7fb78810da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:53.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.977+0000 7fb785e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7880fce60 0x7fb78810da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50726/0 (socket says 172.21.15.84:50726) 2024-04-26T21:28:53.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.977+0000 7fb785e00700 1 -- 172.21.15.84:0/2429145776 learned_addr learned my addr 172.21.15.84:0/2429145776 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:28:53.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.978+0000 7fb785e00700 1 -- 172.21.15.84:0/2429145776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7880fdfd0 msgr2=0x7fb78810df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:53.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.978+0000 7fb785e00700 1 --2- 172.21.15.84:0/2429145776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7880fdfd0 0x7fb78810df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:53.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.978+0000 7fb785e00700 1 -- 172.21.15.84:0/2429145776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb778005040 con 0x7fb7880fce60 2024-04-26T21:28:53.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.978+0000 7fb785e00700 1 --2- 172.21.15.84:0/2429145776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7880fce60 0x7fb78810da20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb77800b3b0 tx=0x7fb778009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:53.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.978+0000 7fb77e000700 1 -- 172.21.15.84:0/2429145776 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb77800e040 con 0x7fb7880fce60 2024-04-26T21:28:53.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.978+0000 7fb77e000700 1 -- 172.21.15.84:0/2429145776 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb778004290 con 0x7fb7880fce60 2024-04-26T21:28:53.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.978+0000 7fb77e000700 1 -- 172.21.15.84:0/2429145776 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb77801c630 con 0x7fb7880fce60 2024-04-26T21:28:53.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.978+0000 7fb78ca00700 1 -- 172.21.15.84:0/2429145776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78810f060 con 0x7fb7880fce60 2024-04-26T21:28:53.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.978+0000 7fb78ca00700 1 -- 172.21.15.84:0/2429145776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78810f5d0 con 0x7fb7880fce60 2024-04-26T21:28:53.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.979+0000 7fb78ca00700 1 -- 172.21.15.84:0/2429145776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78805f5c0 con 0x7fb7880fce60 2024-04-26T21:28:53.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.981+0000 7fb77e000700 1 -- 172.21.15.84:0/2429145776 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fb77800bbf0 con 0x7fb7880fce60 2024-04-26T21:28:53.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.982+0000 7fb77e000700 1 --2- 172.21.15.84:0/2429145776 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb76c06ed20 0x7fb76c0711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:28:53.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.982+0000 7fb77e000700 1 -- 172.21.15.84:0/2429145776 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb7780909e0 con 0x7fb7880fce60 2024-04-26T21:28:53.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.982+0000 7fb785400700 1 --2- 172.21.15.84:0/2429145776 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb76c06ed20 0x7fb76c0711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:28:53.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.983+0000 7fb785400700 1 --2- 172.21.15.84:0/2429145776 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb76c06ed20 0x7fb76c0711d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb774006fd0 tx=0x7fb774006db0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:28:53.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:53.985+0000 7fb77e000700 1 -- 172.21.15.84:0/2429145776 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fb77805d1a0 con 0x7fb7880fce60 2024-04-26T21:28:54.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:53 smithi084 ceph-mon[90138]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:28:54.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:53 smithi084 ceph-mon[90138]: Reconfiguring osd.4 (monmap changed)... 2024-04-26T21:28:54.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:53 smithi084 ceph-mon[90138]: from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:28:54.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:53 smithi084 ceph-mon[90138]: Reconfiguring daemon osd.4 on smithi120 2024-04-26T21:28:54.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:53 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2695424899' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:28:54.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:53 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3987828028' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:28:54.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:53 smithi120 ceph-mon[79001]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:28:54.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:53 smithi120 ceph-mon[79001]: Reconfiguring osd.4 (monmap changed)... 2024-04-26T21:28:54.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:53 smithi120 ceph-mon[79001]: from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:28:54.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:53 smithi120 ceph-mon[79001]: Reconfiguring daemon osd.4 on smithi120 2024-04-26T21:28:54.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:53 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2695424899' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:28:54.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:53 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3987828028' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:28:54.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:54.283+0000 7fb78ca00700 1 -- 172.21.15.84:0/2429145776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb788105940 con 0x7fb7880fce60 2024-04-26T21:28:54.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:54.284+0000 7fb77e000700 1 -- 172.21.15.84:0/2429145776 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fb77805cd30 con 0x7fb7880fce60 2024-04-26T21:28:54.284 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:28:54.284 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:28:54.285 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:28:54.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:54.286+0000 7fb78ca00700 1 -- 172.21.15.84:0/2429145776 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb76c06ed20 msgr2=0x7fb76c0711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:54.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:54.286+0000 7fb78ca00700 1 --2- 172.21.15.84:0/2429145776 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb76c06ed20 0x7fb76c0711d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb774006fd0 tx=0x7fb774006db0 comp rx=0 tx=0).stop 2024-04-26T21:28:54.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:54.286+0000 7fb78ca00700 1 -- 172.21.15.84:0/2429145776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7880fce60 msgr2=0x7fb78810da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:28:54.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:54.286+0000 7fb78ca00700 1 --2- 172.21.15.84:0/2429145776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7880fce60 0x7fb78810da20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb77800b3b0 tx=0x7fb778009e30 comp rx=0 tx=0).stop 2024-04-26T21:28:54.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:54.287+0000 7fb78ca00700 1 -- 172.21.15.84:0/2429145776 shutdown_connections 2024-04-26T21:28:54.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:54.287+0000 7fb78ca00700 1 --2- 172.21.15.84:0/2429145776 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb76c06ed20 0x7fb76c0711d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:54.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:54.287+0000 7fb78ca00700 1 --2- 172.21.15.84:0/2429145776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7880fce60 0x7fb78810da20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:54.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:54.287+0000 7fb78ca00700 1 --2- 172.21.15.84:0/2429145776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7880fdfd0 0x7fb78810df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:28:54.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:54.287+0000 7fb78ca00700 1 -- 172.21.15.84:0/2429145776 >> 172.21.15.84:0/2429145776 conn(0x7fb7880f8500 msgr2=0x7fb7880f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:28:54.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:54.287+0000 7fb78ca00700 1 -- 172.21.15.84:0/2429145776 shutdown_connections 2024-04-26T21:28:54.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:28:54.287+0000 7fb78ca00700 1 -- 172.21.15.84:0/2429145776 wait complete. 2024-04-26T21:28:54.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:54 smithi120 ceph-mon[79001]: pgmap v38: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-04-26T21:28:54.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:54 smithi120 ceph-mon[79001]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:28:54.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:54 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2429145776' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:28:55.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:54 smithi084 ceph-mon[90138]: pgmap v38: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-04-26T21:28:55.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:54 smithi084 ceph-mon[90138]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:28:55.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:54 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2429145776' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:28:56.065 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:55 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:56.066 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:55 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:56.066 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:55 smithi120 ceph-mon[79001]: Reconfiguring osd.5 (monmap changed)... 2024-04-26T21:28:56.066 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:55 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T21:28:56.066 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:55 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:56.066 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:55 smithi120 ceph-mon[79001]: Reconfiguring daemon osd.5 on smithi120 2024-04-26T21:28:56.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:55 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:56.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:55 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:56.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:55 smithi084 ceph-mon[90138]: Reconfiguring osd.5 (monmap changed)... 2024-04-26T21:28:56.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:55 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T21:28:56.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:55 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:56.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:55 smithi084 ceph-mon[90138]: Reconfiguring daemon osd.5 on smithi120 2024-04-26T21:28:57.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:56 smithi120 ceph-mon[79001]: pgmap v39: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-04-26T21:28:57.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:56 smithi084 ceph-mon[90138]: pgmap v39: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-04-26T21:28:58.608 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:58 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:58.608 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:58 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:58.608 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:58 smithi120 ceph-mon[79001]: Reconfiguring mds.cephfs.smithi120.qnkxcn (monmap changed)... 2024-04-26T21:28:58.609 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:58 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.qnkxcn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:28:58.609 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:58 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:58.609 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:58 smithi120 ceph-mon[79001]: Reconfiguring daemon mds.cephfs.smithi120.qnkxcn on smithi120 2024-04-26T21:28:58.609 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:58 smithi120 ceph-mon[79001]: pgmap v40: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-04-26T21:28:58.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:58 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:58.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:58 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:28:58.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:58 smithi084 ceph-mon[90138]: Reconfiguring mds.cephfs.smithi120.qnkxcn (monmap changed)... 2024-04-26T21:28:58.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:58 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.qnkxcn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:28:58.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:58 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:58.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:58 smithi084 ceph-mon[90138]: Reconfiguring daemon mds.cephfs.smithi120.qnkxcn on smithi120 2024-04-26T21:28:58.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:58 smithi084 ceph-mon[90138]: pgmap v40: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-04-26T21:28:59.604 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:28:59 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:28:59.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:28:59 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:29:00.952 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:00 smithi120 ceph-mon[79001]: pgmap v41: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-04-26T21:29:00.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:00 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:00.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:00 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:00.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:00 smithi120 ceph-mon[79001]: Reconfiguring mds.cephfs.smithi120.ufqfoh (monmap changed)... 2024-04-26T21:29:00.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:00 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.ufqfoh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:29:00.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:00 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:29:00.953 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:00 smithi120 ceph-mon[79001]: Reconfiguring daemon mds.cephfs.smithi120.ufqfoh on smithi120 2024-04-26T21:29:01.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:00 smithi084 ceph-mon[90138]: pgmap v41: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-04-26T21:29:01.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:00 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:01.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:00 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:01.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:00 smithi084 ceph-mon[90138]: Reconfiguring mds.cephfs.smithi120.ufqfoh (monmap changed)... 2024-04-26T21:29:01.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:00 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.ufqfoh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:29:01.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:00 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:29:01.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:00 smithi084 ceph-mon[90138]: Reconfiguring daemon mds.cephfs.smithi120.ufqfoh on smithi120 2024-04-26T21:29:03.063 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:02 smithi084 ceph-mon[90138]: pgmap v42: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:03.063 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:03.064 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:03.064 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:29:03.064 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:29:03.064 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:29:03.064 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:03.064 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi084"}]: dispatch 2024-04-26T21:29:03.064 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi084"}]': finished 2024-04-26T21:29:03.064 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi120"}]: dispatch 2024-04-26T21:29:03.064 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi120"}]': finished 2024-04-26T21:29:03.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:02 smithi120 ceph-mon[79001]: pgmap v42: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:03.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:03.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:03.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:29:03.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:29:03.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:29:03.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:03.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi084"}]: dispatch 2024-04-26T21:29:03.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi084"}]': finished 2024-04-26T21:29:03.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi120"}]: dispatch 2024-04-26T21:29:03.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi120"}]': finished 2024-04-26T21:29:04.087 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:03 smithi084 ceph-mon[90138]: Upgrade: Setting container_image for all mon 2024-04-26T21:29:04.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:03 smithi120 ceph-mon[79001]: Upgrade: Setting container_image for all mon 2024-04-26T21:29:05.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:04 smithi084 ceph-mon[90138]: pgmap v43: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:05.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:04 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:05.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:04 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi084", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:29:05.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:04 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:29:05.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:04 smithi120 ceph-mon[79001]: pgmap v43: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:05.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:04 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:05.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:04 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi084", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:29:05.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:04 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:29:05.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:05 smithi084 ceph-mon[90138]: Upgrade: Updating crash.smithi084 (1/2) 2024-04-26T21:29:05.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:05 smithi084 ceph-mon[90138]: Deploying daemon crash.smithi084 on smithi084 2024-04-26T21:29:06.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:05 smithi120 ceph-mon[79001]: Upgrade: Updating crash.smithi084 (1/2) 2024-04-26T21:29:06.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:05 smithi120 ceph-mon[79001]: Deploying daemon crash.smithi084 on smithi084 2024-04-26T21:29:07.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:06 smithi084 ceph-mon[90138]: pgmap v44: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:07.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:06 smithi120 ceph-mon[79001]: pgmap v44: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:08.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:08 smithi120 ceph-mon[79001]: pgmap v45: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:09.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:08 smithi084 ceph-mon[90138]: pgmap v45: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:11.005 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:10 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:11.005 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:10 smithi120 ceph-mon[79001]: pgmap v46: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:11.005 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:10 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:11.078 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:10 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:11.078 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:10 smithi084 ceph-mon[90138]: pgmap v46: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:11.078 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:10 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:13.149 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:12 smithi120 ceph-mon[79001]: pgmap v47: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:13.149 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:12 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:13.150 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:12 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi120", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:29:13.150 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:12 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:29:13.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:12 smithi084 ceph-mon[90138]: pgmap v47: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:13.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:12 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:13.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:12 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi120", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:29:13.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:12 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:29:13.795 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:13 smithi084 ceph-mon[90138]: Upgrade: Updating crash.smithi120 (2/2) 2024-04-26T21:29:13.795 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:13 smithi084 ceph-mon[90138]: Deploying daemon crash.smithi120 on smithi120 2024-04-26T21:29:14.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:13 smithi120 ceph-mon[79001]: Upgrade: Updating crash.smithi120 (2/2) 2024-04-26T21:29:14.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:13 smithi120 ceph-mon[79001]: Deploying daemon crash.smithi120 on smithi120 2024-04-26T21:29:15.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:14 smithi084 ceph-mon[90138]: pgmap v48: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:15.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:29:15.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:14 smithi120 ceph-mon[79001]: pgmap v48: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:15.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:29:17.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:16 smithi084 ceph-mon[90138]: pgmap v49: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-26T21:29:17.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:16 smithi084 ceph-mon[90138]: mgrmap e39: smithi084.gyasul(active, since 92s), standbys: smithi120.zjaduj 2024-04-26T21:29:17.170 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:16 smithi120 ceph-mon[79001]: pgmap v49: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-26T21:29:17.170 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:16 smithi120 ceph-mon[79001]: mgrmap e39: smithi084.gyasul(active, since 92s), standbys: smithi120.zjaduj 2024-04-26T21:29:18.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:18 smithi084 ceph-mon[90138]: pgmap v50: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-26T21:29:18.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:18 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:18.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:18 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:18.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:18 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:29:19.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:18 smithi120 ceph-mon[79001]: pgmap v50: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-26T21:29:19.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:18 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:19.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:18 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:19.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:18 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:29:21.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:20 smithi084 ceph-mon[90138]: pgmap v51: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-26T21:29:21.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:20 smithi120 ceph-mon[79001]: pgmap v51: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-26T21:29:23.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:22 smithi084 ceph-mon[90138]: pgmap v52: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-26T21:29:23.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:22 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:23.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:22 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:23.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:22 smithi120 ceph-mon[79001]: pgmap v52: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-26T21:29:23.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:22 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:23.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:22 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:24.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.454+0000 7f4be3e00700 1 -- 172.21.15.84:0/693001174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc100280 msgr2=0x7f4bdc1006f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:24.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.454+0000 7f4be3e00700 1 --2- 172.21.15.84:0/693001174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc100280 0x7f4bdc1006f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8004940 tx=0x7f4bc8009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:24.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.455+0000 7f4be3e00700 1 -- 172.21.15.84:0/693001174 shutdown_connections 2024-04-26T21:29:24.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.455+0000 7f4be3e00700 1 --2- 172.21.15.84:0/693001174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc100280 0x7f4bdc1006f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:24.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.455+0000 7f4be3e00700 1 --2- 172.21.15.84:0/693001174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bdc0fefd0 0x7f4bdc0ff3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:24.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.455+0000 7f4be3e00700 1 -- 172.21.15.84:0/693001174 >> 172.21.15.84:0/693001174 conn(0x7f4bdc0fa8f0 msgr2=0x7f4bdc0fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:24.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.455+0000 7f4be3e00700 1 -- 172.21.15.84:0/693001174 shutdown_connections 2024-04-26T21:29:24.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.455+0000 7f4be3e00700 1 -- 172.21.15.84:0/693001174 wait complete. 2024-04-26T21:29:24.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.456+0000 7f4be3e00700 1 Processor -- start 2024-04-26T21:29:24.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.456+0000 7f4be3e00700 1 -- start start 2024-04-26T21:29:24.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.456+0000 7f4be3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bdc0fefd0 0x7f4bdc10fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:24.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.456+0000 7f4be3e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc100280 0x7f4bdc1100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:24.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.456+0000 7f4be3e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc1106d0 con 0x7f4bdc100280 2024-04-26T21:29:24.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.456+0000 7f4be3e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc110f20 con 0x7f4bdc0fefd0 2024-04-26T21:29:24.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.457+0000 7f4be0a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc100280 0x7f4bdc1100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:24.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.457+0000 7f4be1400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bdc0fefd0 0x7f4bdc10fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:24.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.457+0000 7f4be0a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc100280 0x7f4bdc1100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49744/0 (socket says 172.21.15.84:49744) 2024-04-26T21:29:24.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.457+0000 7f4be0a00700 1 -- 172.21.15.84:0/4262219519 learned_addr learned my addr 172.21.15.84:0/4262219519 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:29:24.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.457+0000 7f4be0a00700 1 -- 172.21.15.84:0/4262219519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bdc0fefd0 msgr2=0x7f4bdc10fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:24.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.457+0000 7f4be0a00700 1 --2- 172.21.15.84:0/4262219519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bdc0fefd0 0x7f4bdc10fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:24.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.457+0000 7f4be0a00700 1 -- 172.21.15.84:0/4262219519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc8005040 con 0x7f4bdc100280 2024-04-26T21:29:24.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.457+0000 7f4be1400700 1 --2- 172.21.15.84:0/4262219519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bdc0fefd0 0x7f4bdc10fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:29:24.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.458+0000 7f4be0a00700 1 --2- 172.21.15.84:0/4262219519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc100280 0x7f4bdc1100d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800b0d0 tx=0x7f4bc8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:24.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.458+0000 7f4bd9600700 1 -- 172.21.15.84:0/4262219519 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bc800e030 con 0x7f4bdc100280 2024-04-26T21:29:24.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.458+0000 7f4bd9600700 1 -- 172.21.15.84:0/4262219519 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4bc801c400 con 0x7f4bdc100280 2024-04-26T21:29:24.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.458+0000 7f4be3e00700 1 -- 172.21.15.84:0/4262219519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bdc1111a0 con 0x7f4bdc100280 2024-04-26T21:29:24.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.458+0000 7f4be3e00700 1 -- 172.21.15.84:0/4262219519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bdc1116e0 con 0x7f4bdc100280 2024-04-26T21:29:24.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.459+0000 7f4bd9600700 1 -- 172.21.15.84:0/4262219519 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bc800b630 con 0x7f4bdc100280 2024-04-26T21:29:24.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.460+0000 7f4be3e00700 1 -- 172.21.15.84:0/4262219519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bdc05f5c0 con 0x7f4bdc100280 2024-04-26T21:29:24.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.461+0000 7f4bd9600700 1 -- 172.21.15.84:0/4262219519 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4bc801c570 con 0x7f4bdc100280 2024-04-26T21:29:24.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.463+0000 7f4bd9600700 1 --2- 172.21.15.84:0/4262219519 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f4bc406ec00 0x7f4bc40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:24.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.463+0000 7f4bd9600700 1 -- 172.21.15.84:0/4262219519 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4bc8090480 con 0x7f4bdc100280 2024-04-26T21:29:24.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.463+0000 7f4be1400700 1 --2- 172.21.15.84:0/4262219519 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f4bc406ec00 0x7f4bc40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:24.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.464+0000 7f4be1400700 1 --2- 172.21.15.84:0/4262219519 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f4bc406ec00 0x7f4bc40710b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009b80 tx=0x7f4bd000b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:24.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.468+0000 7f4bd9600700 1 -- 172.21.15.84:0/4262219519 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f4bc805cf20 con 0x7f4bdc100280 2024-04-26T21:29:24.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.727+0000 7f4be3e00700 1 -- 172.21.15.84:0/4262219519 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bdc111a80 con 0x7f4bc406ec00 2024-04-26T21:29:24.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.729+0000 7f4bd9600700 1 -- 172.21.15.84:0/4262219519 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f4bdc111a80 con 0x7f4bc406ec00 2024-04-26T21:29:24.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.732+0000 7f4be3e00700 1 -- 172.21.15.84:0/4262219519 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f4bc406ec00 msgr2=0x7f4bc40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:24.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.732+0000 7f4be3e00700 1 --2- 172.21.15.84:0/4262219519 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f4bc406ec00 0x7f4bc40710b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009b80 tx=0x7f4bd000b040 comp rx=0 tx=0).stop 2024-04-26T21:29:24.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.732+0000 7f4be3e00700 1 -- 172.21.15.84:0/4262219519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc100280 msgr2=0x7f4bdc1100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:24.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.732+0000 7f4be3e00700 1 --2- 172.21.15.84:0/4262219519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc100280 0x7f4bdc1100d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800b0d0 tx=0x7f4bc8009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:24.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.732+0000 7f4be3e00700 1 -- 172.21.15.84:0/4262219519 shutdown_connections 2024-04-26T21:29:24.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.732+0000 7f4be3e00700 1 --2- 172.21.15.84:0/4262219519 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f4bc406ec00 0x7f4bc40710b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:24.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.732+0000 7f4be3e00700 1 --2- 172.21.15.84:0/4262219519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bdc0fefd0 0x7f4bdc10fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:24.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.732+0000 7f4be3e00700 1 --2- 172.21.15.84:0/4262219519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc100280 0x7f4bdc1100d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:24.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.732+0000 7f4be3e00700 1 -- 172.21.15.84:0/4262219519 >> 172.21.15.84:0/4262219519 conn(0x7f4bdc0fa8f0 msgr2=0x7f4bdc0fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:24.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.732+0000 7f4be3e00700 1 -- 172.21.15.84:0/4262219519 shutdown_connections 2024-04-26T21:29:24.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.732+0000 7f4be3e00700 1 -- 172.21.15.84:0/4262219519 wait complete. 2024-04-26T21:29:24.749 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:29:24.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.886+0000 7f3635600700 1 -- 172.21.15.84:0/3268463505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630100060 msgr2=0x7f36301004d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:24.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.886+0000 7f3635600700 1 --2- 172.21.15.84:0/3268463505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630100060 0x7f36301004d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f361c004940 tx=0x7f361c009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:24.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.886+0000 7f3635600700 1 -- 172.21.15.84:0/3268463505 shutdown_connections 2024-04-26T21:29:24.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.886+0000 7f3635600700 1 --2- 172.21.15.84:0/3268463505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630100060 0x7f36301004d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:24.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.886+0000 7f3635600700 1 --2- 172.21.15.84:0/3268463505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36300fee60 0x7f36300ff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:24.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.886+0000 7f3635600700 1 -- 172.21.15.84:0/3268463505 >> 172.21.15.84:0/3268463505 conn(0x7f36300fa570 msgr2=0x7f36300fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:24.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.887+0000 7f3635600700 1 -- 172.21.15.84:0/3268463505 shutdown_connections 2024-04-26T21:29:24.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.887+0000 7f3635600700 1 -- 172.21.15.84:0/3268463505 wait complete. 2024-04-26T21:29:24.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.888+0000 7f3635600700 1 Processor -- start 2024-04-26T21:29:24.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.888+0000 7f3635600700 1 -- start start 2024-04-26T21:29:24.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.888+0000 7f3635600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36300fee60 0x7f363010fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:24.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.888+0000 7f3635600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630100060 0x7f363010ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:24.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.888+0000 7f3635600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3630110630 con 0x7f3630100060 2024-04-26T21:29:24.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.888+0000 7f3635600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3630110e20 con 0x7f36300fee60 2024-04-26T21:29:24.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.889+0000 7f362f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630100060 0x7f363010ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:24.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.889+0000 7f362f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630100060 0x7f363010ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49770/0 (socket says 172.21.15.84:49770) 2024-04-26T21:29:24.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.889+0000 7f362f400700 1 -- 172.21.15.84:0/3626128022 learned_addr learned my addr 172.21.15.84:0/3626128022 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:29:24.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.889+0000 7f362fe00700 1 --2- 172.21.15.84:0/3626128022 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36300fee60 0x7f363010fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:24.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.889+0000 7f362f400700 1 -- 172.21.15.84:0/3626128022 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36300fee60 msgr2=0x7f363010fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:24.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.889+0000 7f362f400700 1 --2- 172.21.15.84:0/3626128022 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36300fee60 0x7f363010fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:24.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.889+0000 7f362f400700 1 -- 172.21.15.84:0/3626128022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c005040 con 0x7f3630100060 2024-04-26T21:29:24.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.890+0000 7f362f400700 1 --2- 172.21.15.84:0/3626128022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630100060 0x7f363010ffa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f361c00b3b0 tx=0x7f361c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:24.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.890+0000 7f3627e00700 1 -- 172.21.15.84:0/3626128022 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f361c00e040 con 0x7f3630100060 2024-04-26T21:29:24.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.890+0000 7f3627e00700 1 -- 172.21.15.84:0/3626128022 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f361c004290 con 0x7f3630100060 2024-04-26T21:29:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.890+0000 7f3635600700 1 -- 172.21.15.84:0/3626128022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36301110a0 con 0x7f3630100060 2024-04-26T21:29:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.891+0000 7f3627e00700 1 -- 172.21.15.84:0/3626128022 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f361c01c630 con 0x7f3630100060 2024-04-26T21:29:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.891+0000 7f3635600700 1 -- 172.21.15.84:0/3626128022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3630111660 con 0x7f3630100060 2024-04-26T21:29:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.892+0000 7f3635600700 1 -- 172.21.15.84:0/3626128022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363005f5c0 con 0x7f3630100060 2024-04-26T21:29:24.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.894+0000 7f3627e00700 1 -- 172.21.15.84:0/3626128022 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f361c00bbf0 con 0x7f3630100060 2024-04-26T21:29:24.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.895+0000 7f3627e00700 1 --2- 172.21.15.84:0/3626128022 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f361406ec10 0x7f36140710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:24.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.895+0000 7f3627e00700 1 -- 172.21.15.84:0/3626128022 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f361c08fbf0 con 0x7f3630100060 2024-04-26T21:29:24.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.895+0000 7f362fe00700 1 --2- 172.21.15.84:0/3626128022 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f361406ec10 0x7f36140710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:24.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.896+0000 7f362fe00700 1 --2- 172.21.15.84:0/3626128022 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f361406ec10 0x7f36140710c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f36300ffbd0 tx=0x7f3620009620 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:24.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:24.903+0000 7f3627e00700 1 -- 172.21.15.84:0/3626128022 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f361c05c5d0 con 0x7f3630100060 2024-04-26T21:29:25.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.159+0000 7f3635600700 1 -- 172.21.15.84:0/3626128022 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3630111990 con 0x7f361406ec10 2024-04-26T21:29:25.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:24 smithi084 ceph-mon[90138]: pgmap v53: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-26T21:29:25.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:24 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:25.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:24 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:25.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:24 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:25.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.162+0000 7f3627e00700 1 -- 172.21.15.84:0/3626128022 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7f3630111990 con 0x7f361406ec10 2024-04-26T21:29:25.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.165+0000 7f3635600700 1 -- 172.21.15.84:0/3626128022 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f361406ec10 msgr2=0x7f36140710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:25.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.165+0000 7f3635600700 1 --2- 172.21.15.84:0/3626128022 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f361406ec10 0x7f36140710c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f36300ffbd0 tx=0x7f3620009620 comp rx=0 tx=0).stop 2024-04-26T21:29:25.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.165+0000 7f3635600700 1 -- 172.21.15.84:0/3626128022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630100060 msgr2=0x7f363010ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:25.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.165+0000 7f3635600700 1 --2- 172.21.15.84:0/3626128022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630100060 0x7f363010ffa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f361c00b3b0 tx=0x7f361c009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:25.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.165+0000 7f3635600700 1 -- 172.21.15.84:0/3626128022 shutdown_connections 2024-04-26T21:29:25.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.165+0000 7f3635600700 1 --2- 172.21.15.84:0/3626128022 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f361406ec10 0x7f36140710c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:25.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.165+0000 7f3635600700 1 --2- 172.21.15.84:0/3626128022 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36300fee60 0x7f363010fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:25.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.165+0000 7f3635600700 1 --2- 172.21.15.84:0/3626128022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3630100060 0x7f363010ffa0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:25.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.165+0000 7f3635600700 1 -- 172.21.15.84:0/3626128022 >> 172.21.15.84:0/3626128022 conn(0x7f36300fa570 msgr2=0x7f36300fbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:25.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.166+0000 7f3635600700 1 -- 172.21.15.84:0/3626128022 shutdown_connections 2024-04-26T21:29:25.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.166+0000 7f3635600700 1 -- 172.21.15.84:0/3626128022 wait complete. 2024-04-26T21:29:25.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:24 smithi120 ceph-mon[79001]: pgmap v53: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-26T21:29:25.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:24 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:25.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:24 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:25.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:24 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:25.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.307+0000 7fec39800700 1 -- 172.21.15.84:0/2284464502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec341046a0 msgr2=0x7fec34104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:25.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.307+0000 7fec39800700 1 --2- 172.21.15.84:0/2284464502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec341046a0 0x7fec34104b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fec1c004940 tx=0x7fec1c009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:25.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.307+0000 7fec39800700 1 -- 172.21.15.84:0/2284464502 shutdown_connections 2024-04-26T21:29:25.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.307+0000 7fec39800700 1 --2- 172.21.15.84:0/2284464502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec341046a0 0x7fec34104b10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:25.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.307+0000 7fec39800700 1 --2- 172.21.15.84:0/2284464502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec341033f0 0x7fec34103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:25.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.307+0000 7fec39800700 1 -- 172.21.15.84:0/2284464502 >> 172.21.15.84:0/2284464502 conn(0x7fec340725e0 msgr2=0x7fec34074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:25.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.307+0000 7fec39800700 1 -- 172.21.15.84:0/2284464502 shutdown_connections 2024-04-26T21:29:25.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.307+0000 7fec39800700 1 -- 172.21.15.84:0/2284464502 wait complete. 2024-04-26T21:29:25.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.308+0000 7fec39800700 1 Processor -- start 2024-04-26T21:29:25.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.308+0000 7fec39800700 1 -- start start 2024-04-26T21:29:25.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.309+0000 7fec39800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec341033f0 0x7fec34113ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:25.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.309+0000 7fec39800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec341046a0 0x7fec34114430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:25.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.309+0000 7fec39800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec34114a30 con 0x7fec341046a0 2024-04-26T21:29:25.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.309+0000 7fec39800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec34114ba0 con 0x7fec341033f0 2024-04-26T21:29:25.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.309+0000 7fec2a000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec341046a0 0x7fec34114430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:25.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.309+0000 7fec2a000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec341046a0 0x7fec34114430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49786/0 (socket says 172.21.15.84:49786) 2024-04-26T21:29:25.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.309+0000 7fec2a000700 1 -- 172.21.15.84:0/3742519177 learned_addr learned my addr 172.21.15.84:0/3742519177 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:29:25.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.309+0000 7fec32a00700 1 --2- 172.21.15.84:0/3742519177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec341033f0 0x7fec34113ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:25.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.310+0000 7fec2a000700 1 -- 172.21.15.84:0/3742519177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec341033f0 msgr2=0x7fec34113ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:25.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.310+0000 7fec2a000700 1 --2- 172.21.15.84:0/3742519177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec341033f0 0x7fec34113ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:25.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.310+0000 7fec2a000700 1 -- 172.21.15.84:0/3742519177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c005040 con 0x7fec341046a0 2024-04-26T21:29:25.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.310+0000 7fec2a000700 1 --2- 172.21.15.84:0/3742519177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec341046a0 0x7fec34114430 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00b3b0 tx=0x7fec1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:25.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.310+0000 7fec2b400700 1 -- 172.21.15.84:0/3742519177 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec1c00e040 con 0x7fec341046a0 2024-04-26T21:29:25.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.310+0000 7fec2b400700 1 -- 172.21.15.84:0/3742519177 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec1c004290 con 0x7fec341046a0 2024-04-26T21:29:25.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.310+0000 7fec39800700 1 -- 172.21.15.84:0/3742519177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec341195a0 con 0x7fec341046a0 2024-04-26T21:29:25.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.310+0000 7fec2b400700 1 -- 172.21.15.84:0/3742519177 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec1c01c630 con 0x7fec341046a0 2024-04-26T21:29:25.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.310+0000 7fec39800700 1 -- 172.21.15.84:0/3742519177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec34119b60 con 0x7fec341046a0 2024-04-26T21:29:25.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.311+0000 7fec39800700 1 -- 172.21.15.84:0/3742519177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec3404c710 con 0x7fec341046a0 2024-04-26T21:29:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.313+0000 7fec2b400700 1 -- 172.21.15.84:0/3742519177 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fec1c00bbf0 con 0x7fec341046a0 2024-04-26T21:29:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.313+0000 7fec2b400700 1 --2- 172.21.15.84:0/3742519177 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fec1806ec00 0x7fec180710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.314+0000 7fec2b400700 1 -- 172.21.15.84:0/3742519177 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fec1c08fbf0 con 0x7fec341046a0 2024-04-26T21:29:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.314+0000 7fec32a00700 1 --2- 172.21.15.84:0/3742519177 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fec1806ec00 0x7fec180710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:25.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.315+0000 7fec32a00700 1 --2- 172.21.15.84:0/3742519177 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fec1806ec00 0x7fec180710b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fec24004990 tx=0x7fec24009ee0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.318+0000 7fec2b400700 1 -- 172.21.15.84:0/3742519177 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fec1c05c5d0 con 0x7fec341046a0 2024-04-26T21:29:25.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.546+0000 7fec39800700 1 -- 172.21.15.84:0/3742519177 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fec341089e0 con 0x7fec1806ec00 2024-04-26T21:29:25.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.571+0000 7fec2b400700 1 -- 172.21.15.84:0/3742519177 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fec341089e0 con 0x7fec1806ec00 2024-04-26T21:29:25.573 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:29:25.573 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (4m) 0s ago 15m 14.2M - 0.25.0 c8568f914cd2 bcb419cf9108 2024-04-26T21:29:25.573 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (16s) 0s ago 15m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 b4010dfbe623 2024-04-26T21:29:25.573 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (8s) 3s ago 13m 6665k - 19.0.0-3306-gbc612ffb 55dc54019ad8 89a4e50ea23c 2024-04-26T21:29:25.573 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (4m) 0s ago 14m 76.4M - 9.4.7 954c08fa6188 1bf95f604e07 2024-04-26T21:29:25.573 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (8m) 0s ago 8m 115M - 17.2.7-907-g2be3efa9 1c5834633715 485d7884e1d5 2024-04-26T21:29:25.573 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (7m) 0s ago 7m 13.9M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:29:25.573 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (8m) 3s ago 8m 113M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:29:25.573 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (7m) 3s ago 7m 13.8M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:29:25.573 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (3m) 0s ago 16m 500M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:29:25.574 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283,8765 running (2m) 3s ago 13m 452M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d6ae0b4628b5 2024-04-26T21:29:25.574 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (114s) 0s ago 16m 41.8M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 bf610abb6a62 2024-04-26T21:29:25.574 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (73s) 3s ago 13m 33.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 5d530496253b 2024-04-26T21:29:25.574 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (4m) 0s ago 15m 7578k - 1.5.0 0da6a335fe13 81e00b40bfbf 2024-04-26T21:29:25.574 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (3m) 3s ago 13m 7810k - 1.5.0 0da6a335fe13 0506a1d46ec4 2024-04-26T21:29:25.574 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (12m) 0s ago 12m 209M 1557M 17.2.7-907-g2be3efa9 1c5834633715 3a2e74d7e51a 2024-04-26T21:29:25.574 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (12m) 0s ago 12m 210M 1557M 17.2.7-907-g2be3efa9 1c5834633715 d283a0a93213 2024-04-26T21:29:25.574 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (11m) 0s ago 11m 166M 1557M 17.2.7-907-g2be3efa9 1c5834633715 5899468fc5c8 2024-04-26T21:29:25.574 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (11m) 3s ago 10m 230M 2581M 17.2.7-907-g2be3efa9 1c5834633715 b8a14c87d730 2024-04-26T21:29:25.574 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (10m) 3s ago 10m 216M 2581M 17.2.7-907-g2be3efa9 1c5834633715 4d294df735a3 2024-04-26T21:29:25.574 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (9m) 3s ago 9m 201M 2581M 17.2.7-907-g2be3efa9 1c5834633715 9b60997971a8 2024-04-26T21:29:25.574 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (2m) 0s ago 14m 51.3M - 2.43.0 a07b618ecd1d d3008b765eec 2024-04-26T21:29:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.574+0000 7fec39800700 1 -- 172.21.15.84:0/3742519177 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fec1806ec00 msgr2=0x7fec180710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.574+0000 7fec39800700 1 --2- 172.21.15.84:0/3742519177 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fec1806ec00 0x7fec180710b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fec24004990 tx=0x7fec24009ee0 comp rx=0 tx=0).stop 2024-04-26T21:29:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.574+0000 7fec39800700 1 -- 172.21.15.84:0/3742519177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec341046a0 msgr2=0x7fec34114430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.574+0000 7fec39800700 1 --2- 172.21.15.84:0/3742519177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec341046a0 0x7fec34114430 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00b3b0 tx=0x7fec1c009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.574+0000 7fec39800700 1 -- 172.21.15.84:0/3742519177 shutdown_connections 2024-04-26T21:29:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.574+0000 7fec39800700 1 --2- 172.21.15.84:0/3742519177 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fec1806ec00 0x7fec180710b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.574+0000 7fec39800700 1 --2- 172.21.15.84:0/3742519177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec341033f0 0x7fec34113ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.574+0000 7fec39800700 1 --2- 172.21.15.84:0/3742519177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec341046a0 0x7fec34114430 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.574+0000 7fec39800700 1 -- 172.21.15.84:0/3742519177 >> 172.21.15.84:0/3742519177 conn(0x7fec340725e0 msgr2=0x7fec34073c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:25.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.574+0000 7fec39800700 1 -- 172.21.15.84:0/3742519177 shutdown_connections 2024-04-26T21:29:25.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.574+0000 7fec39800700 1 -- 172.21.15.84:0/3742519177 wait complete. 2024-04-26T21:29:25.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.718+0000 7f70f6a00700 1 -- 172.21.15.84:0/2749162451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70f0066ed0 msgr2=0x7f70f0101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:25.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.718+0000 7f70f6a00700 1 --2- 172.21.15.84:0/2749162451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70f0066ed0 0x7f70f0101e30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f70e0004940 tx=0x7f70e0009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:25.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.718+0000 7f70f6a00700 1 -- 172.21.15.84:0/2749162451 shutdown_connections 2024-04-26T21:29:25.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.718+0000 7f70f6a00700 1 --2- 172.21.15.84:0/2749162451 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70f0102370 0x7f70f0104750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:25.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.718+0000 7f70f6a00700 1 --2- 172.21.15.84:0/2749162451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70f0066ed0 0x7f70f0101e30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:25.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.718+0000 7f70f6a00700 1 -- 172.21.15.84:0/2749162451 >> 172.21.15.84:0/2749162451 conn(0x7f70f00f7440 msgr2=0x7f70f00f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:25.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.718+0000 7f70f6a00700 1 -- 172.21.15.84:0/2749162451 shutdown_connections 2024-04-26T21:29:25.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.718+0000 7f70f6a00700 1 -- 172.21.15.84:0/2749162451 wait complete. 2024-04-26T21:29:25.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.719+0000 7f70f6a00700 1 Processor -- start 2024-04-26T21:29:25.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.719+0000 7f70f6a00700 1 -- start start 2024-04-26T21:29:25.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.719+0000 7f70f6a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70f0066ed0 0x7f70f010fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:25.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.719+0000 7f70f6a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70f0102370 0x7f70f0110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.719+0000 7f70f6a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f0110640 con 0x7f70f0102370 2024-04-26T21:29:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.719+0000 7f70f6a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f01107b0 con 0x7f70f0066ed0 2024-04-26T21:29:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.720+0000 7f70ef400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70f0102370 0x7f70f0110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.720+0000 7f70ef400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70f0102370 0x7f70f0110040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49806/0 (socket says 172.21.15.84:49806) 2024-04-26T21:29:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.720+0000 7f70ef400700 1 -- 172.21.15.84:0/4291293018 learned_addr learned my addr 172.21.15.84:0/4291293018 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:29:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.720+0000 7f70efe00700 1 --2- 172.21.15.84:0/4291293018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70f0066ed0 0x7f70f010fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.720+0000 7f70ef400700 1 -- 172.21.15.84:0/4291293018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70f0066ed0 msgr2=0x7f70f010fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.720+0000 7f70ef400700 1 --2- 172.21.15.84:0/4291293018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70f0066ed0 0x7f70f010fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.720+0000 7f70ef400700 1 -- 172.21.15.84:0/4291293018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e0005040 con 0x7f70f0102370 2024-04-26T21:29:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.721+0000 7f70ef400700 1 --2- 172.21.15.84:0/4291293018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70f0102370 0x7f70f0110040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f70dc002a50 tx=0x7f70dc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.721+0000 7f70e7e00700 1 -- 172.21.15.84:0/4291293018 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70dc007cc0 con 0x7f70f0102370 2024-04-26T21:29:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.721+0000 7f70e7e00700 1 -- 172.21.15.84:0/4291293018 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70dc00f040 con 0x7f70f0102370 2024-04-26T21:29:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.721+0000 7f70f6a00700 1 -- 172.21.15.84:0/4291293018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f0115210 con 0x7f70f0102370 2024-04-26T21:29:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.721+0000 7f70e7e00700 1 -- 172.21.15.84:0/4291293018 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70dc00da30 con 0x7f70f0102370 2024-04-26T21:29:25.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.721+0000 7f70f6a00700 1 -- 172.21.15.84:0/4291293018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f01157d0 con 0x7f70f0102370 2024-04-26T21:29:25.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.722+0000 7f70f6a00700 1 -- 172.21.15.84:0/4291293018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f004c710 con 0x7f70f0102370 2024-04-26T21:29:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.725+0000 7f70e7e00700 1 -- 172.21.15.84:0/4291293018 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f70dc00db90 con 0x7f70f0102370 2024-04-26T21:29:25.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.726+0000 7f70e7e00700 1 --2- 172.21.15.84:0/4291293018 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f70d406ec00 0x7f70d40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:25.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.726+0000 7f70e7e00700 1 -- 172.21.15.84:0/4291293018 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f70dc08e550 con 0x7f70f0102370 2024-04-26T21:29:25.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.727+0000 7f70efe00700 1 --2- 172.21.15.84:0/4291293018 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f70d406ec00 0x7f70d40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:25.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.728+0000 7f70efe00700 1 --2- 172.21.15.84:0/4291293018 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f70d406ec00 0x7f70d40710b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f70e000b3b0 tx=0x7f70e0009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:25.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:25.732+0000 7f70e7e00700 1 -- 172.21.15.84:0/4291293018 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f70dc05aeb0 con 0x7f70f0102370 2024-04-26T21:29:26.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.075+0000 7f70f6a00700 1 -- 172.21.15.84:0/4291293018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f70f0115a40 con 0x7f70f0102370 2024-04-26T21:29:26.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.076+0000 7f70e7e00700 1 -- 172.21.15.84:0/4291293018 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f70f0115a40 con 0x7f70f0102370 2024-04-26T21:29:26.078 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:29:26.078 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:29:26.078 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:29:26.078 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:29:26.078 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:29:26.078 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:29:26.078 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:29:26.078 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:29:26.078 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-26T21:29:26.078 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:29:26.079 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:29:26.079 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-26T21:29:26.079 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:29:26.079 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:29:26.079 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 10, 2024-04-26T21:29:26.079 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 4 2024-04-26T21:29:26.079 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:29:26.079 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:29:26.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.079+0000 7f70f6a00700 1 -- 172.21.15.84:0/4291293018 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f70d406ec00 msgr2=0x7f70d40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:26.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.079+0000 7f70f6a00700 1 --2- 172.21.15.84:0/4291293018 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f70d406ec00 0x7f70d40710b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f70e000b3b0 tx=0x7f70e0009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:26.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.079+0000 7f70f6a00700 1 -- 172.21.15.84:0/4291293018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70f0102370 msgr2=0x7f70f0110040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:26.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.079+0000 7f70f6a00700 1 --2- 172.21.15.84:0/4291293018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70f0102370 0x7f70f0110040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f70dc002a50 tx=0x7f70dc0046b0 comp rx=0 tx=0).stop 2024-04-26T21:29:26.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.079+0000 7f70f6a00700 1 -- 172.21.15.84:0/4291293018 shutdown_connections 2024-04-26T21:29:26.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.079+0000 7f70f6a00700 1 --2- 172.21.15.84:0/4291293018 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f70d406ec00 0x7f70d40710b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:26.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.079+0000 7f70f6a00700 1 --2- 172.21.15.84:0/4291293018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70f0066ed0 0x7f70f010fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:26.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.079+0000 7f70f6a00700 1 --2- 172.21.15.84:0/4291293018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70f0102370 0x7f70f0110040 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:26.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.079+0000 7f70f6a00700 1 -- 172.21.15.84:0/4291293018 >> 172.21.15.84:0/4291293018 conn(0x7f70f00f7440 msgr2=0x7f70f00f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:26.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.079+0000 7f70f6a00700 1 -- 172.21.15.84:0/4291293018 shutdown_connections 2024-04-26T21:29:26.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.079+0000 7f70f6a00700 1 -- 172.21.15.84:0/4291293018 wait complete. 2024-04-26T21:29:26.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:25 smithi084 ceph-mon[90138]: from='client.34204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:29:26.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:26.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:25 smithi120 ceph-mon[79001]: from='client.34204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:29:26.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:26.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.227+0000 7f6c9ba00700 1 -- 172.21.15.84:0/2187726414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c941002a0 msgr2=0x7f6c94100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:26.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.227+0000 7f6c9ba00700 1 --2- 172.21.15.84:0/2187726414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c941002a0 0x7f6c94100710 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6c80004940 tx=0x7f6c80009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:26.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.227+0000 7f6c9ba00700 1 -- 172.21.15.84:0/2187726414 shutdown_connections 2024-04-26T21:29:26.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.227+0000 7f6c9ba00700 1 --2- 172.21.15.84:0/2187726414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c941002a0 0x7f6c94100710 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:26.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.227+0000 7f6c9ba00700 1 --2- 172.21.15.84:0/2187726414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c940feff0 0x7f6c940ff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:26.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.227+0000 7f6c9ba00700 1 -- 172.21.15.84:0/2187726414 >> 172.21.15.84:0/2187726414 conn(0x7f6c940fa8f0 msgr2=0x7f6c940fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:26.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.227+0000 7f6c9ba00700 1 -- 172.21.15.84:0/2187726414 shutdown_connections 2024-04-26T21:29:26.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.227+0000 7f6c9ba00700 1 -- 172.21.15.84:0/2187726414 wait complete. 2024-04-26T21:29:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.228+0000 7f6c9ba00700 1 Processor -- start 2024-04-26T21:29:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.228+0000 7f6c9ba00700 1 -- start start 2024-04-26T21:29:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.228+0000 7f6c9ba00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c940feff0 0x7f6c9410fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.228+0000 7f6c9ba00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c941002a0 0x7f6c94110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.228+0000 7f6c9ba00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c94110640 con 0x7f6c941002a0 2024-04-26T21:29:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.228+0000 7f6c9ba00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c941107b0 con 0x7f6c940feff0 2024-04-26T21:29:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.229+0000 7f6c93e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c941002a0 0x7f6c94110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.229+0000 7f6c93e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c941002a0 0x7f6c94110040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49836/0 (socket says 172.21.15.84:49836) 2024-04-26T21:29:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.229+0000 7f6c93e00700 1 -- 172.21.15.84:0/888723246 learned_addr learned my addr 172.21.15.84:0/888723246 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:29:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.229+0000 7f6c99000700 1 --2- 172.21.15.84:0/888723246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c940feff0 0x7f6c9410fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.229+0000 7f6c93e00700 1 -- 172.21.15.84:0/888723246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c940feff0 msgr2=0x7f6c9410fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.229+0000 7f6c93e00700 1 --2- 172.21.15.84:0/888723246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c940feff0 0x7f6c9410fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.229+0000 7f6c93e00700 1 -- 172.21.15.84:0/888723246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c80005040 con 0x7f6c941002a0 2024-04-26T21:29:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.229+0000 7f6c93e00700 1 --2- 172.21.15.84:0/888723246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c941002a0 0x7f6c94110040 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6c80009150 tx=0x7f6c80009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.230+0000 7f6c90c00700 1 -- 172.21.15.84:0/888723246 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c8000e040 con 0x7f6c941002a0 2024-04-26T21:29:26.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.230+0000 7f6c90c00700 1 -- 172.21.15.84:0/888723246 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c8000bcc0 con 0x7f6c941002a0 2024-04-26T21:29:26.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.230+0000 7f6c9ba00700 1 -- 172.21.15.84:0/888723246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c941151b0 con 0x7f6c941002a0 2024-04-26T21:29:26.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.230+0000 7f6c90c00700 1 -- 172.21.15.84:0/888723246 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c8001c630 con 0x7f6c941002a0 2024-04-26T21:29:26.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.230+0000 7f6c9ba00700 1 -- 172.21.15.84:0/888723246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c94115770 con 0x7f6c941002a0 2024-04-26T21:29:26.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.231+0000 7f6c9ba00700 1 -- 172.21.15.84:0/888723246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c9404c710 con 0x7f6c941002a0 2024-04-26T21:29:26.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.232+0000 7f6c90c00700 1 -- 172.21.15.84:0/888723246 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6c80013420 con 0x7f6c941002a0 2024-04-26T21:29:26.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.234+0000 7f6c90c00700 1 --2- 172.21.15.84:0/888723246 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6c7c06ec00 0x7f6c7c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:26.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.234+0000 7f6c90c00700 1 -- 172.21.15.84:0/888723246 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6c8008f480 con 0x7f6c941002a0 2024-04-26T21:29:26.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.234+0000 7f6c99000700 1 --2- 172.21.15.84:0/888723246 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6c7c06ec00 0x7f6c7c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:26.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.235+0000 7f6c99000700 1 --2- 172.21.15.84:0/888723246 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6c7c06ec00 0x7f6c7c0710b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6c88004990 tx=0x7f6c88009ee0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:26.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.239+0000 7f6c90c00700 1 -- 172.21.15.84:0/888723246 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f6c8005be60 con 0x7f6c941002a0 2024-04-26T21:29:26.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.520+0000 7f6c9ba00700 1 -- 172.21.15.84:0/888723246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6c94115b70 con 0x7f6c941002a0 2024-04-26T21:29:26.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.520+0000 7f6c90c00700 1 -- 172.21.15.84:0/888723246 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1922 (secure 0 0 0) 0x7f6c8005b9f0 con 0x7f6c941002a0 2024-04-26T21:29:26.523 INFO:teuthology.orchestra.run.smithi084.stdout:e15 2024-04-26T21:29:26.523 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:29:26.523 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:29:26.523 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:29:26.523 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:29:26.523 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:29:26.523 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:29:26.523 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 15 2024-04-26T21:29:26.523 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:29:26.523 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:29:26.523 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:27:24.731661+0000 2024-04-26T21:29:26.524 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:29:26.524 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:29:26.524 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:29:26.524 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:29:26.524 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:29:26.524 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-04-26T21:29:26.524 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:29:26.524 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:29:26.524 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:29:26.524 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:29:26.524 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:29:26.524 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:29:26.524 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456,1=24231} 2024-04-26T21:29:26.524 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:29:26.525 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:29:26.525 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:29:26.525 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:29:26.525 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:29:26.525 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:29:26.525 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:29:26.525 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-04-26T21:29:26.525 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:29:26.525 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 0 members: 2024-04-26T21:29:26.525 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:29:26.525 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:29:26.525 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:29:26.525 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:29:26.526 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:29:26.526 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:29:26.526 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:29:26.526 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:29:26.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.523+0000 7f6c9ba00700 1 -- 172.21.15.84:0/888723246 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6c7c06ec00 msgr2=0x7f6c7c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:26.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.523+0000 7f6c9ba00700 1 --2- 172.21.15.84:0/888723246 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6c7c06ec00 0x7f6c7c0710b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6c88004990 tx=0x7f6c88009ee0 comp rx=0 tx=0).stop 2024-04-26T21:29:26.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.523+0000 7f6c9ba00700 1 -- 172.21.15.84:0/888723246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c941002a0 msgr2=0x7f6c94110040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:26.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.523+0000 7f6c9ba00700 1 --2- 172.21.15.84:0/888723246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c941002a0 0x7f6c94110040 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6c80009150 tx=0x7f6c80009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:26.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.524+0000 7f6c9ba00700 1 -- 172.21.15.84:0/888723246 shutdown_connections 2024-04-26T21:29:26.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.524+0000 7f6c9ba00700 1 --2- 172.21.15.84:0/888723246 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6c7c06ec00 0x7f6c7c0710b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:26.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.524+0000 7f6c9ba00700 1 --2- 172.21.15.84:0/888723246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c940feff0 0x7f6c9410fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:26.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.524+0000 7f6c9ba00700 1 --2- 172.21.15.84:0/888723246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c941002a0 0x7f6c94110040 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:26.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.524+0000 7f6c9ba00700 1 -- 172.21.15.84:0/888723246 >> 172.21.15.84:0/888723246 conn(0x7f6c940fa8f0 msgr2=0x7f6c940fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:26.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.524+0000 7f6c9ba00700 1 -- 172.21.15.84:0/888723246 shutdown_connections 2024-04-26T21:29:26.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.524+0000 7f6c9ba00700 1 -- 172.21.15.84:0/888723246 wait complete. 2024-04-26T21:29:26.528 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 15 2024-04-26T21:29:26.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.684+0000 7f1ccb000700 1 -- 172.21.15.84:0/3466683779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc40fcf10 msgr2=0x7f1cc40fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:26.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.684+0000 7f1ccb000700 1 --2- 172.21.15.84:0/3466683779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc40fcf10 0x7f1cc40fd320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4004940 tx=0x7f1cb4009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:26.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.684+0000 7f1ccb000700 1 -- 172.21.15.84:0/3466683779 shutdown_connections 2024-04-26T21:29:26.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.684+0000 7f1ccb000700 1 --2- 172.21.15.84:0/3466683779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cc40fe080 0x7f1cc40fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:26.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.684+0000 7f1ccb000700 1 --2- 172.21.15.84:0/3466683779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc40fcf10 0x7f1cc40fd320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:26.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.684+0000 7f1ccb000700 1 -- 172.21.15.84:0/3466683779 >> 172.21.15.84:0/3466683779 conn(0x7f1cc40f8560 msgr2=0x7f1cc40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:26.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.684+0000 7f1ccb000700 1 -- 172.21.15.84:0/3466683779 shutdown_connections 2024-04-26T21:29:26.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.684+0000 7f1ccb000700 1 -- 172.21.15.84:0/3466683779 wait complete. 2024-04-26T21:29:26.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.685+0000 7f1ccb000700 1 Processor -- start 2024-04-26T21:29:26.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.685+0000 7f1ccb000700 1 -- start start 2024-04-26T21:29:26.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.686+0000 7f1ccb000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc40fcf10 0x7f1cc4071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:26.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.686+0000 7f1ccb000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cc40fe080 0x7f1cc40702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:26.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.686+0000 7f1ccb000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc4070860 con 0x7f1cc40fcf10 2024-04-26T21:29:26.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.686+0000 7f1ccb000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40709d0 con 0x7f1cc40fe080 2024-04-26T21:29:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.686+0000 7f1cc3e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc40fcf10 0x7f1cc4071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.686+0000 7f1cc3e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc40fcf10 0x7f1cc4071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49848/0 (socket says 172.21.15.84:49848) 2024-04-26T21:29:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.686+0000 7f1cc3e00700 1 -- 172.21.15.84:0/2723824710 learned_addr learned my addr 172.21.15.84:0/2723824710 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:29:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.686+0000 7f1cc3400700 1 --2- 172.21.15.84:0/2723824710 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cc40fe080 0x7f1cc40702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.687+0000 7f1cc3e00700 1 -- 172.21.15.84:0/2723824710 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cc40fe080 msgr2=0x7f1cc40702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.687+0000 7f1cc3e00700 1 --2- 172.21.15.84:0/2723824710 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cc40fe080 0x7f1cc40702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.687+0000 7f1cc3e00700 1 -- 172.21.15.84:0/2723824710 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb4005040 con 0x7f1cc40fcf10 2024-04-26T21:29:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.687+0000 7f1cc3400700 1 --2- 172.21.15.84:0/2723824710 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cc40fe080 0x7f1cc40702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:29:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.687+0000 7f1cc3e00700 1 --2- 172.21.15.84:0/2723824710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc40fcf10 0x7f1cc4071de0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400b3b0 tx=0x7f1cb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.687+0000 7f1cbbe00700 1 -- 172.21.15.84:0/2723824710 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cb400e040 con 0x7f1cc40fcf10 2024-04-26T21:29:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.687+0000 7f1cbbe00700 1 -- 172.21.15.84:0/2723824710 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1cb400bcc0 con 0x7f1cc40fcf10 2024-04-26T21:29:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.687+0000 7f1cbbe00700 1 -- 172.21.15.84:0/2723824710 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cb401c630 con 0x7f1cc40fcf10 2024-04-26T21:29:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.687+0000 7f1ccb000700 1 -- 172.21.15.84:0/2723824710 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc4070c50 con 0x7f1cc40fcf10 2024-04-26T21:29:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.687+0000 7f1ccb000700 1 -- 172.21.15.84:0/2723824710 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc4115a10 con 0x7f1cc40fcf10 2024-04-26T21:29:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.689+0000 7f1ccb000700 1 -- 172.21.15.84:0/2723824710 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc405f5c0 con 0x7f1cc40fcf10 2024-04-26T21:29:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.690+0000 7f1cbbe00700 1 -- 172.21.15.84:0/2723824710 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1cb4013980 con 0x7f1cc40fcf10 2024-04-26T21:29:26.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.690+0000 7f1cbbe00700 1 --2- 172.21.15.84:0/2723824710 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f1ca806ec00 0x7f1ca80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:26.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.691+0000 7f1cbbe00700 1 -- 172.21.15.84:0/2723824710 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f1cb408f450 con 0x7f1cc40fcf10 2024-04-26T21:29:26.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.691+0000 7f1cc3400700 1 --2- 172.21.15.84:0/2723824710 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f1ca806ec00 0x7f1ca80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:26.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.692+0000 7f1cc3400700 1 --2- 172.21.15.84:0/2723824710 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f1ca806ec00 0x7f1ca80710b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00041d0 tx=0x7f1cb0009040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.695+0000 7f1cbbe00700 1 -- 172.21.15.84:0/2723824710 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f1cb4058320 con 0x7f1cc40fcf10 2024-04-26T21:29:26.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.948+0000 7f1ccb000700 1 -- 172.21.15.84:0/2723824710 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1cc41023f0 con 0x7f1ca806ec00 2024-04-26T21:29:26.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.950+0000 7f1cbbe00700 1 -- 172.21.15.84:0/2723824710 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7f1cc41023f0 con 0x7f1ca806ec00 2024-04-26T21:29:26.952 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:29:26.952 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:29:26.952 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:29:26.952 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:29:26.952 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-04-26T21:29:26.952 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr", 2024-04-26T21:29:26.952 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-04-26T21:29:26.952 INFO:teuthology.orchestra.run.smithi084.stdout: "crash" 2024-04-26T21:29:26.953 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-04-26T21:29:26.953 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "6/21 daemons upgraded", 2024-04-26T21:29:26.953 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading crash daemons", 2024-04-26T21:29:26.953 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:29:26.953 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:29:26.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.953+0000 7f1ccb000700 1 -- 172.21.15.84:0/2723824710 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f1ca806ec00 msgr2=0x7f1ca80710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:26.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.953+0000 7f1ccb000700 1 --2- 172.21.15.84:0/2723824710 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f1ca806ec00 0x7f1ca80710b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00041d0 tx=0x7f1cb0009040 comp rx=0 tx=0).stop 2024-04-26T21:29:26.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.953+0000 7f1ccb000700 1 -- 172.21.15.84:0/2723824710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc40fcf10 msgr2=0x7f1cc4071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:26.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.953+0000 7f1ccb000700 1 --2- 172.21.15.84:0/2723824710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc40fcf10 0x7f1cc4071de0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400b3b0 tx=0x7f1cb4009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:26.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.954+0000 7f1ccb000700 1 -- 172.21.15.84:0/2723824710 shutdown_connections 2024-04-26T21:29:26.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.954+0000 7f1ccb000700 1 --2- 172.21.15.84:0/2723824710 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f1ca806ec00 0x7f1ca80710b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:26.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.954+0000 7f1ccb000700 1 --2- 172.21.15.84:0/2723824710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc40fcf10 0x7f1cc4071de0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:26.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.954+0000 7f1ccb000700 1 --2- 172.21.15.84:0/2723824710 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cc40fe080 0x7f1cc40702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:26.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.954+0000 7f1ccb000700 1 -- 172.21.15.84:0/2723824710 >> 172.21.15.84:0/2723824710 conn(0x7f1cc40f8560 msgr2=0x7f1cc40f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:26.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.954+0000 7f1ccb000700 1 -- 172.21.15.84:0/2723824710 shutdown_connections 2024-04-26T21:29:26.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:26.954+0000 7f1ccb000700 1 -- 172.21.15.84:0/2723824710 wait complete. 2024-04-26T21:29:27.044 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:26 smithi120 ceph-mon[79001]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:29:27.044 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:26 smithi120 ceph-mon[79001]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:29:27.044 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:26 smithi120 ceph-mon[79001]: pgmap v54: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-26T21:29:27.044 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:26 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/4291293018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:29:27.044 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:26 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/888723246' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:29:27.044 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:26 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:27.044 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:26 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:27.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.108+0000 7f422ae00700 1 -- 172.21.15.84:0/1847632496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42240fcf10 msgr2=0x7f42240fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:27.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.108+0000 7f422ae00700 1 --2- 172.21.15.84:0/1847632496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42240fcf10 0x7f42240fd320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4214004940 tx=0x7f4214009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:27.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.108+0000 7f422ae00700 1 -- 172.21.15.84:0/1847632496 shutdown_connections 2024-04-26T21:29:27.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.108+0000 7f422ae00700 1 --2- 172.21.15.84:0/1847632496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42240fe080 0x7f42240fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:27.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.108+0000 7f422ae00700 1 --2- 172.21.15.84:0/1847632496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42240fcf10 0x7f42240fd320 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:27.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.108+0000 7f422ae00700 1 -- 172.21.15.84:0/1847632496 >> 172.21.15.84:0/1847632496 conn(0x7f42240f8560 msgr2=0x7f42240fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:27.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.108+0000 7f422ae00700 1 -- 172.21.15.84:0/1847632496 shutdown_connections 2024-04-26T21:29:27.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.108+0000 7f422ae00700 1 -- 172.21.15.84:0/1847632496 wait complete. 2024-04-26T21:29:27.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.109+0000 7f422ae00700 1 Processor -- start 2024-04-26T21:29:27.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.109+0000 7f422ae00700 1 -- start start 2024-04-26T21:29:27.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.109+0000 7f422ae00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42240fcf10 0x7f422410d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:27.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.109+0000 7f422ae00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42240fe080 0x7f422410df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:27.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.109+0000 7f422ae00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422410e520 con 0x7f42240fcf10 2024-04-26T21:29:27.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.109+0000 7f422ae00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422410ed70 con 0x7f42240fe080 2024-04-26T21:29:27.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.110+0000 7f4223e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42240fcf10 0x7f422410d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:27.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.110+0000 7f4223e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42240fcf10 0x7f422410d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49876/0 (socket says 172.21.15.84:49876) 2024-04-26T21:29:27.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.110+0000 7f4223e00700 1 -- 172.21.15.84:0/4137949310 learned_addr learned my addr 172.21.15.84:0/4137949310 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:29:27.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.110+0000 7f4223400700 1 --2- 172.21.15.84:0/4137949310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42240fe080 0x7f422410df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:27.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.110+0000 7f4223e00700 1 -- 172.21.15.84:0/4137949310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42240fe080 msgr2=0x7f422410df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:27.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.110+0000 7f4223e00700 1 --2- 172.21.15.84:0/4137949310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42240fe080 0x7f422410df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:27.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.110+0000 7f4223e00700 1 -- 172.21.15.84:0/4137949310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4214005040 con 0x7f42240fcf10 2024-04-26T21:29:27.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.111+0000 7f4223e00700 1 --2- 172.21.15.84:0/4137949310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42240fcf10 0x7f422410d9e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f421400b3b0 tx=0x7f4214009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:27.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.111+0000 7f421be00700 1 -- 172.21.15.84:0/4137949310 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f421400e040 con 0x7f42240fcf10 2024-04-26T21:29:27.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.111+0000 7f422ae00700 1 -- 172.21.15.84:0/4137949310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422410eff0 con 0x7f42240fcf10 2024-04-26T21:29:27.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.111+0000 7f421be00700 1 -- 172.21.15.84:0/4137949310 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4214004290 con 0x7f42240fcf10 2024-04-26T21:29:27.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.111+0000 7f421be00700 1 -- 172.21.15.84:0/4137949310 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f421401c630 con 0x7f42240fcf10 2024-04-26T21:29:27.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.111+0000 7f422ae00700 1 -- 172.21.15.84:0/4137949310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422410f530 con 0x7f42240fcf10 2024-04-26T21:29:27.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.112+0000 7f422ae00700 1 -- 172.21.15.84:0/4137949310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422405f5c0 con 0x7f42240fcf10 2024-04-26T21:29:27.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.113+0000 7f421be00700 1 -- 172.21.15.84:0/4137949310 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f421400bbf0 con 0x7f42240fcf10 2024-04-26T21:29:27.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.114+0000 7f421be00700 1 --2- 172.21.15.84:0/4137949310 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f420806ec10 0x7f42080710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:27.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.114+0000 7f421be00700 1 -- 172.21.15.84:0/4137949310 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f421408fa10 con 0x7f42240fcf10 2024-04-26T21:29:27.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.115+0000 7f4223400700 1 --2- 172.21.15.84:0/4137949310 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f420806ec10 0x7f42080710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:27.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.115+0000 7f4223400700 1 --2- 172.21.15.84:0/4137949310 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f420806ec10 0x7f42080710c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4210007fd0 tx=0x7f4210009040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:27.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.119+0000 7f421be00700 1 -- 172.21.15.84:0/4137949310 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f421405c410 con 0x7f42240fcf10 2024-04-26T21:29:27.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:26 smithi084 ceph-mon[90138]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:29:27.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:26 smithi084 ceph-mon[90138]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:29:27.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:26 smithi084 ceph-mon[90138]: pgmap v54: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-26T21:29:27.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:26 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/4291293018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:29:27.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:26 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/888723246' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:29:27.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:26 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:27.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:26 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:27.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.456+0000 7f422ae00700 1 -- 172.21.15.84:0/4137949310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f422404bed0 con 0x7f42240fcf10 2024-04-26T21:29:27.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.456+0000 7f421be00700 1 -- 172.21.15.84:0/4137949310 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f421405bfa0 con 0x7f42240fcf10 2024-04-26T21:29:27.458 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:29:27.458 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:29:27.458 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:29:27.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.459+0000 7f422ae00700 1 -- 172.21.15.84:0/4137949310 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f420806ec10 msgr2=0x7f42080710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:27.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.459+0000 7f422ae00700 1 --2- 172.21.15.84:0/4137949310 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f420806ec10 0x7f42080710c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4210007fd0 tx=0x7f4210009040 comp rx=0 tx=0).stop 2024-04-26T21:29:27.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.459+0000 7f422ae00700 1 -- 172.21.15.84:0/4137949310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42240fcf10 msgr2=0x7f422410d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:27.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.459+0000 7f422ae00700 1 --2- 172.21.15.84:0/4137949310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42240fcf10 0x7f422410d9e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f421400b3b0 tx=0x7f4214009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:27.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.459+0000 7f422ae00700 1 -- 172.21.15.84:0/4137949310 shutdown_connections 2024-04-26T21:29:27.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.459+0000 7f422ae00700 1 --2- 172.21.15.84:0/4137949310 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f420806ec10 0x7f42080710c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:27.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.459+0000 7f422ae00700 1 --2- 172.21.15.84:0/4137949310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42240fcf10 0x7f422410d9e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:27.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.459+0000 7f422ae00700 1 --2- 172.21.15.84:0/4137949310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42240fe080 0x7f422410df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:27.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.459+0000 7f422ae00700 1 -- 172.21.15.84:0/4137949310 >> 172.21.15.84:0/4137949310 conn(0x7f42240f8560 msgr2=0x7f42240f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:27.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.459+0000 7f422ae00700 1 -- 172.21.15.84:0/4137949310 shutdown_connections 2024-04-26T21:29:27.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:27.459+0000 7f422ae00700 1 -- 172.21.15.84:0/4137949310 wait complete. 2024-04-26T21:29:28.128 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:27 smithi084 ceph-mon[90138]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:29:28.128 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:27 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/4137949310' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:29:28.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:27 smithi120 ceph-mon[79001]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:29:28.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:27 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/4137949310' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:29:29.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:28 smithi084 ceph-mon[90138]: pgmap v55: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:29.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:28 smithi120 ceph-mon[79001]: pgmap v55: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:30.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:29 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:29:30.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:29 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:30.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:29 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:30.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:29 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:29:30.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:29 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:30.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:29 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:31.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:30 smithi084 ceph-mon[90138]: pgmap v56: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:30 smithi120 ceph-mon[79001]: pgmap v56: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:33.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:32 smithi084 ceph-mon[90138]: pgmap v57: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:33.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:33.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:29:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:29:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:29:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:29:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:29:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:29:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi084"}]: dispatch 2024-04-26T21:29:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi084"}]': finished 2024-04-26T21:29:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi120"}]: dispatch 2024-04-26T21:29:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi120"}]': finished 2024-04-26T21:29:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-26T21:29:33.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:32 smithi120 ceph-mon[79001]: pgmap v57: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:33.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:33.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:33.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:29:33.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:29:33.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:33.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:29:33.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:29:33.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:29:33.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:29:33.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:33.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi084"}]: dispatch 2024-04-26T21:29:33.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi084"}]': finished 2024-04-26T21:29:33.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi120"}]: dispatch 2024-04-26T21:29:33.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi120"}]': finished 2024-04-26T21:29:33.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-26T21:29:34.060 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:33 smithi084 ceph-mon[90138]: Upgrade: Setting container_image for all crash 2024-04-26T21:29:34.060 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:33 smithi084 ceph-mon[90138]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-26T21:29:34.060 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:33 smithi084 ceph-mon[90138]: Upgrade: osd.0 is safe to restart 2024-04-26T21:29:34.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:33 smithi120 ceph-mon[79001]: Upgrade: Setting container_image for all crash 2024-04-26T21:29:34.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:33 smithi120 ceph-mon[79001]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-26T21:29:34.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:33 smithi120 ceph-mon[79001]: Upgrade: osd.0 is safe to restart 2024-04-26T21:29:35.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:34 smithi084 ceph-mon[90138]: pgmap v58: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:35.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:34 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:35.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:34 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T21:29:35.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:34 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:29:35.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:34 smithi120 ceph-mon[79001]: pgmap v58: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:35.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:34 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:35.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:34 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T21:29:35.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:34 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:29:36.069 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:35 smithi084 ceph-mon[90138]: Upgrade: Updating osd.0 2024-04-26T21:29:36.069 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:35 smithi084 ceph-mon[90138]: Deploying daemon osd.0 on smithi084 2024-04-26T21:29:36.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:35 smithi120 ceph-mon[79001]: Upgrade: Updating osd.0 2024-04-26T21:29:36.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:35 smithi120 ceph-mon[79001]: Deploying daemon osd.0 on smithi084 2024-04-26T21:29:37.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:36 smithi084 ceph-mon[90138]: pgmap v59: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:37.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:36 smithi120 ceph-mon[79001]: pgmap v59: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:39.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:38 smithi084 ceph-mon[90138]: pgmap v60: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:39.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:38 smithi120 ceph-mon[79001]: pgmap v60: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:39.890 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:39 smithi084 systemd[1]: Stopping Ceph osd.0 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:29:40.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:39 smithi084 ceph-mon[90138]: osd.0 marked itself down and dead 2024-04-26T21:29:40.163 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:39 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0[43863]: 2024-04-26T21:29:39.887+0000 7f6512e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:29:40.163 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:39 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0[43863]: 2024-04-26T21:29:39.887+0000 7f6512e00700 -1 osd.0 48 *** Got signal Terminated *** 2024-04-26T21:29:40.163 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:39 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0[43863]: 2024-04-26T21:29:39.887+0000 7f6512e00700 -1 osd.0 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:29:40.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:39 smithi120 ceph-mon[79001]: osd.0 marked itself down and dead 2024-04-26T21:29:40.788 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:40 smithi084 podman[98700]: 2024-04-26 21:29:40.514892063 +0000 UTC m=+0.750370991 container died 3a2e74d7e51a857d8479d8097aa6db2a82872f8d613b581e03b48ca2112686c7 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, RELEASE=quincy-2be3efa, org.label-schema.schema-version=1.0) 2024-04-26T21:29:41.117 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:40 smithi084 ceph-mon[90138]: pgmap v61: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:41.117 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:40 smithi084 ceph-mon[90138]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:29:41.117 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:40 smithi084 ceph-mon[90138]: osdmap e49: 6 total, 5 up, 6 in 2024-04-26T21:29:41.118 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:40 smithi084 podman[98700]: 2024-04-26 21:29:40.89796947 +0000 UTC m=+1.133448429 container cleanup 3a2e74d7e51a857d8479d8097aa6db2a82872f8d613b581e03b48ca2112686c7 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0, RELEASE=quincy-2be3efa, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, ceph=True) 2024-04-26T21:29:41.118 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:40 smithi084 bash[98700]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0 2024-04-26T21:29:41.412 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:41 smithi084 podman[98718]: 2024-04-26 21:29:41.116215053 +0000 UTC m=+0.582913707 container remove 3a2e74d7e51a857d8479d8097aa6db2a82872f8d613b581e03b48ca2112686c7 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=quincy-2be3efa, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T21:29:41.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:41 smithi120 ceph-mon[79001]: pgmap v61: 65 pgs: 65 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:41.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:41 smithi120 ceph-mon[79001]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:29:41.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:41 smithi120 ceph-mon[79001]: osdmap e49: 6 total, 5 up, 6 in 2024-04-26T21:29:41.968 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:41 smithi084 podman[98807]: 2024-04-26 21:29:41.844864291 +0000 UTC m=+0.036556206 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:29:41.968 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:41 smithi084 podman[98807]: 2024-04-26 21:29:41.96707712 +0000 UTC m=+0.158769042 container create af598d16572ff2ff99f17aa7944260c6cd22c361b7771ad8c80741360ac25470 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:29:42.238 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:42 smithi084 ceph-mon[90138]: osdmap e50: 6 total, 5 up, 6 in 2024-04-26T21:29:42.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:42 smithi120 ceph-mon[79001]: osdmap e50: 6 total, 5 up, 6 in 2024-04-26T21:29:42.663 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:42 smithi084 podman[98807]: 2024-04-26 21:29:42.237658523 +0000 UTC m=+0.429350455 container init af598d16572ff2ff99f17aa7944260c6cd22c361b7771ad8c80741360ac25470 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:29:42.663 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:42 smithi084 podman[98807]: 2024-04-26 21:29:42.249289538 +0000 UTC m=+0.440981447 container start af598d16572ff2ff99f17aa7944260c6cd22c361b7771ad8c80741360ac25470 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-deactivate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-04-26T21:29:42.663 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:42 smithi084 podman[98807]: 2024-04-26 21:29:42.377950926 +0000 UTC m=+0.569642900 container attach af598d16572ff2ff99f17aa7944260c6cd22c361b7771ad8c80741360ac25470 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-26T21:29:43.013 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:42 smithi084 podman[98807]: 2024-04-26 21:29:42.704067621 +0000 UTC m=+0.895759572 container died af598d16572ff2ff99f17aa7944260c6cd22c361b7771ad8c80741360ac25470 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-26T21:29:43.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:43 smithi084 ceph-mon[90138]: pgmap v64: 65 pgs: 9 stale+active+clean, 56 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:43.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:43 smithi120 ceph-mon[79001]: pgmap v64: 65 pgs: 9 stale+active+clean, 56 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:43.828 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:43 smithi084 podman[98833]: 2024-04-26 21:29:43.431742053 +0000 UTC m=+0.712926876 container remove af598d16572ff2ff99f17aa7944260c6cd22c361b7771ad8c80741360ac25470 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:29:43.829 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:43 smithi084 systemd[1]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.0.service: Deactivated successfully. 2024-04-26T21:29:43.829 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:43 smithi084 systemd[1]: Stopped Ceph osd.0 for 8bb44d26-0411-11ef-bc93-c7b262605968. 2024-04-26T21:29:43.829 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:43 smithi084 systemd[1]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.0.service: Consumed 1min 36.471s CPU time. 2024-04-26T21:29:44.162 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:43 smithi084 systemd[1]: Starting Ceph osd.0 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:29:44.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.11", "id": [3, 0]}]: dispatch 2024-04-26T21:29:44.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [3, 2]}]: dispatch 2024-04-26T21:29:44.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [3, 0]}]: dispatch 2024-04-26T21:29:44.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 2]}]: dispatch 2024-04-26T21:29:44.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 2]}]: dispatch 2024-04-26T21:29:44.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.4", "id": [1, 0]}]: dispatch 2024-04-26T21:29:44.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [1, 0]}]: dispatch 2024-04-26T21:29:44.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [3, 0]}]: dispatch 2024-04-26T21:29:44.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]: dispatch 2024-04-26T21:29:44.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.11", "id": [3, 0]}]: dispatch 2024-04-26T21:29:44.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [3, 2]}]: dispatch 2024-04-26T21:29:44.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [3, 0]}]: dispatch 2024-04-26T21:29:44.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 2]}]: dispatch 2024-04-26T21:29:44.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 2]}]: dispatch 2024-04-26T21:29:44.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.4", "id": [1, 0]}]: dispatch 2024-04-26T21:29:44.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [1, 0]}]: dispatch 2024-04-26T21:29:44.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [3, 0]}]: dispatch 2024-04-26T21:29:44.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]: dispatch 2024-04-26T21:29:44.447 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:44 smithi084 podman[98933]: 2024-04-26 21:29:44.076621392 +0000 UTC m=+0.032979242 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:29:44.448 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:44 smithi084 podman[98933]: 2024-04-26 21:29:44.18444758 +0000 UTC m=+0.140805484 container create 24daa360a13e2ca571743a538aaed8c6b84ba5c6c79da8143cb1f3b336162d94 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-26T21:29:44.448 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:44 smithi084 podman[98933]: 2024-04-26 21:29:44.445869494 +0000 UTC m=+0.402227385 container init 24daa360a13e2ca571743a538aaed8c6b84ba5c6c79da8143cb1f3b336162d94 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-26T21:29:44.700 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:44 smithi084 podman[98933]: 2024-04-26 21:29:44.457935146 +0000 UTC m=+0.414293029 container start 24daa360a13e2ca571743a538aaed8c6b84ba5c6c79da8143cb1f3b336162d94 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-activate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:29:44.701 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:44 smithi084 podman[98933]: 2024-04-26 21:29:44.560599986 +0000 UTC m=+0.516957873 container attach 24daa360a13e2ca571743a538aaed8c6b84ba5c6c79da8143cb1f3b336162d94 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:29:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-mon[90138]: pgmap v65: 65 pgs: 9 stale+active+clean, 56 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.11", "id": [3, 0]}]': finished 2024-04-26T21:29:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [3, 2]}]': finished 2024-04-26T21:29:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [3, 0]}]': finished 2024-04-26T21:29:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 2]}]': finished 2024-04-26T21:29:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 2]}]': finished 2024-04-26T21:29:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.4", "id": [1, 0]}]': finished 2024-04-26T21:29:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [1, 0]}]': finished 2024-04-26T21:29:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [3, 0]}]': finished 2024-04-26T21:29:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]': finished 2024-04-26T21:29:45.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-mon[90138]: osdmap e51: 6 total, 5 up, 6 in 2024-04-26T21:29:45.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:45.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:29:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:45 smithi120 ceph-mon[79001]: pgmap v65: 65 pgs: 9 stale+active+clean, 56 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:29:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.11", "id": [3, 0]}]': finished 2024-04-26T21:29:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [3, 2]}]': finished 2024-04-26T21:29:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [3, 0]}]': finished 2024-04-26T21:29:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 2]}]': finished 2024-04-26T21:29:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 2]}]': finished 2024-04-26T21:29:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.4", "id": [1, 0]}]': finished 2024-04-26T21:29:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [1, 0]}]': finished 2024-04-26T21:29:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [3, 0]}]': finished 2024-04-26T21:29:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]': finished 2024-04-26T21:29:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:45 smithi120 ceph-mon[79001]: osdmap e51: 6 total, 5 up, 6 in 2024-04-26T21:29:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:29:45.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-activate[98948]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:29:45.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-activate[98948]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:29:45.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:45 smithi084 bash[98933]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:29:45.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:45 smithi084 bash[98933]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:29:45.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:45 smithi084 bash[98933]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T21:29:45.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:45 smithi084 bash[98933]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-26T21:29:45.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:45 smithi084 bash[98933]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-26T21:29:45.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:45 smithi084 bash[98933]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-26T21:29:45.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:45 smithi084 bash[98933]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-26T21:29:45.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:45 smithi084 bash[98933]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T21:29:45.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:45 smithi084 bash[98933]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-26T21:29:45.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-activate[98948]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T21:29:45.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-activate[98948]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-26T21:29:45.755 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-activate[98948]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-26T21:29:45.755 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-activate[98948]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-26T21:29:45.755 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-activate[98948]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-26T21:29:45.755 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-activate[98948]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T21:29:45.755 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:45 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-activate[98948]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-26T21:29:45.755 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:45 smithi084 podman[98933]: 2024-04-26 21:29:45.478649596 +0000 UTC m=+1.435007517 container died 24daa360a13e2ca571743a538aaed8c6b84ba5c6c79da8143cb1f3b336162d94 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:29:46.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:46 smithi084 ceph-mon[90138]: osdmap e52: 6 total, 5 up, 6 in 2024-04-26T21:29:46.412 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:46 smithi084 podman[99082]: 2024-04-26 21:29:46.090084971 +0000 UTC m=+0.588367293 container remove 24daa360a13e2ca571743a538aaed8c6b84ba5c6c79da8143cb1f3b336162d94 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True) 2024-04-26T21:29:46.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:46 smithi120 ceph-mon[79001]: osdmap e52: 6 total, 5 up, 6 in 2024-04-26T21:29:46.762 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:46 smithi084 podman[99141]: 2024-04-26 21:29:46.350161378 +0000 UTC m=+0.036103070 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:29:46.762 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:46 smithi084 podman[99141]: 2024-04-26 21:29:46.465162028 +0000 UTC m=+0.151103751 container create 99fbe2faa51b0d77990434297e753e370a6781050ad4914db36c06c8a4df788d (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-26T21:29:46.762 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:46 smithi084 podman[99141]: 2024-04-26 21:29:46.760684855 +0000 UTC m=+0.446626601 container init 99fbe2faa51b0d77990434297e753e370a6781050ad4914db36c06c8a4df788d (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, ceph=True, CEPH_POINT_RELEASE=) 2024-04-26T21:29:47.069 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:46 smithi084 podman[99141]: 2024-04-26 21:29:46.771993597 +0000 UTC m=+0.457935290 container start 99fbe2faa51b0d77990434297e753e370a6781050ad4914db36c06c8a4df788d (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:29:47.069 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:46 smithi084 ceph-osd[99159]: -- 172.21.15.84:0/4284479917 <== mon.0 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5560e6275680 con 0x5560e623f000 2024-04-26T21:29:47.070 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:46 smithi084 bash[99141]: 99fbe2faa51b0d77990434297e753e370a6781050ad4914db36c06c8a4df788d 2024-04-26T21:29:47.070 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:46 smithi084 systemd[1]: Started Ceph osd.0 for 8bb44d26-0411-11ef-bc93-c7b262605968. 2024-04-26T21:29:47.359 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:47 smithi084 ceph-mon[90138]: pgmap v68: 65 pgs: 7 peering, 18 active+undersized+degraded, 14 active+undersized, 26 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 69/363 objects degraded (19.008%) 2024-04-26T21:29:47.359 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:47 smithi084 ceph-mon[90138]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-26T21:29:47.360 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:47 smithi084 ceph-mon[90138]: Health check failed: Degraded data redundancy: 69/363 objects degraded (19.008%), 18 pgs degraded (PG_DEGRADED) 2024-04-26T21:29:47.360 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:47 smithi084 ceph-mon[90138]: osdmap e53: 6 total, 5 up, 6 in 2024-04-26T21:29:47.360 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:47 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:47.360 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:47 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:47 smithi120 ceph-mon[79001]: pgmap v68: 65 pgs: 7 peering, 18 active+undersized+degraded, 14 active+undersized, 26 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 69/363 objects degraded (19.008%) 2024-04-26T21:29:47.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:47 smithi120 ceph-mon[79001]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-26T21:29:47.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:47 smithi120 ceph-mon[79001]: Health check failed: Degraded data redundancy: 69/363 objects degraded (19.008%), 18 pgs degraded (PG_DEGRADED) 2024-04-26T21:29:47.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:47 smithi120 ceph-mon[79001]: osdmap e53: 6 total, 5 up, 6 in 2024-04-26T21:29:47.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:47 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:47.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:47 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:47.662 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:47 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0[99155]: 2024-04-26T21:29:47.357+0000 7f741e27b7c0 -1 Falling back to public interface 2024-04-26T21:29:48.343 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:48 smithi084 ceph-mon[90138]: osdmap e54: 6 total, 5 up, 6 in 2024-04-26T21:29:48.343 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:48 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:29:48.343 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:48 smithi084 ceph-mon[90138]: pgmap v71: 65 pgs: 7 peering, 18 active+undersized+degraded, 14 active+undersized, 26 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 69/363 objects degraded (19.008%) 2024-04-26T21:29:48.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:48 smithi120 ceph-mon[79001]: osdmap e54: 6 total, 5 up, 6 in 2024-04-26T21:29:48.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:48 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:29:48.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:48 smithi120 ceph-mon[79001]: pgmap v71: 65 pgs: 7 peering, 18 active+undersized+degraded, 14 active+undersized, 26 active+clean; 310 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 69/363 objects degraded (19.008%) 2024-04-26T21:29:49.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:49 smithi084 ceph-mon[90138]: osdmap e55: 6 total, 5 up, 6 in 2024-04-26T21:29:49.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:49 smithi120 ceph-mon[79001]: osdmap e55: 6 total, 5 up, 6 in 2024-04-26T21:29:50.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:50 smithi084 ceph-mon[90138]: osdmap e56: 6 total, 5 up, 6 in 2024-04-26T21:29:50.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:50 smithi084 ceph-mon[90138]: pgmap v74: 65 pgs: 8 active+clean+remapped, 18 active+undersized+degraded, 14 active+undersized, 25 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 69/363 objects degraded (19.008%); 9/363 objects misplaced (2.479%); 1024 KiB/s, 116 objects/s recovering 2024-04-26T21:29:50.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:50 smithi120 ceph-mon[79001]: osdmap e56: 6 total, 5 up, 6 in 2024-04-26T21:29:50.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:50 smithi120 ceph-mon[79001]: pgmap v74: 65 pgs: 8 active+clean+remapped, 18 active+undersized+degraded, 14 active+undersized, 25 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 69/363 objects degraded (19.008%); 9/363 objects misplaced (2.479%); 1024 KiB/s, 116 objects/s recovering 2024-04-26T21:29:51.399 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:51 smithi084 ceph-mon[90138]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-26T21:29:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:51 smithi120 ceph-mon[79001]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-26T21:29:52.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:52 smithi084 ceph-mon[90138]: pgmap v75: 65 pgs: 8 active+clean+remapped, 18 active+undersized+degraded, 14 active+undersized, 25 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 69/363 objects degraded (19.008%); 9/363 objects misplaced (2.479%); 721 KiB/s, 81 objects/s recovering 2024-04-26T21:29:52.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:52 smithi120 ceph-mon[79001]: pgmap v75: 65 pgs: 8 active+clean+remapped, 18 active+undersized+degraded, 14 active+undersized, 25 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 69/363 objects degraded (19.008%); 9/363 objects misplaced (2.479%); 721 KiB/s, 81 objects/s recovering 2024-04-26T21:29:52.662 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:52 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0[99155]: 2024-04-26T21:29:52.409+0000 7f741e27b7c0 -1 osd.0 48 log_to_monitors true 2024-04-26T21:29:53.370 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:53 smithi084 ceph-mon[90138]: from='osd.0 [v2:172.21.15.84:6802/215849876,v1:172.21.15.84:6803/215849876]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T21:29:53.370 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:29:53 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0[99155]: 2024-04-26T21:29:53.153+0000 7f740d600700 -1 osd.0 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:29:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:53 smithi120 ceph-mon[79001]: from='osd.0 [v2:172.21.15.84:6802/215849876,v1:172.21.15.84:6803/215849876]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T21:29:54.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:54 smithi084 ceph-mon[90138]: from='osd.0 [v2:172.21.15.84:6802/215849876,v1:172.21.15.84:6803/215849876]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T21:29:54.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:54 smithi084 ceph-mon[90138]: osdmap e57: 6 total, 5 up, 6 in 2024-04-26T21:29:54.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:54 smithi084 ceph-mon[90138]: from='osd.0 [v2:172.21.15.84:6802/215849876,v1:172.21.15.84:6803/215849876]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-04-26T21:29:54.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:54 smithi084 ceph-mon[90138]: pgmap v77: 65 pgs: 8 active+clean+remapped, 18 active+undersized+degraded, 14 active+undersized, 25 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 69/363 objects degraded (19.008%); 9/363 objects misplaced (2.479%); 682 KiB/s, 77 objects/s recovering 2024-04-26T21:29:54.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:54 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:54.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:54 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:54.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:54 smithi120 ceph-mon[79001]: from='osd.0 [v2:172.21.15.84:6802/215849876,v1:172.21.15.84:6803/215849876]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T21:29:54.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:54 smithi120 ceph-mon[79001]: osdmap e57: 6 total, 5 up, 6 in 2024-04-26T21:29:54.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:54 smithi120 ceph-mon[79001]: from='osd.0 [v2:172.21.15.84:6802/215849876,v1:172.21.15.84:6803/215849876]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-04-26T21:29:54.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:54 smithi120 ceph-mon[79001]: pgmap v77: 65 pgs: 8 active+clean+remapped, 18 active+undersized+degraded, 14 active+undersized, 25 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 69/363 objects degraded (19.008%); 9/363 objects misplaced (2.479%); 682 KiB/s, 77 objects/s recovering 2024-04-26T21:29:54.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:54 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:54.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:54 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:55.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:55 smithi084 ceph-mon[90138]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:29:55.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:55 smithi084 ceph-mon[90138]: osd.0 [v2:172.21.15.84:6802/215849876,v1:172.21.15.84:6803/215849876] boot 2024-04-26T21:29:55.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:55 smithi084 ceph-mon[90138]: osdmap e58: 6 total, 6 up, 6 in 2024-04-26T21:29:55.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:55 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:29:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:55 smithi120 ceph-mon[79001]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:29:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:55 smithi120 ceph-mon[79001]: osd.0 [v2:172.21.15.84:6802/215849876,v1:172.21.15.84:6803/215849876] boot 2024-04-26T21:29:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:55 smithi120 ceph-mon[79001]: osdmap e58: 6 total, 6 up, 6 in 2024-04-26T21:29:55.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:55 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:29:56.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:56 smithi084 ceph-mon[90138]: osdmap e59: 6 total, 6 up, 6 in 2024-04-26T21:29:56.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:56 smithi084 ceph-mon[90138]: pgmap v80: 65 pgs: 8 remapped+peering, 23 peering, 3 active+undersized+degraded, 6 active+undersized, 25 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 14/363 objects degraded (3.857%) 2024-04-26T21:29:56.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:56.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:56.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:56 smithi120 ceph-mon[79001]: osdmap e59: 6 total, 6 up, 6 in 2024-04-26T21:29:56.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:56 smithi120 ceph-mon[79001]: pgmap v80: 65 pgs: 8 remapped+peering, 23 peering, 3 active+undersized+degraded, 6 active+undersized, 25 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 14/363 objects degraded (3.857%) 2024-04-26T21:29:56.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:56.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:57.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:57 smithi084 ceph-mon[90138]: Health check update: Degraded data redundancy: 14/363 objects degraded (3.857%), 3 pgs degraded (PG_DEGRADED) 2024-04-26T21:29:57.285 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:57 smithi084 ceph-mon[90138]: osdmap e60: 6 total, 6 up, 6 in 2024-04-26T21:29:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:57 smithi120 ceph-mon[79001]: Health check update: Degraded data redundancy: 14/363 objects degraded (3.857%), 3 pgs degraded (PG_DEGRADED) 2024-04-26T21:29:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:57 smithi120 ceph-mon[79001]: osdmap e60: 6 total, 6 up, 6 in 2024-04-26T21:29:57.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.652+0000 7fb043000700 1 -- 172.21.15.84:0/2557912296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb03c0ffee0 msgr2=0x7fb03c102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:57.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.652+0000 7fb043000700 1 --2- 172.21.15.84:0/2557912296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb03c0ffee0 0x7fb03c102300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb028004940 tx=0x7fb028009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:57.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.652+0000 7fb043000700 1 -- 172.21.15.84:0/2557912296 shutdown_connections 2024-04-26T21:29:57.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.652+0000 7fb043000700 1 --2- 172.21.15.84:0/2557912296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb03c0ffee0 0x7fb03c102300 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:57.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.652+0000 7fb043000700 1 --2- 172.21.15.84:0/2557912296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb03c0662c0 0x7fb03c0ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:57.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.652+0000 7fb043000700 1 -- 172.21.15.84:0/2557912296 >> 172.21.15.84:0/2557912296 conn(0x7fb03c0f7430 msgr2=0x7fb03c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:57.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.652+0000 7fb043000700 1 -- 172.21.15.84:0/2557912296 shutdown_connections 2024-04-26T21:29:57.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.652+0000 7fb043000700 1 -- 172.21.15.84:0/2557912296 wait complete. 2024-04-26T21:29:57.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.653+0000 7fb043000700 1 Processor -- start 2024-04-26T21:29:57.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.653+0000 7fb043000700 1 -- start start 2024-04-26T21:29:57.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.653+0000 7fb043000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb03c0662c0 0x7fb03c10fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:57.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.653+0000 7fb043000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb03c0ffee0 0x7fb03c110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:57.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.653+0000 7fb043000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c110790 con 0x7fb03c0662c0 2024-04-26T21:29:57.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.653+0000 7fb043000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c110fe0 con 0x7fb03c0ffee0 2024-04-26T21:29:57.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.654+0000 7fb03be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb03c0662c0 0x7fb03c10fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:57.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.654+0000 7fb03be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb03c0662c0 0x7fb03c10fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33590/0 (socket says 172.21.15.84:33590) 2024-04-26T21:29:57.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.654+0000 7fb03be00700 1 -- 172.21.15.84:0/2644921120 learned_addr learned my addr 172.21.15.84:0/2644921120 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:29:57.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.654+0000 7fb03b400700 1 --2- 172.21.15.84:0/2644921120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb03c0ffee0 0x7fb03c110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.654+0000 7fb03be00700 1 -- 172.21.15.84:0/2644921120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb03c0ffee0 msgr2=0x7fb03c110190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.654+0000 7fb03be00700 1 --2- 172.21.15.84:0/2644921120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb03c0ffee0 0x7fb03c110190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.654+0000 7fb03be00700 1 -- 172.21.15.84:0/2644921120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb028005040 con 0x7fb03c0662c0 2024-04-26T21:29:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.655+0000 7fb03be00700 1 --2- 172.21.15.84:0/2644921120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb03c0662c0 0x7fb03c10fc50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb02c002a50 tx=0x7fb02c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.655+0000 7fb033e00700 1 -- 172.21.15.84:0/2644921120 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb02c007cc0 con 0x7fb03c0662c0 2024-04-26T21:29:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.655+0000 7fb043000700 1 -- 172.21.15.84:0/2644921120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03c1112c0 con 0x7fb03c0662c0 2024-04-26T21:29:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.655+0000 7fb033e00700 1 -- 172.21.15.84:0/2644921120 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb02c00f040 con 0x7fb03c0662c0 2024-04-26T21:29:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.655+0000 7fb033e00700 1 -- 172.21.15.84:0/2644921120 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb02c00daf0 con 0x7fb03c0662c0 2024-04-26T21:29:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.655+0000 7fb043000700 1 -- 172.21.15.84:0/2644921120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03c111800 con 0x7fb03c0662c0 2024-04-26T21:29:57.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.656+0000 7fb043000700 1 -- 172.21.15.84:0/2644921120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03c05f5c0 con 0x7fb03c0662c0 2024-04-26T21:29:57.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.658+0000 7fb033e00700 1 -- 172.21.15.84:0/2644921120 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb02c009810 con 0x7fb03c0662c0 2024-04-26T21:29:57.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.659+0000 7fb033e00700 1 --2- 172.21.15.84:0/2644921120 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb02006ec10 0x7fb0200710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:57.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.659+0000 7fb033e00700 1 -- 172.21.15.84:0/2644921120 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fb02c08e680 con 0x7fb03c0662c0 2024-04-26T21:29:57.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.659+0000 7fb03b400700 1 --2- 172.21.15.84:0/2644921120 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb02006ec10 0x7fb0200710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.660+0000 7fb03b400700 1 --2- 172.21.15.84:0/2644921120 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb02006ec10 0x7fb0200710c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb028004f90 tx=0x7fb028009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:57.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.664+0000 7fb033e00700 1 -- 172.21.15.84:0/2644921120 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fb02c05aeb0 con 0x7fb03c0662c0 2024-04-26T21:29:57.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.953+0000 7fb043000700 1 -- 172.21.15.84:0/2644921120 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb03c111bd0 con 0x7fb02006ec10 2024-04-26T21:29:57.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.954+0000 7fb033e00700 1 -- 172.21.15.84:0/2644921120 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb03c111bd0 con 0x7fb02006ec10 2024-04-26T21:29:57.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.958+0000 7fb043000700 1 -- 172.21.15.84:0/2644921120 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb02006ec10 msgr2=0x7fb0200710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:57.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.958+0000 7fb043000700 1 --2- 172.21.15.84:0/2644921120 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb02006ec10 0x7fb0200710c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb028004f90 tx=0x7fb028009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:57.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.958+0000 7fb043000700 1 -- 172.21.15.84:0/2644921120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb03c0662c0 msgr2=0x7fb03c10fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:57.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.958+0000 7fb043000700 1 --2- 172.21.15.84:0/2644921120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb03c0662c0 0x7fb03c10fc50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb02c002a50 tx=0x7fb02c004600 comp rx=0 tx=0).stop 2024-04-26T21:29:57.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.958+0000 7fb043000700 1 -- 172.21.15.84:0/2644921120 shutdown_connections 2024-04-26T21:29:57.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.958+0000 7fb043000700 1 --2- 172.21.15.84:0/2644921120 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb02006ec10 0x7fb0200710c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:57.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.958+0000 7fb043000700 1 --2- 172.21.15.84:0/2644921120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb03c0662c0 0x7fb03c10fc50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:57.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.958+0000 7fb043000700 1 --2- 172.21.15.84:0/2644921120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb03c0ffee0 0x7fb03c110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:57.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.958+0000 7fb043000700 1 -- 172.21.15.84:0/2644921120 >> 172.21.15.84:0/2644921120 conn(0x7fb03c0f7430 msgr2=0x7fb03c0fba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:57.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.958+0000 7fb043000700 1 -- 172.21.15.84:0/2644921120 shutdown_connections 2024-04-26T21:29:57.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:57.958+0000 7fb043000700 1 -- 172.21.15.84:0/2644921120 wait complete. 2024-04-26T21:29:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:29:58.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.127+0000 7fcc59800700 1 -- 172.21.15.84:0/2270882090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc54071de0 msgr2=0x7fcc540702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:58.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.127+0000 7fcc59800700 1 --2- 172.21.15.84:0/2270882090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc54071de0 0x7fcc540702f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcc44004940 tx=0x7fcc44009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:58.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.127+0000 7fcc59800700 1 -- 172.21.15.84:0/2270882090 shutdown_connections 2024-04-26T21:29:58.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.127+0000 7fcc59800700 1 --2- 172.21.15.84:0/2270882090 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc54070830 0x7fcc54070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:58.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.127+0000 7fcc59800700 1 --2- 172.21.15.84:0/2270882090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc54071de0 0x7fcc540702f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:58.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.127+0000 7fcc59800700 1 -- 172.21.15.84:0/2270882090 >> 172.21.15.84:0/2270882090 conn(0x7fcc540f8500 msgr2=0x7fcc540fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:58.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.128+0000 7fcc59800700 1 -- 172.21.15.84:0/2270882090 shutdown_connections 2024-04-26T21:29:58.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.128+0000 7fcc59800700 1 -- 172.21.15.84:0/2270882090 wait complete. 2024-04-26T21:29:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.129+0000 7fcc59800700 1 Processor -- start 2024-04-26T21:29:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.129+0000 7fcc59800700 1 -- start start 2024-04-26T21:29:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.129+0000 7fcc59800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc54070830 0x7fcc5410fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.129+0000 7fcc59800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc54110330 0x7fcc541110d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.129+0000 7fcc59800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc541107f0 con 0x7fcc54070830 2024-04-26T21:29:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.129+0000 7fcc59800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc54110930 con 0x7fcc54110330 2024-04-26T21:29:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.130+0000 7fcc52a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc54070830 0x7fcc5410fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.130+0000 7fcc52a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc54070830 0x7fcc5410fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33606/0 (socket says 172.21.15.84:33606) 2024-04-26T21:29:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.130+0000 7fcc52a00700 1 -- 172.21.15.84:0/1557628354 learned_addr learned my addr 172.21.15.84:0/1557628354 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:29:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.130+0000 7fcc52000700 1 --2- 172.21.15.84:0/1557628354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc54110330 0x7fcc541110d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.130+0000 7fcc52a00700 1 -- 172.21.15.84:0/1557628354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc54110330 msgr2=0x7fcc541110d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.130+0000 7fcc52a00700 1 --2- 172.21.15.84:0/1557628354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc54110330 0x7fcc541110d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.130+0000 7fcc52a00700 1 -- 172.21.15.84:0/1557628354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc44005040 con 0x7fcc54070830 2024-04-26T21:29:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.131+0000 7fcc52a00700 1 --2- 172.21.15.84:0/1557628354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc54070830 0x7fcc5410fdf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcc44000c00 tx=0x7fcc44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:58.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.131+0000 7fcc4aa00700 1 -- 172.21.15.84:0/1557628354 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc44020070 con 0x7fcc54070830 2024-04-26T21:29:58.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.131+0000 7fcc4aa00700 1 -- 172.21.15.84:0/1557628354 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc44009430 con 0x7fcc54070830 2024-04-26T21:29:58.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.131+0000 7fcc59800700 1 -- 172.21.15.84:0/1557628354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc54111700 con 0x7fcc54070830 2024-04-26T21:29:58.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.131+0000 7fcc4aa00700 1 -- 172.21.15.84:0/1557628354 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc4400e070 con 0x7fcc54070830 2024-04-26T21:29:58.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.131+0000 7fcc59800700 1 -- 172.21.15.84:0/1557628354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc54111c60 con 0x7fcc54070830 2024-04-26T21:29:58.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.133+0000 7fcc59800700 1 -- 172.21.15.84:0/1557628354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc541082d0 con 0x7fcc54070830 2024-04-26T21:29:58.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.134+0000 7fcc4aa00700 1 -- 172.21.15.84:0/1557628354 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcc4401c670 con 0x7fcc54070830 2024-04-26T21:29:58.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.135+0000 7fcc4aa00700 1 --2- 172.21.15.84:0/1557628354 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fcc3806ec10 0x7fcc380710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:58.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.135+0000 7fcc4aa00700 1 -- 172.21.15.84:0/1557628354 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fcc4408fae0 con 0x7fcc54070830 2024-04-26T21:29:58.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.135+0000 7fcc52000700 1 --2- 172.21.15.84:0/1557628354 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fcc3806ec10 0x7fcc380710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:58.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.136+0000 7fcc52000700 1 --2- 172.21.15.84:0/1557628354 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fcc3806ec10 0x7fcc380710c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcc40004600 tx=0x7fcc4000b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.142+0000 7fcc4aa00700 1 -- 172.21.15.84:0/1557628354 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fcc440587e0 con 0x7fcc54070830 2024-04-26T21:29:58.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:58 smithi120 ceph-mon[79001]: osdmap e61: 6 total, 6 up, 6 in 2024-04-26T21:29:58.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:58 smithi120 ceph-mon[79001]: pgmap v83: 65 pgs: 8 remapped+peering, 23 peering, 3 active+undersized+degraded, 6 active+undersized, 25 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 14/363 objects degraded (3.857%) 2024-04-26T21:29:58.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:58 smithi120 ceph-mon[79001]: from='client.34236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:29:58.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.473+0000 7fcc59800700 1 -- 172.21.15.84:0/1557628354 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc54107bd0 con 0x7fcc3806ec10 2024-04-26T21:29:58.473 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:58 smithi084 ceph-mon[90138]: osdmap e61: 6 total, 6 up, 6 in 2024-04-26T21:29:58.474 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:58 smithi084 ceph-mon[90138]: pgmap v83: 65 pgs: 8 remapped+peering, 23 peering, 3 active+undersized+degraded, 6 active+undersized, 25 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 14/363 objects degraded (3.857%) 2024-04-26T21:29:58.474 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:58 smithi084 ceph-mon[90138]: from='client.34236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:29:58.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.475+0000 7fcc4aa00700 1 -- 172.21.15.84:0/1557628354 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fcc54107bd0 con 0x7fcc3806ec10 2024-04-26T21:29:58.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.478+0000 7fcc59800700 1 -- 172.21.15.84:0/1557628354 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fcc3806ec10 msgr2=0x7fcc380710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:58.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.478+0000 7fcc59800700 1 --2- 172.21.15.84:0/1557628354 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fcc3806ec10 0x7fcc380710c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcc40004600 tx=0x7fcc4000b040 comp rx=0 tx=0).stop 2024-04-26T21:29:58.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.478+0000 7fcc59800700 1 -- 172.21.15.84:0/1557628354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc54070830 msgr2=0x7fcc5410fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:58.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.478+0000 7fcc59800700 1 --2- 172.21.15.84:0/1557628354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc54070830 0x7fcc5410fdf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcc44000c00 tx=0x7fcc44009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:58.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.478+0000 7fcc59800700 1 -- 172.21.15.84:0/1557628354 shutdown_connections 2024-04-26T21:29:58.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.478+0000 7fcc59800700 1 --2- 172.21.15.84:0/1557628354 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fcc3806ec10 0x7fcc380710c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:58.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.478+0000 7fcc59800700 1 --2- 172.21.15.84:0/1557628354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc54070830 0x7fcc5410fdf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:58.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.478+0000 7fcc59800700 1 --2- 172.21.15.84:0/1557628354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc54110330 0x7fcc541110d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:58.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.478+0000 7fcc59800700 1 -- 172.21.15.84:0/1557628354 >> 172.21.15.84:0/1557628354 conn(0x7fcc540f8500 msgr2=0x7fcc540f9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:58.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.478+0000 7fcc59800700 1 -- 172.21.15.84:0/1557628354 shutdown_connections 2024-04-26T21:29:58.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.478+0000 7fcc59800700 1 -- 172.21.15.84:0/1557628354 wait complete. 2024-04-26T21:29:58.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.628+0000 7f94a2a00700 1 -- 172.21.15.84:0/946188767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f949c1033f0 msgr2=0x7f949c103800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:58.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.628+0000 7f94a2a00700 1 --2- 172.21.15.84:0/946188767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f949c1033f0 0x7f949c103800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f948c004940 tx=0x7f948c009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:58.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.628+0000 7f94a2a00700 1 -- 172.21.15.84:0/946188767 shutdown_connections 2024-04-26T21:29:58.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.628+0000 7f94a2a00700 1 --2- 172.21.15.84:0/946188767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f949c1046a0 0x7f949c104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:58.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.628+0000 7f94a2a00700 1 --2- 172.21.15.84:0/946188767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f949c1033f0 0x7f949c103800 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:58.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.628+0000 7f94a2a00700 1 -- 172.21.15.84:0/946188767 >> 172.21.15.84:0/946188767 conn(0x7f949c0725e0 msgr2=0x7f949c074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:58.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.628+0000 7f94a2a00700 1 -- 172.21.15.84:0/946188767 shutdown_connections 2024-04-26T21:29:58.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.628+0000 7f94a2a00700 1 -- 172.21.15.84:0/946188767 wait complete. 2024-04-26T21:29:58.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.629+0000 7f94a2a00700 1 Processor -- start 2024-04-26T21:29:58.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.629+0000 7f94a2a00700 1 -- start start 2024-04-26T21:29:58.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.630+0000 7f94a2a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f949c1033f0 0x7f949c113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:58.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.630+0000 7f94a2a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f949c1046a0 0x7f949c114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:58.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.630+0000 7f94a2a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c114a40 con 0x7f949c1033f0 2024-04-26T21:29:58.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.630+0000 7f94a2a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c114bb0 con 0x7f949c1046a0 2024-04-26T21:29:58.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.630+0000 7f949be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f949c1033f0 0x7f949c113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:58.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.630+0000 7f949be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f949c1033f0 0x7f949c113f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33624/0 (socket says 172.21.15.84:33624) 2024-04-26T21:29:58.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.630+0000 7f949be00700 1 -- 172.21.15.84:0/3415149691 learned_addr learned my addr 172.21.15.84:0/3415149691 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:29:58.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.631+0000 7f949be00700 1 -- 172.21.15.84:0/3415149691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f949c1046a0 msgr2=0x7f949c114440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T21:29:58.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.631+0000 7f949be00700 1 --2- 172.21.15.84:0/3415149691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f949c1046a0 0x7f949c114440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:58.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.631+0000 7f949be00700 1 -- 172.21.15.84:0/3415149691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c005040 con 0x7f949c1033f0 2024-04-26T21:29:58.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.631+0000 7f949be00700 1 --2- 172.21.15.84:0/3415149691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f949c1033f0 0x7f949c113f00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f948c009150 tx=0x7f948c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:58.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.631+0000 7f9493e00700 1 -- 172.21.15.84:0/3415149691 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f948c00e040 con 0x7f949c1033f0 2024-04-26T21:29:58.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.631+0000 7f9493e00700 1 -- 172.21.15.84:0/3415149691 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f948c00bcc0 con 0x7f949c1033f0 2024-04-26T21:29:58.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.632+0000 7f94a2a00700 1 -- 172.21.15.84:0/3415149691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949c1195b0 con 0x7f949c1033f0 2024-04-26T21:29:58.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.632+0000 7f9493e00700 1 -- 172.21.15.84:0/3415149691 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f948c01c610 con 0x7f949c1033f0 2024-04-26T21:29:58.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.632+0000 7f94a2a00700 1 -- 172.21.15.84:0/3415149691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c119b70 con 0x7f949c1033f0 2024-04-26T21:29:58.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.633+0000 7f94a2a00700 1 -- 172.21.15.84:0/3415149691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949c04c710 con 0x7f949c1033f0 2024-04-26T21:29:58.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.635+0000 7f9493e00700 1 -- 172.21.15.84:0/3415149691 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f948c013a80 con 0x7f949c1033f0 2024-04-26T21:29:58.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.636+0000 7f9493e00700 1 --2- 172.21.15.84:0/3415149691 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f948006ec00 0x7f94800710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:58.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.636+0000 7f9493e00700 1 -- 172.21.15.84:0/3415149691 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f948c08f410 con 0x7f949c1033f0 2024-04-26T21:29:58.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.636+0000 7f949b400700 1 --2- 172.21.15.84:0/3415149691 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f948006ec00 0x7f94800710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:58.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.636+0000 7f949b400700 1 --2- 172.21.15.84:0/3415149691 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f948006ec00 0x7f94800710b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9488004d00 tx=0x7f9488009ce0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:58.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.640+0000 7f9493e00700 1 -- 172.21.15.84:0/3415149691 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f948c05bd90 con 0x7f949c1033f0 2024-04-26T21:29:58.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.886+0000 7f94a2a00700 1 -- 172.21.15.84:0/3415149691 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f949c1089c0 con 0x7f948006ec00 2024-04-26T21:29:58.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.914+0000 7f9493e00700 1 -- 172.21.15.84:0/3415149691 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f949c1089c0 con 0x7f948006ec00 2024-04-26T21:29:58.915 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:29:58.915 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (4m) 4s ago 15m 14.2M - 0.25.0 c8568f914cd2 bcb419cf9108 2024-04-26T21:29:58.915 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (49s) 4s ago 15m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 b4010dfbe623 2024-04-26T21:29:58.915 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (41s) 36s ago 14m 6665k - 19.0.0-3306-gbc612ffb 55dc54019ad8 89a4e50ea23c 2024-04-26T21:29:58.915 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (4m) 4s ago 15m 76.4M - 9.4.7 954c08fa6188 1bf95f604e07 2024-04-26T21:29:58.915 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (8m) 4s ago 8m 115M - 17.2.7-907-g2be3efa9 1c5834633715 485d7884e1d5 2024-04-26T21:29:58.915 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (8m) 4s ago 8m 14.1M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:29:58.916 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (8m) 36s ago 8m 113M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:29:58.916 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (8m) 36s ago 8m 13.8M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:29:58.916 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (4m) 4s ago 17m 502M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:29:58.916 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283,8765 running (2m) 36s ago 14m 452M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d6ae0b4628b5 2024-04-26T21:29:58.916 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (2m) 4s ago 17m 43.5M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 bf610abb6a62 2024-04-26T21:29:58.916 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (107s) 36s ago 14m 33.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 5d530496253b 2024-04-26T21:29:58.916 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (4m) 4s ago 15m 7948k - 1.5.0 0da6a335fe13 81e00b40bfbf 2024-04-26T21:29:58.916 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (4m) 36s ago 14m 7810k - 1.5.0 0da6a335fe13 0506a1d46ec4 2024-04-26T21:29:58.916 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (12s) 4s ago 13m 11.1M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 99fbe2faa51b 2024-04-26T21:29:58.916 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (12m) 4s ago 12m 214M 1557M 17.2.7-907-g2be3efa9 1c5834633715 d283a0a93213 2024-04-26T21:29:58.916 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (12m) 4s ago 12m 177M 1557M 17.2.7-907-g2be3efa9 1c5834633715 5899468fc5c8 2024-04-26T21:29:58.916 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (11m) 36s ago 11m 230M 2581M 17.2.7-907-g2be3efa9 1c5834633715 b8a14c87d730 2024-04-26T21:29:58.916 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (10m) 36s ago 10m 216M 2581M 17.2.7-907-g2be3efa9 1c5834633715 4d294df735a3 2024-04-26T21:29:58.916 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (10m) 36s ago 10m 201M 2581M 17.2.7-907-g2be3efa9 1c5834633715 9b60997971a8 2024-04-26T21:29:58.916 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (3m) 4s ago 14m 53.8M - 2.43.0 a07b618ecd1d d3008b765eec 2024-04-26T21:29:58.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.918+0000 7f94a2a00700 1 -- 172.21.15.84:0/3415149691 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f948006ec00 msgr2=0x7f94800710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:58.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.918+0000 7f94a2a00700 1 --2- 172.21.15.84:0/3415149691 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f948006ec00 0x7f94800710b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9488004d00 tx=0x7f9488009ce0 comp rx=0 tx=0).stop 2024-04-26T21:29:58.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.918+0000 7f94a2a00700 1 -- 172.21.15.84:0/3415149691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f949c1033f0 msgr2=0x7f949c113f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:58.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.918+0000 7f94a2a00700 1 --2- 172.21.15.84:0/3415149691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f949c1033f0 0x7f949c113f00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f948c009150 tx=0x7f948c009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:58.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.918+0000 7f94a2a00700 1 -- 172.21.15.84:0/3415149691 shutdown_connections 2024-04-26T21:29:58.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.918+0000 7f94a2a00700 1 --2- 172.21.15.84:0/3415149691 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f948006ec00 0x7f94800710b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:58.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.918+0000 7f94a2a00700 1 --2- 172.21.15.84:0/3415149691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f949c1033f0 0x7f949c113f00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:58.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.918+0000 7f94a2a00700 1 --2- 172.21.15.84:0/3415149691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f949c1046a0 0x7f949c114440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:58.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.918+0000 7f94a2a00700 1 -- 172.21.15.84:0/3415149691 >> 172.21.15.84:0/3415149691 conn(0x7f949c0725e0 msgr2=0x7f949c073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:58.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.918+0000 7f94a2a00700 1 -- 172.21.15.84:0/3415149691 shutdown_connections 2024-04-26T21:29:58.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:58.918+0000 7f94a2a00700 1 -- 172.21.15.84:0/3415149691 wait complete. 2024-04-26T21:29:59.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.083+0000 7fc1a7600700 1 -- 172.21.15.84:0/1718327896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a0066b50 msgr2=0x7fc1a0101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:59.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.083+0000 7fc1a7600700 1 --2- 172.21.15.84:0/1718327896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a0066b50 0x7fc1a0101db0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc194004940 tx=0x7fc194009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:59.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.083+0000 7fc1a7600700 1 -- 172.21.15.84:0/1718327896 shutdown_connections 2024-04-26T21:29:59.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.083+0000 7fc1a7600700 1 --2- 172.21.15.84:0/1718327896 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1a01022f0 0x7fc1a01046d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:59.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.083+0000 7fc1a7600700 1 --2- 172.21.15.84:0/1718327896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a0066b50 0x7fc1a0101db0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:59.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.083+0000 7fc1a7600700 1 -- 172.21.15.84:0/1718327896 >> 172.21.15.84:0/1718327896 conn(0x7fc1a00f7420 msgr2=0x7fc1a00f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:59.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.083+0000 7fc1a7600700 1 -- 172.21.15.84:0/1718327896 shutdown_connections 2024-04-26T21:29:59.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.083+0000 7fc1a7600700 1 -- 172.21.15.84:0/1718327896 wait complete. 2024-04-26T21:29:59.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.084+0000 7fc1a7600700 1 Processor -- start 2024-04-26T21:29:59.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.084+0000 7fc1a7600700 1 -- start start 2024-04-26T21:29:59.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.085+0000 7fc1a7600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1a0066b50 0x7fc1a010fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:59.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.085+0000 7fc1a7600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a01022f0 0x7fc1a0110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:59.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.085+0000 7fc1a7600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a0110780 con 0x7fc1a01022f0 2024-04-26T21:29:59.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.085+0000 7fc1a7600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a0110fd0 con 0x7fc1a0066b50 2024-04-26T21:29:59.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.085+0000 7fc19fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a01022f0 0x7fc1a0110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:59.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.085+0000 7fc19fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a01022f0 0x7fc1a0110180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33638/0 (socket says 172.21.15.84:33638) 2024-04-26T21:29:59.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.085+0000 7fc19fe00700 1 -- 172.21.15.84:0/4209415026 learned_addr learned my addr 172.21.15.84:0/4209415026 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:29:59.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.085+0000 7fc1a4c00700 1 --2- 172.21.15.84:0/4209415026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1a0066b50 0x7fc1a010fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:59.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.086+0000 7fc19fe00700 1 -- 172.21.15.84:0/4209415026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1a0066b50 msgr2=0x7fc1a010fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:59.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.086+0000 7fc19fe00700 1 --2- 172.21.15.84:0/4209415026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1a0066b50 0x7fc1a010fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:59.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.086+0000 7fc19fe00700 1 -- 172.21.15.84:0/4209415026 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc194005040 con 0x7fc1a01022f0 2024-04-26T21:29:59.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.086+0000 7fc1a4c00700 1 --2- 172.21.15.84:0/4209415026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1a0066b50 0x7fc1a010fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:29:59.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.086+0000 7fc19fe00700 1 --2- 172.21.15.84:0/4209415026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a01022f0 0x7fc1a0110180 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc18c002a50 tx=0x7fc18c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:59.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.086+0000 7fc19cc00700 1 -- 172.21.15.84:0/4209415026 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc18c007cc0 con 0x7fc1a01022f0 2024-04-26T21:29:59.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.086+0000 7fc19cc00700 1 -- 172.21.15.84:0/4209415026 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc18c00f040 con 0x7fc1a01022f0 2024-04-26T21:29:59.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.087+0000 7fc1a7600700 1 -- 172.21.15.84:0/4209415026 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a01112b0 con 0x7fc1a01022f0 2024-04-26T21:29:59.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.087+0000 7fc19cc00700 1 -- 172.21.15.84:0/4209415026 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc18c009640 con 0x7fc1a01022f0 2024-04-26T21:29:59.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.087+0000 7fc1a7600700 1 -- 172.21.15.84:0/4209415026 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a01117f0 con 0x7fc1a01022f0 2024-04-26T21:29:59.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.088+0000 7fc1a7600700 1 -- 172.21.15.84:0/4209415026 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a005f5c0 con 0x7fc1a01022f0 2024-04-26T21:29:59.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.089+0000 7fc19cc00700 1 -- 172.21.15.84:0/4209415026 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc18c0097c0 con 0x7fc1a01022f0 2024-04-26T21:29:59.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.091+0000 7fc19cc00700 1 --2- 172.21.15.84:0/4209415026 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc18806ec00 0x7fc1880710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:59.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.091+0000 7fc19cc00700 1 -- 172.21.15.84:0/4209415026 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fc18c08e5d0 con 0x7fc1a01022f0 2024-04-26T21:29:59.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.092+0000 7fc1a4c00700 1 --2- 172.21.15.84:0/4209415026 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc18806ec00 0x7fc1880710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:59.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.092+0000 7fc1a4c00700 1 --2- 172.21.15.84:0/4209415026 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc18806ec00 0x7fc1880710b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc19400b970 tx=0x7fc194009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:59.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.096+0000 7fc19cc00700 1 -- 172.21.15.84:0/4209415026 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fc18c05aeb0 con 0x7fc1a01022f0 2024-04-26T21:29:59.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:59 smithi084 ceph-mon[90138]: osdmap e62: 6 total, 6 up, 6 in 2024-04-26T21:29:59.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:59 smithi084 ceph-mon[90138]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:29:59.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:59 smithi084 ceph-mon[90138]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:29:59.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:59 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:59.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:29:59 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:29:59.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.425+0000 7fc1a7600700 1 -- 172.21.15.84:0/4209415026 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc1a0111bc0 con 0x7fc1a01022f0 2024-04-26T21:29:59.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.426+0000 7fc19cc00700 1 -- 172.21.15.84:0/4209415026 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fc18c05aa40 con 0x7fc1a01022f0 2024-04-26T21:29:59.426 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:29:59.427 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:29:59.427 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:29:59.427 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:29:59.427 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:29:59.427 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:29:59.427 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:29:59.427 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:29:59.427 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 5, 2024-04-26T21:29:59.427 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 1 2024-04-26T21:29:59.427 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:29:59.427 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:29:59.427 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-26T21:29:59.427 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:29:59.427 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:29:59.428 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 9, 2024-04-26T21:29:59.428 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 5 2024-04-26T21:29:59.428 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:29:59.428 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:29:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.428+0000 7fc1a7600700 1 -- 172.21.15.84:0/4209415026 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc18806ec00 msgr2=0x7fc1880710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.428+0000 7fc1a7600700 1 --2- 172.21.15.84:0/4209415026 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc18806ec00 0x7fc1880710b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc19400b970 tx=0x7fc194009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.428+0000 7fc1a7600700 1 -- 172.21.15.84:0/4209415026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a01022f0 msgr2=0x7fc1a0110180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:59.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.429+0000 7fc1a7600700 1 --2- 172.21.15.84:0/4209415026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a01022f0 0x7fc1a0110180 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc18c002a50 tx=0x7fc18c0046b0 comp rx=0 tx=0).stop 2024-04-26T21:29:59.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.429+0000 7fc1a7600700 1 -- 172.21.15.84:0/4209415026 shutdown_connections 2024-04-26T21:29:59.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.429+0000 7fc1a7600700 1 --2- 172.21.15.84:0/4209415026 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc18806ec00 0x7fc1880710b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:59.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.429+0000 7fc1a7600700 1 --2- 172.21.15.84:0/4209415026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1a0066b50 0x7fc1a010fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:59.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.429+0000 7fc1a7600700 1 --2- 172.21.15.84:0/4209415026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a01022f0 0x7fc1a0110180 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:59.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.429+0000 7fc1a7600700 1 -- 172.21.15.84:0/4209415026 >> 172.21.15.84:0/4209415026 conn(0x7fc1a00f7420 msgr2=0x7fc1a00f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:59.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.429+0000 7fc1a7600700 1 -- 172.21.15.84:0/4209415026 shutdown_connections 2024-04-26T21:29:59.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.429+0000 7fc1a7600700 1 -- 172.21.15.84:0/4209415026 wait complete. 2024-04-26T21:29:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:59 smithi120 ceph-mon[79001]: osdmap e62: 6 total, 6 up, 6 in 2024-04-26T21:29:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:59 smithi120 ceph-mon[79001]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:29:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:59 smithi120 ceph-mon[79001]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:29:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:59 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:29:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:29:59 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:29:59.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.581+0000 7f574de00700 1 -- 172.21.15.84:0/1998976281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5748070830 msgr2=0x7f5748070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:59.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.581+0000 7f574de00700 1 --2- 172.21.15.84:0/1998976281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5748070830 0x7f5748070ca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5734004940 tx=0x7f5734009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:59.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.581+0000 7f574de00700 1 -- 172.21.15.84:0/1998976281 shutdown_connections 2024-04-26T21:29:59.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.581+0000 7f574de00700 1 --2- 172.21.15.84:0/1998976281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5748070830 0x7f5748070ca0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:59.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.581+0000 7f574de00700 1 --2- 172.21.15.84:0/1998976281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5748071de0 0x7f57480702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:59.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.581+0000 7f574de00700 1 -- 172.21.15.84:0/1998976281 >> 172.21.15.84:0/1998976281 conn(0x7f57480f8590 msgr2=0x7f57480fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:59.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.581+0000 7f574de00700 1 -- 172.21.15.84:0/1998976281 shutdown_connections 2024-04-26T21:29:59.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.581+0000 7f574de00700 1 -- 172.21.15.84:0/1998976281 wait complete. 2024-04-26T21:29:59.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.582+0000 7f574de00700 1 Processor -- start 2024-04-26T21:29:59.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.583+0000 7f574de00700 1 -- start start 2024-04-26T21:29:59.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.583+0000 7f574de00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5748070830 0x7f574810fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:59.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.583+0000 7f574de00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5748071de0 0x7f5748110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:59.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.583+0000 7f574de00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5748110770 con 0x7f5748070830 2024-04-26T21:29:59.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.583+0000 7f574de00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5748110fc0 con 0x7f5748071de0 2024-04-26T21:29:59.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.584+0000 7f5746a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5748070830 0x7f574810fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:59.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.584+0000 7f5746a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5748070830 0x7f574810fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33646/0 (socket says 172.21.15.84:33646) 2024-04-26T21:29:59.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.584+0000 7f5746a00700 1 -- 172.21.15.84:0/2763295572 learned_addr learned my addr 172.21.15.84:0/2763295572 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:29:59.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.584+0000 7f5746000700 1 --2- 172.21.15.84:0/2763295572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5748071de0 0x7f5748110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:59.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.584+0000 7f5746a00700 1 -- 172.21.15.84:0/2763295572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5748071de0 msgr2=0x7f5748110170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:59.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.584+0000 7f5746a00700 1 --2- 172.21.15.84:0/2763295572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5748071de0 0x7f5748110170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:59.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.584+0000 7f5746a00700 1 -- 172.21.15.84:0/2763295572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5734005040 con 0x7f5748070830 2024-04-26T21:29:59.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.585+0000 7f5746a00700 1 --2- 172.21.15.84:0/2763295572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5748070830 0x7f574810fc30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f573800c8b0 tx=0x7f5738004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:59.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.585+0000 7f573ea00700 1 -- 172.21.15.84:0/2763295572 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57380106f0 con 0x7f5748070830 2024-04-26T21:29:59.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.585+0000 7f573ea00700 1 -- 172.21.15.84:0/2763295572 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5738010d20 con 0x7f5748070830 2024-04-26T21:29:59.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.585+0000 7f573ea00700 1 -- 172.21.15.84:0/2763295572 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5738012e90 con 0x7f5748070830 2024-04-26T21:29:59.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.585+0000 7f574de00700 1 -- 172.21.15.84:0/2763295572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57481112a0 con 0x7f5748070830 2024-04-26T21:29:59.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.585+0000 7f574de00700 1 -- 172.21.15.84:0/2763295572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5748111790 con 0x7f5748070830 2024-04-26T21:29:59.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.587+0000 7f574de00700 1 -- 172.21.15.84:0/2763295572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f574805f5c0 con 0x7f5748070830 2024-04-26T21:29:59.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.588+0000 7f573ea00700 1 -- 172.21.15.84:0/2763295572 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5738010850 con 0x7f5748070830 2024-04-26T21:29:59.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.588+0000 7f573ea00700 1 --2- 172.21.15.84:0/2763295572 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f572c06ec00 0x7f572c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:29:59.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.589+0000 7f573ea00700 1 -- 172.21.15.84:0/2763295572 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f573808e7a0 con 0x7f5748070830 2024-04-26T21:29:59.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.589+0000 7f5746000700 1 --2- 172.21.15.84:0/2763295572 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f572c06ec00 0x7f572c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:29:59.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.590+0000 7f5746000700 1 --2- 172.21.15.84:0/2763295572 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f572c06ec00 0x7f572c0710b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f573400b970 tx=0x7f5734009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:29:59.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.597+0000 7f573ea00700 1 -- 172.21.15.84:0/2763295572 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f573805b0a0 con 0x7f5748070830 2024-04-26T21:29:59.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.877+0000 7f574de00700 1 -- 172.21.15.84:0/2763295572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5748111b60 con 0x7f5748070830 2024-04-26T21:29:59.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.878+0000 7f573ea00700 1 -- 172.21.15.84:0/2763295572 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1922 (secure 0 0 0) 0x7f573805ac30 con 0x7f5748070830 2024-04-26T21:29:59.879 INFO:teuthology.orchestra.run.smithi084.stdout:e15 2024-04-26T21:29:59.880 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:29:59.880 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:29:59.880 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:29:59.880 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:29:59.880 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:29:59.880 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:29:59.880 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 15 2024-04-26T21:29:59.880 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:29:59.880 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:29:59.880 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:27:24.731661+0000 2024-04-26T21:29:59.880 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:29:59.880 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:29:59.880 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:29:59.881 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:29:59.881 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:29:59.881 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-04-26T21:29:59.881 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:29:59.881 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:29:59.881 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:29:59.881 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:29:59.881 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:29:59.881 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:29:59.881 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456,1=24231} 2024-04-26T21:29:59.881 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:29:59.881 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:29:59.881 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:29:59.881 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:29:59.882 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:29:59.882 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:29:59.882 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:29:59.882 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-04-26T21:29:59.882 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:29:59.882 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 0 members: 2024-04-26T21:29:59.882 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:29:59.882 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:29:59.882 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:29:59.882 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:29:59.882 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:29:59.882 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:29:59.882 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:29:59.883 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:29:59.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.882+0000 7f574de00700 1 -- 172.21.15.84:0/2763295572 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f572c06ec00 msgr2=0x7f572c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:59.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.882+0000 7f574de00700 1 --2- 172.21.15.84:0/2763295572 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f572c06ec00 0x7f572c0710b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f573400b970 tx=0x7f5734009e30 comp rx=0 tx=0).stop 2024-04-26T21:29:59.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.882+0000 7f574de00700 1 -- 172.21.15.84:0/2763295572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5748070830 msgr2=0x7f574810fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:29:59.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.882+0000 7f574de00700 1 --2- 172.21.15.84:0/2763295572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5748070830 0x7f574810fc30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f573800c8b0 tx=0x7f5738004470 comp rx=0 tx=0).stop 2024-04-26T21:29:59.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.882+0000 7f574de00700 1 -- 172.21.15.84:0/2763295572 shutdown_connections 2024-04-26T21:29:59.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.882+0000 7f574de00700 1 --2- 172.21.15.84:0/2763295572 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f572c06ec00 0x7f572c0710b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:59.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.882+0000 7f574de00700 1 --2- 172.21.15.84:0/2763295572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5748070830 0x7f574810fc30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:59.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.882+0000 7f574de00700 1 --2- 172.21.15.84:0/2763295572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5748071de0 0x7f5748110170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:29:59.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.882+0000 7f574de00700 1 -- 172.21.15.84:0/2763295572 >> 172.21.15.84:0/2763295572 conn(0x7f57480f8590 msgr2=0x7f57480fa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:29:59.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.882+0000 7f574de00700 1 -- 172.21.15.84:0/2763295572 shutdown_connections 2024-04-26T21:29:59.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:29:59.883+0000 7f574de00700 1 -- 172.21.15.84:0/2763295572 wait complete. 2024-04-26T21:29:59.884 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 15 2024-04-26T21:30:00.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.032+0000 7fdd9b400700 1 -- 172.21.15.84:0/1905617962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd940fcf10 msgr2=0x7fdd940fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:00.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.032+0000 7fdd9b400700 1 --2- 172.21.15.84:0/1905617962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd940fcf10 0x7fdd940fd320 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdd88004940 tx=0x7fdd88009e30 comp rx=0 tx=0).stop 2024-04-26T21:30:00.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.032+0000 7fdd9b400700 1 -- 172.21.15.84:0/1905617962 shutdown_connections 2024-04-26T21:30:00.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.032+0000 7fdd9b400700 1 --2- 172.21.15.84:0/1905617962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd940fe080 0x7fdd940fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:00.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.032+0000 7fdd9b400700 1 --2- 172.21.15.84:0/1905617962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd940fcf10 0x7fdd940fd320 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:00.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.032+0000 7fdd9b400700 1 -- 172.21.15.84:0/1905617962 >> 172.21.15.84:0/1905617962 conn(0x7fdd940f8560 msgr2=0x7fdd940fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:30:00.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.032+0000 7fdd9b400700 1 -- 172.21.15.84:0/1905617962 shutdown_connections 2024-04-26T21:30:00.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.032+0000 7fdd9b400700 1 -- 172.21.15.84:0/1905617962 wait complete. 2024-04-26T21:30:00.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.033+0000 7fdd9b400700 1 Processor -- start 2024-04-26T21:30:00.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.033+0000 7fdd9b400700 1 -- start start 2024-04-26T21:30:00.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.034+0000 7fdd9b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd940fcf10 0x7fdd9410fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:00.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.034+0000 7fdd9b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd940fe080 0x7fdd94110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:00.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.034+0000 7fdd9b400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd94110740 con 0x7fdd940fcf10 2024-04-26T21:30:00.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.034+0000 7fdd9b400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd94110f90 con 0x7fdd940fe080 2024-04-26T21:30:00.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.034+0000 7fdd98a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd940fcf10 0x7fdd9410fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:00.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.034+0000 7fdd98a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd940fcf10 0x7fdd9410fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33666/0 (socket says 172.21.15.84:33666) 2024-04-26T21:30:00.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.034+0000 7fdd98a00700 1 -- 172.21.15.84:0/4226359410 learned_addr learned my addr 172.21.15.84:0/4226359410 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:30:00.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.034+0000 7fdd93e00700 1 --2- 172.21.15.84:0/4226359410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd940fe080 0x7fdd94110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:00.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.035+0000 7fdd98a00700 1 -- 172.21.15.84:0/4226359410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd940fe080 msgr2=0x7fdd94110140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:00.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.035+0000 7fdd98a00700 1 --2- 172.21.15.84:0/4226359410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd940fe080 0x7fdd94110140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:00.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.035+0000 7fdd98a00700 1 -- 172.21.15.84:0/4226359410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd88005040 con 0x7fdd940fcf10 2024-04-26T21:30:00.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.035+0000 7fdd98a00700 1 --2- 172.21.15.84:0/4226359410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd940fcf10 0x7fdd9410fc00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdd88009150 tx=0x7fdd88009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:30:00.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.036+0000 7fdd90c00700 1 -- 172.21.15.84:0/4226359410 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd8800e040 con 0x7fdd940fcf10 2024-04-26T21:30:00.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.036+0000 7fdd90c00700 1 -- 172.21.15.84:0/4226359410 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd88004290 con 0x7fdd940fcf10 2024-04-26T21:30:00.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.036+0000 7fdd9b400700 1 -- 172.21.15.84:0/4226359410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd94111210 con 0x7fdd940fcf10 2024-04-26T21:30:00.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.036+0000 7fdd90c00700 1 -- 172.21.15.84:0/4226359410 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd8801c630 con 0x7fdd940fcf10 2024-04-26T21:30:00.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.036+0000 7fdd9b400700 1 -- 172.21.15.84:0/4226359410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd94111750 con 0x7fdd940fcf10 2024-04-26T21:30:00.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.037+0000 7fdd9b400700 1 -- 172.21.15.84:0/4226359410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd94101a10 con 0x7fdd940fcf10 2024-04-26T21:30:00.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.039+0000 7fdd90c00700 1 -- 172.21.15.84:0/4226359410 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fdd8800bbf0 con 0x7fdd940fcf10 2024-04-26T21:30:00.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.040+0000 7fdd90c00700 1 --2- 172.21.15.84:0/4226359410 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdd7c06ec00 0x7fdd7c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:00.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.040+0000 7fdd90c00700 1 -- 172.21.15.84:0/4226359410 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fdd8808f450 con 0x7fdd940fcf10 2024-04-26T21:30:00.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.041+0000 7fdd93e00700 1 --2- 172.21.15.84:0/4226359410 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdd7c06ec00 0x7fdd7c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:00.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.042+0000 7fdd93e00700 1 --2- 172.21.15.84:0/4226359410 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdd7c06ec00 0x7fdd7c0710b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdd80004f40 tx=0x7fdd8000b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:30:00.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.045+0000 7fdd90c00700 1 -- 172.21.15.84:0/4226359410 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fdd8805bd30 con 0x7fdd940fcf10 2024-04-26T21:30:00.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.327+0000 7fdd9b400700 1 -- 172.21.15.84:0/4226359410 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd94111a80 con 0x7fdd7c06ec00 2024-04-26T21:30:00.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.329+0000 7fdd90c00700 1 -- 172.21.15.84:0/4226359410 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fdd94111a80 con 0x7fdd7c06ec00 2024-04-26T21:30:00.330 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:30:00.330 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:30:00.330 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:30:00.330 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:30:00.330 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-04-26T21:30:00.330 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr", 2024-04-26T21:30:00.330 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-04-26T21:30:00.330 INFO:teuthology.orchestra.run.smithi084.stdout: "crash" 2024-04-26T21:30:00.330 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-04-26T21:30:00.330 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "7/21 daemons upgraded", 2024-04-26T21:30:00.330 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading osd daemons", 2024-04-26T21:30:00.330 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:30:00.330 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:30:00.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.331+0000 7fdd9b400700 1 -- 172.21.15.84:0/4226359410 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdd7c06ec00 msgr2=0x7fdd7c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:00.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.331+0000 7fdd9b400700 1 --2- 172.21.15.84:0/4226359410 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdd7c06ec00 0x7fdd7c0710b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdd80004f40 tx=0x7fdd8000b040 comp rx=0 tx=0).stop 2024-04-26T21:30:00.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.332+0000 7fdd9b400700 1 -- 172.21.15.84:0/4226359410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd940fcf10 msgr2=0x7fdd9410fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:00.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.332+0000 7fdd9b400700 1 --2- 172.21.15.84:0/4226359410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd940fcf10 0x7fdd9410fc00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdd88009150 tx=0x7fdd88009e30 comp rx=0 tx=0).stop 2024-04-26T21:30:00.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.332+0000 7fdd9b400700 1 -- 172.21.15.84:0/4226359410 shutdown_connections 2024-04-26T21:30:00.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.332+0000 7fdd9b400700 1 --2- 172.21.15.84:0/4226359410 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdd7c06ec00 0x7fdd7c0710b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:00.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.332+0000 7fdd9b400700 1 --2- 172.21.15.84:0/4226359410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd940fcf10 0x7fdd9410fc00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:00.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.332+0000 7fdd9b400700 1 --2- 172.21.15.84:0/4226359410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd940fe080 0x7fdd94110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:00.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.332+0000 7fdd9b400700 1 -- 172.21.15.84:0/4226359410 >> 172.21.15.84:0/4226359410 conn(0x7fdd940f8560 msgr2=0x7fdd940f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:30:00.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.332+0000 7fdd9b400700 1 -- 172.21.15.84:0/4226359410 shutdown_connections 2024-04-26T21:30:00.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.332+0000 7fdd9b400700 1 -- 172.21.15.84:0/4226359410 wait complete. 2024-04-26T21:30:00.447 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:00 smithi084 ceph-mon[90138]: osdmap e63: 6 total, 6 up, 6 in 2024-04-26T21:30:00.447 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:00 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/4209415026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:30:00.447 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:00 smithi084 ceph-mon[90138]: pgmap v86: 65 pgs: 1 remapped+peering, 1 peering, 63 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6.0 MiB/s, 149 objects/s recovering 2024-04-26T21:30:00.447 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:00 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2763295572' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:30:00.447 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:00 smithi084 ceph-mon[90138]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 14/363 objects degraded (3.857%), 3 pgs degraded 2024-04-26T21:30:00.447 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:00 smithi084 ceph-mon[90138]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:30:00.447 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:00 smithi084 ceph-mon[90138]: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:30:00.447 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:00 smithi084 ceph-mon[90138]: [WRN] PG_DEGRADED: Degraded data redundancy: 14/363 objects degraded (3.857%), 3 pgs degraded 2024-04-26T21:30:00.448 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:00 smithi084 ceph-mon[90138]: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-04-26T21:30:00.448 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:00 smithi084 ceph-mon[90138]: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-04-26T21:30:00.448 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:00 smithi084 ceph-mon[90138]: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-04-26T21:30:00.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.487+0000 7f1048a00700 1 -- 172.21.15.84:0/594856121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10440fcc10 msgr2=0x7f10440fd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:00.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.487+0000 7f1048a00700 1 --2- 172.21.15.84:0/594856121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10440fcc10 0x7f10440fd020 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1034004940 tx=0x7f1034009e30 comp rx=0 tx=0).stop 2024-04-26T21:30:00.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.487+0000 7f1048a00700 1 -- 172.21.15.84:0/594856121 shutdown_connections 2024-04-26T21:30:00.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.487+0000 7f1048a00700 1 --2- 172.21.15.84:0/594856121 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10440fdec0 0x7f10440fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:00.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.487+0000 7f1048a00700 1 --2- 172.21.15.84:0/594856121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10440fcc10 0x7f10440fd020 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:00.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.487+0000 7f1048a00700 1 -- 172.21.15.84:0/594856121 >> 172.21.15.84:0/594856121 conn(0x7f10440f83b0 msgr2=0x7f10440fa7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:30:00.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.487+0000 7f1048a00700 1 -- 172.21.15.84:0/594856121 shutdown_connections 2024-04-26T21:30:00.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.487+0000 7f1048a00700 1 -- 172.21.15.84:0/594856121 wait complete. 2024-04-26T21:30:00.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.488+0000 7f1048a00700 1 Processor -- start 2024-04-26T21:30:00.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.488+0000 7f1048a00700 1 -- start start 2024-04-26T21:30:00.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.489+0000 7f1048a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10440fcc10 0x7f104410fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:00.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.489+0000 7f1048a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10440fdec0 0x7f104410ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:00.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.489+0000 7f1048a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10441105f0 con 0x7f10440fcc10 2024-04-26T21:30:00.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.489+0000 7f1048a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1044110de0 con 0x7f10440fdec0 2024-04-26T21:30:00.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.489+0000 7f1043400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10440fcc10 0x7f104410fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:00.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.489+0000 7f1043400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10440fcc10 0x7f104410fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33680/0 (socket says 172.21.15.84:33680) 2024-04-26T21:30:00.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.489+0000 7f1043400700 1 -- 172.21.15.84:0/836269134 learned_addr learned my addr 172.21.15.84:0/836269134 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:30:00.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.489+0000 7f1042a00700 1 --2- 172.21.15.84:0/836269134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10440fdec0 0x7f104410ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:00.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.489+0000 7f1043400700 1 -- 172.21.15.84:0/836269134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10440fdec0 msgr2=0x7f104410ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.490+0000 7f1043400700 1 --2- 172.21.15.84:0/836269134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10440fdec0 0x7f104410ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.490+0000 7f1043400700 1 -- 172.21.15.84:0/836269134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1034005040 con 0x7f10440fcc10 2024-04-26T21:30:00.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.490+0000 7f1043400700 1 --2- 172.21.15.84:0/836269134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10440fcc10 0x7f104410fa20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1034009150 tx=0x7f1034009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:30:00.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.490+0000 7f103b400700 1 -- 172.21.15.84:0/836269134 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f103400e040 con 0x7f10440fcc10 2024-04-26T21:30:00.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.490+0000 7f103b400700 1 -- 172.21.15.84:0/836269134 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f103400bbf0 con 0x7f10440fcc10 2024-04-26T21:30:00.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.490+0000 7f1048a00700 1 -- 172.21.15.84:0/836269134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1044111060 con 0x7f10440fcc10 2024-04-26T21:30:00.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.490+0000 7f103b400700 1 -- 172.21.15.84:0/836269134 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f103401c630 con 0x7f10440fcc10 2024-04-26T21:30:00.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.490+0000 7f1048a00700 1 -- 172.21.15.84:0/836269134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1044111620 con 0x7f10440fcc10 2024-04-26T21:30:00.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.491+0000 7f1048a00700 1 -- 172.21.15.84:0/836269134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1044101850 con 0x7f10440fcc10 2024-04-26T21:30:00.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.492+0000 7f103b400700 1 -- 172.21.15.84:0/836269134 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f103400bd60 con 0x7f10440fcc10 2024-04-26T21:30:00.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.493+0000 7f103b400700 1 --2- 172.21.15.84:0/836269134 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f102806ec10 0x7f10280710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:00.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.493+0000 7f103b400700 1 -- 172.21.15.84:0/836269134 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f103408fc90 con 0x7f10440fcc10 2024-04-26T21:30:00.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.494+0000 7f1042a00700 1 --2- 172.21.15.84:0/836269134 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f102806ec10 0x7f10280710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:00.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.494+0000 7f1042a00700 1 --2- 172.21.15.84:0/836269134 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f102806ec10 0x7f10280710c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1030006fd0 tx=0x7f1030008040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:30:00.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.498+0000 7f103b400700 1 -- 172.21.15.84:0/836269134 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f103405c570 con 0x7f10440fcc10 2024-04-26T21:30:00.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:00 smithi120 ceph-mon[79001]: osdmap e63: 6 total, 6 up, 6 in 2024-04-26T21:30:00.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:00 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/4209415026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:30:00.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:00 smithi120 ceph-mon[79001]: pgmap v86: 65 pgs: 1 remapped+peering, 1 peering, 63 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6.0 MiB/s, 149 objects/s recovering 2024-04-26T21:30:00.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:00 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2763295572' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:30:00.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:00 smithi120 ceph-mon[79001]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 14/363 objects degraded (3.857%), 3 pgs degraded 2024-04-26T21:30:00.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:00 smithi120 ceph-mon[79001]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:30:00.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:00 smithi120 ceph-mon[79001]: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:30:00.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:00 smithi120 ceph-mon[79001]: [WRN] PG_DEGRADED: Degraded data redundancy: 14/363 objects degraded (3.857%), 3 pgs degraded 2024-04-26T21:30:00.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:00 smithi120 ceph-mon[79001]: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-04-26T21:30:00.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:00 smithi120 ceph-mon[79001]: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-04-26T21:30:00.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:00 smithi120 ceph-mon[79001]: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-04-26T21:30:00.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.818+0000 7f1048a00700 1 -- 172.21.15.84:0/836269134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f104405f5c0 con 0x7f10440fcc10 2024-04-26T21:30:00.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.819+0000 7f103b400700 1 -- 172.21.15.84:0/836269134 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f103405c100 con 0x7f10440fcc10 2024-04-26T21:30:00.820 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:30:00.820 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:30:00.820 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:30:00.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.822+0000 7f1048a00700 1 -- 172.21.15.84:0/836269134 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f102806ec10 msgr2=0x7f10280710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:00.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.822+0000 7f1048a00700 1 --2- 172.21.15.84:0/836269134 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f102806ec10 0x7f10280710c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1030006fd0 tx=0x7f1030008040 comp rx=0 tx=0).stop 2024-04-26T21:30:00.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.822+0000 7f1048a00700 1 -- 172.21.15.84:0/836269134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10440fcc10 msgr2=0x7f104410fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:00.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.822+0000 7f1048a00700 1 --2- 172.21.15.84:0/836269134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10440fcc10 0x7f104410fa20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1034009150 tx=0x7f1034009e30 comp rx=0 tx=0).stop 2024-04-26T21:30:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.822+0000 7f1048a00700 1 -- 172.21.15.84:0/836269134 shutdown_connections 2024-04-26T21:30:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.822+0000 7f1048a00700 1 --2- 172.21.15.84:0/836269134 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f102806ec10 0x7f10280710c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.823+0000 7f1048a00700 1 --2- 172.21.15.84:0/836269134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10440fcc10 0x7f104410fa20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.823+0000 7f1048a00700 1 --2- 172.21.15.84:0/836269134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10440fdec0 0x7f104410ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.823+0000 7f1048a00700 1 -- 172.21.15.84:0/836269134 >> 172.21.15.84:0/836269134 conn(0x7f10440f83b0 msgr2=0x7f10440f9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:30:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.823+0000 7f1048a00700 1 -- 172.21.15.84:0/836269134 shutdown_connections 2024-04-26T21:30:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:00.823+0000 7f1048a00700 1 -- 172.21.15.84:0/836269134 wait complete. 2024-04-26T21:30:01.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:01 smithi084 ceph-mon[90138]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/363 objects degraded (3.857%), 3 pgs degraded) 2024-04-26T21:30:01.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:01 smithi084 ceph-mon[90138]: osdmap e64: 6 total, 6 up, 6 in 2024-04-26T21:30:01.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:01 smithi084 ceph-mon[90138]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:30:01.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:01 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/836269134' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:30:01.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:01 smithi120 ceph-mon[79001]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/363 objects degraded (3.857%), 3 pgs degraded) 2024-04-26T21:30:01.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:01 smithi120 ceph-mon[79001]: osdmap e64: 6 total, 6 up, 6 in 2024-04-26T21:30:01.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:01 smithi120 ceph-mon[79001]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:30:01.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:01 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/836269134' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:30:02.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:02.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:02.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:30:02.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:30:02.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:02.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:30:02.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:30:02.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:30:02.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:30:02.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-26T21:30:02.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:02 smithi084 ceph-mon[90138]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-26T21:30:02.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:02 smithi084 ceph-mon[90138]: Upgrade: osd.1 is safe to restart 2024-04-26T21:30:02.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:02 smithi084 ceph-mon[90138]: pgmap v88: 65 pgs: 1 remapped+peering, 1 peering, 63 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 5.2 MiB/s, 130 objects/s recovering 2024-04-26T21:30:02.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:02.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:02.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:30:02.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:30:02.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:02.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:30:02.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:30:02.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:30:02.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:30:02.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-26T21:30:02.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:02 smithi120 ceph-mon[79001]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-26T21:30:02.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:02 smithi120 ceph-mon[79001]: Upgrade: osd.1 is safe to restart 2024-04-26T21:30:02.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:02 smithi120 ceph-mon[79001]: pgmap v88: 65 pgs: 1 remapped+peering, 1 peering, 63 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 5.2 MiB/s, 130 objects/s recovering 2024-04-26T21:30:04.981 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:04 smithi084 ceph-mon[90138]: pgmap v89: 65 pgs: 65 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 4.0 MiB/s, 137 objects/s recovering 2024-04-26T21:30:04.981 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:04 smithi084 ceph-mon[90138]: Upgrade: Updating osd.1 2024-04-26T21:30:04.981 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:04 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:04.981 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:04 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T21:30:04.981 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:04 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:30:04.981 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:04 smithi084 ceph-mon[90138]: Deploying daemon osd.1 on smithi084 2024-04-26T21:30:05.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:04 smithi120 ceph-mon[79001]: pgmap v89: 65 pgs: 65 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 4.0 MiB/s, 137 objects/s recovering 2024-04-26T21:30:05.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:04 smithi120 ceph-mon[79001]: Upgrade: Updating osd.1 2024-04-26T21:30:05.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:04 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:05.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:04 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T21:30:05.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:04 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:30:05.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:04 smithi120 ceph-mon[79001]: Deploying daemon osd.1 on smithi084 2024-04-26T21:30:07.136 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:06 smithi084 ceph-mon[90138]: pgmap v90: 65 pgs: 65 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.2 MiB/s, 83 objects/s recovering 2024-04-26T21:30:07.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:06 smithi120 ceph-mon[79001]: pgmap v90: 65 pgs: 65 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.2 MiB/s, 83 objects/s recovering 2024-04-26T21:30:08.943 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:08 smithi084 systemd[1]: Stopping Ceph osd.1 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:30:09.410 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:08 smithi120 ceph-mon[79001]: pgmap v91: 65 pgs: 65 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s, 73 objects/s recovering 2024-04-26T21:30:09.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:08 smithi084 ceph-mon[90138]: pgmap v91: 65 pgs: 65 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s, 73 objects/s recovering 2024-04-26T21:30:09.413 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:09 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1[51081]: 2024-04-26T21:30:09.190+0000 7fe1c2200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:30:09.413 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:09 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1[51081]: 2024-04-26T21:30:09.190+0000 7fe1c2200700 -1 osd.1 64 *** Got signal Terminated *** 2024-04-26T21:30:09.413 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:09 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1[51081]: 2024-04-26T21:30:09.190+0000 7fe1c2200700 -1 osd.1 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:30:10.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:10 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:10.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:10 smithi084 ceph-mon[90138]: osd.1 marked itself down and dead 2024-04-26T21:30:10.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:10 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:10.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:10 smithi120 ceph-mon[79001]: osd.1 marked itself down and dead 2024-04-26T21:30:10.771 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:10 smithi084 podman[104186]: 2024-04-26 21:30:10.485975236 +0000 UTC m=+1.497616758 container died d283a0a932134f895f38be1781b6d2977571e401724c299bef24fde939082629 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-2be3efa, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-26T21:30:11.038 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:11 smithi084 podman[104186]: 2024-04-26 21:30:11.012617071 +0000 UTC m=+2.024258622 container cleanup d283a0a932134f895f38be1781b6d2977571e401724c299bef24fde939082629 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1, ceph=True, RELEASE=quincy-2be3efa, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:30:11.038 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:11 smithi084 bash[104186]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1 2024-04-26T21:30:11.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:11 smithi084 ceph-mon[90138]: pgmap v92: 65 pgs: 65 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 22 objects/s recovering 2024-04-26T21:30:11.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:11 smithi084 ceph-mon[90138]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:30:11.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:11 smithi084 ceph-mon[90138]: osdmap e65: 6 total, 5 up, 6 in 2024-04-26T21:30:11.413 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:11 smithi084 podman[104203]: 2024-04-26 21:30:11.280967888 +0000 UTC m=+0.789361851 container remove d283a0a932134f895f38be1781b6d2977571e401724c299bef24fde939082629 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-2be3efa) 2024-04-26T21:30:11.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:11 smithi120 ceph-mon[79001]: pgmap v92: 65 pgs: 65 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 22 objects/s recovering 2024-04-26T21:30:11.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:11 smithi120 ceph-mon[79001]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:30:11.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:11 smithi120 ceph-mon[79001]: osdmap e65: 6 total, 5 up, 6 in 2024-04-26T21:30:12.375 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:12 smithi084 ceph-mon[90138]: osdmap e66: 6 total, 5 up, 6 in 2024-04-26T21:30:12.376 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:12 smithi084 podman[104293]: 2024-04-26 21:30:12.099842816 +0000 UTC m=+0.034154265 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:30:12.376 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:12 smithi084 podman[104293]: 2024-04-26 21:30:12.223725253 +0000 UTC m=+0.158036713 container create 4249e4e7e81a0d829f29511cdf0826ccf721242d4e8ac5953a4f2345ab9fd1b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-26T21:30:12.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:12 smithi120 ceph-mon[79001]: osdmap e66: 6 total, 5 up, 6 in 2024-04-26T21:30:12.663 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:12 smithi084 podman[104293]: 2024-04-26 21:30:12.469316912 +0000 UTC m=+0.403628375 container init 4249e4e7e81a0d829f29511cdf0826ccf721242d4e8ac5953a4f2345ab9fd1b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:30:12.663 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:12 smithi084 podman[104293]: 2024-04-26 21:30:12.480248971 +0000 UTC m=+0.414560433 container start 4249e4e7e81a0d829f29511cdf0826ccf721242d4e8ac5953a4f2345ab9fd1b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T21:30:12.663 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:12 smithi084 podman[104293]: 2024-04-26 21:30:12.559350976 +0000 UTC m=+0.493662439 container attach 4249e4e7e81a0d829f29511cdf0826ccf721242d4e8ac5953a4f2345ab9fd1b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=) 2024-04-26T21:30:13.287 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:13 smithi084 ceph-mon[90138]: pgmap v95: 65 pgs: 11 stale+active+clean, 54 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:30:13.288 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:12 smithi084 podman[104293]: 2024-04-26 21:30:12.936753043 +0000 UTC m=+0.871064519 container died 4249e4e7e81a0d829f29511cdf0826ccf721242d4e8ac5953a4f2345ab9fd1b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-04-26T21:30:13.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:13 smithi120 ceph-mon[79001]: pgmap v95: 65 pgs: 11 stale+active+clean, 54 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:30:14.097 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:13 smithi084 podman[104319]: 2024-04-26 21:30:13.67163079 +0000 UTC m=+0.714046564 container remove 4249e4e7e81a0d829f29511cdf0826ccf721242d4e8ac5953a4f2345ab9fd1b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:30:14.097 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:13 smithi084 systemd[1]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.1.service: Deactivated successfully. 2024-04-26T21:30:14.097 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:13 smithi084 systemd[1]: Stopped Ceph osd.1 for 8bb44d26-0411-11ef-bc93-c7b262605968. 2024-04-26T21:30:14.098 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:13 smithi084 systemd[1]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.1.service: Consumed 1min 40.422s CPU time. 2024-04-26T21:30:14.098 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:14 smithi084 systemd[1]: Starting Ceph osd.1 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:30:14.728 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:14 smithi084 podman[104420]: 2024-04-26 21:30:14.359981625 +0000 UTC m=+0.035980339 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:30:14.728 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:14 smithi084 podman[104420]: 2024-04-26 21:30:14.481325118 +0000 UTC m=+0.157323869 container create fed7172f64fe611e372d9a39b8654ff6a8013fc7e1d352ccbc428d5a81176b35 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-26T21:30:14.728 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:14 smithi084 podman[104420]: 2024-04-26 21:30:14.726834278 +0000 UTC m=+0.402833099 container init fed7172f64fe611e372d9a39b8654ff6a8013fc7e1d352ccbc428d5a81176b35 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.build-date=20240424) 2024-04-26T21:30:15.025 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:14 smithi084 podman[104420]: 2024-04-26 21:30:14.740020084 +0000 UTC m=+0.416018842 container start fed7172f64fe611e372d9a39b8654ff6a8013fc7e1d352ccbc428d5a81176b35 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-26T21:30:15.025 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:14 smithi084 podman[104420]: 2024-04-26 21:30:14.81724989 +0000 UTC m=+0.493248664 container attach fed7172f64fe611e372d9a39b8654ff6a8013fc7e1d352ccbc428d5a81176b35 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-26T21:30:15.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:15 smithi084 ceph-mon[90138]: pgmap v96: 65 pgs: 2 active+undersized+degraded, 8 stale+active+clean, 3 active+undersized, 52 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 8/363 objects degraded (2.204%) 2024-04-26T21:30:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:15 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:15 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:30:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:15 smithi084 ceph-mon[90138]: Health check failed: Degraded data redundancy: 8/363 objects degraded (2.204%), 2 pgs degraded (PG_DEGRADED) 2024-04-26T21:30:15.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:15 smithi120 ceph-mon[79001]: pgmap v96: 65 pgs: 2 active+undersized+degraded, 8 stale+active+clean, 3 active+undersized, 52 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 8/363 objects degraded (2.204%) 2024-04-26T21:30:15.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:15 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:15.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:15 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:30:15.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:15 smithi120 ceph-mon[79001]: Health check failed: Degraded data redundancy: 8/363 objects degraded (2.204%), 2 pgs degraded (PG_DEGRADED) 2024-04-26T21:30:16.081 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:15 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-activate[104434]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:30:16.081 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:15 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-activate[104434]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:30:16.082 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:15 smithi084 bash[104420]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:30:16.082 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:15 smithi084 bash[104420]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:30:16.082 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:15 smithi084 bash[104420]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T21:30:16.082 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:15 smithi084 bash[104420]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-26T21:30:16.082 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:15 smithi084 bash[104420]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-26T21:30:16.082 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:15 smithi084 bash[104420]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-26T21:30:16.082 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:15 smithi084 bash[104420]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-26T21:30:16.082 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:15 smithi084 bash[104420]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T21:30:16.082 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:15 smithi084 bash[104420]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-26T21:30:16.082 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:15 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-activate[104434]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T21:30:16.082 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:15 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-activate[104434]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-26T21:30:16.082 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:15 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-activate[104434]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-26T21:30:16.082 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:15 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-activate[104434]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-26T21:30:16.082 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:15 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-activate[104434]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-26T21:30:16.083 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:15 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-activate[104434]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T21:30:16.083 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:15 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-activate[104434]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-26T21:30:16.083 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:15 smithi084 podman[104420]: 2024-04-26 21:30:15.726450271 +0000 UTC m=+1.402449042 container died fed7172f64fe611e372d9a39b8654ff6a8013fc7e1d352ccbc428d5a81176b35 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-activate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-26T21:30:16.874 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:16 smithi084 podman[104562]: 2024-04-26 21:30:16.521482403 +0000 UTC m=+0.774767752 container remove fed7172f64fe611e372d9a39b8654ff6a8013fc7e1d352ccbc428d5a81176b35 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:30:17.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:17 smithi084 ceph-mon[90138]: pgmap v97: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 57/363 objects degraded (15.702%) 2024-04-26T21:30:17.163 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:16 smithi084 podman[104623]: 2024-04-26 21:30:16.778423495 +0000 UTC m=+0.033264475 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:30:17.163 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:16 smithi084 podman[104623]: 2024-04-26 21:30:16.914051512 +0000 UTC m=+0.168892521 container create 2dc81d93f7e5f30ad5faf93fcd6ef8fe616b4ee8de5ab7c27655ff42ae7a665f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-04-26T21:30:17.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:17 smithi120 ceph-mon[79001]: pgmap v97: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 57/363 objects degraded (15.702%) 2024-04-26T21:30:17.662 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:17 smithi084 podman[104623]: 2024-04-26 21:30:17.167158909 +0000 UTC m=+0.421999942 container init 2dc81d93f7e5f30ad5faf93fcd6ef8fe616b4ee8de5ab7c27655ff42ae7a665f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-26T21:30:17.662 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:17 smithi084 podman[104623]: 2024-04-26 21:30:17.178062442 +0000 UTC m=+0.432903457 container start 2dc81d93f7e5f30ad5faf93fcd6ef8fe616b4ee8de5ab7c27655ff42ae7a665f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424) 2024-04-26T21:30:17.663 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:17 smithi084 ceph-osd[104641]: -- 172.21.15.84:0/1713665582 <== mon.0 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55964971b680 con 0x5596496e4c00 2024-04-26T21:30:17.663 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:17 smithi084 bash[104623]: 2dc81d93f7e5f30ad5faf93fcd6ef8fe616b4ee8de5ab7c27655ff42ae7a665f 2024-04-26T21:30:17.663 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:17 smithi084 systemd[1]: Started Ceph osd.1 for 8bb44d26-0411-11ef-bc93-c7b262605968. 2024-04-26T21:30:18.162 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:17 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1[104637]: 2024-04-26T21:30:17.767+0000 7f11b6d927c0 -1 Falling back to public interface 2024-04-26T21:30:18.660 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:18 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:18.660 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:18 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:18.660 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:18 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:30:18.660 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:18 smithi084 ceph-mon[90138]: pgmap v98: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 57/363 objects degraded (15.702%) 2024-04-26T21:30:18.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:18 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:18.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:18 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:18.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:18 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:30:18.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:18 smithi120 ceph-mon[79001]: pgmap v98: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 57/363 objects degraded (15.702%) 2024-04-26T21:30:21.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:20 smithi084 ceph-mon[90138]: pgmap v99: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 57/363 objects degraded (15.702%) 2024-04-26T21:30:21.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:20 smithi120 ceph-mon[79001]: pgmap v99: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 57/363 objects degraded (15.702%) 2024-04-26T21:30:23.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:22 smithi084 ceph-mon[90138]: pgmap v100: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 57/363 objects degraded (15.702%) 2024-04-26T21:30:23.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:22 smithi084 ceph-mon[90138]: Health check update: Degraded data redundancy: 57/363 objects degraded (15.702%), 16 pgs degraded (PG_DEGRADED) 2024-04-26T21:30:23.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:22 smithi120 ceph-mon[79001]: pgmap v100: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 57/363 objects degraded (15.702%) 2024-04-26T21:30:23.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:22 smithi120 ceph-mon[79001]: Health check update: Degraded data redundancy: 57/363 objects degraded (15.702%), 16 pgs degraded (PG_DEGRADED) 2024-04-26T21:30:23.662 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:23 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1[104637]: 2024-04-26T21:30:23.314+0000 7f11b6d927c0 -1 osd.1 64 log_to_monitors true 2024-04-26T21:30:24.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:23 smithi084 ceph-mon[90138]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:30:24.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:23 smithi084 ceph-mon[90138]: from='osd.1 [v2:172.21.15.84:6810/3809321856,v1:172.21.15.84:6811/3809321856]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T21:30:24.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:23 smithi120 ceph-mon[79001]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:30:24.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:23 smithi120 ceph-mon[79001]: from='osd.1 [v2:172.21.15.84:6810/3809321856,v1:172.21.15.84:6811/3809321856]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T21:30:25.162 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:30:24 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1[104637]: 2024-04-26T21:30:24.929+0000 7f11a1200700 -1 osd.1 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:30:25.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:24 smithi084 ceph-mon[90138]: pgmap v101: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 57/363 objects degraded (15.702%) 2024-04-26T21:30:25.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:24 smithi084 ceph-mon[90138]: from='osd.1 [v2:172.21.15.84:6810/3809321856,v1:172.21.15.84:6811/3809321856]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T21:30:25.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:24 smithi084 ceph-mon[90138]: osdmap e67: 6 total, 5 up, 6 in 2024-04-26T21:30:25.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:24 smithi084 ceph-mon[90138]: from='osd.1 [v2:172.21.15.84:6810/3809321856,v1:172.21.15.84:6811/3809321856]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-04-26T21:30:25.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:24 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:25.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:24 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:25.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:24 smithi120 ceph-mon[79001]: pgmap v101: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 57/363 objects degraded (15.702%) 2024-04-26T21:30:25.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:24 smithi120 ceph-mon[79001]: from='osd.1 [v2:172.21.15.84:6810/3809321856,v1:172.21.15.84:6811/3809321856]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T21:30:25.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:24 smithi120 ceph-mon[79001]: osdmap e67: 6 total, 5 up, 6 in 2024-04-26T21:30:25.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:24 smithi120 ceph-mon[79001]: from='osd.1 [v2:172.21.15.84:6810/3809321856,v1:172.21.15.84:6811/3809321856]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-04-26T21:30:25.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:24 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:25.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:24 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:26.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:25 smithi084 ceph-mon[90138]: from='osd.1 [v2:172.21.15.84:6810/3809321856,v1:172.21.15.84:6811/3809321856]' entity='osd.1' 2024-04-26T21:30:26.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:25 smithi120 ceph-mon[79001]: from='osd.1 [v2:172.21.15.84:6810/3809321856,v1:172.21.15.84:6811/3809321856]' entity='osd.1' 2024-04-26T21:30:27.334 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:26 smithi120 ceph-mon[79001]: pgmap v103: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 57/363 objects degraded (15.702%) 2024-04-26T21:30:27.334 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:26 smithi120 ceph-mon[79001]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:30:27.334 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:26 smithi120 ceph-mon[79001]: osd.1 [v2:172.21.15.84:6810/3809321856,v1:172.21.15.84:6811/3809321856] boot 2024-04-26T21:30:27.334 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:26 smithi120 ceph-mon[79001]: osdmap e68: 6 total, 6 up, 6 in 2024-04-26T21:30:27.335 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:26 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:30:27.335 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:26 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:27.335 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:26 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:27.335 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:26 smithi120 ceph-mon[79001]: osdmap e69: 6 total, 6 up, 6 in 2024-04-26T21:30:27.403 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:26 smithi084 ceph-mon[90138]: pgmap v103: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 57/363 objects degraded (15.702%) 2024-04-26T21:30:27.403 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:26 smithi084 ceph-mon[90138]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:30:27.404 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:26 smithi084 ceph-mon[90138]: osd.1 [v2:172.21.15.84:6810/3809321856,v1:172.21.15.84:6811/3809321856] boot 2024-04-26T21:30:27.404 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:26 smithi084 ceph-mon[90138]: osdmap e68: 6 total, 6 up, 6 in 2024-04-26T21:30:27.404 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:26 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:30:27.404 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:26 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:27.404 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:26 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:27.404 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:26 smithi084 ceph-mon[90138]: osdmap e69: 6 total, 6 up, 6 in 2024-04-26T21:30:29.357 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:28 smithi084 ceph-mon[90138]: pgmap v106: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 57/363 objects degraded (15.702%) 2024-04-26T21:30:29.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:28 smithi120 ceph-mon[79001]: pgmap v106: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 57/363 objects degraded (15.702%) 2024-04-26T21:30:30.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:29 smithi120 ceph-mon[79001]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:30:30.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:29 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:30.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:29 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:30:30.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:29 smithi084 ceph-mon[90138]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:30:30.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:29 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:30.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:29 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:30:30.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.980+0000 7f5b05600700 1 -- 172.21.15.84:0/338691076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b000fe080 msgr2=0x7f5b000fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:30.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.980+0000 7f5b05600700 1 --2- 172.21.15.84:0/338691076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b000fe080 0x7f5b000fe4f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5aec004940 tx=0x7f5aec009e30 comp rx=0 tx=0).stop 2024-04-26T21:30:30.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.980+0000 7f5b05600700 1 -- 172.21.15.84:0/338691076 shutdown_connections 2024-04-26T21:30:30.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.980+0000 7f5b05600700 1 --2- 172.21.15.84:0/338691076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b000fe080 0x7f5b000fe4f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:30.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.980+0000 7f5b05600700 1 --2- 172.21.15.84:0/338691076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b000fcf10 0x7f5b000fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:30.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.980+0000 7f5b05600700 1 -- 172.21.15.84:0/338691076 >> 172.21.15.84:0/338691076 conn(0x7f5b000f8560 msgr2=0x7f5b000fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:30:30.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.980+0000 7f5b05600700 1 -- 172.21.15.84:0/338691076 shutdown_connections 2024-04-26T21:30:30.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.980+0000 7f5b05600700 1 -- 172.21.15.84:0/338691076 wait complete. 2024-04-26T21:30:30.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.981+0000 7f5b05600700 1 Processor -- start 2024-04-26T21:30:30.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.982+0000 7f5b05600700 1 -- start start 2024-04-26T21:30:30.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.982+0000 7f5b05600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b000fcf10 0x7f5b0010fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:30.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.982+0000 7f5b05600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b000fe080 0x7f5b00110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:30.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.982+0000 7f5b05600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b00110760 con 0x7f5b000fcf10 2024-04-26T21:30:30.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.982+0000 7f5b05600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b00110fb0 con 0x7f5b000fe080 2024-04-26T21:30:30.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.982+0000 7f5afea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b000fcf10 0x7f5b0010fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:30.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.982+0000 7f5afea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b000fcf10 0x7f5b0010fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45286/0 (socket says 172.21.15.84:45286) 2024-04-26T21:30:30.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.982+0000 7f5afea00700 1 -- 172.21.15.84:0/3876454061 learned_addr learned my addr 172.21.15.84:0/3876454061 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:30:30.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.983+0000 7f5afe000700 1 --2- 172.21.15.84:0/3876454061 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b000fe080 0x7f5b00110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:30.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.983+0000 7f5afea00700 1 -- 172.21.15.84:0/3876454061 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b000fe080 msgr2=0x7f5b00110160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:30.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.983+0000 7f5afea00700 1 --2- 172.21.15.84:0/3876454061 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b000fe080 0x7f5b00110160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:30.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.983+0000 7f5afea00700 1 -- 172.21.15.84:0/3876454061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec005040 con 0x7f5b000fcf10 2024-04-26T21:30:30.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.983+0000 7f5afe000700 1 --2- 172.21.15.84:0/3876454061 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b000fe080 0x7f5b00110160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:30:30.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.983+0000 7f5afea00700 1 --2- 172.21.15.84:0/3876454061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b000fcf10 0x7f5b0010fc20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5af0002a50 tx=0x7f5af00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:30:30.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.984+0000 7f5af6a00700 1 -- 172.21.15.84:0/3876454061 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5af0007cc0 con 0x7f5b000fcf10 2024-04-26T21:30:30.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.985+0000 7f5af6a00700 1 -- 172.21.15.84:0/3876454061 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5af000f040 con 0x7f5b000fcf10 2024-04-26T21:30:30.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.985+0000 7f5af6a00700 1 -- 172.21.15.84:0/3876454061 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5af000db70 con 0x7f5b000fcf10 2024-04-26T21:30:30.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.985+0000 7f5b05600700 1 -- 172.21.15.84:0/3876454061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b00111290 con 0x7f5b000fcf10 2024-04-26T21:30:30.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.985+0000 7f5b05600700 1 -- 172.21.15.84:0/3876454061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b001117d0 con 0x7f5b000fcf10 2024-04-26T21:30:30.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.986+0000 7f5b05600700 1 -- 172.21.15.84:0/3876454061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b00101a10 con 0x7f5b000fcf10 2024-04-26T21:30:30.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.987+0000 7f5af6a00700 1 -- 172.21.15.84:0/3876454061 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5af000dd10 con 0x7f5b000fcf10 2024-04-26T21:30:30.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.988+0000 7f5af6a00700 1 --2- 172.21.15.84:0/3876454061 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5ae406ec10 0x7f5ae40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:30.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.989+0000 7f5af6a00700 1 -- 172.21.15.84:0/3876454061 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f5af008dfa0 con 0x7f5b000fcf10 2024-04-26T21:30:30.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.989+0000 7f5afe000700 1 --2- 172.21.15.84:0/3876454061 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5ae406ec10 0x7f5ae40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:30.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.990+0000 7f5afe000700 1 --2- 172.21.15.84:0/3876454061 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5ae406ec10 0x7f5ae40710c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00b020 tx=0x7f5aec009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:30:30.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:30.994+0000 7f5af6a00700 1 -- 172.21.15.84:0/3876454061 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f5af005a800 con 0x7f5b000fcf10 2024-04-26T21:30:31.248 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:30 smithi084 ceph-mon[90138]: pgmap v107: 65 pgs: 65 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:30:31.248 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:30 smithi084 ceph-mon[90138]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 57/363 objects degraded (15.702%), 16 pgs degraded) 2024-04-26T21:30:31.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.246+0000 7f5b05600700 1 -- 172.21.15.84:0/3876454061 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b00111a40 con 0x7f5ae406ec10 2024-04-26T21:30:31.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.248+0000 7f5af6a00700 1 -- 172.21.15.84:0/3876454061 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5b00111a40 con 0x7f5ae406ec10 2024-04-26T21:30:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.250+0000 7f5b05600700 1 -- 172.21.15.84:0/3876454061 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5ae406ec10 msgr2=0x7f5ae40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.250+0000 7f5b05600700 1 --2- 172.21.15.84:0/3876454061 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5ae406ec10 0x7f5ae40710c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00b020 tx=0x7f5aec009e30 comp rx=0 tx=0).stop 2024-04-26T21:30:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.250+0000 7f5b05600700 1 -- 172.21.15.84:0/3876454061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b000fcf10 msgr2=0x7f5b0010fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.250+0000 7f5b05600700 1 --2- 172.21.15.84:0/3876454061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b000fcf10 0x7f5b0010fc20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5af0002a50 tx=0x7f5af00046b0 comp rx=0 tx=0).stop 2024-04-26T21:30:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.251+0000 7f5b05600700 1 -- 172.21.15.84:0/3876454061 shutdown_connections 2024-04-26T21:30:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.251+0000 7f5b05600700 1 --2- 172.21.15.84:0/3876454061 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5ae406ec10 0x7f5ae40710c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.251+0000 7f5b05600700 1 --2- 172.21.15.84:0/3876454061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b000fcf10 0x7f5b0010fc20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.251+0000 7f5b05600700 1 --2- 172.21.15.84:0/3876454061 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b000fe080 0x7f5b00110160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.251+0000 7f5b05600700 1 -- 172.21.15.84:0/3876454061 >> 172.21.15.84:0/3876454061 conn(0x7f5b000f8560 msgr2=0x7f5b000f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:30:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.251+0000 7f5b05600700 1 -- 172.21.15.84:0/3876454061 shutdown_connections 2024-04-26T21:30:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.251+0000 7f5b05600700 1 -- 172.21.15.84:0/3876454061 wait complete. 2024-04-26T21:30:31.269 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:30:31.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.405+0000 7fec33200700 1 -- 172.21.15.84:0/1475919951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec340fbb00 msgr2=0x7fec340fbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:31.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.405+0000 7fec33200700 1 --2- 172.21.15.84:0/1475919951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec340fbb00 0x7fec340fbf10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fec24004940 tx=0x7fec24009e30 comp rx=0 tx=0).stop 2024-04-26T21:30:31.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.405+0000 7fec33200700 1 -- 172.21.15.84:0/1475919951 shutdown_connections 2024-04-26T21:30:31.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.405+0000 7fec33200700 1 --2- 172.21.15.84:0/1475919951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec340fcdb0 0x7fec340fd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:31.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.405+0000 7fec33200700 1 --2- 172.21.15.84:0/1475919951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec340fbb00 0x7fec340fbf10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:31.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.405+0000 7fec33200700 1 -- 172.21.15.84:0/1475919951 >> 172.21.15.84:0/1475919951 conn(0x7fec340f7260 msgr2=0x7fec340f9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:30:31.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.406+0000 7fec33200700 1 -- 172.21.15.84:0/1475919951 shutdown_connections 2024-04-26T21:30:31.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.406+0000 7fec33200700 1 -- 172.21.15.84:0/1475919951 wait complete. 2024-04-26T21:30:31.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.406+0000 7fec33200700 1 Processor -- start 2024-04-26T21:30:31.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.407+0000 7fec33200700 1 -- start start 2024-04-26T21:30:31.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.407+0000 7fec33200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec340fbb00 0x7fec3410fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:31.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.407+0000 7fec33200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec340fcdb0 0x7fec3410ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:31.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.407+0000 7fec33200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec341105c0 con 0x7fec340fcdb0 2024-04-26T21:30:31.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.407+0000 7fec33200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec34110dc0 con 0x7fec340fbb00 2024-04-26T21:30:31.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.407+0000 7fec31400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec340fcdb0 0x7fec3410ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:31.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.407+0000 7fec31400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec340fcdb0 0x7fec3410ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45314/0 (socket says 172.21.15.84:45314) 2024-04-26T21:30:31.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.407+0000 7fec31400700 1 -- 172.21.15.84:0/3956989208 learned_addr learned my addr 172.21.15.84:0/3956989208 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:30:31.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.408+0000 7fec31400700 1 -- 172.21.15.84:0/3956989208 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec340fbb00 msgr2=0x7fec3410fa80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T21:30:31.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.408+0000 7fec31400700 1 --2- 172.21.15.84:0/3956989208 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec340fbb00 0x7fec3410fa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:31.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.408+0000 7fec31400700 1 -- 172.21.15.84:0/3956989208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec24005040 con 0x7fec340fcdb0 2024-04-26T21:30:31.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.408+0000 7fec31400700 1 --2- 172.21.15.84:0/3956989208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec340fcdb0 0x7fec3410ffc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fec2000c830 tx=0x7fec20004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:30:31.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.408+0000 7fec2a000700 1 -- 172.21.15.84:0/3956989208 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec2000a760 con 0x7fec340fcdb0 2024-04-26T21:30:31.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.408+0000 7fec2a000700 1 -- 172.21.15.84:0/3956989208 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec2000ad90 con 0x7fec340fcdb0 2024-04-26T21:30:31.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.408+0000 7fec2a000700 1 -- 172.21.15.84:0/3956989208 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec200113a0 con 0x7fec340fcdb0 2024-04-26T21:30:31.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.408+0000 7fec33200700 1 -- 172.21.15.84:0/3956989208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec341110a0 con 0x7fec340fcdb0 2024-04-26T21:30:31.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.409+0000 7fec33200700 1 -- 172.21.15.84:0/3956989208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec341115e0 con 0x7fec340fcdb0 2024-04-26T21:30:31.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.410+0000 7fec33200700 1 -- 172.21.15.84:0/3956989208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec34101740 con 0x7fec340fcdb0 2024-04-26T21:30:31.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.411+0000 7fec2a000700 1 -- 172.21.15.84:0/3956989208 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fec20012400 con 0x7fec340fcdb0 2024-04-26T21:30:31.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.412+0000 7fec2a000700 1 --2- 172.21.15.84:0/3956989208 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fec1806ec10 0x7fec180710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:31.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.412+0000 7fec2a000700 1 -- 172.21.15.84:0/3956989208 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fec2008e910 con 0x7fec340fcdb0 2024-04-26T21:30:31.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.412+0000 7fec31e00700 1 --2- 172.21.15.84:0/3956989208 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fec1806ec10 0x7fec180710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:31.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.413+0000 7fec31e00700 1 --2- 172.21.15.84:0/3956989208 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fec1806ec10 0x7fec180710c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fec24004f90 tx=0x7fec24009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:30:31.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.417+0000 7fec2a000700 1 -- 172.21.15.84:0/3956989208 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fec2005b1f0 con 0x7fec340fcdb0 2024-04-26T21:30:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:30 smithi120 ceph-mon[79001]: pgmap v107: 65 pgs: 65 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:30:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:30 smithi120 ceph-mon[79001]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 57/363 objects degraded (15.702%), 16 pgs degraded) 2024-04-26T21:30:31.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.672+0000 7fec33200700 1 -- 172.21.15.84:0/3956989208 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fec34111910 con 0x7fec1806ec10 2024-04-26T21:30:31.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.674+0000 7fec2a000700 1 -- 172.21.15.84:0/3956989208 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fec34111910 con 0x7fec1806ec10 2024-04-26T21:30:31.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.678+0000 7fec33200700 1 -- 172.21.15.84:0/3956989208 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fec1806ec10 msgr2=0x7fec180710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:31.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.678+0000 7fec33200700 1 --2- 172.21.15.84:0/3956989208 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fec1806ec10 0x7fec180710c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fec24004f90 tx=0x7fec24009e30 comp rx=0 tx=0).stop 2024-04-26T21:30:31.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.678+0000 7fec33200700 1 -- 172.21.15.84:0/3956989208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec340fcdb0 msgr2=0x7fec3410ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:31.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.678+0000 7fec33200700 1 --2- 172.21.15.84:0/3956989208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec340fcdb0 0x7fec3410ffc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fec2000c830 tx=0x7fec20004470 comp rx=0 tx=0).stop 2024-04-26T21:30:31.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.678+0000 7fec33200700 1 -- 172.21.15.84:0/3956989208 shutdown_connections 2024-04-26T21:30:31.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.678+0000 7fec33200700 1 --2- 172.21.15.84:0/3956989208 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fec1806ec10 0x7fec180710c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:31.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.678+0000 7fec33200700 1 --2- 172.21.15.84:0/3956989208 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec340fbb00 0x7fec3410fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:31.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.678+0000 7fec33200700 1 --2- 172.21.15.84:0/3956989208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec340fcdb0 0x7fec3410ffc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:31.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.678+0000 7fec33200700 1 -- 172.21.15.84:0/3956989208 >> 172.21.15.84:0/3956989208 conn(0x7fec340f7260 msgr2=0x7fec340663e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:30:31.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.678+0000 7fec33200700 1 -- 172.21.15.84:0/3956989208 shutdown_connections 2024-04-26T21:30:31.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.678+0000 7fec33200700 1 -- 172.21.15.84:0/3956989208 wait complete. 2024-04-26T21:30:31.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.834+0000 7fc73fc00700 1 -- 172.21.15.84:0/963504309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7380fcf10 msgr2=0x7fc7380fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:31.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.834+0000 7fc73fc00700 1 --2- 172.21.15.84:0/963504309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7380fcf10 0x7fc7380fd320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc72c004940 tx=0x7fc72c009e30 comp rx=0 tx=0).stop 2024-04-26T21:30:31.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.834+0000 7fc73fc00700 1 -- 172.21.15.84:0/963504309 shutdown_connections 2024-04-26T21:30:31.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.834+0000 7fc73fc00700 1 --2- 172.21.15.84:0/963504309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7380fe080 0x7fc7380fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:31.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.834+0000 7fc73fc00700 1 --2- 172.21.15.84:0/963504309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7380fcf10 0x7fc7380fd320 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:31.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.834+0000 7fc73fc00700 1 -- 172.21.15.84:0/963504309 >> 172.21.15.84:0/963504309 conn(0x7fc7380f8560 msgr2=0x7fc7380fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:30:31.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.835+0000 7fc73fc00700 1 -- 172.21.15.84:0/963504309 shutdown_connections 2024-04-26T21:30:31.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.835+0000 7fc73fc00700 1 -- 172.21.15.84:0/963504309 wait complete. 2024-04-26T21:30:31.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.835+0000 7fc73fc00700 1 Processor -- start 2024-04-26T21:30:31.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.836+0000 7fc73fc00700 1 -- start start 2024-04-26T21:30:31.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.836+0000 7fc73fc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7380fcf10 0x7fc73810fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:31.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.836+0000 7fc73fc00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7380fe080 0x7fc738110120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:31.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.836+0000 7fc73fc00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc738110720 con 0x7fc7380fe080 2024-04-26T21:30:31.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.836+0000 7fc73fc00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc738110f70 con 0x7fc7380fcf10 2024-04-26T21:30:31.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.836+0000 7fc737e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7380fe080 0x7fc738110120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:31.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.836+0000 7fc737e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7380fe080 0x7fc738110120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39826/0 (socket says 172.21.15.84:39826) 2024-04-26T21:30:31.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.836+0000 7fc737e00700 1 -- 172.21.15.84:0/654157712 learned_addr learned my addr 172.21.15.84:0/654157712 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:30:31.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.837+0000 7fc73d200700 1 --2- 172.21.15.84:0/654157712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7380fcf10 0x7fc73810fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:31.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.837+0000 7fc737e00700 1 -- 172.21.15.84:0/654157712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7380fcf10 msgr2=0x7fc73810fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:31.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.837+0000 7fc737e00700 1 --2- 172.21.15.84:0/654157712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7380fcf10 0x7fc73810fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:31.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.837+0000 7fc737e00700 1 -- 172.21.15.84:0/654157712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c005040 con 0x7fc7380fe080 2024-04-26T21:30:31.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.837+0000 7fc73d200700 1 --2- 172.21.15.84:0/654157712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7380fcf10 0x7fc73810fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:30:31.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.837+0000 7fc737e00700 1 --2- 172.21.15.84:0/654157712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7380fe080 0x7fc738110120 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc724002a50 tx=0x7fc7240046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:30:31.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.839+0000 7fc734c00700 1 -- 172.21.15.84:0/654157712 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc724007cc0 con 0x7fc7380fe080 2024-04-26T21:30:31.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.839+0000 7fc73fc00700 1 -- 172.21.15.84:0/654157712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc738111250 con 0x7fc7380fe080 2024-04-26T21:30:31.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.839+0000 7fc734c00700 1 -- 172.21.15.84:0/654157712 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc72400f040 con 0x7fc7380fe080 2024-04-26T21:30:31.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.839+0000 7fc734c00700 1 -- 172.21.15.84:0/654157712 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc724009640 con 0x7fc7380fe080 2024-04-26T21:30:31.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.839+0000 7fc73fc00700 1 -- 172.21.15.84:0/654157712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc738111790 con 0x7fc7380fe080 2024-04-26T21:30:31.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.840+0000 7fc73fc00700 1 -- 172.21.15.84:0/654157712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc738101a10 con 0x7fc7380fe080 2024-04-26T21:30:31.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.842+0000 7fc734c00700 1 -- 172.21.15.84:0/654157712 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc7240097a0 con 0x7fc7380fe080 2024-04-26T21:30:31.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.844+0000 7fc734c00700 1 --2- 172.21.15.84:0/654157712 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc72006ec10 0x7fc7200710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:31.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.844+0000 7fc734c00700 1 -- 172.21.15.84:0/654157712 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fc72408e6f0 con 0x7fc7380fe080 2024-04-26T21:30:31.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.844+0000 7fc73d200700 1 --2- 172.21.15.84:0/654157712 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc72006ec10 0x7fc7200710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:31.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.845+0000 7fc73d200700 1 --2- 172.21.15.84:0/654157712 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc72006ec10 0x7fc7200710c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00b7a0 tx=0x7fc72c009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:30:31.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:31.849+0000 7fc734c00700 1 -- 172.21.15.84:0/654157712 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fc72405af50 con 0x7fc7380fe080 2024-04-26T21:30:32.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.085+0000 7fc73fc00700 1 -- 172.21.15.84:0/654157712 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc738111a00 con 0x7fc72006ec10 2024-04-26T21:30:32.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.115+0000 7fc734c00700 1 -- 172.21.15.84:0/654157712 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc738111a00 con 0x7fc72006ec10 2024-04-26T21:30:32.117 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:30:32.118 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (5m) 7s ago 16m 14.2M - 0.25.0 c8568f914cd2 bcb419cf9108 2024-04-26T21:30:32.118 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (82s) 7s ago 16m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 b4010dfbe623 2024-04-26T21:30:32.118 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (75s) 69s ago 15m 6665k - 19.0.0-3306-gbc612ffb 55dc54019ad8 89a4e50ea23c 2024-04-26T21:30:32.118 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (5m) 7s ago 15m 76.4M - 9.4.7 954c08fa6188 1bf95f604e07 2024-04-26T21:30:32.118 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (9m) 7s ago 9m 114M - 17.2.7-907-g2be3efa9 1c5834633715 485d7884e1d5 2024-04-26T21:30:32.118 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (9m) 7s ago 9m 14.2M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:30:32.118 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (9m) 69s ago 9m 113M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:30:32.118 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (9m) 69s ago 9m 13.8M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:30:32.118 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (4m) 7s ago 17m 504M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:30:32.118 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283,8765 running (3m) 69s ago 14m 452M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d6ae0b4628b5 2024-04-26T21:30:32.118 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (3m) 7s ago 18m 44.8M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 bf610abb6a62 2024-04-26T21:30:32.118 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (2m) 69s ago 14m 33.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 5d530496253b 2024-04-26T21:30:32.118 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (5m) 7s ago 16m 7940k - 1.5.0 0da6a335fe13 81e00b40bfbf 2024-04-26T21:30:32.118 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (5m) 69s ago 14m 7810k - 1.5.0 0da6a335fe13 0506a1d46ec4 2024-04-26T21:30:32.119 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (45s) 7s ago 13m 122M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 99fbe2faa51b 2024-04-26T21:30:32.119 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (15s) 7s ago 13m 11.2M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 2dc81d93f7e5 2024-04-26T21:30:32.119 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (12m) 7s ago 12m 184M 1557M 17.2.7-907-g2be3efa9 1c5834633715 5899468fc5c8 2024-04-26T21:30:32.119 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (12m) 69s ago 12m 230M 2581M 17.2.7-907-g2be3efa9 1c5834633715 b8a14c87d730 2024-04-26T21:30:32.119 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (11m) 69s ago 11m 216M 2581M 17.2.7-907-g2be3efa9 1c5834633715 4d294df735a3 2024-04-26T21:30:32.119 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (10m) 69s ago 10m 201M 2581M 17.2.7-907-g2be3efa9 1c5834633715 9b60997971a8 2024-04-26T21:30:32.119 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (3m) 7s ago 15m 54.4M - 2.43.0 a07b618ecd1d d3008b765eec 2024-04-26T21:30:32.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.119+0000 7fc73fc00700 1 -- 172.21.15.84:0/654157712 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc72006ec10 msgr2=0x7fc7200710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:32.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.119+0000 7fc73fc00700 1 --2- 172.21.15.84:0/654157712 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc72006ec10 0x7fc7200710c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00b7a0 tx=0x7fc72c009e30 comp rx=0 tx=0).stop 2024-04-26T21:30:32.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.119+0000 7fc73fc00700 1 -- 172.21.15.84:0/654157712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7380fe080 msgr2=0x7fc738110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:32.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.119+0000 7fc73fc00700 1 --2- 172.21.15.84:0/654157712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7380fe080 0x7fc738110120 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc724002a50 tx=0x7fc7240046b0 comp rx=0 tx=0).stop 2024-04-26T21:30:32.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.120+0000 7fc73fc00700 1 -- 172.21.15.84:0/654157712 shutdown_connections 2024-04-26T21:30:32.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.120+0000 7fc73fc00700 1 --2- 172.21.15.84:0/654157712 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc72006ec10 0x7fc7200710c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:32.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.120+0000 7fc73fc00700 1 --2- 172.21.15.84:0/654157712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7380fcf10 0x7fc73810fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:32.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.120+0000 7fc73fc00700 1 --2- 172.21.15.84:0/654157712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7380fe080 0x7fc738110120 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:32.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.120+0000 7fc73fc00700 1 -- 172.21.15.84:0/654157712 >> 172.21.15.84:0/654157712 conn(0x7fc7380f8560 msgr2=0x7fc7380f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:30:32.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.120+0000 7fc73fc00700 1 -- 172.21.15.84:0/654157712 shutdown_connections 2024-04-26T21:30:32.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.120+0000 7fc73fc00700 1 -- 172.21.15.84:0/654157712 wait complete. 2024-04-26T21:30:32.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.277+0000 7f9a3b400700 1 -- 172.21.15.84:0/2921958145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a340fcf10 msgr2=0x7f9a340fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:32.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.277+0000 7f9a3b400700 1 --2- 172.21.15.84:0/2921958145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a340fcf10 0x7f9a340fd320 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9a28004940 tx=0x7f9a28009e30 comp rx=0 tx=0).stop 2024-04-26T21:30:32.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.277+0000 7f9a3b400700 1 -- 172.21.15.84:0/2921958145 shutdown_connections 2024-04-26T21:30:32.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.277+0000 7f9a3b400700 1 --2- 172.21.15.84:0/2921958145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a340fe080 0x7f9a340fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:32.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.277+0000 7f9a3b400700 1 --2- 172.21.15.84:0/2921958145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a340fcf10 0x7f9a340fd320 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:32.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.277+0000 7f9a3b400700 1 -- 172.21.15.84:0/2921958145 >> 172.21.15.84:0/2921958145 conn(0x7f9a340f8560 msgr2=0x7f9a340fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:30:32.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.278+0000 7f9a3b400700 1 -- 172.21.15.84:0/2921958145 shutdown_connections 2024-04-26T21:30:32.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.278+0000 7f9a3b400700 1 -- 172.21.15.84:0/2921958145 wait complete. 2024-04-26T21:30:32.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.278+0000 7f9a3b400700 1 Processor -- start 2024-04-26T21:30:32.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.279+0000 7f9a3b400700 1 -- start start 2024-04-26T21:30:32.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.279+0000 7f9a3b400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a340fcf10 0x7f9a3410fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:32.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.279+0000 7f9a3b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a340fe080 0x7f9a34110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:32.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.279+0000 7f9a3b400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a341107c0 con 0x7f9a340fe080 2024-04-26T21:30:32.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.279+0000 7f9a3b400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a34110fb0 con 0x7f9a340fcf10 2024-04-26T21:30:32.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.279+0000 7f9a33e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a340fe080 0x7f9a34110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:32.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.279+0000 7f9a33e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a340fe080 0x7f9a34110130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39838/0 (socket says 172.21.15.84:39838) 2024-04-26T21:30:32.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.279+0000 7f9a33e00700 1 -- 172.21.15.84:0/34930799 learned_addr learned my addr 172.21.15.84:0/34930799 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:30:32.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.280+0000 7f9a38a00700 1 --2- 172.21.15.84:0/34930799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a340fcf10 0x7f9a3410fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:32.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.280+0000 7f9a33e00700 1 -- 172.21.15.84:0/34930799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a340fcf10 msgr2=0x7f9a3410fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:32.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.280+0000 7f9a33e00700 1 --2- 172.21.15.84:0/34930799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a340fcf10 0x7f9a3410fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:32.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.280+0000 7f9a33e00700 1 -- 172.21.15.84:0/34930799 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a28005040 con 0x7f9a340fe080 2024-04-26T21:30:32.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.280+0000 7f9a33e00700 1 --2- 172.21.15.84:0/34930799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a340fe080 0x7f9a34110130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000b790 tx=0x7f9a20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:30:32.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.281+0000 7f9a30c00700 1 -- 172.21.15.84:0/34930799 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a2000f770 con 0x7f9a340fe080 2024-04-26T21:30:32.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.281+0000 7f9a30c00700 1 -- 172.21.15.84:0/34930799 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a2000fda0 con 0x7f9a340fe080 2024-04-26T21:30:32.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.281+0000 7f9a30c00700 1 -- 172.21.15.84:0/34930799 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a2000d310 con 0x7f9a340fe080 2024-04-26T21:30:32.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.281+0000 7f9a3b400700 1 -- 172.21.15.84:0/34930799 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a34111290 con 0x7f9a340fe080 2024-04-26T21:30:32.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.281+0000 7f9a3b400700 1 -- 172.21.15.84:0/34930799 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a34111850 con 0x7f9a340fe080 2024-04-26T21:30:32.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.282+0000 7f9a3b400700 1 -- 172.21.15.84:0/34930799 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a34101a10 con 0x7f9a340fe080 2024-04-26T21:30:32.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.283+0000 7f9a30c00700 1 -- 172.21.15.84:0/34930799 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9a20010420 con 0x7f9a340fe080 2024-04-26T21:30:32.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.284+0000 7f9a30c00700 1 --2- 172.21.15.84:0/34930799 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9a1c06ec10 0x7f9a1c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:32.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.285+0000 7f9a30c00700 1 -- 172.21.15.84:0/34930799 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f9a2008e930 con 0x7f9a340fe080 2024-04-26T21:30:32.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.285+0000 7f9a38a00700 1 --2- 172.21.15.84:0/34930799 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9a1c06ec10 0x7f9a1c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:32.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.286+0000 7f9a38a00700 1 --2- 172.21.15.84:0/34930799 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9a1c06ec10 0x7f9a1c0710c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a28004f90 tx=0x7f9a28009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:30:32.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.290+0000 7f9a30c00700 1 -- 172.21.15.84:0/34930799 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f9a2005b230 con 0x7f9a340fe080 2024-04-26T21:30:32.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.611+0000 7f9a3b400700 1 -- 172.21.15.84:0/34930799 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9a34105b80 con 0x7f9a340fe080 2024-04-26T21:30:32.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.612+0000 7f9a30c00700 1 -- 172.21.15.84:0/34930799 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f9a34105b80 con 0x7f9a340fe080 2024-04-26T21:30:32.615 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:30:32.615 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:30:32.615 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:30:32.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:30:32.615 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:30:32.615 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:30:32.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:30:32.615 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:30:32.615 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4, 2024-04-26T21:30:32.616 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:30:32.616 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:30:32.616 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:30:32.616 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-26T21:30:32.616 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:30:32.616 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:30:32.616 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 8, 2024-04-26T21:30:32.616 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 6 2024-04-26T21:30:32.616 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:30:32.616 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:30:32.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.615+0000 7f9a3b400700 1 -- 172.21.15.84:0/34930799 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9a1c06ec10 msgr2=0x7f9a1c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:32.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.615+0000 7f9a3b400700 1 --2- 172.21.15.84:0/34930799 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9a1c06ec10 0x7f9a1c0710c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a28004f90 tx=0x7f9a28009e30 comp rx=0 tx=0).stop 2024-04-26T21:30:32.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.615+0000 7f9a3b400700 1 -- 172.21.15.84:0/34930799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a340fe080 msgr2=0x7f9a34110130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:32.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.615+0000 7f9a3b400700 1 --2- 172.21.15.84:0/34930799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a340fe080 0x7f9a34110130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000b790 tx=0x7f9a20009250 comp rx=0 tx=0).stop 2024-04-26T21:30:32.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.615+0000 7f9a3b400700 1 -- 172.21.15.84:0/34930799 shutdown_connections 2024-04-26T21:30:32.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.615+0000 7f9a3b400700 1 --2- 172.21.15.84:0/34930799 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9a1c06ec10 0x7f9a1c0710c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:32.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.615+0000 7f9a3b400700 1 --2- 172.21.15.84:0/34930799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a340fcf10 0x7f9a3410fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:32.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.615+0000 7f9a3b400700 1 --2- 172.21.15.84:0/34930799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a340fe080 0x7f9a34110130 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:32.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.615+0000 7f9a3b400700 1 -- 172.21.15.84:0/34930799 >> 172.21.15.84:0/34930799 conn(0x7f9a340f8560 msgr2=0x7f9a340f9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:30:32.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.616+0000 7f9a3b400700 1 -- 172.21.15.84:0/34930799 shutdown_connections 2024-04-26T21:30:32.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.616+0000 7f9a3b400700 1 -- 172.21.15.84:0/34930799 wait complete. 2024-04-26T21:30:32.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.764+0000 7f39ec600700 1 -- 172.21.15.84:0/4094260744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39e40ffee0 msgr2=0x7f39e4102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:32.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.764+0000 7f39ec600700 1 --2- 172.21.15.84:0/4094260744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39e40ffee0 0x7f39e4102300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f39d0004940 tx=0x7f39d0009e30 comp rx=0 tx=0).stop 2024-04-26T21:30:32.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.764+0000 7f39ec600700 1 -- 172.21.15.84:0/4094260744 shutdown_connections 2024-04-26T21:30:32.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.764+0000 7f39ec600700 1 --2- 172.21.15.84:0/4094260744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39e40ffee0 0x7f39e4102300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:32.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.764+0000 7f39ec600700 1 --2- 172.21.15.84:0/4094260744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39e40662c0 0x7f39e40ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:32.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.764+0000 7f39ec600700 1 -- 172.21.15.84:0/4094260744 >> 172.21.15.84:0/4094260744 conn(0x7f39e40f7430 msgr2=0x7f39e40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:30:32.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.764+0000 7f39ec600700 1 -- 172.21.15.84:0/4094260744 shutdown_connections 2024-04-26T21:30:32.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.764+0000 7f39ec600700 1 -- 172.21.15.84:0/4094260744 wait complete. 2024-04-26T21:30:32.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.765+0000 7f39ec600700 1 Processor -- start 2024-04-26T21:30:32.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.765+0000 7f39ec600700 1 -- start start 2024-04-26T21:30:32.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.765+0000 7f39ec600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39e40662c0 0x7f39e410fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:32.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.765+0000 7f39ec600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39e40ffee0 0x7f39e41101e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:32.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.765+0000 7f39ec600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e4110870 con 0x7f39e40ffee0 2024-04-26T21:30:32.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.765+0000 7f39ec600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e4111010 con 0x7f39e40662c0 2024-04-26T21:30:32.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.766+0000 7f39e9200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39e40ffee0 0x7f39e41101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:32.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.766+0000 7f39e9200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39e40ffee0 0x7f39e41101e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39862/0 (socket says 172.21.15.84:39862) 2024-04-26T21:30:32.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.766+0000 7f39e9200700 1 -- 172.21.15.84:0/3432055044 learned_addr learned my addr 172.21.15.84:0/3432055044 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:30:32.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.766+0000 7f39e9c00700 1 --2- 172.21.15.84:0/3432055044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39e40662c0 0x7f39e410fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:32.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.766+0000 7f39e9200700 1 -- 172.21.15.84:0/3432055044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39e40662c0 msgr2=0x7f39e410fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:32.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.766+0000 7f39e9200700 1 --2- 172.21.15.84:0/3432055044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39e40662c0 0x7f39e410fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:32.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.766+0000 7f39e9200700 1 -- 172.21.15.84:0/3432055044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d0005040 con 0x7f39e40ffee0 2024-04-26T21:30:32.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.767+0000 7f39e9200700 1 --2- 172.21.15.84:0/3432055044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39e40ffee0 0x7f39e41101e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009150 tx=0x7f39d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:30:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.767+0000 7f39e1600700 1 -- 172.21.15.84:0/3432055044 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39d000e040 con 0x7f39e40ffee0 2024-04-26T21:30:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.767+0000 7f39e1600700 1 -- 172.21.15.84:0/3432055044 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f39d000bbf0 con 0x7f39e40ffee0 2024-04-26T21:30:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.767+0000 7f39ec600700 1 -- 172.21.15.84:0/3432055044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e4111290 con 0x7f39e40ffee0 2024-04-26T21:30:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.767+0000 7f39e1600700 1 -- 172.21.15.84:0/3432055044 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39d001c630 con 0x7f39e40ffee0 2024-04-26T21:30:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.767+0000 7f39ec600700 1 -- 172.21.15.84:0/3432055044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e4111850 con 0x7f39e40ffee0 2024-04-26T21:30:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.768+0000 7f39ec600700 1 -- 172.21.15.84:0/3432055044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e40f8f60 con 0x7f39e40ffee0 2024-04-26T21:30:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.769+0000 7f39e1600700 1 -- 172.21.15.84:0/3432055044 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f39d000bd60 con 0x7f39e40ffee0 2024-04-26T21:30:32.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.771+0000 7f39e1600700 1 --2- 172.21.15.84:0/3432055044 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f39cc06ec10 0x7f39cc0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:32.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.771+0000 7f39e1600700 1 -- 172.21.15.84:0/3432055044 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f39d008fcc0 con 0x7f39e40ffee0 2024-04-26T21:30:32.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.771+0000 7f39e9c00700 1 --2- 172.21.15.84:0/3432055044 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f39cc06ec10 0x7f39cc0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:32.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.772+0000 7f39e9c00700 1 --2- 172.21.15.84:0/3432055044 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f39cc06ec10 0x7f39cc0710c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f39d8006fd0 tx=0x7f39d8008040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:30:32.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:32.776+0000 7f39e1600700 1 -- 172.21.15.84:0/3432055044 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f39d0095020 con 0x7f39e40ffee0 2024-04-26T21:30:32.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:32 smithi084 ceph-mon[90138]: from='client.34268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:30:32.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:32 smithi084 ceph-mon[90138]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:30:32.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:32 smithi084 ceph-mon[90138]: pgmap v108: 65 pgs: 65 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:30:32.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:32.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:32.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:30:32.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:30:32.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:32.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:30:32.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:30:32.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:30:32.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:30:32.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-26T21:30:32.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:32 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/34930799' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:30:33.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.055+0000 7f39ec600700 1 -- 172.21.15.84:0/3432055044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f39e4105a90 con 0x7f39e40ffee0 2024-04-26T21:30:33.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.056+0000 7f39e1600700 1 -- 172.21.15.84:0/3432055044 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1903 (secure 0 0 0) 0x7f39d005c5a0 con 0x7f39e40ffee0 2024-04-26T21:30:33.059 INFO:teuthology.orchestra.run.smithi084.stdout:e17 2024-04-26T21:30:33.059 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:30:33.059 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:30:33.059 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:30:33.059 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:30:33.059 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:30:33.060 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:30:33.060 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 17 2024-04-26T21:30:33.060 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:30:33.060 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:30:33.060 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:30:28.772328+0000 2024-04-26T21:30:33.060 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:30:33.060 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:30:33.060 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:30:33.060 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:30:33.060 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:30:33.061 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-04-26T21:30:33.061 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:30:33.061 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:30:33.061 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:30:33.061 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:30:33.061 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:30:33.061 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:30:33.062 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456,1=24231} 2024-04-26T21:30:33.062 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:30:33.062 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:30:33.062 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:30:33.062 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:30:33.062 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:30:33.062 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:30:33.062 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:30:33.062 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-04-26T21:30:33.062 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:30:33.063 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 14456 members: 24231,14456 2024-04-26T21:30:33.063 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:30:33.063 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:30:33.063 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:30:33.063 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:30:33.063 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:30:33.063 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:30:33.063 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:30:33.064 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:30:33.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.059+0000 7f39ec600700 1 -- 172.21.15.84:0/3432055044 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f39cc06ec10 msgr2=0x7f39cc0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:33.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.059+0000 7f39ec600700 1 --2- 172.21.15.84:0/3432055044 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f39cc06ec10 0x7f39cc0710c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f39d8006fd0 tx=0x7f39d8008040 comp rx=0 tx=0).stop 2024-04-26T21:30:33.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.059+0000 7f39ec600700 1 -- 172.21.15.84:0/3432055044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39e40ffee0 msgr2=0x7f39e41101e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:33.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.059+0000 7f39ec600700 1 --2- 172.21.15.84:0/3432055044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39e40ffee0 0x7f39e41101e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009150 tx=0x7f39d0009e30 comp rx=0 tx=0).stop 2024-04-26T21:30:33.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.060+0000 7f39ec600700 1 -- 172.21.15.84:0/3432055044 shutdown_connections 2024-04-26T21:30:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.060+0000 7f39ec600700 1 --2- 172.21.15.84:0/3432055044 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f39cc06ec10 0x7f39cc0710c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.060+0000 7f39ec600700 1 --2- 172.21.15.84:0/3432055044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39e40662c0 0x7f39e410fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.060+0000 7f39ec600700 1 --2- 172.21.15.84:0/3432055044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39e40ffee0 0x7f39e41101e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.060+0000 7f39ec600700 1 -- 172.21.15.84:0/3432055044 >> 172.21.15.84:0/3432055044 conn(0x7f39e40f7430 msgr2=0x7f39e4100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:30:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.060+0000 7f39ec600700 1 -- 172.21.15.84:0/3432055044 shutdown_connections 2024-04-26T21:30:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.060+0000 7f39ec600700 1 -- 172.21.15.84:0/3432055044 wait complete. 2024-04-26T21:30:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2024-04-26T21:30:33.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:32 smithi120 ceph-mon[79001]: from='client.34268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:30:33.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:32 smithi120 ceph-mon[79001]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:30:33.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:32 smithi120 ceph-mon[79001]: pgmap v108: 65 pgs: 65 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:30:33.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:33.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:33.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:30:33.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:30:33.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:33.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:30:33.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:30:33.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:30:33.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:30:33.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-26T21:30:33.186 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:32 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/34930799' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:30:33.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.209+0000 7f5035c00700 1 -- 172.21.15.84:0/3296381067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50300fdfd0 msgr2=0x7f50300fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:33.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.209+0000 7f5035c00700 1 --2- 172.21.15.84:0/3296381067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50300fdfd0 0x7f50300fe440 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f501c004940 tx=0x7f501c009e30 comp rx=0 tx=0).stop 2024-04-26T21:30:33.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.209+0000 7f5035c00700 1 -- 172.21.15.84:0/3296381067 shutdown_connections 2024-04-26T21:30:33.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.209+0000 7f5035c00700 1 --2- 172.21.15.84:0/3296381067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50300fdfd0 0x7f50300fe440 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:33.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.209+0000 7f5035c00700 1 --2- 172.21.15.84:0/3296381067 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50300fce60 0x7f50300fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:33.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.209+0000 7f5035c00700 1 -- 172.21.15.84:0/3296381067 >> 172.21.15.84:0/3296381067 conn(0x7f50300f8540 msgr2=0x7f50300fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:30:33.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.210+0000 7f5035c00700 1 -- 172.21.15.84:0/3296381067 shutdown_connections 2024-04-26T21:30:33.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.210+0000 7f5035c00700 1 -- 172.21.15.84:0/3296381067 wait complete. 2024-04-26T21:30:33.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.210+0000 7f5035c00700 1 Processor -- start 2024-04-26T21:30:33.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.211+0000 7f5035c00700 1 -- start start 2024-04-26T21:30:33.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.211+0000 7f5035c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50300fce60 0x7f503010fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:33.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.211+0000 7f5035c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50300fdfd0 0x7f5030110060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:33.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.211+0000 7f5035c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5030110660 con 0x7f50300fce60 2024-04-26T21:30:33.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.211+0000 7f5035c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50301107d0 con 0x7f50300fdfd0 2024-04-26T21:30:33.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.211+0000 7f502ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50300fce60 0x7f503010fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:33.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.211+0000 7f502ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50300fce60 0x7f503010fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39884/0 (socket says 172.21.15.84:39884) 2024-04-26T21:30:33.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.211+0000 7f502ea00700 1 -- 172.21.15.84:0/1986566222 learned_addr learned my addr 172.21.15.84:0/1986566222 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:30:33.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.212+0000 7f502e000700 1 --2- 172.21.15.84:0/1986566222 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50300fdfd0 0x7f5030110060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:33.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.212+0000 7f502ea00700 1 -- 172.21.15.84:0/1986566222 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50300fdfd0 msgr2=0x7f5030110060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:33.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.212+0000 7f502ea00700 1 --2- 172.21.15.84:0/1986566222 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50300fdfd0 0x7f5030110060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:33.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.212+0000 7f502ea00700 1 -- 172.21.15.84:0/1986566222 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c005040 con 0x7f50300fce60 2024-04-26T21:30:33.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.212+0000 7f502ea00700 1 --2- 172.21.15.84:0/1986566222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50300fce60 0x7f503010fb20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f502000c830 tx=0x7f5020004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:30:33.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.212+0000 7f5026a00700 1 -- 172.21.15.84:0/1986566222 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f502000a760 con 0x7f50300fce60 2024-04-26T21:30:33.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.212+0000 7f5026a00700 1 -- 172.21.15.84:0/1986566222 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f502000ad90 con 0x7f50300fce60 2024-04-26T21:30:33.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.212+0000 7f5026a00700 1 -- 172.21.15.84:0/1986566222 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50200113a0 con 0x7f50300fce60 2024-04-26T21:30:33.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.212+0000 7f5035c00700 1 -- 172.21.15.84:0/1986566222 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5030115230 con 0x7f50300fce60 2024-04-26T21:30:33.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.212+0000 7f5035c00700 1 -- 172.21.15.84:0/1986566222 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50301157f0 con 0x7f50300fce60 2024-04-26T21:30:33.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.214+0000 7f5035c00700 1 -- 172.21.15.84:0/1986566222 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5030101960 con 0x7f50300fce60 2024-04-26T21:30:33.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.214+0000 7f5026a00700 1 -- 172.21.15.84:0/1986566222 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5020012400 con 0x7f50300fce60 2024-04-26T21:30:33.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.215+0000 7f5026a00700 1 --2- 172.21.15.84:0/1986566222 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f501406ec00 0x7f50140710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:33.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.215+0000 7f5026a00700 1 -- 172.21.15.84:0/1986566222 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f502008e910 con 0x7f50300fce60 2024-04-26T21:30:33.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.216+0000 7f502e000700 1 --2- 172.21.15.84:0/1986566222 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f501406ec00 0x7f50140710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:33.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.217+0000 7f502e000700 1 --2- 172.21.15.84:0/1986566222 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f501406ec00 0x7f50140710b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f501c00b970 tx=0x7f501c009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:30:33.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.220+0000 7f5026a00700 1 -- 172.21.15.84:0/1986566222 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f502005b1f0 con 0x7f50300fce60 2024-04-26T21:30:33.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.459+0000 7f5035c00700 1 -- 172.21.15.84:0/1986566222 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f503002b3b0 con 0x7f501406ec00 2024-04-26T21:30:33.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.461+0000 7f5026a00700 1 -- 172.21.15.84:0/1986566222 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f503002b3b0 con 0x7f501406ec00 2024-04-26T21:30:33.463 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:30:33.463 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:30:33.463 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:30:33.463 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:30:33.463 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-04-26T21:30:33.463 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr", 2024-04-26T21:30:33.463 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-04-26T21:30:33.463 INFO:teuthology.orchestra.run.smithi084.stdout: "crash" 2024-04-26T21:30:33.463 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-04-26T21:30:33.463 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "8/21 daemons upgraded", 2024-04-26T21:30:33.464 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading osd daemons", 2024-04-26T21:30:33.464 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:30:33.464 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:30:33.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.464+0000 7f5035c00700 1 -- 172.21.15.84:0/1986566222 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f501406ec00 msgr2=0x7f50140710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:33.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.464+0000 7f5035c00700 1 --2- 172.21.15.84:0/1986566222 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f501406ec00 0x7f50140710b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f501c00b970 tx=0x7f501c009e30 comp rx=0 tx=0).stop 2024-04-26T21:30:33.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.464+0000 7f5035c00700 1 -- 172.21.15.84:0/1986566222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50300fce60 msgr2=0x7f503010fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:33.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.464+0000 7f5035c00700 1 --2- 172.21.15.84:0/1986566222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50300fce60 0x7f503010fb20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f502000c830 tx=0x7f5020004470 comp rx=0 tx=0).stop 2024-04-26T21:30:33.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.464+0000 7f5035c00700 1 -- 172.21.15.84:0/1986566222 shutdown_connections 2024-04-26T21:30:33.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.464+0000 7f5035c00700 1 --2- 172.21.15.84:0/1986566222 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f501406ec00 0x7f50140710b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:33.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.464+0000 7f5035c00700 1 --2- 172.21.15.84:0/1986566222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50300fce60 0x7f503010fb20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:33.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.464+0000 7f5035c00700 1 --2- 172.21.15.84:0/1986566222 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50300fdfd0 0x7f5030110060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:33.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.464+0000 7f5035c00700 1 -- 172.21.15.84:0/1986566222 >> 172.21.15.84:0/1986566222 conn(0x7f50300f8540 msgr2=0x7f50300f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:30:33.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.465+0000 7f5035c00700 1 -- 172.21.15.84:0/1986566222 shutdown_connections 2024-04-26T21:30:33.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.465+0000 7f5035c00700 1 -- 172.21.15.84:0/1986566222 wait complete. 2024-04-26T21:30:33.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.607+0000 7f2254e00700 1 -- 172.21.15.84:0/3508932123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2250103230 msgr2=0x7f2250103640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:33.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.607+0000 7f2254e00700 1 --2- 172.21.15.84:0/3508932123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2250103230 0x7f2250103640 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2240004940 tx=0x7f2240009e30 comp rx=0 tx=0).stop 2024-04-26T21:30:33.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.607+0000 7f2254e00700 1 -- 172.21.15.84:0/3508932123 shutdown_connections 2024-04-26T21:30:33.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.607+0000 7f2254e00700 1 --2- 172.21.15.84:0/3508932123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22501044e0 0x7f2250104950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:33.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.607+0000 7f2254e00700 1 --2- 172.21.15.84:0/3508932123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2250103230 0x7f2250103640 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:33.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.607+0000 7f2254e00700 1 -- 172.21.15.84:0/3508932123 >> 172.21.15.84:0/3508932123 conn(0x7f22500724d0 msgr2=0x7f22500748e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:30:33.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.607+0000 7f2254e00700 1 -- 172.21.15.84:0/3508932123 shutdown_connections 2024-04-26T21:30:33.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.607+0000 7f2254e00700 1 -- 172.21.15.84:0/3508932123 wait complete. 2024-04-26T21:30:33.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.609+0000 7f2254e00700 1 Processor -- start 2024-04-26T21:30:33.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.609+0000 7f2254e00700 1 -- start start 2024-04-26T21:30:33.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.609+0000 7f2254e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2250103230 0x7f2250113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:33.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.609+0000 7f2254e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22501044e0 0x7f22501143e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:33.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.609+0000 7f2254e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2250115150 con 0x7f22501044e0 2024-04-26T21:30:33.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.609+0000 7f2254e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22501152c0 con 0x7f2250103230 2024-04-26T21:30:33.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.610+0000 7f224ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22501044e0 0x7f22501143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:33.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.610+0000 7f224ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22501044e0 0x7f22501143e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39914/0 (socket says 172.21.15.84:39914) 2024-04-26T21:30:33.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.610+0000 7f224ea00700 1 -- 172.21.15.84:0/2824100746 learned_addr learned my addr 172.21.15.84:0/2824100746 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:30:33.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.610+0000 7f224f400700 1 --2- 172.21.15.84:0/2824100746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2250103230 0x7f2250113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:33.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.610+0000 7f224ea00700 1 -- 172.21.15.84:0/2824100746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2250103230 msgr2=0x7f2250113ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:33.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.610+0000 7f224ea00700 1 --2- 172.21.15.84:0/2824100746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2250103230 0x7f2250113ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:33.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.610+0000 7f224ea00700 1 -- 172.21.15.84:0/2824100746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2240005040 con 0x7f22501044e0 2024-04-26T21:30:33.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.610+0000 7f224f400700 1 --2- 172.21.15.84:0/2824100746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2250103230 0x7f2250113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:30:33.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.611+0000 7f224ea00700 1 --2- 172.21.15.84:0/2824100746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22501044e0 0x7f22501143e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f223c002a50 tx=0x7f223c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:30:33.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.611+0000 7f2247400700 1 -- 172.21.15.84:0/2824100746 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f223c007cc0 con 0x7f22501044e0 2024-04-26T21:30:33.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.611+0000 7f2247400700 1 -- 172.21.15.84:0/2824100746 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f223c00f040 con 0x7f22501044e0 2024-04-26T21:30:33.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.611+0000 7f2254e00700 1 -- 172.21.15.84:0/2824100746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2250115540 con 0x7f22501044e0 2024-04-26T21:30:33.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.611+0000 7f2247400700 1 -- 172.21.15.84:0/2824100746 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f223c009640 con 0x7f22501044e0 2024-04-26T21:30:33.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.611+0000 7f2254e00700 1 -- 172.21.15.84:0/2824100746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2250115b00 con 0x7f22501044e0 2024-04-26T21:30:33.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.612+0000 7f2254e00700 1 -- 172.21.15.84:0/2824100746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2250076060 con 0x7f22501044e0 2024-04-26T21:30:33.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.613+0000 7f2247400700 1 -- 172.21.15.84:0/2824100746 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f223c0097a0 con 0x7f22501044e0 2024-04-26T21:30:33.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.614+0000 7f2247400700 1 --2- 172.21.15.84:0/2824100746 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f223406ec00 0x7f22340710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:30:33.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.614+0000 7f2247400700 1 -- 172.21.15.84:0/2824100746 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f223c08e610 con 0x7f22501044e0 2024-04-26T21:30:33.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.614+0000 7f224f400700 1 --2- 172.21.15.84:0/2824100746 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f223406ec00 0x7f22340710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:30:33.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.615+0000 7f224f400700 1 --2- 172.21.15.84:0/2824100746 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f223406ec00 0x7f22340710b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f224000b3b0 tx=0x7f2240009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:30:33.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.619+0000 7f2247400700 1 -- 172.21.15.84:0/2824100746 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f223c0573e0 con 0x7f22501044e0 2024-04-26T21:30:33.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:33 smithi084 ceph-mon[90138]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:30:33.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:33 smithi084 ceph-mon[90138]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-26T21:30:33.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:33 smithi084 ceph-mon[90138]: Upgrade: osd.2 is safe to restart 2024-04-26T21:30:33.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:33 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3432055044' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:30:33.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.922+0000 7f2254e00700 1 -- 172.21.15.84:0/2824100746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f225004bed0 con 0x7f22501044e0 2024-04-26T21:30:33.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.922+0000 7f2247400700 1 -- 172.21.15.84:0/2824100746 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f223c05aaa0 con 0x7f22501044e0 2024-04-26T21:30:33.924 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:30:33.924 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:30:33.924 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:30:33.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.925+0000 7f2254e00700 1 -- 172.21.15.84:0/2824100746 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f223406ec00 msgr2=0x7f22340710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:33.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.925+0000 7f2254e00700 1 --2- 172.21.15.84:0/2824100746 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f223406ec00 0x7f22340710b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f224000b3b0 tx=0x7f2240009e30 comp rx=0 tx=0).stop 2024-04-26T21:30:33.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.925+0000 7f2254e00700 1 -- 172.21.15.84:0/2824100746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22501044e0 msgr2=0x7f22501143e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:30:33.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.925+0000 7f2254e00700 1 --2- 172.21.15.84:0/2824100746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22501044e0 0x7f22501143e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f223c002a50 tx=0x7f223c0046b0 comp rx=0 tx=0).stop 2024-04-26T21:30:33.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.925+0000 7f2254e00700 1 -- 172.21.15.84:0/2824100746 shutdown_connections 2024-04-26T21:30:33.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.925+0000 7f2254e00700 1 --2- 172.21.15.84:0/2824100746 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f223406ec00 0x7f22340710b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:33.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.925+0000 7f2254e00700 1 --2- 172.21.15.84:0/2824100746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2250103230 0x7f2250113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:33.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.925+0000 7f2254e00700 1 --2- 172.21.15.84:0/2824100746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22501044e0 0x7f22501143e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:30:33.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.925+0000 7f2254e00700 1 -- 172.21.15.84:0/2824100746 >> 172.21.15.84:0/2824100746 conn(0x7f22500724d0 msgr2=0x7f2250074b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:30:33.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.925+0000 7f2254e00700 1 -- 172.21.15.84:0/2824100746 shutdown_connections 2024-04-26T21:30:33.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:30:33.926+0000 7f2254e00700 1 -- 172.21.15.84:0/2824100746 wait complete. 2024-04-26T21:30:34.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:33 smithi120 ceph-mon[79001]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:30:34.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:33 smithi120 ceph-mon[79001]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-26T21:30:34.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:33 smithi120 ceph-mon[79001]: Upgrade: osd.2 is safe to restart 2024-04-26T21:30:34.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:33 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3432055044' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:30:35.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:34 smithi084 ceph-mon[90138]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:30:35.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:34 smithi084 ceph-mon[90138]: pgmap v109: 65 pgs: 65 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:30:35.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:34 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2824100746' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:30:35.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:34 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:35.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:34 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T21:30:35.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:34 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:30:35.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:34 smithi120 ceph-mon[79001]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:30:35.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:34 smithi120 ceph-mon[79001]: pgmap v109: 65 pgs: 65 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:30:35.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:34 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2824100746' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:30:35.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:34 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:35.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:34 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T21:30:35.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:34 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:30:35.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:35 smithi084 ceph-mon[90138]: Upgrade: Updating osd.2 2024-04-26T21:30:35.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:35 smithi084 ceph-mon[90138]: Deploying daemon osd.2 on smithi084 2024-04-26T21:30:36.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:35 smithi120 ceph-mon[79001]: Upgrade: Updating osd.2 2024-04-26T21:30:36.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:35 smithi120 ceph-mon[79001]: Deploying daemon osd.2 on smithi084 2024-04-26T21:30:37.136 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:36 smithi084 ceph-mon[90138]: pgmap v110: 65 pgs: 65 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:30:37.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:36 smithi120 ceph-mon[79001]: pgmap v110: 65 pgs: 65 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:30:39.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:38 smithi084 ceph-mon[90138]: pgmap v111: 65 pgs: 65 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:30:39.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:38 smithi120 ceph-mon[79001]: pgmap v111: 65 pgs: 65 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:30:39.662 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:39 smithi084 systemd[1]: Stopping Ceph osd.2 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:30:40.075 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:39 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2[58661]: 2024-04-26T21:30:39.659+0000 7f09c4600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:30:40.075 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:39 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2[58661]: 2024-04-26T21:30:39.659+0000 7f09c4600700 -1 osd.2 69 *** Got signal Terminated *** 2024-04-26T21:30:40.075 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:39 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2[58661]: 2024-04-26T21:30:39.659+0000 7f09c4600700 -1 osd.2 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:30:40.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:40.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:40 smithi084 ceph-mon[90138]: osd.2 marked itself down and dead 2024-04-26T21:30:40.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:40.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:40 smithi120 ceph-mon[79001]: osd.2 marked itself down and dead 2024-04-26T21:30:40.912 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:40 smithi084 podman[109675]: 2024-04-26 21:30:40.6472714 +0000 UTC m=+1.110606084 container died 5899468fc5c8ca8606143cd9e71408874c94da51ad41181b2a9d8ad079566275 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, RELEASE=quincy-2be3efa, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-26T21:30:41.338 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:41 smithi084 ceph-mon[90138]: pgmap v112: 65 pgs: 65 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:30:41.338 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:41 smithi084 ceph-mon[90138]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:30:41.339 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:41 smithi084 ceph-mon[90138]: osdmap e70: 6 total, 5 up, 6 in 2024-04-26T21:30:41.339 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:41 smithi084 podman[109675]: 2024-04-26 21:30:41.095128301 +0000 UTC m=+1.558463027 container cleanup 5899468fc5c8ca8606143cd9e71408874c94da51ad41181b2a9d8ad079566275 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=quincy-2be3efa, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2) 2024-04-26T21:30:41.339 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:41 smithi084 bash[109675]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2 2024-04-26T21:30:41.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:41 smithi120 ceph-mon[79001]: pgmap v112: 65 pgs: 65 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:30:41.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:41 smithi120 ceph-mon[79001]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:30:41.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:41 smithi120 ceph-mon[79001]: osdmap e70: 6 total, 5 up, 6 in 2024-04-26T21:30:41.662 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:41 smithi084 podman[109693]: 2024-04-26 21:30:41.337244436 +0000 UTC m=+0.683957431 container remove 5899468fc5c8ca8606143cd9e71408874c94da51ad41181b2a9d8ad079566275 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=quincy-2be3efa, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:30:42.401 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:42 smithi084 ceph-mon[90138]: osdmap e71: 6 total, 5 up, 6 in 2024-04-26T21:30:42.402 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:42 smithi084 ceph-mon[90138]: pgmap v115: 65 pgs: 11 stale+active+clean, 54 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:30:42.402 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:42 smithi084 podman[109779]: 2024-04-26 21:30:42.022300258 +0000 UTC m=+0.032562910 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:30:42.402 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:42 smithi084 podman[109779]: 2024-04-26 21:30:42.146755593 +0000 UTC m=+0.157018271 container create 367122affea95b49eea706ae97f589b1fe848adddde4ed85c3ad6d974edc3347 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-26T21:30:42.402 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:42 smithi084 podman[109779]: 2024-04-26 21:30:42.400749721 +0000 UTC m=+0.411012402 container init 367122affea95b49eea706ae97f589b1fe848adddde4ed85c3ad6d974edc3347 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-26T21:30:42.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:42 smithi120 ceph-mon[79001]: osdmap e71: 6 total, 5 up, 6 in 2024-04-26T21:30:42.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:42 smithi120 ceph-mon[79001]: pgmap v115: 65 pgs: 11 stale+active+clean, 54 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-26T21:30:42.662 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:42 smithi084 podman[109779]: 2024-04-26 21:30:42.412244587 +0000 UTC m=+0.422507266 container start 367122affea95b49eea706ae97f589b1fe848adddde4ed85c3ad6d974edc3347 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True) 2024-04-26T21:30:42.663 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:42 smithi084 podman[109779]: 2024-04-26 21:30:42.482480278 +0000 UTC m=+0.492742943 container attach 367122affea95b49eea706ae97f589b1fe848adddde4ed85c3ad6d974edc3347 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:30:43.162 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:42 smithi084 podman[109779]: 2024-04-26 21:30:42.866738848 +0000 UTC m=+0.877001529 container died 367122affea95b49eea706ae97f589b1fe848adddde4ed85c3ad6d974edc3347 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.build-date=20240424, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:30:43.865 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:43 smithi084 podman[109804]: 2024-04-26 21:30:43.552914653 +0000 UTC m=+0.665206009 container remove 367122affea95b49eea706ae97f589b1fe848adddde4ed85c3ad6d974edc3347 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-26T21:30:43.865 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:43 smithi084 systemd[1]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.2.service: Deactivated successfully. 2024-04-26T21:30:43.865 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:43 smithi084 systemd[1]: Stopped Ceph osd.2 for 8bb44d26-0411-11ef-bc93-c7b262605968. 2024-04-26T21:30:43.865 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:43 smithi084 systemd[1]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.2.service: Consumed 1min 21.619s CPU time. 2024-04-26T21:30:44.162 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:44 smithi084 systemd[1]: Starting Ceph osd.2 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:30:44.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:43 smithi084 ceph-mon[90138]: Health check failed: Degraded data redundancy: 15/363 objects degraded (4.132%), 4 pgs degraded (PG_DEGRADED) 2024-04-26T21:30:44.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:43 smithi120 ceph-mon[79001]: Health check failed: Degraded data redundancy: 15/363 objects degraded (4.132%), 4 pgs degraded (PG_DEGRADED) 2024-04-26T21:30:44.628 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:44 smithi084 podman[109902]: 2024-04-26 21:30:44.271439936 +0000 UTC m=+0.035370787 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:30:44.628 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:44 smithi084 podman[109902]: 2024-04-26 21:30:44.370886988 +0000 UTC m=+0.134817873 container create 608372c0476d910a7152a929f6f92241acb451ce408dd1362cfd90a046091c36 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:30:44.628 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:44 smithi084 podman[109902]: 2024-04-26 21:30:44.616146761 +0000 UTC m=+0.380077650 container init 608372c0476d910a7152a929f6f92241acb451ce408dd1362cfd90a046091c36 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-26T21:30:44.628 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:44 smithi084 podman[109902]: 2024-04-26 21:30:44.627448104 +0000 UTC m=+0.391378982 container start 608372c0476d910a7152a929f6f92241acb451ce408dd1362cfd90a046091c36 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-26T21:30:44.912 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:44 smithi084 podman[109902]: 2024-04-26 21:30:44.748404017 +0000 UTC m=+0.512334873 container attach 608372c0476d910a7152a929f6f92241acb451ce408dd1362cfd90a046091c36 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-activate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-26T21:30:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:45 smithi084 ceph-mon[90138]: pgmap v116: 65 pgs: 4 active+undersized+degraded, 6 stale+active+clean, 8 active+undersized, 47 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 15/363 objects degraded (4.132%) 2024-04-26T21:30:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:30:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:45 smithi120 ceph-mon[79001]: pgmap v116: 65 pgs: 4 active+undersized+degraded, 6 stale+active+clean, 8 active+undersized, 47 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 15/363 objects degraded (4.132%) 2024-04-26T21:30:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:30:45.914 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:45 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-activate[109917]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:30:45.914 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:45 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-activate[109917]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:30:45.914 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:45 smithi084 bash[109902]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:30:45.914 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:45 smithi084 bash[109902]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:30:45.915 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:45 smithi084 bash[109902]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T21:30:45.915 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:45 smithi084 bash[109902]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-26T21:30:45.915 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:45 smithi084 bash[109902]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-26T21:30:45.915 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:45 smithi084 bash[109902]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-26T21:30:45.915 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:45 smithi084 bash[109902]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-26T21:30:45.915 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:45 smithi084 bash[109902]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T21:30:45.915 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:45 smithi084 bash[109902]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-26T21:30:45.915 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:45 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-activate[109917]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T21:30:45.915 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:45 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-activate[109917]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-26T21:30:45.915 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:45 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-activate[109917]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-26T21:30:45.915 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:45 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-activate[109917]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-26T21:30:45.915 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:45 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-activate[109917]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-26T21:30:45.915 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:45 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-activate[109917]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T21:30:45.916 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:45 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-activate[109917]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-26T21:30:45.916 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:45 smithi084 podman[109902]: 2024-04-26 21:30:45.627458825 +0000 UTC m=+1.391389714 container died 608372c0476d910a7152a929f6f92241acb451ce408dd1362cfd90a046091c36 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-26T21:30:46.662 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:46 smithi084 podman[110045]: 2024-04-26 21:30:46.37732298 +0000 UTC m=+0.731371689 container remove 608372c0476d910a7152a929f6f92241acb451ce408dd1362cfd90a046091c36 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-activate, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-26T21:30:47.034 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:46 smithi084 podman[110105]: 2024-04-26 21:30:46.66016061 +0000 UTC m=+0.046765062 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:30:47.034 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:46 smithi084 podman[110105]: 2024-04-26 21:30:46.769839464 +0000 UTC m=+0.156443947 container create 9e77abf095bd1b9857a8df81e8c347e331eea61b18d6b96aa3c190fe865bf1b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD) 2024-04-26T21:30:47.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:47 smithi084 ceph-mon[90138]: pgmap v117: 65 pgs: 13 active+undersized+degraded, 17 active+undersized, 35 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 47/363 objects degraded (12.948%) 2024-04-26T21:30:47.413 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:47 smithi084 podman[110105]: 2024-04-26 21:30:47.032990294 +0000 UTC m=+0.419594803 container init 9e77abf095bd1b9857a8df81e8c347e331eea61b18d6b96aa3c190fe865bf1b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T21:30:47.413 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:47 smithi084 podman[110105]: 2024-04-26 21:30:47.044014471 +0000 UTC m=+0.430618954 container start 9e77abf095bd1b9857a8df81e8c347e331eea61b18d6b96aa3c190fe865bf1b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:30:47.413 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:47 smithi084 ceph-osd[110124]: -- 172.21.15.84:0/1739951142 <== mon.0 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559fe3f55680 con 0x559fe3f1ec00 2024-04-26T21:30:47.413 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:47 smithi084 bash[110105]: 9e77abf095bd1b9857a8df81e8c347e331eea61b18d6b96aa3c190fe865bf1b9 2024-04-26T21:30:47.413 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:47 smithi084 systemd[1]: Started Ceph osd.2 for 8bb44d26-0411-11ef-bc93-c7b262605968. 2024-04-26T21:30:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:47 smithi120 ceph-mon[79001]: pgmap v117: 65 pgs: 13 active+undersized+degraded, 17 active+undersized, 35 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 47/363 objects degraded (12.948%) 2024-04-26T21:30:47.912 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:47 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2[110120]: 2024-04-26T21:30:47.620+0000 7fc2a05477c0 -1 Falling back to public interface 2024-04-26T21:30:48.603 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:48 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:48.603 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:48 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:48.603 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:48 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:30:48.603 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:48 smithi084 ceph-mon[90138]: pgmap v118: 65 pgs: 13 active+undersized+degraded, 17 active+undersized, 35 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 47/363 objects degraded (12.948%) 2024-04-26T21:30:48.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:48 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:48.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:48 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:48.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:48 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:30:48.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:48 smithi120 ceph-mon[79001]: pgmap v118: 65 pgs: 13 active+undersized+degraded, 17 active+undersized, 35 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 47/363 objects degraded (12.948%) 2024-04-26T21:30:51.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:50 smithi084 ceph-mon[90138]: pgmap v119: 65 pgs: 13 active+undersized+degraded, 17 active+undersized, 35 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 47/363 objects degraded (12.948%) 2024-04-26T21:30:51.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:50 smithi120 ceph-mon[79001]: pgmap v119: 65 pgs: 13 active+undersized+degraded, 17 active+undersized, 35 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 47/363 objects degraded (12.948%) 2024-04-26T21:30:52.839 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:52 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2[110120]: 2024-04-26T21:30:52.563+0000 7fc2a05477c0 -1 osd.2 69 log_to_monitors true 2024-04-26T21:30:53.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:52 smithi084 ceph-mon[90138]: pgmap v120: 65 pgs: 13 active+undersized+degraded, 17 active+undersized, 35 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 47/363 objects degraded (12.948%) 2024-04-26T21:30:53.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:52 smithi084 ceph-mon[90138]: Health check update: Degraded data redundancy: 47/363 objects degraded (12.948%), 13 pgs degraded (PG_DEGRADED) 2024-04-26T21:30:53.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:52 smithi084 ceph-mon[90138]: from='osd.2 [v2:172.21.15.84:6818/926975972,v1:172.21.15.84:6819/926975972]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T21:30:53.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:52 smithi120 ceph-mon[79001]: pgmap v120: 65 pgs: 13 active+undersized+degraded, 17 active+undersized, 35 active+clean; 310 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 47/363 objects degraded (12.948%) 2024-04-26T21:30:53.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:52 smithi120 ceph-mon[79001]: Health check update: Degraded data redundancy: 47/363 objects degraded (12.948%), 13 pgs degraded (PG_DEGRADED) 2024-04-26T21:30:53.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:52 smithi120 ceph-mon[79001]: from='osd.2 [v2:172.21.15.84:6818/926975972,v1:172.21.15.84:6819/926975972]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T21:30:54.162 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:30:53 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2[110120]: 2024-04-26T21:30:53.946+0000 7fc28a800700 -1 osd.2 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:30:54.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:53 smithi084 ceph-mon[90138]: from='osd.2 [v2:172.21.15.84:6818/926975972,v1:172.21.15.84:6819/926975972]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T21:30:54.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:53 smithi084 ceph-mon[90138]: osdmap e72: 6 total, 5 up, 6 in 2024-04-26T21:30:54.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:53 smithi084 ceph-mon[90138]: from='osd.2 [v2:172.21.15.84:6818/926975972,v1:172.21.15.84:6819/926975972]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-04-26T21:30:54.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:53 smithi120 ceph-mon[79001]: from='osd.2 [v2:172.21.15.84:6818/926975972,v1:172.21.15.84:6819/926975972]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T21:30:54.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:53 smithi120 ceph-mon[79001]: osdmap e72: 6 total, 5 up, 6 in 2024-04-26T21:30:54.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:53 smithi120 ceph-mon[79001]: from='osd.2 [v2:172.21.15.84:6818/926975972,v1:172.21.15.84:6819/926975972]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-04-26T21:30:55.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:54 smithi084 ceph-mon[90138]: pgmap v122: 65 pgs: 13 active+undersized+degraded, 17 active+undersized, 35 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 47/363 objects degraded (12.948%) 2024-04-26T21:30:55.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:54 smithi084 ceph-mon[90138]: from='osd.2 [v2:172.21.15.84:6818/926975972,v1:172.21.15.84:6819/926975972]' entity='osd.2' 2024-04-26T21:30:55.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:54 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:55.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:54 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:54 smithi120 ceph-mon[79001]: pgmap v122: 65 pgs: 13 active+undersized+degraded, 17 active+undersized, 35 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 47/363 objects degraded (12.948%) 2024-04-26T21:30:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:54 smithi120 ceph-mon[79001]: from='osd.2 [v2:172.21.15.84:6818/926975972,v1:172.21.15.84:6819/926975972]' entity='osd.2' 2024-04-26T21:30:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:54 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:54 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:56.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:55 smithi084 ceph-mon[90138]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:30:56.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:55 smithi084 ceph-mon[90138]: osd.2 [v2:172.21.15.84:6818/926975972,v1:172.21.15.84:6819/926975972] boot 2024-04-26T21:30:56.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:55 smithi084 ceph-mon[90138]: osdmap e73: 6 total, 6 up, 6 in 2024-04-26T21:30:56.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:55 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:30:56.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:55 smithi120 ceph-mon[79001]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:30:56.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:55 smithi120 ceph-mon[79001]: osd.2 [v2:172.21.15.84:6818/926975972,v1:172.21.15.84:6819/926975972] boot 2024-04-26T21:30:56.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:55 smithi120 ceph-mon[79001]: osdmap e73: 6 total, 6 up, 6 in 2024-04-26T21:30:56.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:55 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:30:57.335 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:56 smithi120 ceph-mon[79001]: pgmap v124: 65 pgs: 13 active+undersized+degraded, 17 active+undersized, 35 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 47/363 objects degraded (12.948%) 2024-04-26T21:30:57.335 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:56 smithi120 ceph-mon[79001]: osdmap e74: 6 total, 6 up, 6 in 2024-04-26T21:30:57.335 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:57.335 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:57.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:56 smithi084 ceph-mon[90138]: pgmap v124: 65 pgs: 13 active+undersized+degraded, 17 active+undersized, 35 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 47/363 objects degraded (12.948%) 2024-04-26T21:30:57.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:56 smithi084 ceph-mon[90138]: osdmap e74: 6 total, 6 up, 6 in 2024-04-26T21:30:57.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:57.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:30:59.232 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:30:58 smithi084 ceph-mon[90138]: pgmap v126: 65 pgs: 13 active+undersized+degraded, 17 active+undersized, 35 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 47/363 objects degraded (12.948%) 2024-04-26T21:30:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:30:58 smithi120 ceph-mon[79001]: pgmap v126: 65 pgs: 13 active+undersized+degraded, 17 active+undersized, 35 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 47/363 objects degraded (12.948%) 2024-04-26T21:31:00.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:00 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:00.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:00 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:31:00.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:00 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:00.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:00 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:31:01.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:01 smithi084 ceph-mon[90138]: pgmap v127: 65 pgs: 65 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:01.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:01 smithi084 ceph-mon[90138]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 47/363 objects degraded (12.948%), 13 pgs degraded) 2024-04-26T21:31:01.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:01 smithi120 ceph-mon[79001]: pgmap v127: 65 pgs: 65 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:01.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:01 smithi120 ceph-mon[79001]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 47/363 objects degraded (12.948%), 13 pgs degraded) 2024-04-26T21:31:03.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:03 smithi084 ceph-mon[90138]: pgmap v128: 65 pgs: 65 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:03.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:03 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:03.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:03 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:03.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:03 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:31:03.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:03 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:31:03.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:03 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:03.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:03 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:31:03.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:03 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:31:03.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:03 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:31:03.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:03 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:31:03.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:03 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-26T21:31:03.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:03 smithi120 ceph-mon[79001]: pgmap v128: 65 pgs: 65 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:03.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:03 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:03.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:03 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:03.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:03 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:31:03.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:03 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:31:03.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:03 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:03.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:03 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:31:03.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:03 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:31:03.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:03 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:31:03.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:03 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:31:03.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:03 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-26T21:31:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.096+0000 7faf0ea00700 1 -- 172.21.15.84:0/3305416228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf080fcf10 msgr2=0x7faf080fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:04.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.096+0000 7faf0ea00700 1 --2- 172.21.15.84:0/3305416228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf080fcf10 0x7faf080fd320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faef8004940 tx=0x7faef8009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:04.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.096+0000 7faf0ea00700 1 -- 172.21.15.84:0/3305416228 shutdown_connections 2024-04-26T21:31:04.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.096+0000 7faf0ea00700 1 --2- 172.21.15.84:0/3305416228 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf080fe080 0x7faf080fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:04.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.096+0000 7faf0ea00700 1 --2- 172.21.15.84:0/3305416228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf080fcf10 0x7faf080fd320 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:04.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.096+0000 7faf0ea00700 1 -- 172.21.15.84:0/3305416228 >> 172.21.15.84:0/3305416228 conn(0x7faf080f8560 msgr2=0x7faf080fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:04.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.096+0000 7faf0ea00700 1 -- 172.21.15.84:0/3305416228 shutdown_connections 2024-04-26T21:31:04.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.097+0000 7faf0ea00700 1 -- 172.21.15.84:0/3305416228 wait complete. 2024-04-26T21:31:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.097+0000 7faf0ea00700 1 Processor -- start 2024-04-26T21:31:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.098+0000 7faf0ea00700 1 -- start start 2024-04-26T21:31:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.098+0000 7faf0ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf080fcf10 0x7faf0810fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.098+0000 7faf0ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf080fe080 0x7faf08110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.098+0000 7faf0ea00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf08110740 con 0x7faf080fcf10 2024-04-26T21:31:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.098+0000 7faf0ea00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf08110f90 con 0x7faf080fe080 2024-04-26T21:31:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.098+0000 7faf07e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf080fcf10 0x7faf0810fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.098+0000 7faf07e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf080fcf10 0x7faf0810fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51360/0 (socket says 172.21.15.84:51360) 2024-04-26T21:31:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.098+0000 7faf07e00700 1 -- 172.21.15.84:0/3607376210 learned_addr learned my addr 172.21.15.84:0/3607376210 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:31:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.099+0000 7faf07400700 1 --2- 172.21.15.84:0/3607376210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf080fe080 0x7faf08110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:04.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.099+0000 7faf07e00700 1 -- 172.21.15.84:0/3607376210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf080fe080 msgr2=0x7faf08110140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:04.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.099+0000 7faf07e00700 1 --2- 172.21.15.84:0/3607376210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf080fe080 0x7faf08110140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:04.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.099+0000 7faf07e00700 1 -- 172.21.15.84:0/3607376210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef8005040 con 0x7faf080fcf10 2024-04-26T21:31:04.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.099+0000 7faf07e00700 1 --2- 172.21.15.84:0/3607376210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf080fcf10 0x7faf0810fc00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faef800b3b0 tx=0x7faef8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:04.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.099+0000 7faeffe00700 1 -- 172.21.15.84:0/3607376210 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faef800e040 con 0x7faf080fcf10 2024-04-26T21:31:04.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.099+0000 7faeffe00700 1 -- 172.21.15.84:0/3607376210 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faef800bcc0 con 0x7faf080fcf10 2024-04-26T21:31:04.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.099+0000 7faf0ea00700 1 -- 172.21.15.84:0/3607376210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf08111210 con 0x7faf080fcf10 2024-04-26T21:31:04.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.099+0000 7faeffe00700 1 -- 172.21.15.84:0/3607376210 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faef801c630 con 0x7faf080fcf10 2024-04-26T21:31:04.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.099+0000 7faf0ea00700 1 -- 172.21.15.84:0/3607376210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf08111750 con 0x7faf080fcf10 2024-04-26T21:31:04.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.101+0000 7faf0ea00700 1 -- 172.21.15.84:0/3607376210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf08101a10 con 0x7faf080fcf10 2024-04-26T21:31:04.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.102+0000 7faeffe00700 1 -- 172.21.15.84:0/3607376210 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7faef8013980 con 0x7faf080fcf10 2024-04-26T21:31:04.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.103+0000 7faeffe00700 1 --2- 172.21.15.84:0/3607376210 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7faeec06ec00 0x7faeec0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:04.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.103+0000 7faeffe00700 1 -- 172.21.15.84:0/3607376210 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6585+0+0 (secure 0 0 0) 0x7faef808f680 con 0x7faf080fcf10 2024-04-26T21:31:04.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.103+0000 7faf07400700 1 --2- 172.21.15.84:0/3607376210 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7faeec06ec00 0x7faeec0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:04.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.104+0000 7faf07400700 1 --2- 172.21.15.84:0/3607376210 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7faeec06ec00 0x7faeec0710b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faef40041d0 tx=0x7faef4009040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:04.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.108+0000 7faeffe00700 1 -- 172.21.15.84:0/3607376210 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7faef805be60 con 0x7faf080fcf10 2024-04-26T21:31:04.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.352+0000 7faf0ea00700 1 -- 172.21.15.84:0/3607376210 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faf08111a30 con 0x7faeec06ec00 2024-04-26T21:31:04.353 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:04 smithi084 ceph-mon[90138]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-26T21:31:04.353 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:04 smithi084 ceph-mon[90138]: Upgrade: osd.3 is safe to restart 2024-04-26T21:31:04.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.354+0000 7faeffe00700 1 -- 172.21.15.84:0/3607376210 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7faf08111a30 con 0x7faeec06ec00 2024-04-26T21:31:04.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.357+0000 7faf0ea00700 1 -- 172.21.15.84:0/3607376210 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7faeec06ec00 msgr2=0x7faeec0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:04.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.357+0000 7faf0ea00700 1 --2- 172.21.15.84:0/3607376210 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7faeec06ec00 0x7faeec0710b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faef40041d0 tx=0x7faef4009040 comp rx=0 tx=0).stop 2024-04-26T21:31:04.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.357+0000 7faf0ea00700 1 -- 172.21.15.84:0/3607376210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf080fcf10 msgr2=0x7faf0810fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:04.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.357+0000 7faf0ea00700 1 --2- 172.21.15.84:0/3607376210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf080fcf10 0x7faf0810fc00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faef800b3b0 tx=0x7faef8009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:04.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.357+0000 7faf0ea00700 1 -- 172.21.15.84:0/3607376210 shutdown_connections 2024-04-26T21:31:04.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.357+0000 7faf0ea00700 1 --2- 172.21.15.84:0/3607376210 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7faeec06ec00 0x7faeec0710b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:04.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.357+0000 7faf0ea00700 1 --2- 172.21.15.84:0/3607376210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf080fcf10 0x7faf0810fc00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:04.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.357+0000 7faf0ea00700 1 --2- 172.21.15.84:0/3607376210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf080fe080 0x7faf08110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:04.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.357+0000 7faf0ea00700 1 -- 172.21.15.84:0/3607376210 >> 172.21.15.84:0/3607376210 conn(0x7faf080f8560 msgr2=0x7faf080f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:04.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.357+0000 7faf0ea00700 1 -- 172.21.15.84:0/3607376210 shutdown_connections 2024-04-26T21:31:04.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.357+0000 7faf0ea00700 1 -- 172.21.15.84:0/3607376210 wait complete. 2024-04-26T21:31:04.373 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:31:04.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:04 smithi120 ceph-mon[79001]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-26T21:31:04.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:04 smithi120 ceph-mon[79001]: Upgrade: osd.3 is safe to restart 2024-04-26T21:31:04.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.512+0000 7f5461e00700 1 -- 172.21.15.84:0/1199785137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f545c0fdfd0 msgr2=0x7f545c0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:04.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.512+0000 7f5461e00700 1 --2- 172.21.15.84:0/1199785137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f545c0fdfd0 0x7f545c0fe440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5444004940 tx=0x7f5444009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:04.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.512+0000 7f5461e00700 1 -- 172.21.15.84:0/1199785137 shutdown_connections 2024-04-26T21:31:04.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.512+0000 7f5461e00700 1 --2- 172.21.15.84:0/1199785137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f545c0fdfd0 0x7f545c0fe440 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:04.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.512+0000 7f5461e00700 1 --2- 172.21.15.84:0/1199785137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f545c0fce60 0x7f545c0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:04.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.512+0000 7f5461e00700 1 -- 172.21.15.84:0/1199785137 >> 172.21.15.84:0/1199785137 conn(0x7f545c0f8540 msgr2=0x7f545c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:04.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.513+0000 7f5461e00700 1 -- 172.21.15.84:0/1199785137 shutdown_connections 2024-04-26T21:31:04.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.513+0000 7f5461e00700 1 -- 172.21.15.84:0/1199785137 wait complete. 2024-04-26T21:31:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.514+0000 7f5461e00700 1 Processor -- start 2024-04-26T21:31:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.514+0000 7f5461e00700 1 -- start start 2024-04-26T21:31:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.514+0000 7f5461e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f545c0fce60 0x7f545c10fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.514+0000 7f5461e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f545c0fdfd0 0x7f545c110060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.514+0000 7f5461e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c110660 con 0x7f545c0fce60 2024-04-26T21:31:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.514+0000 7f5461e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c1107d0 con 0x7f545c0fdfd0 2024-04-26T21:31:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.514+0000 7f545aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f545c0fce60 0x7f545c10fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.515+0000 7f545aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f545c0fce60 0x7f545c10fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51376/0 (socket says 172.21.15.84:51376) 2024-04-26T21:31:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.515+0000 7f545aa00700 1 -- 172.21.15.84:0/3594065675 learned_addr learned my addr 172.21.15.84:0/3594065675 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:31:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.515+0000 7f5452000700 1 --2- 172.21.15.84:0/3594065675 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f545c0fdfd0 0x7f545c110060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.515+0000 7f545aa00700 1 -- 172.21.15.84:0/3594065675 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f545c0fdfd0 msgr2=0x7f545c110060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:04.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.515+0000 7f545aa00700 1 --2- 172.21.15.84:0/3594065675 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f545c0fdfd0 0x7f545c110060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:04.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.515+0000 7f545aa00700 1 -- 172.21.15.84:0/3594065675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5444005040 con 0x7f545c0fce60 2024-04-26T21:31:04.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.515+0000 7f5452000700 1 --2- 172.21.15.84:0/3594065675 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f545c0fdfd0 0x7f545c110060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:31:04.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.515+0000 7f545aa00700 1 --2- 172.21.15.84:0/3594065675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f545c0fce60 0x7f545c10fb20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f544c00c830 tx=0x7f544c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:04.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.516+0000 7f5453400700 1 -- 172.21.15.84:0/3594065675 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f544c00a760 con 0x7f545c0fce60 2024-04-26T21:31:04.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.516+0000 7f5453400700 1 -- 172.21.15.84:0/3594065675 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f544c00ad90 con 0x7f545c0fce60 2024-04-26T21:31:04.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.516+0000 7f5453400700 1 -- 172.21.15.84:0/3594065675 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f544c0113a0 con 0x7f545c0fce60 2024-04-26T21:31:04.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.516+0000 7f5461e00700 1 -- 172.21.15.84:0/3594065675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f545c115230 con 0x7f545c0fce60 2024-04-26T21:31:04.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.516+0000 7f5461e00700 1 -- 172.21.15.84:0/3594065675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545c1157f0 con 0x7f545c0fce60 2024-04-26T21:31:04.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.517+0000 7f5461e00700 1 -- 172.21.15.84:0/3594065675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f545c101960 con 0x7f545c0fce60 2024-04-26T21:31:04.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.518+0000 7f5453400700 1 -- 172.21.15.84:0/3594065675 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f544c012400 con 0x7f545c0fce60 2024-04-26T21:31:04.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.519+0000 7f5453400700 1 --2- 172.21.15.84:0/3594065675 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f544006ec00 0x7f54400710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:04.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.519+0000 7f5453400700 1 -- 172.21.15.84:0/3594065675 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f544c08e910 con 0x7f545c0fce60 2024-04-26T21:31:04.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.519+0000 7f5452000700 1 --2- 172.21.15.84:0/3594065675 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f544006ec00 0x7f54400710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:04.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.520+0000 7f5452000700 1 --2- 172.21.15.84:0/3594065675 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f544006ec00 0x7f54400710b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f544400b7a0 tx=0x7f5444009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:04.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.524+0000 7f5453400700 1 -- 172.21.15.84:0/3594065675 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f544c05b1f0 con 0x7f545c0fce60 2024-04-26T21:31:04.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.771+0000 7f5461e00700 1 -- 172.21.15.84:0/3594065675 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f545c02b410 con 0x7f544006ec00 2024-04-26T21:31:04.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.773+0000 7f5453400700 1 -- 172.21.15.84:0/3594065675 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f545c02b410 con 0x7f544006ec00 2024-04-26T21:31:04.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.776+0000 7f5461e00700 1 -- 172.21.15.84:0/3594065675 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f544006ec00 msgr2=0x7f54400710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:04.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.776+0000 7f5461e00700 1 --2- 172.21.15.84:0/3594065675 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f544006ec00 0x7f54400710b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f544400b7a0 tx=0x7f5444009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:04.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.776+0000 7f5461e00700 1 -- 172.21.15.84:0/3594065675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f545c0fce60 msgr2=0x7f545c10fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:04.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.776+0000 7f5461e00700 1 --2- 172.21.15.84:0/3594065675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f545c0fce60 0x7f545c10fb20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f544c00c830 tx=0x7f544c004470 comp rx=0 tx=0).stop 2024-04-26T21:31:04.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.776+0000 7f5461e00700 1 -- 172.21.15.84:0/3594065675 shutdown_connections 2024-04-26T21:31:04.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.776+0000 7f5461e00700 1 --2- 172.21.15.84:0/3594065675 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f544006ec00 0x7f54400710b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:04.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.776+0000 7f5461e00700 1 --2- 172.21.15.84:0/3594065675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f545c0fce60 0x7f545c10fb20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:04.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.776+0000 7f5461e00700 1 --2- 172.21.15.84:0/3594065675 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f545c0fdfd0 0x7f545c110060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:04.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.776+0000 7f5461e00700 1 -- 172.21.15.84:0/3594065675 >> 172.21.15.84:0/3594065675 conn(0x7f545c0f8540 msgr2=0x7f545c0f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:04.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.776+0000 7f5461e00700 1 -- 172.21.15.84:0/3594065675 shutdown_connections 2024-04-26T21:31:04.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.777+0000 7f5461e00700 1 -- 172.21.15.84:0/3594065675 wait complete. 2024-04-26T21:31:04.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.917+0000 7fa3e0200700 1 -- 172.21.15.84:0/1248875838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3d80fefc0 msgr2=0x7fa3d80ff3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:04.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.917+0000 7fa3e0200700 1 --2- 172.21.15.84:0/1248875838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3d80fefc0 0x7fa3d80ff3d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc004940 tx=0x7fa3cc009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:04.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.918+0000 7fa3e0200700 1 -- 172.21.15.84:0/1248875838 shutdown_connections 2024-04-26T21:31:04.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.918+0000 7fa3e0200700 1 --2- 172.21.15.84:0/1248875838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3d8100270 0x7fa3d81006e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:04.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.918+0000 7fa3e0200700 1 --2- 172.21.15.84:0/1248875838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3d80fefc0 0x7fa3d80ff3d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:04.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.918+0000 7fa3e0200700 1 -- 172.21.15.84:0/1248875838 >> 172.21.15.84:0/1248875838 conn(0x7fa3d80fa8f0 msgr2=0x7fa3d80fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:04.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.918+0000 7fa3e0200700 1 -- 172.21.15.84:0/1248875838 shutdown_connections 2024-04-26T21:31:04.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.918+0000 7fa3e0200700 1 -- 172.21.15.84:0/1248875838 wait complete. 2024-04-26T21:31:04.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.918+0000 7fa3e0200700 1 Processor -- start 2024-04-26T21:31:04.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.919+0000 7fa3e0200700 1 -- start start 2024-04-26T21:31:04.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.919+0000 7fa3e0200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3d80fefc0 0x7fa3d810fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:04.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.919+0000 7fa3e0200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3d8100270 0x7fa3d8110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:04.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.919+0000 7fa3e0200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d8110640 con 0x7fa3d80fefc0 2024-04-26T21:31:04.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.919+0000 7fa3e0200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d81107b0 con 0x7fa3d8100270 2024-04-26T21:31:04.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.919+0000 7fa3dd800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3d80fefc0 0x7fa3d810fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:04.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.919+0000 7fa3dd800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3d80fefc0 0x7fa3d810fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51392/0 (socket says 172.21.15.84:51392) 2024-04-26T21:31:04.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.919+0000 7fa3dd800700 1 -- 172.21.15.84:0/1378520385 learned_addr learned my addr 172.21.15.84:0/1378520385 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:31:04.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.919+0000 7fa3dce00700 1 --2- 172.21.15.84:0/1378520385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3d8100270 0x7fa3d8110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:04.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.920+0000 7fa3dd800700 1 -- 172.21.15.84:0/1378520385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3d8100270 msgr2=0x7fa3d8110040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:04.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.920+0000 7fa3dd800700 1 --2- 172.21.15.84:0/1378520385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3d8100270 0x7fa3d8110040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:04.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.920+0000 7fa3dd800700 1 -- 172.21.15.84:0/1378520385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc005040 con 0x7fa3d80fefc0 2024-04-26T21:31:04.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.920+0000 7fa3dd800700 1 --2- 172.21.15.84:0/1378520385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3d80fefc0 0x7fa3d810fb00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00b3b0 tx=0x7fa3cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:04.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.920+0000 7fa3d5600700 1 -- 172.21.15.84:0/1378520385 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3cc00e040 con 0x7fa3d80fefc0 2024-04-26T21:31:04.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.920+0000 7fa3d5600700 1 -- 172.21.15.84:0/1378520385 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3cc004290 con 0x7fa3d80fefc0 2024-04-26T21:31:04.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.920+0000 7fa3e0200700 1 -- 172.21.15.84:0/1378520385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d81151b0 con 0x7fa3d80fefc0 2024-04-26T21:31:04.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.920+0000 7fa3d5600700 1 -- 172.21.15.84:0/1378520385 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3cc01c630 con 0x7fa3d80fefc0 2024-04-26T21:31:04.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.920+0000 7fa3e0200700 1 -- 172.21.15.84:0/1378520385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d8115770 con 0x7fa3d80fefc0 2024-04-26T21:31:04.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.921+0000 7fa3e0200700 1 -- 172.21.15.84:0/1378520385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d804c710 con 0x7fa3d80fefc0 2024-04-26T21:31:04.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.922+0000 7fa3d5600700 1 -- 172.21.15.84:0/1378520385 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa3cc00bbf0 con 0x7fa3d80fefc0 2024-04-26T21:31:04.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.923+0000 7fa3d5600700 1 --2- 172.21.15.84:0/1378520385 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa3c006ec00 0x7fa3c00710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:04.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.923+0000 7fa3d5600700 1 -- 172.21.15.84:0/1378520385 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fa3cc08fda0 con 0x7fa3d80fefc0 2024-04-26T21:31:04.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.924+0000 7fa3dce00700 1 --2- 172.21.15.84:0/1378520385 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa3c006ec00 0x7fa3c00710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:04.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.924+0000 7fa3dce00700 1 --2- 172.21.15.84:0/1378520385 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa3c006ec00 0x7fa3c00710b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4004990 tx=0x7fa3c4009ee0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:04.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:04.928+0000 7fa3d5600700 1 -- 172.21.15.84:0/1378520385 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fa3cc05c600 con 0x7fa3d80fefc0 2024-04-26T21:31:05.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.170+0000 7fa3e0200700 1 -- 172.21.15.84:0/1378520385 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3d81045e0 con 0x7fa3c006ec00 2024-04-26T21:31:05.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.198+0000 7fa3d5600700 1 -- 172.21.15.84:0/1378520385 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fa3d81045e0 con 0x7fa3c006ec00 2024-04-26T21:31:05.199 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:31:05.199 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (5m) 10s ago 16m 14.5M - 0.25.0 c8568f914cd2 bcb419cf9108 2024-04-26T21:31:05.199 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (115s) 10s ago 17m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 b4010dfbe623 2024-04-26T21:31:05.199 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (108s) 102s ago 15m 6665k - 19.0.0-3306-gbc612ffb 55dc54019ad8 89a4e50ea23c 2024-04-26T21:31:05.199 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (5m) 10s ago 16m 76.4M - 9.4.7 954c08fa6188 1bf95f604e07 2024-04-26T21:31:05.199 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (9m) 10s ago 9m 114M - 17.2.7-907-g2be3efa9 1c5834633715 485d7884e1d5 2024-04-26T21:31:05.199 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (9m) 10s ago 9m 14.3M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:31:05.199 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (9m) 102s ago 9m 113M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:31:05.199 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (9m) 102s ago 9m 13.8M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:31:05.199 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (5m) 10s ago 18m 505M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:31:05.199 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283,8765 running (4m) 102s ago 15m 452M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d6ae0b4628b5 2024-04-26T21:31:05.199 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (3m) 10s ago 18m 43.8M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 bf610abb6a62 2024-04-26T21:31:05.199 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (2m) 102s ago 15m 33.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 5d530496253b 2024-04-26T21:31:05.200 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (6m) 10s ago 16m 8010k - 1.5.0 0da6a335fe13 81e00b40bfbf 2024-04-26T21:31:05.200 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (5m) 102s ago 15m 7810k - 1.5.0 0da6a335fe13 0506a1d46ec4 2024-04-26T21:31:05.200 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (78s) 10s ago 14m 124M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 99fbe2faa51b 2024-04-26T21:31:05.200 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (48s) 10s ago 13m 84.9M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 2dc81d93f7e5 2024-04-26T21:31:05.200 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (18s) 10s ago 13m 11.2M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 9e77abf095bd 2024-04-26T21:31:05.200 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (12m) 102s ago 12m 230M 2581M 17.2.7-907-g2be3efa9 1c5834633715 b8a14c87d730 2024-04-26T21:31:05.200 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (12m) 102s ago 12m 216M 2581M 17.2.7-907-g2be3efa9 1c5834633715 4d294df735a3 2024-04-26T21:31:05.200 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (11m) 102s ago 11m 201M 2581M 17.2.7-907-g2be3efa9 1c5834633715 9b60997971a8 2024-04-26T21:31:05.200 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (4m) 10s ago 16m 56.2M - 2.43.0 a07b618ecd1d d3008b765eec 2024-04-26T21:31:05.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.201+0000 7fa3e0200700 1 -- 172.21.15.84:0/1378520385 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa3c006ec00 msgr2=0x7fa3c00710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:05.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.201+0000 7fa3e0200700 1 --2- 172.21.15.84:0/1378520385 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa3c006ec00 0x7fa3c00710b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4004990 tx=0x7fa3c4009ee0 comp rx=0 tx=0).stop 2024-04-26T21:31:05.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.201+0000 7fa3e0200700 1 -- 172.21.15.84:0/1378520385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3d80fefc0 msgr2=0x7fa3d810fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:05.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.201+0000 7fa3e0200700 1 --2- 172.21.15.84:0/1378520385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3d80fefc0 0x7fa3d810fb00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00b3b0 tx=0x7fa3cc009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:05.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.201+0000 7fa3e0200700 1 -- 172.21.15.84:0/1378520385 shutdown_connections 2024-04-26T21:31:05.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.201+0000 7fa3e0200700 1 --2- 172.21.15.84:0/1378520385 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa3c006ec00 0x7fa3c00710b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:05.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.201+0000 7fa3e0200700 1 --2- 172.21.15.84:0/1378520385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3d80fefc0 0x7fa3d810fb00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:05.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.201+0000 7fa3e0200700 1 --2- 172.21.15.84:0/1378520385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3d8100270 0x7fa3d8110040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:05.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.201+0000 7fa3e0200700 1 -- 172.21.15.84:0/1378520385 >> 172.21.15.84:0/1378520385 conn(0x7fa3d80fa8f0 msgr2=0x7fa3d80fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:05.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.201+0000 7fa3e0200700 1 -- 172.21.15.84:0/1378520385 shutdown_connections 2024-04-26T21:31:05.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.201+0000 7fa3e0200700 1 -- 172.21.15.84:0/1378520385 wait complete. 2024-04-26T21:31:05.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.352+0000 7fea35600700 1 -- 172.21.15.84:0/293642134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea301046a0 msgr2=0x7fea30104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:05.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.352+0000 7fea35600700 1 --2- 172.21.15.84:0/293642134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea301046a0 0x7fea30104b10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fea1c004940 tx=0x7fea1c009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:05.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.353+0000 7fea35600700 1 -- 172.21.15.84:0/293642134 shutdown_connections 2024-04-26T21:31:05.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.353+0000 7fea35600700 1 --2- 172.21.15.84:0/293642134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea301046a0 0x7fea30104b10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:05.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.353+0000 7fea35600700 1 --2- 172.21.15.84:0/293642134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea301033f0 0x7fea30103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:05.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.353+0000 7fea35600700 1 -- 172.21.15.84:0/293642134 >> 172.21.15.84:0/293642134 conn(0x7fea300725e0 msgr2=0x7fea30074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:05.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.353+0000 7fea35600700 1 -- 172.21.15.84:0/293642134 shutdown_connections 2024-04-26T21:31:05.355 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:05 smithi084 ceph-mon[90138]: pgmap v129: 65 pgs: 65 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:05.355 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:05 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:05.355 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:05 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T21:31:05.355 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:05 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:31:05.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.353+0000 7fea35600700 1 -- 172.21.15.84:0/293642134 wait complete. 2024-04-26T21:31:05.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.354+0000 7fea35600700 1 Processor -- start 2024-04-26T21:31:05.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.354+0000 7fea35600700 1 -- start start 2024-04-26T21:31:05.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.354+0000 7fea35600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea301033f0 0x7fea30113ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:05.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.354+0000 7fea35600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea301046a0 0x7fea30114430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:05.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.354+0000 7fea35600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea30114a30 con 0x7fea301046a0 2024-04-26T21:31:05.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.354+0000 7fea35600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea30114ba0 con 0x7fea301033f0 2024-04-26T21:31:05.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.355+0000 7fea2e000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea301046a0 0x7fea30114430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:05.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.355+0000 7fea2e000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea301046a0 0x7fea30114430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51402/0 (socket says 172.21.15.84:51402) 2024-04-26T21:31:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.355+0000 7fea2e000700 1 -- 172.21.15.84:0/3254515333 learned_addr learned my addr 172.21.15.84:0/3254515333 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:31:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.355+0000 7fea2ea00700 1 --2- 172.21.15.84:0/3254515333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea301033f0 0x7fea30113ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.355+0000 7fea2e000700 1 -- 172.21.15.84:0/3254515333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea301033f0 msgr2=0x7fea30113ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.355+0000 7fea2e000700 1 --2- 172.21.15.84:0/3254515333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea301033f0 0x7fea30113ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.355+0000 7fea2e000700 1 -- 172.21.15.84:0/3254515333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c005040 con 0x7fea301046a0 2024-04-26T21:31:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.355+0000 7fea2e000700 1 --2- 172.21.15.84:0/3254515333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea301046a0 0x7fea30114430 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009150 tx=0x7fea1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.356+0000 7fea26a00700 1 -- 172.21.15.84:0/3254515333 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea1c00e040 con 0x7fea301046a0 2024-04-26T21:31:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.356+0000 7fea26a00700 1 -- 172.21.15.84:0/3254515333 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea1c00bcc0 con 0x7fea301046a0 2024-04-26T21:31:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.356+0000 7fea35600700 1 -- 172.21.15.84:0/3254515333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea301195a0 con 0x7fea301046a0 2024-04-26T21:31:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.356+0000 7fea26a00700 1 -- 172.21.15.84:0/3254515333 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea1c01c630 con 0x7fea301046a0 2024-04-26T21:31:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.356+0000 7fea35600700 1 -- 172.21.15.84:0/3254515333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea30119b60 con 0x7fea301046a0 2024-04-26T21:31:05.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.357+0000 7fea35600700 1 -- 172.21.15.84:0/3254515333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3004c710 con 0x7fea301046a0 2024-04-26T21:31:05.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.358+0000 7fea26a00700 1 -- 172.21.15.84:0/3254515333 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fea1c013420 con 0x7fea301046a0 2024-04-26T21:31:05.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.359+0000 7fea26a00700 1 --2- 172.21.15.84:0/3254515333 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fea1406ec00 0x7fea140710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:05.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.359+0000 7fea26a00700 1 -- 172.21.15.84:0/3254515333 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fea1c08f590 con 0x7fea301046a0 2024-04-26T21:31:05.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.359+0000 7fea2ea00700 1 --2- 172.21.15.84:0/3254515333 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fea1406ec00 0x7fea140710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:05.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.360+0000 7fea2ea00700 1 --2- 172.21.15.84:0/3254515333 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fea1406ec00 0x7fea140710b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fea20004990 tx=0x7fea20009ee0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:05.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.364+0000 7fea26a00700 1 -- 172.21.15.84:0/3254515333 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fea1c05be90 con 0x7fea301046a0 2024-04-26T21:31:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:05 smithi120 ceph-mon[79001]: pgmap v129: 65 pgs: 65 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:05 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:05 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T21:31:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:05 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:31:05.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.678+0000 7fea35600700 1 -- 172.21.15.84:0/3254515333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fea30119f10 con 0x7fea301046a0 2024-04-26T21:31:05.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.679+0000 7fea26a00700 1 -- 172.21.15.84:0/3254515333 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fea1c05ba20 con 0x7fea301046a0 2024-04-26T21:31:05.680 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:31:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:31:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:31:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:31:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:31:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:31:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:31:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:31:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 3, 2024-04-26T21:31:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 3 2024-04-26T21:31:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:31:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:31:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-26T21:31:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:31:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:31:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 7, 2024-04-26T21:31:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 7 2024-04-26T21:31:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:31:05.682 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:31:05.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.682+0000 7fea35600700 1 -- 172.21.15.84:0/3254515333 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fea1406ec00 msgr2=0x7fea140710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:05.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.682+0000 7fea35600700 1 --2- 172.21.15.84:0/3254515333 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fea1406ec00 0x7fea140710b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fea20004990 tx=0x7fea20009ee0 comp rx=0 tx=0).stop 2024-04-26T21:31:05.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.682+0000 7fea35600700 1 -- 172.21.15.84:0/3254515333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea301046a0 msgr2=0x7fea30114430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:05.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.682+0000 7fea35600700 1 --2- 172.21.15.84:0/3254515333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea301046a0 0x7fea30114430 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009150 tx=0x7fea1c009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:05.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.682+0000 7fea35600700 1 -- 172.21.15.84:0/3254515333 shutdown_connections 2024-04-26T21:31:05.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.682+0000 7fea35600700 1 --2- 172.21.15.84:0/3254515333 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fea1406ec00 0x7fea140710b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:05.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.682+0000 7fea35600700 1 --2- 172.21.15.84:0/3254515333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea301033f0 0x7fea30113ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:05.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.682+0000 7fea35600700 1 --2- 172.21.15.84:0/3254515333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea301046a0 0x7fea30114430 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:05.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.682+0000 7fea35600700 1 -- 172.21.15.84:0/3254515333 >> 172.21.15.84:0/3254515333 conn(0x7fea300725e0 msgr2=0x7fea30073c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:05.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.683+0000 7fea35600700 1 -- 172.21.15.84:0/3254515333 shutdown_connections 2024-04-26T21:31:05.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.683+0000 7fea35600700 1 -- 172.21.15.84:0/3254515333 wait complete. 2024-04-26T21:31:05.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.830+0000 7ffbdce00700 1 -- 172.21.15.84:0/2449002151 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbd80ffee0 msgr2=0x7ffbd8102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:05.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.830+0000 7ffbdce00700 1 --2- 172.21.15.84:0/2449002151 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbd80ffee0 0x7ffbd8102300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4004940 tx=0x7ffbc4009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:05.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.830+0000 7ffbdce00700 1 -- 172.21.15.84:0/2449002151 shutdown_connections 2024-04-26T21:31:05.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.830+0000 7ffbdce00700 1 --2- 172.21.15.84:0/2449002151 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbd80ffee0 0x7ffbd8102300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:05.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.830+0000 7ffbdce00700 1 --2- 172.21.15.84:0/2449002151 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbd8066b50 0x7ffbd80ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:05.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.830+0000 7ffbdce00700 1 -- 172.21.15.84:0/2449002151 >> 172.21.15.84:0/2449002151 conn(0x7ffbd80f73f0 msgr2=0x7ffbd80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:05.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.831+0000 7ffbdce00700 1 -- 172.21.15.84:0/2449002151 shutdown_connections 2024-04-26T21:31:05.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.831+0000 7ffbdce00700 1 -- 172.21.15.84:0/2449002151 wait complete. 2024-04-26T21:31:05.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.831+0000 7ffbdce00700 1 Processor -- start 2024-04-26T21:31:05.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.832+0000 7ffbdce00700 1 -- start start 2024-04-26T21:31:05.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.832+0000 7ffbdce00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbd8066b50 0x7ffbd810fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:05.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.832+0000 7ffbdce00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbd80ffee0 0x7ffbd8110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:05.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.832+0000 7ffbdce00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8110870 con 0x7ffbd8066b50 2024-04-26T21:31:05.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.832+0000 7ffbdce00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8110fb0 con 0x7ffbd80ffee0 2024-04-26T21:31:05.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.832+0000 7ffbd5e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbd8066b50 0x7ffbd810fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:05.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.832+0000 7ffbd5e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbd8066b50 0x7ffbd810fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51426/0 (socket says 172.21.15.84:51426) 2024-04-26T21:31:05.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.832+0000 7ffbd5e00700 1 -- 172.21.15.84:0/3879710955 learned_addr learned my addr 172.21.15.84:0/3879710955 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:31:05.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.832+0000 7ffbd5400700 1 --2- 172.21.15.84:0/3879710955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbd80ffee0 0x7ffbd8110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:05.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.833+0000 7ffbd5e00700 1 -- 172.21.15.84:0/3879710955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbd80ffee0 msgr2=0x7ffbd8110270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:05.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.833+0000 7ffbd5e00700 1 --2- 172.21.15.84:0/3879710955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbd80ffee0 0x7ffbd8110270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:05.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.833+0000 7ffbd5e00700 1 -- 172.21.15.84:0/3879710955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc4005040 con 0x7ffbd8066b50 2024-04-26T21:31:05.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.833+0000 7ffbd5e00700 1 --2- 172.21.15.84:0/3879710955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbd8066b50 0x7ffbd810fd30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8002a50 tx=0x7ffbc8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:05.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.833+0000 7ffbce000700 1 -- 172.21.15.84:0/3879710955 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbc8007cc0 con 0x7ffbd8066b50 2024-04-26T21:31:05.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.833+0000 7ffbce000700 1 -- 172.21.15.84:0/3879710955 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffbc800f040 con 0x7ffbd8066b50 2024-04-26T21:31:05.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.833+0000 7ffbdce00700 1 -- 172.21.15.84:0/3879710955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd8111290 con 0x7ffbd8066b50 2024-04-26T21:31:05.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.833+0000 7ffbce000700 1 -- 172.21.15.84:0/3879710955 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbc800daf0 con 0x7ffbd8066b50 2024-04-26T21:31:05.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.833+0000 7ffbdce00700 1 -- 172.21.15.84:0/3879710955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd8111850 con 0x7ffbd8066b50 2024-04-26T21:31:05.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.834+0000 7ffbdce00700 1 -- 172.21.15.84:0/3879710955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd80f8f90 con 0x7ffbd8066b50 2024-04-26T21:31:05.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.835+0000 7ffbce000700 1 -- 172.21.15.84:0/3879710955 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ffbc8009070 con 0x7ffbd8066b50 2024-04-26T21:31:05.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.836+0000 7ffbce000700 1 --2- 172.21.15.84:0/3879710955 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ffbbc06ec10 0x7ffbbc0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:05.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.836+0000 7ffbce000700 1 -- 172.21.15.84:0/3879710955 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6585+0+0 (secure 0 0 0) 0x7ffbc808e730 con 0x7ffbd8066b50 2024-04-26T21:31:05.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.837+0000 7ffbd5400700 1 --2- 172.21.15.84:0/3879710955 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ffbbc06ec10 0x7ffbbc0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:05.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.837+0000 7ffbd5400700 1 --2- 172.21.15.84:0/3879710955 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ffbbc06ec10 0x7ffbbc0710c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4004f90 tx=0x7ffbc4009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:05.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:05.841+0000 7ffbce000700 1 -- 172.21.15.84:0/3879710955 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7ffbc805af10 con 0x7ffbd8066b50 2024-04-26T21:31:06.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.095+0000 7ffbdce00700 1 -- 172.21.15.84:0/3879710955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffbd81059d0 con 0x7ffbd8066b50 2024-04-26T21:31:06.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.096+0000 7ffbce000700 1 -- 172.21.15.84:0/3879710955 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1903 (secure 0 0 0) 0x7ffbc805aaa0 con 0x7ffbd8066b50 2024-04-26T21:31:06.097 INFO:teuthology.orchestra.run.smithi084.stdout:e17 2024-04-26T21:31:06.097 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:31:06.097 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:31:06.097 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:31:06.097 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:31:06.097 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:31:06.097 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:31:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 17 2024-04-26T21:31:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:31:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:31:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:30:28.772328+0000 2024-04-26T21:31:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:31:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:31:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:31:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:31:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:31:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-04-26T21:31:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:31:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:31:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:31:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:31:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:31:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:31:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456,1=24231} 2024-04-26T21:31:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:31:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:31:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:31:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:31:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:31:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:31:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:31:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-04-26T21:31:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:31:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 14456 members: 24231,14456 2024-04-26T21:31:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:31:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:31:06.100 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:31:06.100 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:31:06.100 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:31:06.100 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:31:06.100 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:31:06.100 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:31:06.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.099+0000 7ffbdce00700 1 -- 172.21.15.84:0/3879710955 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ffbbc06ec10 msgr2=0x7ffbbc0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:06.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.099+0000 7ffbdce00700 1 --2- 172.21.15.84:0/3879710955 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ffbbc06ec10 0x7ffbbc0710c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4004f90 tx=0x7ffbc4009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:06.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.099+0000 7ffbdce00700 1 -- 172.21.15.84:0/3879710955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbd8066b50 msgr2=0x7ffbd810fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:06.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.099+0000 7ffbdce00700 1 --2- 172.21.15.84:0/3879710955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbd8066b50 0x7ffbd810fd30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8002a50 tx=0x7ffbc8004600 comp rx=0 tx=0).stop 2024-04-26T21:31:06.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.099+0000 7ffbdce00700 1 -- 172.21.15.84:0/3879710955 shutdown_connections 2024-04-26T21:31:06.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.099+0000 7ffbdce00700 1 --2- 172.21.15.84:0/3879710955 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ffbbc06ec10 0x7ffbbc0710c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:06.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.099+0000 7ffbdce00700 1 --2- 172.21.15.84:0/3879710955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbd8066b50 0x7ffbd810fd30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:06.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.099+0000 7ffbdce00700 1 --2- 172.21.15.84:0/3879710955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffbd80ffee0 0x7ffbd8110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:06.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.099+0000 7ffbdce00700 1 -- 172.21.15.84:0/3879710955 >> 172.21.15.84:0/3879710955 conn(0x7ffbd80f73f0 msgr2=0x7ffbd80fbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:06.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.099+0000 7ffbdce00700 1 -- 172.21.15.84:0/3879710955 shutdown_connections 2024-04-26T21:31:06.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.099+0000 7ffbdce00700 1 -- 172.21.15.84:0/3879710955 wait complete. 2024-04-26T21:31:06.102 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2024-04-26T21:31:06.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.249+0000 7f224a600700 1 -- 172.21.15.84:0/1349202732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22440fcf10 msgr2=0x7f22440fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:06.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.249+0000 7f224a600700 1 --2- 172.21.15.84:0/1349202732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22440fcf10 0x7f22440fd320 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2234004940 tx=0x7f2234009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:06.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.249+0000 7f224a600700 1 -- 172.21.15.84:0/1349202732 shutdown_connections 2024-04-26T21:31:06.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.249+0000 7f224a600700 1 --2- 172.21.15.84:0/1349202732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22440fe080 0x7f22440fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:06.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.249+0000 7f224a600700 1 --2- 172.21.15.84:0/1349202732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22440fcf10 0x7f22440fd320 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:06.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.249+0000 7f224a600700 1 -- 172.21.15.84:0/1349202732 >> 172.21.15.84:0/1349202732 conn(0x7f22440f8560 msgr2=0x7f22440fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:06.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.249+0000 7f224a600700 1 -- 172.21.15.84:0/1349202732 shutdown_connections 2024-04-26T21:31:06.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.249+0000 7f224a600700 1 -- 172.21.15.84:0/1349202732 wait complete. 2024-04-26T21:31:06.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.250+0000 7f224a600700 1 Processor -- start 2024-04-26T21:31:06.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.251+0000 7f224a600700 1 -- start start 2024-04-26T21:31:06.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.251+0000 7f224a600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22440fcf10 0x7f224410fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:06.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.251+0000 7f224a600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22440fe080 0x7f2244110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:06.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.251+0000 7f224a600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2244110740 con 0x7f22440fe080 2024-04-26T21:31:06.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.251+0000 7f224a600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2244110f90 con 0x7f22440fcf10 2024-04-26T21:31:06.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.251+0000 7f2242a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22440fe080 0x7f2244110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:06.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.251+0000 7f2242a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22440fe080 0x7f2244110140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51446/0 (socket says 172.21.15.84:51446) 2024-04-26T21:31:06.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.251+0000 7f2242a00700 1 -- 172.21.15.84:0/3236731736 learned_addr learned my addr 172.21.15.84:0/3236731736 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:31:06.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.251+0000 7f2242a00700 1 -- 172.21.15.84:0/3236731736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22440fcf10 msgr2=0x7f224410fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:06.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.251+0000 7f2243400700 1 --2- 172.21.15.84:0/3236731736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22440fcf10 0x7f224410fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:06.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.252+0000 7f2242a00700 1 --2- 172.21.15.84:0/3236731736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22440fcf10 0x7f224410fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:06.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.252+0000 7f2242a00700 1 -- 172.21.15.84:0/3236731736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2234005040 con 0x7f22440fe080 2024-04-26T21:31:06.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.252+0000 7f2243400700 1 --2- 172.21.15.84:0/3236731736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22440fcf10 0x7f224410fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:31:06.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.252+0000 7f2242a00700 1 --2- 172.21.15.84:0/3236731736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22440fe080 0x7f2244110140 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2230002a50 tx=0x7f22300046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:06.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.252+0000 7f223b400700 1 -- 172.21.15.84:0/3236731736 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2230007cc0 con 0x7f22440fe080 2024-04-26T21:31:06.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.252+0000 7f223b400700 1 -- 172.21.15.84:0/3236731736 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f223000f040 con 0x7f22440fe080 2024-04-26T21:31:06.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.252+0000 7f223b400700 1 -- 172.21.15.84:0/3236731736 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2230009640 con 0x7f22440fe080 2024-04-26T21:31:06.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.252+0000 7f224a600700 1 -- 172.21.15.84:0/3236731736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2244111270 con 0x7f22440fe080 2024-04-26T21:31:06.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.252+0000 7f224a600700 1 -- 172.21.15.84:0/3236731736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22441117b0 con 0x7f22440fe080 2024-04-26T21:31:06.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.253+0000 7f224a600700 1 -- 172.21.15.84:0/3236731736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2244101a10 con 0x7f22440fe080 2024-04-26T21:31:06.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.255+0000 7f223b400700 1 -- 172.21.15.84:0/3236731736 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f22300097a0 con 0x7f22440fe080 2024-04-26T21:31:06.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.255+0000 7f223b400700 1 --2- 172.21.15.84:0/3236731736 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f222806ec10 0x7f22280710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:06.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.256+0000 7f223b400700 1 -- 172.21.15.84:0/3236731736 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f223008e410 con 0x7f22440fe080 2024-04-26T21:31:06.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.256+0000 7f2243400700 1 --2- 172.21.15.84:0/3236731736 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f222806ec10 0x7f22280710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:06.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.256+0000 7f2243400700 1 --2- 172.21.15.84:0/3236731736 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f222806ec10 0x7f22280710c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f223400b7a0 tx=0x7f2234009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:06.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.260+0000 7f223b400700 1 -- 172.21.15.84:0/3236731736 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f223005ac70 con 0x7f22440fe080 2024-04-26T21:31:06.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:06 smithi084 ceph-mon[90138]: from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:31:06.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:06 smithi084 ceph-mon[90138]: Upgrade: Updating osd.3 2024-04-26T21:31:06.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:06 smithi084 ceph-mon[90138]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:31:06.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:06 smithi084 ceph-mon[90138]: Deploying daemon osd.3 on smithi120 2024-04-26T21:31:06.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:06 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3254515333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:31:06.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:06 smithi120 ceph-mon[79001]: from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:31:06.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:06 smithi120 ceph-mon[79001]: Upgrade: Updating osd.3 2024-04-26T21:31:06.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:06 smithi120 ceph-mon[79001]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:31:06.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:06 smithi120 ceph-mon[79001]: Deploying daemon osd.3 on smithi120 2024-04-26T21:31:06.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:06 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3254515333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:31:06.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.505+0000 7f224a600700 1 -- 172.21.15.84:0/3236731736 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2244111a20 con 0x7f222806ec10 2024-04-26T21:31:06.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.508+0000 7f223b400700 1 -- 172.21.15.84:0/3236731736 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2244111a20 con 0x7f222806ec10 2024-04-26T21:31:06.509 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:31:06.509 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:31:06.509 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:31:06.509 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:31:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-04-26T21:31:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr", 2024-04-26T21:31:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-04-26T21:31:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: "crash" 2024-04-26T21:31:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-04-26T21:31:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "9/21 daemons upgraded", 2024-04-26T21:31:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading osd daemons", 2024-04-26T21:31:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:31:06.510 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:31:06.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.511+0000 7f224a600700 1 -- 172.21.15.84:0/3236731736 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f222806ec10 msgr2=0x7f22280710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:06.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.511+0000 7f224a600700 1 --2- 172.21.15.84:0/3236731736 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f222806ec10 0x7f22280710c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f223400b7a0 tx=0x7f2234009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:06.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.511+0000 7f224a600700 1 -- 172.21.15.84:0/3236731736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22440fe080 msgr2=0x7f2244110140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:06.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.511+0000 7f224a600700 1 --2- 172.21.15.84:0/3236731736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22440fe080 0x7f2244110140 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2230002a50 tx=0x7f22300046b0 comp rx=0 tx=0).stop 2024-04-26T21:31:06.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.512+0000 7f224a600700 1 -- 172.21.15.84:0/3236731736 shutdown_connections 2024-04-26T21:31:06.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.512+0000 7f224a600700 1 --2- 172.21.15.84:0/3236731736 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f222806ec10 0x7f22280710c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:06.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.512+0000 7f224a600700 1 --2- 172.21.15.84:0/3236731736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22440fcf10 0x7f224410fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:06.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.512+0000 7f224a600700 1 --2- 172.21.15.84:0/3236731736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22440fe080 0x7f2244110140 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:06.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.512+0000 7f224a600700 1 -- 172.21.15.84:0/3236731736 >> 172.21.15.84:0/3236731736 conn(0x7f22440f8560 msgr2=0x7f22440f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:06.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.512+0000 7f224a600700 1 -- 172.21.15.84:0/3236731736 shutdown_connections 2024-04-26T21:31:06.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.512+0000 7f224a600700 1 -- 172.21.15.84:0/3236731736 wait complete. 2024-04-26T21:31:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.658+0000 7f73d3e00700 1 -- 172.21.15.84:0/675731389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d4100080 msgr2=0x7f73d41004f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.658+0000 7f73d3e00700 1 --2- 172.21.15.84:0/675731389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d4100080 0x7f73d41004f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f73c0004940 tx=0x7f73c0009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.658+0000 7f73d3e00700 1 -- 172.21.15.84:0/675731389 shutdown_connections 2024-04-26T21:31:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.658+0000 7f73d3e00700 1 --2- 172.21.15.84:0/675731389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d4100080 0x7f73d41004f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.658+0000 7f73d3e00700 1 --2- 172.21.15.84:0/675731389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73d40fee80 0x7f73d40ff290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.658+0000 7f73d3e00700 1 -- 172.21.15.84:0/675731389 >> 172.21.15.84:0/675731389 conn(0x7f73d40fa730 msgr2=0x7f73d40fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.659+0000 7f73d3e00700 1 -- 172.21.15.84:0/675731389 shutdown_connections 2024-04-26T21:31:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.659+0000 7f73d3e00700 1 -- 172.21.15.84:0/675731389 wait complete. 2024-04-26T21:31:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.659+0000 7f73d3e00700 1 Processor -- start 2024-04-26T21:31:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.660+0000 7f73d3e00700 1 -- start start 2024-04-26T21:31:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.660+0000 7f73d3e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73d40fee80 0x7f73d410fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.660+0000 7f73d3e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d4100080 0x7f73d410ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.660+0000 7f73d3e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d41105a0 con 0x7f73d4100080 2024-04-26T21:31:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.660+0000 7f73d3e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d4110df0 con 0x7f73d40fee80 2024-04-26T21:31:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.660+0000 7f73d2000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d4100080 0x7f73d410ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.660+0000 7f73d2000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d4100080 0x7f73d410ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51460/0 (socket says 172.21.15.84:51460) 2024-04-26T21:31:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.660+0000 7f73d2000700 1 -- 172.21.15.84:0/2891778094 learned_addr learned my addr 172.21.15.84:0/2891778094 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:31:06.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.661+0000 7f73d2a00700 1 --2- 172.21.15.84:0/2891778094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73d40fee80 0x7f73d410fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:06.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.661+0000 7f73d2000700 1 -- 172.21.15.84:0/2891778094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73d40fee80 msgr2=0x7f73d410fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:06.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.661+0000 7f73d2000700 1 --2- 172.21.15.84:0/2891778094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73d40fee80 0x7f73d410fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:06.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.661+0000 7f73d2000700 1 -- 172.21.15.84:0/2891778094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c0005040 con 0x7f73d4100080 2024-04-26T21:31:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.661+0000 7f73d2a00700 1 --2- 172.21.15.84:0/2891778094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73d40fee80 0x7f73d410fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:31:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.661+0000 7f73d2000700 1 --2- 172.21.15.84:0/2891778094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d4100080 0x7f73d410ffa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009150 tx=0x7f73c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.661+0000 7f73caa00700 1 -- 172.21.15.84:0/2891778094 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73c000e040 con 0x7f73d4100080 2024-04-26T21:31:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.661+0000 7f73caa00700 1 -- 172.21.15.84:0/2891778094 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f73c000bbf0 con 0x7f73d4100080 2024-04-26T21:31:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.661+0000 7f73caa00700 1 -- 172.21.15.84:0/2891778094 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73c001c630 con 0x7f73d4100080 2024-04-26T21:31:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.661+0000 7f73d3e00700 1 -- 172.21.15.84:0/2891778094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d4111070 con 0x7f73d4100080 2024-04-26T21:31:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.662+0000 7f73d3e00700 1 -- 172.21.15.84:0/2891778094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d41115b0 con 0x7f73d4100080 2024-04-26T21:31:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.663+0000 7f73d3e00700 1 -- 172.21.15.84:0/2891778094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d40fe230 con 0x7f73d4100080 2024-04-26T21:31:06.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.664+0000 7f73caa00700 1 -- 172.21.15.84:0/2891778094 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f73c000bd60 con 0x7f73d4100080 2024-04-26T21:31:06.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.665+0000 7f73caa00700 1 --2- 172.21.15.84:0/2891778094 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f73b806ec00 0x7f73b80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:06.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.665+0000 7f73caa00700 1 -- 172.21.15.84:0/2891778094 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f73c008fd30 con 0x7f73d4100080 2024-04-26T21:31:06.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.665+0000 7f73d2a00700 1 --2- 172.21.15.84:0/2891778094 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f73b806ec00 0x7f73b80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:06.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.666+0000 7f73d2a00700 1 --2- 172.21.15.84:0/2891778094 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f73b806ec00 0x7f73b80710b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009fd0 tx=0x7f73c400b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:06.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.670+0000 7f73caa00700 1 -- 172.21.15.84:0/2891778094 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f73c005c590 con 0x7f73d4100080 2024-04-26T21:31:06.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.982+0000 7f73d3e00700 1 -- 172.21.15.84:0/2891778094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f73d404bed0 con 0x7f73d4100080 2024-04-26T21:31:06.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.983+0000 7f73caa00700 1 -- 172.21.15.84:0/2891778094 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f73c005c120 con 0x7f73d4100080 2024-04-26T21:31:06.984 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:31:06.984 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:31:06.984 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:31:06.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.986+0000 7f73d3e00700 1 -- 172.21.15.84:0/2891778094 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f73b806ec00 msgr2=0x7f73b80710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:06.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.986+0000 7f73d3e00700 1 --2- 172.21.15.84:0/2891778094 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f73b806ec00 0x7f73b80710b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009fd0 tx=0x7f73c400b040 comp rx=0 tx=0).stop 2024-04-26T21:31:06.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.986+0000 7f73d3e00700 1 -- 172.21.15.84:0/2891778094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d4100080 msgr2=0x7f73d410ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:06.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.986+0000 7f73d3e00700 1 --2- 172.21.15.84:0/2891778094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d4100080 0x7f73d410ffa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009150 tx=0x7f73c0009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:06.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.986+0000 7f73d3e00700 1 -- 172.21.15.84:0/2891778094 shutdown_connections 2024-04-26T21:31:06.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.986+0000 7f73d3e00700 1 --2- 172.21.15.84:0/2891778094 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f73b806ec00 0x7f73b80710b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:06.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.986+0000 7f73d3e00700 1 --2- 172.21.15.84:0/2891778094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73d40fee80 0x7f73d410fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:06.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.986+0000 7f73d3e00700 1 --2- 172.21.15.84:0/2891778094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d4100080 0x7f73d410ffa0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:06.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.986+0000 7f73d3e00700 1 -- 172.21.15.84:0/2891778094 >> 172.21.15.84:0/2891778094 conn(0x7f73d40fa730 msgr2=0x7f73d40fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:06.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.986+0000 7f73d3e00700 1 -- 172.21.15.84:0/2891778094 shutdown_connections 2024-04-26T21:31:06.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:06.986+0000 7f73d3e00700 1 -- 172.21.15.84:0/2891778094 wait complete. 2024-04-26T21:31:07.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:07 smithi120 ceph-mon[79001]: from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:31:07.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:07 smithi120 ceph-mon[79001]: pgmap v130: 65 pgs: 65 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:07.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:07 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3879710955' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:31:07.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:07 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2891778094' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:31:07.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:07 smithi084 ceph-mon[90138]: from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:31:07.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:07 smithi084 ceph-mon[90138]: pgmap v130: 65 pgs: 65 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:07.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:07 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3879710955' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:31:07.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:07 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2891778094' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:31:08.400 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:08 smithi120 ceph-mon[79001]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:31:08.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:08 smithi084 ceph-mon[90138]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:31:09.348 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:09 smithi084 ceph-mon[90138]: pgmap v131: 65 pgs: 65 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:09.348 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:09 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:09.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:09 smithi120 ceph-mon[79001]: pgmap v131: 65 pgs: 65 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:09.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:09 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:09.933 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:09 smithi120 systemd[1]: Stopping Ceph osd.3 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:31:10.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:10 smithi084 ceph-mon[90138]: pgmap v132: 65 pgs: 65 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:10.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:10 smithi084 ceph-mon[90138]: osd.3 marked itself down and dead 2024-04-26T21:31:10.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:10 smithi120 ceph-mon[79001]: pgmap v132: 65 pgs: 65 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:10.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:10 smithi120 ceph-mon[79001]: osd.3 marked itself down and dead 2024-04-26T21:31:10.433 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:09 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3[38195]: 2024-04-26T21:31:09.975+0000 7faf3fa00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:31:10.433 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:09 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3[38195]: 2024-04-26T21:31:09.975+0000 7faf3fa00700 -1 osd.3 74 *** Got signal Terminated *** 2024-04-26T21:31:10.433 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:09 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3[38195]: 2024-04-26T21:31:09.975+0000 7faf3fa00700 -1 osd.3 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:31:10.932 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:10 smithi120 podman[87871]: 2024-04-26 21:31:10.625180604 +0000 UTC m=+0.845600540 container died b8a14c87d730a2906fc1f39921cc211d8e06e629aea56630689a85ffcd12343b (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-2be3efa, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-26T21:31:11.343 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:11 smithi120 ceph-mon[79001]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:31:11.343 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:11 smithi120 ceph-mon[79001]: osdmap e75: 6 total, 5 up, 6 in 2024-04-26T21:31:11.343 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:11 smithi120 podman[87871]: 2024-04-26 21:31:11.08337569 +0000 UTC m=+1.303795619 container cleanup b8a14c87d730a2906fc1f39921cc211d8e06e629aea56630689a85ffcd12343b (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3, org.label-schema.vendor=CentOS, RELEASE=quincy-2be3efa, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-26T21:31:11.344 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:11 smithi120 bash[87871]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3 2024-04-26T21:31:11.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:11 smithi084 ceph-mon[90138]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:31:11.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:11 smithi084 ceph-mon[90138]: osdmap e75: 6 total, 5 up, 6 in 2024-04-26T21:31:11.682 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:11 smithi120 podman[87889]: 2024-04-26 21:31:11.342547637 +0000 UTC m=+0.701826431 container remove b8a14c87d730a2906fc1f39921cc211d8e06e629aea56630689a85ffcd12343b (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-2be3efa, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-26T21:31:12.409 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:12 smithi120 ceph-mon[79001]: osdmap e76: 6 total, 5 up, 6 in 2024-04-26T21:31:12.409 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:12 smithi120 ceph-mon[79001]: pgmap v135: 65 pgs: 14 stale+active+clean, 51 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:12.409 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:12 smithi120 podman[87974]: 2024-04-26 21:31:12.097105758 +0000 UTC m=+0.039519011 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:31:12.409 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:12 smithi120 podman[87974]: 2024-04-26 21:31:12.235226265 +0000 UTC m=+0.177639531 container create 8acfd1ccaff5ab3d6197ade7e7e6c5ef2a8fea087b74d2aa9ef309e6c67cbc09 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-26T21:31:12.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:12 smithi084 ceph-mon[90138]: osdmap e76: 6 total, 5 up, 6 in 2024-04-26T21:31:12.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:12 smithi084 ceph-mon[90138]: pgmap v135: 65 pgs: 14 stale+active+clean, 51 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:12.683 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:12 smithi120 podman[87974]: 2024-04-26 21:31:12.506542103 +0000 UTC m=+0.448955379 container init 8acfd1ccaff5ab3d6197ade7e7e6c5ef2a8fea087b74d2aa9ef309e6c67cbc09 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-26T21:31:12.683 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:12 smithi120 podman[87974]: 2024-04-26 21:31:12.51821936 +0000 UTC m=+0.460632632 container start 8acfd1ccaff5ab3d6197ade7e7e6c5ef2a8fea087b74d2aa9ef309e6c67cbc09 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-deactivate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-26T21:31:12.683 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:12 smithi120 podman[87974]: 2024-04-26 21:31:12.620855511 +0000 UTC m=+0.563268777 container attach 8acfd1ccaff5ab3d6197ade7e7e6c5ef2a8fea087b74d2aa9ef309e6c67cbc09 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-26T21:31:13.306 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:12 smithi120 podman[87974]: 2024-04-26 21:31:12.963229596 +0000 UTC m=+0.905642872 container died 8acfd1ccaff5ab3d6197ade7e7e6c5ef2a8fea087b74d2aa9ef309e6c67cbc09 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424) 2024-04-26T21:31:13.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:13 smithi120 ceph-mon[79001]: Health check failed: Degraded data redundancy: 11/363 objects degraded (3.030%), 4 pgs degraded (PG_DEGRADED) 2024-04-26T21:31:13.933 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:13 smithi120 podman[87999]: 2024-04-26 21:31:13.674142597 +0000 UTC m=+0.692958434 container remove 8acfd1ccaff5ab3d6197ade7e7e6c5ef2a8fea087b74d2aa9ef309e6c67cbc09 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:31:13.933 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:13 smithi120 systemd[1]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.3.service: Deactivated successfully. 2024-04-26T21:31:13.933 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:13 smithi120 systemd[1]: Stopped Ceph osd.3 for 8bb44d26-0411-11ef-bc93-c7b262605968. 2024-04-26T21:31:13.933 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:13 smithi120 systemd[1]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.3.service: Consumed 1min 51.989s CPU time. 2024-04-26T21:31:14.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:13 smithi084 ceph-mon[90138]: Health check failed: Degraded data redundancy: 11/363 objects degraded (3.030%), 4 pgs degraded (PG_DEGRADED) 2024-04-26T21:31:14.432 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:14 smithi120 systemd[1]: Starting Ceph osd.3 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:31:14.755 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:14 smithi120 podman[88097]: 2024-04-26 21:31:14.398778253 +0000 UTC m=+0.034357086 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:31:14.755 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:14 smithi120 podman[88097]: 2024-04-26 21:31:14.516858285 +0000 UTC m=+0.152437155 container create 2b78cd7d1114efebb6b3d9f48233d195c364cf8ee07b96684476e367ff5e618f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-activate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-26T21:31:14.755 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:14 smithi120 podman[88097]: 2024-04-26 21:31:14.753898504 +0000 UTC m=+0.389477407 container init 2b78cd7d1114efebb6b3d9f48233d195c364cf8ee07b96684476e367ff5e618f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-activate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True) 2024-04-26T21:31:15.028 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:14 smithi120 podman[88097]: 2024-04-26 21:31:14.765725027 +0000 UTC m=+0.401303924 container start 2b78cd7d1114efebb6b3d9f48233d195c364cf8ee07b96684476e367ff5e618f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=) 2024-04-26T21:31:15.028 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:14 smithi120 podman[88097]: 2024-04-26 21:31:14.869090182 +0000 UTC m=+0.504669040 container attach 2b78cd7d1114efebb6b3d9f48233d195c364cf8ee07b96684476e367ff5e618f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-26T21:31:15.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:15 smithi084 ceph-mon[90138]: pgmap v136: 65 pgs: 4 active+undersized+degraded, 11 stale+active+clean, 8 active+undersized, 42 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 11/363 objects degraded (3.030%) 2024-04-26T21:31:15.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:15 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:15 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:31:15.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:15 smithi120 ceph-mon[79001]: pgmap v136: 65 pgs: 4 active+undersized+degraded, 11 stale+active+clean, 8 active+undersized, 42 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 11/363 objects degraded (3.030%) 2024-04-26T21:31:15.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:15 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:15.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:15 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:31:16.139 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:15 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-activate[88111]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:31:16.139 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:15 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-activate[88111]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:31:16.139 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:15 smithi120 bash[88097]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:31:16.139 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:15 smithi120 bash[88097]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:31:16.140 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:15 smithi120 bash[88097]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T21:31:16.140 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:15 smithi120 bash[88097]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-26T21:31:16.140 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:15 smithi120 bash[88097]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-26T21:31:16.140 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:15 smithi120 bash[88097]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-26T21:31:16.140 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:15 smithi120 bash[88097]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-26T21:31:16.140 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:15 smithi120 bash[88097]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T21:31:16.140 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:15 smithi120 bash[88097]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-26T21:31:16.140 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:15 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-activate[88111]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T21:31:16.140 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:15 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-activate[88111]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-26T21:31:16.140 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:15 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-activate[88111]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-26T21:31:16.140 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:15 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-activate[88111]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-26T21:31:16.140 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:15 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-activate[88111]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-26T21:31:16.140 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:15 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-activate[88111]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T21:31:16.140 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:15 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-activate[88111]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-26T21:31:16.140 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:15 smithi120 podman[88097]: 2024-04-26 21:31:15.766827823 +0000 UTC m=+1.402406699 container died 2b78cd7d1114efebb6b3d9f48233d195c364cf8ee07b96684476e367ff5e618f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424) 2024-04-26T21:31:16.891 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:16 smithi120 podman[88251]: 2024-04-26 21:31:16.514122195 +0000 UTC m=+0.727836423 container remove 2b78cd7d1114efebb6b3d9f48233d195c364cf8ee07b96684476e367ff5e618f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-26T21:31:17.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:17 smithi120 ceph-mon[79001]: pgmap v137: 65 pgs: 16 active+undersized+degraded, 17 active+undersized, 32 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 64/363 objects degraded (17.631%) 2024-04-26T21:31:17.183 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:16 smithi120 podman[88311]: 2024-04-26 21:31:16.797404807 +0000 UTC m=+0.036550021 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:31:17.183 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:16 smithi120 podman[88311]: 2024-04-26 21:31:16.923441987 +0000 UTC m=+0.162587214 container create d7e5825e264024dd3fbabd3b27f7c48aeb75a92a236836df4fe7e8a2c31fa002 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True) 2024-04-26T21:31:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:17 smithi084 ceph-mon[90138]: pgmap v137: 65 pgs: 16 active+undersized+degraded, 17 active+undersized, 32 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 64/363 objects degraded (17.631%) 2024-04-26T21:31:17.683 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:17 smithi120 podman[88311]: 2024-04-26 21:31:17.20388992 +0000 UTC m=+0.443035154 container init d7e5825e264024dd3fbabd3b27f7c48aeb75a92a236836df4fe7e8a2c31fa002 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:31:17.683 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:17 smithi120 podman[88311]: 2024-04-26 21:31:17.213827187 +0000 UTC m=+0.452972394 container start d7e5825e264024dd3fbabd3b27f7c48aeb75a92a236836df4fe7e8a2c31fa002 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=) 2024-04-26T21:31:17.683 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:17 smithi120 ceph-osd[88330]: -- 172.21.15.120:0/3915454307 <== mon.1 v2:172.21.15.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556fd5d53680 con 0x556fd5d1d000 2024-04-26T21:31:17.683 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:17 smithi120 bash[88311]: d7e5825e264024dd3fbabd3b27f7c48aeb75a92a236836df4fe7e8a2c31fa002 2024-04-26T21:31:17.683 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:17 smithi120 systemd[1]: Started Ceph osd.3 for 8bb44d26-0411-11ef-bc93-c7b262605968. 2024-04-26T21:31:18.182 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:17 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3[88326]: 2024-04-26T21:31:17.786+0000 7f1e9d5987c0 -1 Falling back to public interface 2024-04-26T21:31:18.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:18 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:18.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:18 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:18.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:18 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:31:18.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:18 smithi084 ceph-mon[90138]: pgmap v138: 65 pgs: 16 active+undersized+degraded, 17 active+undersized, 32 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 64/363 objects degraded (17.631%) 2024-04-26T21:31:18.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:18 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:18.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:18 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:18.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:18 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:31:18.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:18 smithi120 ceph-mon[79001]: pgmap v138: 65 pgs: 16 active+undersized+degraded, 17 active+undersized, 32 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 64/363 objects degraded (17.631%) 2024-04-26T21:31:21.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:20 smithi084 ceph-mon[90138]: pgmap v139: 65 pgs: 16 active+undersized+degraded, 17 active+undersized, 32 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 64/363 objects degraded (17.631%) 2024-04-26T21:31:21.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:20 smithi120 ceph-mon[79001]: pgmap v139: 65 pgs: 16 active+undersized+degraded, 17 active+undersized, 32 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 64/363 objects degraded (17.631%) 2024-04-26T21:31:22.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:22 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:22.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:22 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:22.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:22 smithi120 ceph-mon[79001]: pgmap v140: 65 pgs: 16 active+undersized+degraded, 17 active+undersized, 32 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 64/363 objects degraded (17.631%) 2024-04-26T21:31:22.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:22 smithi120 ceph-mon[79001]: Health check update: Degraded data redundancy: 64/363 objects degraded (17.631%), 16 pgs degraded (PG_DEGRADED) 2024-04-26T21:31:23.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:22 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:23.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:22 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:23.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:22 smithi084 ceph-mon[90138]: pgmap v140: 65 pgs: 16 active+undersized+degraded, 17 active+undersized, 32 active+clean; 310 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 64/363 objects degraded (17.631%) 2024-04-26T21:31:23.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:22 smithi084 ceph-mon[90138]: Health check update: Degraded data redundancy: 64/363 objects degraded (17.631%), 16 pgs degraded (PG_DEGRADED) 2024-04-26T21:31:23.682 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:23 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3[88326]: 2024-04-26T21:31:23.387+0000 7f1e9d5987c0 -1 osd.3 74 log_to_monitors true 2024-04-26T21:31:24.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:23 smithi084 ceph-mon[90138]: from='osd.3 [v2:172.21.15.120:6800/2439161252,v1:172.21.15.120:6801/2439161252]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T21:31:24.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:23 smithi084 ceph-mon[90138]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T21:31:24.182 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:31:23 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3[88326]: 2024-04-26T21:31:23.742+0000 7f1e8ca00700 -1 osd.3 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:31:24.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:23 smithi120 ceph-mon[79001]: from='osd.3 [v2:172.21.15.120:6800/2439161252,v1:172.21.15.120:6801/2439161252]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T21:31:24.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:23 smithi120 ceph-mon[79001]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T21:31:24.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:24 smithi120 ceph-mon[79001]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T21:31:24.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:24 smithi120 ceph-mon[79001]: from='osd.3 [v2:172.21.15.120:6800/2439161252,v1:172.21.15.120:6801/2439161252]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:31:24.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:24 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:24.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:24 smithi120 ceph-mon[79001]: osdmap e77: 6 total, 5 up, 6 in 2024-04-26T21:31:24.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:24 smithi120 ceph-mon[79001]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:31:24.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:24 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:24.934 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:24 smithi120 ceph-mon[79001]: pgmap v142: 65 pgs: 16 active+undersized+degraded, 17 active+undersized, 32 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 64/363 objects degraded (17.631%) 2024-04-26T21:31:25.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:24 smithi084 ceph-mon[90138]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T21:31:25.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:24 smithi084 ceph-mon[90138]: from='osd.3 [v2:172.21.15.120:6800/2439161252,v1:172.21.15.120:6801/2439161252]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:31:25.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:24 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:25.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:24 smithi084 ceph-mon[90138]: osdmap e77: 6 total, 5 up, 6 in 2024-04-26T21:31:25.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:24 smithi084 ceph-mon[90138]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:31:25.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:24 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:25.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:24 smithi084 ceph-mon[90138]: pgmap v142: 65 pgs: 16 active+undersized+degraded, 17 active+undersized, 32 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 64/363 objects degraded (17.631%) 2024-04-26T21:31:25.860 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:25 smithi120 ceph-mon[79001]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:31:25.860 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:25 smithi120 ceph-mon[79001]: osd.3 [v2:172.21.15.120:6800/2439161252,v1:172.21.15.120:6801/2439161252] boot 2024-04-26T21:31:25.860 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:25 smithi120 ceph-mon[79001]: osdmap e78: 6 total, 6 up, 6 in 2024-04-26T21:31:25.860 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:31:26.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:25 smithi084 ceph-mon[90138]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:31:26.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:25 smithi084 ceph-mon[90138]: osd.3 [v2:172.21.15.120:6800/2439161252,v1:172.21.15.120:6801/2439161252] boot 2024-04-26T21:31:26.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:25 smithi084 ceph-mon[90138]: osdmap e78: 6 total, 6 up, 6 in 2024-04-26T21:31:26.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:31:27.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:26 smithi084 ceph-mon[90138]: osdmap e79: 6 total, 6 up, 6 in 2024-04-26T21:31:27.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:26 smithi084 ceph-mon[90138]: pgmap v145: 65 pgs: 16 active+undersized+degraded, 17 active+undersized, 32 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 64/363 objects degraded (17.631%) 2024-04-26T21:31:27.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:26 smithi120 ceph-mon[79001]: osdmap e79: 6 total, 6 up, 6 in 2024-04-26T21:31:27.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:26 smithi120 ceph-mon[79001]: pgmap v145: 65 pgs: 16 active+undersized+degraded, 17 active+undersized, 32 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 64/363 objects degraded (17.631%) 2024-04-26T21:31:28.623 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:28 smithi120 ceph-mon[79001]: pgmap v146: 65 pgs: 16 active+undersized+degraded, 17 active+undersized, 32 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 64/363 objects degraded (17.631%) 2024-04-26T21:31:28.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:28 smithi084 ceph-mon[90138]: pgmap v146: 65 pgs: 16 active+undersized+degraded, 17 active+undersized, 32 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 64/363 objects degraded (17.631%) 2024-04-26T21:31:30.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:30 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:30.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:30 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:31:30.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:30 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:30.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:30 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:30.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:30 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:31:30.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:30 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:31:30.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:30 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:30.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:30 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:31:30.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:30 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:31:30.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:30 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:31:30.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:30 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:31:30.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:30 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-26T21:31:30.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:30 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:30.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:30 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:31:30.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:30 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:30.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:30 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:30.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:30 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:31:30.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:30 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:31:30.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:30 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:30.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:30 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:31:30.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:30 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:31:30.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:30 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:31:30.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:30 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:31:30.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:30 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-26T21:31:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:31 smithi084 ceph-mon[90138]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-26T21:31:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:31 smithi084 ceph-mon[90138]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-04-26T21:31:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:31 smithi084 ceph-mon[90138]: pgmap v147: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:31 smithi084 ceph-mon[90138]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 64/363 objects degraded (17.631%), 16 pgs degraded) 2024-04-26T21:31:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:31 smithi120 ceph-mon[79001]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-26T21:31:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:31 smithi120 ceph-mon[79001]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-04-26T21:31:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:31 smithi120 ceph-mon[79001]: pgmap v147: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:31.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:31 smithi120 ceph-mon[79001]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 64/363 objects degraded (17.631%), 16 pgs degraded) 2024-04-26T21:31:33.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:33 smithi084 ceph-mon[90138]: pgmap v148: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:33.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:33 smithi120 ceph-mon[79001]: pgmap v148: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:35.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:35 smithi084 ceph-mon[90138]: pgmap v149: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:35.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:35 smithi120 ceph-mon[79001]: pgmap v149: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:37.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.151+0000 7fb2ed600700 1 -- 172.21.15.84:0/975392223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2e80fe2f0 msgr2=0x7fb2e80fe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:37.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.151+0000 7fb2ed600700 1 --2- 172.21.15.84:0/975392223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2e80fe2f0 0x7fb2e80fe700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8004940 tx=0x7fb2d8009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:37.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.151+0000 7fb2ed600700 1 -- 172.21.15.84:0/975392223 shutdown_connections 2024-04-26T21:31:37.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.151+0000 7fb2ed600700 1 --2- 172.21.15.84:0/975392223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e80fc8e0 0x7fb2e80fcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:37.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.151+0000 7fb2ed600700 1 --2- 172.21.15.84:0/975392223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2e80fe2f0 0x7fb2e80fe700 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:37.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.151+0000 7fb2ed600700 1 -- 172.21.15.84:0/975392223 >> 172.21.15.84:0/975392223 conn(0x7fb2e80f83b0 msgr2=0x7fb2e80fa7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:37.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.151+0000 7fb2ed600700 1 -- 172.21.15.84:0/975392223 shutdown_connections 2024-04-26T21:31:37.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.152+0000 7fb2ed600700 1 -- 172.21.15.84:0/975392223 wait complete. 2024-04-26T21:31:37.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.152+0000 7fb2ed600700 1 Processor -- start 2024-04-26T21:31:37.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.153+0000 7fb2ed600700 1 -- start start 2024-04-26T21:31:37.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.153+0000 7fb2ed600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2e80fc8e0 0x7fb2e810fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:37.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.153+0000 7fb2ed600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e80fe2f0 0x7fb2e810ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:37.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.153+0000 7fb2ed600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e8110580 con 0x7fb2e80fc8e0 2024-04-26T21:31:37.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.153+0000 7fb2ed600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e8110dd0 con 0x7fb2e80fe2f0 2024-04-26T21:31:37.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.153+0000 7fb2e7e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2e80fc8e0 0x7fb2e810fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:37.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.153+0000 7fb2e7e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2e80fc8e0 0x7fb2e810fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35786/0 (socket says 172.21.15.84:35786) 2024-04-26T21:31:37.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.153+0000 7fb2e7e00700 1 -- 172.21.15.84:0/318725431 learned_addr learned my addr 172.21.15.84:0/318725431 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:31:37.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.154+0000 7fb2e7400700 1 --2- 172.21.15.84:0/318725431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e80fe2f0 0x7fb2e810ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:37.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.154+0000 7fb2e7e00700 1 -- 172.21.15.84:0/318725431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e80fe2f0 msgr2=0x7fb2e810ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:37.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.154+0000 7fb2e7e00700 1 --2- 172.21.15.84:0/318725431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e80fe2f0 0x7fb2e810ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:37.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.154+0000 7fb2e7e00700 1 -- 172.21.15.84:0/318725431 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d8005040 con 0x7fb2e80fc8e0 2024-04-26T21:31:37.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.154+0000 7fb2e7400700 1 --2- 172.21.15.84:0/318725431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e80fe2f0 0x7fb2e810ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:31:37.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.154+0000 7fb2e7e00700 1 --2- 172.21.15.84:0/318725431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2e80fc8e0 0x7fb2e810fa40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009150 tx=0x7fb2d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:37.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.154+0000 7fb2dfe00700 1 -- 172.21.15.84:0/318725431 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2d800e040 con 0x7fb2e80fc8e0 2024-04-26T21:31:37.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.154+0000 7fb2dfe00700 1 -- 172.21.15.84:0/318725431 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2d800bbf0 con 0x7fb2e80fc8e0 2024-04-26T21:31:37.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.154+0000 7fb2ed600700 1 -- 172.21.15.84:0/318725431 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e8111050 con 0x7fb2e80fc8e0 2024-04-26T21:31:37.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.154+0000 7fb2dfe00700 1 -- 172.21.15.84:0/318725431 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2d801c630 con 0x7fb2e80fc8e0 2024-04-26T21:31:37.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.155+0000 7fb2ed600700 1 -- 172.21.15.84:0/318725431 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e8111590 con 0x7fb2e80fc8e0 2024-04-26T21:31:37.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.156+0000 7fb2ed600700 1 -- 172.21.15.84:0/318725431 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e8101850 con 0x7fb2e80fc8e0 2024-04-26T21:31:37.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.157+0000 7fb2dfe00700 1 -- 172.21.15.84:0/318725431 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb2d800bd60 con 0x7fb2e80fc8e0 2024-04-26T21:31:37.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.158+0000 7fb2dfe00700 1 --2- 172.21.15.84:0/318725431 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb2cc06ec10 0x7fb2cc0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:37.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.158+0000 7fb2dfe00700 1 -- 172.21.15.84:0/318725431 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fb2d808fdd0 con 0x7fb2e80fc8e0 2024-04-26T21:31:37.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.158+0000 7fb2e7400700 1 --2- 172.21.15.84:0/318725431 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb2cc06ec10 0x7fb2cc0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:37.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.159+0000 7fb2e7400700 1 --2- 172.21.15.84:0/318725431 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb2cc06ec10 0x7fb2cc0710c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4007fd0 tx=0x7fb2d4009040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:37.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.163+0000 7fb2dfe00700 1 -- 172.21.15.84:0/318725431 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fb2d805c630 con 0x7fb2e80fc8e0 2024-04-26T21:31:37.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.404+0000 7fb2ed600700 1 -- 172.21.15.84:0/318725431 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2e81117b0 con 0x7fb2cc06ec10 2024-04-26T21:31:37.406 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:37 smithi084 ceph-mon[90138]: pgmap v150: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:37.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.405+0000 7fb2dfe00700 1 -- 172.21.15.84:0/318725431 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fb2e81117b0 con 0x7fb2cc06ec10 2024-04-26T21:31:37.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.408+0000 7fb2ed600700 1 -- 172.21.15.84:0/318725431 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb2cc06ec10 msgr2=0x7fb2cc0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:37.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.408+0000 7fb2ed600700 1 --2- 172.21.15.84:0/318725431 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb2cc06ec10 0x7fb2cc0710c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4007fd0 tx=0x7fb2d4009040 comp rx=0 tx=0).stop 2024-04-26T21:31:37.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.408+0000 7fb2ed600700 1 -- 172.21.15.84:0/318725431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2e80fc8e0 msgr2=0x7fb2e810fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:37.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.408+0000 7fb2ed600700 1 --2- 172.21.15.84:0/318725431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2e80fc8e0 0x7fb2e810fa40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009150 tx=0x7fb2d8009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:37.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.408+0000 7fb2ed600700 1 -- 172.21.15.84:0/318725431 shutdown_connections 2024-04-26T21:31:37.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.408+0000 7fb2ed600700 1 --2- 172.21.15.84:0/318725431 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb2cc06ec10 0x7fb2cc0710c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:37.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.408+0000 7fb2ed600700 1 --2- 172.21.15.84:0/318725431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2e80fc8e0 0x7fb2e810fa40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:37.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.408+0000 7fb2ed600700 1 --2- 172.21.15.84:0/318725431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e80fe2f0 0x7fb2e810ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:37.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.408+0000 7fb2ed600700 1 -- 172.21.15.84:0/318725431 >> 172.21.15.84:0/318725431 conn(0x7fb2e80f83b0 msgr2=0x7fb2e80f9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:37.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.408+0000 7fb2ed600700 1 -- 172.21.15.84:0/318725431 shutdown_connections 2024-04-26T21:31:37.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.408+0000 7fb2ed600700 1 -- 172.21.15.84:0/318725431 wait complete. 2024-04-26T21:31:37.425 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:31:37.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:37 smithi120 ceph-mon[79001]: pgmap v150: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:37.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.562+0000 7fa4af200700 1 -- 172.21.15.84:0/1882379578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4b00fcc00 msgr2=0x7fa4b00fd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:37.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.562+0000 7fa4af200700 1 --2- 172.21.15.84:0/1882379578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4b00fcc00 0x7fa4b00fd010 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0004940 tx=0x7fa4a0009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:37.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.562+0000 7fa4af200700 1 -- 172.21.15.84:0/1882379578 shutdown_connections 2024-04-26T21:31:37.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.562+0000 7fa4af200700 1 --2- 172.21.15.84:0/1882379578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4b00fdeb0 0x7fa4b00fe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:37.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.562+0000 7fa4af200700 1 --2- 172.21.15.84:0/1882379578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4b00fcc00 0x7fa4b00fd010 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:37.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.562+0000 7fa4af200700 1 -- 172.21.15.84:0/1882379578 >> 172.21.15.84:0/1882379578 conn(0x7fa4b00f8340 msgr2=0x7fa4b00fa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:37.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.562+0000 7fa4af200700 1 -- 172.21.15.84:0/1882379578 shutdown_connections 2024-04-26T21:31:37.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.562+0000 7fa4af200700 1 -- 172.21.15.84:0/1882379578 wait complete. 2024-04-26T21:31:37.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.563+0000 7fa4af200700 1 Processor -- start 2024-04-26T21:31:37.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.563+0000 7fa4af200700 1 -- start start 2024-04-26T21:31:37.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.563+0000 7fa4af200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4b00fcc00 0x7fa4b0071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:37.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.563+0000 7fa4af200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4b00fdeb0 0x7fa4b00702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:37.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.563+0000 7fa4af200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b0070860 con 0x7fa4b00fcc00 2024-04-26T21:31:37.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.563+0000 7fa4af200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b00709d0 con 0x7fa4b00fdeb0 2024-04-26T21:31:37.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.563+0000 7fa4ade00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4b00fcc00 0x7fa4b0071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:37.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.563+0000 7fa4ade00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4b00fcc00 0x7fa4b0071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35804/0 (socket says 172.21.15.84:35804) 2024-04-26T21:31:37.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.563+0000 7fa4ade00700 1 -- 172.21.15.84:0/2708459461 learned_addr learned my addr 172.21.15.84:0/2708459461 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:31:37.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.564+0000 7fa4ade00700 1 -- 172.21.15.84:0/2708459461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4b00fdeb0 msgr2=0x7fa4b00702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:37.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.564+0000 7fa4ade00700 1 --2- 172.21.15.84:0/2708459461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4b00fdeb0 0x7fa4b00702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:37.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.564+0000 7fa4ade00700 1 -- 172.21.15.84:0/2708459461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a0005040 con 0x7fa4b00fcc00 2024-04-26T21:31:37.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.564+0000 7fa4ade00700 1 --2- 172.21.15.84:0/2708459461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4b00fcc00 0x7fa4b0071de0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa4a000b3b0 tx=0x7fa4a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:37.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.564+0000 7fa4a6000700 1 -- 172.21.15.84:0/2708459461 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4a000e040 con 0x7fa4b00fcc00 2024-04-26T21:31:37.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.564+0000 7fa4a6000700 1 -- 172.21.15.84:0/2708459461 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa4a000bcc0 con 0x7fa4b00fcc00 2024-04-26T21:31:37.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.564+0000 7fa4af200700 1 -- 172.21.15.84:0/2708459461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b0070c50 con 0x7fa4b00fcc00 2024-04-26T21:31:37.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.564+0000 7fa4a6000700 1 -- 172.21.15.84:0/2708459461 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4a001c630 con 0x7fa4b00fcc00 2024-04-26T21:31:37.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.564+0000 7fa4af200700 1 -- 172.21.15.84:0/2708459461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b0115850 con 0x7fa4b00fcc00 2024-04-26T21:31:37.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.566+0000 7fa4af200700 1 -- 172.21.15.84:0/2708459461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b00fc000 con 0x7fa4b00fcc00 2024-04-26T21:31:37.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.567+0000 7fa4a6000700 1 -- 172.21.15.84:0/2708459461 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa4a0013980 con 0x7fa4b00fcc00 2024-04-26T21:31:37.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.567+0000 7fa4a6000700 1 --2- 172.21.15.84:0/2708459461 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa49406ec00 0x7fa4940710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:37.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.568+0000 7fa4a6000700 1 -- 172.21.15.84:0/2708459461 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fa4a008f5e0 con 0x7fa4b00fcc00 2024-04-26T21:31:37.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.568+0000 7fa4ad400700 1 --2- 172.21.15.84:0/2708459461 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa49406ec00 0x7fa4940710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:37.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.568+0000 7fa4ad400700 1 --2- 172.21.15.84:0/2708459461 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa49406ec00 0x7fa4940710b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009fd0 tx=0x7fa49c009e10 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:37.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.573+0000 7fa4a6000700 1 -- 172.21.15.84:0/2708459461 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fa4a0058310 con 0x7fa4b00fcc00 2024-04-26T21:31:37.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.821+0000 7fa4af200700 1 -- 172.21.15.84:0/2708459461 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4b01021c0 con 0x7fa49406ec00 2024-04-26T21:31:37.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.824+0000 7fa4a6000700 1 -- 172.21.15.84:0/2708459461 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fa4b01021c0 con 0x7fa49406ec00 2024-04-26T21:31:37.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.826+0000 7fa4af200700 1 -- 172.21.15.84:0/2708459461 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa49406ec00 msgr2=0x7fa4940710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:37.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.826+0000 7fa4af200700 1 --2- 172.21.15.84:0/2708459461 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa49406ec00 0x7fa4940710b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009fd0 tx=0x7fa49c009e10 comp rx=0 tx=0).stop 2024-04-26T21:31:37.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.826+0000 7fa4af200700 1 -- 172.21.15.84:0/2708459461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4b00fcc00 msgr2=0x7fa4b0071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:37.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.826+0000 7fa4af200700 1 --2- 172.21.15.84:0/2708459461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4b00fcc00 0x7fa4b0071de0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa4a000b3b0 tx=0x7fa4a0009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:37.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.826+0000 7fa4af200700 1 -- 172.21.15.84:0/2708459461 shutdown_connections 2024-04-26T21:31:37.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.826+0000 7fa4af200700 1 --2- 172.21.15.84:0/2708459461 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa49406ec00 0x7fa4940710b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:37.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.826+0000 7fa4af200700 1 --2- 172.21.15.84:0/2708459461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4b00fcc00 0x7fa4b0071de0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:37.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.826+0000 7fa4af200700 1 --2- 172.21.15.84:0/2708459461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4b00fdeb0 0x7fa4b00702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:37.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.826+0000 7fa4af200700 1 -- 172.21.15.84:0/2708459461 >> 172.21.15.84:0/2708459461 conn(0x7fa4b00f8340 msgr2=0x7fa4b00f9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:37.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.827+0000 7fa4af200700 1 -- 172.21.15.84:0/2708459461 shutdown_connections 2024-04-26T21:31:37.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.827+0000 7fa4af200700 1 -- 172.21.15.84:0/2708459461 wait complete. 2024-04-26T21:31:37.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.981+0000 7f01df000700 1 -- 172.21.15.84:0/3285464246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d80fc8e0 msgr2=0x7f01d80fcd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:37.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.981+0000 7f01df000700 1 --2- 172.21.15.84:0/3285464246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d80fc8e0 0x7f01d80fcd50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f01c4004940 tx=0x7f01c4009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:37.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.981+0000 7f01df000700 1 -- 172.21.15.84:0/3285464246 shutdown_connections 2024-04-26T21:31:37.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.981+0000 7f01df000700 1 --2- 172.21.15.84:0/3285464246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d80fc8e0 0x7f01d80fcd50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:37.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.981+0000 7f01df000700 1 --2- 172.21.15.84:0/3285464246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01d80fe2f0 0x7f01d80fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:37.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.981+0000 7f01df000700 1 -- 172.21.15.84:0/3285464246 >> 172.21.15.84:0/3285464246 conn(0x7f01d80f83b0 msgr2=0x7f01d80fa7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:37.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.981+0000 7f01df000700 1 -- 172.21.15.84:0/3285464246 shutdown_connections 2024-04-26T21:31:37.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.981+0000 7f01df000700 1 -- 172.21.15.84:0/3285464246 wait complete. 2024-04-26T21:31:37.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.982+0000 7f01df000700 1 Processor -- start 2024-04-26T21:31:37.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.982+0000 7f01df000700 1 -- start start 2024-04-26T21:31:37.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.983+0000 7f01df000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d80fc8e0 0x7f01d8071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:37.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.983+0000 7f01df000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01d80fe2f0 0x7f01d80702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:37.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.983+0000 7f01df000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d80708d0 con 0x7f01d80fc8e0 2024-04-26T21:31:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.983+0000 7f01df000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d8070a10 con 0x7f01d80fe2f0 2024-04-26T21:31:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.983+0000 7f01ddc00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d80fc8e0 0x7f01d8071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.983+0000 7f01ddc00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d80fc8e0 0x7f01d8071d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35824/0 (socket says 172.21.15.84:35824) 2024-04-26T21:31:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.983+0000 7f01ddc00700 1 -- 172.21.15.84:0/4063631641 learned_addr learned my addr 172.21.15.84:0/4063631641 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:31:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.983+0000 7f01dd200700 1 --2- 172.21.15.84:0/4063631641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01d80fe2f0 0x7f01d80702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:37.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.983+0000 7f01ddc00700 1 -- 172.21.15.84:0/4063631641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01d80fe2f0 msgr2=0x7f01d80702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:37.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.983+0000 7f01ddc00700 1 --2- 172.21.15.84:0/4063631641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01d80fe2f0 0x7f01d80702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:37.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.983+0000 7f01ddc00700 1 -- 172.21.15.84:0/4063631641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c4005040 con 0x7f01d80fc8e0 2024-04-26T21:31:37.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.984+0000 7f01ddc00700 1 --2- 172.21.15.84:0/4063631641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d80fc8e0 0x7f01d8071d70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00b790 tx=0x7f01cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:37.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.984+0000 7f01d5600700 1 -- 172.21.15.84:0/4063631641 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01cc00f770 con 0x7f01d80fc8e0 2024-04-26T21:31:37.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.984+0000 7f01d5600700 1 -- 172.21.15.84:0/4063631641 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f01cc00fda0 con 0x7f01d80fc8e0 2024-04-26T21:31:37.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.984+0000 7f01df000700 1 -- 172.21.15.84:0/4063631641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d8070cc0 con 0x7f01d80fc8e0 2024-04-26T21:31:37.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.984+0000 7f01d5600700 1 -- 172.21.15.84:0/4063631641 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01cc00d310 con 0x7f01d80fc8e0 2024-04-26T21:31:37.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.984+0000 7f01df000700 1 -- 172.21.15.84:0/4063631641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d8115870 con 0x7f01d80fc8e0 2024-04-26T21:31:37.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.985+0000 7f01df000700 1 -- 172.21.15.84:0/4063631641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d805f5c0 con 0x7f01d80fc8e0 2024-04-26T21:31:37.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.986+0000 7f01d5600700 1 -- 172.21.15.84:0/4063631641 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f01cc010420 con 0x7f01d80fc8e0 2024-04-26T21:31:37.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.987+0000 7f01d5600700 1 --2- 172.21.15.84:0/4063631641 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f01c006ec10 0x7f01c00710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:37.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.987+0000 7f01d5600700 1 -- 172.21.15.84:0/4063631641 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f01cc08e9d0 con 0x7f01d80fc8e0 2024-04-26T21:31:37.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.987+0000 7f01dd200700 1 --2- 172.21.15.84:0/4063631641 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f01c006ec10 0x7f01c00710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:37.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.988+0000 7f01dd200700 1 --2- 172.21.15.84:0/4063631641 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f01c006ec10 0x7f01c00710c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f01c400b970 tx=0x7f01c4009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:37.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:37.992+0000 7f01d5600700 1 -- 172.21.15.84:0/4063631641 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f01cc057700 con 0x7f01d80fc8e0 2024-04-26T21:31:38.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.228+0000 7f01df000700 1 -- 172.21.15.84:0/4063631641 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f01d8102160 con 0x7f01c006ec10 2024-04-26T21:31:38.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.240+0000 7f01d5600700 1 -- 172.21.15.84:0/4063631641 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f01d8102160 con 0x7f01c006ec10 2024-04-26T21:31:38.243 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:31:38.243 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (6m) 43s ago 17m 14.5M - 0.25.0 c8568f914cd2 bcb419cf9108 2024-04-26T21:31:38.243 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (2m) 43s ago 17m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 b4010dfbe623 2024-04-26T21:31:38.243 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (2m) 16s ago 16m 6665k - 19.0.0-3306-gbc612ffb 55dc54019ad8 89a4e50ea23c 2024-04-26T21:31:38.243 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (6m) 43s ago 16m 76.4M - 9.4.7 954c08fa6188 1bf95f604e07 2024-04-26T21:31:38.243 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (10m) 43s ago 10m 114M - 17.2.7-907-g2be3efa9 1c5834633715 485d7884e1d5 2024-04-26T21:31:38.243 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (10m) 43s ago 10m 14.3M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:31:38.243 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (10m) 16s ago 10m 113M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:31:38.243 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (10m) 16s ago 10m 14.3M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:31:38.244 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (5m) 43s ago 18m 505M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:31:38.244 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283,8765 running (4m) 16s ago 15m 453M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d6ae0b4628b5 2024-04-26T21:31:38.244 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (4m) 43s ago 19m 43.8M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 bf610abb6a62 2024-04-26T21:31:38.244 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (3m) 16s ago 15m 34.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 5d530496253b 2024-04-26T21:31:38.244 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (6m) 43s ago 17m 8010k - 1.5.0 0da6a335fe13 81e00b40bfbf 2024-04-26T21:31:38.244 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (6m) 16s ago 16m 7931k - 1.5.0 0da6a335fe13 0506a1d46ec4 2024-04-26T21:31:38.244 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (111s) 43s ago 14m 124M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 99fbe2faa51b 2024-04-26T21:31:38.244 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (81s) 43s ago 14m 84.9M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 2dc81d93f7e5 2024-04-26T21:31:38.244 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (51s) 43s ago 13m 11.2M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 9e77abf095bd 2024-04-26T21:31:38.244 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (21s) 16s ago 13m 11.1M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 d7e5825e2640 2024-04-26T21:31:38.244 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (12m) 16s ago 12m 221M 2581M 17.2.7-907-g2be3efa9 1c5834633715 4d294df735a3 2024-04-26T21:31:38.244 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (12m) 16s ago 12m 207M 2581M 17.2.7-907-g2be3efa9 1c5834633715 9b60997971a8 2024-04-26T21:31:38.244 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (4m) 43s ago 16m 56.2M - 2.43.0 a07b618ecd1d d3008b765eec 2024-04-26T21:31:38.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.243+0000 7f01df000700 1 -- 172.21.15.84:0/4063631641 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f01c006ec10 msgr2=0x7f01c00710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:38.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.243+0000 7f01df000700 1 --2- 172.21.15.84:0/4063631641 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f01c006ec10 0x7f01c00710c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f01c400b970 tx=0x7f01c4009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:38.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.243+0000 7f01df000700 1 -- 172.21.15.84:0/4063631641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d80fc8e0 msgr2=0x7f01d8071d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:38.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.243+0000 7f01df000700 1 --2- 172.21.15.84:0/4063631641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d80fc8e0 0x7f01d8071d70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00b790 tx=0x7f01cc009250 comp rx=0 tx=0).stop 2024-04-26T21:31:38.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.243+0000 7f01df000700 1 -- 172.21.15.84:0/4063631641 shutdown_connections 2024-04-26T21:31:38.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.243+0000 7f01df000700 1 --2- 172.21.15.84:0/4063631641 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f01c006ec10 0x7f01c00710c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:38.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.243+0000 7f01df000700 1 --2- 172.21.15.84:0/4063631641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d80fc8e0 0x7f01d8071d70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:38.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.243+0000 7f01df000700 1 --2- 172.21.15.84:0/4063631641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01d80fe2f0 0x7f01d80702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:38.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.243+0000 7f01df000700 1 -- 172.21.15.84:0/4063631641 >> 172.21.15.84:0/4063631641 conn(0x7f01d80f83b0 msgr2=0x7f01d80f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:38.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.243+0000 7f01df000700 1 -- 172.21.15.84:0/4063631641 shutdown_connections 2024-04-26T21:31:38.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.243+0000 7f01df000700 1 -- 172.21.15.84:0/4063631641 wait complete. 2024-04-26T21:31:38.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.386+0000 7f5920200700 1 -- 172.21.15.84:0/3353815343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59180fce60 msgr2=0x7f59180fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:38.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.386+0000 7f5920200700 1 --2- 172.21.15.84:0/3353815343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59180fce60 0x7f59180fd270 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f590c009ce0 tx=0x7f590c004d10 comp rx=0 tx=0).stop 2024-04-26T21:31:38.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.386+0000 7f5920200700 1 -- 172.21.15.84:0/3353815343 shutdown_connections 2024-04-26T21:31:38.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.386+0000 7f5920200700 1 --2- 172.21.15.84:0/3353815343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59180fdfd0 0x7f59180fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:38.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.386+0000 7f5920200700 1 --2- 172.21.15.84:0/3353815343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59180fce60 0x7f59180fd270 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:38.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.386+0000 7f5920200700 1 -- 172.21.15.84:0/3353815343 >> 172.21.15.84:0/3353815343 conn(0x7f59180f8540 msgr2=0x7f59180fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:38.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.386+0000 7f5920200700 1 -- 172.21.15.84:0/3353815343 shutdown_connections 2024-04-26T21:31:38.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.386+0000 7f5920200700 1 -- 172.21.15.84:0/3353815343 wait complete. 2024-04-26T21:31:38.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.387+0000 7f5920200700 1 Processor -- start 2024-04-26T21:31:38.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.387+0000 7f5920200700 1 -- start start 2024-04-26T21:31:38.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.388+0000 7f5920200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59180fce60 0x7f591810dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:38.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.388+0000 7f5920200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59180fdfd0 0x7f591810e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:38.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.388+0000 7f5920200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591810e6a0 con 0x7f59180fce60 2024-04-26T21:31:38.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.388+0000 7f5920200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5918113040 con 0x7f59180fdfd0 2024-04-26T21:31:38.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.388+0000 7f591d800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59180fce60 0x7f591810dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:38.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.388+0000 7f591d800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59180fce60 0x7f591810dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35846/0 (socket says 172.21.15.84:35846) 2024-04-26T21:31:38.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.388+0000 7f591d800700 1 -- 172.21.15.84:0/2338927929 learned_addr learned my addr 172.21.15.84:0/2338927929 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:31:38.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.388+0000 7f591d800700 1 -- 172.21.15.84:0/2338927929 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59180fdfd0 msgr2=0x7f591810e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:38.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.388+0000 7f591d800700 1 --2- 172.21.15.84:0/2338927929 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59180fdfd0 0x7f591810e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:38.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.388+0000 7f591d800700 1 -- 172.21.15.84:0/2338927929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c009940 con 0x7f59180fce60 2024-04-26T21:31:38.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.389+0000 7f591d800700 1 --2- 172.21.15.84:0/2338927929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59180fce60 0x7f591810dad0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f590c005010 tx=0x7f590c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:38.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.389+0000 7f5915600700 1 -- 172.21.15.84:0/2338927929 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f590c00e040 con 0x7f59180fce60 2024-04-26T21:31:38.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.389+0000 7f5915600700 1 -- 172.21.15.84:0/2338927929 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f590c0128e0 con 0x7f59180fce60 2024-04-26T21:31:38.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.389+0000 7f5915600700 1 -- 172.21.15.84:0/2338927929 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f590c01c910 con 0x7f59180fce60 2024-04-26T21:31:38.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.389+0000 7f5920200700 1 -- 172.21.15.84:0/2338927929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5918113240 con 0x7f59180fce60 2024-04-26T21:31:38.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.389+0000 7f5920200700 1 -- 172.21.15.84:0/2338927929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59181137b0 con 0x7f59180fce60 2024-04-26T21:31:38.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.390+0000 7f5920200700 1 -- 172.21.15.84:0/2338927929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f591804c710 con 0x7f59180fce60 2024-04-26T21:31:38.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.391+0000 7f5915600700 1 -- 172.21.15.84:0/2338927929 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f590c012410 con 0x7f59180fce60 2024-04-26T21:31:38.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.392+0000 7f5915600700 1 --2- 172.21.15.84:0/2338927929 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f590006ec00 0x7f59000710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:38.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.392+0000 7f5915600700 1 -- 172.21.15.84:0/2338927929 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f590c090630 con 0x7f59180fce60 2024-04-26T21:31:38.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.393+0000 7f591ce00700 1 --2- 172.21.15.84:0/2338927929 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f590006ec00 0x7f59000710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:38.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.393+0000 7f591ce00700 1 --2- 172.21.15.84:0/2338927929 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f590006ec00 0x7f59000710b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5904006fd0 tx=0x7f5904006db0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:38.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.397+0000 7f5915600700 1 -- 172.21.15.84:0/2338927929 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f590c05ce90 con 0x7f59180fce60 2024-04-26T21:31:38.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.696+0000 7f5920200700 1 -- 172.21.15.84:0/2338927929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5918113ae0 con 0x7f59180fce60 2024-04-26T21:31:38.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.696+0000 7f5915600700 1 -- 172.21.15.84:0/2338927929 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f590c004e30 con 0x7f59180fce60 2024-04-26T21:31:38.698 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:31:38.698 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:31:38.699 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:31:38.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:31:38.699 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:31:38.699 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:31:38.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:31:38.699 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:31:38.699 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2, 2024-04-26T21:31:38.699 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 4 2024-04-26T21:31:38.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:31:38.699 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:31:38.699 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-26T21:31:38.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:31:38.699 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:31:38.699 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6, 2024-04-26T21:31:38.699 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 8 2024-04-26T21:31:38.700 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:31:38.700 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:31:38.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.699+0000 7f5920200700 1 -- 172.21.15.84:0/2338927929 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f590006ec00 msgr2=0x7f59000710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:38.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.699+0000 7f5920200700 1 --2- 172.21.15.84:0/2338927929 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f590006ec00 0x7f59000710b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5904006fd0 tx=0x7f5904006db0 comp rx=0 tx=0).stop 2024-04-26T21:31:38.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.699+0000 7f5920200700 1 -- 172.21.15.84:0/2338927929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59180fce60 msgr2=0x7f591810dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:38.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.699+0000 7f5920200700 1 --2- 172.21.15.84:0/2338927929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59180fce60 0x7f591810dad0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f590c005010 tx=0x7f590c004d10 comp rx=0 tx=0).stop 2024-04-26T21:31:38.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.699+0000 7f5920200700 1 -- 172.21.15.84:0/2338927929 shutdown_connections 2024-04-26T21:31:38.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.699+0000 7f5920200700 1 --2- 172.21.15.84:0/2338927929 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f590006ec00 0x7f59000710b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:38.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.699+0000 7f5920200700 1 --2- 172.21.15.84:0/2338927929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59180fce60 0x7f591810dad0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:38.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.699+0000 7f5920200700 1 --2- 172.21.15.84:0/2338927929 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59180fdfd0 0x7f591810e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:38.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.699+0000 7f5920200700 1 -- 172.21.15.84:0/2338927929 >> 172.21.15.84:0/2338927929 conn(0x7f59180f8540 msgr2=0x7f59180f9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:38.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.699+0000 7f5920200700 1 -- 172.21.15.84:0/2338927929 shutdown_connections 2024-04-26T21:31:38.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.700+0000 7f5920200700 1 -- 172.21.15.84:0/2338927929 wait complete. 2024-04-26T21:31:38.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.846+0000 7f4038200700 1 -- 172.21.15.84:0/3975814091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40301033f0 msgr2=0x7f4030103800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:38.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.846+0000 7f4038200700 1 --2- 172.21.15.84:0/3975814091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40301033f0 0x7f4030103800 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4024004940 tx=0x7f4024009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:38.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.846+0000 7f4038200700 1 -- 172.21.15.84:0/3975814091 shutdown_connections 2024-04-26T21:31:38.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.846+0000 7f4038200700 1 --2- 172.21.15.84:0/3975814091 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40301046a0 0x7f4030104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:38.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.846+0000 7f4038200700 1 --2- 172.21.15.84:0/3975814091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40301033f0 0x7f4030103800 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:38.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.846+0000 7f4038200700 1 -- 172.21.15.84:0/3975814091 >> 172.21.15.84:0/3975814091 conn(0x7f40300725e0 msgr2=0x7f4030074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:38.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.846+0000 7f4038200700 1 -- 172.21.15.84:0/3975814091 shutdown_connections 2024-04-26T21:31:38.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.846+0000 7f4038200700 1 -- 172.21.15.84:0/3975814091 wait complete. 2024-04-26T21:31:38.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.847+0000 7f4038200700 1 Processor -- start 2024-04-26T21:31:38.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.847+0000 7f4038200700 1 -- start start 2024-04-26T21:31:38.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.847+0000 7f4038200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40301033f0 0x7f4030113f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:38.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.847+0000 7f4038200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40301046a0 0x7f4030114460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:38.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.847+0000 7f4038200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4030114af0 con 0x7f40301033f0 2024-04-26T21:31:38.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.847+0000 7f4038200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4030119490 con 0x7f40301046a0 2024-04-26T21:31:38.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.848+0000 7f4035800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40301033f0 0x7f4030113f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:38.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.848+0000 7f4035800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40301033f0 0x7f4030113f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35856/0 (socket says 172.21.15.84:35856) 2024-04-26T21:31:38.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.848+0000 7f4035800700 1 -- 172.21.15.84:0/2041810683 learned_addr learned my addr 172.21.15.84:0/2041810683 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:31:38.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.848+0000 7f4035800700 1 -- 172.21.15.84:0/2041810683 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40301046a0 msgr2=0x7f4030114460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:38.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.848+0000 7f4034e00700 1 --2- 172.21.15.84:0/2041810683 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40301046a0 0x7f4030114460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:38.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.848+0000 7f4035800700 1 --2- 172.21.15.84:0/2041810683 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40301046a0 0x7f4030114460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:38.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.848+0000 7f4035800700 1 -- 172.21.15.84:0/2041810683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4024005040 con 0x7f40301033f0 2024-04-26T21:31:38.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.848+0000 7f4034e00700 1 --2- 172.21.15.84:0/2041810683 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40301046a0 0x7f4030114460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:31:38.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.848+0000 7f4035800700 1 --2- 172.21.15.84:0/2041810683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40301033f0 0x7f4030113f20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f402400b3b0 tx=0x7f4024009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:38.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.849+0000 7f402d600700 1 -- 172.21.15.84:0/2041810683 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f402400e040 con 0x7f40301033f0 2024-04-26T21:31:38.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.849+0000 7f402d600700 1 -- 172.21.15.84:0/2041810683 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4024004290 con 0x7f40301033f0 2024-04-26T21:31:38.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.849+0000 7f4038200700 1 -- 172.21.15.84:0/2041810683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4030119690 con 0x7f40301033f0 2024-04-26T21:31:38.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.849+0000 7f402d600700 1 -- 172.21.15.84:0/2041810683 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f402401c630 con 0x7f40301033f0 2024-04-26T21:31:38.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.849+0000 7f4038200700 1 -- 172.21.15.84:0/2041810683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4030119c00 con 0x7f40301033f0 2024-04-26T21:31:38.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.850+0000 7f4038200700 1 -- 172.21.15.84:0/2041810683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f403004c710 con 0x7f40301033f0 2024-04-26T21:31:38.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.851+0000 7f402d600700 1 -- 172.21.15.84:0/2041810683 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f402400bbf0 con 0x7f40301033f0 2024-04-26T21:31:38.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.852+0000 7f402d600700 1 --2- 172.21.15.84:0/2041810683 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f401806ec00 0x7f40180710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:38.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.852+0000 7f402d600700 1 -- 172.21.15.84:0/2041810683 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f402408fdc0 con 0x7f40301033f0 2024-04-26T21:31:38.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.852+0000 7f4034e00700 1 --2- 172.21.15.84:0/2041810683 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f401806ec00 0x7f40180710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:38.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.853+0000 7f4034e00700 1 --2- 172.21.15.84:0/2041810683 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f401806ec00 0x7f40180710b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f401c006fd0 tx=0x7f401c008040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:38.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:38.856+0000 7f402d600700 1 -- 172.21.15.84:0/2041810683 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f4024093030 con 0x7f40301033f0 2024-04-26T21:31:39.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.131+0000 7f4038200700 1 -- 172.21.15.84:0/2041810683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f403011a080 con 0x7f40301033f0 2024-04-26T21:31:39.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.132+0000 7f402d600700 1 -- 172.21.15.84:0/2041810683 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1903 (secure 0 0 0) 0x7f402405c620 con 0x7f40301033f0 2024-04-26T21:31:39.135 INFO:teuthology.orchestra.run.smithi084.stdout:e17 2024-04-26T21:31:39.135 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:31:39.135 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:31:39.135 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:31:39.135 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:31:39.135 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:31:39.135 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:31:39.135 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 17 2024-04-26T21:31:39.135 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:31:39.135 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:31:39.135 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:30:28.772328+0000 2024-04-26T21:31:39.136 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:31:39.136 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:31:39.136 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:31:39.136 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:31:39.136 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:31:39.136 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-04-26T21:31:39.136 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:31:39.136 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:31:39.136 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:31:39.136 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:31:39.136 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:31:39.136 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:31:39.136 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456,1=24231} 2024-04-26T21:31:39.136 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:31:39.136 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:31:39.136 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:31:39.137 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:31:39.137 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:31:39.137 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:31:39.137 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:31:39.137 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-04-26T21:31:39.137 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:31:39.137 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 14456 members: 24231,14456 2024-04-26T21:31:39.137 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:31:39.137 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:31:39.137 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:31:39.137 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:31:39.137 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:31:39.137 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:31:39.137 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:31:39.137 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:31:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.135+0000 7f4038200700 1 -- 172.21.15.84:0/2041810683 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f401806ec00 msgr2=0x7f40180710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.135+0000 7f4038200700 1 --2- 172.21.15.84:0/2041810683 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f401806ec00 0x7f40180710b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f401c006fd0 tx=0x7f401c008040 comp rx=0 tx=0).stop 2024-04-26T21:31:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.135+0000 7f4038200700 1 -- 172.21.15.84:0/2041810683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40301033f0 msgr2=0x7f4030113f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.135+0000 7f4038200700 1 --2- 172.21.15.84:0/2041810683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40301033f0 0x7f4030113f20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f402400b3b0 tx=0x7f4024009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.135+0000 7f4038200700 1 -- 172.21.15.84:0/2041810683 shutdown_connections 2024-04-26T21:31:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.135+0000 7f4038200700 1 --2- 172.21.15.84:0/2041810683 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f401806ec00 0x7f40180710b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.135+0000 7f4038200700 1 --2- 172.21.15.84:0/2041810683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40301033f0 0x7f4030113f20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.135+0000 7f4038200700 1 --2- 172.21.15.84:0/2041810683 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40301046a0 0x7f4030114460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.135+0000 7f4038200700 1 -- 172.21.15.84:0/2041810683 >> 172.21.15.84:0/2041810683 conn(0x7f40300725e0 msgr2=0x7f4030073c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.136+0000 7f4038200700 1 -- 172.21.15.84:0/2041810683 shutdown_connections 2024-04-26T21:31:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.136+0000 7f4038200700 1 -- 172.21.15.84:0/2041810683 wait complete. 2024-04-26T21:31:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2024-04-26T21:31:39.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:39 smithi120 ceph-mon[79001]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:31:39.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:39 smithi120 ceph-mon[79001]: pgmap v151: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:39.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:39 smithi120 ceph-mon[79001]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:31:39.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:39 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2338927929' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:31:39.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.281+0000 7f5142a00700 1 -- 172.21.15.84:0/776539877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f513c1046a0 msgr2=0x7f513c104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:39.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.281+0000 7f5142a00700 1 --2- 172.21.15.84:0/776539877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f513c1046a0 0x7f513c104b10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5128004940 tx=0x7f5128009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:39.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.282+0000 7f5142a00700 1 -- 172.21.15.84:0/776539877 shutdown_connections 2024-04-26T21:31:39.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.282+0000 7f5142a00700 1 --2- 172.21.15.84:0/776539877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f513c1046a0 0x7f513c104b10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:39.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.282+0000 7f5142a00700 1 --2- 172.21.15.84:0/776539877 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f513c1033f0 0x7f513c103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:39.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.282+0000 7f5142a00700 1 -- 172.21.15.84:0/776539877 >> 172.21.15.84:0/776539877 conn(0x7f513c0725e0 msgr2=0x7f513c074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:39.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.282+0000 7f5142a00700 1 -- 172.21.15.84:0/776539877 shutdown_connections 2024-04-26T21:31:39.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.282+0000 7f5142a00700 1 -- 172.21.15.84:0/776539877 wait complete. 2024-04-26T21:31:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.282+0000 7f5142a00700 1 Processor -- start 2024-04-26T21:31:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.283+0000 7f5142a00700 1 -- start start 2024-04-26T21:31:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.283+0000 7f5142a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f513c1033f0 0x7f513c113f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.283+0000 7f5142a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f513c1046a0 0x7f513c114460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.283+0000 7f5142a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c114af0 con 0x7f513c1033f0 2024-04-26T21:31:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.283+0000 7f5142a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c119490 con 0x7f513c1046a0 2024-04-26T21:31:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.283+0000 7f513be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f513c1033f0 0x7f513c113f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.283+0000 7f513be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f513c1033f0 0x7f513c113f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35880/0 (socket says 172.21.15.84:35880) 2024-04-26T21:31:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.283+0000 7f513be00700 1 -- 172.21.15.84:0/2962243162 learned_addr learned my addr 172.21.15.84:0/2962243162 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:31:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.284+0000 7f513be00700 1 -- 172.21.15.84:0/2962243162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f513c1046a0 msgr2=0x7f513c114460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.284+0000 7f513be00700 1 --2- 172.21.15.84:0/2962243162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f513c1046a0 0x7f513c114460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.284+0000 7f513be00700 1 -- 172.21.15.84:0/2962243162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5128005040 con 0x7f513c1033f0 2024-04-26T21:31:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.284+0000 7f513be00700 1 --2- 172.21.15.84:0/2962243162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f513c1033f0 0x7f513c113f20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f512c00b790 tx=0x7f512c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.284+0000 7f5133e00700 1 -- 172.21.15.84:0/2962243162 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f512c00f770 con 0x7f513c1033f0 2024-04-26T21:31:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.284+0000 7f5133e00700 1 -- 172.21.15.84:0/2962243162 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f512c00fda0 con 0x7f513c1033f0 2024-04-26T21:31:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.284+0000 7f5133e00700 1 -- 172.21.15.84:0/2962243162 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f512c00d310 con 0x7f513c1033f0 2024-04-26T21:31:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.284+0000 7f5142a00700 1 -- 172.21.15.84:0/2962243162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f513c1196f0 con 0x7f513c1033f0 2024-04-26T21:31:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.284+0000 7f5142a00700 1 -- 172.21.15.84:0/2962243162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513c119c60 con 0x7f513c1033f0 2024-04-26T21:31:39.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.285+0000 7f5142a00700 1 -- 172.21.15.84:0/2962243162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f513c04c710 con 0x7f513c1033f0 2024-04-26T21:31:39.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.286+0000 7f5133e00700 1 -- 172.21.15.84:0/2962243162 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f512c010420 con 0x7f513c1033f0 2024-04-26T21:31:39.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.288+0000 7f5133e00700 1 --2- 172.21.15.84:0/2962243162 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f512006ec00 0x7f51200710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:39.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.288+0000 7f5133e00700 1 -- 172.21.15.84:0/2962243162 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f512c08e8f0 con 0x7f513c1033f0 2024-04-26T21:31:39.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.288+0000 7f513b400700 1 --2- 172.21.15.84:0/2962243162 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f512006ec00 0x7f51200710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:39.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.289+0000 7f513b400700 1 --2- 172.21.15.84:0/2962243162 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f512006ec00 0x7f51200710b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5128004f90 tx=0x7f5128009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:39.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.293+0000 7f5133e00700 1 -- 172.21.15.84:0/2962243162 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f512c05b1d0 con 0x7f513c1033f0 2024-04-26T21:31:39.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:39 smithi084 ceph-mon[90138]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:31:39.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:39 smithi084 ceph-mon[90138]: pgmap v151: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:39.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:39 smithi084 ceph-mon[90138]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:31:39.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:39 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2338927929' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:31:39.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.522+0000 7f5142a00700 1 -- 172.21.15.84:0/2962243162 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f513c108940 con 0x7f512006ec00 2024-04-26T21:31:39.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.526+0000 7f5133e00700 1 -- 172.21.15.84:0/2962243162 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f513c108940 con 0x7f512006ec00 2024-04-26T21:31:39.527 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:31:39.528 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:31:39.528 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:31:39.528 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:31:39.528 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-04-26T21:31:39.528 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr", 2024-04-26T21:31:39.528 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-04-26T21:31:39.528 INFO:teuthology.orchestra.run.smithi084.stdout: "crash" 2024-04-26T21:31:39.528 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-04-26T21:31:39.528 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "10/21 daemons upgraded", 2024-04-26T21:31:39.528 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading osd daemons", 2024-04-26T21:31:39.528 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:31:39.528 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:31:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.529+0000 7f5142a00700 1 -- 172.21.15.84:0/2962243162 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f512006ec00 msgr2=0x7f51200710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.529+0000 7f5142a00700 1 --2- 172.21.15.84:0/2962243162 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f512006ec00 0x7f51200710b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5128004f90 tx=0x7f5128009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.529+0000 7f5142a00700 1 -- 172.21.15.84:0/2962243162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f513c1033f0 msgr2=0x7f513c113f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.529+0000 7f5142a00700 1 --2- 172.21.15.84:0/2962243162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f513c1033f0 0x7f513c113f20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f512c00b790 tx=0x7f512c009250 comp rx=0 tx=0).stop 2024-04-26T21:31:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.529+0000 7f5142a00700 1 -- 172.21.15.84:0/2962243162 shutdown_connections 2024-04-26T21:31:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.529+0000 7f5142a00700 1 --2- 172.21.15.84:0/2962243162 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f512006ec00 0x7f51200710b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.529+0000 7f5142a00700 1 --2- 172.21.15.84:0/2962243162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f513c1033f0 0x7f513c113f20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.529+0000 7f5142a00700 1 --2- 172.21.15.84:0/2962243162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f513c1046a0 0x7f513c114460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.529+0000 7f5142a00700 1 -- 172.21.15.84:0/2962243162 >> 172.21.15.84:0/2962243162 conn(0x7f513c0725e0 msgr2=0x7f513c073c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.529+0000 7f5142a00700 1 -- 172.21.15.84:0/2962243162 shutdown_connections 2024-04-26T21:31:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.529+0000 7f5142a00700 1 -- 172.21.15.84:0/2962243162 wait complete. 2024-04-26T21:31:39.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.681+0000 7f08d3600700 1 -- 172.21.15.84:0/1459020903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08cc0ffee0 msgr2=0x7f08cc102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:39.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.681+0000 7f08d3600700 1 --2- 172.21.15.84:0/1459020903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08cc0ffee0 0x7f08cc102300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f08b8004940 tx=0x7f08b8009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:39.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.681+0000 7f08d3600700 1 -- 172.21.15.84:0/1459020903 shutdown_connections 2024-04-26T21:31:39.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.681+0000 7f08d3600700 1 --2- 172.21.15.84:0/1459020903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08cc0ffee0 0x7f08cc102300 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:39.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.681+0000 7f08d3600700 1 --2- 172.21.15.84:0/1459020903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08cc0662c0 0x7f08cc0ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:39.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.681+0000 7f08d3600700 1 -- 172.21.15.84:0/1459020903 >> 172.21.15.84:0/1459020903 conn(0x7f08cc0f7430 msgr2=0x7f08cc0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:39.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.681+0000 7f08d3600700 1 -- 172.21.15.84:0/1459020903 shutdown_connections 2024-04-26T21:31:39.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.681+0000 7f08d3600700 1 -- 172.21.15.84:0/1459020903 wait complete. 2024-04-26T21:31:39.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.682+0000 7f08d3600700 1 Processor -- start 2024-04-26T21:31:39.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.682+0000 7f08d3600700 1 -- start start 2024-04-26T21:31:39.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.683+0000 7f08d3600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08cc0662c0 0x7f08cc10fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:39.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.683+0000 7f08d3600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08cc0ffee0 0x7f08cc110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:39.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.683+0000 7f08d3600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc110790 con 0x7f08cc0662c0 2024-04-26T21:31:39.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.683+0000 7f08d3600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc110fe0 con 0x7f08cc0ffee0 2024-04-26T21:31:39.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.683+0000 7f08d0c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08cc0662c0 0x7f08cc10fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:39.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.683+0000 7f08d0c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08cc0662c0 0x7f08cc10fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35908/0 (socket says 172.21.15.84:35908) 2024-04-26T21:31:39.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.683+0000 7f08d0c00700 1 -- 172.21.15.84:0/2056170311 learned_addr learned my addr 172.21.15.84:0/2056170311 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:31:39.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.683+0000 7f08d0c00700 1 -- 172.21.15.84:0/2056170311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08cc0ffee0 msgr2=0x7f08cc110190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:39.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.683+0000 7f08d0c00700 1 --2- 172.21.15.84:0/2056170311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08cc0ffee0 0x7f08cc110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:39.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.683+0000 7f08d0c00700 1 -- 172.21.15.84:0/2056170311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b8005040 con 0x7f08cc0662c0 2024-04-26T21:31:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.684+0000 7f08d0c00700 1 --2- 172.21.15.84:0/2056170311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08cc0662c0 0x7f08cc10fc50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f08c0001cd0 tx=0x7f08c0009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.684+0000 7f08c8c00700 1 -- 172.21.15.84:0/2056170311 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08c0004020 con 0x7f08cc0662c0 2024-04-26T21:31:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.684+0000 7f08c8c00700 1 -- 172.21.15.84:0/2056170311 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f08c000f040 con 0x7f08cc0662c0 2024-04-26T21:31:39.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.684+0000 7f08c8c00700 1 -- 172.21.15.84:0/2056170311 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08c0009310 con 0x7f08cc0662c0 2024-04-26T21:31:39.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.684+0000 7f08d3600700 1 -- 172.21.15.84:0/2056170311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08cc1112c0 con 0x7f08cc0662c0 2024-04-26T21:31:39.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.684+0000 7f08d3600700 1 -- 172.21.15.84:0/2056170311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08cc1117b0 con 0x7f08cc0662c0 2024-04-26T21:31:39.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.685+0000 7f08d3600700 1 -- 172.21.15.84:0/2056170311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08cc05f5c0 con 0x7f08cc0662c0 2024-04-26T21:31:39.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.686+0000 7f08c8c00700 1 -- 172.21.15.84:0/2056170311 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f08c0009530 con 0x7f08cc0662c0 2024-04-26T21:31:39.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.687+0000 7f08c8c00700 1 --2- 172.21.15.84:0/2056170311 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f08b406ec10 0x7f08b40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:31:39.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.687+0000 7f08c8c00700 1 -- 172.21.15.84:0/2056170311 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f08c008e350 con 0x7f08cc0662c0 2024-04-26T21:31:39.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.687+0000 7f08cbe00700 1 --2- 172.21.15.84:0/2056170311 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f08b406ec10 0x7f08b40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:31:39.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.688+0000 7f08cbe00700 1 --2- 172.21.15.84:0/2056170311 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f08b406ec10 0x7f08b40710c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f08b8004f90 tx=0x7f08b8009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:31:39.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:39.692+0000 7f08c8c00700 1 -- 172.21.15.84:0/2056170311 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f08c005abb0 con 0x7f08cc0662c0 2024-04-26T21:31:40.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:40.008+0000 7f08d3600700 1 -- 172.21.15.84:0/2056170311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f08cc04bed0 con 0x7f08cc0662c0 2024-04-26T21:31:40.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:40.009+0000 7f08c8c00700 1 -- 172.21.15.84:0/2056170311 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f08c00097e0 con 0x7f08cc0662c0 2024-04-26T21:31:40.011 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:31:40.011 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:31:40.011 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:31:40.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:40.012+0000 7f08d3600700 1 -- 172.21.15.84:0/2056170311 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f08b406ec10 msgr2=0x7f08b40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:40.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:40.012+0000 7f08d3600700 1 --2- 172.21.15.84:0/2056170311 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f08b406ec10 0x7f08b40710c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f08b8004f90 tx=0x7f08b8009e30 comp rx=0 tx=0).stop 2024-04-26T21:31:40.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:40.012+0000 7f08d3600700 1 -- 172.21.15.84:0/2056170311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08cc0662c0 msgr2=0x7f08cc10fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:31:40.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:40.012+0000 7f08d3600700 1 --2- 172.21.15.84:0/2056170311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08cc0662c0 0x7f08cc10fc50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f08c0001cd0 tx=0x7f08c0009ef0 comp rx=0 tx=0).stop 2024-04-26T21:31:40.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:40.012+0000 7f08d3600700 1 -- 172.21.15.84:0/2056170311 shutdown_connections 2024-04-26T21:31:40.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:40.012+0000 7f08d3600700 1 --2- 172.21.15.84:0/2056170311 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f08b406ec10 0x7f08b40710c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:40.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:40.012+0000 7f08d3600700 1 --2- 172.21.15.84:0/2056170311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08cc0662c0 0x7f08cc10fc50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:40.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:40.012+0000 7f08d3600700 1 --2- 172.21.15.84:0/2056170311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08cc0ffee0 0x7f08cc110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:31:40.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:40.012+0000 7f08d3600700 1 -- 172.21.15.84:0/2056170311 >> 172.21.15.84:0/2056170311 conn(0x7f08cc0f7430 msgr2=0x7f08cc0fbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:31:40.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:40.012+0000 7f08d3600700 1 -- 172.21.15.84:0/2056170311 shutdown_connections 2024-04-26T21:31:40.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:31:40.012+0000 7f08d3600700 1 -- 172.21.15.84:0/2056170311 wait complete. 2024-04-26T21:31:40.408 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:40 smithi084 ceph-mon[90138]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:31:40.408 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:40.408 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:40 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2041810683' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:31:40.408 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:40 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2056170311' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:31:40.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:40 smithi120 ceph-mon[79001]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:31:40.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:40.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:40 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2041810683' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:31:40.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:40 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2056170311' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:31:41.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:41 smithi084 ceph-mon[90138]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:31:41.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:41 smithi084 ceph-mon[90138]: pgmap v152: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:41.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:41 smithi120 ceph-mon[79001]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:31:41.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:41 smithi120 ceph-mon[79001]: pgmap v152: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:43.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:43 smithi084 ceph-mon[90138]: pgmap v153: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:43.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:43 smithi120 ceph-mon[79001]: pgmap v153: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:45 smithi084 ceph-mon[90138]: pgmap v154: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:31:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-26T21:31:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:45 smithi120 ceph-mon[79001]: pgmap v154: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:31:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-26T21:31:46.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:46 smithi120 ceph-mon[79001]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-26T21:31:46.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:46 smithi120 ceph-mon[79001]: Upgrade: osd.4 is safe to restart 2024-04-26T21:31:46.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:46 smithi084 ceph-mon[90138]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-26T21:31:46.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:46 smithi084 ceph-mon[90138]: Upgrade: osd.4 is safe to restart 2024-04-26T21:31:47.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:47 smithi084 ceph-mon[90138]: pgmap v155: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:47.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:47 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:47.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:47 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T21:31:47.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:47 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:31:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:47 smithi120 ceph-mon[79001]: pgmap v155: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:47 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:31:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:47 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T21:31:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:47 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:31:48.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:48 smithi120 ceph-mon[79001]: Upgrade: Updating osd.4 2024-04-26T21:31:48.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:48 smithi120 ceph-mon[79001]: Deploying daemon osd.4 on smithi120 2024-04-26T21:31:48.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:48 smithi084 ceph-mon[90138]: Upgrade: Updating osd.4 2024-04-26T21:31:48.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:48 smithi084 ceph-mon[90138]: Deploying daemon osd.4 on smithi120 2024-04-26T21:31:49.385 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:49 smithi120 ceph-mon[79001]: pgmap v156: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:49.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:49 smithi084 ceph-mon[90138]: pgmap v156: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:51.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:51 smithi084 ceph-mon[90138]: pgmap v157: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:51 smithi120 ceph-mon[79001]: pgmap v157: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:51.871 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:51 smithi120 systemd[1]: Stopping Ceph osd.4 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:31:52.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:52 smithi120 ceph-mon[79001]: osd.4 marked itself down and dead 2024-04-26T21:31:52.183 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:51 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[44891]: 2024-04-26T21:31:51.868+0000 7eff12c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:31:52.183 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:51 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[44891]: 2024-04-26T21:31:51.868+0000 7eff12c00700 -1 osd.4 79 *** Got signal Terminated *** 2024-04-26T21:31:52.183 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:51 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[44891]: 2024-04-26T21:31:51.868+0000 7eff12c00700 -1 osd.4 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:31:52.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:52 smithi084 ceph-mon[90138]: osd.4 marked itself down and dead 2024-04-26T21:31:52.860 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:52 smithi120 podman[93149]: 2024-04-26 21:31:52.558528947 +0000 UTC m=+0.820675768 container died 4d294df735a3062bdaf94ac89772955f5d29705c35a5be9818c43747aa50f772 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=quincy-2be3efa, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-26T21:31:53.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:53 smithi120 ceph-mon[79001]: pgmap v158: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:53.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:53 smithi120 ceph-mon[79001]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:31:53.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:53 smithi120 ceph-mon[79001]: osdmap e80: 6 total, 5 up, 6 in 2024-04-26T21:31:53.183 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:52 smithi120 podman[93149]: 2024-04-26 21:31:52.995958322 +0000 UTC m=+1.258105177 container cleanup 4d294df735a3062bdaf94ac89772955f5d29705c35a5be9818c43747aa50f772 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=quincy-2be3efa, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-04-26T21:31:53.183 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:52 smithi120 bash[93149]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4 2024-04-26T21:31:53.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:53 smithi084 ceph-mon[90138]: pgmap v158: 65 pgs: 65 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:31:53.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:53 smithi084 ceph-mon[90138]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:31:53.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:53 smithi084 ceph-mon[90138]: osdmap e80: 6 total, 5 up, 6 in 2024-04-26T21:31:53.682 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:53 smithi120 podman[93170]: 2024-04-26 21:31:53.222361165 +0000 UTC m=+0.650210609 container remove 4d294df735a3062bdaf94ac89772955f5d29705c35a5be9818c43747aa50f772 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=quincy-2be3efa, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-26T21:31:54.386 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:54 smithi120 ceph-mon[79001]: osdmap e81: 6 total, 5 up, 6 in 2024-04-26T21:31:54.387 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:54 smithi120 podman[93260]: 2024-04-26 21:31:53.950209109 +0000 UTC m=+0.033975249 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:31:54.387 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:54 smithi120 podman[93260]: 2024-04-26 21:31:54.092934269 +0000 UTC m=+0.176700466 container create 5be7ad631b0d353b7d6863e3e4895fb0256e2b019308184ab208f0dc2b958183 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True) 2024-04-26T21:31:54.387 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:54 smithi120 podman[93260]: 2024-04-26 21:31:54.385747005 +0000 UTC m=+0.469513208 container init 5be7ad631b0d353b7d6863e3e4895fb0256e2b019308184ab208f0dc2b958183 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-26T21:31:54.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:54 smithi084 ceph-mon[90138]: osdmap e81: 6 total, 5 up, 6 in 2024-04-26T21:31:54.682 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:54 smithi120 podman[93260]: 2024-04-26 21:31:54.397909758 +0000 UTC m=+0.481675910 container start 5be7ad631b0d353b7d6863e3e4895fb0256e2b019308184ab208f0dc2b958183 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T21:31:54.682 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:54 smithi120 podman[93260]: 2024-04-26 21:31:54.562876563 +0000 UTC m=+0.646642756 container attach 5be7ad631b0d353b7d6863e3e4895fb0256e2b019308184ab208f0dc2b958183 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T21:31:55.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:55 smithi120 ceph-mon[79001]: pgmap v161: 65 pgs: 10 active+undersized+degraded, 2 peering, 2 stale+active+clean, 8 active+undersized, 43 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 44/363 objects degraded (12.121%) 2024-04-26T21:31:55.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:55 smithi120 ceph-mon[79001]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-26T21:31:55.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:55 smithi120 ceph-mon[79001]: Health check failed: Degraded data redundancy: 44/363 objects degraded (12.121%), 10 pgs degraded (PG_DEGRADED) 2024-04-26T21:31:55.183 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:54 smithi120 podman[93260]: 2024-04-26 21:31:54.849913433 +0000 UTC m=+0.933679566 container died 5be7ad631b0d353b7d6863e3e4895fb0256e2b019308184ab208f0dc2b958183 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T21:31:55.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:55 smithi084 ceph-mon[90138]: pgmap v161: 65 pgs: 10 active+undersized+degraded, 2 peering, 2 stale+active+clean, 8 active+undersized, 43 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 44/363 objects degraded (12.121%) 2024-04-26T21:31:55.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:55 smithi084 ceph-mon[90138]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-26T21:31:55.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:55 smithi084 ceph-mon[90138]: Health check failed: Degraded data redundancy: 44/363 objects degraded (12.121%), 10 pgs degraded (PG_DEGRADED) 2024-04-26T21:31:55.932 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:55 smithi120 podman[93286]: 2024-04-26 21:31:55.547035993 +0000 UTC m=+0.679015493 container remove 5be7ad631b0d353b7d6863e3e4895fb0256e2b019308184ab208f0dc2b958183 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-deactivate, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-26T21:31:55.932 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:55 smithi120 systemd[1]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.4.service: Deactivated successfully. 2024-04-26T21:31:55.933 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:55 smithi120 systemd[1]: Stopped Ceph osd.4 for 8bb44d26-0411-11ef-bc93-c7b262605968. 2024-04-26T21:31:55.933 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:55 smithi120 systemd[1]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.4.service: Consumed 1min 38.420s CPU time. 2024-04-26T21:31:56.297 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:56 smithi120 ceph-mon[79001]: pgmap v162: 65 pgs: 16 active+undersized+degraded, 2 peering, 14 active+undersized, 33 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/363 objects degraded (17.080%) 2024-04-26T21:31:56.297 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:55 smithi120 systemd[1]: Starting Ceph osd.4 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:31:56.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:56 smithi084 ceph-mon[90138]: pgmap v162: 65 pgs: 16 active+undersized+degraded, 2 peering, 14 active+undersized, 33 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/363 objects degraded (17.080%) 2024-04-26T21:31:56.550 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:56 smithi120 podman[93386]: 2024-04-26 21:31:56.201234402 +0000 UTC m=+0.034106292 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:31:56.550 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:56 smithi120 podman[93386]: 2024-04-26 21:31:56.342225922 +0000 UTC m=+0.175097836 container create 818ff570b7244a53fedc75f61fda6b48c7fb3dadea018636d5a9ea32596cfa2a (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-activate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-26T21:31:56.932 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:56 smithi120 podman[93386]: 2024-04-26 21:31:56.660697288 +0000 UTC m=+0.493569246 container init 818ff570b7244a53fedc75f61fda6b48c7fb3dadea018636d5a9ea32596cfa2a (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-26T21:31:56.933 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:56 smithi120 podman[93386]: 2024-04-26 21:31:56.672568391 +0000 UTC m=+0.505440291 container start 818ff570b7244a53fedc75f61fda6b48c7fb3dadea018636d5a9ea32596cfa2a (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_CLEAN=True) 2024-04-26T21:31:56.933 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:56 smithi120 podman[93386]: 2024-04-26 21:31:56.759673146 +0000 UTC m=+0.592545067 container attach 818ff570b7244a53fedc75f61fda6b48c7fb3dadea018636d5a9ea32596cfa2a (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-26T21:31:57.934 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:57 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-activate[93401]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:31:57.934 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:57 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-activate[93401]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:31:57.934 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:57 smithi120 bash[93386]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:31:57.934 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:57 smithi120 bash[93386]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:31:57.934 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:57 smithi120 bash[93386]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T21:31:57.934 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:57 smithi120 bash[93386]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-26T21:31:57.934 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:57 smithi120 bash[93386]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-26T21:31:57.934 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:57 smithi120 bash[93386]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-26T21:31:57.935 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:57 smithi120 bash[93386]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-26T21:31:57.935 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:57 smithi120 bash[93386]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T21:31:57.935 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:57 smithi120 bash[93386]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-26T21:31:57.935 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:57 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-activate[93401]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T21:31:57.935 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:57 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-activate[93401]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-26T21:31:57.935 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:57 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-activate[93401]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-26T21:31:57.935 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:57 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-activate[93401]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-26T21:31:57.935 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:57 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-activate[93401]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-26T21:31:57.935 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:57 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-activate[93401]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T21:31:57.935 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:57 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-activate[93401]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-26T21:31:57.935 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:57 smithi120 podman[93386]: 2024-04-26 21:31:57.705744524 +0000 UTC m=+1.538616487 container died 818ff570b7244a53fedc75f61fda6b48c7fb3dadea018636d5a9ea32596cfa2a (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-activate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:31:58.914 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:31:58 smithi120 ceph-mon[79001]: pgmap v163: 65 pgs: 16 active+undersized+degraded, 2 peering, 14 active+undersized, 33 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/363 objects degraded (17.080%) 2024-04-26T21:31:58.915 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:58 smithi120 podman[93540]: 2024-04-26 21:31:58.61424758 +0000 UTC m=+0.884817108 container remove 818ff570b7244a53fedc75f61fda6b48c7fb3dadea018636d5a9ea32596cfa2a (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-26T21:31:59.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:31:58 smithi084 ceph-mon[90138]: pgmap v163: 65 pgs: 16 active+undersized+degraded, 2 peering, 14 active+undersized, 33 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/363 objects degraded (17.080%) 2024-04-26T21:31:59.182 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:58 smithi120 podman[93601]: 2024-04-26 21:31:58.88117454 +0000 UTC m=+0.037231755 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:31:59.182 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:59 smithi120 podman[93601]: 2024-04-26 21:31:59.007224245 +0000 UTC m=+0.163281497 container create 894dcbaab8eb53d9c7d362d2f962ce6528009f6f83297fc52d570e8da32a191a (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-26T21:31:59.682 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:59 smithi120 podman[93601]: 2024-04-26 21:31:59.311685127 +0000 UTC m=+0.467742446 container init 894dcbaab8eb53d9c7d362d2f962ce6528009f6f83297fc52d570e8da32a191a (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424) 2024-04-26T21:31:59.683 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:59 smithi120 podman[93601]: 2024-04-26 21:31:59.324314983 +0000 UTC m=+0.480372217 container start 894dcbaab8eb53d9c7d362d2f962ce6528009f6f83297fc52d570e8da32a191a (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240424, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:31:59.683 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:59 smithi120 ceph-osd[93620]: -- 172.21.15.120:0/3538212522 <== mon.1 v2:172.21.15.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c11434f680 con 0x55c114319000 2024-04-26T21:31:59.683 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:59 smithi120 bash[93601]: 894dcbaab8eb53d9c7d362d2f962ce6528009f6f83297fc52d570e8da32a191a 2024-04-26T21:31:59.683 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:59 smithi120 systemd[1]: Started Ceph osd.4 for 8bb44d26-0411-11ef-bc93-c7b262605968. 2024-04-26T21:32:00.159 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:31:59 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:31:59.895+0000 7f283b3af7c0 -1 Falling back to public interface 2024-04-26T21:32:00.159 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:00 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:00.159 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:00 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:32:00.159 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:00 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:00.159 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:00 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:00.159 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:00 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:00.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:00 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:00.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:00 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:32:00.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:00 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:00.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:00 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:00.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:00 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:01.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:01 smithi120 ceph-mon[79001]: pgmap v164: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/363 objects degraded (17.080%) 2024-04-26T21:32:01.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:01 smithi120 ceph-mon[79001]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-26T21:32:01.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:01 smithi084 ceph-mon[90138]: pgmap v164: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/363 objects degraded (17.080%) 2024-04-26T21:32:01.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:01 smithi084 ceph-mon[90138]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-26T21:32:03.396 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:03 smithi120 ceph-mon[79001]: pgmap v165: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/363 objects degraded (17.080%) 2024-04-26T21:32:03.397 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:03 smithi120 ceph-mon[79001]: Health check update: Degraded data redundancy: 62/363 objects degraded (17.080%), 16 pgs degraded (PG_DEGRADED) 2024-04-26T21:32:03.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:03 smithi084 ceph-mon[90138]: pgmap v165: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/363 objects degraded (17.080%) 2024-04-26T21:32:03.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:03 smithi084 ceph-mon[90138]: Health check update: Degraded data redundancy: 62/363 objects degraded (17.080%), 16 pgs degraded (PG_DEGRADED) 2024-04-26T21:32:05.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:05 smithi084 ceph-mon[90138]: pgmap v166: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/363 objects degraded (17.080%) 2024-04-26T21:32:05.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:05 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:05.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:05 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:05 smithi120 ceph-mon[79001]: pgmap v166: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/363 objects degraded (17.080%) 2024-04-26T21:32:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:05 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:05 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:05.932 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:32:05 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:32:05.476+0000 7f283b3af7c0 -1 osd.4 79 log_to_monitors true 2024-04-26T21:32:06.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:06 smithi084 ceph-mon[90138]: from='osd.4 [v2:172.21.15.120:6808/267967952,v1:172.21.15.120:6809/267967952]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T21:32:06.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:06 smithi084 ceph-mon[90138]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T21:32:06.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:06 smithi120 ceph-mon[79001]: from='osd.4 [v2:172.21.15.120:6808/267967952,v1:172.21.15.120:6809/267967952]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T21:32:06.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:06 smithi120 ceph-mon[79001]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T21:32:06.432 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:32:06 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:32:06.054+0000 7f282a800700 -1 osd.4 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:32:07.300 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:07 smithi120 ceph-mon[79001]: pgmap v167: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/363 objects degraded (17.080%) 2024-04-26T21:32:07.300 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:07 smithi120 ceph-mon[79001]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T21:32:07.300 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:07 smithi120 ceph-mon[79001]: osdmap e82: 6 total, 5 up, 6 in 2024-04-26T21:32:07.300 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:07 smithi120 ceph-mon[79001]: from='osd.4 [v2:172.21.15.120:6808/267967952,v1:172.21.15.120:6809/267967952]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:32:07.301 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:07 smithi120 ceph-mon[79001]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:32:07.301 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:07 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:07.301 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:07 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:07.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:07 smithi084 ceph-mon[90138]: pgmap v167: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 62/363 objects degraded (17.080%) 2024-04-26T21:32:07.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:07 smithi084 ceph-mon[90138]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T21:32:07.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:07 smithi084 ceph-mon[90138]: osdmap e82: 6 total, 5 up, 6 in 2024-04-26T21:32:07.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:07 smithi084 ceph-mon[90138]: from='osd.4 [v2:172.21.15.120:6808/267967952,v1:172.21.15.120:6809/267967952]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:32:07.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:07 smithi084 ceph-mon[90138]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:32:07.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:07 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:07.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:07 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:08.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:08 smithi084 ceph-mon[90138]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:32:08.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:08 smithi084 ceph-mon[90138]: osd.4 [v2:172.21.15.120:6808/267967952,v1:172.21.15.120:6809/267967952] boot 2024-04-26T21:32:08.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:08 smithi084 ceph-mon[90138]: osdmap e83: 6 total, 6 up, 6 in 2024-04-26T21:32:08.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:08 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:32:08.431 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:08 smithi120 ceph-mon[79001]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:32:08.431 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:08 smithi120 ceph-mon[79001]: osd.4 [v2:172.21.15.120:6808/267967952,v1:172.21.15.120:6809/267967952] boot 2024-04-26T21:32:08.431 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:08 smithi120 ceph-mon[79001]: osdmap e83: 6 total, 6 up, 6 in 2024-04-26T21:32:08.431 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:08 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:32:09.314 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:09 smithi084 ceph-mon[90138]: pgmap v170: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 62/363 objects degraded (17.080%) 2024-04-26T21:32:09.314 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:09 smithi084 ceph-mon[90138]: osdmap e84: 6 total, 6 up, 6 in 2024-04-26T21:32:09.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:09 smithi120 ceph-mon[79001]: pgmap v170: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 62/363 objects degraded (17.080%) 2024-04-26T21:32:09.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:09 smithi120 ceph-mon[79001]: osdmap e84: 6 total, 6 up, 6 in 2024-04-26T21:32:10.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.187+0000 7f451ac00700 1 -- 172.21.15.84:0/164179289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45141033f0 msgr2=0x7f4514103800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:10.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.187+0000 7f451ac00700 1 --2- 172.21.15.84:0/164179289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45141033f0 0x7f4514103800 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4504004940 tx=0x7f4504009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:10.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.187+0000 7f451ac00700 1 -- 172.21.15.84:0/164179289 shutdown_connections 2024-04-26T21:32:10.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.187+0000 7f451ac00700 1 --2- 172.21.15.84:0/164179289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45141046a0 0x7f4514104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:10.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.187+0000 7f451ac00700 1 --2- 172.21.15.84:0/164179289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45141033f0 0x7f4514103800 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:10.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.187+0000 7f451ac00700 1 -- 172.21.15.84:0/164179289 >> 172.21.15.84:0/164179289 conn(0x7f45140725e0 msgr2=0x7f4514074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:10.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.187+0000 7f451ac00700 1 -- 172.21.15.84:0/164179289 shutdown_connections 2024-04-26T21:32:10.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.187+0000 7f451ac00700 1 -- 172.21.15.84:0/164179289 wait complete. 2024-04-26T21:32:10.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.188+0000 7f451ac00700 1 Processor -- start 2024-04-26T21:32:10.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.188+0000 7f451ac00700 1 -- start start 2024-04-26T21:32:10.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.188+0000 7f451ac00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45141033f0 0x7f4514113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:10.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.188+0000 7f451ac00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45141046a0 0x7f4514114400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:10.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.188+0000 7f451ac00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4514114a00 con 0x7f45141033f0 2024-04-26T21:32:10.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.188+0000 7f451ac00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4514114b70 con 0x7f45141046a0 2024-04-26T21:32:10.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.189+0000 7f4513e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45141033f0 0x7f4514113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:10.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.189+0000 7f4513e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45141033f0 0x7f4514113ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49340/0 (socket says 172.21.15.84:49340) 2024-04-26T21:32:10.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.189+0000 7f4513e00700 1 -- 172.21.15.84:0/4260869483 learned_addr learned my addr 172.21.15.84:0/4260869483 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:32:10.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.189+0000 7f4513400700 1 --2- 172.21.15.84:0/4260869483 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45141046a0 0x7f4514114400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:10.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.189+0000 7f4513e00700 1 -- 172.21.15.84:0/4260869483 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45141046a0 msgr2=0x7f4514114400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:10.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.189+0000 7f4513e00700 1 --2- 172.21.15.84:0/4260869483 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45141046a0 0x7f4514114400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:10.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.189+0000 7f4513e00700 1 -- 172.21.15.84:0/4260869483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4504005040 con 0x7f45141033f0 2024-04-26T21:32:10.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.189+0000 7f4513e00700 1 --2- 172.21.15.84:0/4260869483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45141033f0 0x7f4514113ec0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4504013870 tx=0x7f4504009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:10.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.190+0000 7f450be00700 1 -- 172.21.15.84:0/4260869483 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f450400e070 con 0x7f45141033f0 2024-04-26T21:32:10.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.190+0000 7f450be00700 1 -- 172.21.15.84:0/4260869483 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4504013de0 con 0x7f45141033f0 2024-04-26T21:32:10.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.190+0000 7f450be00700 1 -- 172.21.15.84:0/4260869483 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f450401cea0 con 0x7f45141033f0 2024-04-26T21:32:10.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.190+0000 7f451ac00700 1 -- 172.21.15.84:0/4260869483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4514119570 con 0x7f45141033f0 2024-04-26T21:32:10.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.190+0000 7f451ac00700 1 -- 172.21.15.84:0/4260869483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4514119a50 con 0x7f45141033f0 2024-04-26T21:32:10.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.191+0000 7f451ac00700 1 -- 172.21.15.84:0/4260869483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f451404c710 con 0x7f45141033f0 2024-04-26T21:32:10.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.192+0000 7f450be00700 1 -- 172.21.15.84:0/4260869483 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f450401c690 con 0x7f45141033f0 2024-04-26T21:32:10.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.193+0000 7f450be00700 1 --2- 172.21.15.84:0/4260869483 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f44f806ec00 0x7f44f80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:10.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.193+0000 7f450be00700 1 -- 172.21.15.84:0/4260869483 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f450408ffd0 con 0x7f45141033f0 2024-04-26T21:32:10.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.193+0000 7f4513400700 1 --2- 172.21.15.84:0/4260869483 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f44f806ec00 0x7f44f80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:10.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.194+0000 7f4513400700 1 --2- 172.21.15.84:0/4260869483 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f44f806ec00 0x7f44f80710b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4500009b80 tx=0x7f450000b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:10.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.198+0000 7f450be00700 1 -- 172.21.15.84:0/4260869483 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f45040c5060 con 0x7f45141033f0 2024-04-26T21:32:10.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:10 smithi084 ceph-mon[90138]: pgmap v172: 65 pgs: 1 peering, 3 active+undersized+degraded, 2 active+undersized, 59 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 7/363 objects degraded (1.928%) 2024-04-26T21:32:10.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:10 smithi084 ceph-mon[90138]: Health check update: Degraded data redundancy: 7/363 objects degraded (1.928%), 3 pgs degraded (PG_DEGRADED) 2024-04-26T21:32:10.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:10 smithi120 ceph-mon[79001]: pgmap v172: 65 pgs: 1 peering, 3 active+undersized+degraded, 2 active+undersized, 59 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 7/363 objects degraded (1.928%) 2024-04-26T21:32:10.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:10 smithi120 ceph-mon[79001]: Health check update: Degraded data redundancy: 7/363 objects degraded (1.928%), 3 pgs degraded (PG_DEGRADED) 2024-04-26T21:32:10.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.445+0000 7f451ac00700 1 -- 172.21.15.84:0/4260869483 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4514108970 con 0x7f44f806ec00 2024-04-26T21:32:10.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.448+0000 7f450be00700 1 -- 172.21.15.84:0/4260869483 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f4514108970 con 0x7f44f806ec00 2024-04-26T21:32:10.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.451+0000 7f451ac00700 1 -- 172.21.15.84:0/4260869483 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f44f806ec00 msgr2=0x7f44f80710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:10.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.451+0000 7f451ac00700 1 --2- 172.21.15.84:0/4260869483 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f44f806ec00 0x7f44f80710b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4500009b80 tx=0x7f450000b040 comp rx=0 tx=0).stop 2024-04-26T21:32:10.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.451+0000 7f451ac00700 1 -- 172.21.15.84:0/4260869483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45141033f0 msgr2=0x7f4514113ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:10.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.451+0000 7f451ac00700 1 --2- 172.21.15.84:0/4260869483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45141033f0 0x7f4514113ec0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4504013870 tx=0x7f4504009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:10.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.451+0000 7f451ac00700 1 -- 172.21.15.84:0/4260869483 shutdown_connections 2024-04-26T21:32:10.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.451+0000 7f451ac00700 1 --2- 172.21.15.84:0/4260869483 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f44f806ec00 0x7f44f80710b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:10.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.451+0000 7f451ac00700 1 --2- 172.21.15.84:0/4260869483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45141033f0 0x7f4514113ec0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:10.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.451+0000 7f451ac00700 1 --2- 172.21.15.84:0/4260869483 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45141046a0 0x7f4514114400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:10.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.451+0000 7f451ac00700 1 -- 172.21.15.84:0/4260869483 >> 172.21.15.84:0/4260869483 conn(0x7f45140725e0 msgr2=0x7f4514073bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:10.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.452+0000 7f451ac00700 1 -- 172.21.15.84:0/4260869483 shutdown_connections 2024-04-26T21:32:10.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.452+0000 7f451ac00700 1 -- 172.21.15.84:0/4260869483 wait complete. 2024-04-26T21:32:10.467 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:32:10.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.603+0000 7f2f17e00700 1 -- 172.21.15.84:0/1435506980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f180fee60 msgr2=0x7f2f180ff270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:10.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.603+0000 7f2f17e00700 1 --2- 172.21.15.84:0/1435506980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f180fee60 0x7f2f180ff270 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2f08004940 tx=0x7f2f08009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:10.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.603+0000 7f2f17e00700 1 -- 172.21.15.84:0/1435506980 shutdown_connections 2024-04-26T21:32:10.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.603+0000 7f2f17e00700 1 --2- 172.21.15.84:0/1435506980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f18100060 0x7f2f181004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:10.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.603+0000 7f2f17e00700 1 --2- 172.21.15.84:0/1435506980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f180fee60 0x7f2f180ff270 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:10.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.603+0000 7f2f17e00700 1 -- 172.21.15.84:0/1435506980 >> 172.21.15.84:0/1435506980 conn(0x7f2f180fa570 msgr2=0x7f2f180fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:10.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.603+0000 7f2f17e00700 1 -- 172.21.15.84:0/1435506980 shutdown_connections 2024-04-26T21:32:10.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.603+0000 7f2f17e00700 1 -- 172.21.15.84:0/1435506980 wait complete. 2024-04-26T21:32:10.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.604+0000 7f2f17e00700 1 Processor -- start 2024-04-26T21:32:10.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.604+0000 7f2f17e00700 1 -- start start 2024-04-26T21:32:10.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.604+0000 7f2f17e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f180fee60 0x7f2f1810fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:10.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.604+0000 7f2f17e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f18100060 0x7f2f1810ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:10.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.604+0000 7f2f17e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f18110590 con 0x7f2f180fee60 2024-04-26T21:32:10.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.604+0000 7f2f17e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f18110de0 con 0x7f2f18100060 2024-04-26T21:32:10.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.605+0000 7f2f16a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f180fee60 0x7f2f1810fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:10.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.605+0000 7f2f16a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f180fee60 0x7f2f1810fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49352/0 (socket says 172.21.15.84:49352) 2024-04-26T21:32:10.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.605+0000 7f2f16a00700 1 -- 172.21.15.84:0/1428180389 learned_addr learned my addr 172.21.15.84:0/1428180389 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:32:10.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.605+0000 7f2f16000700 1 --2- 172.21.15.84:0/1428180389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f18100060 0x7f2f1810ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:10.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.605+0000 7f2f16a00700 1 -- 172.21.15.84:0/1428180389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f18100060 msgr2=0x7f2f1810ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:10.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.605+0000 7f2f16a00700 1 --2- 172.21.15.84:0/1428180389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f18100060 0x7f2f1810ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:10.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.605+0000 7f2f16a00700 1 -- 172.21.15.84:0/1428180389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f08005040 con 0x7f2f180fee60 2024-04-26T21:32:10.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.605+0000 7f2f16a00700 1 --2- 172.21.15.84:0/1428180389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f180fee60 0x7f2f1810fa50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2f08000c00 tx=0x7f2f08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:10.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.606+0000 7f2f0ea00700 1 -- 172.21.15.84:0/1428180389 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f0800e040 con 0x7f2f180fee60 2024-04-26T21:32:10.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.606+0000 7f2f0ea00700 1 -- 172.21.15.84:0/1428180389 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f0800bbf0 con 0x7f2f180fee60 2024-04-26T21:32:10.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.606+0000 7f2f17e00700 1 -- 172.21.15.84:0/1428180389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f18111060 con 0x7f2f180fee60 2024-04-26T21:32:10.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.606+0000 7f2f0ea00700 1 -- 172.21.15.84:0/1428180389 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f0801c630 con 0x7f2f180fee60 2024-04-26T21:32:10.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.606+0000 7f2f17e00700 1 -- 172.21.15.84:0/1428180389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f181115a0 con 0x7f2f180fee60 2024-04-26T21:32:10.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.607+0000 7f2f17e00700 1 -- 172.21.15.84:0/1428180389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1805f5c0 con 0x7f2f180fee60 2024-04-26T21:32:10.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.608+0000 7f2f0ea00700 1 -- 172.21.15.84:0/1428180389 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2f0800bd60 con 0x7f2f180fee60 2024-04-26T21:32:10.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.609+0000 7f2f0ea00700 1 --2- 172.21.15.84:0/1428180389 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2efc06ec00 0x7f2efc0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:10.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.609+0000 7f2f0ea00700 1 -- 172.21.15.84:0/1428180389 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f2f0808fac0 con 0x7f2f180fee60 2024-04-26T21:32:10.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.609+0000 7f2f16000700 1 --2- 172.21.15.84:0/1428180389 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2efc06ec00 0x7f2efc0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:10.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.610+0000 7f2f16000700 1 --2- 172.21.15.84:0/1428180389 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2efc06ec00 0x7f2efc0710b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f04004f40 tx=0x7f2f0400b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:10.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.614+0000 7f2f0ea00700 1 -- 172.21.15.84:0/1428180389 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f2f0805c460 con 0x7f2f180fee60 2024-04-26T21:32:10.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.861+0000 7f2f17e00700 1 -- 172.21.15.84:0/1428180389 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f18111990 con 0x7f2efc06ec00 2024-04-26T21:32:10.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.863+0000 7f2f0ea00700 1 -- 172.21.15.84:0/1428180389 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f2f18111990 con 0x7f2efc06ec00 2024-04-26T21:32:10.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.866+0000 7f2f17e00700 1 -- 172.21.15.84:0/1428180389 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2efc06ec00 msgr2=0x7f2efc0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:10.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.866+0000 7f2f17e00700 1 --2- 172.21.15.84:0/1428180389 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2efc06ec00 0x7f2efc0710b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f04004f40 tx=0x7f2f0400b040 comp rx=0 tx=0).stop 2024-04-26T21:32:10.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.866+0000 7f2f17e00700 1 -- 172.21.15.84:0/1428180389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f180fee60 msgr2=0x7f2f1810fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:10.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.866+0000 7f2f17e00700 1 --2- 172.21.15.84:0/1428180389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f180fee60 0x7f2f1810fa50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2f08000c00 tx=0x7f2f08009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:10.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.866+0000 7f2f17e00700 1 -- 172.21.15.84:0/1428180389 shutdown_connections 2024-04-26T21:32:10.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.866+0000 7f2f17e00700 1 --2- 172.21.15.84:0/1428180389 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2efc06ec00 0x7f2efc0710b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:10.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.866+0000 7f2f17e00700 1 --2- 172.21.15.84:0/1428180389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f180fee60 0x7f2f1810fa50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:10.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.866+0000 7f2f17e00700 1 --2- 172.21.15.84:0/1428180389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f18100060 0x7f2f1810ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:10.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.866+0000 7f2f17e00700 1 -- 172.21.15.84:0/1428180389 >> 172.21.15.84:0/1428180389 conn(0x7f2f180fa570 msgr2=0x7f2f180fbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:10.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.867+0000 7f2f17e00700 1 -- 172.21.15.84:0/1428180389 shutdown_connections 2024-04-26T21:32:10.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:10.867+0000 7f2f17e00700 1 -- 172.21.15.84:0/1428180389 wait complete. 2024-04-26T21:32:11.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.022+0000 7fe2c6000700 1 -- 172.21.15.84:0/3004608726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2c01033f0 msgr2=0x7fe2c0103800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:11.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.022+0000 7fe2c6000700 1 --2- 172.21.15.84:0/3004608726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2c01033f0 0x7fe2c0103800 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0004940 tx=0x7fe2b0009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:11.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.022+0000 7fe2c6000700 1 -- 172.21.15.84:0/3004608726 shutdown_connections 2024-04-26T21:32:11.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.022+0000 7fe2c6000700 1 --2- 172.21.15.84:0/3004608726 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2c01046a0 0x7fe2c0104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:11.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.022+0000 7fe2c6000700 1 --2- 172.21.15.84:0/3004608726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2c01033f0 0x7fe2c0103800 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:11.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.022+0000 7fe2c6000700 1 -- 172.21.15.84:0/3004608726 >> 172.21.15.84:0/3004608726 conn(0x7fe2c00725e0 msgr2=0x7fe2c0074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:11.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.022+0000 7fe2c6000700 1 -- 172.21.15.84:0/3004608726 shutdown_connections 2024-04-26T21:32:11.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.022+0000 7fe2c6000700 1 -- 172.21.15.84:0/3004608726 wait complete. 2024-04-26T21:32:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.023+0000 7fe2c6000700 1 Processor -- start 2024-04-26T21:32:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.024+0000 7fe2c6000700 1 -- start start 2024-04-26T21:32:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.024+0000 7fe2c6000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2c01033f0 0x7fe2c0113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.024+0000 7fe2c6000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2c01046a0 0x7fe2c01143e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.024+0000 7fe2c6000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c01149e0 con 0x7fe2c01046a0 2024-04-26T21:32:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.024+0000 7fe2c6000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c0114b50 con 0x7fe2c01033f0 2024-04-26T21:32:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.024+0000 7fe2bea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2c01046a0 0x7fe2c01143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.024+0000 7fe2bea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2c01046a0 0x7fe2c01143e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49362/0 (socket says 172.21.15.84:49362) 2024-04-26T21:32:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.024+0000 7fe2bea00700 1 -- 172.21.15.84:0/1982524890 learned_addr learned my addr 172.21.15.84:0/1982524890 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:32:11.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.025+0000 7fe2bf400700 1 --2- 172.21.15.84:0/1982524890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2c01033f0 0x7fe2c0113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:11.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.025+0000 7fe2bea00700 1 -- 172.21.15.84:0/1982524890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2c01033f0 msgr2=0x7fe2c0113ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.025+0000 7fe2bea00700 1 --2- 172.21.15.84:0/1982524890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2c01033f0 0x7fe2c0113ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.025+0000 7fe2bea00700 1 -- 172.21.15.84:0/1982524890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b0005040 con 0x7fe2c01046a0 2024-04-26T21:32:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.025+0000 7fe2bea00700 1 --2- 172.21.15.84:0/1982524890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2c01046a0 0x7fe2c01143e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00eb40 tx=0x7fe2ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.025+0000 7fe2b7400700 1 -- 172.21.15.84:0/1982524890 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2ac007cc0 con 0x7fe2c01046a0 2024-04-26T21:32:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.025+0000 7fe2b7400700 1 -- 172.21.15.84:0/1982524890 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe2ac00f040 con 0x7fe2c01046a0 2024-04-26T21:32:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.025+0000 7fe2b7400700 1 -- 172.21.15.84:0/1982524890 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2ac009620 con 0x7fe2c01046a0 2024-04-26T21:32:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.025+0000 7fe2c6000700 1 -- 172.21.15.84:0/1982524890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c0119550 con 0x7fe2c01046a0 2024-04-26T21:32:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.026+0000 7fe2c6000700 1 -- 172.21.15.84:0/1982524890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c0119a90 con 0x7fe2c01046a0 2024-04-26T21:32:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.027+0000 7fe2c6000700 1 -- 172.21.15.84:0/1982524890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c004c710 con 0x7fe2c01046a0 2024-04-26T21:32:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.028+0000 7fe2b7400700 1 -- 172.21.15.84:0/1982524890 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe2ac009780 con 0x7fe2c01046a0 2024-04-26T21:32:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.029+0000 7fe2b7400700 1 --2- 172.21.15.84:0/1982524890 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe2a406ec00 0x7fe2a40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.029+0000 7fe2b7400700 1 -- 172.21.15.84:0/1982524890 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fe2ac08e5a0 con 0x7fe2c01046a0 2024-04-26T21:32:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.029+0000 7fe2bf400700 1 --2- 172.21.15.84:0/1982524890 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe2a406ec00 0x7fe2a40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.030+0000 7fe2bf400700 1 --2- 172.21.15.84:0/1982524890 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe2a406ec00 0x7fe2a40710b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000b0d0 tx=0x7fe2b0009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:11.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.033+0000 7fe2b7400700 1 -- 172.21.15.84:0/1982524890 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fe2ac05aeb0 con 0x7fe2c01046a0 2024-04-26T21:32:11.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:11 smithi084 ceph-mon[90138]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:32:11.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:11 smithi084 ceph-mon[90138]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:32:11.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.271+0000 7fe2c6000700 1 -- 172.21.15.84:0/1982524890 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2c0108940 con 0x7fe2a406ec00 2024-04-26T21:32:11.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.288+0000 7fe2b7400700 1 -- 172.21.15.84:0/1982524890 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe2c0108940 con 0x7fe2a406ec00 2024-04-26T21:32:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:32:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (7m) 76s ago 17m 14.5M - 0.25.0 c8568f914cd2 bcb419cf9108 2024-04-26T21:32:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (3m) 76s ago 18m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 b4010dfbe623 2024-04-26T21:32:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (2m) 7s ago 16m 6665k - 19.0.0-3306-gbc612ffb 55dc54019ad8 89a4e50ea23c 2024-04-26T21:32:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (6m) 76s ago 17m 76.4M - 9.4.7 954c08fa6188 1bf95f604e07 2024-04-26T21:32:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (10m) 76s ago 10m 114M - 17.2.7-907-g2be3efa9 1c5834633715 485d7884e1d5 2024-04-26T21:32:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (10m) 76s ago 10m 14.3M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:32:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (10m) 7s ago 10m 113M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:32:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (10m) 7s ago 10m 14.5M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:32:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (6m) 76s ago 19m 505M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:32:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283,8765 running (5m) 7s ago 16m 453M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d6ae0b4628b5 2024-04-26T21:32:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (4m) 76s ago 19m 43.8M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 bf610abb6a62 2024-04-26T21:32:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (3m) 7s ago 16m 35.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 5d530496253b 2024-04-26T21:32:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (7m) 76s ago 18m 8010k - 1.5.0 0da6a335fe13 81e00b40bfbf 2024-04-26T21:32:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (6m) 7s ago 16m 7918k - 1.5.0 0da6a335fe13 0506a1d46ec4 2024-04-26T21:32:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (2m) 76s ago 15m 124M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 99fbe2faa51b 2024-04-26T21:32:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (114s) 76s ago 14m 84.9M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 2dc81d93f7e5 2024-04-26T21:32:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (84s) 76s ago 14m 11.2M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 9e77abf095bd 2024-04-26T21:32:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (54s) 7s ago 13m 82.6M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 d7e5825e2640 2024-04-26T21:32:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (12s) 7s ago 13m 11.2M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 894dcbaab8eb 2024-04-26T21:32:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (12m) 7s ago 12m 206M 2581M 17.2.7-907-g2be3efa9 1c5834633715 9b60997971a8 2024-04-26T21:32:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (5m) 76s ago 17m 56.2M - 2.43.0 a07b618ecd1d d3008b765eec 2024-04-26T21:32:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.291+0000 7fe2c6000700 1 -- 172.21.15.84:0/1982524890 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe2a406ec00 msgr2=0x7fe2a40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.291+0000 7fe2c6000700 1 --2- 172.21.15.84:0/1982524890 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe2a406ec00 0x7fe2a40710b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000b0d0 tx=0x7fe2b0009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.291+0000 7fe2c6000700 1 -- 172.21.15.84:0/1982524890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2c01046a0 msgr2=0x7fe2c01143e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.291+0000 7fe2c6000700 1 --2- 172.21.15.84:0/1982524890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2c01046a0 0x7fe2c01143e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00eb40 tx=0x7fe2ac00b040 comp rx=0 tx=0).stop 2024-04-26T21:32:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.291+0000 7fe2c6000700 1 -- 172.21.15.84:0/1982524890 shutdown_connections 2024-04-26T21:32:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.291+0000 7fe2c6000700 1 --2- 172.21.15.84:0/1982524890 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe2a406ec00 0x7fe2a40710b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.291+0000 7fe2c6000700 1 --2- 172.21.15.84:0/1982524890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2c01033f0 0x7fe2c0113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.291+0000 7fe2c6000700 1 --2- 172.21.15.84:0/1982524890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2c01046a0 0x7fe2c01143e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.291+0000 7fe2c6000700 1 -- 172.21.15.84:0/1982524890 >> 172.21.15.84:0/1982524890 conn(0x7fe2c00725e0 msgr2=0x7fe2c0073c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.292+0000 7fe2c6000700 1 -- 172.21.15.84:0/1982524890 shutdown_connections 2024-04-26T21:32:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.292+0000 7fe2c6000700 1 -- 172.21.15.84:0/1982524890 wait complete. 2024-04-26T21:32:11.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:11 smithi120 ceph-mon[79001]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:32:11.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:11 smithi120 ceph-mon[79001]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:32:11.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.440+0000 7fad7e200700 1 -- 172.21.15.84:0/4036541375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad78071de0 msgr2=0x7fad780702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:11.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.440+0000 7fad7e200700 1 --2- 172.21.15.84:0/4036541375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad78071de0 0x7fad780702f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fad68004940 tx=0x7fad68009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:11.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.441+0000 7fad7e200700 1 -- 172.21.15.84:0/4036541375 shutdown_connections 2024-04-26T21:32:11.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.441+0000 7fad7e200700 1 --2- 172.21.15.84:0/4036541375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad78070830 0x7fad78070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:11.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.441+0000 7fad7e200700 1 --2- 172.21.15.84:0/4036541375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad78071de0 0x7fad780702f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:11.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.441+0000 7fad7e200700 1 -- 172.21.15.84:0/4036541375 >> 172.21.15.84:0/4036541375 conn(0x7fad780f8540 msgr2=0x7fad780fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:11.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.441+0000 7fad7e200700 1 -- 172.21.15.84:0/4036541375 shutdown_connections 2024-04-26T21:32:11.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.441+0000 7fad7e200700 1 -- 172.21.15.84:0/4036541375 wait complete. 2024-04-26T21:32:11.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.442+0000 7fad7e200700 1 Processor -- start 2024-04-26T21:32:11.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.442+0000 7fad7e200700 1 -- start start 2024-04-26T21:32:11.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.442+0000 7fad7e200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad78070830 0x7fad7810fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:11.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.442+0000 7fad7e200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad78071de0 0x7fad78110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:11.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.442+0000 7fad7e200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad78110680 con 0x7fad78070830 2024-04-26T21:32:11.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.442+0000 7fad7e200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad781107f0 con 0x7fad78071de0 2024-04-26T21:32:11.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.442+0000 7fad77400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad78070830 0x7fad7810fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:11.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.443+0000 7fad77400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad78070830 0x7fad7810fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49388/0 (socket says 172.21.15.84:49388) 2024-04-26T21:32:11.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.443+0000 7fad77400700 1 -- 172.21.15.84:0/3606989293 learned_addr learned my addr 172.21.15.84:0/3606989293 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:32:11.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.443+0000 7fad77400700 1 -- 172.21.15.84:0/3606989293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad78071de0 msgr2=0x7fad78110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:11.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.443+0000 7fad6fe00700 1 --2- 172.21.15.84:0/3606989293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad78071de0 0x7fad78110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:11.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.443+0000 7fad77400700 1 --2- 172.21.15.84:0/3606989293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad78071de0 0x7fad78110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:11.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.443+0000 7fad77400700 1 -- 172.21.15.84:0/3606989293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad68005040 con 0x7fad78070830 2024-04-26T21:32:11.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.443+0000 7fad6fe00700 1 --2- 172.21.15.84:0/3606989293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad78071de0 0x7fad78110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:32:11.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.443+0000 7fad77400700 1 --2- 172.21.15.84:0/3606989293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad78070830 0x7fad7810fb40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fad6800b970 tx=0x7fad68009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:11.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.444+0000 7fad6f400700 1 -- 172.21.15.84:0/3606989293 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad6800e040 con 0x7fad78070830 2024-04-26T21:32:11.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.444+0000 7fad6f400700 1 -- 172.21.15.84:0/3606989293 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad68004290 con 0x7fad78070830 2024-04-26T21:32:11.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.444+0000 7fad7e200700 1 -- 172.21.15.84:0/3606989293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad781151f0 con 0x7fad78070830 2024-04-26T21:32:11.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.444+0000 7fad6f400700 1 -- 172.21.15.84:0/3606989293 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad6801c630 con 0x7fad78070830 2024-04-26T21:32:11.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.444+0000 7fad7e200700 1 -- 172.21.15.84:0/3606989293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad781157b0 con 0x7fad78070830 2024-04-26T21:32:11.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.445+0000 7fad7e200700 1 -- 172.21.15.84:0/3606989293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad7804c710 con 0x7fad78070830 2024-04-26T21:32:11.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.446+0000 7fad6f400700 1 -- 172.21.15.84:0/3606989293 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fad6800bbf0 con 0x7fad78070830 2024-04-26T21:32:11.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.447+0000 7fad6f400700 1 --2- 172.21.15.84:0/3606989293 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fad5806ec00 0x7fad580710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:11.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.447+0000 7fad6f400700 1 -- 172.21.15.84:0/3606989293 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fad6808fd20 con 0x7fad78070830 2024-04-26T21:32:11.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.448+0000 7fad6fe00700 1 --2- 172.21.15.84:0/3606989293 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fad5806ec00 0x7fad580710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:11.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.448+0000 7fad6fe00700 1 --2- 172.21.15.84:0/3606989293 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fad5806ec00 0x7fad580710b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fad60007fd0 tx=0x7fad60009040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:11.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.452+0000 7fad6f400700 1 -- 172.21.15.84:0/3606989293 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fad6805c580 con 0x7fad78070830 2024-04-26T21:32:11.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.766+0000 7fad7e200700 1 -- 172.21.15.84:0/3606989293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fad78107ac0 con 0x7fad78070830 2024-04-26T21:32:11.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.767+0000 7fad6f400700 1 -- 172.21.15.84:0/3606989293 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fad68013e60 con 0x7fad78070830 2024-04-26T21:32:11.767 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:32:11.767 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:32:11.768 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:32:11.768 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:32:11.768 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:32:11.768 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:32:11.768 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:32:11.768 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:32:11.768 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 1, 2024-04-26T21:32:11.768 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 5 2024-04-26T21:32:11.768 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:32:11.768 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:32:11.768 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-26T21:32:11.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:32:11.769 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:32:11.769 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 5, 2024-04-26T21:32:11.769 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 9 2024-04-26T21:32:11.769 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:32:11.769 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:32:11.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.769+0000 7fad7e200700 1 -- 172.21.15.84:0/3606989293 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fad5806ec00 msgr2=0x7fad580710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:11.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.769+0000 7fad7e200700 1 --2- 172.21.15.84:0/3606989293 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fad5806ec00 0x7fad580710b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fad60007fd0 tx=0x7fad60009040 comp rx=0 tx=0).stop 2024-04-26T21:32:11.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.769+0000 7fad7e200700 1 -- 172.21.15.84:0/3606989293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad78070830 msgr2=0x7fad7810fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:11.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.769+0000 7fad7e200700 1 --2- 172.21.15.84:0/3606989293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad78070830 0x7fad7810fb40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fad6800b970 tx=0x7fad68009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:11.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.769+0000 7fad7e200700 1 -- 172.21.15.84:0/3606989293 shutdown_connections 2024-04-26T21:32:11.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.769+0000 7fad7e200700 1 --2- 172.21.15.84:0/3606989293 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fad5806ec00 0x7fad580710b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:11.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.769+0000 7fad7e200700 1 --2- 172.21.15.84:0/3606989293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad78070830 0x7fad7810fb40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:11.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.769+0000 7fad7e200700 1 --2- 172.21.15.84:0/3606989293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad78071de0 0x7fad78110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:11.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.769+0000 7fad7e200700 1 -- 172.21.15.84:0/3606989293 >> 172.21.15.84:0/3606989293 conn(0x7fad780f8540 msgr2=0x7fad780f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:11.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.770+0000 7fad7e200700 1 -- 172.21.15.84:0/3606989293 shutdown_connections 2024-04-26T21:32:11.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.770+0000 7fad7e200700 1 -- 172.21.15.84:0/3606989293 wait complete. 2024-04-26T21:32:11.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.915+0000 7f8485000700 1 -- 172.21.15.84:0/1466386359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84800fce40 msgr2=0x7f84800fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:11.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.915+0000 7f8485000700 1 --2- 172.21.15.84:0/1466386359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84800fce40 0x7f84800fd250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8470004940 tx=0x7f8470009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:11.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.915+0000 7f8485000700 1 -- 172.21.15.84:0/1466386359 shutdown_connections 2024-04-26T21:32:11.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.915+0000 7f8485000700 1 --2- 172.21.15.84:0/1466386359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84800fe040 0x7f84800fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:11.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.915+0000 7f8485000700 1 --2- 172.21.15.84:0/1466386359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84800fce40 0x7f84800fd250 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:11.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.915+0000 7f8485000700 1 -- 172.21.15.84:0/1466386359 >> 172.21.15.84:0/1466386359 conn(0x7f84800f84a0 msgr2=0x7f84800fa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:11.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.915+0000 7f8485000700 1 -- 172.21.15.84:0/1466386359 shutdown_connections 2024-04-26T21:32:11.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.915+0000 7f8485000700 1 -- 172.21.15.84:0/1466386359 wait complete. 2024-04-26T21:32:11.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.916+0000 7f8485000700 1 Processor -- start 2024-04-26T21:32:11.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.916+0000 7f8485000700 1 -- start start 2024-04-26T21:32:11.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.916+0000 7f8485000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84800fce40 0x7f848010fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:11.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.916+0000 7f8485000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84800fe040 0x7f84801100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:11.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.916+0000 7f8485000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8480110770 con 0x7f84800fce40 2024-04-26T21:32:11.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.916+0000 7f8485000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8480110f60 con 0x7f84800fe040 2024-04-26T21:32:11.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.917+0000 7f847de00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84800fce40 0x7f848010fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:11.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.917+0000 7f847de00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84800fce40 0x7f848010fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55864/0 (socket says 172.21.15.84:55864) 2024-04-26T21:32:11.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.917+0000 7f847de00700 1 -- 172.21.15.84:0/1596409323 learned_addr learned my addr 172.21.15.84:0/1596409323 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:32:11.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.917+0000 7f847d400700 1 --2- 172.21.15.84:0/1596409323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84800fe040 0x7f84801100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.917+0000 7f847de00700 1 -- 172.21.15.84:0/1596409323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84800fe040 msgr2=0x7f84801100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.917+0000 7f847de00700 1 --2- 172.21.15.84:0/1596409323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84800fe040 0x7f84801100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.917+0000 7f847de00700 1 -- 172.21.15.84:0/1596409323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8470005040 con 0x7f84800fce40 2024-04-26T21:32:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.917+0000 7f847de00700 1 --2- 172.21.15.84:0/1596409323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84800fce40 0x7f848010fba0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f847000b970 tx=0x7f8470009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.918+0000 7f8476000700 1 -- 172.21.15.84:0/1596409323 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f847000e040 con 0x7f84800fce40 2024-04-26T21:32:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.918+0000 7f8476000700 1 -- 172.21.15.84:0/1596409323 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8470004290 con 0x7f84800fce40 2024-04-26T21:32:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.918+0000 7f8485000700 1 -- 172.21.15.84:0/1596409323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84801111e0 con 0x7f84800fce40 2024-04-26T21:32:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.918+0000 7f8476000700 1 -- 172.21.15.84:0/1596409323 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f847001c630 con 0x7f84800fce40 2024-04-26T21:32:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.918+0000 7f8485000700 1 -- 172.21.15.84:0/1596409323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84801117a0 con 0x7f84800fce40 2024-04-26T21:32:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.919+0000 7f8485000700 1 -- 172.21.15.84:0/1596409323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84801019d0 con 0x7f84800fce40 2024-04-26T21:32:11.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.920+0000 7f8476000700 1 -- 172.21.15.84:0/1596409323 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f847000bbf0 con 0x7f84800fce40 2024-04-26T21:32:11.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.922+0000 7f8476000700 1 --2- 172.21.15.84:0/1596409323 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f846406ec10 0x7f84640710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:11.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.922+0000 7f8476000700 1 -- 172.21.15.84:0/1596409323 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f847008fd20 con 0x7f84800fce40 2024-04-26T21:32:11.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.922+0000 7f847d400700 1 --2- 172.21.15.84:0/1596409323 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f846406ec10 0x7f84640710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:11.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.923+0000 7f847d400700 1 --2- 172.21.15.84:0/1596409323 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f846406ec10 0x7f84640710c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f846c006fd0 tx=0x7f846c008040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:11.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:11.926+0000 7f8476000700 1 -- 172.21.15.84:0/1596409323 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f847005c580 con 0x7f84800fce40 2024-04-26T21:32:12.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.207+0000 7f8485000700 1 -- 172.21.15.84:0/1596409323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f848004bed0 con 0x7f84800fce40 2024-04-26T21:32:12.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.207+0000 7f8476000700 1 -- 172.21.15.84:0/1596409323 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1903 (secure 0 0 0) 0x7f8470013e60 con 0x7f84800fce40 2024-04-26T21:32:12.209 INFO:teuthology.orchestra.run.smithi084.stdout:e17 2024-04-26T21:32:12.209 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:32:12.209 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:32:12.209 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:32:12.209 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:32:12.209 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:32:12.209 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:32:12.209 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 17 2024-04-26T21:32:12.210 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:32:12.210 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:32:12.210 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:30:28.772328+0000 2024-04-26T21:32:12.210 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:32:12.210 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:32:12.210 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:32:12.210 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:32:12.210 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:32:12.210 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-04-26T21:32:12.210 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:32:12.210 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:32:12.210 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:32:12.210 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:32:12.210 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:32:12.211 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:32:12.211 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456,1=24231} 2024-04-26T21:32:12.211 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:32:12.211 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:32:12.211 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:32:12.211 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:32:12.211 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:32:12.211 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:32:12.211 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:32:12.211 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-04-26T21:32:12.211 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:32:12.211 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 14456 members: 24231,14456 2024-04-26T21:32:12.211 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:32:12.211 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{1:24231} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:32:12.211 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:32:12.212 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:32:12.212 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:32:12.212 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:32:12.212 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:32:12.212 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:32:12.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.210+0000 7f8485000700 1 -- 172.21.15.84:0/1596409323 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f846406ec10 msgr2=0x7f84640710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.210+0000 7f8485000700 1 --2- 172.21.15.84:0/1596409323 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f846406ec10 0x7f84640710c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f846c006fd0 tx=0x7f846c008040 comp rx=0 tx=0).stop 2024-04-26T21:32:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.210+0000 7f8485000700 1 -- 172.21.15.84:0/1596409323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84800fce40 msgr2=0x7f848010fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.210+0000 7f8485000700 1 --2- 172.21.15.84:0/1596409323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84800fce40 0x7f848010fba0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f847000b970 tx=0x7f8470009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.211+0000 7f8485000700 1 -- 172.21.15.84:0/1596409323 shutdown_connections 2024-04-26T21:32:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.211+0000 7f8485000700 1 --2- 172.21.15.84:0/1596409323 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f846406ec10 0x7f84640710c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.211+0000 7f8485000700 1 --2- 172.21.15.84:0/1596409323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84800fce40 0x7f848010fba0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.211+0000 7f8485000700 1 --2- 172.21.15.84:0/1596409323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84800fe040 0x7f84801100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.211+0000 7f8485000700 1 -- 172.21.15.84:0/1596409323 >> 172.21.15.84:0/1596409323 conn(0x7f84800f84a0 msgr2=0x7f84800f9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.211+0000 7f8485000700 1 -- 172.21.15.84:0/1596409323 shutdown_connections 2024-04-26T21:32:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.211+0000 7f8485000700 1 -- 172.21.15.84:0/1596409323 wait complete. 2024-04-26T21:32:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2024-04-26T21:32:12.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.363+0000 7fe746600700 1 -- 172.21.15.84:0/2884964867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe740070940 msgr2=0x7fe740070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:12.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.363+0000 7fe746600700 1 --2- 172.21.15.84:0/2884964867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe740070940 0x7fe740070db0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe728004940 tx=0x7fe728009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:12.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.363+0000 7fe746600700 1 -- 172.21.15.84:0/2884964867 shutdown_connections 2024-04-26T21:32:12.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.363+0000 7fe746600700 1 --2- 172.21.15.84:0/2884964867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe740070940 0x7fe740070db0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:12.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.363+0000 7fe746600700 1 --2- 172.21.15.84:0/2884964867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe740071ef0 0x7fe740070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:12.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.363+0000 7fe746600700 1 -- 172.21.15.84:0/2884964867 >> 172.21.15.84:0/2884964867 conn(0x7fe7400f8560 msgr2=0x7fe7400fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:12.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.363+0000 7fe746600700 1 -- 172.21.15.84:0/2884964867 shutdown_connections 2024-04-26T21:32:12.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.363+0000 7fe746600700 1 -- 172.21.15.84:0/2884964867 wait complete. 2024-04-26T21:32:12.365 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:12 smithi084 ceph-mon[90138]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:32:12.365 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:12 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3606989293' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:12.365 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:12 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:12.365 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:12 smithi084 ceph-mon[90138]: pgmap v173: 65 pgs: 1 peering, 64 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:32:12.365 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:12 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:12.365 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:12 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:32:12.365 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:12 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:32:12.365 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:12 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:12.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.364+0000 7fe746600700 1 Processor -- start 2024-04-26T21:32:12.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.364+0000 7fe746600700 1 -- start start 2024-04-26T21:32:12.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.365+0000 7fe746600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe740070940 0x7fe74010fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:12.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.365+0000 7fe746600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe740071ef0 0x7fe740110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:12.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.365+0000 7fe746600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe740110730 con 0x7fe740071ef0 2024-04-26T21:32:12.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.365+0000 7fe746600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe740110f30 con 0x7fe740070940 2024-04-26T21:32:12.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.365+0000 7fe737e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe740071ef0 0x7fe740110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:12.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.365+0000 7fe737e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe740071ef0 0x7fe740110130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55882/0 (socket says 172.21.15.84:55882) 2024-04-26T21:32:12.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.365+0000 7fe737e00700 1 -- 172.21.15.84:0/3257316847 learned_addr learned my addr 172.21.15.84:0/3257316847 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:32:12.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.365+0000 7fe73f400700 1 --2- 172.21.15.84:0/3257316847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe740070940 0x7fe74010fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:12.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.366+0000 7fe737e00700 1 -- 172.21.15.84:0/3257316847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe740070940 msgr2=0x7fe74010fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:12.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.366+0000 7fe737e00700 1 --2- 172.21.15.84:0/3257316847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe740070940 0x7fe74010fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:12.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.366+0000 7fe737e00700 1 -- 172.21.15.84:0/3257316847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe728005040 con 0x7fe740071ef0 2024-04-26T21:32:12.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.366+0000 7fe73f400700 1 --2- 172.21.15.84:0/3257316847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe740070940 0x7fe74010fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:32:12.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.366+0000 7fe737e00700 1 --2- 172.21.15.84:0/3257316847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe740071ef0 0x7fe740110130 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe72800b0d0 tx=0x7fe728009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:12.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.366+0000 7fe737400700 1 -- 172.21.15.84:0/3257316847 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe72800e030 con 0x7fe740071ef0 2024-04-26T21:32:12.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.366+0000 7fe737400700 1 -- 172.21.15.84:0/3257316847 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe72801c400 con 0x7fe740071ef0 2024-04-26T21:32:12.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.366+0000 7fe746600700 1 -- 172.21.15.84:0/3257316847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7401111b0 con 0x7fe740071ef0 2024-04-26T21:32:12.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.366+0000 7fe737400700 1 -- 172.21.15.84:0/3257316847 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe72800b630 con 0x7fe740071ef0 2024-04-26T21:32:12.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.367+0000 7fe746600700 1 -- 172.21.15.84:0/3257316847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7401116f0 con 0x7fe740071ef0 2024-04-26T21:32:12.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.368+0000 7fe746600700 1 -- 172.21.15.84:0/3257316847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe74005f5c0 con 0x7fe740071ef0 2024-04-26T21:32:12.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.370+0000 7fe737400700 1 -- 172.21.15.84:0/3257316847 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe72801c570 con 0x7fe740071ef0 2024-04-26T21:32:12.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.371+0000 7fe737400700 1 --2- 172.21.15.84:0/3257316847 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe72406ec00 0x7fe7240710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:12.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.371+0000 7fe737400700 1 -- 172.21.15.84:0/3257316847 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fe7280901c0 con 0x7fe740071ef0 2024-04-26T21:32:12.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.371+0000 7fe73f400700 1 --2- 172.21.15.84:0/3257316847 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe72406ec00 0x7fe7240710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:12.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.372+0000 7fe73f400700 1 --2- 172.21.15.84:0/3257316847 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe72406ec00 0x7fe7240710b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe730004fd0 tx=0x7fe73000b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:12.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.378+0000 7fe737400700 1 -- 172.21.15.84:0/3257316847 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fe72805ca60 con 0x7fe740071ef0 2024-04-26T21:32:12.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:12 smithi120 ceph-mon[79001]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:32:12.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:12 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3606989293' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:12.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:12 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:12.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:12 smithi120 ceph-mon[79001]: pgmap v173: 65 pgs: 1 peering, 64 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:32:12.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:12 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:12.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:12 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:32:12.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:12 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:32:12.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:12 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:12.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.611+0000 7fe746600700 1 -- 172.21.15.84:0/3257316847 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe740111a70 con 0x7fe72406ec00 2024-04-26T21:32:12.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.613+0000 7fe737400700 1 -- 172.21.15.84:0/3257316847 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe740111a70 con 0x7fe72406ec00 2024-04-26T21:32:12.613 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:32:12.613 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:32:12.613 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:32:12.613 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:32:12.613 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-04-26T21:32:12.614 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr", 2024-04-26T21:32:12.614 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-04-26T21:32:12.614 INFO:teuthology.orchestra.run.smithi084.stdout: "crash" 2024-04-26T21:32:12.614 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-04-26T21:32:12.614 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "11/21 daemons upgraded", 2024-04-26T21:32:12.614 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading osd daemons", 2024-04-26T21:32:12.614 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:32:12.614 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:32:12.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.615+0000 7fe746600700 1 -- 172.21.15.84:0/3257316847 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe72406ec00 msgr2=0x7fe7240710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:12.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.615+0000 7fe746600700 1 --2- 172.21.15.84:0/3257316847 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe72406ec00 0x7fe7240710b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe730004fd0 tx=0x7fe73000b040 comp rx=0 tx=0).stop 2024-04-26T21:32:12.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.615+0000 7fe746600700 1 -- 172.21.15.84:0/3257316847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe740071ef0 msgr2=0x7fe740110130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:12.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.615+0000 7fe746600700 1 --2- 172.21.15.84:0/3257316847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe740071ef0 0x7fe740110130 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe72800b0d0 tx=0x7fe728009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:12.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.616+0000 7fe746600700 1 -- 172.21.15.84:0/3257316847 shutdown_connections 2024-04-26T21:32:12.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.616+0000 7fe746600700 1 --2- 172.21.15.84:0/3257316847 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe72406ec00 0x7fe7240710b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:12.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.616+0000 7fe746600700 1 --2- 172.21.15.84:0/3257316847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe740070940 0x7fe74010fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:12.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.616+0000 7fe746600700 1 --2- 172.21.15.84:0/3257316847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe740071ef0 0x7fe740110130 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:12.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.616+0000 7fe746600700 1 -- 172.21.15.84:0/3257316847 >> 172.21.15.84:0/3257316847 conn(0x7fe7400f8560 msgr2=0x7fe7400f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:12.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.616+0000 7fe746600700 1 -- 172.21.15.84:0/3257316847 shutdown_connections 2024-04-26T21:32:12.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.616+0000 7fe746600700 1 -- 172.21.15.84:0/3257316847 wait complete. 2024-04-26T21:32:12.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.754+0000 7fd703800700 1 -- 172.21.15.84:0/1079221507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6fc073110 msgr2=0x7fd6fc073b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:12.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.754+0000 7fd703800700 1 --2- 172.21.15.84:0/1079221507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6fc073110 0x7fd6fc073b20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8004940 tx=0x7fd6e8009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:12.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.754+0000 7fd703800700 1 -- 172.21.15.84:0/1079221507 shutdown_connections 2024-04-26T21:32:12.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.754+0000 7fd703800700 1 --2- 172.21.15.84:0/1079221507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6fc073110 0x7fd6fc073b20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:12.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.754+0000 7fd703800700 1 --2- 172.21.15.84:0/1079221507 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6fc0727c0 0x7fd6fc072bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:12.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.754+0000 7fd703800700 1 -- 172.21.15.84:0/1079221507 >> 172.21.15.84:0/1079221507 conn(0x7fd6fc0fa8f0 msgr2=0x7fd6fc0fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:12.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.754+0000 7fd703800700 1 -- 172.21.15.84:0/1079221507 shutdown_connections 2024-04-26T21:32:12.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.754+0000 7fd703800700 1 -- 172.21.15.84:0/1079221507 wait complete. 2024-04-26T21:32:12.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.755+0000 7fd703800700 1 Processor -- start 2024-04-26T21:32:12.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.755+0000 7fd703800700 1 -- start start 2024-04-26T21:32:12.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.755+0000 7fd703800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6fc0727c0 0x7fd6fc113f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:12.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.756+0000 7fd703800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6fc114480 0x7fd6fc1194b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:12.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.756+0000 7fd703800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc1149d0 con 0x7fd6fc114480 2024-04-26T21:32:12.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.756+0000 7fd703800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc114b10 con 0x7fd6fc0727c0 2024-04-26T21:32:12.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.756+0000 7fd6fbe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6fc114480 0x7fd6fc1194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:12.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.756+0000 7fd6fbe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6fc114480 0x7fd6fc1194b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55902/0 (socket says 172.21.15.84:55902) 2024-04-26T21:32:12.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.756+0000 7fd6fbe00700 1 -- 172.21.15.84:0/391839485 learned_addr learned my addr 172.21.15.84:0/391839485 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:32:12.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.756+0000 7fd700e00700 1 --2- 172.21.15.84:0/391839485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6fc0727c0 0x7fd6fc113f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:12.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.756+0000 7fd6fbe00700 1 -- 172.21.15.84:0/391839485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6fc0727c0 msgr2=0x7fd6fc113f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:12.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.756+0000 7fd6fbe00700 1 --2- 172.21.15.84:0/391839485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6fc0727c0 0x7fd6fc113f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:12.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.756+0000 7fd6fbe00700 1 -- 172.21.15.84:0/391839485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e8005040 con 0x7fd6fc114480 2024-04-26T21:32:12.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.756+0000 7fd700e00700 1 --2- 172.21.15.84:0/391839485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6fc0727c0 0x7fd6fc113f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:32:12.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.756+0000 7fd6fbe00700 1 --2- 172.21.15.84:0/391839485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6fc114480 0x7fd6fc1194b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800b3b0 tx=0x7fd6e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:12.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.757+0000 7fd6f8c00700 1 -- 172.21.15.84:0/391839485 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6e800e040 con 0x7fd6fc114480 2024-04-26T21:32:12.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.757+0000 7fd6f8c00700 1 -- 172.21.15.84:0/391839485 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6e8004290 con 0x7fd6fc114480 2024-04-26T21:32:12.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.757+0000 7fd703800700 1 -- 172.21.15.84:0/391839485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6fc119a50 con 0x7fd6fc114480 2024-04-26T21:32:12.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.757+0000 7fd6f8c00700 1 -- 172.21.15.84:0/391839485 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6e801c630 con 0x7fd6fc114480 2024-04-26T21:32:12.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.757+0000 7fd703800700 1 -- 172.21.15.84:0/391839485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6fc11a010 con 0x7fd6fc114480 2024-04-26T21:32:12.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.758+0000 7fd703800700 1 -- 172.21.15.84:0/391839485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6fc04c710 con 0x7fd6fc114480 2024-04-26T21:32:12.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.759+0000 7fd6f8c00700 1 -- 172.21.15.84:0/391839485 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd6e800bbf0 con 0x7fd6fc114480 2024-04-26T21:32:12.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.760+0000 7fd6f8c00700 1 --2- 172.21.15.84:0/391839485 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd6e406ec00 0x7fd6e40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:12.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.760+0000 7fd6f8c00700 1 -- 172.21.15.84:0/391839485 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fd6e808fcf0 con 0x7fd6fc114480 2024-04-26T21:32:12.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.761+0000 7fd700e00700 1 --2- 172.21.15.84:0/391839485 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd6e406ec00 0x7fd6e40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:12.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.761+0000 7fd700e00700 1 --2- 172.21.15.84:0/391839485 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd6e406ec00 0x7fd6e40710b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0006fd0 tx=0x7fd6f0008040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:12.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:12.765+0000 7fd6f8c00700 1 -- 172.21.15.84:0/391839485 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fd6e805c5d0 con 0x7fd6fc114480 2024-04-26T21:32:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:13.059+0000 7fd703800700 1 -- 172.21.15.84:0/391839485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd6fc10bf80 con 0x7fd6fc114480 2024-04-26T21:32:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:13.060+0000 7fd6f8c00700 1 -- 172.21.15.84:0/391839485 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fd6e805c160 con 0x7fd6fc114480 2024-04-26T21:32:13.061 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:32:13.061 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:32:13.061 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:32:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:13.062+0000 7fd703800700 1 -- 172.21.15.84:0/391839485 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd6e406ec00 msgr2=0x7fd6e40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:13.062+0000 7fd703800700 1 --2- 172.21.15.84:0/391839485 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd6e406ec00 0x7fd6e40710b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0006fd0 tx=0x7fd6f0008040 comp rx=0 tx=0).stop 2024-04-26T21:32:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:13.062+0000 7fd703800700 1 -- 172.21.15.84:0/391839485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6fc114480 msgr2=0x7fd6fc1194b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:13.062+0000 7fd703800700 1 --2- 172.21.15.84:0/391839485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6fc114480 0x7fd6fc1194b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800b3b0 tx=0x7fd6e8009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:13.063+0000 7fd703800700 1 -- 172.21.15.84:0/391839485 shutdown_connections 2024-04-26T21:32:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:13.063+0000 7fd703800700 1 --2- 172.21.15.84:0/391839485 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd6e406ec00 0x7fd6e40710b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:13.063+0000 7fd703800700 1 --2- 172.21.15.84:0/391839485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6fc0727c0 0x7fd6fc113f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:13.063+0000 7fd703800700 1 --2- 172.21.15.84:0/391839485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6fc114480 0x7fd6fc1194b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:13.063+0000 7fd703800700 1 -- 172.21.15.84:0/391839485 >> 172.21.15.84:0/391839485 conn(0x7fd6fc0fa8f0 msgr2=0x7fd6fc0fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:13.063+0000 7fd703800700 1 -- 172.21.15.84:0/391839485 shutdown_connections 2024-04-26T21:32:13.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:13.063+0000 7fd703800700 1 -- 172.21.15.84:0/391839485 wait complete. 2024-04-26T21:32:13.402 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:13 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:13.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:13 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:13.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:13 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:13.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:13 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:13.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:13 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-26T21:32:13.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:13 smithi120 ceph-mon[79001]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-26T21:32:13.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:13 smithi120 ceph-mon[79001]: Upgrade: osd.5 is safe to restart 2024-04-26T21:32:13.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:13 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/1596409323' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:32:13.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:13 smithi120 ceph-mon[79001]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:32:13.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:13 smithi120 ceph-mon[79001]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/363 objects degraded (1.928%), 3 pgs degraded) 2024-04-26T21:32:13.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:13 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/391839485' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:32:13.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:13 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:13.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:13 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:13.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:13 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:13.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:13 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:13.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:13 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-26T21:32:13.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:13 smithi084 ceph-mon[90138]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-26T21:32:13.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:13 smithi084 ceph-mon[90138]: Upgrade: osd.5 is safe to restart 2024-04-26T21:32:13.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:13 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/1596409323' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:32:13.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:13 smithi084 ceph-mon[90138]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:32:13.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:13 smithi084 ceph-mon[90138]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/363 objects degraded (1.928%), 3 pgs degraded) 2024-04-26T21:32:13.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:13 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/391839485' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:32:15.381 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:15 smithi120 ceph-mon[79001]: pgmap v174: 65 pgs: 65 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:32:15.381 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:15 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:15.381 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:15 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:32:15.381 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:15 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:15.381 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:15 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T21:32:15.382 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:15 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:32:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:15 smithi084 ceph-mon[90138]: pgmap v174: 65 pgs: 65 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:32:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:15 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:15 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:32:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:15 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:15 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T21:32:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:15 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:32:16.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:16 smithi120 ceph-mon[79001]: Upgrade: Updating osd.5 2024-04-26T21:32:16.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:16 smithi120 ceph-mon[79001]: Deploying daemon osd.5 on smithi120 2024-04-26T21:32:16.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:16 smithi084 ceph-mon[90138]: Upgrade: Updating osd.5 2024-04-26T21:32:16.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:16 smithi084 ceph-mon[90138]: Deploying daemon osd.5 on smithi120 2024-04-26T21:32:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:17 smithi084 ceph-mon[90138]: pgmap v175: 65 pgs: 65 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:32:17.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:17 smithi120 ceph-mon[79001]: pgmap v175: 65 pgs: 65 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:32:19.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:19 smithi084 ceph-mon[90138]: pgmap v176: 65 pgs: 65 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:32:19.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:19 smithi120 ceph-mon[79001]: pgmap v176: 65 pgs: 65 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:32:19.933 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:19 smithi120 systemd[1]: Stopping Ceph osd.5 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:32:20.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:20 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:20.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:20 smithi084 ceph-mon[90138]: pgmap v177: 65 pgs: 65 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:32:20.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:20 smithi084 ceph-mon[90138]: osd.5 marked itself down and dead 2024-04-26T21:32:20.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:20 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:20.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:20 smithi120 ceph-mon[79001]: pgmap v177: 65 pgs: 65 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:32:20.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:20 smithi120 ceph-mon[79001]: osd.5 marked itself down and dead 2024-04-26T21:32:20.433 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:20 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[51702]: 2024-04-26T21:32:20.024+0000 7fe58c200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:32:20.433 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:20 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[51702]: 2024-04-26T21:32:20.024+0000 7fe58c200700 -1 osd.5 84 *** Got signal Terminated *** 2024-04-26T21:32:20.433 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:20 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[51702]: 2024-04-26T21:32:20.024+0000 7fe58c200700 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:32:20.933 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:20 smithi120 podman[98151]: 2024-04-26 21:32:20.600609563 +0000 UTC m=+0.754401012 container died 9b60997971a874f77f17f3e96f8e394c70d6bbd4b81e87fffeae9faaff80aebe (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=quincy-2be3efa, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-26T21:32:21.196 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:21 smithi120 ceph-mon[79001]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:32:21.197 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:21 smithi120 ceph-mon[79001]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-26T21:32:21.197 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:21 smithi120 ceph-mon[79001]: osdmap e85: 6 total, 5 up, 6 in 2024-04-26T21:32:21.197 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:21 smithi120 podman[98151]: 2024-04-26 21:32:21.154288529 +0000 UTC m=+1.308080038 container cleanup 9b60997971a874f77f17f3e96f8e394c70d6bbd4b81e87fffeae9faaff80aebe (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, RELEASE=quincy-2be3efa, maintainer=Guillaume Abrioux ) 2024-04-26T21:32:21.197 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:21 smithi120 bash[98151]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5 2024-04-26T21:32:21.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:21 smithi084 ceph-mon[90138]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:32:21.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:21 smithi084 ceph-mon[90138]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-26T21:32:21.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:21 smithi084 ceph-mon[90138]: osdmap e85: 6 total, 5 up, 6 in 2024-04-26T21:32:21.682 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:21 smithi120 podman[98169]: 2024-04-26 21:32:21.412354395 +0000 UTC m=+0.800081805 container remove 9b60997971a874f77f17f3e96f8e394c70d6bbd4b81e87fffeae9faaff80aebe (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5, ceph=True, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-2be3efa, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-26T21:32:22.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:22 smithi084 ceph-mon[90138]: osdmap e86: 6 total, 5 up, 6 in 2024-04-26T21:32:22.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:22 smithi084 ceph-mon[90138]: pgmap v180: 65 pgs: 6 peering, 10 stale+active+clean, 49 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:32:22.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:22 smithi120 ceph-mon[79001]: osdmap e86: 6 total, 5 up, 6 in 2024-04-26T21:32:22.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:22 smithi120 ceph-mon[79001]: pgmap v180: 65 pgs: 6 peering, 10 stale+active+clean, 49 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:32:22.433 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:22 smithi120 podman[98258]: 2024-04-26 21:32:22.158565935 +0000 UTC m=+0.037014882 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:32:22.433 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:22 smithi120 podman[98258]: 2024-04-26 21:32:22.271583895 +0000 UTC m=+0.150032879 container create 54492f7d9133de11f7b380e6273e6a13d1eb691337ebd1db8fb1f881430be246 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-deactivate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0) 2024-04-26T21:32:22.933 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:22 smithi120 podman[98258]: 2024-04-26 21:32:22.601238429 +0000 UTC m=+0.479687399 container init 54492f7d9133de11f7b380e6273e6a13d1eb691337ebd1db8fb1f881430be246 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-26T21:32:22.933 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:22 smithi120 podman[98258]: 2024-04-26 21:32:22.613182679 +0000 UTC m=+0.491631611 container start 54492f7d9133de11f7b380e6273e6a13d1eb691337ebd1db8fb1f881430be246 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:32:22.933 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:22 smithi120 podman[98258]: 2024-04-26 21:32:22.725130065 +0000 UTC m=+0.603579086 container attach 54492f7d9133de11f7b380e6273e6a13d1eb691337ebd1db8fb1f881430be246 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-26T21:32:23.399 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:23 smithi120 ceph-mon[79001]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-04-26T21:32:23.399 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:23 smithi120 podman[98258]: 2024-04-26 21:32:23.065943455 +0000 UTC m=+0.944392462 container died 54492f7d9133de11f7b380e6273e6a13d1eb691337ebd1db8fb1f881430be246 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-deactivate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0) 2024-04-26T21:32:23.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:23 smithi084 ceph-mon[90138]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-04-26T21:32:24.171 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:23 smithi120 podman[98283]: 2024-04-26 21:32:23.778622655 +0000 UTC m=+0.691565135 container remove 54492f7d9133de11f7b380e6273e6a13d1eb691337ebd1db8fb1f881430be246 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T21:32:24.171 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:23 smithi120 systemd[1]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.5.service: Deactivated successfully. 2024-04-26T21:32:24.171 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:23 smithi120 systemd[1]: Stopped Ceph osd.5 for 8bb44d26-0411-11ef-bc93-c7b262605968. 2024-04-26T21:32:24.171 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:23 smithi120 systemd[1]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.5.service: Consumed 1min 36.081s CPU time. 2024-04-26T21:32:24.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:24 smithi120 ceph-mon[79001]: pgmap v181: 65 pgs: 9 active+undersized+degraded, 6 peering, 1 stale+active+clean, 10 active+undersized, 39 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41/363 objects degraded (11.295%) 2024-04-26T21:32:24.433 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:24 smithi120 systemd[1]: Starting Ceph osd.5 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:32:24.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:24 smithi084 ceph-mon[90138]: pgmap v181: 65 pgs: 9 active+undersized+degraded, 6 peering, 1 stale+active+clean, 10 active+undersized, 39 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41/363 objects degraded (11.295%) 2024-04-26T21:32:24.851 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:24 smithi120 podman[98385]: 2024-04-26 21:32:24.445050938 +0000 UTC m=+0.035140861 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:32:24.851 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:24 smithi120 podman[98385]: 2024-04-26 21:32:24.579799349 +0000 UTC m=+0.169889336 container create 5a3259555eb4fc9ad512ecf4dc999e9763f1ac7153e4c51eed13a75e90fa65b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-26T21:32:24.852 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:24 smithi120 podman[98385]: 2024-04-26 21:32:24.850636429 +0000 UTC m=+0.440726395 container init 5a3259555eb4fc9ad512ecf4dc999e9763f1ac7153e4c51eed13a75e90fa65b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2) 2024-04-26T21:32:25.174 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:24 smithi120 podman[98385]: 2024-04-26 21:32:24.862433335 +0000 UTC m=+0.452523302 container start 5a3259555eb4fc9ad512ecf4dc999e9763f1ac7153e4c51eed13a75e90fa65b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:32:25.174 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:24 smithi120 podman[98385]: 2024-04-26 21:32:24.94080786 +0000 UTC m=+0.530897873 container attach 5a3259555eb4fc9ad512ecf4dc999e9763f1ac7153e4c51eed13a75e90fa65b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-activate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-04-26T21:32:25.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:25 smithi120 ceph-mon[79001]: Health check failed: Degraded data redundancy: 41/363 objects degraded (11.295%), 9 pgs degraded (PG_DEGRADED) 2024-04-26T21:32:25.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:25 smithi084 ceph-mon[90138]: Health check failed: Degraded data redundancy: 41/363 objects degraded (11.295%), 9 pgs degraded (PG_DEGRADED) 2024-04-26T21:32:26.185 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:25 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-activate[98400]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:32:26.185 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:25 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-activate[98400]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:32:26.185 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:25 smithi120 bash[98385]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:32:26.185 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:25 smithi120 bash[98385]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:32:26.185 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:25 smithi120 bash[98385]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T21:32:26.185 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:25 smithi120 bash[98385]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-26T21:32:26.185 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:25 smithi120 bash[98385]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-26T21:32:26.185 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:25 smithi120 bash[98385]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-26T21:32:26.186 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:25 smithi120 bash[98385]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-26T21:32:26.186 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:25 smithi120 bash[98385]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T21:32:26.186 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:25 smithi120 bash[98385]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-26T21:32:26.186 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:25 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-activate[98400]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T21:32:26.186 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:25 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-activate[98400]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-26T21:32:26.186 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:25 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-activate[98400]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-26T21:32:26.186 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:25 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-activate[98400]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-26T21:32:26.186 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:25 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-activate[98400]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-26T21:32:26.186 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:25 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-activate[98400]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T21:32:26.186 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:25 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-activate[98400]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-26T21:32:26.186 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:25 smithi120 podman[98385]: 2024-04-26 21:32:25.84194529 +0000 UTC m=+1.432035290 container died 5a3259555eb4fc9ad512ecf4dc999e9763f1ac7153e4c51eed13a75e90fa65b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-activate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-04-26T21:32:26.587 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:26 smithi120 ceph-mon[79001]: pgmap v182: 65 pgs: 11 active+undersized+degraded, 6 peering, 11 active+undersized, 37 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48/363 objects degraded (13.223%) 2024-04-26T21:32:26.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:26 smithi084 ceph-mon[90138]: pgmap v182: 65 pgs: 11 active+undersized+degraded, 6 peering, 11 active+undersized, 37 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48/363 objects degraded (13.223%) 2024-04-26T21:32:26.932 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:26 smithi120 podman[98534]: 2024-04-26 21:32:26.58639845 +0000 UTC m=+0.722183280 container remove 5a3259555eb4fc9ad512ecf4dc999e9763f1ac7153e4c51eed13a75e90fa65b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:32:27.217 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:26 smithi120 podman[98594]: 2024-04-26 21:32:26.855237263 +0000 UTC m=+0.032479363 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:32:27.218 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:26 smithi120 podman[98594]: 2024-04-26 21:32:26.971215576 +0000 UTC m=+0.148457744 container create e39948e51a137afcde075a5bc5920c1628820686dc8014bfff43a8ee28483d78 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-26T21:32:27.218 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:27 smithi120 podman[98594]: 2024-04-26 21:32:27.216540636 +0000 UTC m=+0.393782781 container init e39948e51a137afcde075a5bc5920c1628820686dc8014bfff43a8ee28483d78 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-26T21:32:27.683 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:27 smithi120 podman[98594]: 2024-04-26 21:32:27.227569645 +0000 UTC m=+0.404811816 container start e39948e51a137afcde075a5bc5920c1628820686dc8014bfff43a8ee28483d78 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:32:27.683 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:27 smithi120 ceph-osd[98612]: -- 172.21.15.120:0/3026363012 <== mon.1 v2:172.21.15.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562d1d7f3680 con 0x562d1d7bcc00 2024-04-26T21:32:27.683 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:27 smithi120 bash[98594]: e39948e51a137afcde075a5bc5920c1628820686dc8014bfff43a8ee28483d78 2024-04-26T21:32:27.683 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:27 smithi120 systemd[1]: Started Ceph osd.5 for 8bb44d26-0411-11ef-bc93-c7b262605968. 2024-04-26T21:32:28.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:27 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:32:27.812+0000 7fd47d88e7c0 -1 Falling back to public interface 2024-04-26T21:32:28.777 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:28 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:28.778 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:28 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:28.778 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:28 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:28.778 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:28 smithi120 ceph-mon[79001]: pgmap v183: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/363 objects degraded (15.152%) 2024-04-26T21:32:28.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:28 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:28.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:28 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:28.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:28 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:28.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:28 smithi084 ceph-mon[90138]: pgmap v183: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/363 objects degraded (15.152%) 2024-04-26T21:32:29.849 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:29 smithi120 ceph-mon[79001]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-04-26T21:32:29.850 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:29 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:29.850 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:29 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:32:29.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:29 smithi084 ceph-mon[90138]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-04-26T21:32:29.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:29 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:29.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:29 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:32:30.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:30 smithi084 ceph-mon[90138]: pgmap v184: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/363 objects degraded (15.152%) 2024-04-26T21:32:30.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:30 smithi120 ceph-mon[79001]: pgmap v184: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/363 objects degraded (15.152%) 2024-04-26T21:32:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:32 smithi084 ceph-mon[90138]: pgmap v185: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/363 objects degraded (15.152%) 2024-04-26T21:32:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:32 smithi084 ceph-mon[90138]: Health check update: Degraded data redundancy: 55/363 objects degraded (15.152%), 14 pgs degraded (PG_DEGRADED) 2024-04-26T21:32:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:32 smithi084 ceph-mon[90138]: from='osd.5 [v2:172.21.15.120:6816/3209575908,v1:172.21.15.120:6817/3209575908]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T21:32:33.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:32 smithi084 ceph-mon[90138]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T21:32:33.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:32 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:32:32.789+0000 7fd47d88e7c0 -1 osd.5 84 log_to_monitors true 2024-04-26T21:32:33.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:32:32 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:32:32.922+0000 7fd46cc00700 -1 osd.5 84 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:32:33.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:32 smithi120 ceph-mon[79001]: pgmap v185: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/363 objects degraded (15.152%) 2024-04-26T21:32:33.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:32 smithi120 ceph-mon[79001]: Health check update: Degraded data redundancy: 55/363 objects degraded (15.152%), 14 pgs degraded (PG_DEGRADED) 2024-04-26T21:32:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:32 smithi120 ceph-mon[79001]: from='osd.5 [v2:172.21.15.120:6816/3209575908,v1:172.21.15.120:6817/3209575908]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T21:32:33.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:32 smithi120 ceph-mon[79001]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T21:32:34.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:33 smithi120 ceph-mon[79001]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T21:32:34.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:33 smithi120 ceph-mon[79001]: osdmap e87: 6 total, 5 up, 6 in 2024-04-26T21:32:34.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:33 smithi120 ceph-mon[79001]: from='osd.5 [v2:172.21.15.120:6816/3209575908,v1:172.21.15.120:6817/3209575908]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:32:34.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:33 smithi120 ceph-mon[79001]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:32:34.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:33 smithi084 ceph-mon[90138]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T21:32:34.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:33 smithi084 ceph-mon[90138]: osdmap e87: 6 total, 5 up, 6 in 2024-04-26T21:32:34.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:33 smithi084 ceph-mon[90138]: from='osd.5 [v2:172.21.15.120:6816/3209575908,v1:172.21.15.120:6817/3209575908]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:32:34.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:33 smithi084 ceph-mon[90138]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-04-26T21:32:35.147 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:34 smithi120 ceph-mon[79001]: pgmap v187: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 55/363 objects degraded (15.152%) 2024-04-26T21:32:35.147 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:34 smithi120 ceph-mon[79001]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:32:35.147 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:34 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:35.147 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:34 smithi120 ceph-mon[79001]: osd.5 [v2:172.21.15.120:6816/3209575908,v1:172.21.15.120:6817/3209575908] boot 2024-04-26T21:32:35.148 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:34 smithi120 ceph-mon[79001]: osdmap e88: 6 total, 6 up, 6 in 2024-04-26T21:32:35.148 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:34 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:32:35.148 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:34 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:35.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:34 smithi084 ceph-mon[90138]: pgmap v187: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 55/363 objects degraded (15.152%) 2024-04-26T21:32:35.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:34 smithi084 ceph-mon[90138]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:32:35.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:34 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:35.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:34 smithi084 ceph-mon[90138]: osd.5 [v2:172.21.15.120:6816/3209575908,v1:172.21.15.120:6817/3209575908] boot 2024-04-26T21:32:35.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:34 smithi084 ceph-mon[90138]: osdmap e88: 6 total, 6 up, 6 in 2024-04-26T21:32:35.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:34 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:32:35.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:34 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:36.411 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:35 smithi120 ceph-mon[79001]: osdmap e89: 6 total, 6 up, 6 in 2024-04-26T21:32:36.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:35 smithi084 ceph-mon[90138]: osdmap e89: 6 total, 6 up, 6 in 2024-04-26T21:32:37.257 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:36 smithi120 ceph-mon[79001]: pgmap v190: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 55/363 objects degraded (15.152%) 2024-04-26T21:32:37.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:36 smithi084 ceph-mon[90138]: pgmap v190: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 55/363 objects degraded (15.152%) 2024-04-26T21:32:38.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:38 smithi084 ceph-mon[90138]: pgmap v191: 65 pgs: 12 active+undersized+degraded, 13 active+undersized, 40 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 51/363 objects degraded (14.050%) 2024-04-26T21:32:38.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:38 smithi120 ceph-mon[79001]: pgmap v191: 65 pgs: 12 active+undersized+degraded, 13 active+undersized, 40 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 51/363 objects degraded (14.050%) 2024-04-26T21:32:39.564 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:39 smithi084 ceph-mon[90138]: Health check update: Degraded data redundancy: 51/363 objects degraded (14.050%), 12 pgs degraded (PG_DEGRADED) 2024-04-26T21:32:39.588 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:39 smithi120 ceph-mon[79001]: Health check update: Degraded data redundancy: 51/363 objects degraded (14.050%), 12 pgs degraded (PG_DEGRADED) 2024-04-26T21:32:41.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:41.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:41.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:32:41.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:32:41.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:41.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: pgmap v192: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:32:41.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:41.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:41.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:41.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:41.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:41.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: Upgrade: Setting container_image for all osd 2024-04-26T21:32:41.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:41.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-26T21:32:41.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-26T21:32:41.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-26T21:32:41.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-26T21:32:41.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-26T21:32:41.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-26T21:32:41.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-26T21:32:41.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-26T21:32:41.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-26T21:32:41.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-26T21:32:41.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-26T21:32:41.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-26T21:32:41.165 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-26T21:32:41.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:41.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:41.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:32:41.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:32:41.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:41.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: pgmap v192: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:32:41.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:41.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:41.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:41.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:41.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:41.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: Upgrade: Setting container_image for all osd 2024-04-26T21:32:41.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:41.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-26T21:32:41.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-26T21:32:41.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-26T21:32:41.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-26T21:32:41.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-26T21:32:41.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-26T21:32:41.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-26T21:32:41.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-26T21:32:41.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-26T21:32:41.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-26T21:32:41.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-26T21:32:41.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-26T21:32:41.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-26T21:32:42.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:41 smithi084 ceph-mon[90138]: Upgrade: Setting require_osd_release to 19 squid 2024-04-26T21:32:42.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:41 smithi084 ceph-mon[90138]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 51/363 objects degraded (14.050%), 12 pgs degraded) 2024-04-26T21:32:42.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:41 smithi084 ceph-mon[90138]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-26T21:32:42.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:41 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-26T21:32:42.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:41 smithi084 ceph-mon[90138]: osdmap e90: 6 total, 6 up, 6 in 2024-04-26T21:32:42.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:41 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:42.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:41 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-26T21:32:42.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:41 smithi120 ceph-mon[79001]: Upgrade: Setting require_osd_release to 19 squid 2024-04-26T21:32:42.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:41 smithi120 ceph-mon[79001]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 51/363 objects degraded (14.050%), 12 pgs degraded) 2024-04-26T21:32:42.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:41 smithi120 ceph-mon[79001]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-26T21:32:42.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:41 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-26T21:32:42.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:41 smithi120 ceph-mon[79001]: osdmap e90: 6 total, 6 up, 6 in 2024-04-26T21:32:42.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:41 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:42.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:41 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-26T21:32:43.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:42 smithi084 ceph-mon[90138]: Upgrade: Scaling down filesystem cephfs 2024-04-26T21:32:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:42 smithi084 ceph-mon[90138]: pgmap v194: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:32:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:42 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-26T21:32:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:42 smithi084 ceph-mon[90138]: stopping daemon mds.cephfs.smithi120.qnkxcn 2024-04-26T21:32:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:42 smithi084 ceph-mon[90138]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:32:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:42 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:42 smithi084 ceph-mon[90138]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:stopping} 2 up:standby 2024-04-26T21:32:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:42 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:32:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:42 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:32:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:42 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:42 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:43.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:42 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:43.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:42 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:43.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:42 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:43.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:42 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:43.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:42 smithi120 ceph-mon[79001]: Upgrade: Scaling down filesystem cephfs 2024-04-26T21:32:43.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:42 smithi120 ceph-mon[79001]: pgmap v194: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:32:43.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:42 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-26T21:32:43.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:42 smithi120 ceph-mon[79001]: stopping daemon mds.cephfs.smithi120.qnkxcn 2024-04-26T21:32:43.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:42 smithi120 ceph-mon[79001]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:active} 2 up:standby 2024-04-26T21:32:43.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:42 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:43.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:42 smithi120 ceph-mon[79001]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:stopping} 2 up:standby 2024-04-26T21:32:43.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:42 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:32:43.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:42 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:32:43.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:42 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:43.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:42 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:43.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:42 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:43.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:42 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:43.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:42 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:43.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:42 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:43.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.226+0000 7f5b48000700 1 -- 172.21.15.84:0/1816953356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b400fdfd0 msgr2=0x7f5b400fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:43.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.226+0000 7f5b48000700 1 --2- 172.21.15.84:0/1816953356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b400fdfd0 0x7f5b400fe440 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5b30004940 tx=0x7f5b30009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:43.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.226+0000 7f5b48000700 1 -- 172.21.15.84:0/1816953356 shutdown_connections 2024-04-26T21:32:43.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.226+0000 7f5b48000700 1 --2- 172.21.15.84:0/1816953356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b400fdfd0 0x7f5b400fe440 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:43.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.226+0000 7f5b48000700 1 --2- 172.21.15.84:0/1816953356 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b400fce60 0x7f5b400fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:43.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.226+0000 7f5b48000700 1 -- 172.21.15.84:0/1816953356 >> 172.21.15.84:0/1816953356 conn(0x7f5b400f8540 msgr2=0x7f5b400fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:43.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.226+0000 7f5b48000700 1 -- 172.21.15.84:0/1816953356 shutdown_connections 2024-04-26T21:32:43.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.226+0000 7f5b48000700 1 -- 172.21.15.84:0/1816953356 wait complete. 2024-04-26T21:32:43.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.227+0000 7f5b48000700 1 Processor -- start 2024-04-26T21:32:43.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.227+0000 7f5b48000700 1 -- start start 2024-04-26T21:32:43.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.228+0000 7f5b48000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b400fce60 0x7f5b40071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:43.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.228+0000 7f5b48000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b400fdfd0 0x7f5b400702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:43.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.228+0000 7f5b48000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b400707f0 con 0x7f5b400fdfd0 2024-04-26T21:32:43.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.228+0000 7f5b48000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b40070960 con 0x7f5b400fce60 2024-04-26T21:32:43.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.228+0000 7f5b44c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b400fdfd0 0x7f5b400702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:43.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.228+0000 7f5b44c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b400fdfd0 0x7f5b400702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58512/0 (socket says 172.21.15.84:58512) 2024-04-26T21:32:43.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.228+0000 7f5b44c00700 1 -- 172.21.15.84:0/848798067 learned_addr learned my addr 172.21.15.84:0/848798067 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:32:43.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.228+0000 7f5b45600700 1 --2- 172.21.15.84:0/848798067 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b400fce60 0x7f5b40071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:43.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.228+0000 7f5b44c00700 1 -- 172.21.15.84:0/848798067 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b400fce60 msgr2=0x7f5b40071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:43.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.228+0000 7f5b44c00700 1 --2- 172.21.15.84:0/848798067 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b400fce60 0x7f5b40071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:43.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.228+0000 7f5b44c00700 1 -- 172.21.15.84:0/848798067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b30005040 con 0x7f5b400fdfd0 2024-04-26T21:32:43.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.229+0000 7f5b44c00700 1 --2- 172.21.15.84:0/848798067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b400fdfd0 0x7f5b400702b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009150 tx=0x7f5b30009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:43.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.229+0000 7f5b3d600700 1 -- 172.21.15.84:0/848798067 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b3000e040 con 0x7f5b400fdfd0 2024-04-26T21:32:43.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.229+0000 7f5b3d600700 1 -- 172.21.15.84:0/848798067 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5b3000bcc0 con 0x7f5b400fdfd0 2024-04-26T21:32:43.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.229+0000 7f5b48000700 1 -- 172.21.15.84:0/848798067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b40070be0 con 0x7f5b400fdfd0 2024-04-26T21:32:43.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.229+0000 7f5b3d600700 1 -- 172.21.15.84:0/848798067 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b3001c630 con 0x7f5b400fdfd0 2024-04-26T21:32:43.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.229+0000 7f5b48000700 1 -- 172.21.15.84:0/848798067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b40115a40 con 0x7f5b400fdfd0 2024-04-26T21:32:43.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.231+0000 7f5b48000700 1 -- 172.21.15.84:0/848798067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b4004c710 con 0x7f5b400fdfd0 2024-04-26T21:32:43.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.231+0000 7f5b3d600700 1 -- 172.21.15.84:0/848798067 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5b30013420 con 0x7f5b400fdfd0 2024-04-26T21:32:43.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.232+0000 7f5b3d600700 1 --2- 172.21.15.84:0/848798067 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5b2806ec00 0x7f5b280710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:43.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.232+0000 7f5b3d600700 1 -- 172.21.15.84:0/848798067 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f5b3008f580 con 0x7f5b400fdfd0 2024-04-26T21:32:43.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.233+0000 7f5b45600700 1 --2- 172.21.15.84:0/848798067 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5b2806ec00 0x7f5b280710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:43.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.233+0000 7f5b45600700 1 --2- 172.21.15.84:0/848798067 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5b2806ec00 0x7f5b280710b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b34006fd0 tx=0x7f5b34008040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:43.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.238+0000 7f5b3d600700 1 -- 172.21.15.84:0/848798067 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f5b3005be60 con 0x7f5b400fdfd0 2024-04-26T21:32:43.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.483+0000 7f5b48000700 1 -- 172.21.15.84:0/848798067 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b40102270 con 0x7f5b2806ec00 2024-04-26T21:32:43.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.485+0000 7f5b3d600700 1 -- 172.21.15.84:0/848798067 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5b40102270 con 0x7f5b2806ec00 2024-04-26T21:32:43.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.488+0000 7f5b48000700 1 -- 172.21.15.84:0/848798067 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5b2806ec00 msgr2=0x7f5b280710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:43.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.488+0000 7f5b48000700 1 --2- 172.21.15.84:0/848798067 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5b2806ec00 0x7f5b280710b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b34006fd0 tx=0x7f5b34008040 comp rx=0 tx=0).stop 2024-04-26T21:32:43.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.488+0000 7f5b48000700 1 -- 172.21.15.84:0/848798067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b400fdfd0 msgr2=0x7f5b400702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:43.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.488+0000 7f5b48000700 1 --2- 172.21.15.84:0/848798067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b400fdfd0 0x7f5b400702b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009150 tx=0x7f5b30009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:43.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.488+0000 7f5b48000700 1 -- 172.21.15.84:0/848798067 shutdown_connections 2024-04-26T21:32:43.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.489+0000 7f5b48000700 1 --2- 172.21.15.84:0/848798067 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5b2806ec00 0x7f5b280710b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:43.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.489+0000 7f5b48000700 1 --2- 172.21.15.84:0/848798067 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b400fce60 0x7f5b40071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:43.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.489+0000 7f5b48000700 1 --2- 172.21.15.84:0/848798067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b400fdfd0 0x7f5b400702b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:43.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.489+0000 7f5b48000700 1 -- 172.21.15.84:0/848798067 >> 172.21.15.84:0/848798067 conn(0x7f5b400f8540 msgr2=0x7f5b400f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:43.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.489+0000 7f5b48000700 1 -- 172.21.15.84:0/848798067 shutdown_connections 2024-04-26T21:32:43.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.489+0000 7f5b48000700 1 -- 172.21.15.84:0/848798067 wait complete. 2024-04-26T21:32:43.508 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:32:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.647+0000 7f2e36800700 1 -- 172.21.15.84:0/2334489864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e300727c0 msgr2=0x7f2e30072bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.647+0000 7f2e36800700 1 --2- 172.21.15.84:0/2334489864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e300727c0 0x7f2e30072bd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2e20004940 tx=0x7f2e20009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.647+0000 7f2e36800700 1 -- 172.21.15.84:0/2334489864 shutdown_connections 2024-04-26T21:32:43.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.647+0000 7f2e36800700 1 --2- 172.21.15.84:0/2334489864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e30073110 0x7f2e30073b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:43.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.647+0000 7f2e36800700 1 --2- 172.21.15.84:0/2334489864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e300727c0 0x7f2e30072bd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:43.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.647+0000 7f2e36800700 1 -- 172.21.15.84:0/2334489864 >> 172.21.15.84:0/2334489864 conn(0x7f2e300fa8f0 msgr2=0x7f2e300fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:43.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.647+0000 7f2e36800700 1 -- 172.21.15.84:0/2334489864 shutdown_connections 2024-04-26T21:32:43.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.647+0000 7f2e36800700 1 -- 172.21.15.84:0/2334489864 wait complete. 2024-04-26T21:32:43.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.648+0000 7f2e36800700 1 Processor -- start 2024-04-26T21:32:43.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.648+0000 7f2e36800700 1 -- start start 2024-04-26T21:32:43.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.649+0000 7f2e36800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e300727c0 0x7f2e30113f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:43.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.649+0000 7f2e36800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e30114460 0x7f2e30119490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:43.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.649+0000 7f2e36800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e30114920 con 0x7f2e30114460 2024-04-26T21:32:43.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.649+0000 7f2e36800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e30114a60 con 0x7f2e300727c0 2024-04-26T21:32:43.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.649+0000 7f2e26a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e30114460 0x7f2e30119490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:43.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.649+0000 7f2e26a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e30114460 0x7f2e30119490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58534/0 (socket says 172.21.15.84:58534) 2024-04-26T21:32:43.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.649+0000 7f2e26a00700 1 -- 172.21.15.84:0/3397197441 learned_addr learned my addr 172.21.15.84:0/3397197441 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:32:43.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.649+0000 7f2e2f400700 1 --2- 172.21.15.84:0/3397197441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e300727c0 0x7f2e30113f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:43.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.649+0000 7f2e26a00700 1 -- 172.21.15.84:0/3397197441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e300727c0 msgr2=0x7f2e30113f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:43.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.649+0000 7f2e26a00700 1 --2- 172.21.15.84:0/3397197441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e300727c0 0x7f2e30113f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:43.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.649+0000 7f2e26a00700 1 -- 172.21.15.84:0/3397197441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e20005040 con 0x7f2e30114460 2024-04-26T21:32:43.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.650+0000 7f2e26a00700 1 --2- 172.21.15.84:0/3397197441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e30114460 0x7f2e30119490 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2e18002a50 tx=0x7f2e180046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:43.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.650+0000 7f2e27e00700 1 -- 172.21.15.84:0/3397197441 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e18007cc0 con 0x7f2e30114460 2024-04-26T21:32:43.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.650+0000 7f2e27e00700 1 -- 172.21.15.84:0/3397197441 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e1800f040 con 0x7f2e30114460 2024-04-26T21:32:43.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.650+0000 7f2e36800700 1 -- 172.21.15.84:0/3397197441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e30119a30 con 0x7f2e30114460 2024-04-26T21:32:43.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.650+0000 7f2e27e00700 1 -- 172.21.15.84:0/3397197441 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e18009640 con 0x7f2e30114460 2024-04-26T21:32:43.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.650+0000 7f2e36800700 1 -- 172.21.15.84:0/3397197441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e30119fa0 con 0x7f2e30114460 2024-04-26T21:32:43.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.651+0000 7f2e36800700 1 -- 172.21.15.84:0/3397197441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3004c710 con 0x7f2e30114460 2024-04-26T21:32:43.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.652+0000 7f2e27e00700 1 -- 172.21.15.84:0/3397197441 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2e180097a0 con 0x7f2e30114460 2024-04-26T21:32:43.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.653+0000 7f2e27e00700 1 --2- 172.21.15.84:0/3397197441 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2e1406ec00 0x7f2e140710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:43.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.654+0000 7f2e27e00700 1 -- 172.21.15.84:0/3397197441 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f2e1808e780 con 0x7f2e30114460 2024-04-26T21:32:43.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.654+0000 7f2e2f400700 1 --2- 172.21.15.84:0/3397197441 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2e1406ec00 0x7f2e140710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:43.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.654+0000 7f2e2f400700 1 --2- 172.21.15.84:0/3397197441 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2e1406ec00 0x7f2e140710b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000b970 tx=0x7f2e20009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:43.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.658+0000 7f2e27e00700 1 -- 172.21.15.84:0/3397197441 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f2e1805af60 con 0x7f2e30114460 2024-04-26T21:32:43.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:43 smithi084 ceph-mon[90138]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-04-26T21:32:43.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.911+0000 7f2e36800700 1 -- 172.21.15.84:0/3397197441 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e3010a4c0 con 0x7f2e1406ec00 2024-04-26T21:32:43.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.913+0000 7f2e27e00700 1 -- 172.21.15.84:0/3397197441 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2e3010a4c0 con 0x7f2e1406ec00 2024-04-26T21:32:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.916+0000 7f2e36800700 1 -- 172.21.15.84:0/3397197441 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2e1406ec00 msgr2=0x7f2e140710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.916+0000 7f2e36800700 1 --2- 172.21.15.84:0/3397197441 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2e1406ec00 0x7f2e140710b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000b970 tx=0x7f2e20009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.916+0000 7f2e36800700 1 -- 172.21.15.84:0/3397197441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e30114460 msgr2=0x7f2e30119490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.916+0000 7f2e36800700 1 --2- 172.21.15.84:0/3397197441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e30114460 0x7f2e30119490 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2e18002a50 tx=0x7f2e180046b0 comp rx=0 tx=0).stop 2024-04-26T21:32:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.916+0000 7f2e36800700 1 -- 172.21.15.84:0/3397197441 shutdown_connections 2024-04-26T21:32:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.916+0000 7f2e36800700 1 --2- 172.21.15.84:0/3397197441 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2e1406ec00 0x7f2e140710b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.916+0000 7f2e36800700 1 --2- 172.21.15.84:0/3397197441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e300727c0 0x7f2e30113f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.916+0000 7f2e36800700 1 --2- 172.21.15.84:0/3397197441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e30114460 0x7f2e30119490 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.916+0000 7f2e36800700 1 -- 172.21.15.84:0/3397197441 >> 172.21.15.84:0/3397197441 conn(0x7f2e300fa8f0 msgr2=0x7f2e300fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:43.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.917+0000 7f2e36800700 1 -- 172.21.15.84:0/3397197441 shutdown_connections 2024-04-26T21:32:43.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:43.917+0000 7f2e36800700 1 -- 172.21.15.84:0/3397197441 wait complete. 2024-04-26T21:32:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.063+0000 7f523a600700 1 -- 172.21.15.84:0/1406498434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52340ffdc0 msgr2=0x7f52341021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.063+0000 7f523a600700 1 --2- 172.21.15.84:0/1406498434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52340ffdc0 0x7f52341021a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5220004940 tx=0x7f5220009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.063+0000 7f523a600700 1 -- 172.21.15.84:0/1406498434 shutdown_connections 2024-04-26T21:32:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.063+0000 7f523a600700 1 --2- 172.21.15.84:0/1406498434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52340ffdc0 0x7f52341021a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.063+0000 7f523a600700 1 --2- 172.21.15.84:0/1406498434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5234066220 0x7f52340ff880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.063+0000 7f523a600700 1 -- 172.21.15.84:0/1406498434 >> 172.21.15.84:0/1406498434 conn(0x7f52340f7250 msgr2=0x7f52340f9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.063+0000 7f523a600700 1 -- 172.21.15.84:0/1406498434 shutdown_connections 2024-04-26T21:32:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.063+0000 7f523a600700 1 -- 172.21.15.84:0/1406498434 wait complete. 2024-04-26T21:32:44.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.064+0000 7f523a600700 1 Processor -- start 2024-04-26T21:32:44.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.064+0000 7f523a600700 1 -- start start 2024-04-26T21:32:44.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.064+0000 7f523a600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5234066220 0x7f523410fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:44.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.065+0000 7f523a600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52340ffdc0 0x7f523410ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:44.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.065+0000 7f523a600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52341105c0 con 0x7f5234066220 2024-04-26T21:32:44.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.065+0000 7f523a600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5234110e10 con 0x7f52340ffdc0 2024-04-26T21:32:44.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.065+0000 7f5239200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5234066220 0x7f523410fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:44.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.065+0000 7f5239200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5234066220 0x7f523410fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58564/0 (socket says 172.21.15.84:58564) 2024-04-26T21:32:44.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.065+0000 7f5239200700 1 -- 172.21.15.84:0/528887887 learned_addr learned my addr 172.21.15.84:0/528887887 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:32:44.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.065+0000 7f5239200700 1 -- 172.21.15.84:0/528887887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52340ffdc0 msgr2=0x7f523410ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:44.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.065+0000 7f5239200700 1 --2- 172.21.15.84:0/528887887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52340ffdc0 0x7f523410ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:44.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.065+0000 7f5239200700 1 -- 172.21.15.84:0/528887887 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5220005040 con 0x7f5234066220 2024-04-26T21:32:44.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.066+0000 7f5239200700 1 --2- 172.21.15.84:0/528887887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5234066220 0x7f523410fa80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5228002a80 tx=0x7f5228004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:44.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.066+0000 7f5230c00700 1 -- 172.21.15.84:0/528887887 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5228007cc0 con 0x7f5234066220 2024-04-26T21:32:44.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.066+0000 7f523a600700 1 -- 172.21.15.84:0/528887887 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52341110f0 con 0x7f5234066220 2024-04-26T21:32:44.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.066+0000 7f5230c00700 1 -- 172.21.15.84:0/528887887 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f522800f040 con 0x7f5234066220 2024-04-26T21:32:44.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.066+0000 7f5230c00700 1 -- 172.21.15.84:0/528887887 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f522800dad0 con 0x7f5234066220 2024-04-26T21:32:44.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.066+0000 7f523a600700 1 -- 172.21.15.84:0/528887887 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5234111630 con 0x7f5234066220 2024-04-26T21:32:44.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.067+0000 7f523a600700 1 -- 172.21.15.84:0/528887887 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523405f5c0 con 0x7f5234066220 2024-04-26T21:32:44.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.068+0000 7f5230c00700 1 -- 172.21.15.84:0/528887887 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f522800dc30 con 0x7f5234066220 2024-04-26T21:32:44.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.069+0000 7f5230c00700 1 --2- 172.21.15.84:0/528887887 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f521c06ec10 0x7f521c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:44.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.069+0000 7f5230c00700 1 -- 172.21.15.84:0/528887887 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f522808e680 con 0x7f5234066220 2024-04-26T21:32:44.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.070+0000 7f5233e00700 1 --2- 172.21.15.84:0/528887887 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f521c06ec10 0x7f521c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:44.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.070+0000 7f5233e00700 1 --2- 172.21.15.84:0/528887887 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f521c06ec10 0x7f521c0710c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5220004f90 tx=0x7f5220009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:44.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.074+0000 7f5230c00700 1 -- 172.21.15.84:0/528887887 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f522805aee0 con 0x7f5234066220 2024-04-26T21:32:44.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:43 smithi120 ceph-mon[79001]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-04-26T21:32:44.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.296+0000 7f523a600700 1 -- 172.21.15.84:0/528887887 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5234111b40 con 0x7f521c06ec10 2024-04-26T21:32:44.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.325+0000 7f5230c00700 1 -- 172.21.15.84:0/528887887 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f5234111b40 con 0x7f521c06ec10 2024-04-26T21:32:44.327 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:32:44.327 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (7m) 109s ago 18m 14.5M - 0.25.0 c8568f914cd2 bcb419cf9108 2024-04-26T21:32:44.328 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (3m) 109s ago 18m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 b4010dfbe623 2024-04-26T21:32:44.328 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (3m) 12s ago 17m 6665k - 19.0.0-3306-gbc612ffb 55dc54019ad8 89a4e50ea23c 2024-04-26T21:32:44.328 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (7m) 109s ago 18m 76.4M - 9.4.7 954c08fa6188 1bf95f604e07 2024-04-26T21:32:44.328 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (11m) 109s ago 11m 114M - 17.2.7-907-g2be3efa9 1c5834633715 485d7884e1d5 2024-04-26T21:32:44.328 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (11m) 109s ago 11m 14.3M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:32:44.328 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (11m) 12s ago 11m 113M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:32:44.328 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (11m) 12s ago 11m 14.6M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:32:44.328 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (7m) 109s ago 20m 505M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:32:44.328 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283,8765 running (5m) 12s ago 17m 454M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d6ae0b4628b5 2024-04-26T21:32:44.328 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (5m) 109s ago 20m 43.8M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 bf610abb6a62 2024-04-26T21:32:44.328 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (4m) 12s ago 16m 36.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 5d530496253b 2024-04-26T21:32:44.328 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (7m) 109s ago 18m 8010k - 1.5.0 0da6a335fe13 81e00b40bfbf 2024-04-26T21:32:44.328 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (7m) 12s ago 17m 7541k - 1.5.0 0da6a335fe13 0506a1d46ec4 2024-04-26T21:32:44.328 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (2m) 109s ago 16m 124M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 99fbe2faa51b 2024-04-26T21:32:44.328 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (2m) 109s ago 15m 84.9M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 2dc81d93f7e5 2024-04-26T21:32:44.328 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (117s) 109s ago 14m 11.2M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 9e77abf095bd 2024-04-26T21:32:44.329 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (87s) 12s ago 14m 83.1M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 d7e5825e2640 2024-04-26T21:32:44.329 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (45s) 12s ago 13m 80.2M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 894dcbaab8eb 2024-04-26T21:32:44.329 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (17s) 12s ago 13m 11.2M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 e39948e51a13 2024-04-26T21:32:44.329 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (5m) 109s ago 17m 56.2M - 2.43.0 a07b618ecd1d d3008b765eec 2024-04-26T21:32:44.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.328+0000 7f523a600700 1 -- 172.21.15.84:0/528887887 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f521c06ec10 msgr2=0x7f521c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:44.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.328+0000 7f523a600700 1 --2- 172.21.15.84:0/528887887 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f521c06ec10 0x7f521c0710c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5220004f90 tx=0x7f5220009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:44.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.328+0000 7f523a600700 1 -- 172.21.15.84:0/528887887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5234066220 msgr2=0x7f523410fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:44.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.328+0000 7f523a600700 1 --2- 172.21.15.84:0/528887887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5234066220 0x7f523410fa80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5228002a80 tx=0x7f5228004600 comp rx=0 tx=0).stop 2024-04-26T21:32:44.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.328+0000 7f523a600700 1 -- 172.21.15.84:0/528887887 shutdown_connections 2024-04-26T21:32:44.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.328+0000 7f523a600700 1 --2- 172.21.15.84:0/528887887 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f521c06ec10 0x7f521c0710c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:44.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.328+0000 7f523a600700 1 --2- 172.21.15.84:0/528887887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5234066220 0x7f523410fa80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:44.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.328+0000 7f523a600700 1 --2- 172.21.15.84:0/528887887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52340ffdc0 0x7f523410ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:44.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.328+0000 7f523a600700 1 -- 172.21.15.84:0/528887887 >> 172.21.15.84:0/528887887 conn(0x7f52340f7250 msgr2=0x7f52340fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:44.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.329+0000 7f523a600700 1 -- 172.21.15.84:0/528887887 shutdown_connections 2024-04-26T21:32:44.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.329+0000 7f523a600700 1 -- 172.21.15.84:0/528887887 wait complete. 2024-04-26T21:32:44.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.464+0000 7f2d69600700 1 -- 172.21.15.84:0/2262282173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d640feff0 msgr2=0x7f2d640ff400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:44.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.464+0000 7f2d69600700 1 --2- 172.21.15.84:0/2262282173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d640feff0 0x7f2d640ff400 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2d54004940 tx=0x7f2d54009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:44.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.464+0000 7f2d69600700 1 -- 172.21.15.84:0/2262282173 shutdown_connections 2024-04-26T21:32:44.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.464+0000 7f2d69600700 1 --2- 172.21.15.84:0/2262282173 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d641002a0 0x7f2d64100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:44.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.464+0000 7f2d69600700 1 --2- 172.21.15.84:0/2262282173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d640feff0 0x7f2d640ff400 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:44.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.464+0000 7f2d69600700 1 -- 172.21.15.84:0/2262282173 >> 172.21.15.84:0/2262282173 conn(0x7f2d640fa8f0 msgr2=0x7f2d640fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:44.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.464+0000 7f2d69600700 1 -- 172.21.15.84:0/2262282173 shutdown_connections 2024-04-26T21:32:44.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.465+0000 7f2d69600700 1 -- 172.21.15.84:0/2262282173 wait complete. 2024-04-26T21:32:44.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.465+0000 7f2d69600700 1 Processor -- start 2024-04-26T21:32:44.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.465+0000 7f2d69600700 1 -- start start 2024-04-26T21:32:44.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.466+0000 7f2d69600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d640feff0 0x7f2d6410fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:44.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.466+0000 7f2d69600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d641002a0 0x7f2d64110060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:44.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.466+0000 7f2d69600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d641106f0 con 0x7f2d641002a0 2024-04-26T21:32:44.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.466+0000 7f2d69600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d64115090 con 0x7f2d640feff0 2024-04-26T21:32:44.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.466+0000 7f2d5a000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d641002a0 0x7f2d64110060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:44.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.466+0000 7f2d5a000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d641002a0 0x7f2d64110060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58582/0 (socket says 172.21.15.84:58582) 2024-04-26T21:32:44.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.466+0000 7f2d5a000700 1 -- 172.21.15.84:0/4062319811 learned_addr learned my addr 172.21.15.84:0/4062319811 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:32:44.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.466+0000 7f2d62a00700 1 --2- 172.21.15.84:0/4062319811 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d640feff0 0x7f2d6410fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:44.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.466+0000 7f2d5a000700 1 -- 172.21.15.84:0/4062319811 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d640feff0 msgr2=0x7f2d6410fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:44.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.466+0000 7f2d5a000700 1 --2- 172.21.15.84:0/4062319811 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d640feff0 0x7f2d6410fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:44.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.466+0000 7f2d5a000700 1 -- 172.21.15.84:0/4062319811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d54005040 con 0x7f2d641002a0 2024-04-26T21:32:44.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.467+0000 7f2d5a000700 1 --2- 172.21.15.84:0/4062319811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d641002a0 0x7f2d64110060 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c00bbb0 tx=0x7f2d4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:44.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.467+0000 7f2d5b400700 1 -- 172.21.15.84:0/4062319811 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d4c0092e0 con 0x7f2d641002a0 2024-04-26T21:32:44.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.467+0000 7f2d5b400700 1 -- 172.21.15.84:0/4062319811 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d4c00cbd0 con 0x7f2d641002a0 2024-04-26T21:32:44.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.467+0000 7f2d5b400700 1 -- 172.21.15.84:0/4062319811 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d4c007400 con 0x7f2d641002a0 2024-04-26T21:32:44.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.467+0000 7f2d69600700 1 -- 172.21.15.84:0/4062319811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d641152f0 con 0x7f2d641002a0 2024-04-26T21:32:44.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.467+0000 7f2d69600700 1 -- 172.21.15.84:0/4062319811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d64115860 con 0x7f2d641002a0 2024-04-26T21:32:44.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.468+0000 7f2d69600700 1 -- 172.21.15.84:0/4062319811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6404c710 con 0x7f2d641002a0 2024-04-26T21:32:44.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.469+0000 7f2d5b400700 1 -- 172.21.15.84:0/4062319811 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2d4c012070 con 0x7f2d641002a0 2024-04-26T21:32:44.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.470+0000 7f2d5b400700 1 --2- 172.21.15.84:0/4062319811 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2d4806ec00 0x7f2d480710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:44.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.470+0000 7f2d5b400700 1 -- 172.21.15.84:0/4062319811 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f2d4c08e550 con 0x7f2d641002a0 2024-04-26T21:32:44.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.471+0000 7f2d62a00700 1 --2- 172.21.15.84:0/4062319811 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2d4806ec00 0x7f2d480710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:44.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.471+0000 7f2d62a00700 1 --2- 172.21.15.84:0/4062319811 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2d4806ec00 0x7f2d480710b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400b970 tx=0x7f2d54009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:44.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.475+0000 7f2d5b400700 1 -- 172.21.15.84:0/4062319811 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f2d4c05adb0 con 0x7f2d641002a0 2024-04-26T21:32:44.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.795+0000 7f2d69600700 1 -- 172.21.15.84:0/4062319811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2d64115ad0 con 0x7f2d641002a0 2024-04-26T21:32:44.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.796+0000 7f2d5b400700 1 -- 172.21.15.84:0/4062319811 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f2d4c05a940 con 0x7f2d641002a0 2024-04-26T21:32:44.798 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:32:44.798 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:32:44.798 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:32:44.799 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:32:44.799 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:32:44.799 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:32:44.799 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:32:44.799 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:32:44.799 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 6 2024-04-26T21:32:44.799 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:32:44.799 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:32:44.799 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-26T21:32:44.799 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:32:44.799 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:32:44.799 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4, 2024-04-26T21:32:44.800 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 10 2024-04-26T21:32:44.800 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:32:44.800 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:32:44.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.799+0000 7f2d69600700 1 -- 172.21.15.84:0/4062319811 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2d4806ec00 msgr2=0x7f2d480710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:44.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.799+0000 7f2d69600700 1 --2- 172.21.15.84:0/4062319811 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2d4806ec00 0x7f2d480710b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400b970 tx=0x7f2d54009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:44.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.799+0000 7f2d69600700 1 -- 172.21.15.84:0/4062319811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d641002a0 msgr2=0x7f2d64110060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:44.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.799+0000 7f2d69600700 1 --2- 172.21.15.84:0/4062319811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d641002a0 0x7f2d64110060 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c00bbb0 tx=0x7f2d4c009840 comp rx=0 tx=0).stop 2024-04-26T21:32:44.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.799+0000 7f2d69600700 1 -- 172.21.15.84:0/4062319811 shutdown_connections 2024-04-26T21:32:44.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.799+0000 7f2d69600700 1 --2- 172.21.15.84:0/4062319811 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2d4806ec00 0x7f2d480710b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:44.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.799+0000 7f2d69600700 1 --2- 172.21.15.84:0/4062319811 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d640feff0 0x7f2d6410fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.799+0000 7f2d69600700 1 --2- 172.21.15.84:0/4062319811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d641002a0 0x7f2d64110060 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.799+0000 7f2d69600700 1 -- 172.21.15.84:0/4062319811 >> 172.21.15.84:0/4062319811 conn(0x7f2d640fa8f0 msgr2=0x7f2d640fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.799+0000 7f2d69600700 1 -- 172.21.15.84:0/4062319811 shutdown_connections 2024-04-26T21:32:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.799+0000 7f2d69600700 1 -- 172.21.15.84:0/4062319811 wait complete. 2024-04-26T21:32:44.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.944+0000 7fb0cb600700 1 -- 172.21.15.84:0/3466068043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0c40fff10 msgr2=0x7fb0c4102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:44.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.944+0000 7fb0cb600700 1 --2- 172.21.15.84:0/3466068043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0c40fff10 0x7fb0c4102330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0004940 tx=0x7fb0b0009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:44.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.944+0000 7fb0cb600700 1 -- 172.21.15.84:0/3466068043 shutdown_connections 2024-04-26T21:32:44.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.944+0000 7fb0cb600700 1 --2- 172.21.15.84:0/3466068043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0c40fff10 0x7fb0c4102330 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:44.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.944+0000 7fb0cb600700 1 --2- 172.21.15.84:0/3466068043 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0c4066ed0 0x7fb0c40ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:44.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.944+0000 7fb0cb600700 1 -- 172.21.15.84:0/3466068043 >> 172.21.15.84:0/3466068043 conn(0x7fb0c40f7420 msgr2=0x7fb0c40f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:44.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.944+0000 7fb0cb600700 1 -- 172.21.15.84:0/3466068043 shutdown_connections 2024-04-26T21:32:44.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.944+0000 7fb0cb600700 1 -- 172.21.15.84:0/3466068043 wait complete. 2024-04-26T21:32:44.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.945+0000 7fb0cb600700 1 Processor -- start 2024-04-26T21:32:44.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.945+0000 7fb0cb600700 1 -- start start 2024-04-26T21:32:44.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.945+0000 7fb0cb600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0c4066ed0 0x7fb0c40fd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:44.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.945+0000 7fb0cb600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0c40fff10 0x7fb0c40fb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:44.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.945+0000 7fb0cb600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c40fd820 con 0x7fb0c40fff10 2024-04-26T21:32:44.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.945+0000 7fb0cb600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c4111630 con 0x7fb0c4066ed0 2024-04-26T21:32:44.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.945+0000 7fb0c3e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0c40fff10 0x7fb0c40fb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:44.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.946+0000 7fb0c3e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0c40fff10 0x7fb0c40fb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58592/0 (socket says 172.21.15.84:58592) 2024-04-26T21:32:44.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.946+0000 7fb0c3e00700 1 -- 172.21.15.84:0/2344377901 learned_addr learned my addr 172.21.15.84:0/2344377901 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:32:44.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.946+0000 7fb0c8c00700 1 --2- 172.21.15.84:0/2344377901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0c4066ed0 0x7fb0c40fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:44.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.946+0000 7fb0c3e00700 1 -- 172.21.15.84:0/2344377901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0c4066ed0 msgr2=0x7fb0c40fd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:44.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.946+0000 7fb0c3e00700 1 --2- 172.21.15.84:0/2344377901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0c4066ed0 0x7fb0c40fd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:44.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.946+0000 7fb0c3e00700 1 -- 172.21.15.84:0/2344377901 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b0005040 con 0x7fb0c40fff10 2024-04-26T21:32:44.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.946+0000 7fb0c3e00700 1 --2- 172.21.15.84:0/2344377901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0c40fff10 0x7fb0c40fb8d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000b3b0 tx=0x7fb0b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:44.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.947+0000 7fb0c0c00700 1 -- 172.21.15.84:0/2344377901 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0b000e040 con 0x7fb0c40fff10 2024-04-26T21:32:44.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.947+0000 7fb0c0c00700 1 -- 172.21.15.84:0/2344377901 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb0b0004290 con 0x7fb0c40fff10 2024-04-26T21:32:44.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.947+0000 7fb0cb600700 1 -- 172.21.15.84:0/2344377901 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c4111880 con 0x7fb0c40fff10 2024-04-26T21:32:44.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.947+0000 7fb0c0c00700 1 -- 172.21.15.84:0/2344377901 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0b001c630 con 0x7fb0c40fff10 2024-04-26T21:32:44.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.947+0000 7fb0cb600700 1 -- 172.21.15.84:0/2344377901 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c40fc240 con 0x7fb0c40fff10 2024-04-26T21:32:44.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.948+0000 7fb0cb600700 1 -- 172.21.15.84:0/2344377901 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c404c710 con 0x7fb0c40fff10 2024-04-26T21:32:44.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.949+0000 7fb0c0c00700 1 -- 172.21.15.84:0/2344377901 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb0b000bbf0 con 0x7fb0c40fff10 2024-04-26T21:32:44.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.950+0000 7fb0c0c00700 1 --2- 172.21.15.84:0/2344377901 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb0ac06ec00 0x7fb0ac0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:44.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.950+0000 7fb0c0c00700 1 -- 172.21.15.84:0/2344377901 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fb0b008fc60 con 0x7fb0c40fff10 2024-04-26T21:32:44.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.950+0000 7fb0c8c00700 1 --2- 172.21.15.84:0/2344377901 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb0ac06ec00 0x7fb0ac0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:44.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.951+0000 7fb0c8c00700 1 --2- 172.21.15.84:0/2344377901 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb0ac06ec00 0x7fb0ac0710b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80041d0 tx=0x7fb0b8009040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:44.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:44.955+0000 7fb0c0c00700 1 -- 172.21.15.84:0/2344377901 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fb0b005c4c0 con 0x7fb0c40fff10 2024-04-26T21:32:45.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.213+0000 7fb0cb600700 1 -- 172.21.15.84:0/2344377901 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb0c40fc520 con 0x7fb0c40fff10 2024-04-26T21:32:45.215 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:45 smithi084 ceph-mon[90138]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:32:45.215 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:45 smithi084 ceph-mon[90138]: pgmap v195: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 921 B/s wr, 0 op/s 2024-04-26T21:32:45.215 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:45 smithi084 ceph-mon[90138]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:32:45.215 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:45.215 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:32:45.215 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:45 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/4062319811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:45.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.214+0000 7fb0c0c00700 1 -- 172.21.15.84:0/2344377901 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1899 (secure 0 0 0) 0x7fb0b005c050 con 0x7fb0c40fff10 2024-04-26T21:32:45.216 INFO:teuthology.orchestra.run.smithi084.stdout:e19 2024-04-26T21:32:45.216 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:32:45.216 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:32:45.216 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:32:45.216 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:32:45.217 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:32:45.217 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:32:45.217 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 19 2024-04-26T21:32:45.217 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:32:45.217 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:32:45.217 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:32:42.154173+0000 2024-04-26T21:32:45.217 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:32:45.217 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:32:45.217 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:32:45.217 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:32:45.217 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:32:45.217 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-04-26T21:32:45.217 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:32:45.217 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:32:45.217 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:32:45.218 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:32:45.218 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 1 2024-04-26T21:32:45.218 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:32:45.218 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456,1=24231} 2024-04-26T21:32:45.218 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:32:45.218 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:32:45.218 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:32:45.218 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:32:45.218 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:32:45.218 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:32:45.218 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:32:45.218 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-04-26T21:32:45.218 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:32:45.218 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 14456 members: 14456 2024-04-26T21:32:45.218 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:32:45.219 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{1:24231} state up:stopping seq 5 join_fscid=1 addr [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:32:45.219 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:32:45.219 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:32:45.219 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:32:45.219 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:32:45.219 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:32:45.219 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:32:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.218+0000 7fb0cb600700 1 -- 172.21.15.84:0/2344377901 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb0ac06ec00 msgr2=0x7fb0ac0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.218+0000 7fb0cb600700 1 --2- 172.21.15.84:0/2344377901 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb0ac06ec00 0x7fb0ac0710b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80041d0 tx=0x7fb0b8009040 comp rx=0 tx=0).stop 2024-04-26T21:32:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.218+0000 7fb0cb600700 1 -- 172.21.15.84:0/2344377901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0c40fff10 msgr2=0x7fb0c40fb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.218+0000 7fb0cb600700 1 --2- 172.21.15.84:0/2344377901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0c40fff10 0x7fb0c40fb8d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000b3b0 tx=0x7fb0b0009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.218+0000 7fb0cb600700 1 -- 172.21.15.84:0/2344377901 shutdown_connections 2024-04-26T21:32:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.218+0000 7fb0cb600700 1 --2- 172.21.15.84:0/2344377901 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb0ac06ec00 0x7fb0ac0710b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.218+0000 7fb0cb600700 1 --2- 172.21.15.84:0/2344377901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0c4066ed0 0x7fb0c40fd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.218+0000 7fb0cb600700 1 --2- 172.21.15.84:0/2344377901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0c40fff10 0x7fb0c40fb8d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.218+0000 7fb0cb600700 1 -- 172.21.15.84:0/2344377901 >> 172.21.15.84:0/2344377901 conn(0x7fb0c40f7420 msgr2=0x7fb0c40f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.218+0000 7fb0cb600700 1 -- 172.21.15.84:0/2344377901 shutdown_connections 2024-04-26T21:32:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.218+0000 7fb0cb600700 1 -- 172.21.15.84:0/2344377901 wait complete. 2024-04-26T21:32:45.221 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 19 2024-04-26T21:32:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.365+0000 7fb26da00700 1 -- 172.21.15.84:0/3025935940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2680fbcb0 msgr2=0x7fb2680fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.365+0000 7fb26da00700 1 --2- 172.21.15.84:0/3025935940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2680fbcb0 0x7fb2680fc0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb258004940 tx=0x7fb258009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.365+0000 7fb26da00700 1 -- 172.21.15.84:0/3025935940 shutdown_connections 2024-04-26T21:32:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.365+0000 7fb26da00700 1 --2- 172.21.15.84:0/3025935940 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2680fcf60 0x7fb2680fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.365+0000 7fb26da00700 1 --2- 172.21.15.84:0/3025935940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2680fbcb0 0x7fb2680fc0c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.365+0000 7fb26da00700 1 -- 172.21.15.84:0/3025935940 >> 172.21.15.84:0/3025935940 conn(0x7fb2680f7430 msgr2=0x7fb2680f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.365+0000 7fb26da00700 1 -- 172.21.15.84:0/3025935940 shutdown_connections 2024-04-26T21:32:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.365+0000 7fb26da00700 1 -- 172.21.15.84:0/3025935940 wait complete. 2024-04-26T21:32:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.366+0000 7fb26da00700 1 Processor -- start 2024-04-26T21:32:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.366+0000 7fb26da00700 1 -- start start 2024-04-26T21:32:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.367+0000 7fb26da00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2680fbcb0 0x7fb26810fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.367+0000 7fb26da00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2680fcf60 0x7fb2681101b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.367+0000 7fb26da00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2681107b0 con 0x7fb2680fcf60 2024-04-26T21:32:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.367+0000 7fb26da00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb268110fb0 con 0x7fb2680fbcb0 2024-04-26T21:32:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.367+0000 7fb266000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2680fcf60 0x7fb2681101b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.367+0000 7fb266000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2680fcf60 0x7fb2681101b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58602/0 (socket says 172.21.15.84:58602) 2024-04-26T21:32:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.367+0000 7fb266000700 1 -- 172.21.15.84:0/1852869171 learned_addr learned my addr 172.21.15.84:0/1852869171 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:32:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.367+0000 7fb266a00700 1 --2- 172.21.15.84:0/1852869171 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2680fbcb0 0x7fb26810fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.367+0000 7fb266000700 1 -- 172.21.15.84:0/1852869171 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2680fbcb0 msgr2=0x7fb26810fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.367+0000 7fb266000700 1 --2- 172.21.15.84:0/1852869171 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2680fbcb0 0x7fb26810fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.367+0000 7fb266000700 1 -- 172.21.15.84:0/1852869171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb258005040 con 0x7fb2680fcf60 2024-04-26T21:32:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.368+0000 7fb266a00700 1 --2- 172.21.15.84:0/1852869171 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2680fbcb0 0x7fb26810fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:32:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.368+0000 7fb266000700 1 --2- 172.21.15.84:0/1852869171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2680fcf60 0x7fb2681101b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb25400c830 tx=0x7fb254004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.368+0000 7fb25ea00700 1 -- 172.21.15.84:0/1852869171 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb25400a760 con 0x7fb2680fcf60 2024-04-26T21:32:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.368+0000 7fb26da00700 1 -- 172.21.15.84:0/1852869171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb268111290 con 0x7fb2680fcf60 2024-04-26T21:32:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.368+0000 7fb25ea00700 1 -- 172.21.15.84:0/1852869171 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb25400ad90 con 0x7fb2680fcf60 2024-04-26T21:32:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.368+0000 7fb25ea00700 1 -- 172.21.15.84:0/1852869171 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2540113a0 con 0x7fb2680fcf60 2024-04-26T21:32:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.368+0000 7fb26da00700 1 -- 172.21.15.84:0/1852869171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2681117d0 con 0x7fb2680fcf60 2024-04-26T21:32:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.369+0000 7fb26da00700 1 -- 172.21.15.84:0/1852869171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2681018f0 con 0x7fb2680fcf60 2024-04-26T21:32:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.370+0000 7fb25ea00700 1 -- 172.21.15.84:0/1852869171 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb254012400 con 0x7fb2680fcf60 2024-04-26T21:32:45.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.371+0000 7fb25ea00700 1 --2- 172.21.15.84:0/1852869171 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb24c06ec00 0x7fb24c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:45.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.371+0000 7fb25ea00700 1 -- 172.21.15.84:0/1852869171 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fb25408e950 con 0x7fb2680fcf60 2024-04-26T21:32:45.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.372+0000 7fb266a00700 1 --2- 172.21.15.84:0/1852869171 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb24c06ec00 0x7fb24c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:45.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.372+0000 7fb266a00700 1 --2- 172.21.15.84:0/1852869171 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb24c06ec00 0x7fb24c0710b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb258000c00 tx=0x7fb258009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:45.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.378+0000 7fb25ea00700 1 -- 172.21.15.84:0/1852869171 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fb25405b250 con 0x7fb2680fcf60 2024-04-26T21:32:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:45 smithi120 ceph-mon[79001]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:32:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:45 smithi120 ceph-mon[79001]: pgmap v195: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 921 B/s wr, 0 op/s 2024-04-26T21:32:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:45 smithi120 ceph-mon[79001]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:32:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:32:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:45 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/4062319811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:45.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.620+0000 7fb26da00700 1 -- 172.21.15.84:0/1852869171 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb268111a50 con 0x7fb24c06ec00 2024-04-26T21:32:45.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.623+0000 7fb25ea00700 1 -- 172.21.15.84:0/1852869171 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb268111a50 con 0x7fb24c06ec00 2024-04-26T21:32:45.625 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:32:45.625 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:32:45.625 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:32:45.625 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:32:45.625 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-04-26T21:32:45.625 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr", 2024-04-26T21:32:45.625 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-04-26T21:32:45.625 INFO:teuthology.orchestra.run.smithi084.stdout: "osd", 2024-04-26T21:32:45.625 INFO:teuthology.orchestra.run.smithi084.stdout: "crash" 2024-04-26T21:32:45.626 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-04-26T21:32:45.626 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "12/21 daemons upgraded", 2024-04-26T21:32:45.626 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading osd daemons", 2024-04-26T21:32:45.626 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:32:45.626 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:32:45.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.625+0000 7fb26da00700 1 -- 172.21.15.84:0/1852869171 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb24c06ec00 msgr2=0x7fb24c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:45.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.625+0000 7fb26da00700 1 --2- 172.21.15.84:0/1852869171 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb24c06ec00 0x7fb24c0710b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb258000c00 tx=0x7fb258009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:45.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.625+0000 7fb26da00700 1 -- 172.21.15.84:0/1852869171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2680fcf60 msgr2=0x7fb2681101b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:45.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.625+0000 7fb26da00700 1 --2- 172.21.15.84:0/1852869171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2680fcf60 0x7fb2681101b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb25400c830 tx=0x7fb254004470 comp rx=0 tx=0).stop 2024-04-26T21:32:45.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.626+0000 7fb26da00700 1 -- 172.21.15.84:0/1852869171 shutdown_connections 2024-04-26T21:32:45.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.626+0000 7fb26da00700 1 --2- 172.21.15.84:0/1852869171 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb24c06ec00 0x7fb24c0710b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:45.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.626+0000 7fb26da00700 1 --2- 172.21.15.84:0/1852869171 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2680fbcb0 0x7fb26810fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:45.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.626+0000 7fb26da00700 1 --2- 172.21.15.84:0/1852869171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2680fcf60 0x7fb2681101b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:45.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.626+0000 7fb26da00700 1 -- 172.21.15.84:0/1852869171 >> 172.21.15.84:0/1852869171 conn(0x7fb2680f7430 msgr2=0x7fb268065b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:45.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.626+0000 7fb26da00700 1 -- 172.21.15.84:0/1852869171 shutdown_connections 2024-04-26T21:32:45.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.626+0000 7fb26da00700 1 -- 172.21.15.84:0/1852869171 wait complete. 2024-04-26T21:32:45.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.769+0000 7efd71c00700 1 -- 172.21.15.84:0/3904506217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd6c066c10 msgr2=0x7efd6c0ff880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.769+0000 7efd71c00700 1 --2- 172.21.15.84:0/3904506217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd6c066c10 0x7efd6c0ff880 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efd5c004940 tx=0x7efd5c009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.770+0000 7efd71c00700 1 -- 172.21.15.84:0/3904506217 shutdown_connections 2024-04-26T21:32:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.770+0000 7efd71c00700 1 --2- 172.21.15.84:0/3904506217 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd6c0ffdc0 0x7efd6c1021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.770+0000 7efd71c00700 1 --2- 172.21.15.84:0/3904506217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd6c066c10 0x7efd6c0ff880 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.770+0000 7efd71c00700 1 -- 172.21.15.84:0/3904506217 >> 172.21.15.84:0/3904506217 conn(0x7efd6c0f7270 msgr2=0x7efd6c0f9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.770+0000 7efd71c00700 1 -- 172.21.15.84:0/3904506217 shutdown_connections 2024-04-26T21:32:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.770+0000 7efd71c00700 1 -- 172.21.15.84:0/3904506217 wait complete. 2024-04-26T21:32:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.771+0000 7efd71c00700 1 Processor -- start 2024-04-26T21:32:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.771+0000 7efd71c00700 1 -- start start 2024-04-26T21:32:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.771+0000 7efd71c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd6c066c10 0x7efd6c10fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.771+0000 7efd71c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd6c0ffdc0 0x7efd6c10ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.771+0000 7efd71c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c1105d0 con 0x7efd6c0ffdc0 2024-04-26T21:32:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.771+0000 7efd71c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c110dc0 con 0x7efd6c066c10 2024-04-26T21:32:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.771+0000 7efd6b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd6c0ffdc0 0x7efd6c10ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.771+0000 7efd6b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd6c0ffdc0 0x7efd6c10ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58616/0 (socket says 172.21.15.84:58616) 2024-04-26T21:32:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.771+0000 7efd6b400700 1 -- 172.21.15.84:0/185486830 learned_addr learned my addr 172.21.15.84:0/185486830 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:32:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.772+0000 7efd6be00700 1 --2- 172.21.15.84:0/185486830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd6c066c10 0x7efd6c10fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.772+0000 7efd6b400700 1 -- 172.21.15.84:0/185486830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd6c066c10 msgr2=0x7efd6c10fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.772+0000 7efd6b400700 1 --2- 172.21.15.84:0/185486830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd6c066c10 0x7efd6c10fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.772+0000 7efd6b400700 1 -- 172.21.15.84:0/185486830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c005040 con 0x7efd6c0ffdc0 2024-04-26T21:32:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.772+0000 7efd6b400700 1 --2- 172.21.15.84:0/185486830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd6c0ffdc0 0x7efd6c10ff40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efd5800b790 tx=0x7efd58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.772+0000 7efd63e00700 1 -- 172.21.15.84:0/185486830 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd5800f770 con 0x7efd6c0ffdc0 2024-04-26T21:32:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.772+0000 7efd63e00700 1 -- 172.21.15.84:0/185486830 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd5800fda0 con 0x7efd6c0ffdc0 2024-04-26T21:32:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.772+0000 7efd63e00700 1 -- 172.21.15.84:0/185486830 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd5800d310 con 0x7efd6c0ffdc0 2024-04-26T21:32:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.772+0000 7efd71c00700 1 -- 172.21.15.84:0/185486830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6c1110a0 con 0x7efd6c0ffdc0 2024-04-26T21:32:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.773+0000 7efd71c00700 1 -- 172.21.15.84:0/185486830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6c111610 con 0x7efd6c0ffdc0 2024-04-26T21:32:45.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.774+0000 7efd71c00700 1 -- 172.21.15.84:0/185486830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6c0faef0 con 0x7efd6c0ffdc0 2024-04-26T21:32:45.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.775+0000 7efd63e00700 1 -- 172.21.15.84:0/185486830 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7efd58010420 con 0x7efd6c0ffdc0 2024-04-26T21:32:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.776+0000 7efd63e00700 1 --2- 172.21.15.84:0/185486830 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7efd5006ec00 0x7efd500710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:32:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.776+0000 7efd63e00700 1 -- 172.21.15.84:0/185486830 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6585+0+0 (secure 0 0 0) 0x7efd5808e9d0 con 0x7efd6c0ffdc0 2024-04-26T21:32:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.777+0000 7efd6be00700 1 --2- 172.21.15.84:0/185486830 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7efd5006ec00 0x7efd500710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:32:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.777+0000 7efd6be00700 1 --2- 172.21.15.84:0/185486830 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7efd5006ec00 0x7efd500710b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00b3b0 tx=0x7efd5c009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:32:45.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:45.781+0000 7efd63e00700 1 -- 172.21.15.84:0/185486830 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7efd5805b230 con 0x7efd6c0ffdc0 2024-04-26T21:32:46.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:46.076+0000 7efd71c00700 1 -- 172.21.15.84:0/185486830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efd6c1118e0 con 0x7efd6c0ffdc0 2024-04-26T21:32:46.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:46.077+0000 7efd63e00700 1 -- 172.21.15.84:0/185486830 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7efd5805adc0 con 0x7efd6c0ffdc0 2024-04-26T21:32:46.079 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:32:46.079 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:32:46.079 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:32:46.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:46.080+0000 7efd71c00700 1 -- 172.21.15.84:0/185486830 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7efd5006ec00 msgr2=0x7efd500710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:46.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:46.080+0000 7efd71c00700 1 --2- 172.21.15.84:0/185486830 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7efd5006ec00 0x7efd500710b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00b3b0 tx=0x7efd5c009e30 comp rx=0 tx=0).stop 2024-04-26T21:32:46.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:46.080+0000 7efd71c00700 1 -- 172.21.15.84:0/185486830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd6c0ffdc0 msgr2=0x7efd6c10ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:32:46.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:46.080+0000 7efd71c00700 1 --2- 172.21.15.84:0/185486830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd6c0ffdc0 0x7efd6c10ff40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efd5800b790 tx=0x7efd58009250 comp rx=0 tx=0).stop 2024-04-26T21:32:46.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:46.080+0000 7efd71c00700 1 -- 172.21.15.84:0/185486830 shutdown_connections 2024-04-26T21:32:46.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:46.080+0000 7efd71c00700 1 --2- 172.21.15.84:0/185486830 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7efd5006ec00 0x7efd500710b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:46.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:46.080+0000 7efd71c00700 1 --2- 172.21.15.84:0/185486830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd6c066c10 0x7efd6c10fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:46.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:46.080+0000 7efd71c00700 1 --2- 172.21.15.84:0/185486830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd6c0ffdc0 0x7efd6c10ff40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:32:46.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:46.080+0000 7efd71c00700 1 -- 172.21.15.84:0/185486830 >> 172.21.15.84:0/185486830 conn(0x7efd6c0f7270 msgr2=0x7efd6c0fb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:32:46.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:46.081+0000 7efd71c00700 1 -- 172.21.15.84:0/185486830 shutdown_connections 2024-04-26T21:32:46.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:32:46.081+0000 7efd71c00700 1 -- 172.21.15.84:0/185486830 wait complete. 2024-04-26T21:32:46.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:46 smithi084 ceph-mon[90138]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:32:46.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:46 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2344377901' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:32:46.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:46 smithi120 ceph-mon[79001]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:32:46.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:46 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2344377901' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:32:47.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:47 smithi084 ceph-mon[90138]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:32:47.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:47 smithi084 ceph-mon[90138]: pgmap v196: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-04-26T21:32:47.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:47 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/185486830' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:32:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:47 smithi120 ceph-mon[79001]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:32:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:47 smithi120 ceph-mon[79001]: pgmap v196: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-04-26T21:32:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:47 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/185486830' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:32:49.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:49 smithi084 ceph-mon[90138]: pgmap v197: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-04-26T21:32:49.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:49 smithi084 ceph-mon[90138]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:stopping} 2 up:standby 2024-04-26T21:32:49.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:49 smithi120 ceph-mon[79001]: pgmap v197: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-04-26T21:32:49.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:49 smithi120 ceph-mon[79001]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi120.qnkxcn=up:stopping} 2 up:standby 2024-04-26T21:32:50.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:50.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:50 smithi084 ceph-mon[90138]: pgmap v198: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s wr, 0 op/s 2024-04-26T21:32:50.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:50.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:50 smithi120 ceph-mon[79001]: pgmap v198: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s wr, 0 op/s 2024-04-26T21:32:53.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:52 smithi084 ceph-mon[90138]: pgmap v199: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s wr, 0 op/s 2024-04-26T21:32:53.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:52 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:53.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:52 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:32:53.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:52 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:32:53.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:52 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:53.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:52 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:53.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:52 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:53.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:52 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:53.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:52 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:53.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:52 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:53.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:52 smithi120 ceph-mon[79001]: pgmap v199: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s wr, 0 op/s 2024-04-26T21:32:53.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:52 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:53.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:52 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:32:53.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:52 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:32:53.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:52 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:32:53.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:52 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:53.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:52 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:53.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:52 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:53.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:52 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:53.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:52 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:32:54.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:53 smithi084 ceph-mon[90138]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-04-26T21:32:54.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:53 smithi120 ceph-mon[79001]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-04-26T21:32:55.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:54 smithi084 ceph-mon[90138]: pgmap v200: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.8 KiB/s wr, 1 op/s 2024-04-26T21:32:55.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:54 smithi120 ceph-mon[79001]: pgmap v200: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.8 KiB/s wr, 1 op/s 2024-04-26T21:32:57.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:56 smithi084 ceph-mon[90138]: pgmap v201: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.2 KiB/s wr, 0 op/s 2024-04-26T21:32:57.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:56 smithi120 ceph-mon[79001]: pgmap v201: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.2 KiB/s wr, 0 op/s 2024-04-26T21:32:59.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:58 smithi084 ceph-mon[90138]: pgmap v202: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 852 B/s wr, 0 op/s 2024-04-26T21:32:59.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:58 smithi120 ceph-mon[79001]: pgmap v202: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 852 B/s wr, 0 op/s 2024-04-26T21:32:59.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:32:59 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:33:00.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:32:59 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:33:01.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:00 smithi084 ceph-mon[90138]: pgmap v203: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-04-26T21:33:01.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:00 smithi120 ceph-mon[79001]: pgmap v203: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-04-26T21:33:03.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:02 smithi120 ceph-mon[79001]: pgmap v204: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 938 B/s wr, 5 op/s 2024-04-26T21:33:03.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:02 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:33:03.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:02 smithi084 ceph-mon[90138]: pgmap v204: 65 pgs: 65 active+clean; 310 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 938 B/s wr, 5 op/s 2024-04-26T21:33:03.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:02 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:33:05.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:04 smithi084 ceph-mon[90138]: pgmap v205: 65 pgs: 65 active+clean; 230 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1023 B/s wr, 7 op/s 2024-04-26T21:33:05.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:04 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:33:05.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:04 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:33:05.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:04 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:05.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:04 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:33:05.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:04 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:05.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:04 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:05.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:04 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:05.164 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:04 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:05.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:04 smithi120 ceph-mon[79001]: pgmap v205: 65 pgs: 65 active+clean; 230 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1023 B/s wr, 7 op/s 2024-04-26T21:33:05.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:04 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:33:05.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:04 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:33:05.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:04 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:05.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:04 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:33:05.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:04 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:05.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:04 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:05.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:04 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:05.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:04 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:06.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:05 smithi084 ceph-mon[90138]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-04-26T21:33:06.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:05 smithi120 ceph-mon[79001]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-04-26T21:33:07.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:06 smithi084 ceph-mon[90138]: pgmap v206: 65 pgs: 65 active+clean; 194 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 7 op/s 2024-04-26T21:33:07.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:06 smithi120 ceph-mon[79001]: pgmap v206: 65 pgs: 65 active+clean; 194 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 7 op/s 2024-04-26T21:33:09.215 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:08 smithi084 ceph-mon[90138]: pgmap v207: 65 pgs: 65 active+clean; 182 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 7 op/s 2024-04-26T21:33:09.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:08 smithi120 ceph-mon[79001]: pgmap v207: 65 pgs: 65 active+clean; 182 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 7 op/s 2024-04-26T21:33:11.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:10 smithi084 ceph-mon[90138]: pgmap v208: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 8 op/s 2024-04-26T21:33:11.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:10 smithi120 ceph-mon[79001]: pgmap v208: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 8 op/s 2024-04-26T21:33:13.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:12 smithi084 ceph-mon[90138]: pgmap v209: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 426 B/s wr, 3 op/s 2024-04-26T21:33:13.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:12 smithi084 ceph-mon[90138]: daemon mds.cephfs.smithi120.qnkxcn finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-04-26T21:33:13.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:12 smithi120 ceph-mon[79001]: pgmap v209: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 426 B/s wr, 3 op/s 2024-04-26T21:33:13.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:12 smithi120 ceph-mon[79001]: daemon mds.cephfs.smithi120.qnkxcn finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-04-26T21:33:14.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:13 smithi084 ceph-mon[90138]: mds.1 [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] down:stopped 2024-04-26T21:33:14.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:13 smithi084 ceph-mon[90138]: fsmap cephfs:1 {0=cephfs.smithi084.hbjunw=up:active} 2 up:standby 2024-04-26T21:33:14.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:13 smithi120 ceph-mon[79001]: mds.1 [v2:172.21.15.120:6824/3398077484,v1:172.21.15.120:6825/3398077484] down:stopped 2024-04-26T21:33:14.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:13 smithi120 ceph-mon[79001]: fsmap cephfs:1 {0=cephfs.smithi084.hbjunw=up:active} 2 up:standby 2024-04-26T21:33:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:14 smithi084 ceph-mon[90138]: pgmap v210: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 426 B/s wr, 3 op/s 2024-04-26T21:33:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:14 smithi084 ceph-mon[90138]: mds.? [v2:172.21.15.120:6824/4163804141,v1:172.21.15.120:6825/4163804141] up:boot 2024-04-26T21:33:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:14 smithi084 ceph-mon[90138]: fsmap cephfs:1 {0=cephfs.smithi084.hbjunw=up:active} 3 up:standby 2024-04-26T21:33:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.qnkxcn"}]: dispatch 2024-04-26T21:33:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:33:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:33:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:33:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:33:15.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:15.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:33:15.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:15.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:15.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:15.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:15.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi084.hbjunw"]}]: dispatch 2024-04-26T21:33:15.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:14 smithi120 ceph-mon[79001]: pgmap v210: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 426 B/s wr, 3 op/s 2024-04-26T21:33:15.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:14 smithi120 ceph-mon[79001]: mds.? [v2:172.21.15.120:6824/4163804141,v1:172.21.15.120:6825/4163804141] up:boot 2024-04-26T21:33:15.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:14 smithi120 ceph-mon[79001]: fsmap cephfs:1 {0=cephfs.smithi084.hbjunw=up:active} 3 up:standby 2024-04-26T21:33:15.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.qnkxcn"}]: dispatch 2024-04-26T21:33:15.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:33:15.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:33:15.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:33:15.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:33:15.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:15.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:33:15.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:15.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:15.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:15.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:15.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi084.hbjunw"]}]: dispatch 2024-04-26T21:33:16.156 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:15 smithi084 ceph-mon[90138]: Upgrade: It appears safe to stop mds.cephfs.smithi084.hbjunw 2024-04-26T21:33:16.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.249+0000 7fdba7e00700 1 -- 172.21.15.84:0/1439110071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdba80fdec0 msgr2=0x7fdba80fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:16.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.249+0000 7fdba7e00700 1 --2- 172.21.15.84:0/1439110071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdba80fdec0 0x7fdba80fe330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdb94004940 tx=0x7fdb94009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:16.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.249+0000 7fdba7e00700 1 -- 172.21.15.84:0/1439110071 shutdown_connections 2024-04-26T21:33:16.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.249+0000 7fdba7e00700 1 --2- 172.21.15.84:0/1439110071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdba80fdec0 0x7fdba80fe330 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:16.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.249+0000 7fdba7e00700 1 --2- 172.21.15.84:0/1439110071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdba80fcc10 0x7fdba80fd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:16.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.249+0000 7fdba7e00700 1 -- 172.21.15.84:0/1439110071 >> 172.21.15.84:0/1439110071 conn(0x7fdba80f83b0 msgr2=0x7fdba80fa7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:16.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.249+0000 7fdba7e00700 1 -- 172.21.15.84:0/1439110071 shutdown_connections 2024-04-26T21:33:16.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.249+0000 7fdba7e00700 1 -- 172.21.15.84:0/1439110071 wait complete. 2024-04-26T21:33:16.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.250+0000 7fdba7e00700 1 Processor -- start 2024-04-26T21:33:16.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.251+0000 7fdba7e00700 1 -- start start 2024-04-26T21:33:16.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.251+0000 7fdba7e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdba80fcc10 0x7fdba810fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:16.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.251+0000 7fdba7e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdba80fdec0 0x7fdba810ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:16.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.251+0000 7fdba7e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba8110590 con 0x7fdba80fcc10 2024-04-26T21:33:16.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.251+0000 7fdba7e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba8110de0 con 0x7fdba80fdec0 2024-04-26T21:33:16.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.251+0000 7fdba6a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdba80fcc10 0x7fdba810fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:16.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.251+0000 7fdba6a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdba80fcc10 0x7fdba810fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49506/0 (socket says 172.21.15.84:49506) 2024-04-26T21:33:16.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.251+0000 7fdba6a00700 1 -- 172.21.15.84:0/1155329695 learned_addr learned my addr 172.21.15.84:0/1155329695 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:33:16.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.252+0000 7fdba6000700 1 --2- 172.21.15.84:0/1155329695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdba80fdec0 0x7fdba810ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:16.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.252+0000 7fdba6a00700 1 -- 172.21.15.84:0/1155329695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdba80fdec0 msgr2=0x7fdba810ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:16.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.252+0000 7fdba6a00700 1 --2- 172.21.15.84:0/1155329695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdba80fdec0 0x7fdba810ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:16.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.252+0000 7fdba6a00700 1 -- 172.21.15.84:0/1155329695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb94005040 con 0x7fdba80fcc10 2024-04-26T21:33:16.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.252+0000 7fdba6000700 1 --2- 172.21.15.84:0/1155329695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdba80fdec0 0x7fdba810ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:33:16.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.252+0000 7fdba6a00700 1 --2- 172.21.15.84:0/1155329695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdba80fcc10 0x7fdba810fa50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800c830 tx=0x7fdb98004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:16.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.253+0000 7fdb9ea00700 1 -- 172.21.15.84:0/1155329695 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb9800a760 con 0x7fdba80fcc10 2024-04-26T21:33:16.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.253+0000 7fdba7e00700 1 -- 172.21.15.84:0/1155329695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba81110c0 con 0x7fdba80fcc10 2024-04-26T21:33:16.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.253+0000 7fdb9ea00700 1 -- 172.21.15.84:0/1155329695 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb9800ad90 con 0x7fdba80fcc10 2024-04-26T21:33:16.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.253+0000 7fdb9ea00700 1 -- 172.21.15.84:0/1155329695 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb980113a0 con 0x7fdba80fcc10 2024-04-26T21:33:16.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.253+0000 7fdba7e00700 1 -- 172.21.15.84:0/1155329695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba8111600 con 0x7fdba80fcc10 2024-04-26T21:33:16.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.254+0000 7fdba7e00700 1 -- 172.21.15.84:0/1155329695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba8101850 con 0x7fdba80fcc10 2024-04-26T21:33:16.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.255+0000 7fdb9ea00700 1 -- 172.21.15.84:0/1155329695 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fdb98012400 con 0x7fdba80fcc10 2024-04-26T21:33:16.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.257+0000 7fdb9ea00700 1 --2- 172.21.15.84:0/1155329695 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdb8c06ec10 0x7fdb8c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:16.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.257+0000 7fdb9ea00700 1 -- 172.21.15.84:0/1155329695 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fdb9808e850 con 0x7fdba80fcc10 2024-04-26T21:33:16.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.257+0000 7fdba6000700 1 --2- 172.21.15.84:0/1155329695 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdb8c06ec10 0x7fdb8c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:16.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.258+0000 7fdba6000700 1 --2- 172.21.15.84:0/1155329695 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdb8c06ec10 0x7fdb8c0710c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400b020 tx=0x7fdb94009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:16.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.262+0000 7fdb9ea00700 1 -- 172.21.15.84:0/1155329695 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fdb9805b1f0 con 0x7fdba80fcc10 2024-04-26T21:33:16.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:15 smithi120 ceph-mon[79001]: Upgrade: It appears safe to stop mds.cephfs.smithi084.hbjunw 2024-04-26T21:33:16.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.533+0000 7fdba7e00700 1 -- 172.21.15.84:0/1155329695 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdba81118d0 con 0x7fdb8c06ec10 2024-04-26T21:33:16.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.536+0000 7fdb9ea00700 1 -- 172.21.15.84:0/1155329695 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fdba81118d0 con 0x7fdb8c06ec10 2024-04-26T21:33:16.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.538+0000 7fdba7e00700 1 -- 172.21.15.84:0/1155329695 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdb8c06ec10 msgr2=0x7fdb8c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:16.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.538+0000 7fdba7e00700 1 --2- 172.21.15.84:0/1155329695 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdb8c06ec10 0x7fdb8c0710c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400b020 tx=0x7fdb94009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:16.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.538+0000 7fdba7e00700 1 -- 172.21.15.84:0/1155329695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdba80fcc10 msgr2=0x7fdba810fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:16.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.538+0000 7fdba7e00700 1 --2- 172.21.15.84:0/1155329695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdba80fcc10 0x7fdba810fa50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800c830 tx=0x7fdb98004470 comp rx=0 tx=0).stop 2024-04-26T21:33:16.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.539+0000 7fdba7e00700 1 -- 172.21.15.84:0/1155329695 shutdown_connections 2024-04-26T21:33:16.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.539+0000 7fdba7e00700 1 --2- 172.21.15.84:0/1155329695 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdb8c06ec10 0x7fdb8c0710c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:16.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.539+0000 7fdba7e00700 1 --2- 172.21.15.84:0/1155329695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdba80fcc10 0x7fdba810fa50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:16.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.539+0000 7fdba7e00700 1 --2- 172.21.15.84:0/1155329695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdba80fdec0 0x7fdba810ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:16.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.539+0000 7fdba7e00700 1 -- 172.21.15.84:0/1155329695 >> 172.21.15.84:0/1155329695 conn(0x7fdba80f83b0 msgr2=0x7fdba80f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:16.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.539+0000 7fdba7e00700 1 -- 172.21.15.84:0/1155329695 shutdown_connections 2024-04-26T21:33:16.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.539+0000 7fdba7e00700 1 -- 172.21.15.84:0/1155329695 wait complete. 2024-04-26T21:33:16.556 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:33:16.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.693+0000 7fdf29000700 1 -- 172.21.15.84:0/4119081966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf240fdfd0 msgr2=0x7fdf240fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:16.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.693+0000 7fdf29000700 1 --2- 172.21.15.84:0/4119081966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf240fdfd0 0x7fdf240fe440 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c004940 tx=0x7fdf0c009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:16.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.693+0000 7fdf29000700 1 -- 172.21.15.84:0/4119081966 shutdown_connections 2024-04-26T21:33:16.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.693+0000 7fdf29000700 1 --2- 172.21.15.84:0/4119081966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf240fdfd0 0x7fdf240fe440 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:16.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.693+0000 7fdf29000700 1 --2- 172.21.15.84:0/4119081966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf240fce60 0x7fdf240fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:16.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.693+0000 7fdf29000700 1 -- 172.21.15.84:0/4119081966 >> 172.21.15.84:0/4119081966 conn(0x7fdf240f8540 msgr2=0x7fdf240fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:16.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.694+0000 7fdf29000700 1 -- 172.21.15.84:0/4119081966 shutdown_connections 2024-04-26T21:33:16.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.694+0000 7fdf29000700 1 -- 172.21.15.84:0/4119081966 wait complete. 2024-04-26T21:33:16.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.694+0000 7fdf29000700 1 Processor -- start 2024-04-26T21:33:16.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.695+0000 7fdf29000700 1 -- start start 2024-04-26T21:33:16.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.695+0000 7fdf29000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf240fce60 0x7fdf2410fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:16.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.695+0000 7fdf29000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf240fdfd0 0x7fdf24110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:16.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.695+0000 7fdf29000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf24110650 con 0x7fdf240fdfd0 2024-04-26T21:33:16.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.695+0000 7fdf29000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf241107c0 con 0x7fdf240fce60 2024-04-26T21:33:16.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.695+0000 7fdf19400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf240fdfd0 0x7fdf24110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:16.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.695+0000 7fdf19400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf240fdfd0 0x7fdf24110050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49520/0 (socket says 172.21.15.84:49520) 2024-04-26T21:33:16.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.695+0000 7fdf19400700 1 -- 172.21.15.84:0/2243604197 learned_addr learned my addr 172.21.15.84:0/2243604197 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:33:16.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.696+0000 7fdf21e00700 1 --2- 172.21.15.84:0/2243604197 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf240fce60 0x7fdf2410fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:16.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.696+0000 7fdf19400700 1 -- 172.21.15.84:0/2243604197 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf240fce60 msgr2=0x7fdf2410fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:16.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.696+0000 7fdf19400700 1 --2- 172.21.15.84:0/2243604197 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf240fce60 0x7fdf2410fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:16.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.696+0000 7fdf19400700 1 -- 172.21.15.84:0/2243604197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c005040 con 0x7fdf240fdfd0 2024-04-26T21:33:16.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.696+0000 7fdf19400700 1 --2- 172.21.15.84:0/2243604197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf240fdfd0 0x7fdf24110050 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c00b3b0 tx=0x7fdf0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:16.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.696+0000 7fdf1aa00700 1 -- 172.21.15.84:0/2243604197 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf0c00e040 con 0x7fdf240fdfd0 2024-04-26T21:33:16.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.697+0000 7fdf1aa00700 1 -- 172.21.15.84:0/2243604197 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf0c004290 con 0x7fdf240fdfd0 2024-04-26T21:33:16.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.697+0000 7fdf29000700 1 -- 172.21.15.84:0/2243604197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf241151c0 con 0x7fdf240fdfd0 2024-04-26T21:33:16.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.697+0000 7fdf1aa00700 1 -- 172.21.15.84:0/2243604197 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf0c01c630 con 0x7fdf240fdfd0 2024-04-26T21:33:16.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.697+0000 7fdf29000700 1 -- 172.21.15.84:0/2243604197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf24115780 con 0x7fdf240fdfd0 2024-04-26T21:33:16.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.698+0000 7fdf29000700 1 -- 172.21.15.84:0/2243604197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf24101960 con 0x7fdf240fdfd0 2024-04-26T21:33:16.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.699+0000 7fdf1aa00700 1 -- 172.21.15.84:0/2243604197 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fdf0c00bbf0 con 0x7fdf240fdfd0 2024-04-26T21:33:16.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.700+0000 7fdf1aa00700 1 --2- 172.21.15.84:0/2243604197 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdf0806ec00 0x7fdf080710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:16.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.700+0000 7fdf1aa00700 1 -- 172.21.15.84:0/2243604197 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fdf0c08fc30 con 0x7fdf240fdfd0 2024-04-26T21:33:16.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.701+0000 7fdf21e00700 1 --2- 172.21.15.84:0/2243604197 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdf0806ec00 0x7fdf080710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:16.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.701+0000 7fdf21e00700 1 --2- 172.21.15.84:0/2243604197 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdf0806ec00 0x7fdf080710b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdf14007fd0 tx=0x7fdf14009040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:16.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.705+0000 7fdf1aa00700 1 -- 172.21.15.84:0/2243604197 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fdf0c05c5d0 con 0x7fdf240fdfd0 2024-04-26T21:33:16.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.968+0000 7fdf29000700 1 -- 172.21.15.84:0/2243604197 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf2402b340 con 0x7fdf0806ec00 2024-04-26T21:33:16.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.970+0000 7fdf1aa00700 1 -- 172.21.15.84:0/2243604197 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fdf2402b340 con 0x7fdf0806ec00 2024-04-26T21:33:16.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.973+0000 7fdf29000700 1 -- 172.21.15.84:0/2243604197 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdf0806ec00 msgr2=0x7fdf080710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:16.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.973+0000 7fdf29000700 1 --2- 172.21.15.84:0/2243604197 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdf0806ec00 0x7fdf080710b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdf14007fd0 tx=0x7fdf14009040 comp rx=0 tx=0).stop 2024-04-26T21:33:16.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.973+0000 7fdf29000700 1 -- 172.21.15.84:0/2243604197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf240fdfd0 msgr2=0x7fdf24110050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:16.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.973+0000 7fdf29000700 1 --2- 172.21.15.84:0/2243604197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf240fdfd0 0x7fdf24110050 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c00b3b0 tx=0x7fdf0c009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:16.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.973+0000 7fdf29000700 1 -- 172.21.15.84:0/2243604197 shutdown_connections 2024-04-26T21:33:16.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.973+0000 7fdf29000700 1 --2- 172.21.15.84:0/2243604197 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdf0806ec00 0x7fdf080710b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:16.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.973+0000 7fdf29000700 1 --2- 172.21.15.84:0/2243604197 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf240fce60 0x7fdf2410fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:16.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.973+0000 7fdf29000700 1 --2- 172.21.15.84:0/2243604197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf240fdfd0 0x7fdf24110050 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:16.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.973+0000 7fdf29000700 1 -- 172.21.15.84:0/2243604197 >> 172.21.15.84:0/2243604197 conn(0x7fdf240f8540 msgr2=0x7fdf240f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:16.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.973+0000 7fdf29000700 1 -- 172.21.15.84:0/2243604197 shutdown_connections 2024-04-26T21:33:16.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:16.974+0000 7fdf29000700 1 -- 172.21.15.84:0/2243604197 wait complete. 2024-04-26T21:33:17.117 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:16 smithi084 ceph-mon[90138]: pgmap v211: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 1 op/s 2024-04-26T21:33:17.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.129+0000 7fc1f1200700 1 -- 172.21.15.84:0/4174846351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec070830 msgr2=0x7fc1ec070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:17.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.129+0000 7fc1f1200700 1 --2- 172.21.15.84:0/4174846351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec070830 0x7fc1ec070ca0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8004940 tx=0x7fc1d8009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:17.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.129+0000 7fc1f1200700 1 -- 172.21.15.84:0/4174846351 shutdown_connections 2024-04-26T21:33:17.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.129+0000 7fc1f1200700 1 --2- 172.21.15.84:0/4174846351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec070830 0x7fc1ec070ca0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:17.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.129+0000 7fc1f1200700 1 --2- 172.21.15.84:0/4174846351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1ec071de0 0x7fc1ec0702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:17.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.129+0000 7fc1f1200700 1 -- 172.21.15.84:0/4174846351 >> 172.21.15.84:0/4174846351 conn(0x7fc1ec0f8500 msgr2=0x7fc1ec0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:17.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.129+0000 7fc1f1200700 1 -- 172.21.15.84:0/4174846351 shutdown_connections 2024-04-26T21:33:17.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.129+0000 7fc1f1200700 1 -- 172.21.15.84:0/4174846351 wait complete. 2024-04-26T21:33:17.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.130+0000 7fc1f1200700 1 Processor -- start 2024-04-26T21:33:17.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.130+0000 7fc1f1200700 1 -- start start 2024-04-26T21:33:17.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.130+0000 7fc1f1200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec070830 0x7fc1ec10fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.130+0000 7fc1f1200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1ec071de0 0x7fc1ec110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.130+0000 7fc1f1200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec110810 con 0x7fc1ec070830 2024-04-26T21:33:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.130+0000 7fc1f1200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec111000 con 0x7fc1ec071de0 2024-04-26T21:33:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.131+0000 7fc1e9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec070830 0x7fc1ec10fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.131+0000 7fc1e9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec070830 0x7fc1ec10fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49536/0 (socket says 172.21.15.84:49536) 2024-04-26T21:33:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.131+0000 7fc1e9e00700 1 -- 172.21.15.84:0/2538552765 learned_addr learned my addr 172.21.15.84:0/2538552765 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:33:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.131+0000 7fc1e9400700 1 --2- 172.21.15.84:0/2538552765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1ec071de0 0x7fc1ec110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.131+0000 7fc1e9e00700 1 -- 172.21.15.84:0/2538552765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1ec071de0 msgr2=0x7fc1ec110180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.131+0000 7fc1e9e00700 1 --2- 172.21.15.84:0/2538552765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1ec071de0 0x7fc1ec110180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.131+0000 7fc1e9e00700 1 -- 172.21.15.84:0/2538552765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d8005040 con 0x7fc1ec070830 2024-04-26T21:33:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.131+0000 7fc1e9400700 1 --2- 172.21.15.84:0/2538552765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1ec071de0 0x7fc1ec110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:33:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.132+0000 7fc1e9e00700 1 --2- 172.21.15.84:0/2538552765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec070830 0x7fc1ec10fc40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00b790 tx=0x7fc1dc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.132+0000 7fc1e2000700 1 -- 172.21.15.84:0/2538552765 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1dc00f6f0 con 0x7fc1ec070830 2024-04-26T21:33:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.132+0000 7fc1e2000700 1 -- 172.21.15.84:0/2538552765 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc1dc00fd20 con 0x7fc1ec070830 2024-04-26T21:33:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.132+0000 7fc1f1200700 1 -- 172.21.15.84:0/2538552765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ec1112e0 con 0x7fc1ec070830 2024-04-26T21:33:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.132+0000 7fc1e2000700 1 -- 172.21.15.84:0/2538552765 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1dc0103a0 con 0x7fc1ec070830 2024-04-26T21:33:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.133+0000 7fc1f1200700 1 -- 172.21.15.84:0/2538552765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ec1118a0 con 0x7fc1ec070830 2024-04-26T21:33:17.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.134+0000 7fc1f1200700 1 -- 172.21.15.84:0/2538552765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ec05f5c0 con 0x7fc1ec070830 2024-04-26T21:33:17.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.135+0000 7fc1e2000700 1 -- 172.21.15.84:0/2538552765 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc1dc00f850 con 0x7fc1ec070830 2024-04-26T21:33:17.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.136+0000 7fc1e2000700 1 --2- 172.21.15.84:0/2538552765 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc1d006ec00 0x7fc1d00710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:17.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.136+0000 7fc1e2000700 1 -- 172.21.15.84:0/2538552765 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fc1dc08e750 con 0x7fc1ec070830 2024-04-26T21:33:17.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.136+0000 7fc1e9400700 1 --2- 172.21.15.84:0/2538552765 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc1d006ec00 0x7fc1d00710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:17.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.137+0000 7fc1e9400700 1 --2- 172.21.15.84:0/2538552765 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc1d006ec00 0x7fc1d00710b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800b3b0 tx=0x7fc1d8009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:17.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.141+0000 7fc1e2000700 1 -- 172.21.15.84:0/2538552765 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fc1dc05afd0 con 0x7fc1ec070830 2024-04-26T21:33:17.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.390+0000 7fc1f1200700 1 -- 172.21.15.84:0/2538552765 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1ec111bc0 con 0x7fc1d006ec00 2024-04-26T21:33:17.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.404+0000 7fc1e2000700 1 -- 172.21.15.84:0/2538552765 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc1ec111bc0 con 0x7fc1d006ec00 2024-04-26T21:33:17.406 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:33:17.406 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (8m) 2m ago 18m 14.5M - 0.25.0 c8568f914cd2 bcb419cf9108 2024-04-26T21:33:17.406 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (4m) 2m ago 19m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 b4010dfbe623 2024-04-26T21:33:17.406 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (4m) 45s ago 17m 6665k - 19.0.0-3306-gbc612ffb 55dc54019ad8 89a4e50ea23c 2024-04-26T21:33:17.406 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (7m) 2m ago 18m 76.4M - 9.4.7 954c08fa6188 1bf95f604e07 2024-04-26T21:33:17.406 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (11m) 2m ago 11m 114M - 17.2.7-907-g2be3efa9 1c5834633715 485d7884e1d5 2024-04-26T21:33:17.406 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (11m) 2m ago 11m 14.3M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:33:17.406 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (11m) 45s ago 11m 113M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:33:17.406 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (11m) 45s ago 11m 14.6M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:33:17.407 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (7m) 2m ago 20m 505M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:33:17.407 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283,8765 running (6m) 45s ago 17m 454M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d6ae0b4628b5 2024-04-26T21:33:17.407 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (5m) 2m ago 20m 43.8M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 bf610abb6a62 2024-04-26T21:33:17.407 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (5m) 45s ago 17m 36.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 5d530496253b 2024-04-26T21:33:17.407 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (8m) 2m ago 19m 8010k - 1.5.0 0da6a335fe13 81e00b40bfbf 2024-04-26T21:33:17.407 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (7m) 45s ago 17m 7541k - 1.5.0 0da6a335fe13 0506a1d46ec4 2024-04-26T21:33:17.407 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (3m) 2m ago 16m 124M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 99fbe2faa51b 2024-04-26T21:33:17.407 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (3m) 2m ago 16m 84.9M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 2dc81d93f7e5 2024-04-26T21:33:17.407 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (2m) 2m ago 15m 11.2M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 9e77abf095bd 2024-04-26T21:33:17.407 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (2m) 45s ago 14m 83.1M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 d7e5825e2640 2024-04-26T21:33:17.407 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (78s) 45s ago 14m 80.2M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 894dcbaab8eb 2024-04-26T21:33:17.407 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (50s) 45s ago 13m 11.2M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 e39948e51a13 2024-04-26T21:33:17.407 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (6m) 2m ago 18m 56.2M - 2.43.0 a07b618ecd1d d3008b765eec 2024-04-26T21:33:17.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.407+0000 7fc1f1200700 1 -- 172.21.15.84:0/2538552765 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc1d006ec00 msgr2=0x7fc1d00710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:17.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.407+0000 7fc1f1200700 1 --2- 172.21.15.84:0/2538552765 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc1d006ec00 0x7fc1d00710b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800b3b0 tx=0x7fc1d8009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:17.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.407+0000 7fc1f1200700 1 -- 172.21.15.84:0/2538552765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec070830 msgr2=0x7fc1ec10fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:17.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.407+0000 7fc1f1200700 1 --2- 172.21.15.84:0/2538552765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec070830 0x7fc1ec10fc40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00b790 tx=0x7fc1dc009220 comp rx=0 tx=0).stop 2024-04-26T21:33:17.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.408+0000 7fc1f1200700 1 -- 172.21.15.84:0/2538552765 shutdown_connections 2024-04-26T21:33:17.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.408+0000 7fc1f1200700 1 --2- 172.21.15.84:0/2538552765 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc1d006ec00 0x7fc1d00710b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:17.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.408+0000 7fc1f1200700 1 --2- 172.21.15.84:0/2538552765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec070830 0x7fc1ec10fc40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:17.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.408+0000 7fc1f1200700 1 --2- 172.21.15.84:0/2538552765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1ec071de0 0x7fc1ec110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:17.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.408+0000 7fc1f1200700 1 -- 172.21.15.84:0/2538552765 >> 172.21.15.84:0/2538552765 conn(0x7fc1ec0f8500 msgr2=0x7fc1ec0f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:17.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.408+0000 7fc1f1200700 1 -- 172.21.15.84:0/2538552765 shutdown_connections 2024-04-26T21:33:17.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.408+0000 7fc1f1200700 1 -- 172.21.15.84:0/2538552765 wait complete. 2024-04-26T21:33:17.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:16 smithi120 ceph-mon[79001]: pgmap v211: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 1 op/s 2024-04-26T21:33:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.551+0000 7f9f69a00700 1 -- 172.21.15.84:0/2209745784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f64070940 msgr2=0x7f9f64070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.551+0000 7f9f69a00700 1 --2- 172.21.15.84:0/2209745784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f64070940 0x7f9f64070db0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9f50004940 tx=0x7f9f50009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.551+0000 7f9f69a00700 1 -- 172.21.15.84:0/2209745784 shutdown_connections 2024-04-26T21:33:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.551+0000 7f9f69a00700 1 --2- 172.21.15.84:0/2209745784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f64070940 0x7f9f64070db0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.551+0000 7f9f69a00700 1 --2- 172.21.15.84:0/2209745784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f64071ef0 0x7f9f64070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.551+0000 7f9f69a00700 1 -- 172.21.15.84:0/2209745784 >> 172.21.15.84:0/2209745784 conn(0x7f9f640f8560 msgr2=0x7f9f640fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.551+0000 7f9f69a00700 1 -- 172.21.15.84:0/2209745784 shutdown_connections 2024-04-26T21:33:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.551+0000 7f9f69a00700 1 -- 172.21.15.84:0/2209745784 wait complete. 2024-04-26T21:33:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.552+0000 7f9f69a00700 1 Processor -- start 2024-04-26T21:33:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.552+0000 7f9f69a00700 1 -- start start 2024-04-26T21:33:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.553+0000 7f9f69a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f64070940 0x7f9f64114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.553+0000 7f9f69a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f64071ef0 0x7f9f64114590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.553+0000 7f9f69a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f64114c20 con 0x7f9f64070940 2024-04-26T21:33:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.553+0000 7f9f69a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f641153c0 con 0x7f9f64071ef0 2024-04-26T21:33:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.553+0000 7f9f62a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f64070940 0x7f9f64114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.553+0000 7f9f62a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f64070940 0x7f9f64114050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49558/0 (socket says 172.21.15.84:49558) 2024-04-26T21:33:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.553+0000 7f9f62a00700 1 -- 172.21.15.84:0/1239582660 learned_addr learned my addr 172.21.15.84:0/1239582660 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:33:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.553+0000 7f9f62000700 1 --2- 172.21.15.84:0/1239582660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f64071ef0 0x7f9f64114590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.553+0000 7f9f62a00700 1 -- 172.21.15.84:0/1239582660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f64071ef0 msgr2=0x7f9f64114590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.553+0000 7f9f62a00700 1 --2- 172.21.15.84:0/1239582660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f64071ef0 0x7f9f64114590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.553+0000 7f9f62a00700 1 -- 172.21.15.84:0/1239582660 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f50005040 con 0x7f9f64070940 2024-04-26T21:33:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.554+0000 7f9f62a00700 1 --2- 172.21.15.84:0/1239582660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f64070940 0x7f9f64114050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9f5400b790 tx=0x7f9f54009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.554+0000 7f9f5aa00700 1 -- 172.21.15.84:0/1239582660 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f5400f6f0 con 0x7f9f64070940 2024-04-26T21:33:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.554+0000 7f9f5aa00700 1 -- 172.21.15.84:0/1239582660 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f5400fd20 con 0x7f9f64070940 2024-04-26T21:33:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.554+0000 7f9f5aa00700 1 -- 172.21.15.84:0/1239582660 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f540103a0 con 0x7f9f64070940 2024-04-26T21:33:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.554+0000 7f9f69a00700 1 -- 172.21.15.84:0/1239582660 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f641156a0 con 0x7f9f64070940 2024-04-26T21:33:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.554+0000 7f9f69a00700 1 -- 172.21.15.84:0/1239582660 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f64115c60 con 0x7f9f64070940 2024-04-26T21:33:17.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.556+0000 7f9f69a00700 1 -- 172.21.15.84:0/1239582660 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f6405f5c0 con 0x7f9f64070940 2024-04-26T21:33:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.556+0000 7f9f5aa00700 1 -- 172.21.15.84:0/1239582660 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9f54011400 con 0x7f9f64070940 2024-04-26T21:33:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.557+0000 7f9f5aa00700 1 --2- 172.21.15.84:0/1239582660 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9f4806ec00 0x7f9f480710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.557+0000 7f9f5aa00700 1 -- 172.21.15.84:0/1239582660 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f9f5408e770 con 0x7f9f64070940 2024-04-26T21:33:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.558+0000 7f9f62000700 1 --2- 172.21.15.84:0/1239582660 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9f4806ec00 0x7f9f480710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:17.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.559+0000 7f9f62000700 1 --2- 172.21.15.84:0/1239582660 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9f4806ec00 0x7f9f480710b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000b3b0 tx=0x7f9f50009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:17.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.563+0000 7f9f5aa00700 1 -- 172.21.15.84:0/1239582660 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f9f5405afd0 con 0x7f9f64070940 2024-04-26T21:33:17.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.881+0000 7f9f69a00700 1 -- 172.21.15.84:0/1239582660 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9f64115f30 con 0x7f9f64070940 2024-04-26T21:33:17.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.882+0000 7f9f5aa00700 1 -- 172.21.15.84:0/1239582660 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f9f5405ab60 con 0x7f9f64070940 2024-04-26T21:33:17.883 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:33:17.883 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:33:17.883 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:33:17.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:33:17.884 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:33:17.884 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:33:17.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:33:17.884 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:33:17.884 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 6 2024-04-26T21:33:17.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:33:17.884 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:33:17.884 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-26T21:33:17.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:33:17.884 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:33:17.884 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4, 2024-04-26T21:33:17.884 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 10 2024-04-26T21:33:17.884 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:33:17.885 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:33:17.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.884+0000 7f9f69a00700 1 -- 172.21.15.84:0/1239582660 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9f4806ec00 msgr2=0x7f9f480710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:17.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.884+0000 7f9f69a00700 1 --2- 172.21.15.84:0/1239582660 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9f4806ec00 0x7f9f480710b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000b3b0 tx=0x7f9f50009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:17.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.884+0000 7f9f69a00700 1 -- 172.21.15.84:0/1239582660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f64070940 msgr2=0x7f9f64114050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:17.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.884+0000 7f9f69a00700 1 --2- 172.21.15.84:0/1239582660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f64070940 0x7f9f64114050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9f5400b790 tx=0x7f9f54009220 comp rx=0 tx=0).stop 2024-04-26T21:33:17.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.884+0000 7f9f69a00700 1 -- 172.21.15.84:0/1239582660 shutdown_connections 2024-04-26T21:33:17.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.884+0000 7f9f69a00700 1 --2- 172.21.15.84:0/1239582660 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9f4806ec00 0x7f9f480710b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:17.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.884+0000 7f9f69a00700 1 --2- 172.21.15.84:0/1239582660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f64070940 0x7f9f64114050 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:17.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.885+0000 7f9f69a00700 1 --2- 172.21.15.84:0/1239582660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f64071ef0 0x7f9f64114590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:17.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.885+0000 7f9f69a00700 1 -- 172.21.15.84:0/1239582660 >> 172.21.15.84:0/1239582660 conn(0x7f9f640f8560 msgr2=0x7f9f640f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:17.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.885+0000 7f9f69a00700 1 -- 172.21.15.84:0/1239582660 shutdown_connections 2024-04-26T21:33:17.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:17.885+0000 7f9f69a00700 1 -- 172.21.15.84:0/1239582660 wait complete. 2024-04-26T21:33:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.040+0000 7f1419c00700 1 -- 172.21.15.84:0/2964088225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14141002a0 msgr2=0x7f1414100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.040+0000 7f1419c00700 1 --2- 172.21.15.84:0/2964088225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14141002a0 0x7f1414100710 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1400004940 tx=0x7f1400009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.040+0000 7f1419c00700 1 -- 172.21.15.84:0/2964088225 shutdown_connections 2024-04-26T21:33:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.040+0000 7f1419c00700 1 --2- 172.21.15.84:0/2964088225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14141002a0 0x7f1414100710 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.040+0000 7f1419c00700 1 --2- 172.21.15.84:0/2964088225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14140feff0 0x7f14140ff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.040+0000 7f1419c00700 1 -- 172.21.15.84:0/2964088225 >> 172.21.15.84:0/2964088225 conn(0x7f14140fa8f0 msgr2=0x7f14140fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.040+0000 7f1419c00700 1 -- 172.21.15.84:0/2964088225 shutdown_connections 2024-04-26T21:33:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.040+0000 7f1419c00700 1 -- 172.21.15.84:0/2964088225 wait complete. 2024-04-26T21:33:18.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.041+0000 7f1419c00700 1 Processor -- start 2024-04-26T21:33:18.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.041+0000 7f1419c00700 1 -- start start 2024-04-26T21:33:18.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.041+0000 7f1419c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14140feff0 0x7f141410faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:18.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.041+0000 7f1419c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14141002a0 0x7f1414110030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:18.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.041+0000 7f1419c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14141106c0 con 0x7f14140feff0 2024-04-26T21:33:18.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.041+0000 7f1419c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1414115060 con 0x7f14141002a0 2024-04-26T21:33:18.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.042+0000 7f1412a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14140feff0 0x7f141410faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:18.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.042+0000 7f1412a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14140feff0 0x7f141410faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49586/0 (socket says 172.21.15.84:49586) 2024-04-26T21:33:18.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.042+0000 7f1412a00700 1 -- 172.21.15.84:0/3719435693 learned_addr learned my addr 172.21.15.84:0/3719435693 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:33:18.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.042+0000 7f1412000700 1 --2- 172.21.15.84:0/3719435693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14141002a0 0x7f1414110030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:18.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.042+0000 7f1412a00700 1 -- 172.21.15.84:0/3719435693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14141002a0 msgr2=0x7f1414110030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:18.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.042+0000 7f1412a00700 1 --2- 172.21.15.84:0/3719435693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14141002a0 0x7f1414110030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:18.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.042+0000 7f1412a00700 1 -- 172.21.15.84:0/3719435693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1400005040 con 0x7f14140feff0 2024-04-26T21:33:18.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.043+0000 7f1412a00700 1 --2- 172.21.15.84:0/3719435693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14140feff0 0x7f141410faf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f140400b790 tx=0x7f1404009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:18.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.043+0000 7f140aa00700 1 -- 172.21.15.84:0/3719435693 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f140400f770 con 0x7f14140feff0 2024-04-26T21:33:18.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.043+0000 7f140aa00700 1 -- 172.21.15.84:0/3719435693 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f140400fda0 con 0x7f14140feff0 2024-04-26T21:33:18.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.043+0000 7f1419c00700 1 -- 172.21.15.84:0/3719435693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14141152c0 con 0x7f14140feff0 2024-04-26T21:33:18.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.043+0000 7f140aa00700 1 -- 172.21.15.84:0/3719435693 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f140400d310 con 0x7f14140feff0 2024-04-26T21:33:18.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.043+0000 7f1419c00700 1 -- 172.21.15.84:0/3719435693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1414115830 con 0x7f14140feff0 2024-04-26T21:33:18.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.045+0000 7f1419c00700 1 -- 172.21.15.84:0/3719435693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141404c710 con 0x7f14140feff0 2024-04-26T21:33:18.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.046+0000 7f140aa00700 1 -- 172.21.15.84:0/3719435693 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1404010420 con 0x7f14140feff0 2024-04-26T21:33:18.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.047+0000 7f140aa00700 1 --2- 172.21.15.84:0/3719435693 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f13f806ec00 0x7f13f80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:18.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.047+0000 7f140aa00700 1 -- 172.21.15.84:0/3719435693 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f140408e860 con 0x7f14140feff0 2024-04-26T21:33:18.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.048+0000 7f1412000700 1 --2- 172.21.15.84:0/3719435693 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f13f806ec00 0x7f13f80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:18.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.048+0000 7f1412000700 1 --2- 172.21.15.84:0/3719435693 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f13f806ec00 0x7f13f80710b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f140000b3b0 tx=0x7f1400009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:18.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.052+0000 7f140aa00700 1 -- 172.21.15.84:0/3719435693 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f140405b200 con 0x7f14140feff0 2024-04-26T21:33:18.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:18 smithi084 ceph-mon[90138]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:33:18.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:18 smithi084 ceph-mon[90138]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:33:18.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:18 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:18.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:18 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.hbjunw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:33:18.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:18 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:33:18.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:18 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/1239582660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.334+0000 7f1419c00700 1 -- 172.21.15.84:0/3719435693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1414115cf0 con 0x7f14140feff0 2024-04-26T21:33:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.335+0000 7f140aa00700 1 -- 172.21.15.84:0/3719435693 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1890 (secure 0 0 0) 0x7f140405ad90 con 0x7f14140feff0 2024-04-26T21:33:18.337 INFO:teuthology.orchestra.run.smithi084.stdout:e22 2024-04-26T21:33:18.338 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:33:18.338 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:33:18.338 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:33:18.338 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:33:18.338 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:33:18.338 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:33:18.338 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 21 2024-04-26T21:33:18.338 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:33:18.338 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:33:18.338 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:33:12.479430+0000 2024-04-26T21:33:18.338 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:33:18.338 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:33:18.338 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:33:18.339 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:33:18.339 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:33:18.339 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-04-26T21:33:18.339 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:33:18.339 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:33:18.339 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-04-26T21:33:18.339 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:33:18.339 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 1 2024-04-26T21:33:18.339 INFO:teuthology.orchestra.run.smithi084.stdout:in 0 2024-04-26T21:33:18.339 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=14456} 2024-04-26T21:33:18.339 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:33:18.339 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:33:18.339 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 1 2024-04-26T21:33:18.339 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:33:18.340 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:33:18.340 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:33:18.340 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:33:18.340 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-04-26T21:33:18.340 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:33:18.340 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 14456 members: 14456 2024-04-26T21:33:18.340 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:14456} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.84:6826/1450914842,v1:172.21.15.84:6827/1450914842] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:33:18.340 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:33:18.340 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:33:18.340 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:33:18.340 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:33:18.340 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:33:18.340 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:33:18.340 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{-1:44247} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.120:6824/4163804141,v1:172.21.15.120:6825/4163804141] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:33:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.338+0000 7f1419c00700 1 -- 172.21.15.84:0/3719435693 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f13f806ec00 msgr2=0x7f13f80710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.338+0000 7f1419c00700 1 --2- 172.21.15.84:0/3719435693 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f13f806ec00 0x7f13f80710b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f140000b3b0 tx=0x7f1400009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.338+0000 7f1419c00700 1 -- 172.21.15.84:0/3719435693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14140feff0 msgr2=0x7f141410faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.338+0000 7f1419c00700 1 --2- 172.21.15.84:0/3719435693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14140feff0 0x7f141410faf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f140400b790 tx=0x7f1404009250 comp rx=0 tx=0).stop 2024-04-26T21:33:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.338+0000 7f1419c00700 1 -- 172.21.15.84:0/3719435693 shutdown_connections 2024-04-26T21:33:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.338+0000 7f1419c00700 1 --2- 172.21.15.84:0/3719435693 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f13f806ec00 0x7f13f80710b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.338+0000 7f1419c00700 1 --2- 172.21.15.84:0/3719435693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14140feff0 0x7f141410faf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.338+0000 7f1419c00700 1 --2- 172.21.15.84:0/3719435693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14141002a0 0x7f1414110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.338+0000 7f1419c00700 1 -- 172.21.15.84:0/3719435693 >> 172.21.15.84:0/3719435693 conn(0x7f14140fa8f0 msgr2=0x7f14140fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.338+0000 7f1419c00700 1 -- 172.21.15.84:0/3719435693 shutdown_connections 2024-04-26T21:33:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.338+0000 7f1419c00700 1 -- 172.21.15.84:0/3719435693 wait complete. 2024-04-26T21:33:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 22 2024-04-26T21:33:18.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:18 smithi120 ceph-mon[79001]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:33:18.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:18 smithi120 ceph-mon[79001]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:33:18.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:18 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:18.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:18 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.hbjunw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:33:18.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:18 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:33:18.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:18 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/1239582660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:18.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.483+0000 7f9516c00700 1 -- 172.21.15.84:0/190214917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95100fce60 msgr2=0x7f95100fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:18.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.483+0000 7f9516c00700 1 --2- 172.21.15.84:0/190214917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95100fce60 0x7f95100fd270 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9500004940 tx=0x7f9500009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:18.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.484+0000 7f9516c00700 1 -- 172.21.15.84:0/190214917 shutdown_connections 2024-04-26T21:33:18.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.484+0000 7f9516c00700 1 --2- 172.21.15.84:0/190214917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95100fdfd0 0x7f95100fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:18.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.484+0000 7f9516c00700 1 --2- 172.21.15.84:0/190214917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95100fce60 0x7f95100fd270 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:18.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.484+0000 7f9516c00700 1 -- 172.21.15.84:0/190214917 >> 172.21.15.84:0/190214917 conn(0x7f95100f8500 msgr2=0x7f95100fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:18.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.484+0000 7f9516c00700 1 -- 172.21.15.84:0/190214917 shutdown_connections 2024-04-26T21:33:18.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.484+0000 7f9516c00700 1 -- 172.21.15.84:0/190214917 wait complete. 2024-04-26T21:33:18.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.485+0000 7f9516c00700 1 Processor -- start 2024-04-26T21:33:18.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.486+0000 7f9516c00700 1 -- start start 2024-04-26T21:33:18.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.486+0000 7f9516c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95100fce60 0x7f9510114030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:18.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.486+0000 7f9516c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95100fdfd0 0x7f9510114570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:18.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.486+0000 7f9516c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9510114b70 con 0x7f95100fce60 2024-04-26T21:33:18.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.486+0000 7f9516c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95101153c0 con 0x7f95100fdfd0 2024-04-26T21:33:18.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.486+0000 7f950fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95100fce60 0x7f9510114030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:18.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.486+0000 7f950fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95100fce60 0x7f9510114030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49614/0 (socket says 172.21.15.84:49614) 2024-04-26T21:33:18.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.486+0000 7f950fe00700 1 -- 172.21.15.84:0/145195653 learned_addr learned my addr 172.21.15.84:0/145195653 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:33:18.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.487+0000 7f950f400700 1 --2- 172.21.15.84:0/145195653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95100fdfd0 0x7f9510114570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:18.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.487+0000 7f950fe00700 1 -- 172.21.15.84:0/145195653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95100fdfd0 msgr2=0x7f9510114570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:18.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.487+0000 7f950fe00700 1 --2- 172.21.15.84:0/145195653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95100fdfd0 0x7f9510114570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:18.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.487+0000 7f950fe00700 1 -- 172.21.15.84:0/145195653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9500005040 con 0x7f95100fce60 2024-04-26T21:33:18.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.487+0000 7f950fe00700 1 --2- 172.21.15.84:0/145195653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95100fce60 0x7f9510114030 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f950000b3b0 tx=0x7f9500009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:18.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.487+0000 7f9507e00700 1 -- 172.21.15.84:0/145195653 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f950000e040 con 0x7f95100fce60 2024-04-26T21:33:18.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.488+0000 7f9516c00700 1 -- 172.21.15.84:0/145195653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9510115640 con 0x7f95100fce60 2024-04-26T21:33:18.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.488+0000 7f9516c00700 1 -- 172.21.15.84:0/145195653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9510115b80 con 0x7f95100fce60 2024-04-26T21:33:18.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.488+0000 7f9507e00700 1 -- 172.21.15.84:0/145195653 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9500004290 con 0x7f95100fce60 2024-04-26T21:33:18.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.488+0000 7f9507e00700 1 -- 172.21.15.84:0/145195653 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f950001c630 con 0x7f95100fce60 2024-04-26T21:33:18.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.489+0000 7f9516c00700 1 -- 172.21.15.84:0/145195653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9510100950 con 0x7f95100fce60 2024-04-26T21:33:18.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.490+0000 7f9507e00700 1 -- 172.21.15.84:0/145195653 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f950000bbf0 con 0x7f95100fce60 2024-04-26T21:33:18.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.491+0000 7f9507e00700 1 --2- 172.21.15.84:0/145195653 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f94f406ec10 0x7f94f40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:18.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.491+0000 7f9507e00700 1 -- 172.21.15.84:0/145195653 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f950008fd30 con 0x7f95100fce60 2024-04-26T21:33:18.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.491+0000 7f950f400700 1 --2- 172.21.15.84:0/145195653 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f94f406ec10 0x7f94f40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:18.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.492+0000 7f950f400700 1 --2- 172.21.15.84:0/145195653 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f94f406ec10 0x7f94f40710c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f94fc007fd0 tx=0x7f94fc009040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:18.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.496+0000 7f9507e00700 1 -- 172.21.15.84:0/145195653 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f950005c610 con 0x7f95100fce60 2024-04-26T21:33:18.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.748+0000 7f9516c00700 1 -- 172.21.15.84:0/145195653 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9510115df0 con 0x7f94f406ec10 2024-04-26T21:33:18.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.751+0000 7f9507e00700 1 -- 172.21.15.84:0/145195653 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9510115df0 con 0x7f94f406ec10 2024-04-26T21:33:18.753 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:33:18.753 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:33:18.753 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:33:18.753 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:33:18.753 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-04-26T21:33:18.753 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr", 2024-04-26T21:33:18.753 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-04-26T21:33:18.753 INFO:teuthology.orchestra.run.smithi084.stdout: "osd", 2024-04-26T21:33:18.753 INFO:teuthology.orchestra.run.smithi084.stdout: "crash" 2024-04-26T21:33:18.753 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-04-26T21:33:18.753 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "12/21 daemons upgraded", 2024-04-26T21:33:18.753 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading mds daemons", 2024-04-26T21:33:18.754 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:33:18.754 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:33:18.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.754+0000 7f9516c00700 1 -- 172.21.15.84:0/145195653 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f94f406ec10 msgr2=0x7f94f40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:18.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.754+0000 7f9516c00700 1 --2- 172.21.15.84:0/145195653 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f94f406ec10 0x7f94f40710c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f94fc007fd0 tx=0x7f94fc009040 comp rx=0 tx=0).stop 2024-04-26T21:33:18.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.754+0000 7f9516c00700 1 -- 172.21.15.84:0/145195653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95100fce60 msgr2=0x7f9510114030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:18.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.754+0000 7f9516c00700 1 --2- 172.21.15.84:0/145195653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95100fce60 0x7f9510114030 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f950000b3b0 tx=0x7f9500009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:18.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.754+0000 7f9516c00700 1 -- 172.21.15.84:0/145195653 shutdown_connections 2024-04-26T21:33:18.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.754+0000 7f9516c00700 1 --2- 172.21.15.84:0/145195653 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f94f406ec10 0x7f94f40710c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:18.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.754+0000 7f9516c00700 1 --2- 172.21.15.84:0/145195653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95100fce60 0x7f9510114030 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:18.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.754+0000 7f9516c00700 1 --2- 172.21.15.84:0/145195653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95100fdfd0 0x7f9510114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:18.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.754+0000 7f9516c00700 1 -- 172.21.15.84:0/145195653 >> 172.21.15.84:0/145195653 conn(0x7f95100f8500 msgr2=0x7f95100f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:18.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.754+0000 7f9516c00700 1 -- 172.21.15.84:0/145195653 shutdown_connections 2024-04-26T21:33:18.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.754+0000 7f9516c00700 1 -- 172.21.15.84:0/145195653 wait complete. 2024-04-26T21:33:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.900+0000 7f5b2a000700 1 -- 172.21.15.84:0/1652000609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b240fe080 msgr2=0x7f5b240fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.900+0000 7f5b2a000700 1 --2- 172.21.15.84:0/1652000609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b240fe080 0x7f5b240fe4f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5b10004940 tx=0x7f5b10009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.900+0000 7f5b2a000700 1 -- 172.21.15.84:0/1652000609 shutdown_connections 2024-04-26T21:33:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.900+0000 7f5b2a000700 1 --2- 172.21.15.84:0/1652000609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b240fe080 0x7f5b240fe4f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.900+0000 7f5b2a000700 1 --2- 172.21.15.84:0/1652000609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b240fcf10 0x7f5b240fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.900+0000 7f5b2a000700 1 -- 172.21.15.84:0/1652000609 >> 172.21.15.84:0/1652000609 conn(0x7f5b240f8560 msgr2=0x7f5b240fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.900+0000 7f5b2a000700 1 -- 172.21.15.84:0/1652000609 shutdown_connections 2024-04-26T21:33:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.900+0000 7f5b2a000700 1 -- 172.21.15.84:0/1652000609 wait complete. 2024-04-26T21:33:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.901+0000 7f5b2a000700 1 Processor -- start 2024-04-26T21:33:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.901+0000 7f5b2a000700 1 -- start start 2024-04-26T21:33:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.901+0000 7f5b2a000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b240fcf10 0x7f5b2410fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.901+0000 7f5b2a000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b240fe080 0x7f5b24110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.902+0000 7f5b2a000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b24110740 con 0x7f5b240fcf10 2024-04-26T21:33:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.902+0000 7f5b2a000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b24110f90 con 0x7f5b240fe080 2024-04-26T21:33:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.902+0000 7f5b23400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b240fcf10 0x7f5b2410fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.902+0000 7f5b23400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b240fcf10 0x7f5b2410fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49624/0 (socket says 172.21.15.84:49624) 2024-04-26T21:33:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.902+0000 7f5b23400700 1 -- 172.21.15.84:0/995461133 learned_addr learned my addr 172.21.15.84:0/995461133 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:33:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.902+0000 7f5b22a00700 1 --2- 172.21.15.84:0/995461133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b240fe080 0x7f5b24110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.902+0000 7f5b23400700 1 -- 172.21.15.84:0/995461133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b240fe080 msgr2=0x7f5b24110140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.902+0000 7f5b23400700 1 --2- 172.21.15.84:0/995461133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b240fe080 0x7f5b24110140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.902+0000 7f5b23400700 1 -- 172.21.15.84:0/995461133 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b10005040 con 0x7f5b240fcf10 2024-04-26T21:33:18.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.903+0000 7f5b23400700 1 --2- 172.21.15.84:0/995461133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b240fcf10 0x7f5b2410fc00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400c830 tx=0x7f5b14004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:18.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.903+0000 7f5b1b400700 1 -- 172.21.15.84:0/995461133 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b1400a760 con 0x7f5b240fcf10 2024-04-26T21:33:18.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.903+0000 7f5b1b400700 1 -- 172.21.15.84:0/995461133 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5b1400ad90 con 0x7f5b240fcf10 2024-04-26T21:33:18.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.903+0000 7f5b2a000700 1 -- 172.21.15.84:0/995461133 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b24111270 con 0x7f5b240fcf10 2024-04-26T21:33:18.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.903+0000 7f5b1b400700 1 -- 172.21.15.84:0/995461133 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b140113a0 con 0x7f5b240fcf10 2024-04-26T21:33:18.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.903+0000 7f5b2a000700 1 -- 172.21.15.84:0/995461133 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b241117b0 con 0x7f5b240fcf10 2024-04-26T21:33:18.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.904+0000 7f5b2a000700 1 -- 172.21.15.84:0/995461133 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b24101a10 con 0x7f5b240fcf10 2024-04-26T21:33:18.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.905+0000 7f5b1b400700 1 -- 172.21.15.84:0/995461133 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5b1400a8c0 con 0x7f5b240fcf10 2024-04-26T21:33:18.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.906+0000 7f5b1b400700 1 --2- 172.21.15.84:0/995461133 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5b0806ec10 0x7f5b080710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:18.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.906+0000 7f5b1b400700 1 -- 172.21.15.84:0/995461133 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f5b1408e8e0 con 0x7f5b240fcf10 2024-04-26T21:33:18.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.906+0000 7f5b22a00700 1 --2- 172.21.15.84:0/995461133 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5b0806ec10 0x7f5b080710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:18.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.907+0000 7f5b22a00700 1 --2- 172.21.15.84:0/995461133 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5b0806ec10 0x7f5b080710c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000b970 tx=0x7f5b10009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:18.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:18.911+0000 7f5b1b400700 1 -- 172.21.15.84:0/995461133 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f5b1405b1c0 con 0x7f5b240fcf10 2024-04-26T21:33:19.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:19.237+0000 7f5b2a000700 1 -- 172.21.15.84:0/995461133 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5b2405f5c0 con 0x7f5b240fcf10 2024-04-26T21:33:19.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:19.238+0000 7f5b1b400700 1 -- 172.21.15.84:0/995461133 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f5b1405ad50 con 0x7f5b240fcf10 2024-04-26T21:33:19.241 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:33:19.241 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:33:19.241 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:33:19.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:19.241+0000 7f5b2a000700 1 -- 172.21.15.84:0/995461133 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5b0806ec10 msgr2=0x7f5b080710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:19.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:19.241+0000 7f5b2a000700 1 --2- 172.21.15.84:0/995461133 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5b0806ec10 0x7f5b080710c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000b970 tx=0x7f5b10009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:19.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:19.241+0000 7f5b2a000700 1 -- 172.21.15.84:0/995461133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b240fcf10 msgr2=0x7f5b2410fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:19.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:19.241+0000 7f5b2a000700 1 --2- 172.21.15.84:0/995461133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b240fcf10 0x7f5b2410fc00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400c830 tx=0x7f5b14004470 comp rx=0 tx=0).stop 2024-04-26T21:33:19.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:19.241+0000 7f5b2a000700 1 -- 172.21.15.84:0/995461133 shutdown_connections 2024-04-26T21:33:19.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:19.241+0000 7f5b2a000700 1 --2- 172.21.15.84:0/995461133 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5b0806ec10 0x7f5b080710c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:19.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:19.241+0000 7f5b2a000700 1 --2- 172.21.15.84:0/995461133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b240fcf10 0x7f5b2410fc00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:19.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:19.241+0000 7f5b2a000700 1 --2- 172.21.15.84:0/995461133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b240fe080 0x7f5b24110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:19.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:19.241+0000 7f5b2a000700 1 -- 172.21.15.84:0/995461133 >> 172.21.15.84:0/995461133 conn(0x7f5b240f8560 msgr2=0x7f5b240f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:19.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:19.242+0000 7f5b2a000700 1 -- 172.21.15.84:0/995461133 shutdown_connections 2024-04-26T21:33:19.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:19.242+0000 7f5b2a000700 1 -- 172.21.15.84:0/995461133 wait complete. 2024-04-26T21:33:19.385 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:19 smithi084 ceph-mon[90138]: Upgrade: Updating mds.cephfs.smithi084.hbjunw 2024-04-26T21:33:19.386 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:19 smithi084 ceph-mon[90138]: Deploying daemon mds.cephfs.smithi084.hbjunw on smithi084 2024-04-26T21:33:19.386 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:19 smithi084 ceph-mon[90138]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:33:19.386 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:19 smithi084 ceph-mon[90138]: pgmap v212: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-26T21:33:19.386 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:19 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3719435693' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:33:19.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:19 smithi120 ceph-mon[79001]: Upgrade: Updating mds.cephfs.smithi084.hbjunw 2024-04-26T21:33:19.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:19 smithi120 ceph-mon[79001]: Deploying daemon mds.cephfs.smithi084.hbjunw on smithi084 2024-04-26T21:33:19.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:19 smithi120 ceph-mon[79001]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:33:19.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:19 smithi120 ceph-mon[79001]: pgmap v212: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-26T21:33:19.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:19 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3719435693' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:33:20.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:20 smithi084 ceph-mon[90138]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:33:20.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:20 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/995461133' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:33:20.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:20 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084[90134]: 2024-04-26T21:33:20.144+0000 7fb171000700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:33:20.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:20 smithi120 ceph-mon[79001]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:33:20.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:20 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/995461133' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:33:21.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:21 smithi084 ceph-mon[90138]: pgmap v213: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-26T21:33:21.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:21 smithi084 ceph-mon[90138]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T21:33:21.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:21 smithi084 ceph-mon[90138]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:33:21.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:21 smithi084 ceph-mon[90138]: osdmap e91: 6 total, 6 up, 6 in 2024-04-26T21:33:21.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:21 smithi084 ceph-mon[90138]: Standby daemon mds.cephfs.smithi084.rtrqtr assigned to filesystem cephfs as rank 0 2024-04-26T21:33:21.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:21 smithi084 ceph-mon[90138]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T21:33:21.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:21 smithi084 ceph-mon[90138]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-26T21:33:21.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:21 smithi084 ceph-mon[90138]: fsmap cephfs:1/1 {0=cephfs.smithi084.rtrqtr=up:replay} 2 up:standby 2024-04-26T21:33:21.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:21 smithi120 ceph-mon[79001]: pgmap v213: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-26T21:33:21.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:21 smithi120 ceph-mon[79001]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T21:33:21.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:21 smithi120 ceph-mon[79001]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:33:21.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:21 smithi120 ceph-mon[79001]: osdmap e91: 6 total, 6 up, 6 in 2024-04-26T21:33:21.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:21 smithi120 ceph-mon[79001]: Standby daemon mds.cephfs.smithi084.rtrqtr assigned to filesystem cephfs as rank 0 2024-04-26T21:33:21.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:21 smithi120 ceph-mon[79001]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T21:33:21.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:21 smithi120 ceph-mon[79001]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-26T21:33:21.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:21 smithi120 ceph-mon[79001]: fsmap cephfs:1/1 {0=cephfs.smithi084.rtrqtr=up:replay} 2 up:standby 2024-04-26T21:33:23.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:23 smithi084 ceph-mon[90138]: pgmap v215: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-04-26T21:33:23.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:23 smithi120 ceph-mon[79001]: pgmap v215: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-04-26T21:33:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:25 smithi084 ceph-mon[90138]: pgmap v216: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 3 op/s 2024-04-26T21:33:25.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:25 smithi120 ceph-mon[79001]: pgmap v216: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 3 op/s 2024-04-26T21:33:27.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:27 smithi084 ceph-mon[90138]: pgmap v217: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-26T21:33:27.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:27 smithi084 ceph-mon[90138]: reconnect by client.14520 192.168.0.1:0/2483101042 after 0.00199997 2024-04-26T21:33:27.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:27 smithi084 ceph-mon[90138]: reconnect by client.24273 192.168.0.1:0/1517871093 after 0.00299995 2024-04-26T21:33:27.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:27 smithi084 ceph-mon[90138]: mds.? [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] up:reconnect 2024-04-26T21:33:27.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:27 smithi084 ceph-mon[90138]: fsmap cephfs:1/1 {0=cephfs.smithi084.rtrqtr=up:reconnect} 2 up:standby 2024-04-26T21:33:27.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:27 smithi120 ceph-mon[79001]: pgmap v217: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-26T21:33:27.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:27 smithi120 ceph-mon[79001]: reconnect by client.14520 192.168.0.1:0/2483101042 after 0.00199997 2024-04-26T21:33:27.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:27 smithi120 ceph-mon[79001]: reconnect by client.24273 192.168.0.1:0/1517871093 after 0.00299995 2024-04-26T21:33:27.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:27 smithi120 ceph-mon[79001]: mds.? [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] up:reconnect 2024-04-26T21:33:27.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:27 smithi120 ceph-mon[79001]: fsmap cephfs:1/1 {0=cephfs.smithi084.rtrqtr=up:reconnect} 2 up:standby 2024-04-26T21:33:28.334 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:28 smithi120 ceph-mon[79001]: mds.? [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] up:rejoin 2024-04-26T21:33:28.334 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:28 smithi120 ceph-mon[79001]: fsmap cephfs:1/1 {0=cephfs.smithi084.rtrqtr=up:rejoin} 2 up:standby 2024-04-26T21:33:28.334 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:28 smithi120 ceph-mon[79001]: daemon mds.cephfs.smithi084.rtrqtr is now active in filesystem cephfs as rank 0 2024-04-26T21:33:28.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:28 smithi084 ceph-mon[90138]: mds.? [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] up:rejoin 2024-04-26T21:33:28.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:28 smithi084 ceph-mon[90138]: fsmap cephfs:1/1 {0=cephfs.smithi084.rtrqtr=up:rejoin} 2 up:standby 2024-04-26T21:33:28.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:28 smithi084 ceph-mon[90138]: daemon mds.cephfs.smithi084.rtrqtr is now active in filesystem cephfs as rank 0 2024-04-26T21:33:29.371 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:29 smithi120 ceph-mon[79001]: pgmap v218: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-26T21:33:29.371 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:29 smithi120 ceph-mon[79001]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T21:33:29.371 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:29 smithi120 ceph-mon[79001]: mds.? [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] up:active 2024-04-26T21:33:29.372 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:29 smithi120 ceph-mon[79001]: fsmap cephfs:1 {0=cephfs.smithi084.rtrqtr=up:active} 2 up:standby 2024-04-26T21:33:29.372 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:29 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:33:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:29 smithi084 ceph-mon[90138]: pgmap v218: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-26T21:33:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:29 smithi084 ceph-mon[90138]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T21:33:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:29 smithi084 ceph-mon[90138]: mds.? [v2:172.21.15.84:6828/1543850087,v1:172.21.15.84:6829/1543850087] up:active 2024-04-26T21:33:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:29 smithi084 ceph-mon[90138]: fsmap cephfs:1 {0=cephfs.smithi084.rtrqtr=up:active} 2 up:standby 2024-04-26T21:33:29.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:29 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:33:31.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:31 smithi084 ceph-mon[90138]: pgmap v219: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 409 B/s wr, 7 op/s 2024-04-26T21:33:31.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:31 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:31 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:31 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:33:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:31 smithi084 ceph-mon[90138]: mds.? [v2:172.21.15.84:6826/1392878113,v1:172.21.15.84:6827/1392878113] up:boot 2024-04-26T21:33:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:31 smithi084 ceph-mon[90138]: fsmap cephfs:1 {0=cephfs.smithi084.rtrqtr=up:active} 3 up:standby 2024-04-26T21:33:31.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:31 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.hbjunw"}]: dispatch 2024-04-26T21:33:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:31 smithi120 ceph-mon[79001]: pgmap v219: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 409 B/s wr, 7 op/s 2024-04-26T21:33:31.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:31 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:31.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:31 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:31.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:31 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:33:31.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:31 smithi120 ceph-mon[79001]: mds.? [v2:172.21.15.84:6826/1392878113,v1:172.21.15.84:6827/1392878113] up:boot 2024-04-26T21:33:31.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:31 smithi120 ceph-mon[79001]: fsmap cephfs:1 {0=cephfs.smithi084.rtrqtr=up:active} 3 up:standby 2024-04-26T21:33:31.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:31 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.hbjunw"}]: dispatch 2024-04-26T21:33:33.383 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:33 smithi084 ceph-mon[90138]: pgmap v220: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 350 B/s wr, 6 op/s 2024-04-26T21:33:33.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:33 smithi120 ceph-mon[79001]: pgmap v220: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 350 B/s wr, 6 op/s 2024-04-26T21:33:35.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:35 smithi084 ceph-mon[90138]: pgmap v221: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 426 B/s wr, 7 op/s 2024-04-26T21:33:35.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:35 smithi120 ceph-mon[79001]: pgmap v221: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 426 B/s wr, 7 op/s 2024-04-26T21:33:37.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:37 smithi084 ceph-mon[90138]: pgmap v222: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-04-26T21:33:37.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:37 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:37.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:37 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:37.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:37 smithi120 ceph-mon[79001]: pgmap v222: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-04-26T21:33:37.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:37 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:37.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:37 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:39.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:39 smithi084 ceph-mon[90138]: pgmap v223: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-04-26T21:33:39.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:39 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:39.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:39 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:39.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:39 smithi120 ceph-mon[79001]: pgmap v223: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-04-26T21:33:39.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:39 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:39.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:39 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:41.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:41 smithi084 ceph-mon[90138]: pgmap v224: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-04-26T21:33:41.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:41 smithi120 ceph-mon[79001]: pgmap v224: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-04-26T21:33:43.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:43 smithi084 ceph-mon[90138]: pgmap v225: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 4.4 KiB/s wr, 3 op/s 2024-04-26T21:33:43.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:43 smithi120 ceph-mon[79001]: pgmap v225: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 4.4 KiB/s wr, 3 op/s 2024-04-26T21:33:44.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:33:44.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:33:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:45 smithi084 ceph-mon[90138]: pgmap v226: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 4.4 KiB/s wr, 3 op/s 2024-04-26T21:33:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:33:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:33:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:33:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi084.rtrqtr"]}]: dispatch 2024-04-26T21:33:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:45 smithi120 ceph-mon[79001]: pgmap v226: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 4.4 KiB/s wr, 3 op/s 2024-04-26T21:33:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:33:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:33:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:33:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:45.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:45.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi084.rtrqtr"]}]: dispatch 2024-04-26T21:33:46.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:46 smithi084 ceph-mon[90138]: Detected new or changed devices on smithi084 2024-04-26T21:33:46.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:46 smithi084 ceph-mon[90138]: Upgrade: It appears safe to stop mds.cephfs.smithi084.rtrqtr 2024-04-26T21:33:46.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:46 smithi120 ceph-mon[79001]: Detected new or changed devices on smithi084 2024-04-26T21:33:46.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:46 smithi120 ceph-mon[79001]: Upgrade: It appears safe to stop mds.cephfs.smithi084.rtrqtr 2024-04-26T21:33:47.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:47 smithi084 ceph-mon[90138]: pgmap v227: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 4.3 KiB/s wr, 2 op/s 2024-04-26T21:33:47.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:47 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:47.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:47 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.rtrqtr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:33:47.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:47 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:33:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:47 smithi120 ceph-mon[79001]: pgmap v227: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 4.3 KiB/s wr, 2 op/s 2024-04-26T21:33:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:47 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:47 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.rtrqtr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:33:47.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:47 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:33:48.200 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:48 smithi084 ceph-mon[90138]: Upgrade: Updating mds.cephfs.smithi084.rtrqtr 2024-04-26T21:33:48.201 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:48 smithi084 ceph-mon[90138]: Deploying daemon mds.cephfs.smithi084.rtrqtr on smithi084 2024-04-26T21:33:48.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:48 smithi120 ceph-mon[79001]: Upgrade: Updating mds.cephfs.smithi084.rtrqtr 2024-04-26T21:33:48.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:48 smithi120 ceph-mon[79001]: Deploying daemon mds.cephfs.smithi084.rtrqtr on smithi084 2024-04-26T21:33:49.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:49 smithi084 ceph-mon[90138]: pgmap v228: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:33:49.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.422+0000 7f85ab200700 1 -- 172.21.15.84:0/942625918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85ac0ffd40 msgr2=0x7f85ac102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:49.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.422+0000 7f85ab200700 1 --2- 172.21.15.84:0/942625918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85ac0ffd40 0x7f85ac102160 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8598004940 tx=0x7f8598009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:49.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.422+0000 7f85ab200700 1 -- 172.21.15.84:0/942625918 shutdown_connections 2024-04-26T21:33:49.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.422+0000 7f85ab200700 1 --2- 172.21.15.84:0/942625918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85ac0ffd40 0x7f85ac102160 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:49.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.422+0000 7f85ab200700 1 --2- 172.21.15.84:0/942625918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85ac066b50 0x7f85ac0ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:49.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.422+0000 7f85ab200700 1 -- 172.21.15.84:0/942625918 >> 172.21.15.84:0/942625918 conn(0x7f85ac0f7270 msgr2=0x7f85ac0f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:49.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.422+0000 7f85ab200700 1 -- 172.21.15.84:0/942625918 shutdown_connections 2024-04-26T21:33:49.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.422+0000 7f85ab200700 1 -- 172.21.15.84:0/942625918 wait complete. 2024-04-26T21:33:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.423+0000 7f85ab200700 1 Processor -- start 2024-04-26T21:33:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.423+0000 7f85ab200700 1 -- start start 2024-04-26T21:33:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.424+0000 7f85ab200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85ac066b50 0x7f85ac10fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.424+0000 7f85ab200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85ac0ffd40 0x7f85ac10fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.424+0000 7f85ab200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac1105f0 con 0x7f85ac066b50 2024-04-26T21:33:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.424+0000 7f85ab200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac110e40 con 0x7f85ac0ffd40 2024-04-26T21:33:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.424+0000 7f85a9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85ac066b50 0x7f85ac10fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.424+0000 7f85a9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85ac066b50 0x7f85ac10fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37016/0 (socket says 172.21.15.84:37016) 2024-04-26T21:33:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.424+0000 7f85a9e00700 1 -- 172.21.15.84:0/4131169590 learned_addr learned my addr 172.21.15.84:0/4131169590 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:33:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.425+0000 7f85a9400700 1 --2- 172.21.15.84:0/4131169590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85ac0ffd40 0x7f85ac10fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.425+0000 7f85a9e00700 1 -- 172.21.15.84:0/4131169590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85ac0ffd40 msgr2=0x7f85ac10fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.425+0000 7f85a9e00700 1 --2- 172.21.15.84:0/4131169590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85ac0ffd40 0x7f85ac10fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.425+0000 7f85a9e00700 1 -- 172.21.15.84:0/4131169590 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8598005040 con 0x7f85ac066b50 2024-04-26T21:33:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.425+0000 7f85a9400700 1 --2- 172.21.15.84:0/4131169590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85ac0ffd40 0x7f85ac10fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:33:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.425+0000 7f85a9e00700 1 --2- 172.21.15.84:0/4131169590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85ac066b50 0x7f85ac10fab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f859c00c7e0 tx=0x7f859c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.425+0000 7f85a2000700 1 -- 172.21.15.84:0/4131169590 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f859c012810 con 0x7f85ac066b50 2024-04-26T21:33:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.425+0000 7f85a2000700 1 -- 172.21.15.84:0/4131169590 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f859c012e40 con 0x7f85ac066b50 2024-04-26T21:33:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.425+0000 7f85a2000700 1 -- 172.21.15.84:0/4131169590 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f859c00a550 con 0x7f85ac066b50 2024-04-26T21:33:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.425+0000 7f85ab200700 1 -- 172.21.15.84:0/4131169590 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ac111120 con 0x7f85ac066b50 2024-04-26T21:33:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.426+0000 7f85ab200700 1 -- 172.21.15.84:0/4131169590 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ac111660 con 0x7f85ac066b50 2024-04-26T21:33:49.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.427+0000 7f85ab200700 1 -- 172.21.15.84:0/4131169590 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ac05f5c0 con 0x7f85ac066b50 2024-04-26T21:33:49.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.428+0000 7f85a2000700 1 -- 172.21.15.84:0/4131169590 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f859c011380 con 0x7f85ac066b50 2024-04-26T21:33:49.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.429+0000 7f85a2000700 1 --2- 172.21.15.84:0/4131169590 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f859006ec10 0x7f85900710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:49.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.429+0000 7f85a2000700 1 -- 172.21.15.84:0/4131169590 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f859c08ed60 con 0x7f85ac066b50 2024-04-26T21:33:49.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.429+0000 7f85a9400700 1 --2- 172.21.15.84:0/4131169590 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f859006ec10 0x7f85900710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:49.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.430+0000 7f85a9400700 1 --2- 172.21.15.84:0/4131169590 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f859006ec10 0x7f85900710c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f859800b7a0 tx=0x7f8598009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:49.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:49 smithi120 ceph-mon[79001]: pgmap v228: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:33:49.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.434+0000 7f85a2000700 1 -- 172.21.15.84:0/4131169590 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f859c093070 con 0x7f85ac066b50 2024-04-26T21:33:49.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.701+0000 7f85ab200700 1 -- 172.21.15.84:0/4131169590 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f85ac111aa0 con 0x7f859006ec10 2024-04-26T21:33:49.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.704+0000 7f85a2000700 1 -- 172.21.15.84:0/4131169590 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f85ac111aa0 con 0x7f859006ec10 2024-04-26T21:33:49.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.706+0000 7f85ab200700 1 -- 172.21.15.84:0/4131169590 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f859006ec10 msgr2=0x7f85900710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:49.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.706+0000 7f85ab200700 1 --2- 172.21.15.84:0/4131169590 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f859006ec10 0x7f85900710c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f859800b7a0 tx=0x7f8598009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:49.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.706+0000 7f85ab200700 1 -- 172.21.15.84:0/4131169590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85ac066b50 msgr2=0x7f85ac10fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:49.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.706+0000 7f85ab200700 1 --2- 172.21.15.84:0/4131169590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85ac066b50 0x7f85ac10fab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f859c00c7e0 tx=0x7f859c007f90 comp rx=0 tx=0).stop 2024-04-26T21:33:49.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.707+0000 7f85ab200700 1 -- 172.21.15.84:0/4131169590 shutdown_connections 2024-04-26T21:33:49.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.707+0000 7f85ab200700 1 --2- 172.21.15.84:0/4131169590 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f859006ec10 0x7f85900710c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:49.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.707+0000 7f85ab200700 1 --2- 172.21.15.84:0/4131169590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85ac066b50 0x7f85ac10fab0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:49.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.707+0000 7f85ab200700 1 --2- 172.21.15.84:0/4131169590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85ac0ffd40 0x7f85ac10fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:49.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.707+0000 7f85ab200700 1 -- 172.21.15.84:0/4131169590 >> 172.21.15.84:0/4131169590 conn(0x7f85ac0f7270 msgr2=0x7f85ac0fb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:49.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.707+0000 7f85ab200700 1 -- 172.21.15.84:0/4131169590 shutdown_connections 2024-04-26T21:33:49.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.707+0000 7f85ab200700 1 -- 172.21.15.84:0/4131169590 wait complete. 2024-04-26T21:33:49.725 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:33:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.861+0000 7fce90200700 1 -- 172.21.15.84:0/1786459588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce88070890 msgr2=0x7fce88070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.861+0000 7fce90200700 1 --2- 172.21.15.84:0/1786459588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce88070890 0x7fce88070d00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fce74004940 tx=0x7fce74009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.861+0000 7fce90200700 1 -- 172.21.15.84:0/1786459588 shutdown_connections 2024-04-26T21:33:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.861+0000 7fce90200700 1 --2- 172.21.15.84:0/1786459588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce88070890 0x7fce88070d00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.861+0000 7fce90200700 1 --2- 172.21.15.84:0/1786459588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce88071e40 0x7fce88070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.861+0000 7fce90200700 1 -- 172.21.15.84:0/1786459588 >> 172.21.15.84:0/1786459588 conn(0x7fce880f8540 msgr2=0x7fce880fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.861+0000 7fce90200700 1 -- 172.21.15.84:0/1786459588 shutdown_connections 2024-04-26T21:33:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.861+0000 7fce90200700 1 -- 172.21.15.84:0/1786459588 wait complete. 2024-04-26T21:33:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.862+0000 7fce90200700 1 Processor -- start 2024-04-26T21:33:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.862+0000 7fce90200700 1 -- start start 2024-04-26T21:33:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.863+0000 7fce90200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce88070890 0x7fce8810fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.863+0000 7fce90200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce88071e40 0x7fce88110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.863+0000 7fce90200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce88110710 con 0x7fce88070890 2024-04-26T21:33:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.863+0000 7fce90200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce881150b0 con 0x7fce88071e40 2024-04-26T21:33:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.863+0000 7fce8d800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce88070890 0x7fce8810fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.863+0000 7fce8d800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce88070890 0x7fce8810fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37028/0 (socket says 172.21.15.84:37028) 2024-04-26T21:33:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.863+0000 7fce8d800700 1 -- 172.21.15.84:0/526276268 learned_addr learned my addr 172.21.15.84:0/526276268 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:33:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.863+0000 7fce8ce00700 1 --2- 172.21.15.84:0/526276268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce88071e40 0x7fce88110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.863+0000 7fce8d800700 1 -- 172.21.15.84:0/526276268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce88071e40 msgr2=0x7fce88110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.863+0000 7fce8d800700 1 --2- 172.21.15.84:0/526276268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce88071e40 0x7fce88110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.863+0000 7fce8d800700 1 -- 172.21.15.84:0/526276268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce74005040 con 0x7fce88070890 2024-04-26T21:33:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.863+0000 7fce8ce00700 1 --2- 172.21.15.84:0/526276268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce88071e40 0x7fce88110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:33:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.864+0000 7fce8d800700 1 --2- 172.21.15.84:0/526276268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce88070890 0x7fce8810fb40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fce7c00b790 tx=0x7fce7c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.864+0000 7fce85600700 1 -- 172.21.15.84:0/526276268 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce7c00f6f0 con 0x7fce88070890 2024-04-26T21:33:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.864+0000 7fce85600700 1 -- 172.21.15.84:0/526276268 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce7c00fd20 con 0x7fce88070890 2024-04-26T21:33:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.864+0000 7fce90200700 1 -- 172.21.15.84:0/526276268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce88115310 con 0x7fce88070890 2024-04-26T21:33:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.864+0000 7fce85600700 1 -- 172.21.15.84:0/526276268 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce7c0103a0 con 0x7fce88070890 2024-04-26T21:33:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.864+0000 7fce90200700 1 -- 172.21.15.84:0/526276268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce88115880 con 0x7fce88070890 2024-04-26T21:33:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.866+0000 7fce90200700 1 -- 172.21.15.84:0/526276268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8804c710 con 0x7fce88070890 2024-04-26T21:33:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.866+0000 7fce85600700 1 -- 172.21.15.84:0/526276268 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fce7c010500 con 0x7fce88070890 2024-04-26T21:33:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.867+0000 7fce85600700 1 --2- 172.21.15.84:0/526276268 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fce7006ecd0 0x7fce70071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.867+0000 7fce85600700 1 -- 172.21.15.84:0/526276268 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fce7c08e790 con 0x7fce88070890 2024-04-26T21:33:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.868+0000 7fce8ce00700 1 --2- 172.21.15.84:0/526276268 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fce7006ecd0 0x7fce70071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.868+0000 7fce8ce00700 1 --2- 172.21.15.84:0/526276268 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fce7006ecd0 0x7fce70071180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fce7400b7a0 tx=0x7fce74009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:49.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:49.872+0000 7fce85600700 1 -- 172.21.15.84:0/526276268 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fce7c05afa0 con 0x7fce88070890 2024-04-26T21:33:50.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.143+0000 7fce90200700 1 -- 172.21.15.84:0/526276268 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fce88103db0 con 0x7fce7006ecd0 2024-04-26T21:33:50.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.146+0000 7fce85600700 1 -- 172.21.15.84:0/526276268 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fce88103db0 con 0x7fce7006ecd0 2024-04-26T21:33:50.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.148+0000 7fce90200700 1 -- 172.21.15.84:0/526276268 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fce7006ecd0 msgr2=0x7fce70071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:50.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.148+0000 7fce90200700 1 --2- 172.21.15.84:0/526276268 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fce7006ecd0 0x7fce70071180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fce7400b7a0 tx=0x7fce74009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:50.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.148+0000 7fce90200700 1 -- 172.21.15.84:0/526276268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce88070890 msgr2=0x7fce8810fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:50.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.148+0000 7fce90200700 1 --2- 172.21.15.84:0/526276268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce88070890 0x7fce8810fb40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fce7c00b790 tx=0x7fce7c009220 comp rx=0 tx=0).stop 2024-04-26T21:33:50.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.148+0000 7fce90200700 1 -- 172.21.15.84:0/526276268 shutdown_connections 2024-04-26T21:33:50.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.148+0000 7fce90200700 1 --2- 172.21.15.84:0/526276268 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fce7006ecd0 0x7fce70071180 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:50.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.149+0000 7fce90200700 1 --2- 172.21.15.84:0/526276268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce88070890 0x7fce8810fb40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:50.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.149+0000 7fce90200700 1 --2- 172.21.15.84:0/526276268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce88071e40 0x7fce88110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:50.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.149+0000 7fce90200700 1 -- 172.21.15.84:0/526276268 >> 172.21.15.84:0/526276268 conn(0x7fce880f8540 msgr2=0x7fce880f9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:50.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.149+0000 7fce90200700 1 -- 172.21.15.84:0/526276268 shutdown_connections 2024-04-26T21:33:50.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.149+0000 7fce90200700 1 -- 172.21.15.84:0/526276268 wait complete. 2024-04-26T21:33:50.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.297+0000 7ffb58a00700 1 -- 172.21.15.84:0/1836365418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb540727c0 msgr2=0x7ffb54072bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:50.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.297+0000 7ffb58a00700 1 --2- 172.21.15.84:0/1836365418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb540727c0 0x7ffb54072bd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffb44004940 tx=0x7ffb44009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:50.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.297+0000 7ffb58a00700 1 -- 172.21.15.84:0/1836365418 shutdown_connections 2024-04-26T21:33:50.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.297+0000 7ffb58a00700 1 --2- 172.21.15.84:0/1836365418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb54073110 0x7ffb54073b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:50.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.297+0000 7ffb58a00700 1 --2- 172.21.15.84:0/1836365418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb540727c0 0x7ffb54072bd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:50.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.297+0000 7ffb58a00700 1 -- 172.21.15.84:0/1836365418 >> 172.21.15.84:0/1836365418 conn(0x7ffb540fa8f0 msgr2=0x7ffb540fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:50.299 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:49 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084[90134]: 2024-04-26T21:33:49.978+0000 7fb171000700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:33:50.300 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:50 smithi084 ceph-mon[90138]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T21:33:50.300 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:50 smithi084 ceph-mon[90138]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:33:50.300 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:50 smithi084 ceph-mon[90138]: osdmap e92: 6 total, 6 up, 6 in 2024-04-26T21:33:50.300 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:50 smithi084 ceph-mon[90138]: Standby daemon mds.cephfs.smithi120.ufqfoh assigned to filesystem cephfs as rank 0 2024-04-26T21:33:50.300 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:50 smithi084 ceph-mon[90138]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T21:33:50.300 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:50 smithi084 ceph-mon[90138]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-26T21:33:50.300 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:50 smithi084 ceph-mon[90138]: fsmap cephfs:1/1 {0=cephfs.smithi120.ufqfoh=up:replay} 2 up:standby 2024-04-26T21:33:50.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.297+0000 7ffb58a00700 1 -- 172.21.15.84:0/1836365418 shutdown_connections 2024-04-26T21:33:50.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.297+0000 7ffb58a00700 1 -- 172.21.15.84:0/1836365418 wait complete. 2024-04-26T21:33:50.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.298+0000 7ffb58a00700 1 Processor -- start 2024-04-26T21:33:50.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.298+0000 7ffb58a00700 1 -- start start 2024-04-26T21:33:50.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.298+0000 7ffb58a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb540727c0 0x7ffb54113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:50.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.299+0000 7ffb58a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb54114410 0x7ffb54119440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:50.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.299+0000 7ffb58a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb541148d0 con 0x7ffb54114410 2024-04-26T21:33:50.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.299+0000 7ffb58a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb54114a10 con 0x7ffb540727c0 2024-04-26T21:33:50.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.299+0000 7ffb51400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb54114410 0x7ffb54119440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:50.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.299+0000 7ffb51400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb54114410 0x7ffb54119440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37048/0 (socket says 172.21.15.84:37048) 2024-04-26T21:33:50.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.299+0000 7ffb51e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb540727c0 0x7ffb54113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:50.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.299+0000 7ffb51400700 1 -- 172.21.15.84:0/643023180 learned_addr learned my addr 172.21.15.84:0/643023180 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:33:50.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.299+0000 7ffb51400700 1 -- 172.21.15.84:0/643023180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb540727c0 msgr2=0x7ffb54113ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:50.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.299+0000 7ffb51400700 1 --2- 172.21.15.84:0/643023180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb540727c0 0x7ffb54113ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:50.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.299+0000 7ffb51400700 1 -- 172.21.15.84:0/643023180 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb44005040 con 0x7ffb54114410 2024-04-26T21:33:50.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.300+0000 7ffb51400700 1 --2- 172.21.15.84:0/643023180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb54114410 0x7ffb54119440 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000eb40 tx=0x7ffb4000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:50.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.300+0000 7ffb4a000700 1 -- 172.21.15.84:0/643023180 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb40007cc0 con 0x7ffb54114410 2024-04-26T21:33:50.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.300+0000 7ffb4a000700 1 -- 172.21.15.84:0/643023180 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffb4000f040 con 0x7ffb54114410 2024-04-26T21:33:50.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.300+0000 7ffb58a00700 1 -- 172.21.15.84:0/643023180 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb54119980 con 0x7ffb54114410 2024-04-26T21:33:50.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.300+0000 7ffb4a000700 1 -- 172.21.15.84:0/643023180 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb4000ca10 con 0x7ffb54114410 2024-04-26T21:33:50.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.300+0000 7ffb58a00700 1 -- 172.21.15.84:0/643023180 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb54119e70 con 0x7ffb54114410 2024-04-26T21:33:50.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.302+0000 7ffb58a00700 1 -- 172.21.15.84:0/643023180 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5404c710 con 0x7ffb54114410 2024-04-26T21:33:50.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.303+0000 7ffb4a000700 1 -- 172.21.15.84:0/643023180 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ffb4000cc80 con 0x7ffb54114410 2024-04-26T21:33:50.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.304+0000 7ffb4a000700 1 --2- 172.21.15.84:0/643023180 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ffb3806ec00 0x7ffb380710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:50.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.304+0000 7ffb4a000700 1 -- 172.21.15.84:0/643023180 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6757+0+0 (secure 0 0 0) 0x7ffb4008e620 con 0x7ffb54114410 2024-04-26T21:33:50.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.305+0000 7ffb51e00700 1 --2- 172.21.15.84:0/643023180 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ffb3806ec00 0x7ffb380710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:50.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.305+0000 7ffb51e00700 1 --2- 172.21.15.84:0/643023180 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ffb3806ec00 0x7ffb380710b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffb44013870 tx=0x7ffb44009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:50.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.309+0000 7ffb4a000700 1 -- 172.21.15.84:0/643023180 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7ffb4005ae00 con 0x7ffb54114410 2024-04-26T21:33:50.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:50 smithi120 ceph-mon[79001]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T21:33:50.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:50 smithi120 ceph-mon[79001]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:33:50.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:50 smithi120 ceph-mon[79001]: osdmap e92: 6 total, 6 up, 6 in 2024-04-26T21:33:50.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:50 smithi120 ceph-mon[79001]: Standby daemon mds.cephfs.smithi120.ufqfoh assigned to filesystem cephfs as rank 0 2024-04-26T21:33:50.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:50 smithi120 ceph-mon[79001]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T21:33:50.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:50 smithi120 ceph-mon[79001]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-26T21:33:50.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:50 smithi120 ceph-mon[79001]: fsmap cephfs:1/1 {0=cephfs.smithi120.ufqfoh=up:replay} 2 up:standby 2024-04-26T21:33:50.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.545+0000 7ffb58a00700 1 -- 172.21.15.84:0/643023180 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb5410a460 con 0x7ffb3806ec00 2024-04-26T21:33:50.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.564+0000 7ffb4a000700 1 -- 172.21.15.84:0/643023180 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ffb5410a460 con 0x7ffb3806ec00 2024-04-26T21:33:50.567 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:33:50.567 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (8m) 13s ago 19m 14.9M - 0.25.0 c8568f914cd2 bcb419cf9108 2024-04-26T21:33:50.567 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (4m) 13s ago 19m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 b4010dfbe623 2024-04-26T21:33:50.567 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (4m) 78s ago 18m 6665k - 19.0.0-3306-gbc612ffb 55dc54019ad8 89a4e50ea23c 2024-04-26T21:33:50.567 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (8m) 13s ago 19m 74.6M - 9.4.7 954c08fa6188 1bf95f604e07 2024-04-26T21:33:50.567 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (23s) 13s ago 12m 11.0M - 19.0.0-3306-gbc612ffb 55dc54019ad8 26d10fe664bb 2024-04-26T21:33:50.567 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (12m) 13s ago 12m 64.6M - 17.2.7-907-g2be3efa9 1c5834633715 f4077993180c 2024-04-26T21:33:50.567 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (12m) 78s ago 12m 113M - 17.2.7-907-g2be3efa9 1c5834633715 9df3e61d691a 2024-04-26T21:33:50.567 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (12m) 78s ago 12m 14.6M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:33:50.568 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (8m) 13s ago 21m 510M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:33:50.568 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283,8765 running (6m) 78s ago 18m 454M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d6ae0b4628b5 2024-04-26T21:33:50.568 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (6m) 13s ago 21m 52.1M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 bf610abb6a62 2024-04-26T21:33:50.568 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (5m) 78s ago 18m 36.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 5d530496253b 2024-04-26T21:33:50.568 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (8m) 13s ago 19m 8182k - 1.5.0 0da6a335fe13 81e00b40bfbf 2024-04-26T21:33:50.568 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (8m) 78s ago 18m 7541k - 1.5.0 0da6a335fe13 0506a1d46ec4 2024-04-26T21:33:50.568 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (4m) 13s ago 17m 112M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 99fbe2faa51b 2024-04-26T21:33:50.568 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (3m) 13s ago 16m 95.3M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 2dc81d93f7e5 2024-04-26T21:33:50.568 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (3m) 13s ago 16m 88.7M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 9e77abf095bd 2024-04-26T21:33:50.568 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (2m) 78s ago 15m 83.1M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 d7e5825e2640 2024-04-26T21:33:50.568 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (111s) 78s ago 14m 80.2M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 894dcbaab8eb 2024-04-26T21:33:50.568 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (83s) 78s ago 14m 11.2M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 e39948e51a13 2024-04-26T21:33:50.568 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (6m) 13s ago 18m 59.6M - 2.43.0 a07b618ecd1d d3008b765eec 2024-04-26T21:33:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.568+0000 7ffb58a00700 1 -- 172.21.15.84:0/643023180 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ffb3806ec00 msgr2=0x7ffb380710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.568+0000 7ffb58a00700 1 --2- 172.21.15.84:0/643023180 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ffb3806ec00 0x7ffb380710b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffb44013870 tx=0x7ffb44009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.568+0000 7ffb58a00700 1 -- 172.21.15.84:0/643023180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb54114410 msgr2=0x7ffb54119440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:50.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.568+0000 7ffb58a00700 1 --2- 172.21.15.84:0/643023180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb54114410 0x7ffb54119440 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000eb40 tx=0x7ffb4000b040 comp rx=0 tx=0).stop 2024-04-26T21:33:50.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.568+0000 7ffb58a00700 1 -- 172.21.15.84:0/643023180 shutdown_connections 2024-04-26T21:33:50.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.568+0000 7ffb58a00700 1 --2- 172.21.15.84:0/643023180 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ffb3806ec00 0x7ffb380710b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:50.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.568+0000 7ffb58a00700 1 --2- 172.21.15.84:0/643023180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb540727c0 0x7ffb54113ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:50.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.568+0000 7ffb58a00700 1 --2- 172.21.15.84:0/643023180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb54114410 0x7ffb54119440 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:50.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.568+0000 7ffb58a00700 1 -- 172.21.15.84:0/643023180 >> 172.21.15.84:0/643023180 conn(0x7ffb540fa8f0 msgr2=0x7ffb540fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:50.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.568+0000 7ffb58a00700 1 -- 172.21.15.84:0/643023180 shutdown_connections 2024-04-26T21:33:50.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.568+0000 7ffb58a00700 1 -- 172.21.15.84:0/643023180 wait complete. 2024-04-26T21:33:50.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.722+0000 7fec7dc00700 1 -- 172.21.15.84:0/965899421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec78103230 msgr2=0x7fec78103640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:50.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.722+0000 7fec7dc00700 1 --2- 172.21.15.84:0/965899421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec78103230 0x7fec78103640 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fec68004940 tx=0x7fec68009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:50.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.722+0000 7fec7dc00700 1 -- 172.21.15.84:0/965899421 shutdown_connections 2024-04-26T21:33:50.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.722+0000 7fec7dc00700 1 --2- 172.21.15.84:0/965899421 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec781044e0 0x7fec78104950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:50.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.722+0000 7fec7dc00700 1 --2- 172.21.15.84:0/965899421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec78103230 0x7fec78103640 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:50.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.722+0000 7fec7dc00700 1 -- 172.21.15.84:0/965899421 >> 172.21.15.84:0/965899421 conn(0x7fec780724d0 msgr2=0x7fec780748e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:50.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.722+0000 7fec7dc00700 1 -- 172.21.15.84:0/965899421 shutdown_connections 2024-04-26T21:33:50.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.723+0000 7fec7dc00700 1 -- 172.21.15.84:0/965899421 wait complete. 2024-04-26T21:33:50.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.723+0000 7fec7dc00700 1 Processor -- start 2024-04-26T21:33:50.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.723+0000 7fec7dc00700 1 -- start start 2024-04-26T21:33:50.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.724+0000 7fec7dc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec78103230 0x7fec78113e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:50.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.724+0000 7fec7dc00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec781044e0 0x7fec78114350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:50.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.724+0000 7fec7dc00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec781150f0 con 0x7fec781044e0 2024-04-26T21:33:50.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.724+0000 7fec7dc00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec78115260 con 0x7fec78103230 2024-04-26T21:33:50.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.724+0000 7fec77400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec781044e0 0x7fec78114350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:50.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.724+0000 7fec77400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec781044e0 0x7fec78114350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37070/0 (socket says 172.21.15.84:37070) 2024-04-26T21:33:50.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.724+0000 7fec77400700 1 -- 172.21.15.84:0/3129089249 learned_addr learned my addr 172.21.15.84:0/3129089249 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:33:50.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.724+0000 7fec77e00700 1 --2- 172.21.15.84:0/3129089249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec78103230 0x7fec78113e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:50.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.725+0000 7fec77400700 1 -- 172.21.15.84:0/3129089249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec78103230 msgr2=0x7fec78113e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:50.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.725+0000 7fec77400700 1 --2- 172.21.15.84:0/3129089249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec78103230 0x7fec78113e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:50.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.725+0000 7fec77400700 1 -- 172.21.15.84:0/3129089249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec68005040 con 0x7fec781044e0 2024-04-26T21:33:50.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.725+0000 7fec77e00700 1 --2- 172.21.15.84:0/3129089249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec78103230 0x7fec78113e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:33:50.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.725+0000 7fec77400700 1 --2- 172.21.15.84:0/3129089249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec781044e0 0x7fec78114350 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fec6400eb40 tx=0x7fec6400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:50.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.725+0000 7fec6fe00700 1 -- 172.21.15.84:0/3129089249 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec64007cc0 con 0x7fec781044e0 2024-04-26T21:33:50.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.725+0000 7fec6fe00700 1 -- 172.21.15.84:0/3129089249 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec6400f040 con 0x7fec781044e0 2024-04-26T21:33:50.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.725+0000 7fec7dc00700 1 -- 172.21.15.84:0/3129089249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec781154e0 con 0x7fec781044e0 2024-04-26T21:33:50.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.725+0000 7fec6fe00700 1 -- 172.21.15.84:0/3129089249 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec6400ca10 con 0x7fec781044e0 2024-04-26T21:33:50.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.725+0000 7fec7dc00700 1 -- 172.21.15.84:0/3129089249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec78115a20 con 0x7fec781044e0 2024-04-26T21:33:50.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.726+0000 7fec7dc00700 1 -- 172.21.15.84:0/3129089249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec7810c530 con 0x7fec781044e0 2024-04-26T21:33:50.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.728+0000 7fec6fe00700 1 -- 172.21.15.84:0/3129089249 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fec6400cb70 con 0x7fec781044e0 2024-04-26T21:33:50.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.729+0000 7fec6fe00700 1 --2- 172.21.15.84:0/3129089249 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fec5c06ec00 0x7fec5c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:50.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.729+0000 7fec6fe00700 1 -- 172.21.15.84:0/3129089249 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fec6408e520 con 0x7fec781044e0 2024-04-26T21:33:50.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.729+0000 7fec77e00700 1 --2- 172.21.15.84:0/3129089249 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fec5c06ec00 0x7fec5c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:50.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.730+0000 7fec77e00700 1 --2- 172.21.15.84:0/3129089249 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fec5c06ec00 0x7fec5c0710b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fec68013870 tx=0x7fec68009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:50.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:50.734+0000 7fec6fe00700 1 -- 172.21.15.84:0/3129089249 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fec64057250 con 0x7fec781044e0 2024-04-26T21:33:51.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.049+0000 7fec7dc00700 1 -- 172.21.15.84:0/3129089249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fec7804bed0 con 0x7fec781044e0 2024-04-26T21:33:51.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.050+0000 7fec6fe00700 1 -- 172.21.15.84:0/3129089249 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fec6405a910 con 0x7fec781044e0 2024-04-26T21:33:51.052 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:33:51.052 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:33:51.052 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:33:51.052 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:33:51.052 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:33:51.052 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:33:51.052 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:33:51.052 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:33:51.052 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 6 2024-04-26T21:33:51.052 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:33:51.052 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:33:51.052 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2, 2024-04-26T21:33:51.053 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 1 2024-04-26T21:33:51.053 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:33:51.053 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:33:51.053 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2, 2024-04-26T21:33:51.053 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 11 2024-04-26T21:33:51.053 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:33:51.053 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:33:51.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.053+0000 7fec7dc00700 1 -- 172.21.15.84:0/3129089249 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fec5c06ec00 msgr2=0x7fec5c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:51.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.053+0000 7fec7dc00700 1 --2- 172.21.15.84:0/3129089249 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fec5c06ec00 0x7fec5c0710b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fec68013870 tx=0x7fec68009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:51.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.053+0000 7fec7dc00700 1 -- 172.21.15.84:0/3129089249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec781044e0 msgr2=0x7fec78114350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:51.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.053+0000 7fec7dc00700 1 --2- 172.21.15.84:0/3129089249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec781044e0 0x7fec78114350 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fec6400eb40 tx=0x7fec6400b040 comp rx=0 tx=0).stop 2024-04-26T21:33:51.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.053+0000 7fec7dc00700 1 -- 172.21.15.84:0/3129089249 shutdown_connections 2024-04-26T21:33:51.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.053+0000 7fec7dc00700 1 --2- 172.21.15.84:0/3129089249 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fec5c06ec00 0x7fec5c0710b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:51.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.053+0000 7fec7dc00700 1 --2- 172.21.15.84:0/3129089249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec78103230 0x7fec78113e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:51.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.053+0000 7fec7dc00700 1 --2- 172.21.15.84:0/3129089249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec781044e0 0x7fec78114350 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:51.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.053+0000 7fec7dc00700 1 -- 172.21.15.84:0/3129089249 >> 172.21.15.84:0/3129089249 conn(0x7fec780724d0 msgr2=0x7fec78074b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:51.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.054+0000 7fec7dc00700 1 -- 172.21.15.84:0/3129089249 shutdown_connections 2024-04-26T21:33:51.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.054+0000 7fec7dc00700 1 -- 172.21.15.84:0/3129089249 wait complete. 2024-04-26T21:33:51.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.204+0000 7fe85a600700 1 -- 172.21.15.84:0/3860142829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8541002a0 msgr2=0x7fe854100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:51.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.204+0000 7fe85a600700 1 --2- 172.21.15.84:0/3860142829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8541002a0 0x7fe854100710 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009ce0 tx=0x7fe83c004d10 comp rx=0 tx=0).stop 2024-04-26T21:33:51.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.204+0000 7fe85a600700 1 -- 172.21.15.84:0/3860142829 shutdown_connections 2024-04-26T21:33:51.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.204+0000 7fe85a600700 1 --2- 172.21.15.84:0/3860142829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8541002a0 0x7fe854100710 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:51.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.204+0000 7fe85a600700 1 --2- 172.21.15.84:0/3860142829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8540feff0 0x7fe8540ff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:51.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.204+0000 7fe85a600700 1 -- 172.21.15.84:0/3860142829 >> 172.21.15.84:0/3860142829 conn(0x7fe8540fa8f0 msgr2=0x7fe8540fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:51.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.205+0000 7fe85a600700 1 -- 172.21.15.84:0/3860142829 shutdown_connections 2024-04-26T21:33:51.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.205+0000 7fe85a600700 1 -- 172.21.15.84:0/3860142829 wait complete. 2024-04-26T21:33:51.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.205+0000 7fe85a600700 1 Processor -- start 2024-04-26T21:33:51.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.206+0000 7fe85a600700 1 -- start start 2024-04-26T21:33:51.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.206+0000 7fe85a600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8540feff0 0x7fe85410fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:51.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.206+0000 7fe85a600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8541002a0 0x7fe854110220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:51.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.206+0000 7fe85a600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8541108a0 con 0x7fe8541002a0 2024-04-26T21:33:51.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.206+0000 7fe85a600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe854115240 con 0x7fe8540feff0 2024-04-26T21:33:51.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.206+0000 7fe84aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8541002a0 0x7fe854110220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:51.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.206+0000 7fe84aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8541002a0 0x7fe854110220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37090/0 (socket says 172.21.15.84:37090) 2024-04-26T21:33:51.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.206+0000 7fe84aa00700 1 -- 172.21.15.84:0/3780833170 learned_addr learned my addr 172.21.15.84:0/3780833170 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:33:51.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.206+0000 7fe853400700 1 --2- 172.21.15.84:0/3780833170 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8540feff0 0x7fe85410fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:51.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.206+0000 7fe84aa00700 1 -- 172.21.15.84:0/3780833170 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8540feff0 msgr2=0x7fe85410fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:51.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.206+0000 7fe84aa00700 1 --2- 172.21.15.84:0/3780833170 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8540feff0 0x7fe85410fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:51.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.207+0000 7fe84aa00700 1 -- 172.21.15.84:0/3780833170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c009940 con 0x7fe8541002a0 2024-04-26T21:33:51.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.207+0000 7fe84aa00700 1 --2- 172.21.15.84:0/3780833170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8541002a0 0x7fe854110220 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe83c005010 tx=0x7fe83c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:51.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.207+0000 7fe84be00700 1 -- 172.21.15.84:0/3780833170 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe83c00e040 con 0x7fe8541002a0 2024-04-26T21:33:51.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.207+0000 7fe84be00700 1 -- 172.21.15.84:0/3780833170 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe83c008ed0 con 0x7fe8541002a0 2024-04-26T21:33:51.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.207+0000 7fe84be00700 1 -- 172.21.15.84:0/3780833170 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe83c01c870 con 0x7fe8541002a0 2024-04-26T21:33:51.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.207+0000 7fe85a600700 1 -- 172.21.15.84:0/3780833170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8541153e0 con 0x7fe8541002a0 2024-04-26T21:33:51.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.207+0000 7fe85a600700 1 -- 172.21.15.84:0/3780833170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe854115950 con 0x7fe8541002a0 2024-04-26T21:33:51.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.208+0000 7fe85a600700 1 -- 172.21.15.84:0/3780833170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe85404c710 con 0x7fe8541002a0 2024-04-26T21:33:51.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.209+0000 7fe84be00700 1 -- 172.21.15.84:0/3780833170 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe83c012c70 con 0x7fe8541002a0 2024-04-26T21:33:51.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.210+0000 7fe84be00700 1 --2- 172.21.15.84:0/3780833170 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe83806ec00 0x7fe8380710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:51.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.210+0000 7fe84be00700 1 -- 172.21.15.84:0/3780833170 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fe83c090540 con 0x7fe8541002a0 2024-04-26T21:33:51.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.211+0000 7fe853400700 1 --2- 172.21.15.84:0/3780833170 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe83806ec00 0x7fe8380710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:51.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.211+0000 7fe853400700 1 --2- 172.21.15.84:0/3780833170 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe83806ec00 0x7fe8380710b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe8540fe3a0 tx=0x7fe844009ee0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:51.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.215+0000 7fe84be00700 1 -- 172.21.15.84:0/3780833170 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fe83c0591c0 con 0x7fe8541002a0 2024-04-26T21:33:51.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:51 smithi084 ceph-mon[90138]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:33:51.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:51 smithi084 ceph-mon[90138]: pgmap v229: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:33:51.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:51 smithi084 ceph-mon[90138]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:33:51.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:51 smithi084 ceph-mon[90138]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:33:51.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:51 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3129089249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:51 smithi120 ceph-mon[79001]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:33:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:51 smithi120 ceph-mon[79001]: pgmap v229: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:33:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:51 smithi120 ceph-mon[79001]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:33:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:51 smithi120 ceph-mon[79001]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:33:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:51 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3129089249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:33:51.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.498+0000 7fe85a600700 1 -- 172.21.15.84:0/3780833170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe854115e10 con 0x7fe8541002a0 2024-04-26T21:33:51.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.499+0000 7fe84be00700 1 -- 172.21.15.84:0/3780833170 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1707 (secure 0 0 0) 0x7fe83c004e30 con 0x7fe8541002a0 2024-04-26T21:33:51.501 INFO:teuthology.orchestra.run.smithi084.stdout:e30 2024-04-26T21:33:51.501 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:33:51.501 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:33:51.501 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:33:51.501 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:33:51.501 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:33:51.501 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:33:51.501 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 30 2024-04-26T21:33:51.501 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:33:51.502 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:33:51.502 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:33:49.986203+0000 2024-04-26T21:33:51.502 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:33:51.502 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:33:51.502 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:33:51.502 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:33:51.502 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:33:51.502 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-04-26T21:33:51.502 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:33:51.502 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:33:51.502 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 92 2024-04-26T21:33:51.502 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:33:51.502 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 1 2024-04-26T21:33:51.502 INFO:teuthology.orchestra.run.smithi084.stdout:in 0 2024-04-26T21:33:51.503 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24237} 2024-04-26T21:33:51.503 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:33:51.503 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:33:51.503 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 1 2024-04-26T21:33:51.503 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:33:51.503 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:33:51.503 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:33:51.503 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:33:51.503 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-04-26T21:33:51.503 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:33:51.503 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 0 members: 2024-04-26T21:33:51.503 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{0:24237} state up:replay seq 2 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:33:51.503 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:33:51.503 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:33:51.504 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:33:51.504 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:33:51.504 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{-1:34446} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.84:6826/1392878113,v1:172.21.15.84:6827/1392878113] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:33:51.504 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{-1:44247} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.120:6824/4163804141,v1:172.21.15.120:6825/4163804141] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:33:51.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.502+0000 7fe85a600700 1 -- 172.21.15.84:0/3780833170 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe83806ec00 msgr2=0x7fe8380710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:51.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.502+0000 7fe85a600700 1 --2- 172.21.15.84:0/3780833170 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe83806ec00 0x7fe8380710b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe8540fe3a0 tx=0x7fe844009ee0 comp rx=0 tx=0).stop 2024-04-26T21:33:51.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.502+0000 7fe85a600700 1 -- 172.21.15.84:0/3780833170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8541002a0 msgr2=0x7fe854110220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:51.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.502+0000 7fe85a600700 1 --2- 172.21.15.84:0/3780833170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8541002a0 0x7fe854110220 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe83c005010 tx=0x7fe83c004d10 comp rx=0 tx=0).stop 2024-04-26T21:33:51.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.502+0000 7fe85a600700 1 -- 172.21.15.84:0/3780833170 shutdown_connections 2024-04-26T21:33:51.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.502+0000 7fe85a600700 1 --2- 172.21.15.84:0/3780833170 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe83806ec00 0x7fe8380710b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:51.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.502+0000 7fe85a600700 1 --2- 172.21.15.84:0/3780833170 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8540feff0 0x7fe85410fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:51.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.502+0000 7fe85a600700 1 --2- 172.21.15.84:0/3780833170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8541002a0 0x7fe854110220 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:51.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.502+0000 7fe85a600700 1 -- 172.21.15.84:0/3780833170 >> 172.21.15.84:0/3780833170 conn(0x7fe8540fa8f0 msgr2=0x7fe8540fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:51.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.502+0000 7fe85a600700 1 -- 172.21.15.84:0/3780833170 shutdown_connections 2024-04-26T21:33:51.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.502+0000 7fe85a600700 1 -- 172.21.15.84:0/3780833170 wait complete. 2024-04-26T21:33:51.506 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 30 2024-04-26T21:33:51.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.645+0000 7f6cea600700 1 -- 172.21.15.84:0/2425215533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce40fcf10 msgr2=0x7f6ce40fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:51.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.645+0000 7f6cea600700 1 --2- 172.21.15.84:0/2425215533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce40fcf10 0x7f6ce40fd320 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4004940 tx=0x7f6cd4009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:51.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.645+0000 7f6cea600700 1 -- 172.21.15.84:0/2425215533 shutdown_connections 2024-04-26T21:33:51.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.645+0000 7f6cea600700 1 --2- 172.21.15.84:0/2425215533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ce40fe080 0x7f6ce40fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:51.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.645+0000 7f6cea600700 1 --2- 172.21.15.84:0/2425215533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce40fcf10 0x7f6ce40fd320 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:51.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.645+0000 7f6cea600700 1 -- 172.21.15.84:0/2425215533 >> 172.21.15.84:0/2425215533 conn(0x7f6ce40f8560 msgr2=0x7f6ce40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:51.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.645+0000 7f6cea600700 1 -- 172.21.15.84:0/2425215533 shutdown_connections 2024-04-26T21:33:51.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.645+0000 7f6cea600700 1 -- 172.21.15.84:0/2425215533 wait complete. 2024-04-26T21:33:51.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.646+0000 7f6cea600700 1 Processor -- start 2024-04-26T21:33:51.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.646+0000 7f6cea600700 1 -- start start 2024-04-26T21:33:51.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.647+0000 7f6cea600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ce40fcf10 0x7f6ce4071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:51.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.647+0000 7f6cea600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce40fe080 0x7f6ce40702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:51.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.647+0000 7f6cea600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce4070860 con 0x7f6ce40fe080 2024-04-26T21:33:51.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.647+0000 7f6cea600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40709d0 con 0x7f6ce40fcf10 2024-04-26T21:33:51.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.647+0000 7f6ce2a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce40fe080 0x7f6ce40702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:51.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.647+0000 7f6ce2a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce40fe080 0x7f6ce40702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37110/0 (socket says 172.21.15.84:37110) 2024-04-26T21:33:51.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.647+0000 7f6ce2a00700 1 -- 172.21.15.84:0/4113777634 learned_addr learned my addr 172.21.15.84:0/4113777634 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:33:51.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.647+0000 7f6ce3400700 1 --2- 172.21.15.84:0/4113777634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ce40fcf10 0x7f6ce4071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:51.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.647+0000 7f6ce2a00700 1 -- 172.21.15.84:0/4113777634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ce40fcf10 msgr2=0x7f6ce4071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:51.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.647+0000 7f6ce2a00700 1 --2- 172.21.15.84:0/4113777634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ce40fcf10 0x7f6ce4071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:51.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.647+0000 7f6ce2a00700 1 -- 172.21.15.84:0/4113777634 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd4005040 con 0x7f6ce40fe080 2024-04-26T21:33:51.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.648+0000 7f6ce2a00700 1 --2- 172.21.15.84:0/4113777634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce40fe080 0x7f6ce40702b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000eb40 tx=0x7f6cd000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:51.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.648+0000 7f6cdb400700 1 -- 172.21.15.84:0/4113777634 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cd0007cc0 con 0x7f6ce40fe080 2024-04-26T21:33:51.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.648+0000 7f6cdb400700 1 -- 172.21.15.84:0/4113777634 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6cd000f040 con 0x7f6ce40fe080 2024-04-26T21:33:51.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.648+0000 7f6cdb400700 1 -- 172.21.15.84:0/4113777634 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cd0009620 con 0x7f6ce40fe080 2024-04-26T21:33:51.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.648+0000 7f6cea600700 1 -- 172.21.15.84:0/4113777634 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce4070c50 con 0x7f6ce40fe080 2024-04-26T21:33:51.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.648+0000 7f6cea600700 1 -- 172.21.15.84:0/4113777634 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce4115990 con 0x7f6ce40fe080 2024-04-26T21:33:51.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.649+0000 7f6cea600700 1 -- 172.21.15.84:0/4113777634 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce405f5c0 con 0x7f6ce40fe080 2024-04-26T21:33:51.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.650+0000 7f6cdb400700 1 -- 172.21.15.84:0/4113777634 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6cd0009780 con 0x7f6ce40fe080 2024-04-26T21:33:51.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.651+0000 7f6cdb400700 1 --2- 172.21.15.84:0/4113777634 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6cc806ec00 0x7f6cc80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:51.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.652+0000 7f6cdb400700 1 -- 172.21.15.84:0/4113777634 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f6cd008e590 con 0x7f6ce40fe080 2024-04-26T21:33:51.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.652+0000 7f6ce3400700 1 --2- 172.21.15.84:0/4113777634 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6cc806ec00 0x7f6cc80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:51.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.652+0000 7f6ce3400700 1 --2- 172.21.15.84:0/4113777634 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6cc806ec00 0x7f6cc80710b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4004890 tx=0x7f6cd4009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:51.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.656+0000 7f6cdb400700 1 -- 172.21.15.84:0/4113777634 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f6cd0057360 con 0x7f6ce40fe080 2024-04-26T21:33:51.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.907+0000 7f6cea600700 1 -- 172.21.15.84:0/4113777634 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ce4102320 con 0x7f6cc806ec00 2024-04-26T21:33:51.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.909+0000 7f6cdb400700 1 -- 172.21.15.84:0/4113777634 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6ce4102320 con 0x7f6cc806ec00 2024-04-26T21:33:51.911 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:33:51.911 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:33:51.911 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:33:51.911 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:33:51.911 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-04-26T21:33:51.912 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr", 2024-04-26T21:33:51.912 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-04-26T21:33:51.912 INFO:teuthology.orchestra.run.smithi084.stdout: "osd", 2024-04-26T21:33:51.912 INFO:teuthology.orchestra.run.smithi084.stdout: "crash" 2024-04-26T21:33:51.912 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-04-26T21:33:51.912 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "13/21 daemons upgraded", 2024-04-26T21:33:51.912 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading mds daemons", 2024-04-26T21:33:51.912 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:33:51.912 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:33:51.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.912+0000 7f6cea600700 1 -- 172.21.15.84:0/4113777634 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6cc806ec00 msgr2=0x7f6cc80710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:51.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.912+0000 7f6cea600700 1 --2- 172.21.15.84:0/4113777634 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6cc806ec00 0x7f6cc80710b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4004890 tx=0x7f6cd4009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:51.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.912+0000 7f6cea600700 1 -- 172.21.15.84:0/4113777634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce40fe080 msgr2=0x7f6ce40702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:51.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.912+0000 7f6cea600700 1 --2- 172.21.15.84:0/4113777634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce40fe080 0x7f6ce40702b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000eb40 tx=0x7f6cd000b040 comp rx=0 tx=0).stop 2024-04-26T21:33:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.912+0000 7f6cea600700 1 -- 172.21.15.84:0/4113777634 shutdown_connections 2024-04-26T21:33:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.912+0000 7f6cea600700 1 --2- 172.21.15.84:0/4113777634 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6cc806ec00 0x7f6cc80710b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.912+0000 7f6cea600700 1 --2- 172.21.15.84:0/4113777634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ce40fcf10 0x7f6ce4071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.912+0000 7f6cea600700 1 --2- 172.21.15.84:0/4113777634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce40fe080 0x7f6ce40702b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.912+0000 7f6cea600700 1 -- 172.21.15.84:0/4113777634 >> 172.21.15.84:0/4113777634 conn(0x7f6ce40f8560 msgr2=0x7f6ce40f9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.913+0000 7f6cea600700 1 -- 172.21.15.84:0/4113777634 shutdown_connections 2024-04-26T21:33:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:51.913+0000 7f6cea600700 1 -- 172.21.15.84:0/4113777634 wait complete. 2024-04-26T21:33:52.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.055+0000 7fc433e00700 1 -- 172.21.15.84:0/110627933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4340fee80 msgr2=0x7fc4340ff290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:52.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.055+0000 7fc433e00700 1 --2- 172.21.15.84:0/110627933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4340fee80 0x7fc4340ff290 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc424004940 tx=0x7fc424009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:52.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.055+0000 7fc433e00700 1 -- 172.21.15.84:0/110627933 shutdown_connections 2024-04-26T21:33:52.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.055+0000 7fc433e00700 1 --2- 172.21.15.84:0/110627933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc434100080 0x7fc4341004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:52.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.055+0000 7fc433e00700 1 --2- 172.21.15.84:0/110627933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4340fee80 0x7fc4340ff290 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:52.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.055+0000 7fc433e00700 1 -- 172.21.15.84:0/110627933 >> 172.21.15.84:0/110627933 conn(0x7fc4340fa730 msgr2=0x7fc4340fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:52.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.055+0000 7fc433e00700 1 -- 172.21.15.84:0/110627933 shutdown_connections 2024-04-26T21:33:52.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.055+0000 7fc433e00700 1 -- 172.21.15.84:0/110627933 wait complete. 2024-04-26T21:33:52.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.056+0000 7fc433e00700 1 Processor -- start 2024-04-26T21:33:52.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.056+0000 7fc433e00700 1 -- start start 2024-04-26T21:33:52.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.057+0000 7fc433e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4340fee80 0x7fc43410fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:52.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.057+0000 7fc433e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc434100080 0x7fc43410ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:52.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.057+0000 7fc433e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc434110610 con 0x7fc4340fee80 2024-04-26T21:33:52.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.057+0000 7fc433e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc434110e00 con 0x7fc434100080 2024-04-26T21:33:52.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.057+0000 7fc432a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4340fee80 0x7fc43410fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:52.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.057+0000 7fc432a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4340fee80 0x7fc43410fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42750/0 (socket says 172.21.15.84:42750) 2024-04-26T21:33:52.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.057+0000 7fc432a00700 1 -- 172.21.15.84:0/3536318969 learned_addr learned my addr 172.21.15.84:0/3536318969 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:33:52.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.057+0000 7fc432000700 1 --2- 172.21.15.84:0/3536318969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc434100080 0x7fc43410ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:52.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.057+0000 7fc432a00700 1 -- 172.21.15.84:0/3536318969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc434100080 msgr2=0x7fc43410ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:52.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.057+0000 7fc432a00700 1 --2- 172.21.15.84:0/3536318969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc434100080 0x7fc43410ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:52.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.057+0000 7fc432a00700 1 -- 172.21.15.84:0/3536318969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc424005040 con 0x7fc4340fee80 2024-04-26T21:33:52.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.058+0000 7fc432a00700 1 --2- 172.21.15.84:0/3536318969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4340fee80 0x7fc43410fa40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc42400b970 tx=0x7fc424009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:52.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.058+0000 7fc42aa00700 1 -- 172.21.15.84:0/3536318969 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc42400e040 con 0x7fc4340fee80 2024-04-26T21:33:52.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.058+0000 7fc42aa00700 1 -- 172.21.15.84:0/3536318969 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc424004290 con 0x7fc4340fee80 2024-04-26T21:33:52.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.058+0000 7fc433e00700 1 -- 172.21.15.84:0/3536318969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc434111080 con 0x7fc4340fee80 2024-04-26T21:33:52.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.058+0000 7fc42aa00700 1 -- 172.21.15.84:0/3536318969 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc42401c630 con 0x7fc4340fee80 2024-04-26T21:33:52.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.058+0000 7fc433e00700 1 -- 172.21.15.84:0/3536318969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc434111640 con 0x7fc4340fee80 2024-04-26T21:33:52.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.059+0000 7fc433e00700 1 -- 172.21.15.84:0/3536318969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4340fe230 con 0x7fc4340fee80 2024-04-26T21:33:52.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.060+0000 7fc42aa00700 1 -- 172.21.15.84:0/3536318969 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc42400bbf0 con 0x7fc4340fee80 2024-04-26T21:33:52.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.061+0000 7fc42aa00700 1 --2- 172.21.15.84:0/3536318969 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc41806ec00 0x7fc4180710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:52.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.061+0000 7fc42aa00700 1 -- 172.21.15.84:0/3536318969 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fc42408fdd0 con 0x7fc4340fee80 2024-04-26T21:33:52.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.061+0000 7fc432000700 1 --2- 172.21.15.84:0/3536318969 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc41806ec00 0x7fc4180710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:52.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.062+0000 7fc432000700 1 --2- 172.21.15.84:0/3536318969 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc41806ec00 0x7fc4180710b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc420006fd0 tx=0x7fc420008040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:52.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.066+0000 7fc42aa00700 1 -- 172.21.15.84:0/3536318969 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fc42405c580 con 0x7fc4340fee80 2024-04-26T21:33:52.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:52 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3780833170' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:33:52.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:52 smithi084 ceph-mon[90138]: pgmap v231: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-04-26T21:33:52.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:52 smithi084 ceph-mon[90138]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:33:52.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.381+0000 7fc433e00700 1 -- 172.21.15.84:0/3536318969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc4341119c0 con 0x7fc4340fee80 2024-04-26T21:33:52.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.382+0000 7fc42aa00700 1 -- 172.21.15.84:0/3536318969 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+297 (secure 0 0 0) 0x7fc424013e60 con 0x7fc4340fee80 2024-04-26T21:33:52.384 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-04-26T21:33:52.384 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-26T21:33:52.384 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs is degraded 2024-04-26T21:33:52.384 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:33:52.384 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:33:52.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.385+0000 7fc433e00700 1 -- 172.21.15.84:0/3536318969 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc41806ec00 msgr2=0x7fc4180710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:52.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.385+0000 7fc433e00700 1 --2- 172.21.15.84:0/3536318969 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc41806ec00 0x7fc4180710b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc420006fd0 tx=0x7fc420008040 comp rx=0 tx=0).stop 2024-04-26T21:33:52.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.385+0000 7fc433e00700 1 -- 172.21.15.84:0/3536318969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4340fee80 msgr2=0x7fc43410fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:33:52.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.385+0000 7fc433e00700 1 --2- 172.21.15.84:0/3536318969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4340fee80 0x7fc43410fa40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc42400b970 tx=0x7fc424009e30 comp rx=0 tx=0).stop 2024-04-26T21:33:52.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.385+0000 7fc433e00700 1 -- 172.21.15.84:0/3536318969 shutdown_connections 2024-04-26T21:33:52.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.385+0000 7fc433e00700 1 --2- 172.21.15.84:0/3536318969 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc41806ec00 0x7fc4180710b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:52.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.385+0000 7fc433e00700 1 --2- 172.21.15.84:0/3536318969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4340fee80 0x7fc43410fa40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:52.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.385+0000 7fc433e00700 1 --2- 172.21.15.84:0/3536318969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc434100080 0x7fc43410ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:52.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.386+0000 7fc433e00700 1 -- 172.21.15.84:0/3536318969 >> 172.21.15.84:0/3536318969 conn(0x7fc4340fa730 msgr2=0x7fc4340fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:33:52.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.386+0000 7fc433e00700 1 -- 172.21.15.84:0/3536318969 shutdown_connections 2024-04-26T21:33:52.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:33:52.386+0000 7fc433e00700 1 -- 172.21.15.84:0/3536318969 wait complete. 2024-04-26T21:33:52.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:52 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3780833170' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:33:52.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:52 smithi120 ceph-mon[79001]: pgmap v231: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-04-26T21:33:52.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:52 smithi120 ceph-mon[79001]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:33:53.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:53 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3536318969' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:33:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:53 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3536318969' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:33:54.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:54 smithi084 ceph-mon[90138]: pgmap v232: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 3 op/s 2024-04-26T21:33:54.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:54 smithi120 ceph-mon[79001]: pgmap v232: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 3 op/s 2024-04-26T21:33:56.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:56 smithi084 ceph-mon[90138]: reconnect by client.24273 192.168.0.1:0/1517871093 after 0.00199996 2024-04-26T21:33:56.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:56 smithi084 ceph-mon[90138]: reconnect by client.14520 192.168.0.1:0/2483101042 after 0.00299994 2024-04-26T21:33:56.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:56 smithi084 ceph-mon[90138]: mds.? [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] up:reconnect 2024-04-26T21:33:56.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:56 smithi084 ceph-mon[90138]: fsmap cephfs:1/1 {0=cephfs.smithi120.ufqfoh=up:reconnect} 2 up:standby 2024-04-26T21:33:56.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:56.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:56.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:33:56.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:56 smithi084 ceph-mon[90138]: pgmap v233: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-26T21:33:56.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:56 smithi120 ceph-mon[79001]: reconnect by client.24273 192.168.0.1:0/1517871093 after 0.00199996 2024-04-26T21:33:56.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:56 smithi120 ceph-mon[79001]: reconnect by client.14520 192.168.0.1:0/2483101042 after 0.00299994 2024-04-26T21:33:56.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:56 smithi120 ceph-mon[79001]: mds.? [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] up:reconnect 2024-04-26T21:33:56.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:56 smithi120 ceph-mon[79001]: fsmap cephfs:1/1 {0=cephfs.smithi120.ufqfoh=up:reconnect} 2 up:standby 2024-04-26T21:33:56.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:56.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:33:56.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:33:56.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:56 smithi120 ceph-mon[79001]: pgmap v233: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-26T21:33:57.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:57 smithi084 ceph-mon[90138]: mds.? [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] up:rejoin 2024-04-26T21:33:57.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:57 smithi084 ceph-mon[90138]: mds.? [v2:172.21.15.84:6828/4015119551,v1:172.21.15.84:6829/4015119551] up:boot 2024-04-26T21:33:57.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:57 smithi084 ceph-mon[90138]: fsmap cephfs:1/1 {0=cephfs.smithi120.ufqfoh=up:rejoin} 3 up:standby 2024-04-26T21:33:57.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:57 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.rtrqtr"}]: dispatch 2024-04-26T21:33:57.663 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:57 smithi084 ceph-mon[90138]: daemon mds.cephfs.smithi120.ufqfoh is now active in filesystem cephfs as rank 0 2024-04-26T21:33:57.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:57 smithi120 ceph-mon[79001]: mds.? [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] up:rejoin 2024-04-26T21:33:57.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:57 smithi120 ceph-mon[79001]: mds.? [v2:172.21.15.84:6828/4015119551,v1:172.21.15.84:6829/4015119551] up:boot 2024-04-26T21:33:57.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:57 smithi120 ceph-mon[79001]: fsmap cephfs:1/1 {0=cephfs.smithi120.ufqfoh=up:rejoin} 3 up:standby 2024-04-26T21:33:57.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:57 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.rtrqtr"}]: dispatch 2024-04-26T21:33:57.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:57 smithi120 ceph-mon[79001]: daemon mds.cephfs.smithi120.ufqfoh is now active in filesystem cephfs as rank 0 2024-04-26T21:33:58.406 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:58 smithi084 ceph-mon[90138]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T21:33:58.407 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:58 smithi084 ceph-mon[90138]: mds.? [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] up:active 2024-04-26T21:33:58.407 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:58 smithi084 ceph-mon[90138]: fsmap cephfs:1 {0=cephfs.smithi120.ufqfoh=up:active} 3 up:standby 2024-04-26T21:33:58.407 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:58 smithi084 ceph-mon[90138]: pgmap v234: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-04-26T21:33:58.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:58 smithi120 ceph-mon[79001]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T21:33:58.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:58 smithi120 ceph-mon[79001]: mds.? [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] up:active 2024-04-26T21:33:58.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:58 smithi120 ceph-mon[79001]: fsmap cephfs:1 {0=cephfs.smithi120.ufqfoh=up:active} 3 up:standby 2024-04-26T21:33:58.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:58 smithi120 ceph-mon[79001]: pgmap v234: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-04-26T21:33:59.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:33:59 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:33:59.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:33:59 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:34:00.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:00 smithi084 ceph-mon[90138]: pgmap v235: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 204 B/s wr, 8 op/s 2024-04-26T21:34:00.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:00 smithi120 ceph-mon[79001]: pgmap v235: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 204 B/s wr, 8 op/s 2024-04-26T21:34:03.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:03 smithi084 ceph-mon[90138]: pgmap v236: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 172 B/s wr, 7 op/s 2024-04-26T21:34:03.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:03 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:03.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:03 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:03.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:03 smithi120 ceph-mon[79001]: pgmap v236: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 172 B/s wr, 7 op/s 2024-04-26T21:34:03.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:03 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:03.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:03 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:05.283 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:05 smithi084 ceph-mon[90138]: pgmap v237: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 7 op/s 2024-04-26T21:34:05.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:05 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:05.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:05 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:05 smithi120 ceph-mon[79001]: pgmap v237: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 7 op/s 2024-04-26T21:34:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:05 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:05.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:05 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:07.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:07 smithi084 ceph-mon[90138]: pgmap v238: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-04-26T21:34:07.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:07 smithi120 ceph-mon[79001]: pgmap v238: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-04-26T21:34:09.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:09 smithi084 ceph-mon[90138]: pgmap v239: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-04-26T21:34:09.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:09 smithi120 ceph-mon[79001]: pgmap v239: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-04-26T21:34:10.859 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:10 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:10.860 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:10 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:10.860 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:10 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:34:10.860 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:10 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:34:10.860 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:10 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:10.860 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:10 smithi120 ceph-mon[79001]: pgmap v240: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 686 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-04-26T21:34:10.860 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:10 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:34:10.860 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:10 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:10.860 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:10 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:10.860 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:10 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:10.860 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:10 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:10.860 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:10 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi120.qnkxcn"]}]: dispatch 2024-04-26T21:34:10.861 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:10 smithi120 ceph-mon[79001]: Upgrade: It appears safe to stop mds.cephfs.smithi120.qnkxcn 2024-04-26T21:34:10.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:10 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:10.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:10 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:10.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:10 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:34:10.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:10 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:34:10.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:10 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:10.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:10 smithi084 ceph-mon[90138]: pgmap v240: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 686 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-04-26T21:34:10.914 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:10 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:34:10.914 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:10 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:10.914 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:10 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:10.914 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:10 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:10.914 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:10 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:10.914 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:10 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi120.qnkxcn"]}]: dispatch 2024-04-26T21:34:10.914 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:10 smithi084 ceph-mon[90138]: Upgrade: It appears safe to stop mds.cephfs.smithi120.qnkxcn 2024-04-26T21:34:13.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:12 smithi084 ceph-mon[90138]: pgmap v241: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 4.2 KiB/s wr, 2 op/s 2024-04-26T21:34:13.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:12 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:13.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:12 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.qnkxcn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:34:13.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:12 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:34:13.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:12 smithi120 ceph-mon[79001]: pgmap v241: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 4.2 KiB/s wr, 2 op/s 2024-04-26T21:34:13.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:12 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:13.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:12 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.qnkxcn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:34:13.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:12 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:34:14.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:13 smithi084 ceph-mon[90138]: Upgrade: Updating mds.cephfs.smithi120.qnkxcn 2024-04-26T21:34:14.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:13 smithi084 ceph-mon[90138]: Deploying daemon mds.cephfs.smithi120.qnkxcn on smithi120 2024-04-26T21:34:14.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:13 smithi120 ceph-mon[79001]: Upgrade: Updating mds.cephfs.smithi120.qnkxcn 2024-04-26T21:34:14.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:13 smithi120 ceph-mon[79001]: Deploying daemon mds.cephfs.smithi120.qnkxcn on smithi120 2024-04-26T21:34:15.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:14 smithi084 ceph-mon[90138]: pgmap v242: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-04-26T21:34:15.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:34:15.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:14 smithi120 ceph-mon[79001]: pgmap v242: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-04-26T21:34:15.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:34:17.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:16 smithi120 ceph-mon[79001]: pgmap v243: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-04-26T21:34:17.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:16 smithi120 ceph-mon[79001]: osdmap e93: 6 total, 6 up, 6 in 2024-04-26T21:34:17.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:16 smithi120 ceph-mon[79001]: fsmap cephfs:1 {0=cephfs.smithi120.ufqfoh=up:active} 2 up:standby 2024-04-26T21:34:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:16 smithi084 ceph-mon[90138]: pgmap v243: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-04-26T21:34:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:16 smithi084 ceph-mon[90138]: osdmap e93: 6 total, 6 up, 6 in 2024-04-26T21:34:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:16 smithi084 ceph-mon[90138]: fsmap cephfs:1 {0=cephfs.smithi120.ufqfoh=up:active} 2 up:standby 2024-04-26T21:34:19.167 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:18 smithi120 ceph-mon[79001]: pgmap v245: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:19.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:18 smithi084 ceph-mon[90138]: pgmap v245: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:21.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:20 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:21.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:20 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:21.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:20 smithi084 ceph-mon[90138]: pgmap v246: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:21.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:20 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:34:21.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:20 smithi084 ceph-mon[90138]: mds.? [v2:172.21.15.120:6824/1351450046,v1:172.21.15.120:6825/1351450046] up:boot 2024-04-26T21:34:21.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:20 smithi084 ceph-mon[90138]: fsmap cephfs:1 {0=cephfs.smithi120.ufqfoh=up:active} 3 up:standby 2024-04-26T21:34:21.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:20 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.qnkxcn"}]: dispatch 2024-04-26T21:34:21.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:20 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:21.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:20 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:21.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:20 smithi120 ceph-mon[79001]: pgmap v246: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:21.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:20 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:34:21.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:20 smithi120 ceph-mon[79001]: mds.? [v2:172.21.15.120:6824/1351450046,v1:172.21.15.120:6825/1351450046] up:boot 2024-04-26T21:34:21.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:20 smithi120 ceph-mon[79001]: fsmap cephfs:1 {0=cephfs.smithi120.ufqfoh=up:active} 3 up:standby 2024-04-26T21:34:21.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:20 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.qnkxcn"}]: dispatch 2024-04-26T21:34:22.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.552+0000 7faeba200700 1 -- 172.21.15.84:0/795182776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faeb4066ed0 msgr2=0x7faeb40ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:22.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.552+0000 7faeba200700 1 --2- 172.21.15.84:0/795182776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faeb4066ed0 0x7faeb40ff9d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faea4004940 tx=0x7faea4009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:22.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.552+0000 7faeba200700 1 -- 172.21.15.84:0/795182776 shutdown_connections 2024-04-26T21:34:22.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.552+0000 7faeba200700 1 --2- 172.21.15.84:0/795182776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faeb40fff10 0x7faeb4102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:22.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.552+0000 7faeba200700 1 --2- 172.21.15.84:0/795182776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faeb4066ed0 0x7faeb40ff9d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:22.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.552+0000 7faeba200700 1 -- 172.21.15.84:0/795182776 >> 172.21.15.84:0/795182776 conn(0x7faeb40f7420 msgr2=0x7faeb40f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:22.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.552+0000 7faeba200700 1 -- 172.21.15.84:0/795182776 shutdown_connections 2024-04-26T21:34:22.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.552+0000 7faeba200700 1 -- 172.21.15.84:0/795182776 wait complete. 2024-04-26T21:34:22.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.553+0000 7faeba200700 1 Processor -- start 2024-04-26T21:34:22.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.553+0000 7faeba200700 1 -- start start 2024-04-26T21:34:22.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.554+0000 7faeba200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faeb4066ed0 0x7faeb40fd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:22.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.554+0000 7faeba200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faeb40fff10 0x7faeb40fb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:22.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.554+0000 7faeba200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb40fbe10 con 0x7faeb4066ed0 2024-04-26T21:34:22.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.554+0000 7faeba200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb40fbf80 con 0x7faeb40fff10 2024-04-26T21:34:22.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.554+0000 7faeb3400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faeb4066ed0 0x7faeb40fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:22.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.554+0000 7faeb3400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faeb4066ed0 0x7faeb40fd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41024/0 (socket says 172.21.15.84:41024) 2024-04-26T21:34:22.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.554+0000 7faeb3400700 1 -- 172.21.15.84:0/3458858186 learned_addr learned my addr 172.21.15.84:0/3458858186 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:34:22.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.554+0000 7faeb2a00700 1 --2- 172.21.15.84:0/3458858186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faeb40fff10 0x7faeb40fb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:22.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.554+0000 7faeb3400700 1 -- 172.21.15.84:0/3458858186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faeb40fff10 msgr2=0x7faeb40fb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:22.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.555+0000 7faeb3400700 1 --2- 172.21.15.84:0/3458858186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faeb40fff10 0x7faeb40fb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:22.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.555+0000 7faeb3400700 1 -- 172.21.15.84:0/3458858186 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea4005040 con 0x7faeb4066ed0 2024-04-26T21:34:22.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.555+0000 7faeb2a00700 1 --2- 172.21.15.84:0/3458858186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faeb40fff10 0x7faeb40fb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:34:22.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.555+0000 7faeb3400700 1 --2- 172.21.15.84:0/3458858186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faeb4066ed0 0x7faeb40fd220 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faea400b970 tx=0x7faea4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:22.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.555+0000 7faeab400700 1 -- 172.21.15.84:0/3458858186 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faea400e040 con 0x7faeb4066ed0 2024-04-26T21:34:22.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.555+0000 7faeab400700 1 -- 172.21.15.84:0/3458858186 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faea4004290 con 0x7faeb4066ed0 2024-04-26T21:34:22.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.555+0000 7faeba200700 1 -- 172.21.15.84:0/3458858186 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb40fc200 con 0x7faeb4066ed0 2024-04-26T21:34:22.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.555+0000 7faeab400700 1 -- 172.21.15.84:0/3458858186 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faea401c630 con 0x7faeb4066ed0 2024-04-26T21:34:22.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.555+0000 7faeba200700 1 -- 172.21.15.84:0/3458858186 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb4115a30 con 0x7faeb4066ed0 2024-04-26T21:34:22.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.557+0000 7faeba200700 1 -- 172.21.15.84:0/3458858186 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb404c710 con 0x7faeb4066ed0 2024-04-26T21:34:22.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.558+0000 7faeab400700 1 -- 172.21.15.84:0/3458858186 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7faea400bbf0 con 0x7faeb4066ed0 2024-04-26T21:34:22.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.559+0000 7faeab400700 1 --2- 172.21.15.84:0/3458858186 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fae9806ec00 0x7fae980710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:22.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.559+0000 7faeab400700 1 -- 172.21.15.84:0/3458858186 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6757+0+0 (secure 0 0 0) 0x7faea408fc10 con 0x7faeb4066ed0 2024-04-26T21:34:22.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.559+0000 7faeb2a00700 1 --2- 172.21.15.84:0/3458858186 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fae9806ec00 0x7fae980710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:22.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.560+0000 7faeb2a00700 1 --2- 172.21.15.84:0/3458858186 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fae9806ec00 0x7fae980710b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faea0006fd0 tx=0x7faea0008040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:22.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.564+0000 7faeab400700 1 -- 172.21.15.84:0/3458858186 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7faea405c500 con 0x7faeb4066ed0 2024-04-26T21:34:22.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.809+0000 7faeba200700 1 -- 172.21.15.84:0/3458858186 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faeb40f8f80 con 0x7fae9806ec00 2024-04-26T21:34:22.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.811+0000 7faeab400700 1 -- 172.21.15.84:0/3458858186 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7faeb40f8f80 con 0x7fae9806ec00 2024-04-26T21:34:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.814+0000 7faeba200700 1 -- 172.21.15.84:0/3458858186 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fae9806ec00 msgr2=0x7fae980710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.814+0000 7faeba200700 1 --2- 172.21.15.84:0/3458858186 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fae9806ec00 0x7fae980710b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faea0006fd0 tx=0x7faea0008040 comp rx=0 tx=0).stop 2024-04-26T21:34:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.814+0000 7faeba200700 1 -- 172.21.15.84:0/3458858186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faeb4066ed0 msgr2=0x7faeb40fd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.814+0000 7faeba200700 1 --2- 172.21.15.84:0/3458858186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faeb4066ed0 0x7faeb40fd220 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faea400b970 tx=0x7faea4009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.815+0000 7faeba200700 1 -- 172.21.15.84:0/3458858186 shutdown_connections 2024-04-26T21:34:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.815+0000 7faeba200700 1 --2- 172.21.15.84:0/3458858186 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fae9806ec00 0x7fae980710b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.815+0000 7faeba200700 1 --2- 172.21.15.84:0/3458858186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faeb4066ed0 0x7faeb40fd220 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.815+0000 7faeba200700 1 --2- 172.21.15.84:0/3458858186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faeb40fff10 0x7faeb40fb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.815+0000 7faeba200700 1 -- 172.21.15.84:0/3458858186 >> 172.21.15.84:0/3458858186 conn(0x7faeb40f7420 msgr2=0x7faeb40f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.815+0000 7faeba200700 1 -- 172.21.15.84:0/3458858186 shutdown_connections 2024-04-26T21:34:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.815+0000 7faeba200700 1 -- 172.21.15.84:0/3458858186 wait complete. 2024-04-26T21:34:22.833 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:34:22.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.960+0000 7fd71f000700 1 -- 172.21.15.84:0/3573932326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd718070940 msgr2=0x7fd718070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:22.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.960+0000 7fd71f000700 1 --2- 172.21.15.84:0/3573932326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd718070940 0x7fd718070db0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd704004940 tx=0x7fd704009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:22.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.964+0000 7fd71f000700 1 -- 172.21.15.84:0/3573932326 shutdown_connections 2024-04-26T21:34:22.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.964+0000 7fd71f000700 1 --2- 172.21.15.84:0/3573932326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd718070940 0x7fd718070db0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:22.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.964+0000 7fd71f000700 1 --2- 172.21.15.84:0/3573932326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd718071ef0 0x7fd718070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:22.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.964+0000 7fd71f000700 1 -- 172.21.15.84:0/3573932326 >> 172.21.15.84:0/3573932326 conn(0x7fd7180f8560 msgr2=0x7fd7180fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:22.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.965+0000 7fd71f000700 1 -- 172.21.15.84:0/3573932326 shutdown_connections 2024-04-26T21:34:22.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.965+0000 7fd71f000700 1 -- 172.21.15.84:0/3573932326 wait complete. 2024-04-26T21:34:22.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.966+0000 7fd71f000700 1 Processor -- start 2024-04-26T21:34:22.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.966+0000 7fd71f000700 1 -- start start 2024-04-26T21:34:22.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.966+0000 7fd71f000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd718070940 0x7fd718114080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:22.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.966+0000 7fd71f000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd718071ef0 0x7fd7181145c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:22.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.966+0000 7fd71f000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd718114c50 con 0x7fd718070940 2024-04-26T21:34:22.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.966+0000 7fd71f000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7181153f0 con 0x7fd718071ef0 2024-04-26T21:34:22.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.967+0000 7fd717e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd718070940 0x7fd718114080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:22.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.967+0000 7fd717e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd718070940 0x7fd718114080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41030/0 (socket says 172.21.15.84:41030) 2024-04-26T21:34:22.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.967+0000 7fd717e00700 1 -- 172.21.15.84:0/3057283493 learned_addr learned my addr 172.21.15.84:0/3057283493 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:34:22.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.967+0000 7fd717400700 1 --2- 172.21.15.84:0/3057283493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd718071ef0 0x7fd7181145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:22.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.967+0000 7fd717e00700 1 -- 172.21.15.84:0/3057283493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd718071ef0 msgr2=0x7fd7181145c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:22.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.967+0000 7fd717e00700 1 --2- 172.21.15.84:0/3057283493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd718071ef0 0x7fd7181145c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:22.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.967+0000 7fd717e00700 1 -- 172.21.15.84:0/3057283493 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd704005040 con 0x7fd718070940 2024-04-26T21:34:22.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.968+0000 7fd717e00700 1 --2- 172.21.15.84:0/3057283493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd718070940 0x7fd718114080 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd70800b790 tx=0x7fd708009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:22.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.968+0000 7fd70fe00700 1 -- 172.21.15.84:0/3057283493 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd70800f6f0 con 0x7fd718070940 2024-04-26T21:34:22.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.968+0000 7fd70fe00700 1 -- 172.21.15.84:0/3057283493 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd70800fd20 con 0x7fd718070940 2024-04-26T21:34:22.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.968+0000 7fd70fe00700 1 -- 172.21.15.84:0/3057283493 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7080103a0 con 0x7fd718070940 2024-04-26T21:34:22.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.968+0000 7fd71f000700 1 -- 172.21.15.84:0/3057283493 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7181156d0 con 0x7fd718070940 2024-04-26T21:34:22.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.968+0000 7fd71f000700 1 -- 172.21.15.84:0/3057283493 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd718115c90 con 0x7fd718070940 2024-04-26T21:34:22.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.969+0000 7fd71f000700 1 -- 172.21.15.84:0/3057283493 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7180fe030 con 0x7fd718070940 2024-04-26T21:34:22.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.970+0000 7fd70fe00700 1 -- 172.21.15.84:0/3057283493 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd70800f850 con 0x7fd718070940 2024-04-26T21:34:22.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.971+0000 7fd70fe00700 1 --2- 172.21.15.84:0/3057283493 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd6fc06ec10 0x7fd6fc0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:22.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.971+0000 7fd70fe00700 1 -- 172.21.15.84:0/3057283493 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fd70808e730 con 0x7fd718070940 2024-04-26T21:34:22.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.971+0000 7fd717400700 1 --2- 172.21.15.84:0/3057283493 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd6fc06ec10 0x7fd6fc0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:22.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.972+0000 7fd717400700 1 --2- 172.21.15.84:0/3057283493 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd6fc06ec10 0x7fd6fc0710c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd70400b3b0 tx=0x7fd704009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:22.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:22.976+0000 7fd70fe00700 1 -- 172.21.15.84:0/3057283493 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fd70805af60 con 0x7fd718070940 2024-04-26T21:34:23.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:22 smithi084 ceph-mon[90138]: pgmap v247: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:23.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:22 smithi120 ceph-mon[79001]: pgmap v247: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:23.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.205+0000 7fd71f000700 1 -- 172.21.15.84:0/3057283493 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd718107d70 con 0x7fd6fc06ec10 2024-04-26T21:34:23.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.207+0000 7fd70fe00700 1 -- 172.21.15.84:0/3057283493 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd718107d70 con 0x7fd6fc06ec10 2024-04-26T21:34:23.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.210+0000 7fd71f000700 1 -- 172.21.15.84:0/3057283493 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd6fc06ec10 msgr2=0x7fd6fc0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:23.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.210+0000 7fd71f000700 1 --2- 172.21.15.84:0/3057283493 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd6fc06ec10 0x7fd6fc0710c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd70400b3b0 tx=0x7fd704009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:23.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.210+0000 7fd71f000700 1 -- 172.21.15.84:0/3057283493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd718070940 msgr2=0x7fd718114080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:23.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.210+0000 7fd71f000700 1 --2- 172.21.15.84:0/3057283493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd718070940 0x7fd718114080 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd70800b790 tx=0x7fd708009220 comp rx=0 tx=0).stop 2024-04-26T21:34:23.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.210+0000 7fd71f000700 1 -- 172.21.15.84:0/3057283493 shutdown_connections 2024-04-26T21:34:23.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.210+0000 7fd71f000700 1 --2- 172.21.15.84:0/3057283493 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd6fc06ec10 0x7fd6fc0710c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:23.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.210+0000 7fd71f000700 1 --2- 172.21.15.84:0/3057283493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd718070940 0x7fd718114080 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:23.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.210+0000 7fd71f000700 1 --2- 172.21.15.84:0/3057283493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd718071ef0 0x7fd7181145c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:23.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.210+0000 7fd71f000700 1 -- 172.21.15.84:0/3057283493 >> 172.21.15.84:0/3057283493 conn(0x7fd7180f8560 msgr2=0x7fd718103200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:23.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.211+0000 7fd71f000700 1 -- 172.21.15.84:0/3057283493 shutdown_connections 2024-04-26T21:34:23.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.211+0000 7fd71f000700 1 -- 172.21.15.84:0/3057283493 wait complete. 2024-04-26T21:34:23.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.358+0000 7fc692a00700 1 -- 172.21.15.84:0/259718496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68c0fce60 msgr2=0x7fc68c0fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:23.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.358+0000 7fc692a00700 1 --2- 172.21.15.84:0/259718496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68c0fce60 0x7fc68c0fd270 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc67c004940 tx=0x7fc67c009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:23.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.358+0000 7fc692a00700 1 -- 172.21.15.84:0/259718496 shutdown_connections 2024-04-26T21:34:23.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.358+0000 7fc692a00700 1 --2- 172.21.15.84:0/259718496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc68c0fdfd0 0x7fc68c0fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:23.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.358+0000 7fc692a00700 1 --2- 172.21.15.84:0/259718496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68c0fce60 0x7fc68c0fd270 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:23.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.358+0000 7fc692a00700 1 -- 172.21.15.84:0/259718496 >> 172.21.15.84:0/259718496 conn(0x7fc68c0f8540 msgr2=0x7fc68c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:23.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.358+0000 7fc692a00700 1 -- 172.21.15.84:0/259718496 shutdown_connections 2024-04-26T21:34:23.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.358+0000 7fc692a00700 1 -- 172.21.15.84:0/259718496 wait complete. 2024-04-26T21:34:23.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.359+0000 7fc692a00700 1 Processor -- start 2024-04-26T21:34:23.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.359+0000 7fc692a00700 1 -- start start 2024-04-26T21:34:23.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.359+0000 7fc692a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc68c0fce60 0x7fc68c10fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:23.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.359+0000 7fc692a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68c0fdfd0 0x7fc68c110060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:23.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.359+0000 7fc692a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c110660 con 0x7fc68c0fdfd0 2024-04-26T21:34:23.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.359+0000 7fc692a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c1107d0 con 0x7fc68c0fce60 2024-04-26T21:34:23.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.359+0000 7fc68b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68c0fdfd0 0x7fc68c110060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:23.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.360+0000 7fc68be00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc68c0fce60 0x7fc68c10fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:23.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.360+0000 7fc68b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68c0fdfd0 0x7fc68c110060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41046/0 (socket says 172.21.15.84:41046) 2024-04-26T21:34:23.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.360+0000 7fc68b400700 1 -- 172.21.15.84:0/2254088063 learned_addr learned my addr 172.21.15.84:0/2254088063 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:34:23.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.360+0000 7fc68b400700 1 -- 172.21.15.84:0/2254088063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc68c0fce60 msgr2=0x7fc68c10fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:23.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.360+0000 7fc68b400700 1 --2- 172.21.15.84:0/2254088063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc68c0fce60 0x7fc68c10fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:23.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.360+0000 7fc68b400700 1 -- 172.21.15.84:0/2254088063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67c005040 con 0x7fc68c0fdfd0 2024-04-26T21:34:23.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.360+0000 7fc68b400700 1 --2- 172.21.15.84:0/2254088063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68c0fdfd0 0x7fc68c110060 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc67800c830 tx=0x7fc678004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:23.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.360+0000 7fc683e00700 1 -- 172.21.15.84:0/2254088063 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6780106f0 con 0x7fc68c0fdfd0 2024-04-26T21:34:23.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.361+0000 7fc683e00700 1 -- 172.21.15.84:0/2254088063 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc678010d20 con 0x7fc68c0fdfd0 2024-04-26T21:34:23.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.361+0000 7fc692a00700 1 -- 172.21.15.84:0/2254088063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68c115230 con 0x7fc68c0fdfd0 2024-04-26T21:34:23.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.361+0000 7fc683e00700 1 -- 172.21.15.84:0/2254088063 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6780113a0 con 0x7fc68c0fdfd0 2024-04-26T21:34:23.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.361+0000 7fc692a00700 1 -- 172.21.15.84:0/2254088063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68c1157f0 con 0x7fc68c0fdfd0 2024-04-26T21:34:23.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.362+0000 7fc692a00700 1 -- 172.21.15.84:0/2254088063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc68c101960 con 0x7fc68c0fdfd0 2024-04-26T21:34:23.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.363+0000 7fc683e00700 1 -- 172.21.15.84:0/2254088063 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc678012400 con 0x7fc68c0fdfd0 2024-04-26T21:34:23.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.364+0000 7fc683e00700 1 --2- 172.21.15.84:0/2254088063 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc67006ec00 0x7fc6700710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:23.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.364+0000 7fc683e00700 1 -- 172.21.15.84:0/2254088063 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fc67808e8e0 con 0x7fc68c0fdfd0 2024-04-26T21:34:23.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.364+0000 7fc68be00700 1 --2- 172.21.15.84:0/2254088063 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc67006ec00 0x7fc6700710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:23.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.365+0000 7fc68be00700 1 --2- 172.21.15.84:0/2254088063 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc67006ec00 0x7fc6700710b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009fd0 tx=0x7fc67c009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:23.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.369+0000 7fc683e00700 1 -- 172.21.15.84:0/2254088063 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fc67805b110 con 0x7fc68c0fdfd0 2024-04-26T21:34:23.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.605+0000 7fc692a00700 1 -- 172.21.15.84:0/2254088063 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc68c02b410 con 0x7fc67006ec00 2024-04-26T21:34:23.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.616+0000 7fc683e00700 1 -- 172.21.15.84:0/2254088063 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fc68c02b410 con 0x7fc67006ec00 2024-04-26T21:34:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:34:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (9m) 21s ago 19m 14.9M - 0.25.0 c8568f914cd2 bcb419cf9108 2024-04-26T21:34:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (5m) 21s ago 20m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 b4010dfbe623 2024-04-26T21:34:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (5m) 111s ago 18m 6665k - 19.0.0-3306-gbc612ffb 55dc54019ad8 89a4e50ea23c 2024-04-26T21:34:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (9m) 21s ago 19m 75.3M - 9.4.7 954c08fa6188 1bf95f604e07 2024-04-26T21:34:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (56s) 21s ago 13m 11.2M - 19.0.0-3306-gbc612ffb 55dc54019ad8 26d10fe664bb 2024-04-26T21:34:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (28s) 21s ago 12m 11.0M - 19.0.0-3306-gbc612ffb 55dc54019ad8 c801ec16a810 2024-04-26T21:34:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 starting - - - - 2024-04-26T21:34:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (12m) 111s ago 12m 14.6M - 17.2.7-907-g2be3efa9 1c5834633715 c085ad962855 2024-04-26T21:34:23.618 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (8m) 21s ago 21m 510M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:34:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283,8765 running (7m) 111s ago 18m 454M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d6ae0b4628b5 2024-04-26T21:34:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (6m) 21s ago 21m 52.5M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 bf610abb6a62 2024-04-26T21:34:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (6m) 111s ago 18m 36.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 5d530496253b 2024-04-26T21:34:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (9m) 21s ago 20m 8321k - 1.5.0 0da6a335fe13 81e00b40bfbf 2024-04-26T21:34:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (8m) 111s ago 18m 7541k - 1.5.0 0da6a335fe13 0506a1d46ec4 2024-04-26T21:34:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (4m) 21s ago 17m 113M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 99fbe2faa51b 2024-04-26T21:34:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (4m) 21s ago 17m 98.0M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 2dc81d93f7e5 2024-04-26T21:34:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (3m) 21s ago 16m 90.1M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 9e77abf095bd 2024-04-26T21:34:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (3m) 111s ago 15m 83.1M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 d7e5825e2640 2024-04-26T21:34:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (2m) 111s ago 15m 80.2M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 894dcbaab8eb 2024-04-26T21:34:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (116s) 111s ago 14m 11.2M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 e39948e51a13 2024-04-26T21:34:23.619 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (7m) 21s ago 19m 60.0M - 2.43.0 a07b618ecd1d d3008b765eec 2024-04-26T21:34:23.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.619+0000 7fc692a00700 1 -- 172.21.15.84:0/2254088063 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc67006ec00 msgr2=0x7fc6700710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:23.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.619+0000 7fc692a00700 1 --2- 172.21.15.84:0/2254088063 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc67006ec00 0x7fc6700710b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009fd0 tx=0x7fc67c009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:23.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.619+0000 7fc692a00700 1 -- 172.21.15.84:0/2254088063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68c0fdfd0 msgr2=0x7fc68c110060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:23.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.619+0000 7fc692a00700 1 --2- 172.21.15.84:0/2254088063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68c0fdfd0 0x7fc68c110060 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc67800c830 tx=0x7fc678004470 comp rx=0 tx=0).stop 2024-04-26T21:34:23.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.619+0000 7fc692a00700 1 -- 172.21.15.84:0/2254088063 shutdown_connections 2024-04-26T21:34:23.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.619+0000 7fc692a00700 1 --2- 172.21.15.84:0/2254088063 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc67006ec00 0x7fc6700710b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:23.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.619+0000 7fc692a00700 1 --2- 172.21.15.84:0/2254088063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc68c0fce60 0x7fc68c10fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:23.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.619+0000 7fc692a00700 1 --2- 172.21.15.84:0/2254088063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc68c0fdfd0 0x7fc68c110060 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:23.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.619+0000 7fc692a00700 1 -- 172.21.15.84:0/2254088063 >> 172.21.15.84:0/2254088063 conn(0x7fc68c0f8540 msgr2=0x7fc68c0f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:23.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.619+0000 7fc692a00700 1 -- 172.21.15.84:0/2254088063 shutdown_connections 2024-04-26T21:34:23.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.619+0000 7fc692a00700 1 -- 172.21.15.84:0/2254088063 wait complete. 2024-04-26T21:34:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.765+0000 7fd0af000700 1 -- 172.21.15.84:0/3004594322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0a8070940 msgr2=0x7fd0a8070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.765+0000 7fd0af000700 1 --2- 172.21.15.84:0/3004594322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0a8070940 0x7fd0a8070db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd094004940 tx=0x7fd094009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.765+0000 7fd0af000700 1 -- 172.21.15.84:0/3004594322 shutdown_connections 2024-04-26T21:34:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.765+0000 7fd0af000700 1 --2- 172.21.15.84:0/3004594322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0a8070940 0x7fd0a8070db0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.765+0000 7fd0af000700 1 --2- 172.21.15.84:0/3004594322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0a8071ef0 0x7fd0a8070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.765+0000 7fd0af000700 1 -- 172.21.15.84:0/3004594322 >> 172.21.15.84:0/3004594322 conn(0x7fd0a80f8560 msgr2=0x7fd0a80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.765+0000 7fd0af000700 1 -- 172.21.15.84:0/3004594322 shutdown_connections 2024-04-26T21:34:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.765+0000 7fd0af000700 1 -- 172.21.15.84:0/3004594322 wait complete. 2024-04-26T21:34:23.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.766+0000 7fd0af000700 1 Processor -- start 2024-04-26T21:34:23.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.766+0000 7fd0af000700 1 -- start start 2024-04-26T21:34:23.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.766+0000 7fd0af000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0a8070940 0x7fd0a8113fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:23.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.766+0000 7fd0af000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0a8071ef0 0x7fd0a8114510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:23.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.766+0000 7fd0af000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a8114b10 con 0x7fd0a8070940 2024-04-26T21:34:23.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.766+0000 7fd0af000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a8115360 con 0x7fd0a8071ef0 2024-04-26T21:34:23.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.767+0000 7fd0a7e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0a8070940 0x7fd0a8113fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:23.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.767+0000 7fd0a7e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0a8070940 0x7fd0a8113fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41068/0 (socket says 172.21.15.84:41068) 2024-04-26T21:34:23.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.767+0000 7fd0a7e00700 1 -- 172.21.15.84:0/1445070846 learned_addr learned my addr 172.21.15.84:0/1445070846 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:34:23.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.767+0000 7fd0a7400700 1 --2- 172.21.15.84:0/1445070846 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0a8071ef0 0x7fd0a8114510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:23.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.767+0000 7fd0a7e00700 1 -- 172.21.15.84:0/1445070846 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0a8071ef0 msgr2=0x7fd0a8114510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:23.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.767+0000 7fd0a7e00700 1 --2- 172.21.15.84:0/1445070846 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0a8071ef0 0x7fd0a8114510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:23.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.767+0000 7fd0a7e00700 1 -- 172.21.15.84:0/1445070846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd094005040 con 0x7fd0a8070940 2024-04-26T21:34:23.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.767+0000 7fd0a7400700 1 --2- 172.21.15.84:0/1445070846 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0a8071ef0 0x7fd0a8114510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:34:23.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.767+0000 7fd0a7e00700 1 --2- 172.21.15.84:0/1445070846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0a8070940 0x7fd0a8113fd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd09800c8b0 tx=0x7fd098004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:23.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.768+0000 7fd09fe00700 1 -- 172.21.15.84:0/1445070846 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd09800a760 con 0x7fd0a8070940 2024-04-26T21:34:23.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.768+0000 7fd09fe00700 1 -- 172.21.15.84:0/1445070846 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd09800ad90 con 0x7fd0a8070940 2024-04-26T21:34:23.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.768+0000 7fd0af000700 1 -- 172.21.15.84:0/1445070846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a8115640 con 0x7fd0a8070940 2024-04-26T21:34:23.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.768+0000 7fd09fe00700 1 -- 172.21.15.84:0/1445070846 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0980113a0 con 0x7fd0a8070940 2024-04-26T21:34:23.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.768+0000 7fd0af000700 1 -- 172.21.15.84:0/1445070846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a8115b80 con 0x7fd0a8070940 2024-04-26T21:34:23.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.769+0000 7fd0af000700 1 -- 172.21.15.84:0/1445070846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a805f5c0 con 0x7fd0a8070940 2024-04-26T21:34:23.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.770+0000 7fd09fe00700 1 -- 172.21.15.84:0/1445070846 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd098012400 con 0x7fd0a8070940 2024-04-26T21:34:23.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.771+0000 7fd09fe00700 1 --2- 172.21.15.84:0/1445070846 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd08c06ec10 0x7fd08c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:23.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.771+0000 7fd09fe00700 1 -- 172.21.15.84:0/1445070846 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fd09808e970 con 0x7fd0a8070940 2024-04-26T21:34:23.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.772+0000 7fd0a7400700 1 --2- 172.21.15.84:0/1445070846 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd08c06ec10 0x7fd08c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:23.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.772+0000 7fd0a7400700 1 --2- 172.21.15.84:0/1445070846 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd08c06ec10 0x7fd08c0710c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd09400b3b0 tx=0x7fd094009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:23.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:23.776+0000 7fd09fe00700 1 -- 172.21.15.84:0/1445070846 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fd09805b1a0 con 0x7fd0a8070940 2024-04-26T21:34:24.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.078+0000 7fd0af000700 1 -- 172.21.15.84:0/1445070846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd0a804bed0 con 0x7fd0a8070940 2024-04-26T21:34:24.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.079+0000 7fd09fe00700 1 -- 172.21.15.84:0/1445070846 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fd09805ad30 con 0x7fd0a8070940 2024-04-26T21:34:24.080 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:34:24.081 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:34:24.081 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:34:24.081 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:34:24.081 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:34:24.081 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:34:24.081 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:34:24.081 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:34:24.081 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 6 2024-04-26T21:34:24.081 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:34:24.081 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:34:24.081 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 1, 2024-04-26T21:34:24.081 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 3 2024-04-26T21:34:24.081 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:34:24.081 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:34:24.082 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 1, 2024-04-26T21:34:24.082 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 13 2024-04-26T21:34:24.082 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:34:24.082 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:34:24.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.081+0000 7fd0af000700 1 -- 172.21.15.84:0/1445070846 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd08c06ec10 msgr2=0x7fd08c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:24.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.081+0000 7fd0af000700 1 --2- 172.21.15.84:0/1445070846 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd08c06ec10 0x7fd08c0710c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd09400b3b0 tx=0x7fd094009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:24.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.081+0000 7fd0af000700 1 -- 172.21.15.84:0/1445070846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0a8070940 msgr2=0x7fd0a8113fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:24.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.081+0000 7fd0af000700 1 --2- 172.21.15.84:0/1445070846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0a8070940 0x7fd0a8113fd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd09800c8b0 tx=0x7fd098004470 comp rx=0 tx=0).stop 2024-04-26T21:34:24.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.081+0000 7fd0af000700 1 -- 172.21.15.84:0/1445070846 shutdown_connections 2024-04-26T21:34:24.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.081+0000 7fd0af000700 1 --2- 172.21.15.84:0/1445070846 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd08c06ec10 0x7fd08c0710c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:24.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.081+0000 7fd0af000700 1 --2- 172.21.15.84:0/1445070846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0a8070940 0x7fd0a8113fd0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:24.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.082+0000 7fd0af000700 1 --2- 172.21.15.84:0/1445070846 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0a8071ef0 0x7fd0a8114510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:24.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.082+0000 7fd0af000700 1 -- 172.21.15.84:0/1445070846 >> 172.21.15.84:0/1445070846 conn(0x7fd0a80f8560 msgr2=0x7fd0a80f9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:24.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.082+0000 7fd0af000700 1 -- 172.21.15.84:0/1445070846 shutdown_connections 2024-04-26T21:34:24.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.082+0000 7fd0af000700 1 -- 172.21.15.84:0/1445070846 wait complete. 2024-04-26T21:34:24.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:23 smithi120 ceph-mon[79001]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:34:24.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.235+0000 7fd36fe00700 1 -- 172.21.15.84:0/1887790811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3680feff0 msgr2=0x7fd3680ff400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:24.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.235+0000 7fd36fe00700 1 --2- 172.21.15.84:0/1887790811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3680feff0 0x7fd3680ff400 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd35c004940 tx=0x7fd35c009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:24.237 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:23 smithi084 ceph-mon[90138]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:34:24.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.235+0000 7fd36fe00700 1 -- 172.21.15.84:0/1887790811 shutdown_connections 2024-04-26T21:34:24.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.235+0000 7fd36fe00700 1 --2- 172.21.15.84:0/1887790811 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3681002a0 0x7fd368100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:24.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.235+0000 7fd36fe00700 1 --2- 172.21.15.84:0/1887790811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3680feff0 0x7fd3680ff400 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:24.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.235+0000 7fd36fe00700 1 -- 172.21.15.84:0/1887790811 >> 172.21.15.84:0/1887790811 conn(0x7fd3680fa8f0 msgr2=0x7fd3680fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:24.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.236+0000 7fd36fe00700 1 -- 172.21.15.84:0/1887790811 shutdown_connections 2024-04-26T21:34:24.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.236+0000 7fd36fe00700 1 -- 172.21.15.84:0/1887790811 wait complete. 2024-04-26T21:34:24.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.237+0000 7fd36fe00700 1 Processor -- start 2024-04-26T21:34:24.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.237+0000 7fd36fe00700 1 -- start start 2024-04-26T21:34:24.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.237+0000 7fd36fe00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3680feff0 0x7fd36810fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:24.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.237+0000 7fd36fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3681002a0 0x7fd368110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:24.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.237+0000 7fd36fe00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd368110670 con 0x7fd3681002a0 2024-04-26T21:34:24.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.238+0000 7fd36fe00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3681107e0 con 0x7fd3680feff0 2024-04-26T21:34:24.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.238+0000 7fd36ca00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3681002a0 0x7fd368110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:24.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.238+0000 7fd36ca00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3681002a0 0x7fd368110070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41090/0 (socket says 172.21.15.84:41090) 2024-04-26T21:34:24.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.238+0000 7fd36ca00700 1 -- 172.21.15.84:0/1392424637 learned_addr learned my addr 172.21.15.84:0/1392424637 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:34:24.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.238+0000 7fd36d400700 1 --2- 172.21.15.84:0/1392424637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3680feff0 0x7fd36810fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:24.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.238+0000 7fd36ca00700 1 -- 172.21.15.84:0/1392424637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3680feff0 msgr2=0x7fd36810fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:24.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.238+0000 7fd36ca00700 1 --2- 172.21.15.84:0/1392424637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3680feff0 0x7fd36810fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:24.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.238+0000 7fd36ca00700 1 -- 172.21.15.84:0/1392424637 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35c005040 con 0x7fd3681002a0 2024-04-26T21:34:24.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.239+0000 7fd36ca00700 1 --2- 172.21.15.84:0/1392424637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3681002a0 0x7fd368110070 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd354002a50 tx=0x7fd3540046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:24.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.239+0000 7fd365600700 1 -- 172.21.15.84:0/1392424637 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd354007cc0 con 0x7fd3681002a0 2024-04-26T21:34:24.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.239+0000 7fd365600700 1 -- 172.21.15.84:0/1392424637 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd35400f040 con 0x7fd3681002a0 2024-04-26T21:34:24.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.239+0000 7fd36fe00700 1 -- 172.21.15.84:0/1392424637 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd368115240 con 0x7fd3681002a0 2024-04-26T21:34:24.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.239+0000 7fd365600700 1 -- 172.21.15.84:0/1392424637 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd35400da70 con 0x7fd3681002a0 2024-04-26T21:34:24.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.239+0000 7fd36fe00700 1 -- 172.21.15.84:0/1392424637 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd368115800 con 0x7fd3681002a0 2024-04-26T21:34:24.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.241+0000 7fd36fe00700 1 -- 172.21.15.84:0/1392424637 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36804c710 con 0x7fd3681002a0 2024-04-26T21:34:24.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.242+0000 7fd365600700 1 -- 172.21.15.84:0/1392424637 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd35400dc10 con 0x7fd3681002a0 2024-04-26T21:34:24.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.243+0000 7fd365600700 1 --2- 172.21.15.84:0/1392424637 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd35006ec00 0x7fd3500710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:24.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.243+0000 7fd365600700 1 -- 172.21.15.84:0/1392424637 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fd35408e000 con 0x7fd3681002a0 2024-04-26T21:34:24.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.243+0000 7fd36d400700 1 --2- 172.21.15.84:0/1392424637 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd35006ec00 0x7fd3500710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:24.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.244+0000 7fd36d400700 1 --2- 172.21.15.84:0/1392424637 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd35006ec00 0x7fd3500710b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00b3b0 tx=0x7fd35c009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:24.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.248+0000 7fd365600700 1 -- 172.21.15.84:0/1392424637 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fd35405a7d0 con 0x7fd3681002a0 2024-04-26T21:34:24.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.517+0000 7fd36fe00700 1 -- 172.21.15.84:0/1392424637 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd368115c00 con 0x7fd3681002a0 2024-04-26T21:34:24.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.517+0000 7fd365600700 1 -- 172.21.15.84:0/1392424637 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1896 (secure 0 0 0) 0x7fd35405a360 con 0x7fd3681002a0 2024-04-26T21:34:24.520 INFO:teuthology.orchestra.run.smithi084.stdout:e35 2024-04-26T21:34:24.520 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:34:24.520 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:34:24.520 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:34:24.521 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:34:24.521 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:34:24.521 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:34:24.521 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 33 2024-04-26T21:34:24.521 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:34:24.521 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:34:24.521 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:33:57.335661+0000 2024-04-26T21:34:24.521 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:34:24.521 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:34:24.521 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:34:24.521 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:34:24.521 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:34:24.521 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-04-26T21:34:24.521 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:34:24.521 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:34:24.522 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 92 2024-04-26T21:34:24.522 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:34:24.522 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 1 2024-04-26T21:34:24.522 INFO:teuthology.orchestra.run.smithi084.stdout:in 0 2024-04-26T21:34:24.522 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24237} 2024-04-26T21:34:24.522 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:34:24.522 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:34:24.522 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 1 2024-04-26T21:34:24.522 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:34:24.522 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:34:24.522 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:34:24.522 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:34:24.522 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-04-26T21:34:24.522 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:34:24.523 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 24237 members: 24237 2024-04-26T21:34:24.523 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{0:24237} state up:active seq 189 join_fscid=1 addr [v2:172.21.15.120:6826/2972379081,v1:172.21.15.120:6827/2972379081] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:34:24.523 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:34:24.523 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:34:24.523 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:34:24.523 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:34:24.523 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{-1:34446} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.84:6826/1392878113,v1:172.21.15.84:6827/1392878113] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:34:24.523 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{-1:34478} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.84:6828/4015119551,v1:172.21.15.84:6829/4015119551] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:34:24.523 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.120:6824/1351450046,v1:172.21.15.120:6825/1351450046] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:34:24.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.520+0000 7fd36fe00700 1 -- 172.21.15.84:0/1392424637 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd35006ec00 msgr2=0x7fd3500710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:24.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.520+0000 7fd36fe00700 1 --2- 172.21.15.84:0/1392424637 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd35006ec00 0x7fd3500710b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00b3b0 tx=0x7fd35c009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:24.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.520+0000 7fd36fe00700 1 -- 172.21.15.84:0/1392424637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3681002a0 msgr2=0x7fd368110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:24.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.520+0000 7fd36fe00700 1 --2- 172.21.15.84:0/1392424637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3681002a0 0x7fd368110070 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd354002a50 tx=0x7fd3540046b0 comp rx=0 tx=0).stop 2024-04-26T21:34:24.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.520+0000 7fd36fe00700 1 -- 172.21.15.84:0/1392424637 shutdown_connections 2024-04-26T21:34:24.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.520+0000 7fd36fe00700 1 --2- 172.21.15.84:0/1392424637 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd35006ec00 0x7fd3500710b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:24.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.520+0000 7fd36fe00700 1 --2- 172.21.15.84:0/1392424637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3680feff0 0x7fd36810fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:24.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.520+0000 7fd36fe00700 1 --2- 172.21.15.84:0/1392424637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3681002a0 0x7fd368110070 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:24.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.520+0000 7fd36fe00700 1 -- 172.21.15.84:0/1392424637 >> 172.21.15.84:0/1392424637 conn(0x7fd3680fa8f0 msgr2=0x7fd3680fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:24.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.520+0000 7fd36fe00700 1 -- 172.21.15.84:0/1392424637 shutdown_connections 2024-04-26T21:34:24.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.520+0000 7fd36fe00700 1 -- 172.21.15.84:0/1392424637 wait complete. 2024-04-26T21:34:24.525 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 35 2024-04-26T21:34:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.671+0000 7ff5a9200700 1 -- 172.21.15.84:0/581169325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5a4066260 msgr2=0x7ff5a40ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.671+0000 7ff5a9200700 1 --2- 172.21.15.84:0/581169325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5a4066260 0x7ff5a40ffa00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff594004940 tx=0x7ff594009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.671+0000 7ff5a9200700 1 -- 172.21.15.84:0/581169325 shutdown_connections 2024-04-26T21:34:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.671+0000 7ff5a9200700 1 --2- 172.21.15.84:0/581169325 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5a40fff40 0x7ff5a4102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.671+0000 7ff5a9200700 1 --2- 172.21.15.84:0/581169325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5a4066260 0x7ff5a40ffa00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.671+0000 7ff5a9200700 1 -- 172.21.15.84:0/581169325 >> 172.21.15.84:0/581169325 conn(0x7ff5a40f7430 msgr2=0x7ff5a40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.672+0000 7ff5a9200700 1 -- 172.21.15.84:0/581169325 shutdown_connections 2024-04-26T21:34:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.672+0000 7ff5a9200700 1 -- 172.21.15.84:0/581169325 wait complete. 2024-04-26T21:34:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.672+0000 7ff5a9200700 1 Processor -- start 2024-04-26T21:34:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.672+0000 7ff5a9200700 1 -- start start 2024-04-26T21:34:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.673+0000 7ff5a9200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5a4066260 0x7ff5a410fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.673+0000 7ff5a9200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5a40fff40 0x7ff5a4110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.673+0000 7ff5a9200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4110780 con 0x7ff5a4066260 2024-04-26T21:34:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.673+0000 7ff5a9200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4110fd0 con 0x7ff5a40fff40 2024-04-26T21:34:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.673+0000 7ff5a1e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5a4066260 0x7ff5a410fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.673+0000 7ff5a1e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5a4066260 0x7ff5a410fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41098/0 (socket says 172.21.15.84:41098) 2024-04-26T21:34:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.673+0000 7ff5a1e00700 1 -- 172.21.15.84:0/3914800526 learned_addr learned my addr 172.21.15.84:0/3914800526 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:34:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.673+0000 7ff5a1400700 1 --2- 172.21.15.84:0/3914800526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5a40fff40 0x7ff5a4110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.673+0000 7ff5a1e00700 1 -- 172.21.15.84:0/3914800526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5a40fff40 msgr2=0x7ff5a4110180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.673+0000 7ff5a1e00700 1 --2- 172.21.15.84:0/3914800526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5a40fff40 0x7ff5a4110180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.673+0000 7ff5a1e00700 1 -- 172.21.15.84:0/3914800526 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff594005040 con 0x7ff5a4066260 2024-04-26T21:34:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.674+0000 7ff5a1e00700 1 --2- 172.21.15.84:0/3914800526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5a4066260 0x7ff5a410fc40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff59400b970 tx=0x7ff594009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:24.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.674+0000 7ff59a000700 1 -- 172.21.15.84:0/3914800526 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff59400e040 con 0x7ff5a4066260 2024-04-26T21:34:24.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.674+0000 7ff59a000700 1 -- 172.21.15.84:0/3914800526 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff594004290 con 0x7ff5a4066260 2024-04-26T21:34:24.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.674+0000 7ff5a9200700 1 -- 172.21.15.84:0/3914800526 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a4111250 con 0x7ff5a4066260 2024-04-26T21:34:24.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.674+0000 7ff59a000700 1 -- 172.21.15.84:0/3914800526 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff59401c630 con 0x7ff5a4066260 2024-04-26T21:34:24.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.674+0000 7ff5a9200700 1 -- 172.21.15.84:0/3914800526 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a4111790 con 0x7ff5a4066260 2024-04-26T21:34:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.675+0000 7ff5a9200700 1 -- 172.21.15.84:0/3914800526 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a405f5c0 con 0x7ff5a4066260 2024-04-26T21:34:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.676+0000 7ff59a000700 1 -- 172.21.15.84:0/3914800526 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff59400bbf0 con 0x7ff5a4066260 2024-04-26T21:34:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.677+0000 7ff59a000700 1 --2- 172.21.15.84:0/3914800526 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ff58806ec10 0x7ff5880710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.677+0000 7ff59a000700 1 -- 172.21.15.84:0/3914800526 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6757+0+0 (secure 0 0 0) 0x7ff59408fdd0 con 0x7ff5a4066260 2024-04-26T21:34:24.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.677+0000 7ff5a1400700 1 --2- 172.21.15.84:0/3914800526 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ff58806ec10 0x7ff5880710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:24.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.678+0000 7ff5a1400700 1 --2- 172.21.15.84:0/3914800526 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ff58806ec10 0x7ff5880710c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff590004d60 tx=0x7ff59000b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:24.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.682+0000 7ff59a000700 1 -- 172.21.15.84:0/3914800526 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7ff59405c580 con 0x7ff5a4066260 2024-04-26T21:34:24.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.912+0000 7ff5a9200700 1 -- 172.21.15.84:0/3914800526 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5a4111b70 con 0x7ff58806ec10 2024-04-26T21:34:24.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.914+0000 7ff59a000700 1 -- 172.21.15.84:0/3914800526 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff5a4111b70 con 0x7ff58806ec10 2024-04-26T21:34:24.916 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:34:24.916 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:34:24.916 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:34:24.916 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:34:24.916 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-04-26T21:34:24.916 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr", 2024-04-26T21:34:24.916 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-04-26T21:34:24.916 INFO:teuthology.orchestra.run.smithi084.stdout: "osd", 2024-04-26T21:34:24.916 INFO:teuthology.orchestra.run.smithi084.stdout: "crash" 2024-04-26T21:34:24.916 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-04-26T21:34:24.916 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "15/21 daemons upgraded", 2024-04-26T21:34:24.916 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading mds daemons", 2024-04-26T21:34:24.916 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:34:24.916 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:34:24.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.916+0000 7ff5a9200700 1 -- 172.21.15.84:0/3914800526 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ff58806ec10 msgr2=0x7ff5880710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:24.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.916+0000 7ff5a9200700 1 --2- 172.21.15.84:0/3914800526 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ff58806ec10 0x7ff5880710c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff590004d60 tx=0x7ff59000b040 comp rx=0 tx=0).stop 2024-04-26T21:34:24.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.916+0000 7ff5a9200700 1 -- 172.21.15.84:0/3914800526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5a4066260 msgr2=0x7ff5a410fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:24.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.916+0000 7ff5a9200700 1 --2- 172.21.15.84:0/3914800526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5a4066260 0x7ff5a410fc40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff59400b970 tx=0x7ff594009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:24.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.917+0000 7ff5a9200700 1 -- 172.21.15.84:0/3914800526 shutdown_connections 2024-04-26T21:34:24.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.917+0000 7ff5a9200700 1 --2- 172.21.15.84:0/3914800526 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ff58806ec10 0x7ff5880710c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:24.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.917+0000 7ff5a9200700 1 --2- 172.21.15.84:0/3914800526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5a4066260 0x7ff5a410fc40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:24.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.917+0000 7ff5a9200700 1 --2- 172.21.15.84:0/3914800526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5a40fff40 0x7ff5a4110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:24.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.917+0000 7ff5a9200700 1 -- 172.21.15.84:0/3914800526 >> 172.21.15.84:0/3914800526 conn(0x7ff5a40f7430 msgr2=0x7ff5a40fbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:24.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.917+0000 7ff5a9200700 1 -- 172.21.15.84:0/3914800526 shutdown_connections 2024-04-26T21:34:24.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:24.917+0000 7ff5a9200700 1 -- 172.21.15.84:0/3914800526 wait complete. 2024-04-26T21:34:25.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.057+0000 7fc9f6000700 1 -- 172.21.15.84:0/1695307332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9f01033f0 msgr2=0x7fc9f0103800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:25.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.057+0000 7fc9f6000700 1 --2- 172.21.15.84:0/1695307332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9f01033f0 0x7fc9f0103800 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009ce0 tx=0x7fc9e0004d10 comp rx=0 tx=0).stop 2024-04-26T21:34:25.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.057+0000 7fc9f6000700 1 -- 172.21.15.84:0/1695307332 shutdown_connections 2024-04-26T21:34:25.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.057+0000 7fc9f6000700 1 --2- 172.21.15.84:0/1695307332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc9f01046a0 0x7fc9f0104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:25.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.057+0000 7fc9f6000700 1 --2- 172.21.15.84:0/1695307332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9f01033f0 0x7fc9f0103800 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:25.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.058+0000 7fc9f6000700 1 -- 172.21.15.84:0/1695307332 >> 172.21.15.84:0/1695307332 conn(0x7fc9f00725e0 msgr2=0x7fc9f0074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:25.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.058+0000 7fc9f6000700 1 -- 172.21.15.84:0/1695307332 shutdown_connections 2024-04-26T21:34:25.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.058+0000 7fc9f6000700 1 -- 172.21.15.84:0/1695307332 wait complete. 2024-04-26T21:34:25.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.058+0000 7fc9f6000700 1 Processor -- start 2024-04-26T21:34:25.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.059+0000 7fc9f6000700 1 -- start start 2024-04-26T21:34:25.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.059+0000 7fc9f6000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc9f01033f0 0x7fc9f01140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:25.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.059+0000 7fc9f6000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9f01046a0 0x7fc9f0114610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:25.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.059+0000 7fc9f6000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f0114c10 con 0x7fc9f01046a0 2024-04-26T21:34:25.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.059+0000 7fc9f6000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f0114d80 con 0x7fc9f01033f0 2024-04-26T21:34:25.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.059+0000 7fc9e6a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9f01046a0 0x7fc9f0114610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:25.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.059+0000 7fc9ef400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc9f01033f0 0x7fc9f01140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:25.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.059+0000 7fc9e6a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9f01046a0 0x7fc9f0114610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41118/0 (socket says 172.21.15.84:41118) 2024-04-26T21:34:25.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.059+0000 7fc9e6a00700 1 -- 172.21.15.84:0/3235319015 learned_addr learned my addr 172.21.15.84:0/3235319015 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:34:25.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.060+0000 7fc9e6a00700 1 -- 172.21.15.84:0/3235319015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc9f01033f0 msgr2=0x7fc9f01140d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:25.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.060+0000 7fc9e6a00700 1 --2- 172.21.15.84:0/3235319015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc9f01033f0 0x7fc9f01140d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:25.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.060+0000 7fc9e6a00700 1 -- 172.21.15.84:0/3235319015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e0009940 con 0x7fc9f01046a0 2024-04-26T21:34:25.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.060+0000 7fc9e6a00700 1 --2- 172.21.15.84:0/3235319015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9f01046a0 0x7fc9f0114610 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8002a50 tx=0x7fc9d80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:25.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.060+0000 7fc9e7e00700 1 -- 172.21.15.84:0/3235319015 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9d8007cc0 con 0x7fc9f01046a0 2024-04-26T21:34:25.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.060+0000 7fc9e7e00700 1 -- 172.21.15.84:0/3235319015 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9d800f040 con 0x7fc9f01046a0 2024-04-26T21:34:25.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.060+0000 7fc9e7e00700 1 -- 172.21.15.84:0/3235319015 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9d800da30 con 0x7fc9f01046a0 2024-04-26T21:34:25.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.060+0000 7fc9f6000700 1 -- 172.21.15.84:0/3235319015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f01197e0 con 0x7fc9f01046a0 2024-04-26T21:34:25.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.061+0000 7fc9f6000700 1 -- 172.21.15.84:0/3235319015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f0119da0 con 0x7fc9f01046a0 2024-04-26T21:34:25.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.062+0000 7fc9f6000700 1 -- 172.21.15.84:0/3235319015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f004c710 con 0x7fc9f01046a0 2024-04-26T21:34:25.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.063+0000 7fc9e7e00700 1 -- 172.21.15.84:0/3235319015 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc9d800db90 con 0x7fc9f01046a0 2024-04-26T21:34:25.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.064+0000 7fc9e7e00700 1 --2- 172.21.15.84:0/3235319015 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc9d406ec00 0x7fc9d40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:25.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.064+0000 7fc9e7e00700 1 -- 172.21.15.84:0/3235319015 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fc9d808e700 con 0x7fc9f01046a0 2024-04-26T21:34:25.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.064+0000 7fc9ef400700 1 --2- 172.21.15.84:0/3235319015 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc9d406ec00 0x7fc9d40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:25.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.065+0000 7fc9ef400700 1 --2- 172.21.15.84:0/3235319015 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc9d406ec00 0x7fc9d40710b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0015040 tx=0x7fc9e0004d10 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:25.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.068+0000 7fc9e7e00700 1 -- 172.21.15.84:0/3235319015 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fc9d805aeb0 con 0x7fc9f01046a0 2024-04-26T21:34:25.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:24 smithi120 ceph-mon[79001]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:34:25.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:24 smithi120 ceph-mon[79001]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:34:25.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:24 smithi120 ceph-mon[79001]: pgmap v248: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:25.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:24 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/1445070846' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:25.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:24 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:25.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:24 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:25.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:24 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/1392424637' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:34:25.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.360+0000 7fc9f6000700 1 -- 172.21.15.84:0/3235319015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc9f011a220 con 0x7fc9f01046a0 2024-04-26T21:34:25.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.361+0000 7fc9e7e00700 1 -- 172.21.15.84:0/3235319015 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fc9d805aa40 con 0x7fc9f01046a0 2024-04-26T21:34:25.363 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:24 smithi084 ceph-mon[90138]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:34:25.363 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:24 smithi084 ceph-mon[90138]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:34:25.363 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:24 smithi084 ceph-mon[90138]: pgmap v248: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:25.363 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:24 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/1445070846' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:25.363 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:24 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:25.363 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:24 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:25.363 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:24 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/1392424637' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:34:25.363 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:34:25.363 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:34:25.363 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:34:25.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.363+0000 7fc9f6000700 1 -- 172.21.15.84:0/3235319015 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc9d406ec00 msgr2=0x7fc9d40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:25.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.363+0000 7fc9f6000700 1 --2- 172.21.15.84:0/3235319015 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc9d406ec00 0x7fc9d40710b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0015040 tx=0x7fc9e0004d10 comp rx=0 tx=0).stop 2024-04-26T21:34:25.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.364+0000 7fc9f6000700 1 -- 172.21.15.84:0/3235319015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9f01046a0 msgr2=0x7fc9f0114610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:25.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.364+0000 7fc9f6000700 1 --2- 172.21.15.84:0/3235319015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9f01046a0 0x7fc9f0114610 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8002a50 tx=0x7fc9d80046b0 comp rx=0 tx=0).stop 2024-04-26T21:34:25.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.364+0000 7fc9f6000700 1 -- 172.21.15.84:0/3235319015 shutdown_connections 2024-04-26T21:34:25.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.364+0000 7fc9f6000700 1 --2- 172.21.15.84:0/3235319015 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc9d406ec00 0x7fc9d40710b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:25.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.364+0000 7fc9f6000700 1 --2- 172.21.15.84:0/3235319015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc9f01033f0 0x7fc9f01140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:25.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.364+0000 7fc9f6000700 1 --2- 172.21.15.84:0/3235319015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9f01046a0 0x7fc9f0114610 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:25.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.364+0000 7fc9f6000700 1 -- 172.21.15.84:0/3235319015 >> 172.21.15.84:0/3235319015 conn(0x7fc9f00725e0 msgr2=0x7fc9f0073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:25.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.364+0000 7fc9f6000700 1 -- 172.21.15.84:0/3235319015 shutdown_connections 2024-04-26T21:34:25.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:25.364+0000 7fc9f6000700 1 -- 172.21.15.84:0/3235319015 wait complete. 2024-04-26T21:34:26.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:25 smithi120 ceph-mon[79001]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:34:26.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:25 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3235319015' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:34:26.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:25 smithi084 ceph-mon[90138]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:34:26.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:25 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3235319015' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:34:27.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:26 smithi084 ceph-mon[90138]: pgmap v249: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:27.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:26 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:27.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:26 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:27.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:26 smithi120 ceph-mon[79001]: pgmap v249: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:27.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:26 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:27.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:26 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:29.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:28 smithi120 ceph-mon[79001]: pgmap v250: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:28 smithi084 ceph-mon[90138]: pgmap v250: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:30.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:29 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:34:30.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:29 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:34:31.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:30 smithi084 ceph-mon[90138]: pgmap v251: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:30 smithi120 ceph-mon[79001]: pgmap v251: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:33.281 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:32 smithi120 ceph-mon[79001]: pgmap v252: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:33.281 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:32 smithi120 ceph-mon[79001]: Detected new or changed devices on smithi120 2024-04-26T21:34:33.281 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:33.281 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:33.281 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:34:33.282 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:34:33.282 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:33.282 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:34:33.282 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:33.282 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:33.283 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:33.283 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:33.283 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi120.ufqfoh"]}]: dispatch 2024-04-26T21:34:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:32 smithi084 ceph-mon[90138]: pgmap v252: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:32 smithi084 ceph-mon[90138]: Detected new or changed devices on smithi120 2024-04-26T21:34:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:34:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:34:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:34:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:33.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi120.ufqfoh"]}]: dispatch 2024-04-26T21:34:34.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:34 smithi120 ceph-mon[79001]: Upgrade: It appears safe to stop mds.cephfs.smithi120.ufqfoh 2024-04-26T21:34:34.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:34 smithi084 ceph-mon[90138]: Upgrade: It appears safe to stop mds.cephfs.smithi120.ufqfoh 2024-04-26T21:34:35.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:35 smithi084 ceph-mon[90138]: pgmap v253: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:35.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:35 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:35.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:35 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.ufqfoh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:34:35.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:35 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:34:35.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:35 smithi120 ceph-mon[79001]: pgmap v253: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:35.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:35 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:35.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:35 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi120.ufqfoh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:34:35.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:35 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:34:36.135 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:36 smithi120 ceph-mon[79001]: Upgrade: Updating mds.cephfs.smithi120.ufqfoh 2024-04-26T21:34:36.135 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:36 smithi120 ceph-mon[79001]: Deploying daemon mds.cephfs.smithi120.ufqfoh on smithi120 2024-04-26T21:34:36.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:36 smithi084 ceph-mon[90138]: Upgrade: Updating mds.cephfs.smithi120.ufqfoh 2024-04-26T21:34:36.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:36 smithi084 ceph-mon[90138]: Deploying daemon mds.cephfs.smithi120.ufqfoh on smithi120 2024-04-26T21:34:37.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:37 smithi120 ceph-mon[79001]: pgmap v254: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:37.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:37 smithi084 ceph-mon[90138]: pgmap v254: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:38.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:37 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084[90134]: 2024-04-26T21:34:37.841+0000 7fb171000700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:34:38.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:38 smithi084 ceph-mon[90138]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T21:34:38.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:38 smithi084 ceph-mon[90138]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:34:38.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:38 smithi084 ceph-mon[90138]: osdmap e94: 6 total, 6 up, 6 in 2024-04-26T21:34:38.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:38 smithi084 ceph-mon[90138]: Standby daemon mds.cephfs.smithi084.hbjunw assigned to filesystem cephfs as rank 0 2024-04-26T21:34:38.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:38 smithi084 ceph-mon[90138]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T21:34:38.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:38 smithi084 ceph-mon[90138]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-26T21:34:38.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:38 smithi084 ceph-mon[90138]: fsmap cephfs:1/1 {0=cephfs.smithi084.hbjunw=up:replay} 2 up:standby 2024-04-26T21:34:38.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:38 smithi120 ceph-mon[79001]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T21:34:38.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:38 smithi120 ceph-mon[79001]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:34:38.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:38 smithi120 ceph-mon[79001]: osdmap e94: 6 total, 6 up, 6 in 2024-04-26T21:34:38.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:38 smithi120 ceph-mon[79001]: Standby daemon mds.cephfs.smithi084.hbjunw assigned to filesystem cephfs as rank 0 2024-04-26T21:34:38.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:38 smithi120 ceph-mon[79001]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T21:34:38.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:38 smithi120 ceph-mon[79001]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-26T21:34:38.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:38 smithi120 ceph-mon[79001]: fsmap cephfs:1/1 {0=cephfs.smithi084.hbjunw=up:replay} 2 up:standby 2024-04-26T21:34:39.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:39 smithi084 ceph-mon[90138]: pgmap v256: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:39.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:39 smithi120 ceph-mon[79001]: pgmap v256: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:34:40.409 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.ufqfoh"}]: dispatch 2024-04-26T21:34:40.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.ufqfoh"}]: dispatch 2024-04-26T21:34:41.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:41 smithi084 ceph-mon[90138]: pgmap v257: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 5.6 MiB/s rd, 2 op/s 2024-04-26T21:34:41.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:41 smithi120 ceph-mon[79001]: pgmap v257: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 5.6 MiB/s rd, 2 op/s 2024-04-26T21:34:43.361 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:43 smithi120 ceph-mon[79001]: pgmap v258: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 6.4 MiB/s rd, 2 op/s 2024-04-26T21:34:43.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:43 smithi084 ceph-mon[90138]: pgmap v258: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 6.4 MiB/s rd, 2 op/s 2024-04-26T21:34:45.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:45 smithi120 ceph-mon[79001]: pgmap v259: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-26T21:34:45.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:45.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:34:45.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:45 smithi120 ceph-mon[79001]: reconnect by client.14520 192.168.0.1:0/2483101042 after 0.00199997 2024-04-26T21:34:45.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:45 smithi120 ceph-mon[79001]: reconnect by client.24273 192.168.0.1:0/1517871093 after 0.00199997 2024-04-26T21:34:45.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:45 smithi120 ceph-mon[79001]: mds.? [v2:172.21.15.84:6826/1392878113,v1:172.21.15.84:6827/1392878113] up:reconnect 2024-04-26T21:34:45.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:45 smithi120 ceph-mon[79001]: fsmap cephfs:1/1 {0=cephfs.smithi084.hbjunw=up:reconnect} 2 up:standby 2024-04-26T21:34:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:45 smithi084 ceph-mon[90138]: pgmap v259: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-26T21:34:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:34:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:45 smithi084 ceph-mon[90138]: reconnect by client.14520 192.168.0.1:0/2483101042 after 0.00199997 2024-04-26T21:34:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:45 smithi084 ceph-mon[90138]: reconnect by client.24273 192.168.0.1:0/1517871093 after 0.00199997 2024-04-26T21:34:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:45 smithi084 ceph-mon[90138]: mds.? [v2:172.21.15.84:6826/1392878113,v1:172.21.15.84:6827/1392878113] up:reconnect 2024-04-26T21:34:45.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:45 smithi084 ceph-mon[90138]: fsmap cephfs:1/1 {0=cephfs.smithi084.hbjunw=up:reconnect} 2 up:standby 2024-04-26T21:34:46.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:46 smithi120 ceph-mon[79001]: mds.? [v2:172.21.15.84:6826/1392878113,v1:172.21.15.84:6827/1392878113] up:rejoin 2024-04-26T21:34:46.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:46 smithi120 ceph-mon[79001]: mds.? [v2:172.21.15.120:6826/2847041344,v1:172.21.15.120:6827/2847041344] up:boot 2024-04-26T21:34:46.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:46 smithi120 ceph-mon[79001]: fsmap cephfs:1/1 {0=cephfs.smithi084.hbjunw=up:rejoin} 3 up:standby 2024-04-26T21:34:46.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.ufqfoh"}]: dispatch 2024-04-26T21:34:46.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:46.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:46 smithi120 ceph-mon[79001]: daemon mds.cephfs.smithi084.hbjunw is now active in filesystem cephfs as rank 0 2024-04-26T21:34:46.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:46.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:34:46.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:46.403 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:46.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:46 smithi084 ceph-mon[90138]: mds.? [v2:172.21.15.84:6826/1392878113,v1:172.21.15.84:6827/1392878113] up:rejoin 2024-04-26T21:34:46.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:46 smithi084 ceph-mon[90138]: mds.? [v2:172.21.15.120:6826/2847041344,v1:172.21.15.120:6827/2847041344] up:boot 2024-04-26T21:34:46.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:46 smithi084 ceph-mon[90138]: fsmap cephfs:1/1 {0=cephfs.smithi084.hbjunw=up:rejoin} 3 up:standby 2024-04-26T21:34:46.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi120.ufqfoh"}]: dispatch 2024-04-26T21:34:46.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:46.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:46 smithi084 ceph-mon[90138]: daemon mds.cephfs.smithi084.hbjunw is now active in filesystem cephfs as rank 0 2024-04-26T21:34:46.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:46.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:34:46.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:46.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:47.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:47 smithi084 ceph-mon[90138]: pgmap v260: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-26T21:34:47.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:47 smithi084 ceph-mon[90138]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T21:34:47.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:47 smithi084 ceph-mon[90138]: mds.? [v2:172.21.15.84:6826/1392878113,v1:172.21.15.84:6827/1392878113] up:active 2024-04-26T21:34:47.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:47 smithi084 ceph-mon[90138]: fsmap cephfs:1 {0=cephfs.smithi084.hbjunw=up:active} 3 up:standby 2024-04-26T21:34:47.420 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:47 smithi120 ceph-mon[79001]: pgmap v260: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-26T21:34:47.420 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:47 smithi120 ceph-mon[79001]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T21:34:47.420 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:47 smithi120 ceph-mon[79001]: mds.? [v2:172.21.15.84:6826/1392878113,v1:172.21.15.84:6827/1392878113] up:active 2024-04-26T21:34:47.420 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:47 smithi120 ceph-mon[79001]: fsmap cephfs:1 {0=cephfs.smithi084.hbjunw=up:active} 3 up:standby 2024-04-26T21:34:48.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:48 smithi084 ceph-mon[90138]: pgmap v261: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-26T21:34:48.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:48 smithi120 ceph-mon[79001]: pgmap v261: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-26T21:34:49.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:49 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:49.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:49 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:49.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:49 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:49.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:49 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:50.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:50 smithi084 ceph-mon[90138]: pgmap v262: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 7 op/s 2024-04-26T21:34:50.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:50 smithi120 ceph-mon[79001]: pgmap v262: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 7 op/s 2024-04-26T21:34:51.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:51 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:51.933 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:51 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:52.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:51 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:52.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:51 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:52.922 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:52 smithi120 ceph-mon[79001]: pgmap v263: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 8.4 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:34:53.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:52 smithi084 ceph-mon[90138]: pgmap v263: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 8.4 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:34:55.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:54 smithi084 ceph-mon[90138]: pgmap v264: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 7.8 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:34:55.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:54 smithi120 ceph-mon[79001]: pgmap v264: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 7.8 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:34:55.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.530+0000 7f66ee000700 1 -- 172.21.15.84:0/1424143438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e8070940 msgr2=0x7f66e8070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:55.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.530+0000 7f66ee000700 1 --2- 172.21.15.84:0/1424143438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e8070940 0x7f66e8070db0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f66d0004940 tx=0x7f66d0009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:55.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.531+0000 7f66ee000700 1 -- 172.21.15.84:0/1424143438 shutdown_connections 2024-04-26T21:34:55.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.531+0000 7f66ee000700 1 --2- 172.21.15.84:0/1424143438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e8070940 0x7f66e8070db0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:55.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.531+0000 7f66ee000700 1 --2- 172.21.15.84:0/1424143438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66e8071ef0 0x7f66e8070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:55.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.531+0000 7f66ee000700 1 -- 172.21.15.84:0/1424143438 >> 172.21.15.84:0/1424143438 conn(0x7f66e80f8560 msgr2=0x7f66e80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:55.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.531+0000 7f66ee000700 1 -- 172.21.15.84:0/1424143438 shutdown_connections 2024-04-26T21:34:55.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.531+0000 7f66ee000700 1 -- 172.21.15.84:0/1424143438 wait complete. 2024-04-26T21:34:55.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.532+0000 7f66ee000700 1 Processor -- start 2024-04-26T21:34:55.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.532+0000 7f66ee000700 1 -- start start 2024-04-26T21:34:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.532+0000 7f66ee000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66e8070940 0x7f66e810fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.532+0000 7f66ee000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e8071ef0 0x7f66e8110110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.532+0000 7f66ee000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e8110710 con 0x7f66e8071ef0 2024-04-26T21:34:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.532+0000 7f66ee000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e8110f60 con 0x7f66e8070940 2024-04-26T21:34:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.533+0000 7f66dfe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e8071ef0 0x7f66e8110110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.533+0000 7f66dfe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e8071ef0 0x7f66e8110110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55482/0 (socket says 172.21.15.84:55482) 2024-04-26T21:34:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.533+0000 7f66dfe00700 1 -- 172.21.15.84:0/604493648 learned_addr learned my addr 172.21.15.84:0/604493648 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:34:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.533+0000 7f66e7400700 1 --2- 172.21.15.84:0/604493648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66e8070940 0x7f66e810fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.533+0000 7f66dfe00700 1 -- 172.21.15.84:0/604493648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66e8070940 msgr2=0x7f66e810fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.533+0000 7f66dfe00700 1 --2- 172.21.15.84:0/604493648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66e8070940 0x7f66e810fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.533+0000 7f66dfe00700 1 -- 172.21.15.84:0/604493648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d0005040 con 0x7f66e8071ef0 2024-04-26T21:34:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.533+0000 7f66dfe00700 1 --2- 172.21.15.84:0/604493648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e8071ef0 0x7f66e8110110 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f66d000b3b0 tx=0x7f66d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.534+0000 7f66df400700 1 -- 172.21.15.84:0/604493648 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66d000e040 con 0x7f66e8071ef0 2024-04-26T21:34:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.534+0000 7f66df400700 1 -- 172.21.15.84:0/604493648 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f66d0004290 con 0x7f66e8071ef0 2024-04-26T21:34:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.534+0000 7f66df400700 1 -- 172.21.15.84:0/604493648 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66d001c630 con 0x7f66e8071ef0 2024-04-26T21:34:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.534+0000 7f66ee000700 1 -- 172.21.15.84:0/604493648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e81111e0 con 0x7f66e8071ef0 2024-04-26T21:34:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.534+0000 7f66ee000700 1 -- 172.21.15.84:0/604493648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e8111720 con 0x7f66e8071ef0 2024-04-26T21:34:55.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.535+0000 7f66ee000700 1 -- 172.21.15.84:0/604493648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e805f5c0 con 0x7f66e8071ef0 2024-04-26T21:34:55.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.536+0000 7f66df400700 1 -- 172.21.15.84:0/604493648 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f66d000bbf0 con 0x7f66e8071ef0 2024-04-26T21:34:55.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.538+0000 7f66df400700 1 --2- 172.21.15.84:0/604493648 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f66cc06ec10 0x7f66cc0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:55.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.538+0000 7f66df400700 1 -- 172.21.15.84:0/604493648 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f66d008fdf0 con 0x7f66e8071ef0 2024-04-26T21:34:55.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.538+0000 7f66e7400700 1 --2- 172.21.15.84:0/604493648 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f66cc06ec10 0x7f66cc0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:55.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.539+0000 7f66e7400700 1 --2- 172.21.15.84:0/604493648 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f66cc06ec10 0x7f66cc0710c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009fd0 tx=0x7f66d8009f00 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:55.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.543+0000 7f66df400700 1 -- 172.21.15.84:0/604493648 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f66d005c5d0 con 0x7f66e8071ef0 2024-04-26T21:34:55.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.791+0000 7f66ee000700 1 -- 172.21.15.84:0/604493648 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f66e8111b00 con 0x7f66cc06ec10 2024-04-26T21:34:55.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.794+0000 7f66df400700 1 -- 172.21.15.84:0/604493648 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f66e8111b00 con 0x7f66cc06ec10 2024-04-26T21:34:55.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.797+0000 7f66ee000700 1 -- 172.21.15.84:0/604493648 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f66cc06ec10 msgr2=0x7f66cc0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:55.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.797+0000 7f66ee000700 1 --2- 172.21.15.84:0/604493648 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f66cc06ec10 0x7f66cc0710c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009fd0 tx=0x7f66d8009f00 comp rx=0 tx=0).stop 2024-04-26T21:34:55.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.797+0000 7f66ee000700 1 -- 172.21.15.84:0/604493648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e8071ef0 msgr2=0x7f66e8110110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:55.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.797+0000 7f66ee000700 1 --2- 172.21.15.84:0/604493648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e8071ef0 0x7f66e8110110 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f66d000b3b0 tx=0x7f66d0009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:55.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.797+0000 7f66ee000700 1 -- 172.21.15.84:0/604493648 shutdown_connections 2024-04-26T21:34:55.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.797+0000 7f66ee000700 1 --2- 172.21.15.84:0/604493648 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f66cc06ec10 0x7f66cc0710c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:55.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.797+0000 7f66ee000700 1 --2- 172.21.15.84:0/604493648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66e8070940 0x7f66e810fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:55.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.797+0000 7f66ee000700 1 --2- 172.21.15.84:0/604493648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e8071ef0 0x7f66e8110110 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:55.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.797+0000 7f66ee000700 1 -- 172.21.15.84:0/604493648 >> 172.21.15.84:0/604493648 conn(0x7f66e80f8560 msgr2=0x7f66e80f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:55.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.797+0000 7f66ee000700 1 -- 172.21.15.84:0/604493648 shutdown_connections 2024-04-26T21:34:55.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.798+0000 7f66ee000700 1 -- 172.21.15.84:0/604493648 wait complete. 2024-04-26T21:34:55.817 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:34:55.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.958+0000 7f0607400700 1 -- 172.21.15.84:0/3618750120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06000ffee0 msgr2=0x7f0600102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:55.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.958+0000 7f0607400700 1 --2- 172.21.15.84:0/3618750120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06000ffee0 0x7f0600102300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f05ec004940 tx=0x7f05ec009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:55.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.958+0000 7f0607400700 1 -- 172.21.15.84:0/3618750120 shutdown_connections 2024-04-26T21:34:55.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.958+0000 7f0607400700 1 --2- 172.21.15.84:0/3618750120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06000ffee0 0x7f0600102300 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:55.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.958+0000 7f0607400700 1 --2- 172.21.15.84:0/3618750120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06000662c0 0x7f06000ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:55.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.958+0000 7f0607400700 1 -- 172.21.15.84:0/3618750120 >> 172.21.15.84:0/3618750120 conn(0x7f06000f7430 msgr2=0x7f06000f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:55.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.958+0000 7f0607400700 1 -- 172.21.15.84:0/3618750120 shutdown_connections 2024-04-26T21:34:55.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.958+0000 7f0607400700 1 -- 172.21.15.84:0/3618750120 wait complete. 2024-04-26T21:34:55.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.959+0000 7f0607400700 1 Processor -- start 2024-04-26T21:34:55.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.959+0000 7f0607400700 1 -- start start 2024-04-26T21:34:55.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.960+0000 7f0607400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06000662c0 0x7f060010fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:55.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.960+0000 7f0607400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06000ffee0 0x7f0600110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:55.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.960+0000 7f0607400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0600110790 con 0x7f06000ffee0 2024-04-26T21:34:55.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.960+0000 7f0607400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0600110fe0 con 0x7f06000662c0 2024-04-26T21:34:55.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.960+0000 7f05ffe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06000ffee0 0x7f0600110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:55.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.960+0000 7f05ffe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06000ffee0 0x7f0600110190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55486/0 (socket says 172.21.15.84:55486) 2024-04-26T21:34:55.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.960+0000 7f05ffe00700 1 -- 172.21.15.84:0/1691015919 learned_addr learned my addr 172.21.15.84:0/1691015919 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:34:55.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.960+0000 7f0604a00700 1 --2- 172.21.15.84:0/1691015919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06000662c0 0x7f060010fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:55.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.961+0000 7f05ffe00700 1 -- 172.21.15.84:0/1691015919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06000662c0 msgr2=0x7f060010fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:55.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.961+0000 7f05ffe00700 1 --2- 172.21.15.84:0/1691015919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06000662c0 0x7f060010fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:55.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.961+0000 7f05ffe00700 1 -- 172.21.15.84:0/1691015919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec005040 con 0x7f06000ffee0 2024-04-26T21:34:55.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.961+0000 7f0604a00700 1 --2- 172.21.15.84:0/1691015919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06000662c0 0x7f060010fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:34:55.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.961+0000 7f05ffe00700 1 --2- 172.21.15.84:0/1691015919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06000ffee0 0x7f0600110190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009150 tx=0x7f05ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:55.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.961+0000 7f05fcc00700 1 -- 172.21.15.84:0/1691015919 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05ec00e040 con 0x7f06000ffee0 2024-04-26T21:34:55.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.961+0000 7f05fcc00700 1 -- 172.21.15.84:0/1691015919 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f05ec00bbf0 con 0x7f06000ffee0 2024-04-26T21:34:55.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.961+0000 7f0607400700 1 -- 172.21.15.84:0/1691015919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0600111260 con 0x7f06000ffee0 2024-04-26T21:34:55.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.961+0000 7f05fcc00700 1 -- 172.21.15.84:0/1691015919 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05ec01c630 con 0x7f06000ffee0 2024-04-26T21:34:55.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.961+0000 7f0607400700 1 -- 172.21.15.84:0/1691015919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06001117a0 con 0x7f06000ffee0 2024-04-26T21:34:55.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.963+0000 7f0607400700 1 -- 172.21.15.84:0/1691015919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060005f5c0 con 0x7f06000ffee0 2024-04-26T21:34:55.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.964+0000 7f05fcc00700 1 -- 172.21.15.84:0/1691015919 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f05ec00bd60 con 0x7f06000ffee0 2024-04-26T21:34:55.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.968+0000 7f05fcc00700 1 --2- 172.21.15.84:0/1691015919 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f05e806ece0 0x7f05e8071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:55.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.968+0000 7f0604a00700 1 --2- 172.21.15.84:0/1691015919 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f05e806ece0 0x7f05e8071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:55.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.968+0000 7f05fcc00700 1 -- 172.21.15.84:0/1691015919 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f05ec08fdd0 con 0x7f06000ffee0 2024-04-26T21:34:55.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.969+0000 7f0604a00700 1 --2- 172.21.15.84:0/1691015919 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f05e806ece0 0x7f05e8071190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f05f4009fd0 tx=0x7f05f400b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:55.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:55.970+0000 7f05fcc00700 1 -- 172.21.15.84:0/1691015919 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f05ec093030 con 0x7f06000ffee0 2024-04-26T21:34:56.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.224+0000 7f0607400700 1 -- 172.21.15.84:0/1691015919 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0600111b90 con 0x7f05e806ece0 2024-04-26T21:34:56.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.226+0000 7f05fcc00700 1 -- 172.21.15.84:0/1691015919 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f0600111b90 con 0x7f05e806ece0 2024-04-26T21:34:56.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.229+0000 7f0607400700 1 -- 172.21.15.84:0/1691015919 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f05e806ece0 msgr2=0x7f05e8071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:56.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.229+0000 7f0607400700 1 --2- 172.21.15.84:0/1691015919 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f05e806ece0 0x7f05e8071190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f05f4009fd0 tx=0x7f05f400b040 comp rx=0 tx=0).stop 2024-04-26T21:34:56.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.229+0000 7f0607400700 1 -- 172.21.15.84:0/1691015919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06000ffee0 msgr2=0x7f0600110190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:56.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.229+0000 7f0607400700 1 --2- 172.21.15.84:0/1691015919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06000ffee0 0x7f0600110190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009150 tx=0x7f05ec009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:56.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.229+0000 7f0607400700 1 -- 172.21.15.84:0/1691015919 shutdown_connections 2024-04-26T21:34:56.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.229+0000 7f0607400700 1 --2- 172.21.15.84:0/1691015919 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f05e806ece0 0x7f05e8071190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:56.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.229+0000 7f0607400700 1 --2- 172.21.15.84:0/1691015919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06000662c0 0x7f060010fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:56.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.229+0000 7f0607400700 1 --2- 172.21.15.84:0/1691015919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06000ffee0 0x7f0600110190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:56.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.229+0000 7f0607400700 1 -- 172.21.15.84:0/1691015919 >> 172.21.15.84:0/1691015919 conn(0x7f06000f7430 msgr2=0x7f06000fba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:56.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.229+0000 7f0607400700 1 -- 172.21.15.84:0/1691015919 shutdown_connections 2024-04-26T21:34:56.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.229+0000 7f0607400700 1 -- 172.21.15.84:0/1691015919 wait complete. 2024-04-26T21:34:56.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.381+0000 7f2744000700 1 -- 172.21.15.84:0/3985697153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f273c0ff050 msgr2=0x7f273c0ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:56.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.381+0000 7f2744000700 1 --2- 172.21.15.84:0/3985697153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f273c0ff050 0x7f273c0ff460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2730004940 tx=0x7f2730009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:56.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.381+0000 7f2744000700 1 -- 172.21.15.84:0/3985697153 shutdown_connections 2024-04-26T21:34:56.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.381+0000 7f2744000700 1 --2- 172.21.15.84:0/3985697153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f273c100300 0x7f273c100770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:56.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.381+0000 7f2744000700 1 --2- 172.21.15.84:0/3985697153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f273c0ff050 0x7f273c0ff460 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:56.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.381+0000 7f2744000700 1 -- 172.21.15.84:0/3985697153 >> 172.21.15.84:0/3985697153 conn(0x7f273c0fa8f0 msgr2=0x7f273c0fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:56.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.381+0000 7f2744000700 1 -- 172.21.15.84:0/3985697153 shutdown_connections 2024-04-26T21:34:56.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.381+0000 7f2744000700 1 -- 172.21.15.84:0/3985697153 wait complete. 2024-04-26T21:34:56.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.382+0000 7f2744000700 1 Processor -- start 2024-04-26T21:34:56.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.382+0000 7f2744000700 1 -- start start 2024-04-26T21:34:56.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.383+0000 7f2744000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f273c0ff050 0x7f273c072750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:56.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.383+0000 7f2744000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f273c100300 0x7f273c072c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:56.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.383+0000 7f2744000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c073370 con 0x7f273c100300 2024-04-26T21:34:56.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.383+0000 7f2744000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c073b30 con 0x7f273c0ff050 2024-04-26T21:34:56.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.383+0000 7f2740c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f273c100300 0x7f273c072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:56.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.383+0000 7f2740c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f273c100300 0x7f273c072c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55510/0 (socket says 172.21.15.84:55510) 2024-04-26T21:34:56.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.383+0000 7f2740c00700 1 -- 172.21.15.84:0/2571774194 learned_addr learned my addr 172.21.15.84:0/2571774194 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:34:56.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.383+0000 7f2741600700 1 --2- 172.21.15.84:0/2571774194 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f273c0ff050 0x7f273c072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:56.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.384+0000 7f2740c00700 1 -- 172.21.15.84:0/2571774194 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f273c0ff050 msgr2=0x7f273c072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:56.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.384+0000 7f2740c00700 1 --2- 172.21.15.84:0/2571774194 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f273c0ff050 0x7f273c072750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:56.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.384+0000 7f2740c00700 1 -- 172.21.15.84:0/2571774194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2730005040 con 0x7f273c100300 2024-04-26T21:34:56.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.384+0000 7f2740c00700 1 --2- 172.21.15.84:0/2571774194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f273c100300 0x7f273c072c90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f272800b790 tx=0x7f2728009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:56.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.384+0000 7f2739600700 1 -- 172.21.15.84:0/2571774194 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f272800f770 con 0x7f273c100300 2024-04-26T21:34:56.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.384+0000 7f2739600700 1 -- 172.21.15.84:0/2571774194 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f272800fda0 con 0x7f273c100300 2024-04-26T21:34:56.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.384+0000 7f2739600700 1 -- 172.21.15.84:0/2571774194 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f272800d310 con 0x7f273c100300 2024-04-26T21:34:56.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.384+0000 7f2744000700 1 -- 172.21.15.84:0/2571774194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273c073e10 con 0x7f273c100300 2024-04-26T21:34:56.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.385+0000 7f2744000700 1 -- 172.21.15.84:0/2571774194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273c0743d0 con 0x7f273c100300 2024-04-26T21:34:56.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.386+0000 7f2744000700 1 -- 172.21.15.84:0/2571774194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273c05f5c0 con 0x7f273c100300 2024-04-26T21:34:56.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.387+0000 7f2739600700 1 -- 172.21.15.84:0/2571774194 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2728010420 con 0x7f273c100300 2024-04-26T21:34:56.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.389+0000 7f2739600700 1 --2- 172.21.15.84:0/2571774194 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f272406ec10 0x7f27240710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:56.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.389+0000 7f2739600700 1 -- 172.21.15.84:0/2571774194 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f272808e9f0 con 0x7f273c100300 2024-04-26T21:34:56.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.389+0000 7f2741600700 1 --2- 172.21.15.84:0/2571774194 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f272406ec10 0x7f27240710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:56.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.390+0000 7f2741600700 1 --2- 172.21.15.84:0/2571774194 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f272406ec10 0x7f27240710c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2730009fd0 tx=0x7f2730009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:56.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.393+0000 7f2739600700 1 -- 172.21.15.84:0/2571774194 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f27280576a0 con 0x7f273c100300 2024-04-26T21:34:56.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.642+0000 7f2744000700 1 -- 172.21.15.84:0/2571774194 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f273c074710 con 0x7f272406ec10 2024-04-26T21:34:56.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.672+0000 7f2739600700 1 -- 172.21.15.84:0/2571774194 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f273c074710 con 0x7f272406ec10 2024-04-26T21:34:56.673 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:34:56.674 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (9m) 54s ago 20m 14.9M - 0.25.0 c8568f914cd2 bcb419cf9108 2024-04-26T21:34:56.674 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (5m) 54s ago 20m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 b4010dfbe623 2024-04-26T21:34:56.674 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (5m) 8s ago 19m 6665k - 19.0.0-3306-gbc612ffb 55dc54019ad8 89a4e50ea23c 2024-04-26T21:34:56.674 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (9m) 54s ago 20m 75.3M - 9.4.7 954c08fa6188 1bf95f604e07 2024-04-26T21:34:56.674 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (89s) 54s ago 13m 11.2M - 19.0.0-3306-gbc612ffb 55dc54019ad8 26d10fe664bb 2024-04-26T21:34:56.674 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (61s) 54s ago 13m 11.0M - 19.0.0-3306-gbc612ffb 55dc54019ad8 c801ec16a810 2024-04-26T21:34:56.674 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (37s) 8s ago 13m 11.1M - 19.0.0-3306-gbc612ffb 55dc54019ad8 137a38b571df 2024-04-26T21:34:56.674 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (12s) 8s ago 13m 10.9M - 19.0.0-3306-gbc612ffb 55dc54019ad8 0f6be9e294cb 2024-04-26T21:34:56.674 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (9m) 54s ago 22m 510M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:34:56.674 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283,8765 running (7m) 8s ago 19m 454M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d6ae0b4628b5 2024-04-26T21:34:56.674 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (7m) 54s ago 22m 52.5M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 bf610abb6a62 2024-04-26T21:34:56.674 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (6m) 8s ago 19m 41.8M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 5d530496253b 2024-04-26T21:34:56.674 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (9m) 54s ago 20m 8321k - 1.5.0 0da6a335fe13 81e00b40bfbf 2024-04-26T21:34:56.674 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (9m) 8s ago 19m 8112k - 1.5.0 0da6a335fe13 0506a1d46ec4 2024-04-26T21:34:56.674 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (5m) 54s ago 18m 113M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 99fbe2faa51b 2024-04-26T21:34:56.675 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (4m) 54s ago 17m 98.0M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 2dc81d93f7e5 2024-04-26T21:34:56.675 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (4m) 54s ago 17m 90.1M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 9e77abf095bd 2024-04-26T21:34:56.675 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (3m) 8s ago 16m 96.4M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 d7e5825e2640 2024-04-26T21:34:56.675 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (2m) 8s ago 15m 87.7M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 894dcbaab8eb 2024-04-26T21:34:56.675 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (2m) 8s ago 15m 85.7M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 e39948e51a13 2024-04-26T21:34:56.675 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (8m) 54s ago 19m 60.0M - 2.43.0 a07b618ecd1d d3008b765eec 2024-04-26T21:34:56.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.674+0000 7f2744000700 1 -- 172.21.15.84:0/2571774194 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f272406ec10 msgr2=0x7f27240710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:56.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.674+0000 7f2744000700 1 --2- 172.21.15.84:0/2571774194 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f272406ec10 0x7f27240710c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2730009fd0 tx=0x7f2730009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:56.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.674+0000 7f2744000700 1 -- 172.21.15.84:0/2571774194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f273c100300 msgr2=0x7f273c072c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:56.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.674+0000 7f2744000700 1 --2- 172.21.15.84:0/2571774194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f273c100300 0x7f273c072c90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f272800b790 tx=0x7f2728009250 comp rx=0 tx=0).stop 2024-04-26T21:34:56.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.675+0000 7f2744000700 1 -- 172.21.15.84:0/2571774194 shutdown_connections 2024-04-26T21:34:56.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.675+0000 7f2744000700 1 --2- 172.21.15.84:0/2571774194 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f272406ec10 0x7f27240710c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:56.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.675+0000 7f2744000700 1 --2- 172.21.15.84:0/2571774194 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f273c0ff050 0x7f273c072750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:56.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.675+0000 7f2744000700 1 --2- 172.21.15.84:0/2571774194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f273c100300 0x7f273c072c90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:56.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.675+0000 7f2744000700 1 -- 172.21.15.84:0/2571774194 >> 172.21.15.84:0/2571774194 conn(0x7f273c0fa8f0 msgr2=0x7f273c0fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:56.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.675+0000 7f2744000700 1 -- 172.21.15.84:0/2571774194 shutdown_connections 2024-04-26T21:34:56.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.675+0000 7f2744000700 1 -- 172.21.15.84:0/2571774194 wait complete. 2024-04-26T21:34:56.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.819+0000 7f5cec000700 1 -- 172.21.15.84:0/1721366994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ce41046a0 msgr2=0x7f5ce4104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:56.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.819+0000 7f5cec000700 1 --2- 172.21.15.84:0/1721366994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ce41046a0 0x7f5ce4104b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0004940 tx=0x7f5cd0009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:56.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.819+0000 7f5cec000700 1 -- 172.21.15.84:0/1721366994 shutdown_connections 2024-04-26T21:34:56.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.819+0000 7f5cec000700 1 --2- 172.21.15.84:0/1721366994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ce41046a0 0x7f5ce4104b10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:56.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.819+0000 7f5cec000700 1 --2- 172.21.15.84:0/1721366994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ce41033f0 0x7f5ce4103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:56.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.819+0000 7f5cec000700 1 -- 172.21.15.84:0/1721366994 >> 172.21.15.84:0/1721366994 conn(0x7f5ce40725e0 msgr2=0x7f5ce4074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:56.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.819+0000 7f5cec000700 1 -- 172.21.15.84:0/1721366994 shutdown_connections 2024-04-26T21:34:56.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.819+0000 7f5cec000700 1 -- 172.21.15.84:0/1721366994 wait complete. 2024-04-26T21:34:56.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.820+0000 7f5cec000700 1 Processor -- start 2024-04-26T21:34:56.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.821+0000 7f5cec000700 1 -- start start 2024-04-26T21:34:56.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.821+0000 7f5cec000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ce41033f0 0x7f5ce4113ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:56.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.821+0000 7f5cec000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ce41046a0 0x7f5ce4114430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:56.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.821+0000 7f5cec000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce4114a30 con 0x7f5ce41046a0 2024-04-26T21:34:56.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.821+0000 7f5cec000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce4114ba0 con 0x7f5ce41033f0 2024-04-26T21:34:56.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.821+0000 7f5ce8c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ce41046a0 0x7f5ce4114430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:56.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.821+0000 7f5ce8c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ce41046a0 0x7f5ce4114430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55524/0 (socket says 172.21.15.84:55524) 2024-04-26T21:34:56.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.821+0000 7f5ce8c00700 1 -- 172.21.15.84:0/1157045557 learned_addr learned my addr 172.21.15.84:0/1157045557 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:34:56.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.821+0000 7f5ce9600700 1 --2- 172.21.15.84:0/1157045557 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ce41033f0 0x7f5ce4113ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:56.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.822+0000 7f5ce8c00700 1 -- 172.21.15.84:0/1157045557 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ce41033f0 msgr2=0x7f5ce4113ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:56.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.822+0000 7f5ce8c00700 1 --2- 172.21.15.84:0/1157045557 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ce41033f0 0x7f5ce4113ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:56.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.822+0000 7f5ce8c00700 1 -- 172.21.15.84:0/1157045557 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd0005040 con 0x7f5ce41046a0 2024-04-26T21:34:56.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.822+0000 7f5ce8c00700 1 --2- 172.21.15.84:0/1157045557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ce41046a0 0x7f5ce4114430 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000b3b0 tx=0x7f5cd0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:56.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.822+0000 7f5ce1600700 1 -- 172.21.15.84:0/1157045557 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cd000e040 con 0x7f5ce41046a0 2024-04-26T21:34:56.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.822+0000 7f5ce1600700 1 -- 172.21.15.84:0/1157045557 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5cd0004290 con 0x7f5ce41046a0 2024-04-26T21:34:56.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.822+0000 7f5ce1600700 1 -- 172.21.15.84:0/1157045557 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cd001c630 con 0x7f5ce41046a0 2024-04-26T21:34:56.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.822+0000 7f5cec000700 1 -- 172.21.15.84:0/1157045557 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce41195a0 con 0x7f5ce41046a0 2024-04-26T21:34:56.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.823+0000 7f5cec000700 1 -- 172.21.15.84:0/1157045557 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce4119b10 con 0x7f5ce41046a0 2024-04-26T21:34:56.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.824+0000 7f5cec000700 1 -- 172.21.15.84:0/1157045557 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce404c710 con 0x7f5ce41046a0 2024-04-26T21:34:56.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.825+0000 7f5ce1600700 1 -- 172.21.15.84:0/1157045557 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5cd000bbf0 con 0x7f5ce41046a0 2024-04-26T21:34:56.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.826+0000 7f5ce1600700 1 --2- 172.21.15.84:0/1157045557 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5ccc06ec00 0x7f5ccc0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:56.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.826+0000 7f5ce1600700 1 -- 172.21.15.84:0/1157045557 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f5cd008fe20 con 0x7f5ce41046a0 2024-04-26T21:34:56.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.826+0000 7f5ce9600700 1 --2- 172.21.15.84:0/1157045557 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5ccc06ec00 0x7f5ccc0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:56.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.827+0000 7f5ce9600700 1 --2- 172.21.15.84:0/1157045557 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5ccc06ec00 0x7f5ccc0710b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8007fd0 tx=0x7f5cd8009040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:56.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:56.831+0000 7f5ce1600700 1 -- 172.21.15.84:0/1157045557 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f5cd005c620 con 0x7f5ce41046a0 2024-04-26T21:34:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.132+0000 7f5cec000700 1 -- 172.21.15.84:0/1157045557 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5ce410bee0 con 0x7f5ce41046a0 2024-04-26T21:34:57.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.133+0000 7f5ce1600700 1 -- 172.21.15.84:0/1157045557 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f5cd005c1b0 con 0x7f5ce41046a0 2024-04-26T21:34:57.135 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:34:57.135 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:34:57.135 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:34:57.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:34:57.135 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:34:57.136 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:34:57.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:34:57.136 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:34:57.136 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 6 2024-04-26T21:34:57.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:34:57.136 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:34:57.136 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 4 2024-04-26T21:34:57.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:34:57.136 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:34:57.136 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 14 2024-04-26T21:34:57.136 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:34:57.136 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:34:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.136+0000 7f5cec000700 1 -- 172.21.15.84:0/1157045557 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5ccc06ec00 msgr2=0x7f5ccc0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.136+0000 7f5cec000700 1 --2- 172.21.15.84:0/1157045557 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5ccc06ec00 0x7f5ccc0710b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8007fd0 tx=0x7f5cd8009040 comp rx=0 tx=0).stop 2024-04-26T21:34:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.136+0000 7f5cec000700 1 -- 172.21.15.84:0/1157045557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ce41046a0 msgr2=0x7f5ce4114430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.136+0000 7f5cec000700 1 --2- 172.21.15.84:0/1157045557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ce41046a0 0x7f5ce4114430 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000b3b0 tx=0x7f5cd0009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.136+0000 7f5cec000700 1 -- 172.21.15.84:0/1157045557 shutdown_connections 2024-04-26T21:34:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.136+0000 7f5cec000700 1 --2- 172.21.15.84:0/1157045557 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5ccc06ec00 0x7f5ccc0710b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.136+0000 7f5cec000700 1 --2- 172.21.15.84:0/1157045557 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ce41033f0 0x7f5ce4113ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.136+0000 7f5cec000700 1 --2- 172.21.15.84:0/1157045557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ce41046a0 0x7f5ce4114430 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.136+0000 7f5cec000700 1 -- 172.21.15.84:0/1157045557 >> 172.21.15.84:0/1157045557 conn(0x7f5ce40725e0 msgr2=0x7f5ce4073c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.136+0000 7f5cec000700 1 -- 172.21.15.84:0/1157045557 shutdown_connections 2024-04-26T21:34:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.136+0000 7f5cec000700 1 -- 172.21.15.84:0/1157045557 wait complete. 2024-04-26T21:34:57.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:34:57.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: pgmap v265: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-04-26T21:34:57.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:57.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:57.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:34:57.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:34:57.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:57.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:34:57.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:57.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:57.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:57.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:57.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:57.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:57.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi084.hbjunw"}]: dispatch 2024-04-26T21:34:57.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi084.hbjunw"}]': finished 2024-04-26T21:34:57.185 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi084.rtrqtr"}]: dispatch 2024-04-26T21:34:57.186 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi084.rtrqtr"}]': finished 2024-04-26T21:34:57.186 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi120.qnkxcn"}]: dispatch 2024-04-26T21:34:57.186 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi120.qnkxcn"}]': finished 2024-04-26T21:34:57.186 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi120.ufqfoh"}]: dispatch 2024-04-26T21:34:57.186 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi120.ufqfoh"}]': finished 2024-04-26T21:34:57.186 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-04-26T21:34:57.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.290+0000 7fe9b0000700 1 -- 172.21.15.84:0/1398227507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9a80fcf60 msgr2=0x7fe9a80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:57.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.290+0000 7fe9b0000700 1 --2- 172.21.15.84:0/1398227507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9a80fcf60 0x7fe9a80fd3d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe994004940 tx=0x7fe994009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:57.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.290+0000 7fe9b0000700 1 -- 172.21.15.84:0/1398227507 shutdown_connections 2024-04-26T21:34:57.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.290+0000 7fe9b0000700 1 --2- 172.21.15.84:0/1398227507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9a80fcf60 0x7fe9a80fd3d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:57.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.290+0000 7fe9b0000700 1 --2- 172.21.15.84:0/1398227507 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9a80fbcb0 0x7fe9a80fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:57.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.290+0000 7fe9b0000700 1 -- 172.21.15.84:0/1398227507 >> 172.21.15.84:0/1398227507 conn(0x7fe9a80f7430 msgr2=0x7fe9a80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:57.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.291+0000 7fe9b0000700 1 -- 172.21.15.84:0/1398227507 shutdown_connections 2024-04-26T21:34:57.295 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:34:57.295 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: pgmap v265: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-04-26T21:34:57.295 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:57.295 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:57.295 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:34:57.295 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:34:57.295 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:57.295 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:34:57.295 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:57.296 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:57.296 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:57.296 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:57.296 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:57.296 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:57.296 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi084.hbjunw"}]: dispatch 2024-04-26T21:34:57.296 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi084.hbjunw"}]': finished 2024-04-26T21:34:57.296 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi084.rtrqtr"}]: dispatch 2024-04-26T21:34:57.296 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi084.rtrqtr"}]': finished 2024-04-26T21:34:57.296 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi120.qnkxcn"}]: dispatch 2024-04-26T21:34:57.296 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi120.qnkxcn"}]': finished 2024-04-26T21:34:57.296 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi120.ufqfoh"}]: dispatch 2024-04-26T21:34:57.296 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi120.ufqfoh"}]': finished 2024-04-26T21:34:57.296 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-04-26T21:34:57.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.291+0000 7fe9b0000700 1 -- 172.21.15.84:0/1398227507 wait complete. 2024-04-26T21:34:57.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.292+0000 7fe9b0000700 1 Processor -- start 2024-04-26T21:34:57.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.292+0000 7fe9b0000700 1 -- start start 2024-04-26T21:34:57.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.292+0000 7fe9b0000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9a80fbcb0 0x7fe9a8105f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:57.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.292+0000 7fe9b0000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9a80fcf60 0x7fe9a81064d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:57.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.292+0000 7fe9b0000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a8106b20 con 0x7fe9a80fbcb0 2024-04-26T21:34:57.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.292+0000 7fe9b0000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a8107320 con 0x7fe9a80fcf60 2024-04-26T21:34:57.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.293+0000 7fe9ad600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9a80fbcb0 0x7fe9a8105f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:57.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.293+0000 7fe9ad600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9a80fbcb0 0x7fe9a8105f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55534/0 (socket says 172.21.15.84:55534) 2024-04-26T21:34:57.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.293+0000 7fe9ad600700 1 -- 172.21.15.84:0/896536699 learned_addr learned my addr 172.21.15.84:0/896536699 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:34:57.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.293+0000 7fe9acc00700 1 --2- 172.21.15.84:0/896536699 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9a80fcf60 0x7fe9a81064d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.293+0000 7fe9ad600700 1 -- 172.21.15.84:0/896536699 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9a80fcf60 msgr2=0x7fe9a81064d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.293+0000 7fe9ad600700 1 --2- 172.21.15.84:0/896536699 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9a80fcf60 0x7fe9a81064d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.293+0000 7fe9ad600700 1 -- 172.21.15.84:0/896536699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe994005040 con 0x7fe9a80fbcb0 2024-04-26T21:34:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.293+0000 7fe9acc00700 1 --2- 172.21.15.84:0/896536699 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9a80fcf60 0x7fe9a81064d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:34:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.294+0000 7fe9ad600700 1 --2- 172.21.15.84:0/896536699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9a80fbcb0 0x7fe9a8105f90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe99c002a50 tx=0x7fe99c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.294+0000 7fe9a5600700 1 -- 172.21.15.84:0/896536699 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe99c007cc0 con 0x7fe9a80fbcb0 2024-04-26T21:34:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.294+0000 7fe9a5600700 1 -- 172.21.15.84:0/896536699 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe99c00f040 con 0x7fe9a80fbcb0 2024-04-26T21:34:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.294+0000 7fe9b0000700 1 -- 172.21.15.84:0/896536699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a8107600 con 0x7fe9a80fbcb0 2024-04-26T21:34:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.294+0000 7fe9a5600700 1 -- 172.21.15.84:0/896536699 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe99c009640 con 0x7fe9a80fbcb0 2024-04-26T21:34:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.294+0000 7fe9b0000700 1 -- 172.21.15.84:0/896536699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a8107bc0 con 0x7fe9a80fbcb0 2024-04-26T21:34:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.296+0000 7fe9b0000700 1 -- 172.21.15.84:0/896536699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a81018f0 con 0x7fe9a80fbcb0 2024-04-26T21:34:57.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.300+0000 7fe9a5600700 1 -- 172.21.15.84:0/896536699 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe99c0097a0 con 0x7fe9a80fbcb0 2024-04-26T21:34:57.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.301+0000 7fe9a5600700 1 --2- 172.21.15.84:0/896536699 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe99006eda0 0x7fe990071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:57.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.301+0000 7fe9a5600700 1 -- 172.21.15.84:0/896536699 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fe99c08edc0 con 0x7fe9a80fbcb0 2024-04-26T21:34:57.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.301+0000 7fe9acc00700 1 --2- 172.21.15.84:0/896536699 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe99006eda0 0x7fe990071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:57.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.302+0000 7fe9acc00700 1 --2- 172.21.15.84:0/896536699 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe99006eda0 0x7fe990071250 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe99400b7a0 tx=0x7fe994009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:57.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.305+0000 7fe9a5600700 1 -- 172.21.15.84:0/896536699 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fe99c057a70 con 0x7fe9a80fbcb0 2024-04-26T21:34:57.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.585+0000 7fe9b0000700 1 -- 172.21.15.84:0/896536699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe9a804bed0 con 0x7fe9a80fbcb0 2024-04-26T21:34:57.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.585+0000 7fe9a5600700 1 -- 172.21.15.84:0/896536699 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1949 (secure 0 0 0) 0x7fe99c05b130 con 0x7fe9a80fbcb0 2024-04-26T21:34:57.587 INFO:teuthology.orchestra.run.smithi084.stdout:e41 2024-04-26T21:34:57.588 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:34:57.588 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:34:57.588 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:34:57.588 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:34:57.588 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:34:57.588 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:34:57.588 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 41 2024-04-26T21:34:57.588 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:34:57.588 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:34:57.588 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:34:57.284358+0000 2024-04-26T21:34:57.588 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:34:57.588 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:34:57.588 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:34:57.588 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:34:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:34:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-04-26T21:34:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:34:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:34:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 94 2024-04-26T21:34:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T21:34:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:34:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:34:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=34446,1=34478} 2024-04-26T21:34:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:34:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:34:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:34:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:34:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:34:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:34:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:34:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-04-26T21:34:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:34:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 34446 members: 34446 2024-04-26T21:34:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:34446} state up:active seq 22 join_fscid=1 addr [v2:172.21.15.84:6826/1392878113,v1:172.21.15.84:6827/1392878113] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:34:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{1:34478} state up:starting seq 1 join_fscid=1 addr [v2:172.21.15.84:6828/4015119551,v1:172.21.15.84:6829/4015119551] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:34:57.590 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:34:57.590 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:34:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:34:57.590 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:34:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.120:6824/1351450046,v1:172.21.15.120:6825/1351450046] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:34:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:44305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.120:6826/2847041344,v1:172.21.15.120:6827/2847041344] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:34:57.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.588+0000 7fe9b0000700 1 -- 172.21.15.84:0/896536699 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe99006eda0 msgr2=0x7fe990071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:57.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.588+0000 7fe9b0000700 1 --2- 172.21.15.84:0/896536699 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe99006eda0 0x7fe990071250 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe99400b7a0 tx=0x7fe994009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:57.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.588+0000 7fe9b0000700 1 -- 172.21.15.84:0/896536699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9a80fbcb0 msgr2=0x7fe9a8105f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:57.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.588+0000 7fe9b0000700 1 --2- 172.21.15.84:0/896536699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9a80fbcb0 0x7fe9a8105f90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe99c002a50 tx=0x7fe99c0046b0 comp rx=0 tx=0).stop 2024-04-26T21:34:57.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.589+0000 7fe9b0000700 1 -- 172.21.15.84:0/896536699 shutdown_connections 2024-04-26T21:34:57.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.589+0000 7fe9b0000700 1 --2- 172.21.15.84:0/896536699 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe99006eda0 0x7fe990071250 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:57.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.589+0000 7fe9b0000700 1 --2- 172.21.15.84:0/896536699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9a80fbcb0 0x7fe9a8105f90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:57.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.589+0000 7fe9b0000700 1 --2- 172.21.15.84:0/896536699 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9a80fcf60 0x7fe9a81064d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:57.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.589+0000 7fe9b0000700 1 -- 172.21.15.84:0/896536699 >> 172.21.15.84:0/896536699 conn(0x7fe9a80f7430 msgr2=0x7fe9a8065c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:57.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.589+0000 7fe9b0000700 1 -- 172.21.15.84:0/896536699 shutdown_connections 2024-04-26T21:34:57.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.589+0000 7fe9b0000700 1 -- 172.21.15.84:0/896536699 wait complete. 2024-04-26T21:34:57.592 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 41 2024-04-26T21:34:57.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.734+0000 7f1aa9000700 1 -- 172.21.15.84:0/3304976672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa40fcf10 msgr2=0x7f1aa40fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:57.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.734+0000 7f1aa9000700 1 --2- 172.21.15.84:0/3304976672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa40fcf10 0x7f1aa40fd320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1a94004940 tx=0x7f1a94009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:57.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.734+0000 7f1aa9000700 1 -- 172.21.15.84:0/3304976672 shutdown_connections 2024-04-26T21:34:57.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.734+0000 7f1aa9000700 1 --2- 172.21.15.84:0/3304976672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1aa40fe080 0x7f1aa40fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:57.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.734+0000 7f1aa9000700 1 --2- 172.21.15.84:0/3304976672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa40fcf10 0x7f1aa40fd320 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:57.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.734+0000 7f1aa9000700 1 -- 172.21.15.84:0/3304976672 >> 172.21.15.84:0/3304976672 conn(0x7f1aa40f8560 msgr2=0x7f1aa40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:57.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.734+0000 7f1aa9000700 1 -- 172.21.15.84:0/3304976672 shutdown_connections 2024-04-26T21:34:57.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.734+0000 7f1aa9000700 1 -- 172.21.15.84:0/3304976672 wait complete. 2024-04-26T21:34:57.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.735+0000 7f1aa9000700 1 Processor -- start 2024-04-26T21:34:57.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.735+0000 7f1aa9000700 1 -- start start 2024-04-26T21:34:57.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.735+0000 7f1aa9000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1aa40fcf10 0x7f1aa410fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:57.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.735+0000 7f1aa9000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa40fe080 0x7f1aa4110150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:57.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.735+0000 7f1aa9000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa41107e0 con 0x7f1aa40fe080 2024-04-26T21:34:57.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.735+0000 7f1aa9000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa4110fd0 con 0x7f1aa40fcf10 2024-04-26T21:34:57.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.736+0000 7f1aa1400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa40fe080 0x7f1aa4110150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:57.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.736+0000 7f1aa1400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa40fe080 0x7f1aa4110150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55546/0 (socket says 172.21.15.84:55546) 2024-04-26T21:34:57.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.736+0000 7f1aa1400700 1 -- 172.21.15.84:0/8468605 learned_addr learned my addr 172.21.15.84:0/8468605 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:34:57.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.736+0000 7f1aa1e00700 1 --2- 172.21.15.84:0/8468605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1aa40fcf10 0x7f1aa410fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:57.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.736+0000 7f1aa1400700 1 -- 172.21.15.84:0/8468605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1aa40fcf10 msgr2=0x7f1aa410fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:57.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.736+0000 7f1aa1400700 1 --2- 172.21.15.84:0/8468605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1aa40fcf10 0x7f1aa410fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:57.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.736+0000 7f1aa1400700 1 -- 172.21.15.84:0/8468605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a94005040 con 0x7f1aa40fe080 2024-04-26T21:34:57.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.736+0000 7f1aa1e00700 1 --2- 172.21.15.84:0/8468605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1aa40fcf10 0x7f1aa410fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:34:57.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.737+0000 7f1aa1400700 1 --2- 172.21.15.84:0/8468605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa40fe080 0x7f1aa4110150 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000b790 tx=0x7f1a90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:57.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.737+0000 7f1a9a000700 1 -- 172.21.15.84:0/8468605 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a9000f770 con 0x7f1aa40fe080 2024-04-26T21:34:57.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.737+0000 7f1a9a000700 1 -- 172.21.15.84:0/8468605 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a9000fda0 con 0x7f1aa40fe080 2024-04-26T21:34:57.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.737+0000 7f1a9a000700 1 -- 172.21.15.84:0/8468605 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a9000d310 con 0x7f1aa40fe080 2024-04-26T21:34:57.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.737+0000 7f1aa9000700 1 -- 172.21.15.84:0/8468605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa41112b0 con 0x7f1aa40fe080 2024-04-26T21:34:57.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.737+0000 7f1aa9000700 1 -- 172.21.15.84:0/8468605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa4111870 con 0x7f1aa40fe080 2024-04-26T21:34:57.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.738+0000 7f1aa9000700 1 -- 172.21.15.84:0/8468605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa4101a10 con 0x7f1aa40fe080 2024-04-26T21:34:57.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.740+0000 7f1a9a000700 1 -- 172.21.15.84:0/8468605 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1a90010420 con 0x7f1aa40fe080 2024-04-26T21:34:57.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.741+0000 7f1a9a000700 1 --2- 172.21.15.84:0/8468605 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f1a8806ec10 0x7f1a880710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:57.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.741+0000 7f1a9a000700 1 -- 172.21.15.84:0/8468605 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f1a9008e930 con 0x7f1aa40fe080 2024-04-26T21:34:57.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.741+0000 7f1aa1e00700 1 --2- 172.21.15.84:0/8468605 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f1a8806ec10 0x7f1a880710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:57.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.742+0000 7f1aa1e00700 1 --2- 172.21.15.84:0/8468605 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f1a8806ec10 0x7f1a880710c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400b3b0 tx=0x7f1a94009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:57.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.746+0000 7f1a9a000700 1 -- 172.21.15.84:0/8468605 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f1a9005b1d0 con 0x7f1aa40fe080 2024-04-26T21:34:58.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:57.998+0000 7f1aa9000700 1 -- 172.21.15.84:0/8468605 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1aa4111b40 con 0x7f1a8806ec10 2024-04-26T21:34:58.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.000+0000 7f1a9a000700 1 -- 172.21.15.84:0/8468605 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f1aa4111b40 con 0x7f1a8806ec10 2024-04-26T21:34:58.004 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:34:58.004 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:34:58.004 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:34:58.004 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:34:58.004 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-04-26T21:34:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-04-26T21:34:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: "osd", 2024-04-26T21:34:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: "mds", 2024-04-26T21:34:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr", 2024-04-26T21:34:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: "crash" 2024-04-26T21:34:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-04-26T21:34:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "16/21 daemons upgraded", 2024-04-26T21:34:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading node-exporter daemons", 2024-04-26T21:34:58.006 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:34:58.006 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:34:58.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.002+0000 7f1aa9000700 1 -- 172.21.15.84:0/8468605 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f1a8806ec10 msgr2=0x7f1a880710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:58.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.002+0000 7f1aa9000700 1 --2- 172.21.15.84:0/8468605 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f1a8806ec10 0x7f1a880710c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400b3b0 tx=0x7f1a94009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:58.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.002+0000 7f1aa9000700 1 -- 172.21.15.84:0/8468605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa40fe080 msgr2=0x7f1aa4110150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:58.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.002+0000 7f1aa9000700 1 --2- 172.21.15.84:0/8468605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa40fe080 0x7f1aa4110150 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000b790 tx=0x7f1a90009250 comp rx=0 tx=0).stop 2024-04-26T21:34:58.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.003+0000 7f1aa9000700 1 -- 172.21.15.84:0/8468605 shutdown_connections 2024-04-26T21:34:58.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.003+0000 7f1aa9000700 1 --2- 172.21.15.84:0/8468605 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f1a8806ec10 0x7f1a880710c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:58.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.003+0000 7f1aa9000700 1 --2- 172.21.15.84:0/8468605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1aa40fcf10 0x7f1aa410fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:58.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.003+0000 7f1aa9000700 1 --2- 172.21.15.84:0/8468605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa40fe080 0x7f1aa4110150 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:58.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.003+0000 7f1aa9000700 1 -- 172.21.15.84:0/8468605 >> 172.21.15.84:0/8468605 conn(0x7f1aa40f8560 msgr2=0x7f1aa40f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:58.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.003+0000 7f1aa9000700 1 -- 172.21.15.84:0/8468605 shutdown_connections 2024-04-26T21:34:58.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.003+0000 7f1aa9000700 1 -- 172.21.15.84:0/8468605 wait complete. 2024-04-26T21:34:58.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.153+0000 7f5db7800700 1 -- 172.21.15.84:0/830874019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db00fe080 msgr2=0x7f5db00fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:58.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.153+0000 7f5db7800700 1 --2- 172.21.15.84:0/830874019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db00fe080 0x7f5db00fe4f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c004940 tx=0x7f5d9c009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:58.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.153+0000 7f5db7800700 1 -- 172.21.15.84:0/830874019 shutdown_connections 2024-04-26T21:34:58.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.153+0000 7f5db7800700 1 --2- 172.21.15.84:0/830874019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db00fe080 0x7f5db00fe4f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:58.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.153+0000 7f5db7800700 1 --2- 172.21.15.84:0/830874019 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5db00fcf10 0x7f5db00fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:58.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.153+0000 7f5db7800700 1 -- 172.21.15.84:0/830874019 >> 172.21.15.84:0/830874019 conn(0x7f5db00f8560 msgr2=0x7f5db00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:58.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.153+0000 7f5db7800700 1 -- 172.21.15.84:0/830874019 shutdown_connections 2024-04-26T21:34:58.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.153+0000 7f5db7800700 1 -- 172.21.15.84:0/830874019 wait complete. 2024-04-26T21:34:58.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.154+0000 7f5db7800700 1 Processor -- start 2024-04-26T21:34:58.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.154+0000 7f5db7800700 1 -- start start 2024-04-26T21:34:58.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.154+0000 7f5db7800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5db00fcf10 0x7f5db010fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:58.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.154+0000 7f5db7800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db00fe080 0x7f5db0110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:58.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.155+0000 7f5db7800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db0110810 con 0x7f5db00fe080 2024-04-26T21:34:58.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.155+0000 7f5db7800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db0111000 con 0x7f5db00fcf10 2024-04-26T21:34:58.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.155+0000 7f5dafe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db00fe080 0x7f5db0110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:58.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.155+0000 7f5dafe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db00fe080 0x7f5db0110180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55572/0 (socket says 172.21.15.84:55572) 2024-04-26T21:34:58.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.155+0000 7f5dafe00700 1 -- 172.21.15.84:0/604376803 learned_addr learned my addr 172.21.15.84:0/604376803 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:34:58.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.155+0000 7f5dafe00700 1 -- 172.21.15.84:0/604376803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5db00fcf10 msgr2=0x7f5db010fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:58.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.155+0000 7f5db4e00700 1 --2- 172.21.15.84:0/604376803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5db00fcf10 0x7f5db010fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:58.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.155+0000 7f5dafe00700 1 --2- 172.21.15.84:0/604376803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5db00fcf10 0x7f5db010fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:58.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.155+0000 7f5dafe00700 1 -- 172.21.15.84:0/604376803 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9c005040 con 0x7f5db00fe080 2024-04-26T21:34:58.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.155+0000 7f5db4e00700 1 --2- 172.21.15.84:0/604376803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5db00fcf10 0x7f5db010fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:34:58.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.156+0000 7f5dafe00700 1 --2- 172.21.15.84:0/604376803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db00fe080 0x7f5db0110180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c009150 tx=0x7f5d9c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.156+0000 7f5dacc00700 1 -- 172.21.15.84:0/604376803 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d9c00e040 con 0x7f5db00fe080 2024-04-26T21:34:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.156+0000 7f5dacc00700 1 -- 172.21.15.84:0/604376803 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d9c00bbf0 con 0x7f5db00fe080 2024-04-26T21:34:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.156+0000 7f5dacc00700 1 -- 172.21.15.84:0/604376803 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d9c01c630 con 0x7f5db00fe080 2024-04-26T21:34:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.156+0000 7f5db7800700 1 -- 172.21.15.84:0/604376803 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db0111280 con 0x7f5db00fe080 2024-04-26T21:34:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.156+0000 7f5db7800700 1 -- 172.21.15.84:0/604376803 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db0111840 con 0x7f5db00fe080 2024-04-26T21:34:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.157+0000 7f5db7800700 1 -- 172.21.15.84:0/604376803 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db0101a10 con 0x7f5db00fe080 2024-04-26T21:34:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.158+0000 7f5dacc00700 1 -- 172.21.15.84:0/604376803 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5d9c00bd60 con 0x7f5db00fe080 2024-04-26T21:34:58.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.159+0000 7f5dacc00700 1 --2- 172.21.15.84:0/604376803 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5d9806ec10 0x7f5d980710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:34:58.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.159+0000 7f5dacc00700 1 -- 172.21.15.84:0/604376803 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f5d9c08fd90 con 0x7f5db00fe080 2024-04-26T21:34:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.159+0000 7f5db4e00700 1 --2- 172.21.15.84:0/604376803 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5d9806ec10 0x7f5d980710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:34:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.160+0000 7f5db4e00700 1 --2- 172.21.15.84:0/604376803 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5d9806ec10 0x7f5d980710c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5da4006fd0 tx=0x7f5da4008040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:34:58.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.165+0000 7f5dacc00700 1 -- 172.21.15.84:0/604376803 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f5d9c05c570 con 0x7f5db00fe080 2024-04-26T21:34:58.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:34:58.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: Upgrade: Setting container_image for all mds 2024-04-26T21:34:58.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:34:58.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-04-26T21:34:58.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/1157045557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:58.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: daemon mds.cephfs.smithi084.rtrqtr assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-26T21:34:58.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-04-26T21:34:58.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi084.rtrqtr=up:starting} 2 up:standby 2024-04-26T21:34:58.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:58.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: daemon mds.cephfs.smithi084.rtrqtr is now active in filesystem cephfs as rank 1 2024-04-26T21:34:58.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:58.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:58.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:58.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:58.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:58.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:58.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:58.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:58.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:58.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:58.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:58.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:58.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:58.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:57 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/896536699' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:34:58.185 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:34:58.185 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: Upgrade: Setting container_image for all mds 2024-04-26T21:34:58.185 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:34:58.185 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-04-26T21:34:58.185 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/1157045557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:58.185 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: daemon mds.cephfs.smithi084.rtrqtr assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-26T21:34:58.185 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-04-26T21:34:58.185 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi084.rtrqtr=up:starting} 2 up:standby 2024-04-26T21:34:58.185 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:58.185 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: daemon mds.cephfs.smithi084.rtrqtr is now active in filesystem cephfs as rank 1 2024-04-26T21:34:58.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:58.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:58.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:58.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:58.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:58.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:58.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:58.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:58.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:58.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:58.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:58.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:34:58.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:34:58.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:57 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/896536699' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:34:58.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.484+0000 7f5db7800700 1 -- 172.21.15.84:0/604376803 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5db004bed0 con 0x7f5db00fe080 2024-04-26T21:34:58.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.485+0000 7f5dacc00700 1 -- 172.21.15.84:0/604376803 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f5d9c05c100 con 0x7f5db00fe080 2024-04-26T21:34:58.487 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:34:58.487 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:34:58.487 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:34:58.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.488+0000 7f5db7800700 1 -- 172.21.15.84:0/604376803 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5d9806ec10 msgr2=0x7f5d980710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:58.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.488+0000 7f5db7800700 1 --2- 172.21.15.84:0/604376803 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5d9806ec10 0x7f5d980710c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5da4006fd0 tx=0x7f5da4008040 comp rx=0 tx=0).stop 2024-04-26T21:34:58.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.488+0000 7f5db7800700 1 -- 172.21.15.84:0/604376803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db00fe080 msgr2=0x7f5db0110180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:34:58.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.488+0000 7f5db7800700 1 --2- 172.21.15.84:0/604376803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db00fe080 0x7f5db0110180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c009150 tx=0x7f5d9c009e30 comp rx=0 tx=0).stop 2024-04-26T21:34:58.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.488+0000 7f5db7800700 1 -- 172.21.15.84:0/604376803 shutdown_connections 2024-04-26T21:34:58.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.488+0000 7f5db7800700 1 --2- 172.21.15.84:0/604376803 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5d9806ec10 0x7f5d980710c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:58.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.488+0000 7f5db7800700 1 --2- 172.21.15.84:0/604376803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5db00fcf10 0x7f5db010fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:58.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.488+0000 7f5db7800700 1 --2- 172.21.15.84:0/604376803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db00fe080 0x7f5db0110180 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:34:58.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.488+0000 7f5db7800700 1 -- 172.21.15.84:0/604376803 >> 172.21.15.84:0/604376803 conn(0x7f5db00f8560 msgr2=0x7f5db00f9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:34:58.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.488+0000 7f5db7800700 1 -- 172.21.15.84:0/604376803 shutdown_connections 2024-04-26T21:34:58.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:34:58.488+0000 7f5db7800700 1 -- 172.21.15.84:0/604376803 wait complete. 2024-04-26T21:34:59.079 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:58 smithi084 ceph-mon[90138]: Upgrade: Setting container_image for all rgw 2024-04-26T21:34:59.080 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:58 smithi084 ceph-mon[90138]: Upgrade: Setting container_image for all rbd-mirror 2024-04-26T21:34:59.080 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:58 smithi084 ceph-mon[90138]: Upgrade: Setting container_image for all ceph-exporter 2024-04-26T21:34:59.080 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:58 smithi084 ceph-mon[90138]: Upgrade: Setting container_image for all iscsi 2024-04-26T21:34:59.080 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:58 smithi084 ceph-mon[90138]: Upgrade: Setting container_image for all nfs 2024-04-26T21:34:59.080 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:58 smithi084 ceph-mon[90138]: Upgrade: Setting container_image for all nvmeof 2024-04-26T21:34:59.080 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:58 smithi084 ceph-mon[90138]: pgmap v266: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-04-26T21:34:59.080 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:58 smithi084 ceph-mon[90138]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:34:59.080 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:58 smithi084 ceph-mon[90138]: mds.? [v2:172.21.15.84:6828/4015119551,v1:172.21.15.84:6829/4015119551] up:active 2024-04-26T21:34:59.080 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:58 smithi084 ceph-mon[90138]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi084.rtrqtr=up:active} 2 up:standby 2024-04-26T21:34:59.080 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:34:58 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/604376803' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:34:59.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:58 smithi120 ceph-mon[79001]: Upgrade: Setting container_image for all rgw 2024-04-26T21:34:59.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:58 smithi120 ceph-mon[79001]: Upgrade: Setting container_image for all rbd-mirror 2024-04-26T21:34:59.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:58 smithi120 ceph-mon[79001]: Upgrade: Setting container_image for all ceph-exporter 2024-04-26T21:34:59.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:58 smithi120 ceph-mon[79001]: Upgrade: Setting container_image for all iscsi 2024-04-26T21:34:59.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:58 smithi120 ceph-mon[79001]: Upgrade: Setting container_image for all nfs 2024-04-26T21:34:59.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:58 smithi120 ceph-mon[79001]: Upgrade: Setting container_image for all nvmeof 2024-04-26T21:34:59.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:58 smithi120 ceph-mon[79001]: pgmap v266: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-04-26T21:34:59.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:58 smithi120 ceph-mon[79001]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:34:59.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:58 smithi120 ceph-mon[79001]: mds.? [v2:172.21.15.84:6828/4015119551,v1:172.21.15.84:6829/4015119551] up:active 2024-04-26T21:34:59.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:58 smithi120 ceph-mon[79001]: fsmap cephfs:2 {0=cephfs.smithi084.hbjunw=up:active,1=cephfs.smithi084.rtrqtr=up:active} 2 up:standby 2024-04-26T21:34:59.184 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:34:58 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/604376803' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:35:00.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:00 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:00.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:00 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:35:00.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:00 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:00.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:00 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:35:01.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:01 smithi084 ceph-mon[90138]: Upgrade: Updating node-exporter.smithi084 (1/2) 2024-04-26T21:35:01.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:01 smithi084 ceph-mon[90138]: Deploying daemon node-exporter.smithi084 on smithi084 2024-04-26T21:35:01.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:01 smithi084 ceph-mon[90138]: pgmap v267: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 6.9 KiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-04-26T21:35:01.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:01 smithi120 ceph-mon[79001]: Upgrade: Updating node-exporter.smithi084 (1/2) 2024-04-26T21:35:01.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:01 smithi120 ceph-mon[79001]: Deploying daemon node-exporter.smithi084 on smithi084 2024-04-26T21:35:01.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:01 smithi120 ceph-mon[79001]: pgmap v267: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 6.9 KiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-04-26T21:35:03.403 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:03 smithi084 ceph-mon[90138]: pgmap v268: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 3.9 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-26T21:35:03.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:03 smithi120 ceph-mon[79001]: pgmap v268: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 3.9 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-26T21:35:05.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:04 smithi084 ceph-mon[90138]: pgmap v269: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-04-26T21:35:05.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:04 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:05.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:04 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:05.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:04 smithi120 ceph-mon[79001]: pgmap v269: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-04-26T21:35:05.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:04 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:05.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:04 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:07.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:06 smithi084 ceph-mon[90138]: pgmap v270: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-04-26T21:35:07.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:06 smithi120 ceph-mon[79001]: pgmap v270: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-04-26T21:35:08.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:07 smithi084 ceph-mon[90138]: Upgrade: Updating node-exporter.smithi120 (2/2) 2024-04-26T21:35:08.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:07 smithi084 ceph-mon[90138]: Deploying daemon node-exporter.smithi120 on smithi120 2024-04-26T21:35:08.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:07 smithi120 ceph-mon[79001]: Upgrade: Updating node-exporter.smithi120 (2/2) 2024-04-26T21:35:08.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:07 smithi120 ceph-mon[79001]: Deploying daemon node-exporter.smithi120 on smithi120 2024-04-26T21:35:09.123 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:08 smithi120 ceph-mon[79001]: pgmap v271: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-26T21:35:09.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:08 smithi084 ceph-mon[90138]: pgmap v271: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-26T21:35:11.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:10 smithi084 ceph-mon[90138]: pgmap v272: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-26T21:35:11.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:10 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:11.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:10 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:11.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:10 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:35:11.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:10 smithi120 ceph-mon[79001]: pgmap v272: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-26T21:35:11.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:10 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:11.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:10 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:11.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:10 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:35:13.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:12 smithi120 ceph-mon[79001]: pgmap v273: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:35:13.272 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:12 smithi084 ceph-mon[90138]: pgmap v273: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:35:15.092 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:14 smithi084 ceph-mon[90138]: pgmap v274: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:35:15.092 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:35:15.092 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:15.092 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:15.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:14 smithi120 ceph-mon[79001]: pgmap v274: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:35:15.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:35:15.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:15.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:17.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:16 smithi120 ceph-mon[79001]: pgmap v275: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-04-26T21:35:17.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:16 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:17.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:16 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:17.183 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:16 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:16 smithi084 ceph-mon[90138]: pgmap v275: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-04-26T21:35:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:16 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:16 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:16 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:18.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:17 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:18.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:17 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:19.270 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:18 smithi120 ceph-mon[79001]: pgmap v276: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:19.271 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:18 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:19.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:18 smithi084 ceph-mon[90138]: pgmap v276: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:19.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:18 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:20.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:19 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:20.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:19 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:21.137 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:20 smithi084 ceph-mon[90138]: pgmap v277: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:21.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:20 smithi120 ceph-mon[79001]: pgmap v277: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:23.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:23 smithi084 ceph-mon[90138]: pgmap v278: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:23.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:23 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:23.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:23 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:23.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:23 smithi120 ceph-mon[79001]: pgmap v278: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:23.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:23 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:23.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:23 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:25 smithi084 ceph-mon[90138]: pgmap v279: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:35:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:35:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:35:25.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:25 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:25 smithi120 ceph-mon[79001]: pgmap v279: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:25.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:25.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:25.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:35:25.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:35:25.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:25.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:35:25.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:25.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:25 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:27.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:27 smithi084 ceph-mon[90138]: pgmap v280: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:27.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:27 smithi120 ceph-mon[79001]: pgmap v280: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:28.292 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:28 smithi084 ceph-mon[90138]: Upgrade: Updating prometheus.smithi084 2024-04-26T21:35:28.334 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:28 smithi120 ceph-mon[79001]: Upgrade: Updating prometheus.smithi084 2024-04-26T21:35:28.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.655+0000 7f3d97a00700 1 -- 172.21.15.84:0/699412316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d900ffee0 msgr2=0x7f3d90102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:28.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.655+0000 7f3d97a00700 1 --2- 172.21.15.84:0/699412316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d900ffee0 0x7f3d90102300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c004940 tx=0x7f3d7c009e30 comp rx=0 tx=0).stop 2024-04-26T21:35:28.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.655+0000 7f3d97a00700 1 -- 172.21.15.84:0/699412316 shutdown_connections 2024-04-26T21:35:28.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.655+0000 7f3d97a00700 1 --2- 172.21.15.84:0/699412316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d900ffee0 0x7f3d90102300 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:28.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.655+0000 7f3d97a00700 1 --2- 172.21.15.84:0/699412316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d900662c0 0x7f3d900ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:28.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.655+0000 7f3d97a00700 1 -- 172.21.15.84:0/699412316 >> 172.21.15.84:0/699412316 conn(0x7f3d900f7430 msgr2=0x7f3d900f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:35:28.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.655+0000 7f3d97a00700 1 -- 172.21.15.84:0/699412316 shutdown_connections 2024-04-26T21:35:28.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.655+0000 7f3d97a00700 1 -- 172.21.15.84:0/699412316 wait complete. 2024-04-26T21:35:28.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.656+0000 7f3d97a00700 1 Processor -- start 2024-04-26T21:35:28.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.656+0000 7f3d97a00700 1 -- start start 2024-04-26T21:35:28.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.657+0000 7f3d97a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d900662c0 0x7f3d9010fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:28.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.657+0000 7f3d97a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d900ffee0 0x7f3d90110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:28.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.657+0000 7f3d97a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d90110790 con 0x7f3d900662c0 2024-04-26T21:35:28.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.657+0000 7f3d97a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d90110fe0 con 0x7f3d900ffee0 2024-04-26T21:35:28.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.657+0000 7f3d95000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d900662c0 0x7f3d9010fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:35:28.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.657+0000 7f3d95000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d900662c0 0x7f3d9010fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58856/0 (socket says 172.21.15.84:58856) 2024-04-26T21:35:28.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.657+0000 7f3d95000700 1 -- 172.21.15.84:0/1862177031 learned_addr learned my addr 172.21.15.84:0/1862177031 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:35:28.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.657+0000 7f3d8fe00700 1 --2- 172.21.15.84:0/1862177031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d900ffee0 0x7f3d90110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:35:28.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.658+0000 7f3d95000700 1 -- 172.21.15.84:0/1862177031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d900ffee0 msgr2=0x7f3d90110190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:28.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.658+0000 7f3d95000700 1 --2- 172.21.15.84:0/1862177031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d900ffee0 0x7f3d90110190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:28.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.658+0000 7f3d95000700 1 -- 172.21.15.84:0/1862177031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c005040 con 0x7f3d900662c0 2024-04-26T21:35:28.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.658+0000 7f3d95000700 1 --2- 172.21.15.84:0/1862177031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d900662c0 0x7f3d9010fc50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400c800 tx=0x7f3d84004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:35:28.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.658+0000 7f3d8cc00700 1 -- 172.21.15.84:0/1862177031 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d8400a760 con 0x7f3d900662c0 2024-04-26T21:35:28.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.658+0000 7f3d97a00700 1 -- 172.21.15.84:0/1862177031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d901112c0 con 0x7f3d900662c0 2024-04-26T21:35:28.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.658+0000 7f3d8cc00700 1 -- 172.21.15.84:0/1862177031 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3d8400ad90 con 0x7f3d900662c0 2024-04-26T21:35:28.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.658+0000 7f3d8cc00700 1 -- 172.21.15.84:0/1862177031 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d840113a0 con 0x7f3d900662c0 2024-04-26T21:35:28.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.659+0000 7f3d97a00700 1 -- 172.21.15.84:0/1862177031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d90111800 con 0x7f3d900662c0 2024-04-26T21:35:28.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.660+0000 7f3d97a00700 1 -- 172.21.15.84:0/1862177031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d900f8f60 con 0x7f3d900662c0 2024-04-26T21:35:28.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.661+0000 7f3d8cc00700 1 -- 172.21.15.84:0/1862177031 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3d84012400 con 0x7f3d900662c0 2024-04-26T21:35:28.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.662+0000 7f3d8cc00700 1 --2- 172.21.15.84:0/1862177031 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f3d7806ec10 0x7f3d780710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:28.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.662+0000 7f3d8cc00700 1 -- 172.21.15.84:0/1862177031 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f3d8408eaa0 con 0x7f3d900662c0 2024-04-26T21:35:28.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.662+0000 7f3d8fe00700 1 --2- 172.21.15.84:0/1862177031 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f3d7806ec10 0x7f3d780710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:35:28.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.663+0000 7f3d8fe00700 1 --2- 172.21.15.84:0/1862177031 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f3d7806ec10 0x7f3d780710c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c004f90 tx=0x7f3d7c009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:35:28.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.667+0000 7f3d8cc00700 1 -- 172.21.15.84:0/1862177031 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f3d8405b200 con 0x7f3d900662c0 2024-04-26T21:35:28.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.922+0000 7f3d97a00700 1 -- 172.21.15.84:0/1862177031 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d90111a80 con 0x7f3d7806ec10 2024-04-26T21:35:28.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.924+0000 7f3d8cc00700 1 -- 172.21.15.84:0/1862177031 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7f3d90111a80 con 0x7f3d7806ec10 2024-04-26T21:35:28.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.927+0000 7f3d97a00700 1 -- 172.21.15.84:0/1862177031 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f3d7806ec10 msgr2=0x7f3d780710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:28.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.927+0000 7f3d97a00700 1 --2- 172.21.15.84:0/1862177031 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f3d7806ec10 0x7f3d780710c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c004f90 tx=0x7f3d7c009e30 comp rx=0 tx=0).stop 2024-04-26T21:35:28.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.927+0000 7f3d97a00700 1 -- 172.21.15.84:0/1862177031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d900662c0 msgr2=0x7f3d9010fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:28.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.927+0000 7f3d97a00700 1 --2- 172.21.15.84:0/1862177031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d900662c0 0x7f3d9010fc50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400c800 tx=0x7f3d84004470 comp rx=0 tx=0).stop 2024-04-26T21:35:28.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.928+0000 7f3d97a00700 1 -- 172.21.15.84:0/1862177031 shutdown_connections 2024-04-26T21:35:28.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.928+0000 7f3d97a00700 1 --2- 172.21.15.84:0/1862177031 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f3d7806ec10 0x7f3d780710c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:28.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.928+0000 7f3d97a00700 1 --2- 172.21.15.84:0/1862177031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d900662c0 0x7f3d9010fc50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:28.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.928+0000 7f3d97a00700 1 --2- 172.21.15.84:0/1862177031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d900ffee0 0x7f3d90110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:28.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.928+0000 7f3d97a00700 1 -- 172.21.15.84:0/1862177031 >> 172.21.15.84:0/1862177031 conn(0x7f3d900f7430 msgr2=0x7f3d900fbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:35:28.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.928+0000 7f3d97a00700 1 -- 172.21.15.84:0/1862177031 shutdown_connections 2024-04-26T21:35:28.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:28.928+0000 7f3d97a00700 1 -- 172.21.15.84:0/1862177031 wait complete. 2024-04-26T21:35:28.944 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:35:29.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.081+0000 7f1859a00700 1 -- 172.21.15.84:0/1695696030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18540fce60 msgr2=0x7f18540fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:29.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.081+0000 7f1859a00700 1 --2- 172.21.15.84:0/1695696030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18540fce60 0x7f18540fd270 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1844004940 tx=0x7f1844009e30 comp rx=0 tx=0).stop 2024-04-26T21:35:29.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.081+0000 7f1859a00700 1 -- 172.21.15.84:0/1695696030 shutdown_connections 2024-04-26T21:35:29.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.081+0000 7f1859a00700 1 --2- 172.21.15.84:0/1695696030 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18540fdfd0 0x7f18540fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:29.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.081+0000 7f1859a00700 1 --2- 172.21.15.84:0/1695696030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18540fce60 0x7f18540fd270 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:29.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.081+0000 7f1859a00700 1 -- 172.21.15.84:0/1695696030 >> 172.21.15.84:0/1695696030 conn(0x7f18540f8540 msgr2=0x7f18540fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:35:29.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.081+0000 7f1859a00700 1 -- 172.21.15.84:0/1695696030 shutdown_connections 2024-04-26T21:35:29.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.081+0000 7f1859a00700 1 -- 172.21.15.84:0/1695696030 wait complete. 2024-04-26T21:35:29.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.082+0000 7f1859a00700 1 Processor -- start 2024-04-26T21:35:29.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.082+0000 7f1859a00700 1 -- start start 2024-04-26T21:35:29.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.083+0000 7f1859a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18540fce60 0x7f185410d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:29.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.083+0000 7f1859a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18540fdfd0 0x7f185410de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:29.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.083+0000 7f1859a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185410e450 con 0x7f18540fdfd0 2024-04-26T21:35:29.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.083+0000 7f1859a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185410e5c0 con 0x7f18540fce60 2024-04-26T21:35:29.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.083+0000 7f1852000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18540fdfd0 0x7f185410de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:35:29.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.083+0000 7f1852000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18540fdfd0 0x7f185410de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58878/0 (socket says 172.21.15.84:58878) 2024-04-26T21:35:29.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.083+0000 7f1852000700 1 -- 172.21.15.84:0/3873526796 learned_addr learned my addr 172.21.15.84:0/3873526796 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:35:29.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.083+0000 7f1852a00700 1 --2- 172.21.15.84:0/3873526796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18540fce60 0x7f185410d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:35:29.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.083+0000 7f1852000700 1 -- 172.21.15.84:0/3873526796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18540fce60 msgr2=0x7f185410d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:29.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.083+0000 7f1852000700 1 --2- 172.21.15.84:0/3873526796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18540fce60 0x7f185410d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:29.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.084+0000 7f1852000700 1 -- 172.21.15.84:0/3873526796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1844005040 con 0x7f18540fdfd0 2024-04-26T21:35:29.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.084+0000 7f1852000700 1 --2- 172.21.15.84:0/3873526796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18540fdfd0 0x7f185410de50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f184000c830 tx=0x7f1840004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:35:29.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.084+0000 7f184aa00700 1 -- 172.21.15.84:0/3873526796 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f184000a760 con 0x7f18540fdfd0 2024-04-26T21:35:29.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.084+0000 7f184aa00700 1 -- 172.21.15.84:0/3873526796 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f184000ad90 con 0x7f18540fdfd0 2024-04-26T21:35:29.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.084+0000 7f1859a00700 1 -- 172.21.15.84:0/3873526796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1854113020 con 0x7f18540fdfd0 2024-04-26T21:35:29.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.084+0000 7f184aa00700 1 -- 172.21.15.84:0/3873526796 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18400113a0 con 0x7f18540fdfd0 2024-04-26T21:35:29.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.084+0000 7f1859a00700 1 -- 172.21.15.84:0/3873526796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18541135b0 con 0x7f18540fdfd0 2024-04-26T21:35:29.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.086+0000 7f1859a00700 1 -- 172.21.15.84:0/3873526796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185404c710 con 0x7f18540fdfd0 2024-04-26T21:35:29.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.087+0000 7f184aa00700 1 -- 172.21.15.84:0/3873526796 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1840012400 con 0x7f18540fdfd0 2024-04-26T21:35:29.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.088+0000 7f184aa00700 1 --2- 172.21.15.84:0/3873526796 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f183806ec00 0x7f18380710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:29.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.088+0000 7f184aa00700 1 -- 172.21.15.84:0/3873526796 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f184008e950 con 0x7f18540fdfd0 2024-04-26T21:35:29.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.088+0000 7f1852a00700 1 --2- 172.21.15.84:0/3873526796 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f183806ec00 0x7f18380710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:35:29.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.089+0000 7f1852a00700 1 --2- 172.21.15.84:0/3873526796 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f183806ec00 0x7f18380710b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1844004f90 tx=0x7f1844009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:35:29.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.093+0000 7f184aa00700 1 -- 172.21.15.84:0/3873526796 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f184005b1f0 con 0x7f18540fdfd0 2024-04-26T21:35:29.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:29 smithi084 ceph-mon[90138]: Deploying daemon prometheus.smithi084 on smithi084 2024-04-26T21:35:29.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:29 smithi084 ceph-mon[90138]: pgmap v281: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:29.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:29 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:35:29.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.347+0000 7f1859a00700 1 -- 172.21.15.84:0/3873526796 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1854102360 con 0x7f183806ec00 2024-04-26T21:35:29.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.350+0000 7f184aa00700 1 -- 172.21.15.84:0/3873526796 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7f1854102360 con 0x7f183806ec00 2024-04-26T21:35:29.352 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:29 smithi120 ceph-mon[79001]: Deploying daemon prometheus.smithi084 on smithi084 2024-04-26T21:35:29.352 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:29 smithi120 ceph-mon[79001]: pgmap v281: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:29.352 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:29 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:35:29.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.353+0000 7f1859a00700 1 -- 172.21.15.84:0/3873526796 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f183806ec00 msgr2=0x7f18380710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:29.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.353+0000 7f1859a00700 1 --2- 172.21.15.84:0/3873526796 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f183806ec00 0x7f18380710b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1844004f90 tx=0x7f1844009e30 comp rx=0 tx=0).stop 2024-04-26T21:35:29.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.353+0000 7f1859a00700 1 -- 172.21.15.84:0/3873526796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18540fdfd0 msgr2=0x7f185410de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:29.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.353+0000 7f1859a00700 1 --2- 172.21.15.84:0/3873526796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18540fdfd0 0x7f185410de50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f184000c830 tx=0x7f1840004470 comp rx=0 tx=0).stop 2024-04-26T21:35:29.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.353+0000 7f1859a00700 1 -- 172.21.15.84:0/3873526796 shutdown_connections 2024-04-26T21:35:29.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.353+0000 7f1859a00700 1 --2- 172.21.15.84:0/3873526796 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f183806ec00 0x7f18380710b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:29.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.353+0000 7f1859a00700 1 --2- 172.21.15.84:0/3873526796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18540fce60 0x7f185410d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:29.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.353+0000 7f1859a00700 1 --2- 172.21.15.84:0/3873526796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18540fdfd0 0x7f185410de50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:29.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.353+0000 7f1859a00700 1 -- 172.21.15.84:0/3873526796 >> 172.21.15.84:0/3873526796 conn(0x7f18540f8540 msgr2=0x7f18540f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:35:29.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.353+0000 7f1859a00700 1 -- 172.21.15.84:0/3873526796 shutdown_connections 2024-04-26T21:35:29.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.353+0000 7f1859a00700 1 -- 172.21.15.84:0/3873526796 wait complete. 2024-04-26T21:35:29.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.504+0000 7fe225000700 1 -- 172.21.15.84:0/1289724890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe220100060 msgr2=0x7fe2201004d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:29.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.504+0000 7fe225000700 1 --2- 172.21.15.84:0/1289724890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe220100060 0x7fe2201004d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe20c004940 tx=0x7fe20c009e30 comp rx=0 tx=0).stop 2024-04-26T21:35:29.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.504+0000 7fe225000700 1 -- 172.21.15.84:0/1289724890 shutdown_connections 2024-04-26T21:35:29.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.505+0000 7fe225000700 1 --2- 172.21.15.84:0/1289724890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe220100060 0x7fe2201004d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:29.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.505+0000 7fe225000700 1 --2- 172.21.15.84:0/1289724890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2200fee60 0x7fe2200ff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:29.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.505+0000 7fe225000700 1 -- 172.21.15.84:0/1289724890 >> 172.21.15.84:0/1289724890 conn(0x7fe2200fa730 msgr2=0x7fe2200fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:35:29.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.505+0000 7fe225000700 1 -- 172.21.15.84:0/1289724890 shutdown_connections 2024-04-26T21:35:29.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.505+0000 7fe225000700 1 -- 172.21.15.84:0/1289724890 wait complete. 2024-04-26T21:35:29.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.505+0000 7fe225000700 1 Processor -- start 2024-04-26T21:35:29.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.506+0000 7fe225000700 1 -- start start 2024-04-26T21:35:29.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.506+0000 7fe225000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2200fee60 0x7fe22010fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:29.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.506+0000 7fe225000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe220100060 0x7fe22010ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:29.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.506+0000 7fe225000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe220110570 con 0x7fe220100060 2024-04-26T21:35:29.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.506+0000 7fe225000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe220110dc0 con 0x7fe2200fee60 2024-04-26T21:35:29.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.506+0000 7fe21ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe220100060 0x7fe22010ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:35:29.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.506+0000 7fe21ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe220100060 0x7fe22010ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58896/0 (socket says 172.21.15.84:58896) 2024-04-26T21:35:29.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.506+0000 7fe21ea00700 1 -- 172.21.15.84:0/147558165 learned_addr learned my addr 172.21.15.84:0/147558165 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:35:29.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.507+0000 7fe21f400700 1 --2- 172.21.15.84:0/147558165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2200fee60 0x7fe22010fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:35:29.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.507+0000 7fe21ea00700 1 -- 172.21.15.84:0/147558165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2200fee60 msgr2=0x7fe22010fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:29.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.507+0000 7fe21ea00700 1 --2- 172.21.15.84:0/147558165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2200fee60 0x7fe22010fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:29.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.507+0000 7fe21ea00700 1 -- 172.21.15.84:0/147558165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20c005040 con 0x7fe220100060 2024-04-26T21:35:29.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.507+0000 7fe21ea00700 1 --2- 172.21.15.84:0/147558165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe220100060 0x7fe22010ff70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe20c00b3b0 tx=0x7fe20c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:35:29.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.507+0000 7fe217400700 1 -- 172.21.15.84:0/147558165 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe20c00e040 con 0x7fe220100060 2024-04-26T21:35:29.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.507+0000 7fe217400700 1 -- 172.21.15.84:0/147558165 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe20c004290 con 0x7fe220100060 2024-04-26T21:35:29.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.507+0000 7fe217400700 1 -- 172.21.15.84:0/147558165 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe20c01c630 con 0x7fe220100060 2024-04-26T21:35:29.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.507+0000 7fe225000700 1 -- 172.21.15.84:0/147558165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe220111040 con 0x7fe220100060 2024-04-26T21:35:29.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.508+0000 7fe225000700 1 -- 172.21.15.84:0/147558165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe220111580 con 0x7fe220100060 2024-04-26T21:35:29.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.509+0000 7fe225000700 1 -- 172.21.15.84:0/147558165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2200fe230 con 0x7fe220100060 2024-04-26T21:35:29.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.510+0000 7fe217400700 1 -- 172.21.15.84:0/147558165 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe20c00bbf0 con 0x7fe220100060 2024-04-26T21:35:29.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.511+0000 7fe217400700 1 --2- 172.21.15.84:0/147558165 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe20406ec00 0x7fe2040710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:29.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.511+0000 7fe217400700 1 -- 172.21.15.84:0/147558165 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fe20c08fdf0 con 0x7fe220100060 2024-04-26T21:35:29.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.511+0000 7fe21f400700 1 --2- 172.21.15.84:0/147558165 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe20406ec00 0x7fe2040710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:35:29.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.512+0000 7fe21f400700 1 --2- 172.21.15.84:0/147558165 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe20406ec00 0x7fe2040710b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe2200ffbd0 tx=0x7fe21000b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:35:29.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.516+0000 7fe217400700 1 -- 172.21.15.84:0/147558165 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fe20c05c5d0 con 0x7fe220100060 2024-04-26T21:35:29.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.756+0000 7fe225000700 1 -- 172.21.15.84:0/147558165 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe220111900 con 0x7fe20406ec00 2024-04-26T21:35:29.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.785+0000 7fe217400700 1 -- 172.21.15.84:0/147558165 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe220111900 con 0x7fe20406ec00 2024-04-26T21:35:29.787 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:35:29.787 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (10m) 12s ago 21m 14.9M - 0.25.0 c8568f914cd2 bcb419cf9108 2024-04-26T21:35:29.788 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (6m) 12s ago 21m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 b4010dfbe623 2024-04-26T21:35:29.788 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (6m) 15s ago 20m 6665k - 19.0.0-3306-gbc612ffb 55dc54019ad8 89a4e50ea23c 2024-04-26T21:35:29.788 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (10m) 12s ago 20m 75.6M - 9.4.7 954c08fa6188 1bf95f604e07 2024-04-26T21:35:29.788 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (2m) 12s ago 14m 58.1M - 19.0.0-3306-gbc612ffb 55dc54019ad8 26d10fe664bb 2024-04-26T21:35:29.788 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (94s) 12s ago 14m 13.9M - 19.0.0-3306-gbc612ffb 55dc54019ad8 c801ec16a810 2024-04-26T21:35:29.788 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (70s) 15s ago 14m 11.2M - 19.0.0-3306-gbc612ffb 55dc54019ad8 137a38b571df 2024-04-26T21:35:29.788 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (45s) 15s ago 13m 11.1M - 19.0.0-3306-gbc612ffb 55dc54019ad8 0f6be9e294cb 2024-04-26T21:35:29.788 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (9m) 12s ago 22m 512M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:35:29.788 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283,8765 running (8m) 15s ago 19m 455M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d6ae0b4628b5 2024-04-26T21:35:29.788 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (7m) 12s ago 23m 58.1M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 bf610abb6a62 2024-04-26T21:35:29.788 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (7m) 15s ago 19m 43.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 5d530496253b 2024-04-26T21:35:29.788 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (26s) 12s ago 21m 7088k - 1.5.0 0da6a335fe13 bda8f4e31302 2024-04-26T21:35:29.788 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (19s) 15s ago 19m 2985k - 1.5.0 0da6a335fe13 c28df53d1aa9 2024-04-26T21:35:29.789 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (5m) 12s ago 18m 114M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 99fbe2faa51b 2024-04-26T21:35:29.789 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (5m) 12s ago 18m 99.8M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 2dc81d93f7e5 2024-04-26T21:35:29.789 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (4m) 12s ago 17m 91.4M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 9e77abf095bd 2024-04-26T21:35:29.789 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (4m) 15s ago 17m 96.6M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 d7e5825e2640 2024-04-26T21:35:29.789 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (3m) 15s ago 16m 88.1M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 894dcbaab8eb 2024-04-26T21:35:29.789 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (3m) 15s ago 15m 85.9M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 e39948e51a13 2024-04-26T21:35:29.789 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (8m) 12s ago 20m 60.9M - 2.43.0 a07b618ecd1d d3008b765eec 2024-04-26T21:35:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.789+0000 7fe225000700 1 -- 172.21.15.84:0/147558165 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe20406ec00 msgr2=0x7fe2040710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.789+0000 7fe225000700 1 --2- 172.21.15.84:0/147558165 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe20406ec00 0x7fe2040710b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe2200ffbd0 tx=0x7fe21000b040 comp rx=0 tx=0).stop 2024-04-26T21:35:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.789+0000 7fe225000700 1 -- 172.21.15.84:0/147558165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe220100060 msgr2=0x7fe22010ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.789+0000 7fe225000700 1 --2- 172.21.15.84:0/147558165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe220100060 0x7fe22010ff70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe20c00b3b0 tx=0x7fe20c009e30 comp rx=0 tx=0).stop 2024-04-26T21:35:29.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.789+0000 7fe225000700 1 -- 172.21.15.84:0/147558165 shutdown_connections 2024-04-26T21:35:29.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.789+0000 7fe225000700 1 --2- 172.21.15.84:0/147558165 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe20406ec00 0x7fe2040710b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:29.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.789+0000 7fe225000700 1 --2- 172.21.15.84:0/147558165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2200fee60 0x7fe22010fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:29.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.789+0000 7fe225000700 1 --2- 172.21.15.84:0/147558165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe220100060 0x7fe22010ff70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:29.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.789+0000 7fe225000700 1 -- 172.21.15.84:0/147558165 >> 172.21.15.84:0/147558165 conn(0x7fe2200fa730 msgr2=0x7fe2200fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:35:29.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.790+0000 7fe225000700 1 -- 172.21.15.84:0/147558165 shutdown_connections 2024-04-26T21:35:29.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.790+0000 7fe225000700 1 -- 172.21.15.84:0/147558165 wait complete. 2024-04-26T21:35:29.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.945+0000 7f31c4000700 1 -- 172.21.15.84:0/924315356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31bc0fe080 msgr2=0x7f31bc0fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:29.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.945+0000 7f31c4000700 1 --2- 172.21.15.84:0/924315356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31bc0fe080 0x7f31bc0fe4f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f31b0004940 tx=0x7f31b0009e30 comp rx=0 tx=0).stop 2024-04-26T21:35:29.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.945+0000 7f31c4000700 1 -- 172.21.15.84:0/924315356 shutdown_connections 2024-04-26T21:35:29.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.945+0000 7f31c4000700 1 --2- 172.21.15.84:0/924315356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31bc0fe080 0x7f31bc0fe4f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:29.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.946+0000 7f31c4000700 1 --2- 172.21.15.84:0/924315356 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31bc0fcf10 0x7f31bc0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:29.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.946+0000 7f31c4000700 1 -- 172.21.15.84:0/924315356 >> 172.21.15.84:0/924315356 conn(0x7f31bc0f8560 msgr2=0x7f31bc0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:35:29.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.946+0000 7f31c4000700 1 -- 172.21.15.84:0/924315356 shutdown_connections 2024-04-26T21:35:29.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.946+0000 7f31c4000700 1 -- 172.21.15.84:0/924315356 wait complete. 2024-04-26T21:35:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.947+0000 7f31c4000700 1 Processor -- start 2024-04-26T21:35:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.947+0000 7f31c4000700 1 -- start start 2024-04-26T21:35:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.947+0000 7f31c4000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31bc0fcf10 0x7f31bc10fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.947+0000 7f31c4000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31bc0fe080 0x7f31bc110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.947+0000 7f31c4000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc110730 con 0x7f31bc0fe080 2024-04-26T21:35:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.947+0000 7f31c4000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc110f80 con 0x7f31bc0fcf10 2024-04-26T21:35:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.948+0000 7f31c0c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31bc0fe080 0x7f31bc110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:35:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.948+0000 7f31c0c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31bc0fe080 0x7f31bc110130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58928/0 (socket says 172.21.15.84:58928) 2024-04-26T21:35:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.948+0000 7f31c0c00700 1 -- 172.21.15.84:0/3392485029 learned_addr learned my addr 172.21.15.84:0/3392485029 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:35:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.948+0000 7f31c0c00700 1 -- 172.21.15.84:0/3392485029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31bc0fcf10 msgr2=0x7f31bc10fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.948+0000 7f31c0c00700 1 --2- 172.21.15.84:0/3392485029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31bc0fcf10 0x7f31bc10fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.948+0000 7f31c0c00700 1 -- 172.21.15.84:0/3392485029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b0005040 con 0x7f31bc0fe080 2024-04-26T21:35:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.949+0000 7f31c0c00700 1 --2- 172.21.15.84:0/3392485029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31bc0fe080 0x7f31bc110130 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f31b000b3b0 tx=0x7f31b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:35:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.949+0000 7f31b9600700 1 -- 172.21.15.84:0/3392485029 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31b000e040 con 0x7f31bc0fe080 2024-04-26T21:35:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.949+0000 7f31b9600700 1 -- 172.21.15.84:0/3392485029 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f31b0004290 con 0x7f31bc0fe080 2024-04-26T21:35:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.949+0000 7f31b9600700 1 -- 172.21.15.84:0/3392485029 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31b001c630 con 0x7f31bc0fe080 2024-04-26T21:35:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.949+0000 7f31c4000700 1 -- 172.21.15.84:0/3392485029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31bc111200 con 0x7f31bc0fe080 2024-04-26T21:35:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.949+0000 7f31c4000700 1 -- 172.21.15.84:0/3392485029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31bc111740 con 0x7f31bc0fe080 2024-04-26T21:35:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.950+0000 7f31c4000700 1 -- 172.21.15.84:0/3392485029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31bc101a10 con 0x7f31bc0fe080 2024-04-26T21:35:29.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.951+0000 7f31b9600700 1 -- 172.21.15.84:0/3392485029 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f31b000bbf0 con 0x7f31bc0fe080 2024-04-26T21:35:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.952+0000 7f31b9600700 1 --2- 172.21.15.84:0/3392485029 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f31a406ec10 0x7f31a40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.953+0000 7f31b9600700 1 -- 172.21.15.84:0/3392485029 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f31b008fd30 con 0x7f31bc0fe080 2024-04-26T21:35:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.953+0000 7f31c1600700 1 --2- 172.21.15.84:0/3392485029 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f31a406ec10 0x7f31a40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:35:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.953+0000 7f31c1600700 1 --2- 172.21.15.84:0/3392485029 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f31a406ec10 0x7f31a40710c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f31ac004d00 tx=0x7f31ac009ce0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:35:29.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:29.957+0000 7f31b9600700 1 -- 172.21.15.84:0/3392485029 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f31b005c5d0 con 0x7f31bc0fe080 2024-04-26T21:35:30.235 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:30 smithi084 ceph-mon[90138]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:35:30.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.281+0000 7f31c4000700 1 -- 172.21.15.84:0/3392485029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f31bc105ae0 con 0x7f31bc0fe080 2024-04-26T21:35:30.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.282+0000 7f31b9600700 1 -- 172.21.15.84:0/3392485029 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f31b005c160 con 0x7f31bc0fe080 2024-04-26T21:35:30.284 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:35:30.284 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:35:30.284 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:35:30.284 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:35:30.284 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:35:30.284 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:35:30.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:35:30.285 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:35:30.285 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 6 2024-04-26T21:35:30.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:35:30.285 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:35:30.285 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 4 2024-04-26T21:35:30.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:35:30.285 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:35:30.285 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 14 2024-04-26T21:35:30.285 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:35:30.285 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:35:30.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.285+0000 7f31c4000700 1 -- 172.21.15.84:0/3392485029 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f31a406ec10 msgr2=0x7f31a40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:30.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.285+0000 7f31c4000700 1 --2- 172.21.15.84:0/3392485029 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f31a406ec10 0x7f31a40710c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f31ac004d00 tx=0x7f31ac009ce0 comp rx=0 tx=0).stop 2024-04-26T21:35:30.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.285+0000 7f31c4000700 1 -- 172.21.15.84:0/3392485029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31bc0fe080 msgr2=0x7f31bc110130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:30.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.285+0000 7f31c4000700 1 --2- 172.21.15.84:0/3392485029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31bc0fe080 0x7f31bc110130 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f31b000b3b0 tx=0x7f31b0009e30 comp rx=0 tx=0).stop 2024-04-26T21:35:30.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.285+0000 7f31c4000700 1 -- 172.21.15.84:0/3392485029 shutdown_connections 2024-04-26T21:35:30.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.285+0000 7f31c4000700 1 --2- 172.21.15.84:0/3392485029 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f31a406ec10 0x7f31a40710c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:30.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.285+0000 7f31c4000700 1 --2- 172.21.15.84:0/3392485029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31bc0fcf10 0x7f31bc10fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:30.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.285+0000 7f31c4000700 1 --2- 172.21.15.84:0/3392485029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31bc0fe080 0x7f31bc110130 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:30.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.285+0000 7f31c4000700 1 -- 172.21.15.84:0/3392485029 >> 172.21.15.84:0/3392485029 conn(0x7f31bc0f8560 msgr2=0x7f31bc0f9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:35:30.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.286+0000 7f31c4000700 1 -- 172.21.15.84:0/3392485029 shutdown_connections 2024-04-26T21:35:30.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.286+0000 7f31c4000700 1 -- 172.21.15.84:0/3392485029 wait complete. 2024-04-26T21:35:30.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:30 smithi120 ceph-mon[79001]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:35:30.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.439+0000 7fb436000700 1 -- 172.21.15.84:0/1005892701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4300ffee0 msgr2=0x7fb430102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:30.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.439+0000 7fb436000700 1 --2- 172.21.15.84:0/1005892701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4300ffee0 0x7fb430102300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb418004940 tx=0x7fb418009e30 comp rx=0 tx=0).stop 2024-04-26T21:35:30.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.439+0000 7fb436000700 1 -- 172.21.15.84:0/1005892701 shutdown_connections 2024-04-26T21:35:30.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.439+0000 7fb436000700 1 --2- 172.21.15.84:0/1005892701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4300ffee0 0x7fb430102300 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:30.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.439+0000 7fb436000700 1 --2- 172.21.15.84:0/1005892701 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4300662c0 0x7fb4300ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:30.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.439+0000 7fb436000700 1 -- 172.21.15.84:0/1005892701 >> 172.21.15.84:0/1005892701 conn(0x7fb4300f7430 msgr2=0x7fb4300f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:35:30.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.439+0000 7fb436000700 1 -- 172.21.15.84:0/1005892701 shutdown_connections 2024-04-26T21:35:30.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.439+0000 7fb436000700 1 -- 172.21.15.84:0/1005892701 wait complete. 2024-04-26T21:35:30.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.440+0000 7fb436000700 1 Processor -- start 2024-04-26T21:35:30.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.440+0000 7fb436000700 1 -- start start 2024-04-26T21:35:30.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.441+0000 7fb436000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4300662c0 0x7fb43010fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:30.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.441+0000 7fb436000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4300ffee0 0x7fb430110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:30.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.441+0000 7fb436000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb430110740 con 0x7fb4300662c0 2024-04-26T21:35:30.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.441+0000 7fb436000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb430110f90 con 0x7fb4300ffee0 2024-04-26T21:35:30.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.441+0000 7fb42f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4300662c0 0x7fb43010fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:35:30.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.441+0000 7fb42f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4300662c0 0x7fb43010fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58940/0 (socket says 172.21.15.84:58940) 2024-04-26T21:35:30.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.441+0000 7fb42f400700 1 -- 172.21.15.84:0/1795886381 learned_addr learned my addr 172.21.15.84:0/1795886381 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:35:30.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.441+0000 7fb427e00700 1 --2- 172.21.15.84:0/1795886381 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4300ffee0 0x7fb430110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:35:30.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.441+0000 7fb42f400700 1 -- 172.21.15.84:0/1795886381 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4300ffee0 msgr2=0x7fb430110140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:30.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.441+0000 7fb42f400700 1 --2- 172.21.15.84:0/1795886381 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4300ffee0 0x7fb430110140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:30.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.442+0000 7fb42f400700 1 -- 172.21.15.84:0/1795886381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb418005040 con 0x7fb4300662c0 2024-04-26T21:35:30.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.442+0000 7fb42f400700 1 --2- 172.21.15.84:0/1795886381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4300662c0 0x7fb43010fc00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb42000c800 tx=0x7fb420004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:35:30.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.442+0000 7fb427400700 1 -- 172.21.15.84:0/1795886381 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb42000a760 con 0x7fb4300662c0 2024-04-26T21:35:30.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.442+0000 7fb427400700 1 -- 172.21.15.84:0/1795886381 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb42000ad90 con 0x7fb4300662c0 2024-04-26T21:35:30.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.442+0000 7fb436000700 1 -- 172.21.15.84:0/1795886381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb430111270 con 0x7fb4300662c0 2024-04-26T21:35:30.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.442+0000 7fb427400700 1 -- 172.21.15.84:0/1795886381 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4200113a0 con 0x7fb4300662c0 2024-04-26T21:35:30.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.442+0000 7fb436000700 1 -- 172.21.15.84:0/1795886381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4301117b0 con 0x7fb4300662c0 2024-04-26T21:35:30.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.444+0000 7fb436000700 1 -- 172.21.15.84:0/1795886381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43005f5c0 con 0x7fb4300662c0 2024-04-26T21:35:30.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.445+0000 7fb427400700 1 -- 172.21.15.84:0/1795886381 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb420012400 con 0x7fb4300662c0 2024-04-26T21:35:30.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.446+0000 7fb427400700 1 --2- 172.21.15.84:0/1795886381 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb41406ec10 0x7fb4140710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:30.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.446+0000 7fb427400700 1 -- 172.21.15.84:0/1795886381 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fb42008e9f0 con 0x7fb4300662c0 2024-04-26T21:35:30.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.447+0000 7fb427e00700 1 --2- 172.21.15.84:0/1795886381 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb41406ec10 0x7fb4140710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:35:30.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.447+0000 7fb427e00700 1 --2- 172.21.15.84:0/1795886381 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb41406ec10 0x7fb4140710c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb41800b970 tx=0x7fb418009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:35:30.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.451+0000 7fb427400700 1 -- 172.21.15.84:0/1795886381 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fb420090e60 con 0x7fb4300662c0 2024-04-26T21:35:30.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.737+0000 7fb436000700 1 -- 172.21.15.84:0/1795886381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb430111b30 con 0x7fb4300662c0 2024-04-26T21:35:30.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.738+0000 7fb427400700 1 -- 172.21.15.84:0/1795886381 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 42 v42) v1 ==== 76+0+1954 (secure 0 0 0) 0x7fb42005b1f0 con 0x7fb4300662c0 2024-04-26T21:35:30.740 INFO:teuthology.orchestra.run.smithi084.stdout:e42 2024-04-26T21:35:30.740 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:35:30.740 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:35:30.740 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:35:30.740 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:35:30.741 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:35:30.741 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:35:30.741 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 42 2024-04-26T21:35:30.741 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:35:30.741 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:35:30.741 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:34:58.296487+0000 2024-04-26T21:35:30.741 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:35:30.741 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:35:30.741 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:35:30.741 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:35:30.741 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:35:30.741 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-04-26T21:35:30.741 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:35:30.741 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:35:30.742 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 94 2024-04-26T21:35:30.742 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T21:35:30.742 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:35:30.742 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:35:30.742 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=34446,1=34478} 2024-04-26T21:35:30.742 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:35:30.742 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:35:30.742 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:35:30.742 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:35:30.742 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:35:30.742 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:35:30.742 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:35:30.742 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-04-26T21:35:30.742 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:35:30.742 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 34446 members: 34446,34478 2024-04-26T21:35:30.743 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:34446} state up:active seq 22 join_fscid=1 addr [v2:172.21.15.84:6826/1392878113,v1:172.21.15.84:6827/1392878113] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:35:30.743 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{1:34478} state up:active seq 17 join_fscid=1 addr [v2:172.21.15.84:6828/4015119551,v1:172.21.15.84:6829/4015119551] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:35:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:35:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:35:30.743 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:35:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:35:30.743 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.120:6824/1351450046,v1:172.21.15.120:6825/1351450046] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:35:30.743 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:44305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.120:6826/2847041344,v1:172.21.15.120:6827/2847041344] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:35:30.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.741+0000 7fb436000700 1 -- 172.21.15.84:0/1795886381 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb41406ec10 msgr2=0x7fb4140710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:30.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.741+0000 7fb436000700 1 --2- 172.21.15.84:0/1795886381 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb41406ec10 0x7fb4140710c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb41800b970 tx=0x7fb418009e30 comp rx=0 tx=0).stop 2024-04-26T21:35:30.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.741+0000 7fb436000700 1 -- 172.21.15.84:0/1795886381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4300662c0 msgr2=0x7fb43010fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:30.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.741+0000 7fb436000700 1 --2- 172.21.15.84:0/1795886381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4300662c0 0x7fb43010fc00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb42000c800 tx=0x7fb420004470 comp rx=0 tx=0).stop 2024-04-26T21:35:30.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.741+0000 7fb436000700 1 -- 172.21.15.84:0/1795886381 shutdown_connections 2024-04-26T21:35:30.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.741+0000 7fb436000700 1 --2- 172.21.15.84:0/1795886381 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb41406ec10 0x7fb4140710c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:30.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.741+0000 7fb436000700 1 --2- 172.21.15.84:0/1795886381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4300662c0 0x7fb43010fc00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:30.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.741+0000 7fb436000700 1 --2- 172.21.15.84:0/1795886381 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4300ffee0 0x7fb430110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:30.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.741+0000 7fb436000700 1 -- 172.21.15.84:0/1795886381 >> 172.21.15.84:0/1795886381 conn(0x7fb4300f7430 msgr2=0x7fb4300fba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:35:30.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.741+0000 7fb436000700 1 -- 172.21.15.84:0/1795886381 shutdown_connections 2024-04-26T21:35:30.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.741+0000 7fb436000700 1 -- 172.21.15.84:0/1795886381 wait complete. 2024-04-26T21:35:30.745 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 42 2024-04-26T21:35:30.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.887+0000 7f131f600700 1 -- 172.21.15.84:0/3033165114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13180fe080 msgr2=0x7f13180fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:30.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.887+0000 7f131f600700 1 --2- 172.21.15.84:0/3033165114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13180fe080 0x7f13180fe4f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1304004940 tx=0x7f1304009e30 comp rx=0 tx=0).stop 2024-04-26T21:35:30.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.887+0000 7f131f600700 1 -- 172.21.15.84:0/3033165114 shutdown_connections 2024-04-26T21:35:30.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.887+0000 7f131f600700 1 --2- 172.21.15.84:0/3033165114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13180fe080 0x7f13180fe4f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:30.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.887+0000 7f131f600700 1 --2- 172.21.15.84:0/3033165114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13180fcf10 0x7f13180fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:30.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.887+0000 7f131f600700 1 -- 172.21.15.84:0/3033165114 >> 172.21.15.84:0/3033165114 conn(0x7f13180f8560 msgr2=0x7f13180fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:35:30.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.887+0000 7f131f600700 1 -- 172.21.15.84:0/3033165114 shutdown_connections 2024-04-26T21:35:30.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.887+0000 7f131f600700 1 -- 172.21.15.84:0/3033165114 wait complete. 2024-04-26T21:35:30.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.888+0000 7f131f600700 1 Processor -- start 2024-04-26T21:35:30.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.889+0000 7f131f600700 1 -- start start 2024-04-26T21:35:30.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.889+0000 7f131f600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13180fcf10 0x7f1318107160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.889+0000 7f131f600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13180fe080 0x7f13181076a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.889+0000 7f131f600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1318107cf0 con 0x7f13180fcf10 2024-04-26T21:35:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.889+0000 7f131f600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1318108540 con 0x7f13180fe080 2024-04-26T21:35:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.889+0000 7f131cc00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13180fcf10 0x7f1318107160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:35:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.889+0000 7f131cc00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13180fcf10 0x7f1318107160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58964/0 (socket says 172.21.15.84:58964) 2024-04-26T21:35:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.889+0000 7f131cc00700 1 -- 172.21.15.84:0/4226008857 learned_addr learned my addr 172.21.15.84:0/4226008857 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:35:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.890+0000 7f1317e00700 1 --2- 172.21.15.84:0/4226008857 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13180fe080 0x7f13181076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:35:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.890+0000 7f131cc00700 1 -- 172.21.15.84:0/4226008857 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13180fe080 msgr2=0x7f13181076a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.890+0000 7f131cc00700 1 --2- 172.21.15.84:0/4226008857 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13180fe080 0x7f13181076a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.890+0000 7f131cc00700 1 -- 172.21.15.84:0/4226008857 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1304005040 con 0x7f13180fcf10 2024-04-26T21:35:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.890+0000 7f131cc00700 1 --2- 172.21.15.84:0/4226008857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13180fcf10 0x7f1318107160 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f130c00c830 tx=0x7f130c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:35:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.890+0000 7f1314c00700 1 -- 172.21.15.84:0/4226008857 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f130c00a760 con 0x7f13180fcf10 2024-04-26T21:35:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.890+0000 7f1314c00700 1 -- 172.21.15.84:0/4226008857 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f130c00ad90 con 0x7f13180fcf10 2024-04-26T21:35:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.890+0000 7f1314c00700 1 -- 172.21.15.84:0/4226008857 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f130c0113a0 con 0x7f13180fcf10 2024-04-26T21:35:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.890+0000 7f131f600700 1 -- 172.21.15.84:0/4226008857 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1318108820 con 0x7f13180fcf10 2024-04-26T21:35:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.891+0000 7f131f600700 1 -- 172.21.15.84:0/4226008857 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1318108de0 con 0x7f13180fcf10 2024-04-26T21:35:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.892+0000 7f131f600700 1 -- 172.21.15.84:0/4226008857 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1318101a10 con 0x7f13180fcf10 2024-04-26T21:35:30.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.893+0000 7f1314c00700 1 -- 172.21.15.84:0/4226008857 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f130c012400 con 0x7f13180fcf10 2024-04-26T21:35:30.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.894+0000 7f1314c00700 1 --2- 172.21.15.84:0/4226008857 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f130006ec10 0x7f13000710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:30.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.894+0000 7f1314c00700 1 -- 172.21.15.84:0/4226008857 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f130c08e950 con 0x7f13180fcf10 2024-04-26T21:35:30.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.894+0000 7f1317e00700 1 --2- 172.21.15.84:0/4226008857 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f130006ec10 0x7f13000710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:35:30.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.895+0000 7f1317e00700 1 --2- 172.21.15.84:0/4226008857 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f130006ec10 0x7f13000710c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1304004f90 tx=0x7f1304009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:35:30.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:30.899+0000 7f1314c00700 1 -- 172.21.15.84:0/4226008857 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f130c0576c0 con 0x7f13180fcf10 2024-04-26T21:35:31.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.152+0000 7f131f600700 1 -- 172.21.15.84:0/4226008857 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1318105ae0 con 0x7f130006ec10 2024-04-26T21:35:31.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.153+0000 7f1314c00700 1 -- 172.21.15.84:0/4226008857 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7f1318105ae0 con 0x7f130006ec10 2024-04-26T21:35:31.155 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:35:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:35:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:35:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:35:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-04-26T21:35:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-04-26T21:35:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: "osd", 2024-04-26T21:35:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: "mds", 2024-04-26T21:35:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr", 2024-04-26T21:35:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: "crash" 2024-04-26T21:35:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-04-26T21:35:31.156 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "16/21 daemons upgraded", 2024-04-26T21:35:31.156 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading prometheus daemons", 2024-04-26T21:35:31.156 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:35:31.156 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:35:31.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.156+0000 7f131f600700 1 -- 172.21.15.84:0/4226008857 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f130006ec10 msgr2=0x7f13000710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:31.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.156+0000 7f131f600700 1 --2- 172.21.15.84:0/4226008857 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f130006ec10 0x7f13000710c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1304004f90 tx=0x7f1304009e30 comp rx=0 tx=0).stop 2024-04-26T21:35:31.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.156+0000 7f131f600700 1 -- 172.21.15.84:0/4226008857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13180fcf10 msgr2=0x7f1318107160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:31.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.156+0000 7f131f600700 1 --2- 172.21.15.84:0/4226008857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13180fcf10 0x7f1318107160 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f130c00c830 tx=0x7f130c004470 comp rx=0 tx=0).stop 2024-04-26T21:35:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.157+0000 7f131f600700 1 -- 172.21.15.84:0/4226008857 shutdown_connections 2024-04-26T21:35:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.157+0000 7f131f600700 1 --2- 172.21.15.84:0/4226008857 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f130006ec10 0x7f13000710c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.157+0000 7f131f600700 1 --2- 172.21.15.84:0/4226008857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13180fcf10 0x7f1318107160 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.157+0000 7f131f600700 1 --2- 172.21.15.84:0/4226008857 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13180fe080 0x7f13181076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.157+0000 7f131f600700 1 -- 172.21.15.84:0/4226008857 >> 172.21.15.84:0/4226008857 conn(0x7f13180f8560 msgr2=0x7f13180f9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:35:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.157+0000 7f131f600700 1 -- 172.21.15.84:0/4226008857 shutdown_connections 2024-04-26T21:35:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.157+0000 7f131f600700 1 -- 172.21.15.84:0/4226008857 wait complete. 2024-04-26T21:35:31.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.297+0000 7fe62a200700 1 -- 172.21.15.84:0/2364408854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6240fff40 msgr2=0x7fe624102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:31.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.297+0000 7fe62a200700 1 --2- 172.21.15.84:0/2364408854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6240fff40 0x7fe624102320 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe610004940 tx=0x7fe610009e30 comp rx=0 tx=0).stop 2024-04-26T21:35:31.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.297+0000 7fe62a200700 1 -- 172.21.15.84:0/2364408854 shutdown_connections 2024-04-26T21:35:31.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.297+0000 7fe62a200700 1 --2- 172.21.15.84:0/2364408854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6240fff40 0x7fe624102320 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:31.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.297+0000 7fe62a200700 1 --2- 172.21.15.84:0/2364408854 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe624066260 0x7fe6240ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:31.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.297+0000 7fe62a200700 1 -- 172.21.15.84:0/2364408854 >> 172.21.15.84:0/2364408854 conn(0x7fe6240f7430 msgr2=0x7fe6240f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:35:31.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.297+0000 7fe62a200700 1 -- 172.21.15.84:0/2364408854 shutdown_connections 2024-04-26T21:35:31.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.297+0000 7fe62a200700 1 -- 172.21.15.84:0/2364408854 wait complete. 2024-04-26T21:35:31.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.298+0000 7fe62a200700 1 Processor -- start 2024-04-26T21:35:31.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.298+0000 7fe62a200700 1 -- start start 2024-04-26T21:35:31.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.299+0000 7fe62a200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe624066260 0x7fe62410fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:31.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.299+0000 7fe62a200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6240fff40 0x7fe624110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:31.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.299+0000 7fe62a200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe624110740 con 0x7fe6240fff40 2024-04-26T21:35:31.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.299+0000 7fe62a200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe624110f90 con 0x7fe624066260 2024-04-26T21:35:31.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.299+0000 7fe622a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6240fff40 0x7fe624110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:35:31.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.299+0000 7fe622a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6240fff40 0x7fe624110140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58978/0 (socket says 172.21.15.84:58978) 2024-04-26T21:35:31.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.299+0000 7fe622a00700 1 -- 172.21.15.84:0/2993221443 learned_addr learned my addr 172.21.15.84:0/2993221443 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:35:31.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.299+0000 7fe623400700 1 --2- 172.21.15.84:0/2993221443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe624066260 0x7fe62410fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:35:31.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.300+0000 7fe622a00700 1 -- 172.21.15.84:0/2993221443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe624066260 msgr2=0x7fe62410fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:31.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.300+0000 7fe622a00700 1 --2- 172.21.15.84:0/2993221443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe624066260 0x7fe62410fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:31.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.300+0000 7fe622a00700 1 -- 172.21.15.84:0/2993221443 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe610005040 con 0x7fe6240fff40 2024-04-26T21:35:31.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.300+0000 7fe622a00700 1 --2- 172.21.15.84:0/2993221443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6240fff40 0x7fe624110140 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe61000b970 tx=0x7fe610009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:35:31.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.300+0000 7fe61b400700 1 -- 172.21.15.84:0/2993221443 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe61000e040 con 0x7fe6240fff40 2024-04-26T21:35:31.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.300+0000 7fe61b400700 1 -- 172.21.15.84:0/2993221443 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe610004290 con 0x7fe6240fff40 2024-04-26T21:35:31.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.300+0000 7fe62a200700 1 -- 172.21.15.84:0/2993221443 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe624111210 con 0x7fe6240fff40 2024-04-26T21:35:31.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.300+0000 7fe61b400700 1 -- 172.21.15.84:0/2993221443 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe61001c630 con 0x7fe6240fff40 2024-04-26T21:35:31.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.300+0000 7fe62a200700 1 -- 172.21.15.84:0/2993221443 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe624111750 con 0x7fe6240fff40 2024-04-26T21:35:31.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.302+0000 7fe62a200700 1 -- 172.21.15.84:0/2993221443 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62405f5c0 con 0x7fe6240fff40 2024-04-26T21:35:31.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.303+0000 7fe61b400700 1 -- 172.21.15.84:0/2993221443 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe6100139f0 con 0x7fe6240fff40 2024-04-26T21:35:31.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.303+0000 7fe61b400700 1 --2- 172.21.15.84:0/2993221443 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe60806ec10 0x7fe6080710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:35:31.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.304+0000 7fe61b400700 1 -- 172.21.15.84:0/2993221443 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fe61008fc40 con 0x7fe6240fff40 2024-04-26T21:35:31.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.304+0000 7fe623400700 1 --2- 172.21.15.84:0/2993221443 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe60806ec10 0x7fe6080710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:35:31.305 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:31 smithi084 ceph-mon[90138]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:35:31.305 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:31 smithi084 ceph-mon[90138]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:35:31.306 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:31 smithi084 ceph-mon[90138]: pgmap v282: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:31.306 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:31 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3392485029' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:31.306 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:31 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/1795886381' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:35:31.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.305+0000 7fe623400700 1 --2- 172.21.15.84:0/2993221443 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe60806ec10 0x7fe6080710c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe614009fd0 tx=0x7fe614009f00 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:35:31.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.309+0000 7fe61b400700 1 -- 172.21.15.84:0/2993221443 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fe61005c4e0 con 0x7fe6240fff40 2024-04-26T21:35:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:31 smithi120 ceph-mon[79001]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:35:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:31 smithi120 ceph-mon[79001]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:35:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:31 smithi120 ceph-mon[79001]: pgmap v282: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:31.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:31 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3392485029' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:31.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:31 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/1795886381' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:35:31.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.616+0000 7fe62a200700 1 -- 172.21.15.84:0/2993221443 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe62404bed0 con 0x7fe6240fff40 2024-04-26T21:35:31.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.617+0000 7fe61b400700 1 -- 172.21.15.84:0/2993221443 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fe61005c070 con 0x7fe6240fff40 2024-04-26T21:35:31.618 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:35:31.618 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:35:31.618 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:35:31.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.619+0000 7fe62a200700 1 -- 172.21.15.84:0/2993221443 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe60806ec10 msgr2=0x7fe6080710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:31.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.619+0000 7fe62a200700 1 --2- 172.21.15.84:0/2993221443 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe60806ec10 0x7fe6080710c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe614009fd0 tx=0x7fe614009f00 comp rx=0 tx=0).stop 2024-04-26T21:35:31.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.619+0000 7fe62a200700 1 -- 172.21.15.84:0/2993221443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6240fff40 msgr2=0x7fe624110140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:35:31.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.619+0000 7fe62a200700 1 --2- 172.21.15.84:0/2993221443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6240fff40 0x7fe624110140 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe61000b970 tx=0x7fe610009e30 comp rx=0 tx=0).stop 2024-04-26T21:35:31.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.620+0000 7fe62a200700 1 -- 172.21.15.84:0/2993221443 shutdown_connections 2024-04-26T21:35:31.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.620+0000 7fe62a200700 1 --2- 172.21.15.84:0/2993221443 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe60806ec10 0x7fe6080710c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:31.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.620+0000 7fe62a200700 1 --2- 172.21.15.84:0/2993221443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe624066260 0x7fe62410fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:31.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.620+0000 7fe62a200700 1 --2- 172.21.15.84:0/2993221443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6240fff40 0x7fe624110140 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:35:31.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.620+0000 7fe62a200700 1 -- 172.21.15.84:0/2993221443 >> 172.21.15.84:0/2993221443 conn(0x7fe6240f7430 msgr2=0x7fe6240fbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:35:31.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.620+0000 7fe62a200700 1 -- 172.21.15.84:0/2993221443 shutdown_connections 2024-04-26T21:35:31.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:35:31.620+0000 7fe62a200700 1 -- 172.21.15.84:0/2993221443 wait complete. 2024-04-26T21:35:32.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:32 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2993221443' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:35:32.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:32 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2993221443' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:35:33.274 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:33 smithi084 ceph-mon[90138]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:35:33.274 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:33 smithi084 ceph-mon[90138]: pgmap v283: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:33.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:33 smithi120 ceph-mon[79001]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:35:33.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:33 smithi120 ceph-mon[79001]: pgmap v283: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:35.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:35 smithi084 ceph-mon[90138]: pgmap v284: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:35.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:35 smithi120 ceph-mon[79001]: pgmap v284: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:36.537 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:36 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:36.537 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:36 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:36.537 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:36 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:35:36.537 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:36 smithi084 ceph-mon[90138]: pgmap v285: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:36.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:36 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:36.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:36 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:36.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:36 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:35:36.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:36 smithi120 ceph-mon[79001]: pgmap v285: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:39.410 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:38 smithi084 ceph-mon[90138]: pgmap v286: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:39.410 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:38 smithi120 ceph-mon[79001]: pgmap v286: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:41.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:40 smithi084 ceph-mon[90138]: pgmap v287: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:41.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:40 smithi120 ceph-mon[79001]: pgmap v287: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:42.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:42 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:42.914 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:42 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:42.914 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:42 smithi084 ceph-mon[90138]: pgmap v288: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:42.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:42 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:42.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:42 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:42.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:42 smithi120 ceph-mon[79001]: pgmap v288: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:44.785 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:44.786 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:44.788 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:44 smithi084 ceph-mon[90138]: pgmap v289: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:44.788 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:35:44.936 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:44.936 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:44.936 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:44 smithi120 ceph-mon[79001]: pgmap v289: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:44.936 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:35:47.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:46 smithi084 ceph-mon[90138]: pgmap v290: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:46 smithi120 ceph-mon[79001]: pgmap v290: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:49.094 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:48 smithi084 ceph-mon[90138]: pgmap v291: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:49.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:48 smithi120 ceph-mon[79001]: pgmap v291: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:50.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:50.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:50.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:35:50.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:35:50.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:50.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:35:50.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:35:50.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:35:50.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.553 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.554 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.554 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.554 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.554 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.554 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:50 smithi084 ceph-mon[90138]: pgmap v292: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:50.686 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:50.686 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:50.686 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:35:50.686 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:35:50.686 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:35:50.686 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:35:50.686 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:35:50.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:35:50.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.687 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.688 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:35:50.688 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:50 smithi120 ceph-mon[79001]: pgmap v292: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:53.060 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:52 smithi084 ceph-mon[90138]: Upgrade: Updating alertmanager.smithi084 2024-04-26T21:35:53.060 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:52 smithi084 ceph-mon[90138]: Deploying daemon alertmanager.smithi084 on smithi084 2024-04-26T21:35:53.060 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:52 smithi084 ceph-mon[90138]: pgmap v293: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:52 smithi120 ceph-mon[79001]: Upgrade: Updating alertmanager.smithi084 2024-04-26T21:35:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:52 smithi120 ceph-mon[79001]: Deploying daemon alertmanager.smithi084 on smithi084 2024-04-26T21:35:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:52 smithi120 ceph-mon[79001]: pgmap v293: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:55.231 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:54 smithi084 ceph-mon[90138]: pgmap v294: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:54 smithi120 ceph-mon[79001]: pgmap v294: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:57.220 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:56 smithi084 ceph-mon[90138]: pgmap v295: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:56 smithi120 ceph-mon[79001]: pgmap v295: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:59.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:58 smithi084 ceph-mon[90138]: pgmap v296: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:35:59.235 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:58 smithi120 ceph-mon[79001]: pgmap v296: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:00.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:59 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:36:00.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:59 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:00.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:59 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:00.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:35:59 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:36:00.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:59 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:36:00.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:59 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:00.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:59 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:00.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:35:59 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:36:01.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:00 smithi084 ceph-mon[90138]: pgmap v297: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:01.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:00 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:01.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:00 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:01.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:00 smithi120 ceph-mon[79001]: pgmap v297: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:01.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:00 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:01.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:00 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:01.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.790+0000 7f5885200700 1 -- 172.21.15.84:0/500681144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5880066af0 msgr2=0x7f58800ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:01.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.790+0000 7f5885200700 1 --2- 172.21.15.84:0/500681144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5880066af0 0x7f58800ffa00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5870004940 tx=0x7f5870009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:01.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.790+0000 7f5885200700 1 -- 172.21.15.84:0/500681144 shutdown_connections 2024-04-26T21:36:01.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.790+0000 7f5885200700 1 --2- 172.21.15.84:0/500681144 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58800fff40 0x7f5880102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:01.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.790+0000 7f5885200700 1 --2- 172.21.15.84:0/500681144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5880066af0 0x7f58800ffa00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:01.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.790+0000 7f5885200700 1 -- 172.21.15.84:0/500681144 >> 172.21.15.84:0/500681144 conn(0x7f58800f73f0 msgr2=0x7f58800f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:01.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.790+0000 7f5885200700 1 -- 172.21.15.84:0/500681144 shutdown_connections 2024-04-26T21:36:01.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.790+0000 7f5885200700 1 -- 172.21.15.84:0/500681144 wait complete. 2024-04-26T21:36:01.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.791+0000 7f5885200700 1 Processor -- start 2024-04-26T21:36:01.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.791+0000 7f5885200700 1 -- start start 2024-04-26T21:36:01.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.791+0000 7f5885200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5880066af0 0x7f588010fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:01.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.791+0000 7f5885200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58800fff40 0x7f5880110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:01.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.791+0000 7f5885200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5880110780 con 0x7f58800fff40 2024-04-26T21:36:01.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.791+0000 7f5885200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5880110fd0 con 0x7f5880066af0 2024-04-26T21:36:01.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.792+0000 7f587d400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58800fff40 0x7f5880110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:01.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.792+0000 7f587d400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58800fff40 0x7f5880110180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35958/0 (socket says 172.21.15.84:35958) 2024-04-26T21:36:01.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.792+0000 7f587d400700 1 -- 172.21.15.84:0/657621004 learned_addr learned my addr 172.21.15.84:0/657621004 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:36:01.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.792+0000 7f587de00700 1 --2- 172.21.15.84:0/657621004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5880066af0 0x7f588010fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:01.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.792+0000 7f587d400700 1 -- 172.21.15.84:0/657621004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5880066af0 msgr2=0x7f588010fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:01.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.792+0000 7f587d400700 1 --2- 172.21.15.84:0/657621004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5880066af0 0x7f588010fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:01.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.792+0000 7f587d400700 1 -- 172.21.15.84:0/657621004 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5870005040 con 0x7f58800fff40 2024-04-26T21:36:01.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.793+0000 7f587d400700 1 --2- 172.21.15.84:0/657621004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58800fff40 0x7f5880110180 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f586c00c8c0 tx=0x7f586c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:01.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.793+0000 7f5876000700 1 -- 172.21.15.84:0/657621004 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f586c00a980 con 0x7f58800fff40 2024-04-26T21:36:01.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.793+0000 7f5876000700 1 -- 172.21.15.84:0/657621004 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f586c00ce60 con 0x7f58800fff40 2024-04-26T21:36:01.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.793+0000 7f5876000700 1 -- 172.21.15.84:0/657621004 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f586c0115e0 con 0x7f58800fff40 2024-04-26T21:36:01.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.793+0000 7f5885200700 1 -- 172.21.15.84:0/657621004 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58801112b0 con 0x7f58800fff40 2024-04-26T21:36:01.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.793+0000 7f5885200700 1 -- 172.21.15.84:0/657621004 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58801117f0 con 0x7f58800fff40 2024-04-26T21:36:01.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.794+0000 7f5885200700 1 -- 172.21.15.84:0/657621004 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588005f5c0 con 0x7f58800fff40 2024-04-26T21:36:01.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.795+0000 7f5876000700 1 -- 172.21.15.84:0/657621004 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f586c012400 con 0x7f58800fff40 2024-04-26T21:36:01.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.796+0000 7f5876000700 1 --2- 172.21.15.84:0/657621004 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f586406ec10 0x7f58640710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:01.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.796+0000 7f5876000700 1 -- 172.21.15.84:0/657621004 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f586c08ea90 con 0x7f58800fff40 2024-04-26T21:36:01.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.797+0000 7f587de00700 1 --2- 172.21.15.84:0/657621004 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f586406ec10 0x7f58640710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:01.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.797+0000 7f587de00700 1 --2- 172.21.15.84:0/657621004 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f586406ec10 0x7f58640710c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5870009fd0 tx=0x7f5870009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:01.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:01.801+0000 7f5876000700 1 -- 172.21.15.84:0/657621004 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f586c05b270 con 0x7f58800fff40 2024-04-26T21:36:02.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.052+0000 7f5885200700 1 -- 172.21.15.84:0/657621004 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5880111c30 con 0x7f586406ec10 2024-04-26T21:36:02.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.054+0000 7f5876000700 1 -- 172.21.15.84:0/657621004 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7f5880111c30 con 0x7f586406ec10 2024-04-26T21:36:02.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.056+0000 7f5885200700 1 -- 172.21.15.84:0/657621004 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f586406ec10 msgr2=0x7f58640710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:02.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.056+0000 7f5885200700 1 --2- 172.21.15.84:0/657621004 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f586406ec10 0x7f58640710c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5870009fd0 tx=0x7f5870009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:02.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.056+0000 7f5885200700 1 -- 172.21.15.84:0/657621004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58800fff40 msgr2=0x7f5880110180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:02.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.056+0000 7f5885200700 1 --2- 172.21.15.84:0/657621004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58800fff40 0x7f5880110180 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f586c00c8c0 tx=0x7f586c0044c0 comp rx=0 tx=0).stop 2024-04-26T21:36:02.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.057+0000 7f5885200700 1 -- 172.21.15.84:0/657621004 shutdown_connections 2024-04-26T21:36:02.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.057+0000 7f5885200700 1 --2- 172.21.15.84:0/657621004 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f586406ec10 0x7f58640710c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:02.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.057+0000 7f5885200700 1 --2- 172.21.15.84:0/657621004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5880066af0 0x7f588010fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:02.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.057+0000 7f5885200700 1 --2- 172.21.15.84:0/657621004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58800fff40 0x7f5880110180 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:02.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.057+0000 7f5885200700 1 -- 172.21.15.84:0/657621004 >> 172.21.15.84:0/657621004 conn(0x7f58800f73f0 msgr2=0x7f58800fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:02.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.057+0000 7f5885200700 1 -- 172.21.15.84:0/657621004 shutdown_connections 2024-04-26T21:36:02.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.057+0000 7f5885200700 1 -- 172.21.15.84:0/657621004 wait complete. 2024-04-26T21:36:02.072 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:36:02.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.210+0000 7fc16ac00700 1 -- 172.21.15.84:0/1929871556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641002a0 msgr2=0x7fc164100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:02.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.210+0000 7fc16ac00700 1 --2- 172.21.15.84:0/1929871556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641002a0 0x7fc164100710 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc150004940 tx=0x7fc150009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:02.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.210+0000 7fc16ac00700 1 -- 172.21.15.84:0/1929871556 shutdown_connections 2024-04-26T21:36:02.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.210+0000 7fc16ac00700 1 --2- 172.21.15.84:0/1929871556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641002a0 0x7fc164100710 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:02.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.210+0000 7fc16ac00700 1 --2- 172.21.15.84:0/1929871556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1640feff0 0x7fc1640ff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:02.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.210+0000 7fc16ac00700 1 -- 172.21.15.84:0/1929871556 >> 172.21.15.84:0/1929871556 conn(0x7fc1640fa8f0 msgr2=0x7fc1640fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:02.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.210+0000 7fc16ac00700 1 -- 172.21.15.84:0/1929871556 shutdown_connections 2024-04-26T21:36:02.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.210+0000 7fc16ac00700 1 -- 172.21.15.84:0/1929871556 wait complete. 2024-04-26T21:36:02.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.211+0000 7fc16ac00700 1 Processor -- start 2024-04-26T21:36:02.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.211+0000 7fc16ac00700 1 -- start start 2024-04-26T21:36:02.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.211+0000 7fc16ac00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1640feff0 0x7fc16410fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:02.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.211+0000 7fc16ac00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641002a0 0x7fc164110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:02.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.211+0000 7fc16ac00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc164110680 con 0x7fc1641002a0 2024-04-26T21:36:02.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.211+0000 7fc16ac00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1641107f0 con 0x7fc1640feff0 2024-04-26T21:36:02.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.212+0000 7fc163400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641002a0 0x7fc164110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:02.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.212+0000 7fc163400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641002a0 0x7fc164110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44574/0 (socket says 172.21.15.84:44574) 2024-04-26T21:36:02.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.212+0000 7fc163400700 1 -- 172.21.15.84:0/3977446200 learned_addr learned my addr 172.21.15.84:0/3977446200 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:36:02.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.212+0000 7fc163e00700 1 --2- 172.21.15.84:0/3977446200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1640feff0 0x7fc16410fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:02.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.212+0000 7fc163400700 1 -- 172.21.15.84:0/3977446200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1640feff0 msgr2=0x7fc16410fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:02.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.212+0000 7fc163400700 1 --2- 172.21.15.84:0/3977446200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1640feff0 0x7fc16410fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:02.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.212+0000 7fc163400700 1 -- 172.21.15.84:0/3977446200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc150005040 con 0x7fc1641002a0 2024-04-26T21:36:02.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.212+0000 7fc163400700 1 --2- 172.21.15.84:0/3977446200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641002a0 0x7fc164110080 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc15000b3b0 tx=0x7fc150009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:02.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.213+0000 7fc15be00700 1 -- 172.21.15.84:0/3977446200 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc15000e040 con 0x7fc1641002a0 2024-04-26T21:36:02.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.213+0000 7fc15be00700 1 -- 172.21.15.84:0/3977446200 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc150004290 con 0x7fc1641002a0 2024-04-26T21:36:02.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.213+0000 7fc16ac00700 1 -- 172.21.15.84:0/3977446200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1641151f0 con 0x7fc1641002a0 2024-04-26T21:36:02.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.213+0000 7fc15be00700 1 -- 172.21.15.84:0/3977446200 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc15001c630 con 0x7fc1641002a0 2024-04-26T21:36:02.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.213+0000 7fc16ac00700 1 -- 172.21.15.84:0/3977446200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1641157b0 con 0x7fc1641002a0 2024-04-26T21:36:02.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.214+0000 7fc16ac00700 1 -- 172.21.15.84:0/3977446200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc16404c710 con 0x7fc1641002a0 2024-04-26T21:36:02.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.215+0000 7fc15be00700 1 -- 172.21.15.84:0/3977446200 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc15000bbf0 con 0x7fc1641002a0 2024-04-26T21:36:02.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.216+0000 7fc15be00700 1 --2- 172.21.15.84:0/3977446200 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc14806ec00 0x7fc1480710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:02.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.217+0000 7fc15be00700 1 -- 172.21.15.84:0/3977446200 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fc15008fec0 con 0x7fc1641002a0 2024-04-26T21:36:02.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.217+0000 7fc163e00700 1 --2- 172.21.15.84:0/3977446200 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc14806ec00 0x7fc1480710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:02.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.217+0000 7fc163e00700 1 --2- 172.21.15.84:0/3977446200 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc14806ec00 0x7fc1480710b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc154004990 tx=0x7fc154009ee0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:02.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.222+0000 7fc15be00700 1 -- 172.21.15.84:0/3977446200 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fc15005c620 con 0x7fc1641002a0 2024-04-26T21:36:02.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.473+0000 7fc16ac00700 1 -- 172.21.15.84:0/3977446200 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1641045c0 con 0x7fc14806ec00 2024-04-26T21:36:02.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.474+0000 7fc15be00700 1 -- 172.21.15.84:0/3977446200 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7fc1641045c0 con 0x7fc14806ec00 2024-04-26T21:36:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.477+0000 7fc16ac00700 1 -- 172.21.15.84:0/3977446200 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc14806ec00 msgr2=0x7fc1480710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.477+0000 7fc16ac00700 1 --2- 172.21.15.84:0/3977446200 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc14806ec00 0x7fc1480710b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc154004990 tx=0x7fc154009ee0 comp rx=0 tx=0).stop 2024-04-26T21:36:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.477+0000 7fc16ac00700 1 -- 172.21.15.84:0/3977446200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641002a0 msgr2=0x7fc164110080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.477+0000 7fc16ac00700 1 --2- 172.21.15.84:0/3977446200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641002a0 0x7fc164110080 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc15000b3b0 tx=0x7fc150009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.478+0000 7fc16ac00700 1 -- 172.21.15.84:0/3977446200 shutdown_connections 2024-04-26T21:36:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.478+0000 7fc16ac00700 1 --2- 172.21.15.84:0/3977446200 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc14806ec00 0x7fc1480710b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.478+0000 7fc16ac00700 1 --2- 172.21.15.84:0/3977446200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1640feff0 0x7fc16410fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:02.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.478+0000 7fc16ac00700 1 --2- 172.21.15.84:0/3977446200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641002a0 0x7fc164110080 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:02.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.478+0000 7fc16ac00700 1 -- 172.21.15.84:0/3977446200 >> 172.21.15.84:0/3977446200 conn(0x7fc1640fa8f0 msgr2=0x7fc1640fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:02.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.478+0000 7fc16ac00700 1 -- 172.21.15.84:0/3977446200 shutdown_connections 2024-04-26T21:36:02.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.478+0000 7fc16ac00700 1 -- 172.21.15.84:0/3977446200 wait complete. 2024-04-26T21:36:02.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.640+0000 7f89b5200700 1 -- 172.21.15.84:0/762380504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89b0070830 msgr2=0x7f89b0070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:02.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.640+0000 7f89b5200700 1 --2- 172.21.15.84:0/762380504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89b0070830 0x7f89b0070ca0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f899c004940 tx=0x7f899c009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:02.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.640+0000 7f89b5200700 1 -- 172.21.15.84:0/762380504 shutdown_connections 2024-04-26T21:36:02.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.640+0000 7f89b5200700 1 --2- 172.21.15.84:0/762380504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89b0070830 0x7f89b0070ca0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:02.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.640+0000 7f89b5200700 1 --2- 172.21.15.84:0/762380504 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89b0071de0 0x7f89b00702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:02.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.640+0000 7f89b5200700 1 -- 172.21.15.84:0/762380504 >> 172.21.15.84:0/762380504 conn(0x7f89b00f8500 msgr2=0x7f89b00fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:02.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.641+0000 7f89b5200700 1 -- 172.21.15.84:0/762380504 shutdown_connections 2024-04-26T21:36:02.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.641+0000 7f89b5200700 1 -- 172.21.15.84:0/762380504 wait complete. 2024-04-26T21:36:02.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.641+0000 7f89b5200700 1 Processor -- start 2024-04-26T21:36:02.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.642+0000 7f89b5200700 1 -- start start 2024-04-26T21:36:02.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.642+0000 7f89b5200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89b0070830 0x7f89b00fcce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:02.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.642+0000 7f89b5200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89b0071de0 0x7f89b00fd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:02.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.642+0000 7f89b5200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b00fd870 con 0x7f89b0070830 2024-04-26T21:36:02.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.642+0000 7f89b5200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b00fe0c0 con 0x7f89b0071de0 2024-04-26T21:36:02.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.642+0000 7f89ade00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89b0070830 0x7f89b00fcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:02.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.642+0000 7f89ade00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89b0070830 0x7f89b00fcce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44598/0 (socket says 172.21.15.84:44598) 2024-04-26T21:36:02.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.642+0000 7f89ade00700 1 -- 172.21.15.84:0/104095568 learned_addr learned my addr 172.21.15.84:0/104095568 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:36:02.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.643+0000 7f89ad400700 1 --2- 172.21.15.84:0/104095568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89b0071de0 0x7f89b00fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:02.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.643+0000 7f89ade00700 1 -- 172.21.15.84:0/104095568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89b0071de0 msgr2=0x7f89b00fd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:02.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.643+0000 7f89ade00700 1 --2- 172.21.15.84:0/104095568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89b0071de0 0x7f89b00fd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:02.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.643+0000 7f89ade00700 1 -- 172.21.15.84:0/104095568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c005040 con 0x7f89b0070830 2024-04-26T21:36:02.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.643+0000 7f89ad400700 1 --2- 172.21.15.84:0/104095568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89b0071de0 0x7f89b00fd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:36:02.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.643+0000 7f89ade00700 1 --2- 172.21.15.84:0/104095568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89b0070830 0x7f89b00fcce0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f89a0002a80 tx=0x7f89a0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:02.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.644+0000 7f89a6000700 1 -- 172.21.15.84:0/104095568 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89a0007cc0 con 0x7f89b0070830 2024-04-26T21:36:02.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.644+0000 7f89b5200700 1 -- 172.21.15.84:0/104095568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b00fe3a0 con 0x7f89b0070830 2024-04-26T21:36:02.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.644+0000 7f89b5200700 1 -- 172.21.15.84:0/104095568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b00fe960 con 0x7f89b0070830 2024-04-26T21:36:02.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.644+0000 7f89a6000700 1 -- 172.21.15.84:0/104095568 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f89a000f040 con 0x7f89b0070830 2024-04-26T21:36:02.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.644+0000 7f89a6000700 1 -- 172.21.15.84:0/104095568 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89a000d9e0 con 0x7f89b0070830 2024-04-26T21:36:02.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.645+0000 7f89b5200700 1 -- 172.21.15.84:0/104095568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89900052e0 con 0x7f89b0070830 2024-04-26T21:36:02.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.647+0000 7f89a6000700 1 -- 172.21.15.84:0/104095568 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f89a0009740 con 0x7f89b0070830 2024-04-26T21:36:02.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.648+0000 7f89a6000700 1 --2- 172.21.15.84:0/104095568 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f899406ece0 0x7f8994071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:02.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.648+0000 7f89a6000700 1 -- 172.21.15.84:0/104095568 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f89a008e7d0 con 0x7f89b0070830 2024-04-26T21:36:02.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.648+0000 7f89ad400700 1 --2- 172.21.15.84:0/104095568 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f899406ece0 0x7f8994071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:02.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.649+0000 7f89ad400700 1 --2- 172.21.15.84:0/104095568 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f899406ece0 0x7f8994071190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f899c00b7a0 tx=0x7f899c009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:02.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.654+0000 7f89a6000700 1 -- 172.21.15.84:0/104095568 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f89a0057400 con 0x7f89b0070830 2024-04-26T21:36:02.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.894+0000 7f89b5200700 1 -- 172.21.15.84:0/104095568 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8990000bf0 con 0x7f899406ece0 2024-04-26T21:36:02.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.906+0000 7f89a6000700 1 -- 172.21.15.84:0/104095568 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f8990000bf0 con 0x7f899406ece0 2024-04-26T21:36:02.907 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:36:02.907 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 starting - - - - 2024-04-26T21:36:02.907 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (6m) 21s ago 21m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 b4010dfbe623 2024-04-26T21:36:02.907 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (6m) 48s ago 20m 6665k - 19.0.0-3306-gbc612ffb 55dc54019ad8 89a4e50ea23c 2024-04-26T21:36:02.907 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (10m) 21s ago 21m 75.8M - 9.4.7 954c08fa6188 1bf95f604e07 2024-04-26T21:36:02.907 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (2m) 21s ago 14m 58.1M - 19.0.0-3306-gbc612ffb 55dc54019ad8 26d10fe664bb 2024-04-26T21:36:02.907 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (2m) 21s ago 14m 14.5M - 19.0.0-3306-gbc612ffb 55dc54019ad8 c801ec16a810 2024-04-26T21:36:02.907 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (103s) 48s ago 14m 11.2M - 19.0.0-3306-gbc612ffb 55dc54019ad8 137a38b571df 2024-04-26T21:36:02.907 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (78s) 48s ago 14m 11.1M - 19.0.0-3306-gbc612ffb 55dc54019ad8 0f6be9e294cb 2024-04-26T21:36:02.907 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (10m) 21s ago 23m 514M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:36:02.907 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283,8765 running (8m) 48s ago 20m 455M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d6ae0b4628b5 2024-04-26T21:36:02.907 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (8m) 21s ago 23m 56.3M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 bf610abb6a62 2024-04-26T21:36:02.907 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (7m) 48s ago 20m 43.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 5d530496253b 2024-04-26T21:36:02.908 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (59s) 21s ago 21m 7172k - 1.5.0 0da6a335fe13 bda8f4e31302 2024-04-26T21:36:02.908 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (52s) 48s ago 20m 2985k - 1.5.0 0da6a335fe13 c28df53d1aa9 2024-04-26T21:36:02.908 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (6m) 21s ago 19m 114M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 99fbe2faa51b 2024-04-26T21:36:02.908 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (5m) 21s ago 18m 99.9M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 2dc81d93f7e5 2024-04-26T21:36:02.908 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (5m) 21s ago 18m 91.5M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 9e77abf095bd 2024-04-26T21:36:02.908 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (4m) 48s ago 17m 96.6M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 d7e5825e2640 2024-04-26T21:36:02.908 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (4m) 48s ago 17m 88.1M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 894dcbaab8eb 2024-04-26T21:36:02.908 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (3m) 48s ago 16m 85.9M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 e39948e51a13 2024-04-26T21:36:02.908 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (28s) 21s ago 21m 41.2M - 2.43.0 a07b618ecd1d 8e385c5bfadf 2024-04-26T21:36:02.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.910+0000 7f89b5200700 1 -- 172.21.15.84:0/104095568 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f899406ece0 msgr2=0x7f8994071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:02.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.910+0000 7f89b5200700 1 --2- 172.21.15.84:0/104095568 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f899406ece0 0x7f8994071190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f899c00b7a0 tx=0x7f899c009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:02.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.910+0000 7f89b5200700 1 -- 172.21.15.84:0/104095568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89b0070830 msgr2=0x7f89b00fcce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:02.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.910+0000 7f89b5200700 1 --2- 172.21.15.84:0/104095568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89b0070830 0x7f89b00fcce0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f89a0002a80 tx=0x7f89a0004600 comp rx=0 tx=0).stop 2024-04-26T21:36:02.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.910+0000 7f89b5200700 1 -- 172.21.15.84:0/104095568 shutdown_connections 2024-04-26T21:36:02.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.910+0000 7f89b5200700 1 --2- 172.21.15.84:0/104095568 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f899406ece0 0x7f8994071190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:02.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.910+0000 7f89b5200700 1 --2- 172.21.15.84:0/104095568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89b0070830 0x7f89b00fcce0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:02.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.910+0000 7f89b5200700 1 --2- 172.21.15.84:0/104095568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89b0071de0 0x7f89b00fd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:02.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.910+0000 7f89b5200700 1 -- 172.21.15.84:0/104095568 >> 172.21.15.84:0/104095568 conn(0x7f89b00f8500 msgr2=0x7f89b00f9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:02.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.910+0000 7f89b5200700 1 -- 172.21.15.84:0/104095568 shutdown_connections 2024-04-26T21:36:02.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:02.910+0000 7f89b5200700 1 -- 172.21.15.84:0/104095568 wait complete. 2024-04-26T21:36:03.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.063+0000 7f8c7ea00700 1 -- 172.21.15.84:0/2476223416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c78100270 msgr2=0x7f8c781006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:03.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.063+0000 7f8c7ea00700 1 --2- 172.21.15.84:0/2476223416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c78100270 0x7f8c781006e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8c64004940 tx=0x7f8c64009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:03.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.063+0000 7f8c7ea00700 1 -- 172.21.15.84:0/2476223416 shutdown_connections 2024-04-26T21:36:03.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.063+0000 7f8c7ea00700 1 --2- 172.21.15.84:0/2476223416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c78100270 0x7f8c781006e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:03.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.063+0000 7f8c7ea00700 1 --2- 172.21.15.84:0/2476223416 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c780fefc0 0x7f8c780ff3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:03.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.063+0000 7f8c7ea00700 1 -- 172.21.15.84:0/2476223416 >> 172.21.15.84:0/2476223416 conn(0x7f8c780fa8f0 msgr2=0x7f8c780fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:03.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.063+0000 7f8c7ea00700 1 -- 172.21.15.84:0/2476223416 shutdown_connections 2024-04-26T21:36:03.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.064+0000 7f8c7ea00700 1 -- 172.21.15.84:0/2476223416 wait complete. 2024-04-26T21:36:03.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.064+0000 7f8c7ea00700 1 Processor -- start 2024-04-26T21:36:03.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.064+0000 7f8c7ea00700 1 -- start start 2024-04-26T21:36:03.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.065+0000 7f8c7ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c780fefc0 0x7f8c7810fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:03.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.065+0000 7f8c7ea00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c78100270 0x7f8c7810ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:03.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.065+0000 7f8c7ea00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c781105d0 con 0x7f8c780fefc0 2024-04-26T21:36:03.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.065+0000 7f8c7ea00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c78110740 con 0x7f8c78100270 2024-04-26T21:36:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.065+0000 7f8c77e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c780fefc0 0x7f8c7810fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.065+0000 7f8c77e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c780fefc0 0x7f8c7810fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44612/0 (socket says 172.21.15.84:44612) 2024-04-26T21:36:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.065+0000 7f8c77e00700 1 -- 172.21.15.84:0/4207656958 learned_addr learned my addr 172.21.15.84:0/4207656958 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:36:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.065+0000 7f8c77400700 1 --2- 172.21.15.84:0/4207656958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c78100270 0x7f8c7810ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.065+0000 7f8c77e00700 1 -- 172.21.15.84:0/4207656958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c78100270 msgr2=0x7f8c7810ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.065+0000 7f8c77e00700 1 --2- 172.21.15.84:0/4207656958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c78100270 0x7f8c7810ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.065+0000 7f8c77e00700 1 -- 172.21.15.84:0/4207656958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c64005040 con 0x7f8c780fefc0 2024-04-26T21:36:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.066+0000 7f8c77400700 1 --2- 172.21.15.84:0/4207656958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c78100270 0x7f8c7810ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:36:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.066+0000 7f8c77e00700 1 --2- 172.21.15.84:0/4207656958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c780fefc0 0x7f8c7810fa90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800eb70 tx=0x7f8c6800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.066+0000 7f8c6fe00700 1 -- 172.21.15.84:0/4207656958 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c68007cc0 con 0x7f8c780fefc0 2024-04-26T21:36:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.066+0000 7f8c6fe00700 1 -- 172.21.15.84:0/4207656958 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c6800f040 con 0x7f8c780fefc0 2024-04-26T21:36:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.066+0000 7f8c7ea00700 1 -- 172.21.15.84:0/4207656958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c78115140 con 0x7f8c780fefc0 2024-04-26T21:36:03.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.066+0000 7f8c6fe00700 1 -- 172.21.15.84:0/4207656958 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c68009640 con 0x7f8c780fefc0 2024-04-26T21:36:03.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.066+0000 7f8c7ea00700 1 -- 172.21.15.84:0/4207656958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c78115700 con 0x7f8c780fefc0 2024-04-26T21:36:03.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.067+0000 7f8c7ea00700 1 -- 172.21.15.84:0/4207656958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7804c710 con 0x7f8c780fefc0 2024-04-26T21:36:03.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.069+0000 7f8c6fe00700 1 -- 172.21.15.84:0/4207656958 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f8c680097a0 con 0x7f8c780fefc0 2024-04-26T21:36:03.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.070+0000 7f8c6fe00700 1 --2- 172.21.15.84:0/4207656958 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8c5c06ec00 0x7f8c5c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:03.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.070+0000 7f8c6fe00700 1 -- 172.21.15.84:0/4207656958 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f8c6808e640 con 0x7f8c780fefc0 2024-04-26T21:36:03.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.070+0000 7f8c77400700 1 --2- 172.21.15.84:0/4207656958 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8c5c06ec00 0x7f8c5c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:03.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.071+0000 7f8c77400700 1 --2- 172.21.15.84:0/4207656958 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8c5c06ec00 0x7f8c5c0710b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8c64004560 tx=0x7f8c64009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:03.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.075+0000 7f8c6fe00700 1 -- 172.21.15.84:0/4207656958 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f8c6805adc0 con 0x7f8c780fefc0 2024-04-26T21:36:03.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:02 smithi084 ceph-mon[90138]: pgmap v298: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:03.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:02 smithi084 ceph-mon[90138]: from='client.34568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:36:03.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.414+0000 7f8c7ea00700 1 -- 172.21.15.84:0/4207656958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8c78115be0 con 0x7f8c780fefc0 2024-04-26T21:36:03.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.414+0000 7f8c6fe00700 1 -- 172.21.15.84:0/4207656958 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f8c6805a950 con 0x7f8c780fefc0 2024-04-26T21:36:03.415 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:36:03.415 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:36:03.415 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:36:03.415 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:36:03.415 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:36:03.415 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:36:03.415 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:36:03.416 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:36:03.416 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 6 2024-04-26T21:36:03.416 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:36:03.416 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:36:03.416 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 4 2024-04-26T21:36:03.416 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:36:03.416 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:36:03.416 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 14 2024-04-26T21:36:03.416 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:36:03.416 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:36:03.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.417+0000 7f8c7ea00700 1 -- 172.21.15.84:0/4207656958 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8c5c06ec00 msgr2=0x7f8c5c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:03.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.417+0000 7f8c7ea00700 1 --2- 172.21.15.84:0/4207656958 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8c5c06ec00 0x7f8c5c0710b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8c64004560 tx=0x7f8c64009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:03.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.417+0000 7f8c7ea00700 1 -- 172.21.15.84:0/4207656958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c780fefc0 msgr2=0x7f8c7810fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:03.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.417+0000 7f8c7ea00700 1 --2- 172.21.15.84:0/4207656958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c780fefc0 0x7f8c7810fa90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800eb70 tx=0x7f8c6800b040 comp rx=0 tx=0).stop 2024-04-26T21:36:03.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.417+0000 7f8c7ea00700 1 -- 172.21.15.84:0/4207656958 shutdown_connections 2024-04-26T21:36:03.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.417+0000 7f8c7ea00700 1 --2- 172.21.15.84:0/4207656958 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8c5c06ec00 0x7f8c5c0710b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:03.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.417+0000 7f8c7ea00700 1 --2- 172.21.15.84:0/4207656958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c780fefc0 0x7f8c7810fa90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:03.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.417+0000 7f8c7ea00700 1 --2- 172.21.15.84:0/4207656958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c78100270 0x7f8c7810ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:03.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.417+0000 7f8c7ea00700 1 -- 172.21.15.84:0/4207656958 >> 172.21.15.84:0/4207656958 conn(0x7f8c780fa8f0 msgr2=0x7f8c780fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:03.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.418+0000 7f8c7ea00700 1 -- 172.21.15.84:0/4207656958 shutdown_connections 2024-04-26T21:36:03.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.418+0000 7f8c7ea00700 1 -- 172.21.15.84:0/4207656958 wait complete. 2024-04-26T21:36:03.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:02 smithi120 ceph-mon[79001]: pgmap v298: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:03.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:02 smithi120 ceph-mon[79001]: from='client.34568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:36:03.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.574+0000 7fe965e00700 1 -- 172.21.15.84:0/3736732324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9600fdff0 msgr2=0x7fe9600fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:03.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.574+0000 7fe965e00700 1 --2- 172.21.15.84:0/3736732324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9600fdff0 0x7fe9600fe460 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe94c004940 tx=0x7fe94c009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:03.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.574+0000 7fe965e00700 1 -- 172.21.15.84:0/3736732324 shutdown_connections 2024-04-26T21:36:03.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.574+0000 7fe965e00700 1 --2- 172.21.15.84:0/3736732324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9600fdff0 0x7fe9600fe460 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:03.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.574+0000 7fe965e00700 1 --2- 172.21.15.84:0/3736732324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9600fce80 0x7fe9600fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:03.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.574+0000 7fe965e00700 1 -- 172.21.15.84:0/3736732324 >> 172.21.15.84:0/3736732324 conn(0x7fe9600f8540 msgr2=0x7fe9600fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:03.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.575+0000 7fe965e00700 1 -- 172.21.15.84:0/3736732324 shutdown_connections 2024-04-26T21:36:03.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.575+0000 7fe965e00700 1 -- 172.21.15.84:0/3736732324 wait complete. 2024-04-26T21:36:03.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.575+0000 7fe965e00700 1 Processor -- start 2024-04-26T21:36:03.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.575+0000 7fe965e00700 1 -- start start 2024-04-26T21:36:03.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.576+0000 7fe965e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9600fce80 0x7fe960071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:03.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.576+0000 7fe965e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9600fdff0 0x7fe9600702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:03.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.576+0000 7fe965e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe960072200 con 0x7fe9600fce80 2024-04-26T21:36:03.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.576+0000 7fe965e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9600707f0 con 0x7fe9600fdff0 2024-04-26T21:36:03.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.576+0000 7fe95ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9600fce80 0x7fe960071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:03.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.576+0000 7fe95ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9600fce80 0x7fe960071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44634/0 (socket says 172.21.15.84:44634) 2024-04-26T21:36:03.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.576+0000 7fe95ea00700 1 -- 172.21.15.84:0/3457865299 learned_addr learned my addr 172.21.15.84:0/3457865299 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:36:03.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.577+0000 7fe95e000700 1 --2- 172.21.15.84:0/3457865299 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9600fdff0 0x7fe9600702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:03.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.577+0000 7fe95ea00700 1 -- 172.21.15.84:0/3457865299 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9600fdff0 msgr2=0x7fe9600702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:03.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.577+0000 7fe95ea00700 1 --2- 172.21.15.84:0/3457865299 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9600fdff0 0x7fe9600702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:03.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.577+0000 7fe95ea00700 1 -- 172.21.15.84:0/3457865299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c005040 con 0x7fe9600fce80 2024-04-26T21:36:03.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.577+0000 7fe95ea00700 1 --2- 172.21.15.84:0/3457865299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9600fce80 0x7fe960071c00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe95000c830 tx=0x7fe950004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:03.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.577+0000 7fe956a00700 1 -- 172.21.15.84:0/3457865299 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe95000a760 con 0x7fe9600fce80 2024-04-26T21:36:03.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.577+0000 7fe956a00700 1 -- 172.21.15.84:0/3457865299 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe95000ad90 con 0x7fe9600fce80 2024-04-26T21:36:03.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.577+0000 7fe965e00700 1 -- 172.21.15.84:0/3457865299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe960070aa0 con 0x7fe9600fce80 2024-04-26T21:36:03.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.577+0000 7fe956a00700 1 -- 172.21.15.84:0/3457865299 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9500113a0 con 0x7fe9600fce80 2024-04-26T21:36:03.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.577+0000 7fe965e00700 1 -- 172.21.15.84:0/3457865299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe960071060 con 0x7fe9600fce80 2024-04-26T21:36:03.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.578+0000 7fe965e00700 1 -- 172.21.15.84:0/3457865299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96004c710 con 0x7fe9600fce80 2024-04-26T21:36:03.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.579+0000 7fe956a00700 1 -- 172.21.15.84:0/3457865299 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe950012400 con 0x7fe9600fce80 2024-04-26T21:36:03.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.580+0000 7fe956a00700 1 --2- 172.21.15.84:0/3457865299 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe94406ec00 0x7fe9440710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:03.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.580+0000 7fe956a00700 1 -- 172.21.15.84:0/3457865299 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fe95008ea10 con 0x7fe9600fce80 2024-04-26T21:36:03.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.581+0000 7fe95e000700 1 --2- 172.21.15.84:0/3457865299 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe94406ec00 0x7fe9440710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:03.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.581+0000 7fe95e000700 1 --2- 172.21.15.84:0/3457865299 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe94406ec00 0x7fe9440710b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe94c004f90 tx=0x7fe94c009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:03.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.585+0000 7fe956a00700 1 -- 172.21.15.84:0/3457865299 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fe95005b1f0 con 0x7fe9600fce80 2024-04-26T21:36:03.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.864+0000 7fe965e00700 1 -- 172.21.15.84:0/3457865299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe960115cc0 con 0x7fe9600fce80 2024-04-26T21:36:03.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.865+0000 7fe956a00700 1 -- 172.21.15.84:0/3457865299 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 42 v42) v1 ==== 76+0+1954 (secure 0 0 0) 0x7fe95005ad80 con 0x7fe9600fce80 2024-04-26T21:36:03.866 INFO:teuthology.orchestra.run.smithi084.stdout:e42 2024-04-26T21:36:03.866 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:36:03.866 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:36:03.866 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:36:03.866 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:36:03.866 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:36:03.866 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:36:03.866 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 42 2024-04-26T21:36:03.866 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:36:03.866 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:36:03.867 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:34:58.296487+0000 2024-04-26T21:36:03.867 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:36:03.867 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:36:03.867 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:36:03.867 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:36:03.867 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:36:03.867 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-04-26T21:36:03.867 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:36:03.867 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:36:03.867 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 94 2024-04-26T21:36:03.867 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T21:36:03.867 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:36:03.867 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:36:03.867 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=34446,1=34478} 2024-04-26T21:36:03.867 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:36:03.868 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:36:03.868 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:36:03.868 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:36:03.868 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:36:03.868 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:36:03.868 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:36:03.868 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-04-26T21:36:03.868 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:36:03.868 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 34446 members: 34446,34478 2024-04-26T21:36:03.868 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:34446} state up:active seq 22 join_fscid=1 addr [v2:172.21.15.84:6826/1392878113,v1:172.21.15.84:6827/1392878113] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:36:03.868 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{1:34478} state up:active seq 17 join_fscid=1 addr [v2:172.21.15.84:6828/4015119551,v1:172.21.15.84:6829/4015119551] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:36:03.868 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:36:03.868 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:36:03.868 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:36:03.868 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:36:03.869 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.120:6824/1351450046,v1:172.21.15.120:6825/1351450046] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:36:03.869 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:44305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.120:6826/2847041344,v1:172.21.15.120:6827/2847041344] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:36:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.868+0000 7fe965e00700 1 -- 172.21.15.84:0/3457865299 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe94406ec00 msgr2=0x7fe9440710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.868+0000 7fe965e00700 1 --2- 172.21.15.84:0/3457865299 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe94406ec00 0x7fe9440710b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe94c004f90 tx=0x7fe94c009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.868+0000 7fe965e00700 1 -- 172.21.15.84:0/3457865299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9600fce80 msgr2=0x7fe960071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.868+0000 7fe965e00700 1 --2- 172.21.15.84:0/3457865299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9600fce80 0x7fe960071c00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe95000c830 tx=0x7fe950004470 comp rx=0 tx=0).stop 2024-04-26T21:36:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.868+0000 7fe965e00700 1 -- 172.21.15.84:0/3457865299 shutdown_connections 2024-04-26T21:36:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.868+0000 7fe965e00700 1 --2- 172.21.15.84:0/3457865299 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe94406ec00 0x7fe9440710b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.868+0000 7fe965e00700 1 --2- 172.21.15.84:0/3457865299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9600fce80 0x7fe960071c00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.868+0000 7fe965e00700 1 --2- 172.21.15.84:0/3457865299 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9600fdff0 0x7fe9600702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.868+0000 7fe965e00700 1 -- 172.21.15.84:0/3457865299 >> 172.21.15.84:0/3457865299 conn(0x7fe9600f8540 msgr2=0x7fe9600f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.868+0000 7fe965e00700 1 -- 172.21.15.84:0/3457865299 shutdown_connections 2024-04-26T21:36:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:03.868+0000 7fe965e00700 1 -- 172.21.15.84:0/3457865299 wait complete. 2024-04-26T21:36:03.871 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 42 2024-04-26T21:36:04.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.015+0000 7f042a000700 1 -- 172.21.15.84:0/667375099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04241046a0 msgr2=0x7f0424104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:04.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.015+0000 7f042a000700 1 --2- 172.21.15.84:0/667375099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04241046a0 0x7f0424104b10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0410004940 tx=0x7f0410009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:04.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.015+0000 7f042a000700 1 -- 172.21.15.84:0/667375099 shutdown_connections 2024-04-26T21:36:04.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.015+0000 7f042a000700 1 --2- 172.21.15.84:0/667375099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04241046a0 0x7f0424104b10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:04.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.015+0000 7f042a000700 1 --2- 172.21.15.84:0/667375099 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04241033f0 0x7f0424103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:04.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.015+0000 7f042a000700 1 -- 172.21.15.84:0/667375099 >> 172.21.15.84:0/667375099 conn(0x7f04240725e0 msgr2=0x7f0424074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:04.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.015+0000 7f042a000700 1 -- 172.21.15.84:0/667375099 shutdown_connections 2024-04-26T21:36:04.017 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:03 smithi084 ceph-mon[90138]: from='client.34572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:36:04.017 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:03 smithi084 ceph-mon[90138]: from='client.34576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:36:04.017 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:03 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/4207656958' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:04.017 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:03 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3457865299' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:36:04.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.016+0000 7f042a000700 1 -- 172.21.15.84:0/667375099 wait complete. 2024-04-26T21:36:04.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.017+0000 7f042a000700 1 Processor -- start 2024-04-26T21:36:04.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.017+0000 7f042a000700 1 -- start start 2024-04-26T21:36:04.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.017+0000 7f042a000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04241033f0 0x7f0424113f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:04.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.017+0000 7f042a000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04241046a0 0x7f0424114460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:04.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.017+0000 7f042a000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0424114af0 con 0x7f04241033f0 2024-04-26T21:36:04.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.017+0000 7f042a000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0424119490 con 0x7f04241046a0 2024-04-26T21:36:04.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.017+0000 7f0423400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04241033f0 0x7f0424113f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:04.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.017+0000 7f0423400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04241033f0 0x7f0424113f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44654/0 (socket says 172.21.15.84:44654) 2024-04-26T21:36:04.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.017+0000 7f0423400700 1 -- 172.21.15.84:0/1942161237 learned_addr learned my addr 172.21.15.84:0/1942161237 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:36:04.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.018+0000 7f0423400700 1 -- 172.21.15.84:0/1942161237 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04241046a0 msgr2=0x7f0424114460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:04.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.018+0000 7f0423400700 1 --2- 172.21.15.84:0/1942161237 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04241046a0 0x7f0424114460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:04.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.018+0000 7f0423400700 1 -- 172.21.15.84:0/1942161237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0410005040 con 0x7f04241033f0 2024-04-26T21:36:04.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.018+0000 7f0423400700 1 --2- 172.21.15.84:0/1942161237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04241033f0 0x7f0424113f20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f041400b790 tx=0x7f0414009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:04.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.018+0000 7f041b400700 1 -- 172.21.15.84:0/1942161237 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f041400f770 con 0x7f04241033f0 2024-04-26T21:36:04.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.018+0000 7f041b400700 1 -- 172.21.15.84:0/1942161237 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f041400fda0 con 0x7f04241033f0 2024-04-26T21:36:04.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.018+0000 7f041b400700 1 -- 172.21.15.84:0/1942161237 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f041400d310 con 0x7f04241033f0 2024-04-26T21:36:04.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.019+0000 7f042a000700 1 -- 172.21.15.84:0/1942161237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04241196f0 con 0x7f04241033f0 2024-04-26T21:36:04.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.019+0000 7f042a000700 1 -- 172.21.15.84:0/1942161237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0424119c60 con 0x7f04241033f0 2024-04-26T21:36:04.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.020+0000 7f042a000700 1 -- 172.21.15.84:0/1942161237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042404c710 con 0x7f04241033f0 2024-04-26T21:36:04.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.021+0000 7f041b400700 1 -- 172.21.15.84:0/1942161237 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0414010420 con 0x7f04241033f0 2024-04-26T21:36:04.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.022+0000 7f041b400700 1 --2- 172.21.15.84:0/1942161237 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f040806ec00 0x7f04080710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:04.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.022+0000 7f041b400700 1 -- 172.21.15.84:0/1942161237 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f041408e9f0 con 0x7f04241033f0 2024-04-26T21:36:04.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.022+0000 7f0422a00700 1 --2- 172.21.15.84:0/1942161237 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f040806ec00 0x7f04080710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:04.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.023+0000 7f0422a00700 1 --2- 172.21.15.84:0/1942161237 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f040806ec00 0x7f04080710b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0410004f90 tx=0x7f0410009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:04.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.026+0000 7f041b400700 1 -- 172.21.15.84:0/1942161237 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f041405b1d0 con 0x7f04241033f0 2024-04-26T21:36:04.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.262+0000 7f042a000700 1 -- 172.21.15.84:0/1942161237 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0424119f30 con 0x7f040806ec00 2024-04-26T21:36:04.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.265+0000 7f041b400700 1 -- 172.21.15.84:0/1942161237 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7f0424119f30 con 0x7f040806ec00 2024-04-26T21:36:04.266 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:36:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:36:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:36:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:36:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-04-26T21:36:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-04-26T21:36:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "osd", 2024-04-26T21:36:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "mds", 2024-04-26T21:36:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr", 2024-04-26T21:36:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "crash" 2024-04-26T21:36:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-04-26T21:36:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "16/21 daemons upgraded", 2024-04-26T21:36:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading alertmanager daemons", 2024-04-26T21:36:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:36:04.267 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:36:04.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.268+0000 7f042a000700 1 -- 172.21.15.84:0/1942161237 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f040806ec00 msgr2=0x7f04080710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:04.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.268+0000 7f042a000700 1 --2- 172.21.15.84:0/1942161237 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f040806ec00 0x7f04080710b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0410004f90 tx=0x7f0410009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:04.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.269+0000 7f042a000700 1 -- 172.21.15.84:0/1942161237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04241033f0 msgr2=0x7f0424113f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:04.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.269+0000 7f042a000700 1 --2- 172.21.15.84:0/1942161237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04241033f0 0x7f0424113f20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f041400b790 tx=0x7f0414009250 comp rx=0 tx=0).stop 2024-04-26T21:36:04.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.269+0000 7f042a000700 1 -- 172.21.15.84:0/1942161237 shutdown_connections 2024-04-26T21:36:04.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.269+0000 7f042a000700 1 --2- 172.21.15.84:0/1942161237 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f040806ec00 0x7f04080710b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:04.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.269+0000 7f042a000700 1 --2- 172.21.15.84:0/1942161237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04241033f0 0x7f0424113f20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:04.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.269+0000 7f042a000700 1 --2- 172.21.15.84:0/1942161237 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04241046a0 0x7f0424114460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:04.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.269+0000 7f042a000700 1 -- 172.21.15.84:0/1942161237 >> 172.21.15.84:0/1942161237 conn(0x7f04240725e0 msgr2=0x7f0424073c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:04.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.269+0000 7f042a000700 1 -- 172.21.15.84:0/1942161237 shutdown_connections 2024-04-26T21:36:04.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.269+0000 7f042a000700 1 -- 172.21.15.84:0/1942161237 wait complete. 2024-04-26T21:36:04.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.422+0000 7f7a21c00700 1 -- 172.21.15.84:0/1202909362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a1c0fcf10 msgr2=0x7f7a1c0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.422+0000 7f7a21c00700 1 --2- 172.21.15.84:0/1202909362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a1c0fcf10 0x7f7a1c0fd320 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c004940 tx=0x7f7a0c009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.422+0000 7f7a21c00700 1 -- 172.21.15.84:0/1202909362 shutdown_connections 2024-04-26T21:36:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.422+0000 7f7a21c00700 1 --2- 172.21.15.84:0/1202909362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a1c0fe080 0x7f7a1c0fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.422+0000 7f7a21c00700 1 --2- 172.21.15.84:0/1202909362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a1c0fcf10 0x7f7a1c0fd320 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.422+0000 7f7a21c00700 1 -- 172.21.15.84:0/1202909362 >> 172.21.15.84:0/1202909362 conn(0x7f7a1c0f8560 msgr2=0x7f7a1c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.422+0000 7f7a21c00700 1 -- 172.21.15.84:0/1202909362 shutdown_connections 2024-04-26T21:36:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.422+0000 7f7a21c00700 1 -- 172.21.15.84:0/1202909362 wait complete. 2024-04-26T21:36:04.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.423+0000 7f7a21c00700 1 Processor -- start 2024-04-26T21:36:04.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.423+0000 7f7a21c00700 1 -- start start 2024-04-26T21:36:04.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.423+0000 7f7a21c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a1c0fcf10 0x7f7a1c10fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:04.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.423+0000 7f7a21c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a1c0fe080 0x7f7a1c110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:04.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.423+0000 7f7a21c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c110740 con 0x7f7a1c0fcf10 2024-04-26T21:36:04.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.423+0000 7f7a21c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c110f90 con 0x7f7a1c0fe080 2024-04-26T21:36:04.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.424+0000 7f7a1aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a1c0fcf10 0x7f7a1c10fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:04.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.424+0000 7f7a1aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a1c0fcf10 0x7f7a1c10fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44672/0 (socket says 172.21.15.84:44672) 2024-04-26T21:36:04.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.424+0000 7f7a1aa00700 1 -- 172.21.15.84:0/1623915556 learned_addr learned my addr 172.21.15.84:0/1623915556 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:36:04.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.424+0000 7f7a1a000700 1 --2- 172.21.15.84:0/1623915556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a1c0fe080 0x7f7a1c110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:04.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.424+0000 7f7a1aa00700 1 -- 172.21.15.84:0/1623915556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a1c0fe080 msgr2=0x7f7a1c110140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:04.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.424+0000 7f7a1aa00700 1 --2- 172.21.15.84:0/1623915556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a1c0fe080 0x7f7a1c110140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:04.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.424+0000 7f7a1aa00700 1 -- 172.21.15.84:0/1623915556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c005040 con 0x7f7a1c0fcf10 2024-04-26T21:36:04.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.424+0000 7f7a1a000700 1 --2- 172.21.15.84:0/1623915556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a1c0fe080 0x7f7a1c110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:36:04.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.425+0000 7f7a1aa00700 1 --2- 172.21.15.84:0/1623915556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a1c0fcf10 0x7f7a1c10fc00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c00b3b0 tx=0x7f7a0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:04.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.425+0000 7f7a12a00700 1 -- 172.21.15.84:0/1623915556 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a0c00e040 con 0x7f7a1c0fcf10 2024-04-26T21:36:04.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.425+0000 7f7a12a00700 1 -- 172.21.15.84:0/1623915556 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7a0c004290 con 0x7f7a1c0fcf10 2024-04-26T21:36:04.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.425+0000 7f7a12a00700 1 -- 172.21.15.84:0/1623915556 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a0c01c630 con 0x7f7a1c0fcf10 2024-04-26T21:36:04.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.425+0000 7f7a21c00700 1 -- 172.21.15.84:0/1623915556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1c111210 con 0x7f7a1c0fcf10 2024-04-26T21:36:04.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.425+0000 7f7a21c00700 1 -- 172.21.15.84:0/1623915556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c111750 con 0x7f7a1c0fcf10 2024-04-26T21:36:04.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.426+0000 7f7a21c00700 1 -- 172.21.15.84:0/1623915556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1c101a10 con 0x7f7a1c0fcf10 2024-04-26T21:36:04.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.427+0000 7f7a12a00700 1 -- 172.21.15.84:0/1623915556 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7a0c00bbf0 con 0x7f7a1c0fcf10 2024-04-26T21:36:04.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.429+0000 7f7a12a00700 1 --2- 172.21.15.84:0/1623915556 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f7a0006ec10 0x7f7a000710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:04.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.429+0000 7f7a12a00700 1 -- 172.21.15.84:0/1623915556 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f7a0c08fdb0 con 0x7f7a1c0fcf10 2024-04-26T21:36:04.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.429+0000 7f7a1a000700 1 --2- 172.21.15.84:0/1623915556 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f7a0006ec10 0x7f7a000710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:04.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.430+0000 7f7a1a000700 1 --2- 172.21.15.84:0/1623915556 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f7a0006ec10 0x7f7a000710c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7a08007fd0 tx=0x7f7a08009040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:04.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:03 smithi120 ceph-mon[79001]: from='client.34572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:36:04.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:03 smithi120 ceph-mon[79001]: from='client.34576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:36:04.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:03 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/4207656958' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:04.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:03 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3457865299' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:36:04.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.433+0000 7f7a12a00700 1 -- 172.21.15.84:0/1623915556 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f7a0c05c5d0 con 0x7f7a1c0fcf10 2024-04-26T21:36:04.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.756+0000 7f7a21c00700 1 -- 172.21.15.84:0/1623915556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7a1c05f5c0 con 0x7f7a1c0fcf10 2024-04-26T21:36:04.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.756+0000 7f7a12a00700 1 -- 172.21.15.84:0/1623915556 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f7a0c05c160 con 0x7f7a1c0fcf10 2024-04-26T21:36:04.757 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:36:04.757 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:36:04.757 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:36:04.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.759+0000 7f7a21c00700 1 -- 172.21.15.84:0/1623915556 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f7a0006ec10 msgr2=0x7f7a000710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:04.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.759+0000 7f7a21c00700 1 --2- 172.21.15.84:0/1623915556 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f7a0006ec10 0x7f7a000710c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7a08007fd0 tx=0x7f7a08009040 comp rx=0 tx=0).stop 2024-04-26T21:36:04.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.759+0000 7f7a21c00700 1 -- 172.21.15.84:0/1623915556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a1c0fcf10 msgr2=0x7f7a1c10fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:04.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.759+0000 7f7a21c00700 1 --2- 172.21.15.84:0/1623915556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a1c0fcf10 0x7f7a1c10fc00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c00b3b0 tx=0x7f7a0c009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:04.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.759+0000 7f7a21c00700 1 -- 172.21.15.84:0/1623915556 shutdown_connections 2024-04-26T21:36:04.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.759+0000 7f7a21c00700 1 --2- 172.21.15.84:0/1623915556 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f7a0006ec10 0x7f7a000710c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:04.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.759+0000 7f7a21c00700 1 --2- 172.21.15.84:0/1623915556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a1c0fcf10 0x7f7a1c10fc00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:04.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.759+0000 7f7a21c00700 1 --2- 172.21.15.84:0/1623915556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a1c0fe080 0x7f7a1c110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:04.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.759+0000 7f7a21c00700 1 -- 172.21.15.84:0/1623915556 >> 172.21.15.84:0/1623915556 conn(0x7f7a1c0f8560 msgr2=0x7f7a1c0f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:04.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.759+0000 7f7a21c00700 1 -- 172.21.15.84:0/1623915556 shutdown_connections 2024-04-26T21:36:04.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:04.760+0000 7f7a21c00700 1 -- 172.21.15.84:0/1623915556 wait complete. 2024-04-26T21:36:05.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:04 smithi084 ceph-mon[90138]: pgmap v299: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:05.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:04 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/1623915556' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:36:05.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:04 smithi120 ceph-mon[79001]: pgmap v299: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:05.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:04 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/1623915556' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:36:06.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:05 smithi084 ceph-mon[90138]: from='client.34588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:36:06.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:05 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:06.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:05 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:06.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:05 smithi120 ceph-mon[79001]: from='client.34588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:36:06.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:05 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:06.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:05 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:07.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:06 smithi084 ceph-mon[90138]: pgmap v300: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:07.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:06 smithi120 ceph-mon[79001]: pgmap v300: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:09.103 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:08 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:09.103 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:08 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:09.103 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:08 smithi084 ceph-mon[90138]: pgmap v301: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:09.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:08 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:09.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:08 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:09.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:08 smithi120 ceph-mon[79001]: pgmap v301: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:11.163 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:10 smithi084 ceph-mon[90138]: pgmap v302: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:11.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:10 smithi120 ceph-mon[79001]: pgmap v302: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:13.109 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:12 smithi084 ceph-mon[90138]: pgmap v303: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:13.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:12 smithi120 ceph-mon[79001]: pgmap v303: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:14.582 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:14.583 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:14.583 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:36:14.583 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:36:14.583 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:14.583 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-26T21:36:14.583 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-26T21:36:14.583 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:36:14.583 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.583 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.583 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.583 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.584 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.584 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.584 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.584 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.584 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.584 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.584 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.584 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.584 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.584 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.584 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.584 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: pgmap v304: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:14.584 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:36:14.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:14.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:14.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:36:14.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:36:14.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:14.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-26T21:36:14.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-26T21:36:14.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:36:14.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.684 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:14.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: pgmap v304: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:14.685 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:36:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:16 smithi084 ceph-mon[90138]: pgmap v305: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:16 smithi084 ceph-mon[90138]: Upgrade: Updating grafana.smithi084 2024-04-26T21:36:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:16 smithi084 ceph-mon[90138]: Deploying daemon grafana.smithi084 on smithi084 2024-04-26T21:36:17.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:16 smithi120 ceph-mon[79001]: pgmap v305: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:17.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:16 smithi120 ceph-mon[79001]: Upgrade: Updating grafana.smithi084 2024-04-26T21:36:17.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:16 smithi120 ceph-mon[79001]: Deploying daemon grafana.smithi084 on smithi084 2024-04-26T21:36:19.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:18 smithi084 ceph-mon[90138]: pgmap v306: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:19.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:18 smithi120 ceph-mon[79001]: pgmap v306: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:21.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:20 smithi084 ceph-mon[90138]: pgmap v307: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:21.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:20 smithi120 ceph-mon[79001]: pgmap v307: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:23.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:22 smithi084 ceph-mon[90138]: pgmap v308: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:23.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:22 smithi120 ceph-mon[79001]: pgmap v308: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:25.321 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:24 smithi084 ceph-mon[90138]: pgmap v309: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:25.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:24 smithi120 ceph-mon[79001]: pgmap v309: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:27.038 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:26 smithi084 ceph-mon[90138]: pgmap v310: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:27.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:26 smithi120 ceph-mon[79001]: pgmap v310: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:29.389 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:28 smithi084 ceph-mon[90138]: pgmap v311: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:29.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:28 smithi120 ceph-mon[79001]: pgmap v311: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:30.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:30 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:36:30.261 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:30 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:36:31.136 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:31 smithi084 ceph-mon[90138]: pgmap v312: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:31.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:31 smithi120 ceph-mon[79001]: pgmap v312: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:32.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:32.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:32.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:32 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:36:32.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:32.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:32.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:32 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:36:33.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:33 smithi084 ceph-mon[90138]: pgmap v313: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:33.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:33 smithi120 ceph-mon[79001]: pgmap v313: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:34.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.930+0000 7f66d3800700 1 -- 172.21.15.84:0/321764635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66cc0fcf10 msgr2=0x7f66cc0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:34.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.930+0000 7f66d3800700 1 --2- 172.21.15.84:0/321764635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66cc0fcf10 0x7f66cc0fd320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f66c0004940 tx=0x7f66c0009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:34.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.930+0000 7f66d3800700 1 -- 172.21.15.84:0/321764635 shutdown_connections 2024-04-26T21:36:34.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.930+0000 7f66d3800700 1 --2- 172.21.15.84:0/321764635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66cc0fe080 0x7f66cc0fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:34.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.930+0000 7f66d3800700 1 --2- 172.21.15.84:0/321764635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66cc0fcf10 0x7f66cc0fd320 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:34.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.930+0000 7f66d3800700 1 -- 172.21.15.84:0/321764635 >> 172.21.15.84:0/321764635 conn(0x7f66cc0f8560 msgr2=0x7f66cc0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:34.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.930+0000 7f66d3800700 1 -- 172.21.15.84:0/321764635 shutdown_connections 2024-04-26T21:36:34.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.930+0000 7f66d3800700 1 -- 172.21.15.84:0/321764635 wait complete. 2024-04-26T21:36:34.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.931+0000 7f66d3800700 1 Processor -- start 2024-04-26T21:36:34.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.931+0000 7f66d3800700 1 -- start start 2024-04-26T21:36:34.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.932+0000 7f66d3800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66cc0fcf10 0x7f66cc071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:34.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.932+0000 7f66d3800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66cc0fe080 0x7f66cc0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:34.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.932+0000 7f66d3800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc070860 con 0x7f66cc0fcf10 2024-04-26T21:36:34.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.932+0000 7f66d3800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc0709d0 con 0x7f66cc0fe080 2024-04-26T21:36:34.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.932+0000 7f66d0e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66cc0fcf10 0x7f66cc071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:34.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.932+0000 7f66d0e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66cc0fcf10 0x7f66cc071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57040/0 (socket says 172.21.15.84:57040) 2024-04-26T21:36:34.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.932+0000 7f66d0e00700 1 -- 172.21.15.84:0/2408763170 learned_addr learned my addr 172.21.15.84:0/2408763170 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:36:34.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.932+0000 7f66cbe00700 1 --2- 172.21.15.84:0/2408763170 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66cc0fe080 0x7f66cc0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:34.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.932+0000 7f66d0e00700 1 -- 172.21.15.84:0/2408763170 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66cc0fe080 msgr2=0x7f66cc0702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:34.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.932+0000 7f66d0e00700 1 --2- 172.21.15.84:0/2408763170 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66cc0fe080 0x7f66cc0702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:34.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.933+0000 7f66d0e00700 1 -- 172.21.15.84:0/2408763170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c0005040 con 0x7f66cc0fcf10 2024-04-26T21:36:34.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.933+0000 7f66d0e00700 1 --2- 172.21.15.84:0/2408763170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66cc0fcf10 0x7f66cc071de0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f66c000b3b0 tx=0x7f66c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:34.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.933+0000 7f66c8c00700 1 -- 172.21.15.84:0/2408763170 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66c000e040 con 0x7f66cc0fcf10 2024-04-26T21:36:34.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.933+0000 7f66c8c00700 1 -- 172.21.15.84:0/2408763170 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f66c0004290 con 0x7f66cc0fcf10 2024-04-26T21:36:34.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.933+0000 7f66c8c00700 1 -- 172.21.15.84:0/2408763170 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66c001c630 con 0x7f66cc0fcf10 2024-04-26T21:36:34.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.933+0000 7f66d3800700 1 -- 172.21.15.84:0/2408763170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66cc070c50 con 0x7f66cc0fcf10 2024-04-26T21:36:34.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.934+0000 7f66d3800700 1 -- 172.21.15.84:0/2408763170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66cc115a10 con 0x7f66cc0fcf10 2024-04-26T21:36:34.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.935+0000 7f66d3800700 1 -- 172.21.15.84:0/2408763170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66cc05f5c0 con 0x7f66cc0fcf10 2024-04-26T21:36:34.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.936+0000 7f66c8c00700 1 -- 172.21.15.84:0/2408763170 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f66c000bbf0 con 0x7f66cc0fcf10 2024-04-26T21:36:34.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.937+0000 7f66c8c00700 1 --2- 172.21.15.84:0/2408763170 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f66b406ecc0 0x7f66b4071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:34.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.937+0000 7f66c8c00700 1 -- 172.21.15.84:0/2408763170 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f66c008fde0 con 0x7f66cc0fcf10 2024-04-26T21:36:34.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.937+0000 7f66cbe00700 1 --2- 172.21.15.84:0/2408763170 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f66b406ecc0 0x7f66b4071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:34.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.938+0000 7f66cbe00700 1 --2- 172.21.15.84:0/2408763170 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f66b406ecc0 0x7f66b4071170 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f66b8007fd0 tx=0x7f66b8009f60 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:34.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:34.944+0000 7f66c8c00700 1 -- 172.21.15.84:0/2408763170 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f66c0094070 con 0x7f66cc0fcf10 2024-04-26T21:36:35.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.202+0000 7f66d3800700 1 -- 172.21.15.84:0/2408763170 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f66cc1023f0 con 0x7f66b406ecc0 2024-04-26T21:36:35.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.204+0000 7f66c8c00700 1 -- 172.21.15.84:0/2408763170 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f66cc1023f0 con 0x7f66b406ecc0 2024-04-26T21:36:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.209+0000 7f66d3800700 1 -- 172.21.15.84:0/2408763170 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f66b406ecc0 msgr2=0x7f66b4071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.209+0000 7f66d3800700 1 --2- 172.21.15.84:0/2408763170 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f66b406ecc0 0x7f66b4071170 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f66b8007fd0 tx=0x7f66b8009f60 comp rx=0 tx=0).stop 2024-04-26T21:36:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.209+0000 7f66d3800700 1 -- 172.21.15.84:0/2408763170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66cc0fcf10 msgr2=0x7f66cc071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:35.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.209+0000 7f66d3800700 1 --2- 172.21.15.84:0/2408763170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66cc0fcf10 0x7f66cc071de0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f66c000b3b0 tx=0x7f66c0009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:35.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.209+0000 7f66d3800700 1 -- 172.21.15.84:0/2408763170 shutdown_connections 2024-04-26T21:36:35.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.209+0000 7f66d3800700 1 --2- 172.21.15.84:0/2408763170 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f66b406ecc0 0x7f66b4071170 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:35.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.209+0000 7f66d3800700 1 --2- 172.21.15.84:0/2408763170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66cc0fcf10 0x7f66cc071de0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:35.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.209+0000 7f66d3800700 1 --2- 172.21.15.84:0/2408763170 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66cc0fe080 0x7f66cc0702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:35.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.209+0000 7f66d3800700 1 -- 172.21.15.84:0/2408763170 >> 172.21.15.84:0/2408763170 conn(0x7f66cc0f8560 msgr2=0x7f66cc0f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:35.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.209+0000 7f66d3800700 1 -- 172.21.15.84:0/2408763170 shutdown_connections 2024-04-26T21:36:35.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.209+0000 7f66d3800700 1 -- 172.21.15.84:0/2408763170 wait complete. 2024-04-26T21:36:35.226 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:36:35.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.366+0000 7f0e6ac00700 1 -- 172.21.15.84:0/4018369572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e640fcf10 msgr2=0x7f0e640fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:35.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.366+0000 7f0e6ac00700 1 --2- 172.21.15.84:0/4018369572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e640fcf10 0x7f0e640fd320 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0e54004880 tx=0x7f0e54009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:35.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.366+0000 7f0e6ac00700 1 -- 172.21.15.84:0/4018369572 shutdown_connections 2024-04-26T21:36:35.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.366+0000 7f0e6ac00700 1 --2- 172.21.15.84:0/4018369572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e640fe080 0x7f0e640fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:35.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.366+0000 7f0e6ac00700 1 --2- 172.21.15.84:0/4018369572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e640fcf10 0x7f0e640fd320 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:35.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.366+0000 7f0e6ac00700 1 -- 172.21.15.84:0/4018369572 >> 172.21.15.84:0/4018369572 conn(0x7f0e640f8560 msgr2=0x7f0e640fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:35.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.366+0000 7f0e6ac00700 1 -- 172.21.15.84:0/4018369572 shutdown_connections 2024-04-26T21:36:35.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.366+0000 7f0e6ac00700 1 -- 172.21.15.84:0/4018369572 wait complete. 2024-04-26T21:36:35.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.367+0000 7f0e6ac00700 1 Processor -- start 2024-04-26T21:36:35.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.367+0000 7f0e6ac00700 1 -- start start 2024-04-26T21:36:35.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.367+0000 7f0e6ac00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e640fcf10 0x7f0e64071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:35.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.367+0000 7f0e6ac00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e640fe080 0x7f0e640702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:35.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.367+0000 7f0e6ac00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e64070860 con 0x7f0e640fcf10 2024-04-26T21:36:35.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.367+0000 7f0e6ac00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e640709d0 con 0x7f0e640fe080 2024-04-26T21:36:35.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.368+0000 7f0e63e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e640fcf10 0x7f0e64071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:35.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.368+0000 7f0e63e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e640fcf10 0x7f0e64071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57062/0 (socket says 172.21.15.84:57062) 2024-04-26T21:36:35.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.368+0000 7f0e63e00700 1 -- 172.21.15.84:0/3899181638 learned_addr learned my addr 172.21.15.84:0/3899181638 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:36:35.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.368+0000 7f0e63400700 1 --2- 172.21.15.84:0/3899181638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e640fe080 0x7f0e640702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:35.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.368+0000 7f0e63e00700 1 -- 172.21.15.84:0/3899181638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e640fe080 msgr2=0x7f0e640702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:35.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.368+0000 7f0e63e00700 1 --2- 172.21.15.84:0/3899181638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e640fe080 0x7f0e640702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:35.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.368+0000 7f0e63e00700 1 -- 172.21.15.84:0/3899181638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e54005040 con 0x7f0e640fcf10 2024-04-26T21:36:35.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.369+0000 7f0e63e00700 1 --2- 172.21.15.84:0/3899181638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e640fcf10 0x7f0e64071de0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0e54008cd0 tx=0x7f0e54009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:35.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.369+0000 7f0e5be00700 1 -- 172.21.15.84:0/3899181638 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e5400e030 con 0x7f0e640fcf10 2024-04-26T21:36:35.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.369+0000 7f0e5be00700 1 -- 172.21.15.84:0/3899181638 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0e54013e60 con 0x7f0e640fcf10 2024-04-26T21:36:35.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.369+0000 7f0e5be00700 1 -- 172.21.15.84:0/3899181638 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e540123c0 con 0x7f0e640fcf10 2024-04-26T21:36:35.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.369+0000 7f0e6ac00700 1 -- 172.21.15.84:0/3899181638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e64070c50 con 0x7f0e640fcf10 2024-04-26T21:36:35.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.369+0000 7f0e6ac00700 1 -- 172.21.15.84:0/3899181638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e64115a10 con 0x7f0e640fcf10 2024-04-26T21:36:35.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.370+0000 7f0e6ac00700 1 -- 172.21.15.84:0/3899181638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e6405f5c0 con 0x7f0e640fcf10 2024-04-26T21:36:35.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.371+0000 7f0e5be00700 1 -- 172.21.15.84:0/3899181638 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0e5401c400 con 0x7f0e640fcf10 2024-04-26T21:36:35.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.373+0000 7f0e5be00700 1 --2- 172.21.15.84:0/3899181638 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f0e4806ec10 0x7f0e480710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:35.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.373+0000 7f0e5be00700 1 -- 172.21.15.84:0/3899181638 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f0e540902d0 con 0x7f0e640fcf10 2024-04-26T21:36:35.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.373+0000 7f0e63400700 1 --2- 172.21.15.84:0/3899181638 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f0e4806ec10 0x7f0e480710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:35.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.374+0000 7f0e63400700 1 --2- 172.21.15.84:0/3899181638 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f0e4806ec10 0x7f0e480710c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0e500043d0 tx=0x7f0e5000b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:35.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.378+0000 7f0e5be00700 1 -- 172.21.15.84:0/3899181638 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f0e54058f80 con 0x7f0e640fcf10 2024-04-26T21:36:35.379 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:35 smithi084 ceph-mon[90138]: pgmap v314: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:35.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:35 smithi120 ceph-mon[79001]: pgmap v314: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:35.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.648+0000 7f0e6ac00700 1 -- 172.21.15.84:0/3899181638 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e641023f0 con 0x7f0e4806ec10 2024-04-26T21:36:35.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.650+0000 7f0e5be00700 1 -- 172.21.15.84:0/3899181638 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f0e641023f0 con 0x7f0e4806ec10 2024-04-26T21:36:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.653+0000 7f0e6ac00700 1 -- 172.21.15.84:0/3899181638 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f0e4806ec10 msgr2=0x7f0e480710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.653+0000 7f0e6ac00700 1 --2- 172.21.15.84:0/3899181638 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f0e4806ec10 0x7f0e480710c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0e500043d0 tx=0x7f0e5000b040 comp rx=0 tx=0).stop 2024-04-26T21:36:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.653+0000 7f0e6ac00700 1 -- 172.21.15.84:0/3899181638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e640fcf10 msgr2=0x7f0e64071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.653+0000 7f0e6ac00700 1 --2- 172.21.15.84:0/3899181638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e640fcf10 0x7f0e64071de0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0e54008cd0 tx=0x7f0e54009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.653+0000 7f0e6ac00700 1 -- 172.21.15.84:0/3899181638 shutdown_connections 2024-04-26T21:36:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.653+0000 7f0e6ac00700 1 --2- 172.21.15.84:0/3899181638 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f0e4806ec10 0x7f0e480710c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.653+0000 7f0e6ac00700 1 --2- 172.21.15.84:0/3899181638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e640fcf10 0x7f0e64071de0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.653+0000 7f0e6ac00700 1 --2- 172.21.15.84:0/3899181638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e640fe080 0x7f0e640702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.653+0000 7f0e6ac00700 1 -- 172.21.15.84:0/3899181638 >> 172.21.15.84:0/3899181638 conn(0x7f0e640f8560 msgr2=0x7f0e640f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.653+0000 7f0e6ac00700 1 -- 172.21.15.84:0/3899181638 shutdown_connections 2024-04-26T21:36:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.653+0000 7f0e6ac00700 1 -- 172.21.15.84:0/3899181638 wait complete. 2024-04-26T21:36:35.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.808+0000 7f850fc00700 1 -- 172.21.15.84:0/2231775198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85080ffee0 msgr2=0x7f8508102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:35.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.808+0000 7f850fc00700 1 --2- 172.21.15.84:0/2231775198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85080ffee0 0x7f8508102300 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f84f4004940 tx=0x7f84f4009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:35.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.808+0000 7f850fc00700 1 -- 172.21.15.84:0/2231775198 shutdown_connections 2024-04-26T21:36:35.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.808+0000 7f850fc00700 1 --2- 172.21.15.84:0/2231775198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85080ffee0 0x7f8508102300 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:35.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.808+0000 7f850fc00700 1 --2- 172.21.15.84:0/2231775198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85080662c0 0x7f85080ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:35.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.808+0000 7f850fc00700 1 -- 172.21.15.84:0/2231775198 >> 172.21.15.84:0/2231775198 conn(0x7f85080f7430 msgr2=0x7f85080f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:35.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.808+0000 7f850fc00700 1 -- 172.21.15.84:0/2231775198 shutdown_connections 2024-04-26T21:36:35.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.808+0000 7f850fc00700 1 -- 172.21.15.84:0/2231775198 wait complete. 2024-04-26T21:36:35.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.809+0000 7f850fc00700 1 Processor -- start 2024-04-26T21:36:35.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.809+0000 7f850fc00700 1 -- start start 2024-04-26T21:36:35.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.810+0000 7f850fc00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85080662c0 0x7f850810fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:35.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.810+0000 7f850fc00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85080ffee0 0x7f8508110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:35.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.810+0000 7f850fc00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8508110760 con 0x7f85080662c0 2024-04-26T21:36:35.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.810+0000 7f850fc00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8508110fb0 con 0x7f85080ffee0 2024-04-26T21:36:35.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.810+0000 7f850d200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85080662c0 0x7f850810fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:35.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.810+0000 7f850d200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85080662c0 0x7f850810fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57090/0 (socket says 172.21.15.84:57090) 2024-04-26T21:36:35.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.810+0000 7f850d200700 1 -- 172.21.15.84:0/2234378210 learned_addr learned my addr 172.21.15.84:0/2234378210 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:36:35.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.810+0000 7f8507e00700 1 --2- 172.21.15.84:0/2234378210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85080ffee0 0x7f8508110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:35.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.810+0000 7f850d200700 1 -- 172.21.15.84:0/2234378210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85080ffee0 msgr2=0x7f8508110160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:35.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.810+0000 7f850d200700 1 --2- 172.21.15.84:0/2234378210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85080ffee0 0x7f8508110160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:35.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.810+0000 7f850d200700 1 -- 172.21.15.84:0/2234378210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f4005040 con 0x7f85080662c0 2024-04-26T21:36:35.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.811+0000 7f850d200700 1 --2- 172.21.15.84:0/2234378210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85080662c0 0x7f850810fc20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00c800 tx=0x7f84fc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:35.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.811+0000 7f8504c00700 1 -- 172.21.15.84:0/2234378210 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84fc00a760 con 0x7f85080662c0 2024-04-26T21:36:35.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.811+0000 7f8504c00700 1 -- 172.21.15.84:0/2234378210 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f84fc00ad90 con 0x7f85080662c0 2024-04-26T21:36:35.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.811+0000 7f850fc00700 1 -- 172.21.15.84:0/2234378210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8508111290 con 0x7f85080662c0 2024-04-26T21:36:35.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.811+0000 7f8504c00700 1 -- 172.21.15.84:0/2234378210 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84fc0113a0 con 0x7f85080662c0 2024-04-26T21:36:35.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.811+0000 7f850fc00700 1 -- 172.21.15.84:0/2234378210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85081117d0 con 0x7f85080662c0 2024-04-26T21:36:35.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.812+0000 7f850fc00700 1 -- 172.21.15.84:0/2234378210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850805f5c0 con 0x7f85080662c0 2024-04-26T21:36:35.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.813+0000 7f8504c00700 1 -- 172.21.15.84:0/2234378210 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f84fc012400 con 0x7f85080662c0 2024-04-26T21:36:35.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.814+0000 7f8504c00700 1 --2- 172.21.15.84:0/2234378210 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f84f006ec10 0x7f84f00710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:35.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.815+0000 7f8504c00700 1 -- 172.21.15.84:0/2234378210 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f84fc08ea90 con 0x7f85080662c0 2024-04-26T21:36:35.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.815+0000 7f8507e00700 1 --2- 172.21.15.84:0/2234378210 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f84f006ec10 0x7f84f00710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:35.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.816+0000 7f8507e00700 1 --2- 172.21.15.84:0/2234378210 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f84f006ec10 0x7f84f00710c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f84f4004f90 tx=0x7f84f4009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:35.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:35.820+0000 7f8504c00700 1 -- 172.21.15.84:0/2234378210 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f84fc05b1f0 con 0x7f85080662c0 2024-04-26T21:36:36.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.056+0000 7f850fc00700 1 -- 172.21.15.84:0/2234378210 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8508111bb0 con 0x7f84f006ec10 2024-04-26T21:36:36.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.085+0000 7f8504c00700 1 -- 172.21.15.84:0/2234378210 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f8508111bb0 con 0x7f84f006ec10 2024-04-26T21:36:36.087 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:36:36.087 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (37s) 30s ago 22m 14.5M - 0.25.0 c8568f914cd2 61e7fdb22568 2024-04-26T21:36:36.087 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (7m) 30s ago 22m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 b4010dfbe623 2024-04-26T21:36:36.088 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (7m) 81s ago 21m 6665k - 19.0.0-3306-gbc612ffb 55dc54019ad8 89a4e50ea23c 2024-04-26T21:36:36.088 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 starting - - - - 2024-04-26T21:36:36.088 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (3m) 30s ago 15m 58.2M - 19.0.0-3306-gbc612ffb 55dc54019ad8 26d10fe664bb 2024-04-26T21:36:36.088 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (2m) 30s ago 15m 15.3M - 19.0.0-3306-gbc612ffb 55dc54019ad8 c801ec16a810 2024-04-26T21:36:36.088 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (2m) 81s ago 15m 11.2M - 19.0.0-3306-gbc612ffb 55dc54019ad8 137a38b571df 2024-04-26T21:36:36.088 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (111s) 81s ago 15m 11.1M - 19.0.0-3306-gbc612ffb 55dc54019ad8 0f6be9e294cb 2024-04-26T21:36:36.088 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (10m) 30s ago 23m 514M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:36:36.088 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283,8765 running (9m) 81s ago 20m 455M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d6ae0b4628b5 2024-04-26T21:36:36.088 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (9m) 30s ago 24m 57.1M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 bf610abb6a62 2024-04-26T21:36:36.088 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (8m) 81s ago 20m 43.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 5d530496253b 2024-04-26T21:36:36.088 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (92s) 30s ago 22m 7432k - 1.5.0 0da6a335fe13 bda8f4e31302 2024-04-26T21:36:36.088 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (86s) 81s ago 21m 2985k - 1.5.0 0da6a335fe13 c28df53d1aa9 2024-04-26T21:36:36.088 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (6m) 30s ago 19m 114M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 99fbe2faa51b 2024-04-26T21:36:36.088 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (6m) 30s ago 19m 100M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 2dc81d93f7e5 2024-04-26T21:36:36.089 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (5m) 30s ago 18m 91.5M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 9e77abf095bd 2024-04-26T21:36:36.089 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (5m) 81s ago 18m 96.6M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 d7e5825e2640 2024-04-26T21:36:36.089 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (4m) 81s ago 17m 88.1M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 894dcbaab8eb 2024-04-26T21:36:36.089 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (4m) 81s ago 17m 85.9M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 e39948e51a13 2024-04-26T21:36:36.089 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (61s) 30s ago 21m 47.9M - 2.43.0 a07b618ecd1d 8e385c5bfadf 2024-04-26T21:36:36.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.088+0000 7f850fc00700 1 -- 172.21.15.84:0/2234378210 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f84f006ec10 msgr2=0x7f84f00710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:36.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.088+0000 7f850fc00700 1 --2- 172.21.15.84:0/2234378210 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f84f006ec10 0x7f84f00710c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f84f4004f90 tx=0x7f84f4009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:36.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.088+0000 7f850fc00700 1 -- 172.21.15.84:0/2234378210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85080662c0 msgr2=0x7f850810fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:36.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.088+0000 7f850fc00700 1 --2- 172.21.15.84:0/2234378210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85080662c0 0x7f850810fc20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00c800 tx=0x7f84fc004470 comp rx=0 tx=0).stop 2024-04-26T21:36:36.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.089+0000 7f850fc00700 1 -- 172.21.15.84:0/2234378210 shutdown_connections 2024-04-26T21:36:36.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.089+0000 7f850fc00700 1 --2- 172.21.15.84:0/2234378210 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f84f006ec10 0x7f84f00710c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:36.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.089+0000 7f850fc00700 1 --2- 172.21.15.84:0/2234378210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85080662c0 0x7f850810fc20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:36.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.089+0000 7f850fc00700 1 --2- 172.21.15.84:0/2234378210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85080ffee0 0x7f8508110160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:36.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.089+0000 7f850fc00700 1 -- 172.21.15.84:0/2234378210 >> 172.21.15.84:0/2234378210 conn(0x7f85080f7430 msgr2=0x7f85080fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:36.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.089+0000 7f850fc00700 1 -- 172.21.15.84:0/2234378210 shutdown_connections 2024-04-26T21:36:36.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.089+0000 7f850fc00700 1 -- 172.21.15.84:0/2234378210 wait complete. 2024-04-26T21:36:36.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.245+0000 7ffa92200700 1 -- 172.21.15.84:0/3652227159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c0fe080 msgr2=0x7ffa8c0fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:36.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.245+0000 7ffa92200700 1 --2- 172.21.15.84:0/3652227159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c0fe080 0x7ffa8c0fe4f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffa78004940 tx=0x7ffa78009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:36.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.245+0000 7ffa92200700 1 -- 172.21.15.84:0/3652227159 shutdown_connections 2024-04-26T21:36:36.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.246+0000 7ffa92200700 1 --2- 172.21.15.84:0/3652227159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c0fe080 0x7ffa8c0fe4f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:36.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.246+0000 7ffa92200700 1 --2- 172.21.15.84:0/3652227159 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa8c0fcf10 0x7ffa8c0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:36.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.246+0000 7ffa92200700 1 -- 172.21.15.84:0/3652227159 >> 172.21.15.84:0/3652227159 conn(0x7ffa8c0f8560 msgr2=0x7ffa8c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:36.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.246+0000 7ffa92200700 1 -- 172.21.15.84:0/3652227159 shutdown_connections 2024-04-26T21:36:36.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.246+0000 7ffa92200700 1 -- 172.21.15.84:0/3652227159 wait complete. 2024-04-26T21:36:36.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.246+0000 7ffa92200700 1 Processor -- start 2024-04-26T21:36:36.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.247+0000 7ffa92200700 1 -- start start 2024-04-26T21:36:36.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.247+0000 7ffa92200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c0fcf10 0x7ffa8c10fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:36.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.247+0000 7ffa92200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa8c0fe080 0x7ffa8c110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:36.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.247+0000 7ffa92200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c110810 con 0x7ffa8c0fcf10 2024-04-26T21:36:36.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.247+0000 7ffa92200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c111000 con 0x7ffa8c0fe080 2024-04-26T21:36:36.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.247+0000 7ffa8b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c0fcf10 0x7ffa8c10fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:36.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.247+0000 7ffa8b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c0fcf10 0x7ffa8c10fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57106/0 (socket says 172.21.15.84:57106) 2024-04-26T21:36:36.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.247+0000 7ffa8b400700 1 -- 172.21.15.84:0/2728515717 learned_addr learned my addr 172.21.15.84:0/2728515717 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:36:36.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.248+0000 7ffa8aa00700 1 --2- 172.21.15.84:0/2728515717 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa8c0fe080 0x7ffa8c110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:36.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.248+0000 7ffa8b400700 1 -- 172.21.15.84:0/2728515717 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa8c0fe080 msgr2=0x7ffa8c110180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:36.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.248+0000 7ffa8b400700 1 --2- 172.21.15.84:0/2728515717 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa8c0fe080 0x7ffa8c110180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:36.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.248+0000 7ffa8b400700 1 -- 172.21.15.84:0/2728515717 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa78005040 con 0x7ffa8c0fcf10 2024-04-26T21:36:36.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.248+0000 7ffa8b400700 1 --2- 172.21.15.84:0/2728515717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c0fcf10 0x7ffa8c10fc40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00b790 tx=0x7ffa7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:36.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.249+0000 7ffa83400700 1 -- 172.21.15.84:0/2728515717 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa7c00f770 con 0x7ffa8c0fcf10 2024-04-26T21:36:36.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.249+0000 7ffa83400700 1 -- 172.21.15.84:0/2728515717 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa7c00fda0 con 0x7ffa8c0fcf10 2024-04-26T21:36:36.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.249+0000 7ffa92200700 1 -- 172.21.15.84:0/2728515717 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8c1112e0 con 0x7ffa8c0fcf10 2024-04-26T21:36:36.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.249+0000 7ffa83400700 1 -- 172.21.15.84:0/2728515717 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa7c00d310 con 0x7ffa8c0fcf10 2024-04-26T21:36:36.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.249+0000 7ffa92200700 1 -- 172.21.15.84:0/2728515717 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8c1118a0 con 0x7ffa8c0fcf10 2024-04-26T21:36:36.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.250+0000 7ffa92200700 1 -- 172.21.15.84:0/2728515717 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8c101a10 con 0x7ffa8c0fcf10 2024-04-26T21:36:36.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.251+0000 7ffa83400700 1 -- 172.21.15.84:0/2728515717 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ffa7c010420 con 0x7ffa8c0fcf10 2024-04-26T21:36:36.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.252+0000 7ffa83400700 1 --2- 172.21.15.84:0/2728515717 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ffa7006ec10 0x7ffa700710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:36.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.252+0000 7ffa83400700 1 -- 172.21.15.84:0/2728515717 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7ffa7c08e940 con 0x7ffa8c0fcf10 2024-04-26T21:36:36.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.252+0000 7ffa8aa00700 1 --2- 172.21.15.84:0/2728515717 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ffa7006ec10 0x7ffa700710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:36.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.253+0000 7ffa8aa00700 1 --2- 172.21.15.84:0/2728515717 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ffa7006ec10 0x7ffa700710c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffa78004f90 tx=0x7ffa78009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:36.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.257+0000 7ffa83400700 1 -- 172.21.15.84:0/2728515717 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7ffa7c05b1e0 con 0x7ffa8c0fcf10 2024-04-26T21:36:36.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.566+0000 7ffa92200700 1 -- 172.21.15.84:0/2728515717 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffa8c105af0 con 0x7ffa8c0fcf10 2024-04-26T21:36:36.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.567+0000 7ffa83400700 1 -- 172.21.15.84:0/2728515717 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7ffa7c05ad70 con 0x7ffa8c0fcf10 2024-04-26T21:36:36.568 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:36:36.569 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:36:36.569 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:36:36.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:36:36.569 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:36:36.569 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:36:36.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:36:36.569 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:36:36.569 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 6 2024-04-26T21:36:36.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:36:36.569 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:36:36.569 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 4 2024-04-26T21:36:36.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:36:36.569 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:36:36.570 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 14 2024-04-26T21:36:36.570 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:36:36.570 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:36:36.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.570+0000 7ffa92200700 1 -- 172.21.15.84:0/2728515717 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ffa7006ec10 msgr2=0x7ffa700710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:36.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.570+0000 7ffa92200700 1 --2- 172.21.15.84:0/2728515717 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ffa7006ec10 0x7ffa700710c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffa78004f90 tx=0x7ffa78009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:36.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.570+0000 7ffa92200700 1 -- 172.21.15.84:0/2728515717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c0fcf10 msgr2=0x7ffa8c10fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:36.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.570+0000 7ffa92200700 1 --2- 172.21.15.84:0/2728515717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c0fcf10 0x7ffa8c10fc40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00b790 tx=0x7ffa7c009250 comp rx=0 tx=0).stop 2024-04-26T21:36:36.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.570+0000 7ffa92200700 1 -- 172.21.15.84:0/2728515717 shutdown_connections 2024-04-26T21:36:36.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.570+0000 7ffa92200700 1 --2- 172.21.15.84:0/2728515717 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ffa7006ec10 0x7ffa700710c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:36.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.570+0000 7ffa92200700 1 --2- 172.21.15.84:0/2728515717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c0fcf10 0x7ffa8c10fc40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:36.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.570+0000 7ffa92200700 1 --2- 172.21.15.84:0/2728515717 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa8c0fe080 0x7ffa8c110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:36.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.570+0000 7ffa92200700 1 -- 172.21.15.84:0/2728515717 >> 172.21.15.84:0/2728515717 conn(0x7ffa8c0f8560 msgr2=0x7ffa8c0f9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:36.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.570+0000 7ffa92200700 1 -- 172.21.15.84:0/2728515717 shutdown_connections 2024-04-26T21:36:36.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.570+0000 7ffa92200700 1 -- 172.21.15.84:0/2728515717 wait complete. 2024-04-26T21:36:36.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.720+0000 7fea74a00700 1 -- 172.21.15.84:0/3580787422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea700fcf10 msgr2=0x7fea700fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:36.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.720+0000 7fea74a00700 1 --2- 172.21.15.84:0/3580787422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea700fcf10 0x7fea700fd320 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fea60004940 tx=0x7fea60009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:36.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.720+0000 7fea74a00700 1 -- 172.21.15.84:0/3580787422 shutdown_connections 2024-04-26T21:36:36.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.720+0000 7fea74a00700 1 --2- 172.21.15.84:0/3580787422 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea700fe080 0x7fea700fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:36.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.720+0000 7fea74a00700 1 --2- 172.21.15.84:0/3580787422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea700fcf10 0x7fea700fd320 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:36.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.720+0000 7fea74a00700 1 -- 172.21.15.84:0/3580787422 >> 172.21.15.84:0/3580787422 conn(0x7fea700f8560 msgr2=0x7fea700fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:36.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.720+0000 7fea74a00700 1 -- 172.21.15.84:0/3580787422 shutdown_connections 2024-04-26T21:36:36.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.720+0000 7fea74a00700 1 -- 172.21.15.84:0/3580787422 wait complete. 2024-04-26T21:36:36.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.721+0000 7fea74a00700 1 Processor -- start 2024-04-26T21:36:36.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.721+0000 7fea74a00700 1 -- start start 2024-04-26T21:36:36.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.722+0000 7fea74a00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea700fcf10 0x7fea7010fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:36.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.722+0000 7fea74a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea700fe080 0x7fea70110120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:36.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.722+0000 7fea74a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea701107b0 con 0x7fea700fe080 2024-04-26T21:36:36.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.722+0000 7fea74a00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea70110fa0 con 0x7fea700fcf10 2024-04-26T21:36:36.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.722+0000 7fea6d400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea700fe080 0x7fea70110120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:36.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.722+0000 7fea6d400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea700fe080 0x7fea70110120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57134/0 (socket says 172.21.15.84:57134) 2024-04-26T21:36:36.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.722+0000 7fea6d400700 1 -- 172.21.15.84:0/1103052615 learned_addr learned my addr 172.21.15.84:0/1103052615 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:36:36.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.722+0000 7fea6de00700 1 --2- 172.21.15.84:0/1103052615 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea700fcf10 0x7fea7010fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:36.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.723+0000 7fea6d400700 1 -- 172.21.15.84:0/1103052615 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea700fcf10 msgr2=0x7fea7010fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:36.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.723+0000 7fea6d400700 1 --2- 172.21.15.84:0/1103052615 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea700fcf10 0x7fea7010fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:36.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.723+0000 7fea6d400700 1 -- 172.21.15.84:0/1103052615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea60005040 con 0x7fea700fe080 2024-04-26T21:36:36.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.723+0000 7fea6d400700 1 --2- 172.21.15.84:0/1103052615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea700fe080 0x7fea70110120 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00b790 tx=0x7fea5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:36.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.723+0000 7fea66000700 1 -- 172.21.15.84:0/1103052615 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea5c00f770 con 0x7fea700fe080 2024-04-26T21:36:36.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.723+0000 7fea66000700 1 -- 172.21.15.84:0/1103052615 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea5c00fda0 con 0x7fea700fe080 2024-04-26T21:36:36.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.723+0000 7fea74a00700 1 -- 172.21.15.84:0/1103052615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea70111280 con 0x7fea700fe080 2024-04-26T21:36:36.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.723+0000 7fea66000700 1 -- 172.21.15.84:0/1103052615 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea5c00d310 con 0x7fea700fe080 2024-04-26T21:36:36.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.723+0000 7fea74a00700 1 -- 172.21.15.84:0/1103052615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea70111840 con 0x7fea700fe080 2024-04-26T21:36:36.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.725+0000 7fea74a00700 1 -- 172.21.15.84:0/1103052615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea70101a10 con 0x7fea700fe080 2024-04-26T21:36:36.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.726+0000 7fea66000700 1 -- 172.21.15.84:0/1103052615 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fea5c010420 con 0x7fea700fe080 2024-04-26T21:36:36.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.727+0000 7fea66000700 1 --2- 172.21.15.84:0/1103052615 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fea5406ec10 0x7fea540710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:36.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.727+0000 7fea66000700 1 -- 172.21.15.84:0/1103052615 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fea5c08ea50 con 0x7fea700fe080 2024-04-26T21:36:36.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.728+0000 7fea6de00700 1 --2- 172.21.15.84:0/1103052615 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fea5406ec10 0x7fea540710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:36.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.728+0000 7fea6de00700 1 --2- 172.21.15.84:0/1103052615 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fea5406ec10 0x7fea540710c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fea60004f90 tx=0x7fea60009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:36.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:36.732+0000 7fea66000700 1 -- 172.21.15.84:0/1103052615 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fea5c05b230 con 0x7fea700fe080 2024-04-26T21:36:37.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.061+0000 7fea74a00700 1 -- 172.21.15.84:0/1103052615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fea70105af0 con 0x7fea700fe080 2024-04-26T21:36:37.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.062+0000 7fea66000700 1 -- 172.21.15.84:0/1103052615 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 42 v42) v1 ==== 76+0+1954 (secure 0 0 0) 0x7fea5c05adc0 con 0x7fea700fe080 2024-04-26T21:36:37.064 INFO:teuthology.orchestra.run.smithi084.stdout:e42 2024-04-26T21:36:37.064 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:36:37.064 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:36:37.064 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:36:37.064 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:36:37.064 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:36:37.065 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:36:37.065 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 42 2024-04-26T21:36:37.065 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:36:37.065 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:36:37.065 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:34:58.296487+0000 2024-04-26T21:36:37.065 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:36:37.065 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:36:37.065 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:36:37.065 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:36:37.065 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:36:37.065 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-04-26T21:36:37.065 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:36:37.066 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:36:37.066 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 94 2024-04-26T21:36:37.066 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T21:36:37.066 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:36:37.066 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:36:37.066 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=34446,1=34478} 2024-04-26T21:36:37.066 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:36:37.066 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:36:37.066 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:36:37.066 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:36:37.066 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:36:37.066 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:36:37.066 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:36:37.066 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-04-26T21:36:37.066 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:36:37.067 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 34446 members: 34446,34478 2024-04-26T21:36:37.067 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:34446} state up:active seq 22 join_fscid=1 addr [v2:172.21.15.84:6826/1392878113,v1:172.21.15.84:6827/1392878113] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:36:37.067 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{1:34478} state up:active seq 17 join_fscid=1 addr [v2:172.21.15.84:6828/4015119551,v1:172.21.15.84:6829/4015119551] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:36:37.067 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:36:37.067 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:36:37.067 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:36:37.067 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:36:37.067 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.120:6824/1351450046,v1:172.21.15.120:6825/1351450046] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:36:37.067 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:44305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.120:6826/2847041344,v1:172.21.15.120:6827/2847041344] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:36:37.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.066+0000 7fea74a00700 1 -- 172.21.15.84:0/1103052615 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fea5406ec10 msgr2=0x7fea540710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:37.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.066+0000 7fea74a00700 1 --2- 172.21.15.84:0/1103052615 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fea5406ec10 0x7fea540710c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fea60004f90 tx=0x7fea60009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:37.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.066+0000 7fea74a00700 1 -- 172.21.15.84:0/1103052615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea700fe080 msgr2=0x7fea70110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:37.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.066+0000 7fea74a00700 1 --2- 172.21.15.84:0/1103052615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea700fe080 0x7fea70110120 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00b790 tx=0x7fea5c009250 comp rx=0 tx=0).stop 2024-04-26T21:36:37.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.066+0000 7fea74a00700 1 -- 172.21.15.84:0/1103052615 shutdown_connections 2024-04-26T21:36:37.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.066+0000 7fea74a00700 1 --2- 172.21.15.84:0/1103052615 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fea5406ec10 0x7fea540710c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:37.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.066+0000 7fea74a00700 1 --2- 172.21.15.84:0/1103052615 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea700fcf10 0x7fea7010fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:37.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.066+0000 7fea74a00700 1 --2- 172.21.15.84:0/1103052615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea700fe080 0x7fea70110120 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:37.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.066+0000 7fea74a00700 1 -- 172.21.15.84:0/1103052615 >> 172.21.15.84:0/1103052615 conn(0x7fea700f8560 msgr2=0x7fea700f9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:37.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.066+0000 7fea74a00700 1 -- 172.21.15.84:0/1103052615 shutdown_connections 2024-04-26T21:36:37.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.067+0000 7fea74a00700 1 -- 172.21.15.84:0/1103052615 wait complete. 2024-04-26T21:36:37.069 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 42 2024-04-26T21:36:37.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.241+0000 7f6184000700 1 -- 172.21.15.84:0/3981983593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c0fffa0 msgr2=0x7f617c102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:37.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.241+0000 7f6184000700 1 --2- 172.21.15.84:0/3981983593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c0fffa0 0x7f617c102380 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6168004940 tx=0x7f6168009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:37.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.241+0000 7f6184000700 1 -- 172.21.15.84:0/3981983593 shutdown_connections 2024-04-26T21:36:37.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.241+0000 7f6184000700 1 --2- 172.21.15.84:0/3981983593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c0fffa0 0x7f617c102380 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:37.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.241+0000 7f6184000700 1 --2- 172.21.15.84:0/3981983593 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f617c066200 0x7f617c0ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:37.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.241+0000 7f6184000700 1 -- 172.21.15.84:0/3981983593 >> 172.21.15.84:0/3981983593 conn(0x7f617c0f7430 msgr2=0x7f617c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:37.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.241+0000 7f6184000700 1 -- 172.21.15.84:0/3981983593 shutdown_connections 2024-04-26T21:36:37.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.241+0000 7f6184000700 1 -- 172.21.15.84:0/3981983593 wait complete. 2024-04-26T21:36:37.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.242+0000 7f6184000700 1 Processor -- start 2024-04-26T21:36:37.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.243+0000 7f6184000700 1 -- start start 2024-04-26T21:36:37.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.243+0000 7f6184000700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f617c066200 0x7f617c10da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:37.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.243+0000 7f6184000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c0fffa0 0x7f617c10df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:37.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.243+0000 7f6184000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c10e570 con 0x7f617c0fffa0 2024-04-26T21:36:37.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.243+0000 7f6184000700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c10edc0 con 0x7f617c066200 2024-04-26T21:36:37.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.243+0000 7f6180c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c0fffa0 0x7f617c10df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:37.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.243+0000 7f6180c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c0fffa0 0x7f617c10df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57148/0 (socket says 172.21.15.84:57148) 2024-04-26T21:36:37.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.243+0000 7f6180c00700 1 -- 172.21.15.84:0/1496446477 learned_addr learned my addr 172.21.15.84:0/1496446477 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:36:37.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.244+0000 7f6181600700 1 --2- 172.21.15.84:0/1496446477 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f617c066200 0x7f617c10da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:37.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.244+0000 7f6180c00700 1 -- 172.21.15.84:0/1496446477 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f617c066200 msgr2=0x7f617c10da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:37.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.244+0000 7f6180c00700 1 --2- 172.21.15.84:0/1496446477 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f617c066200 0x7f617c10da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:37.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.244+0000 7f6180c00700 1 -- 172.21.15.84:0/1496446477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6168005040 con 0x7f617c0fffa0 2024-04-26T21:36:37.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.244+0000 7f6180c00700 1 --2- 172.21.15.84:0/1496446477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c0fffa0 0x7f617c10df70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f616800b970 tx=0x7f6168009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:37.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.244+0000 7f6179600700 1 -- 172.21.15.84:0/1496446477 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f616800e040 con 0x7f617c0fffa0 2024-04-26T21:36:37.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.244+0000 7f6179600700 1 -- 172.21.15.84:0/1496446477 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f616800bbf0 con 0x7f617c0fffa0 2024-04-26T21:36:37.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.244+0000 7f6179600700 1 -- 172.21.15.84:0/1496446477 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f616801c630 con 0x7f617c0fffa0 2024-04-26T21:36:37.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.244+0000 7f6184000700 1 -- 172.21.15.84:0/1496446477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617c10f040 con 0x7f617c0fffa0 2024-04-26T21:36:37.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.245+0000 7f6184000700 1 -- 172.21.15.84:0/1496446477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617c10f580 con 0x7f617c0fffa0 2024-04-26T21:36:37.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.246+0000 7f6184000700 1 -- 172.21.15.84:0/1496446477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617c05f5c0 con 0x7f617c0fffa0 2024-04-26T21:36:37.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.247+0000 7f6179600700 1 -- 172.21.15.84:0/1496446477 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f616800bd60 con 0x7f617c0fffa0 2024-04-26T21:36:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.248+0000 7f6179600700 1 --2- 172.21.15.84:0/1496446477 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f616406ec10 0x7f61640710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.248+0000 7f6179600700 1 -- 172.21.15.84:0/1496446477 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f616808fd80 con 0x7f617c0fffa0 2024-04-26T21:36:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.248+0000 7f6181600700 1 --2- 172.21.15.84:0/1496446477 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f616406ec10 0x7f61640710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.249+0000 7f6181600700 1 --2- 172.21.15.84:0/1496446477 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f616406ec10 0x7f61640710c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f617c065f40 tx=0x7f6170009040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:37.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.253+0000 7f6179600700 1 -- 172.21.15.84:0/1496446477 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f616805c560 con 0x7f617c0fffa0 2024-04-26T21:36:37.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:37 smithi084 ceph-mon[90138]: from='client.34596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:36:37.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:37 smithi084 ceph-mon[90138]: from='client.34600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:36:37.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:37 smithi084 ceph-mon[90138]: pgmap v315: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:37.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:37 smithi084 ceph-mon[90138]: from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:36:37.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:37 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2728515717' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:37.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:37 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/1103052615' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:36:37.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:37 smithi120 ceph-mon[79001]: from='client.34596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:36:37.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:37 smithi120 ceph-mon[79001]: from='client.34600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:36:37.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:37 smithi120 ceph-mon[79001]: pgmap v315: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:37.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:37 smithi120 ceph-mon[79001]: from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:36:37.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:37 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2728515717' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:37.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:37 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/1103052615' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:36:37.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.505+0000 7f6184000700 1 -- 172.21.15.84:0/1496446477 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f617c10f9c0 con 0x7f616406ec10 2024-04-26T21:36:37.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.507+0000 7f6179600700 1 -- 172.21.15.84:0/1496446477 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f617c10f9c0 con 0x7f616406ec10 2024-04-26T21:36:37.508 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:36:37.508 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:36:37.508 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-04-26T21:36:37.509 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:36:37.509 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-04-26T21:36:37.509 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-04-26T21:36:37.509 INFO:teuthology.orchestra.run.smithi084.stdout: "osd", 2024-04-26T21:36:37.509 INFO:teuthology.orchestra.run.smithi084.stdout: "mds", 2024-04-26T21:36:37.509 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr", 2024-04-26T21:36:37.509 INFO:teuthology.orchestra.run.smithi084.stdout: "crash" 2024-04-26T21:36:37.509 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-04-26T21:36:37.509 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "16/21 daemons upgraded", 2024-04-26T21:36:37.509 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading grafana daemons", 2024-04-26T21:36:37.509 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:36:37.509 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:36:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.509+0000 7f6184000700 1 -- 172.21.15.84:0/1496446477 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f616406ec10 msgr2=0x7f61640710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.509+0000 7f6184000700 1 --2- 172.21.15.84:0/1496446477 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f616406ec10 0x7f61640710c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f617c065f40 tx=0x7f6170009040 comp rx=0 tx=0).stop 2024-04-26T21:36:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.509+0000 7f6184000700 1 -- 172.21.15.84:0/1496446477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c0fffa0 msgr2=0x7f617c10df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.509+0000 7f6184000700 1 --2- 172.21.15.84:0/1496446477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c0fffa0 0x7f617c10df70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f616800b970 tx=0x7f6168009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:37.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.510+0000 7f6184000700 1 -- 172.21.15.84:0/1496446477 shutdown_connections 2024-04-26T21:36:37.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.510+0000 7f6184000700 1 --2- 172.21.15.84:0/1496446477 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f616406ec10 0x7f61640710c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:37.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.510+0000 7f6184000700 1 --2- 172.21.15.84:0/1496446477 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f617c066200 0x7f617c10da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:37.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.510+0000 7f6184000700 1 --2- 172.21.15.84:0/1496446477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c0fffa0 0x7f617c10df70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:37.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.510+0000 7f6184000700 1 -- 172.21.15.84:0/1496446477 >> 172.21.15.84:0/1496446477 conn(0x7f617c0f7430 msgr2=0x7f617c0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:37.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.510+0000 7f6184000700 1 -- 172.21.15.84:0/1496446477 shutdown_connections 2024-04-26T21:36:37.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.510+0000 7f6184000700 1 -- 172.21.15.84:0/1496446477 wait complete. 2024-04-26T21:36:37.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.664+0000 7f98e3200700 1 -- 172.21.15.84:0/957992461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98e40fc8e0 msgr2=0x7f98e40fcd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:37.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.664+0000 7f98e3200700 1 --2- 172.21.15.84:0/957992461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98e40fc8e0 0x7f98e40fcd50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f98d0004940 tx=0x7f98d0009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:37.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.664+0000 7f98e3200700 1 -- 172.21.15.84:0/957992461 shutdown_connections 2024-04-26T21:36:37.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.664+0000 7f98e3200700 1 --2- 172.21.15.84:0/957992461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98e40fc8e0 0x7f98e40fcd50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:37.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.664+0000 7f98e3200700 1 --2- 172.21.15.84:0/957992461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98e40fe2f0 0x7f98e40fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:37.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.664+0000 7f98e3200700 1 -- 172.21.15.84:0/957992461 >> 172.21.15.84:0/957992461 conn(0x7f98e40f83b0 msgr2=0x7f98e40fa7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:37.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.664+0000 7f98e3200700 1 -- 172.21.15.84:0/957992461 shutdown_connections 2024-04-26T21:36:37.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.664+0000 7f98e3200700 1 -- 172.21.15.84:0/957992461 wait complete. 2024-04-26T21:36:37.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.665+0000 7f98e3200700 1 Processor -- start 2024-04-26T21:36:37.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.666+0000 7f98e3200700 1 -- start start 2024-04-26T21:36:37.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.666+0000 7f98e3200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98e40fc8e0 0x7f98e410d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:37.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.666+0000 7f98e3200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98e40fe2f0 0x7f98e410dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:37.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.666+0000 7f98e3200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e410e370 con 0x7f98e40fe2f0 2024-04-26T21:36:37.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.666+0000 7f98e3200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e410ebc0 con 0x7f98e40fc8e0 2024-04-26T21:36:37.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.666+0000 7f98e1400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98e40fe2f0 0x7f98e410dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:37.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.667+0000 7f98e1400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98e40fe2f0 0x7f98e410dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57166/0 (socket says 172.21.15.84:57166) 2024-04-26T21:36:37.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.667+0000 7f98e1400700 1 -- 172.21.15.84:0/3003712187 learned_addr learned my addr 172.21.15.84:0/3003712187 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:36:37.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.667+0000 7f98e1e00700 1 --2- 172.21.15.84:0/3003712187 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98e40fc8e0 0x7f98e410d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:37.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.667+0000 7f98e1400700 1 -- 172.21.15.84:0/3003712187 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98e40fc8e0 msgr2=0x7f98e410d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:37.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.667+0000 7f98e1400700 1 --2- 172.21.15.84:0/3003712187 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98e40fc8e0 0x7f98e410d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:37.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.667+0000 7f98e1400700 1 -- 172.21.15.84:0/3003712187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d0005040 con 0x7f98e40fe2f0 2024-04-26T21:36:37.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.667+0000 7f98e1400700 1 --2- 172.21.15.84:0/3003712187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98e40fe2f0 0x7f98e410dd70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f98d0009150 tx=0x7f98d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:37.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.668+0000 7f98da000700 1 -- 172.21.15.84:0/3003712187 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98d000e040 con 0x7f98e40fe2f0 2024-04-26T21:36:37.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.668+0000 7f98da000700 1 -- 172.21.15.84:0/3003712187 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f98d000bbf0 con 0x7f98e40fe2f0 2024-04-26T21:36:37.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.668+0000 7f98e3200700 1 -- 172.21.15.84:0/3003712187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e410ee40 con 0x7f98e40fe2f0 2024-04-26T21:36:37.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.668+0000 7f98da000700 1 -- 172.21.15.84:0/3003712187 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98d001c630 con 0x7f98e40fe2f0 2024-04-26T21:36:37.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.668+0000 7f98e3200700 1 -- 172.21.15.84:0/3003712187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e410f380 con 0x7f98e40fe2f0 2024-04-26T21:36:37.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.669+0000 7f98e3200700 1 -- 172.21.15.84:0/3003712187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e405f5c0 con 0x7f98e40fe2f0 2024-04-26T21:36:37.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.670+0000 7f98da000700 1 -- 172.21.15.84:0/3003712187 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f98d000bd60 con 0x7f98e40fe2f0 2024-04-26T21:36:37.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.672+0000 7f98da000700 1 --2- 172.21.15.84:0/3003712187 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f98c806ec10 0x7f98c80710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:37.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.672+0000 7f98da000700 1 -- 172.21.15.84:0/3003712187 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f98d008fd90 con 0x7f98e40fe2f0 2024-04-26T21:36:37.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.672+0000 7f98e1e00700 1 --2- 172.21.15.84:0/3003712187 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f98c806ec10 0x7f98c80710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:37.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.673+0000 7f98e1e00700 1 --2- 172.21.15.84:0/3003712187 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f98c806ec10 0x7f98c80710c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f98d4004990 tx=0x7f98d4009ee0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:37.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.677+0000 7f98da000700 1 -- 172.21.15.84:0/3003712187 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f98d005c570 con 0x7f98e40fe2f0 2024-04-26T21:36:37.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.994+0000 7f98e3200700 1 -- 172.21.15.84:0/3003712187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f98e4105800 con 0x7f98e40fe2f0 2024-04-26T21:36:37.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.995+0000 7f98da000700 1 -- 172.21.15.84:0/3003712187 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f98d005c100 con 0x7f98e40fe2f0 2024-04-26T21:36:37.996 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:36:37.997 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:36:37.997 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:36:37.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.997+0000 7f98e3200700 1 -- 172.21.15.84:0/3003712187 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f98c806ec10 msgr2=0x7f98c80710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:37.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.998+0000 7f98e3200700 1 --2- 172.21.15.84:0/3003712187 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f98c806ec10 0x7f98c80710c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f98d4004990 tx=0x7f98d4009ee0 comp rx=0 tx=0).stop 2024-04-26T21:36:37.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.998+0000 7f98e3200700 1 -- 172.21.15.84:0/3003712187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98e40fe2f0 msgr2=0x7f98e410dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:37.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.998+0000 7f98e3200700 1 --2- 172.21.15.84:0/3003712187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98e40fe2f0 0x7f98e410dd70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f98d0009150 tx=0x7f98d0009e30 comp rx=0 tx=0).stop 2024-04-26T21:36:38.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.998+0000 7f98e3200700 1 -- 172.21.15.84:0/3003712187 shutdown_connections 2024-04-26T21:36:38.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.998+0000 7f98e3200700 1 --2- 172.21.15.84:0/3003712187 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f98c806ec10 0x7f98c80710c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:38.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.998+0000 7f98e3200700 1 --2- 172.21.15.84:0/3003712187 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98e40fc8e0 0x7f98e410d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:38.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.998+0000 7f98e3200700 1 --2- 172.21.15.84:0/3003712187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98e40fe2f0 0x7f98e410dd70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:38.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.998+0000 7f98e3200700 1 -- 172.21.15.84:0/3003712187 >> 172.21.15.84:0/3003712187 conn(0x7f98e40f83b0 msgr2=0x7f98e40f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:38.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.998+0000 7f98e3200700 1 -- 172.21.15.84:0/3003712187 shutdown_connections 2024-04-26T21:36:38.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:36:37.998+0000 7f98e3200700 1 -- 172.21.15.84:0/3003712187 wait complete. 2024-04-26T21:36:38.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:38 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:38.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:38 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:38.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:38 smithi084 ceph-mon[90138]: from='client.34616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:36:38.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:38 smithi084 ceph-mon[90138]: pgmap v316: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:38.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:38 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3003712187' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:36:38.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:38 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:38.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:38 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:38.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:38 smithi120 ceph-mon[79001]: from='client.34616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:36:38.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:38 smithi120 ceph-mon[79001]: pgmap v316: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:38.683 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:38 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3003712187' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:36:40.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:40.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:40 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:40.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:40 smithi084 ceph-mon[90138]: pgmap v317: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:40.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:40.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:40 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:40.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:40 smithi120 ceph-mon[79001]: pgmap v317: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:43.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:42 smithi084 ceph-mon[90138]: pgmap v318: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:43.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:42 smithi120 ceph-mon[79001]: pgmap v318: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:44 smithi084 ceph-mon[90138]: pgmap v319: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:36:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:44 smithi120 ceph-mon[79001]: pgmap v319: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:36:46.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:46.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:46.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:36:46.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:36:46.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:46.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-26T21:36:46.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:36:46.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:46.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-26T21:36:46.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-26T21:36:46.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:36:46.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-26T21:36:46.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-26T21:36:46.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-26T21:36:46.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-26T21:36:46.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-26T21:36:46.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-26T21:36:46.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-26T21:36:46.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-26T21:36:46.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-26T21:36:46.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-26T21:36:46.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-26T21:36:46.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:36:46.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-26T21:36:46.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-26T21:36:46.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-26T21:36:46.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-26T21:36:46.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-26T21:36:46.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-26T21:36:46.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-26T21:36:46.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-26T21:36:46.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:36:46.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:36:46.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:36:46.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:36:46.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:36:46.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:36:46.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-26T21:36:46.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-26T21:36:46.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:36:46.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:36:46.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:36:46.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:46.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:36:46.418 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:36:46.419 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:36:46.419 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:46.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:46.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:46.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:36:46.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:36:46.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:46.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-26T21:36:46.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:36:46.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:36:46.435 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:46.436 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-26T21:36:46.436 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-26T21:36:46.436 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:36:46.436 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-26T21:36:46.436 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-26T21:36:46.437 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-26T21:36:46.437 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-26T21:36:46.437 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-26T21:36:46.437 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-26T21:36:46.437 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-26T21:36:46.437 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-26T21:36:46.437 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-26T21:36:46.437 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-26T21:36:46.437 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-26T21:36:46.437 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:36:46.437 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-26T21:36:46.438 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-26T21:36:46.438 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-26T21:36:46.438 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-26T21:36:46.438 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-26T21:36:46.438 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-26T21:36:46.438 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-26T21:36:46.438 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-26T21:36:46.438 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:36:46.438 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:36:46.438 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:36:46.438 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:36:46.438 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:36:46.439 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:36:46.439 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-26T21:36:46.439 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-26T21:36:46.439 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:36:46.439 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:36:46.439 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:36:46.439 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:46.439 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:36:46.439 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:36:46.439 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:36:46.440 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:47.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:47 smithi084 ceph-mon[90138]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-26T21:36:47.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:47 smithi084 ceph-mon[90138]: Upgrade: Finalizing container_image settings 2024-04-26T21:36:47.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:47 smithi084 ceph-mon[90138]: Upgrade: Complete! 2024-04-26T21:36:47.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:47 smithi084 ceph-mon[90138]: pgmap v320: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:47 smithi120 ceph-mon[79001]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-26T21:36:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:47 smithi120 ceph-mon[79001]: Upgrade: Finalizing container_image settings 2024-04-26T21:36:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:47 smithi120 ceph-mon[79001]: Upgrade: Complete! 2024-04-26T21:36:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:47 smithi120 ceph-mon[79001]: pgmap v320: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:49.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:49 smithi084 ceph-mon[90138]: pgmap v321: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:49.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:49 smithi120 ceph-mon[79001]: pgmap v321: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:50.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:50.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:50 smithi084 ceph-mon[90138]: pgmap v322: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:50.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:36:50.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:50 smithi120 ceph-mon[79001]: pgmap v322: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:53.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:52 smithi084 ceph-mon[90138]: pgmap v323: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:52 smithi120 ceph-mon[79001]: pgmap v323: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:55.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:54 smithi084 ceph-mon[90138]: pgmap v324: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:54 smithi120 ceph-mon[79001]: pgmap v324: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:57.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:56 smithi084 ceph-mon[90138]: pgmap v325: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:56 smithi120 ceph-mon[79001]: pgmap v325: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:59.235 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:58 smithi120 ceph-mon[79001]: pgmap v326: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:36:59.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:58 smithi084 ceph-mon[90138]: pgmap v326: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:00.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:36:59 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:37:00.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:36:59 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:37:01.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:00 smithi084 ceph-mon[90138]: pgmap v327: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:01.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:00 smithi120 ceph-mon[79001]: pgmap v327: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:03.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:02 smithi084 ceph-mon[90138]: pgmap v328: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:03.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:02 smithi120 ceph-mon[79001]: pgmap v328: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:05.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:05 smithi084 ceph-mon[90138]: pgmap v329: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:05 smithi120 ceph-mon[79001]: pgmap v329: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:07.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:07 smithi084 ceph-mon[90138]: pgmap v330: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:07.439 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:07 smithi120 ceph-mon[79001]: pgmap v330: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:08.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.168+0000 7f01c5e00700 1 -- 172.21.15.84:0/1189986419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01c0071ef0 msgr2=0x7f01c0070400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:08.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.168+0000 7f01c5e00700 1 --2- 172.21.15.84:0/1189986419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01c0071ef0 0x7f01c0070400 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f01b0004940 tx=0x7f01b0009e30 comp rx=0 tx=0).stop 2024-04-26T21:37:08.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.169+0000 7f01c5e00700 1 -- 172.21.15.84:0/1189986419 shutdown_connections 2024-04-26T21:37:08.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.169+0000 7f01c5e00700 1 --2- 172.21.15.84:0/1189986419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01c0070940 0x7f01c0070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:08.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.169+0000 7f01c5e00700 1 --2- 172.21.15.84:0/1189986419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01c0071ef0 0x7f01c0070400 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:08.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.169+0000 7f01c5e00700 1 -- 172.21.15.84:0/1189986419 >> 172.21.15.84:0/1189986419 conn(0x7f01c00f8560 msgr2=0x7f01c00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:08.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.169+0000 7f01c5e00700 1 -- 172.21.15.84:0/1189986419 shutdown_connections 2024-04-26T21:37:08.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.169+0000 7f01c5e00700 1 -- 172.21.15.84:0/1189986419 wait complete. 2024-04-26T21:37:08.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.170+0000 7f01c5e00700 1 Processor -- start 2024-04-26T21:37:08.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.170+0000 7f01c5e00700 1 -- start start 2024-04-26T21:37:08.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.170+0000 7f01c5e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01c0070940 0x7f01c010fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:08.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.170+0000 7f01c5e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01c0071ef0 0x7f01c01101e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:08.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.170+0000 7f01c5e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c01107e0 con 0x7f01c0070940 2024-04-26T21:37:08.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.170+0000 7f01c5e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c0110fe0 con 0x7f01c0071ef0 2024-04-26T21:37:08.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.171+0000 7f01bea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01c0070940 0x7f01c010fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:08.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.171+0000 7f01bea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01c0070940 0x7f01c010fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57302/0 (socket says 172.21.15.84:57302) 2024-04-26T21:37:08.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.171+0000 7f01bea00700 1 -- 172.21.15.84:0/2056718756 learned_addr learned my addr 172.21.15.84:0/2056718756 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:37:08.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.171+0000 7f01be000700 1 --2- 172.21.15.84:0/2056718756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01c0071ef0 0x7f01c01101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:08.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.171+0000 7f01bea00700 1 -- 172.21.15.84:0/2056718756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01c0071ef0 msgr2=0x7f01c01101e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:08.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.171+0000 7f01bea00700 1 --2- 172.21.15.84:0/2056718756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01c0071ef0 0x7f01c01101e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:08.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.171+0000 7f01bea00700 1 -- 172.21.15.84:0/2056718756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b0005040 con 0x7f01c0070940 2024-04-26T21:37:08.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.171+0000 7f01bea00700 1 --2- 172.21.15.84:0/2056718756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01c0070940 0x7f01c010fca0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f01b000b970 tx=0x7f01b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:08.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.172+0000 7f01b6a00700 1 -- 172.21.15.84:0/2056718756 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01b000e040 con 0x7f01c0070940 2024-04-26T21:37:08.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.172+0000 7f01b6a00700 1 -- 172.21.15.84:0/2056718756 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f01b000bbf0 con 0x7f01c0070940 2024-04-26T21:37:08.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.172+0000 7f01c5e00700 1 -- 172.21.15.84:0/2056718756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c0111260 con 0x7f01c0070940 2024-04-26T21:37:08.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.172+0000 7f01b6a00700 1 -- 172.21.15.84:0/2056718756 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01b001c630 con 0x7f01c0070940 2024-04-26T21:37:08.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.172+0000 7f01c5e00700 1 -- 172.21.15.84:0/2056718756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c01117a0 con 0x7f01c0070940 2024-04-26T21:37:08.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.173+0000 7f01c5e00700 1 -- 172.21.15.84:0/2056718756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c005f5c0 con 0x7f01c0070940 2024-04-26T21:37:08.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.174+0000 7f01b6a00700 1 -- 172.21.15.84:0/2056718756 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f01b000bd60 con 0x7f01c0070940 2024-04-26T21:37:08.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.175+0000 7f01b6a00700 1 --2- 172.21.15.84:0/2056718756 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f01a406ec10 0x7f01a40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:08.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.176+0000 7f01b6a00700 1 -- 172.21.15.84:0/2056718756 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f01b008fe30 con 0x7f01c0070940 2024-04-26T21:37:08.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.176+0000 7f01be000700 1 --2- 172.21.15.84:0/2056718756 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f01a406ec10 0x7f01a40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:08.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.176+0000 7f01be000700 1 --2- 172.21.15.84:0/2056718756 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f01a406ec10 0x7f01a40710c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f01ac004d60 tx=0x7f01ac00b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:08.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.180+0000 7f01b6a00700 1 -- 172.21.15.84:0/2056718756 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f01b005c590 con 0x7f01c0070940 2024-04-26T21:37:08.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.443+0000 7f01c5e00700 1 -- 172.21.15.84:0/2056718756 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f01c0111ad0 con 0x7f01a406ec10 2024-04-26T21:37:08.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.445+0000 7f01b6a00700 1 -- 172.21.15.84:0/2056718756 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f01c0111ad0 con 0x7f01a406ec10 2024-04-26T21:37:08.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.448+0000 7f01c5e00700 1 -- 172.21.15.84:0/2056718756 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f01a406ec10 msgr2=0x7f01a40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:08.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.448+0000 7f01c5e00700 1 --2- 172.21.15.84:0/2056718756 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f01a406ec10 0x7f01a40710c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f01ac004d60 tx=0x7f01ac00b040 comp rx=0 tx=0).stop 2024-04-26T21:37:08.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.448+0000 7f01c5e00700 1 -- 172.21.15.84:0/2056718756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01c0070940 msgr2=0x7f01c010fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:08.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.448+0000 7f01c5e00700 1 --2- 172.21.15.84:0/2056718756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01c0070940 0x7f01c010fca0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f01b000b970 tx=0x7f01b0009e30 comp rx=0 tx=0).stop 2024-04-26T21:37:08.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.448+0000 7f01c5e00700 1 -- 172.21.15.84:0/2056718756 shutdown_connections 2024-04-26T21:37:08.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.448+0000 7f01c5e00700 1 --2- 172.21.15.84:0/2056718756 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f01a406ec10 0x7f01a40710c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:08.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.448+0000 7f01c5e00700 1 --2- 172.21.15.84:0/2056718756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01c0070940 0x7f01c010fca0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:08.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.448+0000 7f01c5e00700 1 --2- 172.21.15.84:0/2056718756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01c0071ef0 0x7f01c01101e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:08.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.448+0000 7f01c5e00700 1 -- 172.21.15.84:0/2056718756 >> 172.21.15.84:0/2056718756 conn(0x7f01c00f8560 msgr2=0x7f01c00f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:08.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.449+0000 7f01c5e00700 1 -- 172.21.15.84:0/2056718756 shutdown_connections 2024-04-26T21:37:08.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:08.449+0000 7f01c5e00700 1 -- 172.21.15.84:0/2056718756 wait complete. 2024-04-26T21:37:09.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:09 smithi084 ceph-mon[90138]: pgmap v331: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:09.277 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph orch ps' 2024-04-26T21:37:09.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:09 smithi120 ceph-mon[79001]: pgmap v331: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:09.795 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:37:10.286 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:10 smithi084 ceph-mon[90138]: from='client.34624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:37:10.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:10 smithi120 ceph-mon[79001]: from='client.34624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:37:11.110 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:11 smithi084 ceph-mon[90138]: pgmap v332: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:11.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:11 smithi120 ceph-mon[79001]: pgmap v332: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.948+0000 7f76c5800700 1 -- 172.21.15.84:0/2616718376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c0101d00 msgr2=0x7f76c01020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.948+0000 7f76c5800700 1 --2- 172.21.15.84:0/2616718376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c0101d00 0x7f76c01020d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f76b0004940 tx=0x7f76b0009e30 comp rx=0 tx=0).stop 2024-04-26T21:37:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.948+0000 7f76c5800700 1 -- 172.21.15.84:0/2616718376 shutdown_connections 2024-04-26T21:37:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.948+0000 7f76c5800700 1 --2- 172.21.15.84:0/2616718376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76c01026a0 0x7f76c00fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.948+0000 7f76c5800700 1 --2- 172.21.15.84:0/2616718376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c0101d00 0x7f76c01020d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.948+0000 7f76c5800700 1 -- 172.21.15.84:0/2616718376 >> 172.21.15.84:0/2616718376 conn(0x7f76c00f78d0 msgr2=0x7f76c00f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.948+0000 7f76c5800700 1 -- 172.21.15.84:0/2616718376 shutdown_connections 2024-04-26T21:37:11.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.948+0000 7f76c5800700 1 -- 172.21.15.84:0/2616718376 wait complete. 2024-04-26T21:37:11.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.950+0000 7f76c5800700 1 Processor -- start 2024-04-26T21:37:11.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.950+0000 7f76c5800700 1 -- start start 2024-04-26T21:37:11.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.951+0000 7f76c5800700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76c0101d00 0x7f76c0112a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:11.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.951+0000 7f76c5800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c01026a0 0x7f76c0112fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:11.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.951+0000 7f76c5800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c0113610 con 0x7f76c01026a0 2024-04-26T21:37:11.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.951+0000 7f76c5800700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c010ca00 con 0x7f76c0101d00 2024-04-26T21:37:11.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.951+0000 7f76be000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c01026a0 0x7f76c0112fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:11.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.951+0000 7f76be000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c01026a0 0x7f76c0112fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48782/0 (socket says 172.21.15.84:48782) 2024-04-26T21:37:11.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.951+0000 7f76be000700 1 -- 172.21.15.84:0/2747674315 learned_addr learned my addr 172.21.15.84:0/2747674315 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:37:11.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.951+0000 7f76bea00700 1 --2- 172.21.15.84:0/2747674315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76c0101d00 0x7f76c0112a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:11.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.952+0000 7f76be000700 1 -- 172.21.15.84:0/2747674315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76c0101d00 msgr2=0x7f76c0112a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:11.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.952+0000 7f76be000700 1 --2- 172.21.15.84:0/2747674315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76c0101d00 0x7f76c0112a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:11.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.952+0000 7f76be000700 1 -- 172.21.15.84:0/2747674315 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b0005040 con 0x7f76c01026a0 2024-04-26T21:37:11.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.952+0000 7f76be000700 1 --2- 172.21.15.84:0/2747674315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c01026a0 0x7f76c0112fc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f76ac002a50 tx=0x7f76ac004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:11.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.952+0000 7f76b6a00700 1 -- 172.21.15.84:0/2747674315 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76ac007cc0 con 0x7f76c01026a0 2024-04-26T21:37:11.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.952+0000 7f76b6a00700 1 -- 172.21.15.84:0/2747674315 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f76ac00f040 con 0x7f76c01026a0 2024-04-26T21:37:11.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.952+0000 7f76b6a00700 1 -- 172.21.15.84:0/2747674315 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76ac00daf0 con 0x7f76c01026a0 2024-04-26T21:37:11.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.952+0000 7f76c5800700 1 -- 172.21.15.84:0/2747674315 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c010cce0 con 0x7f76c01026a0 2024-04-26T21:37:11.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.952+0000 7f76c5800700 1 -- 172.21.15.84:0/2747674315 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c010d2a0 con 0x7f76c01026a0 2024-04-26T21:37:11.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.954+0000 7f76c5800700 1 -- 172.21.15.84:0/2747674315 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c00fd450 con 0x7f76c01026a0 2024-04-26T21:37:11.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.955+0000 7f76b6a00700 1 -- 172.21.15.84:0/2747674315 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f76ac009810 con 0x7f76c01026a0 2024-04-26T21:37:11.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.956+0000 7f76b6a00700 1 --2- 172.21.15.84:0/2747674315 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f76a406ec10 0x7f76a40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:11.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.956+0000 7f76b6a00700 1 -- 172.21.15.84:0/2747674315 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f76ac08e750 con 0x7f76c01026a0 2024-04-26T21:37:11.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.956+0000 7f76bea00700 1 --2- 172.21.15.84:0/2747674315 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f76a406ec10 0x7f76a40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:11.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.957+0000 7f76bea00700 1 --2- 172.21.15.84:0/2747674315 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f76a406ec10 0x7f76a40710c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f76b000b020 tx=0x7f76b0009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:11.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:11.961+0000 7f76b6a00700 1 -- 172.21.15.84:0/2747674315 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f76ac05aeb0 con 0x7f76c01026a0 2024-04-26T21:37:12.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:12.206+0000 7f76c5800700 1 -- 172.21.15.84:0/2747674315 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f76c0108e00 con 0x7f76a406ec10 2024-04-26T21:37:12.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:12.235+0000 7f76b6a00700 1 -- 172.21.15.84:0/2747674315 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f76c0108e00 con 0x7f76a406ec10 2024-04-26T21:37:12.236 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:37:12.236 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (73s) 35s ago 22m 14.5M - 0.25.0 c8568f914cd2 61e7fdb22568 2024-04-26T21:37:12.236 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (8m) 35s ago 23m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 b4010dfbe623 2024-04-26T21:37:12.236 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (7m) 117s ago 21m 6665k - 19.0.0-3306-gbc612ffb 55dc54019ad8 89a4e50ea23c 2024-04-26T21:37:12.236 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (41s) 35s ago 22m 50.3M - 9.4.12 2bacad6d85d8 3a38ee34dc00 2024-04-26T21:37:12.236 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (3m) 35s ago 15m 58.3M - 19.0.0-3306-gbc612ffb 55dc54019ad8 26d10fe664bb 2024-04-26T21:37:12.236 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (3m) 35s ago 15m 16.3M - 19.0.0-3306-gbc612ffb 55dc54019ad8 c801ec16a810 2024-04-26T21:37:12.236 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (2m) 117s ago 15m 11.2M - 19.0.0-3306-gbc612ffb 55dc54019ad8 137a38b571df 2024-04-26T21:37:12.236 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (2m) 117s ago 15m 11.1M - 19.0.0-3306-gbc612ffb 55dc54019ad8 0f6be9e294cb 2024-04-26T21:37:12.236 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (11m) 35s ago 24m 522M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:37:12.236 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283,8765 running (10m) 117s ago 21m 455M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d6ae0b4628b5 2024-04-26T21:37:12.236 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (9m) 35s ago 24m 58.0M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 bf610abb6a62 2024-04-26T21:37:12.236 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (9m) 117s ago 21m 43.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 5d530496253b 2024-04-26T21:37:12.237 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (2m) 35s ago 23m 7646k - 1.5.0 0da6a335fe13 bda8f4e31302 2024-04-26T21:37:12.237 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (2m) 117s ago 21m 2985k - 1.5.0 0da6a335fe13 c28df53d1aa9 2024-04-26T21:37:12.237 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (7m) 35s ago 20m 115M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 99fbe2faa51b 2024-04-26T21:37:12.237 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (6m) 35s ago 19m 100M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 2dc81d93f7e5 2024-04-26T21:37:12.237 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (6m) 35s ago 19m 91.6M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 9e77abf095bd 2024-04-26T21:37:12.237 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (5m) 117s ago 18m 96.6M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 d7e5825e2640 2024-04-26T21:37:12.237 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (5m) 117s ago 18m 88.1M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 894dcbaab8eb 2024-04-26T21:37:12.237 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (4m) 117s ago 17m 85.9M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 e39948e51a13 2024-04-26T21:37:12.237 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (97s) 35s ago 22m 50.0M - 2.43.0 a07b618ecd1d 8e385c5bfadf 2024-04-26T21:37:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:12.238+0000 7f76c5800700 1 -- 172.21.15.84:0/2747674315 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f76a406ec10 msgr2=0x7f76a40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:12.238+0000 7f76c5800700 1 --2- 172.21.15.84:0/2747674315 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f76a406ec10 0x7f76a40710c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f76b000b020 tx=0x7f76b0009e30 comp rx=0 tx=0).stop 2024-04-26T21:37:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:12.238+0000 7f76c5800700 1 -- 172.21.15.84:0/2747674315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c01026a0 msgr2=0x7f76c0112fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:12.238+0000 7f76c5800700 1 --2- 172.21.15.84:0/2747674315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c01026a0 0x7f76c0112fc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f76ac002a50 tx=0x7f76ac004600 comp rx=0 tx=0).stop 2024-04-26T21:37:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:12.238+0000 7f76c5800700 1 -- 172.21.15.84:0/2747674315 shutdown_connections 2024-04-26T21:37:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:12.238+0000 7f76c5800700 1 --2- 172.21.15.84:0/2747674315 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f76a406ec10 0x7f76a40710c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:12.238+0000 7f76c5800700 1 --2- 172.21.15.84:0/2747674315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76c0101d00 0x7f76c0112a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:12.238+0000 7f76c5800700 1 --2- 172.21.15.84:0/2747674315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c01026a0 0x7f76c0112fc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:12.238+0000 7f76c5800700 1 -- 172.21.15.84:0/2747674315 >> 172.21.15.84:0/2747674315 conn(0x7f76c00f78d0 msgr2=0x7f76c00f8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:12.239+0000 7f76c5800700 1 -- 172.21.15.84:0/2747674315 shutdown_connections 2024-04-26T21:37:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:12.239+0000 7f76c5800700 1 -- 172.21.15.84:0/2747674315 wait complete. 2024-04-26T21:37:12.951 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph orch upgrade status' 2024-04-26T21:37:13.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:13 smithi084 ceph-mon[90138]: pgmap v333: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:13.413 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:37:13.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:13 smithi120 ceph-mon[79001]: pgmap v333: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:14.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:14 smithi084 ceph-mon[90138]: from='client.34628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:37:14.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:37:14.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:14 smithi120 ceph-mon[79001]: from='client.34628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:37:14.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:37:15.306 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:15 smithi084 ceph-mon[90138]: pgmap v334: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:15.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:15 smithi120 ceph-mon[79001]: pgmap v334: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:15.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.584+0000 7fa5a1400700 1 -- 172.21.15.84:0/1250803932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa59c105930 msgr2=0x7fa59c0fefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:15.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.584+0000 7fa5a1400700 1 --2- 172.21.15.84:0/1250803932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa59c105930 0x7fa59c0fefa0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa588004940 tx=0x7fa588009e30 comp rx=0 tx=0).stop 2024-04-26T21:37:15.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.584+0000 7fa5a1400700 1 -- 172.21.15.84:0/1250803932 shutdown_connections 2024-04-26T21:37:15.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.584+0000 7fa5a1400700 1 --2- 172.21.15.84:0/1250803932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa59c105930 0x7fa59c0fefa0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:15.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.584+0000 7fa5a1400700 1 --2- 172.21.15.84:0/1250803932 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa59c104f90 0x7fa59c105360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:15.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.584+0000 7fa5a1400700 1 -- 172.21.15.84:0/1250803932 >> 172.21.15.84:0/1250803932 conn(0x7fa59c0fab40 msgr2=0x7fa59c0fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:15.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.584+0000 7fa5a1400700 1 -- 172.21.15.84:0/1250803932 shutdown_connections 2024-04-26T21:37:15.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.584+0000 7fa5a1400700 1 -- 172.21.15.84:0/1250803932 wait complete. 2024-04-26T21:37:15.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.585+0000 7fa5a1400700 1 Processor -- start 2024-04-26T21:37:15.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.585+0000 7fa5a1400700 1 -- start start 2024-04-26T21:37:15.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.586+0000 7fa5a1400700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa59c104f90 0x7fa59c115d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:15.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.586+0000 7fa5a1400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa59c105930 0x7fa59c116290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:15.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.586+0000 7fa5a1400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c1168e0 con 0x7fa59c105930 2024-04-26T21:37:15.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.586+0000 7fa5a1400700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c10fcb0 con 0x7fa59c104f90 2024-04-26T21:37:15.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.586+0000 7fa599e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa59c105930 0x7fa59c116290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:15.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.586+0000 7fa599e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa59c105930 0x7fa59c116290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48808/0 (socket says 172.21.15.84:48808) 2024-04-26T21:37:15.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.586+0000 7fa599e00700 1 -- 172.21.15.84:0/3286645970 learned_addr learned my addr 172.21.15.84:0/3286645970 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:37:15.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.586+0000 7fa59a800700 1 --2- 172.21.15.84:0/3286645970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa59c104f90 0x7fa59c115d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:15.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.586+0000 7fa599e00700 1 -- 172.21.15.84:0/3286645970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa59c104f90 msgr2=0x7fa59c115d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:15.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.586+0000 7fa599e00700 1 --2- 172.21.15.84:0/3286645970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa59c104f90 0x7fa59c115d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:15.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.586+0000 7fa599e00700 1 -- 172.21.15.84:0/3286645970 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa588005040 con 0x7fa59c105930 2024-04-26T21:37:15.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.587+0000 7fa599e00700 1 --2- 172.21.15.84:0/3286645970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa59c105930 0x7fa59c116290 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa588009100 tx=0x7fa588009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:15.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.587+0000 7fa592a00700 1 -- 172.21.15.84:0/3286645970 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa58800e040 con 0x7fa59c105930 2024-04-26T21:37:15.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.587+0000 7fa592a00700 1 -- 172.21.15.84:0/3286645970 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa588013420 con 0x7fa59c105930 2024-04-26T21:37:15.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.587+0000 7fa592a00700 1 -- 172.21.15.84:0/3286645970 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa58801c630 con 0x7fa59c105930 2024-04-26T21:37:15.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.587+0000 7fa5a1400700 1 -- 172.21.15.84:0/3286645970 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa59c10ff30 con 0x7fa59c105930 2024-04-26T21:37:15.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.587+0000 7fa5a1400700 1 -- 172.21.15.84:0/3286645970 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59c1104f0 con 0x7fa59c105930 2024-04-26T21:37:15.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.588+0000 7fa5a1400700 1 -- 172.21.15.84:0/3286645970 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa59c1006e0 con 0x7fa59c105930 2024-04-26T21:37:15.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.589+0000 7fa592a00700 1 -- 172.21.15.84:0/3286645970 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa588013590 con 0x7fa59c105930 2024-04-26T21:37:15.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.590+0000 7fa592a00700 1 --2- 172.21.15.84:0/3286645970 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa58006ec00 0x7fa5800710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:15.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.590+0000 7fa592a00700 1 -- 172.21.15.84:0/3286645970 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fa58808fbf0 con 0x7fa59c105930 2024-04-26T21:37:15.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.591+0000 7fa59a800700 1 --2- 172.21.15.84:0/3286645970 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa58006ec00 0x7fa5800710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:15.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.591+0000 7fa59a800700 1 --2- 172.21.15.84:0/3286645970 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa58006ec00 0x7fa5800710b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa58c004d60 tx=0x7fa58c00b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:15.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.595+0000 7fa592a00700 1 -- 172.21.15.84:0/3286645970 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fa58805c3d0 con 0x7fa59c105930 2024-04-26T21:37:15.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.846+0000 7fa5a1400700 1 -- 172.21.15.84:0/3286645970 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa59c10c070 con 0x7fa58006ec00 2024-04-26T21:37:15.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.849+0000 7fa592a00700 1 -- 172.21.15.84:0/3286645970 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fa59c10c070 con 0x7fa58006ec00 2024-04-26T21:37:15.850 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:37:15.850 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": null, 2024-04-26T21:37:15.850 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": false, 2024-04-26T21:37:15.850 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "", 2024-04-26T21:37:15.850 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [], 2024-04-26T21:37:15.850 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": null, 2024-04-26T21:37:15.850 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2024-04-26T21:37:15.850 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-04-26T21:37:15.850 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:37:15.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.851+0000 7fa5a1400700 1 -- 172.21.15.84:0/3286645970 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa58006ec00 msgr2=0x7fa5800710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:15.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.852+0000 7fa5a1400700 1 --2- 172.21.15.84:0/3286645970 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa58006ec00 0x7fa5800710b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa58c004d60 tx=0x7fa58c00b040 comp rx=0 tx=0).stop 2024-04-26T21:37:15.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.852+0000 7fa5a1400700 1 -- 172.21.15.84:0/3286645970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa59c105930 msgr2=0x7fa59c116290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:15.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.852+0000 7fa5a1400700 1 --2- 172.21.15.84:0/3286645970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa59c105930 0x7fa59c116290 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa588009100 tx=0x7fa588009e30 comp rx=0 tx=0).stop 2024-04-26T21:37:15.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.852+0000 7fa5a1400700 1 -- 172.21.15.84:0/3286645970 shutdown_connections 2024-04-26T21:37:15.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.852+0000 7fa5a1400700 1 --2- 172.21.15.84:0/3286645970 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa58006ec00 0x7fa5800710b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:15.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.852+0000 7fa5a1400700 1 --2- 172.21.15.84:0/3286645970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa59c104f90 0x7fa59c115d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:15.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.852+0000 7fa5a1400700 1 --2- 172.21.15.84:0/3286645970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa59c105930 0x7fa59c116290 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:15.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.852+0000 7fa5a1400700 1 -- 172.21.15.84:0/3286645970 >> 172.21.15.84:0/3286645970 conn(0x7fa59c0fab40 msgr2=0x7fa59c0fbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:15.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.852+0000 7fa5a1400700 1 -- 172.21.15.84:0/3286645970 shutdown_connections 2024-04-26T21:37:15.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:15.852+0000 7fa5a1400700 1 -- 172.21.15.84:0/3286645970 wait complete. 2024-04-26T21:37:16.673 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph health detail' 2024-04-26T21:37:17.144 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:37:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:17 smithi084 ceph-mon[90138]: from='client.34632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:37:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:17 smithi084 ceph-mon[90138]: pgmap v335: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:17.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:17 smithi120 ceph-mon[79001]: from='client.34632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:37:17.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:17 smithi120 ceph-mon[79001]: pgmap v335: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:19.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:19 smithi084 ceph-mon[90138]: pgmap v336: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:19.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:19 smithi120 ceph-mon[79001]: pgmap v336: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:19.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.606+0000 7f44a4e00700 1 -- 172.21.15.84:0/729741557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0105000 msgr2=0x7f44a01053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:19.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.606+0000 7f44a4e00700 1 --2- 172.21.15.84:0/729741557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0105000 0x7f44a01053d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4490004940 tx=0x7f4490009e30 comp rx=0 tx=0).stop 2024-04-26T21:37:19.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.606+0000 7f44a4e00700 1 -- 172.21.15.84:0/729741557 shutdown_connections 2024-04-26T21:37:19.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.606+0000 7f44a4e00700 1 --2- 172.21.15.84:0/729741557 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44a01059a0 0x7f44a00ff010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:19.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.606+0000 7f44a4e00700 1 --2- 172.21.15.84:0/729741557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0105000 0x7f44a01053d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:19.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.606+0000 7f44a4e00700 1 -- 172.21.15.84:0/729741557 >> 172.21.15.84:0/729741557 conn(0x7f44a00fab70 msgr2=0x7f44a00fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:19.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.606+0000 7f44a4e00700 1 -- 172.21.15.84:0/729741557 shutdown_connections 2024-04-26T21:37:19.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.606+0000 7f44a4e00700 1 -- 172.21.15.84:0/729741557 wait complete. 2024-04-26T21:37:19.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.607+0000 7f44a4e00700 1 Processor -- start 2024-04-26T21:37:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.607+0000 7f44a4e00700 1 -- start start 2024-04-26T21:37:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.608+0000 7f44a4e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0105000 0x7f44a0115b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.608+0000 7f44a4e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44a01059a0 0x7f44a01160b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.608+0000 7f44a4e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a0116700 con 0x7f44a0105000 2024-04-26T21:37:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.608+0000 7f44a4e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a010fce0 con 0x7f44a01059a0 2024-04-26T21:37:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.608+0000 7f449de00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0105000 0x7f44a0115b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.608+0000 7f449de00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0105000 0x7f44a0115b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48832/0 (socket says 172.21.15.84:48832) 2024-04-26T21:37:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.608+0000 7f449de00700 1 -- 172.21.15.84:0/3832999671 learned_addr learned my addr 172.21.15.84:0/3832999671 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:37:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.609+0000 7f449d400700 1 --2- 172.21.15.84:0/3832999671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44a01059a0 0x7f44a01160b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.609+0000 7f449de00700 1 -- 172.21.15.84:0/3832999671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44a01059a0 msgr2=0x7f44a01160b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.609+0000 7f449de00700 1 --2- 172.21.15.84:0/3832999671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44a01059a0 0x7f44a01160b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.609+0000 7f449de00700 1 -- 172.21.15.84:0/3832999671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4490005040 con 0x7f44a0105000 2024-04-26T21:37:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.609+0000 7f449de00700 1 --2- 172.21.15.84:0/3832999671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0105000 0x7f44a0115b70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f449000b8b0 tx=0x7f4490009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.609+0000 7f4496000700 1 -- 172.21.15.84:0/3832999671 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f449000e040 con 0x7f44a0105000 2024-04-26T21:37:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.609+0000 7f4496000700 1 -- 172.21.15.84:0/3832999671 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4490004290 con 0x7f44a0105000 2024-04-26T21:37:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.609+0000 7f44a4e00700 1 -- 172.21.15.84:0/3832999671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a010ff60 con 0x7f44a0105000 2024-04-26T21:37:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.609+0000 7f4496000700 1 -- 172.21.15.84:0/3832999671 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f449001c3f0 con 0x7f44a0105000 2024-04-26T21:37:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.609+0000 7f44a4e00700 1 -- 172.21.15.84:0/3832999671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a0110520 con 0x7f44a0105000 2024-04-26T21:37:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.611+0000 7f44a4e00700 1 -- 172.21.15.84:0/3832999671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a0100750 con 0x7f44a0105000 2024-04-26T21:37:19.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.612+0000 7f4496000700 1 -- 172.21.15.84:0/3832999671 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f44900137b0 con 0x7f44a0105000 2024-04-26T21:37:19.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.613+0000 7f4496000700 1 --2- 172.21.15.84:0/3832999671 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f448406ec00 0x7f44840710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:19.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.613+0000 7f4496000700 1 -- 172.21.15.84:0/3832999671 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f449008fcf0 con 0x7f44a0105000 2024-04-26T21:37:19.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.613+0000 7f449d400700 1 --2- 172.21.15.84:0/3832999671 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f448406ec00 0x7f44840710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:19.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.614+0000 7f449d400700 1 --2- 172.21.15.84:0/3832999671 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f448406ec00 0x7f44840710b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f44a0111410 tx=0x7f448c009040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:19.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.618+0000 7f4496000700 1 -- 172.21.15.84:0/3832999671 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f449005c4d0 con 0x7f44a0105000 2024-04-26T21:37:19.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.934+0000 7f44a4e00700 1 -- 172.21.15.84:0/3832999671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f44a01111c0 con 0x7f44a0105000 2024-04-26T21:37:19.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.935+0000 7f4496000700 1 -- 172.21.15.84:0/3832999671 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f449005c060 con 0x7f44a0105000 2024-04-26T21:37:19.935 INFO:teuthology.orchestra.run.smithi084.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:37:19.935 INFO:teuthology.orchestra.run.smithi084.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:37:19.936 INFO:teuthology.orchestra.run.smithi084.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:37:19.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.938+0000 7f44a4e00700 1 -- 172.21.15.84:0/3832999671 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f448406ec00 msgr2=0x7f44840710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:19.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.938+0000 7f44a4e00700 1 --2- 172.21.15.84:0/3832999671 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f448406ec00 0x7f44840710b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f44a0111410 tx=0x7f448c009040 comp rx=0 tx=0).stop 2024-04-26T21:37:19.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.938+0000 7f44a4e00700 1 -- 172.21.15.84:0/3832999671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0105000 msgr2=0x7f44a0115b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:19.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.938+0000 7f44a4e00700 1 --2- 172.21.15.84:0/3832999671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0105000 0x7f44a0115b70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f449000b8b0 tx=0x7f4490009e30 comp rx=0 tx=0).stop 2024-04-26T21:37:19.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.938+0000 7f44a4e00700 1 -- 172.21.15.84:0/3832999671 shutdown_connections 2024-04-26T21:37:19.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.938+0000 7f44a4e00700 1 --2- 172.21.15.84:0/3832999671 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f448406ec00 0x7f44840710b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:19.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.938+0000 7f44a4e00700 1 --2- 172.21.15.84:0/3832999671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0105000 0x7f44a0115b70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:19.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.938+0000 7f44a4e00700 1 --2- 172.21.15.84:0/3832999671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44a01059a0 0x7f44a01160b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:19.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.938+0000 7f44a4e00700 1 -- 172.21.15.84:0/3832999671 >> 172.21.15.84:0/3832999671 conn(0x7f44a00fab70 msgr2=0x7f44a00fbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:19.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.938+0000 7f44a4e00700 1 -- 172.21.15.84:0/3832999671 shutdown_connections 2024-04-26T21:37:19.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:19.938+0000 7f44a4e00700 1 -- 172.21.15.84:0/3832999671 wait complete. 2024-04-26T21:37:20.308 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:20 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3832999671' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:37:20.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:20 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3832999671' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:37:20.698 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph versions' 2024-04-26T21:37:21.180 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:37:21.334 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:21 smithi084 ceph-mon[90138]: pgmap v337: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:21.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:21 smithi120 ceph-mon[79001]: pgmap v337: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:23.106 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:23 smithi084 ceph-mon[90138]: pgmap v338: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:23.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.374+0000 7f49e4e00700 1 -- 172.21.15.84:0/402128017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e00fbbf0 msgr2=0x7f49e00fbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:23.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.374+0000 7f49e4e00700 1 --2- 172.21.15.84:0/402128017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e00fbbf0 0x7f49e00fbfc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f49d0004940 tx=0x7f49d0009e30 comp rx=0 tx=0).stop 2024-04-26T21:37:23.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.374+0000 7f49e4e00700 1 -- 172.21.15.84:0/402128017 shutdown_connections 2024-04-26T21:37:23.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.374+0000 7f49e4e00700 1 --2- 172.21.15.84:0/402128017 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49e00fc590 0x7f49e0100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.374+0000 7f49e4e00700 1 --2- 172.21.15.84:0/402128017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e00fbbf0 0x7f49e00fbfc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.374+0000 7f49e4e00700 1 -- 172.21.15.84:0/402128017 >> 172.21.15.84:0/402128017 conn(0x7f49e00f7870 msgr2=0x7f49e00f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:23.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.374+0000 7f49e4e00700 1 -- 172.21.15.84:0/402128017 shutdown_connections 2024-04-26T21:37:23.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.374+0000 7f49e4e00700 1 -- 172.21.15.84:0/402128017 wait complete. 2024-04-26T21:37:23.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.375+0000 7f49e4e00700 1 Processor -- start 2024-04-26T21:37:23.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.375+0000 7f49e4e00700 1 -- start start 2024-04-26T21:37:23.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.375+0000 7f49e4e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49e00fbbf0 0x7f49e011a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:23.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.376+0000 7f49e4e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e00fc590 0x7f49e011a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:23.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.376+0000 7f49e4e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e011ac40 con 0x7f49e00fc590 2024-04-26T21:37:23.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.376+0000 7f49e4e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e0114190 con 0x7f49e00fbbf0 2024-04-26T21:37:23.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.376+0000 7f49dd400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e00fc590 0x7f49e011a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:23.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.376+0000 7f49dd400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e00fc590 0x7f49e011a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33672/0 (socket says 172.21.15.84:33672) 2024-04-26T21:37:23.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.376+0000 7f49dd400700 1 -- 172.21.15.84:0/2672291068 learned_addr learned my addr 172.21.15.84:0/2672291068 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:37:23.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.376+0000 7f49dde00700 1 --2- 172.21.15.84:0/2672291068 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49e00fbbf0 0x7f49e011a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:23.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.376+0000 7f49dd400700 1 -- 172.21.15.84:0/2672291068 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49e00fbbf0 msgr2=0x7f49e011a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:23.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.376+0000 7f49dd400700 1 --2- 172.21.15.84:0/2672291068 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49e00fbbf0 0x7f49e011a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.376+0000 7f49dd400700 1 -- 172.21.15.84:0/2672291068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d0005040 con 0x7f49e00fc590 2024-04-26T21:37:23.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.377+0000 7f49dd400700 1 --2- 172.21.15.84:0/2672291068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e00fc590 0x7f49e011a560 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00b790 tx=0x7f49cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:23.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.377+0000 7f49d6000700 1 -- 172.21.15.84:0/2672291068 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49cc00f770 con 0x7f49e00fc590 2024-04-26T21:37:23.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.377+0000 7f49d6000700 1 -- 172.21.15.84:0/2672291068 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f49cc00fda0 con 0x7f49e00fc590 2024-04-26T21:37:23.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.377+0000 7f49e4e00700 1 -- 172.21.15.84:0/2672291068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e0114410 con 0x7f49e00fc590 2024-04-26T21:37:23.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.377+0000 7f49d6000700 1 -- 172.21.15.84:0/2672291068 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49cc00d310 con 0x7f49e00fc590 2024-04-26T21:37:23.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.377+0000 7f49e4e00700 1 -- 172.21.15.84:0/2672291068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e0114950 con 0x7f49e00fc590 2024-04-26T21:37:23.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.378+0000 7f49e4e00700 1 -- 172.21.15.84:0/2672291068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e0066b30 con 0x7f49e00fc590 2024-04-26T21:37:23.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.379+0000 7f49d6000700 1 -- 172.21.15.84:0/2672291068 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f49cc010420 con 0x7f49e00fc590 2024-04-26T21:37:23.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.380+0000 7f49d6000700 1 --2- 172.21.15.84:0/2672291068 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f49c406ec00 0x7f49c40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:23.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.380+0000 7f49d6000700 1 -- 172.21.15.84:0/2672291068 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f49cc08e9f0 con 0x7f49e00fc590 2024-04-26T21:37:23.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.381+0000 7f49dde00700 1 --2- 172.21.15.84:0/2672291068 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f49c406ec00 0x7f49c40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:23.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.381+0000 7f49dde00700 1 --2- 172.21.15.84:0/2672291068 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f49c406ec00 0x7f49c40710b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f49d000b020 tx=0x7f49d0009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:23.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.386+0000 7f49d6000700 1 -- 172.21.15.84:0/2672291068 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f49cc05b1d0 con 0x7f49e00fc590 2024-04-26T21:37:23.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:23 smithi120 ceph-mon[79001]: pgmap v338: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:23.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.705+0000 7f49e4e00700 1 -- 172.21.15.84:0/2672291068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f49e0110580 con 0x7f49e00fc590 2024-04-26T21:37:23.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.707+0000 7f49d6000700 1 -- 172.21.15.84:0/2672291068 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f49cc05ad60 con 0x7f49e00fc590 2024-04-26T21:37:23.707 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:37:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:37:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:37:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:37:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:37:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:37:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:37:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:37:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 6 2024-04-26T21:37:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:37:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:37:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 4 2024-04-26T21:37:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:37:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:37:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 14 2024-04-26T21:37:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:37:23.708 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:37:23.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.709+0000 7f49e4e00700 1 -- 172.21.15.84:0/2672291068 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f49c406ec00 msgr2=0x7f49c40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:23.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.709+0000 7f49e4e00700 1 --2- 172.21.15.84:0/2672291068 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f49c406ec00 0x7f49c40710b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f49d000b020 tx=0x7f49d0009e30 comp rx=0 tx=0).stop 2024-04-26T21:37:23.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.709+0000 7f49e4e00700 1 -- 172.21.15.84:0/2672291068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e00fc590 msgr2=0x7f49e011a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:23.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.709+0000 7f49e4e00700 1 --2- 172.21.15.84:0/2672291068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e00fc590 0x7f49e011a560 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00b790 tx=0x7f49cc009250 comp rx=0 tx=0).stop 2024-04-26T21:37:23.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.710+0000 7f49e4e00700 1 -- 172.21.15.84:0/2672291068 shutdown_connections 2024-04-26T21:37:23.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.710+0000 7f49e4e00700 1 --2- 172.21.15.84:0/2672291068 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f49c406ec00 0x7f49c40710b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.710+0000 7f49e4e00700 1 --2- 172.21.15.84:0/2672291068 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49e00fbbf0 0x7f49e011a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.710+0000 7f49e4e00700 1 --2- 172.21.15.84:0/2672291068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e00fc590 0x7f49e011a560 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.710+0000 7f49e4e00700 1 -- 172.21.15.84:0/2672291068 >> 172.21.15.84:0/2672291068 conn(0x7f49e00f7870 msgr2=0x7f49e00f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:23.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.710+0000 7f49e4e00700 1 -- 172.21.15.84:0/2672291068 shutdown_connections 2024-04-26T21:37:23.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:37:23.710+0000 7f49e4e00700 1 -- 172.21.15.84:0/2672291068 wait complete. 2024-04-26T21:37:24.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:24 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2672291068' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:37:24.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:24 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2672291068' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:37:24.509 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-04-26T21:37:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:37:25.353 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:25 smithi084 ceph-mon[90138]: pgmap v339: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:25.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:25 smithi120 ceph-mon[79001]: pgmap v339: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:27.007 INFO:teuthology.orchestra.run.smithi084.stdout:wait for servicemap items w/ changing names to refresh 2024-04-26T21:37:27.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:27 smithi084 ceph-mon[90138]: pgmap v340: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:27.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:27 smithi120 ceph-mon[79001]: pgmap v340: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:27.780 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'sleep 60' 2024-04-26T21:37:28.258 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:37:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:29 smithi084 ceph-mon[90138]: pgmap v341: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:29 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:37:29.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:29 smithi120 ceph-mon[79001]: pgmap v341: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:29.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:29 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:37:31.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:31 smithi084 ceph-mon[90138]: pgmap v342: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:31 smithi120 ceph-mon[79001]: pgmap v342: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:33.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:33 smithi084 ceph-mon[90138]: pgmap v343: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:33.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:33 smithi120 ceph-mon[79001]: pgmap v343: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:35.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:35 smithi084 ceph-mon[90138]: pgmap v344: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:35.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:35 smithi120 ceph-mon[79001]: pgmap v344: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:37.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:37 smithi084 ceph-mon[90138]: pgmap v345: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:37.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:37 smithi120 ceph-mon[79001]: pgmap v345: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:38.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:38 smithi084 ceph-mon[90138]: pgmap v346: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:38.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:38 smithi120 ceph-mon[79001]: pgmap v346: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:41.366 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:40 smithi084 ceph-mon[90138]: pgmap v347: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:41.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:40 smithi120 ceph-mon[79001]: pgmap v347: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:43.055 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:42 smithi084 ceph-mon[90138]: pgmap v348: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:43.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:42 smithi120 ceph-mon[79001]: pgmap v348: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:44 smithi084 ceph-mon[90138]: pgmap v349: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:37:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:44 smithi120 ceph-mon[79001]: pgmap v349: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:37:47.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:46 smithi084 ceph-mon[90138]: pgmap v350: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:47.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:46 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:37:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:46 smithi120 ceph-mon[79001]: pgmap v350: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:46 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:37:48.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:47 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:37:48.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:47 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:37:48.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:47 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:37:48.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:47 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:37:48.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:47 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:37:48.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:47 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:37:49.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:48 smithi084 ceph-mon[90138]: pgmap v351: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:49.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:49 smithi120 ceph-mon[79001]: pgmap v351: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:51.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:51 smithi084 ceph-mon[90138]: pgmap v352: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:51 smithi120 ceph-mon[79001]: pgmap v352: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:53.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:53 smithi084 ceph-mon[90138]: pgmap v353: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:53 smithi120 ceph-mon[79001]: pgmap v353: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:55.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:55 smithi084 ceph-mon[90138]: pgmap v354: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:55 smithi120 ceph-mon[79001]: pgmap v354: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:57.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:57 smithi084 ceph-mon[90138]: pgmap v355: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:57 smithi120 ceph-mon[79001]: pgmap v355: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:59.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:37:59 smithi084 ceph-mon[90138]: pgmap v356: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:37:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:37:59 smithi120 ceph-mon[79001]: pgmap v356: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:00.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:00 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:38:00.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:00 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:38:01.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:01 smithi084 ceph-mon[90138]: pgmap v357: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:01.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:01 smithi120 ceph-mon[79001]: pgmap v357: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:03.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:03 smithi084 ceph-mon[90138]: pgmap v358: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:03.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:03 smithi120 ceph-mon[79001]: pgmap v358: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:05.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:05 smithi084 ceph-mon[90138]: pgmap v359: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:05 smithi120 ceph-mon[79001]: pgmap v359: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:07.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:07 smithi084 ceph-mon[90138]: pgmap v360: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:07.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:07 smithi120 ceph-mon[79001]: pgmap v360: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:09.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:09 smithi084 ceph-mon[90138]: pgmap v361: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:09.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:09 smithi120 ceph-mon[79001]: pgmap v361: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:11.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:11 smithi084 ceph-mon[90138]: pgmap v362: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:11.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:11 smithi120 ceph-mon[79001]: pgmap v362: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:13.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:13 smithi084 ceph-mon[90138]: pgmap v363: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:13.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:13 smithi120 ceph-mon[79001]: pgmap v363: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:14.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:38:14.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:38:15.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:15 smithi084 ceph-mon[90138]: pgmap v364: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:15.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:15 smithi120 ceph-mon[79001]: pgmap v364: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:17 smithi084 ceph-mon[90138]: pgmap v365: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:17.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:17 smithi120 ceph-mon[79001]: pgmap v365: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:19.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:19 smithi084 ceph-mon[90138]: pgmap v366: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:19.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:19 smithi120 ceph-mon[79001]: pgmap v366: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:21.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:21 smithi084 ceph-mon[90138]: pgmap v367: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:21.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:21 smithi120 ceph-mon[79001]: pgmap v367: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:23.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:23 smithi084 ceph-mon[90138]: pgmap v368: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:23.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:23 smithi120 ceph-mon[79001]: pgmap v368: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:25.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:25 smithi084 ceph-mon[90138]: pgmap v369: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:25.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:25 smithi120 ceph-mon[79001]: pgmap v369: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:27.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:27 smithi084 ceph-mon[90138]: pgmap v370: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:27.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:27 smithi120 ceph-mon[79001]: pgmap v370: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:29 smithi084 ceph-mon[90138]: pgmap v371: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:29 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:38:29.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:29 smithi120 ceph-mon[79001]: pgmap v371: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:29.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:29 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:38:31.169 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:31 smithi084 ceph-mon[90138]: pgmap v372: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:31.218 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph orch ps' 2024-04-26T21:38:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:31 smithi120 ceph-mon[79001]: pgmap v372: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:31.695 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:38:33.285 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:33 smithi084 ceph-mon[90138]: pgmap v373: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:33.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:33 smithi120 ceph-mon[79001]: pgmap v373: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:33.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.767+0000 7f6b38200700 1 -- 172.21.15.84:0/1098627116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b30109410 msgr2=0x7f6b301097e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:33.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.767+0000 7f6b38200700 1 --2- 172.21.15.84:0/1098627116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b30109410 0x7f6b301097e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6b24004940 tx=0x7f6b24009e30 comp rx=0 tx=0).stop 2024-04-26T21:38:33.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.767+0000 7f6b38200700 1 -- 172.21.15.84:0/1098627116 shutdown_connections 2024-04-26T21:38:33.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.767+0000 7f6b38200700 1 --2- 172.21.15.84:0/1098627116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b30109db0 0x7f6b30103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:33.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.767+0000 7f6b38200700 1 --2- 172.21.15.84:0/1098627116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b30109410 0x7f6b301097e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:33.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.767+0000 7f6b38200700 1 -- 172.21.15.84:0/1098627116 >> 172.21.15.84:0/1098627116 conn(0x7f6b30072c00 msgr2=0x7f6b30075010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:33.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.767+0000 7f6b38200700 1 -- 172.21.15.84:0/1098627116 shutdown_connections 2024-04-26T21:38:33.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.768+0000 7f6b38200700 1 -- 172.21.15.84:0/1098627116 wait complete. 2024-04-26T21:38:33.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.768+0000 7f6b38200700 1 Processor -- start 2024-04-26T21:38:33.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.768+0000 7f6b38200700 1 -- start start 2024-04-26T21:38:33.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.769+0000 7f6b38200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b30109410 0x7f6b30119f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:33.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.769+0000 7f6b38200700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b30109db0 0x7f6b3011a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:33.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.769+0000 7f6b38200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3011ab00 con 0x7f6b30109410 2024-04-26T21:38:33.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.769+0000 7f6b38200700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b301140e0 con 0x7f6b30109db0 2024-04-26T21:38:33.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.769+0000 7f6b35800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b30109410 0x7f6b30119f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:33.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.769+0000 7f6b35800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b30109410 0x7f6b30119f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57976/0 (socket says 172.21.15.84:57976) 2024-04-26T21:38:33.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.769+0000 7f6b35800700 1 -- 172.21.15.84:0/1338527231 learned_addr learned my addr 172.21.15.84:0/1338527231 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:33.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.769+0000 7f6b34e00700 1 --2- 172.21.15.84:0/1338527231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b30109db0 0x7f6b3011a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:33.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.769+0000 7f6b35800700 1 -- 172.21.15.84:0/1338527231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b30109db0 msgr2=0x7f6b3011a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:33.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.769+0000 7f6b35800700 1 --2- 172.21.15.84:0/1338527231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b30109db0 0x7f6b3011a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:33.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.770+0000 7f6b35800700 1 -- 172.21.15.84:0/1338527231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b24005040 con 0x7f6b30109410 2024-04-26T21:38:33.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.770+0000 7f6b34e00700 1 --2- 172.21.15.84:0/1338527231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b30109db0 0x7f6b3011a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:38:33.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.770+0000 7f6b35800700 1 --2- 172.21.15.84:0/1338527231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b30109410 0x7f6b30119f70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009150 tx=0x7f6b24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:33.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.770+0000 7f6b2d600700 1 -- 172.21.15.84:0/1338527231 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b2400e040 con 0x7f6b30109410 2024-04-26T21:38:33.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.770+0000 7f6b2d600700 1 -- 172.21.15.84:0/1338527231 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b24013420 con 0x7f6b30109410 2024-04-26T21:38:33.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.770+0000 7f6b2d600700 1 -- 172.21.15.84:0/1338527231 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b2401c630 con 0x7f6b30109410 2024-04-26T21:38:33.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.770+0000 7f6b38200700 1 -- 172.21.15.84:0/1338527231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b30114360 con 0x7f6b30109410 2024-04-26T21:38:33.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.770+0000 7f6b38200700 1 -- 172.21.15.84:0/1338527231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b301148d0 con 0x7f6b30109410 2024-04-26T21:38:33.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.771+0000 7f6b38200700 1 -- 172.21.15.84:0/1338527231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b30104b60 con 0x7f6b30109410 2024-04-26T21:38:33.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.772+0000 7f6b2d600700 1 -- 172.21.15.84:0/1338527231 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6b24013590 con 0x7f6b30109410 2024-04-26T21:38:33.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.773+0000 7f6b2d600700 1 --2- 172.21.15.84:0/1338527231 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6b1806ec00 0x7f6b180710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:33.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.773+0000 7f6b2d600700 1 -- 172.21.15.84:0/1338527231 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f6b2408fd30 con 0x7f6b30109410 2024-04-26T21:38:33.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.774+0000 7f6b34e00700 1 --2- 172.21.15.84:0/1338527231 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6b1806ec00 0x7f6b180710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:33.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.774+0000 7f6b34e00700 1 --2- 172.21.15.84:0/1338527231 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6b1806ec00 0x7f6b180710b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c007fd0 tx=0x7f6b1c009040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:33.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:33.778+0000 7f6b2d600700 1 -- 172.21.15.84:0/1338527231 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f6b2405c490 con 0x7f6b30109410 2024-04-26T21:38:34.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:34.016+0000 7f6b38200700 1 -- 172.21.15.84:0/1338527231 --> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b301155c0 con 0x7f6b1806ec00 2024-04-26T21:38:34.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:34.040+0000 7f6b2d600700 1 -- 172.21.15.84:0/1338527231 <== mgr.24535 v2:172.21.15.84:6800/4242898215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f6b301155c0 con 0x7f6b1806ec00 2024-04-26T21:38:34.042 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:38:34.042 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (2m) 116s ago 24m 14.5M - 0.25.0 c8568f914cd2 61e7fdb22568 2024-04-26T21:38:34.042 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (9m) 116s ago 24m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 b4010dfbe623 2024-04-26T21:38:34.042 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi120 smithi120 running (9m) 3m ago 23m 6665k - 19.0.0-3306-gbc612ffb 55dc54019ad8 89a4e50ea23c 2024-04-26T21:38:34.042 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (2m) 116s ago 23m 50.3M - 9.4.12 2bacad6d85d8 3a38ee34dc00 2024-04-26T21:38:34.042 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.hbjunw smithi084 running (5m) 116s ago 17m 58.3M - 19.0.0-3306-gbc612ffb 55dc54019ad8 26d10fe664bb 2024-04-26T21:38:34.042 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.rtrqtr smithi084 running (4m) 116s ago 17m 16.3M - 19.0.0-3306-gbc612ffb 55dc54019ad8 c801ec16a810 2024-04-26T21:38:34.042 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.qnkxcn smithi120 running (4m) 3m ago 17m 11.2M - 19.0.0-3306-gbc612ffb 55dc54019ad8 137a38b571df 2024-04-26T21:38:34.042 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi120.ufqfoh smithi120 running (3m) 3m ago 17m 11.1M - 19.0.0-3306-gbc612ffb 55dc54019ad8 0f6be9e294cb 2024-04-26T21:38:34.043 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.gyasul smithi084 *:8443,9283,8765 running (12m) 116s ago 25m 522M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a1a5fdd856b8 2024-04-26T21:38:34.043 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi120.zjaduj smithi120 *:8443,9283,8765 running (11m) 3m ago 22m 455M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d6ae0b4628b5 2024-04-26T21:38:34.043 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (11m) 116s ago 26m 58.0M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 bf610abb6a62 2024-04-26T21:38:34.043 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi120 smithi120 running (10m) 3m ago 22m 43.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 5d530496253b 2024-04-26T21:38:34.043 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (3m) 116s ago 24m 7646k - 1.5.0 0da6a335fe13 bda8f4e31302 2024-04-26T21:38:34.043 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi120 smithi120 *:9100 running (3m) 3m ago 22m 2985k - 1.5.0 0da6a335fe13 c28df53d1aa9 2024-04-26T21:38:34.043 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (8m) 116s ago 21m 115M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 99fbe2faa51b 2024-04-26T21:38:34.043 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (8m) 116s ago 21m 100M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 2dc81d93f7e5 2024-04-26T21:38:34.043 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (7m) 116s ago 20m 91.6M 1557M 19.0.0-3306-gbc612ffb 55dc54019ad8 9e77abf095bd 2024-04-26T21:38:34.043 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi120 running (7m) 3m ago 20m 96.6M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 d7e5825e2640 2024-04-26T21:38:34.043 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi120 running (6m) 3m ago 19m 88.1M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 894dcbaab8eb 2024-04-26T21:38:34.043 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi120 running (6m) 3m ago 18m 85.9M 2581M 19.0.0-3306-gbc612ffb 55dc54019ad8 e39948e51a13 2024-04-26T21:38:34.043 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (2m) 116s ago 23m 50.0M - 2.43.0 a07b618ecd1d 8e385c5bfadf 2024-04-26T21:38:34.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:34.043+0000 7f6b38200700 1 -- 172.21.15.84:0/1338527231 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6b1806ec00 msgr2=0x7f6b180710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:34.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:34.043+0000 7f6b38200700 1 --2- 172.21.15.84:0/1338527231 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6b1806ec00 0x7f6b180710b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c007fd0 tx=0x7f6b1c009040 comp rx=0 tx=0).stop 2024-04-26T21:38:34.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:34.043+0000 7f6b38200700 1 -- 172.21.15.84:0/1338527231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b30109410 msgr2=0x7f6b30119f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:34.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:34.043+0000 7f6b38200700 1 --2- 172.21.15.84:0/1338527231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b30109410 0x7f6b30119f70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009150 tx=0x7f6b24009e30 comp rx=0 tx=0).stop 2024-04-26T21:38:34.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:34.043+0000 7f6b38200700 1 -- 172.21.15.84:0/1338527231 shutdown_connections 2024-04-26T21:38:34.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:34.043+0000 7f6b38200700 1 --2- 172.21.15.84:0/1338527231 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6b1806ec00 0x7f6b180710b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:34.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:34.043+0000 7f6b38200700 1 --2- 172.21.15.84:0/1338527231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b30109410 0x7f6b30119f70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:34.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:34.043+0000 7f6b38200700 1 --2- 172.21.15.84:0/1338527231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b30109db0 0x7f6b3011a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:34.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:34.043+0000 7f6b38200700 1 -- 172.21.15.84:0/1338527231 >> 172.21.15.84:0/1338527231 conn(0x7f6b30072c00 msgr2=0x7f6b30074b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:34.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:34.043+0000 7f6b38200700 1 -- 172.21.15.84:0/1338527231 shutdown_connections 2024-04-26T21:38:34.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:34.043+0000 7f6b38200700 1 -- 172.21.15.84:0/1338527231 wait complete. 2024-04-26T21:38:34.825 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph versions' 2024-04-26T21:38:35.308 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:38:35.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:35 smithi120 ceph-mon[79001]: pgmap v374: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:35.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:35 smithi120 ceph-mon[79001]: from='client.34644 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:38:35.454 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:35 smithi084 ceph-mon[90138]: pgmap v374: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:35.455 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:35 smithi084 ceph-mon[90138]: from='client.34644 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:38:36.484 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:36 smithi084 ceph-mon[90138]: pgmap v375: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:36.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:36 smithi120 ceph-mon[79001]: pgmap v375: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.322+0000 7f8ab3600700 1 -- 172.21.15.84:0/928850759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8aac071f30 msgr2=0x7f8aac070300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.322+0000 7f8ab3600700 1 --2- 172.21.15.84:0/928850759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8aac071f30 0x7f8aac070300 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8a94004970 tx=0x7f8a94009e30 comp rx=0 tx=0).stop 2024-04-26T21:38:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.322+0000 7f8ab3600700 1 -- 172.21.15.84:0/928850759 shutdown_connections 2024-04-26T21:38:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.322+0000 7f8ab3600700 1 --2- 172.21.15.84:0/928850759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8aac070840 0x7f8aac070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.322+0000 7f8ab3600700 1 --2- 172.21.15.84:0/928850759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8aac071f30 0x7f8aac070300 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.322+0000 7f8ab3600700 1 -- 172.21.15.84:0/928850759 >> 172.21.15.84:0/928850759 conn(0x7f8aac0f8990 msgr2=0x7f8aac0fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.322+0000 7f8ab3600700 1 -- 172.21.15.84:0/928850759 shutdown_connections 2024-04-26T21:38:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.322+0000 7f8ab3600700 1 -- 172.21.15.84:0/928850759 wait complete. 2024-04-26T21:38:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.323+0000 7f8ab3600700 1 Processor -- start 2024-04-26T21:38:37.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.323+0000 7f8ab3600700 1 -- start start 2024-04-26T21:38:37.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.324+0000 7f8ab3600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8aac070840 0x7f8aac119f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:37.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.324+0000 7f8ab3600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8aac071f30 0x7f8aac11a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:37.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.324+0000 7f8ab3600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac11aaf0 con 0x7f8aac070840 2024-04-26T21:38:37.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.324+0000 7f8ab3600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac1140d0 con 0x7f8aac071f30 2024-04-26T21:38:37.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.324+0000 7f8ab0c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8aac070840 0x7f8aac119f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:37.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.324+0000 7f8ab0c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8aac070840 0x7f8aac119f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58004/0 (socket says 172.21.15.84:58004) 2024-04-26T21:38:37.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.324+0000 7f8ab0c00700 1 -- 172.21.15.84:0/2630341617 learned_addr learned my addr 172.21.15.84:0/2630341617 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:37.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.325+0000 7f8aa3e00700 1 --2- 172.21.15.84:0/2630341617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8aac071f30 0x7f8aac11a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:37.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.325+0000 7f8ab0c00700 1 -- 172.21.15.84:0/2630341617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8aac071f30 msgr2=0x7f8aac11a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:37.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.325+0000 7f8ab0c00700 1 --2- 172.21.15.84:0/2630341617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8aac071f30 0x7f8aac11a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:37.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.325+0000 7f8ab0c00700 1 -- 172.21.15.84:0/2630341617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a94005040 con 0x7f8aac070840 2024-04-26T21:38:37.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.325+0000 7f8ab0c00700 1 --2- 172.21.15.84:0/2630341617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8aac070840 0x7f8aac119f60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8a94004f50 tx=0x7f8a94009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:37.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.325+0000 7f8aa9600700 1 -- 172.21.15.84:0/2630341617 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a9400e040 con 0x7f8aac070840 2024-04-26T21:38:37.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.325+0000 7f8aa9600700 1 -- 172.21.15.84:0/2630341617 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a9400bc10 con 0x7f8aac070840 2024-04-26T21:38:37.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.326+0000 7f8ab3600700 1 -- 172.21.15.84:0/2630341617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aac114350 con 0x7f8aac070840 2024-04-26T21:38:37.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.326+0000 7f8aa9600700 1 -- 172.21.15.84:0/2630341617 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a9401c630 con 0x7f8aac070840 2024-04-26T21:38:37.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.326+0000 7f8ab3600700 1 -- 172.21.15.84:0/2630341617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aac114890 con 0x7f8aac070840 2024-04-26T21:38:37.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.327+0000 7f8ab3600700 1 -- 172.21.15.84:0/2630341617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aac071a40 con 0x7f8aac070840 2024-04-26T21:38:37.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.328+0000 7f8aa9600700 1 -- 172.21.15.84:0/2630341617 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f8a94013420 con 0x7f8aac070840 2024-04-26T21:38:37.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.329+0000 7f8aa9600700 1 --2- 172.21.15.84:0/2630341617 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8a8c06ec00 0x7f8a8c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:37.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.329+0000 7f8aa9600700 1 -- 172.21.15.84:0/2630341617 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f8a9408fdd0 con 0x7f8aac070840 2024-04-26T21:38:37.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.329+0000 7f8aa3e00700 1 --2- 172.21.15.84:0/2630341617 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8a8c06ec00 0x7f8a8c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:37.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.330+0000 7f8aa3e00700 1 --2- 172.21.15.84:0/2630341617 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8a8c06ec00 0x7f8a8c0710b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c007fd0 tx=0x7f8a9c009040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:37.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.338+0000 7f8aa9600700 1 -- 172.21.15.84:0/2630341617 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f8a9405c530 con 0x7f8aac070840 2024-04-26T21:38:37.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.658+0000 7f8ab3600700 1 -- 172.21.15.84:0/2630341617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8aac1155b0 con 0x7f8aac070840 2024-04-26T21:38:37.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.659+0000 7f8aa9600700 1 -- 172.21.15.84:0/2630341617 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f8a9405c0c0 con 0x7f8aac070840 2024-04-26T21:38:37.661 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-26T21:38:37.661 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-04-26T21:38:37.661 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:38:37.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:38:37.661 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-04-26T21:38:37.661 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:38:37.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:38:37.661 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-04-26T21:38:37.661 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 6 2024-04-26T21:38:37.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:38:37.662 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-04-26T21:38:37.662 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 4 2024-04-26T21:38:37.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-26T21:38:37.662 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-04-26T21:38:37.662 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 14 2024-04-26T21:38:37.662 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-26T21:38:37.662 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-26T21:38:37.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.662+0000 7f8ab3600700 1 -- 172.21.15.84:0/2630341617 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8a8c06ec00 msgr2=0x7f8a8c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:37.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.662+0000 7f8ab3600700 1 --2- 172.21.15.84:0/2630341617 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8a8c06ec00 0x7f8a8c0710b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c007fd0 tx=0x7f8a9c009040 comp rx=0 tx=0).stop 2024-04-26T21:38:37.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.662+0000 7f8ab3600700 1 -- 172.21.15.84:0/2630341617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8aac070840 msgr2=0x7f8aac119f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:37.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.662+0000 7f8ab3600700 1 --2- 172.21.15.84:0/2630341617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8aac070840 0x7f8aac119f60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8a94004f50 tx=0x7f8a94009e30 comp rx=0 tx=0).stop 2024-04-26T21:38:37.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.662+0000 7f8ab3600700 1 -- 172.21.15.84:0/2630341617 shutdown_connections 2024-04-26T21:38:37.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.662+0000 7f8ab3600700 1 --2- 172.21.15.84:0/2630341617 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8a8c06ec00 0x7f8a8c0710b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:37.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.662+0000 7f8ab3600700 1 --2- 172.21.15.84:0/2630341617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8aac070840 0x7f8aac119f60 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:37.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.662+0000 7f8ab3600700 1 --2- 172.21.15.84:0/2630341617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8aac071f30 0x7f8aac11a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:37.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.662+0000 7f8ab3600700 1 -- 172.21.15.84:0/2630341617 >> 172.21.15.84:0/2630341617 conn(0x7f8aac0f8990 msgr2=0x7f8aac0f9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:37.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.663+0000 7f8ab3600700 1 -- 172.21.15.84:0/2630341617 shutdown_connections 2024-04-26T21:38:37.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:37.663+0000 7f8ab3600700 1 -- 172.21.15.84:0/2630341617 wait complete. 2024-04-26T21:38:37.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:37 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2630341617' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:38:38.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:37 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2630341617' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:38:38.553 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-04-26T21:38:38.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:38 smithi084 ceph-mon[90138]: pgmap v376: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:39.036 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:38:39.182 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:38 smithi120 ceph-mon[79001]: pgmap v376: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:41.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.220+0000 7fa8f9e00700 1 -- 172.21.15.84:0/1729270467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8f41059a0 msgr2=0x7fa8f40ff010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:41.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.220+0000 7fa8f9e00700 1 --2- 172.21.15.84:0/1729270467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8f41059a0 0x7fa8f40ff010 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc004940 tx=0x7fa8dc009e30 comp rx=0 tx=0).stop 2024-04-26T21:38:41.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.220+0000 7fa8f9e00700 1 -- 172.21.15.84:0/1729270467 shutdown_connections 2024-04-26T21:38:41.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.220+0000 7fa8f9e00700 1 --2- 172.21.15.84:0/1729270467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8f41059a0 0x7fa8f40ff010 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:41.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.220+0000 7fa8f9e00700 1 --2- 172.21.15.84:0/1729270467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8f4105000 0x7fa8f41053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:41.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.220+0000 7fa8f9e00700 1 -- 172.21.15.84:0/1729270467 >> 172.21.15.84:0/1729270467 conn(0x7fa8f40fab70 msgr2=0x7fa8f40fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:41.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.220+0000 7fa8f9e00700 1 -- 172.21.15.84:0/1729270467 shutdown_connections 2024-04-26T21:38:41.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.220+0000 7fa8f9e00700 1 -- 172.21.15.84:0/1729270467 wait complete. 2024-04-26T21:38:41.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.221+0000 7fa8f9e00700 1 Processor -- start 2024-04-26T21:38:41.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.221+0000 7fa8f9e00700 1 -- start start 2024-04-26T21:38:41.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.221+0000 7fa8f9e00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8f4105000 0x7fa8f406a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:41.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.221+0000 7fa8f9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8f41059a0 0x7fa8f406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:41.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.221+0000 7fa8f9e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f406b190 con 0x7fa8f41059a0 2024-04-26T21:38:41.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.221+0000 7fa8f9e00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f406b2d0 con 0x7fa8f4105000 2024-04-26T21:38:41.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.222+0000 7fa8ea000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8f41059a0 0x7fa8f406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:41.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.222+0000 7fa8ea000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8f41059a0 0x7fa8f406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58022/0 (socket says 172.21.15.84:58022) 2024-04-26T21:38:41.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.222+0000 7fa8ea000700 1 -- 172.21.15.84:0/2245861479 learned_addr learned my addr 172.21.15.84:0/2245861479 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:41.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.222+0000 7fa8f2a00700 1 --2- 172.21.15.84:0/2245861479 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8f4105000 0x7fa8f406a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:41.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.222+0000 7fa8ea000700 1 -- 172.21.15.84:0/2245861479 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8f4105000 msgr2=0x7fa8f406a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:41.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.222+0000 7fa8ea000700 1 --2- 172.21.15.84:0/2245861479 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8f4105000 0x7fa8f406a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:41.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.222+0000 7fa8ea000700 1 -- 172.21.15.84:0/2245861479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc005040 con 0x7fa8f41059a0 2024-04-26T21:38:41.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.222+0000 7fa8ea000700 1 --2- 172.21.15.84:0/2245861479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8f41059a0 0x7fa8f406ab40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc009180 tx=0x7fa8dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:41.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.223+0000 7fa8eb400700 1 -- 172.21.15.84:0/2245861479 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8dc00e040 con 0x7fa8f41059a0 2024-04-26T21:38:41.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.223+0000 7fa8eb400700 1 -- 172.21.15.84:0/2245861479 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa8dc00bbc0 con 0x7fa8f41059a0 2024-04-26T21:38:41.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.223+0000 7fa8eb400700 1 -- 172.21.15.84:0/2245861479 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8dc01c3f0 con 0x7fa8f41059a0 2024-04-26T21:38:41.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.223+0000 7fa8f9e00700 1 -- 172.21.15.84:0/2245861479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f41222f0 con 0x7fa8f41059a0 2024-04-26T21:38:41.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.223+0000 7fa8f9e00700 1 -- 172.21.15.84:0/2245861479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f4122880 con 0x7fa8f41059a0 2024-04-26T21:38:41.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.224+0000 7fa8f9e00700 1 -- 172.21.15.84:0/2245861479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f4100750 con 0x7fa8f41059a0 2024-04-26T21:38:41.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.225+0000 7fa8eb400700 1 -- 172.21.15.84:0/2245861479 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa8dc00bd30 con 0x7fa8f41059a0 2024-04-26T21:38:41.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.226+0000 7fa8eb400700 1 --2- 172.21.15.84:0/2245861479 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa8d806ec00 0x7fa8d80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:41.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.226+0000 7fa8eb400700 1 -- 172.21.15.84:0/2245861479 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fa8dc08fe20 con 0x7fa8f41059a0 2024-04-26T21:38:41.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.227+0000 7fa8f2a00700 1 --2- 172.21.15.84:0/2245861479 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa8d806ec00 0x7fa8d80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:41.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.227+0000 7fa8f2a00700 1 --2- 172.21.15.84:0/2245861479 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa8d806ec00 0x7fa8d80710b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4004ec0 tx=0x7fa8e4009040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:41.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.232+0000 7fa8eb400700 1 -- 172.21.15.84:0/2245861479 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fa8dc058a50 con 0x7fa8f41059a0 2024-04-26T21:38:41.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:41 smithi084 ceph-mon[90138]: pgmap v377: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:41.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:41 smithi120 ceph-mon[79001]: pgmap v377: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:41.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.558+0000 7fa8f9e00700 1 -- 172.21.15.84:0/2245861479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa8f404c710 con 0x7fa8f41059a0 2024-04-26T21:38:41.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.559+0000 7fa8eb400700 1 -- 172.21.15.84:0/2245861479 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fa8dc05c110 con 0x7fa8f41059a0 2024-04-26T21:38:41.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.562+0000 7fa8f9e00700 1 -- 172.21.15.84:0/2245861479 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa8d806ec00 msgr2=0x7fa8d80710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:41.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.562+0000 7fa8f9e00700 1 --2- 172.21.15.84:0/2245861479 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa8d806ec00 0x7fa8d80710b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4004ec0 tx=0x7fa8e4009040 comp rx=0 tx=0).stop 2024-04-26T21:38:41.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.562+0000 7fa8f9e00700 1 -- 172.21.15.84:0/2245861479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8f41059a0 msgr2=0x7fa8f406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:41.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.562+0000 7fa8f9e00700 1 --2- 172.21.15.84:0/2245861479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8f41059a0 0x7fa8f406ab40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc009180 tx=0x7fa8dc009e30 comp rx=0 tx=0).stop 2024-04-26T21:38:41.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.562+0000 7fa8f9e00700 1 -- 172.21.15.84:0/2245861479 shutdown_connections 2024-04-26T21:38:41.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.563+0000 7fa8f9e00700 1 --2- 172.21.15.84:0/2245861479 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa8d806ec00 0x7fa8d80710b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:41.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.563+0000 7fa8f9e00700 1 --2- 172.21.15.84:0/2245861479 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8f4105000 0x7fa8f406a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:41.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.563+0000 7fa8f9e00700 1 --2- 172.21.15.84:0/2245861479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8f41059a0 0x7fa8f406ab40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:41.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.563+0000 7fa8f9e00700 1 -- 172.21.15.84:0/2245861479 >> 172.21.15.84:0/2245861479 conn(0x7fa8f40fab70 msgr2=0x7fa8f40fbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:41.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.563+0000 7fa8f9e00700 1 -- 172.21.15.84:0/2245861479 shutdown_connections 2024-04-26T21:38:41.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:41.563+0000 7fa8f9e00700 1 -- 172.21.15.84:0/2245861479 wait complete. 2024-04-26T21:38:41.580 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-04-26T21:38:42.374 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:42 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2245861479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:38:42.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:42 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2245861479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:38:42.435 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-04-26T21:38:42.908 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:38:43.290 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:43 smithi084 ceph-mon[90138]: pgmap v378: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:43.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:43 smithi120 ceph-mon[79001]: pgmap v378: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:45.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.082+0000 7fa5f6c00700 1 -- 172.21.15.84:0/3467275297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f0109410 msgr2=0x7fa5f01097e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:45.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.082+0000 7fa5f6c00700 1 --2- 172.21.15.84:0/3467275297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f0109410 0x7fa5f01097e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0004940 tx=0x7fa5e0009e30 comp rx=0 tx=0).stop 2024-04-26T21:38:45.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.082+0000 7fa5f6c00700 1 -- 172.21.15.84:0/3467275297 shutdown_connections 2024-04-26T21:38:45.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.082+0000 7fa5f6c00700 1 --2- 172.21.15.84:0/3467275297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5f0109db0 0x7fa5f0103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:45.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.082+0000 7fa5f6c00700 1 --2- 172.21.15.84:0/3467275297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f0109410 0x7fa5f01097e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:45.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.082+0000 7fa5f6c00700 1 -- 172.21.15.84:0/3467275297 >> 172.21.15.84:0/3467275297 conn(0x7fa5f0072c00 msgr2=0x7fa5f0075010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:45.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.082+0000 7fa5f6c00700 1 -- 172.21.15.84:0/3467275297 shutdown_connections 2024-04-26T21:38:45.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.082+0000 7fa5f6c00700 1 -- 172.21.15.84:0/3467275297 wait complete. 2024-04-26T21:38:45.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.083+0000 7fa5f6c00700 1 Processor -- start 2024-04-26T21:38:45.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.083+0000 7fa5f6c00700 1 -- start start 2024-04-26T21:38:45.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.084+0000 7fa5f6c00700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5f0109410 0x7fa5f0119f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:45.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.084+0000 7fa5f6c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f0109db0 0x7fa5f011a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:45.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.084+0000 7fa5f6c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f011ab60 con 0x7fa5f0109db0 2024-04-26T21:38:45.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.084+0000 7fa5f6c00700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f01140b0 con 0x7fa5f0109410 2024-04-26T21:38:45.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.084+0000 7fa5ef400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f0109db0 0x7fa5f011a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:45.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.084+0000 7fa5ef400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f0109db0 0x7fa5f011a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60916/0 (socket says 172.21.15.84:60916) 2024-04-26T21:38:45.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.084+0000 7fa5ef400700 1 -- 172.21.15.84:0/1372944858 learned_addr learned my addr 172.21.15.84:0/1372944858 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:45.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.084+0000 7fa5efe00700 1 --2- 172.21.15.84:0/1372944858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5f0109410 0x7fa5f0119f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:45.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.085+0000 7fa5ef400700 1 -- 172.21.15.84:0/1372944858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5f0109410 msgr2=0x7fa5f0119f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:45.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.085+0000 7fa5ef400700 1 --2- 172.21.15.84:0/1372944858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5f0109410 0x7fa5f0119f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:45.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.085+0000 7fa5ef400700 1 -- 172.21.15.84:0/1372944858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e0005040 con 0x7fa5f0109db0 2024-04-26T21:38:45.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.085+0000 7fa5ef400700 1 --2- 172.21.15.84:0/1372944858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f0109db0 0x7fa5f011a480 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc00b790 tx=0x7fa5dc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:45.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.085+0000 7fa5e7e00700 1 -- 172.21.15.84:0/1372944858 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5dc00f6f0 con 0x7fa5f0109db0 2024-04-26T21:38:45.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.085+0000 7fa5e7e00700 1 -- 172.21.15.84:0/1372944858 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa5dc00fd20 con 0x7fa5f0109db0 2024-04-26T21:38:45.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.085+0000 7fa5e7e00700 1 -- 172.21.15.84:0/1372944858 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5dc0103a0 con 0x7fa5f0109db0 2024-04-26T21:38:45.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.085+0000 7fa5f6c00700 1 -- 172.21.15.84:0/1372944858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f0114330 con 0x7fa5f0109db0 2024-04-26T21:38:45.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.085+0000 7fa5f6c00700 1 -- 172.21.15.84:0/1372944858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f01148a0 con 0x7fa5f0109db0 2024-04-26T21:38:45.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.087+0000 7fa5f6c00700 1 -- 172.21.15.84:0/1372944858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f0104b60 con 0x7fa5f0109db0 2024-04-26T21:38:45.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.088+0000 7fa5e7e00700 1 -- 172.21.15.84:0/1372944858 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa5dc011400 con 0x7fa5f0109db0 2024-04-26T21:38:45.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.089+0000 7fa5e7e00700 1 --2- 172.21.15.84:0/1372944858 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa5d406ec00 0x7fa5d40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:45.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.089+0000 7fa5e7e00700 1 -- 172.21.15.84:0/1372944858 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fa5dc08e940 con 0x7fa5f0109db0 2024-04-26T21:38:45.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.089+0000 7fa5efe00700 1 --2- 172.21.15.84:0/1372944858 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa5d406ec00 0x7fa5d40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:45.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.090+0000 7fa5efe00700 1 --2- 172.21.15.84:0/1372944858 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa5d406ec00 0x7fa5d40710b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000b020 tx=0x7fa5e0009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:45.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.094+0000 7fa5e7e00700 1 -- 172.21.15.84:0/1372944858 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fa5dc05b020 con 0x7fa5f0109db0 2024-04-26T21:38:45.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.408+0000 7fa5f6c00700 1 -- 172.21.15.84:0/1372944858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa5f0110580 con 0x7fa5f0109db0 2024-04-26T21:38:45.410 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:45 smithi084 ceph-mon[90138]: pgmap v379: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:45.410 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:45 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:38:45.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.410+0000 7fa5e7e00700 1 -- 172.21.15.84:0/1372944858 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fa5dc05abb0 con 0x7fa5f0109db0 2024-04-26T21:38:45.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.413+0000 7fa5f6c00700 1 -- 172.21.15.84:0/1372944858 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa5d406ec00 msgr2=0x7fa5d40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:45.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.413+0000 7fa5f6c00700 1 --2- 172.21.15.84:0/1372944858 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa5d406ec00 0x7fa5d40710b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000b020 tx=0x7fa5e0009e30 comp rx=0 tx=0).stop 2024-04-26T21:38:45.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.413+0000 7fa5f6c00700 1 -- 172.21.15.84:0/1372944858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f0109db0 msgr2=0x7fa5f011a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:45.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.413+0000 7fa5f6c00700 1 --2- 172.21.15.84:0/1372944858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f0109db0 0x7fa5f011a480 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc00b790 tx=0x7fa5dc009220 comp rx=0 tx=0).stop 2024-04-26T21:38:45.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.413+0000 7fa5f6c00700 1 -- 172.21.15.84:0/1372944858 shutdown_connections 2024-04-26T21:38:45.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.413+0000 7fa5f6c00700 1 --2- 172.21.15.84:0/1372944858 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa5d406ec00 0x7fa5d40710b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:45.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.413+0000 7fa5f6c00700 1 --2- 172.21.15.84:0/1372944858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5f0109410 0x7fa5f0119f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:45.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.413+0000 7fa5f6c00700 1 --2- 172.21.15.84:0/1372944858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f0109db0 0x7fa5f011a480 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:45.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.413+0000 7fa5f6c00700 1 -- 172.21.15.84:0/1372944858 >> 172.21.15.84:0/1372944858 conn(0x7fa5f0072c00 msgr2=0x7fa5f0074b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:45.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.414+0000 7fa5f6c00700 1 -- 172.21.15.84:0/1372944858 shutdown_connections 2024-04-26T21:38:45.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:45.414+0000 7fa5f6c00700 1 -- 172.21.15.84:0/1372944858 wait complete. 2024-04-26T21:38:45.432 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)" 2024-04-26T21:38:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:45 smithi120 ceph-mon[79001]: pgmap v379: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:45 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:38:46.121 DEBUG:teuthology.parallel:result is None 2024-04-26T21:38:46.121 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T21:38:46.134 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi084.front.sepia.ceph.com 2024-04-26T21:38:46.134 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-26T21:38:46.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:46 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/1372944858' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:38:46.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:46 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/1372944858' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:38:46.617 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/mon.smithi084/config 2024-04-26T21:38:47.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:47 smithi084 ceph-mon[90138]: pgmap v380: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:47 smithi120 ceph-mon[79001]: pgmap v380: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.816+0000 7f0919600700 1 -- 172.21.15.84:0/2522634331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0914104fd0 msgr2=0x7f09141053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.816+0000 7f0919600700 1 --2- 172.21.15.84:0/2522634331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0914104fd0 0x7f09141053a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0904004940 tx=0x7f0904009e30 comp rx=0 tx=0).stop 2024-04-26T21:38:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.816+0000 7f0919600700 1 -- 172.21.15.84:0/2522634331 shutdown_connections 2024-04-26T21:38:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.816+0000 7f0919600700 1 --2- 172.21.15.84:0/2522634331 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0914105970 0x7f09140fefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.816+0000 7f0919600700 1 --2- 172.21.15.84:0/2522634331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0914104fd0 0x7f09141053a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.817+0000 7f0919600700 1 -- 172.21.15.84:0/2522634331 >> 172.21.15.84:0/2522634331 conn(0x7f09140fab80 msgr2=0x7f09140fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.817+0000 7f0919600700 1 -- 172.21.15.84:0/2522634331 shutdown_connections 2024-04-26T21:38:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.817+0000 7f0919600700 1 -- 172.21.15.84:0/2522634331 wait complete. 2024-04-26T21:38:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.818+0000 7f0919600700 1 Processor -- start 2024-04-26T21:38:48.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.818+0000 7f0919600700 1 -- start start 2024-04-26T21:38:48.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.818+0000 7f0919600700 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0914104fd0 0x7f0914115b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:48.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.818+0000 7f0919600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0914105970 0x7f0914116060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:48.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.818+0000 7f0919600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09141166b0 con 0x7f0914105970 2024-04-26T21:38:48.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.818+0000 7f0919600700 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091410fc90 con 0x7f0914104fd0 2024-04-26T21:38:48.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.819+0000 7f090be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0914105970 0x7f0914116060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:48.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.819+0000 7f090be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0914105970 0x7f0914116060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60934/0 (socket says 172.21.15.84:60934) 2024-04-26T21:38:48.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.819+0000 7f090be00700 1 -- 172.21.15.84:0/308912415 learned_addr learned my addr 172.21.15.84:0/308912415 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:48.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.819+0000 7f0912a00700 1 --2- 172.21.15.84:0/308912415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0914104fd0 0x7f0914115b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:48.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.819+0000 7f090be00700 1 -- 172.21.15.84:0/308912415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0914104fd0 msgr2=0x7f0914115b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:48.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.819+0000 7f090be00700 1 --2- 172.21.15.84:0/308912415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0914104fd0 0x7f0914115b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:48.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.819+0000 7f090be00700 1 -- 172.21.15.84:0/308912415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0904005040 con 0x7f0914105970 2024-04-26T21:38:48.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.820+0000 7f090be00700 1 --2- 172.21.15.84:0/308912415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0914105970 0x7f0914116060 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00eb40 tx=0x7f08fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:48.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.820+0000 7f090aa00700 1 -- 172.21.15.84:0/308912415 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08fc007cc0 con 0x7f0914105970 2024-04-26T21:38:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.820+0000 7f090aa00700 1 -- 172.21.15.84:0/308912415 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f08fc00f040 con 0x7f0914105970 2024-04-26T21:38:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.820+0000 7f0919600700 1 -- 172.21.15.84:0/308912415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091410ff10 con 0x7f0914105970 2024-04-26T21:38:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.820+0000 7f090aa00700 1 -- 172.21.15.84:0/308912415 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08fc00c9d0 con 0x7f0914105970 2024-04-26T21:38:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.820+0000 7f0919600700 1 -- 172.21.15.84:0/308912415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0914110450 con 0x7f0914105970 2024-04-26T21:38:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.821+0000 7f0919600700 1 -- 172.21.15.84:0/308912415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0914100720 con 0x7f0914105970 2024-04-26T21:38:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.822+0000 7f090aa00700 1 -- 172.21.15.84:0/308912415 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f08fc00cb30 con 0x7f0914105970 2024-04-26T21:38:48.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.824+0000 7f090aa00700 1 --2- 172.21.15.84:0/308912415 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f08f806ec00 0x7f08f80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:48.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.824+0000 7f090aa00700 1 -- 172.21.15.84:0/308912415 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f08fc08e3c0 con 0x7f0914105970 2024-04-26T21:38:48.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.824+0000 7f0912a00700 1 --2- 172.21.15.84:0/308912415 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f08f806ec00 0x7f08f80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:48.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.825+0000 7f0912a00700 1 --2- 172.21.15.84:0/308912415 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f08f806ec00 0x7f08f80710b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0904009000 tx=0x7f0904009e30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:48.829+0000 7f090aa00700 1 -- 172.21.15.84:0/308912415 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f08fc05abd0 con 0x7f0914105970 2024-04-26T21:38:49.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:49.117+0000 7f0919600700 1 -- 172.21.15.84:0/308912415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f091410c0d0 con 0x7f0914105970 2024-04-26T21:38:49.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:49.118+0000 7f090aa00700 1 -- 172.21.15.84:0/308912415 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 42 v42) v1 ==== 76+0+1954 (secure 0 0 0) 0x7f08fc05a760 con 0x7f0914105970 2024-04-26T21:38:49.120 INFO:teuthology.orchestra.run.smithi084.stdout:e42 2024-04-26T21:38:49.120 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:38:49.120 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:38:49.120 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-04-26T21:38:49.120 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:49.120 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:38:49.120 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-04-26T21:38:49.120 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 42 2024-04-26T21:38:49.121 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:38:49.121 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-26T21:21:14.208837+0000 2024-04-26T21:38:49.121 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-04-26T21:34:58.296487+0000 2024-04-26T21:38:49.121 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-04-26T21:38:49.121 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-04-26T21:38:49.121 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-04-26T21:38:49.121 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-04-26T21:38:49.121 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-04-26T21:38:49.121 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-04-26T21:38:49.121 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-04-26T21:38:49.121 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-04-26T21:38:49.121 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 94 2024-04-26T21:38:49.121 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T21:38:49.121 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-04-26T21:38:49.121 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-04-26T21:38:49.122 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=34446,1=34478} 2024-04-26T21:38:49.122 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-04-26T21:38:49.122 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-04-26T21:38:49.122 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-04-26T21:38:49.122 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-04-26T21:38:49.122 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-04-26T21:38:49.122 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data enabled 2024-04-26T21:38:49.122 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-04-26T21:38:49.122 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-04-26T21:38:49.122 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-04-26T21:38:49.122 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 34446 members: 34446,34478 2024-04-26T21:38:49.123 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.hbjunw{0:34446} state up:active seq 22 join_fscid=1 addr [v2:172.21.15.84:6826/1392878113,v1:172.21.15.84:6827/1392878113] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:38:49.123 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.rtrqtr{1:34478} state up:active seq 17 join_fscid=1 addr [v2:172.21.15.84:6828/4015119551,v1:172.21.15.84:6829/4015119551] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:38:49.123 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:49.123 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:49.123 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-04-26T21:38:49.123 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:49.123 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.qnkxcn{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.120:6824/1351450046,v1:172.21.15.120:6825/1351450046] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:38:49.123 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi120.ufqfoh{-1:44305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.120:6826/2847041344,v1:172.21.15.120:6827/2847041344] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:38:49.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:49.120+0000 7f0919600700 1 -- 172.21.15.84:0/308912415 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f08f806ec00 msgr2=0x7f08f80710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:49.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:49.120+0000 7f0919600700 1 --2- 172.21.15.84:0/308912415 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f08f806ec00 0x7f08f80710b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0904009000 tx=0x7f0904009e30 comp rx=0 tx=0).stop 2024-04-26T21:38:49.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:49.120+0000 7f0919600700 1 -- 172.21.15.84:0/308912415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0914105970 msgr2=0x7f0914116060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:49.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:49.120+0000 7f0919600700 1 --2- 172.21.15.84:0/308912415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0914105970 0x7f0914116060 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00eb40 tx=0x7f08fc00b040 comp rx=0 tx=0).stop 2024-04-26T21:38:49.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:49.121+0000 7f0919600700 1 -- 172.21.15.84:0/308912415 shutdown_connections 2024-04-26T21:38:49.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:49.121+0000 7f0919600700 1 --2- 172.21.15.84:0/308912415 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f08f806ec00 0x7f08f80710b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:49.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:49.121+0000 7f0919600700 1 --2- 172.21.15.84:0/308912415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0914104fd0 0x7f0914115b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:49.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:49.121+0000 7f0919600700 1 --2- 172.21.15.84:0/308912415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0914105970 0x7f0914116060 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:49.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:49.121+0000 7f0919600700 1 -- 172.21.15.84:0/308912415 >> 172.21.15.84:0/308912415 conn(0x7f09140fab80 msgr2=0x7f0914107d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:49.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:49.121+0000 7f0919600700 1 -- 172.21.15.84:0/308912415 shutdown_connections 2024-04-26T21:38:49.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:49.121+0000 7f0919600700 1 -- 172.21.15.84:0/308912415 wait complete. 2024-04-26T21:38:49.125 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 42 2024-04-26T21:38:49.411 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:49 smithi084 ceph-mon[90138]: pgmap v381: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:49.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:49 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:38:49.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:49 smithi120 ceph-mon[79001]: pgmap v381: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:49.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:49 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:38:50.093 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-04-26T21:38:50.130 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:38:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.329+0000 7f3cee800640 1 -- 172.21.15.84:0/2955230117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce8100d60 msgr2=0x7f3ce80fa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.329+0000 7f3cee800640 1 --2- 172.21.15.84:0/2955230117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce8100d60 0x7f3ce80fa3f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009c50 tx=0x7f3cd0004d10 comp rx=0 tx=0).stop 2024-04-26T21:38:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.329+0000 7f3cee800640 1 -- 172.21.15.84:0/2955230117 shutdown_connections 2024-04-26T21:38:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.329+0000 7f3cee800640 1 --2- 172.21.15.84:0/2955230117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce8100d60 0x7f3ce80fa3f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.329+0000 7f3cee800640 1 --2- 172.21.15.84:0/2955230117 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ce81003c0 0x7f3ce8100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:50.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.329+0000 7f3cee800640 1 -- 172.21.15.84:0/2955230117 >> 172.21.15.84:0/2955230117 conn(0x7f3ce80f5f30 msgr2=0x7f3ce80f8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:50.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.329+0000 7f3cee800640 1 -- 172.21.15.84:0/2955230117 shutdown_connections 2024-04-26T21:38:50.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.329+0000 7f3cee800640 1 -- 172.21.15.84:0/2955230117 wait complete. 2024-04-26T21:38:50.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.330+0000 7f3cee800640 1 Processor -- start 2024-04-26T21:38:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.330+0000 7f3cee800640 1 -- start start 2024-04-26T21:38:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.330+0000 7f3cee800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce81003c0 0x7f3ce8114e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.330+0000 7f3cee800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ce8100d60 0x7f3ce81153b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.330+0000 7f3cee800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce81159b0 con 0x7f3ce81003c0 2024-04-26T21:38:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.330+0000 7f3cee800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce8115b20 con 0x7f3ce8100d60 2024-04-26T21:38:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.330+0000 7f3ce7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce81003c0 0x7f3ce8114e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.330+0000 7f3ce7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce81003c0 0x7f3ce8114e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60954/0 (socket says 172.21.15.84:60954) 2024-04-26T21:38:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.330+0000 7f3ce7400640 1 -- 172.21.15.84:0/2491505206 learned_addr learned my addr 172.21.15.84:0/2491505206 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.331+0000 7f3ce7400640 1 -- 172.21.15.84:0/2491505206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ce8100d60 msgr2=0x7f3ce81153b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.331+0000 7f3ce7400640 1 --2- 172.21.15.84:0/2491505206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ce8100d60 0x7f3ce81153b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.331+0000 7f3ce7400640 1 -- 172.21.15.84:0/2491505206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd00098b0 con 0x7f3ce81003c0 2024-04-26T21:38:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.331+0000 7f3ce7400640 1 --2- 172.21.15.84:0/2491505206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce81003c0 0x7f3ce8114e70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800c790 tx=0x7f3cd80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.331+0000 7f3cdfe00640 1 -- 172.21.15.84:0/2491505206 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cd800a820 con 0x7f3ce81003c0 2024-04-26T21:38:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.331+0000 7f3cdfe00640 1 -- 172.21.15.84:0/2491505206 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3cd800ae50 con 0x7f3ce81003c0 2024-04-26T21:38:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.331+0000 7f3cee800640 1 -- 172.21.15.84:0/2491505206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce810f1b0 con 0x7f3ce81003c0 2024-04-26T21:38:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.331+0000 7f3cdfe00640 1 -- 172.21.15.84:0/2491505206 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cd80115e0 con 0x7f3ce81003c0 2024-04-26T21:38:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.331+0000 7f3cee800640 1 -- 172.21.15.84:0/2491505206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce810f750 con 0x7f3ce81003c0 2024-04-26T21:38:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.332+0000 7f3cee800640 1 -- 172.21.15.84:0/2491505206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce80fbb30 con 0x7f3ce81003c0 2024-04-26T21:38:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.334+0000 7f3cdfe00640 1 -- 172.21.15.84:0/2491505206 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3cd8012400 con 0x7f3ce81003c0 2024-04-26T21:38:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.334+0000 7f3cdfe00640 1 --2- 172.21.15.84:0/2491505206 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f3ccc06eb70 0x7f3ccc071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.335+0000 7f3cdfe00640 1 -- 172.21.15.84:0/2491505206 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f3cd808ec70 con 0x7f3ce81003c0 2024-04-26T21:38:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.335+0000 7f3cdea00640 1 --2- 172.21.15.84:0/2491505206 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f3ccc06eb70 0x7f3ccc071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.335+0000 7f3cdea00640 1 --2- 172.21.15.84:0/2491505206 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f3ccc06eb70 0x7f3ccc071020 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0005010 tx=0x7f3cd0004d10 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:50.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.339+0000 7f3cdfe00640 1 -- 172.21.15.84:0/2491505206 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f3cd8095080 con 0x7f3ce81003c0 2024-04-26T21:38:50.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:50 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/308912415' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:38:50.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:38:50.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:38:50.417 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:38:50.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:50 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/308912415' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:38:50.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:38:50.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:38:50.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:38:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.556+0000 7f3cee800640 1 -- 172.21.15.84:0/2491505206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ce804bcc0 con 0x7f3ce81003c0 2024-04-26T21:38:50.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.559+0000 7f3cdfe00640 1 -- 172.21.15.84:0/2491505206 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+17121 (secure 0 0 0) 0x7f3cd8057030 con 0x7f3ce81003c0 2024-04-26T21:38:50.561 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:50.562 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":94,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","created":"2024-04-26T21:12:29.304108+0000","modified":"2024-04-26T21:34:37.842273+0000","last_up_change":"2024-04-26T21:32:33.899068+0000","last_in_change":"2024-04-26T21:19:18.310009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:17:58.092436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-26T21:21:13.126623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-26T21:21:13.704785+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6c04d45-3ba8-4cc3-92ee-2e99279c6da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":58,"up_thru":88,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":215849876},{"type":"v1","addr":"172.21.15.84:6803","nonce":215849876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":215849876},{"type":"v1","addr":"172.21.15.84:6805","nonce":215849876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":215849876},{"type":"v1","addr":"172.21.15.84:6809","nonce":215849876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":215849876},{"type":"v1","addr":"172.21.15.84:6807","nonce":215849876}]},"public_addr":"172.21.15.84:6803/215849876","cluster_addr":"172.21.15.84:6805/215849876","heartbeat_back_addr":"172.21.15.84:6809/215849876","heartbeat_front_addr":"172.21.15.84:6807/215849876","state":["exists","up"]},{"osd":1,"uuid":"4417e988-3443-4671-8df5-4d964b8e5954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":64,"up_from":68,"up_thru":88,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3809321856},{"type":"v1","addr":"172.21.15.84:6811","nonce":3809321856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3809321856},{"type":"v1","addr":"172.21.15.84:6813","nonce":3809321856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3809321856},{"type":"v1","addr":"172.21.15.84:6817","nonce":3809321856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3809321856},{"type":"v1","addr":"172.21.15.84:6815","nonce":3809321856}]},"public_addr":"172.21.15.84:6811/3809321856","cluster_addr":"172.21.15.84:6813/3809321856","heartbeat_back_addr":"172.21.15.84:6817/3809321856","heartbeat_front_addr":"172.21.15.84:6815/3809321856","state":["exists","up"]},{"osd":2,"uuid":"240901fd-0810-4752-bfa0-2857359b30a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":69,"up_from":73,"up_thru":88,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":926975972},{"type":"v1","addr":"172.21.15.84:6819","nonce":926975972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":926975972},{"type":"v1","addr":"172.21.15.84:6821","nonce":926975972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":926975972},{"type":"v1","addr":"172.21.15.84:6825","nonce":926975972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":926975972},{"type":"v1","addr":"172.21.15.84:6823","nonce":926975972}]},"public_addr":"172.21.15.84:6819/926975972","cluster_addr":"172.21.15.84:6821/926975972","heartbeat_back_addr":"172.21.15.84:6825/926975972","heartbeat_front_addr":"172.21.15.84:6823/926975972","state":["exists","up"]},{"osd":3,"uuid":"f2d8384f-8b7d-4da4-8a67-4bdb83753822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":74,"up_from":78,"up_thru":88,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2439161252},{"type":"v1","addr":"172.21.15.120:6801","nonce":2439161252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2439161252},{"type":"v1","addr":"172.21.15.120:6803","nonce":2439161252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2439161252},{"type":"v1","addr":"172.21.15.120:6807","nonce":2439161252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2439161252},{"type":"v1","addr":"172.21.15.120:6805","nonce":2439161252}]},"public_addr":"172.21.15.120:6801/2439161252","cluster_addr":"172.21.15.120:6803/2439161252","heartbeat_back_addr":"172.21.15.120:6807/2439161252","heartbeat_front_addr":"172.21.15.120:6805/2439161252","state":["exists","up"]},{"osd":4,"uuid":"27aa8cbb-e94e-4e63-b2d4-be8a71b292ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":79,"up_from":83,"up_thru":88,"down_at":80,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":267967952},{"type":"v1","addr":"172.21.15.120:6809","nonce":267967952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":267967952},{"type":"v1","addr":"172.21.15.120:6811","nonce":267967952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":267967952},{"type":"v1","addr":"172.21.15.120:6815","nonce":267967952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":267967952},{"type":"v1","addr":"172.21.15.120:6813","nonce":267967952}]},"public_addr":"172.21.15.120:6809/267967952","cluster_addr":"172.21.15.120:6811/267967952","heartbeat_back_addr":"172.21.15.120:6815/267967952","heartbeat_front_addr":"172.21.15.120:6813/267967952","state":["exists","up"]},{"osd":5,"uuid":"e13abdd9-155d-40a0-a69a-4448a658ee5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":84,"up_from":88,"up_thru":88,"down_at":85,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3209575908},{"type":"v1","addr":"172.21.15.120:6817","nonce":3209575908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3209575908},{"type":"v1","addr":"172.21.15.120:6819","nonce":3209575908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3209575908},{"type":"v1","addr":"172.21.15.120:6823","nonce":3209575908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3209575908},{"type":"v1","addr":"172.21.15.120:6821","nonce":3209575908}]},"public_addr":"172.21.15.120:6817/3209575908","cluster_addr":"172.21.15.120:6819/3209575908","heartbeat_back_addr":"172.21.15.120:6823/3209575908","heartbeat_front_addr":"172.21.15.120:6821/3209575908","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:45.823555+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:17:20.567670+0000","dead_epoch":64},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:17:55.623700+0000","dead_epoch":69},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:18:31.061632+0000","dead_epoch":74},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:19:06.227030+0000","dead_epoch":79},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:19:40.886216+0000","dead_epoch":84}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.11","mappings":[{"from":3,"to":0}]},{"pgid":"2.12","mappings":[{"from":3,"to":2}]},{"pgid":"2.16","mappings":[{"from":3,"to":0}]},{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.3","mappings":[{"from":4,"to":2}]},{"pgid":"3.4","mappings":[{"from":1,"to":0}]},{"pgid":"3.7","mappings":[{"from":1,"to":0}]},{"pgid":"3.d","mappings":[{"from":3,"to":0}]},{"pgid":"3.e","mappings":[{"from":4,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:6827/2972379081":"2024-04-27T21:34:37.842224+0000","172.21.15.120:6826/2972379081":"2024-04-27T21:34:37.842224+0000","172.21.15.84:6827/1450914842":"2024-04-27T21:33:20.145008+0000","172.21.15.84:0/1001623":"2024-04-27T21:15:11.400421+0000","172.21.15.84:0/354233381":"2024-04-27T21:27:43.672129+0000","172.21.15.84:0/2756731981":"2024-04-27T21:27:43.672129+0000","172.21.15.120:0/1669924996":"2024-04-27T21:26:20.621242+0000","172.21.15.120:0/3421888873":"2024-04-27T21:26:20.621242+0000","172.21.15.84:6828/1543850087":"2024-04-27T21:33:49.979152+0000","172.21.15.84:0/3356039008":"2024-04-27T21:15:11.400421+0000","172.21.15.120:0/1504194308":"2024-04-27T21:26:20.621242+0000","172.21.15.84:0/801206978":"2024-04-27T21:13:03.641160+0000","172.21.15.84:0/2390150734":"2024-04-27T21:24:35.532321+0000","172.21.15.120:6828/3773295163":"2024-04-27T21:26:20.621242+0000","172.21.15.84:6800/3446199945":"2024-04-27T21:15:11.400421+0000","172.21.15.84:0/944666034":"2024-04-27T21:27:43.672129+0000","172.21.15.120:6829/3773295163":"2024-04-27T21:26:20.621242+0000","172.21.15.120:0/553294858":"2024-04-27T21:26:20.621242+0000","172.21.15.84:0/3365760548":"2024-04-27T21:24:35.532321+0000","172.21.15.84:0/2815093662":"2024-04-27T21:24:35.532321+0000","172.21.15.84:6826/1450914842":"2024-04-27T21:33:20.145008+0000","172.21.15.84:0/31938649":"2024-04-27T21:27:43.672129+0000","172.21.15.84:6801/3446199945":"2024-04-27T21:15:11.400421+0000","172.21.15.84:0/3621485381":"2024-04-27T21:13:42.669268+0000","172.21.15.84:6800/3574511298":"2024-04-27T21:24:35.532321+0000","172.21.15.84:0/1430131141":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/413656261":"2024-04-27T21:15:11.400421+0000","172.21.15.84:0/3648317863":"2024-04-27T21:13:03.641160+0000","172.21.15.84:0/2708514508":"2024-04-27T21:24:35.532321+0000","172.21.15.84:0/1155142360":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/1460734944":"2024-04-27T21:13:03.641160+0000","172.21.15.84:6801/3574511298":"2024-04-27T21:24:35.532321+0000","172.21.15.84:6800/3231603698":"2024-04-27T21:13:03.641160+0000","172.21.15.84:6829/1543850087":"2024-04-27T21:33:49.979152+0000","172.21.15.84:6801/3231603698":"2024-04-27T21:13:03.641160+0000","172.21.15.84:6800/2151160823":"2024-04-27T21:13:42.669268+0000","172.21.15.84:6801/3665499318":"2024-04-27T21:27:43.672129+0000","172.21.15.84:0/1070676377":"2024-04-27T21:27:43.672129+0000","172.21.15.84:6800/3665499318":"2024-04-27T21:27:43.672129+0000","172.21.15.84:6801/2151160823":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/1875187384":"2024-04-27T21:27:43.672129+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:38:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.562+0000 7f3cee800640 1 -- 172.21.15.84:0/2491505206 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f3ccc06eb70 msgr2=0x7f3ccc071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.562+0000 7f3cee800640 1 --2- 172.21.15.84:0/2491505206 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f3ccc06eb70 0x7f3ccc071020 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0005010 tx=0x7f3cd0004d10 comp rx=0 tx=0).stop 2024-04-26T21:38:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.562+0000 7f3cee800640 1 -- 172.21.15.84:0/2491505206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce81003c0 msgr2=0x7f3ce8114e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.562+0000 7f3cee800640 1 --2- 172.21.15.84:0/2491505206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce81003c0 0x7f3ce8114e70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800c790 tx=0x7f3cd80043c0 comp rx=0 tx=0).stop 2024-04-26T21:38:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.562+0000 7f3cee800640 1 -- 172.21.15.84:0/2491505206 shutdown_connections 2024-04-26T21:38:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.562+0000 7f3cee800640 1 --2- 172.21.15.84:0/2491505206 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f3ccc06eb70 0x7f3ccc071020 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.562+0000 7f3cee800640 1 --2- 172.21.15.84:0/2491505206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ce8100d60 0x7f3ce81153b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.562+0000 7f3cee800640 1 --2- 172.21.15.84:0/2491505206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce81003c0 0x7f3ce8114e70 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.562+0000 7f3cee800640 1 -- 172.21.15.84:0/2491505206 >> 172.21.15.84:0/2491505206 conn(0x7f3ce80f5f30 msgr2=0x7f3ce80f6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.563+0000 7f3cee800640 1 -- 172.21.15.84:0/2491505206 shutdown_connections 2024-04-26T21:38:50.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.563+0000 7f3cee800640 1 -- 172.21.15.84:0/2491505206 wait complete. 2024-04-26T21:38:50.580 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:17:58.092436+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-26T21:21:13.126623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-26T21:21:13.704785+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:38:50.581 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:38:50.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.771+0000 7f43f6e00640 1 -- 172.21.15.84:0/214667795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f0102a40 msgr2=0x7f43f00fa700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:50.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.771+0000 7f43f6e00640 1 --2- 172.21.15.84:0/214667795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f0102a40 0x7f43f00fa700 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f43dc0048d0 tx=0x7f43dc009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:50.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.771+0000 7f43f6e00640 1 -- 172.21.15.84:0/214667795 shutdown_connections 2024-04-26T21:38:50.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.771+0000 7f43f6e00640 1 --2- 172.21.15.84:0/214667795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f0102a40 0x7f43f00fa700 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:50.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.771+0000 7f43f6e00640 1 --2- 172.21.15.84:0/214667795 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43f01020a0 0x7f43f0102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:50.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.771+0000 7f43f6e00640 1 -- 172.21.15.84:0/214667795 >> 172.21.15.84:0/214667795 conn(0x7f43f00715c0 msgr2=0x7f43f00719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:50.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.771+0000 7f43f6e00640 1 -- 172.21.15.84:0/214667795 shutdown_connections 2024-04-26T21:38:50.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.771+0000 7f43f6e00640 1 -- 172.21.15.84:0/214667795 wait complete. 2024-04-26T21:38:50.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.772+0000 7f43f6e00640 1 Processor -- start 2024-04-26T21:38:50.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.772+0000 7f43f6e00640 1 -- start start 2024-04-26T21:38:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.772+0000 7f43f6e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f01020a0 0x7f43f0114dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.772+0000 7f43f6e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43f0102a40 0x7f43f0115310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.772+0000 7f43f6e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f01159a0 con 0x7f43f01020a0 2024-04-26T21:38:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.773+0000 7f43f6e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f010ef60 con 0x7f43f0102a40 2024-04-26T21:38:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.773+0000 7f43f5a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f01020a0 0x7f43f0114dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.773+0000 7f43f5a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f01020a0 0x7f43f0114dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60970/0 (socket says 172.21.15.84:60970) 2024-04-26T21:38:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.773+0000 7f43f5a00640 1 -- 172.21.15.84:0/2528743155 learned_addr learned my addr 172.21.15.84:0/2528743155 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.773+0000 7f43f5000640 1 --2- 172.21.15.84:0/2528743155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43f0102a40 0x7f43f0115310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.773+0000 7f43f5a00640 1 -- 172.21.15.84:0/2528743155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43f0102a40 msgr2=0x7f43f0115310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.773+0000 7f43f5a00640 1 --2- 172.21.15.84:0/2528743155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43f0102a40 0x7f43f0115310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.773+0000 7f43f5a00640 1 -- 172.21.15.84:0/2528743155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc005040 con 0x7f43f01020a0 2024-04-26T21:38:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.773+0000 7f43f5000640 1 --2- 172.21.15.84:0/2528743155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43f0102a40 0x7f43f0115310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:38:50.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.774+0000 7f43f5a00640 1 --2- 172.21.15.84:0/2528743155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f01020a0 0x7f43f0114dd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f43e400b790 tx=0x7f43e40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:50.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.774+0000 7f43ed600640 1 -- 172.21.15.84:0/2528743155 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43e400c700 con 0x7f43f01020a0 2024-04-26T21:38:50.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.774+0000 7f43ed600640 1 -- 172.21.15.84:0/2528743155 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f43e400cd30 con 0x7f43f01020a0 2024-04-26T21:38:50.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.774+0000 7f43f6e00640 1 -- 172.21.15.84:0/2528743155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f010f240 con 0x7f43f01020a0 2024-04-26T21:38:50.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.774+0000 7f43ed600640 1 -- 172.21.15.84:0/2528743155 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43e4013370 con 0x7f43f01020a0 2024-04-26T21:38:50.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.774+0000 7f43f6e00640 1 -- 172.21.15.84:0/2528743155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f010f760 con 0x7f43f01020a0 2024-04-26T21:38:50.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.775+0000 7f43f6e00640 1 -- 172.21.15.84:0/2528743155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f0065360 con 0x7f43f01020a0 2024-04-26T21:38:50.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.776+0000 7f43ed600640 1 -- 172.21.15.84:0/2528743155 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f43e4012070 con 0x7f43f01020a0 2024-04-26T21:38:50.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.777+0000 7f43ed600640 1 --2- 172.21.15.84:0/2528743155 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f43d806eb80 0x7f43d8071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:50.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.777+0000 7f43ed600640 1 -- 172.21.15.84:0/2528743155 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f43e408e6b0 con 0x7f43f01020a0 2024-04-26T21:38:50.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.777+0000 7f43f5000640 1 --2- 172.21.15.84:0/2528743155 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f43d806eb80 0x7f43d8071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:50.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.778+0000 7f43f5000640 1 --2- 172.21.15.84:0/2528743155 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f43d806eb80 0x7f43d8071030 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f43dc000c00 tx=0x7f43dc009da0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:50.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.782+0000 7f43ed600640 1 -- 172.21.15.84:0/2528743155 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f43e40572a0 con 0x7f43f01020a0 2024-04-26T21:38:50.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.985+0000 7f43f6e00640 1 -- 172.21.15.84:0/2528743155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f43f0109240 con 0x7f43f01020a0 2024-04-26T21:38:50.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.986+0000 7f43ed600640 1 -- 172.21.15.84:0/2528743155 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f43e405a960 con 0x7f43f01020a0 2024-04-26T21:38:50.987 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-04-26T21:38:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.989+0000 7f43f6e00640 1 -- 172.21.15.84:0/2528743155 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f43d806eb80 msgr2=0x7f43d8071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.989+0000 7f43f6e00640 1 --2- 172.21.15.84:0/2528743155 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f43d806eb80 0x7f43d8071030 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f43dc000c00 tx=0x7f43dc009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.989+0000 7f43f6e00640 1 -- 172.21.15.84:0/2528743155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f01020a0 msgr2=0x7f43f0114dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.989+0000 7f43f6e00640 1 --2- 172.21.15.84:0/2528743155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f01020a0 0x7f43f0114dd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f43e400b790 tx=0x7f43e40091d0 comp rx=0 tx=0).stop 2024-04-26T21:38:50.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.989+0000 7f43f6e00640 1 -- 172.21.15.84:0/2528743155 shutdown_connections 2024-04-26T21:38:50.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.989+0000 7f43f6e00640 1 --2- 172.21.15.84:0/2528743155 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f43d806eb80 0x7f43d8071030 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:50.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.989+0000 7f43f6e00640 1 --2- 172.21.15.84:0/2528743155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43f0102a40 0x7f43f0115310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:50.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.989+0000 7f43f6e00640 1 --2- 172.21.15.84:0/2528743155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f01020a0 0x7f43f0114dd0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:50.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.989+0000 7f43f6e00640 1 -- 172.21.15.84:0/2528743155 >> 172.21.15.84:0/2528743155 conn(0x7f43f00715c0 msgr2=0x7f43f00f9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:50.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.989+0000 7f43f6e00640 1 -- 172.21.15.84:0/2528743155 shutdown_connections 2024-04-26T21:38:50.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:50.989+0000 7f43f6e00640 1 -- 172.21.15.84:0/2528743155 wait complete. 2024-04-26T21:38:51.007 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-26T21:38:51.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.194+0000 7f6d3bc00640 1 -- 172.21.15.84:0/663733952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d340fdb50 msgr2=0x7f6d34106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.194+0000 7f6d3bc00640 1 --2- 172.21.15.84:0/663733952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d340fdb50 0x7f6d34106190 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c0048d0 tx=0x7f6d1c009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.194+0000 7f6d3bc00640 1 -- 172.21.15.84:0/663733952 shutdown_connections 2024-04-26T21:38:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.194+0000 7f6d3bc00640 1 --2- 172.21.15.84:0/663733952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d340fdb50 0x7f6d34106190 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.194+0000 7f6d3bc00640 1 --2- 172.21.15.84:0/663733952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d340fd1b0 0x7f6d340fd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.194+0000 7f6d3bc00640 1 -- 172.21.15.84:0/663733952 >> 172.21.15.84:0/663733952 conn(0x7f6d340f6c20 msgr2=0x7f6d340f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.194+0000 7f6d3bc00640 1 -- 172.21.15.84:0/663733952 shutdown_connections 2024-04-26T21:38:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.194+0000 7f6d3bc00640 1 -- 172.21.15.84:0/663733952 wait complete. 2024-04-26T21:38:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.194+0000 7f6d3bc00640 1 Processor -- start 2024-04-26T21:38:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.195+0000 7f6d3bc00640 1 -- start start 2024-04-26T21:38:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.195+0000 7f6d3bc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d340fd1b0 0x7f6d34114fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.195+0000 7f6d3bc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d340fdb50 0x7f6d34115500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.195+0000 7f6d3bc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d34115b90 con 0x7f6d340fdb50 2024-04-26T21:38:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.195+0000 7f6d3bc00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3410f150 con 0x7f6d340fd1b0 2024-04-26T21:38:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.195+0000 7f6d2be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d340fdb50 0x7f6d34115500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.195+0000 7f6d2be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d340fdb50 0x7f6d34115500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60992/0 (socket says 172.21.15.84:60992) 2024-04-26T21:38:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.195+0000 7f6d2be00640 1 -- 172.21.15.84:0/2403272118 learned_addr learned my addr 172.21.15.84:0/2403272118 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.196+0000 7f6d2be00640 1 -- 172.21.15.84:0/2403272118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d340fd1b0 msgr2=0x7f6d34114fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.196+0000 7f6d2be00640 1 --2- 172.21.15.84:0/2403272118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d340fd1b0 0x7f6d34114fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.196+0000 7f6d2be00640 1 -- 172.21.15.84:0/2403272118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c005040 con 0x7f6d340fdb50 2024-04-26T21:38:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.196+0000 7f6d2be00640 1 --2- 172.21.15.84:0/2403272118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d340fdb50 0x7f6d34115500 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c0047f0 tx=0x7f6d1c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.196+0000 7f6d31600640 1 -- 172.21.15.84:0/2403272118 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d1c0094c0 con 0x7f6d340fdb50 2024-04-26T21:38:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.196+0000 7f6d31600640 1 -- 172.21.15.84:0/2403272118 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d1c032e50 con 0x7f6d340fdb50 2024-04-26T21:38:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.196+0000 7f6d3bc00640 1 -- 172.21.15.84:0/2403272118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d3410f3d0 con 0x7f6d340fdb50 2024-04-26T21:38:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.196+0000 7f6d31600640 1 -- 172.21.15.84:0/2403272118 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d1c0435f0 con 0x7f6d340fdb50 2024-04-26T21:38:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.196+0000 7f6d3bc00640 1 -- 172.21.15.84:0/2403272118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3410f890 con 0x7f6d340fdb50 2024-04-26T21:38:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.197+0000 7f6d3bc00640 1 -- 172.21.15.84:0/2403272118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d34065dd0 con 0x7f6d340fdb50 2024-04-26T21:38:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.198+0000 7f6d31600640 1 -- 172.21.15.84:0/2403272118 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6d1c02f070 con 0x7f6d340fdb50 2024-04-26T21:38:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.199+0000 7f6d31600640 1 --2- 172.21.15.84:0/2403272118 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6d1806eb70 0x7f6d18071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.199+0000 7f6d31600640 1 -- 172.21.15.84:0/2403272118 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f6d1c0b0820 con 0x7f6d340fdb50 2024-04-26T21:38:51.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.199+0000 7f6d39200640 1 --2- 172.21.15.84:0/2403272118 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6d1806eb70 0x7f6d18071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:51.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.200+0000 7f6d39200640 1 --2- 172.21.15.84:0/2403272118 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6d1806eb70 0x7f6d18071020 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6d240097e0 tx=0x7f6d24006d20 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:51.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.204+0000 7f6d31600640 1 -- 172.21.15.84:0/2403272118 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f6d1c0793d0 con 0x7f6d340fdb50 2024-04-26T21:38:51.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.402+0000 7f6d3bc00640 1 -- 172.21.15.84:0/2403272118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f6d341093c0 con 0x7f6d340fdb50 2024-04-26T21:38:51.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.402+0000 7f6d31600640 1 -- 172.21.15.84:0/2403272118 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v94) v1 ==== 107+0+11 (secure 0 0 0) 0x7f6d1c07ca90 con 0x7f6d340fdb50 2024-04-26T21:38:51.404 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-04-26T21:38:51.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.405+0000 7f6d3bc00640 1 -- 172.21.15.84:0/2403272118 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6d1806eb70 msgr2=0x7f6d18071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:51.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.405+0000 7f6d3bc00640 1 --2- 172.21.15.84:0/2403272118 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6d1806eb70 0x7f6d18071020 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6d240097e0 tx=0x7f6d24006d20 comp rx=0 tx=0).stop 2024-04-26T21:38:51.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.405+0000 7f6d3bc00640 1 -- 172.21.15.84:0/2403272118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d340fdb50 msgr2=0x7f6d34115500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:51.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.405+0000 7f6d3bc00640 1 --2- 172.21.15.84:0/2403272118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d340fdb50 0x7f6d34115500 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c0047f0 tx=0x7f6d1c009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:51.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.405+0000 7f6d3bc00640 1 -- 172.21.15.84:0/2403272118 shutdown_connections 2024-04-26T21:38:51.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.405+0000 7f6d3bc00640 1 --2- 172.21.15.84:0/2403272118 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6d1806eb70 0x7f6d18071020 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:51.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.405+0000 7f6d3bc00640 1 --2- 172.21.15.84:0/2403272118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d340fdb50 0x7f6d34115500 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:51.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.405+0000 7f6d3bc00640 1 --2- 172.21.15.84:0/2403272118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d340fd1b0 0x7f6d34114fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:51.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.405+0000 7f6d3bc00640 1 -- 172.21.15.84:0/2403272118 >> 172.21.15.84:0/2403272118 conn(0x7f6d340f6c20 msgr2=0x7f6d340f80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:51.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.406+0000 7f6d3bc00640 1 -- 172.21.15.84:0/2403272118 shutdown_connections 2024-04-26T21:38:51.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.406+0000 7f6d3bc00640 1 -- 172.21.15.84:0/2403272118 wait complete. 2024-04-26T21:38:51.411 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:51 smithi084 ceph-mon[90138]: pgmap v382: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:51.411 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:51 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2491505206' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:38:51.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:51 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2528743155' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T21:38:51.424 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-26T21:38:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:51 smithi120 ceph-mon[79001]: pgmap v382: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:51 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2491505206' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:38:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:51 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2528743155' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T21:38:51.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.607+0000 7f6eff200640 1 -- 172.21.15.84:0/568465034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ef81029b0 msgr2=0x7f6ef80fc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:51.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.607+0000 7f6eff200640 1 --2- 172.21.15.84:0/568465034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ef81029b0 0x7f6ef80fc040 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80048d0 tx=0x7f6ee8009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:51.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.608+0000 7f6eff200640 1 -- 172.21.15.84:0/568465034 shutdown_connections 2024-04-26T21:38:51.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.608+0000 7f6eff200640 1 --2- 172.21.15.84:0/568465034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ef81029b0 0x7f6ef80fc040 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:51.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.608+0000 7f6eff200640 1 --2- 172.21.15.84:0/568465034 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ef8102010 0x7f6ef81023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:51.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.608+0000 7f6eff200640 1 -- 172.21.15.84:0/568465034 >> 172.21.15.84:0/568465034 conn(0x7f6ef80f7ba0 msgr2=0x7f6ef80f9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:51.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.608+0000 7f6eff200640 1 -- 172.21.15.84:0/568465034 shutdown_connections 2024-04-26T21:38:51.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.608+0000 7f6eff200640 1 -- 172.21.15.84:0/568465034 wait complete. 2024-04-26T21:38:51.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.608+0000 7f6eff200640 1 Processor -- start 2024-04-26T21:38:51.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.609+0000 7f6eff200640 1 -- start start 2024-04-26T21:38:51.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.609+0000 7f6eff200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ef8102010 0x7f6ef806f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:51.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.609+0000 7f6eff200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ef81029b0 0x7f6ef806fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:51.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.609+0000 7f6eff200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef8071760 con 0x7f6ef8102010 2024-04-26T21:38:51.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.609+0000 7f6eff200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef8070220 con 0x7f6ef81029b0 2024-04-26T21:38:51.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.609+0000 7f6efde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ef8102010 0x7f6ef806f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:51.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.609+0000 7f6efde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ef8102010 0x7f6ef806f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32776/0 (socket says 172.21.15.84:32776) 2024-04-26T21:38:51.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.609+0000 7f6efde00640 1 -- 172.21.15.84:0/3422457605 learned_addr learned my addr 172.21.15.84:0/3422457605 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:51.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.610+0000 7f6efde00640 1 -- 172.21.15.84:0/3422457605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ef81029b0 msgr2=0x7f6ef806fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:51.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.610+0000 7f6efde00640 1 --2- 172.21.15.84:0/3422457605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ef81029b0 0x7f6ef806fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:51.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.610+0000 7f6efde00640 1 -- 172.21.15.84:0/3422457605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee8005040 con 0x7f6ef8102010 2024-04-26T21:38:51.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.610+0000 7f6efde00640 1 --2- 172.21.15.84:0/3422457605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ef8102010 0x7f6ef806f770 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00b790 tx=0x7f6eec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:51.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.610+0000 7f6ef2000640 1 -- 172.21.15.84:0/3422457605 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6eec00c700 con 0x7f6ef8102010 2024-04-26T21:38:51.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.610+0000 7f6ef2000640 1 -- 172.21.15.84:0/3422457605 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6eec00cd30 con 0x7f6ef8102010 2024-04-26T21:38:51.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.610+0000 7f6ef2000640 1 -- 172.21.15.84:0/3422457605 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6eec013370 con 0x7f6ef8102010 2024-04-26T21:38:51.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.610+0000 7f6eff200640 1 -- 172.21.15.84:0/3422457605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef8070500 con 0x7f6ef8102010 2024-04-26T21:38:51.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.610+0000 7f6eff200640 1 -- 172.21.15.84:0/3422457605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef81193c0 con 0x7f6ef8102010 2024-04-26T21:38:51.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.612+0000 7f6eff200640 1 -- 172.21.15.84:0/3422457605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef80fd780 con 0x7f6ef8102010 2024-04-26T21:38:51.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.613+0000 7f6ef2000640 1 -- 172.21.15.84:0/3422457605 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6eec012070 con 0x7f6ef8102010 2024-04-26T21:38:51.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.613+0000 7f6ef2000640 1 --2- 172.21.15.84:0/3422457605 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6ee006eb80 0x7f6ee0071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:51.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.614+0000 7f6ef2000640 1 -- 172.21.15.84:0/3422457605 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f6eec08e520 con 0x7f6ef8102010 2024-04-26T21:38:51.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.614+0000 7f6efd400640 1 --2- 172.21.15.84:0/3422457605 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6ee006eb80 0x7f6ee0071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:51.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.615+0000 7f6efd400640 1 --2- 172.21.15.84:0/3422457605 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6ee006eb80 0x7f6ee0071030 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80043d0 tx=0x7f6ee8009da0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:51.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.619+0000 7f6ef2000640 1 -- 172.21.15.84:0/3422457605 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f6eec0571f0 con 0x7f6ef8102010 2024-04-26T21:38:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.842+0000 7f6eff200640 1 -- 172.21.15.84:0/3422457605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f6ef804bcc0 con 0x7f6ef8102010 2024-04-26T21:38:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.843+0000 7f6ef2000640 1 -- 172.21.15.84:0/3422457605 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v94) v1 ==== 107+0+11 (secure 0 0 0) 0x7f6eec05a8b0 con 0x7f6ef8102010 2024-04-26T21:38:51.844 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-04-26T21:38:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.846+0000 7f6eff200640 1 -- 172.21.15.84:0/3422457605 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6ee006eb80 msgr2=0x7f6ee0071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.846+0000 7f6eff200640 1 --2- 172.21.15.84:0/3422457605 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6ee006eb80 0x7f6ee0071030 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80043d0 tx=0x7f6ee8009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.846+0000 7f6eff200640 1 -- 172.21.15.84:0/3422457605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ef8102010 msgr2=0x7f6ef806f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.846+0000 7f6eff200640 1 --2- 172.21.15.84:0/3422457605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ef8102010 0x7f6ef806f770 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00b790 tx=0x7f6eec0091d0 comp rx=0 tx=0).stop 2024-04-26T21:38:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.846+0000 7f6eff200640 1 -- 172.21.15.84:0/3422457605 shutdown_connections 2024-04-26T21:38:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.846+0000 7f6eff200640 1 --2- 172.21.15.84:0/3422457605 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6ee006eb80 0x7f6ee0071030 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.846+0000 7f6eff200640 1 --2- 172.21.15.84:0/3422457605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ef81029b0 0x7f6ef806fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.846+0000 7f6eff200640 1 --2- 172.21.15.84:0/3422457605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ef8102010 0x7f6ef806f770 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.846+0000 7f6eff200640 1 -- 172.21.15.84:0/3422457605 >> 172.21.15.84:0/3422457605 conn(0x7f6ef80f7ba0 msgr2=0x7f6ef80f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.846+0000 7f6eff200640 1 -- 172.21.15.84:0/3422457605 shutdown_connections 2024-04-26T21:38:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:51.846+0000 7f6eff200640 1 -- 172.21.15.84:0/3422457605 wait complete. 2024-04-26T21:38:51.867 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:38:52.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.062+0000 7f5a1e200640 1 -- 172.21.15.84:0/3379047664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a18102b60 msgr2=0x7f5a180fc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:52.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.062+0000 7f5a1e200640 1 --2- 172.21.15.84:0/3379047664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a18102b60 0x7f5a180fc1f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5a000048d0 tx=0x7f5a00009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:52.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.062+0000 7f5a1e200640 1 -- 172.21.15.84:0/3379047664 shutdown_connections 2024-04-26T21:38:52.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.062+0000 7f5a1e200640 1 --2- 172.21.15.84:0/3379047664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a18102b60 0x7f5a180fc1f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:52.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.062+0000 7f5a1e200640 1 --2- 172.21.15.84:0/3379047664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a181021c0 0x7f5a18102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:52.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.062+0000 7f5a1e200640 1 -- 172.21.15.84:0/3379047664 >> 172.21.15.84:0/3379047664 conn(0x7f5a180f7d30 msgr2=0x7f5a180fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:52.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.062+0000 7f5a1e200640 1 -- 172.21.15.84:0/3379047664 shutdown_connections 2024-04-26T21:38:52.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.063+0000 7f5a1e200640 1 -- 172.21.15.84:0/3379047664 wait complete. 2024-04-26T21:38:52.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.063+0000 7f5a1e200640 1 Processor -- start 2024-04-26T21:38:52.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.063+0000 7f5a1e200640 1 -- start start 2024-04-26T21:38:52.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.064+0000 7f5a1e200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a181021c0 0x7f5a18114f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:52.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.064+0000 7f5a1e200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a18102b60 0x7f5a18115470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:52.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.064+0000 7f5a1e200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a18115a70 con 0x7f5a181021c0 2024-04-26T21:38:52.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.064+0000 7f5a1e200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1810f0c0 con 0x7f5a18102b60 2024-04-26T21:38:52.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.064+0000 7f5a17400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a181021c0 0x7f5a18114f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:52.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.064+0000 7f5a17400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a181021c0 0x7f5a18114f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37404/0 (socket says 172.21.15.84:37404) 2024-04-26T21:38:52.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.064+0000 7f5a17400640 1 -- 172.21.15.84:0/3240655930 learned_addr learned my addr 172.21.15.84:0/3240655930 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:52.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.064+0000 7f5a17400640 1 -- 172.21.15.84:0/3240655930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a18102b60 msgr2=0x7f5a18115470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:52.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.064+0000 7f5a17400640 1 --2- 172.21.15.84:0/3240655930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a18102b60 0x7f5a18115470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:52.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.064+0000 7f5a17400640 1 -- 172.21.15.84:0/3240655930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a00005040 con 0x7f5a181021c0 2024-04-26T21:38:52.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.065+0000 7f5a17400640 1 --2- 172.21.15.84:0/3240655930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a181021c0 0x7f5a18114f30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5a08002a50 tx=0x7f5a08004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:52.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.065+0000 7f5a0f400640 1 -- 172.21.15.84:0/3240655930 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a08007c30 con 0x7f5a181021c0 2024-04-26T21:38:52.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.065+0000 7f5a1e200640 1 -- 172.21.15.84:0/3240655930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a1810f3a0 con 0x7f5a181021c0 2024-04-26T21:38:52.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.065+0000 7f5a0f400640 1 -- 172.21.15.84:0/3240655930 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5a0800f040 con 0x7f5a181021c0 2024-04-26T21:38:52.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.065+0000 7f5a0f400640 1 -- 172.21.15.84:0/3240655930 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a0800dbe0 con 0x7f5a181021c0 2024-04-26T21:38:52.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.065+0000 7f5a1e200640 1 -- 172.21.15.84:0/3240655930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a1810f8c0 con 0x7f5a181021c0 2024-04-26T21:38:52.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.067+0000 7f5a1e200640 1 -- 172.21.15.84:0/3240655930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a180fd930 con 0x7f5a181021c0 2024-04-26T21:38:52.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.067+0000 7f5a0f400640 1 -- 172.21.15.84:0/3240655930 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5a0800dd40 con 0x7f5a181021c0 2024-04-26T21:38:52.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.068+0000 7f5a0f400640 1 --2- 172.21.15.84:0/3240655930 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f59fc06eb70 0x7f59fc071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:52.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.068+0000 7f5a0f400640 1 -- 172.21.15.84:0/3240655930 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f5a0808e9e0 con 0x7f5a181021c0 2024-04-26T21:38:52.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.069+0000 7f5a0fe00640 1 --2- 172.21.15.84:0/3240655930 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f59fc06eb70 0x7f59fc071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:52.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.069+0000 7f5a0fe00640 1 --2- 172.21.15.84:0/3240655930 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f59fc06eb70 0x7f59fc071020 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5a0002bda0 tx=0x7f5a00009da0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:52.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.073+0000 7f5a0f400640 1 -- 172.21.15.84:0/3240655930 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f5a08057610 con 0x7f5a181021c0 2024-04-26T21:38:52.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.318+0000 7f5a1e200640 1 -- 172.21.15.84:0/3240655930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a1804bcc0 con 0x7f5a181021c0 2024-04-26T21:38:52.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.320+0000 7f5a0f400640 1 -- 172.21.15.84:0/3240655930 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+5236 (secure 0 0 0) 0x7f5a1804bcc0 con 0x7f5a181021c0 2024-04-26T21:38:52.321 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:52.321 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44285,"name":"cephfs.smithi120.qnkxcn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/1351450046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1351450046},{"type":"v1","addr":"172.21.15.120:6825","nonce":1351450046}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44305,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6827/2847041344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2847041344},{"type":"v1","addr":"172.21.15.120:6827","nonce":2847041344}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:34:58.296487+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34446,"mds_1":34478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34446":{"gid":34446,"name":"cephfs.smithi084.hbjunw","rank":0,"incarnation":37,"state":"up:active","state_seq":22,"addr":"172.21.15.84:6827/1392878113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1392878113},{"type":"v1","addr":"172.21.15.84:6827","nonce":1392878113}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34478":{"gid":34478,"name":"cephfs.smithi084.rtrqtr","rank":1,"incarnation":41,"state":"up:active","state_seq":17,"addr":"172.21.15.84:6829/4015119551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4015119551},{"type":"v1","addr":"172.21.15.84:6829","nonce":4015119551}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34446,"qdb_cluster":[34446,34478]},"id":1}]} 2024-04-26T21:38:52.321 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 42 2024-04-26T21:38:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.322+0000 7f5a1e200640 1 -- 172.21.15.84:0/3240655930 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f59fc06eb70 msgr2=0x7f59fc071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.322+0000 7f5a1e200640 1 --2- 172.21.15.84:0/3240655930 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f59fc06eb70 0x7f59fc071020 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5a0002bda0 tx=0x7f5a00009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.322+0000 7f5a1e200640 1 -- 172.21.15.84:0/3240655930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a181021c0 msgr2=0x7f5a18114f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.322+0000 7f5a1e200640 1 --2- 172.21.15.84:0/3240655930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a181021c0 0x7f5a18114f30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5a08002a50 tx=0x7f5a08004600 comp rx=0 tx=0).stop 2024-04-26T21:38:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.323+0000 7f5a1e200640 1 -- 172.21.15.84:0/3240655930 shutdown_connections 2024-04-26T21:38:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.323+0000 7f5a1e200640 1 --2- 172.21.15.84:0/3240655930 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f59fc06eb70 0x7f59fc071020 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.323+0000 7f5a1e200640 1 --2- 172.21.15.84:0/3240655930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a18102b60 0x7f5a18115470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.323+0000 7f5a1e200640 1 --2- 172.21.15.84:0/3240655930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a181021c0 0x7f5a18114f30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.323+0000 7f5a1e200640 1 -- 172.21.15.84:0/3240655930 >> 172.21.15.84:0/3240655930 conn(0x7f5a180f7d30 msgr2=0x7f5a18071030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.323+0000 7f5a1e200640 1 -- 172.21.15.84:0/3240655930 shutdown_connections 2024-04-26T21:38:52.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.323+0000 7f5a1e200640 1 -- 172.21.15.84:0/3240655930 wait complete. 2024-04-26T21:38:52.338 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:52 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2403272118' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-26T21:38:52.339 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:52 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3422457605' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-26T21:38:52.342 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 11, 'max_mds': 2, 'flags': 18} 2024-04-26T21:38:52.342 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 12 2024-04-26T21:38:52.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:52 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2403272118' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-26T21:38:52.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:52 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3422457605' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-26T21:38:52.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.535+0000 7f2486400640 1 -- 172.21.15.84:0/2034809992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24801043e0 msgr2=0x7f24801047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:52.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.535+0000 7f2486400640 1 --2- 172.21.15.84:0/2034809992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24801043e0 0x7f24801047b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f24700048d0 tx=0x7f2470009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:52.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.535+0000 7f2486400640 1 -- 172.21.15.84:0/2034809992 shutdown_connections 2024-04-26T21:38:52.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.535+0000 7f2486400640 1 --2- 172.21.15.84:0/2034809992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2480104d80 0x7f24800fe410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:52.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.535+0000 7f2486400640 1 --2- 172.21.15.84:0/2034809992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24801043e0 0x7f24801047b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:52.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.535+0000 7f2486400640 1 -- 172.21.15.84:0/2034809992 >> 172.21.15.84:0/2034809992 conn(0x7f24800f9f90 msgr2=0x7f24800fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:52.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.535+0000 7f2486400640 1 -- 172.21.15.84:0/2034809992 shutdown_connections 2024-04-26T21:38:52.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.535+0000 7f2486400640 1 -- 172.21.15.84:0/2034809992 wait complete. 2024-04-26T21:38:52.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.536+0000 7f2486400640 1 Processor -- start 2024-04-26T21:38:52.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.536+0000 7f2486400640 1 -- start start 2024-04-26T21:38:52.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.536+0000 7f2486400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24801043e0 0x7f2480114ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:52.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.536+0000 7f2486400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2480104d80 0x7f2480115430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:52.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.536+0000 7f2486400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2480115a30 con 0x7f24801043e0 2024-04-26T21:38:52.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.536+0000 7f2486400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248010f080 con 0x7f2480104d80 2024-04-26T21:38:52.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.537+0000 7f247f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24801043e0 0x7f2480114ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:52.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.537+0000 7f247f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24801043e0 0x7f2480114ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37426/0 (socket says 172.21.15.84:37426) 2024-04-26T21:38:52.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.537+0000 7f247f400640 1 -- 172.21.15.84:0/2789955866 learned_addr learned my addr 172.21.15.84:0/2789955866 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:52.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.537+0000 7f2477e00640 1 --2- 172.21.15.84:0/2789955866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2480104d80 0x7f2480115430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:52.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.537+0000 7f247f400640 1 -- 172.21.15.84:0/2789955866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2480104d80 msgr2=0x7f2480115430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:52.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.537+0000 7f247f400640 1 --2- 172.21.15.84:0/2789955866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2480104d80 0x7f2480115430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:52.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.537+0000 7f247f400640 1 -- 172.21.15.84:0/2789955866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2470005040 con 0x7f24801043e0 2024-04-26T21:38:52.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.537+0000 7f247f400640 1 --2- 172.21.15.84:0/2789955866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24801043e0 0x7f2480114ef0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f24700047f0 tx=0x7f2470009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:52.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.538+0000 7f2477400640 1 -- 172.21.15.84:0/2789955866 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24700094c0 con 0x7f24801043e0 2024-04-26T21:38:52.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.538+0000 7f2477400640 1 -- 172.21.15.84:0/2789955866 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2470032e50 con 0x7f24801043e0 2024-04-26T21:38:52.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.538+0000 7f2486400640 1 -- 172.21.15.84:0/2789955866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248010f300 con 0x7f24801043e0 2024-04-26T21:38:52.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.538+0000 7f2477400640 1 -- 172.21.15.84:0/2789955866 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24700433b0 con 0x7f24801043e0 2024-04-26T21:38:52.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.538+0000 7f2486400640 1 -- 172.21.15.84:0/2789955866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f248010f7c0 con 0x7f24801043e0 2024-04-26T21:38:52.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.539+0000 7f2486400640 1 -- 172.21.15.84:0/2789955866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24800ffb50 con 0x7f24801043e0 2024-04-26T21:38:52.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.540+0000 7f2477400640 1 -- 172.21.15.84:0/2789955866 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f247002f070 con 0x7f24801043e0 2024-04-26T21:38:52.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.541+0000 7f2477400640 1 --2- 172.21.15.84:0/2789955866 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f246406eb80 0x7f2464071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:52.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.541+0000 7f2477400640 1 -- 172.21.15.84:0/2789955866 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f24700b09b0 con 0x7f24801043e0 2024-04-26T21:38:52.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.541+0000 7f2477e00640 1 --2- 172.21.15.84:0/2789955866 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f246406eb80 0x7f2464071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:52.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.542+0000 7f2477e00640 1 --2- 172.21.15.84:0/2789955866 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f246406eb80 0x7f2464071030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f24801107b0 tx=0x7f246800b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:52.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.546+0000 7f2477400640 1 -- 172.21.15.84:0/2789955866 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f24700795a0 con 0x7f24801043e0 2024-04-26T21:38:52.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.789+0000 7f2486400640 1 -- 172.21.15.84:0/2789955866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 12, "format": "json"} v 0) v1 -- 0x7f2480110560 con 0x7f24801043e0 2024-04-26T21:38:52.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.791+0000 7f2477400640 1 -- 172.21.15.84:0/2789955866 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 12, "format": "json"}]=0 dumped fsmap epoch 12 v42) v1 ==== 107+0+4877 (secure 0 0 0) 0x7f247007cc60 con 0x7f24801043e0 2024-04-26T21:38:52.792 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:52.792 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/1543850087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1543850087},{"type":"v1","addr":"172.21.15.84:6829","nonce":1543850087}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:23:53.700069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14456,"mds_1":24231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14456":{"gid":14456,"name":"cephfs.smithi084.hbjunw","rank":0,"incarnation":3,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6827/1450914842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1450914842},{"type":"v1","addr":"172.21.15.84:6827","nonce":1450914842}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24231":{"gid":24231,"name":"cephfs.smithi120.qnkxcn","rank":1,"incarnation":6,"state":"up:active","state_seq":5,"addr":"172.21.15.120:6825/3398077484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3398077484},{"type":"v1","addr":"172.21.15.120:6825","nonce":3398077484}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:38:52.792 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 12 2024-04-26T21:38:52.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.793+0000 7f2486400640 1 -- 172.21.15.84:0/2789955866 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f246406eb80 msgr2=0x7f2464071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:52.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.793+0000 7f2486400640 1 --2- 172.21.15.84:0/2789955866 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f246406eb80 0x7f2464071030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f24801107b0 tx=0x7f246800b040 comp rx=0 tx=0).stop 2024-04-26T21:38:52.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.794+0000 7f2486400640 1 -- 172.21.15.84:0/2789955866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24801043e0 msgr2=0x7f2480114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:52.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.794+0000 7f2486400640 1 --2- 172.21.15.84:0/2789955866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24801043e0 0x7f2480114ef0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f24700047f0 tx=0x7f2470009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:52.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.794+0000 7f2486400640 1 -- 172.21.15.84:0/2789955866 shutdown_connections 2024-04-26T21:38:52.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.794+0000 7f2486400640 1 --2- 172.21.15.84:0/2789955866 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f246406eb80 0x7f2464071030 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:52.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.794+0000 7f2486400640 1 --2- 172.21.15.84:0/2789955866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2480104d80 0x7f2480115430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:52.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.794+0000 7f2486400640 1 --2- 172.21.15.84:0/2789955866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24801043e0 0x7f2480114ef0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:52.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.794+0000 7f2486400640 1 -- 172.21.15.84:0/2789955866 >> 172.21.15.84:0/2789955866 conn(0x7f24800f9f90 msgr2=0x7f24800faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:52.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.794+0000 7f2486400640 1 -- 172.21.15.84:0/2789955866 shutdown_connections 2024-04-26T21:38:52.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:52.794+0000 7f2486400640 1 -- 172.21.15.84:0/2789955866 wait complete. 2024-04-26T21:38:52.813 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 13 2024-04-26T21:38:53.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.000+0000 7f6c52200640 1 -- 172.21.15.84:0/2963846413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c4c101ff0 msgr2=0x7f6c4c1023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:53.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.000+0000 7f6c52200640 1 --2- 172.21.15.84:0/2963846413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c4c101ff0 0x7f6c4c1023c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0048d0 tx=0x7f6c3c009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:53.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.000+0000 7f6c52200640 1 -- 172.21.15.84:0/2963846413 shutdown_connections 2024-04-26T21:38:53.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.000+0000 7f6c52200640 1 --2- 172.21.15.84:0/2963846413 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4c102990 0x7f6c4c0fc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:53.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.000+0000 7f6c52200640 1 --2- 172.21.15.84:0/2963846413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c4c101ff0 0x7f6c4c1023c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:53.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.000+0000 7f6c52200640 1 -- 172.21.15.84:0/2963846413 >> 172.21.15.84:0/2963846413 conn(0x7f6c4c0f7be0 msgr2=0x7f6c4c0f9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:53.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.000+0000 7f6c52200640 1 -- 172.21.15.84:0/2963846413 shutdown_connections 2024-04-26T21:38:53.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.000+0000 7f6c52200640 1 -- 172.21.15.84:0/2963846413 wait complete. 2024-04-26T21:38:53.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.001+0000 7f6c52200640 1 Processor -- start 2024-04-26T21:38:53.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.001+0000 7f6c52200640 1 -- start start 2024-04-26T21:38:53.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.001+0000 7f6c52200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c4c101ff0 0x7f6c4c114d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:53.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.001+0000 7f6c52200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4c102990 0x7f6c4c115280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:53.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.001+0000 7f6c52200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c115880 con 0x7f6c4c101ff0 2024-04-26T21:38:53.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.001+0000 7f6c52200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c10eed0 con 0x7f6c4c102990 2024-04-26T21:38:53.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.001+0000 7f6c50e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c4c101ff0 0x7f6c4c114d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:53.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.001+0000 7f6c50e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c4c101ff0 0x7f6c4c114d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37434/0 (socket says 172.21.15.84:37434) 2024-04-26T21:38:53.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.001+0000 7f6c50e00640 1 -- 172.21.15.84:0/3263745590 learned_addr learned my addr 172.21.15.84:0/3263745590 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:53.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.002+0000 7f6c50e00640 1 -- 172.21.15.84:0/3263745590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4c102990 msgr2=0x7f6c4c115280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:53.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.002+0000 7f6c50e00640 1 --2- 172.21.15.84:0/3263745590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4c102990 0x7f6c4c115280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:53.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.002+0000 7f6c50e00640 1 -- 172.21.15.84:0/3263745590 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3c005040 con 0x7f6c4c101ff0 2024-04-26T21:38:53.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.002+0000 7f6c50e00640 1 --2- 172.21.15.84:0/3263745590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c4c101ff0 0x7f6c4c114d40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0047f0 tx=0x7f6c3c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:53.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.002+0000 7f6c48c00640 1 -- 172.21.15.84:0/3263745590 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c3c0094c0 con 0x7f6c4c101ff0 2024-04-26T21:38:53.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.002+0000 7f6c48c00640 1 -- 172.21.15.84:0/3263745590 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c3c032e50 con 0x7f6c4c101ff0 2024-04-26T21:38:53.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.002+0000 7f6c48c00640 1 -- 172.21.15.84:0/3263745590 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c3c0433b0 con 0x7f6c4c101ff0 2024-04-26T21:38:53.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.003+0000 7f6c52200640 1 -- 172.21.15.84:0/3263745590 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c10f150 con 0x7f6c4c101ff0 2024-04-26T21:38:53.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.003+0000 7f6c52200640 1 -- 172.21.15.84:0/3263745590 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4c10f610 con 0x7f6c4c101ff0 2024-04-26T21:38:53.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.004+0000 7f6c52200640 1 -- 172.21.15.84:0/3263745590 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4c0fd760 con 0x7f6c4c101ff0 2024-04-26T21:38:53.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.005+0000 7f6c48c00640 1 -- 172.21.15.84:0/3263745590 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6c3c02f070 con 0x7f6c4c101ff0 2024-04-26T21:38:53.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.006+0000 7f6c48c00640 1 --2- 172.21.15.84:0/3263745590 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6c3006eb80 0x7f6c30071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:53.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.006+0000 7f6c48c00640 1 -- 172.21.15.84:0/3263745590 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f6c3c0b0870 con 0x7f6c4c101ff0 2024-04-26T21:38:53.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.006+0000 7f6c4be00640 1 --2- 172.21.15.84:0/3263745590 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6c3006eb80 0x7f6c30071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:53.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.007+0000 7f6c4be00640 1 --2- 172.21.15.84:0/3263745590 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6c3006eb80 0x7f6c30071030 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c110600 tx=0x7f6c34004f70 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:53.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.011+0000 7f6c48c00640 1 -- 172.21.15.84:0/3263745590 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f6c3c0794c0 con 0x7f6c4c101ff0 2024-04-26T21:38:53.060 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:53 smithi084 ceph-mon[90138]: pgmap v383: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:53.060 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:53 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3240655930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T21:38:53.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.245+0000 7f6c52200640 1 -- 172.21.15.84:0/3263745590 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 13, "format": "json"} v 0) v1 -- 0x7f6c4c109180 con 0x7f6c4c101ff0 2024-04-26T21:38:53.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.246+0000 7f6c48c00640 1 -- 172.21.15.84:0/3263745590 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 13, "format": "json"}]=0 dumped fsmap epoch 13 v42) v1 ==== 107+0+4876 (secure 0 0 0) 0x7f6c3c07cb80 con 0x7f6c4c101ff0 2024-04-26T21:38:53.247 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:53.247 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/1543850087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1543850087},{"type":"v1","addr":"172.21.15.84:6829","nonce":1543850087}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:26:54.045607+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14456,"mds_1":24231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14456":{"gid":14456,"name":"cephfs.smithi084.hbjunw","rank":0,"incarnation":3,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6827/1450914842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1450914842},{"type":"v1","addr":"172.21.15.84:6827","nonce":1450914842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24231":{"gid":24231,"name":"cephfs.smithi120.qnkxcn","rank":1,"incarnation":6,"state":"up:active","state_seq":5,"addr":"172.21.15.120:6825/3398077484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3398077484},{"type":"v1","addr":"172.21.15.120:6825","nonce":3398077484}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:38:53.248 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 13 2024-04-26T21:38:53.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.248+0000 7f6c52200640 1 -- 172.21.15.84:0/3263745590 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6c3006eb80 msgr2=0x7f6c30071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.248+0000 7f6c52200640 1 --2- 172.21.15.84:0/3263745590 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6c3006eb80 0x7f6c30071030 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c110600 tx=0x7f6c34004f70 comp rx=0 tx=0).stop 2024-04-26T21:38:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.248+0000 7f6c52200640 1 -- 172.21.15.84:0/3263745590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c4c101ff0 msgr2=0x7f6c4c114d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.248+0000 7f6c52200640 1 --2- 172.21.15.84:0/3263745590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c4c101ff0 0x7f6c4c114d40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0047f0 tx=0x7f6c3c009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.248+0000 7f6c52200640 1 -- 172.21.15.84:0/3263745590 shutdown_connections 2024-04-26T21:38:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.248+0000 7f6c52200640 1 --2- 172.21.15.84:0/3263745590 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6c3006eb80 0x7f6c30071030 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.248+0000 7f6c52200640 1 --2- 172.21.15.84:0/3263745590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4c102990 0x7f6c4c115280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.248+0000 7f6c52200640 1 --2- 172.21.15.84:0/3263745590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c4c101ff0 0x7f6c4c114d40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.248+0000 7f6c52200640 1 -- 172.21.15.84:0/3263745590 >> 172.21.15.84:0/3263745590 conn(0x7f6c4c0f7be0 msgr2=0x7f6c4c070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.248+0000 7f6c52200640 1 -- 172.21.15.84:0/3263745590 shutdown_connections 2024-04-26T21:38:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.248+0000 7f6c52200640 1 -- 172.21.15.84:0/3263745590 wait complete. 2024-04-26T21:38:53.266 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 14 2024-04-26T21:38:53.327 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:53 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2789955866' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 12, "format": "json"}]: dispatch 2024-04-26T21:38:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:53 smithi120 ceph-mon[79001]: pgmap v383: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:53 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3240655930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T21:38:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:53 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2789955866' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 12, "format": "json"}]: dispatch 2024-04-26T21:38:53.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.451+0000 7f3fb2000640 1 -- 172.21.15.84:0/3709230089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fac06fd50 msgr2=0x7f3fac0701c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:53.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.451+0000 7f3fb2000640 1 --2- 172.21.15.84:0/3709230089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fac06fd50 0x7f3fac0701c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3f940048d0 tx=0x7f3f94009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:53.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.451+0000 7f3fb2000640 1 -- 172.21.15.84:0/3709230089 shutdown_connections 2024-04-26T21:38:53.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.451+0000 7f3fb2000640 1 --2- 172.21.15.84:0/3709230089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fac06fd50 0x7f3fac0701c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:53.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.451+0000 7f3fb2000640 1 --2- 172.21.15.84:0/3709230089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fac071440 0x7f3fac06f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:53.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.451+0000 7f3fb2000640 1 -- 172.21.15.84:0/3709230089 >> 172.21.15.84:0/3709230089 conn(0x7f3fac0f7f90 msgr2=0x7f3fac0fa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:53.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.451+0000 7f3fb2000640 1 -- 172.21.15.84:0/3709230089 shutdown_connections 2024-04-26T21:38:53.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.451+0000 7f3fb2000640 1 -- 172.21.15.84:0/3709230089 wait complete. 2024-04-26T21:38:53.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.452+0000 7f3fb2000640 1 Processor -- start 2024-04-26T21:38:53.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.452+0000 7f3fb2000640 1 -- start start 2024-04-26T21:38:53.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.452+0000 7f3fb2000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fac06fd50 0x7f3fac119580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:53.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.452+0000 7f3fb2000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fac071440 0x7f3fac119ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:53.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.452+0000 7f3fb2000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac11a110 con 0x7f3fac071440 2024-04-26T21:38:53.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.452+0000 7f3fb2000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac113730 con 0x7f3fac06fd50 2024-04-26T21:38:53.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.452+0000 7f3fa3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fac071440 0x7f3fac119ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:53.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.452+0000 7f3fa3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fac071440 0x7f3fac119ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37450/0 (socket says 172.21.15.84:37450) 2024-04-26T21:38:53.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.452+0000 7f3fa3e00640 1 -- 172.21.15.84:0/1013473740 learned_addr learned my addr 172.21.15.84:0/1013473740 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:53.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.453+0000 7f3fa3e00640 1 -- 172.21.15.84:0/1013473740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fac06fd50 msgr2=0x7f3fac119580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:53.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.453+0000 7f3fab400640 1 --2- 172.21.15.84:0/1013473740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fac06fd50 0x7f3fac119580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:53.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.453+0000 7f3fa3e00640 1 --2- 172.21.15.84:0/1013473740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fac06fd50 0x7f3fac119580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:53.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.453+0000 7f3fa3e00640 1 -- 172.21.15.84:0/1013473740 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f94005040 con 0x7f3fac071440 2024-04-26T21:38:53.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.453+0000 7f3fa3e00640 1 --2- 172.21.15.84:0/1013473740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fac071440 0x7f3fac119ac0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3f940048a0 tx=0x7f3f94009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:53.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.453+0000 7f3fa3400640 1 -- 172.21.15.84:0/1013473740 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f940092e0 con 0x7f3fac071440 2024-04-26T21:38:53.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.454+0000 7f3fa3400640 1 -- 172.21.15.84:0/1013473740 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f94009440 con 0x7f3fac071440 2024-04-26T21:38:53.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.454+0000 7f3fa3400640 1 -- 172.21.15.84:0/1013473740 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f94043640 con 0x7f3fac071440 2024-04-26T21:38:53.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.454+0000 7f3fb2000640 1 -- 172.21.15.84:0/1013473740 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fac1139b0 con 0x7f3fac071440 2024-04-26T21:38:53.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.454+0000 7f3fb2000640 1 -- 172.21.15.84:0/1013473740 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fac113ed0 con 0x7f3fac071440 2024-04-26T21:38:53.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.455+0000 7f3fb2000640 1 -- 172.21.15.84:0/1013473740 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fac070f50 con 0x7f3fac071440 2024-04-26T21:38:53.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.456+0000 7f3fa3400640 1 -- 172.21.15.84:0/1013473740 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3f9403b420 con 0x7f3fac071440 2024-04-26T21:38:53.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.457+0000 7f3fa3400640 1 --2- 172.21.15.84:0/1013473740 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f3f9006eb70 0x7f3f90071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:53.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.457+0000 7f3fa3400640 1 -- 172.21.15.84:0/1013473740 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f3f940b13e0 con 0x7f3fac071440 2024-04-26T21:38:53.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.457+0000 7f3fab400640 1 --2- 172.21.15.84:0/1013473740 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f3f9006eb70 0x7f3f90071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:53.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.458+0000 7f3fab400640 1 --2- 172.21.15.84:0/1013473740 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f3f9006eb70 0x7f3f90071020 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c004ce0 tx=0x7f3f9c00b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:53.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.461+0000 7f3fa3400640 1 -- 172.21.15.84:0/1013473740 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f3f9407a0b0 con 0x7f3fac071440 2024-04-26T21:38:53.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.685+0000 7f3fb2000640 1 -- 172.21.15.84:0/1013473740 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 14, "format": "json"} v 0) v1 -- 0x7f3fac114bf0 con 0x7f3fac071440 2024-04-26T21:38:53.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.686+0000 7f3fa3400640 1 -- 172.21.15.84:0/1013473740 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 14, "format": "json"}]=0 dumped fsmap epoch 14 v42) v1 ==== 107+0+4877 (secure 0 0 0) 0x7f3f9407d770 con 0x7f3fac071440 2024-04-26T21:38:53.688 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:53.688 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/1543850087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1543850087},{"type":"v1","addr":"172.21.15.84:6829","nonce":1543850087}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:27:02.728852+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14456,"mds_1":24231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14456":{"gid":14456,"name":"cephfs.smithi084.hbjunw","rank":0,"incarnation":3,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6827/1450914842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1450914842},{"type":"v1","addr":"172.21.15.84:6827","nonce":1450914842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24231":{"gid":24231,"name":"cephfs.smithi120.qnkxcn","rank":1,"incarnation":6,"state":"up:active","state_seq":5,"addr":"172.21.15.120:6825/3398077484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3398077484},{"type":"v1","addr":"172.21.15.120:6825","nonce":3398077484}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:38:53.688 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 14 2024-04-26T21:38:53.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.689+0000 7f3fb2000640 1 -- 172.21.15.84:0/1013473740 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f3f9006eb70 msgr2=0x7f3f90071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:53.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.689+0000 7f3fb2000640 1 --2- 172.21.15.84:0/1013473740 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f3f9006eb70 0x7f3f90071020 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c004ce0 tx=0x7f3f9c00b040 comp rx=0 tx=0).stop 2024-04-26T21:38:53.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.689+0000 7f3fb2000640 1 -- 172.21.15.84:0/1013473740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fac071440 msgr2=0x7f3fac119ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:53.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.689+0000 7f3fb2000640 1 --2- 172.21.15.84:0/1013473740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fac071440 0x7f3fac119ac0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3f940048a0 tx=0x7f3f94009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:53.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.689+0000 7f3fb2000640 1 -- 172.21.15.84:0/1013473740 shutdown_connections 2024-04-26T21:38:53.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.689+0000 7f3fb2000640 1 --2- 172.21.15.84:0/1013473740 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f3f9006eb70 0x7f3f90071020 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:53.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.689+0000 7f3fb2000640 1 --2- 172.21.15.84:0/1013473740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fac071440 0x7f3fac119ac0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:53.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.689+0000 7f3fb2000640 1 --2- 172.21.15.84:0/1013473740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fac06fd50 0x7f3fac119580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:53.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.689+0000 7f3fb2000640 1 -- 172.21.15.84:0/1013473740 >> 172.21.15.84:0/1013473740 conn(0x7f3fac0f7f90 msgr2=0x7f3fac0f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:53.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.689+0000 7f3fb2000640 1 -- 172.21.15.84:0/1013473740 shutdown_connections 2024-04-26T21:38:53.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.689+0000 7f3fb2000640 1 -- 172.21.15.84:0/1013473740 wait complete. 2024-04-26T21:38:53.708 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 15 2024-04-26T21:38:53.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.897+0000 7f363de00640 1 -- 172.21.15.84:0/1605698415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f363806fd50 msgr2=0x7f36380701c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:53.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.897+0000 7f363de00640 1 --2- 172.21.15.84:0/1605698415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f363806fd50 0x7f36380701c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f36240048d0 tx=0x7f3624009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:53.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.897+0000 7f363de00640 1 -- 172.21.15.84:0/1605698415 shutdown_connections 2024-04-26T21:38:53.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.897+0000 7f363de00640 1 --2- 172.21.15.84:0/1605698415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f363806fd50 0x7f36380701c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:53.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.897+0000 7f363de00640 1 --2- 172.21.15.84:0/1605698415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3638071440 0x7f363806f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:53.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.897+0000 7f363de00640 1 -- 172.21.15.84:0/1605698415 >> 172.21.15.84:0/1605698415 conn(0x7f36380f7fa0 msgr2=0x7f36380fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:53.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.897+0000 7f363de00640 1 -- 172.21.15.84:0/1605698415 shutdown_connections 2024-04-26T21:38:53.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.897+0000 7f363de00640 1 -- 172.21.15.84:0/1605698415 wait complete. 2024-04-26T21:38:53.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.898+0000 7f363de00640 1 Processor -- start 2024-04-26T21:38:53.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.898+0000 7f363de00640 1 -- start start 2024-04-26T21:38:53.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.898+0000 7f363de00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f363806fd50 0x7f3638119510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:53.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.898+0000 7f363de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3638071440 0x7f3638119a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:53.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.898+0000 7f363de00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363811a0a0 con 0x7f3638071440 2024-04-26T21:38:53.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.898+0000 7f363de00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36381136c0 con 0x7f363806fd50 2024-04-26T21:38:53.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.898+0000 7f3636000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3638071440 0x7f3638119a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:53.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.899+0000 7f3636000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3638071440 0x7f3638119a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37464/0 (socket says 172.21.15.84:37464) 2024-04-26T21:38:53.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.899+0000 7f3636000640 1 -- 172.21.15.84:0/1030889646 learned_addr learned my addr 172.21.15.84:0/1030889646 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:53.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.899+0000 7f3636a00640 1 --2- 172.21.15.84:0/1030889646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f363806fd50 0x7f3638119510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:53.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.899+0000 7f3636000640 1 -- 172.21.15.84:0/1030889646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f363806fd50 msgr2=0x7f3638119510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:53.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.899+0000 7f3636000640 1 --2- 172.21.15.84:0/1030889646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f363806fd50 0x7f3638119510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:53.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.899+0000 7f3636000640 1 -- 172.21.15.84:0/1030889646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3624005040 con 0x7f3638071440 2024-04-26T21:38:53.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.899+0000 7f3636a00640 1 --2- 172.21.15.84:0/1030889646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f363806fd50 0x7f3638119510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:38:53.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.899+0000 7f3636000640 1 --2- 172.21.15.84:0/1030889646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3638071440 0x7f3638119a50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f36240048a0 tx=0x7f3624009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:53.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.900+0000 7f362ea00640 1 -- 172.21.15.84:0/1030889646 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36240092e0 con 0x7f3638071440 2024-04-26T21:38:53.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.900+0000 7f362ea00640 1 -- 172.21.15.84:0/1030889646 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3624009440 con 0x7f3638071440 2024-04-26T21:38:53.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.900+0000 7f362ea00640 1 -- 172.21.15.84:0/1030889646 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3624043640 con 0x7f3638071440 2024-04-26T21:38:53.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.900+0000 7f363de00640 1 -- 172.21.15.84:0/1030889646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3638113940 con 0x7f3638071440 2024-04-26T21:38:53.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.900+0000 7f363de00640 1 -- 172.21.15.84:0/1030889646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3638113e60 con 0x7f3638071440 2024-04-26T21:38:53.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.901+0000 7f363de00640 1 -- 172.21.15.84:0/1030889646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3638070f50 con 0x7f3638071440 2024-04-26T21:38:53.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.902+0000 7f362ea00640 1 -- 172.21.15.84:0/1030889646 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f362403b420 con 0x7f3638071440 2024-04-26T21:38:53.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.903+0000 7f362ea00640 1 --2- 172.21.15.84:0/1030889646 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f361c06eb80 0x7f361c071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:53.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.903+0000 7f362ea00640 1 -- 172.21.15.84:0/1030889646 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f36240b1760 con 0x7f3638071440 2024-04-26T21:38:53.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.904+0000 7f3636a00640 1 --2- 172.21.15.84:0/1030889646 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f361c06eb80 0x7f361c071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:53.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.904+0000 7f3636a00640 1 --2- 172.21.15.84:0/1030889646 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f361c06eb80 0x7f361c071030 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3628004d80 tx=0x7f362800b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:53.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:53.908+0000 7f362ea00640 1 -- 172.21.15.84:0/1030889646 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f362407a410 con 0x7f3638071440 2024-04-26T21:38:54.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.151+0000 7f363de00640 1 -- 172.21.15.84:0/1030889646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7f3638114bf0 con 0x7f3638071440 2024-04-26T21:38:54.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.152+0000 7f362ea00640 1 -- 172.21.15.84:0/1030889646 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v42) v1 ==== 107+0+4878 (secure 0 0 0) 0x7f3638114bf0 con 0x7f3638071440 2024-04-26T21:38:54.154 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:54.154 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/1543850087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1543850087},{"type":"v1","addr":"172.21.15.84:6829","nonce":1543850087}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:27:24.731661+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14456,"mds_1":24231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14456":{"gid":14456,"name":"cephfs.smithi084.hbjunw","rank":0,"incarnation":3,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6827/1450914842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1450914842},{"type":"v1","addr":"172.21.15.84:6827","nonce":1450914842}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24231":{"gid":24231,"name":"cephfs.smithi120.qnkxcn","rank":1,"incarnation":6,"state":"up:active","state_seq":5,"addr":"172.21.15.120:6825/3398077484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3398077484},{"type":"v1","addr":"172.21.15.120:6825","nonce":3398077484}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:38:54.154 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 15 2024-04-26T21:38:54.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.155+0000 7f363de00640 1 -- 172.21.15.84:0/1030889646 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f361c06eb80 msgr2=0x7f361c071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:54.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.155+0000 7f363de00640 1 --2- 172.21.15.84:0/1030889646 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f361c06eb80 0x7f361c071030 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3628004d80 tx=0x7f362800b040 comp rx=0 tx=0).stop 2024-04-26T21:38:54.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.155+0000 7f363de00640 1 -- 172.21.15.84:0/1030889646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3638071440 msgr2=0x7f3638119a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:54.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.155+0000 7f363de00640 1 --2- 172.21.15.84:0/1030889646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3638071440 0x7f3638119a50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f36240048a0 tx=0x7f3624009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:54.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.155+0000 7f363de00640 1 -- 172.21.15.84:0/1030889646 shutdown_connections 2024-04-26T21:38:54.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.155+0000 7f363de00640 1 --2- 172.21.15.84:0/1030889646 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f361c06eb80 0x7f361c071030 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:54.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.155+0000 7f363de00640 1 --2- 172.21.15.84:0/1030889646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3638071440 0x7f3638119a50 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:54.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.155+0000 7f363de00640 1 --2- 172.21.15.84:0/1030889646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f363806fd50 0x7f3638119510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:54.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.155+0000 7f363de00640 1 -- 172.21.15.84:0/1030889646 >> 172.21.15.84:0/1030889646 conn(0x7f36380f7fa0 msgr2=0x7f36380f9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:54.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.155+0000 7f363de00640 1 -- 172.21.15.84:0/1030889646 shutdown_connections 2024-04-26T21:38:54.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.155+0000 7f363de00640 1 -- 172.21.15.84:0/1030889646 wait complete. 2024-04-26T21:38:54.175 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2024-04-26T21:38:54.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.366+0000 7fb792c00640 1 -- 172.21.15.84:0/3169383300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb78c108680 msgr2=0x7fb78c108a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:54.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.366+0000 7fb792c00640 1 --2- 172.21.15.84:0/3169383300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb78c108680 0x7fb78c108a50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0048d0 tx=0x7fb77c009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:54.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.367+0000 7fb792c00640 1 -- 172.21.15.84:0/3169383300 shutdown_connections 2024-04-26T21:38:54.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.367+0000 7fb792c00640 1 --2- 172.21.15.84:0/3169383300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb78c102670 0x7fb78c102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:54.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.367+0000 7fb792c00640 1 --2- 172.21.15.84:0/3169383300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb78c108680 0x7fb78c108a50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:54.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.367+0000 7fb792c00640 1 -- 172.21.15.84:0/3169383300 >> 172.21.15.84:0/3169383300 conn(0x7fb78c071e60 msgr2=0x7fb78c074270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:54.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.367+0000 7fb792c00640 1 -- 172.21.15.84:0/3169383300 shutdown_connections 2024-04-26T21:38:54.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.367+0000 7fb792c00640 1 -- 172.21.15.84:0/3169383300 wait complete. 2024-04-26T21:38:54.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.368+0000 7fb792c00640 1 Processor -- start 2024-04-26T21:38:54.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.368+0000 7fb792c00640 1 -- start start 2024-04-26T21:38:54.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.368+0000 7fb792c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb78c102670 0x7fb78c119160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:54.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.368+0000 7fb792c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb78c108680 0x7fb78c1196a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:54.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.368+0000 7fb792c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c119d30 con 0x7fb78c102670 2024-04-26T21:38:54.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.368+0000 7fb792c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c1132f0 con 0x7fb78c108680 2024-04-26T21:38:54.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.368+0000 7fb791800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb78c102670 0x7fb78c119160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:54.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.368+0000 7fb791800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb78c102670 0x7fb78c119160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37482/0 (socket says 172.21.15.84:37482) 2024-04-26T21:38:54.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.368+0000 7fb791800640 1 -- 172.21.15.84:0/2147493165 learned_addr learned my addr 172.21.15.84:0/2147493165 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:54.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.369+0000 7fb791800640 1 -- 172.21.15.84:0/2147493165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb78c108680 msgr2=0x7fb78c1196a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:54.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.369+0000 7fb791800640 1 --2- 172.21.15.84:0/2147493165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb78c108680 0x7fb78c1196a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:54.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.369+0000 7fb791800640 1 -- 172.21.15.84:0/2147493165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c005040 con 0x7fb78c102670 2024-04-26T21:38:54.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.369+0000 7fb791800640 1 --2- 172.21.15.84:0/2147493165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb78c102670 0x7fb78c119160 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0047f0 tx=0x7fb77c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:54.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.369+0000 7fb789600640 1 -- 172.21.15.84:0/2147493165 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb77c0094c0 con 0x7fb78c102670 2024-04-26T21:38:54.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.369+0000 7fb789600640 1 -- 172.21.15.84:0/2147493165 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb77c032e50 con 0x7fb78c102670 2024-04-26T21:38:54.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.369+0000 7fb792c00640 1 -- 172.21.15.84:0/2147493165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78c113570 con 0x7fb78c102670 2024-04-26T21:38:54.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.369+0000 7fb789600640 1 -- 172.21.15.84:0/2147493165 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb77c0435f0 con 0x7fb78c102670 2024-04-26T21:38:54.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.370+0000 7fb792c00640 1 -- 172.21.15.84:0/2147493165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78c113a30 con 0x7fb78c102670 2024-04-26T21:38:54.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.371+0000 7fb792c00640 1 -- 172.21.15.84:0/2147493165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78c103da0 con 0x7fb78c102670 2024-04-26T21:38:54.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.372+0000 7fb789600640 1 -- 172.21.15.84:0/2147493165 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb77c02f070 con 0x7fb78c102670 2024-04-26T21:38:54.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.373+0000 7fb789600640 1 --2- 172.21.15.84:0/2147493165 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb77406eb80 0x7fb774071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:54.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.373+0000 7fb789600640 1 -- 172.21.15.84:0/2147493165 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fb77c0b07e0 con 0x7fb78c102670 2024-04-26T21:38:54.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.373+0000 7fb790e00640 1 --2- 172.21.15.84:0/2147493165 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb77406eb80 0x7fb774071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:54.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.374+0000 7fb790e00640 1 --2- 172.21.15.84:0/2147493165 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb77406eb80 0x7fb774071030 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb78c114a20 tx=0x7fb780006d20 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:54.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.379+0000 7fb789600640 1 -- 172.21.15.84:0/2147493165 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fb77c079430 con 0x7fb78c102670 2024-04-26T21:38:54.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:54 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3263745590' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 13, "format": "json"}]: dispatch 2024-04-26T21:38:54.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:54 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/1013473740' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-04-26T21:38:54.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:54 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3263745590' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 13, "format": "json"}]: dispatch 2024-04-26T21:38:54.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:54 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/1013473740' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-04-26T21:38:54.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.604+0000 7fb792c00640 1 -- 172.21.15.84:0/2147493165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7fb78c10f840 con 0x7fb78c102670 2024-04-26T21:38:54.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.606+0000 7fb789600640 1 -- 172.21.15.84:0/2147493165 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v42) v1 ==== 107+0+4892 (secure 0 0 0) 0x7fb77c07caf0 con 0x7fb78c102670 2024-04-26T21:38:54.610 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:54.610 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/1543850087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1543850087},{"type":"v1","addr":"172.21.15.84:6829","nonce":1543850087}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:30:22.810662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14456,"mds_1":24231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14456":{"gid":14456,"name":"cephfs.smithi084.hbjunw","rank":0,"incarnation":3,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6827/1450914842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1450914842},{"type":"v1","addr":"172.21.15.84:6827","nonce":1450914842}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24231":{"gid":24231,"name":"cephfs.smithi120.qnkxcn","rank":1,"incarnation":6,"state":"up:active","state_seq":5,"addr":"172.21.15.120:6825/3398077484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3398077484},{"type":"v1","addr":"172.21.15.120:6825","nonce":3398077484}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14456,"qdb_cluster":[14456,24231]},"id":1}]} 2024-04-26T21:38:54.611 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2024-04-26T21:38:54.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.609+0000 7fb792c00640 1 -- 172.21.15.84:0/2147493165 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb77406eb80 msgr2=0x7fb774071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:54.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.609+0000 7fb792c00640 1 --2- 172.21.15.84:0/2147493165 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb77406eb80 0x7fb774071030 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb78c114a20 tx=0x7fb780006d20 comp rx=0 tx=0).stop 2024-04-26T21:38:54.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.609+0000 7fb792c00640 1 -- 172.21.15.84:0/2147493165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb78c102670 msgr2=0x7fb78c119160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:54.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.609+0000 7fb792c00640 1 --2- 172.21.15.84:0/2147493165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb78c102670 0x7fb78c119160 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0047f0 tx=0x7fb77c009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:54.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.609+0000 7fb792c00640 1 -- 172.21.15.84:0/2147493165 shutdown_connections 2024-04-26T21:38:54.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.609+0000 7fb792c00640 1 --2- 172.21.15.84:0/2147493165 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fb77406eb80 0x7fb774071030 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:54.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.609+0000 7fb792c00640 1 --2- 172.21.15.84:0/2147493165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb78c108680 0x7fb78c1196a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:54.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.609+0000 7fb792c00640 1 --2- 172.21.15.84:0/2147493165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb78c102670 0x7fb78c119160 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:54.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.609+0000 7fb792c00640 1 -- 172.21.15.84:0/2147493165 >> 172.21.15.84:0/2147493165 conn(0x7fb78c071e60 msgr2=0x7fb78c073dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:54.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.609+0000 7fb792c00640 1 -- 172.21.15.84:0/2147493165 shutdown_connections 2024-04-26T21:38:54.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.609+0000 7fb792c00640 1 -- 172.21.15.84:0/2147493165 wait complete. 2024-04-26T21:38:54.629 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-04-26T21:38:54.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.821+0000 7f4f62400640 1 -- 172.21.15.84:0/1726712599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f5c1043e0 msgr2=0x7f4f5c1047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:54.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.821+0000 7f4f62400640 1 --2- 172.21.15.84:0/1726712599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f5c1043e0 0x7f4f5c1047b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c009c50 tx=0x7f4f4c004d10 comp rx=0 tx=0).stop 2024-04-26T21:38:54.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.821+0000 7f4f62400640 1 -- 172.21.15.84:0/1726712599 shutdown_connections 2024-04-26T21:38:54.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.821+0000 7f4f62400640 1 --2- 172.21.15.84:0/1726712599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f5c104d80 0x7f4f5c0fe410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:54.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.821+0000 7f4f62400640 1 --2- 172.21.15.84:0/1726712599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f5c1043e0 0x7f4f5c1047b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:54.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.821+0000 7f4f62400640 1 -- 172.21.15.84:0/1726712599 >> 172.21.15.84:0/1726712599 conn(0x7f4f5c0f9f90 msgr2=0x7f4f5c0fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:54.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.821+0000 7f4f62400640 1 -- 172.21.15.84:0/1726712599 shutdown_connections 2024-04-26T21:38:54.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.822+0000 7f4f62400640 1 -- 172.21.15.84:0/1726712599 wait complete. 2024-04-26T21:38:54.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.822+0000 7f4f62400640 1 Processor -- start 2024-04-26T21:38:54.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.823+0000 7f4f62400640 1 -- start start 2024-04-26T21:38:54.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.823+0000 7f4f62400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f5c1043e0 0x7f4f5c114ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:54.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.823+0000 7f4f62400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f5c104d80 0x7f4f5c115430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:54.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.823+0000 7f4f62400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c115a30 con 0x7f4f5c1043e0 2024-04-26T21:38:54.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.823+0000 7f4f62400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c10f080 con 0x7f4f5c104d80 2024-04-26T21:38:54.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.823+0000 7f4f5b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f5c1043e0 0x7f4f5c114ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:54.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.823+0000 7f4f5b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f5c1043e0 0x7f4f5c114ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37496/0 (socket says 172.21.15.84:37496) 2024-04-26T21:38:54.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.823+0000 7f4f5b400640 1 -- 172.21.15.84:0/2420522669 learned_addr learned my addr 172.21.15.84:0/2420522669 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:54.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.824+0000 7f4f5b400640 1 -- 172.21.15.84:0/2420522669 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f5c104d80 msgr2=0x7f4f5c115430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:54.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.824+0000 7f4f5b400640 1 --2- 172.21.15.84:0/2420522669 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f5c104d80 0x7f4f5c115430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:54.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.824+0000 7f4f5b400640 1 -- 172.21.15.84:0/2420522669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c0098b0 con 0x7f4f5c1043e0 2024-04-26T21:38:54.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.824+0000 7f4f5b400640 1 --2- 172.21.15.84:0/2420522669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f5c1043e0 0x7f4f5c114ef0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c02c1f0 tx=0x7f4f4c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:54.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.824+0000 7f4f53e00640 1 -- 172.21.15.84:0/2420522669 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f4c03a070 con 0x7f4f5c1043e0 2024-04-26T21:38:54.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.824+0000 7f4f53e00640 1 -- 172.21.15.84:0/2420522669 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f4c004610 con 0x7f4f5c1043e0 2024-04-26T21:38:54.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.824+0000 7f4f53e00640 1 -- 172.21.15.84:0/2420522669 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f4c03ebe0 con 0x7f4f5c1043e0 2024-04-26T21:38:54.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.824+0000 7f4f62400640 1 -- 172.21.15.84:0/2420522669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5c10f300 con 0x7f4f5c1043e0 2024-04-26T21:38:54.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.824+0000 7f4f62400640 1 -- 172.21.15.84:0/2420522669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5c10f8a0 con 0x7f4f5c1043e0 2024-04-26T21:38:54.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.826+0000 7f4f62400640 1 -- 172.21.15.84:0/2420522669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5c0ffb50 con 0x7f4f5c1043e0 2024-04-26T21:38:54.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.827+0000 7f4f53e00640 1 -- 172.21.15.84:0/2420522669 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4f4c032070 con 0x7f4f5c1043e0 2024-04-26T21:38:54.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.827+0000 7f4f53e00640 1 --2- 172.21.15.84:0/2420522669 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f4f4006eb80 0x7f4f40071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:54.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.828+0000 7f4f53e00640 1 -- 172.21.15.84:0/2420522669 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f4f4c0b0dc0 con 0x7f4f5c1043e0 2024-04-26T21:38:54.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.828+0000 7f4f52a00640 1 --2- 172.21.15.84:0/2420522669 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f4f4006eb80 0x7f4f40071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:54.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.828+0000 7f4f52a00640 1 --2- 172.21.15.84:0/2420522669 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f4f4006eb80 0x7f4f40071030 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c1107b0 tx=0x7f4f44009c50 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:54.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:54.832+0000 7f4f53e00640 1 -- 172.21.15.84:0/2420522669 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f4f4c079b40 con 0x7f4f5c1043e0 2024-04-26T21:38:55.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.074+0000 7f4f62400640 1 -- 172.21.15.84:0/2420522669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f4f5c10b570 con 0x7f4f5c1043e0 2024-04-26T21:38:55.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.078+0000 7f4f53e00640 1 -- 172.21.15.84:0/2420522669 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v42) v1 ==== 107+0+4891 (secure 0 0 0) 0x7f4f4c07d200 con 0x7f4f5c1043e0 2024-04-26T21:38:55.080 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:55.080 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/1543850087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1543850087},{"type":"v1","addr":"172.21.15.84:6829","nonce":1543850087}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:30:28.772328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14456,"mds_1":24231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14456":{"gid":14456,"name":"cephfs.smithi084.hbjunw","rank":0,"incarnation":3,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6827/1450914842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1450914842},{"type":"v1","addr":"172.21.15.84:6827","nonce":1450914842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24231":{"gid":24231,"name":"cephfs.smithi120.qnkxcn","rank":1,"incarnation":6,"state":"up:active","state_seq":5,"addr":"172.21.15.120:6825/3398077484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3398077484},{"type":"v1","addr":"172.21.15.120:6825","nonce":3398077484}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14456,"qdb_cluster":[24231,14456]},"id":1}]} 2024-04-26T21:38:55.080 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2024-04-26T21:38:55.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.081+0000 7f4f62400640 1 -- 172.21.15.84:0/2420522669 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f4f4006eb80 msgr2=0x7f4f40071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:55.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.081+0000 7f4f62400640 1 --2- 172.21.15.84:0/2420522669 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f4f4006eb80 0x7f4f40071030 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c1107b0 tx=0x7f4f44009c50 comp rx=0 tx=0).stop 2024-04-26T21:38:55.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.081+0000 7f4f62400640 1 -- 172.21.15.84:0/2420522669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f5c1043e0 msgr2=0x7f4f5c114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:55.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.081+0000 7f4f62400640 1 --2- 172.21.15.84:0/2420522669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f5c1043e0 0x7f4f5c114ef0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c02c1f0 tx=0x7f4f4c004d10 comp rx=0 tx=0).stop 2024-04-26T21:38:55.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.081+0000 7f4f62400640 1 -- 172.21.15.84:0/2420522669 shutdown_connections 2024-04-26T21:38:55.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.081+0000 7f4f62400640 1 --2- 172.21.15.84:0/2420522669 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f4f4006eb80 0x7f4f40071030 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:55.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.081+0000 7f4f62400640 1 --2- 172.21.15.84:0/2420522669 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f5c104d80 0x7f4f5c115430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:55.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.081+0000 7f4f62400640 1 --2- 172.21.15.84:0/2420522669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f5c1043e0 0x7f4f5c114ef0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:55.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.081+0000 7f4f62400640 1 -- 172.21.15.84:0/2420522669 >> 172.21.15.84:0/2420522669 conn(0x7f4f5c0f9f90 msgr2=0x7f4f5c0faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:55.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.081+0000 7f4f62400640 1 -- 172.21.15.84:0/2420522669 shutdown_connections 2024-04-26T21:38:55.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.081+0000 7f4f62400640 1 -- 172.21.15.84:0/2420522669 wait complete. 2024-04-26T21:38:55.101 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-04-26T21:38:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.291+0000 7f1272000640 1 -- 172.21.15.84:0/160864409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f126c104d80 msgr2=0x7f126c0fe410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.291+0000 7f1272000640 1 --2- 172.21.15.84:0/160864409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f126c104d80 0x7f126c0fe410 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f12540048d0 tx=0x7f1254009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.291+0000 7f1272000640 1 -- 172.21.15.84:0/160864409 shutdown_connections 2024-04-26T21:38:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.291+0000 7f1272000640 1 --2- 172.21.15.84:0/160864409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f126c104d80 0x7f126c0fe410 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.291+0000 7f1272000640 1 --2- 172.21.15.84:0/160864409 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f126c1043e0 0x7f126c1047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.291+0000 7f1272000640 1 -- 172.21.15.84:0/160864409 >> 172.21.15.84:0/160864409 conn(0x7f126c0f9f90 msgr2=0x7f126c0fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.291+0000 7f1272000640 1 -- 172.21.15.84:0/160864409 shutdown_connections 2024-04-26T21:38:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.291+0000 7f1272000640 1 -- 172.21.15.84:0/160864409 wait complete. 2024-04-26T21:38:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.292+0000 7f1272000640 1 Processor -- start 2024-04-26T21:38:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.292+0000 7f1272000640 1 -- start start 2024-04-26T21:38:55.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.292+0000 7f1272000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f126c1043e0 0x7f126c114e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.292+0000 7f1272000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f126c104d80 0x7f126c1153b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.292+0000 7f1272000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c1159b0 con 0x7f126c1043e0 2024-04-26T21:38:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.292+0000 7f1272000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c115b20 con 0x7f126c104d80 2024-04-26T21:38:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.293+0000 7f126b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f126c1043e0 0x7f126c114e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.293+0000 7f126b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f126c1043e0 0x7f126c114e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37522/0 (socket says 172.21.15.84:37522) 2024-04-26T21:38:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.293+0000 7f126b400640 1 -- 172.21.15.84:0/125685071 learned_addr learned my addr 172.21.15.84:0/125685071 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.293+0000 7f126aa00640 1 --2- 172.21.15.84:0/125685071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f126c104d80 0x7f126c1153b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.293+0000 7f126b400640 1 -- 172.21.15.84:0/125685071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f126c104d80 msgr2=0x7f126c1153b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.293+0000 7f126b400640 1 --2- 172.21.15.84:0/125685071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f126c104d80 0x7f126c1153b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.293+0000 7f126b400640 1 -- 172.21.15.84:0/125685071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1254005040 con 0x7f126c1043e0 2024-04-26T21:38:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.294+0000 7f126b400640 1 --2- 172.21.15.84:0/125685071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f126c1043e0 0x7f126c114e70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f126400cb10 tx=0x7f1264007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.294+0000 7f1263400640 1 -- 172.21.15.84:0/125685071 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1264004200 con 0x7f126c1043e0 2024-04-26T21:38:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.294+0000 7f1263400640 1 -- 172.21.15.84:0/125685071 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f126400acf0 con 0x7f126c1043e0 2024-04-26T21:38:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.294+0000 7f1263400640 1 -- 172.21.15.84:0/125685071 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1264003e40 con 0x7f126c1043e0 2024-04-26T21:38:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.294+0000 7f1272000640 1 -- 172.21.15.84:0/125685071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126c10f220 con 0x7f126c1043e0 2024-04-26T21:38:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.294+0000 7f1272000640 1 -- 172.21.15.84:0/125685071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c10f6f0 con 0x7f126c1043e0 2024-04-26T21:38:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.295+0000 7f1272000640 1 -- 172.21.15.84:0/125685071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c0ffb50 con 0x7f126c1043e0 2024-04-26T21:38:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.297+0000 7f1263400640 1 -- 172.21.15.84:0/125685071 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f126400a820 con 0x7f126c1043e0 2024-04-26T21:38:55.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.297+0000 7f1263400640 1 --2- 172.21.15.84:0/125685071 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f125006eb20 0x7f1250070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:55.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.298+0000 7f1263400640 1 -- 172.21.15.84:0/125685071 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f126408f1b0 con 0x7f126c1043e0 2024-04-26T21:38:55.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.298+0000 7f126aa00640 1 --2- 172.21.15.84:0/125685071 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f125006eb20 0x7f1250070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:55.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.298+0000 7f126aa00640 1 --2- 172.21.15.84:0/125685071 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f125006eb20 0x7f1250070fd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f126c1034a0 tx=0x7f1254009da0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:55.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.302+0000 7f1263400640 1 -- 172.21.15.84:0/125685071 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f1264057d60 con 0x7f126c1043e0 2024-04-26T21:38:55.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:55 smithi084 ceph-mon[90138]: pgmap v384: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:55.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:55 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/1030889646' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-04-26T21:38:55.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:55 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2147493165' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-04-26T21:38:55.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:55 smithi120 ceph-mon[79001]: pgmap v384: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:55.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:55 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/1030889646' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-04-26T21:38:55.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:55 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2147493165' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-04-26T21:38:55.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.525+0000 7f1272000640 1 -- 172.21.15.84:0/125685071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f126c04bcc0 con 0x7f126c1043e0 2024-04-26T21:38:55.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.527+0000 7f1263400640 1 -- 172.21.15.84:0/125685071 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v42) v1 ==== 107+0+4891 (secure 0 0 0) 0x7f126400ae60 con 0x7f126c1043e0 2024-04-26T21:38:55.528 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:55.528 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/1543850087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1543850087},{"type":"v1","addr":"172.21.15.84:6829","nonce":1543850087}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:32:41.152553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14456,"mds_1":24231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14456":{"gid":14456,"name":"cephfs.smithi084.hbjunw","rank":0,"incarnation":3,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6827/1450914842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1450914842},{"type":"v1","addr":"172.21.15.84:6827","nonce":1450914842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24231":{"gid":24231,"name":"cephfs.smithi120.qnkxcn","rank":1,"incarnation":6,"state":"up:active","state_seq":5,"addr":"172.21.15.120:6825/3398077484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3398077484},{"type":"v1","addr":"172.21.15.120:6825","nonce":3398077484}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14456,"qdb_cluster":[14456,24231]},"id":1}]} 2024-04-26T21:38:55.528 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 18 2024-04-26T21:38:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.529+0000 7f1272000640 1 -- 172.21.15.84:0/125685071 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f125006eb20 msgr2=0x7f1250070fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.529+0000 7f1272000640 1 --2- 172.21.15.84:0/125685071 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f125006eb20 0x7f1250070fd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f126c1034a0 tx=0x7f1254009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.529+0000 7f1272000640 1 -- 172.21.15.84:0/125685071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f126c1043e0 msgr2=0x7f126c114e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.529+0000 7f1272000640 1 --2- 172.21.15.84:0/125685071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f126c1043e0 0x7f126c114e70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f126400cb10 tx=0x7f1264007ee0 comp rx=0 tx=0).stop 2024-04-26T21:38:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.530+0000 7f1272000640 1 -- 172.21.15.84:0/125685071 shutdown_connections 2024-04-26T21:38:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.530+0000 7f1272000640 1 --2- 172.21.15.84:0/125685071 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f125006eb20 0x7f1250070fd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.530+0000 7f1272000640 1 --2- 172.21.15.84:0/125685071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f126c104d80 0x7f126c1153b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.530+0000 7f1272000640 1 --2- 172.21.15.84:0/125685071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f126c1043e0 0x7f126c114e70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.530+0000 7f1272000640 1 -- 172.21.15.84:0/125685071 >> 172.21.15.84:0/125685071 conn(0x7f126c0f9f90 msgr2=0x7f126c0fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.530+0000 7f1272000640 1 -- 172.21.15.84:0/125685071 shutdown_connections 2024-04-26T21:38:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.530+0000 7f1272000640 1 -- 172.21.15.84:0/125685071 wait complete. 2024-04-26T21:38:55.548 DEBUG:tasks.fs:max_mds reduced in epoch 18 2024-04-26T21:38:55.549 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-04-26T21:38:55.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.734+0000 7fe0aca00640 1 -- 172.21.15.84:0/4061319480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a8102080 msgr2=0x7fe0a8102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:55.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.734+0000 7fe0aca00640 1 --2- 172.21.15.84:0/4061319480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a8102080 0x7fe0a8102450 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe0980048d0 tx=0x7fe098009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:55.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.734+0000 7fe0aca00640 1 -- 172.21.15.84:0/4061319480 shutdown_connections 2024-04-26T21:38:55.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.734+0000 7fe0aca00640 1 --2- 172.21.15.84:0/4061319480 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0a8064380 0x7fe0a80647b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:55.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.734+0000 7fe0aca00640 1 --2- 172.21.15.84:0/4061319480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a8102080 0x7fe0a8102450 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:55.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.734+0000 7fe0aca00640 1 -- 172.21.15.84:0/4061319480 >> 172.21.15.84:0/4061319480 conn(0x7fe0a8070fb0 msgr2=0x7fe0a80713b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:55.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.734+0000 7fe0aca00640 1 -- 172.21.15.84:0/4061319480 shutdown_connections 2024-04-26T21:38:55.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.734+0000 7fe0aca00640 1 -- 172.21.15.84:0/4061319480 wait complete. 2024-04-26T21:38:55.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.735+0000 7fe0aca00640 1 Processor -- start 2024-04-26T21:38:55.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.735+0000 7fe0aca00640 1 -- start start 2024-04-26T21:38:55.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.735+0000 7fe0aca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a8064380 0x7fe0a80fb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:55.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.736+0000 7fe0aca00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0a8102080 0x7fe0a80fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:55.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.736+0000 7fe0aca00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a80fcf90 con 0x7fe0a8064380 2024-04-26T21:38:55.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.736+0000 7fe0aca00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a80fbaa0 con 0x7fe0a8102080 2024-04-26T21:38:55.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.736+0000 7fe0a6800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a8064380 0x7fe0a80fb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:55.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.736+0000 7fe0a6800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a8064380 0x7fe0a80fb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37550/0 (socket says 172.21.15.84:37550) 2024-04-26T21:38:55.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.736+0000 7fe0a6800640 1 -- 172.21.15.84:0/4055061106 learned_addr learned my addr 172.21.15.84:0/4055061106 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:55.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.736+0000 7fe0a6800640 1 -- 172.21.15.84:0/4055061106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0a8102080 msgr2=0x7fe0a80fb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:55.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.736+0000 7fe0a6800640 1 --2- 172.21.15.84:0/4055061106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0a8102080 0x7fe0a80fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:55.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.736+0000 7fe0a6800640 1 -- 172.21.15.84:0/4055061106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe098005040 con 0x7fe0a8064380 2024-04-26T21:38:55.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.736+0000 7fe0a6800640 1 --2- 172.21.15.84:0/4055061106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a8064380 0x7fe0a80fb020 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe0980047f0 tx=0x7fe098009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:55.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.737+0000 7fe09f400640 1 -- 172.21.15.84:0/4055061106 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0980094c0 con 0x7fe0a8064380 2024-04-26T21:38:55.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.737+0000 7fe09f400640 1 -- 172.21.15.84:0/4055061106 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe098032e50 con 0x7fe0a8064380 2024-04-26T21:38:55.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.737+0000 7fe0aca00640 1 -- 172.21.15.84:0/4055061106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a80fbcc0 con 0x7fe0a8064380 2024-04-26T21:38:55.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.737+0000 7fe09f400640 1 -- 172.21.15.84:0/4055061106 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0980435f0 con 0x7fe0a8064380 2024-04-26T21:38:55.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.737+0000 7fe0aca00640 1 -- 172.21.15.84:0/4055061106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a8119250 con 0x7fe0a8064380 2024-04-26T21:38:55.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.738+0000 7fe0aca00640 1 -- 172.21.15.84:0/4055061106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a80fd780 con 0x7fe0a8064380 2024-04-26T21:38:55.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.739+0000 7fe09f400640 1 -- 172.21.15.84:0/4055061106 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe09802f070 con 0x7fe0a8064380 2024-04-26T21:38:55.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.740+0000 7fe09f400640 1 --2- 172.21.15.84:0/4055061106 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe08c06eb80 0x7fe08c071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:55.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.740+0000 7fe09f400640 1 -- 172.21.15.84:0/4055061106 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fe0980b0840 con 0x7fe0a8064380 2024-04-26T21:38:55.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.740+0000 7fe09de00640 1 --2- 172.21.15.84:0/4055061106 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe08c06eb80 0x7fe08c071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:55.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.741+0000 7fe09de00640 1 --2- 172.21.15.84:0/4055061106 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe08c06eb80 0x7fe08c071030 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80fc750 tx=0x7fe090006d20 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:55.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.744+0000 7fe09f400640 1 -- 172.21.15.84:0/4055061106 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fe0980793f0 con 0x7fe0a8064380 2024-04-26T21:38:55.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.985+0000 7fe0aca00640 1 -- 172.21.15.84:0/4055061106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7fe0a804bcc0 con 0x7fe0a8064380 2024-04-26T21:38:55.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.987+0000 7fe09f400640 1 -- 172.21.15.84:0/4055061106 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v42) v1 ==== 107+0+4887 (secure 0 0 0) 0x7fe09807cab0 con 0x7fe0a8064380 2024-04-26T21:38:55.988 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:55.988 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/1543850087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1543850087},{"type":"v1","addr":"172.21.15.84:6829","nonce":1543850087}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:32:42.154173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14456,"mds_1":24231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14456":{"gid":14456,"name":"cephfs.smithi084.hbjunw","rank":0,"incarnation":3,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6827/1450914842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1450914842},{"type":"v1","addr":"172.21.15.84:6827","nonce":1450914842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24231":{"gid":24231,"name":"cephfs.smithi120.qnkxcn","rank":1,"incarnation":6,"state":"up:stopping","state_seq":5,"addr":"172.21.15.120:6825/3398077484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3398077484},{"type":"v1","addr":"172.21.15.120:6825","nonce":3398077484}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14456,"qdb_cluster":[14456]},"id":1}]} 2024-04-26T21:38:55.988 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 19 2024-04-26T21:38:55.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.989+0000 7fe0aca00640 1 -- 172.21.15.84:0/4055061106 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe08c06eb80 msgr2=0x7fe08c071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:55.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.989+0000 7fe0aca00640 1 --2- 172.21.15.84:0/4055061106 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe08c06eb80 0x7fe08c071030 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80fc750 tx=0x7fe090006d20 comp rx=0 tx=0).stop 2024-04-26T21:38:55.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.989+0000 7fe0aca00640 1 -- 172.21.15.84:0/4055061106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a8064380 msgr2=0x7fe0a80fb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:55.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.989+0000 7fe0aca00640 1 --2- 172.21.15.84:0/4055061106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a8064380 0x7fe0a80fb020 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe0980047f0 tx=0x7fe098009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:55.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.990+0000 7fe0aca00640 1 -- 172.21.15.84:0/4055061106 shutdown_connections 2024-04-26T21:38:55.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.990+0000 7fe0aca00640 1 --2- 172.21.15.84:0/4055061106 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fe08c06eb80 0x7fe08c071030 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:55.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.990+0000 7fe0aca00640 1 --2- 172.21.15.84:0/4055061106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0a8102080 0x7fe0a80fb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:55.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.990+0000 7fe0aca00640 1 --2- 172.21.15.84:0/4055061106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a8064380 0x7fe0a80fb020 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:55.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.990+0000 7fe0aca00640 1 -- 172.21.15.84:0/4055061106 >> 172.21.15.84:0/4055061106 conn(0x7fe0a8070fb0 msgr2=0x7fe0a80f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:55.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.990+0000 7fe0aca00640 1 -- 172.21.15.84:0/4055061106 shutdown_connections 2024-04-26T21:38:55.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:55.990+0000 7fe0aca00640 1 -- 172.21.15.84:0/4055061106 wait complete. 2024-04-26T21:38:56.008 DEBUG:tasks.fs:max_mds reduced in epoch 19 2024-04-26T21:38:56.009 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-04-26T21:38:56.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.197+0000 7f9a3e800640 1 -- 172.21.15.84:0/1194094708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a38102990 msgr2=0x7f9a380fc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:56.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.197+0000 7f9a3e800640 1 --2- 172.21.15.84:0/1194094708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a38102990 0x7f9a380fc020 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9a280048d0 tx=0x7f9a28009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:56.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.198+0000 7f9a3e800640 1 -- 172.21.15.84:0/1194094708 shutdown_connections 2024-04-26T21:38:56.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.198+0000 7f9a3e800640 1 --2- 172.21.15.84:0/1194094708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a38102990 0x7f9a380fc020 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:56.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.198+0000 7f9a3e800640 1 --2- 172.21.15.84:0/1194094708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a38101ff0 0x7f9a381023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:56.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.198+0000 7f9a3e800640 1 -- 172.21.15.84:0/1194094708 >> 172.21.15.84:0/1194094708 conn(0x7f9a380f7be0 msgr2=0x7f9a380f9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:56.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.198+0000 7f9a3e800640 1 -- 172.21.15.84:0/1194094708 shutdown_connections 2024-04-26T21:38:56.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.198+0000 7f9a3e800640 1 -- 172.21.15.84:0/1194094708 wait complete. 2024-04-26T21:38:56.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.198+0000 7f9a3e800640 1 Processor -- start 2024-04-26T21:38:56.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.199+0000 7f9a3e800640 1 -- start start 2024-04-26T21:38:56.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.199+0000 7f9a3e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a38101ff0 0x7f9a38112b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:56.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.199+0000 7f9a3e800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a38102990 0x7f9a38113060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:56.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.199+0000 7f9a3e800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a38113660 con 0x7f9a38101ff0 2024-04-26T21:38:56.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.199+0000 7f9a3e800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3810ccb0 con 0x7f9a38102990 2024-04-26T21:38:56.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.199+0000 7f9a3d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a38101ff0 0x7f9a38112b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:56.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.199+0000 7f9a3d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a38101ff0 0x7f9a38112b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37574/0 (socket says 172.21.15.84:37574) 2024-04-26T21:38:56.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.199+0000 7f9a3d400640 1 -- 172.21.15.84:0/3751342415 learned_addr learned my addr 172.21.15.84:0/3751342415 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:56.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.199+0000 7f9a3d400640 1 -- 172.21.15.84:0/3751342415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a38102990 msgr2=0x7f9a38113060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:56.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.199+0000 7f9a3d400640 1 --2- 172.21.15.84:0/3751342415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a38102990 0x7f9a38113060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:56.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.200+0000 7f9a3d400640 1 -- 172.21.15.84:0/3751342415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a28005040 con 0x7f9a38101ff0 2024-04-26T21:38:56.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.200+0000 7f9a3d400640 1 --2- 172.21.15.84:0/3751342415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a38101ff0 0x7f9a38112b20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00c790 tx=0x7f9a2c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:56.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.200+0000 7f9a35600640 1 -- 172.21.15.84:0/3751342415 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a2c00a820 con 0x7f9a38101ff0 2024-04-26T21:38:56.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.200+0000 7f9a35600640 1 -- 172.21.15.84:0/3751342415 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a2c00ae50 con 0x7f9a38101ff0 2024-04-26T21:38:56.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.200+0000 7f9a3e800640 1 -- 172.21.15.84:0/3751342415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3810cf90 con 0x7f9a38101ff0 2024-04-26T21:38:56.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.200+0000 7f9a35600640 1 -- 172.21.15.84:0/3751342415 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a2c0115e0 con 0x7f9a38101ff0 2024-04-26T21:38:56.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.200+0000 7f9a3e800640 1 -- 172.21.15.84:0/3751342415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3810d4b0 con 0x7f9a38101ff0 2024-04-26T21:38:56.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.201+0000 7f9a3e800640 1 -- 172.21.15.84:0/3751342415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a380fd760 con 0x7f9a38101ff0 2024-04-26T21:38:56.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.203+0000 7f9a35600640 1 -- 172.21.15.84:0/3751342415 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9a2c012400 con 0x7f9a38101ff0 2024-04-26T21:38:56.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.203+0000 7f9a35600640 1 --2- 172.21.15.84:0/3751342415 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9a2006eb80 0x7f9a20071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:56.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.204+0000 7f9a35600640 1 -- 172.21.15.84:0/3751342415 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f9a2c08ebd0 con 0x7f9a38101ff0 2024-04-26T21:38:56.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.204+0000 7f9a3ca00640 1 --2- 172.21.15.84:0/3751342415 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9a2006eb80 0x7f9a20071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:56.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.204+0000 7f9a3ca00640 1 --2- 172.21.15.84:0/3751342415 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9a2006eb80 0x7f9a20071030 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9a2802bda0 tx=0x7f9a28009da0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:56.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.209+0000 7f9a35600640 1 -- 172.21.15.84:0/3751342415 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f9a2c0578a0 con 0x7f9a38101ff0 2024-04-26T21:38:56.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:56 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2420522669' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-04-26T21:38:56.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:56 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/125685071' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-26T21:38:56.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:56 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/4055061106' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-26T21:38:56.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:56 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2420522669' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-04-26T21:38:56.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:56 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/125685071' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-26T21:38:56.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:56 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/4055061106' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-26T21:38:56.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.434+0000 7f9a3e800640 1 -- 172.21.15.84:0/3751342415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f9a3804bcc0 con 0x7f9a38101ff0 2024-04-26T21:38:56.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.435+0000 7f9a35600640 1 -- 172.21.15.84:0/3751342415 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v42) v1 ==== 107+0+4888 (secure 0 0 0) 0x7f9a2c057030 con 0x7f9a38101ff0 2024-04-26T21:38:56.437 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:56.437 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/1543850087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1543850087},{"type":"v1","addr":"172.21.15.84:6829","nonce":1543850087}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:32:47.477199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14456,"mds_1":24231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14456":{"gid":14456,"name":"cephfs.smithi084.hbjunw","rank":0,"incarnation":3,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6827/1450914842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1450914842},{"type":"v1","addr":"172.21.15.84:6827","nonce":1450914842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24231":{"gid":24231,"name":"cephfs.smithi120.qnkxcn","rank":1,"incarnation":6,"state":"up:stopping","state_seq":5,"addr":"172.21.15.120:6825/3398077484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":3398077484},{"type":"v1","addr":"172.21.15.120:6825","nonce":3398077484}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14456,"qdb_cluster":[14456]},"id":1}]} 2024-04-26T21:38:56.437 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 20 2024-04-26T21:38:56.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.438+0000 7f9a3e800640 1 -- 172.21.15.84:0/3751342415 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9a2006eb80 msgr2=0x7f9a20071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:56.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.438+0000 7f9a3e800640 1 --2- 172.21.15.84:0/3751342415 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9a2006eb80 0x7f9a20071030 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9a2802bda0 tx=0x7f9a28009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:56.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.438+0000 7f9a3e800640 1 -- 172.21.15.84:0/3751342415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a38101ff0 msgr2=0x7f9a38112b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:56.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.438+0000 7f9a3e800640 1 --2- 172.21.15.84:0/3751342415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a38101ff0 0x7f9a38112b20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00c790 tx=0x7f9a2c0043c0 comp rx=0 tx=0).stop 2024-04-26T21:38:56.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.438+0000 7f9a3e800640 1 -- 172.21.15.84:0/3751342415 shutdown_connections 2024-04-26T21:38:56.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.439+0000 7f9a3e800640 1 --2- 172.21.15.84:0/3751342415 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f9a2006eb80 0x7f9a20071030 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:56.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.439+0000 7f9a3e800640 1 --2- 172.21.15.84:0/3751342415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a38102990 0x7f9a38113060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:56.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.439+0000 7f9a3e800640 1 --2- 172.21.15.84:0/3751342415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a38101ff0 0x7f9a38112b20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:56.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.439+0000 7f9a3e800640 1 -- 172.21.15.84:0/3751342415 >> 172.21.15.84:0/3751342415 conn(0x7f9a380f7be0 msgr2=0x7f9a380f8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:56.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.439+0000 7f9a3e800640 1 -- 172.21.15.84:0/3751342415 shutdown_connections 2024-04-26T21:38:56.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.439+0000 7f9a3e800640 1 -- 172.21.15.84:0/3751342415 wait complete. 2024-04-26T21:38:56.459 DEBUG:tasks.fs:max_mds reduced in epoch 20 2024-04-26T21:38:56.460 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-04-26T21:38:56.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.653+0000 7f5b1ae00640 1 -- 172.21.15.84:0/1953970113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b141043e0 msgr2=0x7f5b141047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:56.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.653+0000 7f5b1ae00640 1 --2- 172.21.15.84:0/1953970113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b141043e0 0x7f5b141047b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5b040048d0 tx=0x7f5b04009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:56.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.653+0000 7f5b1ae00640 1 -- 172.21.15.84:0/1953970113 shutdown_connections 2024-04-26T21:38:56.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.653+0000 7f5b1ae00640 1 --2- 172.21.15.84:0/1953970113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b14104d80 0x7f5b140fe410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:56.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.653+0000 7f5b1ae00640 1 --2- 172.21.15.84:0/1953970113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b141043e0 0x7f5b141047b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:56.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.653+0000 7f5b1ae00640 1 -- 172.21.15.84:0/1953970113 >> 172.21.15.84:0/1953970113 conn(0x7f5b140f9f90 msgr2=0x7f5b140fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:56.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.653+0000 7f5b1ae00640 1 -- 172.21.15.84:0/1953970113 shutdown_connections 2024-04-26T21:38:56.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.653+0000 7f5b1ae00640 1 -- 172.21.15.84:0/1953970113 wait complete. 2024-04-26T21:38:56.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.654+0000 7f5b1ae00640 1 Processor -- start 2024-04-26T21:38:56.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.654+0000 7f5b1ae00640 1 -- start start 2024-04-26T21:38:56.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.654+0000 7f5b1ae00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b141043e0 0x7f5b14114f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:56.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.654+0000 7f5b1ae00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b14104d80 0x7f5b14115440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:56.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.654+0000 7f5b1ae00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b14115a40 con 0x7f5b14104d80 2024-04-26T21:38:56.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.654+0000 7f5b1ae00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1410f090 con 0x7f5b141043e0 2024-04-26T21:38:56.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.654+0000 7f5b13400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b14104d80 0x7f5b14115440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:56.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.654+0000 7f5b13400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b14104d80 0x7f5b14115440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37606/0 (socket says 172.21.15.84:37606) 2024-04-26T21:38:56.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.654+0000 7f5b13400640 1 -- 172.21.15.84:0/985159524 learned_addr learned my addr 172.21.15.84:0/985159524 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:56.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.655+0000 7f5b13400640 1 -- 172.21.15.84:0/985159524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b141043e0 msgr2=0x7f5b14114f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:56.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.655+0000 7f5b13400640 1 --2- 172.21.15.84:0/985159524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b141043e0 0x7f5b14114f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:56.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.655+0000 7f5b13400640 1 -- 172.21.15.84:0/985159524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b04005040 con 0x7f5b14104d80 2024-04-26T21:38:56.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.655+0000 7f5b13400640 1 --2- 172.21.15.84:0/985159524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b14104d80 0x7f5b14115440 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000c810 tx=0x7f5b000043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:56.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.655+0000 7f5b0be00640 1 -- 172.21.15.84:0/985159524 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b0000a820 con 0x7f5b14104d80 2024-04-26T21:38:56.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.655+0000 7f5b0be00640 1 -- 172.21.15.84:0/985159524 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5b0000ae50 con 0x7f5b14104d80 2024-04-26T21:38:56.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.655+0000 7f5b1ae00640 1 -- 172.21.15.84:0/985159524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1410f370 con 0x7f5b14104d80 2024-04-26T21:38:56.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.655+0000 7f5b0be00640 1 -- 172.21.15.84:0/985159524 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b000115c0 con 0x7f5b14104d80 2024-04-26T21:38:56.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.655+0000 7f5b1ae00640 1 -- 172.21.15.84:0/985159524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1410f890 con 0x7f5b14104d80 2024-04-26T21:38:56.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.657+0000 7f5b1ae00640 1 -- 172.21.15.84:0/985159524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b140ffb50 con 0x7f5b14104d80 2024-04-26T21:38:56.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.658+0000 7f5b0be00640 1 -- 172.21.15.84:0/985159524 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5b0000a980 con 0x7f5b14104d80 2024-04-26T21:38:56.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.659+0000 7f5b0be00640 1 --2- 172.21.15.84:0/985159524 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5af806eb80 0x7f5af8071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:56.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.659+0000 7f5b0be00640 1 -- 172.21.15.84:0/985159524 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f5b0008ef70 con 0x7f5b14104d80 2024-04-26T21:38:56.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.659+0000 7f5b13e00640 1 --2- 172.21.15.84:0/985159524 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5af806eb80 0x7f5af8071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:56.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.660+0000 7f5b13e00640 1 --2- 172.21.15.84:0/985159524 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5af806eb80 0x7f5af8071030 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5b04003080 tx=0x7f5b04009da0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:56.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.664+0000 7f5b0be00640 1 -- 172.21.15.84:0/985159524 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f5b00057ba0 con 0x7f5b14104d80 2024-04-26T21:38:56.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.906+0000 7f5b1ae00640 1 -- 172.21.15.84:0/985159524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f5b1410b550 con 0x7f5b14104d80 2024-04-26T21:38:56.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.907+0000 7f5b0be00640 1 -- 172.21.15.84:0/985159524 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v42) v1 ==== 107+0+4089 (secure 0 0 0) 0x7f5b0005b260 con 0x7f5b14104d80 2024-04-26T21:38:56.909 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:56.909 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/1543850087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1543850087},{"type":"v1","addr":"172.21.15.84:6829","nonce":1543850087}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:33:12.479430+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14456},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14456":{"gid":14456,"name":"cephfs.smithi084.hbjunw","rank":0,"incarnation":3,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6827/1450914842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1450914842},{"type":"v1","addr":"172.21.15.84:6827","nonce":1450914842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14456,"qdb_cluster":[14456]},"id":1}]} 2024-04-26T21:38:56.910 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 21 2024-04-26T21:38:56.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.910+0000 7f5b1ae00640 1 -- 172.21.15.84:0/985159524 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5af806eb80 msgr2=0x7f5af8071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:56.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.910+0000 7f5b1ae00640 1 --2- 172.21.15.84:0/985159524 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5af806eb80 0x7f5af8071030 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5b04003080 tx=0x7f5b04009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:56.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.911+0000 7f5b1ae00640 1 -- 172.21.15.84:0/985159524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b14104d80 msgr2=0x7f5b14115440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:56.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.911+0000 7f5b1ae00640 1 --2- 172.21.15.84:0/985159524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b14104d80 0x7f5b14115440 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000c810 tx=0x7f5b000043c0 comp rx=0 tx=0).stop 2024-04-26T21:38:56.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.911+0000 7f5b1ae00640 1 -- 172.21.15.84:0/985159524 shutdown_connections 2024-04-26T21:38:56.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.911+0000 7f5b1ae00640 1 --2- 172.21.15.84:0/985159524 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5af806eb80 0x7f5af8071030 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:56.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.911+0000 7f5b1ae00640 1 --2- 172.21.15.84:0/985159524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b14104d80 0x7f5b14115440 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:56.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.911+0000 7f5b1ae00640 1 --2- 172.21.15.84:0/985159524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b141043e0 0x7f5b14114f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:56.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.911+0000 7f5b1ae00640 1 -- 172.21.15.84:0/985159524 >> 172.21.15.84:0/985159524 conn(0x7f5b140f9f90 msgr2=0x7f5b140fae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:56.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.911+0000 7f5b1ae00640 1 -- 172.21.15.84:0/985159524 shutdown_connections 2024-04-26T21:38:56.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:56.911+0000 7f5b1ae00640 1 -- 172.21.15.84:0/985159524 wait complete. 2024-04-26T21:38:56.930 DEBUG:tasks.fs:max_mds reduced in epoch 21 2024-04-26T21:38:56.930 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-04-26T21:38:57.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.123+0000 7f479d000640 1 -- 172.21.15.84:0/892167984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47980722b0 msgr2=0x7f479810cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:57.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.123+0000 7f479d000640 1 --2- 172.21.15.84:0/892167984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47980722b0 0x7f479810cb70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f47800048d0 tx=0x7f4780009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:57.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.123+0000 7f479d000640 1 -- 172.21.15.84:0/892167984 shutdown_connections 2024-04-26T21:38:57.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.123+0000 7f479d000640 1 --2- 172.21.15.84:0/892167984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47980722b0 0x7f479810cb70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:57.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.123+0000 7f479d000640 1 --2- 172.21.15.84:0/892167984 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47980719a0 0x7f4798071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:57.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.123+0000 7f479d000640 1 -- 172.21.15.84:0/892167984 >> 172.21.15.84:0/892167984 conn(0x7f47980f9f90 msgr2=0x7f47980fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:57.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.123+0000 7f479d000640 1 -- 172.21.15.84:0/892167984 shutdown_connections 2024-04-26T21:38:57.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.123+0000 7f479d000640 1 -- 172.21.15.84:0/892167984 wait complete. 2024-04-26T21:38:57.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.124+0000 7f479d000640 1 Processor -- start 2024-04-26T21:38:57.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.124+0000 7f479d000640 1 -- start start 2024-04-26T21:38:57.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.124+0000 7f479d000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47980719a0 0x7f47981192d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:57.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.124+0000 7f479d000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47980722b0 0x7f4798119810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:57.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.124+0000 7f479d000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4798119e10 con 0x7f47980722b0 2024-04-26T21:38:57.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.124+0000 7f479d000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4798113460 con 0x7f47980719a0 2024-04-26T21:38:57.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.124+0000 7f478fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47980722b0 0x7f4798119810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:57.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.124+0000 7f478fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47980722b0 0x7f4798119810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37626/0 (socket says 172.21.15.84:37626) 2024-04-26T21:38:57.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.124+0000 7f478fe00640 1 -- 172.21.15.84:0/3106034518 learned_addr learned my addr 172.21.15.84:0/3106034518 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:57.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.125+0000 7f4795e00640 1 --2- 172.21.15.84:0/3106034518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47980719a0 0x7f47981192d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:57.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.125+0000 7f478fe00640 1 -- 172.21.15.84:0/3106034518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47980719a0 msgr2=0x7f47981192d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:57.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.125+0000 7f478fe00640 1 --2- 172.21.15.84:0/3106034518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47980719a0 0x7f47981192d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:57.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.125+0000 7f478fe00640 1 -- 172.21.15.84:0/3106034518 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4780005040 con 0x7f47980722b0 2024-04-26T21:38:57.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.125+0000 7f478fe00640 1 --2- 172.21.15.84:0/3106034518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47980722b0 0x7f4798119810 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4780004930 tx=0x7f4780009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.125+0000 7f478e000640 1 -- 172.21.15.84:0/3106034518 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47800094c0 con 0x7f47980722b0 2024-04-26T21:38:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.125+0000 7f478e000640 1 -- 172.21.15.84:0/3106034518 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4780032e50 con 0x7f47980722b0 2024-04-26T21:38:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.125+0000 7f479d000640 1 -- 172.21.15.84:0/3106034518 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47981136e0 con 0x7f47980722b0 2024-04-26T21:38:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.126+0000 7f478e000640 1 -- 172.21.15.84:0/3106034518 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47800433b0 con 0x7f47980722b0 2024-04-26T21:38:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.126+0000 7f479d000640 1 -- 172.21.15.84:0/3106034518 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4798113ba0 con 0x7f47980722b0 2024-04-26T21:38:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.127+0000 7f4787400640 1 -- 172.21.15.84:0/3106034518 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47980730e0 con 0x7f47980722b0 2024-04-26T21:38:57.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.128+0000 7f478e000640 1 -- 172.21.15.84:0/3106034518 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f478002f070 con 0x7f47980722b0 2024-04-26T21:38:57.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.129+0000 7f478e000640 1 --2- 172.21.15.84:0/3106034518 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f477806eb70 0x7f4778071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:57.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.129+0000 7f478e000640 1 -- 172.21.15.84:0/3106034518 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f47800b08c0 con 0x7f47980722b0 2024-04-26T21:38:57.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.129+0000 7f4795e00640 1 --2- 172.21.15.84:0/3106034518 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f477806eb70 0x7f4778071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:57.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.130+0000 7f4795e00640 1 --2- 172.21.15.84:0/3106034518 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f477806eb70 0x7f4778071020 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4788004ce0 tx=0x7f478800b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.134+0000 7f478e000640 1 -- 172.21.15.84:0/3106034518 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f4780079510 con 0x7f47980722b0 2024-04-26T21:38:57.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.375+0000 7f4787400640 1 -- 172.21.15.84:0/3106034518 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f4798114940 con 0x7f47980722b0 2024-04-26T21:38:57.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.377+0000 7f478e000640 1 -- 172.21.15.84:0/3106034518 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v42) v1 ==== 107+0+4871 (secure 0 0 0) 0x7f478007cbd0 con 0x7f47980722b0 2024-04-26T21:38:57.378 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:57.379 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/1543850087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1543850087},{"type":"v1","addr":"172.21.15.84:6829","nonce":1543850087}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":44247,"name":"cephfs.smithi120.qnkxcn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/4163804141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":4163804141},{"type":"v1","addr":"172.21.15.120:6825","nonce":4163804141}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:33:12.479430+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14456},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14456":{"gid":14456,"name":"cephfs.smithi084.hbjunw","rank":0,"incarnation":3,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6827/1450914842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1450914842},{"type":"v1","addr":"172.21.15.84:6827","nonce":1450914842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14456,"qdb_cluster":[14456]},"id":1}]} 2024-04-26T21:38:57.379 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 22 2024-04-26T21:38:57.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.380+0000 7f4787400640 1 -- 172.21.15.84:0/3106034518 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f477806eb70 msgr2=0x7f4778071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:57.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.380+0000 7f4787400640 1 --2- 172.21.15.84:0/3106034518 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f477806eb70 0x7f4778071020 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4788004ce0 tx=0x7f478800b040 comp rx=0 tx=0).stop 2024-04-26T21:38:57.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.380+0000 7f4787400640 1 -- 172.21.15.84:0/3106034518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47980722b0 msgr2=0x7f4798119810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:57.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.380+0000 7f4787400640 1 --2- 172.21.15.84:0/3106034518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47980722b0 0x7f4798119810 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4780004930 tx=0x7f4780009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:57.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.380+0000 7f4787400640 1 -- 172.21.15.84:0/3106034518 shutdown_connections 2024-04-26T21:38:57.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.380+0000 7f4787400640 1 --2- 172.21.15.84:0/3106034518 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f477806eb70 0x7f4778071020 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:57.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.380+0000 7f4787400640 1 --2- 172.21.15.84:0/3106034518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47980722b0 0x7f4798119810 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:57.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.380+0000 7f4787400640 1 --2- 172.21.15.84:0/3106034518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47980719a0 0x7f47981192d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:57.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.380+0000 7f4787400640 1 -- 172.21.15.84:0/3106034518 >> 172.21.15.84:0/3106034518 conn(0x7f47980f9f90 msgr2=0x7f4798074500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:57.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.380+0000 7f4787400640 1 -- 172.21.15.84:0/3106034518 shutdown_connections 2024-04-26T21:38:57.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.380+0000 7f4787400640 1 -- 172.21.15.84:0/3106034518 wait complete. 2024-04-26T21:38:57.396 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:57 smithi084 ceph-mon[90138]: pgmap v385: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:57.396 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:57 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3751342415' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-26T21:38:57.397 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:57 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/985159524' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-26T21:38:57.400 DEBUG:tasks.fs:max_mds reduced in epoch 22 2024-04-26T21:38:57.400 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-04-26T21:38:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:57 smithi120 ceph-mon[79001]: pgmap v385: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:57 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3751342415' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-26T21:38:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:57 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/985159524' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-26T21:38:57.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.598+0000 7ff94fc00640 1 -- 172.21.15.84:0/2826233970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff948108820 msgr2=0x7ff948108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:57.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.598+0000 7ff94fc00640 1 --2- 172.21.15.84:0/2826233970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff948108820 0x7ff948108bf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0048d0 tx=0x7ff93c009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:57.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.598+0000 7ff94fc00640 1 -- 172.21.15.84:0/2826233970 shutdown_connections 2024-04-26T21:38:57.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.598+0000 7ff94fc00640 1 --2- 172.21.15.84:0/2826233970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff948102820 0x7ff948102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:57.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.598+0000 7ff94fc00640 1 --2- 172.21.15.84:0/2826233970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff948108820 0x7ff948108bf0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:57.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.598+0000 7ff94fc00640 1 -- 172.21.15.84:0/2826233970 >> 172.21.15.84:0/2826233970 conn(0x7ff948072020 msgr2=0x7ff948074430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:57.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.598+0000 7ff94fc00640 1 -- 172.21.15.84:0/2826233970 shutdown_connections 2024-04-26T21:38:57.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.598+0000 7ff94fc00640 1 -- 172.21.15.84:0/2826233970 wait complete. 2024-04-26T21:38:57.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.599+0000 7ff94fc00640 1 Processor -- start 2024-04-26T21:38:57.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.599+0000 7ff94fc00640 1 -- start start 2024-04-26T21:38:57.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.599+0000 7ff94fc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff948102820 0x7ff9481192b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:57.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.599+0000 7ff94fc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff948108820 0x7ff9481197f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.599+0000 7ff94fc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff948119df0 con 0x7ff948102820 2024-04-26T21:38:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.599+0000 7ff94fc00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff948113440 con 0x7ff948108820 2024-04-26T21:38:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.599+0000 7ff94d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff948102820 0x7ff9481192b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.599+0000 7ff94d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff948102820 0x7ff9481192b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37654/0 (socket says 172.21.15.84:37654) 2024-04-26T21:38:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.599+0000 7ff94d200640 1 -- 172.21.15.84:0/602850455 learned_addr learned my addr 172.21.15.84:0/602850455 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.600+0000 7ff94d200640 1 -- 172.21.15.84:0/602850455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff948108820 msgr2=0x7ff9481197f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.600+0000 7ff94d200640 1 --2- 172.21.15.84:0/602850455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff948108820 0x7ff9481197f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.600+0000 7ff94d200640 1 -- 172.21.15.84:0/602850455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c005040 con 0x7ff948102820 2024-04-26T21:38:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.600+0000 7ff94d200640 1 --2- 172.21.15.84:0/602850455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff948102820 0x7ff9481192b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff93c004930 tx=0x7ff93c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.600+0000 7ff944c00640 1 -- 172.21.15.84:0/602850455 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff93c0094c0 con 0x7ff948102820 2024-04-26T21:38:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.601+0000 7ff944c00640 1 -- 172.21.15.84:0/602850455 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff93c032e50 con 0x7ff948102820 2024-04-26T21:38:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.601+0000 7ff944c00640 1 -- 172.21.15.84:0/602850455 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff93c0433b0 con 0x7ff948102820 2024-04-26T21:38:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.601+0000 7ff94fc00640 1 -- 172.21.15.84:0/602850455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9481136c0 con 0x7ff948102820 2024-04-26T21:38:57.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.601+0000 7ff94fc00640 1 -- 172.21.15.84:0/602850455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff948113b80 con 0x7ff948102820 2024-04-26T21:38:57.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.602+0000 7ff94fc00640 1 -- 172.21.15.84:0/602850455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff948103f40 con 0x7ff948102820 2024-04-26T21:38:57.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.603+0000 7ff944c00640 1 -- 172.21.15.84:0/602850455 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff93c02f070 con 0x7ff948102820 2024-04-26T21:38:57.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.604+0000 7ff944c00640 1 --2- 172.21.15.84:0/602850455 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ff93006eb70 0x7ff930071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:57.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.604+0000 7ff944c00640 1 -- 172.21.15.84:0/602850455 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7ff93c0b0a00 con 0x7ff948102820 2024-04-26T21:38:57.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.604+0000 7ff947e00640 1 --2- 172.21.15.84:0/602850455 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ff93006eb70 0x7ff930071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:57.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.605+0000 7ff947e00640 1 --2- 172.21.15.84:0/602850455 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ff93006eb70 0x7ff930071020 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff948114b70 tx=0x7ff934007c30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:57.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.609+0000 7ff944c00640 1 -- 172.21.15.84:0/602850455 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7ff93c0795b0 con 0x7ff948102820 2024-04-26T21:38:57.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.851+0000 7ff94fc00640 1 -- 172.21.15.84:0/602850455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7ff94810f900 con 0x7ff948102820 2024-04-26T21:38:57.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.852+0000 7ff944c00640 1 -- 172.21.15.84:0/602850455 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v42) v1 ==== 107+0+4074 (secure 0 0 0) 0x7ff93c07cc70 con 0x7ff948102820 2024-04-26T21:38:57.854 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:57.854 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/1543850087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1543850087},{"type":"v1","addr":"172.21.15.84:6829","nonce":1543850087}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":44247,"name":"cephfs.smithi120.qnkxcn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/4163804141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":4163804141},{"type":"v1","addr":"172.21.15.120:6825","nonce":4163804141}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:33:20.145337+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:38:57.854 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 23 2024-04-26T21:38:57.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.855+0000 7ff94fc00640 1 -- 172.21.15.84:0/602850455 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ff93006eb70 msgr2=0x7ff930071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:57.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.855+0000 7ff94fc00640 1 --2- 172.21.15.84:0/602850455 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ff93006eb70 0x7ff930071020 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff948114b70 tx=0x7ff934007c30 comp rx=0 tx=0).stop 2024-04-26T21:38:57.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.855+0000 7ff94fc00640 1 -- 172.21.15.84:0/602850455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff948102820 msgr2=0x7ff9481192b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:57.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.855+0000 7ff94fc00640 1 --2- 172.21.15.84:0/602850455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff948102820 0x7ff9481192b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff93c004930 tx=0x7ff93c009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:57.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.855+0000 7ff94fc00640 1 -- 172.21.15.84:0/602850455 shutdown_connections 2024-04-26T21:38:57.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.855+0000 7ff94fc00640 1 --2- 172.21.15.84:0/602850455 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7ff93006eb70 0x7ff930071020 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:57.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.855+0000 7ff94fc00640 1 --2- 172.21.15.84:0/602850455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff948108820 0x7ff9481197f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:57.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.855+0000 7ff94fc00640 1 --2- 172.21.15.84:0/602850455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff948102820 0x7ff9481192b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:57.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.855+0000 7ff94fc00640 1 -- 172.21.15.84:0/602850455 >> 172.21.15.84:0/602850455 conn(0x7ff948072020 msgr2=0x7ff948073fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:57.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.855+0000 7ff94fc00640 1 -- 172.21.15.84:0/602850455 shutdown_connections 2024-04-26T21:38:57.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:57.855+0000 7ff94fc00640 1 -- 172.21.15.84:0/602850455 wait complete. 2024-04-26T21:38:57.876 DEBUG:tasks.fs:max_mds reduced in epoch 23 2024-04-26T21:38:57.876 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-04-26T21:38:58.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.074+0000 7fedfee00640 1 -- 172.21.15.84:0/4245382778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedf80719a0 msgr2=0x7fedf8071d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:58.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.074+0000 7fedfee00640 1 --2- 172.21.15.84:0/4245382778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedf80719a0 0x7fedf8071d70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fedec0048d0 tx=0x7fedec009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:58.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.074+0000 7fedfee00640 1 -- 172.21.15.84:0/4245382778 shutdown_connections 2024-04-26T21:38:58.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.074+0000 7fedfee00640 1 --2- 172.21.15.84:0/4245382778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedf80722b0 0x7fedf810ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:58.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.074+0000 7fedfee00640 1 --2- 172.21.15.84:0/4245382778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedf80719a0 0x7fedf8071d70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:58.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.074+0000 7fedfee00640 1 -- 172.21.15.84:0/4245382778 >> 172.21.15.84:0/4245382778 conn(0x7fedf80f9f60 msgr2=0x7fedf80fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:58.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.074+0000 7fedfee00640 1 -- 172.21.15.84:0/4245382778 shutdown_connections 2024-04-26T21:38:58.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.074+0000 7fedfee00640 1 -- 172.21.15.84:0/4245382778 wait complete. 2024-04-26T21:38:58.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.075+0000 7fedfee00640 1 Processor -- start 2024-04-26T21:38:58.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.075+0000 7fedfee00640 1 -- start start 2024-04-26T21:38:58.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.075+0000 7fedfee00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedf80719a0 0x7fedf8119110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:58.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.075+0000 7fedfee00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedf80722b0 0x7fedf8119650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:58.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.075+0000 7fedfee00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf8119c50 con 0x7fedf80719a0 2024-04-26T21:38:58.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.075+0000 7fedfee00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf81132a0 con 0x7fedf80722b0 2024-04-26T21:38:58.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.076+0000 7fedfda00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedf80719a0 0x7fedf8119110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:58.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.076+0000 7fedfda00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedf80719a0 0x7fedf8119110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37682/0 (socket says 172.21.15.84:37682) 2024-04-26T21:38:58.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.076+0000 7fedfda00640 1 -- 172.21.15.84:0/3698503861 learned_addr learned my addr 172.21.15.84:0/3698503861 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:58.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.076+0000 7fedfd000640 1 --2- 172.21.15.84:0/3698503861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedf80722b0 0x7fedf8119650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:58.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.076+0000 7fedfda00640 1 -- 172.21.15.84:0/3698503861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedf80722b0 msgr2=0x7fedf8119650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:58.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.076+0000 7fedfda00640 1 --2- 172.21.15.84:0/3698503861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedf80722b0 0x7fedf8119650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:58.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.076+0000 7fedfda00640 1 -- 172.21.15.84:0/3698503861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec005040 con 0x7fedf80719a0 2024-04-26T21:38:58.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.076+0000 7fedfd000640 1 --2- 172.21.15.84:0/3698503861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedf80722b0 0x7fedf8119650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:38:58.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.077+0000 7fedfda00640 1 --2- 172.21.15.84:0/3698503861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedf80719a0 0x7fedf8119110 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fedec0047f0 tx=0x7fedec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:58.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.077+0000 7fedf5600640 1 -- 172.21.15.84:0/3698503861 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedec0094c0 con 0x7fedf80719a0 2024-04-26T21:38:58.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.077+0000 7fedfee00640 1 -- 172.21.15.84:0/3698503861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf8113520 con 0x7fedf80719a0 2024-04-26T21:38:58.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.077+0000 7fedf5600640 1 -- 172.21.15.84:0/3698503861 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fedec032e50 con 0x7fedf80719a0 2024-04-26T21:38:58.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.077+0000 7fedf5600640 1 -- 172.21.15.84:0/3698503861 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedec0433b0 con 0x7fedf80719a0 2024-04-26T21:38:58.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.077+0000 7fedfee00640 1 -- 172.21.15.84:0/3698503861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf81139e0 con 0x7fedf80719a0 2024-04-26T21:38:58.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.078+0000 7fedfee00640 1 -- 172.21.15.84:0/3698503861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf8073090 con 0x7fedf80719a0 2024-04-26T21:38:58.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.079+0000 7fedf5600640 1 -- 172.21.15.84:0/3698503861 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fedec02f070 con 0x7fedf80719a0 2024-04-26T21:38:58.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.080+0000 7fedf5600640 1 --2- 172.21.15.84:0/3698503861 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fede006eb80 0x7fede0071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:58.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.080+0000 7fedf5600640 1 -- 172.21.15.84:0/3698503861 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fedec0b0920 con 0x7fedf80719a0 2024-04-26T21:38:58.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.081+0000 7fedfd000640 1 --2- 172.21.15.84:0/3698503861 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fede006eb80 0x7fede0071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:58.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.081+0000 7fedfd000640 1 --2- 172.21.15.84:0/3698503861 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fede006eb80 0x7fede0071030 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fedf81149d0 tx=0x7fede400b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:58.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.085+0000 7fedf5600640 1 -- 172.21.15.84:0/3698503861 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fedec079570 con 0x7fedf80719a0 2024-04-26T21:38:58.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:58 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3106034518' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-26T21:38:58.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:58 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/602850455' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-26T21:38:58.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.320+0000 7fedfee00640 1 -- 172.21.15.84:0/3698503861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fedf804bcc0 con 0x7fedf80719a0 2024-04-26T21:38:58.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.321+0000 7fedf5600640 1 -- 172.21.15.84:0/3698503861 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v42) v1 ==== 107+0+4085 (secure 0 0 0) 0x7fedec07cc30 con 0x7fedf80719a0 2024-04-26T21:38:58.323 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:58.323 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":44247,"name":"cephfs.smithi120.qnkxcn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/4163804141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":4163804141},{"type":"v1","addr":"172.21.15.120:6825","nonce":4163804141}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:33:20.154676+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi084.rtrqtr","rank":0,"incarnation":24,"state":"up:replay","state_seq":3,"addr":"172.21.15.84:6829/1543850087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1543850087},{"type":"v1","addr":"172.21.15.84:6829","nonce":1543850087}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:38:58.323 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 24 2024-04-26T21:38:58.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.323+0000 7fedfee00640 1 -- 172.21.15.84:0/3698503861 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fede006eb80 msgr2=0x7fede0071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:58.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.323+0000 7fedfee00640 1 --2- 172.21.15.84:0/3698503861 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fede006eb80 0x7fede0071030 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fedf81149d0 tx=0x7fede400b040 comp rx=0 tx=0).stop 2024-04-26T21:38:58.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.323+0000 7fedfee00640 1 -- 172.21.15.84:0/3698503861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedf80719a0 msgr2=0x7fedf8119110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:58.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.323+0000 7fedfee00640 1 --2- 172.21.15.84:0/3698503861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedf80719a0 0x7fedf8119110 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fedec0047f0 tx=0x7fedec009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:58.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.323+0000 7fedfee00640 1 -- 172.21.15.84:0/3698503861 shutdown_connections 2024-04-26T21:38:58.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.323+0000 7fedfee00640 1 --2- 172.21.15.84:0/3698503861 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fede006eb80 0x7fede0071030 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:58.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.323+0000 7fedfee00640 1 --2- 172.21.15.84:0/3698503861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedf80722b0 0x7fedf8119650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:58.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.323+0000 7fedfee00640 1 --2- 172.21.15.84:0/3698503861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedf80719a0 0x7fedf8119110 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:58.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.324+0000 7fedfee00640 1 -- 172.21.15.84:0/3698503861 >> 172.21.15.84:0/3698503861 conn(0x7fedf80f9f60 msgr2=0x7fedf80fbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:58.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.324+0000 7fedfee00640 1 -- 172.21.15.84:0/3698503861 shutdown_connections 2024-04-26T21:38:58.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.324+0000 7fedfee00640 1 -- 172.21.15.84:0/3698503861 wait complete. 2024-04-26T21:38:58.342 DEBUG:tasks.fs:max_mds reduced in epoch 24 2024-04-26T21:38:58.342 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-04-26T21:38:58.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:58 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3106034518' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-26T21:38:58.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:58 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/602850455' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-26T21:38:58.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.532+0000 7f6024e00640 1 -- 172.21.15.84:0/3641419546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60200722b0 msgr2=0x7f602010cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:58.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.532+0000 7f6024e00640 1 --2- 172.21.15.84:0/3641419546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60200722b0 0x7f602010cb70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f600c0048d0 tx=0x7f600c009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:58.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.533+0000 7f6024e00640 1 -- 172.21.15.84:0/3641419546 shutdown_connections 2024-04-26T21:38:58.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.533+0000 7f6024e00640 1 --2- 172.21.15.84:0/3641419546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60200722b0 0x7f602010cb70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:58.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.533+0000 7f6024e00640 1 --2- 172.21.15.84:0/3641419546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60200719a0 0x7f6020071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:58.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.533+0000 7f6024e00640 1 -- 172.21.15.84:0/3641419546 >> 172.21.15.84:0/3641419546 conn(0x7f60200f9f90 msgr2=0x7f60200fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:58.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.533+0000 7f6024e00640 1 -- 172.21.15.84:0/3641419546 shutdown_connections 2024-04-26T21:38:58.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.533+0000 7f6024e00640 1 -- 172.21.15.84:0/3641419546 wait complete. 2024-04-26T21:38:58.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.534+0000 7f6024e00640 1 Processor -- start 2024-04-26T21:38:58.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.534+0000 7f6024e00640 1 -- start start 2024-04-26T21:38:58.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.534+0000 7f6024e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60200719a0 0x7f60201192d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:58.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.534+0000 7f6024e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60200722b0 0x7f6020119810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:58.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.534+0000 7f6024e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6020119e10 con 0x7f60200722b0 2024-04-26T21:38:58.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.534+0000 7f6024e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6020113460 con 0x7f60200719a0 2024-04-26T21:38:58.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.535+0000 7f601d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60200722b0 0x7f6020119810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:58.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.535+0000 7f601d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60200722b0 0x7f6020119810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37702/0 (socket says 172.21.15.84:37702) 2024-04-26T21:38:58.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.535+0000 7f601d400640 1 -- 172.21.15.84:0/457277573 learned_addr learned my addr 172.21.15.84:0/457277573 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:58.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.535+0000 7f601de00640 1 --2- 172.21.15.84:0/457277573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60200719a0 0x7f60201192d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:58.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.535+0000 7f601d400640 1 -- 172.21.15.84:0/457277573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60200719a0 msgr2=0x7f60201192d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:58.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.535+0000 7f601d400640 1 --2- 172.21.15.84:0/457277573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60200719a0 0x7f60201192d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:58.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.535+0000 7f601d400640 1 -- 172.21.15.84:0/457277573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c005040 con 0x7f60200722b0 2024-04-26T21:38:58.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.535+0000 7f601d400640 1 --2- 172.21.15.84:0/457277573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60200722b0 0x7f6020119810 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f600c004930 tx=0x7f600c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:58.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.536+0000 7f6016000640 1 -- 172.21.15.84:0/457277573 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f600c0094c0 con 0x7f60200722b0 2024-04-26T21:38:58.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.536+0000 7f6016000640 1 -- 172.21.15.84:0/457277573 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f600c032e50 con 0x7f60200722b0 2024-04-26T21:38:58.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.536+0000 7f6024e00640 1 -- 172.21.15.84:0/457277573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60201136e0 con 0x7f60200722b0 2024-04-26T21:38:58.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.536+0000 7f6016000640 1 -- 172.21.15.84:0/457277573 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f600c0433b0 con 0x7f60200722b0 2024-04-26T21:38:58.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.536+0000 7f6024e00640 1 -- 172.21.15.84:0/457277573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6020113ba0 con 0x7f60200722b0 2024-04-26T21:38:58.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.537+0000 7f6024e00640 1 -- 172.21.15.84:0/457277573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60200730e0 con 0x7f60200722b0 2024-04-26T21:38:58.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.538+0000 7f6016000640 1 -- 172.21.15.84:0/457277573 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f600c02f070 con 0x7f60200722b0 2024-04-26T21:38:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.539+0000 7f6016000640 1 --2- 172.21.15.84:0/457277573 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f600406eb70 0x7f6004071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.539+0000 7f6016000640 1 -- 172.21.15.84:0/457277573 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f600c0b0960 con 0x7f60200722b0 2024-04-26T21:38:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.539+0000 7f601de00640 1 --2- 172.21.15.84:0/457277573 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f600406eb70 0x7f6004071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:58.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.540+0000 7f601de00640 1 --2- 172.21.15.84:0/457277573 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f600406eb70 0x7f6004071020 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6010004ce0 tx=0x7f601000b040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:58.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.544+0000 7f6016000640 1 -- 172.21.15.84:0/457277573 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f600c079510 con 0x7f60200722b0 2024-04-26T21:38:58.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.786+0000 7f6024e00640 1 -- 172.21.15.84:0/457277573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f602010f950 con 0x7f60200722b0 2024-04-26T21:38:58.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.787+0000 7f6016000640 1 -- 172.21.15.84:0/457277573 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v42) v1 ==== 107+0+4090 (secure 0 0 0) 0x7f600c07cbd0 con 0x7f60200722b0 2024-04-26T21:38:58.788 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:58.788 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":44247,"name":"cephfs.smithi120.qnkxcn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/4163804141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":4163804141},{"type":"v1","addr":"172.21.15.120:6825","nonce":4163804141}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:33:25.528180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi084.rtrqtr","rank":0,"incarnation":24,"state":"up:reconnect","state_seq":181,"addr":"172.21.15.84:6829/1543850087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1543850087},{"type":"v1","addr":"172.21.15.84:6829","nonce":1543850087}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:38:58.789 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-04-26T21:38:58.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.790+0000 7f6024e00640 1 -- 172.21.15.84:0/457277573 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f600406eb70 msgr2=0x7f6004071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:58.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.790+0000 7f6024e00640 1 --2- 172.21.15.84:0/457277573 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f600406eb70 0x7f6004071020 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6010004ce0 tx=0x7f601000b040 comp rx=0 tx=0).stop 2024-04-26T21:38:58.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.790+0000 7f6024e00640 1 -- 172.21.15.84:0/457277573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60200722b0 msgr2=0x7f6020119810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:58.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.790+0000 7f6024e00640 1 --2- 172.21.15.84:0/457277573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60200722b0 0x7f6020119810 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f600c004930 tx=0x7f600c009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:58.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.790+0000 7f6024e00640 1 -- 172.21.15.84:0/457277573 shutdown_connections 2024-04-26T21:38:58.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.790+0000 7f6024e00640 1 --2- 172.21.15.84:0/457277573 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f600406eb70 0x7f6004071020 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:58.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.790+0000 7f6024e00640 1 --2- 172.21.15.84:0/457277573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60200722b0 0x7f6020119810 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:58.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.790+0000 7f6024e00640 1 --2- 172.21.15.84:0/457277573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60200719a0 0x7f60201192d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:58.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.790+0000 7f6024e00640 1 -- 172.21.15.84:0/457277573 >> 172.21.15.84:0/457277573 conn(0x7f60200f9f90 msgr2=0x7f6020074500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:58.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.790+0000 7f6024e00640 1 -- 172.21.15.84:0/457277573 shutdown_connections 2024-04-26T21:38:58.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:58.791+0000 7f6024e00640 1 -- 172.21.15.84:0/457277573 wait complete. 2024-04-26T21:38:58.809 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-04-26T21:38:58.810 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-04-26T21:38:59.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.004+0000 7f190d000640 1 -- 172.21.15.84:0/4109192430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1908104bf0 msgr2=0x7f19080fe280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:59.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.004+0000 7f190d000640 1 --2- 172.21.15.84:0/4109192430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1908104bf0 0x7f19080fe280 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f18f00048d0 tx=0x7f18f0009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:59.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.004+0000 7f190d000640 1 -- 172.21.15.84:0/4109192430 shutdown_connections 2024-04-26T21:38:59.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.004+0000 7f190d000640 1 --2- 172.21.15.84:0/4109192430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1908104bf0 0x7f19080fe280 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:59.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.004+0000 7f190d000640 1 --2- 172.21.15.84:0/4109192430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1908104250 0x7f1908104620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:59.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.004+0000 7f190d000640 1 -- 172.21.15.84:0/4109192430 >> 172.21.15.84:0/4109192430 conn(0x7f19080f9f60 msgr2=0x7f19080fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:59.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.004+0000 7f190d000640 1 -- 172.21.15.84:0/4109192430 shutdown_connections 2024-04-26T21:38:59.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.004+0000 7f190d000640 1 -- 172.21.15.84:0/4109192430 wait complete. 2024-04-26T21:38:59.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.005+0000 7f190d000640 1 Processor -- start 2024-04-26T21:38:59.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.005+0000 7f190d000640 1 -- start start 2024-04-26T21:38:59.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.005+0000 7f190d000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1908104250 0x7f1908114df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:59.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.005+0000 7f190d000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1908104bf0 0x7f1908115330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:59.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.005+0000 7f190d000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19081159c0 con 0x7f1908104250 2024-04-26T21:38:59.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.005+0000 7f190d000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190810ef80 con 0x7f1908104bf0 2024-04-26T21:38:59.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.006+0000 7f1907400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1908104250 0x7f1908114df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:59.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.006+0000 7f1907400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1908104250 0x7f1908114df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37732/0 (socket says 172.21.15.84:37732) 2024-04-26T21:38:59.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.006+0000 7f1907400640 1 -- 172.21.15.84:0/2798881734 learned_addr learned my addr 172.21.15.84:0/2798881734 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:59.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.006+0000 7f18ffe00640 1 --2- 172.21.15.84:0/2798881734 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1908104bf0 0x7f1908115330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:59.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.006+0000 7f1907400640 1 -- 172.21.15.84:0/2798881734 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1908104bf0 msgr2=0x7f1908115330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:59.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.006+0000 7f1907400640 1 --2- 172.21.15.84:0/2798881734 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1908104bf0 0x7f1908115330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:59.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.006+0000 7f1907400640 1 -- 172.21.15.84:0/2798881734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f0005040 con 0x7f1908104250 2024-04-26T21:38:59.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.006+0000 7f1907400640 1 --2- 172.21.15.84:0/2798881734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1908104250 0x7f1908114df0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f18f800b790 tx=0x7f18f80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:59.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.007+0000 7f18ff400640 1 -- 172.21.15.84:0/2798881734 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18f800c700 con 0x7f1908104250 2024-04-26T21:38:59.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.007+0000 7f18ff400640 1 -- 172.21.15.84:0/2798881734 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f18f800cd30 con 0x7f1908104250 2024-04-26T21:38:59.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.007+0000 7f18ff400640 1 -- 172.21.15.84:0/2798881734 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18f8013370 con 0x7f1908104250 2024-04-26T21:38:59.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.007+0000 7f190d000640 1 -- 172.21.15.84:0/2798881734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f190810f260 con 0x7f1908104250 2024-04-26T21:38:59.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.007+0000 7f190d000640 1 -- 172.21.15.84:0/2798881734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f190810f750 con 0x7f1908104250 2024-04-26T21:38:59.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.008+0000 7f190d000640 1 -- 172.21.15.84:0/2798881734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19080ff9c0 con 0x7f1908104250 2024-04-26T21:38:59.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.009+0000 7f18ff400640 1 -- 172.21.15.84:0/2798881734 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f18f8012070 con 0x7f1908104250 2024-04-26T21:38:59.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.010+0000 7f18ff400640 1 --2- 172.21.15.84:0/2798881734 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f18e806eb80 0x7f18e8071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:59.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.010+0000 7f18ff400640 1 -- 172.21.15.84:0/2798881734 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f18f808e370 con 0x7f1908104250 2024-04-26T21:38:59.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.010+0000 7f18ffe00640 1 --2- 172.21.15.84:0/2798881734 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f18e806eb80 0x7f18e8071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:59.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.011+0000 7f18ffe00640 1 --2- 172.21.15.84:0/2798881734 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f18e806eb80 0x7f18e8071030 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f18f00048a0 tx=0x7f18f0009da0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:59.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.014+0000 7f18ff400640 1 -- 172.21.15.84:0/2798881734 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f18f8057040 con 0x7f1908104250 2024-04-26T21:38:59.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.261+0000 7f190d000640 1 -- 172.21.15.84:0/2798881734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f1908110540 con 0x7f1908104250 2024-04-26T21:38:59.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.262+0000 7f18ff400640 1 -- 172.21.15.84:0/2798881734 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v42) v1 ==== 107+0+4087 (secure 0 0 0) 0x7f1908110540 con 0x7f1908104250 2024-04-26T21:38:59.264 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:59.264 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":44247,"name":"cephfs.smithi120.qnkxcn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/4163804141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":4163804141},{"type":"v1","addr":"172.21.15.120:6825","nonce":4163804141}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:33:26.044232+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi084.rtrqtr","rank":0,"incarnation":24,"state":"up:rejoin","state_seq":182,"addr":"172.21.15.84:6829/1543850087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1543850087},{"type":"v1","addr":"172.21.15.84:6829","nonce":1543850087}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:38:59.264 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 26 2024-04-26T21:38:59.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.265+0000 7f190d000640 1 -- 172.21.15.84:0/2798881734 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f18e806eb80 msgr2=0x7f18e8071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:59.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.265+0000 7f190d000640 1 --2- 172.21.15.84:0/2798881734 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f18e806eb80 0x7f18e8071030 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f18f00048a0 tx=0x7f18f0009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:59.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.265+0000 7f190d000640 1 -- 172.21.15.84:0/2798881734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1908104250 msgr2=0x7f1908114df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:59.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.265+0000 7f190d000640 1 --2- 172.21.15.84:0/2798881734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1908104250 0x7f1908114df0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f18f800b790 tx=0x7f18f80091d0 comp rx=0 tx=0).stop 2024-04-26T21:38:59.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.265+0000 7f190d000640 1 -- 172.21.15.84:0/2798881734 shutdown_connections 2024-04-26T21:38:59.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.265+0000 7f190d000640 1 --2- 172.21.15.84:0/2798881734 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f18e806eb80 0x7f18e8071030 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:59.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.265+0000 7f190d000640 1 --2- 172.21.15.84:0/2798881734 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1908104bf0 0x7f1908115330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:59.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.265+0000 7f190d000640 1 --2- 172.21.15.84:0/2798881734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1908104250 0x7f1908114df0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:59.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.265+0000 7f190d000640 1 -- 172.21.15.84:0/2798881734 >> 172.21.15.84:0/2798881734 conn(0x7f19080f9f60 msgr2=0x7f19080fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:59.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.265+0000 7f190d000640 1 -- 172.21.15.84:0/2798881734 shutdown_connections 2024-04-26T21:38:59.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.265+0000 7f190d000640 1 -- 172.21.15.84:0/2798881734 wait complete. 2024-04-26T21:38:59.285 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-04-26T21:38:59.285 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-04-26T21:38:59.352 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:59 smithi084 ceph-mon[90138]: pgmap v386: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:59.352 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:59 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3698503861' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-26T21:38:59.352 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:59 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/457277573' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-26T21:38:59.352 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:38:59 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:38:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:59 smithi120 ceph-mon[79001]: pgmap v386: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:38:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:59 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3698503861' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-26T21:38:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:59 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/457277573' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-26T21:38:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:38:59 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:38:59.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.478+0000 7f8256600640 1 -- 172.21.15.84:0/819505586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f825006f7b0 msgr2=0x7f825006fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:59.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.478+0000 7f8256600640 1 --2- 172.21.15.84:0/819505586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f825006f7b0 0x7f825006fb80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f82440048d0 tx=0x7f8244009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:59.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.479+0000 7f8256600640 1 -- 172.21.15.84:0/819505586 shutdown_connections 2024-04-26T21:38:59.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.479+0000 7f8256600640 1 --2- 172.21.15.84:0/819505586 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82500700c0 0x7f8250108380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:59.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.479+0000 7f8256600640 1 --2- 172.21.15.84:0/819505586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f825006f7b0 0x7f825006fb80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:59.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.479+0000 7f8256600640 1 -- 172.21.15.84:0/819505586 >> 172.21.15.84:0/819505586 conn(0x7f82500f7be0 msgr2=0x7f82500f9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:59.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.479+0000 7f8256600640 1 -- 172.21.15.84:0/819505586 shutdown_connections 2024-04-26T21:38:59.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.479+0000 7f8256600640 1 -- 172.21.15.84:0/819505586 wait complete. 2024-04-26T21:38:59.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.480+0000 7f8256600640 1 Processor -- start 2024-04-26T21:38:59.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.480+0000 7f8256600640 1 -- start start 2024-04-26T21:38:59.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.480+0000 7f8256600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f825006f7b0 0x7f8250114cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:59.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.480+0000 7f8256600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82500700c0 0x7f8250115230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:59.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.480+0000 7f8256600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8250115830 con 0x7f82500700c0 2024-04-26T21:38:59.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.480+0000 7f8256600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82501159a0 con 0x7f825006f7b0 2024-04-26T21:38:59.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.480+0000 7f824fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82500700c0 0x7f8250115230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:59.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.480+0000 7f824fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82500700c0 0x7f8250115230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37754/0 (socket says 172.21.15.84:37754) 2024-04-26T21:38:59.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.480+0000 7f824fe00640 1 -- 172.21.15.84:0/1657180924 learned_addr learned my addr 172.21.15.84:0/1657180924 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:59.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.481+0000 7f824fe00640 1 -- 172.21.15.84:0/1657180924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f825006f7b0 msgr2=0x7f8250114cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:59.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.481+0000 7f824fe00640 1 --2- 172.21.15.84:0/1657180924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f825006f7b0 0x7f8250114cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:59.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.481+0000 7f824fe00640 1 -- 172.21.15.84:0/1657180924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8244005040 con 0x7f82500700c0 2024-04-26T21:38:59.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.481+0000 7f824fe00640 1 --2- 172.21.15.84:0/1657180924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82500700c0 0x7f8250115230 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f823c00c830 tx=0x7f823c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:59.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.481+0000 7f824cc00640 1 -- 172.21.15.84:0/1657180924 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f823c00a850 con 0x7f82500700c0 2024-04-26T21:38:59.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.481+0000 7f824cc00640 1 -- 172.21.15.84:0/1657180924 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f823c00ae80 con 0x7f82500700c0 2024-04-26T21:38:59.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.481+0000 7f8256600640 1 -- 172.21.15.84:0/1657180924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825010f030 con 0x7f82500700c0 2024-04-26T21:38:59.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.481+0000 7f824cc00640 1 -- 172.21.15.84:0/1657180924 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f823c012ea0 con 0x7f82500700c0 2024-04-26T21:38:59.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.481+0000 7f8256600640 1 -- 172.21.15.84:0/1657180924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825010f550 con 0x7f82500700c0 2024-04-26T21:38:59.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.483+0000 7f8256600640 1 -- 172.21.15.84:0/1657180924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8250070ef0 con 0x7f82500700c0 2024-04-26T21:38:59.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.484+0000 7f824cc00640 1 -- 172.21.15.84:0/1657180924 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f823c012400 con 0x7f82500700c0 2024-04-26T21:38:59.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.484+0000 7f824cc00640 1 --2- 172.21.15.84:0/1657180924 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f823806eb80 0x7f8238071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:59.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.485+0000 7f824cc00640 1 -- 172.21.15.84:0/1657180924 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f823c08ec80 con 0x7f82500700c0 2024-04-26T21:38:59.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.485+0000 7f8255200640 1 --2- 172.21.15.84:0/1657180924 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f823806eb80 0x7f8238071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:59.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.485+0000 7f8255200640 1 --2- 172.21.15.84:0/1657180924 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f823806eb80 0x7f8238071030 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8244003080 tx=0x7f8244009da0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:59.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.489+0000 7f824cc00640 1 -- 172.21.15.84:0/1657180924 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f823c057950 con 0x7f82500700c0 2024-04-26T21:38:59.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.734+0000 7f8256600640 1 -- 172.21.15.84:0/1657180924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f825004bcc0 con 0x7f82500700c0 2024-04-26T21:38:59.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.735+0000 7f824cc00640 1 -- 172.21.15.84:0/1657180924 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v42) v1 ==== 107+0+4096 (secure 0 0 0) 0x7f823c0126b0 con 0x7f82500700c0 2024-04-26T21:38:59.736 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:38:59.736 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":44247,"name":"cephfs.smithi120.qnkxcn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/4163804141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":4163804141},{"type":"v1","addr":"172.21.15.120:6825","nonce":4163804141}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:33:28.052273+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi084.rtrqtr","rank":0,"incarnation":24,"state":"up:active","state_seq":183,"addr":"172.21.15.84:6829/1543850087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1543850087},{"type":"v1","addr":"172.21.15.84:6829","nonce":1543850087}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14472,"qdb_cluster":[14472]},"id":1}]} 2024-04-26T21:38:59.736 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 27 2024-04-26T21:38:59.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.738+0000 7f8256600640 1 -- 172.21.15.84:0/1657180924 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f823806eb80 msgr2=0x7f8238071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:59.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.738+0000 7f8256600640 1 --2- 172.21.15.84:0/1657180924 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f823806eb80 0x7f8238071030 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8244003080 tx=0x7f8244009da0 comp rx=0 tx=0).stop 2024-04-26T21:38:59.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.738+0000 7f8256600640 1 -- 172.21.15.84:0/1657180924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82500700c0 msgr2=0x7f8250115230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:59.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.738+0000 7f8256600640 1 --2- 172.21.15.84:0/1657180924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82500700c0 0x7f8250115230 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f823c00c830 tx=0x7f823c004430 comp rx=0 tx=0).stop 2024-04-26T21:38:59.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.738+0000 7f8256600640 1 -- 172.21.15.84:0/1657180924 shutdown_connections 2024-04-26T21:38:59.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.738+0000 7f8256600640 1 --2- 172.21.15.84:0/1657180924 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f823806eb80 0x7f8238071030 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:59.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.738+0000 7f8256600640 1 --2- 172.21.15.84:0/1657180924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82500700c0 0x7f8250115230 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:59.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.738+0000 7f8256600640 1 --2- 172.21.15.84:0/1657180924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f825006f7b0 0x7f8250114cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:59.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.738+0000 7f8256600640 1 -- 172.21.15.84:0/1657180924 >> 172.21.15.84:0/1657180924 conn(0x7f82500f7be0 msgr2=0x7f82500f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:59.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.738+0000 7f8256600640 1 -- 172.21.15.84:0/1657180924 shutdown_connections 2024-04-26T21:38:59.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.738+0000 7f8256600640 1 -- 172.21.15.84:0/1657180924 wait complete. 2024-04-26T21:38:59.757 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-04-26T21:38:59.757 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-04-26T21:38:59.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.952+0000 7f318e400640 1 -- 172.21.15.84:0/585317791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f318806fd50 msgr2=0x7f31880701c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:59.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.952+0000 7f318e400640 1 --2- 172.21.15.84:0/585317791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f318806fd50 0x7f31880701c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3170009c50 tx=0x7f3170004d10 comp rx=0 tx=0).stop 2024-04-26T21:38:59.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.952+0000 7f318e400640 1 -- 172.21.15.84:0/585317791 shutdown_connections 2024-04-26T21:38:59.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.952+0000 7f318e400640 1 --2- 172.21.15.84:0/585317791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f318806fd50 0x7f31880701c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:59.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.952+0000 7f318e400640 1 --2- 172.21.15.84:0/585317791 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3188071440 0x7f318806f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:59.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.952+0000 7f318e400640 1 -- 172.21.15.84:0/585317791 >> 172.21.15.84:0/585317791 conn(0x7f31880f7fa0 msgr2=0x7f31880fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:38:59.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.953+0000 7f318e400640 1 -- 172.21.15.84:0/585317791 shutdown_connections 2024-04-26T21:38:59.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.953+0000 7f318e400640 1 -- 172.21.15.84:0/585317791 wait complete. 2024-04-26T21:38:59.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.953+0000 7f318e400640 1 Processor -- start 2024-04-26T21:38:59.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.953+0000 7f318e400640 1 -- start start 2024-04-26T21:38:59.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.954+0000 7f318e400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f318806fd50 0x7f31881195a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:59.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.954+0000 7f318e400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3188071440 0x7f3188119ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:59.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.954+0000 7f318e400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318811a130 con 0x7f318806fd50 2024-04-26T21:38:59.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.954+0000 7f318e400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3188113750 con 0x7f3188071440 2024-04-26T21:38:59.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.954+0000 7f3187400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f318806fd50 0x7f31881195a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:59.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.954+0000 7f3187400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f318806fd50 0x7f31881195a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37768/0 (socket says 172.21.15.84:37768) 2024-04-26T21:38:59.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.954+0000 7f3187400640 1 -- 172.21.15.84:0/3170900510 learned_addr learned my addr 172.21.15.84:0/3170900510 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:38:59.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.954+0000 7f317ea00640 1 --2- 172.21.15.84:0/3170900510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3188071440 0x7f3188119ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:59.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.954+0000 7f3187400640 1 -- 172.21.15.84:0/3170900510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3188071440 msgr2=0x7f3188119ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:38:59.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.954+0000 7f3187400640 1 --2- 172.21.15.84:0/3170900510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3188071440 0x7f3188119ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:38:59.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.954+0000 7f3187400640 1 -- 172.21.15.84:0/3170900510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31700098b0 con 0x7f318806fd50 2024-04-26T21:38:59.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.955+0000 7f3187400640 1 --2- 172.21.15.84:0/3170900510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f318806fd50 0x7f31881195a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f317800c790 tx=0x7f31780043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:59.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.955+0000 7f317fe00640 1 -- 172.21.15.84:0/3170900510 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f317800a820 con 0x7f318806fd50 2024-04-26T21:38:59.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.955+0000 7f317fe00640 1 -- 172.21.15.84:0/3170900510 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f317800ae50 con 0x7f318806fd50 2024-04-26T21:38:59.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.955+0000 7f318e400640 1 -- 172.21.15.84:0/3170900510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3188113a30 con 0x7f318806fd50 2024-04-26T21:38:59.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.955+0000 7f317fe00640 1 -- 172.21.15.84:0/3170900510 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31780115e0 con 0x7f318806fd50 2024-04-26T21:38:59.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.955+0000 7f318e400640 1 -- 172.21.15.84:0/3170900510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3188113f50 con 0x7f318806fd50 2024-04-26T21:38:59.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.956+0000 7f318e400640 1 -- 172.21.15.84:0/3170900510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3188070f50 con 0x7f318806fd50 2024-04-26T21:38:59.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.957+0000 7f317fe00640 1 -- 172.21.15.84:0/3170900510 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3178012400 con 0x7f318806fd50 2024-04-26T21:38:59.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.958+0000 7f317fe00640 1 --2- 172.21.15.84:0/3170900510 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f316c06eb80 0x7f316c071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:38:59.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.958+0000 7f317fe00640 1 -- 172.21.15.84:0/3170900510 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f317808ea80 con 0x7f318806fd50 2024-04-26T21:38:59.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.958+0000 7f317ea00640 1 --2- 172.21.15.84:0/3170900510 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f316c06eb80 0x7f316c071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:38:59.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.959+0000 7f317ea00640 1 --2- 172.21.15.84:0/3170900510 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f316c06eb80 0x7f316c071030 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3188114f60 tx=0x7f317002e040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:38:59.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:38:59.963+0000 7f317fe00640 1 -- 172.21.15.84:0/3170900510 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f31780577f0 con 0x7f318806fd50 2024-04-26T21:39:00.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.207+0000 7f318e400640 1 -- 172.21.15.84:0/3170900510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f318804bcc0 con 0x7f318806fd50 2024-04-26T21:39:00.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.208+0000 7f317fe00640 1 -- 172.21.15.84:0/3170900510 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v42) v1 ==== 107+0+4943 (secure 0 0 0) 0x7f317805aeb0 con 0x7f318806fd50 2024-04-26T21:39:00.209 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:39:00.209 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":34446,"name":"cephfs.smithi084.hbjunw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6827/1392878113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1392878113},{"type":"v1","addr":"172.21.15.84:6827","nonce":1392878113}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44247,"name":"cephfs.smithi120.qnkxcn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/4163804141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":4163804141},{"type":"v1","addr":"172.21.15.120:6825","nonce":4163804141}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:33:28.052273+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi084.rtrqtr","rank":0,"incarnation":24,"state":"up:active","state_seq":183,"addr":"172.21.15.84:6829/1543850087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1543850087},{"type":"v1","addr":"172.21.15.84:6829","nonce":1543850087}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14472,"qdb_cluster":[14472]},"id":1}]} 2024-04-26T21:39:00.209 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2024-04-26T21:39:00.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.211+0000 7f318e400640 1 -- 172.21.15.84:0/3170900510 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f316c06eb80 msgr2=0x7f316c071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:00.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.211+0000 7f318e400640 1 --2- 172.21.15.84:0/3170900510 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f316c06eb80 0x7f316c071030 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3188114f60 tx=0x7f317002e040 comp rx=0 tx=0).stop 2024-04-26T21:39:00.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.211+0000 7f318e400640 1 -- 172.21.15.84:0/3170900510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f318806fd50 msgr2=0x7f31881195a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:00.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.211+0000 7f318e400640 1 --2- 172.21.15.84:0/3170900510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f318806fd50 0x7f31881195a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f317800c790 tx=0x7f31780043c0 comp rx=0 tx=0).stop 2024-04-26T21:39:00.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.211+0000 7f318e400640 1 -- 172.21.15.84:0/3170900510 shutdown_connections 2024-04-26T21:39:00.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.211+0000 7f318e400640 1 --2- 172.21.15.84:0/3170900510 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f316c06eb80 0x7f316c071030 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:00.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.211+0000 7f318e400640 1 --2- 172.21.15.84:0/3170900510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3188071440 0x7f3188119ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:00.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.211+0000 7f318e400640 1 --2- 172.21.15.84:0/3170900510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f318806fd50 0x7f31881195a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:00.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.211+0000 7f318e400640 1 -- 172.21.15.84:0/3170900510 >> 172.21.15.84:0/3170900510 conn(0x7f31880f7fa0 msgr2=0x7f31880f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:00.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.211+0000 7f318e400640 1 -- 172.21.15.84:0/3170900510 shutdown_connections 2024-04-26T21:39:00.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.211+0000 7f318e400640 1 -- 172.21.15.84:0/3170900510 wait complete. 2024-04-26T21:39:00.230 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-04-26T21:39:00.230 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-04-26T21:39:00.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:00 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2798881734' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-26T21:39:00.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:00 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/1657180924' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-26T21:39:00.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.425+0000 7f8c78000640 1 -- 172.21.15.84:0/1354889112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c701043e0 msgr2=0x7f8c701047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:00.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.425+0000 7f8c78000640 1 --2- 172.21.15.84:0/1354889112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c701043e0 0x7f8c701047b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8c640048d0 tx=0x7f8c64009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:00.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.425+0000 7f8c78000640 1 -- 172.21.15.84:0/1354889112 shutdown_connections 2024-04-26T21:39:00.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.425+0000 7f8c78000640 1 --2- 172.21.15.84:0/1354889112 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c70104d80 0x7f8c700fe410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:00.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.425+0000 7f8c78000640 1 --2- 172.21.15.84:0/1354889112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c701043e0 0x7f8c701047b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:00.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.425+0000 7f8c78000640 1 -- 172.21.15.84:0/1354889112 >> 172.21.15.84:0/1354889112 conn(0x7f8c700f9f90 msgr2=0x7f8c700fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:00.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.425+0000 7f8c78000640 1 -- 172.21.15.84:0/1354889112 shutdown_connections 2024-04-26T21:39:00.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.425+0000 7f8c78000640 1 -- 172.21.15.84:0/1354889112 wait complete. 2024-04-26T21:39:00.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.426+0000 7f8c78000640 1 Processor -- start 2024-04-26T21:39:00.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.426+0000 7f8c78000640 1 -- start start 2024-04-26T21:39:00.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.427+0000 7f8c78000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c701043e0 0x7f8c70114ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:00.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.427+0000 7f8c78000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c70104d80 0x7f8c70115430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:00.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.427+0000 7f8c78000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c70115a30 con 0x7f8c701043e0 2024-04-26T21:39:00.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.427+0000 7f8c78000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7010f080 con 0x7f8c70104d80 2024-04-26T21:39:00.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.427+0000 7f8c75600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c701043e0 0x7f8c70114ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:00.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.427+0000 7f8c75600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c701043e0 0x7f8c70114ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37782/0 (socket says 172.21.15.84:37782) 2024-04-26T21:39:00.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.427+0000 7f8c75600640 1 -- 172.21.15.84:0/2600290381 learned_addr learned my addr 172.21.15.84:0/2600290381 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:00.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.427+0000 7f8c74c00640 1 --2- 172.21.15.84:0/2600290381 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c70104d80 0x7f8c70115430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:00.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.427+0000 7f8c75600640 1 -- 172.21.15.84:0/2600290381 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c70104d80 msgr2=0x7f8c70115430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:00.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.427+0000 7f8c75600640 1 --2- 172.21.15.84:0/2600290381 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c70104d80 0x7f8c70115430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:00.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.427+0000 7f8c75600640 1 -- 172.21.15.84:0/2600290381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c64005040 con 0x7f8c701043e0 2024-04-26T21:39:00.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.428+0000 7f8c75600640 1 --2- 172.21.15.84:0/2600290381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c701043e0 0x7f8c70114ef0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8c640047f0 tx=0x7f8c64009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:00.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.428+0000 7f8c6d600640 1 -- 172.21.15.84:0/2600290381 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c640094c0 con 0x7f8c701043e0 2024-04-26T21:39:00.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.428+0000 7f8c6d600640 1 -- 172.21.15.84:0/2600290381 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c64032e50 con 0x7f8c701043e0 2024-04-26T21:39:00.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.428+0000 7f8c78000640 1 -- 172.21.15.84:0/2600290381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7010f300 con 0x7f8c701043e0 2024-04-26T21:39:00.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.428+0000 7f8c6d600640 1 -- 172.21.15.84:0/2600290381 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c640433b0 con 0x7f8c701043e0 2024-04-26T21:39:00.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.428+0000 7f8c78000640 1 -- 172.21.15.84:0/2600290381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7010f7c0 con 0x7f8c701043e0 2024-04-26T21:39:00.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.429+0000 7f8c78000640 1 -- 172.21.15.84:0/2600290381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c700ffb50 con 0x7f8c701043e0 2024-04-26T21:39:00.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.430+0000 7f8c6d600640 1 -- 172.21.15.84:0/2600290381 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f8c6402f070 con 0x7f8c701043e0 2024-04-26T21:39:00.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:00 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2798881734' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-26T21:39:00.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:00 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/1657180924' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-26T21:39:00.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.431+0000 7f8c6d600640 1 --2- 172.21.15.84:0/2600290381 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8c5806eb80 0x7f8c58071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:00.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.431+0000 7f8c6d600640 1 -- 172.21.15.84:0/2600290381 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f8c640b08a0 con 0x7f8c701043e0 2024-04-26T21:39:00.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.431+0000 7f8c74c00640 1 --2- 172.21.15.84:0/2600290381 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8c5806eb80 0x7f8c58071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:00.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.432+0000 7f8c74c00640 1 --2- 172.21.15.84:0/2600290381 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8c5806eb80 0x7f8c58071030 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c007fd0 tx=0x7f8c5c009e90 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:00.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.436+0000 7f8c6d600640 1 -- 172.21.15.84:0/2600290381 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f8c64079490 con 0x7f8c701043e0 2024-04-26T21:39:00.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.660+0000 7f8c78000640 1 -- 172.21.15.84:0/2600290381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f8c7004bcc0 con 0x7f8c701043e0 2024-04-26T21:39:00.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.662+0000 7f8c6d600640 1 -- 172.21.15.84:0/2600290381 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v42) v1 ==== 107+0+4142 (secure 0 0 0) 0x7f8c6407cb50 con 0x7f8c701043e0 2024-04-26T21:39:00.663 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:39:00.663 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":34446,"name":"cephfs.smithi084.hbjunw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6827/1392878113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1392878113},{"type":"v1","addr":"172.21.15.84:6827","nonce":1392878113}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44247,"name":"cephfs.smithi120.qnkxcn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/4163804141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":4163804141},{"type":"v1","addr":"172.21.15.120:6825","nonce":4163804141}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:33:49.979558+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:39:00.663 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-04-26T21:39:00.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.665+0000 7f8c78000640 1 -- 172.21.15.84:0/2600290381 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8c5806eb80 msgr2=0x7f8c58071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:00.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.665+0000 7f8c78000640 1 --2- 172.21.15.84:0/2600290381 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8c5806eb80 0x7f8c58071030 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c007fd0 tx=0x7f8c5c009e90 comp rx=0 tx=0).stop 2024-04-26T21:39:00.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.665+0000 7f8c78000640 1 -- 172.21.15.84:0/2600290381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c701043e0 msgr2=0x7f8c70114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:00.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.665+0000 7f8c78000640 1 --2- 172.21.15.84:0/2600290381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c701043e0 0x7f8c70114ef0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8c640047f0 tx=0x7f8c64009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:00.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.665+0000 7f8c78000640 1 -- 172.21.15.84:0/2600290381 shutdown_connections 2024-04-26T21:39:00.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.665+0000 7f8c78000640 1 --2- 172.21.15.84:0/2600290381 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f8c5806eb80 0x7f8c58071030 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:00.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.665+0000 7f8c78000640 1 --2- 172.21.15.84:0/2600290381 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c70104d80 0x7f8c70115430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:00.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.665+0000 7f8c78000640 1 --2- 172.21.15.84:0/2600290381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c701043e0 0x7f8c70114ef0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:00.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.665+0000 7f8c78000640 1 -- 172.21.15.84:0/2600290381 >> 172.21.15.84:0/2600290381 conn(0x7f8c700f9f90 msgr2=0x7f8c700faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:00.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.665+0000 7f8c78000640 1 -- 172.21.15.84:0/2600290381 shutdown_connections 2024-04-26T21:39:00.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.665+0000 7f8c78000640 1 -- 172.21.15.84:0/2600290381 wait complete. 2024-04-26T21:39:00.682 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-04-26T21:39:00.682 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-04-26T21:39:00.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.874+0000 7fc974400640 1 -- 172.21.15.84:0/156243682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc96c108820 msgr2=0x7fc96c108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:00.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.874+0000 7fc974400640 1 --2- 172.21.15.84:0/156243682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc96c108820 0x7fc96c108bf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc9600048d0 tx=0x7fc960009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:00.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.874+0000 7fc974400640 1 -- 172.21.15.84:0/156243682 shutdown_connections 2024-04-26T21:39:00.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.874+0000 7fc974400640 1 --2- 172.21.15.84:0/156243682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc96c102820 0x7fc96c102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:00.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.874+0000 7fc974400640 1 --2- 172.21.15.84:0/156243682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc96c108820 0x7fc96c108bf0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:00.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.874+0000 7fc974400640 1 -- 172.21.15.84:0/156243682 >> 172.21.15.84:0/156243682 conn(0x7fc96c072020 msgr2=0x7fc96c074430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:00.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.874+0000 7fc974400640 1 -- 172.21.15.84:0/156243682 shutdown_connections 2024-04-26T21:39:00.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.874+0000 7fc974400640 1 -- 172.21.15.84:0/156243682 wait complete. 2024-04-26T21:39:00.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.875+0000 7fc974400640 1 Processor -- start 2024-04-26T21:39:00.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.875+0000 7fc974400640 1 -- start start 2024-04-26T21:39:00.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.875+0000 7fc974400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc96c102820 0x7fc96c1192d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:00.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.876+0000 7fc974400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc96c108820 0x7fc96c119810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:00.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.876+0000 7fc974400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c119e10 con 0x7fc96c108820 2024-04-26T21:39:00.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.876+0000 7fc974400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c113460 con 0x7fc96c102820 2024-04-26T21:39:00.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.876+0000 7fc971000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc96c108820 0x7fc96c119810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:00.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.876+0000 7fc971000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc96c108820 0x7fc96c119810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37792/0 (socket says 172.21.15.84:37792) 2024-04-26T21:39:00.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.876+0000 7fc971000640 1 -- 172.21.15.84:0/214906857 learned_addr learned my addr 172.21.15.84:0/214906857 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:00.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.876+0000 7fc971a00640 1 --2- 172.21.15.84:0/214906857 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc96c102820 0x7fc96c1192d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:00.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.876+0000 7fc971000640 1 -- 172.21.15.84:0/214906857 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc96c102820 msgr2=0x7fc96c1192d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:00.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.876+0000 7fc971000640 1 --2- 172.21.15.84:0/214906857 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc96c102820 0x7fc96c1192d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:00.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.876+0000 7fc971000640 1 -- 172.21.15.84:0/214906857 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc960005040 con 0x7fc96c108820 2024-04-26T21:39:00.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.877+0000 7fc971000640 1 --2- 172.21.15.84:0/214906857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc96c108820 0x7fc96c119810 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc958002a50 tx=0x7fc958004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:00.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.877+0000 7fc969600640 1 -- 172.21.15.84:0/214906857 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc958007c30 con 0x7fc96c108820 2024-04-26T21:39:00.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.877+0000 7fc969600640 1 -- 172.21.15.84:0/214906857 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc95800f040 con 0x7fc96c108820 2024-04-26T21:39:00.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.877+0000 7fc969600640 1 -- 172.21.15.84:0/214906857 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc95800db50 con 0x7fc96c108820 2024-04-26T21:39:00.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.877+0000 7fc974400640 1 -- 172.21.15.84:0/214906857 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96c113740 con 0x7fc96c108820 2024-04-26T21:39:00.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.877+0000 7fc974400640 1 -- 172.21.15.84:0/214906857 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c113c60 con 0x7fc96c108820 2024-04-26T21:39:00.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.878+0000 7fc974400640 1 -- 172.21.15.84:0/214906857 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96c103f40 con 0x7fc96c108820 2024-04-26T21:39:00.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.879+0000 7fc969600640 1 -- 172.21.15.84:0/214906857 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc95801c400 con 0x7fc96c108820 2024-04-26T21:39:00.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.881+0000 7fc969600640 1 --2- 172.21.15.84:0/214906857 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc95406eb80 0x7fc954071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:00.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.881+0000 7fc969600640 1 -- 172.21.15.84:0/214906857 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fc95808e390 con 0x7fc96c108820 2024-04-26T21:39:00.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.881+0000 7fc971a00640 1 --2- 172.21.15.84:0/214906857 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc95406eb80 0x7fc954071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:00.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.882+0000 7fc971a00640 1 --2- 172.21.15.84:0/214906857 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc95406eb80 0x7fc954071030 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc960031870 tx=0x7fc960009da0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:00.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:00.886+0000 7fc969600640 1 -- 172.21.15.84:0/214906857 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fc958056f40 con 0x7fc96c108820 2024-04-26T21:39:01.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.108+0000 7fc974400640 1 -- 172.21.15.84:0/214906857 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fc96c10f950 con 0x7fc96c108820 2024-04-26T21:39:01.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.110+0000 7fc969600640 1 -- 172.21.15.84:0/214906857 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v42) v1 ==== 107+0+4153 (secure 0 0 0) 0x7fc95805a600 con 0x7fc96c108820 2024-04-26T21:39:01.111 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:39:01.111 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34446,"name":"cephfs.smithi084.hbjunw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6827/1392878113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1392878113},{"type":"v1","addr":"172.21.15.84:6827","nonce":1392878113}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44247,"name":"cephfs.smithi120.qnkxcn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/4163804141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":4163804141},{"type":"v1","addr":"172.21.15.120:6825","nonce":4163804141}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:33:49.986203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24237},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24237":{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":0,"incarnation":30,"state":"up:replay","state_seq":2,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:39:01.111 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 30 2024-04-26T21:39:01.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.113+0000 7fc974400640 1 -- 172.21.15.84:0/214906857 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc95406eb80 msgr2=0x7fc954071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:01.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.113+0000 7fc974400640 1 --2- 172.21.15.84:0/214906857 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc95406eb80 0x7fc954071030 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc960031870 tx=0x7fc960009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:01.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.113+0000 7fc974400640 1 -- 172.21.15.84:0/214906857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc96c108820 msgr2=0x7fc96c119810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:01.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.113+0000 7fc974400640 1 --2- 172.21.15.84:0/214906857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc96c108820 0x7fc96c119810 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc958002a50 tx=0x7fc958004600 comp rx=0 tx=0).stop 2024-04-26T21:39:01.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.113+0000 7fc974400640 1 -- 172.21.15.84:0/214906857 shutdown_connections 2024-04-26T21:39:01.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.113+0000 7fc974400640 1 --2- 172.21.15.84:0/214906857 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc95406eb80 0x7fc954071030 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:01.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.113+0000 7fc974400640 1 --2- 172.21.15.84:0/214906857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc96c108820 0x7fc96c119810 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:01.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.113+0000 7fc974400640 1 --2- 172.21.15.84:0/214906857 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc96c102820 0x7fc96c1192d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:01.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.113+0000 7fc974400640 1 -- 172.21.15.84:0/214906857 >> 172.21.15.84:0/214906857 conn(0x7fc96c072020 msgr2=0x7fc96c073fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:01.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.113+0000 7fc974400640 1 -- 172.21.15.84:0/214906857 shutdown_connections 2024-04-26T21:39:01.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.113+0000 7fc974400640 1 -- 172.21.15.84:0/214906857 wait complete. 2024-04-26T21:39:01.130 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-04-26T21:39:01.130 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-04-26T21:39:01.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.320+0000 7f2eb4c00640 1 -- 172.21.15.84:0/2650038118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eb0104c00 msgr2=0x7f2eb00fe2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:01.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.320+0000 7f2eb4c00640 1 --2- 172.21.15.84:0/2650038118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eb0104c00 0x7f2eb00fe2e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0048d0 tx=0x7f2e9c009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:01.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.320+0000 7f2eb4c00640 1 -- 172.21.15.84:0/2650038118 shutdown_connections 2024-04-26T21:39:01.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.320+0000 7f2eb4c00640 1 --2- 172.21.15.84:0/2650038118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eb0104c00 0x7f2eb00fe2e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:01.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.320+0000 7f2eb4c00640 1 --2- 172.21.15.84:0/2650038118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2eb0104260 0x7f2eb0104630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:01.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.320+0000 7f2eb4c00640 1 -- 172.21.15.84:0/2650038118 >> 172.21.15.84:0/2650038118 conn(0x7f2eb00f9f60 msgr2=0x7f2eb00fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:01.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.320+0000 7f2eb4c00640 1 -- 172.21.15.84:0/2650038118 shutdown_connections 2024-04-26T21:39:01.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.320+0000 7f2eb4c00640 1 -- 172.21.15.84:0/2650038118 wait complete. 2024-04-26T21:39:01.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.321+0000 7f2eb4c00640 1 Processor -- start 2024-04-26T21:39:01.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.321+0000 7f2eb4c00640 1 -- start start 2024-04-26T21:39:01.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.321+0000 7f2eb4c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2eb0104260 0x7f2eb0114cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:01.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.321+0000 7f2eb4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eb0104c00 0x7f2eb01151f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:01.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.321+0000 7f2eb4c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb01157f0 con 0x7f2eb0104c00 2024-04-26T21:39:01.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.321+0000 7f2eb4c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb0115960 con 0x7f2eb0104260 2024-04-26T21:39:01.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.321+0000 7f2eaea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eb0104c00 0x7f2eb01151f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:01.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.322+0000 7f2eaea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eb0104c00 0x7f2eb01151f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37806/0 (socket says 172.21.15.84:37806) 2024-04-26T21:39:01.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.322+0000 7f2eaea00640 1 -- 172.21.15.84:0/1961180037 learned_addr learned my addr 172.21.15.84:0/1961180037 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:01.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.322+0000 7f2eaea00640 1 -- 172.21.15.84:0/1961180037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2eb0104260 msgr2=0x7f2eb0114cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:01.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.322+0000 7f2eaea00640 1 --2- 172.21.15.84:0/1961180037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2eb0104260 0x7f2eb0114cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:01.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.322+0000 7f2eaea00640 1 -- 172.21.15.84:0/1961180037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c005040 con 0x7f2eb0104c00 2024-04-26T21:39:01.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.322+0000 7f2eaea00640 1 --2- 172.21.15.84:0/1961180037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eb0104c00 0x7f2eb01151f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0047f0 tx=0x7f2e9c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:01.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.322+0000 7f2ea7400640 1 -- 172.21.15.84:0/1961180037 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e9c0094c0 con 0x7f2eb0104c00 2024-04-26T21:39:01.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.322+0000 7f2ea7400640 1 -- 172.21.15.84:0/1961180037 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e9c032e50 con 0x7f2eb0104c00 2024-04-26T21:39:01.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.322+0000 7f2ea7400640 1 -- 172.21.15.84:0/1961180037 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e9c0435f0 con 0x7f2eb0104c00 2024-04-26T21:39:01.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.322+0000 7f2eb4c00640 1 -- 172.21.15.84:0/1961180037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb010f000 con 0x7f2eb0104c00 2024-04-26T21:39:01.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.323+0000 7f2eb4c00640 1 -- 172.21.15.84:0/1961180037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb010f4c0 con 0x7f2eb0104c00 2024-04-26T21:39:01.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.324+0000 7f2eb4c00640 1 -- 172.21.15.84:0/1961180037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb00ff9d0 con 0x7f2eb0104c00 2024-04-26T21:39:01.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.325+0000 7f2ea7400640 1 -- 172.21.15.84:0/1961180037 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2e9c02f070 con 0x7f2eb0104c00 2024-04-26T21:39:01.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.326+0000 7f2ea7400640 1 --2- 172.21.15.84:0/1961180037 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2e9406eb80 0x7f2e94071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:01.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.326+0000 7f2ea7400640 1 -- 172.21.15.84:0/1961180037 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f2e9c0b0840 con 0x7f2eb0104c00 2024-04-26T21:39:01.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.326+0000 7f2eaf400640 1 --2- 172.21.15.84:0/1961180037 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2e9406eb80 0x7f2e94071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:01.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.327+0000 7f2eaf400640 1 --2- 172.21.15.84:0/1961180037 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2e9406eb80 0x7f2e94071030 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0004af0 tx=0x7f2ea0007c30 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:01.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.331+0000 7f2ea7400640 1 -- 172.21.15.84:0/1961180037 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f2e9c079490 con 0x7f2eb0104c00 2024-04-26T21:39:01.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:01 smithi084 ceph-mon[90138]: pgmap v387: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:01.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:01 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3170900510' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-26T21:39:01.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:01 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2600290381' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-26T21:39:01.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:01 smithi120 ceph-mon[79001]: pgmap v387: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:01.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:01 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3170900510' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-26T21:39:01.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:01 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2600290381' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-26T21:39:01.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.573+0000 7f2eb4c00640 1 -- 172.21.15.84:0/1961180037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f2eb010f730 con 0x7f2eb0104c00 2024-04-26T21:39:01.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.574+0000 7f2ea7400640 1 -- 172.21.15.84:0/1961180037 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v42) v1 ==== 107+0+4158 (secure 0 0 0) 0x7f2e9c07cb50 con 0x7f2eb0104c00 2024-04-26T21:39:01.575 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:39:01.575 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34446,"name":"cephfs.smithi084.hbjunw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6827/1392878113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1392878113},{"type":"v1","addr":"172.21.15.84:6827","nonce":1392878113}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44247,"name":"cephfs.smithi120.qnkxcn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/4163804141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":4163804141},{"type":"v1","addr":"172.21.15.120:6825","nonce":4163804141}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:33:55.270037+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24237},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24237":{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":187,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:39:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 31 2024-04-26T21:39:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.576+0000 7f2eb4c00640 1 -- 172.21.15.84:0/1961180037 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2e9406eb80 msgr2=0x7f2e94071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.576+0000 7f2eb4c00640 1 --2- 172.21.15.84:0/1961180037 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2e9406eb80 0x7f2e94071030 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0004af0 tx=0x7f2ea0007c30 comp rx=0 tx=0).stop 2024-04-26T21:39:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.577+0000 7f2eb4c00640 1 -- 172.21.15.84:0/1961180037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eb0104c00 msgr2=0x7f2eb01151f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.577+0000 7f2eb4c00640 1 --2- 172.21.15.84:0/1961180037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eb0104c00 0x7f2eb01151f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0047f0 tx=0x7f2e9c009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.577+0000 7f2eb4c00640 1 -- 172.21.15.84:0/1961180037 shutdown_connections 2024-04-26T21:39:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.577+0000 7f2eb4c00640 1 --2- 172.21.15.84:0/1961180037 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f2e9406eb80 0x7f2e94071030 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.577+0000 7f2eb4c00640 1 --2- 172.21.15.84:0/1961180037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eb0104c00 0x7f2eb01151f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:01.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.577+0000 7f2eb4c00640 1 --2- 172.21.15.84:0/1961180037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2eb0104260 0x7f2eb0114cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:01.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.577+0000 7f2eb4c00640 1 -- 172.21.15.84:0/1961180037 >> 172.21.15.84:0/1961180037 conn(0x7f2eb00f9f60 msgr2=0x7f2eb00fbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:01.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.577+0000 7f2eb4c00640 1 -- 172.21.15.84:0/1961180037 shutdown_connections 2024-04-26T21:39:01.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.577+0000 7f2eb4c00640 1 -- 172.21.15.84:0/1961180037 wait complete. 2024-04-26T21:39:01.596 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-04-26T21:39:01.596 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-04-26T21:39:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.777+0000 7f72f3e00640 1 -- 172.21.15.84:0/952727015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72f4104bf0 msgr2=0x7f72f40fe280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.777+0000 7f72f3e00640 1 --2- 172.21.15.84:0/952727015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72f4104bf0 0x7f72f40fe280 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f72e00048d0 tx=0x7f72e0009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.777+0000 7f72f3e00640 1 -- 172.21.15.84:0/952727015 shutdown_connections 2024-04-26T21:39:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.777+0000 7f72f3e00640 1 --2- 172.21.15.84:0/952727015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72f4104bf0 0x7f72f40fe280 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.777+0000 7f72f3e00640 1 --2- 172.21.15.84:0/952727015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72f4104250 0x7f72f4104620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.777+0000 7f72f3e00640 1 -- 172.21.15.84:0/952727015 >> 172.21.15.84:0/952727015 conn(0x7f72f40f9f60 msgr2=0x7f72f40fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.777+0000 7f72f3e00640 1 -- 172.21.15.84:0/952727015 shutdown_connections 2024-04-26T21:39:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.778+0000 7f72f3e00640 1 -- 172.21.15.84:0/952727015 wait complete. 2024-04-26T21:39:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.778+0000 7f72f3e00640 1 Processor -- start 2024-04-26T21:39:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.778+0000 7f72f3e00640 1 -- start start 2024-04-26T21:39:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.779+0000 7f72f3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72f4104250 0x7f72f4114d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.779+0000 7f72f3e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72f4104bf0 0x7f72f4115280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.779+0000 7f72f3e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f4115880 con 0x7f72f4104250 2024-04-26T21:39:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.779+0000 7f72f3e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f410eed0 con 0x7f72f4104bf0 2024-04-26T21:39:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.779+0000 7f72f2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72f4104250 0x7f72f4114d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.779+0000 7f72f2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72f4104250 0x7f72f4114d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37816/0 (socket says 172.21.15.84:37816) 2024-04-26T21:39:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.779+0000 7f72f2a00640 1 -- 172.21.15.84:0/3434589406 learned_addr learned my addr 172.21.15.84:0/3434589406 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.779+0000 7f72f2000640 1 --2- 172.21.15.84:0/3434589406 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72f4104bf0 0x7f72f4115280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.779+0000 7f72f2a00640 1 -- 172.21.15.84:0/3434589406 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72f4104bf0 msgr2=0x7f72f4115280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.779+0000 7f72f2a00640 1 --2- 172.21.15.84:0/3434589406 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72f4104bf0 0x7f72f4115280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.779+0000 7f72f2a00640 1 -- 172.21.15.84:0/3434589406 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e0005040 con 0x7f72f4104250 2024-04-26T21:39:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.780+0000 7f72f2a00640 1 --2- 172.21.15.84:0/3434589406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72f4104250 0x7f72f4114d40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f72e4002a50 tx=0x7f72e4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.780+0000 7f72eaa00640 1 -- 172.21.15.84:0/3434589406 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72e4007c30 con 0x7f72f4104250 2024-04-26T21:39:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.780+0000 7f72f3e00640 1 -- 172.21.15.84:0/3434589406 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f410f1b0 con 0x7f72f4104250 2024-04-26T21:39:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.780+0000 7f72eaa00640 1 -- 172.21.15.84:0/3434589406 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72e400f040 con 0x7f72f4104250 2024-04-26T21:39:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.780+0000 7f72eaa00640 1 -- 172.21.15.84:0/3434589406 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72e400db10 con 0x7f72f4104250 2024-04-26T21:39:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.780+0000 7f72f3e00640 1 -- 172.21.15.84:0/3434589406 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f410f6d0 con 0x7f72f4104250 2024-04-26T21:39:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.781+0000 7f72f3e00640 1 -- 172.21.15.84:0/3434589406 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f40ff9c0 con 0x7f72f4104250 2024-04-26T21:39:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.782+0000 7f72eaa00640 1 -- 172.21.15.84:0/3434589406 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f72e400dc90 con 0x7f72f4104250 2024-04-26T21:39:01.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.783+0000 7f72eaa00640 1 --2- 172.21.15.84:0/3434589406 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f72d806eb70 0x7f72d8071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:01.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.784+0000 7f72eaa00640 1 -- 172.21.15.84:0/3434589406 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f72e408e350 con 0x7f72f4104250 2024-04-26T21:39:01.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.784+0000 7f72f2000640 1 --2- 172.21.15.84:0/3434589406 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f72d806eb70 0x7f72d8071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:01.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.784+0000 7f72f2000640 1 --2- 172.21.15.84:0/3434589406 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f72d806eb70 0x7f72d8071020 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f72e0000c00 tx=0x7f72e0009da0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:01.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:01.788+0000 7f72eaa00640 1 -- 172.21.15.84:0/3434589406 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f72e4056f00 con 0x7f72f4104250 2024-04-26T21:39:02.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.032+0000 7f72f3e00640 1 -- 172.21.15.84:0/3434589406 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f72f4110440 con 0x7f72f4104250 2024-04-26T21:39:02.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.033+0000 7f72eaa00640 1 -- 172.21.15.84:0/3434589406 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v42) v1 ==== 107+0+5002 (secure 0 0 0) 0x7f72e405a5c0 con 0x7f72f4104250 2024-04-26T21:39:02.035 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:39:02.035 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34446,"name":"cephfs.smithi084.hbjunw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6827/1392878113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1392878113},{"type":"v1","addr":"172.21.15.84:6827","nonce":1392878113}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":34478,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6829/4015119551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4015119551},{"type":"v1","addr":"172.21.15.84:6829","nonce":4015119551}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44247,"name":"cephfs.smithi120.qnkxcn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/4163804141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":4163804141},{"type":"v1","addr":"172.21.15.120:6825","nonce":4163804141}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:33:55.330193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24237},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24237":{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":188,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:39:02.035 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 32 2024-04-26T21:39:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.036+0000 7f72f3e00640 1 -- 172.21.15.84:0/3434589406 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f72d806eb70 msgr2=0x7f72d8071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.036+0000 7f72f3e00640 1 --2- 172.21.15.84:0/3434589406 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f72d806eb70 0x7f72d8071020 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f72e0000c00 tx=0x7f72e0009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.036+0000 7f72f3e00640 1 -- 172.21.15.84:0/3434589406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72f4104250 msgr2=0x7f72f4114d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.036+0000 7f72f3e00640 1 --2- 172.21.15.84:0/3434589406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72f4104250 0x7f72f4114d40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f72e4002a50 tx=0x7f72e4004600 comp rx=0 tx=0).stop 2024-04-26T21:39:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.037+0000 7f72f3e00640 1 -- 172.21.15.84:0/3434589406 shutdown_connections 2024-04-26T21:39:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.037+0000 7f72f3e00640 1 --2- 172.21.15.84:0/3434589406 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f72d806eb70 0x7f72d8071020 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.037+0000 7f72f3e00640 1 --2- 172.21.15.84:0/3434589406 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72f4104bf0 0x7f72f4115280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.037+0000 7f72f3e00640 1 --2- 172.21.15.84:0/3434589406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72f4104250 0x7f72f4114d40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.037+0000 7f72f3e00640 1 -- 172.21.15.84:0/3434589406 >> 172.21.15.84:0/3434589406 conn(0x7f72f40f9f60 msgr2=0x7f72f40fbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:02.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.037+0000 7f72f3e00640 1 -- 172.21.15.84:0/3434589406 shutdown_connections 2024-04-26T21:39:02.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.037+0000 7f72f3e00640 1 -- 172.21.15.84:0/3434589406 wait complete. 2024-04-26T21:39:02.056 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-04-26T21:39:02.056 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-04-26T21:39:02.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.250+0000 7fa9d5000640 1 -- 172.21.15.84:0/3525074321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9d00722b0 msgr2=0x7fa9d010cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:02.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.250+0000 7fa9d5000640 1 --2- 172.21.15.84:0/3525074321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9d00722b0 0x7fa9d010cb70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80048d0 tx=0x7fa9b8009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:02.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.250+0000 7fa9d5000640 1 -- 172.21.15.84:0/3525074321 shutdown_connections 2024-04-26T21:39:02.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.250+0000 7fa9d5000640 1 --2- 172.21.15.84:0/3525074321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9d00722b0 0x7fa9d010cb70 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:02.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.250+0000 7fa9d5000640 1 --2- 172.21.15.84:0/3525074321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9d00719a0 0x7fa9d0071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:02.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.250+0000 7fa9d5000640 1 -- 172.21.15.84:0/3525074321 >> 172.21.15.84:0/3525074321 conn(0x7fa9d00f9f90 msgr2=0x7fa9d00fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:02.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.251+0000 7fa9d5000640 1 -- 172.21.15.84:0/3525074321 shutdown_connections 2024-04-26T21:39:02.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.251+0000 7fa9d5000640 1 -- 172.21.15.84:0/3525074321 wait complete. 2024-04-26T21:39:02.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.251+0000 7fa9d5000640 1 Processor -- start 2024-04-26T21:39:02.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.251+0000 7fa9d5000640 1 -- start start 2024-04-26T21:39:02.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.252+0000 7fa9d5000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9d00719a0 0x7fa9d01192d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:02.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.252+0000 7fa9d5000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9d00722b0 0x7fa9d0119810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:02.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.252+0000 7fa9d5000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d0119e10 con 0x7fa9d00722b0 2024-04-26T21:39:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.252+0000 7fa9d5000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d0113460 con 0x7fa9d00719a0 2024-04-26T21:39:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.252+0000 7fa9c5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9d00722b0 0x7fa9d0119810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.252+0000 7fa9c5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9d00722b0 0x7fa9d0119810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58346/0 (socket says 172.21.15.84:58346) 2024-04-26T21:39:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.252+0000 7fa9c5400640 1 -- 172.21.15.84:0/2023740386 learned_addr learned my addr 172.21.15.84:0/2023740386 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.252+0000 7fa9cde00640 1 --2- 172.21.15.84:0/2023740386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9d00719a0 0x7fa9d01192d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.252+0000 7fa9c5400640 1 -- 172.21.15.84:0/2023740386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9d00719a0 msgr2=0x7fa9d01192d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.252+0000 7fa9c5400640 1 --2- 172.21.15.84:0/2023740386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9d00719a0 0x7fa9d01192d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.252+0000 7fa9c5400640 1 -- 172.21.15.84:0/2023740386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b8005040 con 0x7fa9d00722b0 2024-04-26T21:39:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.252+0000 7fa9cde00640 1 --2- 172.21.15.84:0/2023740386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9d00719a0 0x7fa9d01192d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:39:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.253+0000 7fa9c5400640 1 --2- 172.21.15.84:0/2023740386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9d00722b0 0x7fa9d0119810 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8004930 tx=0x7fa9b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.253+0000 7fa9c6a00640 1 -- 172.21.15.84:0/2023740386 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9b80094c0 con 0x7fa9d00722b0 2024-04-26T21:39:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.253+0000 7fa9c6a00640 1 -- 172.21.15.84:0/2023740386 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa9b8032e50 con 0x7fa9d00722b0 2024-04-26T21:39:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.253+0000 7fa9c6a00640 1 -- 172.21.15.84:0/2023740386 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9b80433b0 con 0x7fa9d00722b0 2024-04-26T21:39:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.253+0000 7fa9d5000640 1 -- 172.21.15.84:0/2023740386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d01136e0 con 0x7fa9d00722b0 2024-04-26T21:39:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.253+0000 7fa9d5000640 1 -- 172.21.15.84:0/2023740386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d0113ba0 con 0x7fa9d00722b0 2024-04-26T21:39:02.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.254+0000 7fa9d5000640 1 -- 172.21.15.84:0/2023740386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d00730e0 con 0x7fa9d00722b0 2024-04-26T21:39:02.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.255+0000 7fa9c6a00640 1 -- 172.21.15.84:0/2023740386 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa9b802f070 con 0x7fa9d00722b0 2024-04-26T21:39:02.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.256+0000 7fa9c6a00640 1 --2- 172.21.15.84:0/2023740386 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa9b406eb70 0x7fa9b4071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:02.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.256+0000 7fa9c6a00640 1 -- 172.21.15.84:0/2023740386 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fa9b80b0980 con 0x7fa9d00722b0 2024-04-26T21:39:02.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.257+0000 7fa9cde00640 1 --2- 172.21.15.84:0/2023740386 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa9b406eb70 0x7fa9b4071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:02.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.257+0000 7fa9cde00640 1 --2- 172.21.15.84:0/2023740386 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa9b406eb70 0x7fa9b4071020 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00041d0 tx=0x7fa9c0009040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:02.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.261+0000 7fa9c6a00640 1 -- 172.21.15.84:0/2023740386 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fa9b80795d0 con 0x7fa9d00722b0 2024-04-26T21:39:02.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:02 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/214906857' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-26T21:39:02.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:02 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/1961180037' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-26T21:39:02.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:02 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3434589406' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-26T21:39:02.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:02 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/214906857' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-26T21:39:02.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:02 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/1961180037' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-26T21:39:02.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:02 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3434589406' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-26T21:39:02.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.501+0000 7fa9d5000640 1 -- 172.21.15.84:0/2023740386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7fa9d010f950 con 0x7fa9d00722b0 2024-04-26T21:39:02.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.504+0000 7fa9c6a00640 1 -- 172.21.15.84:0/2023740386 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v42) v1 ==== 107+0+5011 (secure 0 0 0) 0x7fa9b807cc90 con 0x7fa9d00722b0 2024-04-26T21:39:02.504 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:39:02.504 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34446,"name":"cephfs.smithi084.hbjunw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6827/1392878113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1392878113},{"type":"v1","addr":"172.21.15.84:6827","nonce":1392878113}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":34478,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6829/4015119551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4015119551},{"type":"v1","addr":"172.21.15.84:6829","nonce":4015119551}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44247,"name":"cephfs.smithi120.qnkxcn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/4163804141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":4163804141},{"type":"v1","addr":"172.21.15.120:6825","nonce":4163804141}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:33:57.335661+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24237},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24237":{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":0,"incarnation":30,"state":"up:active","state_seq":189,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24237,"qdb_cluster":[24237]},"id":1}]} 2024-04-26T21:39:02.504 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 33 2024-04-26T21:39:02.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.505+0000 7fa9d5000640 1 -- 172.21.15.84:0/2023740386 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa9b406eb70 msgr2=0x7fa9b4071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:02.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.505+0000 7fa9d5000640 1 --2- 172.21.15.84:0/2023740386 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa9b406eb70 0x7fa9b4071020 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00041d0 tx=0x7fa9c0009040 comp rx=0 tx=0).stop 2024-04-26T21:39:02.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.505+0000 7fa9d5000640 1 -- 172.21.15.84:0/2023740386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9d00722b0 msgr2=0x7fa9d0119810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:02.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.505+0000 7fa9d5000640 1 --2- 172.21.15.84:0/2023740386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9d00722b0 0x7fa9d0119810 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8004930 tx=0x7fa9b8009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:02.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.505+0000 7fa9d5000640 1 -- 172.21.15.84:0/2023740386 shutdown_connections 2024-04-26T21:39:02.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.505+0000 7fa9d5000640 1 --2- 172.21.15.84:0/2023740386 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa9b406eb70 0x7fa9b4071020 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:02.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.505+0000 7fa9d5000640 1 --2- 172.21.15.84:0/2023740386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9d00722b0 0x7fa9d0119810 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:02.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.505+0000 7fa9d5000640 1 --2- 172.21.15.84:0/2023740386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9d00719a0 0x7fa9d01192d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:02.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.505+0000 7fa9d5000640 1 -- 172.21.15.84:0/2023740386 >> 172.21.15.84:0/2023740386 conn(0x7fa9d00f9f90 msgr2=0x7fa9d0074500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:02.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.505+0000 7fa9d5000640 1 -- 172.21.15.84:0/2023740386 shutdown_connections 2024-04-26T21:39:02.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.507+0000 7fa9d5000640 1 -- 172.21.15.84:0/2023740386 wait complete. 2024-04-26T21:39:02.524 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-04-26T21:39:02.524 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-04-26T21:39:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.710+0000 7f6f91800640 1 -- 172.21.15.84:0/1688557062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f8c1029d0 msgr2=0x7f6f8c0fc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.710+0000 7f6f91800640 1 --2- 172.21.15.84:0/1688557062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f8c1029d0 0x7f6f8c0fc060 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6f740048d0 tx=0x7f6f74009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.710+0000 7f6f91800640 1 -- 172.21.15.84:0/1688557062 shutdown_connections 2024-04-26T21:39:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.710+0000 7f6f91800640 1 --2- 172.21.15.84:0/1688557062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f8c1029d0 0x7f6f8c0fc060 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.710+0000 7f6f91800640 1 --2- 172.21.15.84:0/1688557062 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f8c102030 0x7f6f8c102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.710+0000 7f6f91800640 1 -- 172.21.15.84:0/1688557062 >> 172.21.15.84:0/1688557062 conn(0x7f6f8c0f7c60 msgr2=0x7f6f8c0fa070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.710+0000 7f6f91800640 1 -- 172.21.15.84:0/1688557062 shutdown_connections 2024-04-26T21:39:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.710+0000 7f6f91800640 1 -- 172.21.15.84:0/1688557062 wait complete. 2024-04-26T21:39:02.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.711+0000 7f6f91800640 1 Processor -- start 2024-04-26T21:39:02.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.711+0000 7f6f91800640 1 -- start start 2024-04-26T21:39:02.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.712+0000 7f6f91800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f8c102030 0x7f6f8c06f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:02.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.712+0000 7f6f91800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f8c1029d0 0x7f6f8c06fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:02.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.712+0000 7f6f91800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c071650 con 0x7f6f8c102030 2024-04-26T21:39:02.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.712+0000 7f6f91800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c0701f0 con 0x7f6f8c1029d0 2024-04-26T21:39:02.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.712+0000 7f6f8be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f8c102030 0x7f6f8c06f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:02.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.712+0000 7f6f8be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f8c102030 0x7f6f8c06f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58376/0 (socket says 172.21.15.84:58376) 2024-04-26T21:39:02.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.712+0000 7f6f8be00640 1 -- 172.21.15.84:0/2837159784 learned_addr learned my addr 172.21.15.84:0/2837159784 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:02.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.713+0000 7f6f8be00640 1 -- 172.21.15.84:0/2837159784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f8c1029d0 msgr2=0x7f6f8c06fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:02.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.713+0000 7f6f8be00640 1 --2- 172.21.15.84:0/2837159784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f8c1029d0 0x7f6f8c06fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:02.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.713+0000 7f6f8be00640 1 -- 172.21.15.84:0/2837159784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f74005040 con 0x7f6f8c102030 2024-04-26T21:39:02.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.713+0000 7f6f8be00640 1 --2- 172.21.15.84:0/2837159784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f8c102030 0x7f6f8c06f770 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00c830 tx=0x7f6f7c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:02.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.713+0000 7f6f88c00640 1 -- 172.21.15.84:0/2837159784 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f7c00a850 con 0x7f6f8c102030 2024-04-26T21:39:02.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.713+0000 7f6f88c00640 1 -- 172.21.15.84:0/2837159784 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f7c00ae80 con 0x7f6f8c102030 2024-04-26T21:39:02.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.713+0000 7f6f91800640 1 -- 172.21.15.84:0/2837159784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8c0704d0 con 0x7f6f8c102030 2024-04-26T21:39:02.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.713+0000 7f6f88c00640 1 -- 172.21.15.84:0/2837159784 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f7c012ea0 con 0x7f6f8c102030 2024-04-26T21:39:02.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.713+0000 7f6f91800640 1 -- 172.21.15.84:0/2837159784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8c119240 con 0x7f6f8c102030 2024-04-26T21:39:02.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.715+0000 7f6f91800640 1 -- 172.21.15.84:0/2837159784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8c0fd7a0 con 0x7f6f8c102030 2024-04-26T21:39:02.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.716+0000 7f6f88c00640 1 -- 172.21.15.84:0/2837159784 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6f7c012400 con 0x7f6f8c102030 2024-04-26T21:39:02.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.717+0000 7f6f88c00640 1 --2- 172.21.15.84:0/2837159784 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6f6c06eb70 0x7f6f6c071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:02.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.717+0000 7f6f88c00640 1 -- 172.21.15.84:0/2837159784 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f6f7c08ec20 con 0x7f6f8c102030 2024-04-26T21:39:02.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.717+0000 7f6f83e00640 1 --2- 172.21.15.84:0/2837159784 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6f6c06eb70 0x7f6f6c071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:02.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.718+0000 7f6f83e00640 1 --2- 172.21.15.84:0/2837159784 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6f6c06eb70 0x7f6f6c071020 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6f740043d0 tx=0x7f6f74009da0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:02.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.722+0000 7f6f88c00640 1 -- 172.21.15.84:0/2837159784 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f6f7c0578d0 con 0x7f6f8c102030 2024-04-26T21:39:02.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.953+0000 7f6f91800640 1 -- 172.21.15.84:0/2837159784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f6f8c04bcc0 con 0x7f6f8c102030 2024-04-26T21:39:02.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.955+0000 7f6f88c00640 1 -- 172.21.15.84:0/2837159784 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v42) v1 ==== 107+0+4229 (secure 0 0 0) 0x7f6f7c0126b0 con 0x7f6f8c102030 2024-04-26T21:39:02.955 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:39:02.955 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34446,"name":"cephfs.smithi084.hbjunw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6827/1392878113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1392878113},{"type":"v1","addr":"172.21.15.84:6827","nonce":1392878113}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":34478,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6829/4015119551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4015119551},{"type":"v1","addr":"172.21.15.84:6829","nonce":4015119551}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:33:57.335661+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24237},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24237":{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":0,"incarnation":30,"state":"up:active","state_seq":189,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24237,"qdb_cluster":[24237]},"id":1}]} 2024-04-26T21:39:02.955 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 34 2024-04-26T21:39:02.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.958+0000 7f6f91800640 1 -- 172.21.15.84:0/2837159784 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6f6c06eb70 msgr2=0x7f6f6c071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:02.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.958+0000 7f6f91800640 1 --2- 172.21.15.84:0/2837159784 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6f6c06eb70 0x7f6f6c071020 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6f740043d0 tx=0x7f6f74009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:02.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.958+0000 7f6f91800640 1 -- 172.21.15.84:0/2837159784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f8c102030 msgr2=0x7f6f8c06f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:02.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.958+0000 7f6f91800640 1 --2- 172.21.15.84:0/2837159784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f8c102030 0x7f6f8c06f770 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00c830 tx=0x7f6f7c004430 comp rx=0 tx=0).stop 2024-04-26T21:39:02.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.958+0000 7f6f91800640 1 -- 172.21.15.84:0/2837159784 shutdown_connections 2024-04-26T21:39:02.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.958+0000 7f6f91800640 1 --2- 172.21.15.84:0/2837159784 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f6f6c06eb70 0x7f6f6c071020 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:02.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.958+0000 7f6f91800640 1 --2- 172.21.15.84:0/2837159784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f8c1029d0 0x7f6f8c06fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:02.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.958+0000 7f6f91800640 1 --2- 172.21.15.84:0/2837159784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f8c102030 0x7f6f8c06f770 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:02.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.958+0000 7f6f91800640 1 -- 172.21.15.84:0/2837159784 >> 172.21.15.84:0/2837159784 conn(0x7f6f8c0f7c60 msgr2=0x7f6f8c0f8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:02.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.958+0000 7f6f91800640 1 -- 172.21.15.84:0/2837159784 shutdown_connections 2024-04-26T21:39:02.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:02.958+0000 7f6f91800640 1 -- 172.21.15.84:0/2837159784 wait complete. 2024-04-26T21:39:02.975 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-04-26T21:39:02.975 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-04-26T21:39:03.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.160+0000 7f39c8e00640 1 -- 172.21.15.84:0/3464652548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c4104d80 msgr2=0x7f39c40fe410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:03.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.160+0000 7f39c8e00640 1 --2- 172.21.15.84:0/3464652548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c4104d80 0x7f39c40fe410 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f39ac0048d0 tx=0x7f39ac009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:03.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.160+0000 7f39c8e00640 1 -- 172.21.15.84:0/3464652548 shutdown_connections 2024-04-26T21:39:03.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.160+0000 7f39c8e00640 1 --2- 172.21.15.84:0/3464652548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c4104d80 0x7f39c40fe410 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:03.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.160+0000 7f39c8e00640 1 --2- 172.21.15.84:0/3464652548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39c41043e0 0x7f39c41047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:03.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.160+0000 7f39c8e00640 1 -- 172.21.15.84:0/3464652548 >> 172.21.15.84:0/3464652548 conn(0x7f39c40f9f90 msgr2=0x7f39c40fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:03.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.160+0000 7f39c8e00640 1 -- 172.21.15.84:0/3464652548 shutdown_connections 2024-04-26T21:39:03.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.160+0000 7f39c8e00640 1 -- 172.21.15.84:0/3464652548 wait complete. 2024-04-26T21:39:03.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.161+0000 7f39c8e00640 1 Processor -- start 2024-04-26T21:39:03.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.161+0000 7f39c8e00640 1 -- start start 2024-04-26T21:39:03.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.162+0000 7f39c8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c41043e0 0x7f39c4114f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:03.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.162+0000 7f39c8e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39c4104d80 0x7f39c4115460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:03.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.162+0000 7f39c8e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c4115a60 con 0x7f39c41043e0 2024-04-26T21:39:03.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.162+0000 7f39c8e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c410f0b0 con 0x7f39c4104d80 2024-04-26T21:39:03.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.162+0000 7f39c1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c41043e0 0x7f39c4114f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:03.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.162+0000 7f39c1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c41043e0 0x7f39c4114f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58394/0 (socket says 172.21.15.84:58394) 2024-04-26T21:39:03.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.162+0000 7f39c1e00640 1 -- 172.21.15.84:0/3727382366 learned_addr learned my addr 172.21.15.84:0/3727382366 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:03.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.162+0000 7f39bbe00640 1 --2- 172.21.15.84:0/3727382366 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39c4104d80 0x7f39c4115460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:03.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.162+0000 7f39c1e00640 1 -- 172.21.15.84:0/3727382366 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39c4104d80 msgr2=0x7f39c4115460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:03.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.162+0000 7f39c1e00640 1 --2- 172.21.15.84:0/3727382366 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39c4104d80 0x7f39c4115460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:03.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.162+0000 7f39c1e00640 1 -- 172.21.15.84:0/3727382366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac005040 con 0x7f39c41043e0 2024-04-26T21:39:03.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.163+0000 7f39c1e00640 1 --2- 172.21.15.84:0/3727382366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c41043e0 0x7f39c4114f20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f39b400c790 tx=0x7f39b40043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:03.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.163+0000 7f39ba000640 1 -- 172.21.15.84:0/3727382366 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39b400a820 con 0x7f39c41043e0 2024-04-26T21:39:03.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.163+0000 7f39ba000640 1 -- 172.21.15.84:0/3727382366 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f39b400ae50 con 0x7f39c41043e0 2024-04-26T21:39:03.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.163+0000 7f39c8e00640 1 -- 172.21.15.84:0/3727382366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c410f390 con 0x7f39c41043e0 2024-04-26T21:39:03.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.163+0000 7f39ba000640 1 -- 172.21.15.84:0/3727382366 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39b40115e0 con 0x7f39c41043e0 2024-04-26T21:39:03.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.163+0000 7f39c8e00640 1 -- 172.21.15.84:0/3727382366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c410f8b0 con 0x7f39c41043e0 2024-04-26T21:39:03.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.164+0000 7f39c8e00640 1 -- 172.21.15.84:0/3727382366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c40ffb50 con 0x7f39c41043e0 2024-04-26T21:39:03.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.165+0000 7f39ba000640 1 -- 172.21.15.84:0/3727382366 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f39b4012400 con 0x7f39c41043e0 2024-04-26T21:39:03.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.166+0000 7f39ba000640 1 --2- 172.21.15.84:0/3727382366 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f39a806ebc0 0x7f39a8071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:03.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.166+0000 7f39ba000640 1 -- 172.21.15.84:0/3727382366 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f39b408ec70 con 0x7f39c41043e0 2024-04-26T21:39:03.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.166+0000 7f39bbe00640 1 --2- 172.21.15.84:0/3727382366 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f39a806ebc0 0x7f39a8071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:03.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.167+0000 7f39bbe00640 1 --2- 172.21.15.84:0/3727382366 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f39a806ebc0 0x7f39a8071070 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f39ac000c00 tx=0x7f39ac009da0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:03.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.171+0000 7f39ba000640 1 -- 172.21.15.84:0/3727382366 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f39b40578a0 con 0x7f39c41043e0 2024-04-26T21:39:03.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.410+0000 7f39c8e00640 1 -- 172.21.15.84:0/3727382366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f39c404bcc0 con 0x7f39c41043e0 2024-04-26T21:39:03.411 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:03 smithi084 ceph-mon[90138]: pgmap v388: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:03.411 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:03 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2023740386' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-26T21:39:03.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:03 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2837159784' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-26T21:39:03.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.412+0000 7f39ba000640 1 -- 172.21.15.84:0/3727382366 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v42) v1 ==== 107+0+5079 (secure 0 0 0) 0x7f39b4057030 con 0x7f39c41043e0 2024-04-26T21:39:03.412 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:39:03.413 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34446,"name":"cephfs.smithi084.hbjunw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6827/1392878113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1392878113},{"type":"v1","addr":"172.21.15.84:6827","nonce":1392878113}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":34478,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6829/4015119551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4015119551},{"type":"v1","addr":"172.21.15.84:6829","nonce":4015119551}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44285,"name":"cephfs.smithi120.qnkxcn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/1351450046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1351450046},{"type":"v1","addr":"172.21.15.120:6825","nonce":1351450046}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:33:57.335661+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24237},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24237":{"gid":24237,"name":"cephfs.smithi120.ufqfoh","rank":0,"incarnation":30,"state":"up:active","state_seq":189,"addr":"172.21.15.120:6827/2972379081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2972379081},{"type":"v1","addr":"172.21.15.120:6827","nonce":2972379081}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24237,"qdb_cluster":[24237]},"id":1}]} 2024-04-26T21:39:03.413 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 35 2024-04-26T21:39:03.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.415+0000 7f39c8e00640 1 -- 172.21.15.84:0/3727382366 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f39a806ebc0 msgr2=0x7f39a8071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:03.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.415+0000 7f39c8e00640 1 --2- 172.21.15.84:0/3727382366 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f39a806ebc0 0x7f39a8071070 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f39ac000c00 tx=0x7f39ac009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:03.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.415+0000 7f39c8e00640 1 -- 172.21.15.84:0/3727382366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c41043e0 msgr2=0x7f39c4114f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:03.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.415+0000 7f39c8e00640 1 --2- 172.21.15.84:0/3727382366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c41043e0 0x7f39c4114f20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f39b400c790 tx=0x7f39b40043c0 comp rx=0 tx=0).stop 2024-04-26T21:39:03.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.415+0000 7f39c8e00640 1 -- 172.21.15.84:0/3727382366 shutdown_connections 2024-04-26T21:39:03.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.415+0000 7f39c8e00640 1 --2- 172.21.15.84:0/3727382366 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f39a806ebc0 0x7f39a8071070 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:03.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.415+0000 7f39c8e00640 1 --2- 172.21.15.84:0/3727382366 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39c4104d80 0x7f39c4115460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:03.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.415+0000 7f39c8e00640 1 --2- 172.21.15.84:0/3727382366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c41043e0 0x7f39c4114f20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:03.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.415+0000 7f39c8e00640 1 -- 172.21.15.84:0/3727382366 >> 172.21.15.84:0/3727382366 conn(0x7f39c40f9f90 msgr2=0x7f39c40fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:03.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.415+0000 7f39c8e00640 1 -- 172.21.15.84:0/3727382366 shutdown_connections 2024-04-26T21:39:03.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.415+0000 7f39c8e00640 1 -- 172.21.15.84:0/3727382366 wait complete. 2024-04-26T21:39:03.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:03 smithi120 ceph-mon[79001]: pgmap v388: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:03.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:03 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2023740386' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-26T21:39:03.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:03 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2837159784' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-26T21:39:03.435 DEBUG:tasks.fs:max_mds reduced in epoch 35 2024-04-26T21:39:03.435 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 36 2024-04-26T21:39:03.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.623+0000 7fd57fe00640 1 -- 172.21.15.84:0/3176035702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd580108680 msgr2=0x7fd580108a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:03.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.623+0000 7fd57fe00640 1 --2- 172.21.15.84:0/3176035702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd580108680 0x7fd580108a50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd5700048d0 tx=0x7fd570009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:03.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.623+0000 7fd57fe00640 1 -- 172.21.15.84:0/3176035702 shutdown_connections 2024-04-26T21:39:03.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.623+0000 7fd57fe00640 1 --2- 172.21.15.84:0/3176035702 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd580102670 0x7fd580102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:03.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.623+0000 7fd57fe00640 1 --2- 172.21.15.84:0/3176035702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd580108680 0x7fd580108a50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:03.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.623+0000 7fd57fe00640 1 -- 172.21.15.84:0/3176035702 >> 172.21.15.84:0/3176035702 conn(0x7fd580071e60 msgr2=0x7fd580074270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:03.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.623+0000 7fd57fe00640 1 -- 172.21.15.84:0/3176035702 shutdown_connections 2024-04-26T21:39:03.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.623+0000 7fd57fe00640 1 -- 172.21.15.84:0/3176035702 wait complete. 2024-04-26T21:39:03.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.624+0000 7fd57fe00640 1 Processor -- start 2024-04-26T21:39:03.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.624+0000 7fd57fe00640 1 -- start start 2024-04-26T21:39:03.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.624+0000 7fd57fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd580102670 0x7fd580119110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:03.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.624+0000 7fd57fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd580108680 0x7fd580119650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:03.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.624+0000 7fd57fe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd580119c50 con 0x7fd580102670 2024-04-26T21:39:03.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.624+0000 7fd57fe00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5801132a0 con 0x7fd580108680 2024-04-26T21:39:03.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.624+0000 7fd57ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd580102670 0x7fd580119110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:03.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.624+0000 7fd57ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd580102670 0x7fd580119110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58412/0 (socket says 172.21.15.84:58412) 2024-04-26T21:39:03.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.624+0000 7fd57ea00640 1 -- 172.21.15.84:0/4147611630 learned_addr learned my addr 172.21.15.84:0/4147611630 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:03.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.625+0000 7fd57ea00640 1 -- 172.21.15.84:0/4147611630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd580108680 msgr2=0x7fd580119650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:03.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.625+0000 7fd57ea00640 1 --2- 172.21.15.84:0/4147611630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd580108680 0x7fd580119650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:03.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.625+0000 7fd57ea00640 1 -- 172.21.15.84:0/4147611630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd570005040 con 0x7fd580102670 2024-04-26T21:39:03.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.625+0000 7fd57ea00640 1 --2- 172.21.15.84:0/4147611630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd580102670 0x7fd580119110 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd5700047f0 tx=0x7fd570009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:03.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.625+0000 7fd576a00640 1 -- 172.21.15.84:0/4147611630 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5700094c0 con 0x7fd580102670 2024-04-26T21:39:03.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.625+0000 7fd576a00640 1 -- 172.21.15.84:0/4147611630 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd570032e50 con 0x7fd580102670 2024-04-26T21:39:03.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.625+0000 7fd576a00640 1 -- 172.21.15.84:0/4147611630 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5700433b0 con 0x7fd580102670 2024-04-26T21:39:03.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.625+0000 7fd57fe00640 1 -- 172.21.15.84:0/4147611630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd580113520 con 0x7fd580102670 2024-04-26T21:39:03.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.625+0000 7fd57fe00640 1 -- 172.21.15.84:0/4147611630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd580113990 con 0x7fd580102670 2024-04-26T21:39:03.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.626+0000 7fd57fe00640 1 -- 172.21.15.84:0/4147611630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd580103da0 con 0x7fd580102670 2024-04-26T21:39:03.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.628+0000 7fd576a00640 1 -- 172.21.15.84:0/4147611630 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd57002f070 con 0x7fd580102670 2024-04-26T21:39:03.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.628+0000 7fd576a00640 1 --2- 172.21.15.84:0/4147611630 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd56406eb80 0x7fd564071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:03.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.628+0000 7fd576a00640 1 -- 172.21.15.84:0/4147611630 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fd5700b0950 con 0x7fd580102670 2024-04-26T21:39:03.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.629+0000 7fd577e00640 1 --2- 172.21.15.84:0/4147611630 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd56406eb80 0x7fd564071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:03.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.629+0000 7fd577e00640 1 --2- 172.21.15.84:0/4147611630 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd56406eb80 0x7fd564071030 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd5801149d0 tx=0x7fd568009c50 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:03.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.634+0000 7fd576a00640 1 -- 172.21.15.84:0/4147611630 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fd5700795a0 con 0x7fd580102670 2024-04-26T21:39:03.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.874+0000 7fd57fe00640 1 -- 172.21.15.84:0/4147611630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7fd580113c00 con 0x7fd580102670 2024-04-26T21:39:03.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.875+0000 7fd576a00640 1 -- 172.21.15.84:0/4147611630 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v42) v1 ==== 107+0+4275 (secure 0 0 0) 0x7fd57007cc60 con 0x7fd580102670 2024-04-26T21:39:03.875 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:39:03.875 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34446,"name":"cephfs.smithi084.hbjunw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6827/1392878113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1392878113},{"type":"v1","addr":"172.21.15.84:6827","nonce":1392878113}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":34478,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6829/4015119551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4015119551},{"type":"v1","addr":"172.21.15.84:6829","nonce":4015119551}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44285,"name":"cephfs.smithi120.qnkxcn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/1351450046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1351450046},{"type":"v1","addr":"172.21.15.120:6825","nonce":1351450046}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:34:37.842828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:39:03.876 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 36 2024-04-26T21:39:03.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.877+0000 7fd57fe00640 1 -- 172.21.15.84:0/4147611630 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd56406eb80 msgr2=0x7fd564071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:03.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.877+0000 7fd57fe00640 1 --2- 172.21.15.84:0/4147611630 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd56406eb80 0x7fd564071030 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd5801149d0 tx=0x7fd568009c50 comp rx=0 tx=0).stop 2024-04-26T21:39:03.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.877+0000 7fd57fe00640 1 -- 172.21.15.84:0/4147611630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd580102670 msgr2=0x7fd580119110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:03.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.877+0000 7fd57fe00640 1 --2- 172.21.15.84:0/4147611630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd580102670 0x7fd580119110 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd5700047f0 tx=0x7fd570009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:03.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.877+0000 7fd57fe00640 1 -- 172.21.15.84:0/4147611630 shutdown_connections 2024-04-26T21:39:03.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.877+0000 7fd57fe00640 1 --2- 172.21.15.84:0/4147611630 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd56406eb80 0x7fd564071030 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:03.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.877+0000 7fd57fe00640 1 --2- 172.21.15.84:0/4147611630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd580108680 0x7fd580119650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:03.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.878+0000 7fd57fe00640 1 --2- 172.21.15.84:0/4147611630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd580102670 0x7fd580119110 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:03.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.878+0000 7fd57fe00640 1 -- 172.21.15.84:0/4147611630 >> 172.21.15.84:0/4147611630 conn(0x7fd580071e60 msgr2=0x7fd580073d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:03.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.878+0000 7fd57fe00640 1 -- 172.21.15.84:0/4147611630 shutdown_connections 2024-04-26T21:39:03.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:03.878+0000 7fd57fe00640 1 -- 172.21.15.84:0/4147611630 wait complete. 2024-04-26T21:39:03.896 DEBUG:tasks.fs:max_mds reduced in epoch 36 2024-04-26T21:39:03.896 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 37 2024-04-26T21:39:04.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.093+0000 7fada5e00640 1 -- 172.21.15.84:0/3989786950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada00700c0 msgr2=0x7fada0108380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:04.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.093+0000 7fada5e00640 1 --2- 172.21.15.84:0/3989786950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada00700c0 0x7fada0108380 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fad88009c50 tx=0x7fad88004d10 comp rx=0 tx=0).stop 2024-04-26T21:39:04.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.094+0000 7fada5e00640 1 -- 172.21.15.84:0/3989786950 shutdown_connections 2024-04-26T21:39:04.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.094+0000 7fada5e00640 1 --2- 172.21.15.84:0/3989786950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada00700c0 0x7fada0108380 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.094+0000 7fada5e00640 1 --2- 172.21.15.84:0/3989786950 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fada006f7b0 0x7fada006fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.094+0000 7fada5e00640 1 -- 172.21.15.84:0/3989786950 >> 172.21.15.84:0/3989786950 conn(0x7fada00f7be0 msgr2=0x7fada00f9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.094+0000 7fada5e00640 1 -- 172.21.15.84:0/3989786950 shutdown_connections 2024-04-26T21:39:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.094+0000 7fada5e00640 1 -- 172.21.15.84:0/3989786950 wait complete. 2024-04-26T21:39:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.094+0000 7fada5e00640 1 Processor -- start 2024-04-26T21:39:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.094+0000 7fada5e00640 1 -- start start 2024-04-26T21:39:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.095+0000 7fada5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada006f7b0 0x7fada0114db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.095+0000 7fada5e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fada00700c0 0x7fada01152f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.095+0000 7fada5e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada01158f0 con 0x7fada006f7b0 2024-04-26T21:39:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.095+0000 7fada5e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada010ef40 con 0x7fada00700c0 2024-04-26T21:39:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.095+0000 7fada4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada006f7b0 0x7fada0114db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.095+0000 7fada4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada006f7b0 0x7fada0114db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58436/0 (socket says 172.21.15.84:58436) 2024-04-26T21:39:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.095+0000 7fada4a00640 1 -- 172.21.15.84:0/1095665684 learned_addr learned my addr 172.21.15.84:0/1095665684 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:04.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.095+0000 7fada4a00640 1 -- 172.21.15.84:0/1095665684 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fada00700c0 msgr2=0x7fada01152f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:04.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.095+0000 7fada4a00640 1 --2- 172.21.15.84:0/1095665684 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fada00700c0 0x7fada01152f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:04.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.095+0000 7fada4a00640 1 -- 172.21.15.84:0/1095665684 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad880098b0 con 0x7fada006f7b0 2024-04-26T21:39:04.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.096+0000 7fada4a00640 1 --2- 172.21.15.84:0/1095665684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada006f7b0 0x7fada0114db0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fad90002a50 tx=0x7fad90004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:04.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.096+0000 7fad9cc00640 1 -- 172.21.15.84:0/1095665684 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad90007c30 con 0x7fada006f7b0 2024-04-26T21:39:04.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.096+0000 7fada5e00640 1 -- 172.21.15.84:0/1095665684 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada010f220 con 0x7fada006f7b0 2024-04-26T21:39:04.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.096+0000 7fad9cc00640 1 -- 172.21.15.84:0/1095665684 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad9000f040 con 0x7fada006f7b0 2024-04-26T21:39:04.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.096+0000 7fad9cc00640 1 -- 172.21.15.84:0/1095665684 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad9000db50 con 0x7fada006f7b0 2024-04-26T21:39:04.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.096+0000 7fada5e00640 1 -- 172.21.15.84:0/1095665684 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada010f740 con 0x7fada006f7b0 2024-04-26T21:39:04.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.097+0000 7fada5e00640 1 -- 172.21.15.84:0/1095665684 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada0070ef0 con 0x7fada006f7b0 2024-04-26T21:39:04.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.098+0000 7fad9cc00640 1 -- 172.21.15.84:0/1095665684 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fad9001c400 con 0x7fada006f7b0 2024-04-26T21:39:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.099+0000 7fad9cc00640 1 --2- 172.21.15.84:0/1095665684 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fad8406eb80 0x7fad84071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.099+0000 7fad9cc00640 1 -- 172.21.15.84:0/1095665684 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fad9008e390 con 0x7fada006f7b0 2024-04-26T21:39:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.099+0000 7fad9fe00640 1 --2- 172.21.15.84:0/1095665684 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fad8406eb80 0x7fad84071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.100+0000 7fad9fe00640 1 --2- 172.21.15.84:0/1095665684 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fad8406eb80 0x7fad84071030 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad88003400 tx=0x7fad88004d10 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:04.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.104+0000 7fad9cc00640 1 -- 172.21.15.84:0/1095665684 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fad90056f40 con 0x7fada006f7b0 2024-04-26T21:39:04.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:04 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3727382366' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-04-26T21:39:04.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:04 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/4147611630' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-04-26T21:39:04.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.332+0000 7fada5e00640 1 -- 172.21.15.84:0/1095665684 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7fada004bcc0 con 0x7fada006f7b0 2024-04-26T21:39:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.334+0000 7fad9cc00640 1 -- 172.21.15.84:0/1095665684 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v42) v1 ==== 107+0+4354 (secure 0 0 0) 0x7fad9005a600 con 0x7fada006f7b0 2024-04-26T21:39:04.334 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:39:04.334 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34478,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6829/4015119551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4015119551},{"type":"v1","addr":"172.21.15.84:6829","nonce":4015119551}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44285,"name":"cephfs.smithi120.qnkxcn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/1351450046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1351450046},{"type":"v1","addr":"172.21.15.120:6825","nonce":1351450046}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:34:37.854593+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34446},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34446":{"gid":34446,"name":"cephfs.smithi084.hbjunw","rank":0,"incarnation":37,"state":"up:replay","state_seq":1,"addr":"172.21.15.84:6827/1392878113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1392878113},{"type":"v1","addr":"172.21.15.84:6827","nonce":1392878113}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:39:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 37 2024-04-26T21:39:04.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.336+0000 7fada5e00640 1 -- 172.21.15.84:0/1095665684 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fad8406eb80 msgr2=0x7fad84071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:04.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.336+0000 7fada5e00640 1 --2- 172.21.15.84:0/1095665684 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fad8406eb80 0x7fad84071030 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad88003400 tx=0x7fad88004d10 comp rx=0 tx=0).stop 2024-04-26T21:39:04.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.336+0000 7fada5e00640 1 -- 172.21.15.84:0/1095665684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada006f7b0 msgr2=0x7fada0114db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:04.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.336+0000 7fada5e00640 1 --2- 172.21.15.84:0/1095665684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada006f7b0 0x7fada0114db0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fad90002a50 tx=0x7fad90004600 comp rx=0 tx=0).stop 2024-04-26T21:39:04.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.337+0000 7fada5e00640 1 -- 172.21.15.84:0/1095665684 shutdown_connections 2024-04-26T21:39:04.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.337+0000 7fada5e00640 1 --2- 172.21.15.84:0/1095665684 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fad8406eb80 0x7fad84071030 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:04.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.337+0000 7fada5e00640 1 --2- 172.21.15.84:0/1095665684 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fada00700c0 0x7fada01152f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:04.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.337+0000 7fada5e00640 1 --2- 172.21.15.84:0/1095665684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada006f7b0 0x7fada0114db0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:04.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.337+0000 7fada5e00640 1 -- 172.21.15.84:0/1095665684 >> 172.21.15.84:0/1095665684 conn(0x7fada00f7be0 msgr2=0x7fada00f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:04.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.337+0000 7fada5e00640 1 -- 172.21.15.84:0/1095665684 shutdown_connections 2024-04-26T21:39:04.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.337+0000 7fada5e00640 1 -- 172.21.15.84:0/1095665684 wait complete. 2024-04-26T21:39:04.355 DEBUG:tasks.fs:max_mds reduced in epoch 37 2024-04-26T21:39:04.355 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 38 2024-04-26T21:39:04.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:04 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3727382366' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-04-26T21:39:04.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:04 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/4147611630' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-04-26T21:39:04.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.525+0000 7fa83ba00640 1 -- 172.21.15.84:0/2025075145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8341043e0 msgr2=0x7fa8341047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:04.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.525+0000 7fa83ba00640 1 --2- 172.21.15.84:0/2025075145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8341043e0 0x7fa8341047b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa8280048d0 tx=0x7fa828009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:04.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.525+0000 7fa83ba00640 1 -- 172.21.15.84:0/2025075145 shutdown_connections 2024-04-26T21:39:04.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.525+0000 7fa83ba00640 1 --2- 172.21.15.84:0/2025075145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa834104d80 0x7fa8340fe410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:04.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.525+0000 7fa83ba00640 1 --2- 172.21.15.84:0/2025075145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8341043e0 0x7fa8341047b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:04.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.525+0000 7fa83ba00640 1 -- 172.21.15.84:0/2025075145 >> 172.21.15.84:0/2025075145 conn(0x7fa8340f9f90 msgr2=0x7fa8340fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:04.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.525+0000 7fa83ba00640 1 -- 172.21.15.84:0/2025075145 shutdown_connections 2024-04-26T21:39:04.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.525+0000 7fa83ba00640 1 -- 172.21.15.84:0/2025075145 wait complete. 2024-04-26T21:39:04.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.526+0000 7fa83ba00640 1 Processor -- start 2024-04-26T21:39:04.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.526+0000 7fa83ba00640 1 -- start start 2024-04-26T21:39:04.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.527+0000 7fa83ba00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8341043e0 0x7fa834114f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:04.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.527+0000 7fa83ba00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa834104d80 0x7fa8341154a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:04.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.527+0000 7fa83ba00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa834115b30 con 0x7fa834104d80 2024-04-26T21:39:04.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.527+0000 7fa83ba00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83410f0f0 con 0x7fa8341043e0 2024-04-26T21:39:04.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.527+0000 7fa833e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa834104d80 0x7fa8341154a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:04.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.527+0000 7fa833e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa834104d80 0x7fa8341154a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58456/0 (socket says 172.21.15.84:58456) 2024-04-26T21:39:04.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.527+0000 7fa833e00640 1 -- 172.21.15.84:0/4070916009 learned_addr learned my addr 172.21.15.84:0/4070916009 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:04.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.527+0000 7fa839000640 1 --2- 172.21.15.84:0/4070916009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8341043e0 0x7fa834114f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:04.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.527+0000 7fa833e00640 1 -- 172.21.15.84:0/4070916009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8341043e0 msgr2=0x7fa834114f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:04.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.528+0000 7fa833e00640 1 --2- 172.21.15.84:0/4070916009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8341043e0 0x7fa834114f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:04.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.528+0000 7fa833e00640 1 -- 172.21.15.84:0/4070916009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa828005040 con 0x7fa834104d80 2024-04-26T21:39:04.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.528+0000 7fa833e00640 1 --2- 172.21.15.84:0/4070916009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa834104d80 0x7fa8341154a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa82000b790 tx=0x7fa8200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:04.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.528+0000 7fa830c00640 1 -- 172.21.15.84:0/4070916009 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa82000c700 con 0x7fa834104d80 2024-04-26T21:39:04.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.528+0000 7fa830c00640 1 -- 172.21.15.84:0/4070916009 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa82000cd30 con 0x7fa834104d80 2024-04-26T21:39:04.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.528+0000 7fa83ba00640 1 -- 172.21.15.84:0/4070916009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83410f3d0 con 0x7fa834104d80 2024-04-26T21:39:04.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.528+0000 7fa830c00640 1 -- 172.21.15.84:0/4070916009 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa820013370 con 0x7fa834104d80 2024-04-26T21:39:04.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.528+0000 7fa83ba00640 1 -- 172.21.15.84:0/4070916009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83410f8f0 con 0x7fa834104d80 2024-04-26T21:39:04.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.529+0000 7fa83ba00640 1 -- 172.21.15.84:0/4070916009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8340ffb50 con 0x7fa834104d80 2024-04-26T21:39:04.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.530+0000 7fa830c00640 1 -- 172.21.15.84:0/4070916009 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa820012070 con 0x7fa834104d80 2024-04-26T21:39:04.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.531+0000 7fa830c00640 1 --2- 172.21.15.84:0/4070916009 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa81c06eb70 0x7fa81c071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:04.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.531+0000 7fa830c00640 1 -- 172.21.15.84:0/4070916009 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fa82008e650 con 0x7fa834104d80 2024-04-26T21:39:04.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.531+0000 7fa839000640 1 --2- 172.21.15.84:0/4070916009 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa81c06eb70 0x7fa81c071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:04.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.532+0000 7fa839000640 1 --2- 172.21.15.84:0/4070916009 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa81c06eb70 0x7fa81c071020 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa828003080 tx=0x7fa828009da0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:04.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.536+0000 7fa830c00640 1 -- 172.21.15.84:0/4070916009 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fa8200572a0 con 0x7fa834104d80 2024-04-26T21:39:04.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.775+0000 7fa83ba00640 1 -- 172.21.15.84:0/4070916009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7fa83404bcc0 con 0x7fa834104d80 2024-04-26T21:39:04.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.777+0000 7fa830c00640 1 -- 172.21.15.84:0/4070916009 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v42) v1 ==== 107+0+4358 (secure 0 0 0) 0x7fa82005a960 con 0x7fa834104d80 2024-04-26T21:39:04.777 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:39:04.777 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34478,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6829/4015119551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4015119551},{"type":"v1","addr":"172.21.15.84:6829","nonce":4015119551}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44285,"name":"cephfs.smithi120.qnkxcn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/1351450046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1351450046},{"type":"v1","addr":"172.21.15.120:6825","nonce":1351450046}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:34:43.201033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34446},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34446":{"gid":34446,"name":"cephfs.smithi084.hbjunw","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":20,"addr":"172.21.15.84:6827/1392878113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1392878113},{"type":"v1","addr":"172.21.15.84:6827","nonce":1392878113}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:39:04.777 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 38 2024-04-26T21:39:04.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.779+0000 7fa83ba00640 1 -- 172.21.15.84:0/4070916009 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa81c06eb70 msgr2=0x7fa81c071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:04.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.779+0000 7fa83ba00640 1 --2- 172.21.15.84:0/4070916009 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa81c06eb70 0x7fa81c071020 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa828003080 tx=0x7fa828009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:04.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.779+0000 7fa83ba00640 1 -- 172.21.15.84:0/4070916009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa834104d80 msgr2=0x7fa8341154a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:04.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.779+0000 7fa83ba00640 1 --2- 172.21.15.84:0/4070916009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa834104d80 0x7fa8341154a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa82000b790 tx=0x7fa8200091d0 comp rx=0 tx=0).stop 2024-04-26T21:39:04.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.779+0000 7fa83ba00640 1 -- 172.21.15.84:0/4070916009 shutdown_connections 2024-04-26T21:39:04.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.779+0000 7fa83ba00640 1 --2- 172.21.15.84:0/4070916009 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fa81c06eb70 0x7fa81c071020 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:04.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.779+0000 7fa83ba00640 1 --2- 172.21.15.84:0/4070916009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa834104d80 0x7fa8341154a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:04.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.779+0000 7fa83ba00640 1 --2- 172.21.15.84:0/4070916009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8341043e0 0x7fa834114f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:04.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.779+0000 7fa83ba00640 1 -- 172.21.15.84:0/4070916009 >> 172.21.15.84:0/4070916009 conn(0x7fa8340f9f90 msgr2=0x7fa8340fae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:04.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.780+0000 7fa83ba00640 1 -- 172.21.15.84:0/4070916009 shutdown_connections 2024-04-26T21:39:04.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.780+0000 7fa83ba00640 1 -- 172.21.15.84:0/4070916009 wait complete. 2024-04-26T21:39:04.797 DEBUG:tasks.fs:max_mds reduced in epoch 38 2024-04-26T21:39:04.798 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 39 2024-04-26T21:39:04.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.988+0000 7f5ac6e00640 1 -- 172.21.15.84:0/2881578243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac0102990 msgr2=0x7f5ac00fc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:04.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.988+0000 7f5ac6e00640 1 --2- 172.21.15.84:0/2881578243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac0102990 0x7f5ac00fc020 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00048d0 tx=0x7f5ab0009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:04.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.988+0000 7f5ac6e00640 1 -- 172.21.15.84:0/2881578243 shutdown_connections 2024-04-26T21:39:04.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.988+0000 7f5ac6e00640 1 --2- 172.21.15.84:0/2881578243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac0102990 0x7f5ac00fc020 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:04.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.988+0000 7f5ac6e00640 1 --2- 172.21.15.84:0/2881578243 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac0101ff0 0x7f5ac01023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:04.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.988+0000 7f5ac6e00640 1 -- 172.21.15.84:0/2881578243 >> 172.21.15.84:0/2881578243 conn(0x7f5ac00f7be0 msgr2=0x7f5ac00f9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:04.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.988+0000 7f5ac6e00640 1 -- 172.21.15.84:0/2881578243 shutdown_connections 2024-04-26T21:39:04.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.988+0000 7f5ac6e00640 1 -- 172.21.15.84:0/2881578243 wait complete. 2024-04-26T21:39:04.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.989+0000 7f5ac6e00640 1 Processor -- start 2024-04-26T21:39:04.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.989+0000 7f5ac6e00640 1 -- start start 2024-04-26T21:39:04.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.989+0000 7f5ac6e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac0101ff0 0x7f5ac0112b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:04.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.989+0000 7f5ac6e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac0102990 0x7f5ac0113080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:04.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.989+0000 7f5ac6e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac0113680 con 0x7f5ac0101ff0 2024-04-26T21:39:04.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.989+0000 7f5ac6e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac010ccd0 con 0x7f5ac0102990 2024-04-26T21:39:04.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.990+0000 7f5ac5a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac0101ff0 0x7f5ac0112b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:04.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.990+0000 7f5ac5a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac0101ff0 0x7f5ac0112b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58468/0 (socket says 172.21.15.84:58468) 2024-04-26T21:39:04.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.990+0000 7f5ac5a00640 1 -- 172.21.15.84:0/3002467591 learned_addr learned my addr 172.21.15.84:0/3002467591 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:04.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.990+0000 7f5ac5000640 1 --2- 172.21.15.84:0/3002467591 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac0102990 0x7f5ac0113080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:04.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.990+0000 7f5ac5a00640 1 -- 172.21.15.84:0/3002467591 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac0102990 msgr2=0x7f5ac0113080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:04.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.990+0000 7f5ac5a00640 1 --2- 172.21.15.84:0/3002467591 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac0102990 0x7f5ac0113080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:04.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.990+0000 7f5ac5a00640 1 -- 172.21.15.84:0/3002467591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab0005040 con 0x7f5ac0101ff0 2024-04-26T21:39:04.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.990+0000 7f5ac5a00640 1 --2- 172.21.15.84:0/3002467591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac0101ff0 0x7f5ac0112b40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400c830 tx=0x7f5ab4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:04.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.991+0000 7f5abd600640 1 -- 172.21.15.84:0/3002467591 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ab400a850 con 0x7f5ac0101ff0 2024-04-26T21:39:04.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.991+0000 7f5abd600640 1 -- 172.21.15.84:0/3002467591 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ab400ae80 con 0x7f5ac0101ff0 2024-04-26T21:39:04.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.991+0000 7f5ac6e00640 1 -- 172.21.15.84:0/3002467591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac010cfb0 con 0x7f5ac0101ff0 2024-04-26T21:39:04.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.991+0000 7f5abd600640 1 -- 172.21.15.84:0/3002467591 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ab4012ea0 con 0x7f5ac0101ff0 2024-04-26T21:39:04.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.991+0000 7f5ac6e00640 1 -- 172.21.15.84:0/3002467591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac010d4d0 con 0x7f5ac0101ff0 2024-04-26T21:39:04.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.992+0000 7f5ac6e00640 1 -- 172.21.15.84:0/3002467591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac00fd760 con 0x7f5ac0101ff0 2024-04-26T21:39:04.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.993+0000 7f5abd600640 1 -- 172.21.15.84:0/3002467591 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5ab4012400 con 0x7f5ac0101ff0 2024-04-26T21:39:04.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.994+0000 7f5abd600640 1 --2- 172.21.15.84:0/3002467591 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5aa806eb70 0x7f5aa8071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:04.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.994+0000 7f5abd600640 1 -- 172.21.15.84:0/3002467591 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f5ab408ed20 con 0x7f5ac0101ff0 2024-04-26T21:39:04.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.994+0000 7f5ac5000640 1 --2- 172.21.15.84:0/3002467591 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5aa806eb70 0x7f5aa8071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:04.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.995+0000 7f5ac5000640 1 --2- 172.21.15.84:0/3002467591 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5aa806eb70 0x7f5aa8071020 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0000c00 tx=0x7f5ab0009da0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:04.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:04.999+0000 7f5abd600640 1 -- 172.21.15.84:0/3002467591 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f5ab4057950 con 0x7f5ac0101ff0 2024-04-26T21:39:05.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.242+0000 7f5ac6e00640 1 -- 172.21.15.84:0/3002467591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7f5ac004bcc0 con 0x7f5ac0101ff0 2024-04-26T21:39:05.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.244+0000 7f5abd600640 1 -- 172.21.15.84:0/3002467591 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v42) v1 ==== 107+0+5205 (secure 0 0 0) 0x7f5ab40126b0 con 0x7f5ac0101ff0 2024-04-26T21:39:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:39:05.244 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34478,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6829/4015119551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4015119551},{"type":"v1","addr":"172.21.15.84:6829","nonce":4015119551}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44285,"name":"cephfs.smithi120.qnkxcn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/1351450046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1351450046},{"type":"v1","addr":"172.21.15.120:6825","nonce":1351450046}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44305,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6827/2847041344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2847041344},{"type":"v1","addr":"172.21.15.120:6827","nonce":2847041344}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:34:44.065078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34446},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34446":{"gid":34446,"name":"cephfs.smithi084.hbjunw","rank":0,"incarnation":37,"state":"up:rejoin","state_seq":21,"addr":"172.21.15.84:6827/1392878113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1392878113},{"type":"v1","addr":"172.21.15.84:6827","nonce":1392878113}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:39:05.244 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 39 2024-04-26T21:39:05.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.246+0000 7f5ac6e00640 1 -- 172.21.15.84:0/3002467591 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5aa806eb70 msgr2=0x7f5aa8071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:05.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.246+0000 7f5ac6e00640 1 --2- 172.21.15.84:0/3002467591 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5aa806eb70 0x7f5aa8071020 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0000c00 tx=0x7f5ab0009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:05.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.246+0000 7f5ac6e00640 1 -- 172.21.15.84:0/3002467591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac0101ff0 msgr2=0x7f5ac0112b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:05.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.246+0000 7f5ac6e00640 1 --2- 172.21.15.84:0/3002467591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac0101ff0 0x7f5ac0112b40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400c830 tx=0x7f5ab4004430 comp rx=0 tx=0).stop 2024-04-26T21:39:05.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.247+0000 7f5ac6e00640 1 -- 172.21.15.84:0/3002467591 shutdown_connections 2024-04-26T21:39:05.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.247+0000 7f5ac6e00640 1 --2- 172.21.15.84:0/3002467591 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f5aa806eb70 0x7f5aa8071020 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:05.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.247+0000 7f5ac6e00640 1 --2- 172.21.15.84:0/3002467591 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ac0102990 0x7f5ac0113080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.247+0000 7f5ac6e00640 1 --2- 172.21.15.84:0/3002467591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac0101ff0 0x7f5ac0112b40 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.247+0000 7f5ac6e00640 1 -- 172.21.15.84:0/3002467591 >> 172.21.15.84:0/3002467591 conn(0x7f5ac00f7be0 msgr2=0x7f5ac00f8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.247+0000 7f5ac6e00640 1 -- 172.21.15.84:0/3002467591 shutdown_connections 2024-04-26T21:39:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.247+0000 7f5ac6e00640 1 -- 172.21.15.84:0/3002467591 wait complete. 2024-04-26T21:39:05.265 DEBUG:tasks.fs:max_mds reduced in epoch 39 2024-04-26T21:39:05.265 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 40 2024-04-26T21:39:05.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:05 smithi084 ceph-mon[90138]: pgmap v389: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:05.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:05 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/1095665684' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-04-26T21:39:05.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:05 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/4070916009' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-04-26T21:39:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:05 smithi120 ceph-mon[79001]: pgmap v389: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:05 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/1095665684' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-04-26T21:39:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:05 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/4070916009' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-04-26T21:39:05.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.462+0000 7f3561200640 1 -- 172.21.15.84:0/3951757568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c108820 msgr2=0x7f355c108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:05.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.462+0000 7f3561200640 1 --2- 172.21.15.84:0/3951757568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c108820 0x7f355c108bf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f354c0048d0 tx=0x7f354c009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:05.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.462+0000 7f3561200640 1 -- 172.21.15.84:0/3951757568 shutdown_connections 2024-04-26T21:39:05.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.462+0000 7f3561200640 1 --2- 172.21.15.84:0/3951757568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f355c102820 0x7f355c102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:05.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.462+0000 7f3561200640 1 --2- 172.21.15.84:0/3951757568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c108820 0x7f355c108bf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:05.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.462+0000 7f3561200640 1 -- 172.21.15.84:0/3951757568 >> 172.21.15.84:0/3951757568 conn(0x7f355c072020 msgr2=0x7f355c074430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:05.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.462+0000 7f3561200640 1 -- 172.21.15.84:0/3951757568 shutdown_connections 2024-04-26T21:39:05.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.462+0000 7f3561200640 1 -- 172.21.15.84:0/3951757568 wait complete. 2024-04-26T21:39:05.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.463+0000 7f3561200640 1 Processor -- start 2024-04-26T21:39:05.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.463+0000 7f3561200640 1 -- start start 2024-04-26T21:39:05.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.463+0000 7f3561200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c102820 0x7f355c1192d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:05.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.463+0000 7f3561200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f355c108820 0x7f355c119810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:05.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.463+0000 7f3561200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c119e10 con 0x7f355c102820 2024-04-26T21:39:05.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.463+0000 7f3561200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c113460 con 0x7f355c108820 2024-04-26T21:39:05.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.463+0000 7f3559e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c102820 0x7f355c1192d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:05.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.463+0000 7f3559e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c102820 0x7f355c1192d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58472/0 (socket says 172.21.15.84:58472) 2024-04-26T21:39:05.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.464+0000 7f3559e00640 1 -- 172.21.15.84:0/2300429797 learned_addr learned my addr 172.21.15.84:0/2300429797 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:05.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.464+0000 7f3559e00640 1 -- 172.21.15.84:0/2300429797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f355c108820 msgr2=0x7f355c119810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:05.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.464+0000 7f3559e00640 1 --2- 172.21.15.84:0/2300429797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f355c108820 0x7f355c119810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:05.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.464+0000 7f3559e00640 1 -- 172.21.15.84:0/2300429797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354c005040 con 0x7f355c102820 2024-04-26T21:39:05.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.464+0000 7f3559e00640 1 --2- 172.21.15.84:0/2300429797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c102820 0x7f355c1192d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f354c0047f0 tx=0x7f354c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:05.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.464+0000 7f3552000640 1 -- 172.21.15.84:0/2300429797 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f354c0094c0 con 0x7f355c102820 2024-04-26T21:39:05.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.464+0000 7f3552000640 1 -- 172.21.15.84:0/2300429797 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f354c032e50 con 0x7f355c102820 2024-04-26T21:39:05.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.464+0000 7f3561200640 1 -- 172.21.15.84:0/2300429797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f355c1136e0 con 0x7f355c102820 2024-04-26T21:39:05.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.464+0000 7f3552000640 1 -- 172.21.15.84:0/2300429797 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f354c0433b0 con 0x7f355c102820 2024-04-26T21:39:05.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.465+0000 7f3561200640 1 -- 172.21.15.84:0/2300429797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355c113ba0 con 0x7f355c102820 2024-04-26T21:39:05.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.466+0000 7f3561200640 1 -- 172.21.15.84:0/2300429797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355c103f40 con 0x7f355c102820 2024-04-26T21:39:05.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.467+0000 7f3552000640 1 -- 172.21.15.84:0/2300429797 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f354c02f070 con 0x7f355c102820 2024-04-26T21:39:05.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.468+0000 7f3552000640 1 --2- 172.21.15.84:0/2300429797 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f354006eb80 0x7f3540071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:05.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.468+0000 7f3552000640 1 -- 172.21.15.84:0/2300429797 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f354c0b0920 con 0x7f355c102820 2024-04-26T21:39:05.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.469+0000 7f3559400640 1 --2- 172.21.15.84:0/2300429797 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f354006eb80 0x7f3540071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:05.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.469+0000 7f3559400640 1 --2- 172.21.15.84:0/2300429797 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f354006eb80 0x7f3540071030 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f355c114b90 tx=0x7f3544009c50 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:05.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.473+0000 7f3552000640 1 -- 172.21.15.84:0/2300429797 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f354c079570 con 0x7f355c102820 2024-04-26T21:39:05.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.712+0000 7f3561200640 1 -- 172.21.15.84:0/2300429797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7f355c10f920 con 0x7f355c102820 2024-04-26T21:39:05.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.714+0000 7f3552000640 1 -- 172.21.15.84:0/2300429797 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v42) v1 ==== 107+0+5214 (secure 0 0 0) 0x7f354c07cc30 con 0x7f355c102820 2024-04-26T21:39:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:39:05.714 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34478,"name":"cephfs.smithi084.rtrqtr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6829/4015119551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4015119551},{"type":"v1","addr":"172.21.15.84:6829","nonce":4015119551}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44285,"name":"cephfs.smithi120.qnkxcn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/1351450046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1351450046},{"type":"v1","addr":"172.21.15.120:6825","nonce":1351450046}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44305,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6827/2847041344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2847041344},{"type":"v1","addr":"172.21.15.120:6827","nonce":2847041344}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:34:46.150880+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34446},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34446":{"gid":34446,"name":"cephfs.smithi084.hbjunw","rank":0,"incarnation":37,"state":"up:active","state_seq":22,"addr":"172.21.15.84:6827/1392878113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1392878113},{"type":"v1","addr":"172.21.15.84:6827","nonce":1392878113}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34446,"qdb_cluster":[34446]},"id":1}]} 2024-04-26T21:39:05.715 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 40 2024-04-26T21:39:05.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.717+0000 7f3561200640 1 -- 172.21.15.84:0/2300429797 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f354006eb80 msgr2=0x7f3540071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:05.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.717+0000 7f3561200640 1 --2- 172.21.15.84:0/2300429797 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f354006eb80 0x7f3540071030 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f355c114b90 tx=0x7f3544009c50 comp rx=0 tx=0).stop 2024-04-26T21:39:05.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.717+0000 7f3561200640 1 -- 172.21.15.84:0/2300429797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c102820 msgr2=0x7f355c1192d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:05.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.717+0000 7f3561200640 1 --2- 172.21.15.84:0/2300429797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c102820 0x7f355c1192d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f354c0047f0 tx=0x7f354c009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:05.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.717+0000 7f3561200640 1 -- 172.21.15.84:0/2300429797 shutdown_connections 2024-04-26T21:39:05.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.717+0000 7f3561200640 1 --2- 172.21.15.84:0/2300429797 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f354006eb80 0x7f3540071030 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:05.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.717+0000 7f3561200640 1 --2- 172.21.15.84:0/2300429797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f355c108820 0x7f355c119810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:05.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.717+0000 7f3561200640 1 --2- 172.21.15.84:0/2300429797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c102820 0x7f355c1192d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:05.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.717+0000 7f3561200640 1 -- 172.21.15.84:0/2300429797 >> 172.21.15.84:0/2300429797 conn(0x7f355c072020 msgr2=0x7f355c073fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:05.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.717+0000 7f3561200640 1 -- 172.21.15.84:0/2300429797 shutdown_connections 2024-04-26T21:39:05.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.717+0000 7f3561200640 1 -- 172.21.15.84:0/2300429797 wait complete. 2024-04-26T21:39:05.735 DEBUG:tasks.fs:max_mds reduced in epoch 40 2024-04-26T21:39:05.736 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 41 2024-04-26T21:39:05.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.929+0000 7f406ea00640 1 -- 172.21.15.84:0/2055472530 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405c031b60 con 0x7f4070102670 2024-04-26T21:39:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.929+0000 7f4075c00640 1 -- 172.21.15.84:0/2055472530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4070102670 msgr2=0x7f4070102ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.929+0000 7f4075c00640 1 --2- 172.21.15.84:0/2055472530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4070102670 0x7f4070102ae0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f405c0048d0 tx=0x7f405c009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.930+0000 7f4075c00640 1 -- 172.21.15.84:0/2055472530 shutdown_connections 2024-04-26T21:39:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.930+0000 7f4075c00640 1 --2- 172.21.15.84:0/2055472530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4070102670 0x7f4070102ae0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.930+0000 7f4075c00640 1 --2- 172.21.15.84:0/2055472530 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4070108680 0x7f4070108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.930+0000 7f4075c00640 1 -- 172.21.15.84:0/2055472530 >> 172.21.15.84:0/2055472530 conn(0x7f4070071e60 msgr2=0x7f4070074270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.930+0000 7f4075c00640 1 -- 172.21.15.84:0/2055472530 shutdown_connections 2024-04-26T21:39:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.930+0000 7f4075c00640 1 -- 172.21.15.84:0/2055472530 wait complete. 2024-04-26T21:39:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.930+0000 7f4075c00640 1 Processor -- start 2024-04-26T21:39:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.930+0000 7f4075c00640 1 -- start start 2024-04-26T21:39:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.931+0000 7f4075c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4070102670 0x7f40701190f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.931+0000 7f4075c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4070108680 0x7f4070119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.931+0000 7f4075c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4070119c30 con 0x7f4070108680 2024-04-26T21:39:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.931+0000 7f4075c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4070113280 con 0x7f4070102670 2024-04-26T21:39:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.931+0000 7f406f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4070108680 0x7f4070119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.931+0000 7f406f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4070108680 0x7f4070119630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58498/0 (socket says 172.21.15.84:58498) 2024-04-26T21:39:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.931+0000 7f406f400640 1 -- 172.21.15.84:0/4256380372 learned_addr learned my addr 172.21.15.84:0/4256380372 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.931+0000 7f406fe00640 1 --2- 172.21.15.84:0/4256380372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4070102670 0x7f40701190f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.931+0000 7f406f400640 1 -- 172.21.15.84:0/4256380372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4070102670 msgr2=0x7f40701190f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.931+0000 7f406f400640 1 --2- 172.21.15.84:0/4256380372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4070102670 0x7f40701190f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.932+0000 7f406f400640 1 -- 172.21.15.84:0/4256380372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c005040 con 0x7f4070108680 2024-04-26T21:39:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.932+0000 7f406f400640 1 --2- 172.21.15.84:0/4256380372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4070108680 0x7f4070119630 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f405c004930 tx=0x7f405c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.932+0000 7f4067e00640 1 -- 172.21.15.84:0/4256380372 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405c0094c0 con 0x7f4070108680 2024-04-26T21:39:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.932+0000 7f4067e00640 1 -- 172.21.15.84:0/4256380372 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f405c032e50 con 0x7f4070108680 2024-04-26T21:39:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.932+0000 7f4067e00640 1 -- 172.21.15.84:0/4256380372 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405c0433b0 con 0x7f4070108680 2024-04-26T21:39:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.932+0000 7f4075c00640 1 -- 172.21.15.84:0/4256380372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4070113500 con 0x7f4070108680 2024-04-26T21:39:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.932+0000 7f4075c00640 1 -- 172.21.15.84:0/4256380372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40701139c0 con 0x7f4070108680 2024-04-26T21:39:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.934+0000 7f4075c00640 1 -- 172.21.15.84:0/4256380372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4070103da0 con 0x7f4070108680 2024-04-26T21:39:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.935+0000 7f4067e00640 1 -- 172.21.15.84:0/4256380372 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f405c02f070 con 0x7f4070108680 2024-04-26T21:39:05.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.936+0000 7f4067e00640 1 --2- 172.21.15.84:0/4256380372 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f405406eb70 0x7f4054071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:05.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.936+0000 7f4067e00640 1 -- 172.21.15.84:0/4256380372 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f405c0b0a10 con 0x7f4070108680 2024-04-26T21:39:05.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.936+0000 7f406fe00640 1 --2- 172.21.15.84:0/4256380372 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f405406eb70 0x7f4054071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:05.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.937+0000 7f406fe00640 1 --2- 172.21.15.84:0/4256380372 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f405406eb70 0x7f4054071020 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4060004bc0 tx=0x7f4060009040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:05.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:05.941+0000 7f4067e00640 1 -- 172.21.15.84:0/4256380372 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f405c079660 con 0x7f4070108680 2024-04-26T21:39:06.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.183+0000 7f4075c00640 1 -- 172.21.15.84:0/4256380372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 41, "format": "json"} v 0) v1 -- 0x7f407010f760 con 0x7f4070108680 2024-04-26T21:39:06.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.185+0000 7f4067e00640 1 -- 172.21.15.84:0/4256380372 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 41, "format": "json"}]=0 dumped fsmap epoch 41 v42) v1 ==== 107+0+5231 (secure 0 0 0) 0x7f405c07cd20 con 0x7f4070108680 2024-04-26T21:39:06.185 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:39:06.185 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44285,"name":"cephfs.smithi120.qnkxcn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6825/1351450046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1351450046},{"type":"v1","addr":"172.21.15.120:6825","nonce":1351450046}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44305,"name":"cephfs.smithi120.ufqfoh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6827/2847041344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2847041344},{"type":"v1","addr":"172.21.15.120:6827","nonce":2847041344}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:21:14.208837+0000","modified":"2024-04-26T21:34:57.284358+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34446,"mds_1":34478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34446":{"gid":34446,"name":"cephfs.smithi084.hbjunw","rank":0,"incarnation":37,"state":"up:active","state_seq":22,"addr":"172.21.15.84:6827/1392878113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1392878113},{"type":"v1","addr":"172.21.15.84:6827","nonce":1392878113}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34478":{"gid":34478,"name":"cephfs.smithi084.rtrqtr","rank":1,"incarnation":41,"state":"up:starting","state_seq":1,"addr":"172.21.15.84:6829/4015119551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4015119551},{"type":"v1","addr":"172.21.15.84:6829","nonce":4015119551}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34446,"qdb_cluster":[34446]},"id":1}]} 2024-04-26T21:39:06.185 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 41 2024-04-26T21:39:06.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.188+0000 7f4075c00640 1 -- 172.21.15.84:0/4256380372 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f405406eb70 msgr2=0x7f4054071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:06.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.188+0000 7f4075c00640 1 --2- 172.21.15.84:0/4256380372 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f405406eb70 0x7f4054071020 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4060004bc0 tx=0x7f4060009040 comp rx=0 tx=0).stop 2024-04-26T21:39:06.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.188+0000 7f4075c00640 1 -- 172.21.15.84:0/4256380372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4070108680 msgr2=0x7f4070119630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:06.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.188+0000 7f4075c00640 1 --2- 172.21.15.84:0/4256380372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4070108680 0x7f4070119630 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f405c004930 tx=0x7f405c009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:06.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.188+0000 7f4075c00640 1 -- 172.21.15.84:0/4256380372 shutdown_connections 2024-04-26T21:39:06.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.188+0000 7f4075c00640 1 --2- 172.21.15.84:0/4256380372 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f405406eb70 0x7f4054071020 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:06.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.188+0000 7f4075c00640 1 --2- 172.21.15.84:0/4256380372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4070108680 0x7f4070119630 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:06.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.188+0000 7f4075c00640 1 --2- 172.21.15.84:0/4256380372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4070102670 0x7f40701190f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:06.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.188+0000 7f4075c00640 1 -- 172.21.15.84:0/4256380372 >> 172.21.15.84:0/4256380372 conn(0x7f4070071e60 msgr2=0x7f4070073cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:06.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.188+0000 7f4075c00640 1 -- 172.21.15.84:0/4256380372 shutdown_connections 2024-04-26T21:39:06.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.188+0000 7f4075c00640 1 -- 172.21.15.84:0/4256380372 wait complete. 2024-04-26T21:39:06.204 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-26T21:39:06.215 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-26T21:39:06.216 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-26T21:39:06.216 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:39:06.264 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-26T21:39:06.264 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:39:06.356 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:39:06.411 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:06 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3002467591' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-04-26T21:39:06.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:06 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2300429797' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-04-26T21:39:06.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:06 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3002467591' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-04-26T21:39:06.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:06 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2300429797' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-04-26T21:39:06.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.606+0000 7fdb2b200640 1 -- 172.21.15.84:0/2789136902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb2c064390 msgr2=0x7fdb2c064760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:06.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.606+0000 7fdb2b200640 1 --2- 172.21.15.84:0/2789136902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb2c064390 0x7fdb2c064760 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0048d0 tx=0x7fdb1c009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:06.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.607+0000 7fdb2b200640 1 -- 172.21.15.84:0/2789136902 shutdown_connections 2024-04-26T21:39:06.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.607+0000 7fdb2b200640 1 --2- 172.21.15.84:0/2789136902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb2c064ca0 0x7fdb2c108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.607+0000 7fdb2b200640 1 --2- 172.21.15.84:0/2789136902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb2c064390 0x7fdb2c064760 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.607+0000 7fdb2b200640 1 -- 172.21.15.84:0/2789136902 >> 172.21.15.84:0/2789136902 conn(0x7fdb2c071e00 msgr2=0x7fdb2c072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.607+0000 7fdb2b200640 1 -- 172.21.15.84:0/2789136902 shutdown_connections 2024-04-26T21:39:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.607+0000 7fdb2b200640 1 -- 172.21.15.84:0/2789136902 wait complete. 2024-04-26T21:39:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.608+0000 7fdb2b200640 1 Processor -- start 2024-04-26T21:39:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.608+0000 7fdb2b200640 1 -- start start 2024-04-26T21:39:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.608+0000 7fdb2b200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb2c064390 0x7fdb2c114bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.608+0000 7fdb2b200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb2c064ca0 0x7fdb2c115130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.608+0000 7fdb2b200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c115730 con 0x7fdb2c064ca0 2024-04-26T21:39:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.608+0000 7fdb2b200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c10ed80 con 0x7fdb2c064390 2024-04-26T21:39:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.608+0000 7fdb23e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb2c064ca0 0x7fdb2c115130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.608+0000 7fdb23e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb2c064ca0 0x7fdb2c115130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58520/0 (socket says 172.21.15.84:58520) 2024-04-26T21:39:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.608+0000 7fdb23e00640 1 -- 172.21.15.84:0/2539263156 learned_addr learned my addr 172.21.15.84:0/2539263156 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.609+0000 7fdb23e00640 1 -- 172.21.15.84:0/2539263156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb2c064390 msgr2=0x7fdb2c114bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.609+0000 7fdb23e00640 1 --2- 172.21.15.84:0/2539263156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb2c064390 0x7fdb2c114bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:06.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.609+0000 7fdb23e00640 1 -- 172.21.15.84:0/2539263156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c005040 con 0x7fdb2c064ca0 2024-04-26T21:39:06.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.609+0000 7fdb23e00640 1 --2- 172.21.15.84:0/2539263156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb2c064ca0 0x7fdb2c115130 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400c830 tx=0x7fdb14004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:06.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.609+0000 7fdb22000640 1 -- 172.21.15.84:0/2539263156 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb1400a850 con 0x7fdb2c064ca0 2024-04-26T21:39:06.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.609+0000 7fdb22000640 1 -- 172.21.15.84:0/2539263156 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb1400ae80 con 0x7fdb2c064ca0 2024-04-26T21:39:06.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.609+0000 7fdb22000640 1 -- 172.21.15.84:0/2539263156 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb14012ea0 con 0x7fdb2c064ca0 2024-04-26T21:39:06.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.609+0000 7fdb2b200640 1 -- 172.21.15.84:0/2539263156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb2c10f060 con 0x7fdb2c064ca0 2024-04-26T21:39:06.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.609+0000 7fdb2b200640 1 -- 172.21.15.84:0/2539263156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb2c10f580 con 0x7fdb2c064ca0 2024-04-26T21:39:06.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.611+0000 7fdb2b200640 1 -- 172.21.15.84:0/2539263156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb2c04bcc0 con 0x7fdb2c064ca0 2024-04-26T21:39:06.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.612+0000 7fdb22000640 1 -- 172.21.15.84:0/2539263156 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fdb14012400 con 0x7fdb2c064ca0 2024-04-26T21:39:06.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.613+0000 7fdb22000640 1 --2- 172.21.15.84:0/2539263156 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdb1006eb70 0x7fdb10071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:06.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.613+0000 7fdb22000640 1 -- 172.21.15.84:0/2539263156 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fdb1408eb60 con 0x7fdb2c064ca0 2024-04-26T21:39:06.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.613+0000 7fdb29e00640 1 --2- 172.21.15.84:0/2539263156 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdb1006eb70 0x7fdb10071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:06.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.614+0000 7fdb29e00640 1 --2- 172.21.15.84:0/2539263156 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdb1006eb70 0x7fdb10071020 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0043d0 tx=0x7fdb1c009da0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:06.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.617+0000 7fdb22000640 1 -- 172.21.15.84:0/2539263156 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fdb140578d0 con 0x7fdb2c064ca0 2024-04-26T21:39:06.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.817+0000 7fdb2b200640 1 -- 172.21.15.84:0/2539263156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb2c0fb560 con 0x7fdb2c064ca0 2024-04-26T21:39:06.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.820+0000 7fdb22000640 1 -- 172.21.15.84:0/2539263156 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+17121 (secure 0 0 0) 0x7fdb140126b0 con 0x7fdb2c064ca0 2024-04-26T21:39:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:39:06.821 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":94,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","created":"2024-04-26T21:12:29.304108+0000","modified":"2024-04-26T21:34:37.842273+0000","last_up_change":"2024-04-26T21:32:33.899068+0000","last_in_change":"2024-04-26T21:19:18.310009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:17:58.092436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-26T21:21:13.126623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-26T21:21:13.704785+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6c04d45-3ba8-4cc3-92ee-2e99279c6da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":58,"up_thru":88,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":215849876},{"type":"v1","addr":"172.21.15.84:6803","nonce":215849876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":215849876},{"type":"v1","addr":"172.21.15.84:6805","nonce":215849876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":215849876},{"type":"v1","addr":"172.21.15.84:6809","nonce":215849876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":215849876},{"type":"v1","addr":"172.21.15.84:6807","nonce":215849876}]},"public_addr":"172.21.15.84:6803/215849876","cluster_addr":"172.21.15.84:6805/215849876","heartbeat_back_addr":"172.21.15.84:6809/215849876","heartbeat_front_addr":"172.21.15.84:6807/215849876","state":["exists","up"]},{"osd":1,"uuid":"4417e988-3443-4671-8df5-4d964b8e5954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":64,"up_from":68,"up_thru":88,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3809321856},{"type":"v1","addr":"172.21.15.84:6811","nonce":3809321856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3809321856},{"type":"v1","addr":"172.21.15.84:6813","nonce":3809321856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3809321856},{"type":"v1","addr":"172.21.15.84:6817","nonce":3809321856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3809321856},{"type":"v1","addr":"172.21.15.84:6815","nonce":3809321856}]},"public_addr":"172.21.15.84:6811/3809321856","cluster_addr":"172.21.15.84:6813/3809321856","heartbeat_back_addr":"172.21.15.84:6817/3809321856","heartbeat_front_addr":"172.21.15.84:6815/3809321856","state":["exists","up"]},{"osd":2,"uuid":"240901fd-0810-4752-bfa0-2857359b30a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":69,"up_from":73,"up_thru":88,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":926975972},{"type":"v1","addr":"172.21.15.84:6819","nonce":926975972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":926975972},{"type":"v1","addr":"172.21.15.84:6821","nonce":926975972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":926975972},{"type":"v1","addr":"172.21.15.84:6825","nonce":926975972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":926975972},{"type":"v1","addr":"172.21.15.84:6823","nonce":926975972}]},"public_addr":"172.21.15.84:6819/926975972","cluster_addr":"172.21.15.84:6821/926975972","heartbeat_back_addr":"172.21.15.84:6825/926975972","heartbeat_front_addr":"172.21.15.84:6823/926975972","state":["exists","up"]},{"osd":3,"uuid":"f2d8384f-8b7d-4da4-8a67-4bdb83753822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":74,"up_from":78,"up_thru":88,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2439161252},{"type":"v1","addr":"172.21.15.120:6801","nonce":2439161252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2439161252},{"type":"v1","addr":"172.21.15.120:6803","nonce":2439161252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2439161252},{"type":"v1","addr":"172.21.15.120:6807","nonce":2439161252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2439161252},{"type":"v1","addr":"172.21.15.120:6805","nonce":2439161252}]},"public_addr":"172.21.15.120:6801/2439161252","cluster_addr":"172.21.15.120:6803/2439161252","heartbeat_back_addr":"172.21.15.120:6807/2439161252","heartbeat_front_addr":"172.21.15.120:6805/2439161252","state":["exists","up"]},{"osd":4,"uuid":"27aa8cbb-e94e-4e63-b2d4-be8a71b292ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":79,"up_from":83,"up_thru":88,"down_at":80,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":267967952},{"type":"v1","addr":"172.21.15.120:6809","nonce":267967952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":267967952},{"type":"v1","addr":"172.21.15.120:6811","nonce":267967952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":267967952},{"type":"v1","addr":"172.21.15.120:6815","nonce":267967952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":267967952},{"type":"v1","addr":"172.21.15.120:6813","nonce":267967952}]},"public_addr":"172.21.15.120:6809/267967952","cluster_addr":"172.21.15.120:6811/267967952","heartbeat_back_addr":"172.21.15.120:6815/267967952","heartbeat_front_addr":"172.21.15.120:6813/267967952","state":["exists","up"]},{"osd":5,"uuid":"e13abdd9-155d-40a0-a69a-4448a658ee5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":84,"up_from":88,"up_thru":88,"down_at":85,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3209575908},{"type":"v1","addr":"172.21.15.120:6817","nonce":3209575908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3209575908},{"type":"v1","addr":"172.21.15.120:6819","nonce":3209575908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3209575908},{"type":"v1","addr":"172.21.15.120:6823","nonce":3209575908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3209575908},{"type":"v1","addr":"172.21.15.120:6821","nonce":3209575908}]},"public_addr":"172.21.15.120:6817/3209575908","cluster_addr":"172.21.15.120:6819/3209575908","heartbeat_back_addr":"172.21.15.120:6823/3209575908","heartbeat_front_addr":"172.21.15.120:6821/3209575908","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:45.823555+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:17:20.567670+0000","dead_epoch":64},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:17:55.623700+0000","dead_epoch":69},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:18:31.061632+0000","dead_epoch":74},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:19:06.227030+0000","dead_epoch":79},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:19:40.886216+0000","dead_epoch":84}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.11","mappings":[{"from":3,"to":0}]},{"pgid":"2.12","mappings":[{"from":3,"to":2}]},{"pgid":"2.16","mappings":[{"from":3,"to":0}]},{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.3","mappings":[{"from":4,"to":2}]},{"pgid":"3.4","mappings":[{"from":1,"to":0}]},{"pgid":"3.7","mappings":[{"from":1,"to":0}]},{"pgid":"3.d","mappings":[{"from":3,"to":0}]},{"pgid":"3.e","mappings":[{"from":4,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:6827/2972379081":"2024-04-27T21:34:37.842224+0000","172.21.15.120:6826/2972379081":"2024-04-27T21:34:37.842224+0000","172.21.15.84:6827/1450914842":"2024-04-27T21:33:20.145008+0000","172.21.15.84:0/1001623":"2024-04-27T21:15:11.400421+0000","172.21.15.84:0/354233381":"2024-04-27T21:27:43.672129+0000","172.21.15.84:0/2756731981":"2024-04-27T21:27:43.672129+0000","172.21.15.120:0/1669924996":"2024-04-27T21:26:20.621242+0000","172.21.15.120:0/3421888873":"2024-04-27T21:26:20.621242+0000","172.21.15.84:6828/1543850087":"2024-04-27T21:33:49.979152+0000","172.21.15.84:0/3356039008":"2024-04-27T21:15:11.400421+0000","172.21.15.120:0/1504194308":"2024-04-27T21:26:20.621242+0000","172.21.15.84:0/801206978":"2024-04-27T21:13:03.641160+0000","172.21.15.84:0/2390150734":"2024-04-27T21:24:35.532321+0000","172.21.15.120:6828/3773295163":"2024-04-27T21:26:20.621242+0000","172.21.15.84:6800/3446199945":"2024-04-27T21:15:11.400421+0000","172.21.15.84:0/944666034":"2024-04-27T21:27:43.672129+0000","172.21.15.120:6829/3773295163":"2024-04-27T21:26:20.621242+0000","172.21.15.120:0/553294858":"2024-04-27T21:26:20.621242+0000","172.21.15.84:0/3365760548":"2024-04-27T21:24:35.532321+0000","172.21.15.84:0/2815093662":"2024-04-27T21:24:35.532321+0000","172.21.15.84:6826/1450914842":"2024-04-27T21:33:20.145008+0000","172.21.15.84:0/31938649":"2024-04-27T21:27:43.672129+0000","172.21.15.84:6801/3446199945":"2024-04-27T21:15:11.400421+0000","172.21.15.84:0/3621485381":"2024-04-27T21:13:42.669268+0000","172.21.15.84:6800/3574511298":"2024-04-27T21:24:35.532321+0000","172.21.15.84:0/1430131141":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/413656261":"2024-04-27T21:15:11.400421+0000","172.21.15.84:0/3648317863":"2024-04-27T21:13:03.641160+0000","172.21.15.84:0/2708514508":"2024-04-27T21:24:35.532321+0000","172.21.15.84:0/1155142360":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/1460734944":"2024-04-27T21:13:03.641160+0000","172.21.15.84:6801/3574511298":"2024-04-27T21:24:35.532321+0000","172.21.15.84:6800/3231603698":"2024-04-27T21:13:03.641160+0000","172.21.15.84:6829/1543850087":"2024-04-27T21:33:49.979152+0000","172.21.15.84:6801/3231603698":"2024-04-27T21:13:03.641160+0000","172.21.15.84:6800/2151160823":"2024-04-27T21:13:42.669268+0000","172.21.15.84:6801/3665499318":"2024-04-27T21:27:43.672129+0000","172.21.15.84:0/1070676377":"2024-04-27T21:27:43.672129+0000","172.21.15.84:6800/3665499318":"2024-04-27T21:27:43.672129+0000","172.21.15.84:6801/2151160823":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/1875187384":"2024-04-27T21:27:43.672129+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:39:06.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.823+0000 7fdb2b200640 1 -- 172.21.15.84:0/2539263156 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdb1006eb70 msgr2=0x7fdb10071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:06.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.823+0000 7fdb2b200640 1 --2- 172.21.15.84:0/2539263156 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdb1006eb70 0x7fdb10071020 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0043d0 tx=0x7fdb1c009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:06.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.823+0000 7fdb2b200640 1 -- 172.21.15.84:0/2539263156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb2c064ca0 msgr2=0x7fdb2c115130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:06.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.823+0000 7fdb2b200640 1 --2- 172.21.15.84:0/2539263156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb2c064ca0 0x7fdb2c115130 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400c830 tx=0x7fdb14004430 comp rx=0 tx=0).stop 2024-04-26T21:39:06.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.823+0000 7fdb2b200640 1 -- 172.21.15.84:0/2539263156 shutdown_connections 2024-04-26T21:39:06.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.823+0000 7fdb2b200640 1 --2- 172.21.15.84:0/2539263156 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fdb1006eb70 0x7fdb10071020 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:06.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.823+0000 7fdb2b200640 1 --2- 172.21.15.84:0/2539263156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb2c064ca0 0x7fdb2c115130 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:06.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.823+0000 7fdb2b200640 1 --2- 172.21.15.84:0/2539263156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb2c064390 0x7fdb2c114bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:06.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.823+0000 7fdb2b200640 1 -- 172.21.15.84:0/2539263156 >> 172.21.15.84:0/2539263156 conn(0x7fdb2c071e00 msgr2=0x7fdb2c103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:06.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.823+0000 7fdb2b200640 1 -- 172.21.15.84:0/2539263156 shutdown_connections 2024-04-26T21:39:06.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:06.823+0000 7fdb2b200640 1 -- 172.21.15.84:0/2539263156 wait complete. 2024-04-26T21:39:06.841 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:17:58.092436+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-26T21:21:13.126623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-26T21:21:13.704785+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:39:06.841 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:39:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.079+0000 7f5450800640 1 -- 172.21.15.84:0/2305416665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54480719a0 msgr2=0x7f5448071d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.079+0000 7f5450800640 1 --2- 172.21.15.84:0/2305416665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54480719a0 0x7f5448071d70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f54380048d0 tx=0x7f5438009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.080+0000 7f5450800640 1 -- 172.21.15.84:0/2305416665 shutdown_connections 2024-04-26T21:39:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.080+0000 7f5450800640 1 --2- 172.21.15.84:0/2305416665 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54480722b0 0x7f544810cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.080+0000 7f5450800640 1 --2- 172.21.15.84:0/2305416665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54480719a0 0x7f5448071d70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.080+0000 7f5450800640 1 -- 172.21.15.84:0/2305416665 >> 172.21.15.84:0/2305416665 conn(0x7f54480f9f90 msgr2=0x7f54480fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.080+0000 7f5450800640 1 -- 172.21.15.84:0/2305416665 shutdown_connections 2024-04-26T21:39:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.080+0000 7f5450800640 1 -- 172.21.15.84:0/2305416665 wait complete. 2024-04-26T21:39:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.080+0000 7f5450800640 1 Processor -- start 2024-04-26T21:39:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.081+0000 7f5450800640 1 -- start start 2024-04-26T21:39:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.081+0000 7f5450800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54480719a0 0x7f54481192a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.081+0000 7f5450800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54480722b0 0x7f54481197e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.081+0000 7f5450800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5448119de0 con 0x7f54480722b0 2024-04-26T21:39:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.081+0000 7f5450800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5448113430 con 0x7f54480719a0 2024-04-26T21:39:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.081+0000 7f544d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54480722b0 0x7f54481197e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.081+0000 7f544d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54480722b0 0x7f54481197e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58544/0 (socket says 172.21.15.84:58544) 2024-04-26T21:39:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.081+0000 7f544d400640 1 -- 172.21.15.84:0/1469540288 learned_addr learned my addr 172.21.15.84:0/1469540288 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.082+0000 7f544d400640 1 -- 172.21.15.84:0/1469540288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54480719a0 msgr2=0x7f54481192a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.082+0000 7f544d400640 1 --2- 172.21.15.84:0/1469540288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54480719a0 0x7f54481192a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.082+0000 7f544d400640 1 -- 172.21.15.84:0/1469540288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5438005040 con 0x7f54480722b0 2024-04-26T21:39:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.082+0000 7f544d400640 1 --2- 172.21.15.84:0/1469540288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54480722b0 0x7f54481197e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f543c00c830 tx=0x7f543c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.082+0000 7f5442000640 1 -- 172.21.15.84:0/1469540288 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f543c00a850 con 0x7f54480722b0 2024-04-26T21:39:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.082+0000 7f5442000640 1 -- 172.21.15.84:0/1469540288 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f543c00ae80 con 0x7f54480722b0 2024-04-26T21:39:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.082+0000 7f5450800640 1 -- 172.21.15.84:0/1469540288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5448113710 con 0x7f54480722b0 2024-04-26T21:39:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.082+0000 7f5442000640 1 -- 172.21.15.84:0/1469540288 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f543c012ea0 con 0x7f54480722b0 2024-04-26T21:39:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.082+0000 7f5450800640 1 -- 172.21.15.84:0/1469540288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5448113c30 con 0x7f54480722b0 2024-04-26T21:39:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.084+0000 7f5450800640 1 -- 172.21.15.84:0/1469540288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54480730e0 con 0x7f54480722b0 2024-04-26T21:39:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.085+0000 7f5442000640 1 -- 172.21.15.84:0/1469540288 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f543c012400 con 0x7f54480722b0 2024-04-26T21:39:07.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.086+0000 7f5442000640 1 --2- 172.21.15.84:0/1469540288 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f543006eb70 0x7f5430071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:07.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.086+0000 7f5442000640 1 -- 172.21.15.84:0/1469540288 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f543c08ed20 con 0x7f54480722b0 2024-04-26T21:39:07.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.086+0000 7f544de00640 1 --2- 172.21.15.84:0/1469540288 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f543006eb70 0x7f5430071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:07.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.086+0000 7f544de00640 1 --2- 172.21.15.84:0/1469540288 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f543006eb70 0x7f5430071020 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f54380043d0 tx=0x7f5438009da0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:07.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.092+0000 7f5442000640 1 -- 172.21.15.84:0/1469540288 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f543c057950 con 0x7f54480722b0 2024-04-26T21:39:07.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.298+0000 7f5450800640 1 -- 172.21.15.84:0/1469540288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f544804bcc0 con 0x7f54480722b0 2024-04-26T21:39:07.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.299+0000 7f5442000640 1 -- 172.21.15.84:0/1469540288 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f543c0126b0 con 0x7f54480722b0 2024-04-26T21:39:07.299 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-04-26T21:39:07.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.301+0000 7f5450800640 1 -- 172.21.15.84:0/1469540288 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f543006eb70 msgr2=0x7f5430071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:07.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.301+0000 7f5450800640 1 --2- 172.21.15.84:0/1469540288 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f543006eb70 0x7f5430071020 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f54380043d0 tx=0x7f5438009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:07.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.301+0000 7f5450800640 1 -- 172.21.15.84:0/1469540288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54480722b0 msgr2=0x7f54481197e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:07.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.301+0000 7f5450800640 1 --2- 172.21.15.84:0/1469540288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54480722b0 0x7f54481197e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f543c00c830 tx=0x7f543c004430 comp rx=0 tx=0).stop 2024-04-26T21:39:07.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.302+0000 7f5450800640 1 -- 172.21.15.84:0/1469540288 shutdown_connections 2024-04-26T21:39:07.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.302+0000 7f5450800640 1 --2- 172.21.15.84:0/1469540288 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f543006eb70 0x7f5430071020 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:07.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.302+0000 7f5450800640 1 --2- 172.21.15.84:0/1469540288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54480722b0 0x7f54481197e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:07.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.302+0000 7f5450800640 1 --2- 172.21.15.84:0/1469540288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54480719a0 0x7f54481192a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:07.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.302+0000 7f5450800640 1 -- 172.21.15.84:0/1469540288 >> 172.21.15.84:0/1469540288 conn(0x7f54480f9f90 msgr2=0x7f54480fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:07.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.302+0000 7f5450800640 1 -- 172.21.15.84:0/1469540288 shutdown_connections 2024-04-26T21:39:07.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.302+0000 7f5450800640 1 -- 172.21.15.84:0/1469540288 wait complete. 2024-04-26T21:39:07.320 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-26T21:39:07.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:07 smithi084 ceph-mon[90138]: pgmap v390: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:07.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:07 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/4256380372' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-04-26T21:39:07.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:07 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2539263156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:39:07.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:07 smithi120 ceph-mon[79001]: pgmap v390: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:07.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:07 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/4256380372' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-04-26T21:39:07.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:07 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2539263156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:39:07.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.517+0000 7efff6400640 1 -- 172.21.15.84:0/2403511959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff0102670 msgr2=0x7efff0102ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:07.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.517+0000 7efff6400640 1 --2- 172.21.15.84:0/2403511959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff0102670 0x7efff0102ae0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7effe00048d0 tx=0x7effe0009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:07.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.517+0000 7efff6400640 1 -- 172.21.15.84:0/2403511959 shutdown_connections 2024-04-26T21:39:07.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.517+0000 7efff6400640 1 --2- 172.21.15.84:0/2403511959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff0102670 0x7efff0102ae0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:07.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.517+0000 7efff6400640 1 --2- 172.21.15.84:0/2403511959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff0108680 0x7efff0108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:07.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.517+0000 7efff6400640 1 -- 172.21.15.84:0/2403511959 >> 172.21.15.84:0/2403511959 conn(0x7efff0071e60 msgr2=0x7efff0074270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:07.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.517+0000 7efff6400640 1 -- 172.21.15.84:0/2403511959 shutdown_connections 2024-04-26T21:39:07.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.517+0000 7efff6400640 1 -- 172.21.15.84:0/2403511959 wait complete. 2024-04-26T21:39:07.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.517+0000 7efff6400640 1 Processor -- start 2024-04-26T21:39:07.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.518+0000 7efff6400640 1 -- start start 2024-04-26T21:39:07.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.518+0000 7efff6400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff0102670 0x7efff01190f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:07.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.518+0000 7efff6400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff0108680 0x7efff0119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:07.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.518+0000 7efff6400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff0119c30 con 0x7efff0108680 2024-04-26T21:39:07.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.518+0000 7efff6400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff0113280 con 0x7efff0102670 2024-04-26T21:39:07.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.518+0000 7effefe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff0108680 0x7efff0119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:07.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.518+0000 7effefe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff0108680 0x7efff0119630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58554/0 (socket says 172.21.15.84:58554) 2024-04-26T21:39:07.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.518+0000 7effefe00640 1 -- 172.21.15.84:0/1912491464 learned_addr learned my addr 172.21.15.84:0/1912491464 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:07.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.519+0000 7effefe00640 1 -- 172.21.15.84:0/1912491464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff0102670 msgr2=0x7efff01190f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:07.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.519+0000 7effefe00640 1 --2- 172.21.15.84:0/1912491464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff0102670 0x7efff01190f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:07.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.519+0000 7effefe00640 1 -- 172.21.15.84:0/1912491464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe0005040 con 0x7efff0108680 2024-04-26T21:39:07.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.519+0000 7effefe00640 1 --2- 172.21.15.84:0/1912491464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff0108680 0x7efff0119630 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7effe00047f0 tx=0x7effe0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:07.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.519+0000 7effecc00640 1 -- 172.21.15.84:0/1912491464 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effe00094c0 con 0x7efff0108680 2024-04-26T21:39:07.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.519+0000 7effecc00640 1 -- 172.21.15.84:0/1912491464 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7effe0032e50 con 0x7efff0108680 2024-04-26T21:39:07.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.519+0000 7effecc00640 1 -- 172.21.15.84:0/1912491464 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effe00433b0 con 0x7efff0108680 2024-04-26T21:39:07.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.519+0000 7efff6400640 1 -- 172.21.15.84:0/1912491464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff0113500 con 0x7efff0108680 2024-04-26T21:39:07.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.520+0000 7efff6400640 1 -- 172.21.15.84:0/1912491464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff01139c0 con 0x7efff0108680 2024-04-26T21:39:07.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.521+0000 7efff6400640 1 -- 172.21.15.84:0/1912491464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff0103da0 con 0x7efff0108680 2024-04-26T21:39:07.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.522+0000 7effecc00640 1 -- 172.21.15.84:0/1912491464 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7effe002f070 con 0x7efff0108680 2024-04-26T21:39:07.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.523+0000 7effecc00640 1 --2- 172.21.15.84:0/1912491464 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7effd806eb80 0x7effd8071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:07.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.523+0000 7effecc00640 1 -- 172.21.15.84:0/1912491464 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7effe00b09f0 con 0x7efff0108680 2024-04-26T21:39:07.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.523+0000 7efff5000640 1 --2- 172.21.15.84:0/1912491464 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7effd806eb80 0x7effd8071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:07.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.524+0000 7efff5000640 1 --2- 172.21.15.84:0/1912491464 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7effd806eb80 0x7effd8071030 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7effe4004c80 tx=0x7effe4009c50 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:07.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.529+0000 7effecc00640 1 -- 172.21.15.84:0/1912491464 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7effe00795a0 con 0x7efff0108680 2024-04-26T21:39:07.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.726+0000 7efff6400640 1 -- 172.21.15.84:0/1912491464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7efff004bcc0 con 0x7efff0108680 2024-04-26T21:39:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.727+0000 7effecc00640 1 -- 172.21.15.84:0/1912491464 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v94) v1 ==== 107+0+11 (secure 0 0 0) 0x7effe007cc60 con 0x7efff0108680 2024-04-26T21:39:07.727 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-04-26T21:39:07.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.730+0000 7efff6400640 1 -- 172.21.15.84:0/1912491464 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7effd806eb80 msgr2=0x7effd8071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:07.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.730+0000 7efff6400640 1 --2- 172.21.15.84:0/1912491464 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7effd806eb80 0x7effd8071030 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7effe4004c80 tx=0x7effe4009c50 comp rx=0 tx=0).stop 2024-04-26T21:39:07.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.730+0000 7efff6400640 1 -- 172.21.15.84:0/1912491464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff0108680 msgr2=0x7efff0119630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:07.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.730+0000 7efff6400640 1 --2- 172.21.15.84:0/1912491464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff0108680 0x7efff0119630 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7effe00047f0 tx=0x7effe0009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:07.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.730+0000 7efff6400640 1 -- 172.21.15.84:0/1912491464 shutdown_connections 2024-04-26T21:39:07.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.730+0000 7efff6400640 1 --2- 172.21.15.84:0/1912491464 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7effd806eb80 0x7effd8071030 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:07.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.730+0000 7efff6400640 1 --2- 172.21.15.84:0/1912491464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff0108680 0x7efff0119630 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:07.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.730+0000 7efff6400640 1 --2- 172.21.15.84:0/1912491464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff0102670 0x7efff01190f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:07.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.730+0000 7efff6400640 1 -- 172.21.15.84:0/1912491464 >> 172.21.15.84:0/1912491464 conn(0x7efff0071e60 msgr2=0x7efff0073cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:07.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.730+0000 7efff6400640 1 -- 172.21.15.84:0/1912491464 shutdown_connections 2024-04-26T21:39:07.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.730+0000 7efff6400640 1 -- 172.21.15.84:0/1912491464 wait complete. 2024-04-26T21:39:07.747 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-26T21:39:07.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.947+0000 7f210dc00640 1 -- 172.21.15.84:0/1892346483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2108108680 msgr2=0x7f2108108a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:07.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.947+0000 7f210dc00640 1 --2- 172.21.15.84:0/1892346483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2108108680 0x7f2108108a50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009c50 tx=0x7f20f8004d10 comp rx=0 tx=0).stop 2024-04-26T21:39:07.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.947+0000 7f210dc00640 1 -- 172.21.15.84:0/1892346483 shutdown_connections 2024-04-26T21:39:07.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.947+0000 7f210dc00640 1 --2- 172.21.15.84:0/1892346483 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2108102670 0x7f2108102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:07.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.947+0000 7f210dc00640 1 --2- 172.21.15.84:0/1892346483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2108108680 0x7f2108108a50 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:07.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.947+0000 7f210dc00640 1 -- 172.21.15.84:0/1892346483 >> 172.21.15.84:0/1892346483 conn(0x7f2108071e60 msgr2=0x7f2108074270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:07.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.948+0000 7f210dc00640 1 -- 172.21.15.84:0/1892346483 shutdown_connections 2024-04-26T21:39:07.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.948+0000 7f210dc00640 1 -- 172.21.15.84:0/1892346483 wait complete. 2024-04-26T21:39:07.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.948+0000 7f210dc00640 1 Processor -- start 2024-04-26T21:39:07.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.949+0000 7f210dc00640 1 -- start start 2024-04-26T21:39:07.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.949+0000 7f210dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2108102670 0x7f21081190f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:07.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.949+0000 7f210dc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2108108680 0x7f2108119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:07.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.949+0000 7f210dc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2108119c30 con 0x7f2108102670 2024-04-26T21:39:07.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.949+0000 7f210dc00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2108113280 con 0x7f2108108680 2024-04-26T21:39:07.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.949+0000 7f2107e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2108102670 0x7f21081190f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:07.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.949+0000 7f2107e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2108102670 0x7f21081190f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58576/0 (socket says 172.21.15.84:58576) 2024-04-26T21:39:07.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.949+0000 7f2107e00640 1 -- 172.21.15.84:0/3560040704 learned_addr learned my addr 172.21.15.84:0/3560040704 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:07.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.950+0000 7f2107e00640 1 -- 172.21.15.84:0/3560040704 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2108108680 msgr2=0x7f2108119630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:07.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.950+0000 7f2107e00640 1 --2- 172.21.15.84:0/3560040704 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2108108680 0x7f2108119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:07.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.950+0000 7f2107e00640 1 -- 172.21.15.84:0/3560040704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f80098b0 con 0x7f2108102670 2024-04-26T21:39:07.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.950+0000 7f2107e00640 1 --2- 172.21.15.84:0/3560040704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2108102670 0x7f21081190f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f20f8004a30 tx=0x7f20f8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:07.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.951+0000 7f20ffe00640 1 -- 172.21.15.84:0/3560040704 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20f803a070 con 0x7f2108102670 2024-04-26T21:39:07.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.951+0000 7f20ffe00640 1 -- 172.21.15.84:0/3560040704 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f20f8035b20 con 0x7f2108102670 2024-04-26T21:39:07.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.951+0000 7f210dc00640 1 -- 172.21.15.84:0/3560040704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2108113500 con 0x7f2108102670 2024-04-26T21:39:07.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.951+0000 7f20ffe00640 1 -- 172.21.15.84:0/3560040704 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20f803ea70 con 0x7f2108102670 2024-04-26T21:39:07.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.951+0000 7f210dc00640 1 -- 172.21.15.84:0/3560040704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2108113aa0 con 0x7f2108102670 2024-04-26T21:39:07.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.952+0000 7f210dc00640 1 -- 172.21.15.84:0/3560040704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2108103da0 con 0x7f2108102670 2024-04-26T21:39:07.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.953+0000 7f20ffe00640 1 -- 172.21.15.84:0/3560040704 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f20f8032070 con 0x7f2108102670 2024-04-26T21:39:07.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.954+0000 7f20ffe00640 1 --2- 172.21.15.84:0/3560040704 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f20ec06eb70 0x7f20ec071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:07.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.954+0000 7f20ffe00640 1 -- 172.21.15.84:0/3560040704 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f20f80b0b30 con 0x7f2108102670 2024-04-26T21:39:07.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.954+0000 7f2107400640 1 --2- 172.21.15.84:0/3560040704 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f20ec06eb70 0x7f20ec071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:07.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.955+0000 7f2107400640 1 --2- 172.21.15.84:0/3560040704 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f20ec06eb70 0x7f20ec071020 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f21081149b0 tx=0x7f20f4009c50 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:07.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:07.958+0000 7f20ffe00640 1 -- 172.21.15.84:0/3560040704 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f20f8079810 con 0x7f2108102670 2024-04-26T21:39:08.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.165+0000 7f210dc00640 1 -- 172.21.15.84:0/3560040704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f2108114760 con 0x7f2108102670 2024-04-26T21:39:08.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.166+0000 7f20ffe00640 1 -- 172.21.15.84:0/3560040704 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v94) v1 ==== 107+0+11 (secure 0 0 0) 0x7f20f807ced0 con 0x7f2108102670 2024-04-26T21:39:08.166 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-04-26T21:39:08.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.169+0000 7f210dc00640 1 -- 172.21.15.84:0/3560040704 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f20ec06eb70 msgr2=0x7f20ec071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:08.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.169+0000 7f210dc00640 1 --2- 172.21.15.84:0/3560040704 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f20ec06eb70 0x7f20ec071020 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f21081149b0 tx=0x7f20f4009c50 comp rx=0 tx=0).stop 2024-04-26T21:39:08.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.169+0000 7f210dc00640 1 -- 172.21.15.84:0/3560040704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2108102670 msgr2=0x7f21081190f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:08.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.169+0000 7f210dc00640 1 --2- 172.21.15.84:0/3560040704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2108102670 0x7f21081190f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f20f8004a30 tx=0x7f20f8004d10 comp rx=0 tx=0).stop 2024-04-26T21:39:08.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.169+0000 7f210dc00640 1 -- 172.21.15.84:0/3560040704 shutdown_connections 2024-04-26T21:39:08.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.169+0000 7f210dc00640 1 --2- 172.21.15.84:0/3560040704 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f20ec06eb70 0x7f20ec071020 secure :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f21081149b0 tx=0x7f20f4009c50 comp rx=0 tx=0).stop 2024-04-26T21:39:08.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.169+0000 7f210dc00640 1 --2- 172.21.15.84:0/3560040704 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2108108680 0x7f2108119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:08.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.169+0000 7f210dc00640 1 --2- 172.21.15.84:0/3560040704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2108102670 0x7f21081190f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:08.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.169+0000 7f210dc00640 1 -- 172.21.15.84:0/3560040704 >> 172.21.15.84:0/3560040704 conn(0x7f2108071e60 msgr2=0x7f2108073d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:08.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.169+0000 7f210dc00640 1 -- 172.21.15.84:0/3560040704 shutdown_connections 2024-04-26T21:39:08.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.170+0000 7f210dc00640 1 -- 172.21.15.84:0/3560040704 wait complete. 2024-04-26T21:39:08.186 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:39:08.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.377+0000 7f272f200640 1 -- 172.21.15.84:0/2987433699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2730102990 msgr2=0x7f27300fc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:08.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.377+0000 7f272f200640 1 --2- 172.21.15.84:0/2987433699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2730102990 0x7f27300fc020 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f27180048d0 tx=0x7f2718009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:08.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.378+0000 7f272f200640 1 -- 172.21.15.84:0/2987433699 shutdown_connections 2024-04-26T21:39:08.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.378+0000 7f272f200640 1 --2- 172.21.15.84:0/2987433699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2730102990 0x7f27300fc020 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:08.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.378+0000 7f272f200640 1 --2- 172.21.15.84:0/2987433699 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2730101ff0 0x7f27301023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:08.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.378+0000 7f272f200640 1 -- 172.21.15.84:0/2987433699 >> 172.21.15.84:0/2987433699 conn(0x7f27300f7be0 msgr2=0x7f27300f9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:08.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.378+0000 7f272f200640 1 -- 172.21.15.84:0/2987433699 shutdown_connections 2024-04-26T21:39:08.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.378+0000 7f272f200640 1 -- 172.21.15.84:0/2987433699 wait complete. 2024-04-26T21:39:08.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.378+0000 7f272f200640 1 Processor -- start 2024-04-26T21:39:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.378+0000 7f272f200640 1 -- start start 2024-04-26T21:39:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.379+0000 7f272f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2730101ff0 0x7f273006f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.379+0000 7f272f200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2730102990 0x7f273006fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.379+0000 7f272f200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2730071650 con 0x7f2730101ff0 2024-04-26T21:39:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.379+0000 7f272f200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27300701f0 con 0x7f2730102990 2024-04-26T21:39:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.379+0000 7f272de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2730101ff0 0x7f273006f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.379+0000 7f272de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2730101ff0 0x7f273006f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58588/0 (socket says 172.21.15.84:58588) 2024-04-26T21:39:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.379+0000 7f272de00640 1 -- 172.21.15.84:0/2342304230 learned_addr learned my addr 172.21.15.84:0/2342304230 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.379+0000 7f2725400640 1 --2- 172.21.15.84:0/2342304230 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2730102990 0x7f273006fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.380+0000 7f272de00640 1 -- 172.21.15.84:0/2342304230 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2730102990 msgr2=0x7f273006fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.380+0000 7f272de00640 1 --2- 172.21.15.84:0/2342304230 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2730102990 0x7f273006fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.380+0000 7f272de00640 1 -- 172.21.15.84:0/2342304230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2718005040 con 0x7f2730101ff0 2024-04-26T21:39:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.380+0000 7f2725400640 1 --2- 172.21.15.84:0/2342304230 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2730102990 0x7f273006fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:39:08.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.380+0000 7f272de00640 1 --2- 172.21.15.84:0/2342304230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2730101ff0 0x7f273006f770 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f272000c790 tx=0x7f27200043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:08.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.380+0000 7f2726a00640 1 -- 172.21.15.84:0/2342304230 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f272000a820 con 0x7f2730101ff0 2024-04-26T21:39:08.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.380+0000 7f2726a00640 1 -- 172.21.15.84:0/2342304230 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f272000ae50 con 0x7f2730101ff0 2024-04-26T21:39:08.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.380+0000 7f2726a00640 1 -- 172.21.15.84:0/2342304230 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27200115e0 con 0x7f2730101ff0 2024-04-26T21:39:08.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.380+0000 7f272f200640 1 -- 172.21.15.84:0/2342304230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27300704d0 con 0x7f2730101ff0 2024-04-26T21:39:08.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.380+0000 7f272f200640 1 -- 172.21.15.84:0/2342304230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2730119240 con 0x7f2730101ff0 2024-04-26T21:39:08.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.381+0000 7f272f200640 1 -- 172.21.15.84:0/2342304230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27300fd760 con 0x7f2730101ff0 2024-04-26T21:39:08.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.382+0000 7f2726a00640 1 -- 172.21.15.84:0/2342304230 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2720012400 con 0x7f2730101ff0 2024-04-26T21:39:08.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.383+0000 7f2726a00640 1 --2- 172.21.15.84:0/2342304230 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f271406eb80 0x7f2714071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:08.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.383+0000 7f2726a00640 1 -- 172.21.15.84:0/2342304230 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f272008ea80 con 0x7f2730101ff0 2024-04-26T21:39:08.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.384+0000 7f2725400640 1 --2- 172.21.15.84:0/2342304230 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f271406eb80 0x7f2714071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:08.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.384+0000 7f2725400640 1 --2- 172.21.15.84:0/2342304230 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f271406eb80 0x7f2714071030 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2718000c00 tx=0x7f2718009da0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:08.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.388+0000 7f2726a00640 1 -- 172.21.15.84:0/2342304230 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f27200577f0 con 0x7f2730101ff0 2024-04-26T21:39:08.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:08 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/1469540288' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T21:39:08.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:08 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/1912491464' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-26T21:39:08.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:08 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/1469540288' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T21:39:08.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:08 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/1912491464' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-26T21:39:08.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.600+0000 7f272f200640 1 -- 172.21.15.84:0/2342304230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f273004bcc0 con 0x7f2730101ff0 2024-04-26T21:39:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.601+0000 7f2726a00640 1 -- 172.21.15.84:0/2342304230 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v94) v1 ==== 81+0+2430 (secure 0 0 0) 0x7f272005aeb0 con 0x7f2730101ff0 2024-04-26T21:39:08.601 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.120:6827/2972379081 2024-04-27T21:34:37.842224+0000 2024-04-26T21:39:08.601 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.120:6826/2972379081 2024-04-27T21:34:37.842224+0000 2024-04-26T21:39:08.601 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6827/1450914842 2024-04-27T21:33:20.145008+0000 2024-04-26T21:39:08.601 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1001623 2024-04-27T21:15:11.400421+0000 2024-04-26T21:39:08.602 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/354233381 2024-04-27T21:27:43.672129+0000 2024-04-26T21:39:08.602 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2756731981 2024-04-27T21:27:43.672129+0000 2024-04-26T21:39:08.602 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.120:0/1669924996 2024-04-27T21:26:20.621242+0000 2024-04-26T21:39:08.602 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.120:0/3421888873 2024-04-27T21:26:20.621242+0000 2024-04-26T21:39:08.602 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6828/1543850087 2024-04-27T21:33:49.979152+0000 2024-04-26T21:39:08.602 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3356039008 2024-04-27T21:15:11.400421+0000 2024-04-26T21:39:08.602 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.120:0/1504194308 2024-04-27T21:26:20.621242+0000 2024-04-26T21:39:08.602 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/801206978 2024-04-27T21:13:03.641160+0000 2024-04-26T21:39:08.602 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2390150734 2024-04-27T21:24:35.532321+0000 2024-04-26T21:39:08.602 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.120:6828/3773295163 2024-04-27T21:26:20.621242+0000 2024-04-26T21:39:08.602 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/3446199945 2024-04-27T21:15:11.400421+0000 2024-04-26T21:39:08.602 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/944666034 2024-04-27T21:27:43.672129+0000 2024-04-26T21:39:08.602 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.120:6829/3773295163 2024-04-27T21:26:20.621242+0000 2024-04-26T21:39:08.602 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.120:0/553294858 2024-04-27T21:26:20.621242+0000 2024-04-26T21:39:08.603 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3365760548 2024-04-27T21:24:35.532321+0000 2024-04-26T21:39:08.603 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2815093662 2024-04-27T21:24:35.532321+0000 2024-04-26T21:39:08.603 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6826/1450914842 2024-04-27T21:33:20.145008+0000 2024-04-26T21:39:08.603 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/31938649 2024-04-27T21:27:43.672129+0000 2024-04-26T21:39:08.603 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/3446199945 2024-04-27T21:15:11.400421+0000 2024-04-26T21:39:08.603 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3621485381 2024-04-27T21:13:42.669268+0000 2024-04-26T21:39:08.603 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/3574511298 2024-04-27T21:24:35.532321+0000 2024-04-26T21:39:08.603 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1430131141 2024-04-27T21:13:42.669268+0000 2024-04-26T21:39:08.603 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/413656261 2024-04-27T21:15:11.400421+0000 2024-04-26T21:39:08.603 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3648317863 2024-04-27T21:13:03.641160+0000 2024-04-26T21:39:08.603 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2708514508 2024-04-27T21:24:35.532321+0000 2024-04-26T21:39:08.603 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1155142360 2024-04-27T21:13:42.669268+0000 2024-04-26T21:39:08.603 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1460734944 2024-04-27T21:13:03.641160+0000 2024-04-26T21:39:08.603 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/3574511298 2024-04-27T21:24:35.532321+0000 2024-04-26T21:39:08.604 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/3231603698 2024-04-27T21:13:03.641160+0000 2024-04-26T21:39:08.604 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6829/1543850087 2024-04-27T21:33:49.979152+0000 2024-04-26T21:39:08.604 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/3231603698 2024-04-27T21:13:03.641160+0000 2024-04-26T21:39:08.604 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/2151160823 2024-04-27T21:13:42.669268+0000 2024-04-26T21:39:08.604 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/3665499318 2024-04-27T21:27:43.672129+0000 2024-04-26T21:39:08.604 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1070676377 2024-04-27T21:27:43.672129+0000 2024-04-26T21:39:08.604 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/3665499318 2024-04-27T21:27:43.672129+0000 2024-04-26T21:39:08.604 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/2151160823 2024-04-27T21:13:42.669268+0000 2024-04-26T21:39:08.604 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1875187384 2024-04-27T21:27:43.672129+0000 2024-04-26T21:39:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:listed 41 entries 2024-04-26T21:39:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.603+0000 7f272f200640 1 -- 172.21.15.84:0/2342304230 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f271406eb80 msgr2=0x7f2714071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.603+0000 7f272f200640 1 --2- 172.21.15.84:0/2342304230 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f271406eb80 0x7f2714071030 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2718000c00 tx=0x7f2718009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.603+0000 7f272f200640 1 -- 172.21.15.84:0/2342304230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2730101ff0 msgr2=0x7f273006f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.603+0000 7f272f200640 1 --2- 172.21.15.84:0/2342304230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2730101ff0 0x7f273006f770 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f272000c790 tx=0x7f27200043c0 comp rx=0 tx=0).stop 2024-04-26T21:39:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.604+0000 7f272f200640 1 -- 172.21.15.84:0/2342304230 shutdown_connections 2024-04-26T21:39:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.604+0000 7f272f200640 1 --2- 172.21.15.84:0/2342304230 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f271406eb80 0x7f2714071030 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.604+0000 7f272f200640 1 --2- 172.21.15.84:0/2342304230 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2730102990 0x7f273006fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.604+0000 7f272f200640 1 --2- 172.21.15.84:0/2342304230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2730101ff0 0x7f273006f770 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.604+0000 7f272f200640 1 -- 172.21.15.84:0/2342304230 >> 172.21.15.84:0/2342304230 conn(0x7f27300f7be0 msgr2=0x7f27300f8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.604+0000 7f272f200640 1 -- 172.21.15.84:0/2342304230 shutdown_connections 2024-04-26T21:39:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.604+0000 7f272f200640 1 -- 172.21.15.84:0/2342304230 wait complete. 2024-04-26T21:39:08.622 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-26T21:39:08.622 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:39:08.673 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:39:08.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.916+0000 7f3477c00640 1 -- 172.21.15.84:0/466407382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34701043b0 msgr2=0x7f3470104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:08.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.916+0000 7f3477c00640 1 --2- 172.21.15.84:0/466407382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34701043b0 0x7f3470104780 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f34600048d0 tx=0x7f3460009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:08.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.916+0000 7f3477c00640 1 -- 172.21.15.84:0/466407382 shutdown_connections 2024-04-26T21:39:08.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.916+0000 7f3477c00640 1 --2- 172.21.15.84:0/466407382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3470104d50 0x7f34700fe3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:08.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.916+0000 7f3477c00640 1 --2- 172.21.15.84:0/466407382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34701043b0 0x7f3470104780 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:08.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.916+0000 7f3477c00640 1 -- 172.21.15.84:0/466407382 >> 172.21.15.84:0/466407382 conn(0x7f34700f9f60 msgr2=0x7f34700fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:08.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.916+0000 7f3477c00640 1 -- 172.21.15.84:0/466407382 shutdown_connections 2024-04-26T21:39:08.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.916+0000 7f3477c00640 1 -- 172.21.15.84:0/466407382 wait complete. 2024-04-26T21:39:08.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.917+0000 7f3477c00640 1 Processor -- start 2024-04-26T21:39:08.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.917+0000 7f3477c00640 1 -- start start 2024-04-26T21:39:08.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.917+0000 7f3477c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34701043b0 0x7f3470114f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:08.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.917+0000 7f3477c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3470104d50 0x7f34701154a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:08.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.917+0000 7f3477c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3470115b30 con 0x7f3470104d50 2024-04-26T21:39:08.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.917+0000 7f3477c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347010f0f0 con 0x7f34701043b0 2024-04-26T21:39:08.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.918+0000 7f3467e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3470104d50 0x7f34701154a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:08.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.918+0000 7f3467e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3470104d50 0x7f34701154a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58602/0 (socket says 172.21.15.84:58602) 2024-04-26T21:39:08.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.918+0000 7f3467e00640 1 -- 172.21.15.84:0/3423515690 learned_addr learned my addr 172.21.15.84:0/3423515690 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:08.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.918+0000 7f3475200640 1 --2- 172.21.15.84:0/3423515690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34701043b0 0x7f3470114f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:08.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.918+0000 7f3467e00640 1 -- 172.21.15.84:0/3423515690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34701043b0 msgr2=0x7f3470114f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:08.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.918+0000 7f3467e00640 1 --2- 172.21.15.84:0/3423515690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34701043b0 0x7f3470114f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:08.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.918+0000 7f3467e00640 1 -- 172.21.15.84:0/3423515690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3460005040 con 0x7f3470104d50 2024-04-26T21:39:08.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.919+0000 7f3467e00640 1 --2- 172.21.15.84:0/3423515690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3470104d50 0x7f34701154a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f345800b790 tx=0x7f34580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:08.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.919+0000 7f346d600640 1 -- 172.21.15.84:0/3423515690 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f345800c700 con 0x7f3470104d50 2024-04-26T21:39:08.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.919+0000 7f346d600640 1 -- 172.21.15.84:0/3423515690 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f345800cd30 con 0x7f3470104d50 2024-04-26T21:39:08.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.919+0000 7f3477c00640 1 -- 172.21.15.84:0/3423515690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f347010f3d0 con 0x7f3470104d50 2024-04-26T21:39:08.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.919+0000 7f346d600640 1 -- 172.21.15.84:0/3423515690 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3458013370 con 0x7f3470104d50 2024-04-26T21:39:08.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.919+0000 7f3477c00640 1 -- 172.21.15.84:0/3423515690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f347010f8f0 con 0x7f3470104d50 2024-04-26T21:39:08.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.920+0000 7f3477c00640 1 -- 172.21.15.84:0/3423515690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34700ffb20 con 0x7f3470104d50 2024-04-26T21:39:08.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.921+0000 7f346d600640 1 -- 172.21.15.84:0/3423515690 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3458012070 con 0x7f3470104d50 2024-04-26T21:39:08.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.922+0000 7f346d600640 1 --2- 172.21.15.84:0/3423515690 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f345406eb70 0x7f3454071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:08.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.922+0000 7f346d600640 1 -- 172.21.15.84:0/3423515690 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f345808e6f0 con 0x7f3470104d50 2024-04-26T21:39:08.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.922+0000 7f3475200640 1 --2- 172.21.15.84:0/3423515690 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f345406eb70 0x7f3454071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:08.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.923+0000 7f3475200640 1 --2- 172.21.15.84:0/3423515690 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f345406eb70 0x7f3454071020 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3460004540 tx=0x7f3460009da0 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:08.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:08.927+0000 7f346d600640 1 -- 172.21.15.84:0/3423515690 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f34580572a0 con 0x7f3470104d50 2024-04-26T21:39:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.131+0000 7f3477c00640 1 -- 172.21.15.84:0/3423515690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f347004bcc0 con 0x7f3470104d50 2024-04-26T21:39:09.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.134+0000 7f346d600640 1 -- 172.21.15.84:0/3423515690 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+17121 (secure 0 0 0) 0x7f345805a960 con 0x7f3470104d50 2024-04-26T21:39:09.135 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-26T21:39:09.135 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":94,"fsid":"8bb44d26-0411-11ef-bc93-c7b262605968","created":"2024-04-26T21:12:29.304108+0000","modified":"2024-04-26T21:34:37.842273+0000","last_up_change":"2024-04-26T21:32:33.899068+0000","last_in_change":"2024-04-26T21:19:18.310009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:17:58.092436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-26T21:21:13.126623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-26T21:21:13.704785+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6c04d45-3ba8-4cc3-92ee-2e99279c6da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":58,"up_thru":88,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":215849876},{"type":"v1","addr":"172.21.15.84:6803","nonce":215849876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":215849876},{"type":"v1","addr":"172.21.15.84:6805","nonce":215849876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":215849876},{"type":"v1","addr":"172.21.15.84:6809","nonce":215849876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":215849876},{"type":"v1","addr":"172.21.15.84:6807","nonce":215849876}]},"public_addr":"172.21.15.84:6803/215849876","cluster_addr":"172.21.15.84:6805/215849876","heartbeat_back_addr":"172.21.15.84:6809/215849876","heartbeat_front_addr":"172.21.15.84:6807/215849876","state":["exists","up"]},{"osd":1,"uuid":"4417e988-3443-4671-8df5-4d964b8e5954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":64,"up_from":68,"up_thru":88,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3809321856},{"type":"v1","addr":"172.21.15.84:6811","nonce":3809321856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3809321856},{"type":"v1","addr":"172.21.15.84:6813","nonce":3809321856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3809321856},{"type":"v1","addr":"172.21.15.84:6817","nonce":3809321856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3809321856},{"type":"v1","addr":"172.21.15.84:6815","nonce":3809321856}]},"public_addr":"172.21.15.84:6811/3809321856","cluster_addr":"172.21.15.84:6813/3809321856","heartbeat_back_addr":"172.21.15.84:6817/3809321856","heartbeat_front_addr":"172.21.15.84:6815/3809321856","state":["exists","up"]},{"osd":2,"uuid":"240901fd-0810-4752-bfa0-2857359b30a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":69,"up_from":73,"up_thru":88,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":926975972},{"type":"v1","addr":"172.21.15.84:6819","nonce":926975972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":926975972},{"type":"v1","addr":"172.21.15.84:6821","nonce":926975972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":926975972},{"type":"v1","addr":"172.21.15.84:6825","nonce":926975972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":926975972},{"type":"v1","addr":"172.21.15.84:6823","nonce":926975972}]},"public_addr":"172.21.15.84:6819/926975972","cluster_addr":"172.21.15.84:6821/926975972","heartbeat_back_addr":"172.21.15.84:6825/926975972","heartbeat_front_addr":"172.21.15.84:6823/926975972","state":["exists","up"]},{"osd":3,"uuid":"f2d8384f-8b7d-4da4-8a67-4bdb83753822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":74,"up_from":78,"up_thru":88,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2439161252},{"type":"v1","addr":"172.21.15.120:6801","nonce":2439161252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2439161252},{"type":"v1","addr":"172.21.15.120:6803","nonce":2439161252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2439161252},{"type":"v1","addr":"172.21.15.120:6807","nonce":2439161252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2439161252},{"type":"v1","addr":"172.21.15.120:6805","nonce":2439161252}]},"public_addr":"172.21.15.120:6801/2439161252","cluster_addr":"172.21.15.120:6803/2439161252","heartbeat_back_addr":"172.21.15.120:6807/2439161252","heartbeat_front_addr":"172.21.15.120:6805/2439161252","state":["exists","up"]},{"osd":4,"uuid":"27aa8cbb-e94e-4e63-b2d4-be8a71b292ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":79,"up_from":83,"up_thru":88,"down_at":80,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":267967952},{"type":"v1","addr":"172.21.15.120:6809","nonce":267967952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":267967952},{"type":"v1","addr":"172.21.15.120:6811","nonce":267967952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":267967952},{"type":"v1","addr":"172.21.15.120:6815","nonce":267967952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":267967952},{"type":"v1","addr":"172.21.15.120:6813","nonce":267967952}]},"public_addr":"172.21.15.120:6809/267967952","cluster_addr":"172.21.15.120:6811/267967952","heartbeat_back_addr":"172.21.15.120:6815/267967952","heartbeat_front_addr":"172.21.15.120:6813/267967952","state":["exists","up"]},{"osd":5,"uuid":"e13abdd9-155d-40a0-a69a-4448a658ee5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":84,"up_from":88,"up_thru":88,"down_at":85,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3209575908},{"type":"v1","addr":"172.21.15.120:6817","nonce":3209575908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3209575908},{"type":"v1","addr":"172.21.15.120:6819","nonce":3209575908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3209575908},{"type":"v1","addr":"172.21.15.120:6823","nonce":3209575908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3209575908},{"type":"v1","addr":"172.21.15.120:6821","nonce":3209575908}]},"public_addr":"172.21.15.120:6817/3209575908","cluster_addr":"172.21.15.120:6819/3209575908","heartbeat_back_addr":"172.21.15.120:6823/3209575908","heartbeat_front_addr":"172.21.15.120:6821/3209575908","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:45.823555+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:17:20.567670+0000","dead_epoch":64},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:17:55.623700+0000","dead_epoch":69},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:18:31.061632+0000","dead_epoch":74},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:19:06.227030+0000","dead_epoch":79},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:19:40.886216+0000","dead_epoch":84}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.11","mappings":[{"from":3,"to":0}]},{"pgid":"2.12","mappings":[{"from":3,"to":2}]},{"pgid":"2.16","mappings":[{"from":3,"to":0}]},{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.3","mappings":[{"from":4,"to":2}]},{"pgid":"3.4","mappings":[{"from":1,"to":0}]},{"pgid":"3.7","mappings":[{"from":1,"to":0}]},{"pgid":"3.d","mappings":[{"from":3,"to":0}]},{"pgid":"3.e","mappings":[{"from":4,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:6827/2972379081":"2024-04-27T21:34:37.842224+0000","172.21.15.120:6826/2972379081":"2024-04-27T21:34:37.842224+0000","172.21.15.84:6827/1450914842":"2024-04-27T21:33:20.145008+0000","172.21.15.84:0/1001623":"2024-04-27T21:15:11.400421+0000","172.21.15.84:0/354233381":"2024-04-27T21:27:43.672129+0000","172.21.15.84:0/2756731981":"2024-04-27T21:27:43.672129+0000","172.21.15.120:0/1669924996":"2024-04-27T21:26:20.621242+0000","172.21.15.120:0/3421888873":"2024-04-27T21:26:20.621242+0000","172.21.15.84:6828/1543850087":"2024-04-27T21:33:49.979152+0000","172.21.15.84:0/3356039008":"2024-04-27T21:15:11.400421+0000","172.21.15.120:0/1504194308":"2024-04-27T21:26:20.621242+0000","172.21.15.84:0/801206978":"2024-04-27T21:13:03.641160+0000","172.21.15.84:0/2390150734":"2024-04-27T21:24:35.532321+0000","172.21.15.120:6828/3773295163":"2024-04-27T21:26:20.621242+0000","172.21.15.84:6800/3446199945":"2024-04-27T21:15:11.400421+0000","172.21.15.84:0/944666034":"2024-04-27T21:27:43.672129+0000","172.21.15.120:6829/3773295163":"2024-04-27T21:26:20.621242+0000","172.21.15.120:0/553294858":"2024-04-27T21:26:20.621242+0000","172.21.15.84:0/3365760548":"2024-04-27T21:24:35.532321+0000","172.21.15.84:0/2815093662":"2024-04-27T21:24:35.532321+0000","172.21.15.84:6826/1450914842":"2024-04-27T21:33:20.145008+0000","172.21.15.84:0/31938649":"2024-04-27T21:27:43.672129+0000","172.21.15.84:6801/3446199945":"2024-04-27T21:15:11.400421+0000","172.21.15.84:0/3621485381":"2024-04-27T21:13:42.669268+0000","172.21.15.84:6800/3574511298":"2024-04-27T21:24:35.532321+0000","172.21.15.84:0/1430131141":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/413656261":"2024-04-27T21:15:11.400421+0000","172.21.15.84:0/3648317863":"2024-04-27T21:13:03.641160+0000","172.21.15.84:0/2708514508":"2024-04-27T21:24:35.532321+0000","172.21.15.84:0/1155142360":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/1460734944":"2024-04-27T21:13:03.641160+0000","172.21.15.84:6801/3574511298":"2024-04-27T21:24:35.532321+0000","172.21.15.84:6800/3231603698":"2024-04-27T21:13:03.641160+0000","172.21.15.84:6829/1543850087":"2024-04-27T21:33:49.979152+0000","172.21.15.84:6801/3231603698":"2024-04-27T21:13:03.641160+0000","172.21.15.84:6800/2151160823":"2024-04-27T21:13:42.669268+0000","172.21.15.84:6801/3665499318":"2024-04-27T21:27:43.672129+0000","172.21.15.84:0/1070676377":"2024-04-27T21:27:43.672129+0000","172.21.15.84:6800/3665499318":"2024-04-27T21:27:43.672129+0000","172.21.15.84:6801/2151160823":"2024-04-27T21:13:42.669268+0000","172.21.15.84:0/1875187384":"2024-04-27T21:27:43.672129+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:39:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.137+0000 7f3477c00640 1 -- 172.21.15.84:0/3423515690 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f345406eb70 msgr2=0x7f3454071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.137+0000 7f3477c00640 1 --2- 172.21.15.84:0/3423515690 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f345406eb70 0x7f3454071020 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3460004540 tx=0x7f3460009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.137+0000 7f3477c00640 1 -- 172.21.15.84:0/3423515690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3470104d50 msgr2=0x7f34701154a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.137+0000 7f3477c00640 1 --2- 172.21.15.84:0/3423515690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3470104d50 0x7f34701154a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f345800b790 tx=0x7f34580091d0 comp rx=0 tx=0).stop 2024-04-26T21:39:09.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.137+0000 7f3477c00640 1 -- 172.21.15.84:0/3423515690 shutdown_connections 2024-04-26T21:39:09.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.137+0000 7f3477c00640 1 --2- 172.21.15.84:0/3423515690 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f345406eb70 0x7f3454071020 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:09.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.137+0000 7f3477c00640 1 --2- 172.21.15.84:0/3423515690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3470104d50 0x7f34701154a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:09.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.137+0000 7f3477c00640 1 --2- 172.21.15.84:0/3423515690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34701043b0 0x7f3470114f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:09.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.137+0000 7f3477c00640 1 -- 172.21.15.84:0/3423515690 >> 172.21.15.84:0/3423515690 conn(0x7f34700f9f60 msgr2=0x7f34700faed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:09.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.137+0000 7f3477c00640 1 -- 172.21.15.84:0/3423515690 shutdown_connections 2024-04-26T21:39:09.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.137+0000 7f3477c00640 1 -- 172.21.15.84:0/3423515690 wait complete. 2024-04-26T21:39:09.156 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:17:58.092436+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-26T21:21:13.126623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-26T21:21:13.704785+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:39:09.156 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:39:09.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.355+0000 7f028ba00640 1 -- 172.21.15.84:0/2005508393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0284104d30 msgr2=0x7f02840fe3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:09.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.355+0000 7f028ba00640 1 --2- 172.21.15.84:0/2005508393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0284104d30 0x7f02840fe3c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f026c0048d0 tx=0x7f026c009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:09.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.355+0000 7f028ba00640 1 -- 172.21.15.84:0/2005508393 shutdown_connections 2024-04-26T21:39:09.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.355+0000 7f028ba00640 1 --2- 172.21.15.84:0/2005508393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0284104d30 0x7f02840fe3c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:09.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.355+0000 7f028ba00640 1 --2- 172.21.15.84:0/2005508393 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0284104390 0x7f0284104760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:09.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.355+0000 7f028ba00640 1 -- 172.21.15.84:0/2005508393 >> 172.21.15.84:0/2005508393 conn(0x7f02840f9f60 msgr2=0x7f02840fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:09.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.355+0000 7f028ba00640 1 -- 172.21.15.84:0/2005508393 shutdown_connections 2024-04-26T21:39:09.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.356+0000 7f028ba00640 1 -- 172.21.15.84:0/2005508393 wait complete. 2024-04-26T21:39:09.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.356+0000 7f028ba00640 1 Processor -- start 2024-04-26T21:39:09.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.357+0000 7f028ba00640 1 -- start start 2024-04-26T21:39:09.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.357+0000 7f028ba00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0284104390 0x7f0284114f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:09.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.357+0000 7f028ba00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0284104d30 0x7f0284115460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:09.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.357+0000 7f028ba00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0284115af0 con 0x7f0284104d30 2024-04-26T21:39:09.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.357+0000 7f028ba00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028410f0b0 con 0x7f0284104390 2024-04-26T21:39:09.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.357+0000 7f027be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0284104d30 0x7f0284115460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:09.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.358+0000 7f027be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0284104d30 0x7f0284115460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58606/0 (socket says 172.21.15.84:58606) 2024-04-26T21:39:09.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.358+0000 7f027be00640 1 -- 172.21.15.84:0/4083558489 learned_addr learned my addr 172.21.15.84:0/4083558489 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:09.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.358+0000 7f0289000640 1 --2- 172.21.15.84:0/4083558489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0284104390 0x7f0284114f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:09.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.358+0000 7f027be00640 1 -- 172.21.15.84:0/4083558489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0284104390 msgr2=0x7f0284114f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:09.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.358+0000 7f027be00640 1 --2- 172.21.15.84:0/4083558489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0284104390 0x7f0284114f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:09.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.358+0000 7f027be00640 1 -- 172.21.15.84:0/4083558489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026c005040 con 0x7f0284104d30 2024-04-26T21:39:09.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.358+0000 7f027be00640 1 --2- 172.21.15.84:0/4083558489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0284104d30 0x7f0284115460 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f026c004930 tx=0x7f026c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:09.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.359+0000 7f0281600640 1 -- 172.21.15.84:0/4083558489 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f026c0094c0 con 0x7f0284104d30 2024-04-26T21:39:09.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.359+0000 7f0281600640 1 -- 172.21.15.84:0/4083558489 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f026c032e50 con 0x7f0284104d30 2024-04-26T21:39:09.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.359+0000 7f0281600640 1 -- 172.21.15.84:0/4083558489 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f026c0433b0 con 0x7f0284104d30 2024-04-26T21:39:09.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.359+0000 7f028ba00640 1 -- 172.21.15.84:0/4083558489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028410f330 con 0x7f0284104d30 2024-04-26T21:39:09.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.359+0000 7f028ba00640 1 -- 172.21.15.84:0/4083558489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028410f7f0 con 0x7f0284104d30 2024-04-26T21:39:09.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.360+0000 7f028ba00640 1 -- 172.21.15.84:0/4083558489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02840ffb00 con 0x7f0284104d30 2024-04-26T21:39:09.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.361+0000 7f0281600640 1 -- 172.21.15.84:0/4083558489 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f026c02f070 con 0x7f0284104d30 2024-04-26T21:39:09.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.362+0000 7f0281600640 1 --2- 172.21.15.84:0/4083558489 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f026806eb70 0x7f0268071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:09.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.362+0000 7f0281600640 1 -- 172.21.15.84:0/4083558489 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f026c0b0a50 con 0x7f0284104d30 2024-04-26T21:39:09.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.362+0000 7f0289000640 1 --2- 172.21.15.84:0/4083558489 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f026806eb70 0x7f0268071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:09.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.363+0000 7f0289000640 1 --2- 172.21.15.84:0/4083558489 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f026806eb70 0x7f0268071020 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0274006fd0 tx=0x7f0274008040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:09.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.367+0000 7f0281600640 1 -- 172.21.15.84:0/4083558489 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f026c079600 con 0x7f0284104d30 2024-04-26T21:39:09.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:09 smithi084 ceph-mon[90138]: pgmap v391: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:09.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:09 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3560040704' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-26T21:39:09.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:09 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/2342304230' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T21:39:09.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:09 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3423515690' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:39:09.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:09 smithi120 ceph-mon[79001]: pgmap v391: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:09.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:09 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3560040704' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-26T21:39:09.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:09 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/2342304230' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T21:39:09.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:09 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3423515690' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:39:09.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.567+0000 7f028ba00640 1 -- 172.21.15.84:0/4083558489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f028410b580 con 0x7f0284104d30 2024-04-26T21:39:09.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.568+0000 7f0281600640 1 -- 172.21.15.84:0/4083558489 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f026c07ccc0 con 0x7f0284104d30 2024-04-26T21:39:09.568 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-04-26T21:39:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.571+0000 7f028ba00640 1 -- 172.21.15.84:0/4083558489 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f026806eb70 msgr2=0x7f0268071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.571+0000 7f028ba00640 1 --2- 172.21.15.84:0/4083558489 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f026806eb70 0x7f0268071020 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0274006fd0 tx=0x7f0274008040 comp rx=0 tx=0).stop 2024-04-26T21:39:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.571+0000 7f028ba00640 1 -- 172.21.15.84:0/4083558489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0284104d30 msgr2=0x7f0284115460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.571+0000 7f028ba00640 1 --2- 172.21.15.84:0/4083558489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0284104d30 0x7f0284115460 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f026c004930 tx=0x7f026c009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.571+0000 7f028ba00640 1 -- 172.21.15.84:0/4083558489 shutdown_connections 2024-04-26T21:39:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.571+0000 7f028ba00640 1 --2- 172.21.15.84:0/4083558489 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f026806eb70 0x7f0268071020 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.571+0000 7f028ba00640 1 --2- 172.21.15.84:0/4083558489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0284104d30 0x7f0284115460 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.571+0000 7f028ba00640 1 --2- 172.21.15.84:0/4083558489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0284104390 0x7f0284114f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.571+0000 7f028ba00640 1 -- 172.21.15.84:0/4083558489 >> 172.21.15.84:0/4083558489 conn(0x7f02840f9f60 msgr2=0x7f02840fae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.571+0000 7f028ba00640 1 -- 172.21.15.84:0/4083558489 shutdown_connections 2024-04-26T21:39:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.571+0000 7f028ba00640 1 -- 172.21.15.84:0/4083558489 wait complete. 2024-04-26T21:39:09.589 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-26T21:39:09.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.787+0000 7f879e200640 1 -- 172.21.15.84:0/2147009566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8798104c00 msgr2=0x7f87980fe2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:09.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.787+0000 7f879e200640 1 --2- 172.21.15.84:0/2147009566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8798104c00 0x7f87980fe2e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f87880048d0 tx=0x7f8788009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:09.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.787+0000 7f879e200640 1 -- 172.21.15.84:0/2147009566 shutdown_connections 2024-04-26T21:39:09.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.787+0000 7f879e200640 1 --2- 172.21.15.84:0/2147009566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8798104c00 0x7f87980fe2e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:09.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.787+0000 7f879e200640 1 --2- 172.21.15.84:0/2147009566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8798104260 0x7f8798104630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:09.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.787+0000 7f879e200640 1 -- 172.21.15.84:0/2147009566 >> 172.21.15.84:0/2147009566 conn(0x7f87980f9f60 msgr2=0x7f87980fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:09.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.787+0000 7f879e200640 1 -- 172.21.15.84:0/2147009566 shutdown_connections 2024-04-26T21:39:09.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.787+0000 7f879e200640 1 -- 172.21.15.84:0/2147009566 wait complete. 2024-04-26T21:39:09.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.788+0000 7f879e200640 1 Processor -- start 2024-04-26T21:39:09.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.788+0000 7f879e200640 1 -- start start 2024-04-26T21:39:09.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.788+0000 7f879e200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8798104260 0x7f8798114de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:09.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.788+0000 7f879e200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8798104c00 0x7f8798115320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:09.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.788+0000 7f879e200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87981159b0 con 0x7f8798104c00 2024-04-26T21:39:09.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.788+0000 7f879e200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879810ef70 con 0x7f8798104260 2024-04-26T21:39:09.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.789+0000 7f8797e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8798104c00 0x7f8798115320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:09.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.789+0000 7f8797e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8798104c00 0x7f8798115320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58624/0 (socket says 172.21.15.84:58624) 2024-04-26T21:39:09.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.789+0000 7f8797e00640 1 -- 172.21.15.84:0/3449787504 learned_addr learned my addr 172.21.15.84:0/3449787504 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:09.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.789+0000 7f8797e00640 1 -- 172.21.15.84:0/3449787504 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8798104260 msgr2=0x7f8798114de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:09.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.789+0000 7f8797e00640 1 --2- 172.21.15.84:0/3449787504 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8798104260 0x7f8798114de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:09.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.789+0000 7f8797e00640 1 -- 172.21.15.84:0/3449787504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8788005040 con 0x7f8798104c00 2024-04-26T21:39:09.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.789+0000 7f8797e00640 1 --2- 172.21.15.84:0/3449787504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8798104c00 0x7f8798115320 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f87880047f0 tx=0x7f8788009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:09.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.789+0000 7f8794c00640 1 -- 172.21.15.84:0/3449787504 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87880094c0 con 0x7f8798104c00 2024-04-26T21:39:09.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.790+0000 7f879e200640 1 -- 172.21.15.84:0/3449787504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879810f1f0 con 0x7f8798104c00 2024-04-26T21:39:09.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.790+0000 7f8794c00640 1 -- 172.21.15.84:0/3449787504 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8788032e50 con 0x7f8798104c00 2024-04-26T21:39:09.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.790+0000 7f8794c00640 1 -- 172.21.15.84:0/3449787504 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87880435f0 con 0x7f8798104c00 2024-04-26T21:39:09.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.790+0000 7f879e200640 1 -- 172.21.15.84:0/3449787504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879810f6b0 con 0x7f8798104c00 2024-04-26T21:39:09.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.791+0000 7f879e200640 1 -- 172.21.15.84:0/3449787504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87980ff9d0 con 0x7f8798104c00 2024-04-26T21:39:09.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.792+0000 7f8794c00640 1 -- 172.21.15.84:0/3449787504 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f878802f070 con 0x7f8798104c00 2024-04-26T21:39:09.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.793+0000 7f8794c00640 1 --2- 172.21.15.84:0/3449787504 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f878006eb80 0x7f8780071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:09.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.793+0000 7f8794c00640 1 -- 172.21.15.84:0/3449787504 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7f87880b0860 con 0x7f8798104c00 2024-04-26T21:39:09.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.793+0000 7f879ce00640 1 --2- 172.21.15.84:0/3449787504 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f878006eb80 0x7f8780071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:09.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.794+0000 7f879ce00640 1 --2- 172.21.15.84:0/3449787504 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f878006eb80 0x7f8780071030 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f878c0097e0 tx=0x7f878c006d20 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:09.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.801+0000 7f8794c00640 1 -- 172.21.15.84:0/3449787504 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f87880794b0 con 0x7f8798104c00 2024-04-26T21:39:09.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:09.999+0000 7f879e200640 1 -- 172.21.15.84:0/3449787504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f879804bcc0 con 0x7f8798104c00 2024-04-26T21:39:10.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.000+0000 7f8794c00640 1 -- 172.21.15.84:0/3449787504 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v94) v1 ==== 107+0+11 (secure 0 0 0) 0x7f878807cb70 con 0x7f8798104c00 2024-04-26T21:39:10.000 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-04-26T21:39:10.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.003+0000 7f879e200640 1 -- 172.21.15.84:0/3449787504 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f878006eb80 msgr2=0x7f8780071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:10.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.003+0000 7f879e200640 1 --2- 172.21.15.84:0/3449787504 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f878006eb80 0x7f8780071030 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f878c0097e0 tx=0x7f878c006d20 comp rx=0 tx=0).stop 2024-04-26T21:39:10.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.003+0000 7f879e200640 1 -- 172.21.15.84:0/3449787504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8798104c00 msgr2=0x7f8798115320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:10.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.003+0000 7f879e200640 1 --2- 172.21.15.84:0/3449787504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8798104c00 0x7f8798115320 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f87880047f0 tx=0x7f8788009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:10.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.003+0000 7f879e200640 1 -- 172.21.15.84:0/3449787504 shutdown_connections 2024-04-26T21:39:10.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.003+0000 7f879e200640 1 --2- 172.21.15.84:0/3449787504 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7f878006eb80 0x7f8780071030 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:10.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.003+0000 7f879e200640 1 --2- 172.21.15.84:0/3449787504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8798104c00 0x7f8798115320 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:10.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.003+0000 7f879e200640 1 --2- 172.21.15.84:0/3449787504 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8798104260 0x7f8798114de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:10.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.003+0000 7f879e200640 1 -- 172.21.15.84:0/3449787504 >> 172.21.15.84:0/3449787504 conn(0x7f87980f9f60 msgr2=0x7f87980fbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:10.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.003+0000 7f879e200640 1 -- 172.21.15.84:0/3449787504 shutdown_connections 2024-04-26T21:39:10.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.004+0000 7f879e200640 1 -- 172.21.15.84:0/3449787504 wait complete. 2024-04-26T21:39:10.021 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-26T21:39:10.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.223+0000 7fd5aaa00640 1 -- 172.21.15.84:0/1129431093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5a406f7b0 msgr2=0x7fd5a406fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.223+0000 7fd5aaa00640 1 --2- 172.21.15.84:0/1129431093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5a406f7b0 0x7fd5a406fb80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd5940048d0 tx=0x7fd594009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.223+0000 7fd5aaa00640 1 -- 172.21.15.84:0/1129431093 shutdown_connections 2024-04-26T21:39:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.223+0000 7fd5aaa00640 1 --2- 172.21.15.84:0/1129431093 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5a40700c0 0x7fd5a4108380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.223+0000 7fd5aaa00640 1 --2- 172.21.15.84:0/1129431093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5a406f7b0 0x7fd5a406fb80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.223+0000 7fd5aaa00640 1 -- 172.21.15.84:0/1129431093 >> 172.21.15.84:0/1129431093 conn(0x7fd5a40f7be0 msgr2=0x7fd5a40f9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.223+0000 7fd5aaa00640 1 -- 172.21.15.84:0/1129431093 shutdown_connections 2024-04-26T21:39:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.223+0000 7fd5aaa00640 1 -- 172.21.15.84:0/1129431093 wait complete. 2024-04-26T21:39:10.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.224+0000 7fd5aaa00640 1 Processor -- start 2024-04-26T21:39:10.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.224+0000 7fd5aaa00640 1 -- start start 2024-04-26T21:39:10.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.225+0000 7fd5aaa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5a406f7b0 0x7fd5a4114d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:10.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.225+0000 7fd5aaa00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5a40700c0 0x7fd5a41152a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:10.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.225+0000 7fd5aaa00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a41158a0 con 0x7fd5a406f7b0 2024-04-26T21:39:10.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.225+0000 7fd5aaa00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a410eef0 con 0x7fd5a40700c0 2024-04-26T21:39:10.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.225+0000 7fd5a9600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5a406f7b0 0x7fd5a4114d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:10.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.225+0000 7fd5a9600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5a406f7b0 0x7fd5a4114d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58640/0 (socket says 172.21.15.84:58640) 2024-04-26T21:39:10.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.225+0000 7fd5a9600640 1 -- 172.21.15.84:0/788771423 learned_addr learned my addr 172.21.15.84:0/788771423 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:10.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.225+0000 7fd5a9600640 1 -- 172.21.15.84:0/788771423 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5a40700c0 msgr2=0x7fd5a41152a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:10.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.225+0000 7fd5a9600640 1 --2- 172.21.15.84:0/788771423 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5a40700c0 0x7fd5a41152a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:10.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.225+0000 7fd5a9600640 1 -- 172.21.15.84:0/788771423 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd594005040 con 0x7fd5a406f7b0 2024-04-26T21:39:10.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.226+0000 7fd5a9600640 1 --2- 172.21.15.84:0/788771423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5a406f7b0 0x7fd5a4114d60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd5940047f0 tx=0x7fd594009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:10.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.226+0000 7fd5a1600640 1 -- 172.21.15.84:0/788771423 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5940094c0 con 0x7fd5a406f7b0 2024-04-26T21:39:10.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.226+0000 7fd5a1600640 1 -- 172.21.15.84:0/788771423 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd594032e50 con 0x7fd5a406f7b0 2024-04-26T21:39:10.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.226+0000 7fd5a1600640 1 -- 172.21.15.84:0/788771423 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5940435f0 con 0x7fd5a406f7b0 2024-04-26T21:39:10.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.226+0000 7fd5aaa00640 1 -- 172.21.15.84:0/788771423 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a410f170 con 0x7fd5a406f7b0 2024-04-26T21:39:10.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.226+0000 7fd5aaa00640 1 -- 172.21.15.84:0/788771423 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a410f630 con 0x7fd5a406f7b0 2024-04-26T21:39:10.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.227+0000 7fd5aaa00640 1 -- 172.21.15.84:0/788771423 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a4070ef0 con 0x7fd5a406f7b0 2024-04-26T21:39:10.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.228+0000 7fd5a1600640 1 -- 172.21.15.84:0/788771423 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd59402f070 con 0x7fd5a406f7b0 2024-04-26T21:39:10.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.229+0000 7fd5a1600640 1 --2- 172.21.15.84:0/788771423 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd58806eb80 0x7fd588071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:10.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.229+0000 7fd5a1600640 1 -- 172.21.15.84:0/788771423 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fd5940b0840 con 0x7fd5a406f7b0 2024-04-26T21:39:10.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.229+0000 7fd5a8c00640 1 --2- 172.21.15.84:0/788771423 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd58806eb80 0x7fd588071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:10.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.230+0000 7fd5a8c00640 1 --2- 172.21.15.84:0/788771423 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd58806eb80 0x7fd588071030 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd590007fd0 tx=0x7fd590007b20 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:10.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.234+0000 7fd5a1600640 1 -- 172.21.15.84:0/788771423 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fd5940793f0 con 0x7fd5a406f7b0 2024-04-26T21:39:10.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.420+0000 7fd5aaa00640 1 -- 172.21.15.84:0/788771423 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fd5a410f8a0 con 0x7fd5a406f7b0 2024-04-26T21:39:10.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.421+0000 7fd5a1600640 1 -- 172.21.15.84:0/788771423 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v94) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd59407cab0 con 0x7fd5a406f7b0 2024-04-26T21:39:10.422 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-04-26T21:39:10.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.424+0000 7fd5aaa00640 1 -- 172.21.15.84:0/788771423 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd58806eb80 msgr2=0x7fd588071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:10.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.424+0000 7fd5aaa00640 1 --2- 172.21.15.84:0/788771423 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd58806eb80 0x7fd588071030 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd590007fd0 tx=0x7fd590007b20 comp rx=0 tx=0).stop 2024-04-26T21:39:10.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.424+0000 7fd5aaa00640 1 -- 172.21.15.84:0/788771423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5a406f7b0 msgr2=0x7fd5a4114d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:10.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.424+0000 7fd5aaa00640 1 --2- 172.21.15.84:0/788771423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5a406f7b0 0x7fd5a4114d60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd5940047f0 tx=0x7fd594009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:10.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.424+0000 7fd5aaa00640 1 -- 172.21.15.84:0/788771423 shutdown_connections 2024-04-26T21:39:10.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.424+0000 7fd5aaa00640 1 --2- 172.21.15.84:0/788771423 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fd58806eb80 0x7fd588071030 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:10.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.424+0000 7fd5aaa00640 1 --2- 172.21.15.84:0/788771423 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5a40700c0 0x7fd5a41152a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:10.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.424+0000 7fd5aaa00640 1 --2- 172.21.15.84:0/788771423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5a406f7b0 0x7fd5a4114d60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:10.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.424+0000 7fd5aaa00640 1 -- 172.21.15.84:0/788771423 >> 172.21.15.84:0/788771423 conn(0x7fd5a40f7be0 msgr2=0x7fd5a40f9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:10.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.424+0000 7fd5aaa00640 1 -- 172.21.15.84:0/788771423 shutdown_connections 2024-04-26T21:39:10.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.424+0000 7fd5aaa00640 1 -- 172.21.15.84:0/788771423 wait complete. 2024-04-26T21:39:10.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:10 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/4083558489' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T21:39:10.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:10 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/3449787504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-26T21:39:10.437 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:10 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/4083558489' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T21:39:10.438 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:10 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/3449787504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-26T21:39:10.441 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:39:10.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.619+0000 7fc4dfe00640 1 -- 172.21.15.84:0/3115011963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4e0101ff0 msgr2=0x7fc4e01023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:10.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.619+0000 7fc4dfe00640 1 --2- 172.21.15.84:0/3115011963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4e0101ff0 0x7fc4e01023c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00048d0 tx=0x7fc4d0009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:10.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.619+0000 7fc4dfe00640 1 -- 172.21.15.84:0/3115011963 shutdown_connections 2024-04-26T21:39:10.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.619+0000 7fc4dfe00640 1 --2- 172.21.15.84:0/3115011963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4e0102990 0x7fc4e00fc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:10.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.619+0000 7fc4dfe00640 1 --2- 172.21.15.84:0/3115011963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4e0101ff0 0x7fc4e01023c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:10.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.619+0000 7fc4dfe00640 1 -- 172.21.15.84:0/3115011963 >> 172.21.15.84:0/3115011963 conn(0x7fc4e00f7be0 msgr2=0x7fc4e00f9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:10.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.619+0000 7fc4dfe00640 1 -- 172.21.15.84:0/3115011963 shutdown_connections 2024-04-26T21:39:10.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.619+0000 7fc4dfe00640 1 -- 172.21.15.84:0/3115011963 wait complete. 2024-04-26T21:39:10.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.620+0000 7fc4dfe00640 1 Processor -- start 2024-04-26T21:39:10.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.620+0000 7fc4dfe00640 1 -- start start 2024-04-26T21:39:10.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.621+0000 7fc4dfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4e0101ff0 0x7fc4e0114d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:10.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.621+0000 7fc4dfe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4e0102990 0x7fc4e0115280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:10.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.621+0000 7fc4dfe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e0115880 con 0x7fc4e0101ff0 2024-04-26T21:39:10.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.621+0000 7fc4dfe00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e010eed0 con 0x7fc4e0102990 2024-04-26T21:39:10.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.621+0000 7fc4dea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4e0101ff0 0x7fc4e0114d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.621+0000 7fc4dea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4e0101ff0 0x7fc4e0114d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58656/0 (socket says 172.21.15.84:58656) 2024-04-26T21:39:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.621+0000 7fc4dea00640 1 -- 172.21.15.84:0/4126554407 learned_addr learned my addr 172.21.15.84:0/4126554407 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-26T21:39:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.621+0000 7fc4de000640 1 --2- 172.21.15.84:0/4126554407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4e0102990 0x7fc4e0115280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.621+0000 7fc4dea00640 1 -- 172.21.15.84:0/4126554407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4e0102990 msgr2=0x7fc4e0115280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.621+0000 7fc4dea00640 1 --2- 172.21.15.84:0/4126554407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4e0102990 0x7fc4e0115280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.621+0000 7fc4dea00640 1 -- 172.21.15.84:0/4126554407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d0005040 con 0x7fc4e0101ff0 2024-04-26T21:39:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.621+0000 7fc4de000640 1 --2- 172.21.15.84:0/4126554407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4e0102990 0x7fc4e0115280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:39:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.622+0000 7fc4dea00640 1 --2- 172.21.15.84:0/4126554407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4e0101ff0 0x7fc4e0114d40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00047f0 tx=0x7fc4d0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.622+0000 7fc4d6a00640 1 -- 172.21.15.84:0/4126554407 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4d00094c0 con 0x7fc4e0101ff0 2024-04-26T21:39:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.622+0000 7fc4d6a00640 1 -- 172.21.15.84:0/4126554407 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc4d0032e50 con 0x7fc4e0101ff0 2024-04-26T21:39:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.622+0000 7fc4dfe00640 1 -- 172.21.15.84:0/4126554407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e010f150 con 0x7fc4e0101ff0 2024-04-26T21:39:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.622+0000 7fc4d6a00640 1 -- 172.21.15.84:0/4126554407 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4d00435f0 con 0x7fc4e0101ff0 2024-04-26T21:39:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.622+0000 7fc4dfe00640 1 -- 172.21.15.84:0/4126554407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e010f610 con 0x7fc4e0101ff0 2024-04-26T21:39:10.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.623+0000 7fc4dfe00640 1 -- 172.21.15.84:0/4126554407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e00fd760 con 0x7fc4e0101ff0 2024-04-26T21:39:10.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.624+0000 7fc4d6a00640 1 -- 172.21.15.84:0/4126554407 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc4d002f070 con 0x7fc4e0101ff0 2024-04-26T21:39:10.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.625+0000 7fc4d6a00640 1 --2- 172.21.15.84:0/4126554407 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc4c406eb80 0x7fc4c4071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:39:10.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.625+0000 7fc4d6a00640 1 -- 172.21.15.84:0/4126554407 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6843+0+0 (secure 0 0 0) 0x7fc4d00b0920 con 0x7fc4e0101ff0 2024-04-26T21:39:10.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.625+0000 7fc4de000640 1 --2- 172.21.15.84:0/4126554407 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc4c406eb80 0x7fc4c4071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:39:10.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.626+0000 7fc4de000640 1 --2- 172.21.15.84:0/4126554407 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc4c406eb80 0x7fc4c4071030 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0110600 tx=0x7fc4cc009040 comp rx=0 tx=0).ready entity=mgr.24535 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:39:10.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.629+0000 7fc4d6a00640 1 -- 172.21.15.84:0/4126554407 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fc4d00794d0 con 0x7fc4e0101ff0 2024-04-26T21:39:10.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.844+0000 7fc4dfe00640 1 -- 172.21.15.84:0/4126554407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc4e01103b0 con 0x7fc4e0101ff0 2024-04-26T21:39:10.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.845+0000 7fc4d6a00640 1 -- 172.21.15.84:0/4126554407 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v94) v1 ==== 81+0+2430 (secure 0 0 0) 0x7fc4d007cb90 con 0x7fc4e0101ff0 2024-04-26T21:39:10.845 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.120:6827/2972379081 2024-04-27T21:34:37.842224+0000 2024-04-26T21:39:10.845 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.120:6826/2972379081 2024-04-27T21:34:37.842224+0000 2024-04-26T21:39:10.845 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6827/1450914842 2024-04-27T21:33:20.145008+0000 2024-04-26T21:39:10.845 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1001623 2024-04-27T21:15:11.400421+0000 2024-04-26T21:39:10.845 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/354233381 2024-04-27T21:27:43.672129+0000 2024-04-26T21:39:10.845 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2756731981 2024-04-27T21:27:43.672129+0000 2024-04-26T21:39:10.845 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.120:0/1669924996 2024-04-27T21:26:20.621242+0000 2024-04-26T21:39:10.846 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.120:0/3421888873 2024-04-27T21:26:20.621242+0000 2024-04-26T21:39:10.846 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6828/1543850087 2024-04-27T21:33:49.979152+0000 2024-04-26T21:39:10.846 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3356039008 2024-04-27T21:15:11.400421+0000 2024-04-26T21:39:10.846 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.120:0/1504194308 2024-04-27T21:26:20.621242+0000 2024-04-26T21:39:10.846 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/801206978 2024-04-27T21:13:03.641160+0000 2024-04-26T21:39:10.846 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2390150734 2024-04-27T21:24:35.532321+0000 2024-04-26T21:39:10.846 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.120:6828/3773295163 2024-04-27T21:26:20.621242+0000 2024-04-26T21:39:10.846 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/3446199945 2024-04-27T21:15:11.400421+0000 2024-04-26T21:39:10.846 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/944666034 2024-04-27T21:27:43.672129+0000 2024-04-26T21:39:10.846 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.120:6829/3773295163 2024-04-27T21:26:20.621242+0000 2024-04-26T21:39:10.846 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.120:0/553294858 2024-04-27T21:26:20.621242+0000 2024-04-26T21:39:10.846 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3365760548 2024-04-27T21:24:35.532321+0000 2024-04-26T21:39:10.847 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2815093662 2024-04-27T21:24:35.532321+0000 2024-04-26T21:39:10.847 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6826/1450914842 2024-04-27T21:33:20.145008+0000 2024-04-26T21:39:10.847 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/31938649 2024-04-27T21:27:43.672129+0000 2024-04-26T21:39:10.847 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/3446199945 2024-04-27T21:15:11.400421+0000 2024-04-26T21:39:10.847 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3621485381 2024-04-27T21:13:42.669268+0000 2024-04-26T21:39:10.847 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/3574511298 2024-04-27T21:24:35.532321+0000 2024-04-26T21:39:10.847 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1430131141 2024-04-27T21:13:42.669268+0000 2024-04-26T21:39:10.847 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/413656261 2024-04-27T21:15:11.400421+0000 2024-04-26T21:39:10.847 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3648317863 2024-04-27T21:13:03.641160+0000 2024-04-26T21:39:10.847 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2708514508 2024-04-27T21:24:35.532321+0000 2024-04-26T21:39:10.847 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1155142360 2024-04-27T21:13:42.669268+0000 2024-04-26T21:39:10.847 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1460734944 2024-04-27T21:13:03.641160+0000 2024-04-26T21:39:10.847 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/3574511298 2024-04-27T21:24:35.532321+0000 2024-04-26T21:39:10.847 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/3231603698 2024-04-27T21:13:03.641160+0000 2024-04-26T21:39:10.847 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6829/1543850087 2024-04-27T21:33:49.979152+0000 2024-04-26T21:39:10.848 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/3231603698 2024-04-27T21:13:03.641160+0000 2024-04-26T21:39:10.848 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/2151160823 2024-04-27T21:13:42.669268+0000 2024-04-26T21:39:10.848 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/3665499318 2024-04-27T21:27:43.672129+0000 2024-04-26T21:39:10.848 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1070676377 2024-04-27T21:27:43.672129+0000 2024-04-26T21:39:10.848 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/3665499318 2024-04-27T21:27:43.672129+0000 2024-04-26T21:39:10.848 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/2151160823 2024-04-27T21:13:42.669268+0000 2024-04-26T21:39:10.848 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1875187384 2024-04-27T21:27:43.672129+0000 2024-04-26T21:39:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:listed 41 entries 2024-04-26T21:39:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.847+0000 7fc4dfe00640 1 -- 172.21.15.84:0/4126554407 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc4c406eb80 msgr2=0x7fc4c4071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.847+0000 7fc4dfe00640 1 --2- 172.21.15.84:0/4126554407 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc4c406eb80 0x7fc4c4071030 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0110600 tx=0x7fc4cc009040 comp rx=0 tx=0).stop 2024-04-26T21:39:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.847+0000 7fc4dfe00640 1 -- 172.21.15.84:0/4126554407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4e0101ff0 msgr2=0x7fc4e0114d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:39:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.847+0000 7fc4dfe00640 1 --2- 172.21.15.84:0/4126554407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4e0101ff0 0x7fc4e0114d40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00047f0 tx=0x7fc4d0009da0 comp rx=0 tx=0).stop 2024-04-26T21:39:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.847+0000 7fc4dfe00640 1 -- 172.21.15.84:0/4126554407 shutdown_connections 2024-04-26T21:39:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.847+0000 7fc4dfe00640 1 --2- 172.21.15.84:0/4126554407 >> [v2:172.21.15.84:6800/4242898215,v1:172.21.15.84:6801/4242898215] conn(0x7fc4c406eb80 0x7fc4c4071030 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.847+0000 7fc4dfe00640 1 --2- 172.21.15.84:0/4126554407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4e0102990 0x7fc4e0115280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.847+0000 7fc4dfe00640 1 --2- 172.21.15.84:0/4126554407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4e0101ff0 0x7fc4e0114d40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:39:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.847+0000 7fc4dfe00640 1 -- 172.21.15.84:0/4126554407 >> 172.21.15.84:0/4126554407 conn(0x7fc4e00f7be0 msgr2=0x7fc4e0071140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:39:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.848+0000 7fc4dfe00640 1 -- 172.21.15.84:0/4126554407 shutdown_connections 2024-04-26T21:39:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-26T21:39:10.848+0000 7fc4dfe00640 1 -- 172.21.15.84:0/4126554407 wait complete. 2024-04-26T21:39:10.866 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2024-04-26T21:39:10.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:39:10.866 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T21:39:10.946 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:39:11.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:11 smithi120 ceph-mon[79001]: pgmap v392: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:11.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:11 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/788771423' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-26T21:39:11.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:11 smithi120 ceph-mon[79001]: from='client.? 172.21.15.84:0/4126554407' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T21:39:11.516 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:11 smithi084 ceph-mon[90138]: pgmap v392: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:11.516 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:11 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/788771423' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-26T21:39:11.516 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:11 smithi084 ceph-mon[90138]: from='client.? 172.21.15.84:0/4126554407' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T21:39:12.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:12 smithi084 ceph-mon[90138]: pgmap v393: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:12.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:12 smithi120 ceph-mon[79001]: pgmap v393: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:15.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:15 smithi084 ceph-mon[90138]: pgmap v394: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:15.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:15 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:39:15.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:15 smithi120 ceph-mon[79001]: pgmap v394: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:15.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:15 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:39:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:17 smithi084 ceph-mon[90138]: pgmap v395: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:17.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:17 smithi120 ceph-mon[79001]: pgmap v395: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:19.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:19 smithi084 ceph-mon[90138]: pgmap v396: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:19.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:19 smithi120 ceph-mon[79001]: pgmap v396: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:21.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:21 smithi084 ceph-mon[90138]: pgmap v397: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:21.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:21 smithi120 ceph-mon[79001]: pgmap v397: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:23.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:23 smithi084 ceph-mon[90138]: pgmap v398: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:23.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:23 smithi120 ceph-mon[79001]: pgmap v398: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:25.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:25 smithi084 ceph-mon[90138]: pgmap v399: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:25.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:25 smithi120 ceph-mon[79001]: pgmap v399: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:27.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:27 smithi084 ceph-mon[90138]: pgmap v400: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:27.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:27 smithi120 ceph-mon[79001]: pgmap v400: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:29.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:29 smithi084 ceph-mon[90138]: pgmap v401: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:29.415 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:29 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:39:29.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:29 smithi120 ceph-mon[79001]: pgmap v401: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:29.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:29 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:39:31.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:31 smithi084 ceph-mon[90138]: pgmap v402: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:31 smithi120 ceph-mon[79001]: pgmap v402: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:33.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:33 smithi084 ceph-mon[90138]: pgmap v403: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:33.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:33 smithi120 ceph-mon[79001]: pgmap v403: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:35.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:35 smithi084 ceph-mon[90138]: pgmap v404: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:35.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:35 smithi120 ceph-mon[79001]: pgmap v404: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:37.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:37 smithi084 ceph-mon[90138]: pgmap v405: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:37.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:37 smithi120 ceph-mon[79001]: pgmap v405: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:39.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:39 smithi084 ceph-mon[90138]: pgmap v406: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:39.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:39 smithi120 ceph-mon[79001]: pgmap v406: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:41.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:41 smithi084 ceph-mon[90138]: pgmap v407: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:41.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:41 smithi120 ceph-mon[79001]: pgmap v407: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:43.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:43 smithi084 ceph-mon[90138]: pgmap v408: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:43.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:43 smithi120 ceph-mon[79001]: pgmap v408: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:44.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:39:44.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:39:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:45 smithi084 ceph-mon[90138]: pgmap v409: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:45 smithi120 ceph-mon[79001]: pgmap v409: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:47.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:47 smithi084 ceph-mon[90138]: pgmap v410: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:47 smithi120 ceph-mon[79001]: pgmap v410: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:49.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:49 smithi084 ceph-mon[90138]: pgmap v411: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:49.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:49 smithi120 ceph-mon[79001]: pgmap v411: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:50.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:50 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:39:50.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:50 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:39:51.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:51 smithi084 ceph-mon[90138]: pgmap v412: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:51.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:51 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:39:51.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:51 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:39:51.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:51 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:39:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:51 smithi120 ceph-mon[79001]: pgmap v412: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:51 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:39:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:51 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:39:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:51 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:39:53.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:53 smithi084 ceph-mon[90138]: pgmap v413: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:53 smithi120 ceph-mon[79001]: pgmap v413: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:55.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:55 smithi084 ceph-mon[90138]: pgmap v414: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:55 smithi120 ceph-mon[79001]: pgmap v414: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:57 smithi120 ceph-mon[79001]: pgmap v415: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:57.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:57 smithi084 ceph-mon[90138]: pgmap v415: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:59 smithi120 ceph-mon[79001]: pgmap v416: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:39:59 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:39:59.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:59 smithi084 ceph-mon[90138]: pgmap v416: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:39:59.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:39:59 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:40:00.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:00 smithi120 ceph-mon[79001]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:40:00.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:00 smithi120 ceph-mon[79001]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:40:00.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:00 smithi120 ceph-mon[79001]: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:40:00.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:00 smithi084 ceph-mon[90138]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-26T21:40:00.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:00 smithi084 ceph-mon[90138]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-26T21:40:00.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:00 smithi084 ceph-mon[90138]: fs cephfs has deprecated feature inline_data enabled. 2024-04-26T21:40:01.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:01 smithi084 ceph-mon[90138]: pgmap v417: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:01.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:01 smithi120 ceph-mon[79001]: pgmap v417: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:02.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:02 smithi084 ceph-mon[90138]: pgmap v418: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:02.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:02 smithi120 ceph-mon[79001]: pgmap v418: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:05.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:05 smithi084 ceph-mon[90138]: pgmap v419: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:05 smithi120 ceph-mon[79001]: pgmap v419: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:07.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:07 smithi084 ceph-mon[90138]: pgmap v420: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:07.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:07 smithi120 ceph-mon[79001]: pgmap v420: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:09.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:09 smithi084 ceph-mon[90138]: pgmap v421: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:09.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:09 smithi120 ceph-mon[79001]: pgmap v421: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:11.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:11 smithi084 ceph-mon[90138]: pgmap v422: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:11.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:11 smithi120 ceph-mon[79001]: pgmap v422: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:13.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:13 smithi084 ceph-mon[90138]: pgmap v423: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:13.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:13 smithi120 ceph-mon[79001]: pgmap v423: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:14.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:40:14.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:40:15.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:15 smithi084 ceph-mon[90138]: pgmap v424: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:15.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:15 smithi120 ceph-mon[79001]: pgmap v424: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:17.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:17 smithi084 ceph-mon[90138]: pgmap v425: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:17.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:17 smithi120 ceph-mon[79001]: pgmap v425: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:19.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:19 smithi084 ceph-mon[90138]: pgmap v426: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:19.433 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:19 smithi120 ceph-mon[79001]: pgmap v426: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:21.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:21 smithi084 ceph-mon[90138]: pgmap v427: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:21.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:21 smithi120 ceph-mon[79001]: pgmap v427: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:23.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:23 smithi084 ceph-mon[90138]: pgmap v428: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:23.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:23 smithi120 ceph-mon[79001]: pgmap v428: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:25.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:25 smithi084 ceph-mon[90138]: pgmap v429: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:25.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:25 smithi120 ceph-mon[79001]: pgmap v429: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:27.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:27 smithi084 ceph-mon[90138]: pgmap v430: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:27.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:27 smithi120 ceph-mon[79001]: pgmap v430: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:29 smithi084 ceph-mon[90138]: pgmap v431: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:29 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:40:29.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:29 smithi120 ceph-mon[79001]: pgmap v431: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:29.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:29 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:40:31.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:31 smithi084 ceph-mon[90138]: pgmap v432: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:31 smithi120 ceph-mon[79001]: pgmap v432: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:33.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:33 smithi084 ceph-mon[90138]: pgmap v433: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:33.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:33 smithi120 ceph-mon[79001]: pgmap v433: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:35.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:35 smithi084 ceph-mon[90138]: pgmap v434: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:35.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:35 smithi120 ceph-mon[79001]: pgmap v434: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:37.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:37 smithi084 ceph-mon[90138]: pgmap v435: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:37.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:37 smithi120 ceph-mon[79001]: pgmap v435: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:38.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:38 smithi084 ceph-mon[90138]: pgmap v436: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:38.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:38 smithi120 ceph-mon[79001]: pgmap v436: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:41.366 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:41 smithi084 ceph-mon[90138]: pgmap v437: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:41.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:41 smithi120 ceph-mon[79001]: pgmap v437: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:43.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:43 smithi084 ceph-mon[90138]: pgmap v438: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:43.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:43 smithi120 ceph-mon[79001]: pgmap v438: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:44.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:40:44.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:40:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:45 smithi084 ceph-mon[90138]: pgmap v439: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:45 smithi120 ceph-mon[79001]: pgmap v439: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:47.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:47 smithi084 ceph-mon[90138]: pgmap v440: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:47 smithi120 ceph-mon[79001]: pgmap v440: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:49.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:49 smithi084 ceph-mon[90138]: pgmap v441: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:49.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:49 smithi120 ceph-mon[79001]: pgmap v441: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:51.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:51 smithi084 ceph-mon[90138]: pgmap v442: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:51 smithi120 ceph-mon[79001]: pgmap v442: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:52.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:52 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:40:52.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:52 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:40:53.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:53 smithi084 ceph-mon[90138]: pgmap v443: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:53.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:53 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:40:53.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:53 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:40:53.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:53 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:40:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:53 smithi120 ceph-mon[79001]: pgmap v443: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:53 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:40:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:53 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:40:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:53 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:40:55.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:55 smithi084 ceph-mon[90138]: pgmap v444: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:55 smithi120 ceph-mon[79001]: pgmap v444: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:57.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:57 smithi084 ceph-mon[90138]: pgmap v445: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:57 smithi120 ceph-mon[79001]: pgmap v445: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:59.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:59 smithi084 ceph-mon[90138]: pgmap v446: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:59.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:40:59 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:40:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:59 smithi120 ceph-mon[79001]: pgmap v446: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:40:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:40:59 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:41:01.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:01 smithi084 ceph-mon[90138]: pgmap v447: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:01.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:01 smithi120 ceph-mon[79001]: pgmap v447: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:03.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:03 smithi084 ceph-mon[90138]: pgmap v448: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:03.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:03 smithi120 ceph-mon[79001]: pgmap v448: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:05.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:05 smithi084 ceph-mon[90138]: pgmap v449: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:05 smithi120 ceph-mon[79001]: pgmap v449: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:07.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:07 smithi084 ceph-mon[90138]: pgmap v450: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:07.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:07 smithi120 ceph-mon[79001]: pgmap v450: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:09.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:09 smithi084 ceph-mon[90138]: pgmap v451: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:09.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:09 smithi120 ceph-mon[79001]: pgmap v451: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:11.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:11 smithi084 ceph-mon[90138]: pgmap v452: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:11.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:11 smithi120 ceph-mon[79001]: pgmap v452: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:13.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:13 smithi084 ceph-mon[90138]: pgmap v453: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:13.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:13 smithi120 ceph-mon[79001]: pgmap v453: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:14.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:41:14.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:41:15.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:15 smithi120 ceph-mon[79001]: pgmap v454: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:15.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:15 smithi084 ceph-mon[90138]: pgmap v454: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:17.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:17 smithi120 ceph-mon[79001]: pgmap v455: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:17.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:17 smithi084 ceph-mon[90138]: pgmap v455: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:19.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:19 smithi084 ceph-mon[90138]: pgmap v456: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:19.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:19 smithi120 ceph-mon[79001]: pgmap v456: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:21.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:21 smithi084 ceph-mon[90138]: pgmap v457: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:21.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:21 smithi120 ceph-mon[79001]: pgmap v457: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:23.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:23 smithi084 ceph-mon[90138]: pgmap v458: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:23.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:23 smithi120 ceph-mon[79001]: pgmap v458: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:25.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:25 smithi084 ceph-mon[90138]: pgmap v459: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:25.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:25 smithi120 ceph-mon[79001]: pgmap v459: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:26.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:26 smithi084 ceph-mon[90138]: pgmap v460: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:26.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:26 smithi120 ceph-mon[79001]: pgmap v460: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:29.386 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:29 smithi120 ceph-mon[79001]: pgmap v461: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:29.386 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:29 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:41:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:29 smithi084 ceph-mon[90138]: pgmap v461: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:29 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:41:31.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:31 smithi084 ceph-mon[90138]: pgmap v462: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:31 smithi120 ceph-mon[79001]: pgmap v462: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:33.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:33 smithi084 ceph-mon[90138]: pgmap v463: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:33.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:33 smithi120 ceph-mon[79001]: pgmap v463: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:35.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:35 smithi084 ceph-mon[90138]: pgmap v464: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:35.431 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:35 smithi120 ceph-mon[79001]: pgmap v464: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:37.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:37 smithi084 ceph-mon[90138]: pgmap v465: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:37.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:37 smithi120 ceph-mon[79001]: pgmap v465: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:39.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:39 smithi084 ceph-mon[90138]: pgmap v466: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:39.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:39 smithi120 ceph-mon[79001]: pgmap v466: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:41.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:41 smithi084 ceph-mon[90138]: pgmap v467: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:41.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:41 smithi120 ceph-mon[79001]: pgmap v467: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:43.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:43 smithi084 ceph-mon[90138]: pgmap v468: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:43.431 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:43 smithi120 ceph-mon[79001]: pgmap v468: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:44.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:41:44.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:41:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:45 smithi084 ceph-mon[90138]: pgmap v469: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:45 smithi120 ceph-mon[79001]: pgmap v469: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:47.414 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:47 smithi084 ceph-mon[90138]: pgmap v470: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:47 smithi120 ceph-mon[79001]: pgmap v470: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:49.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:49 smithi084 ceph-mon[90138]: pgmap v471: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:49.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:49 smithi120 ceph-mon[79001]: pgmap v471: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:51.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:51 smithi084 ceph-mon[90138]: pgmap v472: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:51 smithi120 ceph-mon[79001]: pgmap v472: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:53.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:53 smithi084 ceph-mon[90138]: pgmap v473: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:53.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:53 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:41:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:53 smithi120 ceph-mon[79001]: pgmap v473: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:53 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:41:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:55 smithi120 ceph-mon[79001]: pgmap v474: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:55 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:41:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:55 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:41:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:55 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:41:55.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:55 smithi084 ceph-mon[90138]: pgmap v474: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:55.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:55 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:41:55.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:55 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:41:55.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:55 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:41:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:57 smithi120 ceph-mon[79001]: pgmap v475: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:57.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:57 smithi084 ceph-mon[90138]: pgmap v475: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:59 smithi120 ceph-mon[79001]: pgmap v476: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:41:59 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:41:59.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:59 smithi084 ceph-mon[90138]: pgmap v476: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:41:59.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:41:59 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:42:01.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:01 smithi084 ceph-mon[90138]: pgmap v477: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:01.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:01 smithi120 ceph-mon[79001]: pgmap v477: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:03.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:03 smithi084 ceph-mon[90138]: pgmap v478: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:03.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:03 smithi120 ceph-mon[79001]: pgmap v478: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:05.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:05 smithi084 ceph-mon[90138]: pgmap v479: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:05.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:05 smithi120 ceph-mon[79001]: pgmap v479: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:07.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:07 smithi084 ceph-mon[90138]: pgmap v480: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:07.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:07 smithi120 ceph-mon[79001]: pgmap v480: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:09.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:09 smithi084 ceph-mon[90138]: pgmap v481: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:09.681 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:09 smithi120 ceph-mon[79001]: pgmap v481: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:11.465 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:11 smithi084 ceph-mon[90138]: pgmap v482: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:11.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:11 smithi120 ceph-mon[79001]: pgmap v482: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:12.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:12 smithi084 ceph-mon[90138]: pgmap v483: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:12.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:12 smithi120 ceph-mon[79001]: pgmap v483: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:14.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:42:14.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:42:15.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:15 smithi084 ceph-mon[90138]: pgmap v484: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:15.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:15 smithi120 ceph-mon[79001]: pgmap v484: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:17.413 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:17 smithi084 ceph-mon[90138]: pgmap v485: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:17.434 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:17 smithi120 ceph-mon[79001]: pgmap v485: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:19.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:19 smithi084 ceph-mon[90138]: pgmap v486: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:19.431 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:19 smithi120 ceph-mon[79001]: pgmap v486: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:21.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:21 smithi084 ceph-mon[90138]: pgmap v487: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:21.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:21 smithi120 ceph-mon[79001]: pgmap v487: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:23.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:23 smithi084 ceph-mon[90138]: pgmap v488: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:23.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:23 smithi120 ceph-mon[79001]: pgmap v488: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:25.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:25 smithi084 ceph-mon[90138]: pgmap v489: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:25.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:25 smithi120 ceph-mon[79001]: pgmap v489: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:27.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:27 smithi084 ceph-mon[90138]: pgmap v490: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:27.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:27 smithi120 ceph-mon[79001]: pgmap v490: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:29 smithi084 ceph-mon[90138]: pgmap v491: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:29.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:29 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:42:29.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:29 smithi120 ceph-mon[79001]: pgmap v491: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:29.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:29 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:42:31.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:31 smithi084 ceph-mon[90138]: pgmap v492: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:31.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:31 smithi120 ceph-mon[79001]: pgmap v492: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:33.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:33 smithi084 ceph-mon[90138]: pgmap v493: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:33.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:33 smithi120 ceph-mon[79001]: pgmap v493: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:35.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:35 smithi120 ceph-mon[79001]: pgmap v494: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:35.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:35 smithi084 ceph-mon[90138]: pgmap v494: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:37.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:37 smithi120 ceph-mon[79001]: pgmap v495: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:37.661 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:37 smithi084 ceph-mon[90138]: pgmap v495: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:39.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:39 smithi120 ceph-mon[79001]: pgmap v496: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:39.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:39 smithi084 ceph-mon[90138]: pgmap v496: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:41.465 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:41 smithi084 ceph-mon[90138]: pgmap v497: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:41.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:41 smithi120 ceph-mon[79001]: pgmap v497: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:43.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:43 smithi084 ceph-mon[90138]: pgmap v498: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:43.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:43 smithi120 ceph-mon[79001]: pgmap v498: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:44.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:42:44.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:42:45.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:45 smithi084 ceph-mon[90138]: pgmap v499: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:45.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:45 smithi120 ceph-mon[79001]: pgmap v499: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:47.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:47 smithi084 ceph-mon[90138]: pgmap v500: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:47.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:47 smithi120 ceph-mon[79001]: pgmap v500: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:49.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:49 smithi084 ceph-mon[90138]: pgmap v501: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:49.681 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:49 smithi120 ceph-mon[79001]: pgmap v501: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:51.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:51 smithi084 ceph-mon[90138]: pgmap v502: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:51.681 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:51 smithi120 ceph-mon[79001]: pgmap v502: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:52.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:52 smithi084 ceph-mon[90138]: pgmap v503: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:52.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:52 smithi120 ceph-mon[79001]: pgmap v503: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:55.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:55 smithi084 ceph-mon[90138]: pgmap v504: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:55.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:55 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:42:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:55 smithi120 ceph-mon[79001]: pgmap v504: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:55 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:42:56.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:42:56.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:42:56.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:56 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:42:56.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:42:56.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:42:56.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:56 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:42:57.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:57 smithi084 ceph-mon[90138]: pgmap v505: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:57 smithi120 ceph-mon[79001]: pgmap v505: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:59.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:59 smithi084 ceph-mon[90138]: pgmap v506: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:59.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:42:59 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:42:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:59 smithi120 ceph-mon[79001]: pgmap v506: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:42:59.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:42:59 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:43:01.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:01 smithi084 ceph-mon[90138]: pgmap v507: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:01.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:01 smithi120 ceph-mon[79001]: pgmap v507: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:03.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:03 smithi084 ceph-mon[90138]: pgmap v508: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:03.431 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:03 smithi120 ceph-mon[79001]: pgmap v508: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:05.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:05 smithi084 ceph-mon[90138]: pgmap v509: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:05.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:05 smithi120 ceph-mon[79001]: pgmap v509: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:07.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:07 smithi084 ceph-mon[90138]: pgmap v510: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:07.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:07 smithi120 ceph-mon[79001]: pgmap v510: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:09.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:09 smithi084 ceph-mon[90138]: pgmap v511: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:09.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:09 smithi120 ceph-mon[79001]: pgmap v511: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:11.416 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:11 smithi084 ceph-mon[90138]: pgmap v512: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:11.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:11 smithi120 ceph-mon[79001]: pgmap v512: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:13.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:13 smithi084 ceph-mon[90138]: pgmap v513: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:13.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:13 smithi120 ceph-mon[79001]: pgmap v513: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:14.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:14 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:43:14.431 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:14 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:43:15.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:15 smithi120 ceph-mon[79001]: pgmap v514: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:15.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:15 smithi084 ceph-mon[90138]: pgmap v514: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:17.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:17 smithi120 ceph-mon[79001]: pgmap v515: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:17.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:17 smithi084 ceph-mon[90138]: pgmap v515: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:19.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:19 smithi084 ceph-mon[90138]: pgmap v516: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:19.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:19 smithi120 ceph-mon[79001]: pgmap v516: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:21.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:21 smithi084 ceph-mon[90138]: pgmap v517: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:21.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:21 smithi120 ceph-mon[79001]: pgmap v517: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:23.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:23 smithi084 ceph-mon[90138]: pgmap v518: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:23.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:23 smithi120 ceph-mon[79001]: pgmap v518: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:25.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:25 smithi084 ceph-mon[90138]: pgmap v519: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:25.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:25 smithi120 ceph-mon[79001]: pgmap v519: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:27.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:27 smithi084 ceph-mon[90138]: pgmap v520: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:27.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:27 smithi120 ceph-mon[79001]: pgmap v520: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:29.485 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:29 smithi120 ceph-mon[79001]: pgmap v521: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:29.485 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:29 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:43:29.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:29 smithi084 ceph-mon[90138]: pgmap v521: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:29.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:29 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:43:31.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:31 smithi084 ceph-mon[90138]: pgmap v522: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:31.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:31 smithi120 ceph-mon[79001]: pgmap v522: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:33.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:33 smithi084 ceph-mon[90138]: pgmap v523: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:33.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:33 smithi120 ceph-mon[79001]: pgmap v523: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:35.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:35 smithi084 ceph-mon[90138]: pgmap v524: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:35.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:35 smithi120 ceph-mon[79001]: pgmap v524: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:36.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:36 smithi084 ceph-mon[90138]: pgmap v525: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:36.681 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:36 smithi120 ceph-mon[79001]: pgmap v525: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:39.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:39 smithi084 ceph-mon[90138]: pgmap v526: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:39.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:39 smithi120 ceph-mon[79001]: pgmap v526: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:41.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:41 smithi084 ceph-mon[90138]: pgmap v527: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:41.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:41 smithi120 ceph-mon[79001]: pgmap v527: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:43.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:43 smithi084 ceph-mon[90138]: pgmap v528: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:43.431 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:43 smithi120 ceph-mon[79001]: pgmap v528: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:44.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:44 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:43:44.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:44 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:43:45.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:45 smithi084 ceph-mon[90138]: pgmap v529: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:45.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:45 smithi120 ceph-mon[79001]: pgmap v529: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:47.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:47 smithi084 ceph-mon[90138]: pgmap v530: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:47.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:47 smithi120 ceph-mon[79001]: pgmap v530: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:49.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:49 smithi084 ceph-mon[90138]: pgmap v531: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:49.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:49 smithi120 ceph-mon[79001]: pgmap v531: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:51.412 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:51 smithi084 ceph-mon[90138]: pgmap v532: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:51.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:51 smithi120 ceph-mon[79001]: pgmap v532: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:53.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:53 smithi120 ceph-mon[79001]: pgmap v533: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:53.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:53 smithi084 ceph-mon[90138]: pgmap v533: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:55.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:55 smithi120 ceph-mon[79001]: pgmap v534: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:55.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:55 smithi084 ceph-mon[90138]: pgmap v534: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:57 smithi120 ceph-mon[79001]: pgmap v535: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:57.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:57 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:43:57.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:57 smithi084 ceph-mon[90138]: pgmap v535: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:57.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:57 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:43:58.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:58 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:43:58.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:58 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:43:58.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:58 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:43:58.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:58 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:43:58.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:58 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:43:58.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:58 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' 2024-04-26T21:43:59.583 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:59 smithi120 ceph-mon[79001]: pgmap v536: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:59.584 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:43:59 smithi120 ceph-mon[79001]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:43:59.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:59 smithi084 ceph-mon[90138]: pgmap v536: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:43:59.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:43:59 smithi084 ceph-mon[90138]: from='mgr.24535 172.21.15.84:0/439184637' entity='mgr.smithi084.gyasul' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:44:01.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:44:01 smithi084 ceph-mon[90138]: pgmap v537: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:44:01.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:44:01 smithi120 ceph-mon[79001]: pgmap v537: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:44:03.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:44:03 smithi084 ceph-mon[90138]: pgmap v538: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:44:03.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:44:03 smithi120 ceph-mon[79001]: pgmap v538: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:44:05.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:44:05 smithi084 ceph-mon[90138]: pgmap v539: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:44:05.681 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:44:05 smithi120 ceph-mon[79001]: pgmap v539: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:44:07.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:44:07 smithi084 ceph-mon[90138]: pgmap v540: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:44:07.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:44:07 smithi120 ceph-mon[79001]: pgmap v540: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:44:09.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:44:09 smithi084 ceph-mon[90138]: pgmap v541: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:44:09.682 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:44:09 smithi120 ceph-mon[79001]: pgmap v541: 65 pgs: 65 active+clean; 162 MiB data, 695 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:44:10.022 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-04-26T21:44:10.022 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-26T21:44:10.024 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-26T21:44:10.036 INFO:tasks.cephadm:Teardown begin 2024-04-26T21:44:10.036 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephadm.py", line 2246, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-26T21:44:10.037 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T21:44:10.122 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T21:44:10.215 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-26T21:44:10.215 DEBUG:teuthology.orchestra.run.smithi084:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-26T21:44:10.274 DEBUG:teuthology.orchestra.run.smithi120:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-26T21:44:10.330 INFO:tasks.cephadm:Stopping all daemons... 2024-04-26T21:44:10.330 INFO:tasks.cephadm.mon.smithi084:Stopping mon.smithi084... 2024-04-26T21:44:10.331 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-8bb44d26-0411-11ef-bc93-c7b262605968@mon.smithi084 2024-04-26T21:44:10.662 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:44:10 smithi084 systemd[1]: Stopping Ceph mon.smithi084 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:44:11.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:44:10 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084[90134]: 2024-04-26T21:44:10.890+0000 7fb177e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi084 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:44:11.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:44:10 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084[90134]: 2024-04-26T21:44:10.890+0000 7fb177e00700 -1 mon.smithi084@0(leader) e3 *** Got Signal Terminated *** 2024-04-26T21:44:11.162 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:44:10 smithi084 podman[146954]: 2024-04-26 21:44:10.973218006 +0000 UTC m=+0.224763053 container died bf610abb6a622564b2de9b6ac8edc4d15b61c65d191f7bc827e39153ca558686 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-04-26T21:44:11.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:44:11 smithi084 podman[146954]: 2024-04-26 21:44:11.516597264 +0000 UTC m=+0.768142338 container cleanup bf610abb6a622564b2de9b6ac8edc4d15b61c65d191f7bc827e39153ca558686 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-04-26T21:44:11.912 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:44:11 smithi084 bash[146954]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084 2024-04-26T21:44:11.913 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Apr 26 21:44:11 smithi084 podman[146979]: 2024-04-26 21:44:11.7598674 +0000 UTC m=+0.778132628 container remove bf610abb6a622564b2de9b6ac8edc4d15b61c65d191f7bc827e39153ca558686 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi084, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-26T21:44:12.287 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bb44d26-0411-11ef-bc93-c7b262605968@mon.smithi084.service' 2024-04-26T21:44:12.419 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T21:44:12.419 INFO:tasks.cephadm.mon.smithi084:Stopped mon.smithi084 2024-04-26T21:44:12.419 INFO:tasks.cephadm.mon.smithi120:Stopping mon.smithi120... 2024-04-26T21:44:12.419 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-8bb44d26-0411-11ef-bc93-c7b262605968@mon.smithi120 2024-04-26T21:44:12.932 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:44:12 smithi120 systemd[1]: Stopping Ceph mon.smithi120 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:44:13.285 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:44:13 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi120[78997]: 2024-04-26T21:44:13.026+0000 7fbfa4800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi120 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:44:13.285 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:44:13 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi120[78997]: 2024-04-26T21:44:13.026+0000 7fbfa4800700 -1 mon.smithi120@1(peon) e3 *** Got Signal Terminated *** 2024-04-26T21:44:13.600 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:44:13 smithi120 podman[116129]: 2024-04-26 21:44:13.284467982 +0000 UTC m=+0.419141934 container died 5d530496253b9463e83a1106d7a23f1165df69eed82cdae1b78f6a0762fe785e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi120, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-26T21:44:14.139 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:44:13 smithi120 podman[116129]: 2024-04-26 21:44:13.853072187 +0000 UTC m=+0.987746137 container cleanup 5d530496253b9463e83a1106d7a23f1165df69eed82cdae1b78f6a0762fe785e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi120, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:44:14.139 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:44:13 smithi120 bash[116129]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi120 2024-04-26T21:44:14.432 INFO:journalctl@ceph.mon.smithi120.smithi120.stdout:Apr 26 21:44:14 smithi120 podman[116143]: 2024-04-26 21:44:14.138131149 +0000 UTC m=+0.839697038 container remove 5d530496253b9463e83a1106d7a23f1165df69eed82cdae1b78f6a0762fe785e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-mon-smithi120, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-26T21:44:14.677 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bb44d26-0411-11ef-bc93-c7b262605968@mon.smithi120.service' 2024-04-26T21:44:14.811 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T21:44:14.811 INFO:tasks.cephadm.mon.smithi120:Stopped mon.smithi120 2024-04-26T21:44:14.812 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-26T21:44:14.812 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.0 2024-04-26T21:44:15.037 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:44:14 smithi084 systemd[1]: Stopping Ceph osd.0 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:44:15.662 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:44:15 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0[99155]: 2024-04-26T21:44:15.353+0000 7f7413c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:44:15.662 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:44:15 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0[99155]: 2024-04-26T21:44:15.353+0000 7f7413c00700 -1 osd.0 94 *** Got signal Terminated *** 2024-04-26T21:44:15.663 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:44:15 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0[99155]: 2024-04-26T21:44:15.353+0000 7f7413c00700 -1 osd.0 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:44:21.207 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:44:20 smithi084 podman[147098]: 2024-04-26 21:44:20.952489193 +0000 UTC m=+5.764425687 container died 99fbe2faa51b0d77990434297e753e370a6781050ad4914db36c06c8a4df788d (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-26T21:44:21.538 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:44:21 smithi084 podman[147098]: 2024-04-26 21:44:21.303171632 +0000 UTC m=+6.115108165 container cleanup 99fbe2faa51b0d77990434297e753e370a6781050ad4914db36c06c8a4df788d (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-26T21:44:21.539 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:44:21 smithi084 bash[147098]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0 2024-04-26T21:44:21.912 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:44:21 smithi084 podman[147118]: 2024-04-26 21:44:21.538044355 +0000 UTC m=+0.571835109 container remove 99fbe2faa51b0d77990434297e753e370a6781050ad4914db36c06c8a4df788d (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424) 2024-04-26T21:44:22.660 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:44:22 smithi084 podman[147205]: 2024-04-26 21:44:22.286517822 +0000 UTC m=+0.035300326 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:44:22.660 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:44:22 smithi084 podman[147205]: 2024-04-26 21:44:22.39724739 +0000 UTC m=+0.146029941 container create e365c5ea3e5bacd711b86ac4fd1d49ef50279fbf1954633c33878755e51a8382 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-26T21:44:22.660 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:44:22 smithi084 podman[147205]: 2024-04-26 21:44:22.659715268 +0000 UTC m=+0.408497842 container init e365c5ea3e5bacd711b86ac4fd1d49ef50279fbf1954633c33878755e51a8382 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-26T21:44:22.912 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:44:22 smithi084 podman[147205]: 2024-04-26 21:44:22.671356686 +0000 UTC m=+0.420139224 container start e365c5ea3e5bacd711b86ac4fd1d49ef50279fbf1954633c33878755e51a8382 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T21:44:22.912 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:44:22 smithi084 podman[147205]: 2024-04-26 21:44:22.801958008 +0000 UTC m=+0.550740544 container attach e365c5ea3e5bacd711b86ac4fd1d49ef50279fbf1954633c33878755e51a8382 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T21:44:23.412 INFO:journalctl@ceph.osd.0.smithi084.stdout:Apr 26 21:44:23 smithi084 podman[147205]: 2024-04-26 21:44:23.131103639 +0000 UTC m=+0.879886177 container died e365c5ea3e5bacd711b86ac4fd1d49ef50279fbf1954633c33878755e51a8382 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0) 2024-04-26T21:44:23.909 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.0.service' 2024-04-26T21:44:24.019 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T21:44:24.019 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-26T21:44:24.019 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-26T21:44:24.019 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.1 2024-04-26T21:44:24.411 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:44:24 smithi084 systemd[1]: Stopping Ceph osd.1 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:44:24.912 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:44:24 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1[104637]: 2024-04-26T21:44:24.611+0000 7f11ac800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:44:24.912 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:44:24 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1[104637]: 2024-04-26T21:44:24.611+0000 7f11ac800700 -1 osd.1 94 *** Got signal Terminated *** 2024-04-26T21:44:24.912 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:44:24 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1[104637]: 2024-04-26T21:44:24.611+0000 7f11ac800700 -1 osd.1 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:44:30.528 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:44:30 smithi084 podman[147310]: 2024-04-26 21:44:30.224947636 +0000 UTC m=+5.766380839 container died 2dc81d93f7e5f30ad5faf93fcd6ef8fe616b4ee8de5ab7c27655ff42ae7a665f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True) 2024-04-26T21:44:30.912 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:44:30 smithi084 podman[147310]: 2024-04-26 21:44:30.655438196 +0000 UTC m=+6.196871425 container cleanup 2dc81d93f7e5f30ad5faf93fcd6ef8fe616b4ee8de5ab7c27655ff42ae7a665f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424) 2024-04-26T21:44:30.912 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:44:30 smithi084 bash[147310]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1 2024-04-26T21:44:31.411 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:44:30 smithi084 podman[147329]: 2024-04-26 21:44:30.91495004 +0000 UTC m=+0.674466942 container remove 2dc81d93f7e5f30ad5faf93fcd6ef8fe616b4ee8de5ab7c27655ff42ae7a665f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-26T21:44:32.019 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:44:31 smithi084 podman[147419]: 2024-04-26 21:44:31.63652158 +0000 UTC m=+0.037666597 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:44:32.019 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:44:31 smithi084 podman[147419]: 2024-04-26 21:44:31.749172119 +0000 UTC m=+0.150317176 container create f60afacd52a16f77d00a34e1a0aa322783c01f51ef4ccd58d7b07e1cf06914f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-26T21:44:32.020 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:44:32 smithi084 podman[147419]: 2024-04-26 21:44:32.019131708 +0000 UTC m=+0.420276772 container init f60afacd52a16f77d00a34e1a0aa322783c01f51ef4ccd58d7b07e1cf06914f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-26T21:44:32.412 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:44:32 smithi084 podman[147419]: 2024-04-26 21:44:32.031940155 +0000 UTC m=+0.433085232 container start f60afacd52a16f77d00a34e1a0aa322783c01f51ef4ccd58d7b07e1cf06914f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0) 2024-04-26T21:44:32.412 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:44:32 smithi084 podman[147419]: 2024-04-26 21:44:32.143459526 +0000 UTC m=+0.544604562 container attach f60afacd52a16f77d00a34e1a0aa322783c01f51ef4ccd58d7b07e1cf06914f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-26T21:44:32.803 INFO:journalctl@ceph.osd.1.smithi084.stdout:Apr 26 21:44:32 smithi084 podman[147419]: 2024-04-26 21:44:32.47748647 +0000 UTC m=+0.878631530 container died f60afacd52a16f77d00a34e1a0aa322783c01f51ef4ccd58d7b07e1cf06914f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=) 2024-04-26T21:44:33.144 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.1.service' 2024-04-26T21:44:33.252 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T21:44:33.253 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-26T21:44:33.253 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-26T21:44:33.253 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.2 2024-04-26T21:44:33.661 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:44:33 smithi084 systemd[1]: Stopping Ceph osd.2 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:44:34.162 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:44:33 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2[110120]: 2024-04-26T21:44:33.805+0000 7fc295e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:44:34.162 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:44:33 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2[110120]: 2024-04-26T21:44:33.805+0000 7fc295e00700 -1 osd.2 94 *** Got signal Terminated *** 2024-04-26T21:44:34.162 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:44:33 smithi084 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2[110120]: 2024-04-26T21:44:33.805+0000 7fc295e00700 -1 osd.2 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:44:39.662 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:44:39 smithi084 podman[147523]: 2024-04-26 21:44:39.385121814 +0000 UTC m=+5.707327398 container died 9e77abf095bd1b9857a8df81e8c347e331eea61b18d6b96aa3c190fe865bf1b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:44:40.090 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:44:39 smithi084 podman[147523]: 2024-04-26 21:44:39.781833473 +0000 UTC m=+6.104039078 container cleanup 9e77abf095bd1b9857a8df81e8c347e331eea61b18d6b96aa3c190fe865bf1b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-26T21:44:40.090 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:44:39 smithi084 bash[147523]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2 2024-04-26T21:44:40.411 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:44:40 smithi084 podman[147542]: 2024-04-26 21:44:40.089342475 +0000 UTC m=+0.693600005 container remove 9e77abf095bd1b9857a8df81e8c347e331eea61b18d6b96aa3c190fe865bf1b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-26T21:44:40.980 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:44:40 smithi084 podman[147634]: 2024-04-26 21:44:40.605055287 +0000 UTC m=+0.034585556 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:44:40.981 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:44:40 smithi084 podman[147634]: 2024-04-26 21:44:40.717478282 +0000 UTC m=+0.147008576 container create 741b9c276663bd6a3abd92c00e7a5f882553037821b9b0a32ec001dd0e95b016 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240424) 2024-04-26T21:44:40.981 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:44:40 smithi084 podman[147634]: 2024-04-26 21:44:40.979539873 +0000 UTC m=+0.409070174 container init 741b9c276663bd6a3abd92c00e7a5f882553037821b9b0a32ec001dd0e95b016 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-26T21:44:41.412 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:44:40 smithi084 podman[147634]: 2024-04-26 21:44:40.99066752 +0000 UTC m=+0.420197830 container start 741b9c276663bd6a3abd92c00e7a5f882553037821b9b0a32ec001dd0e95b016 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-26T21:44:41.412 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:44:41 smithi084 podman[147634]: 2024-04-26 21:44:41.11135841 +0000 UTC m=+0.540888754 container attach 741b9c276663bd6a3abd92c00e7a5f882553037821b9b0a32ec001dd0e95b016 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS) 2024-04-26T21:44:41.809 INFO:journalctl@ceph.osd.2.smithi084.stdout:Apr 26 21:44:41 smithi084 podman[147634]: 2024-04-26 21:44:41.449294408 +0000 UTC m=+0.878824692 container died 741b9c276663bd6a3abd92c00e7a5f882553037821b9b0a32ec001dd0e95b016 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:44:42.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:41 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:41.902+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:44:42.254 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.2.service' 2024-04-26T21:44:42.353 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T21:44:42.353 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-26T21:44:42.354 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-26T21:44:42.354 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.3 2024-04-26T21:44:42.891 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:44:42 smithi120 systemd[1]: Stopping Ceph osd.3 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:44:43.182 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:44:42 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3[88326]: 2024-04-26T21:44:42.921+0000 7f1e93000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:44:43.182 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:44:42 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3[88326]: 2024-04-26T21:44:42.921+0000 7f1e93000700 -1 osd.3 94 *** Got signal Terminated *** 2024-04-26T21:44:43.182 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:44:42 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3[88326]: 2024-04-26T21:44:42.921+0000 7f1e93000700 -1 osd.3 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:44:43.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:42 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:42.890+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:44:43.682 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:43 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:43.316+0000 7f282c600700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:17.838228+0000 front 2024-04-26T21:44:17.838266+0000 (oldest deadline 2024-04-26T21:44:42.537588+0000) 2024-04-26T21:44:44.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:43 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:43.887+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:44:44.681 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:44 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:44.319+0000 7f282c600700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:17.838228+0000 front 2024-04-26T21:44:17.838266+0000 (oldest deadline 2024-04-26T21:44:42.537588+0000) 2024-04-26T21:44:44.932 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:44:44 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3[88326]: 2024-04-26T21:44:44.680+0000 7f1e8e800700 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:18.475446+0000 front 2024-04-26T21:44:18.475145+0000 (oldest deadline 2024-04-26T21:44:44.374865+0000) 2024-04-26T21:44:44.932 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:44 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:44.876+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:44:45.677 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:45 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:45.308+0000 7f282c600700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:17.838228+0000 front 2024-04-26T21:44:17.838266+0000 (oldest deadline 2024-04-26T21:44:42.537588+0000) 2024-04-26T21:44:45.932 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:44:45 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3[88326]: 2024-04-26T21:44:45.675+0000 7f1e8e800700 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:18.475446+0000 front 2024-04-26T21:44:18.475145+0000 (oldest deadline 2024-04-26T21:44:44.374865+0000) 2024-04-26T21:44:45.932 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:45 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:45.842+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:44:46.682 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:46 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:46.261+0000 7f282c600700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:17.838228+0000 front 2024-04-26T21:44:17.838266+0000 (oldest deadline 2024-04-26T21:44:42.537588+0000) 2024-04-26T21:44:47.182 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:44:46 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3[88326]: 2024-04-26T21:44:46.694+0000 7f1e8e800700 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:18.475446+0000 front 2024-04-26T21:44:18.475145+0000 (oldest deadline 2024-04-26T21:44:44.374865+0000) 2024-04-26T21:44:47.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:46 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:46.804+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:44:47.682 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:47 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:47.273+0000 7f282c600700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:17.838228+0000 front 2024-04-26T21:44:17.838266+0000 (oldest deadline 2024-04-26T21:44:42.537588+0000) 2024-04-26T21:44:48.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:47 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:47.828+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:44:48.182 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:44:47 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3[88326]: 2024-04-26T21:44:47.707+0000 7f1e8e800700 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:18.475446+0000 front 2024-04-26T21:44:18.475145+0000 (oldest deadline 2024-04-26T21:44:44.374865+0000) 2024-04-26T21:44:48.682 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:48 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:48.267+0000 7f282c600700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:17.838228+0000 front 2024-04-26T21:44:17.838266+0000 (oldest deadline 2024-04-26T21:44:42.537588+0000) 2024-04-26T21:44:48.682 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:44:48 smithi120 podman[116264]: 2024-04-26 21:44:48.415545988 +0000 UTC m=+5.623891817 container died d7e5825e264024dd3fbabd3b27f7c48aeb75a92a236836df4fe7e8a2c31fa002 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-26T21:44:49.175 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:48 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:48.826+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:44:49.175 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:44:48 smithi120 podman[116264]: 2024-04-26 21:44:48.946225039 +0000 UTC m=+6.154570910 container cleanup d7e5825e264024dd3fbabd3b27f7c48aeb75a92a236836df4fe7e8a2c31fa002 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424) 2024-04-26T21:44:49.175 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:44:48 smithi120 bash[116264]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3 2024-04-26T21:44:49.432 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:49 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:49.287+0000 7f282c600700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:17.838228+0000 front 2024-04-26T21:44:17.838266+0000 (oldest deadline 2024-04-26T21:44:42.537588+0000) 2024-04-26T21:44:49.432 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:44:49 smithi120 podman[116282]: 2024-04-26 21:44:49.174769326 +0000 UTC m=+0.743761100 container remove d7e5825e264024dd3fbabd3b27f7c48aeb75a92a236836df4fe7e8a2c31fa002 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:44:50.161 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:49 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:49.831+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:44:50.162 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:44:49 smithi120 podman[116371]: 2024-04-26 21:44:49.900278587 +0000 UTC m=+0.033516869 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:44:50.162 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:44:50 smithi120 podman[116371]: 2024-04-26 21:44:50.000946972 +0000 UTC m=+0.134185279 container create 977f69db0666d086b051c2e524d89e25f2a15ca4559a96d2b328b08bd69891ce (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True) 2024-04-26T21:44:50.432 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:44:50 smithi120 podman[116371]: 2024-04-26 21:44:50.281603561 +0000 UTC m=+0.414841941 container init 977f69db0666d086b051c2e524d89e25f2a15ca4559a96d2b328b08bd69891ce (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-26T21:44:50.432 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:44:50 smithi120 podman[116371]: 2024-04-26 21:44:50.295433909 +0000 UTC m=+0.428672203 container start 977f69db0666d086b051c2e524d89e25f2a15ca4559a96d2b328b08bd69891ce (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-26T21:44:50.433 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:44:50 smithi120 podman[116371]: 2024-04-26 21:44:50.39558505 +0000 UTC m=+0.528823423 container attach 977f69db0666d086b051c2e524d89e25f2a15ca4559a96d2b328b08bd69891ce (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-26T21:44:50.433 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:50 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:50.295+0000 7f282c600700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:17.838228+0000 front 2024-04-26T21:44:17.838266+0000 (oldest deadline 2024-04-26T21:44:42.537588+0000) 2024-04-26T21:44:51.178 INFO:journalctl@ceph.osd.3.smithi120.stdout:Apr 26 21:44:50 smithi120 podman[116371]: 2024-04-26 21:44:50.7707183 +0000 UTC m=+0.903956610 container died 977f69db0666d086b051c2e524d89e25f2a15ca4559a96d2b328b08bd69891ce (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:44:51.178 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:50 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:50.831+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:44:51.432 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:51 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:51.325+0000 7f282c600700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:17.838228+0000 front 2024-04-26T21:44:17.838266+0000 (oldest deadline 2024-04-26T21:44:42.537588+0000) 2024-04-26T21:44:51.432 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:51 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:51.325+0000 7f282c600700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-04-26T21:44:28.339782+0000 front 2024-04-26T21:44:28.339942+0000 (oldest deadline 2024-04-26T21:44:51.239537+0000) 2024-04-26T21:44:51.591 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.3.service' 2024-04-26T21:44:51.682 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T21:44:51.682 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-26T21:44:51.683 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-26T21:44:51.683 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.4 2024-04-26T21:44:51.874 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:51 smithi120 systemd[1]: Stopping Ceph osd.4 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:44:52.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:51 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:51.872+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:44:52.682 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:52 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:52.202+0000 7f2830e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:44:52.682 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:52 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:52.202+0000 7f2830e00700 -1 osd.4 94 *** Got signal Terminated *** 2024-04-26T21:44:52.682 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:52 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:52.202+0000 7f2830e00700 -1 osd.4 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:44:52.682 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:52 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:52.352+0000 7f282c600700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:17.838228+0000 front 2024-04-26T21:44:17.838266+0000 (oldest deadline 2024-04-26T21:44:42.537588+0000) 2024-04-26T21:44:52.683 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:52 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:52.352+0000 7f282c600700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-04-26T21:44:28.339782+0000 front 2024-04-26T21:44:28.339942+0000 (oldest deadline 2024-04-26T21:44:51.239537+0000) 2024-04-26T21:44:53.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:52 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:52.844+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:44:53.682 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:53 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:53.308+0000 7f282c600700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:17.838228+0000 front 2024-04-26T21:44:17.838266+0000 (oldest deadline 2024-04-26T21:44:42.537588+0000) 2024-04-26T21:44:53.682 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:53 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:53.308+0000 7f282c600700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-04-26T21:44:28.339782+0000 front 2024-04-26T21:44:28.339942+0000 (oldest deadline 2024-04-26T21:44:51.239537+0000) 2024-04-26T21:44:54.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:53 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:53.856+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:44:54.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:53 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:53.856+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-04-26T21:44:28.262565+0000 front 2024-04-26T21:44:28.262334+0000 (oldest deadline 2024-04-26T21:44:52.962084+0000) 2024-04-26T21:44:54.682 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:54 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:54.283+0000 7f282c600700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:17.838228+0000 front 2024-04-26T21:44:17.838266+0000 (oldest deadline 2024-04-26T21:44:42.537588+0000) 2024-04-26T21:44:54.682 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:54 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:54.283+0000 7f282c600700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-04-26T21:44:28.339782+0000 front 2024-04-26T21:44:28.339942+0000 (oldest deadline 2024-04-26T21:44:51.239537+0000) 2024-04-26T21:44:55.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:54 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:54.827+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:44:55.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:54 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:54.827+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-04-26T21:44:28.262565+0000 front 2024-04-26T21:44:28.262334+0000 (oldest deadline 2024-04-26T21:44:52.962084+0000) 2024-04-26T21:44:55.682 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:55 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:55.316+0000 7f282c600700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:17.838228+0000 front 2024-04-26T21:44:17.838266+0000 (oldest deadline 2024-04-26T21:44:42.537588+0000) 2024-04-26T21:44:55.682 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:55 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:55.316+0000 7f282c600700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-04-26T21:44:28.339782+0000 front 2024-04-26T21:44:28.339942+0000 (oldest deadline 2024-04-26T21:44:51.239537+0000) 2024-04-26T21:44:56.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:55 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:55.814+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:44:56.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:55 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:55.814+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-04-26T21:44:28.262565+0000 front 2024-04-26T21:44:28.262334+0000 (oldest deadline 2024-04-26T21:44:52.962084+0000) 2024-04-26T21:44:56.682 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:56 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:56.269+0000 7f282c600700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:17.838228+0000 front 2024-04-26T21:44:17.838266+0000 (oldest deadline 2024-04-26T21:44:42.537588+0000) 2024-04-26T21:44:56.682 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:56 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4[93615]: 2024-04-26T21:44:56.269+0000 7f282c600700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-04-26T21:44:28.339782+0000 front 2024-04-26T21:44:28.339942+0000 (oldest deadline 2024-04-26T21:44:51.239537+0000) 2024-04-26T21:44:57.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:56 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:56.808+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:44:57.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:56 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:56.808+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-04-26T21:44:28.262565+0000 front 2024-04-26T21:44:28.262334+0000 (oldest deadline 2024-04-26T21:44:52.962084+0000) 2024-04-26T21:44:57.926 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:57 smithi120 podman[116488]: 2024-04-26 21:44:57.601246146 +0000 UTC m=+5.536018377 container died 894dcbaab8eb53d9c7d362d2f962ce6528009f6f83297fc52d570e8da32a191a (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-26T21:44:57.927 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:57 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:57.773+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:44:57.927 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:57 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:57.773+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-04-26T21:44:28.262565+0000 front 2024-04-26T21:44:28.262334+0000 (oldest deadline 2024-04-26T21:44:52.962084+0000) 2024-04-26T21:44:58.181 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:58 smithi120 podman[116488]: 2024-04-26 21:44:58.094828613 +0000 UTC m=+6.029600881 container cleanup 894dcbaab8eb53d9c7d362d2f962ce6528009f6f83297fc52d570e8da32a191a (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-26T21:44:58.182 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:58 smithi120 bash[116488]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4 2024-04-26T21:44:58.791 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:58 smithi120 podman[116507]: 2024-04-26 21:44:58.446690382 +0000 UTC m=+0.836275922 container remove 894dcbaab8eb53d9c7d362d2f962ce6528009f6f83297fc52d570e8da32a191a (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5) 2024-04-26T21:44:59.113 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:58 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:58.791+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:44:59.114 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:58 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:58.791+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-04-26T21:44:28.262565+0000 front 2024-04-26T21:44:28.262334+0000 (oldest deadline 2024-04-26T21:44:52.962084+0000) 2024-04-26T21:44:59.432 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:59 smithi120 podman[116598]: 2024-04-26 21:44:59.113577529 +0000 UTC m=+0.127906226 container create f2b6810c04bad48e2ebb15e4a62ed7501f42a41ce1980230e3400bc99d73b798 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=) 2024-04-26T21:44:59.432 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:59 smithi120 podman[116598]: 2024-04-26 21:44:59.021943793 +0000 UTC m=+0.036272486 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:44:59.776 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:59 smithi120 podman[116598]: 2024-04-26 21:44:59.454281162 +0000 UTC m=+0.468609896 container init f2b6810c04bad48e2ebb15e4a62ed7501f42a41ce1980230e3400bc99d73b798 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:44:59.776 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:59 smithi120 podman[116598]: 2024-04-26 21:44:59.465973361 +0000 UTC m=+0.480302058 container start f2b6810c04bad48e2ebb15e4a62ed7501f42a41ce1980230e3400bc99d73b798 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-26T21:44:59.776 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:59 smithi120 podman[116598]: 2024-04-26 21:44:59.588421308 +0000 UTC m=+0.602750082 container attach f2b6810c04bad48e2ebb15e4a62ed7501f42a41ce1980230e3400bc99d73b798 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-26T21:45:00.182 INFO:journalctl@ceph.osd.4.smithi120.stdout:Apr 26 21:44:59 smithi120 podman[116598]: 2024-04-26 21:44:59.9160226 +0000 UTC m=+0.930351290 container died f2b6810c04bad48e2ebb15e4a62ed7501f42a41ce1980230e3400bc99d73b798 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-26T21:45:00.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:59 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:59.775+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:45:00.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:44:59 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:44:59.775+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-04-26T21:44:28.262565+0000 front 2024-04-26T21:44:28.262334+0000 (oldest deadline 2024-04-26T21:44:52.962084+0000) 2024-04-26T21:45:00.744 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.4.service' 2024-04-26T21:45:00.859 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T21:45:00.859 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-26T21:45:00.859 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-26T21:45:00.859 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.5 2024-04-26T21:45:00.966 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:00 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:00.825+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:45:00.966 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:00 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:00.825+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-04-26T21:44:28.262565+0000 front 2024-04-26T21:44:28.262334+0000 (oldest deadline 2024-04-26T21:44:52.962084+0000) 2024-04-26T21:45:00.966 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:00 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:00.825+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-04-26T21:44:35.263556+0000 front 2024-04-26T21:44:35.263586+0000 (oldest deadline 2024-04-26T21:44:59.863715+0000) 2024-04-26T21:45:01.432 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:00 smithi120 systemd[1]: Stopping Ceph osd.5 for 8bb44d26-0411-11ef-bc93-c7b262605968... 2024-04-26T21:45:01.807 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:01 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:01.439+0000 7fd473200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:45:01.807 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:01 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:01.439+0000 7fd473200700 -1 osd.5 94 *** Got signal Terminated *** 2024-04-26T21:45:01.807 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:01 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:01.439+0000 7fd473200700 -1 osd.5 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:45:01.807 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:01 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:01.806+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:45:02.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:01 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:01.806+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-04-26T21:44:28.262565+0000 front 2024-04-26T21:44:28.262334+0000 (oldest deadline 2024-04-26T21:44:52.962084+0000) 2024-04-26T21:45:02.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:01 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:01.806+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-04-26T21:44:35.263556+0000 front 2024-04-26T21:44:35.263586+0000 (oldest deadline 2024-04-26T21:44:59.863715+0000) 2024-04-26T21:45:03.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:02 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:02.808+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:45:03.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:02 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:02.808+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-04-26T21:44:28.262565+0000 front 2024-04-26T21:44:28.262334+0000 (oldest deadline 2024-04-26T21:44:52.962084+0000) 2024-04-26T21:45:03.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:02 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:02.808+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-04-26T21:44:35.263556+0000 front 2024-04-26T21:44:35.263586+0000 (oldest deadline 2024-04-26T21:44:59.863715+0000) 2024-04-26T21:45:04.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:03 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:03.782+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:45:04.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:03 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:03.783+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-04-26T21:44:28.262565+0000 front 2024-04-26T21:44:28.262334+0000 (oldest deadline 2024-04-26T21:44:52.962084+0000) 2024-04-26T21:45:04.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:03 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:03.783+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-04-26T21:44:35.263556+0000 front 2024-04-26T21:44:35.263586+0000 (oldest deadline 2024-04-26T21:44:59.863715+0000) 2024-04-26T21:45:05.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:04 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:04.748+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:45:05.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:04 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:04.748+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-04-26T21:44:28.262565+0000 front 2024-04-26T21:44:28.262334+0000 (oldest deadline 2024-04-26T21:44:52.962084+0000) 2024-04-26T21:45:05.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:04 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:04.748+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-04-26T21:44:35.263556+0000 front 2024-04-26T21:44:35.263586+0000 (oldest deadline 2024-04-26T21:44:59.863715+0000) 2024-04-26T21:45:06.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:05 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:05.755+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-04-26T21:44:19.560644+0000 front 2024-04-26T21:44:19.560998+0000 (oldest deadline 2024-04-26T21:44:41.860108+0000) 2024-04-26T21:45:06.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:05 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:05.755+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-04-26T21:44:28.262565+0000 front 2024-04-26T21:44:28.262334+0000 (oldest deadline 2024-04-26T21:44:52.962084+0000) 2024-04-26T21:45:06.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:05 smithi120 ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5[98608]: 2024-04-26T21:45:05.755+0000 7fd46ea00700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-04-26T21:44:35.263556+0000 front 2024-04-26T21:44:35.263586+0000 (oldest deadline 2024-04-26T21:44:59.863715+0000) 2024-04-26T21:45:07.145 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:06 smithi120 podman[116703]: 2024-04-26 21:45:06.826739631 +0000 UTC m=+5.536764875 container died e39948e51a137afcde075a5bc5920c1628820686dc8014bfff43a8ee28483d78 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:45:07.432 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:07 smithi120 podman[116703]: 2024-04-26 21:45:07.264874017 +0000 UTC m=+5.974899277 container cleanup e39948e51a137afcde075a5bc5920c1628820686dc8014bfff43a8ee28483d78 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-26T21:45:07.432 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:07 smithi120 bash[116703]: ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5 2024-04-26T21:45:07.931 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:07 smithi120 podman[116723]: 2024-04-26 21:45:07.633029042 +0000 UTC m=+0.794161157 container remove e39948e51a137afcde075a5bc5920c1628820686dc8014bfff43a8ee28483d78 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-26T21:45:08.846 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:08 smithi120 podman[116814]: 2024-04-26 21:45:08.43529592 +0000 UTC m=+0.034978996 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:45:08.846 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:08 smithi120 podman[116814]: 2024-04-26 21:45:08.550710333 +0000 UTC m=+0.150393422 container create cadd302f533e48eb25e557430538cbe40524fb0239eec876a169b0995475e2d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-26T21:45:08.846 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:08 smithi120 podman[116814]: 2024-04-26 21:45:08.845776724 +0000 UTC m=+0.445459819 container init cadd302f533e48eb25e557430538cbe40524fb0239eec876a169b0995475e2d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:45:09.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:08 smithi120 podman[116814]: 2024-04-26 21:45:08.858321052 +0000 UTC m=+0.458004175 container start cadd302f533e48eb25e557430538cbe40524fb0239eec876a169b0995475e2d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux ) 2024-04-26T21:45:09.182 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:08 smithi120 podman[116814]: 2024-04-26 21:45:08.945058625 +0000 UTC m=+0.544741754 container attach cadd302f533e48eb25e557430538cbe40524fb0239eec876a169b0995475e2d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-deactivate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_CLEAN=True, ceph=True) 2024-04-26T21:45:09.682 INFO:journalctl@ceph.osd.5.smithi120.stdout:Apr 26 21:45:09 smithi120 podman[116814]: 2024-04-26 21:45:09.311419988 +0000 UTC m=+0.911103121 container died cadd302f533e48eb25e557430538cbe40524fb0239eec876a169b0995475e2d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-8bb44d26-0411-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-26T21:45:10.126 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bb44d26-0411-11ef-bc93-c7b262605968@osd.5.service' 2024-04-26T21:45:10.240 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T21:45:10.241 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-26T21:45:10.241 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-26T21:45:15.772 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[72906]: fuse finished with error 0 and tester_r 0 2024-04-26T21:45:40.841 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-26T21:45:59.420 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T21:45:59.508 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T21:45:59.601 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-26T21:45:59.604 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675200/remote/smithi084/crash 2024-04-26T21:45:59.605 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/crash -- . 2024-04-26T21:45:59.691 INFO:teuthology.orchestra.run.smithi084.stderr:tar: /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-26T21:45:59.691 INFO:teuthology.orchestra.run.smithi084.stderr:tar: Error is not recoverable: exiting now 2024-04-26T21:45:59.695 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675200/remote/smithi120/crash 2024-04-26T21:45:59.696 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/crash -- . 2024-04-26T21:45:59.783 INFO:teuthology.orchestra.run.smithi120.stderr:tar: /var/lib/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-26T21:45:59.783 INFO:teuthology.orchestra.run.smithi120.stderr:tar: Error is not recoverable: exiting now 2024-04-26T21:45:59.787 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-26T21:45:59.787 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-26T21:45:59.887 INFO:teuthology.orchestra.run.smithi084.stdout:2024-04-26T21:30:00.000180+0000 mon.smithi084 (mon.0) 320 : cluster [WRN] pg 2.13 is active+undersized+degraded, acting [4,2] 2024-04-26T21:45:59.888 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-04-26T21:45:59.888 INFO:tasks.cephadm:Compressing logs... 2024-04-26T21:45:59.889 DEBUG:teuthology.orchestra.run.smithi084:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T21:45:59.893 DEBUG:teuthology.orchestra.run.smithi120:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T21:45:59.952 INFO:teuthology.orchestra.run.smithi084.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-26T21:45:59.952 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi084.rtrqtr.log 2024-04-26T21:45:59.953 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph.log 2024-04-26T21:45:59.954 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi084.rtrqtr.log: gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-osd.2.log 2024-04-26T21:45:59.955 INFO:teuthology.orchestra.run.smithi084.stderr:gzip/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph.log: -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-26T21:45:59.956 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mgr.smithi084.gyasul.log 2024-04-26T21:45:59.957 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-osd.1.log 2024-04-26T21:45:59.959 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mgr.smithi084.gyasul.log: gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-osd.0.log 2024-04-26T21:45:59.960 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-26T21:45:59.960 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mon.smithi084.log 2024-04-26T21:45:59.962 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi084.hbjunw.log 2024-04-26T21:45:59.962 INFO:teuthology.orchestra.run.smithi084.stderr: 91.1% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-26T21:45:59.963 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mon.smithi084.log: gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-26T21:45:59.965 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi084.hbjunw.log: /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-26T21:45:59.967 INFO:teuthology.orchestra.run.smithi084.stderr: 85.2% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-26T21:45:59.969 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-04-26T21:45:59.973 INFO:teuthology.orchestra.run.smithi120.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-26T21:45:59.973 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-04-26T21:45:59.974 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph.log 2024-04-26T21:45:59.976 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.1.log: gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-26T21:45:59.977 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-volume.log: /var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-26T21:45:59.977 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-osd.5.log 2024-04-26T21:45:59.979 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-osd.3.log 2024-04-26T21:45:59.980 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-osd.5.log: 88.3% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-26T21:45:59.980 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mgr.smithi120.zjaduj.log 2024-04-26T21:45:59.981 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-osd.4.log 2024-04-26T21:45:59.982 INFO:teuthology.orchestra.run.smithi120.stderr: 91.3% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-26T21:45:59.983 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mgr.smithi120.zjaduj.log: gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi120.qnkxcn.log 2024-04-26T21:45:59.984 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-26T21:45:59.986 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi120.qnkxcn.log: gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-26T21:45:59.988 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph.cephadm.log: 85.1% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-26T21:45:59.989 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi120.ufqfoh.log 2024-04-26T21:45:59.991 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi120.ufqfoh.log: gzip -5 --verbose -- /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mon.smithi120.log 2024-04-26T21:45:59.996 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mon.smithi120.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-26T21:45:59.998 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/cephadm.log: 90.9% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-26T21:46:00.009 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-26T21:46:00.014 INFO:teuthology.orchestra.run.smithi120.stderr: 90.9% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-26T21:46:00.061 INFO:teuthology.orchestra.run.smithi084.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-26T21:46:00.066 INFO:teuthology.orchestra.run.smithi120.stderr: 89.7% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mgr.smithi120.zjaduj.log.gz 2024-04-26T21:46:00.428 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mgr.smithi084.gyasul.log.gz 2024-04-26T21:46:00.554 INFO:teuthology.orchestra.run.smithi120.stderr: 92.4% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mon.smithi120.log.gz 2024-04-26T21:46:01.420 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mon.smithi084.log.gz 2024-04-26T21:46:03.819 INFO:teuthology.orchestra.run.smithi084.stderr: 93.4% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-osd.2.log.gz 2024-04-26T21:46:04.933 INFO:teuthology.orchestra.run.smithi120.stderr: 93.6% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-osd.5.log.gz 2024-04-26T21:46:05.046 INFO:teuthology.orchestra.run.smithi084.stderr: 95.2% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi084.rtrqtr.log.gz 2024-04-26T21:46:05.158 INFO:teuthology.orchestra.run.smithi084.stderr: 93.5% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-osd.1.log.gz 2024-04-26T21:46:05.490 INFO:teuthology.orchestra.run.smithi120.stderr: 93.5% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-osd.3.log.gz 2024-04-26T21:46:05.652 INFO:teuthology.orchestra.run.smithi120.stderr: 95.2% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi120.ufqfoh.log.gz 2024-04-26T21:46:05.704 INFO:teuthology.orchestra.run.smithi120.stderr: 93.4% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-osd.4.log.gz 2024-04-26T21:46:05.824 INFO:teuthology.orchestra.run.smithi084.stderr: 93.5% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-osd.0.log.gz 2024-04-26T21:46:16.114 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-04-26T21:46:16.114 INFO:teuthology.orchestra.run.smithi120.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-04-26T21:46:16.840 INFO:teuthology.orchestra.run.smithi084.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-04-26T21:46:44.406 INFO:teuthology.orchestra.run.smithi120.stderr: 93.2% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi120.qnkxcn.log.gz 2024-04-26T21:46:44.411 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-26T21:46:44.411 INFO:teuthology.orchestra.run.smithi120.stderr:real 0m44.467s 2024-04-26T21:46:44.411 INFO:teuthology.orchestra.run.smithi120.stderr:user 1m17.749s 2024-04-26T21:46:44.411 INFO:teuthology.orchestra.run.smithi120.stderr:sys 0m5.374s 2024-04-26T21:46:49.570 INFO:teuthology.orchestra.run.smithi084.stderr: 93.4% -- replaced with /var/log/ceph/8bb44d26-0411-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi084.hbjunw.log.gz 2024-04-26T21:46:49.571 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-04-26T21:46:49.571 INFO:teuthology.orchestra.run.smithi084.stderr:real 0m49.645s 2024-04-26T21:46:49.572 INFO:teuthology.orchestra.run.smithi084.stderr:user 1m22.084s 2024-04-26T21:46:49.572 INFO:teuthology.orchestra.run.smithi084.stderr:sys 0m6.401s 2024-04-26T21:46:49.573 INFO:tasks.cephadm:Archiving logs... 2024-04-26T21:46:49.573 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675200/remote/smithi084/log 2024-04-26T21:46:49.574 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T21:47:00.966 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675200/remote/smithi120/log 2024-04-26T21:47:00.968 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T21:47:11.380 INFO:tasks.cephadm:Removing cluster... 2024-04-26T21:47:11.381 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 --force 2024-04-26T21:47:12.545 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8bb44d26-0411-11ef-bc93-c7b262605968 --force 2024-04-26T21:47:13.802 INFO:tasks.cephadm:Removing cephadm ... 2024-04-26T21:47:13.802 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-26T21:47:13.861 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-26T21:47:13.919 INFO:tasks.cephadm:Teardown complete 2024-04-26T21:47:13.919 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T21:47:13.931 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-26T21:47:13.932 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T21:47:13.932 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T21:47:13.939 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T21:47:14.079 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T21:47:14.090 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T21:47:14.090 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T21:47:14.098 DEBUG:teuthology.orchestra.run.smithi120:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T21:47:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-04-26T21:47:14.152 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2024-04-26T21:47:14.153 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T21:47:14.153 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-04-26T21:47:14.153 INFO:teuthology.orchestra.run.smithi084.stdout:^* hv01.front.sepia.ceph.com 3 6 377 5 +1211us[+1214us] +/- 49ms 2024-04-26T21:47:14.153 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 -727us[ -727us] +/- 53ms 2024-04-26T21:47:14.153 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 -1510us[-1510us] +/- 97ms 2024-04-26T21:47:14.153 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:47:14.162 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T21:47:14.162 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2024-04-26T21:47:14.162 INFO:teuthology.orchestra.run.smithi120.stdout:^* hv01.front.sepia.ceph.com 3 6 377 13 +1221us[+1214us] +/- 49ms 2024-04-26T21:47:14.162 INFO:teuthology.orchestra.run.smithi120.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 6 -647us[ -647us] +/- 53ms 2024-04-26T21:47:14.162 INFO:teuthology.orchestra.run.smithi120.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 -1505us[-1505us] +/- 97ms 2024-04-26T21:47:14.162 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:47:14.163 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T21:47:14.174 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T21:47:14.174 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T21:47:14.185 DEBUG:teuthology.orchestra.run.smithi084:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T21:47:14.398 DEBUG:teuthology.orchestra.run.smithi120:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T21:47:14.559 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T21:47:14.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:47:14.654 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T21:47:14.745 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:47:14.745 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T21:47:14.757 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T21:47:14.767 INFO:teuthology.task.internal:Duration was 2651.394986 seconds 2024-04-26T21:47:14.767 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T21:47:14.777 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T21:47:14.777 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T21:47:14.785 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T21:47:14.922 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T21:47:14.927 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T21:47:15.276 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T21:47:15.276 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2024-04-26T21:47:15.276 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T21:47:15.344 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi120.front.sepia.ceph.com 2024-04-26T21:47:15.345 DEBUG:teuthology.orchestra.run.smithi120:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T21:47:15.410 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T21:47:15.410 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T21:47:15.418 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T21:47:15.499 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T21:47:15.499 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T21:47:15.505 DEBUG:teuthology.orchestra.run.smithi120:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T21:47:16.301 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T21:47:16.314 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T21:47:16.314 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T21:47:16.390 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T21:47:16.465 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T21:47:16.476 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T21:47:16.484 DEBUG:teuthology.orchestra.run.smithi120:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T21:47:16.572 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = core 2024-04-26T21:47:16.573 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2024-04-26T21:47:16.628 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T21:47:16.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:47:16.677 DEBUG:teuthology.orchestra.run.smithi120:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T21:47:16.726 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:47:16.727 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T21:47:16.739 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T21:47:16.740 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675200/remote/smithi084 2024-04-26T21:47:16.741 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T21:47:16.853 DEBUG:teuthology.misc:Transferring archived files from smithi120:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675200/remote/smithi120 2024-04-26T21:47:16.853 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T21:47:16.948 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T21:47:16.950 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T21:47:16.958 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T21:47:17.009 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T21:47:17.024 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T21:47:17.024 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T21:47:17.035 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T21:47:17.036 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T21:47:17.043 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T21:47:17.092 INFO:teuthology.orchestra.run.smithi084.stdout: 393249 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 26 21:47 /home/ubuntu/cephtest 2024-04-26T21:47:17.092 INFO:teuthology.orchestra.run.smithi084.stdout: 786694 4 d--------- 2 ubuntu ubuntu 4096 Apr 26 21:21 /home/ubuntu/cephtest/mnt.0 2024-04-26T21:47:17.092 INFO:teuthology.orchestra.run.smithi084.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-04-26T21:47:17.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:47:17.095 INFO:teuthology.orchestra.run.smithi084.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-26T21:47:17.095 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi084 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-26T21:47:17.096 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T21:47:17.109 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T21:47:17.121 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-26T21:47:17.122 INFO:teuthology.nuke:Checking targets against current locks 2024-04-26T21:47:17.149 DEBUG:teuthology.nuke:shortname: smithi084 2024-04-26T21:47:17.149 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T21:47:17.173 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675200', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 20:54:17.469975', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGGL+E7xXSEaYHi58fTGLEpkfO4RSu+4kLRTLO7ZRcQOr6V87NiReo0Efnsg2jhubCvqjxoBxOqTqwGA9vr+2UA='} 2024-04-26T21:47:17.176 DEBUG:teuthology.nuke:shortname: smithi120 2024-04-26T21:47:17.176 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T21:47:17.200 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675200', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 20:54:17.468669', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJc8BBGWb5+55Y2vBOOlS6fUlzp+fTu/4cXIDxZgFLhXbTxWDnXf77eVBcDahl+kygf8wpE4/2qUL0kPfs3kamk='} 2024-04-26T21:47:17.228 INFO:teuthology.orchestra.console.smithi084:Power off 2024-04-26T21:47:17.228 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T21:47:17.251 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2024-04-26T21:47:17.251 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T21:47:17.266 INFO:teuthology.orchestra.console.smithi120:Power off 2024-04-26T21:47:17.266 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T21:47:17.274 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-04-26T21:47:17.288 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off 2024-04-26T21:47:17.288 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T21:47:17.310 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2024-04-26T21:47:21.276 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T21:47:21.311 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T21:47:21.386 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-04-26T21:47:21.420 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2024-04-26T21:47:25.388 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T21:47:25.421 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T21:47:25.498 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-04-26T21:47:25.530 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2024-04-26T21:47:25.599 INFO:teuthology.orchestra.console.smithi084:Power off completed 2024-04-26T21:47:25.630 INFO:teuthology.orchestra.console.smithi120:Power off completed 2024-04-26T21:47:25.735 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2651.3949863910675 failure_reason: reached maximum tries (51) after waiting for 300 seconds flavor: default host.a-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 host.b-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 owner: scheduled_rishabh@teuthology status: fail success: false 2024-04-26T21:47:25.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T21:47:25.822 INFO:teuthology.run:FAIL